Data Engineer with GCP

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using GCP services.
  

• Build and optimise ETL/ELT workflows for batch and real-time data processing.
  

• Work with Google BigQuery for data warehousing, SQL development, and query optimisation.
  

• Develop data processing solutions using Python, PySpark, and Apache Beam.
  

• Implement data integration using Cloud Dataflow, Cloud Composer, and Pub/Sub.
  

• Build and manage data lakes and data warehouses on Google Cloud.
  

• Implement data quality checks, data validation, and monitoring.
  

• Optimise pipeline performance, scalability, and cost efficiency.
  

• Collaborate with data analysts, data scientists, architects, and business teams.
  

• Ensure data security, governance, and compliance best practices.
  

Mandatory Technical Skills

1. Strong experience in Google Cloud Platform (GCP).
   

2. Hands-on experience with BigQuery.
   

3. Strong programming skills in Python and SQL.
   

4. Experience developing ETL/ELT data pipelines.
   

5. Experience with Cloud Dataflow and/or Apache Beam.
   

6. Knowledge of Cloud Storage (GCS).
   

7. Experience with data modelling and data warehousing.
   

8. Experience with batch and real-time data processing.