Lead Data Engineer - GCP

We are looking for a Senior GCP Data Engineer with 6+ years of experience in designing, developing, and maintaining scalable data engineering solutions on Google Cloud Platform (GCP). The ideal candidate should have strong hands-on expertise in Python, SQL, data pipelines, and GCP data services.

Key Responsibilities

• Design and develop scalable and reliable data pipelines using GCP services.
• Develop data processing and transformation solutions using Python and SQL.
• Build and optimize ETL/ELT pipelines for large-volume datasets.
• Work with business and technical teams to understand data requirements and deliver robust solutions.
• Perform data modeling, data validation, and performance optimization.
• Monitor and troubleshoot data pipelines and resolve production issues.
• Implement data quality, security, and governance best practices.
• Participate in code reviews and contribute to technical design and architecture discussions.

Qualifications

• 6+ years of experience in Data Engineering.
• Strong hands-on experience with Google Cloud Platform (GCP).
• Strong programming experience in Python.
• Strong expertise in SQL, including complex queries, joins, CTEs, window functions, and query optimization.
• Experience developing ETL/ELT data pipelines.
• Hands-on experience with one or more GCP services such as:
  • BigQuery
  • Cloud Storage (GCS)
  • Cloud Composer / Airflow
  • Dataflow
  • Pub/Sub
  • Dataproc
• Experience with Apache Spark / PySpark is preferred.
• Good understanding of data warehousing, data modeling, and distributed data processing.
• Experience with Git and CI/CD practices.

Nice to Have

• Experience with Terraform or Infrastructure as Code.
• Exposure to GCP Dataform.
• Experience with real-time/streaming data pipelines.
• Knowledge of cloud security and IAM.
• Experience working in Agile environments.

Additional Information

All your information will be kept confidential according to EEO guidelines.