Data Engineer - GCH
This role focuses on building scalable data pipelines using Databricks and cloud platforms (AWS/Azure) to transform and model complex datasets, with a strong emphasis on automation and performance optimization. The candidate will collaborate on end-to-end solutions, ensuring data reliability while leveraging streaming technologies for real-time processing.
Skills required
About this role
1. Data Engineer:
Core Skills and Knowledge:
- 5-8 years of experience in data engineering.
- Hands-on experience with Databricks (Delta Lake, notebooks, Databricks Workflows).
- Strong programming skills in Python and SQL.
- Working knowledge of Apache Spark (PySpark preferred) for data transformation.
- Experience with either AWS (S3, Glue, EMR) or Azure (ADLS Gen2, Data Factory, Synapse) services.
- Understanding of data modeling concepts (star schema, dimensional modeling).
- Familiarity with version control (Git) and basic CI/CD practices.
Desirable Skills:
- Databricks Certified Data Engineer Associate (or working toward it).
- Exposure to streaming data pipelines (Structured Streaming, Kafka, Kinesis, or Event Hubs).
- Familiarity with orchestration tools (Airflow, Databricks Workflows).
- Basic understanding of data governance and security practices (PII masking, access control).
- Exposure to Power BI or other BI tools for understanding downstream
Similar open roles
Senior Data Platform Automation Engineer - USA Remote
