Senior Data Engineer (Healthcare domain)

On-siteSeniorData Engineerposted 1mo ago

✦Role summaryAI-generated

This role focuses on designing scalable cloud-based data infrastructure and optimizing large-scale pipelines for healthcare data, requiring expertise in Terraform, PySpark, and cloud platforms like Azure and Snowflake. The candidate will lead infrastructure projects while ensuring seamless data integration and self-service tooling for cross-functional teams.

About this role

Collaborate with the Product Owner and team leads to define and design efficient pipelines and data schemas
Build and maintain infrastructure using Terraform for cloud platforms
Design and implement large-scale cloud data infrastructure, self-service tooling, and microservices
Work with large datasets to optimize performance and ensure seamless data integration
Develop and maintain squad-specific data architectures and pipelines following ETL and Data Lake principles
Discover, analyze, and organize disparate data sources into clean, understandable schemas

Qualifications

Hands-on experience with cloud computing services in data and analytics
Experience with data modeling, reporting tools, data governance, and data warehousing
Proficiency in Python and PySpark for distributed data processing
Experience with Azure, Snowflake, and Databricks
Experience with Docker and Kubernetes
Knowledge of infrastructure as code (Terraform)
Advanced SQL skills and familiarity with big data databases such as Snowflake, Redshift, etc.
Experience with stream processing technologies such as Kafka, Spark Structured Streaming
At least an Upper-Intermediate level of English