SS
Sigma Software
Data Engineer
Senior Data Engineer (Healthcare domain)
On-siteSeniorData Engineerposted 1mo ago
Role summaryAI-generated
This role focuses on designing scalable cloud-based data infrastructure and optimizing large-scale pipelines for healthcare data, requiring expertise in Terraform, PySpark, and cloud platforms like Azure and Snowflake. The candidate will collaborate closely with product teams to ensure seamless data integration and self-service tooling while maintaining robust data governance standards.
Skills required
About this role
- Collaborate with the Product Owner and team leads to define and design efficient pipelines and data schemas
- Build and maintain infrastructure using Terraform for cloud platforms
- Design and implement large-scale cloud data infrastructure, self-service tooling, and microservices
- Work with large datasets to optimize performance and ensure seamless data integration
- Develop and maintain squad-specific data architectures and pipelines following ETL and Data Lake principles
- Discover, analyze, and organize disparate data sources into clean, understandable schemas
Qualifications
- Hands-on experience with cloud computing services in data and analytics
- Experience with data modeling, reporting tools, data governance, and data warehousing
- Proficiency in Python and PySpark for distributed data processing
- Experience with Azure, Snowflake, and Databricks
- Experience with Docker and Kubernetes
- Knowledge of infrastructure as code (Terraform)
- Advanced SQL skills and familiarity with big data databases such as Snowflake, Redshift, etc.
- Experience with stream processing technologies such as Kafka, Spark Structured Streaming
- At least an Upper-Intermediate level of English
