Senior Data Platform Engineer
This role focuses on architecting and maintaining a scalable Databricks/Azure-based data platform with Terraform and CI/CD pipelines, ensuring self-service reliability for cross-functional teams. The engineer will bridge infrastructure and data engineering to automate deployments and tooling while supporting Python/.NET-based platform utilities.
Skills required
About this role
Job Title: Data Platform Engineer (Infrastructure & Data Engineering)
Purpose
Support the design, build, and operation of the Data Platform, blending infrastructure engineering with data engineering practices to keep the Databricks/Azure environment reliable, automated, and self-service for platform users.
Key Responsibilities
- Design and maintain CI/CD pipelines (DevOps/GitHub Actions) for infrastructure and application deployments
- Write and maintain Terraform IaC for Azure services and Azure Databricks (Unity Catalog, workspaces, networking, compute policies)
- Develop and support application code in Python and/or .NET for platform tooling and automation
- Build and maintain shared libraries/modules used by data engineers and analysts across the platform
- Design and implement pipelines/processes that support platform management (cost tracking, governance, provisioning, monitoring)
- Collaborate with data engineers, analysts, and security/infra teams to translate requirements into platform capabilities
- Troubleshoot infrastructure, pipeline, and integration issues (networking, auth, connectivity)
- Contribute to platform documentation and best-practice standards
Required Skills & Experience
- Solid experience with Microsoft Azure infrastructure (Entra ID, Key Vault, networking, storage)
- Hands-on Azure Databricks experience (Unity Catalog, cluster/job management)
- Terraform (IaC) experience, ideally in a multi-environment setup
- Proficiency in Python; working knowledge of SQL; .NET is a plus
- Experience building/maintaining CI/CD pipelines (Azure DevOps, GitHub Actions, or similar)
- Understanding of data platform governance and cost management concepts
- Comfortable working across the infra/data engineering boundary
Nice to Have
- Experience with medallion architecture (Bronze/Silver/Gold)
- Exposure to FinOps/cost attribution practices
Role 2 -
Job Title: Senior Data Engineer – Databricks experienced
Purpose
We are seeking a highly skilled Senior Data Engineer with deep expertise in Databricks, Azure, and modern data engineering practices to design, build, and optimize scalable data platforms and pipelines. The ideal candidate will have strong hands-on experience with Databricks, Delta Lake, Spark, and Azure cloud services, enabling data-driven decision-making across the organization. (Databricks experience senior data engineer) – Expecting more details around this role by Monday afternoon.
Responsibilities
Job Title: Data Platform Engineer (Infrastructure & Data Engineering)
Purpose
Support the design, build, and operation of the Data Platform, blending infrastructure engineering with data engineering practices to keep the Databricks/Azure environment reliable, automated, and self-service for platform users.
Key Responsibilities
- Design and maintain CI/CD pipelines (DevOps/GitHub Actions) for infrastructure and application deployments
- Write and maintain Terraform IaC for Azure services and Azure Databricks (Unity Catalog, workspaces, networking, compute policies)
- Develop and support application code in Python and/or .NET for platform tooling and automation
- Build and maintain shared libraries/modules used by data engineers and analysts across the platform
- Design and implement pipelines/processes that support platform management (cost tracking, governance, provisioning, monitoring)
- Collaborate with data engineers, analysts, and security/infra teams to translate requirements into platform capabilities
- Troubleshoot infrastructure, pipeline, and integration issues (networking, auth, connectivity)
- Contribute to platform documentation and best-practice standards
Required Skills & Experience
- Solid experience with Microsoft Azure infrastructure (Entra ID, Key Vault, networking, storage)
- Hands-on Azure Databricks experience (Unity Catalog, cluster/job management)
- Terraform (IaC) experience, ideally in a multi-environment setup
- Proficiency in Python; working knowledge of SQL; .NET is a plus
- Experience building/maintaining CI/CD pipelines (Azure DevOps, GitHub Actions, or similar)
- Understanding of data platform governance and cost management concepts
- Comfortable working across the infra/data engineering boundary
Nice to Have
- Experience with medallion architecture (Bronze/Silver/Gold)
- Exposure to FinOps/cost attribution practices
Role 2 -
Job Title: Senior Data Engineer – Databricks experienced
Purpose
We are seeking a highly skilled Senior Data Engineer with deep expertise in Databricks, Azure, and modern data engineering practices to design, build, and optimize scalable data platforms and pipelines. The ideal candidate will have strong hands-on experience with Databricks, Delta Lake, Spark, and Azure cloud services, enabling data-driven decision-making across the organization. (Databricks experience senior data engineer) – Expecting more details around this role by Monday afternoon.
Qualifications
Job Title: Data Platform Engineer (Infrastructure & Data Engineering)
Purpose
Support the design, build, and operation of the Data Platform, blending infrastructure engineering with data engineering practices to keep the Databricks/Azure environment reliable, automated, and self-service for platform users.
Key Responsibilities
- Design and maintain CI/CD pipelines (DevOps/GitHub Actions) for infrastructure and application deployments
- Write and maintain Terraform IaC for Azure services and Azure Databricks (Unity Catalog, workspaces, networking, compute policies)
- Develop and support application code in Python and/or .NET for platform tooling and automation
- Build and maintain shared libraries/modules used by data engineers and analysts across the platform
- Design and implement pipelines/processes that support platform management (cost tracking, governance, provisioning, monitoring)
- Collaborate with data engineers, analysts, and security/infra teams to translate requirements into platform capabilities
- Troubleshoot infrastructure, pipeline, and integration issues (networking, auth, connectivity)
- Contribute to platform documentation and best-practice standards
Required Skills & Experience
- Solid experience with Microsoft Azure infrastructure (Entra ID, Key Vault, networking, storage)
- Hands-on Azure Databricks experience (Unity Catalog, cluster/job management)
- Terraform (IaC) experience, ideally in a multi-environment setup
- Proficiency in Python; working knowledge of SQL; .NET is a plus
- Experience building/maintaining CI/CD pipelines (Azure DevOps, GitHub Actions, or similar)
- Understanding of data platform governance and cost management concepts
- Comfortable working across the infra/data engineering boundary
Nice to Have
- Experience with medallion architecture (Bronze/Silver/Gold)
- Exposure to FinOps/cost attribution practices
Role 2 -
Job Title: Senior Data Engineer – Databricks experienced
Purpose
We are seeking a highly skilled Senior Data Engineer with deep expertise in Databricks, Azure, and modern data engineering practices to design, build, and optimize scalable data platforms and pipelines. The ideal candidate will have strong hands-on experience with Databricks, Delta Lake, Spark, and Azure cloud services, enabling data-driven decision-making across the organization. (Databricks experience senior data engineer) – Expecting more details around this role by Monday afternoon.
