D
Devoteam
Data Engineer

DATABRICKS Data Architect

HybridSeniorData Engineerposted 1w ago
✦Role summaryAI-generated

The Data Architect will design and implement scalable Lakehouse and Delta Lake solutions on Databricks across multi‑cloud environments, integrating ETL pipelines with Spark, Structured Streaming, and Lakeflow. They will also establish governance, security, and cost‑optimization frameworks using Unity Catalog, Unity Gateway, MLflow, and FinOps best practices.

Skills required

About this role

You will be responsible for designing, implementing, and optimizing Databricks-based data architectures, ensuring scalable, secure, and efficient solutions.

Your main responsibilities will include:

  • Design and implement Lakehouse and Delta Lake architectures across cloud and multi-cloud environments.

  • Develop and optimize ETL/ELT pipelines using Apache Spark, Structured Streaming, and Lakeflow Declarative Pipelines.

  • Implement data governance, security, and lineage frameworks using Unity Catalog.

  • Define AI governance mechanisms using Unity Gateway.

  • Design environments supporting Machine Learning, Generative AI, and advanced analytics using MLflow and Databricks Genie.

  • Optimize Databricks platform performance and costs, applying FinOps best practices.

  • Participate in data platform modernization and migration projects towards Lakehouse architectures.

  • Advise clients on Databricks best practices and collaborate with technical and business teams.

Qualifications

WHAT ARE WE LOOKING FOR?

  • Strong experience in data architecture and designing Databricks-based solutions.

  • Deep knowledge of Apache Spark, Delta Lake, Unity Catalog, and Photon.

  • Experience with cloud platforms such as Azure, AWS, or GCP.

  • Knowledge of cloud infrastructure, networking, storage, and IAM security.

  • Experience designing ETL/ELT pipelines and data processing solutions.

  • Knowledge of data governance, performance optimization, and Lakehouse architectures.

  • Strong communication skills, autonomy, and a customer-oriented mindset.

  • Fluent English and Spanish, both written and spoken.

  • Degree in Computer Science, Information Systems, or equivalent professional experience.

Nice to have:

  • Experience with Lakeflow, MLflow, Genie, or Unity Gateway.

  • Knowledge of Generative AI and Machine Learning.

  • Experience migrating legacy data platforms to Databricks.

  • Knowledge of FinOps and cloud cost optimization.

  • Databricks Data Engineer Professional certification or Platform Architect accreditations.

Additional Information

WHAT CAN YOU EXPECT FROM DEVOTEAM?

At Devoteam, we believe technology creates greater impact when combined with talented people. We offer:

  • Competitive salary based on your experience.

  • Annual performance bonus, linked to individual, team, and company objectives.

  • Flexible compensation package, including transport, childcare, training, health insurance, and meal benefits.

  • Employee benefits, including discounts, physiotherapy, and free English classes.

  • Career development opportunities, with access to training, certifications, and annual performance reviews.

  • 100% remote working model.

If you enjoy designing modern data architectures and leveraging Databricks to help organizations unlock the full potential of their data, we'd love to hear from you!

Apply on Devoteam →Opens in new tab
score your resume against this role

Similar open roles

FC
NEW

Data Engineer II - Data Platform (Remote-Raleigh NC, Dallas TX, Phoenix AZ)

First Citizens Bank·Raleigh, North Carolina; Arizona, United States; Austin, Texas; North Carolina, United States
On-siteMidData Engineer
$111k – $135k USD
today
X
NEW

Data Engineer - Performance Insights

Xero·AU: Sydney (45 Clarence St), AU: Melbourne: (260 Burwood Rd)
On-siteSeniorData Engineer
today
M
NEW

Data Engineer II

Mastercard·Pune, India
On-siteMidData Engineer
today
L
NEW

Lead Data Engineer

Lseg·IND-Bangalore-TowerE,RMZ Infin
On-siteSeniorData Engineer
today
L
NEW

Data Engineer

Littelfuse·Virtual - India
On-siteMidData Engineer
today
GH
NEW

Senior Data Engineer

GE HealthCare·IND19-01-Bengaluru-EPIP 122 (Phase II)
On-siteSeniorData Engineer
today
Apply on Devoteam →