Senior Data Engineer

Job Description:

JOB DESCRIPTIONS

Data Engineering Roles | Databricks & SQL Focus

SENIOR DATA ENGINEER (5 Years Experience)

Position Overview

We are seeking a Data Engineer with 5 years of experience to develop and maintain robust data pipelines and analytics infrastructure. This role focuses on hands-on implementation using Databricks and SQL, contributing to data platform initiatives while continuously growing technical expertise in cloud-native data solutions.

Key Responsibilities

• Develop and deploy ETL/ELT pipelines using Databricks, PySpark, and SQL for data ingestion, transformation, and loading

• Write clean, efficient SQL and Python code for data processing, validation, and analytics

• Support data pipeline maintenance, monitor job executions, and troubleshoot data quality issues within SLA timelines

• Collaborate with Senior Engineers, Data Scientists, and Analytics teams to understand requirements and deliver solutions

• Implement data validation, error handling, and logging mechanisms to ensure pipeline reliability

• Document code, architecture decisions, and runbooks for operational excellence

• Participate in code reviews and contribute to knowledge sharing within the engineering team

Required Skills & Experience

• 5+ years of professional experience in data engineering, ETL development, or data analytics engineering

• Strong proficiency in Databricks (Spark SQL, PySpark) with real-world pipeline development experience

• Solid SQL skills including query optimization, joins, aggregations, and window functions

• Hands-on experience with Python for data processing and scripting

• Experience with cloud platforms such as Azure Data Factory, AWS Glue, or similar ETL services

• Understanding of data architecture, data modeling, and relational databases

• Strong problem-solving skills with attention to data quality and accuracy

Required Certifications (Nice to Have)

• Databricks Certified Data Engineer (Associate) OR

• Snowflake SnowPro Core Certified OR

• AWS Certified Data Engineer (Associate) OR equivalent professional data engineering certification

Preferred Qualifications

• Experience with orchestration tools (Apache Airflow, Tidal, Control-M, etc.)

• Familiarity with cloud data warehousing (Snowflake, Redshift, BigQuery)

• Experience with Git, CI/CD pipelines, and version control

• Knowledge of Agile methodologies and experience working in cross-functional teams

• Background in data validation frameworks and data quality testing

Location:

DGS India - Mumbai - Thane Ashar IT Park

Brand:

Merkle

Time Type:

Full time

Contract Type:

Consultant