Sr Data Engineer
This Senior Data Engineer role at EXL focuses on architecting scalable data pipelines and platforms using Databricks and SQL, with a strong emphasis on optimizing ETL/ELT workflows and ensuring high-performance data solutions for analytics and BI. The candidate will collaborate closely with business stakeholders to deliver end-to-end data engineering solutions while maintaining robust data quality and monitoring frameworks.
Skills required
About this role
The Senior Data Engineer will be responsible for designing, developing, and optimizing scalable data pipelines and data platforms using Databricks, SQL, and modern cloud technologies. The role involves building robust ETL/ELT solutions, supporting analytics and BI reporting, collaborating with business stakeholders, and ensuring high-performance, reliable data solutions. The candidate should have strong technical expertise, leadership capabilities, and experience delivering end-to-end data engineering solutions.
Responsibilities
Design, build, and maintain scalable data pipelines using Databricks and SQL.
- Develop ETL/ELT processes for ingesting and transforming data from multiple sources.
- Optimize SQL queries, stored procedures, and data transformations.
- Implement data quality controls, monitoring, and performance tuning.
- Create and maintain data models for reporting and analytics.
- Support BI initiatives using Power BI and Tableau.
- Work with Snowflake and cloud-based data platforms.
- Follow GitHub, CI/CD, and deployment best practices.
- Prepare technical documentation, data dictionaries, and solution designs.
- Collaborate with stakeholders, analysts, architects, and business teams.
- Mentor junior engineers and participate in code reviews.
- Lead technical discussions and contribute to architectural decisions.
Qualifications
- 6-7+ years of experience in Data Engineering.
- Strong expertise in SQL and query performance optimization.
- Hands-on experience with Databricks Data Engineering.
- Strong understanding of ETL/ELT frameworks and pipeline development.
- Knowledge of data warehousing and data modeling concepts.
- Experience with Snowflake and cloud platforms (Azure/AWS) preferred.
- Familiarity with Power BI and Tableau.
- Strong analytical, problem-solving, and communication skills.
- Insurance domain experience preferred but not mandatory.
- Immediate joiners or candidates with up to 30 days notice period preferred
