Senior Data Engineer
The Senior Data Engineer will design and maintain scalable ETL/ELT pipelines and data lake/warehouse architectures for banking analytics and regulatory reporting. They will leverage Python, SQL, Apache Spark, and Airflow on cloud platforms to ensure high‑performance, secure data solutions.
Skills required
About this role
Job Summary
We are seeking a highly skilled and motivated Senior Data Engineer to design, develop, and optimize scalable data platforms and pipelines within the banking and financial services domain. The ideal candidate will have strong expertise in Python, SQL, big data technologies, and cloud-based data ecosystems. You will be responsible for building robust, secure, and scalable data solutions that support regulatory reporting, risk management, customer analytics, and business intelligence initiatives.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines for processing large volumes of banking and financial data.
- Build and optimize data workflows using Apache Spark and Apache Airflow.
- Design and implement Data Warehouse and Data Lake architectures to support enterprise banking analytics and reporting requirements.
- Develop and maintain high-performance data models for transactional, customer, risk, and regulatory data.
- Collaborate with business stakeholders, data analysts, risk teams, and compliance teams to deliver data-driven solutions.
- Ensure data quality, governance, security, and regulatory compliance across data platforms.
- Implement monitoring, troubleshooting, and performance tuning for data pipelines and processing frameworks.
- Leverage cloud platforms or Cloudera ecosystem technologies to build and manage modern data infrastructure.
- Drive CI/CD implementation and DataOps best practices to improve deployment efficiency and operational reliability.
- Support regulatory reporting, audit requirements, and data lineage initiatives.
- Mentor junior engineers and contribute to technical architecture and best practices.
Requirements
Required Qualifications
- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
- 4+ years of hands-on experience in Data Engineering.
- Strong programming skills in Python and advanced SQL.
- Experience with Apache Spark for large-scale data processing.
- Experience with Apache Airflow for workflow orchestration and scheduling.
- Solid understanding of Data Warehouse and Data Lake architectures.
- Proven experience building and maintaining ETL/ELT pipelines.
- Experience working with cloud platforms (AWS, Azure, or GCP) or the Cloudera ecosystem.
- Strong knowledge of data modeling techniques and performance optimization strategies.
- Experience implementing CI/CD pipelines and DataOps methodologies.
- Banking or Financial Services domain experience with exposure to financial data, regulatory reporting, risk, compliance, or customer analytics.
- Excellent problem-solving, analytical, and communication skills.
Preferred Qualifications
- Experience with banking data domains such as Core Banking, Payments, Lending, Treasury, Risk, AML, KYC, or Regulatory Reporting.
- Knowledge of financial data governance, security, and compliance standards.
- Experience with real-time and batch data processing in highly regulated environments.
- Familiarity with containerization technologies such as Docker and Kubernetes.
- Experience with data lineage, metadata management, and data quality frameworks.
Similar open roles
Senior Staff Software Engineer – Data Platform
