Data Engineer II

Job Purpose

Design and deliver robust, scalable data pipelines and infrastructure components that ensure reliable, high-quality data availability for analytics, data science, and AI workloads. The role operates with growing technical ownership, taking end-to-end responsibility for assigned platform domains and contributing meaningfully to architectural decisions and engineering standards.

Key Result Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines that ingest, transform, and serve data from structured and unstructured sources across cloud environments
• Own assigned pipeline domains end-to-end — from requirements and design through to deployment, monitoring, and iterative improvement
• Implement and evolve data models that support analytics, BI, and machine learning consumption requirements
• Build and maintain orchestration workflows using tools such as Apache Airflow, dbt, or Azure Data Factory
• Optimize pipeline and query performance across cloud data platforms including Snowflake and Azure Synapse
• Define and implement data quality rules, automated testing, and alerting to ensure reliability and consistency of data outputs

Key Result Responsibilities-Continued

• Contribute to architectural discussions and platform decisions, providing well-reasoned technical input and trade-off analysis
• Collaborate with Data Scientists, Analytics Engineers, and business stakeholders to translate data requirements into maintainable engineering solutions
• Conduct code reviews and support the development of Associate and DE I engineers through practical guidance
• Maintain clear documentation for all assigned pipelines, data models, and infrastructure components

Qualifications (Academic, training, languages)

• Bachelor's degree in Computer Science, Computer Engineering, Information Technology, or a related field.
• Fluent in English Language.
• ITIL Certification is an advantage but not mandatory.
• Strong proficiency in SQL and Python for data transformation, automation, and pipeline development.
• Working knowledge of data orchestration and transformation tools (e.g., Apache Airflow, dbt).
• Understanding of data modelling techniques — dimensional modelling, star/snowflake schema, and medallion/lakehouse architecture patterns.
• Familiarity with batch and streaming data processing concepts (e.g., Spark, Kafka, Azure Event Hubs).
• Good grasp of software engineering fundamentals: version control (Git), CI/CD practices, and automated testing.
• Ability to communicate technical designs clearly and provide constructive feedback to junior team members.

Work Experience

• With 4–6 years of hands-on experience in data engineering or a closely related software engineering role
• Demonstrable experience delivering production-grade data pipelines in a cloud environment.
• Solid hands-on experience with cloud data platforms on Azure, AWS, or GCP (e.g., Azure Data Factory, Synapse Analytics, S3, Redshift, BigQuery).
• Experience with data warehousing platforms such as Snowflake or Azure Synapse, including query optimisation and access control.