WG
WNS Global Services
Data Engineer

Assistant Manager - Sr. Data Engineering | Databricks | ADF | Snowflake

On-siteSeniorData Engineerposted 1w ago
✦Role summaryAI-generated

The role involves designing and implementing Azure Data Factory pipelines and Databricks transformations to ingest and process finance data, then delivering curated Gold tables to Snowflake for reporting. The engineer will also ensure data quality through reconciliation, logging, and unit testing while adhering to coding standards.

Skills required

About this role

Senior Data Engineer

We are looking for a Senior Data Engineer with 4 to 5 years of experience to build data pipelines for an enterprise finance data platform on Azure, Databricks and Snowflake. You will develop ingestion and transformation jobs, build Gold data products and publish them to Snowflake for reporting.

KEY RESPONSIBILITIES

Build ingestion pipelines from finance source systems using Azure Data Factory, change data capture, and API and event-driven feeds

Develop transformations in Databricks across the Bronze, Silver and Gold layers using PySpark and Spark SQL

Build conformed dimensions and fact tables to the agreed data model

Load certified Gold data into Snowflake and build the views used by reporting teams

Add data quality, reconciliation and logging checks to pipelines

Write unit tests and support system and user acceptance testing

Follow coding standards and take part in code reviews

Deploy code through Azure DevOps pipelines

Investigate and fix pipeline failures and data issues

Document pipelines, mappings and run procedures

TECHNICAL SKILLS

Must-have

Databricks, including PySpark, Spark SQL and Delta Lake

Azure Data Factory

Snowflake SQL and data loading

Python and advanced SQL

Dimensional modelling

Git and Azure DevOps

Good-to-have

Informatica CDC

Azure Functions and Service Bus

Unity Catalog

Delta Live Tables

Power BI

DOMAIN KNOWLEDGE

Finance data such as general ledger, trial balance, sub-ledgers and bank statements

Finance source systems such as SAP, TM1 and lending platforms

CERTIFICATIONS (GOOD TO HAVE)

Databricks Certified Data Engineer Associate

SnowPro Core

EXPERIENCE AND QUALIFICATIONS

4 to 5 years in data engineering, with at least 2 years on Databricks or Snowflake

Worked on at least one cloud data platform project that went into production

Degree in engineering or computer applications (B.E., B.Tech or MCA)

Qualifications

Degree in engineering or computer applications (B.E., B.Tech or MCA)

score your resume against this role

Similar open roles

FG
NEW

Data Engineer

Ford Global·Chennai, Tamil Nadu, India
On-siteSeniorData Engineer
yesterday
D
NEW

Data Platform Engineer

Domino's·Ann Arbor, MI, United States
On-siteSeniorData Engineer
yesterday
A
NEW

Staff Data Platform Engineer, Knowledge Platform

Airwallex·US - Seattle
HybridStaffData Engineer
$200k – $260k USD
yesterday
A
NEW

Data Platform Principal Architect, Seattle/San Francisco

Airwallex·US - Seattle, US - San Francisco
On-siteStaffData Engineer
$220k – $300k USD
yesterday
BG
NEW

Blackstone Multi-Asset Investing - Lead Data Engineer-Product Management

On-siteSeniorData Engineer
$174k – $180k USD
yesterday
R
NEW

Senior Data Engineer - (GCP & Lakehouse Architecture) - On Site - Octopus by RTG

robusta·Riyadh, Riyadh Province, Saudi Arabia
On-siteSeniorData Engineer
GCPApache icebergPython
2d ago