Senior Data Engineer
The Senior Data Engineer will design and maintain large‑scale ingestion and processing pipelines on Spark and Kafka while migrating workloads to Databricks and AWS services. They will build cloud‑native solutions that integrate with S3 and other AWS components to support analytics, regulatory reporting, and risk management.
Skills required
About this role
The Senior Application Developer will be a key contributor to the Nucleus Cloud Migration Program, supporting Citi's strategic initiative to modernize data platforms and enable industry-leading analytics, regulatory reporting, risk management, surveillance, and finance reporting capabilities. The candidate will design, develop, and deploy scalable cloud-based data solutions that facilitate migration from legacy platforms to Databricks and AWS-based technologies.
Key Responsibilities
- Design, develop, and maintain large-scale data ingestion and processing pipelines using Spark and Kafka.
- Build and optimize cloud-native applications and data solutions on AWS.
- Support the migration of enterprise data workloads to Databricks and modern cloud platforms.
- Develop scalable solutions for data onboarding, transformation, and distribution.
- Integrate data platforms with AWS S3 and other cloud services to support business and regulatory reporting requirements.
- Collaborate with architecture, engineering, and business teams to implement high-performance and resilient data solutions.
- Ensure solutions meet security, governance, and operational requirements.
- Support delivery milestones for the Nucleus modernization roadmap, including MVP and subsequent migration phases.
- Participate in code reviews, testing, deployment, and production support activities.
- Contribute to performance tuning, automation, and operational efficiency initiatives.
Required Skills & Experience
Technical Skills
- Strong Python development experience.
- Advanced knowledge of Apache Spark and distributed data processing.
- Experience building event-driven solutions using Kafka.
- Hands-on experience with AWS cloud services, including S3.
- Experience with Databricks and/or Snowflake.
- Experience designing and implementing Big Data solutions.
- Strong understanding of data engineering principles and modern data architectures.
- Experience with source control, CI/CD, and Agile development methodologies.
Desired Skills
Python • Spark • Kafka • AWS • S3 • Databricks • Snowflake • Big Data • Data Engineering • Cloud Migration • Data Pipelines • Distributed Computing • ETL/ELT • Analytics Platforms • Agile Development
Education:
- Bachelor’s degree/University degree or equivalent experience
This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.
------------------------------------------------------
Job Family Group:
Technology------------------------------------------------------
Job Family:
Applications Development------------------------------------------------------
Time Type:
Full time------------------------------------------------------
Most Relevant Skills
Please see the requirements listed above.------------------------------------------------------
Other Relevant Skills
For complementary skills, please see above and/or contact the recruiter.------------------------------------------------------
Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.
If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.
View Citi’s EEO Policy Statement and the Know Your Rights poster.