Data Engineer - Manager
This role focuses on designing and building scalable batch ETL pipelines using Python and Apache Spark on Databricks within AWS, while ensuring data quality and performance. The Data Engineer will collaborate with analysts and technology teams to develop SQL-based transformations and robust data models that support analytics and reporting platforms.
Skills required
About this role
Role: Data Engineer
Role Summary
State Street Investment Management is seeking a Data Engineer with strong expertise in Python, Apache Spark, Databricks, and AWS to support cloud‑based data engineering initiatives. The role focuses on building and maintaining scalable batch ETL pipelines and well‑structured data models to support analytics and reporting platforms.
Key Responsibilities
- Design and develop batch ETL pipelines using Python and Apache Spark
- Build and optimize data solutions on Databricks (AWS)
- Develop and maintain SQL‑based transformations and data validation logic
- Implement efficient data models to support downstream analytics
- Ensure data quality, performance, and reliability in cloud data platforms
- Collaborate with analysts and technology teams to deliver data solutions
Required Experience
- 7-9 years of experience in data engineering
- Strong experience with cloud data engineering and big data technologies
- Solid understanding of data warehousing and data modeling concepts
- Experience working in large enterprise environments (financial services preferred)
Must‑Have Skills
- Python
- Apache Spark
- Databricks on AWS
- SQL
- Data Warehousing
Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success.
We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.
As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.
Discover more information on jobs at StateStreet.com/careers
Read our CEO Statement
