B
Blend360
Data Engineer

Data Engineer Analyst

HybridMidData Engineerposted 2w ago
✦Role summaryAI-generated

The role involves designing and maintaining scalable data pipelines on AWS, using Spark, PySpark, and CDC techniques. It also includes building data lake solutions with S3 and Apache Iceberg, and orchestrating ETL with Glue, Athena, and Lambda.

Skills required

About this role

What is this position about?

  • Design, build, and maintain scalable data pipelines and ingestion frameworks supporting batch processing, streaming, and change data capture (CDC) patterns.
  • Develop and optimize data processing workflows using Apache Spark and PySpark, ensuring reliable and performant transformation across large datasets.
  • Implement and manage data lake architectures on AWS, leveraging S3 as the primary storage layer and Apache Iceberg for table format management, schema evolution, and time-travel capabilities.
  • Work with AWS-native services including Glue for ETL orchestration, Athena for serverless querying, and Lambda for event-driven data processing.
  • Manage data access controls and security configurations using AWS IAM, ensuring compliant and least-privilege access across the data platform.
  • Collaborate with data analysts, data scientists, and platform engineers to understand data requirements and deliver production-ready solutions.
  • Monitor pipeline health, troubleshoot data quality issues, and implement improvements to ensure data reliability and freshness.
  • Contribute to the documentation of data flows, architecture decisions, and engineering standards within the team.

Qualifications

  • Advanced hands-on experience with AWS services, including:
    • AWS Glue
    • Amazon S3
    • Amazon Athena
    • AWS IAM
  • Apache Spark / PySpark for data processing.
  • Data lake architectures, ideally with knowledge of Apache Iceberg.
  • Data ingestion patterns, including batch processing, streaming, and CDC patterns
  • Experience with SQL for data querying, validation, and exploratory analysis
  • Solid understanding of data modeling and large-scale data processing
  • Ability to work collaboratively in cross-functional teams and communicate technical concepts clearly to non-technical stakeholders.
  • Experience with infrastructure-as-code or pipeline orchestration tools (e.g., Airflow, Step Functions, dbt) is a plus.
  • Familiarity with AI-assisted development workflows and engineering productivity tools

What about languages?

English: Advanced (required for effective communication with global teams)

How much experience must I have?

2+ years of experience in Data Engineering or related roles, with hands-on work building and maintaining cloud-based data pipelines and lake architectures on AWS.

Additional Information

Our Perks and Benefits:

🍽️ Every day lunches! (headquarters):

  • Vegetarian, vegan, gluten and sugar free options.
  • Gourmet meals every Friday with our on-site chef!

⚖️ Flexible working options to help you strike the right balance.

💻 All the equipment you need to harness your talent (Macbook and accessories).

🍎 Snacks and beverages available everyday (headquarters).

🎉 After office events, football, tennis and game nights (headquarters).

⚽ Everyone is welcome to join our football league every Wednesday’s and Friday’s.

🎱 Challenge your teammates to a pool game and win the office’s trophy!

🎾 Tennis courts available for friendly matches.

🎮 Not a sports person? Don’t worry, we also have chess championships, game and music nights for you to join!

📚 Learning opportunities:

  • AWS Certifications (we are AWS Partners).
  • Study plans, courses and other certifications.
  • English Lessons.
  • Learn from your teammates on our Tech Tuesdays!

🧭 Mentoring and Development opportunities to shape your career path.

🎁 Anniversary and birthday gifts.

📍 Great location and even greater teammates!

So what are the next steps?
Our team is eager to learn about you! Send us your resume or LinkedIn profile below and we’ll explore working together!

Apply on Blend360 →Opens in new tab
score your resume against this role

Similar open roles

FC
NEW

Data Engineer II - Data Platform (Remote-Raleigh NC, Dallas TX, Phoenix AZ)

First Citizens Bank·Raleigh, North Carolina; Arizona, United States; Austin, Texas; North Carolina, United States
On-siteMidData Engineer
$111k – $135k USD
today
X
NEW

Data Engineer - Performance Insights

Xero·AU: Sydney (45 Clarence St), AU: Melbourne: (260 Burwood Rd)
On-siteSeniorData Engineer
today
M
NEW

Data Engineer II

Mastercard·Pune, India
On-siteMidData Engineer
today
L
NEW

Lead Data Engineer

Lseg·IND-Bangalore-TowerE,RMZ Infin
On-siteSeniorData Engineer
today
L
NEW

Data Engineer

Littelfuse·Virtual - India
On-siteMidData Engineer
today
GH
NEW

Senior Data Engineer

GE HealthCare·IND19-01-Bengaluru-EPIP 122 (Phase II)
On-siteSeniorData Engineer
today
Apply on Blend360 →