S
Sago
Data Engineer

Data Engineer

RemoteMidData Engineerposted 4d ago
✦Role summaryAI-generated

The candidate will design, develop, and maintain scalable ETL/ELT pipelines using SQL, Python, and PySpark while integrating data from databases, APIs, SharePoint, and cloud storage. They will also implement data-quality checks, monitoring, logging, and alerts to deliver analytics‑ready datasets for Power BI and Superset.

Skills required

About this role

We are looking for a Data Engineer with 2–5 years of experience to design, build, and maintain reliable data pipelines and analytics-ready datasets. The ideal candidate will have strong SQL and Python or PySpark skills, hands-on experience with cloud data platforms, and the ability to troubleshoot data-quality, performance, and production issues independently.

Key Responsibilities

· Design, develop, and maintain scalable ETL and ELT pipelines for batch and scheduled data processing.

· Build and optimize data transformations using SQL, Python, and PySpark.

· Ingest and integrate data from databases, APIs, files, SharePoint, and cloud storage.

· Create and maintain curated, analytics-ready datasets for Power BI, Superset, and other reporting platforms.

· Implement data-quality checks, reconciliation controls, monitoring, logging, and failure alerts.

· Troubleshoot pipeline failures, schema mismatches, performance bottlenecks, and data discrepancies.

· Optimize large-scale data processing for runtime, memory, storage, and cost efficiency.

· Automate recurring workflows and schedule production jobs using orchestration tools such as Apache Airflow.

· Maintain technical documentation, data mappings, business rules, and operational runbooks.

· Collaborate with BI analysts, application teams, and business stakeholders to deliver dependable data solutions.

Requirements

Required Skills and Experience

· 2–5 years of professional experience in data engineering, ETL development, or a similar role.

· Strong SQL skills, including joins, common table expressions, window functions, data validation, and query optimization.

· Hands-on experience with Python and/or PySpark for data processing and automation.

· Practical experience building and supporting ETL or ELT pipelines in production.

· Experience working with large datasets, incremental loads, upserts, schema changes, and partitioned data.

· Good understanding of relational databases, dimensional modeling, data warehousing, and file formats such as Parquet, CSV, and JSON.

· Experience with Git or another version-control system and structured deployment practices.

· Strong debugging, analytical, documentation, and stakeholder-communication skills.

Preferred Skills

· Experience with AWS services such as Amazon S3, Athena, EMR, and EMR Serverless.

· Experience with Apache Spark, Delta Lake, Apache Airflow, Dremio, or Trino-compatible SQL engines.

· Familiarity with Power BI, Apache Superset, or other downstream reporting tools.

· Experience with REST APIs, SharePoint integrations, and automated file-delivery workflows.

· Understanding of data security, access controls, privacy, and production monitoring practices.

Benefits

* 5 Days working
* Remote Job
* Medical Insurance

Apply on Sago →Opens in new tab
score your resume against this role

Similar open roles

FG
NEW

Data Engineer

Ford Global·Chennai, Tamil Nadu, India
On-siteSeniorData Engineer
today
D
NEW

Data Platform Engineer

Domino's·Ann Arbor, MI, United States
On-siteSeniorData Engineer
today
A
NEW

Staff Data Platform Engineer, Knowledge Platform

Airwallex·US - Seattle
HybridStaffData Engineer
$200k – $260k USD
today
A
NEW

Data Platform Principal Architect, Seattle/San Francisco

Airwallex·US - Seattle, US - San Francisco
On-siteStaffData Engineer
$220k – $300k USD
today
R
NEW

Senior Data Engineer - (GCP & Lakehouse Architecture) - On Site - Octopus by RTG

robusta·Riyadh, Riyadh Province, Saudi Arabia
On-siteSeniorData Engineer
GCPApache icebergPython
yesterday
Apply on Sago →