SS
Sigma Software
Data Engineer

Senior Data Engineer

HybridSeniorData Engineerposted 5d ago
✦Role summaryAI-generated

The Senior Data Engineer will design, build, and maintain large‑scale ingestion and transformation pipelines on BigQuery, ensuring data freshness and correct schema contracts. They will also create experimentation infrastructure, implement data quality frameworks, and collaborate with customer engineers to deliver reliable, privacy‑preserving data services.

Skills required

About this role

  • Write and defend diagnostic SQL queries against large-scale production datasets
  • Build and maintain ingestion pipelines for bid, win, and impression logs into BigQuery
  • Harmonize fields across independently designed datasets and maintain versioned field mappings
  • Develop point-in-time-correct feature tables and aggregation pipelines
  • Design and maintain conversion and labeling pipelines with delayed label handling
  • Own the data serving write path, schema contracts, publishing flows, and freshness SLOs
  • Build experimentation infrastructure including traffic splitting and reporting pipelines
  • Perform large-scale historical backfills and safe reprocessing after mapping changes
  • Implement data isolation and safe-aggregation controls for advertiser data protection
  • Develop automated data quality validation frameworks
  • Collaborate closely with Customer engineers and prepare operational documentation
  • Contribute to architecture discussions and platform scalability improvements

Qualifications

  • 5+ years of experience in Data Engineering
  • At least 2 years of experience working with production ML or large-scale analytics pipelines
  • Expert-level SQL skills including window functions and incremental processing patterns
  • Strong Python skills for production-grade pipeline development
  • Hands-on experience with Spark or PySpark
  • Experience designing ETL / ELT pipelines with Airflow, Cloud Composer, Dagster, or similar tools
  • Experience working with cloud data warehouses at scale, preferably BigQuery
  • Strong understanding of data modeling and point-in-time correctness
  • Experience working with event-driven or clickstream datasets at very large scale
  • Experience supporting business-critical production pipelines
  • Upper-Intermediate English level or higher

WILL BE A PLUS

  • Experience with GCP services including Dataflow, Pub/Sub, GCS, and Beam
  • Experience building streaming or near-real-time ingestion systems
  • Understanding of feature stores, train/serve skew, and label leakage prevention
  • Experience in AdTech or auction-based environments
  • Experience handling delayed or incomplete labels in ML systems
  • Experience with dbt or similar transformation frameworks
  • Experience delivering solutions into Customer-owned infrastructure
  • Knowledge of GDPR/CCPA-related privacy engineering practices
  • Experience with experimentation infrastructure and statistical validation pipelines
  • Experience working in hybrid cloud/on-prem Linux environments
  • Terraform and Kubernetes experience
  • Experience optimizing warehouse cost and performance

Additional Information

PERSONAL PROFILE

  • Strong analytical and problem-solving skills
  • Ownership-oriented mindset
  • Ability to work independently in a client-facing environment
  • Strong communication and documentation skills
  • Comfortable working in a fast-paced engineering environment
  • Collaborative and proactive attitude
score your resume against this role

Similar open roles

FG
NEW

Data Engineer

Ford Global·Chennai, Tamil Nadu, India
On-siteSeniorData Engineer
yesterday
D
NEW

Data Platform Engineer

Domino's·Ann Arbor, MI, United States
On-siteSeniorData Engineer
yesterday
A
NEW

Staff Data Platform Engineer, Knowledge Platform

Airwallex·US - Seattle
HybridStaffData Engineer
$200k – $260k USD
yesterday
A
NEW

Data Platform Principal Architect, Seattle/San Francisco

Airwallex·US - Seattle, US - San Francisco
On-siteStaffData Engineer
$220k – $300k USD
yesterday
BG
NEW

Blackstone Multi-Asset Investing - Lead Data Engineer-Product Management

On-siteSeniorData Engineer
$174k – $180k USD
yesterday
R
NEW

Senior Data Engineer - (GCP & Lakehouse Architecture) - On Site - Octopus by RTG

robusta·Riyadh, Riyadh Province, Saudi Arabia
On-siteSeniorData Engineer
GCPApache icebergPython
2d ago
Apply on Sigma Software →