Data Engineer

1. Design, develop, deploy and maintain reliable ETL/ELT batch & streaming data pipelines, ingest structured/semi-structured/unstructured data from multiple source systems (DB, API, log, Kafka etc.)
2. Perform dimensional data modeling, build and iterate data warehouse / data lake, define table schema, partition strategy, data layers (ODS/DWD/DWS/ADS)51job
3. Write & optimize complex SQL, tune query performance, reduce resource cost and improve pipeline stability and SLA
4. Implement data quality rules, anomaly detection, monitoring & alerting, troubleshoot data lineage and data consistency issues
5. Use workflow orchestration tools to schedule, manage and monitor data jobs (Airflow/Dagster)
6. Collaborate with analysts, DS and business stakeholders to translate business requirements into data solutions, build reusable datasets and data APIs
7. Participate in data governance: metadata management, data security, access control, documentation for schema and pipelines51job
8. Evaluate and adopt cloud data technologies (Snowflake/BigQuery/Redshift), continuously optimize storage and compute cost

Qualifications

1. Experience on AWS/Azure/GCP cloud data stack
2. Real-time streaming data pipeline development (Kafka, Flink, Pulsar)
3. Data governance, data lineage, metadata platform construction experience
4. Experience supporting ML feature platform / feature engineering
5. English working proficiency
6. Domain knowledge: automotive, manufacturing, finance, retail etc.

Additional Information

Internal Referral bonus of this vacancy: RMB 3000(Valid only for Bosch associates).For the detailed regulation. please refer to Bosch China Internal Referral Policy