Senior Data Engineer
This role focuses on designing scalable data pipelines and enhancing SOCOTEC’s Lakehouse with governance and AI-driven insights, leveraging Databricks and generative AI tools. The candidate will optimize data workflows while ensuring quality and security in a distributed architecture.
Skills required
About this role
- Develop end-to-end data pipelines (ingestion, transformation, modeling, exposure) and contribute to the implementation of visualizations in Power BI or Databricks SQL.
- Continuously improve the SOCOTEC Lakehouse, particularly in the areas of governance, quality, and data pseudonymization.
- Experiment with generative AI solutions applied to data, such as Databricks GenIE, to transform text queries into actionable insights.
Qualifications
- Bachelor's degree in Big Data, Computer Science, or Software Engineering with a strong specialization or appetite for data and distributed architectures. At least 3 years of experience in Data Engineering
- Strong mastery of SQL and NoSQL databases (modeling, optimized queries, integrity, and performance).
- Good understanding of Big Data architecture and distributed processing tools (Spark, Hadoop, Airflow, Kafka, Delta Lake, etc.).
- Prior experience with Databricks would be appreciated.
- Good communication skills in English or French.
- Experience with collaborative development environments: Git, GitLab, Jupyter Notebooks, VS Code
- Valued knowledge of AWS cloud services.
- Familiarity with ETL/ELT principles, Data Lakehouse, and DataOps (CI/CD, monitoring, data quality).
- Interest in emerging technologies, particularly Generative AI and its integration into Data platforms.
- Team spirit, rigor, and sense of collaboration in an agile environment.
- Technical curiosity and ability to quickly learn new tools and paradigms.
- Autonomy, service-oriented mindset, an
Additional Information
- Attractive salary and bonus with annual revision.
- 42 hours per week (30 minute early finish every Friday), flexible working hours options
- 15 annual leave days (Women) & 13 annual leave days (Men) - increasing with length of service & seniority, 15 working from home days each year
- Team-building activities, Sport Clubs
- Cooperation with colleagues around the world in a leading global group
- Strong team spirit in an entrepreneurial environment of a growing company
- People values, social responsibility, and sustainability.
- Opportunities for self-development and career advancement
- Internal training courses (technical, foreign language, soft skills)
