Data Engineer - Web Scraping (3 months contract)
The contractor will develop and maintain Python-based web scraping pipelines to collect data from luxury brand websites, ensuring configurations are reliable and scalable. They will also monitor and troubleshoot scraping jobs, delivering clean datasets for downstream analysis.
Skills required
About this role
We are growing! We are currently looking to hire a Data Engineer - Web Scraping to work with us remotely on a 3 months contract.
Who we are:
Founded in 2006, CXG is a global customer experience company uniquely positioned at the intersection of data-driven retail performance, customer experience transformation, and operational execution across 200+ luxury brands worldwide.
The mission of our 270 collaborators is to help brands transform customer and employee experiences through tailored insights, strategy, and implementation.
We are passionate about delivering impact.
Our clients include the world’s most admired luxury houses, and our solutions combine research, technology, and human expertise to elevate every customer interaction.
What you will be doing:
- Maintain and manage website scraping configurations using Python.
- Monitor scraping configurations for errors and potential crashes.
- Oversee retrieved data to detect potential issues and blockages.
- Coordinate with stakeholders to understand scraping task requirements and report issues.
- Prepare and share periodic reports on scraping activities with stakeholders.
- Develop necessary pipelines to ingest data into the Datalake and perform required transformations.
Requirements
What you will bring along:
- Proven experience in data engineering with expertise in designing and implementing scalable data architectures.
- Strong experience with ETL processes, data modeling, and data warehousing (Airflow & DBT preferred).
- Expertise in database technologies, both relational (SQL) and NoSQL.
- Knowledge of cloud platforms, particularly Azure.
- Solid understanding of data security measures and compliance standards.
- Excellent Python experience for data engineering and automation.
- Strong collaboration skills to work closely with data scientists and analysts.
- Ability to optimize data pipelines for performance and efficiency.
- Ability to build, test, and maintain tasks and projects.
- Experience with version control systems, such as Git.
- Hands-on experience with Airflow and/or DBT.
- Experience with Terraform for infrastructure management.
- Minimum 2 years of experience in a similar role.
- Strong academic background in a relevant field.
- Fluent in English (French is a plus).
Similar open roles
