Data Engineer_AI

1. Job Description

• Develop and maintain ETL/ELT pipelines using Databricks.

• Write efficient Pyspark & Python Scripts for large-scale data processing.

• Implement data models, transformations and CI/CD pipelines for automation.

• Develop reusable data engineering frameworks, libraries and templates for ingestion, transformation, validation and publishing.

• Ensure Data Quality, Reliability, and Performance across pipelines and shared frameworks.

• Design, develop, test and deploy Power BI scripts and generate visually appearing and insightful reports.

• Integrate Power BI reports into Applications to provide enhanced business capabilities.

• Build data models and develop dashboards using Power BI desktop.

• Work with Reliability Engineers to design and develop Power BI data Visualizations.

• Proficient in using DAX expressions and Power Queries for developing and optimizing Power BI dashboards and reports.

• Knowledge of Azure Cloud Data Engineering Tools.

• Analysis of Validation Test Results.

• Development of Interfaces for Measurement and Simulation.

• Development and Maintenance of Test Automation system related Tools.

• Support Downstream consumers such as analytics, reporting, testing and Reliability teams.

1. Desired Skills

• Good knowledge of data engineering concepts, ETL/ELT pipelines, and data lifecycle management.

• Excellent understanding of data modeling, data transformation, and dashboarding concepts for analytics and reporting.

• Proficiency in programming languages including Python and PySpark, with experience in large-scale data processing.

• Strong knowledge of data visualization and reporting using Microsoft Power BI including DAX expressions and Power Query.

• Familiarity with cloud-based data engineering tools, preferably Microsoft Azure services.

• Basic knowledge of electronics and industrial/validation systems is an added advantage.

1. Education & Experience

• Bachelor’s or Master’s degree in Electronics or Electrical Engineering or Computer Science Engineering with 2 to 5 years of experience.

• Hands-on experience in building and maintaining data pipeline solutions using Databricks.

• Exposure to data engineering concepts including ETL/ELT workflows, data processing, and automation.

1. Soft Skills

• Team player with a proactive mind set

• Good communication skills

• Willing to work in an international team with diverse cultures

• Openness for technical discussions, assessments and reviews

Qualifications

Btech/Mtech

Additional Information

3-6 Years