SM
Software Mind
Data Engineer

[C3T] Data Platform Engineer (Metadata, DQ)

On-siteMidData Engineerposted 4mo ago
✦Role summaryAI-generated

This role focuses on building and maintaining a cloud-native metadata and data quality platform on AWS, requiring hands-on expertise in integrating solutions with lakehouse architectures and enforcing data governance standards. You’ll collaborate closely with cross-functional teams to automate metadata ingestion, lineage tracking, and quality monitoring while owning a critical component of the data ecosystem.

Skills required

About this role

Project – the aim you’ll have

Join a Media & Entertainment project building modern analytical solutions. You'll help develop a cloud-native data ecosystem on AWS, focused on metadata management and data quality. Key selling points: real ownership of a critical data platform component, work with modern open-source tooling, and close collaboration with Data Engineering, Data Governance, AI, and Data Management teams shaping organizational data standards.

Position – how you’ll contribute

  • Implement, configure, and maintain the Metadata Management platform and Data Quality environment.
  • Integrate the solution with the lakehouse, data warehouse, domain systems, and analytical tools.
  • Automate metadata ingestion, data lineage, data quality monitoring, and DQ reporting.
  • Implement and maintain the metamodel and technical mechanisms for enforcing data quality rules.
  • Develop and extend integrations between Data Quality and Metadata Management solutions.
  • Monitor the stability, performance, and security of the environment.
  • Collaborate with Data Governance, Data Engineering, and business teams to roll out standards and drive practical adoption of the data catalog and DQ mechanisms.
  • Produce technical documentation and provide user support.

Qualifications

Expectations – the experience you need

  • Minimum 3–5 years of experience as a Data Engineer / Data Platform Engineer or in a related role.
  • Proven experience building and maintaining production data pipelines (ETL/ELT).
  • Experience with Metadata Management / Data Catalog tools (e.g., DataHub, Apache Atlas, Amundsen).
  • Experience with Data Quality tools (e.g., Great Expectations, Soda, Deequ, or similar).
  • Knowledge of event-driven architecture.
  • Experience in environments with established Data Governance or Master Data Management processes.
  • Strong proficiency in Python (APIs, automation, integrations) and SQL.
  • Hands-on experience working in an AWS environment.
  • Solid knowledge of CI/CD practices and GitHub.
  • Experience implementing data validation, data testing, or data quality control mechanisms within pipelines.
  • Experience with system integrations (REST API, GraphQL, or similar).
  • Understanding of Data Governance, Metadata Management, Data Lineage, and Data Quality concepts.
  • Ability to work independently in a project-based environment.
  • Good communication skills in both Polish and English.

Additional Information

Our offer – professional development, personal growth

  • Flexible employment and remote work
  • International projects with leading global clients
  • International business trips
  • Non-corporate atmosphere
  • Language classes
  • Internal & external training
  • Private healthcare and insurance
  • Multisport card
  • Well-being initiatives
score your resume against this role

Similar open roles

N
NEW

Senior Director, Data Engineering

NielsenIQ·Chennai, TN, India
On-siteSeniorData Engineer
yesterday
CG
NEW

Software Engineer – Data Platform

Continental Group Sector ContiTech·Bangalore, Karnataka, India
On-siteSeniorData Engineer
yesterday
K
NEW

Senior Data Engineer (India)

Karat·Remote (India - Bangalore ONLY)
RemoteSeniorData Engineer
yesterday
T
NEW

Principal Data Engineering

Transamerica·Denver, Colorado; Cedar Rapids, Iowa; Philadelphia, Pennsylvania
On-siteStaffData Engineer
2d ago
HF
NEW

Sr Cloud Data and AI Engineer

Hartford Financial Services Group·Hartford, CT; Columbus, OH; Charlotte, NC; Chicago, IL
On-siteSeniorData Engineer
$117k – $176k USD
2d ago
Apply on Software Mind →