J
Jda
Data Engineer

Lead Software Engineer - Data Engineer,Python,Java,Sql,snowflake,Azure

On-siteSeniorData Engineerposted 3w ago
✦Role summaryAI-generated

Lead the design and implementation of scalable data pipelines and model deployment workflows on Azure Foundry, leveraging Python, Java, and Terraform for infrastructure automation. Collaborate across engineering, AI, and operations teams to maintain CI/CD pipelines with GitHub Actions and ensure reliable, secure delivery of data services.

Skills required

About this role

Scope:

Core responsibilities include designing, developing, and maintaining application features while also owning CI/CD pipelines, infrastructure automation, deployments, and environment reliability. Develop scalable code and automate build/release processes to support continuous delivery and model lifecycle workflows. Support Azure Foundry-based workloads, including model deployments, agent pipelines, evaluation workflows, and operational monitoring. Collaborate with engineering, cloud, AI, QA, and operations teams to ensure reliable, secure, and scalable delivery. Open to learn and adapt to existing DevOps, Azure AI Foundry frameworks, and engineering practices used by the team.

Our current technical environment:

Software:

  • Programming: Python, Java, Node.js

  • Build & CI/CD: GitHub Actions

  • IaC & Config: Terraform, Ansible

  • Containers/Orchestration: Docker, Kubernetes (AKS), Helm 3.0

  • APIs/Standards: REST, JSON, YAML, OpenAPI

  • Databases: Snowflake, PostgreSQL

  • Monitoring/Logging: Prometheus, Grafana/ELK/EFK,

  • Could Provider: Azure and GCP

  • Messaging: Apache Kafka

  • SCM: Github

Application Architecture:

  • Microservices designed using an API-first approach with agent orchestration and event-driven processing.

  • Containerized workloads deployed on Kubernetes for scalable and resilient services.

  • Azure Foundry–integrated pipelines enabling model/agent deployments, flows, and execution endpoints.

  • Distributed, cloud-native architecture with Git-based release governance and automated deployment workflows.

Cloud Architecture:

  • Azure Cloud Services (App Service, AKS, APIM, Key Vault, Storage, Functions)

  • Azure AI Foundry: Model deployments, agents, flows, prompt management

  • End-to-end governance with GitHub Actions

  • Infrastructure-as-Code for provisioning and drift management

Frameworks/Others:

  • Spring Boot, FastAPI, Express.js

  • Azure Foundry SDK, Model lifecycle workflows

  • Docker images, Helm charts

  • Git, Postman, JIRA

What you’ll do:

  • Design, develop, and maintain backend services and cloud-native applications.

  • Build and automate CI/CD pipelines for both application code and AI Foundry models/agents.

  • Automate cloud infrastructure provisioning using Terraform.

  • Manage Azure Foundry deployments, including model endpoints, agent workflows, service configurations, and lifecycle tracking.

  • Deploy containerized workloads on Kubernetes (AKS) and manage Helm-based releases.

  • Implement monitoring, alerting, and observability for applications, Foundry agents, and pipelines.

  • Perform debugging, root-cause analysis, and environment support for production systems.

  • Integrate automation tests and validation steps into CI/CD pipelines.

  • Collaborate with product, AI, and engineering teams to build scalable and reliable solutions.

  • Maintain strong coding standards, security best practices, and version control discipline.

  • Participate in Agile ceremonies and contribute to continuous improvement.

  • Identify performance, cost, and security optimization opportunities across cloud and AI workloads.

What we are looking for:

  • Education: Bachelor’s degree in computer science, Engineering, or related discipline (or equivalent hands-on experience)

  • Years of Experience: 7–9 years of combined DevOps + Development experience

Experience in:

  • Azure Cloud and Azure AI Foundry (model deployment, agent operations, flow orchestration)

  • Microservices development (Java/Python/Node.js)

  • CI/CD automation (GitHub Actions)

  • Kubernetes, Docker, container-based deployments

  • Infrastructure as Code using Terraform

  • REST API design and integration

  • SQL and distributed data platforms (Snowflake preferred)

Expertise in:

  • Core programming and scripting. Should have used frameworks for microservices development.

  • Azure Foundry workspace setup, model region support, model/agent lifecycle

  • Git branching strategies, deployment governance

  • Observability frameworks: Prometheus, Grafana/Elastic

  • Secure development practices and secret management (Azure Key Vault)

  • System debugging, performance tuning, and release automation

    Our Values


    If you want to know the heart of a company, take a look at their values. Ours unite us. They are what drive our success – and the success of our customers. Does your heart beat like ours? Find out here: Core Values

    All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or protected veteran status.

    Apply on Jda →Opens in new tab
    score your resume against this role

    Similar open roles

    D
    NEW

    Director, Data Platform Engineering

    Domino's·Ann Arbor, MI, United States
    On-siteSeniorData Engineer
    yesterday
    V
    NEW

    Data Engineer

    Visa·IN - Bengaluru, India
    On-siteData Engineer
    yesterday
    L
    NEW

    Junior Data Engineer

    Littelfuse·Kaunas - Donelaicio
    On-siteJuniorData Engineer
    yesterday
    D
    NEW

    VP, Senior Cloud Engineer, Data Platform, Group Technology

    Dbs·Singapore - East
    On-siteSeniorData Engineer
    yesterday
    C
    NEW

    Data Engineer

    Citigroup·Pune Maharashtra India
    On-siteMidData Engineer
    yesterday
    Apply on Jda →