B
Brillio
Data Engineer

Senior Lead Data Engineer - R01573561

On-siteSeniorData Engineerposted 4d ago
✦Role summaryAI-generated

The candidate will design and optimize scalable data pipelines and ETL workflows on GCP using BigQuery and Informatica Cloud, while managing and securing the underlying GCP infrastructure. They will also automate integration processes with Python, SQL, and shell scripts to support business analytics and ensure compliance with security protocols.

Skills required

About this role

Senior Lead Data Engineer

Primary Skills

  • Google Cloud Platform Administration, Google Cloud Platform (GCP), Gsuite, Apigee, GCP Security
  • Specialization

  • GCP Infrastructure Engineering: Engineer, Database & Middleware
  • Job requirements

  • Experience Range: With at least 5 to 8 years of hands-on experience in data engineering, including significant expertise in GCP infrastructure and cloud-based ETL solutions Key Responsibilities: 1. Design, develop, and optimize scalable data pipelines and ETL workflows on Google Cloud Platform using IICS and BigQuery 2. Implement, maintain, and troubleshoot GCP infrastructure components, ensuring high availability and security compliance 3. Automate data integration processes utilizing Python, SQL, and shell scripting to support business analytics and reporting 4. Configure and manage GCP security protocols, including IAM roles, audit logging, and data encryption to safeguard sensitive information 5. Integrate Salesforce data with cloud data warehouses, ensuring seamless data flow and accuracy 6. Monitor and tune BigQuery performance, optimizing queries and resource utilization for large-scale datasets 7. Lead migration and modernization initiatives, transitioning legacy systems to GCP-based architectures 8. Document technical solutions, workflow processes, and best practices for ongoing knowledge sharing and operational excellence Required Skills: 1. Google Cloud Platform (GCP) administration 2. IICS (Informatica Intelligent Cloud Services) 3. BigQuery 4. Shell scripting 5. Python 6. Advanced SQL Preferred Skills: 1. Experience with Salesforce data integration 2. Expertise in cloud migration strategies 3. Knowledge of data governance frameworks 4. Proficiency with Terraform or similar infrastructure-as-code tools 5. Familiarity with Kubernetes on GCP 6. Experience with real-time data streaming solutions Desired Qualifications: 1. Bachelor's degree in Computer Science, Information Technology, or a closely related discipline 2. Google Professional Data Engineer certification or equivalent relevant GCP certification 3. Informatica Cloud certification
  • Apply on Brillio →Opens in new tab
    score your resume against this role

    Similar open roles

    Z
    NEW

    D365 Data Engineer

    Zensar·India
    On-siteSeniorData Engineer
    today
    UG
    NEW

    Senior Data Engineer

    UBDS Group·London, England, United Kingdom; Manchester, England, United Kingdom
    On-siteSeniorData Engineer
    today
    C
    NEW

    Senior Data Engineer

    CodeLink·Da Nang, Hai Chau, Vietnam; Hanoi, Ha Noi, Vietnam; Ho Chi Minh City, Ho Chi Minh, Vietnam
    On-siteSeniorData Engineer
    Master data managementData integrationETL
    today
    C
    NEW

    Data Engineer (Machine Learning & Data Platform)

    CodeLink·Da Nang, Hai Chau, Vietnam; Hanoi, Ha Noi, Vietnam; Ho Chi Minh City, Ho Chi Minh, Vietnam
    On-siteMidData Engineer
    today
    B
    NEW

    Data Architect - R01573922

    Brillio·Bangalore, Karnataka, India
    On-siteSeniorData Engineer
    today
    Apply on Brillio →