LP
Leading Path Consulting
Data Engineer

Data Engineer (Python, NiFi) - TS/SCI Poly

On-siteMidData Engineerposted 4d ago
✦Role summaryAI-generated

This Data Engineer will design and build scalable backend services and data ingestion pipelines using Python and NiFi to support operational and analytical systems. The role requires strong data modeling, API development, and collaboration in an Agile environment to drive innovation and process improvement.

Skills required

About this role

We’re looking for a Data Engineer who is passionate about building modern, scalable solutions for ingesting and transforming data. This role blends back-end engineering with data pipeline development and is perfect for someone who enjoys designing modular services and bringing structure to complex data environments.

As part of our Agile team, you’ll design and develop software products and services that efficiently ingest, process, and manage data from a variety of sources. You’ll play a key role in building robust, reusable APIs and data pipelines that support critical operational and analytical systems.

KEY RESPONSIBILITIES

· Design and develop scalable backend services and data ingestion solutions.

· Perform data modeling, data mapping, and large-scale file manipulation.

· Collaborate across disciplines in an Agile environment with minimal supervision.

· Drive innovation and process improvement with a hands-on development approach.

· Optimize application for maximum speed and scalability.

QUALIFICATIONS

· Bachelor’s Degree in Computer Science, Electrical or Computer Engineering or a related technical discipline, or the equivalent combination of education, technical training, or work/military experience.

· At least five (5) years of related experience software engineering experience.

REQUIRED KNOWLEDGE/SKILLS

· Knowledge of NodeJS or Python

· Strong understanding of APIs, microservices, and distributed systems.

· Strong understanding of Large Language Models (LLMs) and using them to enrich data

· Solid experience in building and maintaining ETL workflows and data pipelines.

· Excellent organizational, coordination, interpersonal and team building skills.

· Familiarization with NoSQL datastores.

· Familiarization with MCP Servers and API management

DESIRED KNOWLEDGE/SKILLS

· NiFi experience

· Experience with Flask Application Development

· Experience with Claude Code, Codex, NemoClaw, Aider, Kiro, Gemini CLI, OpenCode or other AI harness.

· Familiarity with Machine Learning Operations (MLOps)

· Hands-on experience working with Elastic and RabbitMQ

· NoSQL experience (i.e. MongoDB)

· Cloud based and Distributed architecture creation or experience

· Experience developing on the Amazon Web Services Cloud or other cloud provider.

· Graph Databases (Janus/Cassandra).

· Graph Query Languages.

Requirements

Active TS/SCI w/ FS Poly required

KEY RESPONSIBILITIES

· Design and develop scalable backend services and data ingestion solutions.

· Perform data modeling, data mapping, and large-scale file manipulation.

· Collaborate across disciplines in an Agile environment with minimal supervision.

· Drive innovation and process improvement with a hands-on development approach.

· Optimize application for maximum speed and scalability.

QUALIFICATIONS

· Bachelor’s Degree in Computer Science, Electrical or Computer Engineering or a related technical discipline, or the equivalent combination of education, technical training, or work/military experience.

· At least five (5) years of related experience software engineering experience.

REQUIRED KNOWLEDGE/SKILLS

· Knowledge of NodeJS or Python

· Strong understanding of APIs, microservices, and distributed systems.

· Strong understanding of Large Language Models (LLMs) and using them to enrich data

· Solid experience in building and maintaining ETL workflows and data pipelines.

· Excellent organizational, coordination, interpersonal and team building skills.

· Familiarization with NoSQL datastores.

· Familiarization with MCP Servers and API management

DESIRED KNOWLEDGE/SKILLS

· NiFi experience

· Experience with Flask Application Development

· Experience with Claude Code, Codex, NemoClaw, Aider, Kiro, Gemini CLI, OpenCode or other AI harness.

· Familiarity with Machine Learning Operations (MLOps)

· Hands-on experience working with Elastic and RabbitMQ

· NoSQL experience (i.e. MongoDB)

· Cloud based and Distributed architecture creation or experience

· Experience developing on the Amazon Web Services Cloud or other cloud provider.

· Graph Databases (Janus/Cassandra).

· Graph Query Languages.

Benefits

Leading Path is an award-winning Information Technology and Management Consulting firm focused on providing solutions in process, technology, and operations to our government and Fortune 500 clients. We offer a professional and family friendly work environment with a strong work-life balance. Leading Path provides a comprehensive and competitive benefits package including fully paid medical/dental/vision premiums, generous PTO, 11 Paid Holidays, 6% 401K contribution, annual training and tuition reimbursement, SPOT Award bonuses, regular team events, opportunities for professional growth and advancement and much more!

score your resume against this role

Similar open roles

D
NEW

Director, Data Platform Engineering

Domino's·Ann Arbor, MI, United States
On-siteSeniorData Engineer
yesterday
V
NEW

Data Engineer

Visa·IN - Bengaluru, India
On-siteData Engineer
yesterday
L
NEW

Junior Data Engineer

Littelfuse·Kaunas - Donelaicio
On-siteJuniorData Engineer
yesterday
D
NEW

VP, Senior Cloud Engineer, Data Platform, Group Technology

Dbs·Singapore - East
On-siteSeniorData Engineer
yesterday
C
NEW

Data Engineer

Citigroup·Pune Maharashtra India
On-siteMidData Engineer
yesterday