Senior AI & Data Engineer
The role involves designing and maintaining cloud‑native applications on AWS and building large‑scale data pipelines with Apache Spark and EMR. It also requires developing generative AI solutions using RAG architectures, AI agents, and AWS Bedrock.
Skills required
About this role
At Quest Global, it’s not just what we do but how and why we do it that makes us different. With over 25 years as an engineering services provider, we believe in the power of doing things differently to make the impossible possible. Our people are driven by the desire to make the world a better place—to make a positive difference that contributes to a brighter future. We bring together technologies and industries, alongside the contributions of diverse individuals who are empowered by an intentional workplace culture, to solve problems better and faster.
Key Responsibilities
- Design, develop, and maintain scalable cloud-native applications and platform services on AWS.
- Build and support large-scale data processing solutions using Apache Spark and AWS EMR.
- Develop AI-powered applications using Generative AI technologies, RAG architectures, AI Agents, and AWS Bedrock services.
- Create and maintain CI/CD pipelines to enable reliable and automated software deployments.
- Design, implement, and optimize NoSQL database solutions, preferably MongoDB Atlas.
- Collaborate with cross-functional teams to gather requirements, design solutions, and deliver high-quality software products.
- Perform code reviews and follow engineering best practices for coding, testing, performance, and security.
- Leverage GenAI tools and AI-assisted development practices to improve productivity and delivery outcomes.
- Design and develop AI-powered agents and automation solutions that provide measurable business value.
- Participate in Agile ceremonies, sprint planning, estimation, and technical discussions.
- Continuously improve application performance, user experience, and engineering efficiency.
- Troubleshoot complex application, infrastructure, and data processing issues.
- Contribute to architectural discussions and technology strategy initiatives.
We are known for our extraordinary people who make the impossible possible every day. Questians are driven by hunger, humility, and aspiration. We believe that our company culture is the key to our ability to make a true difference in every industry we reach. Our teams regularly invest time and dedicated effort into internal culture work, ensuring that all voices are heard.
We wholeheartedly believe in the diversity of thought that comes with fostering a culture rooted in respect, where everyone belongs, is valued, and feels inspired to share their ideas. We know embracing our unique differences makes us better, and that solving the worlds hardest engineering problems requires diverse ideas, perspectives, and backgrounds. We shine the brightest when we tap into the many dimensions that thrive across over 21,000 difference-makers in our workplace.
Work Experience
Must-Have Skills
- Thorough knowledge of AWS services and cloud-native application development.
- Strong experience with Apache Spark using Scala, Java, or Python.
- Proficiency in Python development.
- Deep understanding of developing, optimizing, and running Spark workloads on AWS EMR.
- Strong programming skills in Scala, Java, and/or Python.
- Strong understanding of NoSQL databases, preferably MongoDB Atlas.
- Experience in building and maintaining CI/CD pipelines and DevOps practices.
- Hands-on experience building AI-powered solutions using:
- RAG (Retrieval-Augmented Generation) pipelines
- AI Agents and Agent Skills
- AWS Bedrock
- Bedrock AgentCore
- Experience with open-source AI frameworks such as LangChain and LlamaIndex.
- Experience building AI agents and automation solutions using Generative AI technologies.
- Hands-on experience with GitHub Copilot, Codex, or similar AI-assisted development tools.
- Strong analytical, problem-solving, debugging, and troubleshooting skills.
- Experience with Git and collaborative software development practices.
- Ability to work effectively in cross-functional and Agile teams.
Preferred Skills
- Hands-on experience in Scala development.
- Experience with cloud-native architectures and microservices.
- Familiarity with MLOps and AI deployment best practices.
- Strong problem-solving and collaboration skills.
Additional Information
- Demonstrates an AI-first mindset in software development and engineering practices.
- Ability to create AI agents and automation solutions that deliver measurable business value.
- Experience or interest in developing AI-powered solutions using the AWS Bedrock ecosystem.
- Proactively leverages managed AI models and platforms to improve productivity and innovation.
- Balances delivery excellence with innovation and continuous improvement.
- Strong team player with a collaborative and ownership-driven mindset
