B
BJAK
ML Engineer

AI Phone - On-device AI / ML Systems Engineer

RemoteSeniorML Engineerposted 1w ago
✦Role summaryAI-generated

The candidate will design, benchmark, and integrate on-device machine learning models for Android phones, ensuring low latency, minimal memory usage, and power efficiency. They will also evaluate quantization, compression, and distillation techniques to deliver proactive AI capabilities on consumer devices.

Skills required

Model quantizationAndroid developmentPerformance profilingOn-device inferenceBenchmarkingTensorflow litePytorch mobileC++JavaAIMachine learningPythonNeural networksLLMsTensorFlow

About this role

About

We are reimagining the phone. AI phones need to be proactive, intuitive, intelligent and low cost. This is a mission critical for rest of the world to adopt intelligence.

There are over 5 billion people using everyday applications such as email, messaging, notes, tasks, and calendars, yet most are not AI-native. Our mission is to build proactive applications and devices that bring intelligence into daily conversations, coordination and workflows, with minimal prompting.

Responsibilities

  • Evaluate suitable open-weight and commercially available models for on-device execution.

  • Benchmark model performance on target mobile hardware.

  • Integrate models into Android applications and system services.

  • Optimize inference latency, memory consumption and power usage.

  • Evaluate quantization, compression and model distillation techniques.

  • Work with CPU, GPU and NPU acceleration.

  • Evaluate local model capabilities for different workflows.

  • Build hybrid local/cloud model routing mechanisms.

  • Identify which tasks can be handled locally and which require cloud inference.

  • Work with AI agent engineers to integrate local models into the agent runtime.

Requirements

  • Strong ML systems or inference engineering experience.

  • Experience deploying and optimizing models.

  • Strong Python and C++ skills.

  • Understanding of neural network inference.

  • Experience with model quantization and performance optimization.

  • Understanding of hardware constraints and inference benchmarks.

Nice to have

  • Experience with on-device LLMs.

  • Qualcomm QNN, MediaTek NeuroPilot or similar acceleration frameworks.

  • ONNX Runtime, LiteRT, TensorFlow Lite or ExecuTorch.

  • Android NDK.

  • Mobile or edge AI deployment.

  • Multimodal model optimization.

✕ position closed

This role is no longer accepting applications. It’s kept here for reference — check out the similar open roles below.

Similar open roles

C
NEW

Senior AI/ML Engineer

Chubb·Bangalore, Karnataka, India
On-siteSeniorML Engineer
today
E
NEW

Senior Machine Learning Engineer

Euromonitor·Vilnius, Vilnius City Municipality, Lithuania
On-siteSeniorML Engineer
€60k – €90k USD
today
C
NEW

Principal Machine Learning Engineer - CX

Cisco·San Jose, California, United States of America
On-siteStaffML Engineer
$296k – $375k USD
yesterday
N
NEW

Staff Manufacturing Automation Engineer – AI/ML

Nokia·United States
On-siteStaffML Engineer
AutomationData acquisitionMachine learning
yesterday
S
NEW

Staff Machine Learning Engineer - Medical Devices

SandboxAQ·Canada
RemoteStaffML Engineer
$172k – $258k USD
yesterday
S
NEW

Staff Machine Learning Engineer - Medical Devices

SandboxAQ·United States
RemoteStaffML Engineer
$196k – $294k USD
yesterday