F
Filevine

Senior/Staff ML Ops Engineer

On-siteposted 5mo ago

Skills required

About this role

Filevine is a Legal AI company delivering Legal Operating Intelligence for the future of legal work. Grounded in a singular system of truth, Filevine brings together data, documents, workflows, and teams into one unified platform—where modern legal work happens with clarity and consistency.

Powered by LOIS, the Legal Operating Intelligence System, Filevine connects context across every matter to transform legal operations from reactive to proactive. LOIS reads, understands, and reasons across your data to surface insight, automate complexity, and give professionals the clarity and confidence to see more, know more, and do more. Fueled by a team of exceptional collaborators and innovators, Filevine’s rapid growth has earned AI awards and recognition from Deloitte and Inc. as one of the most innovative and fastest-growing technology companies in the country.

Role Summary:

As a Senior MLOps Engineer at Filevine, you'll sit at the intersection of machine learning, platform infrastructure, and product velocity. You'll build and own the systems that make Filevine's AI capabilities faster to develop, safer to ship, and easier to trust, at scale.

You will be responsible for the full stack of ML infrastructure: evals, observability, model serving, annotation tooling, and the prompt platform that lets every team move with confidence.

Responsibilities

  • Setup and maintain LLM observability frameworks/tools

  • Help improve data annotation tooling

  • Ensure stability of LLM calls (rate limits, provisioned throughput, backups, …)

  • Help to drive security review processes for AI vendors and providers

  • LLM cost optimization recommendations (caching, batching, identification of workflow parts causing high costs, etc.)

  • Hosting finetuned/open weight machine learning models

  • Helping with LLM evaluations (tooling/framework) with the current main focus on agentic evals

  • Platform tooling for enabling non-technical people (e.g. PMs) to iterate on prompts

  • Qualifications

  • 5+ years building and operating software systems end-to-end

  • Hands-on experience with ML infrastructure: model serving, training pipelines, or LLM integrations in production

  • Strong understanding of cloud infrastructure and distributed systems (primarily AWS)

  • Familiarity with observability tooling and cost management for LLM workloads

  • Experience with or openness to: Python, Kubernetes, Terraform

  • Thrives in a remote-first, async environment: clear communicator, high ownership, low ego

  • Bonus: experience with eval frameworks, annotation tooling, or prompt management platforms

  • Compensation starts at 6,000 EUR per month, with the final offer determined by the candidate’s seniority and experience.

    This opportunity is for independent contractors and is not intended to establish an employment relationship. Contractors are responsible for their own taxes and compliance with applicable laws in their jurisdiction.

    This role is open exclusively to candidates currently residing in, or willing to relocate to, Czechia or Slovakia with the legal right to work in these countries. Unfortunately, we are unable to consider applications from candidates based outside of these locations due to operational and regulatory requirements

    Privacy Policy Notice

    Filevine will handle your personal information according to what’s outlined in our Privacy Policy.

    ✕ position closed

    This role is no longer accepting applications. It’s kept here for reference — check out the similar open roles below.

    Similar open roles

    O
    NEW

    Stage Data Scientist F/H -Traces synthétiques de mobilité et sémantique des territoires

    Orange·BELFORT,FRANCE; LANNION,FRANCE
    On-siteJuniorResearch Scientist
    Generative modelingNatural language processingSynthetic data generation
    yesterday
    P
    NEW

    Health Data Analyst

    Providence·Eureka, CA, United States
    On-siteMidData Analyst
    yesterday
    WG
    NEW

    Senior Change Manager - Data, Analytics & AI

    Westpac Group·Sydney, NSW, Australia
    On-siteSeniorOther
    Machine learningData engineeringConversational analytics
    yesterday
    W
    NEW

    Materials Research Engineer -- Principal Engineer

    Westerndigital·San Jose, CA, United States
    On-siteSeniorResearch Scientist
    Thin film depositionPhysical vapor depositionUltra high vacuum
    yesterday
    S
    NEW

    Staff Data Platform Software Engineer

    Servicenow·Santa Clara, CALIFORNIA, United States
    On-siteStaffData Engineer
    $176k – $308k USD
    Apache luceneOpensearchJava
    yesterday
    S
    NEW

    Federal Data and Analytics Sr Sales Executive

    Servicenow·Washington, District of Columbia, United States
    HybridSeniorOther
    $139k – $195k USD
    yesterday