Ovii Job Board

Principal Artificial Intelligence Engineer

Innovaccer

San Francisco, United States • Onsite - San Francisco, United States • Full-Time

Posted 2026-08-10 Tech & Engg

Apply on employer site

Job Description

Ovii's Interpretation of the Role

Innovaccer seeks a Principal AI Engineer to design, build, and ship production‑grade LLM‑based solutions for healthcare. The role spans the full AI lifecycle, from research and prototyping to large‑scale training, serving, and evaluation, while collaborating with product, data, and clinical teams.

Role Snapshot

  • Lead end‑to‑end AI product development
  • Design and ship large‑scale LLM and AI agent solutions
  • Own model training, serving, and evaluation pipelines
  • Mentor engineers and set technical direction
  • Collaborate across product, data, and clinical stakeholders

Must-Have Requirements

  • Python
  • PyTorch
  • Large‑scale distributed training
  • Model serving infrastructure
  • Data pipeline engineering
  • Experiment design & evaluation
  • Research publication record
  • large‑scale model training
  • production AI deployment
  • research publication record
  • MS or PhD in Computer Science, Machine Learning, or related quantitative field

Nice-to-Have Signals

  • Mentoring or setting direction for other engineers
  • Familiarity with HuggingFace, DeepSpeed/FSDP, vLLM/SGLang
  • Exposure to multi‑GPU training
  • mentoring engineers
  • BS with substantial research or open‑source contributions

Work Setup

  • Location: San Francisco, United States
  • Work mode: ONSITE
  • Employment type: Full-Time

Not Specified in JD

  • Visa sponsorship
  • Salary range
  • Remote eligibility
  • Education requirement specifics beyond listed degrees
  • Certifications

What You'll Likely Work On

  • Prototype, train, and deploy production‑grade LLMs and AI agents for healthcare workflows
  • Build and optimize multi‑GPU training pipelines for billions‑parameter models
  • Design and implement serving infrastructure that meets latency and accuracy targets
  • Develop rigorous evaluation frameworks and run ablation experiments
  • Translate clinical and product requirements into AI solutions with cross‑functional teams
  • Guide and mentor junior AI engineers as the team scales

Good Fit If You Have

  • First‑author papers at NeurIPS, ICML, ICLR, ACL, EMNLP or similar
  • Hands‑on experience shipping fine‑tuned models at production scale
  • Ability to explain complex AI concepts to non‑technical clinicians and operators

Skills

  • Python
  • PyTorch
  • Distributed training frameworks (DeepSpeed, FSDP, etc.)
  • Model serving stacks (vLLM, SGLang, HuggingFace)
  • Large‑scale data pipeline engineering
  • Experiment design & evaluation
  • Research publication record at top ML conferences
  • Open‑source ML contributions