
Principal Artificial Intelligence Engineer
Innovaccer
Posted 2026-08-10
Tech & Engg
Job Description
Ovii's Interpretation of the Role
Innovaccer seeks a Principal AI Engineer to design, build, and ship production‑grade LLM‑based solutions for healthcare. The role spans the full AI lifecycle, from research and prototyping to large‑scale training, serving, and evaluation, while collaborating with product, data, and clinical teams.
Role Snapshot
- Lead end‑to‑end AI product development
- Design and ship large‑scale LLM and AI agent solutions
- Own model training, serving, and evaluation pipelines
- Mentor engineers and set technical direction
- Collaborate across product, data, and clinical stakeholders
Must-Have Requirements
- Python
- PyTorch
- Large‑scale distributed training
- Model serving infrastructure
- Data pipeline engineering
- Experiment design & evaluation
- Research publication record
- large‑scale model training
- production AI deployment
- research publication record
- MS or PhD in Computer Science, Machine Learning, or related quantitative field
Nice-to-Have Signals
- Mentoring or setting direction for other engineers
- Familiarity with HuggingFace, DeepSpeed/FSDP, vLLM/SGLang
- Exposure to multi‑GPU training
- mentoring engineers
- BS with substantial research or open‑source contributions
Work Setup
- Location: San Francisco, United States
- Work mode: ONSITE
- Employment type: Full-Time
Not Specified in JD
- Visa sponsorship
- Salary range
- Remote eligibility
- Education requirement specifics beyond listed degrees
- Certifications
What You'll Likely Work On
- Prototype, train, and deploy production‑grade LLMs and AI agents for healthcare workflows
- Build and optimize multi‑GPU training pipelines for billions‑parameter models
- Design and implement serving infrastructure that meets latency and accuracy targets
- Develop rigorous evaluation frameworks and run ablation experiments
- Translate clinical and product requirements into AI solutions with cross‑functional teams
- Guide and mentor junior AI engineers as the team scales
Good Fit If You Have
- First‑author papers at NeurIPS, ICML, ICLR, ACL, EMNLP or similar
- Hands‑on experience shipping fine‑tuned models at production scale
- Ability to explain complex AI concepts to non‑technical clinicians and operators
Skills
- Python
- PyTorch
- Distributed training frameworks (DeepSpeed, FSDP, etc.)
- Model serving stacks (vLLM, SGLang, HuggingFace)
- Large‑scale data pipeline engineering
- Experiment design & evaluation
- Research publication record at top ML conferences
- Open‑source ML contributions