Job Description
Ovii's Interpretation of the Role
Metaforms seeks a Senior AI Engineer to design, build, and continuously improve production‑grade AI agent systems that power large‑scale market research workflows. The role blends applied machine learning with systems engineering to tackle model reliability, long‑context handling, and evaluation infrastructure at scale.
Role Snapshot
- Senior AI Engineer
- Production AI systems
- LLM‑focused engineering
- High ownership
- Bengaluru, on‑site
Must-Have Requirements
- Python
- LLM systems
- Synthetic data pipelines
- Evaluation frameworks
- Prompt engineering
- Model fine‑tuning
- AI system optimization
- Debugging complex system failures
- applied ML in production
- production AI systems
Nice-to-Have Signals
- Go
- TypeScript
- Model monitoring
- Bias evaluation
- Dataset management tooling
- Semantic parsing
- DSLs
- Agentic systems
- Multi‑step reasoning pipelines
- Tool‑use frameworks
- model monitoring
- bias evaluation
- semantic parsing
- agentic systems
Work Setup
- Location: Bengaluru, India
- Work mode: ONSITE
- Employment type: Full-Time
Not Specified in JD
- Visa sponsorship
- Salary range
- Remote eligibility
- Education requirement
- Certifications
- Relocation
- Notice period
- Travel
- Security clearance
- Coding test
- Portfolio
- GitHub
- Writing sample
- Cover letter
What You'll Likely Work On
- Design and own synthetic data generation pipelines for edge‑case coverage
- Create evaluation datasets and structured rubrics for domain‑specific language tasks
- Build automated data quality checks and large‑scale research data pipelines
- Develop continuous monitoring, logging, and performance‑optimization systems for production AI models
- Engineer tooling that lets domain experts iteratively refine training datasets
- Research and implement long‑context handling and cascading‑error solutions in LLM pipelines
- Design end‑to‑end production‑grade AI agent architectures
- Lead prompt‑engineering strategy and experimentation frameworks across the team
Good Fit If You Have
- Enjoys high‑ownership problems and drives solutions independently
- Comfortable debugging complex, non‑deterministic system failures
- Collaborates with domain experts to evolve data and model pipelines
Skills
- Python
- Large Language Models (LLM)
- Synthetic data pipelines
- Evaluation frameworks
- Prompt engineering
- Model fine‑tuning
- AI system optimization
- Go (preferred)
- TypeScript (preferred)
- Model monitoring (nice‑to‑have)
- Bias evaluation (nice‑to‑have)