Senior Software Development Test Engineer - AI

Ovii's Interpretation of the Role

Senior AI‑focused Software Development Engineer in Test (SDET) at Tekion, responsible for ensuring the quality, reliability, and correctness of machine‑learning models and AI agents powering the Automotive Retail Cloud. The role blends test automation, model evaluation, and collaboration with ML, data, and product teams.

Role Snapshot

• Senior AI‑focused SDET
• Build automated testing frameworks for ML models
• Validate model accuracy, latency, and behavior
• Collaborate with ML engineers, data scientists, and product
• Create evaluation datasets and metrics
• Champion quality engineering best practices

Must-Have Requirements

• Python
• Java
• Test automation framework development
• CI/CD and test orchestration
• API/integration testing
• ML model evaluation and metrics
• SDET
• quality engineering
• software engineering

Nice-to-Have Signals

• MLflow
• Weights & Biases
• LangSmith
• Ragas
• DeepEval
• AWS/GCP/Azure
• Docker
• Kubernetes
• Model observability
• Drift detection
• Production ML monitoring
• ML/AI testing
• LLM evaluation

Work Setup

• Location: Bangalore, India
• Work mode: ONSITE
• Employment type: Full-Time

Eligibility Gates

• Visa sponsorship: unknown

Not Specified in JD

• Visa sponsorship
• Salary range
• Remote eligibility
• Education requirement
• Certifications
• Relocation
• Notice period
• Travel
• Security clearance
• Coding test
• Portfolio
• GitHub
• Writing sample
• Cover letter

What You'll Likely Work On

• Design and implement automated testing frameworks for model inference, prompt pipelines, and agentic workflows
• Create and curate evaluation datasets, measure accuracy, relevance, and detect hallucinations
• Build regression suites to catch quality drift across model, prompt, or data changes
• Validate end‑to‑end integration of ML models and AI agents within ARC products
• Define quality metrics, guardrails, and automated monitoring for model degradation
• Partner with ML engineers to root‑cause production issues and improve model robustness

Good Fit If You Have

• Strong Python (or Java) coding ability for production‑grade test automation
• Hands‑on experience testing data‑intensive or ML/AI systems
• Familiarity with LLM evaluation techniques and generative failure modes
• Effective collaboration and communication across ML, data, and product teams