Ovii Job Board

Automation Engineer

Blitzy

Cambridge, United States • Onsite - Cambridge, United States • Full-Time • 3+ years

Posted 2026-05-26 USD 90,000 - USD 145,000 per year Tech & Engg

Apply on employer site

Job Description

Ovii's Interpretation of the Role

Blitzy seeks an Automation Engineer to own and scale automated testing frameworks that validate AI‑generated code in production. The role blends AI‑focused quality assurance with robust test suite development, CI/CD integration, and runtime performance monitoring.

Role Snapshot

  • Own and evolve automated testing frameworks
  • Develop intelligent test suites for AI‑generated applications
  • Integrate testing into CI/CD pipelines
  • Collaborate with AI engineers on runtime quality
  • Monitor performance across multi‑language deployments
  • Drive end‑to‑end and integration test coverage

Must-Have Requirements

  • Playwright
  • Python
  • CI/CD tools (GitHub Actions or similar)
  • Git
  • Testing distributed systems
  • Modern software development practices
  • Experience with cloud platforms
  • Playwright automation
  • Python automation
  • CI/CD integration
  • Distributed systems testing

Nice-to-Have Signals

  • GCP
  • Performance monitoring / APM
  • Chaos engineering
  • Distributed tracing
  • End‑to‑end testing of enterprise‑grade applications
  • Cloud platform experience (GCP preferred)
  • Performance monitoring

Work Setup

  • Location: Cambridge, USA
  • Work mode: ONSITE
  • Employment type: Full-Time

Eligibility Gates

  • Visa sponsorship: unknown

Not Specified in JD

  • Visa sponsorship
  • Travel requirement
  • Security clearance
  • Coding test
  • Portfolio
  • Cover letter

What You'll Likely Work On

  • Expand and maintain automated testing frameworks that validate runtime behavior of AI‑generated code
  • Create intelligent test suites that automatically assess functionality and performance in production environments
  • Extend coverage across multiple languages and frameworks while establishing quality metrics
  • Build systems to detect and flag runtime issues in deployed applications
  • Integrate testing into CI/CD pipelines for continuous quality validation
  • Collaborate with AI engineers to surface platform‑level quality insights and drive improvements
  • Develop monitoring and metrics to track runtime performance across customer deployments

Good Fit If You Have

  • Experience with runtime monitoring of distributed systems
  • Knowledge of performance testing and APM tools
  • Familiarity with chaos engineering and resilience testing
  • Background testing enterprise‑grade, multi‑language applications

Skills

  • Playwright
  • Python
  • CI/CD tools (e.g., GitHub Actions)
  • Git version control
  • Distributed systems testing
  • Modern software development practices
  • Cloud platforms (experience required)
  • GCP (preferred)
  • Performance monitoring / APM
  • Chaos engineering