Ovii Job Board

QA Engineer, Integrations and AI Agents

Composio

Remote • Full-Time

Posted 2026-07-24 Tech & Engg

Apply on employer site

Job Description

Ovii's Interpretation of the Role

We need a hands‑on QA Engineer to own product quality for integrations, APIs, dashboards, and AI‑agent workflows. You’ll design test plans, execute manual and automated tests, and drive defects to resolution while collaborating with engineers and product managers.

Role Snapshot

  • Manual & automated QA for integrations
  • API and workflow testing
  • Regression suite ownership
  • Bug investigation & clear reporting
  • Collaboration with engineering & product

Must-Have Requirements

  • Manual testing of modern web applications
  • API testing (REST) using Postman/Bruno/Insomnia
  • Exploratory testing and debugging
  • Test plan creation and test case design
  • Regression testing
  • Automation scripting in JavaScript, TypeScript or Python
  • Automation frameworks such as Playwright, Cypress, pytest
  • CI/CD pipeline quality gates and flaky‑test management
  • SQL data validation
  • Browser developer tools, logs and network tracing
  • hands‑on testing of modern web applications and APIs
  • building and executing test plans
  • driving defects to resolution

Nice-to-Have Signals

  • Testing developer tools or SDKs
  • OAuth, API keys and webhook knowledge
  • AI agents, LLM evaluation or tool‑calling systems
  • Cross‑browser/device testing
  • Observability tools for incident investigation
  • Establishing QA practices at early‑stage companies
  • testing developer tools or SDKs
  • experience with AI‑agent workflows

Work Setup

  • Work mode: REMOTE
  • Remote scope: COUNTRY_RESTRICTED
  • Remote countries: United States
  • Timezone: Pacific Time or Eastern Time working hours
  • Employment type: Full-Time

What You'll Likely Work On

  • Create and execute test plans from requirements through production release
  • Validate integrations and APIs, covering auth, permissions, retries, webhooks, pagination, rate limits and error handling
  • Test end‑to‑end customer journeys across dashboards, SDKs, connectors and AI‑agent workflows
  • Perform exploratory testing to uncover edge cases and usability gaps
  • Maintain and expand regression suites for high‑risk product areas
  • Evaluate AI‑native experiences such as tool‑calling agents
  • Automate repeatable API, integration and UI test cases to boost release confidence
  • Investigate production incidents using logs, network traces and API responses
  • Write precise bug reports with reproduction steps, impact and severity, then verify fixes
  • Partner with engineers and product managers to assess release risk and define acceptance criteria

Good Fit If You Have

  • Experience with developer‑focused products or SDKs
  • Familiarity with AI agents, LLM evaluation or tool‑calling systems
  • Background in cross‑browser/device testing
  • Exposure to observability or incident‑investigation tooling
  • Track record of establishing QA practices in early‑stage startups

Skills

  • Web application testing
  • API testing (REST, auth, rate limits)
  • Exploratory testing & debugging
  • Test automation (JavaScript/TypeScript/Python)
  • Automation frameworks (Playwright, Cypress, pytest)
  • CI/CD quality gates & flaky‑test management
  • SQL data validation
  • Browser dev tools & network tracing

Remote Eligibility

  • US: PST
  • EST