
QA Engineer, Integrations and AI Agents
Composio
Posted 2026-07-24
Tech & Engg
Job Description
Ovii's Interpretation of the Role
We need a hands‑on QA Engineer to own product quality for integrations, APIs, dashboards, and AI‑agent workflows. You’ll design test plans, execute manual and automated tests, and drive defects to resolution while collaborating with engineers and product managers.
Role Snapshot
- Manual & automated QA for integrations
- API and workflow testing
- Regression suite ownership
- Bug investigation & clear reporting
- Collaboration with engineering & product
Must-Have Requirements
- Manual testing of modern web applications
- API testing (REST) using Postman/Bruno/Insomnia
- Exploratory testing and debugging
- Test plan creation and test case design
- Regression testing
- Automation scripting in JavaScript, TypeScript or Python
- Automation frameworks such as Playwright, Cypress, pytest
- CI/CD pipeline quality gates and flaky‑test management
- SQL data validation
- Browser developer tools, logs and network tracing
- hands‑on testing of modern web applications and APIs
- building and executing test plans
- driving defects to resolution
Nice-to-Have Signals
- Testing developer tools or SDKs
- OAuth, API keys and webhook knowledge
- AI agents, LLM evaluation or tool‑calling systems
- Cross‑browser/device testing
- Observability tools for incident investigation
- Establishing QA practices at early‑stage companies
- testing developer tools or SDKs
- experience with AI‑agent workflows
Work Setup
- Work mode: REMOTE
- Remote scope: COUNTRY_RESTRICTED
- Remote countries: United States
- Timezone: Pacific Time or Eastern Time working hours
- Employment type: Full-Time
What You'll Likely Work On
- Create and execute test plans from requirements through production release
- Validate integrations and APIs, covering auth, permissions, retries, webhooks, pagination, rate limits and error handling
- Test end‑to‑end customer journeys across dashboards, SDKs, connectors and AI‑agent workflows
- Perform exploratory testing to uncover edge cases and usability gaps
- Maintain and expand regression suites for high‑risk product areas
- Evaluate AI‑native experiences such as tool‑calling agents
- Automate repeatable API, integration and UI test cases to boost release confidence
- Investigate production incidents using logs, network traces and API responses
- Write precise bug reports with reproduction steps, impact and severity, then verify fixes
- Partner with engineers and product managers to assess release risk and define acceptance criteria
Good Fit If You Have
- Experience with developer‑focused products or SDKs
- Familiarity with AI agents, LLM evaluation or tool‑calling systems
- Background in cross‑browser/device testing
- Exposure to observability or incident‑investigation tooling
- Track record of establishing QA practices in early‑stage startups
Skills
- Web application testing
- API testing (REST, auth, rate limits)
- Exploratory testing & debugging
- Test automation (JavaScript/TypeScript/Python)
- Automation frameworks (Playwright, Cypress, pytest)
- CI/CD quality gates & flaky‑test management
- SQL data validation
- Browser dev tools & network tracing
Remote Eligibility
- US: PST
- EST