QA Engineer, Integrations, AI Agents

🕒 July 24

🏄 California, New York – Remote

🏄 California – Remote 🗽 New York – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

🔧 QA Engineer (Quality Assurance)

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Composio

WebsiteLinkedInAll Job Openings

11 - 50 employees

Founded 2023

💼 Consulting

📣 Marketing

📦 Logistics

Consulting • Marketing • Logistics

Composio is a developer platform that turns LLMs and AI chat clients into action-taking agents by securely connecting them to 1,000+ apps via managed OAuth, tool execution, sandboxed programmatic environments, and agent infrastructure. It offers SDKs, a CLI, managed gateways, and enterprise features (SSO, governance, org controls) for production workloads so teams can automate workflows across sales, marketing, engineering, support, finance, and more. Composio emphasizes secure delegated auth, intent-resolved tools, and model-agnostic integrations to let agents perform real work at scale.

📋 Description

• At Composio, we are building infrastructure that allows agents to communicate with the tools you use for work including Github, Gmail, Notion, Salesforce, etc. • We raised a $25M Series A from Lightspeed with angels like Guillermo Rauch (CEO of Vercel), Dharmesh Shah (CTO of Hubspot), and Gokul Rajaram. • We've 3x'd our ARR this year, and our customers range from your friends in the YC batch to Wabi, Glean, Zoom and many more. • We are looking for a QA Engineer who will own hands-on product quality across Composio's integrations, APIs, dashboards, and AI-agent workflows. • You will test new features before release, uncover edge cases that automated checks miss, improve regression coverage, and work closely with engineers to drive issues through resolution. • This is a practical, execution-focused role for someone who enjoys breaking complex systems, clearly documenting what went wrong, and ensuring customers receive a reliable product. • This is a globally remote position, but you must work a full schedule aligned with the Pacific Time team.

🎯 Requirements

• Own feature validation: Build test plans and validate new features from requirements through production release. • Test integrations and APIs: Verify authentication, API behavior, permissions, webhooks, retries, pagination, rate limits, error handling, and third-party dependencies. • Validate end-to-end workflows: Test complete customer journeys across the dashboard, SDKs, APIs, connectors, and agent workflows. • Perform exploratory testing: Find edge cases, unexpected interactions, and usability issues that are not covered by standard test cases. • Maintain regression coverage: Build and execute reliable regression suites for high-risk and frequently used product areas. • Test AI-native experiences: Evaluate tool-calling agents and other non-deterministic workflows where outputs may vary between executions. • Improve automation: Automate repeatable API, integration, and UI test cases where automation creates meaningful release confidence. • Investigate production issues: Reproduce customer-reported problems using logs, network traces, API responses, and production signals. • Drive defects to resolution: Write clear bug reports with reproduction steps, evidence, impact, severity, and expected behavior. Verify fixes and prevent regressions. • Strengthen release quality: Partner with engineers and product managers to identify risks, define acceptance criteria, and make informed release decisions.

🏖️ Benefits

• Strong hands-on experience testing modern web applications, APIs, or developer products. • Excellent exploratory testing and debugging skills. • Ability to turn product requirements into structured test plans and high-value test cases. • Experience with functional, integration, API, end-to-end, and regression testing. • Strong understanding of defect severity, prioritization, release risk, and quality signoff. • Experience testing REST APIs using tools such as Postman, Bruno, Insomnia, or equivalent. • Ability to reason about authentication, permissions, retries, webhooks, pagination, rate limits, asynchronous workflows, and eventual consistency. • Comfort using browser developer tools, logs, API payloads, and network traces to investigate failures. • Working knowledge of SQL and the ability to validate data when debugging an issue. • Ability to write or maintain automated tests using JavaScript, TypeScript, Python, or a similar language. • Familiarity with tools such as Playwright, Cypress, pytest, or equivalent frameworks. • Understanding of CI/CD pipelines, automated quality gates, flaky-test management, and regression coverage. • You take ownership of quality problems and drive them through resolution. • You write precise, reproducible bug reports and communicate risk clearly. • You can work independently in an ambiguous, fast-moving startup environment. • You collaborate effectively with engineers, product managers, support teams, and other stakeholders. • You are consistently available and responsive during Pacific Time working hours. • Experience testing developer tools, SDKs, workflow automation products, or integration platforms. • Experience with OAuth, API keys, webhooks, and third-party application integrations. • Familiarity with AI agents, LLM evaluation, MCP, or tool-calling systems. • Experience testing across multiple browsers, devices, and operating systems. • Exposure to observability tools and production incident investigation. • Experience establishing QA practices or improving quality processes at an early-stage company.