Senior QA Engineer, Agent Security

Job description

ABOUT RUNLAYER AI is transforming how every company operates, but most enterprises are stuck. They want to move fast with AI Agents, tools, and workflows, but they can't do it safely. We're fixing that. Our team built AI Actions for OpenAI, shipped Zapier Agents to millions of users, and launched the first remote MCP server with Anthropic. We helped establish the protocol, and now we're building the platform enterprises need to actually put AI to work. Runlayer is one platform for MCPs, Skills, and Agents: purpose-built security, fine-grained governance, and complete observability so organizations can go all-in on AI across the entire company without the risk. We just raised a $30M Series A led by Felicis, with participation from Khosla Ventures, bringing our total raised to $42M. Already trusted by Gusto, Instacart, Opendoor, dbt Labs, and Decagon. ABOUT THE ROLE You’ll own quality and testability for Runlayer Endpoint across macOS, Windows, Linux, enterprise device-management platforms, and AI clients. This is a senior, hands-on engineering role combining exploratory testing, release qualification, and test-infrastructure development. You’ll build scalable, agent-driven testing systems for a complex cross-platform product and help ensure every release is reliable in real enterprise environments. WHAT YOU’LL DO - Own release testing and quality for Runlayer Endpoint - Build and operate a physical and virtual device lab - Design a scalable test strategy across platforms, configurations, clients, and product states - Automate installation, enrollment, configuration, upgrade, rollback, and removal flows - Test deployments through enterprise device-management platforms - Validate integrations with leading AI coding clients - Build agent-driven tooling that expands coverage, gathers evidence, and accelerates failure analysis - Integrate automated quality signals into CI and release workflows - Reproduce customer issues and turn confirmed incidents into permanent regression tests - Partner with engineers to improve product diagnostics, observability, and testability - Define testability and coverage standards for new platforms, clients, and features WHAT WE’RE LOOKING FOR - Senior-level experience owning QA automation or test infrastructure - Strong engineering skills in Python and system scripting such as Bash and PowerShell - Hands-on experience testing software across macOS, Windows, and Linux - Experience with endpoint management, MDM, device labs, or comparable fleet orchestration - Experience testing native installation, upgrades, background services, permissions, credentials, and OS configuration - Strong knowledge of integration, end-to-end, stateful, and combinatorial testing - Ability to distinguish product defects from infrastructure failures and flaky tests - Experience building reliable CI-driven systems with useful diagnostics and test artifacts - Clear technical judgment and excellent bug reporting BONUS QUALIFICATIONS - Experience with Intune, Jamf Pro, Kandji, SimpleMDM, Mosyle, or Workspace ONE - Experience testing endpoint-security or fleet-management products - Familiarity with MCP and AI coding clients - Experience building testing tools for AI agents - Experience with native packaging and signing on macOS, Windows, or Linux - Experience with fault injection, change-impact analysis, or combinatorial test generation WHAT WE OFFER We provide a competitive package designed to attract and retain top talent who can work effectively with enterprise customers. - Competitive salary and equity — compensation that reflects your expertise and customer-facing responsibilities. - Paid time off — paid vacation, paid sick leave, and paid parental leave. - Professional development — budget for conferences, courses, and certifications in AI, enterprise software, and customer success. - Top-tier equipment — your choice of laptop and accessories to create your ideal work environment. - Health benefits — comprehensive health, dental, and vision coverage. - Customer interaction opportunities — work directly with innovative companies and see the immediate impact of your work. Not quite the right fit? Reach out to careers@runlayer.com careers@anysource.com with details about your experience and interests.