Senior Quality Automation Engineer

**Does redefining what Quality looks like in the age of AI — on a brand-new AI product — make you tick?** At Re-Leased our vision is to shape the future of Commercial Real Estate and drive better outcomes for people, property and planet. We're now building **am:pm** — an agentic AI product for commercial real estate operators. Property managers run their portfolios on a system of record like Re-Leased, but most of the actual work happens outside it — emails, phone calls, follow-ups, to-do lists scattered across tools, with no system behind them. am:pm is the system of action for that work: it captures the work to be done as jobs and tasks, grounded in the communication channels, memories, and documents that surround the portfolio — so the work itself finally has a home. You can read more at [](https://ampm.ai/). am:pm is in early access with customers right now. The squad is small, the stack is new, and we're moving fast. ## Your Role We're looking for a senior quality automation engineer to own the quality system for am:pm — based in Napier or remote from another city in New Zealand. The whole squad owns quality; you build the automation, quality controls, and practices that make that possible. This is an automation-led role: engineers write unit and integration tests, and you shape where automated coverage sits across the test pyramid and steward the end-to-end suite, with AI as a core part of how you work — generating tests, triaging failures, creating test data. We're also moving to continuous delivery, and a core part of this role is making that safe — the right level of automated quality controls so changes flow to production with confidence. And because am:pm *is* an AI product, quality means testing agentic behaviour: non-deterministic outputs, tool use, statistical rather than binary correctness. Engineers write the evals — just as they write unit and integration tests — and you bring the quality lens: when evals are the right control, and what they need to catch. This is a small-team, start-up environment inside an established SaaS business — less process, more agency, and a tight feedback loop with real customers. ## Your Responsibilities - Drive quality automation across the test pyramid — set where coverage sits so tests run at the layer that's cheapest and most reliable — and steward the end-to-end suite: curate what earns a place in it, and set the standards engineers follow when contributing tests of their own - Support our move to continuous delivery — design the right level of automated quality controls (pipeline gates, smoke checks, release signals) so we can release frequently without slowing the flow of change - Use AI tooling as a first-class part of your workflow — test generation, bug triage, test data creation — and keep raising the bar on how the team uses it - Curate AI-generated tests and findings — decide what to keep, reject, or refine, applying your own testing judgment rather than accepting output wholesale - Shape how we test AI-powered features — advise on when evals are the right quality control and what they should cover, and contribute adversarial and edge-case scenarios; engineers write and own the evals themselves - Partner with engineers on acceptance criteria and coach them on designing test scenarios from a user's perspective — positive paths, negative paths, edge cases - Run exploratory and risk-based testing to find what automation misses, and feed production bugs back into automation at the layer that would have caught them - Analyse quality workflows — triage, release, escape defects — and drive structural improvements, reporting on quality signals so the squad always knows where quality stands ## Your Experience - 5+ years of QA experience in a SaaS product environment, with automation at the centre of how you work - Track record of designing test automation frameworks from the ground up — architecture, tooling choices, conventions — and building the JavaScript/TypeScript end-to-end suites (e.g. Playwright, Cypress) that run on them - Comfortable working in a production codebase — Git, branches, PRs, code review — and able to read code well enough to locate and understand the surface under test - CI/CD fluent — you understand what runs when and where tests fit, with a clear point of view on the quality controls that make continuous delivery safe: pipeline gates, smoke checks, rollback signals - Actively using AI tools in your workflow today — and opinions on where they're strong and where they aren't - Genuine interest in testing AI products: you've thought about (or worked on) how to test non-deterministic systems, and evals excite you rather than scare you - Strong exploratory testing instincts and sound test-pyramid judgment — you find the bugs automation can't, and you know where automation investment pays off and where it doesn't - Comfortable with ambiguity, change, and making calls with incomplete information — you're drawn to small teams and early-stage product work - A genuine focus on the customer outcome, not just the test count ## Bonus - Experience with LLM eval frameworks — golden datasets, judge models, statistical thresholds - Experience with adversarial testing of AI systems — prompt injection, jailbreaks, hostile inputs - API testing chops (REST), performance or accessibility testing experience - Prior start-up or zero-to-one product experience ## Our Stack & How We Work am:pm is built on .NET 8, Vue 3, SQL Server and a growing set of AI services on Microsoft Azure. The squad manages its own DevOps — Terraform for IaC, Azure DevOps for pipelines. We've woven AI tooling deeply into how we work; if you're excited by the idea of testing AI-native software *and* using AI to test it, you'll fit right in. **Our culture** is very important to us too, and we strongly believe in living out our core values: - **People First**: One team globally; our people and customers always come first. - **Find a Way**: Like a river, we find a way around all obstacles - **Win or Learn:** Our journey for improvement never ends; enjoy the ride! - **Aim High:** We dare to set big goals and love the challenge of achieving them against the odds. **Why you’ll love working here!** **Taking care of you:**Including comprehensive health insurance, access to a premium EAP service and an annual wellness allowance to spend on what helps you feel good - whether that’s towards a gym membership, new running shoes, or mindfulness apps. **Support for families:**Generous paid parental leave and flexible, family-friendly support designed to help growing families balance work and life with confidence. **Recognition for tenure and milestones:**We celebrate time, commitment, and contribution with milestone rewards and additional leave as you grow your career with us. **Flexible working, built for a global team:**With customers and teammates across New Zealand, Australia, the United Kingdom, and North America, we work in a hybrid, remote-friendly way with collaborative offices and the flexibility of a balanced approach to WFH/i-office work. **Ready to Level Up?** Join us and help shape the future of real estate at one of the most exciting SaaS companies born from New Zealand. [](http://www.re-leased.com/)