Test Automation Engineer

Job description

ABOUT THE COMPANY Overview.ai http://Overview.ai is transforming manufacturing quality control with an advanced edge-enabled AI vision system that combines cutting-edge deep learning with ease of use and quick setup. Our system handles a wide array of inspection tasks—from subtle assembly verification to defect detection and orientation checks—delivering real-time, high-accuracy inspections that seamlessly integrate into existing production lines. Trusted by leading manufacturers like Ford, Honda, Toyota, SpaceX, Milliken, and Flex-N-Gate, our cameras enable faster throughput, reduced scrap, and lower inspection costs—without the complexity and expense of traditional vision systems. ABOUT THE ROLE We are seeking a Test Automation Engineer to own the automated test system that our entire engineering organization ships against. As we move to a regular release cadence with nightly end-to-end runs against our main branch, the reliability of that automation is the reliability of our releases — and this role is accountable for it. You will own the shared test system end-to-end: the nightly E2E pipelines that exercise real hardware, the CI/CD orchestration that gates every release, and the physical test rig — environmental chamber, device testbed, and hardware lab — that all of it runs on. This is a build-and-operate role at the intersection of automation software and physical hardware: you make the test system fast, trustworthy, and never flaky, so every squad can ship with confidence. This is distinct from SDETs, who write the tests for their own squad's features. You own the platform they build on — the frameworks, fixtures, device pools, and Hardware-in-the-Loop (HIL) infrastructure — plus the cross-squad E2E and release gates that no single squad owns. WHAT YOU'LL DO Own the nightly E2E system: Design, build, and operate fully automated end-to-end pipelines that run every night against our main and beta branches — driving synthetic video into real NVIDIA Jetson devices, triggering on-device inference, and validating the inference results through PLC / physical outputs. Keep it green and keep it trustworthy. CI/CD test orchestration & release gating: Own the test automation woven through our CI/CD pipelines. Wire the test gates into our regular release cadence and code-freeze week so that "the build is green" is a claim the whole team can trust. Kill flakiness: Treat test health as a product. Build the detection, quarantine, triage, and reporting / observability that keep a large automated suite reliable at scale — parallelized, deterministic, and fast. Build & operate the physical rig: Stand up and scale the shared physical test capability — environmental chamber, device testbed, hardware lab, and HIL infrastructure — that simulates factory conditions and stress-tests real camera systems under real-world compute, memory, and thermal constraints. Production & build-test automation: Own the automated tests that validate the physical signal path before a unit ships — PLC communication (Profinet / EtherNet-IP), digital I/O, and HDMI / display outputs — plus the production / build bring-up automation that verifies every device against spec. Enable every squad: Provide the frameworks, fixtures, harnesses, and device pools that squad SDETs build their tests on. You are a force multiplier for quality across the whole org, not the author of any one squad's tests. System-level debugging: When the nightly run goes red, chase failures across physical hardware, custom baseboards, Linux OS kernels, local network protocols (TCP/IP, RTSP), and edge Docker containers — and turn each one into a durable, automated regression guard. WHAT WE'RE LOOKING FOR - 5+ years in test automation, SDET, or software engineering, with a proven track record of owning an automated test system end-to-end at a Senior or Staff level. - Expert proficiency in Python for building automation frameworks, device-interaction tooling, and test harnesses. - Deep hands-on experience with CI/CD systems (e.g., GitHub Actions, Jenkins, GitLab CI) — building test pipelines and release gates, not just consuming them. - A demonstrated track record of keeping large automated test suites reliable — flaky-test management, parallelization, deterministic fixtures, and test observability. - Hands-on experience with the NVIDIA Jetson ecosystem or similar resource-constrained embedded Linux systems, and with Hardware-in-the-Loop (HIL) or physical device-lab automation. - Hands-on experience with industrial automation and industrial network protocols (PLC, EtherNet/IP, etc.) and hardware I/O (digital I/O, HDMI / display outputs) — the physical signal path our systems are validated against. - Professional experience with, or a strong passion for, using AI agent tools to architect solutions and solve difficult technical problems efficiently. - Excellent problem-solving skills with an independent ownership mindset and the ability to confidently navigate ambiguity in a hardware-software co-design environment. NICE TO HAVE - Experience validating computer vision applications, OpenCV, or real-time video processing streams. - Experience building test dashboards / observability for suite health and release readiness. - Experience managing device farms or lab automation at scale. WHY JOIN - High Agency, Zero Bureaucracy: You are coming in as a senior engineer, not a ticket-taker. You define the test architecture. You pick the tools. You decide how we validate our products. We hire smart people and get out of their way. - High Autonomy: We believe in highly autonomous and creative builders. You will have high ownership over the test system the entire company ships against. - Work Smarter, Not Harder: We don't just build AI; we use it. We love that you want to use AI agents to solve problems. We don't measure hours; we measure leverage. If you can use an AI agent to automate 80% of the grunt work, we'll high-five you, not ask why you aren't typing. - Growth: Join a fast-growing, fast-moving, and profitable startup.