Data Loop Pipeline Engineer

Job description

**Merlin (NASDAQ: MRLN)** is a publicly traded aerospace and defense company building a non-human pilot to deliver full-stack autonomy for any aircraft from takeoff to touchdown. The Merlin Pilot autonomy system powers a growing range of aircraft and mission profiles and has been proven through hundreds of autonomous flights from Merlin's global flight test facilities, including Kerikeri, New Zealand; Smithfield, Rhode Island; and soon, Bedford, Massachusetts. Headquartered in Boston, Merlin is expanding its organization to accelerate the development and deployment of its autonomy platform, helping customers solve some of aviation's most pressing challenges, from pilot shortages to improving flight safety. Backed by some of the world's leading investors prior to its public listing, Merlin continues to advance the certification and commercialization of autonomous flight across commercial and defense aviation. ### About You: You think data infrastructure is a craft. You have built pipelines that ran unattended for months and you have felt the specific satisfaction of a dataset that is exactly what it claims to be. You'd rather prevent a data problem than debug a model trained on one. You will own the machinery that turns flight and simulation output into trustworthy, versioned, traceable training data — and turns deployed behavior back into the next training set. ### Responsibilities: - Build and operate ingestion pipelines for flight test, simulation and operational data, including format normalization, time alignment across sources, and quality validation at the gate. - Implement dataset curation and versioning with full lineage: what went into a dataset, from where, processed how, and by which version of which tool. - Build automated mining and triage for the rare and interesting — anomalies, disagreements between learned and rule-based systems, near-boundary events — so the flywheel prioritizes signal over volume. - Own labeling workflows and tooling, including quality control and inter-annotator agreement where human labeling is involved. - Close the loop: instrument deployed-system behavior so that operational signal reliably reaches the next training cycle without manual shepherding. - Work with Flight Test & Operations on logging and instrumentation requirements, and help resolve access constraints where data is captured by third-party systems. - Monitor pipeline health and dataset coverage; alert on drift, gaps and silent breakage. ### Qualifications: - Degree in Computer Science, Artificial Intelligence, Data Science, Computer Engineering, Applied Math, or a related subject. - 3+ years in data engineering, with production ownership of pipelines feeding ML training. - Strong Python and SQL; solid grasp of data modeling, storage formats and processing frameworks. - Experience with dataset versioning and lineage tooling. - Comfort with high-volume time-series and multimodal sensor data — telemetry, video, audio, structured logs. - Care about correctness. In this role a quiet data bug becomes a model behavior nobody can explain. ### Nice to Have: - Robotics, autonomous vehicle or aerospace data experience. - Familiarity with flight data formats and avionics bus data. - Experience building internal tools that engineers actually chose to use. - Data governance or provenance work in a regulated environment. ### Logistics: - We welcome remote applicants for this role, with a preference for candidates based in or willing to relocate to Boston, MA for a hybrid work schedule at our HQ.