Robotics Engineer - Perception

Job description

At TerraFirma, we’re redefining how the world moves earth for construction. Founded by former SpaceX engineers and backed by Kleiner Perkins and Bain Capital Ventures, TerraFirma is automating construction to make it faster, cheaper, and safer. Our Story & Mission At SpaceX, we were part of the teams that built the largest rocket in human history, launched the largest constellation of satellites ever made, and delivered connectivity to millions of people worldwide. What we learned was simple: infrastructure is everything. At Starbase, the biggest barrier to launching missions to Mars was not building the rocket. It was how slow, expensive, and complex it was to build the infrastructure around it. We lacked buildings, roads, water, power, communications, and waste management, and constructing them took far more time and resources than it should have. From a first-principles perspective, that doesn't make sense. It shouldn't be this hard or costly to create the foundations for progress. That’s when we realized something important: the same engineering mindset that enabled us to tackle space exploration and mass manufacturing could be applied to infrastructure. By bringing the principles of simplification, iteration, acceleration, and automation to construction, we can unlock a new era in how the world builds. Accelerating infrastructure unlocks progress across every domain, creating a self-sustaining engine for tackling humanity’s toughest challenges. The innovations we develop on Earth will lay the groundwork for the technologies that one day make settlement on Mars possible. Job Overview You will design and implement the perception systems that give our automated heavy machinery the awareness needed to operate effectively in complex, unstructured environments. This role combines high-level architecture decisions with hands-on algorithm development, hardware integration, and field testing. You will work across the perception stack, from integrating and calibrating advanced sensors to building real-time processing pipelines for images, point clouds, and other high-bandwidth data streams. Your work will power critical functions such as collision avoidance, motion planning, localization, and operator visualization. Responsibilities - Integrate multi-spectral and TOF sensors into robotic systems with real-time processing constraints - Work with motion and trajectory planning teams to design and synthesize sensor systems to extract required signals and inputs - Implement algorithms to efficiently detect objects of interest from incoming data streams for the purposes of collision avoidance, motion planning, and trajectory planning - Stitch together and manipulate camera feeds and data from other sensors to effectively visualize the state of physical systems to human operators - Develop real-time pipelines for processing, sharing, and fusing data from multiple sensor sources - Train Machine Learning (ML) models on existing and custom datasets and support collection and labeling of data for additional training and validation - Develop simulation and visualization tools to aid in rapid prototyping of robotic software and control algorithms - Own the integration, calibration, and testing of sensors, both for proof-of-concept prototypes and production systems - Lead interdisciplinary teams, mentor new employees, and actively participate in the hiring process Basic Qualifications - B.S. in Robotics, Mechanical Engineering, Physics, Computer Science, Electrical Engineering, or a closely related field - 2+ years of professional or project experience with robotic software development, involving implementation of real-time algorithms for perception and data processing pipelines - Demonstrated experience owning large-scale deliverables, leading teams, and driving product roadmaps Preferred Skills & Experience - Experience working with safety-critical or real-time systems - Experience working with embedded applications for robotics, autonomous vehicles, aerospace, automotive, or construction - Proficiency in C++ and Python, including development for Linux-based systems and bare-metal MCUs - Experience training, testing, optimizing, and deploying online and offline machine learning models with existing and custom datasets - Experience implementing algorithms or pipelines for robotic systems or feedback control from scratch in C++ or Python - Experience performing object detection on multiple data sources including multi-spectral images and point clouds - Experience programming FPGAs for high-throughput networking, compression, or DSP Additional Requirements - Must be willing to work extended hours or weekends when needed to support critical deadlines or triage urgent deployment issues - Comfortable with working in a fast-paced startup environment - Must be willing to relocate to Austin, TX if not within commuting distance Compensation & Benefits Base compensation will vary based on factors such as relevant experience and education. Salaries and leveling will be determined on a case-by-case basis if an offer is extended. Our total compensation package also includes equity in TerraFirma. Relocation packages are available to help cover moving costs, if applicable.