3D/AR/VR Software Engineer

Job description

[FieldAI](https://www.fieldai.com/) is transforming how robots interact with the real world. Our growing R&D team is based in Boston, where we develop risk-aware, reliable, field-ready AI systems that tackle the hardest problems in robotics and unlock the potential of embodied intelligence. We take a pragmatic approach that goes beyond off-the-shelf, purely data-driven methods or transformer-only architectures, combining cutting-edge research with real-world deployment. Our solutions are already deployed globally, and we continuously improve model performance through rapid iteration driven by real field use. FieldAI robots reconstruct and interact with the physical world to unprecedented levels. This asks for an unprecedented user experience. Therefore, we are hiring a **3D/AR/VR Software Engineer** in support of our humanoid UI/UX team. In this role, you will implement, integrate, maintain, and support AR/VR applications that enable supervision, manipulation, and locomotion capabilities for humanoid robots. You will help turn new robotic capabilities into reliable, maintainable, user-facing systems that can be deployed, evaluated, and operated on real robots. Your work will span design, prototyping, UI implementation, and robot integration, user-study-based evaluation. You will draw on your expertise on input and interaction design, rendering, to build innovative 3D interfaces for robotics. ### What You Will Get To Do **Set Research Vision and Strategy** - Define and execute the robotics AI research roadmap in alignment with FieldAI’s mission and product goals. - Identify emerging research directions, tools, and techniques across robotics, embodied AI, and machine learning. - Establish clear technical goals, milestones, and success metrics tied to real-world robot performance. ### **Design and Implement Interactive Workflows in AR/VR** - ### Design and implement intuitive 3D workflows for supervising, manipulating, and controlling humanoid robots in AR/VR. - ### Build interaction techniques for spatial input, visualization, teleoperation, task specification, and robot feedback. - ### Prototype, evaluate, and iterate on new interaction concepts through user studies and deployment on real robotic systems. ### **Integrate the UI with the Robot** - ### Integrate AR/VR applications with robot perception, planning, manipulation, locomotion, and control systems. - ### Build robust interfaces for exchanging commands, state, sensor data, and 3D scene representations between robots and user-facing applications. - ### Debug and optimize end-to-end system behavior across headsets, networks, compute infrastructure, and robotic hardware. ### **Deploy and Support Systems in the Real World** - ### Turn research prototypes into reliable, maintainable applications that can be deployed and operated on real robots. - ### Develop tooling, testing, monitoring, and deployment workflows that support repeatable operation across robots and environments. - ### Diagnose failures in the field and continuously improve system performance, reliability, usability, and robustness. ### **Collaborate Across Disciplines** - ### Work closely with researchers and engineers across perception, planning, control, manipulation, and hardware. - ### Translate new robotic capabilities into user-facing workflows and identify interface requirements that inform system design. - ### Contribute to technical design discussions, code reviews, experimentation, and the development of software infrastructure. ### What You Have - Bachelor’s or Master’s degree in Computer Science, Human-Computer Interaction, Game Development, Creative Technology, Design, Robotics, Electrical Engineering, or a related field. - Strong programming skills in C#, C++, or a different relevant language - Experience designing, implementing, testing, and maintaining production-quality software. - Experience working with Unity, Unreal, git, containers, build systems, and continuous-integration workflows. - Experience working with Meta Quest, Apple, Varjo or comparable headsets - Strong debugging skills across complex, interactive, distributed, and performance-sensitive systems. - Ability to understand prototype code and convert it into maintainable, reliable implementations. - Ability to work effectively in a fast-paced, highly collaborative environment. - Ownership, attention to detail, and a strong focus on reliability and usability for software evaluated by end users. ### The Extras That Set You Apart - Experience with robots. - Experience integrating software with physical systems, sensors, or real-time processes. - Experience with teleoperation systems or human-in-the-loop industrial user interfaces. - Experience with safety-critical user interfaces or workstations (aircraft cockpits, driver/operator cabs) - Experience designing and administrating user studies for ergonomics and human factors. - Experience with gloves or other forms of haptics for AR/VR applications. - Experience integrating systems with ATAK