Embedded Perception Engineer

Job description

ABOUT US: Havoc is a leader in all-domain collaborative autonomy. Its software-defined hardware approach powers military and commercial-grade autonomous systems across sea, air, and land to sense, decide, and act together in complex and contested environments. Havoc connects assets, enabling them to share information, adapt in real time, and continue operating even when communications are disrupted or denied. Havoc optimizes mission performance and minimizes human risk. Havoc was founded in 2024 and headquartered in Providence, Rhode Island. Learn more at Havoc: All-Domain Collaborative Autonomy http://havocai.com/ . ABOUT THE ROLE: As an Embedded Perception Engineer, you will own how our autonomous systems perceive and understand the world — in real time, in operational environments, and under demanding maritime conditions. This role goes beyond model training. You will architect, deploy, and optimize perception pipelines that run reliably on embedded edge hardware. You’ll work across vision models, sensor fusion, and high-performance inference to deliver robust situational awareness to autonomous surface vessels executing real-world missions. If you thrive in dynamic environments, enjoy squeezing maximum performance from embedded AI systems, and want to see your work field-tested and mission-proven, this role offers immediate and meaningful impact. KEY RESPONSIBILITIES AND REQUIREMENTS: PERCEPTION SYSTEM OWNERSHIP - Own end-to-end perception pipelines deployed to operational systems - Deliver high-reliability solutions aligned with mission requirements VISION MODEL DEVELOPMENT - Design, train, and optimize perception models for maritime environments - Develop object detection, classification, and tracking systems - Work with large vision models (ViT, CLIP, SAM, or similar) SENSOR FUSION & INTEGRATION - Fuse multi-modal sensor data (camera, radar, lidar) into unified perception outputs - Collaborate with hardware teams to select and integrate sensors - Develop and validate low-level sensor drivers for high-integrity data pipelines EMBEDDED DEPLOYMENT & OPTIMIZATION - Deploy models using NVIDIA Triton Inference Server - Optimize inference for latency and throughput on edge hardware - Apply quantization, pruning, and other optimization techniques CROSS-TEAM COLLABORATION - Integrate perception outputs into autonomy stacks alongside mission software and platform teams - Support troubleshooting of perception performance in operational environments FIELD PERFORMANCE & MONITORING - Define metrics and evaluation frameworks to monitor deployed system health - Investigate perception failures and drive resolution across teams END-USER ENGAGEMENT - Partner with operators and customers to translate field challenges into engineering solutions QUALIFICATIONS: - Bachelor’s or higher in Computer Science, Electrical Engineering, Robotics, Machine Learning, or related field - 3+ years developing and deploying computer vision or perception systems in C++ and/or Python on Linux - Experience with modern deep learning frameworks (PyTorch, TensorFlow) - Hands-on experience with large vision models (ViT, CLIP, SAM, etc.) - Experience implementing sensor fusion across heterogeneous modalities - Proficiency with NVIDIA Triton, TensorRT, ONNX Runtime, or equivalent inference tooling - Ability to quickly navigate and understand complex codebases - Strong systems-thinking mindset - U.S. Citizenship and eligibility for U.S. security clearance PREFERRED SKILLS: - Experience deploying perception systems on embedded platforms (Jetson, FPGA, similar) - Familiarity with maritime or aerial sensor environments - Experience optimizing models for edge inference - Knowledge of autonomy frameworks (ROS2, MOOS-IvP) - Experience with safety-critical or real-time systems - Familiarity with military systems and defense acquisition processes WHY THIS ROLE MATTERS You won’t just build models — you will build perception systems that operate in real-world, contested environments. Your work will directly influence the reliability, safety, and mission success of autonomous platforms deployed at sea. BENEFITS: - 100% Employer paid Health, Dental and Vision Insurance for you and your families - Life Insurance (Employer Paid) - Ability to participate in the companies 401k program (Matching) - Unlimited PTO policy with an enforced 2 week minimum - Equity Package - Work / Home Office Stipend - Global Entry - 16 Week Paid Parental Leave - Monthly Health and Wellness Stipend OUR VALUES: - Innovation: We are driven to break new ground. Every day presents an opportunity to challenge the status quo, think boldly, and deliver advanced solutions that transform the future of defense technology. - Integrity: We hold ourselves to the highest ethical standards, ensuring transparency, accountability, and trust in all our actions and partnerships. - Mission-Driven: We are focused on achieving impactful outcomes that align with our core mission—protecting lives through innovation. - Forward-Leaning: We continuously seek out new opportunities and remain at the forefront of technological advancements. We embrace change and anticipate the challenges of tomorrow with confidence and creativity. - Ownership of All Tasks: At HavocAI, no problem is too complex or too trivial. We believe that greatness comes from tackling the hardest challenges, but also in handling the smallest, sometimes thankless, tasks with the same level of commitment and care. - Servant Leadership: We lead by serving others, whether it’s supporting our employees, partners, or the broader community. Empowering those around us is key to achieving long-term success and making a lasting impact. HavocAI is an Equal Opportunity Employer and is committed to creating an inclusive and diverse workplace. We welcome applicants from all backgrounds and do not discriminate based on race, color, religion, gender, sexual orientation, age, national origin, disability, veteran status, or any other legally protected status.