Senior AI Serving Engineer, Backend
Sciforium
San Francisco, CA · San Francisco · United States
Posted Nov 15, 2025
$190,000–$250,000 per year
- Full-time
- Engineering
Job description
Sciforium is an AI infrastructure company developing next-generation multimodal AI models and a proprietary, high-efficiency serving platform. Backed by multi-million-dollar funding and direct sponsorship from AMD with hands-on support from AMD engineers the team is scaling rapidly to build the full stack powering frontier AI models and real-time applications. ## **About the role** This role offers a unique opportunity to work on the core systems that power Sciforium’s multimodal AI models. You’ll help build the model serving platform working across C++, Python, runtime execution, and distributed infrastructure to create a fast, reliable engine for real-time AI applications. You’ll gain hands-on experience with performance engineering, learn how large AI models are optimized and deployed at scale, and collaborate closely with ML researchers and experienced systems engineers. If you enjoy low-level programming, care deeply about performance, and want exposure to the full AI stack, this role provides both high-impact work and strong growth potential. ## **What you'll do** - Build the model serving platform, including API, Control Plane, Billing, Monitoring, and distributed inference features. - Collaborate with ML researchers to integrate new multimodal models into production workflows. - Write reliable, maintainable code with strong testing and documentation practices. - Provide operational support for keeping our production services highly performant, available and reliable - Help troubleshoot complex issues across runtime, service, and GPU layers, working closely with other engineers. ## **Ideal candidate profile** - Bachelor’s degree in Computer Science, Engineering, or a related technical field (or equivalent practical experience) - 3+ years of software engineering experience, with a focus on infrastructure or machine learning systems. - Strong proficiency in C++/Python/Go/Rust - Experience with Kubernetes, Containerization - Experience in building large scale ML/MLOps infrastructure - Strong collaboration and communication skills, with the ability to work effectively across engineering and ML teams. - Comfortable working from the office and contributing to a fast-moving, high-ownership team culture. ## **Nice-to-have** - Experience with ML systems engineering, open source inference engine like vLLM, Sglang, or TRT-LLM - Proficiency in CUDA or ROCm and experience with GPU profiling tools - Contributions to open-source ML or HPC infrastructure ## **Benefits include** - Medical, dental, and vision insurance - 401k plan - Daily lunch, snacks, and beverages - Flexible time off - Competitive salary and equity ## **Equal opportunity** Sciforium is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.