Member of Technical Staff - Distributed Systems

Job description

About Us Gimlet is building the first multi-silicon neocloud designed for fast, efficient inference. As AI workloads become more complex and new hardware architectures emerge, simply deploying more GPUs isn't enough. The challenge is making increasingly diverse compute work together. Gimlet's platform intelligently partitions and routes workloads across heterogeneous hardware, enabling step-function improvements in performance and efficiency. Customers deploy through production-grade APIs without needing to think about hardware selection, placement, or optimization. We work with foundation labs, hyperscalers, and AI-native companies to power production workloads at massive scale and help define the infrastructure layer for the future of AI. This gives our team access to systems research problems grounded in frontier models, cutting-edge production workloads, and emerging hardware architectures. ABOUT THE ROLE At Gimlet, we believe every hire changes the company. As a an early-stage company, talent density matters more than headcount. The engineers we hire today will shape the systems, culture, and standards that define Gimlet for years to come. The future of AI infrastructure will not be built on a single hardware platform. It will be built on systems capable of coordinating increasingly heterogeneous compute at unprecedented scale. This role is an opportunity to help build that future. We are not optimizing for headcount, we are optimizing for talent density. You will design and operate the distributed systems that schedule, route, and coordinate AI workloads across thousands of nodes and diverse hardware architectures. WHAT SUCCESS LOOKS LIKE In the first 12-18 months, you will help: - Build scheduling and orchestration systems that coordinate workloads across heterogeneous hardware - Improve reliability and fault tolerance for production AI infrastructure operating at scale - Create APIS and control planes that simplify deployment for customers running mission-critical workloads - Influence the architecture of a platform that will power the next generation of AI systems YOU MAY BE A GOOD FIT IF - Strong software engineering fundamentals - Experience building or operating distributed systems in production environments - Comfort reasoning about concurrency, failure modes, and tradeoffs in large-scale systems - Bachelor's degree in a relevant field, or an equivalent combination of education, training, and professional experience. STRONG CANDIDATES MAY ALSO HAVE - Experience with Kubernetes or Kubernetes-adjacent systems beyond basic usage - Experience designing service-oriented architectures using RPC or asynchronous messaging - Familiarity with scheduling, queues, or resource management systems - Experience building reliable APIs and operating systems under high load - Software development experience in languages commonly used for systems development (e.g., Go, C++, Python) Why join now? Gimlet is at the very beginning of its journey, and that's what makes this moment special. Most AI infrastructure companies are focused on deploying more compute. We are focused on making increasingly diverse compute work together, and that ambition touches every part of how we build and run this company. As an early member of the team, you will have significant ownership over your work, partner directly with a small group of highly capable people, and help shape not just what we build, but how we scale the company. We value people who are excited to work across domains, take ownership of meaningful problems, and help define what Gimlet becomes over the next several years. Agency Policy: Gimlet Labs does not accept unsolicited resumes from recruitment agencies or search firms. Any unsolicited resumes submitted without a signed agreement will be considered the property of Gimlet Labs, and no fees will be paid.