Software Engineer - GitHub Copilot API

Job description

**Overview** GitHub is looking for a Software Engineer II (L62) to join the Copilot API Platform Frameworks team. This role focuses on building and maintaining backend services and APIs that power GitHub Copilot and its integrations, with an emphasis on sound technical design, service performance, reliability at scale, and intelligent LLM request routing. The ideal candidate has experience building and operating distributed systems in production and enjoys working close to the details of system behaviour, latency, and failure modes. You will contribute to technical designs for the features you own, clarifying requirements, proposing approaches, and making pragmatic trade-offs, while partnering with senior engineers to align with broader platform architecture. You care about building services that are observable, efficient, and resilient, and about designing routing and orchestration layers that optimise quality, speed, and cost. As a Software Engineer III on the Copilot API team, you will collaborate with a distributed, diverse group of engineers, product managers, and AI-focused partners across GitHub to deliver improvements that other engineers can depend on. You will help design, implement, and iterate on APIs and service components that underpin Copilot’s scalability, reliability, and intelligence, taking responsibility for a defined area while coordinating dependencies and rollout plans with your team. You will contribute through hands-on implementation, clear design communication, and strong collaboration. You’ll write and review design docs for your work, define success metrics (e.g., latency, error rate, throughput, routing quality, and cost efficiency), and improve performance and reliability through testing, safe deployments, and monitoring. You will participate in on-call and first responder rotations, resolving issues within SLOs and escalating when needed, and help continuously improve the resilience and maintainability of the services you touch. At GitHub, we value developer empathy, transparency, and inclusive collaboration, and we work iteratively with a bias toward action and impact. **Responsibilities** - Design, develop, test, and ship high-quality technical solutions that scale across multiple GitHub services. - Build and evolve LLM routing/orchestration capabilities (e.g., model/endpoint selection, fallback, retries, guardrails, and request shaping) to optimise user experience, quality, latency, and cost. - Design and implement APIs and service components that support Copilot integrations and intelligent inference pathways. - Collaborate cross-functionally with engineering, product, and applied AI partners to define and deliver innovative solutions. - Own and advocate for system health and quality, including participation in on-call and first responder rotations. - Write architecture briefs and proposals, run experiments/prototypes, and use production signals to drive iterative improvements. - Define and track success metrics, including platform reliability metrics (SLOs) and routing effectiveness metrics. - Use CI/CD and safe deployment practices to deliver changes confidently and quickly. - Mentor peers through technical leadership, pairing, and thoughtful code/design reviews. - Become intimately familiar with the systems you build and take pride in writing maintainable code. **Qualifications** **Required Qualifications:** - Degree in Computer Science or related technical field, OR equivalent experience. - Demonstrated technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Go, Ruby, Rust, or Python OR equivalent experience. **Preferred Qualifications:** - Experience in one or more scripting languages (e.g., Bash, Python, or a similar language). - Experience using general purpose programming languages (e.g., Go, Ruby, or a similar language). - Experience with cloud environments and/or Cloud Native Compute Foundation (CNCF) concepts. Software Engineering IC3 - The typical base pay range for this role across Czechia is Kč 966,000.00 - Kč 1,727,000.00 per year. Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled. --- Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about [**requesting accommodations.**](https://careers.microsoft.com/v2/global/en/accessibility.html)