Software Engineer III, Copilot Models Inference

About GitHub: GitHub is the world’s leading platform for agentic software development — powered by Copilot to build, scale, and deliver secure software. Over 180 million developers, including more than 90% of the Fortune 100 companies, use GitHub to collaborate, and more than 77,000 organisations have adopted GitHub Copilot.

Locations: In this role you can work from Remote, United States

Overview

As a software engineer at GitHub, you will enhance the collaboration experience at

GitHub by working closely with a community of engineers and designers with a

distributed, diverse and passionate team delivering the services that millions of

developers depend on. In this role you will design, prototype, implement, ship and

support highly performant and inspiring user experiences with your team.

The GitHub Copilot Models Inference team builds and operates the backend services

and APIs that connect Copilot experiences to AI model providers. These systems make

models available safely and reliably at global scale while managing the production

realities of provider integrations, request routing, service health, latency, capacity, and

changing model availability.

As a Software Engineer III, you will deliver production features end to end and help

operate the services you change. You will participate in design and code reviews, build

tests and operational safeguards, prepare changes for rollout, and use production

signals to improve reliability and performance. Clear communication matters on this

distributed team. You will work with engineers and partners across Models Lifecycle,

product, safety, infrastructure, and external model providers through a mix of live

conversations and thoughtful written updates. This is a hands-on individual contributor

role with opportunities to grow ownership through increasingly independent delivery. Responsibilities: * Design, implement, test, deploy, and maintain backend services and API