Software Engineer, GPT Infrastructure

Hardware - San Francisco and Seattle

About the Team

The GPT Infrastructure team builds systems that turn advances in model inference and optimization into reliable production capabilities. We enable OpenAI workloads to be qualified and optimized across new accelerator platforms without requiring a one-off port and tuning effort for every hardware target.

Our work spans distributed systemsance engineering, secure partner integrations, evaluation systems, and developer tooling. We build the infrastructure that makes optimization workflows automated, reproducible, and trustworthy.

About the Role

We are seeking a software engineer to help build the platform that qualifies and optimizes inference workloads across heterogeneous compute environments.

You will develop both OpenAI-hosted services and secure partner-side software for running long-lived optimization workflows. These workflows generate candidate kernelsance; and use the results to guide further optimization.

You will work across model architecture, distributed execution, compilers, runtimes, networking, and accelerator systems. A central part of the role is turning research prototypes and one-off hardware bring-up efforts into reliable, reusable infrastructure with clear contracts, reproducible results, strong observability, and well-defined security boundaries.

Key Responsibilities

• Design, build, and operate APIs and control-plane services for long-running workload qualification and optimization campaigns, including scheduling, retries, checkpointing, resource budgets, and observability.
• Build secure partner-side execution and evaluation software that can compile, run, verify, profile, and benchmark candidate artifacts on accelerator hardware.
• Integrate model workloads.
• Develop correctness and performance evaluation systems spanning output fidelity, latency, throughput, memory footprint, accelerator utilization, communication e