Member of Technical Staff - AI Platform Engineer

Responsibilities

The AI Platform Engineer sits between research and engineering, turning research workflows into services that other teams can self-serve. The work centres on building and operating the several internal platforms that the research and engineering teams rely on daily. These are production products with real users — backends, dashboards, CLIs and SDKs — built for colleagues inside the company rather than for an abstract audience.

The second half of the role is the foundation those platforms stand on: deploying models and keeping them served, both on managed inference providers and on internally operated GPUs, together with the cluster services that make GPU capacity self-serve rather than a matter of negotiation. This is a hands-on, delivery-oriented platform position rather than a research one: the emphasis falls on the systems and tooling that make other teams' work possible. Model training is part of the surrounding environment and remains accessible, but it is not the focus of the position.

In this role, you will:

• Building and operating the internal platforms end to end — backends, storage, dashboards, and the CLI and SDK surfaces they are driven through — including multi-tenancy, sign-in and access control.
• Owning workload orchestration on the GPU clusters and the services around them — submission and scheduling, provisioning, quotas and placement.
• Deploying models and keeping them served, on managed inference providers and on internally operated GPUs — sizing each deployment for its hardware, and writing serving wrappers where no off-the-shelf engine fits.
• Building the evaluation surface, so that a result stays comparable across months, colleagues and models.
• Establishing and hardening CI/CD, containerized workflows and release safety.
• Instrumenting the platform with logging, metrics and alerting, so that divergence between what a service promises and what it serves is caught by a test rather than by a customer.
• Adding agent surfaces to the platform, with whatever an agent resolves written back as auditable configuration.
• Partnering with research engineers to productionize their experiments, and carrying production issues through to resolution — including on-call for systems built in this role.

Qualifications

"The number one qualification to succeed in this machine learning course is gumption” - John Lafferty, CS Professor at Yale

Above all, we look for a proactive mindset, willingness to learn, unlimited energy, and relentless optimism. You are a great fit if you have a background in the following:

• Several years of hands-on experience building and operating production applications.
• Strong backend engineering in production-grade Python — API design, async services, relational databases and object storage.
• Hands-on experience deploying and serving models in production, on managed inference providers and on self-operated GPUs, with at least one modern LLM serving stack.
• Experience running workloads on shared GPU clusters through a scheduler such as Slurm, and working knowledge of cloud GPU infrastructure.
• Experience with CI/CD, containerized workflows and Kubernetes.
• Experience with MLOps and LLMOps tooling — model registries and hubs such as HuggingFace, experiment tracking and monitoring such as Weights & Biases, and deployment telemetry.
• Experience with production observability and on-call operation — logging, metrics and alerting.
• Experience with modern agentic frameworks.
• A BS, MS, or PhD in Computer Science, Machine Learning, Software Engineering, or a related quantitative field.
• Clear written and verbal communication, and experience collaborating cross-functionally with research, product and platform teams.
• Strong integrity, sound judgment, and respect for others.