Skip to content
DevOps Jobs

Platform Engineer - Self Hosting LLMs built with GO

PhysicsX

Location
Onsite (London, England)
Employment
Full-time
Level
Senior Level
Posted 2 weeks ago

About the role

PhysicsX is a physics AI company re-engineering industrial manufacturing through deep simulation software. This role involves building and operating a production LLM access layer that serves self-hosted open models and routes workloads based on cost, quality, and data sensitivity.

Skills

LLM Inference Serving Model Routing Go Python Kubernetes GPU Workloads vLLM SGLang KServe Distributed Systems Performance Profiling Autoscaling Observability Model Quantisation Production Reliability Air-Gapped Deployments

Full job details