ML Infrastructure Engineer
Alpaca Research
- Location
- Onsite (Cambridge, Massachusetts)
- Compensation
- $100k - $120k/yr
- Employment
- Full-time
- Level
- Mid Level
About the role
Alpaca is building a new computer architecture and platform to make AI hardware and models accessible outside of datacenters. The ML Infrastructure Engineer will oversee and scale training infrastructure for NLP and Robotics research teams, managing compute resources and vendor relationships.
Skills
Full job details
Who we are
Today, AI is something you rent. Alpaca is building the full stack of hardware, software, models, and applications together to make it something you own.
We are developing a new computer architecture that breaks the economics keeping frontier models trapped in datacenters. On top of that, we’re building a platform of models, applications, and services that give that hardware meaning.
Personal AI is moving from the datacenter to the desk, and we are driving that change.
Our team is based in Cambridge, MA.
The Role:
We are looking for a ML infra engineer to oversee the training infrastructure for our NLP and Robotics research teams. In this role, you will be responsible for
Setting up and scaling our compute resources
Enforcing efficient compute utilization
Communicating with compute vendors to get us the most competitive rates
Making compute resources easy for researchers to use
Managing permissions & onboarding/offboarding users
ML infrastructure is key to the success and productivity of our research teams. You will play in integral part in the day-to-day operations of our teams and help accelerate our research processes. In addition to maintaining our compute resources, you will also help set up resources so developers can easily access compute when needed. You will collaborate with researchers to set up infrastructure around their usage and develop tooling to match their workflows.
Minimum qualifications:
Familiar with AWS, GCP, Azure, Slurm, Kubernetes
Proven track record of building & maintaining cloud-based infrastructure
Familiar with distributed infra & multi-host setups
Strong communications skills and independence in owning projects
Familiar with building testing pipelines, CI/CD, logging/telemetry for tracking ML infra use
How to apply
Send us your resume, Github, and some projects you have worked on, along with a short note about why Alpaca interests you.
More than credentials, we want to see what you've made, researched, designed, or shipped.
If the role sounds like you but your background is unconventional, apply anyway.