Site Reliability Engineer
OpticoreIT
- Location
- Remote (London, UK)
- Employment
- Contract
- Level
- Senior Level
About the role
Opticore IT is seeking a Site Reliability Engineer to stand up and automate observability platforms for large-scale AI infrastructure clusters. The role focuses on proactive monitoring, automated remediation, and integrating telemetry systems to ensure infrastructure health and reliability.
Skills
Perks
- Remote Work
Full job details
Opticore IT is a specialist Network Engineer and Project Management consultancy offering a wide variety of opportunities to work within fast-paced, challenging environments across our client base spanning multiple sectors including Finance, Broadcast Media, Telecommunications and more.
Opticore IT are currently searching for Site Reliability Engineers to stand up, tune and automate the observability and telemetry platforms for three large scale AI infrastructure clusters, creating the proactive monitoring and automated remediation capability that underpins the customer's AI infrastructure service. This is a fully remote opportunity operating insideIR35.
What you'll be doing:
Monitor the health of all compute, GPU, storage and network infrastructure across the clusters.
Own and manage Grafana, Loki, Mimir, VictoriaMetrics and supporting telemetry platforms.
Design and maintain dashboards, alerting rules and automated health checks.
Analyse trends to identify degradation before it causes service impact.
Produce operational reporting, capacity forecasting and platform health metrics.
Develop automated workflows that detect faults and trigger remediation actions.
Integrate monitoring systems with HaloITSM and hardware vendor support portals.
Build auto ticketing, escalation and notification capabilities, including automated dispatch of field engineers.
Reduce operational risk through self healing and proactive response mechanisms.
Manage configuration and deployments through Git and CI/CD pipelines.
Maintain runbooks and operational procedures, and continually improve operational tooling and automation.
What you'll bring:
Observability Stack (Grafana, Loki, Mimir, VictoriaMetrics)
Python or Go Scripting & API Automation
Monitoring to ITSM Integration (HaloITSM, Webhooks, Vendor Portals)
GitOps & CI/CD Configuration Management
Proactive Incident Automation & Self Healing
Diversity:
At Opticore IT we embrace diversity and are committed to equal opportunities. We actively recruit for an inclusive and diverse workforce and as such, want to ensure we do everything we can to support your application.
We want you to feel empowered to let us know if you require any adjustments to be made with your application or interview process so please speak to our recruitment team.