Senior Site Reliability Engineer

ABOUT THE JOB

RADAR runs data infrastructure across 1,600+ live retail stores, processing tens of billions of real-world events every day. We’re hiring a Site Reliability Engineer to own the reliability of that system end to end — leading incident response, running day-to-day NOC operations, and building the observability foundation that lets us catch issues before they hit a store floor. You’ll be the steady hand during a live incident, and the engineer making sure there are fewer of them to begin with.

Responsibilities:

• Own the incident management lifecycle end to end: detection, triage, escalation, communication, resolution, and postmortem for production incidents.
• Act as Incident Commander for high severity incidents, coordinating across engineering, support, and leadership until resolution.
• Run day-to-day NOC (Network Operations Center) operations, including 24/7 shift coverage, escalation matrices, and shift handover protocols.
• Coach and mentor NOC analysts on triage discipline and escalation judgment, and own NOC KPIs like response time and escalation accuracy.
• Design and maintain observability pipelines across metrics, logs, and traces, and define SLIs/SLOs with engineering and product.
• Build dashboards and alert that surface true signal from our sensor and platform data, cutting down on noise and alert fatigue.
• Facilitate blameless postmortems and root cause analysis, and track corrective actions through to closure.
• Maintain on-call rotations, runbooks, and escalation policies, and report on MTTA/MTTR/MTBF trends to leadership.

ABOUT YOU

Required:

• You have 5+ years of experience in Site Reliability Engineering, DevOps, Infrastructure, or Production Operations, with direct incident response and on-call experience.
• You have experience running or actively contributing to a NOC, including shift scheduling, escalation processes, and performance metrics.
• You have strong hands-on experience with observability tooling (Prometheus, Grafana, Datadog, New Relic, Splunk, ELK, OpenTelemetry, or similar).
• You have a solid understanding of SLIs, SLOs, SLAs, and error budgets, and how to use them to drive prioritization.
• You have hands-on release engineering experience, including CI/CD pipelines, deployment automation, and safe rollout practices like canary releases, feature flags, and automated rollbacks.
• You are proficient in at least one scripting or programming language (Python, Go, Bash, etc.).
• You have experience with infrastructure-as-code tools (Terraform, Ansible).
• You have experience with cloud platforms (AWS, GCP, or Azure) and container orchestration (Kubernetes, Docker).
• You are a clear, direct communicator who stays calm and organized under pressure during live incidents.

Preferred:

• You have experience building or scaling a NOC from the ground up.
•  You have a background in distributed systems architecture and microservices troubleshooting.
• You have familiarity with chaos engineering and resilience testing.
• You have a certification such as AWS Certified SysOps Administrator, Google Professional Cloud DevOps Engineer, or ITIL.

WHAT YOU'LL DO

In your first 30 days, you will:

• Learn RADAR’s mission, technology stack and core values.
• Complete onboarding and security compliance training.
• Shadow the NOC across shifts and review recent incident history and open postmortem action items.

In your first 60 days, you will:

• Take on-call as primary or secondary responder for at least one service area.
• Tune or consolidate at least one high-volume, low-signal alert source, and audit existing observability coverage for major gaps.
• Draft or update runbooks for the top recurring incident types, and instrument one under-monitored service.

In your first 90 days, you will:

• Lead Incident Commander duties for high severity incidents, including full postmortem facilitation.
• Deliver a reliability report on incident trends, NOC KPIs, and observability maturity gaps.
• Present a roadmap for the next 2–3 quarters covering NOC process, Automation, SLO definitions, and observability investment.

At RADAR, your base pay is one part of your total compensation package. The expected base salary range for this position is $170,000 - $219,000. Individual pay is determined by work location and additional factors,  including job-related skills, experience and relevant education or training.You will also be eligible to receive other benefits including: equity, comprehensive medical and dental coverage, life and disability benefits, 401k plan,  flexible time off, and paid parental leave. The pay range listed for this position is a good faith and reasonable estimate of the range of possible base compensation at the time of posting. 

Research has shown that women & underrepresented minorities are more likely to read lists of requirements and consider themselves unqualified if they don't meet every single one. This list represents what we're ideally looking for, but everyone has unique strengths & weaknesses, and we hire for strength & potential, not lack of weakness.