Role at a glance
- Salary As posted
- Not Disclosed
- Employment
- Full-time
- Location
- London, United Kingdom Belgrade, United Kingdom Ireland
- Experience
- 5+ years of experience in SRE, production engineering, or infrastructure-heavy backend roles
- Job function
-
Software Engineering & IT DevOps & Site Reliability Engineering
Spotted an issue?
We’ll check it against the original posting.
Role Summary
This Site Reliability Engineer role on Perplexity's Crawler team focuses on improving crawler throughput, planning capacity, and building operational reliability through safer deployments, better observability, and durable fixes.
What You'll Do
- Operate and optimize Kubernetes workloads and supporting infrastructure for crawler services, including fetching and rendering fleets
- Build and maintain infrastructure as code and CI/CD pipelines, with safe rollouts, validation, and fast rollback
- Define SLOs and build monitoring, alerting, and observability for availability, latency, throughput, and resource saturation
- Own capacity planning and resource efficiency; diagnose queue backlogs, network failures, and resource bottlenecks with service owners
- Participate in the team's on-call rotation, lead incident response, and turn blameless postmortems into durable reliability improvements
- Write production software to automate diagnosis and routine remediation, with validation and approval gates for high-impact actions
Generated from the employer's posting. Verify important details before applying.
View full postingQualifications
Requires 5+ years in SRE or production engineering with strong programming, Kubernetes, and cloud infrastructure skills.
Required
- 5+ years of experience in SRE, production engineering, or infrastructure-heavy backend roles
- Strong programming skills in Python, C++, Rust, or Go
- Hands-on experience with cloud infrastructure, production Kubernetes, infrastructure as code such as Terraform, and automated deployment...
- Strong Linux and networking fundamentals, including TCP/IP, DNS, TLS, HTTP, and load balancing
- Experience building observability with tools such as Datadog, Prometheus, or Grafana, and using SLOs to guide reliability improvements
- Proven experience diagnosing distributed-system failures, leading production incidents, and improving system performance or resource...
Preferred
- Experience operating web crawlers, search infrastructure, or browser fleets at scale
- Experience with distributed queues, backpressure, workload isolation, or multi-region recovery
Original job description
Content provided by the employer
Original job description
Content provided by the employer
Keeping a crawler running is not the same as keeping it productive. Queues can grow while servers look healthy, and a small change can become a fleet-wide bottleneck. On Perplexity's Crawler team, you'll improve throughput, plan capacity, and build operational reliability through safer deployments, better observability, and durable fixes.
Responsibilities
Operate and optimize Kubernetes workloads and supporting infrastructure for crawler services, including fetching and rendering fleets.
Build and maintain infrastructure as code and CI/CD pipelines, with safe rollouts, validation, and fast rollback.
Define SLOs and build monitoring, alerting, and observability for availability, latency, throughput, and resource saturation.
Own capacity planning and resource efficiency; diagnose queue backlogs, network failures, and resource bottlenecks with service owners.
Participate in the team's on-call rotation, lead incident response, and turn blameless postmortems into durable reliability improvements.
Write production software to automate diagnosis and routine remediation, with validation and approval gates for high-impact actions.
Qualifications
5+ years of experience in SRE, production engineering, or infrastructure-heavy backend roles, with strong programming skills in Python, C++, Rust, or Go.
Hands-on experience with cloud infrastructure, production Kubernetes, infrastructure as code such as Terraform, and automated deployment workflows.
Strong Linux and networking fundamentals, including TCP/IP, DNS, TLS, HTTP, and load balancing.
Experience building observability with tools such as Datadog, Prometheus, or Grafana, and using SLOs to guide reliability improvements.
Proven experience diagnosing distributed-system failures, leading production incidents, and improving system performance or resource efficiency.
Nice to have
Experience operating web crawlers, search infrastructure, or browser fleets at scale.
Experience with distributed queues, backpressure, workload isolation, or multi-region recovery.
About the company
Perplexity
Startup
Perplexity is an innovative technology company that specializes in developing advanced artificial intelligence solutions aimed at enhancing human-computer interaction. With a focus on natural language processing and machine learning, Perplexity empowers users to access information and insights more intuitively and efficiently. The company is dedicated to creating tools that simplify complex data and foster informed decision-making, thereby transforming the way individuals and organizations engage with knowledge. Through its commitment to excellence and user-centric design, Perplexity is shaping the future of information retrieval and analysis.