Perplexity logo
Synced from Ashby · Nov 17

Member of Technical Staff (Index, Search Crawler)

PerplexityLondonPosted Nov 17, 2026
Data Platform EngineerSenior
Apply nowSave & get alerts

Mirrored from Perplexity's own Ashby careers system · refreshed hourly

150
Other open Perplexity roles
Nov 17
Posted
Ashby
Applicant system
Job description

AI answers are only as trustworthy as the information behind them. Perplexity grounds its answers in fresh, real-world sources, and the index is what makes that possible. We're looking for an engineer to work on the indexing and data processing layer of Perplexity's Search Crawler. You'll build systems that ingest, process, and organize large volumes of crawled content into efficient, queryable structures, working primarily on offline and nearline pipelines that keep data fresh, complete, and accessible to downstream retrieval. Throughput, scalability, and correctness are critical across datasets that change continuously.

Responsibilities

  • Design, implement, and operate large-scale indexing systems and data pipelines at the core of Perplexity's search infrastructure.

  • Develop and optimize indexing strategies that balance performance, freshness, and resource efficiency.

  • Work on storage formats, compaction, and update mechanisms that keep data accessible and current.

  • Keep pipelines reliable and predictable under high-throughput conditions.

  • Build well-tested components with clear responsibilities and interface contracts that stay flexible as the system evolves.

  • Define and implement observability across offline and near line pipelines, including structured logs, metrics, and data quality signals.

  • Monitor throughput, resource usage, and cost, and drive optimisations as business needs change.

  • Partner with retrieval, ranking, and ML teams to make sure indexing outputs meet their requirements.

  • Enable safe experimentation on indexing strategies and processing logic through controlled rollouts and clearly defined quality signals.

Qualifications

  • 5+ years of experience building production backend or data infrastructure systems.

  • Strong programming experience in Go, C++, or Rust.

  • Experience with high-throughput data processing systems and very large datasets.

  • Experience building or operating databases, storage systems, data planes, or indexing pipelines.

  • Strong understanding of distributed systems, fault tolerance, consistency, and scalability.

  • Experience running production systems and handling operational incidents.

  • A systems-thinking mindset and the ability to reason about end-to-end data flows.

View original posting on Ashby

What applying to Perplexity usually looks like

Based on publicly available information, candidates applying through ashby for roles at Perplexity can generally expect a structured, digital-first process. Applications are typically submitted through an Ashby-hosted careers page, and candidates may receive automated confirmation upon submission. The process commonly begins with an initial resume or application screen, potentially followed by a recruiter conversation to discuss background and role fit. Depending on the position, candidates may encounter multiple stages, which could include technical assessments, hiring manager discussions, or panel-style interviews relevant to the specific function, such as engineering, product, or business roles. Communication is often handled through email or the Ashby candidate portal, and response times vary depending on team needs and hiring urgency. Candidates are encouraged to review the job posting closely, as specific requirements and evaluation criteria can differ meaningfully across the many open roles.”}}

Based on publicly available information. LandEarly does not verify interview process details.

Land this one early - before the req fills.

LandEarly tailors your resume and screening answers to each posting, submits while the role is still new, and tracks every application in one place.

Set up in minutes · Cancel anytime · No contract

Keep exploring

What this role pays, where else it is open, and how to write the application.

Member of Technical Staff (Index, Search Crawler)
Perplexity · London
Apply