data analyst in search systems

грейд
middle
формат
гибрид
язык
Английский B1
опубликована
3 окт

описание

Perplexity develops core search technologies, including search and answer systems.

задачи

  • Find and diagnose quality issues in the search pipeline
  • Design metrics from scratch to track and measure search quality
  • Build datasets for model training, including LLM-as-a-judge labeling pipelines
  • Improve search snippet quality and page selection algorithms for indexing
  • Design and analyze A/B experiments to validate improvements

требования

  • 4+ Years of experience as a data analyst or in a related role
  • Strong coding skills, including writing production-grade code at a mid-level backend engineer level
  • Proficiency with SQL and Python
  • Hands-on experience with at least one of the following: designing metrics from scratch (not just analyzing existing A/B experiments), building labeling pipelines using LLM-as-a-judge, training ML models that shipped to production with measurable metric improvements, or designing evals with known ground truth (e.g. SimpleQA, BrowseComp) or driving meaningful improvements on such evals
  • Будет плюсом: experience working on search-related products, knowledge of statistics and A/B experiment design, experience with Apache Spark or Databricks

условия

  • Условий в вакансии нет

навыки

компания

похожие вакансии

статьи для аналитиков