data acquisition engineer for JoomPulse

грейд
senior
формат
гибрид Лиссабон
язык
Английский B1
опубликована
12 ноя

описание

JoomPulse is an AI analytics tool for Mercado Livre and Shopee sellers. It provides insights into profitable products and fast-growing categories to help sellers increase profits through data-driven decisions. JoomPulse is part of Joom Group, an international group of e-commerce companies that also includes Joom, JoomPro, and Onfy.

задачи

  • Own and develop scraping for Mercado Livre and extend it to marketplaces such as Shopee
  • Build and maintain distributed crawlers in production
  • Monitor marketplaces for changes, detect them early, and proactively update bypass logic
  • Reverse engineer private APIs to retrieve data faster and more reliably than through HTML
  • Keep crawlers scalable and observable through distributed queues, success-rate monitoring, and alerts for anti-bot regressions
  • Investigate pipeline failures caused by new anti-bot checks and restore data flow
  • Use LLMs and other tools to research and solve problems without ready-made answers
  • Identify useful data for the product and share insights with the team

требования

  • 3+ Years of experience building distributed crawlers in production
  • Strong Python with Scrapy or Playwright, or Node.js with Puppeteer or Crawlee
  • Experience with behavioral simulation, including human-like mouse trajectories, realistic timing, scrolling, clicking, and bypassing behavioral biometrics
  • A security research mindset, including monitoring target sites for changes, detecting changes, and proactively updating bypass logic
  • Experience with residential, mobile, ISP, and rotating proxy infrastructure
  • Experience reverse engineering private APIs using mitmproxy, Charles, or Burp
  • Experience scaling crawlers with distributed queues such as Redis, Kafka, or SQS
  • Active use of LLMs and an experimental mindset, trying available tools until the result is achieved
  • Proactive approach to identifying useful data without a detailed specification
  • English sufficient for daily work in an international team
  • Будет плюсом: direct experience with Mercado Livre, Amazon, Shopee, or TikTok Shop; public GitHub projects involving marketplace crawlers or contributions to Scrapy, Playwright, curl-impersonate, or undetected-chromedriver; experience with anti-detect browsers and stealth tooling such as Multilogin, GoLogin, Kameleo, puppeteer-extra-stealth, curl-impersonate, or tls-client; experience running a project end-to-end or managing other engineers

условия

  • Base salary and performance-based bonuses
  • Flexible hours
  • 22 Days of paid annual leave
  • Health insurance, including dental care, for employees and their children
  • Daily meal allowance
  • 100% Paid sick leave
  • Licenses and access to a wide range of AI tools
  • Opportunities for promotion, professional training, and English courses
  • Annual team-building activities and knowledge-sharing workshops

навыки

компания

Joom — международная группа e-commerce и fintech-компаний, развивающая маркетплейс и смежные цифровые продукты.

похожие вакансии

статьи для разработчиков