Leave us your email address and we'll send you all the new jobs according to your preferences.
Staff Software Engineer, Web-Scale Crawling & Ingestion
Posted 3 hours 57 minutes ago by Fdetimes
Permanent
Full Time
I.T. & Communications Jobs
London, United Kingdom
Job Description
Nebius in London is seeking a Staff Software Engineer to build the content acquisition and crawling infrastructure for a world-scale search platform designed for agentic AI. You will design distributed crawling, scheduling, and ingestion systems capable of handling billions of URLs and terabytes of data.
Collaborate with indexing and ML teams, improve observability, optimize resource use, and drive safe experimentation with crawling strategies.
Fdetimes
Related Jobs
Associate Director (m/f/d), Devops & Software Engineering, Computational Pathology
- Bayern, München, Germany, 80331
Senior Real-Time Wireless Software Engineer
- Hampshire, Southampton, United Kingdom, SO140
Product Manager, Cross-Border Payments & Digital Assets
- London, United Kingdom
Senior Product Manager
- Berkshire, Reading, United Kingdom, RG317
Software Solution Architect
- Not Specified, United Kingdom