Leave us your email address and we'll send you all the new jobs according to your preferences.
Staff Software Engineer, Web-Scale Crawling & Ingestion
Posted 2 hours 4 minutes ago by Nebius Group
Permanent
Full Time
I.T. & Communications Jobs
London, United Kingdom
Job Description
Nebius is hiring a Staff Software Engineer to build the content acquisition and crawling infrastructure for a cutting-edge AI search platform. You will design and operate web-scale crawling, ingestion workflows, and scheduling to handle billions of URLs with high throughput and reliability.
You will work with indexing and ML teams to ensure content quality and observability, while balancing coverage, freshness, and resource use.
Nebius Group
Related Jobs
Software Engineer III - Java
- Dorset, Lower Blandford St. Mary, United Kingdom, DT119
Senior Software Engineer, Workload Identity & Security
- England, United Kingdom
Senior Software Engineer - Public Services Platform
- Not Specified, United Kingdom
Functional Software Engineer
- London, United Kingdom
Senior Functional Software Engineer - Quant Foundations
- London, United Kingdom