Experienced Web Scraping Engineer - Python (Remote)
TLDR
Build scalable scrapers and back-end scraping solutions while maintaining infrastructure processing 300k+ service requests/sec and 500k+ Kafka messages/sec.
We’re a team of 500+ professionals who develop cutting-edge proxy and web data scraping solutions for thousands of the world’s best known businesses, including Fortune 500 companies.
What’s in store for you:
You’ll be solving complex challenges and maintaining our own infrastructure with 60PB+ monthly data traffic. Here are its scale and maturity in numbers:
- 6PB+ Ceph storage
- 60PB+ monthly data traffic through our systems
- 300k+ service requests/sec processed
- 500k+ Kafka messages/sec streamed
A word from the team:
We run one of the most advanced and largest scraping and parsing products in the world. We serve thousands of requests per second with a very high success rate. Our scrapers and parsers are used by leading e-commerce, market intelligence, and AI industry players making the work challenging and truly global. The team is a blend of different interesting personalities from different walks of life and nationalities. Here you can find people who are experts in gaming, playing guitar, riding bicycles, and other areas. We, as a team, will support you in learning how to build your own scrapers and will share all the tips, tricks and hacks we know to ensure that you are onboard in no time.
In this role, you’ll:
Your skills & experience:
Nice to have:
Salary:
Up for the challenge? Let’s talk!
Benefits
Remote-Friendly
Remote
Oxylabs.io creates advanced web data gathering solutions, specializing in proxy and web data scraping technologies. Our products serve thousands of renowned businesses, including Fortune 500 companies, helping them harness the power of data in a dynamic and competitive landscape.
- Founded
- Founded 2015
- Employees
- 201-500 employees
- Industry
- information technology and services