Senior Web Scraping Engineer, Python

October 22

Apply Now
Logo of Oxylabs.io

Oxylabs.io

API • Cybersecurity • eCommerce

Oxylabs. io is a leading provider of web scraping solutions and data collection services. They offer a wide array of proxy solutions including residential, mobile, and datacenter proxies which enable users to access public data at scale. Their services also include AI and ML-driven API solutions and datasets tailored for various business needs, such as market research and SEO monitoring. With a global reach, Oxylabs serves over 3,500 clients by efficiently collecting and delivering necessary web data while ensuring compliance and ethical sourcing. They support industries like e-commerce, cybersecurity, and brand protection with their advanced web data extraction capabilities.

201 - 500 employees

Founded 2015

🔌 API

🔒 Cybersecurity

🛍️ eCommerce

📋 Description

• Develop scalable scrapers. • Define resilient scraping strategies, unblock websites for scraping. • Improve observability in the system. • Develop back-end solutions for scraping & parsing problems of various magnitudes. • Maintain the current system and develop new features related to scraping & parsing.

🎯 Requirements

• 4+ years of experience working with Python. • Understanding of computer science, including data structures, algorithms, computability and complexity. • Version Control skills using Git. • Knowing your way around asynchronous programming would help you a lot. • Practical knowledge of any code testing tool. • Nice to have: • Knows how to use Dev tools & Network tab; • Knows how to write an XPath; • Web development knowledge - HTML/JS/CSS; • Knowledge of any front-end framework; • Experience working with Pydantic, FastAPI, SQLAlchemy, BeautifulSoup, lxml, httpx, Playwright; • Knows how to use an API; • Has experience working with MySQL, Redis, Docker, Kubernetes, Elasticsearch, Kibana and monitoring tools like Grafana, Prometheus; • Has experience in building scalable systems.

Apply Now

Similar Jobs

October 22

Senior Backend Engineer at Hard Rock Digital enhancing Sportsbook and Casino platforms with innovative technologies. Focused on quality code, stakeholder communication, and supporting backend & data science systems.

AWS

Cloud

Docker

Java

Kafka

Kubernetes

Postgres

RabbitMQ

Spring

Spring Boot

SpringBoot

October 22

SmartRecruiters

501 - 1000

Backend Engineer developing services for SmartRecruiters' hiring platform. Building Java and Node.js applications on AWS infrastructure with a focus on quality and collaboration.

AWS

Distributed Systems

Docker

ElasticSearch

Google Cloud Platform

Java

JavaScript

Kubernetes

Node.js

Postgres

October 22

Backend Engineer building and maintaining APIs and services within the healthcare sector. Join our remote-friendly team in Poland to shape the future of healthcare connectivity.

Cloud

Distributed Systems

Docker

Kafka

Kubernetes

NoSQL

RabbitMQ

SQL

October 22

Senior .Net Developer for AI products in a social discovery company. Involves high-loaded application architecture and functionality development.

RabbitMQ

SQL

.NET

October 21

System Software Engineer developing and optimizing deep learning tools for NVIDIA. Collaborating with teams to deliver efficient AI solutions in a fast-paced environment.

Python