Web Scraping Specialist

🔥 0 minutes ago

🗽 New York – Remote

🗽 New York – Remote

💵 $75k - $100k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

Apply Now

Find Similar Remote Jobs

Receive Emails For Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

MLabs

WebsiteLinkedInAll Job Openings

51 - 200 employees

MLabs Consulting helps to setup project specification, implementation, management and maintenance of technical projects for AI, Fintech, Information Technology and more. We specialise in functional programming, compilers, AI, DevOps and full-stack development.

📋 Description

• Code Development: Write, test, and refine high-performance code to extract data from various online sources, ensuring maximum reliability and efficiency. • Data Retrieval: Manage complex data retrieval tasks, including handling pagination and dynamic content loaded via AJAX. • Data Quality: Clean and format extracted data to ensure it meets rigorous quality standards for downstream analysis and processing. • Database Management: Store and manage scraped data in appropriate databases, optimizing for both access speed and long-term data integrity. • Monitoring and Maintenance: Regularly monitor scraping processes and infrastructure to identify and resolve issues, ensuring a continuous and stable data flow.

🎯 Requirements

• Extraction Expertise: Demonstrated ability to extract data from complex websites with minimal supervision, supported by a portfolio of past projects. • Technical Proficiency: Advanced skills in Python or JavaScript, specifically with libraries and frameworks such as BeautifulSoup, Scrapy, or Selenium. • Advanced Programming: Strong knowledge of asynchronous programming, multithreading, and distributed scraping architectures. • Web Fundamentals: In-depth knowledge of HTML, CSS, JavaScript, and the Document Object Model (DOM). • Data Storage: Experience with NoSQL databases (e.g., MongoDB, Cassandra), including the ability to design efficient storage solutions. • Cloud Infrastructure: Experience deploying and managing large-scale scraping jobs using cloud services such as AWS, Google Cloud, or Azure. • Preferred Skills: Ability to apply machine learning algorithms for data cleaning, categorization, or predictive analysis; active participation in relevant open-source projects.

🏖️ Benefits

• Competitive Compensation: A highly competitive salary ranging from **$75,000 to $100,000**, complemented by a comprehensive benefits and equity package. • Impactful Work: The opportunity to work at the forefront of AI development and web-scale knowledge graph creation. • High-Output Culture: A professional environment that prioritizes low ego, technical autonomy, and rapid execution. • Remote Flexibility: This is a remote position requiring a 6-hour overlap with the core team's schedule.