Senior Data Infrastructure Engineer – Scraping, Scale

πŸ•’ October 9

πŸ‡ΈπŸ‡ͺ Sweden – Remote

⏰ Full Time

🟑 Mid-level

🟠 Senior

🚰 Data Engineer

Where this job comes from

Posted on AWISEE's careers page β†—AWISEE's careers page, not through a job board

First seen by Remote Rocketship October 9

Still open on AWISEE's site. Checked 3 hours ago.

Apply Now
Logo of AWISEE

AWISEE

11 - 50 employees

Founded 2018

πŸ“£ Marketing

☁️ SaaS

πŸ›οΈ eCommerce

Marketing β€’ SaaS β€’ eCommerce

AWISEE is a European digital marketing and SEO agency specializing in international link building, Digital PR, and influencer/KOL marketing. The fully-remote company provides outsourced, manual outreach and white-label link building at scale across Europe, Latin America, APAC, North America and other regions, backed by a large publisher network. AWISEE serves B2B clients and agencies and offers tailored SEO services for industries such as SaaS, eCommerce, iGaming, crypto and fintech.

πŸ“‹ Description

β€’ Build and maintain the core ingestion engine powering the social media data lab β€’ Build and manage stealth scraping clusters using residential proxy networks, TLS fingerprinting, headful/headless browser farms, and session rotation β€’ Build fault-tolerant, scalable web-scraping pipelines for Instagram, TikTok, YouTube, X, and web sources β€’ Design distributed queues and workflow engines to manage millions of asynchronous scraping tasks daily β€’ Architect structured and unstructured storage environments for downstream AI modeling β€’ Implement automated alerts for platform UI/API changes, blocking patterns, and proxy failures β€’ Deliver millions of profile, post, and video records daily with near-zero downtime

🎯 Requirements

β€’ 4+ years of experience in high-volume web scraping, data engineering, or reverse engineering β€’ Deep experience defeating advanced anti-bot providers (Cloudflare, Akamai, PerimeterX) via TLS impersonation, browser automation, and proxy management β€’ Mastery of Python or Go β€’ Deep knowledge of Playwright, Puppeteer, Scrapy, or Selenium β€’ Experience with distributed systems and task queues (Temporal, Ray, Kafka, Redis) β€’ Strong SQL skills β€’ Experience with modern analytical data lakes / data warehouses β€’ Preferred: Direct experience extracting short-form video content and user metadata from TikTok, Instagram, and YouTube β€’ Preferred: Experience integrating scraping outputs directly into vector databases and real-time AI processing queues

πŸ–οΈ Benefits

β€’ Remote work arrangement

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ•’ September 15

Bookboost

11 - 50

🏨 Hospitality

πŸ“£ Marketing

πŸ“¦ Logistics

Data Engineer scaling Bookboost’s hotel guest engagement platform. Building AWS data pipelines and infrastructure for analytics, machine learning, and AI features.

πŸ‡ΈπŸ‡ͺ Sweden – Remote

πŸ’° $3.8M Venture Round - Bookboost on 2025-03

⏰ Full Time

🟑 Mid-level

🚰 Data Engineer

πŸ•’ June 18

Capgemini

10,000+ employees

πŸ’Ό Consulting

πŸ₯ Healthcare

πŸ“¦ Logistics

People Manager leading 5–10 consultants and delivering Azure-based data engineering solutions at Capgemini. Building scalable pipelines, lakehouses, warehouses, and AI/ML models.

πŸ•’ May 30

ARNVIND GROUP

1 - 10

πŸ’Ό Consulting

πŸ€– Artificial Intelligence

🎯 Recruiter

Senior Data Engineer developing scalable data solutions for a leading company in Sweden’s healthcare sector. Collaborating with teams to enable analytics and AI through robust data management.

Built byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok