Senior Data Infrastructure Engineer – Scraping, Scale

🔥 18 hours ago

🇸🇪 Sweden – Remote

⏰ Full Time

🟠 Senior

🚰 Data Engineer

👻 Ghost score 25%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

AWISEE

WebsiteLinkedInAll Job Openings

11 - 50 employees

Founded 2018

📣 Marketing

☁️ SaaS

🛍️ eCommerce

Marketing • SaaS • eCommerce

AWISEE is a European digital marketing and SEO agency specializing in international link building, Digital PR, and influencer/KOL marketing. The fully-remote company provides outsourced, manual outreach and white-label link building at scale across Europe, Latin America, APAC, North America and other regions, backed by a large publisher network. AWISEE serves B2B clients and agencies and offers tailored SEO services for industries such as SaaS, eCommerce, iGaming, crypto and fintech.

📋 Description

• Build and maintain the core ingestion engine powering the social media data lab • Build and manage stealth scraping clusters using residential proxy networks, TLS fingerprinting, headful/headless browser farms, and session rotation • Build fault-tolerant, scalable web-scraping pipelines for Instagram, TikTok, YouTube, X, and web sources • Design distributed queues and workflow engines to manage millions of asynchronous scraping tasks daily • Architect structured and unstructured storage environments for downstream AI modeling • Implement automated alerts for platform UI/API changes, blocking patterns, and proxy failures • Deliver millions of profile, post, and video records daily with near-zero downtime

🎯 Requirements

• 4+ years of experience in high-volume web scraping, data engineering, or reverse engineering • Deep experience defeating advanced anti-bot providers (Cloudflare, Akamai, PerimeterX) via TLS impersonation, browser automation, and proxy management • Mastery of Python or Go • Deep knowledge of Playwright, Puppeteer, Scrapy, or Selenium • Experience with distributed systems and task queues (Temporal, Ray, Kafka, Redis) • Strong SQL skills • Experience with modern analytical data lakes / data warehouses • Preferred: Direct experience extracting short-form video content and user metadata from TikTok, Instagram, and YouTube • Preferred: Experience integrating scraping outputs directly into vector databases and real-time AI processing queues

🏖️ Benefits

• Remote work arrangement