Senior Data Engineer

🔥 0 minutes ago

🇧🇷 Brazil – Remote

⏳ Contract/Temporary

🟠 Senior

🚰 Data Engineer

👻 Ghost score 10%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Quartile

WebsiteLinkedInAll Job Openings

201 - 500 employees

📣 Marketing

🛍️ eCommerce

Marketing • Advertising • eCommerce

Quartile is the world’s largest retail media optimization platform, offering advanced advertising solutions for e-commerce businesses. Using six patented machine learning technologies, Quartile automates and optimizes ads across various marketing channels, including Amazon, Google, and social media platforms. The company empowers over 5,300 brands and sellers worldwide, managing over $2 billion in annual ad spend. With a flat-rate fee structure and comprehensive campaign management capabilities, Quartile helps businesses achieve sales growth through strategic insights and cutting-edge AI-driven technology.

📋 Description

• Design, build, and operate ingestion pipelines from advertising and business platforms via REST APIs, Delta Sharing, object storage, and event streams • Model curated data layers in Delta Lake under Unity Catalog using medallion architecture, incremental and CDC patterns, data contracts, lineage, and row/column-level governance • Build the AI serving layer using SQL views, Unity Catalog functions, and low-latency stores exposed to agents through MCP behind Azure API Management • Own data quality and health monitoring as code, including freshness, volume, schema drift, and business-rule expectations • Configure alerting in Grafana and establish clear triage paths • Ship Databricks and Azure resources, jobs, permissions, and environment promotion through Terraform and CI/CD • Own performance and cost through warehouse and cluster sizing, partitioning, liquid clustering, and Databricks Workflows/Lakeflow orchestration • Work daily with AI coding agents by writing precise specifications and reviewing generated output • Collaborate with AI engineers, software engineers, and product teams to turn requirements into data products • Instrument systems with OpenTelemetry and structured logging • Improve production reliability and latency • Document and maintain the codebase and uphold engineering best practices

🎯 Requirements

• Strong software engineering fundamentals in Python and advanced SQL • Deep hands-on experience with Databricks, including Spark/PySpark, Delta Lake, Unity Catalog, Workflows, and SQL warehouses • Experience performance tuning real Databricks workloads • Proven experience designing production data pipelines and data models • Experience with medallion or equivalent layered architectures, incremental processing, CDC, and dimensional modeling • Experience integrating third-party APIs at scale, including authentication, pagination, throttling, partial failure handling, backfills, idempotency, and schema evolution • Familiarity with Azure, including ADLS, Container Apps, Key Vault, API Management, and Entra ID • Experience with Terraform and CI/CD pipelines • Solid Git and code-review habits • Experience with data quality tests, expectations, monitoring, and upstream issue detection • Practical experience using AI coding assistants/agents in engineering work • Excellent problem-solving and analytical skills • Bachelor's degree or higher in Computer Science, Information Technology, or a related field, or equivalent practical experience

🏖️ Benefits

• Equal opportunity employer committed to diversity, inclusion, and belonging