Data Engineer, Databricks

Job not on LinkedIn

🔥 0 minutes ago

🇧🇷 Brazil – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

🚰 Data Engineer

👻 Ghost score 21%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Compass

WebsiteLinkedInAll Job Openings

10,000+ employees

🏠 Real Estate

📱 Media

Real Estate • Media

Compass is a real-estate-focused content and services site that provides detailed market analysis, buying/selling/renting guides, mortgage and financing information, and home improvement and renovation advice. The site offers resources for homebuyers, sellers, renters, agents, and real estate investors — including articles on appraisals, affordable housing, investment strategies, staging and property maintenance. Compass aims to help users make informed decisions across the housing lifecycle through timely market updates and practical how-to content.

📋 Description

• Build and maintain scalable, reliable data pipelines using modern distributed processing technologies to ensure high-quality, high-performance data ingestion, transformation, and delivery. • Organize tables in Delta Lake and Unity Catalog. • Implement a native Databricks on GCP automated MLOps pipeline covering the complete model lifecycle. • Handle data preparation, feature generation, training, validation, registration, deployment, serving, monitoring, and automated retraining. • Contribute from the technical discovery phase—including an inventory of existing models—through the development of a standard pipeline template validated in a pilot, followed by the progressive migration of models in waves organized by criticality. • Work in an Agile environment with sprints, refinement sessions, reviews, and retrospectives.

🎯 Requirements

• Experience with Databricks. • Experience with PySpark and Apache Spark. • Experience with Apache Airflow. • Experience with BigQuery. • Experience integrating and using MLflow. • Knowledge of AWS Glue. • Experience with SQL and NoSQL databases such as PostgreSQL, MongoDB, and Cassandra. • Knowledge of Apache Kafka is a plus. • Knowledge of dbt is a plus.

🏖️ Benefits

• This position is also open to applicants with disabilities.