Data Engineer – Azure, Databricks, Senior

Job not on LinkedIn

🔥 2 hours ago

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Compass

WebsiteLinkedInAll Job Openings

10,000+ employees

🏠 Real Estate

📱 Media

Real Estate • Media

Compass is a real-estate-focused content and services site that provides detailed market analysis, buying/selling/renting guides, mortgage and financing information, and home improvement and renovation advice. The site offers resources for homebuyers, sellers, renters, agents, and real estate investors — including articles on appraisals, affordable housing, investment strategies, staging and property maintenance. Compass aims to help users make informed decisions across the housing lifecycle through timely market updates and practical how-to content.

📋 Description

• Build and maintain scalable, reliable data pipelines using modern distributed processing technologies to ensure high-quality, high-performance data ingestion, transformation, and delivery • Develop data modeling using Databricks, SAP Datasphere, Data Factory, Azure Data Lake Storage (ADLS), Python, and databases (SQL Server, Oracle) • Extract data and create data lakes and tables • Structure RAG for contracts and other documents • Perform ETL from CXL APIs and transform/clean the data into Databricks • Design and structure data tables in Databricks • Develop ETL processes for analyzing structured and unstructured data, using APIs for file analysis and data validation

🎯 Requirements

• Advanced experience and expertise with Databricks • Experience with Azure Data Factory and Azure Data Lake Storage (ADLS) • Experience implementing Data Lake and Data Lakehouse architectures • Experience with Python and Apache Spark • Experience with Apache Airflow • Experience with SQL and NoSQL databases, including PostgreSQL, MongoDB, and Cassandra • Knowledge of Kafka (preferred) • Knowledge of dbt (preferred) • Knowledge of AWS Glue and BigQuery (preferred) • Knowledge of AI / RAG (preferred) • Knowledge of SAP Datasphere (preferred)