Senior Data Engineer – Databricks, ADF, AI

Job not on LinkedIn

🔥 0 minutes ago

Apply Now

Find Similar Remote Jobs

Receive Emails For Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Compass

WebsiteLinkedInAll Job Openings

10,000+ employees

🏠 Real Estate

📱 Media

Real Estate • Media

Compass is a real-estate-focused content and services site that provides detailed market analysis, buying/selling/renting guides, mortgage and financing information, and home improvement and renovation advice. The site offers resources for homebuyers, sellers, renters, agents, and real estate investors — including articles on appraisals, affordable housing, investment strategies, staging and property maintenance. Compass aims to help users make informed decisions across the housing lifecycle through timely market updates and practical how-to content.

📋 Description

• Perform data modeling, working with technologies such as Databricks, SAP Datasphere, Azure Data Factory, Azure Data Lake Storage (ADLS), Python, and databases (SQL Server, Oracle); • Work on extracting data from files received monthly, building a data lake and tables; • Structure RAG for the client's debt contracts and other documents related to loan agreements; • Perform ETL from CXL APIs and transform and process them into Databricks databases to feed CXL quotes; • Structure data tables in Databricks for Judicial Deposits, Financial Guarantees and Collateral; • Develop ETL processes for analyzing structured and unstructured data, using the client's chat API to analyze files and validate data; • Build the Position Manager data product and create reports to replace CXL's Crystal Reports;

🎯 Requirements

• Experience with Databricks, SAP Datasphere, Azure Data Factory, Azure Data Lake Storage (ADLS), and databases (SQL Server, Oracle) • Ability to analyze requirements in order to assist Architects in structuring and detailing requests; • Knowledge of ETL tools and data modeling; • Ability to assist in defining requirements; • Proven experience in Python; • API development and publishing; • Knowledge of DevOps; • Minimum of 4 years of documented work experience (formal employment records), with an academic degree in IT or a postgraduate IT program of 360 accredited hours;