Data Engineer, Databricks

Job not on LinkedIn

🔥 5 minutes ago

Apply Now

Find Similar Remote Jobs

Receive Emails For Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Compass

WebsiteLinkedInAll Job Openings

10,000+ employees

🏠 Real Estate

📱 Media

Real Estate • Media

Compass is a real-estate-focused content and services site that provides detailed market analysis, buying/selling/renting guides, mortgage and financing information, and home improvement and renovation advice. The site offers resources for homebuyers, sellers, renters, agents, and real estate investors — including articles on appraisals, affordable housing, investment strategies, staging and property maintenance. Compass aims to help users make informed decisions across the housing lifecycle through timely market updates and practical how-to content.

📋 Description

• Collaborate with data engineering teams to understand requirements and deliver efficient solutions; • Develop and maintain Azure, Databricks (PySpark), Python, Data Lake, and SQL technologies; • Use Python ElementTree for efficient XML data handling and integration of heterogeneous data; • Develop Python scripts using Pandas for manipulation and analysis of structured data; • Ensure availability, stability and continuous evolution of client systems, ensuring high performance; • Work on security and compliance for business requirements through proactive management, process automation, and continuous improvement of support services; • Maintain data quality and integrity by implementing testing and monitoring practices; • Keep comprehensive technical documentation for processes and solutions implemented; • Support corrective actions, assist with production deliveries and monitor change requests (CHGs);

🎯 Requirements

• Experience with Databricks, PySpark and Python: foundational knowledge of these technologies; • Basic knowledge of SQL and regular expressions (Regex); • Development experience with SQL data modeling and basic distributed computing; • Availability for on-call duty outside business hours and on weekends; • Familiarity with text manipulation in programming and data analysis, particularly regular expressions (Regex); • Experience with Data Lake;