Lead Data Engineer – Databricks, Microsoft Fabric

Job not on LinkedIn

🕒 March 10

⚓ Rhode Island – Remote

⚓ Rhode Island – Remote

⏳ Contract/Temporary

🟠 Senior

🚰 Data Engineer

Apply Now

Find Similar Remote Jobs

Receive Emails For Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

The SpyGlass Group, LLC

WebsiteLinkedInAll Job Openings

51 - 200 employees

Founded 20 years ago

🤝 B2B

💸 Finance

📡 Telecommunications

B2B • Finance • Telecommunications

The SpyGlass Group, LLC is a specialized technology expense management company providing personalized solutions to help businesses optimize their technology service expenses. The company offers services like SnapShot Audit® and SpyCare® to help decipher complex telecom bills, uncover billing mistakes and inefficiencies, and identify cost-saving opportunities. Their unique business model ensures that clients only pay when savings are realized. With expertise in technology cost audits, SpyGlass assists IT teams in managing and reducing telecom expenses without disrupting their daily operations, enabling companies to regain control over their technology budgets.

📋 Description

• Design and implement modern data platforms using Databricks and Microsoft Fabric • Build and maintain scalable data pipelines and ingestion frameworks • Develop and optimize Spark and PySpark workloads within Databricks • Implement lakehouse and data warehouse architectures • Design and manage data models supporting analytics and reporting • Collaborate with data scientists and analytics teams to support AI and advanced analytics initiatives • Implement data quality, governance, and security best practices • Provide technical leadership and mentorship to data engineering team members • Optimize performance, reliability, and scalability of data platforms

🎯 Requirements

• 7+ years of experience in data engineering or data platform development • Strong hands-on experience with Databricks and Apache Spark • Experience implementing Microsoft Fabric data solutions • Proficiency in Python and PySpark • Experience working with Azure data services and cloud-based data platforms • Experience designing modern lakehouse or data warehouse architectures • Strong understanding of data pipeline design, ETL/ELT processes, and data modeling • Experience supporting AI or machine learning workloads • Experience working in enterprise data environments • Familiarity with CI/CD and data platform automation