Senior Data Engineer – Databricks

November 21

Apply Now

Receive Emails with Similar Jobs

Risepoint

WebsiteLinkedInAll Job Openings

Education • B2B

Risepoint is an education technology company that partners with regional public and private universities to design, launch, and grow workforce-focused online degree programs. It provides marketing, student support, faculty support, technology implementations, performance monitoring, and student ROI research to help institutions expand access, increase enrollments, and deliver high-return programs for working adults.

1001 - 5000 employees

Founded 2007

📚 Education

🤝 B2B

📋 Description

• Build reliable, scalable data pipelines on Databricks • Turn requirements into production-grade ELT/ETL jobs, Delta Lake tables, and reusable components • Implement and improve reference patterns, optimize Spark for performance and cost • Apply best practices with Unity Catalog and workflow orchestration • Ship high-quality code others can build on • Partner directly with the customer’s data engineering team to design and deliver scalable, cloud-based data solutions • Execute complex ad-hoc queries using Databricks SQL to explore large lakehouse datasets and uncover actionable insights • Leverage Databricks notebooks to develop robust data transformation workflows using PySpark and SQL • Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks • Build ETL/ELT workflows with AWS and Azure Services • Optimize Spark jobs for both performance and cost • Collaborate with data scientists, ML engineers, and business analysts • Contribute to the development of AI-powered solutions • Implement CI/CD pipelines for Databricks jobs using GitHub Actions, Azure DevOps, or Jenkins • Ensure data quality, lineage, and compliance • Troubleshoot and maintain production data pipelines • Provide mentorship and share best practices

🎯 Requirements

• Bachelor’s degree in computer science, Engineering, or a related field • 5+ years of experience in software/data engineering, including at least 2 years working with Databricks and Apache Spark • Strong proficiency in Python, SQL, and PySpark • Deep understanding of AWS and Azure Cloud service • Experience with Databricks Data LakeHouse, Databricks Workflows, and Databricks SQL, dbt • Solid grasp of data Lakehouse and warehousing architecture • Prior experience supporting AI/ML workflows, including training data pipelines and model deployment support • Familiarity with infrastructure-as-code tools like Terraform or CloudFormation • Strong analytical and troubleshooting skills in a fast-paced, agile environment • Excellent collaboration skills for interfacing with both technical and non-technical customer stakeholders • Clear communicator with strong documentation habits • Comfortable leading discussions, offering strategic input, and mentoring others

🏖️ Benefits

• Risepoint is dedicated to increasing access to affordable education so that more students, especially working adults, can improve their careers and meet employer and community needs.