Lead Technical Consultant – Databricks

Job not on LinkedIn

🔥 4 minutes ago

Apply Now

Find Similar Remote Jobs

Receive Emails For Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Arbi Arredobagno

WebsiteLinkedInAll Job Openings

51 - 200 employees

Founded 1987

👥 B2C

🛒 Retail

B2C • Retail • Manufacturing

Arbi Arredobagno is a leading Italian company specializing in bathroom furniture design and manufacturing. With over thirty years of experience, Arbi stands out for its innovative approach, blending cutting-edge technology with elegant design. The company offers a wide range of bathroom products, including cabinets, washbasins, showers, and accessories, all crafted with a focus on quality and customer satisfaction. Arbi collaborates with renowned designers to create stylish and functional bathroom solutions that cater to various preferences. Emphasizing the importance of Made in Italy craftsmanship, Arbi continues to solidify its reputation as an industry leader in bathroom furnishings.

📋 Description

• Lead the technical delivery of Databricks workstreams across requirements, design, development, testing, deployment, and transition to support. • Gather and analyze business and technical requirements and translate them into practical solution designs, implementation plans, and technical specifications. • Design and build scalable data pipelines and lakehouse solutions using Databricks, Apache Spark/PySpark, Python, SQL, and Delta Lake. • Lead the deployment and integration of Databricks with cloud data platforms, source systems, data warehouses, analytics tools, and downstream applications. • Configure and optimize Databricks jobs, workflows, clusters, notebooks, compute resources, and data pipelines for performance, reliability, scalability, and cost efficiency. • Implement data governance, security, access controls, lineage, and compliance practices using Unity Catalog and related cloud services. • Establish development standards and lead design reviews, code reviews, unit testing, documentation, version control, CI/CD, and troubleshooting within the assigned workstream. • Lead estimation activities, identify technical dependencies and risks, and help define realistic development timelines and delivery goals. • Guide and mentor consultants and engineers, delegate technical tasks, and ensure the team delivers consistent, high-quality work. • Collaborate with client and cross-functional stakeholders, produce technical documentation, and facilitate solution walkthroughs, issue resolution, knowledge transfer, and enablement. • Evaluate relevant Databricks capabilities and emerging technologies and recommend practical improvements that strengthen solution quality and delivery.

🎯 Requirements

• Bachelor's degree in Computer Science, Software Engineering, Information Technology, Data Engineering, or a related field; equivalent relevant experience may be considered. • 5-10 years of experience in technical consulting, data engineering, analytics engineering, software development, or related technology roles. • At least 3 years of hands-on experience designing, developing, and delivering solutions on the Databricks platform. • Demonstrated experience leading a technical workstream or small delivery team on mid- to large-scale client implementations. • Strong hands-on experience with Python, SQL, Apache Spark/PySpark, ETL/ELT frameworks, and data pipeline development. • Experience with key Databricks capabilities such as Delta Lake, Unity Catalog, Workflows/Jobs, notebooks, compute or cluster management, and platform administration concepts. • Experience integrating Databricks with at least one major cloud platform: Microsoft Azure, Amazon Web Services (AWS), or Google Cloud Platform (GCP). • Strong understanding of lakehouse, data lake, data warehouse, batch and streaming processing, data modeling, and modern analytics concepts. • Experience with Git-based development, DevOps, automated testing, CI/CD, Agile delivery, and managing multiple priorities or workstreams. • Client-facing consulting experience, including requirements discussions, technical workshops, solution presentations, estimation, and delivery communication. • Preferred Certifications and Experience: Databricks Data Engineer Associate, Databricks Data Engineer Professional, or another relevant Databricks certification. • Experience with MLflow, machine learning workflows, real-time or streaming solutions, or Databricks SQL. • Experience supporting technical discovery, solution estimates, proposals, or statements of work in partnership with architects and sales teams.