Databricks Practice Lead

Job not on LinkedIn

🔥 0 minutes ago

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

KMS Technology, Inc.

WebsiteLinkedInAll Job Openings

501 - 1000 employees

Founded 2010

🏥 Healthcare

📦 Logistics

📣 Marketing

Healthcare • Logistics • Marketing

KMS Technology, Inc. is a global software services company that specializes in providing end-to-end software development and consulting services. The company offers a wide range of services including software engineering, quality assurance and automation testing, AI & machine learning, cloud migration, and technology consulting. KMS Technology is dedicated to enabling digital transformation for its clients by leveraging cutting-edge technologies and ensuring high-quality software that scales with business needs. The company operates onshore, nearshore, and offshore delivery models to provide agile, reliable, and cost-effective solutions. With a focus on technology companies and the private equity community, KMS Technology supports innovation and technological advancement through its specialized services.

📋 Description

• Lead the technical direction and growth of the Databricks Practice, establishing standards, best practices, and reusable solution accelerators. • Design and review enterprise-scale data platform architectures using Databricks, Apache Spark, and Microsoft Azure. • Provide technical leadership and architectural guidance across multiple client engagements. • Partner with clients to understand business challenges and recommend scalable data and analytics solutions. • Lead technical discovery sessions, solution workshops, architecture reviews, and design discussions with clients. • Mentor and coach Data Engineers, Technical Leads, and Solution Architects, fostering technical excellence and career development. • Define best practices for data engineering, software engineering, DevOps, security, governance, and operational excellence. • Establish standards for ETL/ELT development, data quality, monitoring, performance optimization, and production support. • Drive adoption of modern data architectures, including Lakehouse, Delta Lake, and event-driven data processing. • Collaborate with Delivery Managers and Engineering Managers to support project planning, staffing, technical risk management, and solution quality. • Support pre-sales activities, including solution design, technical proposals, effort estimation, client presentations, and proof-of-concept initiatives. • Stay current with Databricks platform capabilities and emerging technologies, identifying opportunities to improve services and expand practice offerings. • Promote the adoption of AI-assisted software development and engineering best practices across the practice.

🎯 Requirements

• 8+ years of professional experience in Data Engineering, Data Platform Engineering, or related disciplines. • 3+ years of experience leading technical teams, architecture initiatives, or data engineering practices. • Deep expertise with Databricks, including workspace administration, notebooks, jobs, workflows, Unity Catalog, Delta Lake, and Lakehouse architecture. • Strong experience developing scalable data pipelines using Apache Spark (PySpark). • Extensive experience with Microsoft Azure, including services such as Azure Data Lake Storage (ADLS), Azure Data Factory, Azure Event Hubs, Azure Key Vault, and Azure DevOps. • Strong programming skills in Python, including clean coding practices and object-oriented programming principles. • Experience with orchestration tools such as Apache Airflow or Dagster. • Experience working with streaming technologies such as Apache Kafka or Azure Event Hubs. • Strong understanding of data architecture, dimensional data modeling, metadata management, and enterprise data platform design. • Experience implementing data governance, data quality, security, and compliance practices. • Experience building and optimizing enterprise ETL/ELT solutions. • Strong knowledge of SQL and relational database concepts. • Experience deploying cloud-native data solutions, preferably on Microsoft Azure. • Excellent consulting, presentation, and stakeholder management skills with experience interacting directly with enterprise clients. • Experience leading architecture discussions, technical governance, and solution reviews. • Ability to lead multiple initiatives simultaneously while providing technical direction across distributed teams. • Experience working in Agile development environments.

🏖️ Benefits

• 15 days of PTO (in year zero, from the first year onwards it is 3 days per year). • 5 days' leave for the death of immediate family members, negotiable. • Major Medical Expenses Insurance with coverage for immediate dependents (spouse and children). • Annual performance bonus (≈10% of annualized salary). • Annual salary adjustment. • Employee Referral Bonus. • Paid Certifications / Courses Coursera License. • 5% Savings Fund. • 5% Grocery Vouchers.