Senior Databricks Engineer – ML, Analytics

🔥 3 minutes ago

🌲 North Carolina, Pennsylvania, +2 more states – Remote

🌲 North Carolina – Remote 🔔 Pennsylvania – Remote 🤠 Texas – Remote ⛷️ Utah – Remote

⏰ Full Time

🟠 Senior

🤖 Machine Learning Engineer

👻 Ghost score 12%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

BlueFlag LLP

WebsiteLinkedInAll Job Openings

1 - 10 employees

🤝 B2B

🎯 Recruiter

🏛️ Government

B2B • Recruitment • Government

BlueFlag LLP is a company that specializes in providing talent and technology services with a strong focus on project management and talent development. Their aim is to help organizations succeed by offering solutions such as talent sourcing through their Human Algorithm™, project staffing, team assessments, and fractional staffing for efficient part-time roles. Additionally, BlueFlag LLP provides project and program management services, helping clients manage important initiatives and implement tools and processes effectively. They serve a broad spectrum of industries, including government services, insisting on their commitment to public and private sector partnerships. With a foundation built on professionalism, experience, and work ethic, BlueFlag LLP seeks to transform visionary ideas into tangible developments.

📋 Description

• Work directly with Department of Veterans Affairs teams to scope use cases, plan migrations, and deliver working solutions on Databricks • Assess on-premises workloads, including SQL Server, SSIS packages, stored procedures, and scheduled jobs, and adapt them to Databricks patterns in Azure Commercial • Build and tune pipelines with PySpark, Spark SQL, Delta Lake, Lakeflow, and Azure Data Factory • Use Unity Catalog for access, lineage, and sharing to govern customer data • Teach customers through workshops, pairing, and clear documentation • Package reusable templates and code using Git, CI/CD, and Databricks Asset Bundles • AI/ML focus: Build end-to-end ML workflows including feature engineering, training, evaluation, MLflow tracking, Unity Catalog model registry, and model serving • AI/ML focus: Help data scientists move models into governed, monitored production • AI/ML focus: Support generative AI use cases such as retrieval-augmented generation and agents • Analytics focus: Convert SSIS and stored procedure ETL into Databricks pipelines with reconciliation • Analytics focus: Replace on-premises reporting with Databricks SQL, AI/BI dashboards, and Power BI • Analytics focus: Publish reporting data from Databricks SQL warehouses, including semantic models and query performance tuning

🎯 Requirements

• 7+ years in data engineering, including 2+ years building production workloads on Databricks • Strong proficiency in Python, SQL, PySpark, and Spark SQL • Hands-on experience with Delta Lake, lakehouse (medallion) design, and Spark performance tuning • Hands-on Unity Catalog experience: catalogs, grants, lineage, and row- and column-level security • Experience migrating on-premises workloads (e.g., SQL Server, SSIS, stored procedures) to the cloud • Experience with Azure services, including ADLS Gen2, Azure Data Factory, Entra ID, and Key Vault • Experience with Git, CI/CD, and infrastructure as code (e.g., Databricks Asset Bundles, Terraform) • Customer-facing consulting or professional services experience, including requirements sessions, workshops, and training • Clear written and verbal communication with technical and non-technical audiences • Bachelor's degree in computer science, information systems, or a related field • Must be a citizen of the United States • Must be able to obtain a public trust clearance • Must be eligible to work in the United States • AI/ML focus: Experience training, evaluating, and deploying models with MLflow and common frameworks (e.g., scikit-learn, XGBoost, PyTorch) • Analytics focus: Experience with Databricks SQL and Power BI data modeling (star schemas, semantic models, DAX) • Desired: Databricks certifications; healthcare data and HIPAA experience; Azure Government or FedRAMP High experience; Hive metastore to Unity Catalog upgrades; Mosaic AI Vector Search, Agent Framework, or model monitoring; Microsoft Fabric, Pyramid Analytics, or Genie

🏖️ Benefits

• Competitive salary • Generous annual leave and paid holidays • Comprehensive group health and dental plans • 401(k) with company match • Life insurance and AD&D coverage • Ongoing training and professional development opportunities