Databricks Platform Engineer

Job not on LinkedIn

🔥 0 minutes ago

🇺🇸 United States – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

🏗️ Platform Engineer

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Agility Technologies Inc

WebsiteLinkedInAll Job Openings

11 - 50 employees

Founded 2004

💼 Consulting

🎖️ Defense

📦 Logistics

Consulting • Defense • Logistics

Agility Technologies Inc. is a U. S. -based systems integrator and cloud consulting firm that delivers mission-driven digital transformation and IT modernization services primarily for federal and defense agencies, as well as non-profits and commercial clients. The company specializes in low-code/no-code and cloud-native solutions using platforms like Salesforce, MuleSoft, ServiceNow, AWS, Azure, and Tableau, and provides services across architecture, integration, DevSecOps, CI/CD, grants and loan lifecycle management, and cybersecurity/compliance. Agility positions itself as a Salesforce Summit Partner and SBA 8(a) small disadvantaged business focused on secure, scalable enterprise solutions and program delivery for public-sector digital initiatives.

📋 Description

• Build and maintain Databricks workspace infrastructure across development, staging, and production environments • Design, implement, and maintain Databricks platforms in Azure, AWS, or GCP cloud environments • Manage and optimize Databricks clusters, including autoscaling, resource allocation, monitoring, and troubleshooting • Oversee deployment and configuration of Databricks workspaces, user management, access controls, and workspace policies • Collaborate with infrastructure and DevOps teams to implement CI/CD pipelines for Databricks workflows and notebooks • Monitor and manage platform performance, logging, and system health • Implement data security and governance measures aligned with organizational policies and standards • Troubleshoot and resolve platform-related issues with cross-functional teams • Automate provisioning, upgrades, and scaling using Infrastructure-as-Code tools such as Terraform or CloudFormation • Support data engineers and data scientists integrating Databricks with data sources and tools • Stay current with Databricks features, updates, and best practices

🎯 Requirements

• 5+ years of experience in platform engineering, cloud infrastructure, or IT operations • 2+ years of hands-on experience managing Databricks environments • Strong knowledge of Databricks administration, including cluster setup, workspace management, and job orchestration • Proficiency in Apache Spark • Hands-on experience with Azure Government, AWS GovCloud, or GCP Public Sector • Proficiency in Python, Bash, or PowerShell scripting and automation • Experience with Infrastructure-as-Code tools such as Terraform, CloudFormation, or ARM templates • Understanding of cloud networking concepts including VPCs, subnets, security groups, and private endpoints • Familiarity with FedRAMP, FISMA, NIST 800-53, and CMMC • Experience with RBAC, encryption at rest and in transit, and audit logging • Ability to use monitoring and logging tools such as Datadog, AWS CloudWatch, or Azure Monitor • Proficiency diagnosing and resolving cluster performance issues, job failures, and other technical issues • Databricks Certified Associate or Platform Administrator certification preferred • Knowledge of Unity Catalog administration and data governance preferred • Experience with Databricks cost optimization, performance tuning, SSO, MFA, data retention, ETL/ELT, data warehousing, and real-time streaming technologies preferred • Federal cloud certifications preferred • Public Trust or higher clearance eligibility and prior federal client experience preferred

🏖️ Benefits

• 401(k) matching • Dental insurance • Health insurance • Paid time off • Parental leave • Vision insurance