Data Engineer, Databricks, Python, Azure

🕒 March 18

🤠 Texas – Remote

🤠 Texas – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

🔙 Backend Engineer

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Allata

WebsiteLinkedInAll Job Openings

201 - 500 employees

🚘 Automotive

🏥 Healthcare

📦 Logistics

Automotive • Healthcare • Logistics

Allata is a global consulting firm that helps businesses achieve digital excellence by crafting unique customer experiences, identifying revenue-generating opportunities, and improving operational efficiencies. They offer a wide range of services including strategic services, technology and cloud solutions, data and insights, and artificial intelligence development. Allata's approach is experience-led, strategy-aligned, tech-enabled, and data-driven. They work across multiple industries such as automotive, financial services, health and life sciences, high tech, logistics and transportation, among others, to drive modernization, personalization, innovation, and efficiency. With a team of former IT leaders and consulting professionals, Allata guides clients through complex digital landscapes to deliver value-based outcomes and help organizations integrate digital strategies seamlessly into their overall business strategies.

📋 Description

• Design, develop, and maintain scalable data pipelines using Databricks (PySpark) and Python. • Build and optimize ETL/ELT processes within Azure cloud environments. • Implement data models following modern Data Lakehouse principles (e.g., Medallion architecture). • Ensure data quality, consistency, and performance across ingestion, staging, and curated layers. • Collaborate with data architects, analysts, and business stakeholders to translate healthcare data requirements into technical solutions. • Develop reusable data transformation logic and modular processing components. • Support deployment processes following CI/CD and DevOps best practices. • Monitor and optimize data workflows for performance, scalability, and reliability. • Contribute to data governance, security, and compliance practices relevant to healthcare environments.

🎯 Requirements

• Current knowledge of an using modern data tools like (Databricks, FiveTran, Data Fabric and others); Core experience with data architecture, data integrations, data warehousing, and ETL/ELT processes • Applied experience with developing and deploying custom whl and or in session notebook scripts for custom execution across parallel executor and worker nodes • Applied experience in SQL, Stored Procedures, and Pyspark based on area of data platform specialization. • Strong knowledge of cloud and hybrid relational database systems, such as MS SQL Server, PostgresSQL, Oracle, Azure SQL, AWS RDS, Aurora or a comparable engine. • Strong experience with batch and streaming data processing techniques and file compactization strategies. • Strong analytical and problem-solving skills. • Ability to work effectively in cross-functional and distributed teams. • Clear communication skills, with the ability to explain technical concepts to non-technical stakeholders. • Proactive mindset with a strong sense of ownership. • Commitment to delivering high-quality, reliable data solutions.

🏖️ Benefits

• Allata is an equal opportunity employer • We celebrate diversity and are committed to creating an inclusive environment for all employees