Data Engineer, Databricks, Informatica, Azure

🔥 0 minutes ago

🤠 Texas – Remote

🤠 Texas – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

🚰 Data Engineer

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

Apply Now

Find Similar Remote Jobs

Receive Emails For Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Allata

WebsiteLinkedInAll Job Openings

201 - 500 employees

🤝 B2B

B2B • Consulting • Technology

Allata is a global consulting firm that helps businesses achieve digital excellence by crafting unique customer experiences, identifying revenue-generating opportunities, and improving operational efficiencies. They offer a wide range of services including strategic services, technology and cloud solutions, data and insights, and artificial intelligence development. Allata's approach is experience-led, strategy-aligned, tech-enabled, and data-driven. They work across multiple industries such as automotive, financial services, health and life sciences, high tech, logistics and transportation, among others, to drive modernization, personalization, innovation, and efficiency. With a team of former IT leaders and consulting professionals, Allata guides clients through complex digital landscapes to deliver value-based outcomes and help organizations integrate digital strategies seamlessly into their overall business strategies.

📋 Description

• Design, develop, and maintain scalable data pipelines using modern distributed data processing platforms and cloud environments. • Build and optimize ETL/ELT processes following industry best practices and cloud-native architectures. • Implement data models aligned with modern Data Lakehouse principles and data architecture frameworks. • Ensure data quality, consistency, and performance across ingestion, staging, and curated data layers. • Collaborate with data architects, analysts, and business stakeholders to understand complex healthcare data requirements. • Develop reusable data transformation logic and modular processing components for efficient, maintainable systems. • Support deployment processes following CI/CD and DevOps best practices. • Monitor and optimize data workflows for performance, scalability, and reliability in production environments. • Contribute to data governance, security, and compliance practices relevant to regulated healthcare environments.

🎯 Requirements

• Proven hands-on experience with Informatica as a data integration and ETL platform. • Strong experience with Databricks or similar distributed data processing platforms. • Core expertise in data architecture, data integrations, data warehousing, and ETL/ELT process design. • Applied experience developing and deploying custom scripts and modules for distributed computing environments (custom code execution across parallel executors and worker nodes). • Strong proficiency in SQL, Python, and PySpark (or equivalent distributed processing languages) for data transformation and processing. • Solid knowledge of cloud and hybrid relational database systems such as MS SQL Server, PostgreSQL, Oracle, Azure SQL, AWS RDS, or comparable engines. • Hands-on experience with batch and streaming data processing techniques and data compaction strategies.