Senior Data Engineer – Azure Databricks

🔥 53 minutes ago

🇨🇷 Costa Rica – Remote

⏱ Part Time

🟠 Senior

☁️ Cloud Engineer

Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of Applaudo

Applaudo

501 - 1000 employees

Founded 2013

💼 Consulting

📣 Marketing

📦 Logistics

Consulting • Marketing • Logistics

Applaudo is a nearshore software development company that helps businesses accelerate their digital transformation. With over a decade of experience, Applaudo partners with some of the world’s most admired brands to streamline IT solutions, optimize delivery costs, and modernize their digital infrastructure. The company offers a range of services including innovation and experience design, development and maintenance, quality assurance, cloud solutions, artificial intelligence, and cybersecurity. Applaudo is known for its expertise in data solutions and app modernization, and has a strong presence in industries like sports, media and entertainment, retail, consumer packaged goods, and financial services. Headquartered in Austin, TX with offices in San Salvador, Applaudo blends top-tier software development talent with cutting-edge technology to drive business growth for its clients.

📋 Description

• Design, build, and maintain production-grade data pipelines using Azure Databricks and Python • Develop scalable data transformations using PySpark or Spark SQL • Ingest and process data from APIs, relational databases, cloud storage, and SFTP sources • Integrate data from ticketing, CRM, marketing, retail, and other enterprise platforms into a centralized Data Hub • Develop and maintain data warehouse structures, dimensional models, and data marts • Write, optimize, and maintain SQL transformations • Implement data quality validations and consistency checks • Build and maintain outbound data feeds for third-party systems • Investigate data discrepancies and troubleshoot pipeline issues • Document data pipelines, transformation logic, dependencies, and technical processes • Collaborate with team members and stakeholders to clarify requirements, identify risks, and deliver reliable data solutions • Communicate progress, blockers, and potential delays proactively, proposing next steps

🎯 Requirements

• 5+ years of professional experience in Data Engineering • Strong hands-on experience with Azure Databricks • Advanced Python skills for data processing, transformation, and pipeline development • Solid experience with Apache Spark, including PySpark and/or Spark SQL • Advanced SQL proficiency, including complex transformations, data validation, and query performance optimization • Strong knowledge of data warehousing and dimensional modeling, including facts, dimensions, and data marts • Experience integrating data from REST APIs, relational databases, cloud storage, and SFTP • Hands-on experience with Microsoft Azure data services • Experience implementing data quality checks and validating consistency between source systems and target data models • Ability to troubleshoot pipeline failures and investigate data discrepancies • Ability to work autonomously, take ownership, and follow engineering practices and documentation standards • Strong English communication skills • Ability to collaborate effectively with a US-based team • Experience migrating SQL-based data workloads to Azure Databricks is nice to have

🏖️ Benefits

• Employees can work remotely • Opportunity to learn fast and take ownership • Collaboration with strong teams • Investment in modern ways of working • Participation in AI-native transformation at scale

Apply Now