Principal Data Engineer (Azure) - Mexico

March 19

Apply Now

Get a free AI resume review

Tiger Analytics

WebsiteLinkedInAll Job Openings

AI & Analytics for today’s business challenges.

Machine Learning • Predictive Analytics • Forecasting • Optimization • Natural Language Processing

1001 - 5000

Description

• Design and build scalable & metadata-driven data ingestion pipelines (For Batch and Streaming Datasets) • Conceptualize and execute high-performance data processing for structured and unstructured data, and data harmonization • Schedule, orchestrate, and validate pipelines • Design exception handling and log monitoring for debugging • Ideate with peers to make tech stack and tools-related decisions • Interact and collaborate with multiple teams (Consulting/Data Science & App Dev) and stakeholders to bring Analytical Solutions to life

Requirements

• Experience in implementing Data Lake with technologies like Azure Data Factory (ADF), PySpark, Databricks, ADLS, Azure SQL Database • Comprehensive foundation with working knowledge of Azure Synapse Analytics, Event Hub & Streaming Analytics, Cosmos DB, and Purview • Passion for writing high-quality, modular, and scalable code free of bugs in SQL, Python, or Scala/Java • Collaboration with various stakeholders and complete ownership of deliverables • Experience in big data technologies like Hadoop, Spark, Airflow, NiFi, Kafka, Hive, Neo4J, Elastic Search • Understanding of file formats like Delta Lake, Avro, Parquet, JSON, and CSV • Knowledge of building and designing REST APIs with real-time experience on Data Lake or Lakehouse projects • Supporting BI and Data Science teams in consuming data securely and in a governed manner • Certifications like Data Engineering on Microsoft Azure (DP-203) or Databricks Certified Developer (DE) are valuable additions

Benefits

• Great Place to Work-Certified™ • Opportunity to work at the heart of an AI revolution • Exposure to cutting-edge technologies and solutions • Chance to collaborate with talented teams globally • Competitive compensation packages