Data Engineer

Job not on LinkedIn

🔥 20 hours ago

⏰ Full Time

🟡 Mid-level

🟠 Senior

🚰 Data Engineer

Where this job comes from

Posted on Matrix Global's careers page ↗Matrix Global's careers page, not through a job board

First seen by Remote Rocketship 20 hours ago

Still open on Matrix Global's site. Checked 8 minutes ago.

Apply Now
Logo of Matrix Global

Matrix Global

51 - 200 employees

📦 Logistics

💼 Consulting

🍽️ Food & Beverage

Logistics • Consulting • Food & Beverage

Matrix Global is a company that revolutionizes the way the oil and gas industry transacts by providing a sophisticated auction platform for storage and pipeline capacities. Their proprietary MAP platform enhances transparency and competition within the midstream sector, allowing businesses to optimize storage transactions and manage risks effectively through both short-term and long-term contracts. By collaborating with industry leaders, Matrix Global offers strategic opportunities for storage providers and energy companies, fostering a dynamic marketplace for oil and gas transactions.

📋 Description

• Implement, maintain, and support production data pipeline flows within the platform based on solution designs and business requirements • Design and develop use-case-specific data flows, machine learning pipelines, and data tools for analytics and data science teams • Build and optimize data processing workflows using Apache Spark, PySpark, Python (Pandas), SQL, Git, and Apache Airflow • Work with Hadoop ecosystem technologies, including Hive, Impala, HDFS, and Sqoop • Analyze structured and semi-structured datasets to understand data characteristics and support pipeline design and implementation • Optimize big-data pipelines, processing architectures, and datasets to improve performance, scalability, and reliability • Deploy and manage data processing workloads in Kubernetes-based environments • Collaborate with customers and cross-functional teams to understand requirements and deliver effective technical solutions • Apply a business-oriented approach when designing and implementing data workflows • Leverage Large Language Models (LLMs), agentic coding, LLM cost optimization, and AI agent development to accelerate delivery and build data tools for internal and external use cases

🎯 Requirements

• Strong hands-on experience with Python, including Pandas • Experience with Apache Spark and PySpark for distributed data processing • Strong SQL skills and experience analyzing large datasets • Practical experience with Apache Airflow and workflow orchestration • Familiarity with Hadoop ecosystem technologies such as Hive, Impala, HDFS, and Sqoop • Experience with Git and production data pipeline development • Understanding of structured and semi-structured data formats • Experience optimizing data pipelines and workloads in Kubernetes environments • Exposure to LLMs, agentic coding, AI agents, and LLM cost optimization • Strong problem-solving and customer collaboration skills

🏖️ Benefits

• Competitive compensation and benefits • Meaningful career development opportunities • Diverse, inclusive culture • Collaboration, continuous learning, and growth • Challenging and engaging work environment • Opportunity to work with a talented global team • Opportunity to contribute to meaningful technical initiatives • Opportunity to help shape a high performing DevOps culture

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 Yesterday

GFT Technologies

10,000+ employees

💼 Consulting

🛡️ Insurance

🔒 Cybersecurity

Tech Lead liderando arquitetura, pipelines e governança de dados em AWS e Databricks. Atuação na GFT Technologies, empresa global de tecnologia e transformação digital.

🗣️🇧🇷🇵🇹 Portuguese Required

🕒 Yesterday

SoftDesign

51 - 200

🤖 Artificial Intelligence

☁️ SaaS

Data Engineer building Databricks data pipelines and Power BI solutions. SoftDesign offers outsourcing, remote work, and cloud-focused data engineering projects.

🗣️🇧🇷🇵🇹 Portuguese Required

🕒 Yesterday

GFT Technologies

10,000+ employees

💼 Consulting

🛡️ Insurance

🔒 Cybersecurity

Arquiteto de dados AWS na GFT, empresa global de tecnologia e serviços digitais. Projetando plataformas data mesh multi-account com Lake Formation, Iceberg e SageMaker.

🗣️🇧🇷🇵🇹 Portuguese Required

🕒 2 days ago

GFT Technologies

10,000+ employees

💼 Consulting

🛡️ Insurance

🔒 Cybersecurity

Engenheiro de dados desenvolvendo pipelines ETL/ELT com Python, SQL, dbt e Airflow. Analisando dados de recrutamento e RH para apoiar decisões na GFT Technologies.

🗣️🇧🇷🇵🇹 Portuguese Required

🕒 2 days ago

CI&T

5001 - 10000

💼 Consulting

🏥 Healthcare

📣 Marketing

Master DataOps Engineer owning cloud environments, CI/CD, monitoring, and FinOps. Supporting CI&T’s AI and technology transformation solutions for enterprise finance clients.

Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok