Data Engineer

Job not on LinkedIn

🔥 6 minutes ago

🇪🇺 Europe – Remote

⏰ Full Time

🟢 Junior

🟡 Mid-level

🚰 Data Engineer

👻 Ghost score 25%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Matrix Global

WebsiteLinkedInAll Job Openings

51 - 200 employees

📦 Logistics

💼 Consulting

🍽️ Food & Beverage

Logistics • Consulting • Food & Beverage

Matrix Global is a company that revolutionizes the way the oil and gas industry transacts by providing a sophisticated auction platform for storage and pipeline capacities. Their proprietary MAP platform enhances transparency and competition within the midstream sector, allowing businesses to optimize storage transactions and manage risks effectively through both short-term and long-term contracts. By collaborating with industry leaders, Matrix Global offers strategic opportunities for storage providers and energy companies, fostering a dynamic marketplace for oil and gas transactions.

📋 Description

• Develop, implement, and maintain production-grade data pipelines based on data science requirements • Design and build scalable data flows for specific business use cases that can be integrated into the product • Build and maintain machine learning data pipelines • Create tools and frameworks that support data scientists and analytics teams in developing and optimizing innovative solutions • Collaborate closely with Product, R&D, Data, and Analytics teams to enhance system functionality and performance • Train customer data scientists and engineers on maintaining and enhancing data pipelines within the platform • Travel domestically and internationally to support customers when required • Build and manage strong technical relationships with customers and partners

🎯 Requirements

• 2+ years of hands-on experience with Apache Spark (required) • Strong experience with SQL • Experience using version control systems, particularly Git • Hands-on experience with the Apache Hadoop ecosystem, including Hive, Impala, Hue, HDFS, and Sqoop • Experience with Python (Pandas) • Experience with PySpark, Scala, Java, or R • Proven experience in data transformation, validation, cleansing, and machine learning feature engineering • Bachelor's degree or higher in Computer Science, Statistics, Informatics, Information Systems, Engineering, or another quantitative field • Experience working with and optimizing large-scale data pipelines, architectures, and datasets • Strong analytical skills and experience working with structured and semi-structured data • Experience building processes that support data transformation, metadata management, dependency management, and workload optimization • Ability to perform root cause analysis on data and processes to answer business questions and identify improvement opportunities • Strong customer-facing and cross-functional collaboration skills • Fluent in English and Spanish, both written and spoken • Experience working with Linux • Experience building machine learning pipelines • Knowledge of Elasticsearch • Experience with Zeppelin and/or Jupyter • Familiarity with workflow orchestration tools such as Jenkins or Apache Airflow • Experience with microservices and containerization technologies, including Docker and Kubernetes

🏖️ Benefits

• Competitive compensation and benefits • Meaningful career development opportunities • Diverse, inclusive culture • Continuous learning and growth • Opportunity to work with a talented global team • Challenging and engaging work environment