Data Engineer

Job not on LinkedIn

September 13

Apply Now

Receive Emails with Similar Jobs

Kpler

WebsiteLinkedInAll Job Openings

Energy • Transport • Data Services

Kpler is a leading provider of real-time data and intelligence in the maritime and energy sectors. The company offers products and services designed to help businesses make informed decisions in commodity trading, energy transition, and maritime logistics. With a robust platform that provides detailed insights into physical markets, power markets, and financial markets, Kpler enables traders, analysts, fleet managers, and logistics professionals to optimize their operations and strategies. The company's tools include ship tracking, cargo inventories, and power market analytics, serving over 10,000 organizations worldwide.

201 - 500 employees

Founded 2014

⚡ Energy

🚗 Transport

📋 Description

• Work alongside data engineers, data scientists and product managers to develop and implement core algorithms and back-end data pipelines based on project requirements and design specifications. • Add new features and review pipelines and integrations with datastores to ensure the highest cargo tracking data quality for clients and internal users. • Help to optimise system performance, maintain features, troubleshoot issues, and ensure high availability. • Use advanced Operations Research and Data Science techniques to process and transform live data and integrate it into core data pipelines and cargo tracking models. • Manage and ensure the quality of the data provided to clients as part of the Cargo Models team. • Demonstrate strong analytical and debugging skills with a proactive approach to learning.

🎯 Requirements

• Have hands-on experience with Python. Experience with Flask or SQLALchemy is a plus. • Solid SQL skills for querying and managing relational databases. • Knowledge of streaming and big data technologies (such as Kafka or Spark). • Comfortable working with Git, code reviews, and Agile methodologies. • Have an understanding of containerisation and orchestration tools (e.g., Docker, Kubernetes). • Are eager to learn new languages and technologies. • Nice to have: Have worked with AWS (or another cloud provider), using Terraform. • Nice to have: Have experience with Scala or other JVM Languages. • Nice to have: Exposure to Elasticsearch.