Data Engineer – Complex Data Pipelines

🔥 5 minutes ago

🇫🇷 France – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

🚰 Data Engineer

👻 Ghost score 12%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

MARSS Group

WebsiteLinkedInAll Job Openings

51 - 200 employees

📦 Logistics

💼 Consulting

🎖️ Defense

Logistics • Consulting • Defense

MARSS Group is a technology company specializing in the development of advanced security and surveillance systems aimed at enhancing national security. Founded in 2005, the company's expertise is rooted in over 15 years of research and collaboration with EU, NATO, and various defense agencies. MARSS's technological innovations include integrated sensor surveillance, artificial intelligence, and open-source intelligence, which are utilized to protect critical infrastructure, naval assets, special forces, and high-profile individuals globally. Their product lineup features systems such as NiDAR™, advancing command and control functionality, and various solutions designed for counter-unmanned aerial systems and situational awareness in different security contexts.

📋 Description

• Design and build data pipelines from scratch, from data ingestion through processing, transformation, storage and consumption • Design ingestion for distributed recording nodes that are offline most of the time, including local buffering, resumable transfer, and reconciliation of late-arriving or out-of-order data on reconnection • Define, together with the ML team, which data is prioritised during short and bandwidth-limited connection windows • Design pipelines capable of handling structured/tabular data, images, video and temporal/time-series data • Work with sensor-generated sequential data and handle clock drift across nodes to ensure trustworthy downstream timing • Develop robust and scalable data processing solutions using Python and SQL • Design data models and storage approaches, including capacity planning and retention for large volumes of image and video data on self-managed storage • Own workflow definitions in the orchestration layer, including ordering, retry, idempotency and backfill behaviour • Build processes for data ingestion, transformation, validation, quality control and traceability • Develop tools supporting data preparation and availability for machine learning and AI applications • Collaborate with Machine Learning Engineers, DevOps and Software Engineers to understand data requirements and provide solutions • Ensure pipelines are reliable, maintainable and scalable as data volumes and use cases increase • Identify data-quality issues, including gaps and duplicates caused by node outages and retries, and define data-quality and pipeline-health monitoring • Define the overall architecture and technical standards for the in-house data platform • Document pipeline architecture, data flows and technical solutions

🎯 Requirements

• Strong professional experience in a closely related data engineering role • Demonstrated experience designing and implementing data pipelines from zero (not cloud-based), including architectural and technical decisions • Good programming skills in Python & SQL • Professional experience working with several different types of data • Experience building pipelines involving at least some of the following: images, video, sensor data, time-series or other sequential data • Experience with systems that must tolerate unreliable or absent network connectivity and recover gracefully, offline-first, store-and-forward, edge collection or similar architectures • Experience running data infrastructure on bare metal or self-managed servers, rather than exclusively on managed cloud services • Good understanding of data ingestion, transformation, storage, validation and data-quality principles • Experience working with large or complex datasets • Strong Linux skills, including comfort with filesystems, storage, services and network troubleshooting • Good software engineering practices, including Git, testing, code review and documentation • Ability to independently investigate technical problems and propose appropriate architecture and solutions • Fluent English, written and spoken.

🏖️ Benefits

• Full-time employment (CDI)