Data Engineer

🔥 38 minutes ago

🇵🇱 Poland – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

🚰 Data Engineer

👻 Ghost score 10%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Sigma Software Group

WebsiteLinkedInAll Job Openings

1001 - 5000 employees

Founded 2002

💼 Consulting

🏥 Healthcare

🚘 Automotive

Consulting • Healthcare • Automotive

Sigma Software Group is a multinational company, established in 2002, that specializes in providing high-quality software development, graphic design, testing, and support services. The company focuses on delivering solutions across various industries such as automotive, telecommunications, aviation, advertising, gaming, banking, real estate, and healthcare. Sigma Software values professional growth, offers remote work opportunities worldwide, and caters to world-renowned clients like AstraZeneca, Scania, and SAS. The company emphasizes a culture of continuous education, mentorship, and flexible work environments, making it a preferred workplace for IT specialists aiming to work on complex solutions utilizing cutting-edge technologies. Sigma Software is committed to innovative solutions and engineering the future while also contributing to social causes such as charitable work in Ukraine.

📋 Description

• Design, develop, and maintain scalable and reliable data platforms and pipelines for analytics and operational use cases • Build distributed data processing workflows using Apache Spark, pySpark, and Databricks • Develop and evolve cloud-native data solutions leveraging Azure and AWS services • Model and optimize data structures for analytics, reporting, and downstream consumption • Integrate data from multiple heterogeneous sources while ensuring data quality, consistency, and traceability • Implement data quality controls, schema validation, lineage tracking, and monitoring processes • Optimize performance, scalability, reliability, and cost-efficiency of data pipelines and infrastructure • Collaborate closely with scientists, analysts, and engineering teams to translate business and research requirements into technical solutions • Contribute to CI/CD processes, infrastructure automation, and engineering best practices • Research and introduce new technologies and approaches within the data engineering ecosystem

🎯 Requirements

• 3+ years of commercial experience in Data Engineering • 2+ years of hands-on production experience with Databricks • Strong expertise with Delta Lake, including medallion architecture and table optimization • Advanced proficiency in Python, pySpark, and SQL • Deep practical knowledge of Databricks components including Unity Catalog, Lakeflow Jobs / Workflows, and job optimization • Hands-on experience with AWS services including S3, IAM, KMS, and at least one of AWS Batch, ECR, EventBridge, Lambda, or API Gateway • Experience designing event-driven and asynchronous data pipelines • Strong knowledge of Infrastructure as Code and CI/CD practices • Practical experience with Terraform and Databricks Asset Bundles • Experience working with Git workflows, pull request reviews, and automated testing • Understanding of secure authentication approaches such as OIDC and service principals • Practical experience with MLflow, experiment tracking, model registry, and reproducibility practices • Strong understanding of data quality, lineage, schema contracts, and provenance concepts • Experience with data quality frameworks such as Great Expectations, Soda, pyDeequ, or Databricks DQX • Experience monitoring and optimizing data platform reliability and cloud costs • Upper-Intermediate or higher English level • Plus: Experience packaging workloads using Docker and running batch workloads in AWS • Plus: Familiarity with ECR and containerized data processing solutions • Plus: Experience with experiment optimization libraries such as scikit-optimize, BoTorch, Ax, or scipy • Plus: Understanding of ML feature engineering and leakage prevention techniques • Plus: Experience working in regulated or high-security environments • Plus: Knowledge of data governance, compliance, and data residency requirements • Plus: Experience disabling or restricting AI-assisted tooling/features in secure environments

🏖️ Benefits

• Remote work option • Continuous learning opportunities • Opportunity to contribute to breakthrough scientific initiatives • Work with modern technologies and highly skilled global teams