Senior Data Engineer – Databricks Expert

Job not on LinkedIn

🔥 38 minutes ago

🇵🇱 Poland – Remote

💵 zł20k - zł30k / month

⏰ Full Time

🟠 Senior

🚰 Data Engineer

👻 Ghost score 4%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

stermedia.ai

WebsiteLinkedInAll Job Openings

11 - 50 employees

Founded 2009

🤖 Artificial Intelligence

🤝 B2B

🏭 Manufacturing

Artificial Intelligence • B2B • Manufacturing

Stermedia. ai is a B2B AI and software engineering firm that builds custom artificial intelligence, robotic automation, cloud-based manufacturing software and product design solutions. Since 2009 it has provided digital transformation services including deep learning and data science, robotic/process automation, custom web and mobile application development, UX/product design, and cloud architecture (AWS/IBM). The company shows domain experience across manufacturing and automotive (AndonCloud manufacturing software and industry 4. 0 case studies), healthcare (medical imaging AI), HR/recruitment (CV/job-matching), media and public sector projects, and highlights competition wins and multiple client case studies demonstrating technical expertise.

📋 Description

• Design, develop, and maintain data pipelines in Databricks using Python, PySpark, and SQL • Build and maintain Delta Lake tables and transformation layers following bronze, silver, and gold architecture • Integrate data from multiple source systems into consistent, analytics-ready datasets • Implement incremental processing, change data capture, and schema evolution where required • Develop and orchestrate production workflows, including dependencies, scheduling, retries, and monitoring • Optimize Spark workloads, SQL queries, and compute usage to improve performance and manage costs • Implement automated data quality checks, validation, and pipeline tests • Support data access management, governance, and lineage using Unity Catalog • Maintain reusable code, technical documentation, and Git-based development workflows • Collaborate with business stakeholders, data engineers, analysts, and machine learning specialists to translate requirements into reliable data solutions • Contribute to the full delivery lifecycle, from client discussions and business requirements analysis through solution design, implementation, and production deployment

🎯 Requirements

• Strong commercial experience with Databricks, including developing and operating production data pipelines • Advanced knowledge of Python, PySpark, and SQL • Hands-on experience with Apache Spark, distributed data processing, and performance troubleshooting • Practical experience with Delta Lake, including incremental loads, merge operations, and schema management • Strong understanding of lakehouse architecture, ETL/ELT patterns, and data modeling • Experience orchestrating and monitoring workflows in Databricks • Practical knowledge of Unity Catalog, including permissions, data organization, and lineage • Experience optimizing pipeline performance and compute resource usage • Familiarity with cloud storage and services in at least one major cloud environment: Azure, AWS, or GCP • Experience with Git, code reviews, automated testing, and CI/CD workflows • Strong analytical and communication skills, with the ability to work directly with international stakeholders • Good command of English

🏖️ Benefits

• Opportunities to work with modern data engineering and machine learning technologies • An annual self-development budget • The opportunity to contribute to a variety of interesting projects • Internal workshops and knowledge-sharing sessions • Support for personal branding through articles, conference talks, and leading internal workshops • Flexible working hours • The possibility of remote work • A chillout room, free beverages, and team and company events • A friendly atmosphere • MultiSport • LuxMed