Senior Data Engineer

March 18

Craft.co

WebsiteLinkedInAll Job Openings

Creating a more resilient global supply chain.

Technology • company search • data analytics • recruiting • competitive intelligence

51 - 200

Description

• Building and optimizing data pipelines (batch and streaming) • Extracting, analyzing and modeling of rich and diverse datasets. • Designing software that is easily testable and maintainable. • Support Data Engineering Lead in setting Data Strategies and vision • Keep track of emerging technologies & trends in the Data Engineering world, incorporating modern tooling and best practices at Craft. • Work on extendable data processing systems that allows to add and scale pipelines • Applying Machine learning techniques such as anomaly detection, clustering, regression classification, summarisation to extract value from our data sets.

Requirements

• 3+ years of experience in Data Engineering • 3+ years of experience with Python • Experience in developing, maintaining, and ensuring the reliability, scalability, fault tolerance and observability of data pipelines in a production environment • Knowledge and experience of Amazon Web Services (AWS) and Databricks (nice to have) • Demonstrated curiosity through asking questions, digging into new technologies, and always trying to grow. • Strong problem solving and the ability to communicate ideas effectively. • Familiar with infrastructure-as-code approach. • Self-starter, independent, likes to take initiative. • Have fundamental knowledge of data engineering techniques: ETL/ELT, batch and streaming, DWH, Data Lakes, distributed processing • Familiarity with our current technology stack: Python, PySpark, Pandas, SQL (PostgreSQL), Airflow, Docker • Databricks & AWS (S3, Batch, Athena, RDS, DynamoDB, Glue, ECS) • CircleCI, GitHub

Benefits

• Competitive Salary at a well-funded, fast-growing startup • 28 Days of Annual Leave so you can take the time you need to refresh! • Premium Benefits including Medical + Dental + Vision Insurance • Uncapped Sick Leave so you can focus on your health when you need it • 100% Remote work (or hybrid if you prefer we have coworking place in center of Warsaw) • zł 400 Monthly Wellness/Learning stipend (Gym memberships, meals, snacks, books, classes, conferences, etc.)