Middle Big Data Engineer

March 16

Apply Now

Get a free AI resume review

Kitrum

WebsiteLinkedInAll Job Openings

We believe it's all about the people. Right people

Software development • Software Outsourcing • Offshore Outsourcing • Offshore Software Development • Nearshore Software Development

51 - 200

Description

• Manage data quality and integrity • Assist with building tools and technology to ensure that downstream customers can have faith in the data they’re consuming • Cross-functional work with the Data Science or Content Engineering teams to troubleshoot, process, or optimize business-critical pipelines • Work with Core Platform to implement better processing jobs for scaling the consumption of streaming data sets

Requirements

• 3+ years of experience in data engineering creating or managing end-to-end data pipelines on large complex datasets. • Proficiency in Spark • Expertise in Scala, and/or Python • Fluency with at least one dialect of SQL • Level of English: Upper-Intermediate As a plus • Experience with Streaming platforms, typically based around Kafka • Experience in Terraform, Airflow • Strong grasp of AWS data platform services and their strengths/weaknesses • Strong experience using Jira, Slack, JetBrains IDEs, Git, GitLab, GitHub, Docker, Jenkins • Experience using DataBricks

Benefits

• High compensation according to your technical skills • Long-term projects (12m+) with great Customers • 5-day working week, 8-hour working day, flexible schedule • Democratic management style & friendly environment • WFH mode • Annual Paid vacation — 30 b/days + unpaid vacation • Paid sick leaves — 6 b/days per year • Corporate Perks (external training, English course, business speaking club, corporate events/team buildings) • Professional and personal growth