Data Engineer (Spark)

April 17

GetInData | Part of Xebia

WebsiteLinkedInAll Job Openings

Experts dedicated to becoming the leaders in providing Big Data, Cloud, Analytics, ML/AI/BI services.

Big data • Hadoop • NoSQL • Spark • Kafka

51 - 200

Description

• Working on developing a modern platform for the collection and analysis of lineage metadata • Working closely with the GetInData and client teams on building and maintaining specifications and integrations for tools like Apache Airflow, Flink, or Spark • Developing Marquez service for the collection, aggregation, and visualization of lineage metadata • Ensuring compliance with industry standards and regulations • Defining and implementing security measures according to best practices

Requirements

• Very good knowledge of Java or Python, or both • Experience working with databases or data processing systems • Good knowledge of SQL • Experience working with Spark • Knowledge of big data landscape • Ability to work independently and focus on impactful features • Strong B2/C1 English - ability to express complex ideas both in text and speech • Experience as a contributor to an open-source community is a plus • Ability to actively participate/lead discussions with clients to identify and assess concrete and ambitious avenues for improvement

Benefits

• 100% remote work • Flexible working hours • Opportunity to learn and develop with the best Big Data experts • International projects • Possibility of conducting workshops and training • Certifications • Co-financing sport card • Co-financing health care • All equipment needed for work