Senior Data Engineer – Apache NiFi

Job not on LinkedIn

🕒 May 21

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Keyrus

WebsiteLinkedInAll Job Openings

1001 - 5000 employees

Founded 1996

Consulting • Data Analytics • Digital Transformation

Keyrus is a global consulting company that specializes in data and digital transformation. Operating in over 20 countries, Keyrus works with clients to leverage data analytics and cutting-edge digital transformation strategies to drive business success. The company prides itself on being technology agnostic, partnering with various innovative software vendors. Keyrus promotes a multicultural and flexible work environment, emphasizing innovation, trust, and ownership among its employees. The company offers extensive career development opportunities and a comprehensive benefits package. With expertise in data analytics and digital transformation, Keyrus aims to make a significant impact on the digital future.

📋 Description

• Design, develop, and maintain data pipelines using Apache NiFi, ensuring efficient ingestion and transformation. • Integrate structured and unstructured data from multiple sources, including Salesforce, APIs, SFTP, SAP, and CRM, into cloud-based and on-premise databases. • Ensure data quality, security, and governance across diverse sources and destinations. • Optimise and troubleshoot NiFi workflows to improve performance, reliability, and scalability. • Work with APIs to fetch and send real-time data for external integrations (e.g., CustomerGauge). • Manage and operate NiFi architecture within Kubernetes environments. • Collaborate with data scientists, analysts, and engineers to ensure data availability and usability. • Improve and optimise ETL/ELT processes for large-scale data processing. • Use NiFi Registry and Toolkit to maintain version control and streamline deployments across environments. • Develop Bash and Python scripts for automation, monitoring, and workflow execution. • Implement CI/CD pipelines for data pipeline deployments and workflow automation. • Analyse and resolve data pipeline issues, ensuring high availability and reliability.

🎯 Requirements

• Strong expertise in Apache NiFi, including flow design, performance tuning, version control, and security configurations. • Experience in data ingestion, transformation, and processing for both batch and real-time workflows. • Proficiency in SQL and NoSQL databases, such as PostgreSQL, MySQL, and MongoDB. • Experience with big data technologies, including Apache Kafka, Spark, Hadoop, and HDFS. • Familiarity with cloud platforms (AWS, Azure, or GCP) and their data services (e.g., AWS Redshift, Azure Synapse, Google BigQuery). • Proficiency in at least one programming language, such as Python or Java. • Experience with CI/CD pipelines, version control tools (Git, Jenkins), and automation frameworks. • Strong problem-solving skills and ability to work independently in a remote environment. • Excellent communication and stakeholder management skills. • Fluency in English. • Must be Europe-based (Portugal/Spain preferred for permanent option).

🏖️ Benefits

• Meal allowance: €10.20/day • Flexible benefits plan • Private medical insurance • 22 days of annual leave, increasing every 3 years (up to 25 days) • Continuous learning via KLX – Keyrus Learning Experience • A collaborative, international, and human-centred work environment