Data Engineer

February 2

Apply Now

Get a free AI resume review

Aptitude Software

WebsiteLinkedInAll Job Openings

Where others see complexity, we see possibility.

Specialist finance (CFO office) software • Accounting hubs • calculation engines and sub-ledgers • Finance transformation • Financial insight

501 - 1000

Description

• Design and implement robust data architectures, including data lakes and data warehouses, from scratch. • Identify and integrate tools for data transformation and orchestration to streamline data flow and processing. • Collaborate with IT and software development teams to assess and deploy new technologies and tools. • Ensure optimal data processing architectures are in place for both real-time and batch data processing. • Manage the collection, storage, and retrieval of large datasets, ensuring scalability, reliability, and security. • Develop and maintain scalable and efficient data pipelines. • Work closely with data analysts and other stakeholders to understand data needs and deliver solutions that meet business requirements. • Integrate new data sources into the data platform through APIs or bulk data transfer. • Stay abreast of industry trends and best practices in data engineering. • Develop and manage data pipelines for both batch and real-time data processing, with a focus on streaming data handling using Kafka.

Requirements

• Bachelor's or Master's degree in Computer Science, Engineering, or related field. • 4+ years of experience in data engineering, including hands-on experience in building data lakes and data warehouses. • Strong experience in streaming data platforms, particularly Kafka. • Proficiency in SQL and experience with relational and NoSQL databases. • Experience in implementing data processing pipelines and ETL processes. • Strong programming skills in Python. • Understanding of Java, Scala. • Solid understanding of big data technologies (such as Hadoop, Spark) and cloud services (AWS, Azure, GCP). • Excellent problem-solving and analytical skills. • Ability to work independently and manage multiple projects simultaneously.

Benefits

• Profit-related bonus • Private healthcare • Life and disability insurance • ShareSave scheme - ability to purchase company shares on preferential terms • English language lessons during working hours • Flexible working conditions and hybrid work model for Wroclaw based and telework for other cities