Senior Data Engineer – Pipeline

🔥 1 minute ago

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Stefanini Brasil

WebsiteLinkedInAll Job Openings

10,000+ employees

Founded 1987

💼 Consulting

🏥 Healthcare

📦 Logistics

Consulting • Healthcare • Logistics

Stefanini Brasil is a leading provider of digital transformation solutions, offering a range of services including artificial intelligence, cybersecurity, cloud enablement, and consulting. With over 35 years of experience, the company focuses on integrating innovative technologies to help organizations enhance their operations and customer experiences across various industries. Their expertise extends to sectors like healthcare, retail, and industrial goods, enabling businesses to optimize processes and drive value through technology.

📋 Description

• Design and enable data flows, including ETL, ELT, and data streaming processes • Develop and maintain data pipelines for efficient and reliable movement of information between systems • Perform testing and implement tools to automate and optimize real-time and batch data processing • Ensure data integrity and quality throughout the data lifecycle • Use Python for data manipulation, especially Pandas, NumPy, PySpark, Polars, DuckDB, SQLAlchemy, or similar • Work on Machine Learning projects using Airflow, Spark, Flink, Kafka, Parquet, and other similar tools

🎯 Requirements

• Bachelor's degree in Information Technology or a related field, or a degree with postgraduate studies in computing/IT • Practical experience with databases and SQL • Practical knowledge of multidimensional databases • Knowledge of ETL (Extract, Transform, Load) processes • Familiarity with data structures, data warehouses, and data marts • General knowledge of Business Intelligence • Strong analytical skills • Proficiency in Microsoft Power BI • Experience designing and enabling data flows, including ETL, ELT, and data streaming • Experience developing and maintaining data pipelines • Experience testing and implementing tools for real-time and batch data processing • Advanced knowledge of Python for data, especially Pandas, NumPy, PySpark, Polars, DuckDB, and SQLAlchemy, or similar • Advanced knowledge of Machine Learning projects, especially Airflow, Spark, Flink, Kafka, and Parquet, among others

🏖️ Benefits

• Meal allowance or meal voucher • Discounts for courses, universities, and language institutions • Stefanini Academy — an online platform offering free, up-to-date courses with certification • Mentoring • Benefits club for consultations and exams • Health insurance • Dental insurance • Perks and discounts at partner establishments • Travel club • Pet care benefits