Data Engineer – Mid-level

Job not on LinkedIn

2 days ago

Apply Now

Receive Emails with Similar Jobs

Ábaco Consulting

WebsiteLinkedInAll Job Openings

Enterprise • B2B

Ábaco Consulting is a Brazil-based IT consulting and systems integrator specializing in SAP solutions and digital transformation for medium and large enterprises. The firm is an SAP Gold Partner offering services such as S/4HANA Cloud and RISE with SAP migrations, Grow with SAP adoption programs, SAP IBP, SAP Fiori and SAP Analytics Cloud implementations, agile software development, application management (AMS) and digital transformation strategy. Ábaco serves industry clients across manufacturing, retail, fashion, agribusiness and other sectors, and emphasizes accelerated ERP adoption, cloud migrations and operational performance.

51 - 200 employees

Founded 2010

🏢 Enterprise

🤝 B2B

📋 Description

• Manage the full data lifecycle: from (near) real-time ingestion of our media players to cloud storage and delivery via APIs; • Design and maintain robust pipelines (batch and streaming) that feed dashboards, predictive models and reports used across multiple teams; • Ensure data governance, including versioning, cataloging, lineage and high-level data quality; • Promote a data-driven culture: develop frameworks, best practices and guides that make squads increasingly autonomous in their use of data; • Test and innovate: evaluate new technologies (e.g., Delta Lake, Iceberg, DuckDB) and propose proofs of concept that improve performance, reduce costs and accelerate insights; • Mentor the team, supporting analysts and more junior engineers in their technical development.

🎯 Requirements

• 2+ years building data pipelines in production (ETL/ELT, streaming...) • Strong proficiency in Python and advanced SQL • Experience with orchestrators (Airflow, Prefect, Dagster...) • Distributed processing (Spark, Dataproc, EMR, Flink...) • Cloud storage/warehousing (BigQuery, Redshift, Snowflake, Lakehouse, etc.) • Version control with Git and CI/CD (GitHub Actions, GitLab, Argo...) • DataOps practices, data testing and observability • Experience with media, ad tech or mobility data • Certifications in GCP (Data Engineer), AWS (Big Data) or Azure (DP-203) • Knowledge of geospatial data, sensors/IoT or beacons

🏖️ Benefits

• Contract duration: Indeterminate • Project allocation/term: Indeterminate • Type of engagement: Dedicated contractor (PJ)