Mid/Senior Data Engineer

Job not on LinkedIn

6 days ago

Apply Now

Receive Emails with Similar Jobs

Alterdata Software

WebsiteLinkedInAll Job Openings

Software • B2B • Productivity

Alterdata Software is a company that specializes in developing comprehensive software solutions tailored for various sectors, including accounting, real estate, and corporate management. They aim to simplify business management with agile and effective ERP systems, designed to facilitate the day-to-day operations for businesses of all sizes. With a focus on innovative solutions, Alterdata seeks to enhance productivity and control for its users.

1001 - 5000 employees

Founded 1989

🤝 B2B

⚡ Productivity

📋 Description

• Data Architecture on AWS: Design, build and maintain the Data Lake (S3) and Data Warehouse (Redshift), ensuring high availability and efficient partitioning. • Pipeline Engineering (ETL/ELT): Develop data ingestion and transformation routines using AWS Glue and EMR (Spark), prioritizing performance and cost efficiency. • Infrastructure as Code (IaC): Provision and manage all data resources (databases, buckets, instances) using Terraform. No resources are created manually in the AWS Console. • Automation and CI/CD: Implement continuous integration and delivery pipelines for data workflows using GitLab CI, ensuring versioning and automated testing. • Serverless and Event-Driven Architectures: Build event-driven architectures using AWS Lambda, EventBridge and Step Functions for real-time and batch processing. • Governance and Quality: Configure access policies and data catalog via AWS Lake Formation, ensuring compliance with LGPD (Brazilian General Data Protection Law) and information security. • Monitoring and Observability: Implement logging and metrics (CloudWatch) to ensure pipeline health and proactively address incidents. • Collaboration: Work closely with data analysts, data scientists and software engineers to understand requirements and deliver effective data solutions.

🎯 Requirements

• Education: Bachelor’s degree in Computer Science, Data Engineering/Software Engineering or equivalent. • Prior Experience: Proven experience working as a Data Engineer or in a similar role. • Languages: Advanced proficiency in Python (focus on data manipulation and scripting) and advanced SQL. • AWS Core: Hands-on experience with S3, Redshift, Glue, Lambda, Athena and IAM. • IaC (Mandatory): Experience with Terraform for infrastructure management.

🏖️ Benefits

• This position is also open to candidates with disabilities (PwD).