Contract Data Platform Engineer – AWS, Data Pipelines

🕒 April 30

Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of SOUTHWORKS

SOUTHWORKS

201 - 500 employees

☁️ SaaS

🏢 Enterprise

🤖 Artificial Intelligence

SaaS • Enterprise • Artificial Intelligence

SOUTHWORKS is a premium software engineering partner specializing in nearshore development with over 20 years of expertise. Operating across the US, Latin America, and Europe, they offer flexible and transparent software development services known as 'Development on Demand'. SOUTHWORKS focuses on providing world-class engineering talent in short-term, flexible contracts, allowing clients to scale their projects quickly and predictably. With expertise in areas such as cloud video engineering, data & AI, and emerging technologies, SOUTHWORKS serves clients across various industries by delivering high-profile, complex projects without surprises and with a focus on value addition.

📋 Description

• Design, build, maintain and primarily operate scalable streaming and batch data pipelines, with a strong focus on maintenance, monitoring, troubleshooting and continuous improvement of existing pipelines. • Work with AWS services, including Redshift, EMR and ECS, to support data processing and analytics workloads. • Develop and maintain data workflows using Python and SQL. • Orchestrate and monitor pipelines using Apache Airflow. • Build and deploy containerized applications using Docker and Kubernetes. • Break down high-level system designs into well-defined, deliverable tasks with realistic estimates. • Collaborate with cross-functional teams in a fast-paced and distributed environment across the US and Europe. • Drive automation, observability and monitoring to improve reliability, performance and operational efficiency. • Support knowledge transfer and ownership handover as part of the planned transition to the consuming team.

🎯 Requirements

• Strong professional experience with Python and SQL. • Hands-on experience with AWS, specifically Redshift, EMR and ECS. AWS experience is mandatory (other cloud providers are not considered equivalent for this role). • Proven experience building and operating both streaming and batch data pipelines. • Professional experience with Apache Airflow, Docker and Kubernetes. • Ability to translate high-level system designs into actionable technical tasks and realistic estimates. • Comfortable working in dynamic and fast-paced environments and in distributed teams. • Strong interest in automation and monitoring. • Strong hands-on experience with Apache Spark. • Senior-level profile with strong autonomy, communication skills and ability to work effectively in distributed teams. • Proven ability to transfer knowledge and support ownership handovers. • Fluent or professional working proficiency in English (both written and spoken).

🏖️ Benefits

• Health insurance • Remote work options

Apply Now