Mid-Senior Data Developer, PySpark, AWS

🕒 May 20

Apply Now

Find Similar Remote Jobs

Receive Emails For Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

CI&T

WebsiteLinkedInAll Job Openings

5001 - 10000 employees

Founded 1995

🤖 Artificial Intelligence

☁️ SaaS

💰 $5.5M Venture Round on 2014-04

Artificial Intelligence • Cloud Services • SaaS

CI&T is a global tech transformation specialist focusing on helping organizations navigate their technology journey. With services spanning from application modernization and cloud solutions to AI-driven data analytics and customer experience, CI&T empowers businesses to accelerate their growth and maximize operational efficiency. The company emphasizes digital product design, strategy consulting, and immersive experiences, ensuring a robust support system for enterprises in various industries.

📋 Description

• Design, implement, and maintain end-to-end data pipelines (ELT/ETL) with a focus on reliability, reprocessing, and cost efficiency. • Orchestrate jobs and routines using Airflow (on AWS) and serverless functions (AWS Lambda); support deployments on EKS when needed. • Model data in Snowflake (bronze/silver/gold layers) and develop transformations in dbt (macros, tests, docs). • Build integrations and services in Python with FastAPI to expose/consume data and automate processes. • Ingest, normalize, and version market data, with emphasis on historical data and distribution (batch; limited streaming). • Write high-performance SQL (tuning, partitioning/clustering in Snowflake and in Postgres). • Use Pandas for ad-hoc processing, validations, and transformation prototyping. • Ensure quality (dbt tests, data checks), observability (logs/metrics/alerts), security (access controls, masking), and documentation. • Collaborate with business, analytics, and product teams to define SLAs, data contracts, and governance standards.

🎯 Requirements

• Strong experience with SQL (query optimization, relational and analytical modeling). • Hands-on experience with Snowflake (warehousing, roles, tasks, performance, cost management) and dbt (models, tests, sources, exposures). • Experience building data pipelines in Airflow (DAGs, sensors, retries, SLAs) and AWS Lambda. • Knowledge of Postgres (ingestion, basic replication/CDC or maintenance, routines). • Experience with Python for data (Pandas) and API development with FastAPI. • Practice in batch-oriented ELT/ETL, Git versioning, and CI/CD (secure deployment of pipelines/dbt models). • Familiarity with data security and governance (access control, lineage, documentation, sensitive data). • Technical English for reading documentation.

🏖️ Benefits

• Health and dental insurance • Food and meal allowance • Childcare assistance • Extended parental leave • Partnerships with gyms and health & wellness professionals via Wellhub (Gympass) / TotalPass • Profit Sharing (PLR) • Life insurance • Continuous learning platform (CI&T University) • Employee discount club • Free online platform dedicated to physical and mental health and well-being • Prenatal and responsible-parenting course • Partnerships with online course platforms • Language learning platform