Data Engineer

Job not on LinkedIn

October 14

Apply Now

Receive Emails with Similar Jobs

Pavago

WebsiteLinkedInAll Job Openings

Recruitment • B2B • HR Tech

Pavago is a company specializing in offshore recruitment, offering comprehensive solutions to secure top global talent for operations, sales, marketing, and more at significantly reduced costs. Pavago provides an all-in-one service that includes talent acquisition, hiring, onboarding, payroll management, and compliance assurance. With a focus on sourcing the top 1% of offshore talent, Pavago simplifies the recruitment process through a proven five-step method that ensures cultural and skill fit. Catering to small and medium-sized businesses, Pavago is a partner in operational and administrative functions, allowing businesses to focus on growth while benefiting from dedicated support and ongoing training packages.

2 - 10 employees

🎯 Recruiter

🤝 B2B

👥 HR Tech

📋 Description

• Build and maintain ETL/ELT pipelines using Python, SQL, or Scala. • Orchestrate workflows with Airflow, Prefect, Dagster, or Luigi. • Ingest structured and unstructured data from APIs, SaaS platforms, relational databases, and streaming sources. • Manage data warehouses (Snowflake, BigQuery, Redshift). • Design schemas (star/snowflake) optimized for analytics. • Implement partitioning, clustering, and query performance tuning. • Implement validation checks, anomaly detection, and logging for data integrity. • Enforce naming conventions, lineage tracking, and documentation (dbt, Great Expectations). • Maintain compliance with GDPR, HIPAA, or industry-specific regulations. • Develop and monitor streaming pipelines with Kafka, Kinesis, or Pub/Sub. • Ensure low-latency ingestion for time-sensitive use cases. • Partner with analysts and data scientists to provide curated, reliable datasets. • Support BI teams in building dashboards (Tableau, Looker, Power BI). • Document data models and pipelines for knowledge transfer. • Containerize data services with Docker and orchestrate in Kubernetes. • Automate deployments via CI/CD pipelines (GitHub Actions, Jenkins, GitLab CI). • Manage cloud infrastructure using Terraform or CloudFormation.

🎯 Requirements

• 3+ years in data engineering or back-end development. • Strong Python and SQL skills. • Experience with at least one major data warehouse (Snowflake, Redshift, BigQuery). • Familiarity with pipeline orchestration tools (Airflow, Prefect).