Data Engineer, Python, PySpark, AWS Glue, Amazon Athena, SQL, Apache Airflow

Job not on LinkedIn

September 9

Apply Now

Receive Emails with Similar Jobs

Wizdaa

WebsiteLinkedInAll Job Openings

Recruitment • HR Tech • SaaS

Wizdaa is a company that provides access to top-tier remote developers, specializing in helping startups build their dream development teams in the U. S. time zone. They offer a meticulous six-stage human and AI screening process to ensure access to the top 1% of engineering talent. Wizdaa's services include managing hiring processes, onboarding, payroll, benefits, and taxes, allowing startups to focus on core business matters. Known for competitive rates averaging $30/hour, Wizdaa emphasizes cultural fit, technical excellence, and English fluency among their developers. The company prides itself on delivering tailored, cost-effective solutions that maximize startups' runway and success. They also offer insights into leveraging AI tools and aligning remote teams with U. S. time zones to boost productivity.

11 - 50 employees

🎯 Recruiter

👥 HR Tech

☁️ SaaS

📋 Description

• Build, optimize, and scale data pipelines and infrastructure using Python, TypeScript, Apache Airflow, PySpark, AWS Glue, and Snowflake • Design, operationalize, and monitor ingest and transformation workflows: DAGs, alerting, retries, SLAs, lineage, and cost controls • Collaborate with platform and AI/ML teams to automate ingestion, validation, and real-time compute workflows and work toward a feature store • Integrate pipeline health and metrics into engineering dashboards for full visibility and observability • Model data and implement efficient, scalable transformations in Snowflake and PostgreSQL • Build reusable frameworks and connectors to standardize internal data publishing and consumption

🎯 Requirements

• 4+ years of production data engineering experience • Deep, hands-on experience with Apache Airflow, AWS Glue, PySpark, and Python-based data pipelines • Strong SQL skills and experience operating PostgreSQL in live environments • Solid understanding of cloud-native data workflows (AWS preferred) and pipeline observability (metrics, logging, tracing, alerting) • Proven experience owning pipelines end-to-end: design, implementation, testing, deployment, monitoring, and iteration • Experience with Snowflake performance tuning (warehouses, partitions, clustering, query profiling) and cost optimization (preferred) • Real-time or near-real-time processing experience (streaming ingestion, incremental models, CDC) (preferred) • Hands-on experience with a backend TypeScript framework (e.g., NestJS) is a strong plus (preferred) • Experience with data quality frameworks, contract testing, or schema management (e.g., Great Expectations, dbt tests, OpenAPI/Protobuf/Avro) (preferred) • Background in building internal developer platforms or data platform components (connectors, SDKs, CI/CD for data) (preferred)

🏖️ Benefits

• Fully remote position • Compensation paid in USD • Work hours aligned with EST (9 AM to 6 PM EST) or PT time zone