Senior Data Engineer

October 30

Apply Now

Receive Emails with Similar Jobs

Shuru

WebsiteLinkedInAll Job Openings

Artificial Intelligence • B2B • Enterprise

Shuru is a product, AI, and technology consulting firm that partners with businesses to deliver strategic consulting, full-cycle product and custom software development, and curated engineering team extension. Their AI-native engineering teams build scalable AI applications, data engineering and analytics, cloud/DevOps, and API integrations to modernize systems and accelerate product delivery. Shuru operates globally with a remote-first model and emphasizes high ownership, design thinking, and measurable outcomes for enterprise and startup clients.

51 - 200 employees

Founded 2021

🤖 Artificial Intelligence

🤝 B2B

🏢 Enterprise

📋 Description

• Design and implement scalable data pipelines for ingestion, validation, cleanup, and normalization • Build and maintain ETL/ELT processes to support both batch and real-time data processing • Develop data quality frameworks and monitoring systems to ensure data integrity • Optimize pipeline performance and troubleshoot data flow issues • Deploy and manage data infrastructure on AWS and GCP platforms • Implement Infrastructure as Code (IaC) using Terraform for reproducible deployments • Design and maintain data lakes, data warehouses, and streaming architectures • Ensure security, compliance, and cost optimization across cloud resources • Implement event-driven architectures using technologies like Kafka, Kinesis, or Pub/Sub

🎯 Requirements

• 5+ years of experience in data engineering or related field • Hands-on experience with data pipeline development and maintenance • Strong proficiency in Python, SQL, and at least one other programming language (Java, Scala, Go) • Extensive experience with AWS services (S3, Redshift, EMR, Kinesis, Lambda, Glue) • Solid experience with GCP services (BigQuery, Dataflow, Pub/Sub, Cloud Storage) • Proven experience with Infrastructure as Code using Terraform • Strong background in streaming technologies (Apache Kafka, Amazon Kinesis, Google Pub/Sub) • Experience with data processing frameworks (Apache Spark, Apache Beam, Airflow) • Proficiency with data warehousing solutions (Redshift, BigQuery, Snowflake) • Knowledge of NoSQL databases (MongoDB, Cassandra, DynamoDB) • Familiarity with containerization (Docker, Kubernetes) • Experience with monitoring and observability tools (CloudWatch, Stackdriver, Datadog)

🏖️ Benefits

• Competitive salary and benefits package. • Opportunity to work with a team of experienced product and tech leaders. • A flexible work environment with remote working options. • Continuous learning and development opportunities. • Chance to make a significant impact on diverse and innovative projects.