Data Engineer

Job not on LinkedIn

🕒 October 19

🇮🇳 India – Remote

⏰ Full Time

🟢 Junior

🟡 Mid-level

🚰 Data Engineer

🚫👨‍🎓 No degree required

Where this job comes from

Posted on In All Media's careers page ↗In All Media's careers page, not through a job board

First seen by Remote Rocketship October 19

Still open on In All Media's site. Checked 8 hours ago.

Apply Now
Logo of In All Media

In All Media

1001 - 5000 employees

💼 Consulting

📣 Marketing

☁️ SaaS

Consulting • Marketing • SaaS

In All Media is a global community-driven service organization specializing in agile development services. The company focuses on developing digital solutions through a collaborative approach that leverages swarming intelligence and team dynamics. They are dedicated to aligning industry needs with the interests of their technical community members, who possess extensive experience in various domains such as UX/UI design, quality engineering, cloud computing, big data, Salesforce, and more. In All Media emphasizes a secure development environment and a strong collaborative spirit, striving for innovation and excellence in software production. Their model relies on pre-established teams with substantial past experience working together, ensuring efficient and effective delivery of customized development solutions.

📋 Description

• Execute the end-to-end migration of approximately 1,000 datasets to Snowflake • Upgrade orchestration workflows from Apache Airflow 2 to Airflow 3 • Migrate legacy Hive data structures and datasets to Apache Iceberg using the Snowpark Connect framework/connectors • Reconfigure, update, and migrate Confluent/Apache Kafka streaming connections across cloud regions • Adapt existing data pipelines to target Snowflake environments • Optimize SQL queries using CTEs, window functions, and complex joins • Manage, test, and debug DAGs and workflow scheduling in Apache Airflow • Implement testing strategies and conduct hands-on code debugging to ensure data quality and consistency • Modernize streaming infrastructure across cloud regions and uphold data quality and performance standards • Collaborate with the Data Platform team on a major data platform modernization initiative

🎯 Requirements

• Minimum 2+ years of hands-on data engineering experience working with large-scale datasets, Apache Airflow, and Apache Spark • Strong software engineering fundamentals • Hands-on Python development experience • Advanced SQL skills, including complex joins, CTEs, window functions, and query tuning • Proven experience with Snowflake data modeling and schema architecture • Direct experience building and testing pipelines using Apache Airflow, Apache Kafka, and Apache Spark / PySpark • Expertise with Apache Iceberg and Apache Parquet data formats • Experience with AWS S3, including data lakes, bucket partitioning, and lifecycle policies • Ability to define testing strategies and independently debug complex distributed data pipelines • Strong communication skills and ability to work independently in a fast-paced environment • Ability to demonstrate good connectivity to an AWS WorkSpace region by completing the required connectivity test • Required English for interviews, documentation, and daily communication • Ability to overlap until at least 12:00 PM Pacific Time

🏖️ Benefits

• Fully remote work arrangement • Full-time, permanent employment • Client-provisioned AWS WorkSpace

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 October 19

FormativGroup

51 - 200

💼 Consulting

🏥 Healthcare

🛡️ Insurance

Data engineering consultant building Databricks, Snowflake, AWS, and Azure solutions for FormativGroup’s technology integration clients. Supporting pipelines, ETL/ELT, data platforms, governance, and analytics delivery.

🕒 October 12

Saaf Finance

11 - 50

💳 Fintech

🤖 Artificial Intelligence

☁️ SaaS

Senior Data Engineer building scalable pipelines, warehouses, and AI workflows for Saaf AI’s mortgage lending platform. Enabling compliant underwriting, automation, and data-driven operations.

🕒 October 6

Greenlight Planet

1001 - 5000

⚡ Energy

🌍 Social Impact

👥 B2C

SAP Data Engineer developing ABAP solutions and SAP data pipelines. Integrating Sun King’s SAP ecosystem with cloud data platforms while strengthening in-house capabilities.

🕒 September 21

Netomi

51 - 200

💼 Consulting

📦 Logistics

📣 Marketing

Data Engineer II building scalable pipelines and analytics for Netomi's agentic AI customer-experience platform. Developing data products, models, scorecards, and insights for global enterprise brands.

🇮🇳 India – Remote

💰 $30M Series B on 2021-11

⏰ Full Time

🟡 Mid-level

🚰 Data Engineer

🕒 September 21

Netomi

51 - 200

💼 Consulting

📦 Logistics

📣 Marketing

Data Engineer I building scalable pipelines and analytics for Netomi’s enterprise agentic AI customer-experience platform. Supporting data products, real-time insights, and product-quality improvements.

Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok