Data Engineer – Big Data

Job not on LinkedIn

November 26

Apply Now
Logo of 2COMS Consulting Pvt. Ltd.

2COMS Consulting Pvt. Ltd.

Recruitment • HR Tech • B2B

2COMS Consulting Pvt. Ltd. is an India-based recruitment and staffing firm with decades of experience providing end-to-end talent solutions for employers and job seekers. The company offers general and IT staffing, apprenticeship management, hire-train-deploy programs, RPO and international recruitment, gig workforce services, and digital HR/recruitment technology solutions to streamline hiring and reduce training costs. With pan-India operations and clients across sectors like BPO/KPO, retail, and IT, 2COMS focuses on placing candidates, managing apprenticeships, and delivering HRTech-enabled recruitment outsourcing.

10,000+ employees

Founded 1999

🎯 Recruiter

👥 HR Tech

🤝 B2B

📋 Description

• Design, develop, and manage ETL/ELT pipelines using Apache Spark (Scala) • Optimize Spark-based data processing workflows • Build and maintain data pipelines that extract, transform, and load data • Collaborate with data architects and analysts • Implement end-to-end data orchestration using AWS Step Functions or Azure Logic Apps • Utilize AWS Glue, Crawler, or Azure Data Factory • Monitor pipeline health and enforce data quality standards • Maintain high coding standards and produce documentation

🎯 Requirements

• 5-10 years of experience as a Data Engineer • 4+ years of progressive experience developing data solutions in large-scale Big Data environments • 3+ years of hands-on experience with Python, Apache Spark, and Apache Kafka • Proficient in AWS or Azure cloud platforms • Strong expertise in SQL and NoSQL data technologies • Solid understanding of data warehousing principles and ETL/ELT methodologies • Excellent written and verbal communication skills

🏖️ Benefits

• Professional development opportunities

Apply Now

Similar Jobs

November 10

Weekday (YC W21)

11 - 50

☁️ SaaS

🎯 Recruiter

Market Data Engineer specializing in infrastructure and production support for financial IT environments. Managing systems and scripts to optimize market data platform performance.

🇮🇳 India – Remote

⏳ Contract/Temporary

🟠 Senior

🔴 Lead

🚰 Data Engineer

October 31

TWO95 International, Inc

51 - 200

☁️ SaaS

🔒 Cybersecurity

🤖 Artificial Intelligence

Data Engineer developing and implementing analytics platform components for various analytics groups. Supporting data flow troubleshooting with cloud data warehouse activities remotely.

🇮🇳 India – Remote

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🚰 Data Engineer

October 17

InfyStrat Software Services

501 - 1000

🔒 Cybersecurity

Data Engineer building and maintaining data architecture at InfyStrat. Designing robust data pipelines and collaborating with teams to support analytical needs.

🇮🇳 India – Remote

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🚰 Data Engineer

October 12

Ciphercru Innovation Pvt Ltd

51 - 200

🤝 B2B

☁️ SaaS

🤖 Artificial Intelligence

Azure Data Engineer responsible for designing and developing ETL/ELT pipelines using Azure services. Collaborating with teams to optimize data quality and pipeline performance.

🇮🇳 India – Remote

💵 ₹10k / month

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🚰 Data Engineer

September 11

ProArch

201 - 500

🤖 Artificial Intelligence

🔒 Cybersecurity

Senior AWS Data Engineer at ProArch designing and operating AWS data pipelines and warehouses.

🇮🇳 India – Remote

⏳ Contract/Temporary

🟠 Senior

🚰 Data Engineer

Developed by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com