Data Engineer – Big Data

Job not on LinkedIn

November 26

Apply Now

Receive Emails with Similar Jobs

2COMS Consulting Pvt. Ltd.

WebsiteLinkedInAll Job Openings

Recruitment • HR Tech • B2B

2COMS Consulting Pvt. Ltd. is an India-based recruitment and staffing firm with decades of experience providing end-to-end talent solutions for employers and job seekers. The company offers general and IT staffing, apprenticeship management, hire-train-deploy programs, RPO and international recruitment, gig workforce services, and digital HR/recruitment technology solutions to streamline hiring and reduce training costs. With pan-India operations and clients across sectors like BPO/KPO, retail, and IT, 2COMS focuses on placing candidates, managing apprenticeships, and delivering HRTech-enabled recruitment outsourcing.

10,000+ employees

Founded 1999

🎯 Recruiter

👥 HR Tech

🤝 B2B

📋 Description

• Design, develop, and manage ETL/ELT pipelines using Apache Spark (Scala) • Optimize Spark-based data processing workflows • Build and maintain data pipelines that extract, transform, and load data • Collaborate with data architects and analysts • Implement end-to-end data orchestration using AWS Step Functions or Azure Logic Apps • Utilize AWS Glue, Crawler, or Azure Data Factory • Monitor pipeline health and enforce data quality standards • Maintain high coding standards and produce documentation

🎯 Requirements

• 5-10 years of experience as a Data Engineer • 4+ years of progressive experience developing data solutions in large-scale Big Data environments • 3+ years of hands-on experience with Python, Apache Spark, and Apache Kafka • Proficient in AWS or Azure cloud platforms • Strong expertise in SQL and NoSQL data technologies • Solid understanding of data warehousing principles and ETL/ELT methodologies • Excellent written and verbal communication skills

🏖️ Benefits

• Professional development opportunities