Data Engineer

🕒 Yesterday

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

EXL

WebsiteLinkedInAll Job Openings

10,000+ employees

💰 $2M Venture Round on 2015-01

Choosing a digital partner is about more than capabilities — it’s about collaboration and character.

📋 Description

• Collaborate with data analysts, reporting team and business advisors to gather requirements and define data models that effectively support business requirements • Develop and maintain scalable and efficient data pipelines to ensure seamless data flow across various systems and address any issues or bottlenecks in existing pipelines. • Implement robust data checks to ensure the accuracy and integrity of data. Summarize and validate large datasets to ensure they meet quality standards. • Monitor data jobs for successful completion. Troubleshoot and resolve any issues that arise to minimize downtime and ensure continuity of data processes. • Regularly review and audit data processes and pipelines to ensure compliance with internal standards and regulatory requirements • Familiar with working on Agile methodologies - scrum, sprint planning, backlog refinement etc.

🎯 Requirements

• 7-12 years experience on Data Engineering role working with Databricks and any Cloud technologies- AWS, Azure, Databricks. • Bachelor’s degree in computer science, Information Technology, or related field. • Strong proficiency in PySpark, Python, SQL. • Strong experience in data modeling, ETL/ELT pipeline development, and automation • Hands-on experience with performance tuning of data pipelines and workflows • Proficient in working on any cloud components Azure Data Factory, Azure DataBricks, Azure Data Lake, S3, Lamda. • Experience with data modeling, ETL processes, Delta Lake and data warehousing. • Experience on Delta Live Tables, Autoloader & Unity Catalog. • Preferred - Knowledge of the insurance industry and its data requirements. • Strong analytical skills with the ability to collect, organize, analyze, and disseminate significant amounts of information with attention to detail and accuracy. • Excellent communication and problem-solving skills to work effectively with diverse teams • Excellent problem-solving skills and ability to work under tight deadlines.

🏖️ Benefits

• Health insurance • Retirement plans • Paid time off • Flexible work arrangements • Professional development opportunities • Bonuses