Senior Data Engineer

🕒 April 14

Apply Now

Find Similar Remote Jobs

Receive Emails For Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Brillio

WebsiteLinkedInAll Job Openings

1001 - 5000 employees

🤖 Artificial Intelligence

🔒 Cybersecurity

💰 Private Equity Round on 2019-01

Artificial Intelligence • Consulting • Cybersecurity

Brillio is a technology consulting company that specializes in driving digital transformation for businesses across various industries such as banking, financial services, insurance, life sciences, telecom and media, healthcare, and retail. They focus on customer experience transformation, data and AI, product and platform engineering, and provide infrastructure, cloud, and security solutions. With an emphasis on engineering digital products and leveraging generative AI, Brillio aims to provide bespoke solutions that help businesses thrive in the age of AI and technological disruption. They also offer services to help businesses adapt to new technological challenges and turn disruptions into competitive advantages.

📋 Description

• Design and develop scalable ETL/ELT pipelines using PySpark and Spark SQL • Build and maintain Databricks workflows (Jobs) for orchestration • Implement Delta Live Tables (DLT) for declarative pipeline development • Develop and manage batch and streaming data pipelines • Design and implement Medallion Architecture (Bronze, Silver, Gold layers) • Build curated datasets for analytics and reporting • Optimize storage using Delta Lake best practices • Ingest data from multiple sources: Databases (RDBMS, NoSQL), APIs and streaming platforms (Kafka, Event Hubs), Files (CSV, JSON, Parquet)

🎯 Requirements

• Bachelor’s degree in Computer Science, Engineering, or related field • 4–8+ years of experience in Data Engineering • Strong hands-on experience with: Databricks platform, PySpark and Spark SQL, Delta Lake • Experience with: ETL/ELT pipeline development, Distributed data processing • Solid understanding of: Data modeling (Star/Snowflake schemas), Data warehousing concepts

🏖️ Benefits

• Certification in Databricks or Cloud platforms • Experience with real-time analytics • Exposure to data governance tools • Strong problem-solving and analytical thinking • Excellent communication skills • Ability to work in a collaborative environment • Attention to detail and data quality