Lead BI Engineer

Job not on LinkedIn

🔥 0 minutes ago

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

CRG Solutions

WebsiteLinkedInAll Job Openings

201 - 500 employees

Founded 2015

🏢 Enterprise

🤝 B2B

🎯 Recruiter

Enterprise • B2B • Recruitment

CRG Solutions is an IT consulting and engineering firm that delivers managed IT services, enterprise engineering (networks, data centers, cloud, collaboration, and programmability), and talent solutions such as staff augmentation, talent search, nearshoring, and build-operate-transfer. The company also provides automation and digital transformation services (including AI, IoT, RPA), 24/7 help desk and NOC operations, and industry-focused technology support for sectors like healthcare, education, and travel. With roughly 29 years’ experience and operations in LATAM and the US, CRG focuses on helping enterprise clients manage and modernize their technology infrastructure.

📋 Description

• Architect, build, and optimize distributed data pipelines using Apache Spark in a high‑volume, mission‑critical environment. • Design and maintain enterprise Lakehouse architecture with Delta Lake, ensuring ACID compliance, lineage, auditability, and data governance. • Develop automated ingestion frameworks (batch, streaming, and event‑driven) across multiple cloud services and integration points. • Enable machine‑learning workflows by preparing feature‑ready datasets and establishing reproducible ML deployment patterns. • Lead platform‑wide data quality, access control, and cataloging frameworks. • Implement advanced cost‑optimization, cluster tuning, and performance engineering strategies. • Collaborate with Finance, BI, Operations, and ML teams to translate complex business needs into scalable data solutions. • Own production reliability, troubleshooting, and root‑cause analysis for data and ML pipelines.

🎯 Requirements

• 7+ years of experience in advanced data engineering with distributed compute technologies. • Expert‑level Spark engineering (performance tuning, cluster configuration, partition strategies, optimization of large datasets). • Hands‑on experience with Lakehouse architectures including ACID transactions, schema evolution, and governance frameworks. • Deep proficiency in Python and SQL for large‑scale data transformation. • Experience supporting machine‑learning pipelines or model operationalization. • Proven experience architecting cloud‑native data platforms (Azure, AWS, or GCP). • Strong background integrating diverse, complex data sources at enterprise scale. • Demonstrated ability to own mission‑critical production systems. • Experience with distributed streaming frameworks (Kafka, Event Hubs, or similar). • Experience building or supporting ML platforms, feature stores, or experiment‑tracking systems. • Background in data security, compliance controls, or audit‑ready governance. • Experience automating data operations with CI/CD and infrastructure‑as‑code.

🏖️ Benefits

• Flexible work arrangements