Data Engineer - Databricks

Job not on LinkedIn

June 11

Apply Now

Receive Emails with Similar Jobs

InOrg Global

WebsiteLinkedInAll Job Openings

Enterprise • SaaS • B2B

InOrg Global is a company specializing in managed services and innovative business strategies. They focus on providing AI/ML services, strategic operations, and workspace management to enhance productivity and efficiency. InOrg offers a unique Build-Operate-Transfer (BOT) model, guiding businesses through design, development, operation, and seamless transition of control to ensure sustained success. The company is dedicated to empowering digital disruptors and optimizing business processes with expertise in global capability centers, helping clients expand their global reach and achieve operational excellence.

51 - 200 employees

🏢 Enterprise

☁️ SaaS

🤝 B2B

📋 Description

• Design, build, and maintain scalable data pipelines using Databricks and Apache Spark. • Integrate data from various sources into data lakes or data warehouses. • Implement and manage Delta Lake architecture for reliable, versioned data storage. • Ensure data quality, performance, and reliability through testing and monitoring. • Collaborate with data analysts, scientists, and stakeholders to meet data needs. • Automate workflows and manage job scheduling within Databricks. • Maintain clear and thorough documentation of data workflows and architecture.

🎯 Requirements

• 3+ years in data engineering with strong exposure to Databricks and big data tools. • Proficient in Python or Scala for ETL development. • Strong understanding of Spark, Delta Lake, and Databricks SQL. • Familiar with REST APIs, including Databricks REST API usage. • Experience with AWS, Azure, or GCP. • Familiarity with data lakehouse concepts and dimensional modeling. • Comfortable using Git and pipeline automation tools. • Strong problem-solving abilities, attention to detail, and teamwork. • Databricks Certified Data Engineer Associate/Professional (nice to have). • Experience with Airflow or Databricks Workflows. • Familiarity with Datadog, Prometheus, or similar tools. • Exposure to MLflow or model integration in pipelines.