Senior Consultant, Databricks

🔥 1 hour ago

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Unison Group

WebsiteLinkedInAll Job Openings

201 - 500 employees

Founded 2012

💼 Consulting

💳 Fintech

🤖 Artificial Intelligence

Consulting • Fintech • Artificial Intelligence

Unison Group is a Singapore-founded (2012) boutique technology and consulting firm that empowers global financial institutions with specialized services in risk, compliance, analytics, and cloud-native digital transformation. The firm focuses on Liquidity Risk, Market Risk, Credit Risk, and Regulatory Compliance and delivers consulting, system integration, business intelligence, and software/IT development. Key capabilities include data engineering and analytics, cloud engineering (AWS/Azure/Databricks/Snowflake), AI & ML (Generative AI, MLOps, automation), and BFSI-focused solutions; it also offers proprietary platforms (uArrow, Risk Insight, Regulatory Reporting, Workflow, Enterprise AI) to support enterprise-grade deployments and real-time compliance. Unison partners with banks and financial institutions to implement secure, scalable, and compliant systems that drive operational efficiency and informed decision-making.

📋 Description

• Design, develop, and maintain scalable data pipelines using Databricks. • Build and optimize ETL/ELT workflows using PySpark and Spark SQL. • Develop and manage Delta Lake architecture for reliable and efficient data processing. • Integrate data from multiple sources including databases, APIs, streaming platforms, and cloud storage. • Collaborate with business stakeholders, data analysts, and data scientists to understand business requirements. • Optimize Spark jobs for performance, scalability, and cost efficiency. • Implement data quality, governance, and security best practices. • Monitor production workloads and troubleshoot performance issues. • Automate deployment processes using CI/CD pipelines. • Mentor junior team members and provide technical guidance during project delivery.

🎯 Requirements

• Strong experience with **Databricks Platform**. • Hands-on expertise in **Apache Spark**, **PySpark**, and **Spark SQL**. • Experience with **Delta Lake**, Unity Catalog, and Databricks Workflows. • Strong SQL programming and data modeling skills. • Experience with cloud platforms such as **AWS**, **Azure**, or **Google Cloud Platform (GCP)**. • Experience working with data lakes, data warehouses, and modern data architectures. • Knowledge of orchestration tools such as **Azure Data Factory (ADF)**, **Apache Airflow**, or similar. • Experience with version control tools such as Git. • Understanding of CI/CD practices and DevOps concepts. • Excellent analytical, troubleshooting, and problem-solving skills.