Senior Data Engineer, Databricks

Job not on LinkedIn

🔥 6 minutes ago

🇧🇷 Brazil – Remote

⏰ Full Time

🟠 Senior

🚰 Data Engineer

👻 Ghost score 10%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Object Edge

WebsiteLinkedInAll Job Openings

51 - 200 employees

Founded 1994

💼 Consulting

📦 Logistics

🏭 Manufacturing

Consulting • Logistics • Manufacturing

Object Edge is a technology consultancy that specializes in optimizing and building revenue systems for enterprises, particularly in the manufacturing and distribution sectors. The company provides a range of services including digital transformation, generative AI consulting, data management and analytics, experience design, and eCommerce implementation. Object Edge is known for its B2B technology consulting, offering expertise in CPQ (Configure, Price, Quote) solutions and subscription management. They emphasize an agile, consultative approach to understand and address the unique needs of their clients. Object Edge partners with leading technology platforms like Salesforce, commercetools, Oracle, and others to deliver tailored solutions.

📋 Description

• Provide technical leadership with minimal oversight to deliver innovative solutions on the Databricks Platform • Use cloud data lakehouse methodologies, distributed processing engines, event streaming platforms, and modern data technologies • Participate in the Databricks Center of Excellence • Build next-generation data platforms for organizations in data and analytics • Work under the direction of a Solution Architect to design and implement components of client data platform solutions • Participate in design sessions, break down complex development tasks, and complete development items on time • Contribute to Center of Excellence initiatives by developing Databricks solution accelerators • Develop and implement data solutions using Databricks and its platform features • Collaborate with cross-functional teams to design and optimize batch and streaming data pipelines • Ensure data quality and pipeline efficiency • Stay current with emerging technologies and Databricks platform features and continuously improve relevant skills

🎯 Requirements

• At least 2 years of hands-on data pipeline design and development experience with Databricks • Experience with Delta Lake, Uniform (Iceberg), Delta Live Tables (Lakeflow Declarative Pipelines), and Unity Catalog • Proficiency designing and building robust, scalable, YAML configuration-driven data pipelines • Experience with batch, micro-batch, and streaming data ingestion and processing patterns using tools such as Auto Loader • Experience building complex job/workflow orchestration patterns using Databricks Jobs/Workflows or tools such as Airflow and dbt • Exposure to data quality, pipeline audit, and observability solutions using Databricks-native features or tools/frameworks such as Great Expectations, Collibra, and dbt • Proficiency with Apache Spark, Presto, and Amazon EMR • Experience with Amazon Redshift, Snowflake, and Google BigQuery • Strong programming skills using SQL, stored procedures, and object-oriented programming languages such as Java, Python, and PySpark • Familiarity with DevOps and CI/CD pipelines using Databricks Asset Bundles, automated validation, and testing • Exposure to Infrastructure as Code tools such as Terraform is a plus • Familiarity with NoSQL databases and container management systems • Exposure to AI/ML tools such as MLflow, prompt engineering, and modern data and AI agentic workflows • Databricks Data Engineering Associate and/or Professional certification and multiple Databricks project delivery experience are ideal

🏖️ Benefits

• Equal employment opportunity and nondiscrimination protections • Work environment free of unlawful discrimination and harassment

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume