Senior Data Engineer – Databricks

🔥 7 minutes ago

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Extractta

WebsiteLinkedInAll Job Openings

201 - 500 employees

Founded 2005

💼 Consulting

📣 Marketing

☁️ SaaS

Consulting • Marketing • SaaS

Extractta is a company proficient in information technology, dedicated to continually reinventing itself to support the transformation processes of its clients. It emphasizes a deep understanding of client needs and provides ongoing guidance in employing the best products and solutions, showcasing its expertise in technologies such as MongoDB, AWS, Salesforce, and data integration.

📋 Description

• Develop, maintain and optimize data pipelines (ETL/ELT) using Databricks • Build data processing solutions using Apache Spark and PySpark • Work with large volumes of data, ensuring performance, scalability and reliability • Develop and maintain data ingestion, transformation and data availability processes • Contribute to the design and evolution of Data Lake and Lakehouse architectures • Develop and optimize queries using SQL • Implement best practices for data quality, governance and security • Perform performance analysis and optimization of jobs, pipelines and queries • Support technical and architectural decisions related to the data platform • Implement monitoring and failure-handling processes for pipelines • Work with code versioning and CI/CD processes • Participate in agile ceremonies and collaborate with Data Engineering, Analytics, Architecture and business teams • Provide technical support and mentorship to team members, contributing best practices and solution improvements

🎯 Requirements

• Strong experience as a Data Engineer, preferably at a Senior level • Proven experience with Databricks • Strong expertise in Apache Spark and PySpark • Advanced SQL skills • Knowledge of Delta Lake • Experience building and maintaining ETL/ELT pipelines • Familiarity with Data Lake, Lakehouse and/or Data Warehouse architectures • Experience processing large volumes of data • Knowledge of data modeling and transformation • Experience with Git and CI/CD practices • Knowledge of data security, governance and quality best practices • Ability to analyze performance and troubleshoot pipelines • Analytical, collaborative profile with autonomy to lead technical tasks • Preferred: experience with Databricks Unity Catalog • Preferred: knowledge of Databricks Workflows/Jobs • Preferred: experience with Medallion Architecture (Bronze, Silver, Gold) • Preferred: knowledge of Python for Data Engineering • Preferred: experience with data services on AWS, Azure or GCP • Preferred: knowledge of Apache Airflow or Azure Data Factory • Preferred: experience with Terraform • Preferred: certifications related to Databricks or cloud platforms • Preferred: experience in high-volume environments and mission-critical data solutions

🏖️ Benefits

• Meal and/or food allowance • Partnership with Sesi and Sesc, providing access to health, wellness and leisure services • Partnerships with educational institutions offering exclusive discounts on courses and programs • Opportunity for career growth and participation in strategic projects • Opportunity to work at a fast-growing company in the market