Senior Data Engineer – Data & Analytics

Job not on LinkedIn

🔥 0 minutes ago

Apply Now

Find Similar Remote Jobs

Receive Emails For Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Compass

WebsiteLinkedInAll Job Openings

10,000+ employees

🏠 Real Estate

📱 Media

Real Estate • Media

Compass is a real-estate-focused content and services site that provides detailed market analysis, buying/selling/renting guides, mortgage and financing information, and home improvement and renovation advice. The site offers resources for homebuyers, sellers, renters, agents, and real estate investors — including articles on appraisals, affordable housing, investment strategies, staging and property maintenance. Compass aims to help users make informed decisions across the housing lifecycle through timely market updates and practical how-to content.

📋 Description

• Develop and maintain data pipelines (ETL/ELT) using Databricks, Azure Data Factory and other components of the Azure ecosystem • Model and structure data in Data Lakes (ADLS), ensuring data quality, traceability and governance • Ingest and process data from multiple sources (APIs, monthly files, corporate systems) • Implement data solutions for: • PETROS Database (extraction and organization of pension data) • Structuring RAG for analysis of debt contracts • Processing quotation/price data (integration with external APIs such as CXL) • Collateral projects (judicial deposits, financial and real guarantees) • Reconcile purchases and sales with analysis of structured and unstructured data • Support architects in defining solutions and designing data architecture • Participate in gathering and detailing technical and functional requirements • Develop and publish APIs to expose data • Ensure best practices for versioning, CI/CD and DevOps • Work with relational databases (SQL Server, Oracle, among others)

🎯 Requirements

• Bachelor's degree in IT or a postgraduate qualification in the area (minimum 360 hours) • Strong experience with: • Python • SQL • Data Engineering (ETL/ELT) • Databricks • Azure Data Factory • Azure Data Lake Storage (ADLS) • Experience with data modeling • Knowledge of DevOps and best practices for version control • Experience creating and publishing APIs • Experience working in cloud environments (preferably Azure) • Differentials: • Experience with SAP Datasphere or TIBCO Datasphere • Knowledge of ETL tools such as Knime, Informatica PowerCenter • Experience with SAP PowerDesigner • Knowledge of AI solutions applied to data (e.g., RAG, analysis with LLMs) • Experience with financial data or contracts (experience in a Petrobras context is a plus)

🏖️ Benefits

• Bachelor's degree in IT or a postgraduate qualification in the area (minimum 360 hours) • Strong experience with: • Python • SQL • Data Engineering (ETL/ELT) • Databricks • Azure Data Factory • Azure Data Lake Storage (ADLS) • Experience with data modeling • Knowledge of DevOps and best practices for version control • Experience creating and publishing APIs • Experience working in cloud environments (preferably Azure) • Differentials: • Experience with SAP Datasphere or TIBCO Datasphere • Knowledge of ETL tools such as Knime, Informatica PowerCenter • Experience with SAP PowerDesigner • Knowledge of AI solutions applied to data (e.g., RAG, analysis with LLMs) • Experience with financial data or contracts (experience in a Petrobras context is a plus)