Senior Data Engineer, FinOps, Databricks, Cloud Cost

Job not on LinkedIn

🔥 1 hour ago

🇧🇷 Brazil – Remote

⏳ Contract/Temporary

🟠 Senior

🚰 Data Engineer

👻 Ghost score 10%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Rox Partner

WebsiteLinkedInAll Job Openings

51 - 200 employees

Founded 2019

💼 Consulting

🏥 Healthcare

📦 Logistics

Consulting • Healthcare • Logistics

Rox Partner is a Brazilian technology consultancy focused on transforming data into strategic assets and protecting organizations from cyber threats. The company offers data engineering, data management, analytics, machine learning/AI, data platform modernization, DataOps/MLOps and data literacy services alongside managed IT, SOC/managed security, pentesting and security consulting. Rox Partner serves enterprise clients across health, finance, retail, telecom, industry and other sectors, and holds certifications like ISO 27001 and partnerships with Google Cloud, AWS and Microsoft.

📋 Description

• Develop and maintain scalable data pipelines for ingesting, transforming, consolidating, and delivering billing and telemetry data • Build and evolve Lakehouse architectures using the Bronze, Silver, and Gold layers • Model dimensional data for analyzing cloud costs, consumption, budgets, trends, and resource optimization • Integrate and process data from billing services such as AWS Cost and Usage Report (CUR), Azure Cost Management, and Google Cloud Billing • Develop rules for tag normalization, account and project hierarchies, shared cost allocation, and cost apportionment • Implement amortization and cost-distribution logic related to Reserved Instances and Savings Plans • Build and optimize transformations using Python, PySpark, Spark SQL, and Delta Lake • Develop queries, tables, and analytical structures for consumption through Databricks SQL and Lakeview dashboards • Implement data quality, reconciliation, testing, and validation mechanisms • Ensure data governance, traceability, and lineage, leveraging capabilities such as Unity Catalog • Contribute to the evolution of pipeline orchestration, versioning, testing, and CI/CD processes • Identify processing bottlenecks and implement performance and cost improvements in high-volume environments • Collaborate with technical, finance, and FinOps teams to transform business needs into reliable data solutions

🎯 Requirements

• Solid senior-level experience in Data Engineering • Advanced proficiency in Python, PySpark, Apache Spark, and SQL • Experience with Databricks and Lakehouse architecture • Practical knowledge of the Medallion architecture: Bronze, Silver, and Gold • Experience with Delta Lake and table and query optimization, including partitioning, Z-Order, and/or Liquid Clustering • Experience building and maintaining high-volume data pipelines • Experience with dimensional modeling, particularly Kimball concepts • Ability to structure consistent analytical models for reporting and decision-making • Knowledge of data transformation, consolidation, and delivery strategies • Experience with billing data from at least one of the following providers: AWS, Azure, or GCP • Knowledge of cloud service cost and consumption structures • Familiarity with pricing concepts, including On-Demand, Reserved Instances, Savings Plans, Spot, data transfer (egress), and storage tiers • Ability to implement cost processing, reconciliation, classification, and allocation rules • Experience with pipeline orchestration tools such as Databricks Workflows, Lakeflow Pipelines (formerly Delta Live Tables/DLT), Airflow, or dbt, or equivalent technologies • Experience with Git, version control, and CI/CD practices applied to Data Engineering • Knowledge of automated testing, data validation, and pipeline monitoring • Familiarity with Databricks artifact deployment and management practices, such as Databricks Asset Bundles, or equivalent solutions • Preferred: knowledge of or experience with the FOCUS (FinOps Open Cost and Usage Specification) specification • Preferred: experience with Unity Catalog, governance, access control, and data lineage • Preferred: experience with billing data from multiple cloud providers • Preferred: experience in banking, financial, or operationally critical environments • Preferred: experience handling large data volumes with stringent quality and traceability requirements

🏖️ Benefits

• Remote work Monday through Friday, from 9:00 a.m. to 6:00 p.m. • Work equipment provided

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume