Senior Data Engineer – Capacity Planning & Forecasting

Job not on LinkedIn

🔥 2 hours ago

⏰ Full Time

🔴 Lead

🚰 Data Engineer

Where this job comes from

Posted on Virtasant's careers page ↗Virtasant's careers page, not through a job board

First seen by Remote Rocketship 2 hours ago

Still open on Virtasant's site. Checked 1 hour ago.

Apply Now
Logo of Virtasant

Virtasant

51 - 200 employees

💼 Consulting

🏢 Enterprise

🤝 B2B

Consulting • Enterprise • B2B

Virtasant is a cloud services and optimization company that helps businesses migrate to, manage, and build on public cloud platforms. They combine a proprietary automation platform with managed services and FinOps expertise to reduce cloud costs (claiming average savings of over 50%), support Cloud FinOps programs, and deliver outcome-based engagements rather than hourly or seat-based billing. Virtasant also provides enterprise AI guidance and partners with major cloud providers (AWS, Google Cloud, Azure) to deliver migration, optimization, and 24/7 managed operations.

📋 Description

• Design, develop, and maintain scalable ETL/ELT data pipelines for infrastructure and cloud consumption data • Integrate cloud billing, infrastructure telemetry, workload management, and financial system data • Develop optimized data models and analytical datasets for infrastructure utilization, capacity tracking, and cost reporting • Implement data validation, reconciliation, monitoring, and quality checks • Optimize data pipelines for performance, scalability, and operational efficiency • Monitor and forecast infrastructure capacity requirements across GPU, TPU, CPU, memory, and storage resources • Build forecasting models based on workload growth and business requirements • Identify capacity constraints, resource bottlenecks, underutilization, and infrastructure risks • Support demand forecasting, scenario analysis, and capacity optimization • Develop dashboards and reporting solutions for capacity, utilization, and projected demand • Analyze cloud infrastructure consumption and billing data across cloud platforms • Develop cost attribution models across workloads, teams, and business units • Calculate infrastructure cost metrics including cost per GPU hour, CPU hour, workload/job, inference request, and million tokens • Identify cloud cost optimization opportunities • Partner with Finance and Procurement on infrastructure cost reconciliation and financial planning • Design and maintain dimensional and analytical data models for infrastructure capacity and financial reporting • Perform root-cause analysis of utilization anomalies, cost fluctuations, and capacity deviations • Build automated reports and dashboards for stakeholders • Ensure consistency between operational telemetry, consumption records, and financial reporting • Collaborate with Infrastructure Engineering, Finance, Procurement, Data Science, Machine Learning, and Business Operations teams • Translate complex technical and financial data into insights and recommendations for leadership

🎯 Requirements

• 10+ years of experience • Strong proficiency in SQL, including complex queries, joins, window functions, and query optimization • Proficiency in Python for data processing, automation, and analytical workflows • Experience with Pandas, PySpark, or similar data processing frameworks • Hands-on experience building scalable ETL/ELT pipelines • Strong understanding of data warehousing, data modeling, and distributed data processing • Experience with Apache Spark, Airflow, Kafka, Trino, or similar technologies • Knowledge of data quality frameworks, pipeline monitoring, and data governance • Experience working with AWS, Google Cloud Platform, or Microsoft Azure • Understanding of cloud billing, resource utilization, and consumption datasets • Knowledge of compute, storage, networking, and infrastructure resource metrics • Understanding of capacity management, resource utilization, and demand forecasting • Experience analyzing historical trends and predicting future resource requirements • Knowledge of time-series forecasting, statistical modeling, and scenario analysis • Ability to identify infrastructure bottlenecks and resource optimization opportunities • Experience with Tableau, Power BI, Looker, or similar visualization tools • Ability to develop operational dashboards and executive-level reporting • Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, Statistics, Mathematics, or a related quantitative discipline; equivalent practical experience in Data Engineering, Infrastructure Analytics, or Capacity Planning will also be considered • Familiarity with GPU/TPU infrastructure and AI/ML workload consumption is desirable • Experience in cloud infrastructure analytics or FinOps is preferred • Exposure to GPU/TPU capacity planning and AI/ML infrastructure is preferred • Understanding of machine learning inference workloads and compute economics is preferred • Experience with large-scale infrastructure telemetry datasets is preferred • Knowledge of infrastructure cost allocation and unit economics is preferred • Experience supporting financial forecasting, budgeting, or procurement decisions is preferred

🏖️ Benefits

• Fully remote work arrangement • Coverage during Pacific Hours (8:00 AM – 5:00 PM PST)

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 Yesterday

Neon

1001 - 5000

💼 Consulting

🛡️ Insurance

💳 Fintech

Staff Data Engineer construindo arquitetura de features, pipelines e deploy de modelos de crédito. Atuando na Neon, fintech brasileira que simplifica serviços bancários.

🗣️🇧🇷🇵🇹 Portuguese Required

🕒 Yesterday

Vivo (Telefônica Brasil)

10,000+ employees

💼 Consulting

📦 Logistics

📣 Marketing

Arquiteto de Dados na Vivo, líder brasileira de telecomunicações. Projetando arquiteturas multicloud, pipelines escaláveis e soluções de Dados e IA.

🗣️🇧🇷🇵🇹 Portuguese Required

🕒 2 days ago

GFT Technologies

10,000+ employees

💼 Consulting

🛡️ Insurance

🔒 Cybersecurity

Arquiteto de dados AWS na GFT, empresa global de tecnologia e serviços digitais. Projetando plataformas data mesh multi-account com Lake Formation, Iceberg e SageMaker.

🗣️🇧🇷🇵🇹 Portuguese Required

🕒 November 10

opinov8

201 - 500

💼 Consulting

🏥 Healthcare

📦 Logistics

Staff Data Engineer architecting Databricks-focused data platforms, MDM, and agentic AI workflows. Supporting a commercial real estate advisory and services provider.

🕒 November 7

Grupo OLX

1001 - 5000

🛍️ eCommerce

🏠 Real Estate

🏪 Marketplace

Staff Data Engineer building reliable, scalable data platforms for OLX, a Brazilian online marketplace. Enabling governed data ingestion, transformation, exploration, and consumption.

🗣️🇧🇷🇵🇹 Portuguese Required

Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok