Senior Data Engineer

Job not on LinkedIn

🕒 October 29

🇺🇸 United States – Remote

💵 $160k - $180k / year

⏰ Full Time

🟠 Senior

🚰 Data Engineer

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

👻 Ghost score 6%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.Why this score:

• Open for 17 days.
• Jobs at this company usually fill in 34 days.

Apply Now

Check your resume score

Customize resume + cover letter

Find Similar Remote Jobs

☆ Save☑️ Mark as applied❌ Hide

Report problem

VivSoft

WebsiteLinkedInAll Job Openings

51 - 200 employees

Founded 2011

💼 Consulting

🏥 Healthcare

📦 Logistics

Consulting • Healthcare • Logistics

VivSoft is a federal-focused technology company that builds productized, mission-focused software and services to accelerate government efficiency. The firm combines Data/AI and human-machine teaming, cloud/DevSecOps and software factories, and digital experience (UI/UX) to deliver scalable, templated solutions for government customers. VivSoft supports government contracting vehicles (OTAs, CSOs, SBIR), partners with prime contractors, and moves prototypes into production to solve complex, repeating mission problems.

📋 Description

• Architect, build, and manage a cloud-based lakehouse environment using Apache Iceberg, AWS S3, and AWS Glue Catalog • Develop and optimize Apache Spark data pipelines on EMR and Kubernetes environments • Design and implement event-driven data ingestion solutions using S3 events and Amazon SQS • Optimize query performance across Athena, Trino, and Spark SQL environments • Orchestrate data workflows and ETL pipelines using Apache Airflow • Manage infrastructure deployment and automation using Terraform • Develop, publish, monitor, and maintain data products and analytical dashboards • Implement data quality, governance, lineage, access controls, and cost management best practices • Create technical documentation, architectural designs, and operational runbooks • Provide technical leadership and mentorship to junior engineering team members

🎯 Requirements

• Must possess an active Secret Clearance • 8+ years of professional experience in Data Engineering or large-scale data platform development • Expertise in Apache Spark, including performance tuning, partitioning, memory optimization, and handling data skew • Strong proficiency in Python or Scala and advanced SQL development • Experience with open table formats such as Apache Iceberg or Delta Lake • Strong understanding of distributed query engines, including Athena, Trino, and Spark SQL • Hands-on experience with AWS services, including S3, Glue, EMR, Athena, EC2, SQS, and event-driven architectures • Experience with Apache Airflow for workflow orchestration • Proficiency with Terraform and Infrastructure as Code (IaC) • Experience working with Kubernetes environments • Experience developing dashboards and data products using Grafana or similar visualization platforms • Strong understanding of data quality, data governance, lineage, and access control frameworks • Excellent technical leadership, mentoring, and stakeholder communication skills • Ability to translate business, operational, and analytics requirements into scalable data platform solutions • Strong collaboration skills with Data Scientists, AI Engineers, Cloud Engineers, and business stakeholders • Proven ability to lead technical discussions and mentor junior engineers • Excellent written and verbal communication skills • Strong attention to detail regarding data quality, governance, lineage, security, and operational reliability • Preferred: Experience operating and maintaining Apache Iceberg tables at enterprise scale • Preferred: Experience with Trino administration and performance optimization • Preferred: Knowledge of dbt or similar data transformation frameworks • Preferred: Experience with Helm and GitOps deployment methodologies • Preferred: Experience evaluating and implementing modern data visualization platforms beyond Grafana • Preferred: Familiarity with data catalog, metadata management, lineage, and governance tools • Preferred: AWS Data Analytics Certification and/or Certified Kubernetes Administrator (CKA) • Preferred: Prior DoD, USAF, or Federal Government data platform experience • Preferred: Experience supporting AI/ML, data science, or advanced analytics workloads in cloud environments

🏖️ Benefits

• Comprehensive Medical, Dental, and Vision Plans (Healthcare benefits are 100% employer-paid for employees only) • Life Insurance • Paid Time Off (Flexible/Combined PTO, Bereavement Leave, 11 Company Paid Holidays) • 401K Retirement Plan with employer match • Professional Development Training Reimbursement

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume