Senior Data Engineer

Job not on LinkedIn

🔥 1 hour ago

🇺🇸 United States – Remote

⏰ Full Time

🟠 Senior

🚰 Data Engineer

👻 Ghost score 25%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Rackner

WebsiteLinkedInAll Job Openings

11 - 50 employees

💼 Consulting

🎖️ Defense

🤖 Artificial Intelligence

Consulting • Defense • Artificial Intelligence

Rackner is a technology company specializing in applying emerging technologies to mission-critical problems in both the public and private sectors. As a Kubernetes Certified Service Provider, Rackner's experienced engineers manage large clusters in production environments for major organizations. The company focuses on cloud-native solutions, DevSecOps, AI, and platform development to modernize business-critical applications. Rackner is also involved in developing innovative systems using Edge, IoT/Mobile, and VR technologies. The company has been recognized on the Inc 5000 List of Fastest Growing Companies and has secured significant contracts with the Department of Defense and the Department of Homeland Security.

📋 Description

• Lead the design, development, and optimization of enterprise data ingestion pipelines, transformation logic, and data platform components within Microsoft Fabric • Design and implement scalable ETL and ELT architectures for structured and semi-structured enterprise data • Configure, administer, and maintain Microsoft Fabric tenants, workspaces, capacities, security, and governance • Implement Bronze, Silver, and Gold medallion architecture layers • Develop transformation processes with schema validation, cleansing, normalization, enrichment, and reconciliation • Establish data quality monitoring, validation controls, automated testing, and alerting • Design environment separation across development, test, staging, and production • Build and maintain CI/CD deployment pipelines for data platform artifacts • Implement infrastructure-as-code for repeatable, version-controlled deployments • Develop and optimize Spark, PySpark, SQL, and related data-processing workloads • Configure and maintain encryption, RBAC, Microsoft Entra ID integration, Privileged Identity Management, and least-privilege controls • Support secure integration with enterprise source systems and hybrid on-premises/cloud connectivity • Troubleshoot and optimize pipeline, platform, performance, connectivity, and data-quality issues • Support disaster recovery and business continuity planning; develop and test rollback, recovery, and restoration procedures • Establish reusable engineering patterns, standards, and technical documentation • Collaborate with architects, governance specialists, cybersecurity teams, application teams, and source-system owners • Participate in architecture reviews and recommend modernization and integration solutions • Mentor Data Engineers and Associate Data Engineers; review implementations and provide technical guidance • Provide senior-level problem-solving support and support knowledge transfer and operational transition

🎯 Requirements

• Significant experience designing and implementing enterprise data pipelines, ETL/ELT processes, and cloud-based data platforms • Hands-on experience with Microsoft Fabric • Experience administering or configuring enterprise cloud data environments • Strong experience with Azure Data Factory or comparable data integration technologies • Strong SQL proficiency • Experience with Spark and PySpark for large-scale data processing and transformation • Experience implementing enterprise ETL/ELT frameworks • Experience designing and implementing medallion architectures using Bronze, Silver, and Gold data layers • Experience with schema validation, data cleansing, normalization, reconciliation, and data quality controls • Experience developing CI/CD pipelines for data platform deployments • Experience implementing infrastructure-as-code • Experience with source control, automated deployment, and environment promotion processes • Understanding of cloud security principles, including RBAC, identity integration, encryption, and least-privilege access • Experience troubleshooting complex data pipeline, platform, and integration issues • Experience supporting production data environments with availability, reliability, and performance requirements • Strong technical documentation and communication skills • Experience mentoring or providing technical leadership to other engineers • Active Secret clearance

🏖️ Benefits

• Company-supported certifications aligned to current and future program work, including cloud, Kubernetes, DevSecOps, security, AI/ML, project management, and related technical areas • Clear advancement tracks and future leadership opportunities • 401(k) with 100% match up to 6% • Comprehensive medical, dental, vision, life, and disability coverage • Generous PTO and paid holidays • Home-office equipment plan and remote work support • Fitness and wellness reimbursement • Weekly pay schedule • Modern perks, including team events