Senior Data Engineer

🔥 0 minutes ago

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

540

WebsiteLinkedInAll Job Openings

51 - 200 employees

💼 Consulting

📦 Logistics

🏛️ Government

Consulting • Logistics • Government

540 is a technology consulting company that partners with the Federal Government and business clients to drive innovation and break barriers. The company specializes in tech strategy, agile delivery, API design and development, data analytics, and cloud services. 540 helps its clients by leveraging cutting-edge technology and design, creating impactful user experiences, and shipping high-quality code. With a focus on DevSecOps, they securely manage and scale infrastructure as organizations grow. 540's services empower developers, integrators, and data consumers through best practices in APIs and cloud solutions. Their commitment extends to aiding government in implementing advanced technology solutions, particularly in API strategy and data-driven applications.

📋 Description

• Design, develop, and maintain scalable, production-ready data pipelines and data products using Spark (Python/SQL) in a Databricks environment • Lead integration and transformation of complex data from diverse DoW and federal health systems into reliable, reusable data products • Design scalable data ingestion, integration, and exchange approaches, including API-based integrations and services • Establish reusable data engineering patterns, standards, and best practices • Provide technical guidance on data architecture, pipeline design, data modeling, integration approaches, and engineering practices • Monitor, troubleshoot, and optimize production workflows and data pipelines • Define and implement data validation, quality, and governance practices • Troubleshoot complex technical and data integration challenges and drive sustainable solutions • Collaborate with engineers, architects, analysts, and customer stakeholders on scalable technical solutions • Mentor engineers and guide teams through complex technical challenges • Improve engineering tools, processes, and patterns and drive their adoption • Own complex technical areas and maintain engineering quality as the platform grows

🎯 Requirements

• 10+ years of data engineering, software engineering, or related technical experience • Extensive hands-on experience designing, building, and operating production data pipelines and data products • Advanced proficiency with Python and SQL • Strong experience with Apache Spark and distributed data processing • Experience with Databricks or similar modern data platforms • Experience designing and maintaining ETL/ELT processes for complex, large-scale datasets • Experience integrating data across disparate systems and consuming or developing API-based data integrations • Strong understanding of data modeling, data architecture, data quality, and data governance principles • Experience troubleshooting and optimizing complex production data pipelines • Experience with Git-based development workflows and modern software engineering practices • Experience working in terminal / command-line environments • Demonstrated experience providing technical guidance, mentoring engineers, and influencing engineering practices • Strong client and stakeholder communication skills • Ability to independently navigate ambiguity, identify technical risks, and resolve complex engineering challenges • Experience identifying security, privacy, and compliance issues and working with security/compliance/legal stakeholders • Candidates must be U.S. Citizens with an active DoW Secret (or higher) clearance • Bachelor’s Degree in Computer Science, Engineering, Data Science, or a related technical field (preferred) • Nice-to-have: AWS cloud experience; very large datasets; Palantir Foundry; GitLab; Advana or similar DoW data environments; federal health, financial, or other regulated data; AI/ML tools

🏖️ Benefits

• Flexible PTO + all Federal holidays off • Health, dental and vision insurance plans • Flexible Spending Account (FSA) • 401k with employer match • Company-sponsored life insurance, short- and long-term disability • Professional development (training, certifications, conferences) • Paid cloud developer accounts • Referral bonuses • HQ office perks (parking / metro reimbursement, nitro coffee & lunches) • Annual social events (540 Week, hackathon, charity golf tournament, etc.) • Access to 540’s Washington Capitals & Nationals tickets