Senior Data Engineer

Job not on LinkedIn

🔥 0 minutes ago

🇺🇸 United States – Remote

💵 $115k - $165k / year

⏰ Full Time

🟠 Senior

🚰 Data Engineer

👻 Ghost score 0%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Imagine Believe Realize, LLC.

WebsiteLinkedInAll Job Openings

201 - 500 employees

Founded 2007

🏛️ Government

🔒 Cybersecurity

Government • Cybersecurity

Imagine Believe Realize, LLC is a software and systems engineering services company founded in 2007 that provides technical solutions to public and private sector clients. IBR specializes in software engineering (Agile/Scrum, N-tier designs, enterprise SDLC leadership), systems engineering (TOGAF, DoDAF, enterprise architecture), cloud computing, cybersecurity (assessments, DevSecOps, vCISO, incident response, CMMC certified), identity, credential and access management (ICAM) for DoD and federal customers, mobility solutions (BYOD, mobile development), Salesforce customization, Geographic Information Systems (GIS) software for the U. S. Census Bureau, and performance/scaling for high-performance computing environments. It holds government contract vehicles and certifications and positions itself as a mission-focused contractor serving federal clients including DoD, Navy, and the U. S. Census Bureau.

📋 Description

• Design and implement secure, next-generation data engineering solutions supporting critical missions • Collaborate with technical leaders, business stakeholders, and multidisciplinary teams • Support implementation of the DON MAHRS program Data Strategy and High-Level Total Force Data Hub implementation plan • Develop, implement, integrate, and sustain data architectures, data hubs, data lakes, and data warehouses • Design and develop data models, data structures, and data acquisition processes • Develop engineering and implementation plans for data hubs, acquisition, modeling, integration, and related activities • Research and evaluate data sources to identify authoritative and reliable sources for data hub development • Plan, create, and maintain data architectures aligned with business requirements • Design, develop, maintain, and optimize ETL/ELT pipelines and transformation processes • Develop and maintain batch and streaming pipelines using Spark, Python, Databricks, Palantir Foundry, Kafka, and related tools • Develop data acquisition processes to ingest, transform, validate, and integrate enterprise data • Implement incremental loading, late-arriving data, processing-window, data-freshness, and lifecycle approaches • Automate manual data processes and improve workflow efficiency, reliability, and scalability • Develop, maintain, and optimize solutions within Databricks and enterprise data lakes • Configure, monitor, manage, and document Databricks clusters according to DON policies and security requirements • Develop and maintain Spark solutions using PySpark, Spark SQL, DataFrames, and Data Sets • Implement and maintain Delta Lake and Delta Live Tables solutions • Optimize data processing, storage, and query performance • Support Palantir Foundry ontologies, ETL/ELT pipelines, applications, and data-driven user interfaces • Integrate Palantir Foundry with enterprise data engineering and analytics environments • Develop and maintain streaming solutions using Kafka, Kafka Streams, and ksqlDB • Configure and manage Kafka topics and Schema Registry • Develop Python data-processing applications and AWS Lambda functions • Support processing with AWS S3, Kinesis, Lambda, and DynamoDB • Monitor, troubleshoot, and optimize cloud-based processing solutions • Develop data quality controls, validation processes, and data quality gates • Develop and execute data-driven and unit testing for Spark, Python, and other processing solutions • Establish data lifecycle policies covering retention, backup, recovery, and data management • Monitor and troubleshoot pipelines and processing jobs • Improve performance, reliability, scalability, and maintainability

🎯 Requirements

• 5+ years of professional data engineering related experience • 5+ years of IT experience focusing on enterprise data engineering, including data modeling, data quality, data mapping tools, and technical documentation • Bachelor’s degree in Computer Science, Engineering, Mathematics, Statistics, or an IT-related field • Must be eligible to obtain and maintain a Secret security clearance • United States citizenship required to obtain this type of security clearance • Candidates must reside in the continental United States • Professional experience in data architecture, data engineering, data hub, data lake, and/or data warehouse development • Experience designing, developing, implementing, and supporting enterprise-scale data engineering solutions • Experience with data modeling, data mapping, data quality, data integration, and data management • Experience supporting large-scale, high-performance enterprise data applications • Experience developing and supporting ETL/ELT data pipelines and data transformation processes • Hands-on experience with Databricks required • Experience with Python and SQL for data engineering and data processing • Experience with Apache Spark and/or PySpark, including Spark SQL, DataFrames, and/or Data Sets preferred • Experience supporting data integration, migration, transformation, data warehouse, data hub, and/or data lake/Delta Lake implementations • Experience with batch and streaming data processing architectures • Experience with Kafka and/or other distributed streaming technologies • Experience developing and supporting Kafka Streams • Experience working in an AWS cloud environment, including S3, Lambda, Kinesis, and/or DynamoDB • Experience with Git-based version control, including branching, merging, pull requests, and repository management • Experience supporting CI/CD pipelines and cloud monitoring with Jenkins, Docker, and/or CloudWatch preferred • Experience with Palantir Foundry preferred • Experience with the Jupiter data and analytics environment preferred but not required • Ability to debug, troubleshoot, design, and implement solutions to complex technical issues • Ability to thrive in a team-based environment • Experience briefing technology solutions to technology partners, stakeholders, team members, and senior-level management • Strong written and verbal communication • Active CompTIA Security+ or CompTIA Network+ certification preferred; if selected, must obtain CompTIA Security+ before supporting the program

🏖️ Benefits

• Nationwide medical, dental, and vision insurance • 3 weeks of Paid Time Off • 11 Paid Federal Holidays • 401k matching • Life Insurance • Short-Term Disability at no cost to employees • Long-Term Disability at no cost to employees • Supplemental insurance options • Flexible spending accounts • Dependent Care spending accounts • Wellness incentives • Reimbursement for professional development and certifications • Training assistance opportunities to support career growth and progression • Flexible scheduling options • Hybrid and Remote work opportunities to support work-life balance