Senior Data Pipeline Engineer – Elastic

Job not on LinkedIn

🔥 9 minutes ago

Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of SERVISS - HUBZone Certified

SERVISS - HUBZone Certified

2 - 10 employees

Founded 2025

🔒 Cybersecurity

🤖 Artificial Intelligence

🏛️ Government

Cybersecurity • Artificial Intelligence • Government

SERVISS - HUBZone Certified is a HUBZone-certified federal contractor that describes itself as focused on innovating the future of information, systems, and security. The company presents itself as dedicated to data science, agile systems development, and cybersecurity and appears to provide technology and engineering services to federal clients. The site emphasizes mission and values, federal HUBZone status, careers, and contact information—consistent with a government-focused tech services firm offering consulting, systems development, and security/data science capabilities.

📋 Description

• Architect, automate, and maintain scalable, fault-tolerant data processing pipelines that ingest asset, vulnerability, and configuration data from Armis, Axonius, and other SaaS/API sources into Elasticsearch • Handle high-volume, high-velocity data collection, processing, and indexing to support near-real-time visibility • Design Elasticsearch index strategies, mappings, ingest pipelines, and transforms; normalize disparate source data to a common schema (e.g., Elastic Common Schema) for consistent search, correlation, and reporting • Build and maintain Kibana dashboards and visualizations that deliver a true single-pane-of-glass view of the agency's technical posture • Own API integration patterns against evolving vendor APIs, including authentication and token management, pagination, rate limiting, incremental/delta ingestion, and resilient error handling and retry logic • Implement automated reconciliation and data-quality checks to ensure ingested data is complete, consistent, and accurate against source systems; document and maintain data lineage and traceability of transformed data back to source • Manage index lifecycle (ILM), retention, sharding, and cluster performance tuning for high-volume, low-latency operations • Instrument pipelines with monitoring, alerting, and logging so data-flow issues are detected and resolved before they reach stakeholders • Follow programming best practices, emphasizing code reusability and highly automated CI/CD pipelines for scalability

🎯 Requirements

• US citizenship with the ability to obtain Public Trust Suitability • Bachelor's degree in Computer Science, Information Systems, Data Engineering, or a related field (master's degree preferred) • A minimum of six years of experience designing, implementing, and managing the technical delivery of large-scale data engineering or data pipeline services to diverse organizations • 4+ years hands-on with Elasticsearch or OpenSearch: index design, mappings, ingest pipelines, query/aggregation, and cluster performance tuning • Strong experience integrating REST APIs from SaaS platforms, including authentication, pagination, rate limiting, incremental ingestion, and resilient error handling • Proficiency with a scripting/pipeline language (Python strongly preferred) and with ETL/ELT tooling such as Logstash, Elastic Agent/Beats, or equivalent • Experience designing, implementing, and managing data schemas that comply with cyber-relevant data standards and frameworks, e.g., SCAP, STIX, OTEL, Elastic Common Schema, and Splunk Common Information Model • Knowledge of data transformation processes and experience documenting and maintaining data lineage, especially traceability of transformed data to source data • Solid data modeling and normalization skills for heterogeneous sources, including mapping to a common schema • Knowledge of Federal Cybersecurity and Risk Management policies and practices, including FISMA; NIST SP 800-37, 800-53, 800-30, and 800-39; and FedRAMP • Solid understanding of Git, version control workflows, and CI/CD

🏖️ Benefits

• 100% of medical, vision, dental, and life insurance premiums paid for by SERVISS • 401(k) retirement plan with 6% dollar for dollar match • Opportunities for annual performance bonuses and growth incentives • Be part of an exciting company with ground floor opportunities in the Equity Participation Program • Highly competitive compensation and best in class benefits

Apply Now

Similar Jobs

🔥 10 minutes ago

Carrier

10,000+ employees

🏗️ Construction

🏥 Healthcare

📦 Logistics

Data Engineer supporting the delivery of modern data solutions for Carrier's climate and energy innovations. Building data pipelines and integrating diverse data sources.

ERP

ETL

Python

SQL

🔥 1 hour ago

AdvanSix

1001 - 5000

🏭 Manufacturing

🤝 B2B

Big Data Engineer tasked with building and operating the Unified Data Layer at AdvanSix. Responsible for developing data pipelines and ensuring data quality for various analytics applications.

🇺🇸 United States – Remote

💵 $104.6k - $156.8k / year

💰 $12M Grant - AdvanSix on 2024-09

⏰ Full Time

🟡 Mid-level

🟠 Senior

🚰 Data Engineer

Azure

PySpark

Python

Spark

SQL

Vault

🔥 1 hour ago

AdvanSix

1001 - 5000

🏭 Manufacturing

🤝 B2B

Data Architect at AdvanSix defining and governing architecture for Unified Data Layer. Ensuring structured and integrated data across various domains for engineering delivery.

🇺🇸 United States – Remote

💵 $118.8k - $178.2k / year

💰 $12M Grant - AdvanSix on 2024-09

⏰ Full Time

🟠 Senior

🔴 Lead

🚰 Data Engineer

Azure

🔥 2 hours ago

Standvast Fulfillment

51 - 200

📦 Logistics

🛍️ eCommerce

Senior Data Engineer in a fully remote-first organization focusing on engineering best practices with cloud infrastructure. Collaborate with cross-functional teams to deliver innovative solutions and mentor junior developers.

BigQuery

Python

Spark

SQL

🔥 2 hours ago

Instacart

1001 - 5000

🍽️ Food & Beverage

📦 Logistics

🛍️ eCommerce

Senior Risk & Compliance Engineer developing automated risk programs for Instacart's governance, risk, and compliance team. Writing production-level code, building data pipelines, and developing risk models at scale.

Postgres

Python

SQL