Senior Big Data Engineer

March 16

Relativity

WebsiteLinkedInAll Job Openings

Relativity makes software to help users organize data, discover the truth and act on it$1. .$1

Software Development • Legal Technology • E-Discovery • Litigation Support • Software Engineering

1001 - 5000

Description

• Build our next-generation data platform tooling and servicesto support the ingestion and processing of billions of documents at scale. • Improve and extend our Spark based distributed data processing pipeline. • Improve and extend our Rust based distributed query engine used to request large amounts of document data. • Create tools to automate and optimize processes across disciplines • Actively participate in the on-call schedule to investigate and fix production issues related to our data processing pipeline or query engine. • Participate in code reviews for projects written by your team • Focus on quality through comprehensive unit and integration testing

Requirements

• 4+ years of software development experience in writing performant, commercial-grade systems and applications • Experience with monitoring and troubleshooting production environments • Proficiency in programming languages used in high volume data processing and applications like Java or Scala and Python • Experience building data pipelines with distributed compute frameworks like Hadoop, Spark, or Dask • Knowledge of Linux/Unix systems, Docker/Kubernetes and CI/CD including scripting in Python or other scripting languages to automate build and deployment processes • Knowledge of professional software engineering practices & software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations • Leverages best practices and past experiences to mentor and improve the productivity of the team

Benefits

• Comprehensive health plan • Flexible work arrangements • Two, week-long company breaks per year • Unlimited time off • Long-term incentive program • Training investment program