Advanced Distributed Data Platform Engineer

November 21

Apply Now

Receive Emails with Similar Jobs

Relativity

WebsiteLinkedInAll Job Openings

Artificial Intelligence • Enterprise • SaaS

Relativity is a technology company that provides cloud-based software solutions for data discovery, e-discovery, data breach response, contract analysis, and privacy management. Their products, powered by artificial intelligence, offer proactive security and legendary support to help organizations manage sensitive data. Relativity is trusted by thousands of organizations, including law firms, corporations, and government agencies, to organize data, discover truth, and act on it effectively and efficiently. Their end-to-end solutions streamline data discovery from collection to review and production, utilizing tools like RelativityOne, Relativity aiR for AI-driven legal challenges, and custom solutions through the Relativity App Hub. Relativity is committed to offering secure, flexible solutions with a strong focus on customer support and strategic partnerships.

1001 - 5000 employees

🤖 Artificial Intelligence

🏢 Enterprise

☁️ SaaS

📋 Description

• Design and implement complex data pipelines and distributed systems using Spark and Python. • Apply software engineering best practices: clean code, modular design, CI/CD, automated testing, and code reviews. • Develop and maintain lakehouse capabilities with Delta Lake and Iceberg, ensuring reliability and performance. • Enable analytics workflows by integrating dbt for SQL transformations running on Spark. • Collaborate with internal teams to deliver curated datasets and self-service analytics capabilities. • Optimize data warehousing solutions such as Databricks and Snowflake for performance and scalability. • Implement observability and governance frameworks, including data lineage and compliance controls. • Drive performance tuning, scalability strategies, and cost optimization across Spark jobs and cloud-native environments.

🎯 Requirements

• Strong programming skills in Python and SQL; experience with Apache Spark for distributed data processing. • Expertise in Delta Lake and/or Apache Iceberg for lakehouse architecture. • Familiarity with dbt, Databricks, and Snowflake for analytics workflows. • Solid understanding of software engineering principles, CI/CD, and automated testing. • Familiarity with Kubernetes, Docker, and infrastructure-as-code tools. • Understanding of performance tuning, scalability strategies, and cost optimization for large-scale systems. • Nice to Have: Exposure to event-driven architectures and advanced analytics platforms. • Experience enabling self-service analytics for internal stakeholders. • Experience in any of the following languages: Java, Scala, Rust.

🏖️ Benefits

• Comprehensive health, dental, and vision plans • Parental leave for primary and secondary caregivers • Flexible work arrangements • Two, week-long company breaks per year • Unlimited time off • Long-term incentive program • Training investment program