Senior Scala Engineer – Data Platforms

Job not on LinkedIn

November 21

Apply Now

Receive Emails with Similar Jobs

Beyond

WebsiteLinkedInAll Job Openings

Artificial Intelligence • Cloud • SaaS

Beyond is a company that provides a range of cloud services and solutions focused on enhancing data, artificial intelligence, and cloud initiatives. They are known for their expertise in Generative AI, Machine Learning, and MLOps, working with partners like Google Cloud to deliver high-quality solutions. Beyond offers services such as cloud implementation, operations support, and AI-driven workplace solutions. They also focus on improving customer experiences and creating innovative technology products. Beyond has a global presence, delivering solutions in regions including the US, UK, Ireland, and Europe, and they are a trusted Google Cloud partner.

51 - 200 employees

🤖 Artificial Intelligence

☁️ SaaS

📋 Description

• Implement and enhance sophisticated, high-throughput batch and streaming data pipelines using Scala and GCP Dataflow (Apache Beam). • Contribute to the architectural design and technical roadmap for modernizing our data ingestion and processing pipelines. • Develop and implement performance optimizations, such as migrating services to use Cloud Functions for exporting data from BigQuery to Pub/Sub more efficiently. • Collaborate with Staff Engineers to expand the functionality of our data export systems for external partners. This includes pulling data from BigQuery, creating formatted feed files, and exporting them to various external stores (e.g., FTP, GCS, S3). • Support and contribute to the expansion of existing data integrations, including adding new fields to schemas and ensuring that data is propagated correctly through the entire pipeline. • Actively contribute to the refactoring and modernization of legacy Scala codebases, applying best practices in functional programming, testing, and observability. • Collaborate closely with teams using Node.js APIs (for data ingestion) and Python (for data transformations), maintaining clear data contracts and robust integration patterns. • Act as a strong technical communicator, contributing to technical approaches, breaking down complex problems, and engaging in rapid, iterative development cycles by asking questions quickly rather than working in isolation.

🎯 Requirements

• Degree in Computer Science or a related technical discipline. • 6+ years of software engineering experience, with a strong background in building and operating large-scale, high-traffic distributed systems in production. • Deep expertise in Scala and its functional programming paradigms. • Demonstrable, hands-on experience with GCP Dataflow (Apache Beam). Experience with other major streaming/batch frameworks (e.g., Apache Spark, Akka Streams) is also highly valuable. • Strong proficiency in the GCP ecosystem, including critical services like BigQuery, Pub/Sub, and Cloud Functions. • Solid understanding of data engineering principles, including data modeling, schema design, and data lifecycle management. • Experience building and maintaining data export feeds to external systems (e.g., SFTP, GCS, S3). • Proven ability to take ownership of complex technical features and deliver them from design to production. • Excellent communication skills, with experience working in polyglot environments (interfacing with Node.js, Python, etc.) and a proactive, inquisitive approach to problem-solving. • Ability to be available for key synchronous meetings and standups between 6:00 PM and 7:00 PM GMT.