Scala, Spark Developer

Job not on LinkedIn

🔥 0 minutes ago

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Directio

WebsiteLinkedInAll Job Openings

51 - 200 employees

Founded 1996

☁️ SaaS

Software Development • Cloud Services • SaaS

Directio is a global IT services company that specializes in end-to-end software development and cloud solutions. They consult, code, test, deploy, and manage cloud-based and mobile applications, providing 24/7 support from their offices located across Poland, the Philippines, Mexico, and the United States. Their focus is on delivering tailored software solutions that align with clients' goals and help overcome complex challenges in technology and development.

📋 Description

• Design, develop, and maintain scalable data processing applications using Scala and Apache Spark • Build, optimize, and maintain ETL/ELT pipelines processing large volumes of data • Develop efficient Spark applications using Spark SQL and the DataFrame/Dataset API • Optimize Spark jobs by improving partitioning strategies, shuffle operations, caching, and join performance • Troubleshoot and resolve performance issues using Spark UI and monitoring tools • Collaborate with data engineers, software developers, and stakeholders to design scalable data processing solutions • Participate in code reviews and contribute to software quality, performance, and engineering best practices

🎯 Requirements

• Strong commercial experience developing production applications in Scala, including functional programming concepts • Proven hands-on experience with Apache Spark, including Spark SQL, DataFrame/Dataset API • Experience working in production environments with large-scale data processing and distributed data pipelines • Strong understanding of software engineering best practices, code quality, performance optimization, and maintainability

🏖️ Benefits

• Private healthcare • Multisport card • Professional training opportunities