Databricks Developer, Java, Apache Spark, IRS MBI Clearance

Job not on LinkedIn

🕒 May 21

Apply Now

Find Similar Remote Jobs

Receive Emails For Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

3M Consultancy

WebsiteLinkedInAll Job Openings

1 - 10 employees

Founded 2018

🤝 B2B

🎯 Recruiter

B2B • Recruitment • Staffing

3M Consultancy is an established Information Technology Staffing Firm dedicated to fulfilling hiring needs for businesses of all sizes. With over 15 years of experience, they pride themselves on sourcing top talent by meticulously understanding client requirements and business culture. Their strategic approach, which combines flexibility and a deep understanding of industry demands, ensures that organizations receive candidates who fit their unique needs and goals.

📋 Description

• Build and maintain data pipelines using Apache Spark on Databricks • Write clean and efficient Java (Java 8 or higher) following best coding practices • Work with large structured and semi-structured data sets • Tune Spark jobs to improve performance, stability, and cost • Partner with other teams to understand requirements and deliver solutions • Make sure data handling follows security and governance standards • Investigate and fix issues in production environments

🎯 Requirements

• Active federal background clearance (client-issued laptop is a plus) • Bachelor’s degree in Computer Science or a related field • 8+ years of hands-on experience in data engineering or big data development • Strong experience with Java 8 or newer • Comfortable with Streams, Lambdas, and object-oriented design • Hands-on experience with Spark Core, Spark SQL, and DataFrames • Experience with batch processing and streaming • Strong skills in Spark performance tuning • Able to debug jobs using Spark UI and logs • Experience building batch and real-time ETL pipelines • Skilled in data cleansing, transformation, and enrichment • Familiar with CI/CD tools like Jenkins or GitHub Actions • Experience with monitoring tools and production logs • Unit testing using JUnit or TestNG • Comfortable validating data and testing Spark jobs • Experience with Scala or Python in Spark (Nice to Have) • Hands-on experience with Databricks or Google Dataproc (Nice to Have) • Knowledge of Delta Lake or Apache Iceberg (Nice to Have) • Background in data modeling and performance design (Nice to Have)