Data Engineering Lead

Job not on LinkedIn

🔥 0 minutes ago

🇺🇸 United States – Remote

⏰ Full Time

🟠 Senior

🚰 Data Engineer

👻 Ghost score 13%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

RecruityTalent

WebsiteLinkedInAll Job Openings

1 - 10 employees

Founded 2024

💼 Consulting

📦 Logistics

🎯 Recruiter

Consulting • Logistics • Recruitment

RecruityTalent is a recruitment agency that partners with companies to manage the full hiring lifecycle, offering standard and flexible solutions through onsite recruitment projects and agency services. It provides end-to-end hiring support — including job postings, candidate sourcing, screening, interviews and offer management — with experience in IT, BPO and executive search, aligning hiring to clients' business vision and company culture.

📋 Description

• Define and enforce best practices and coding standards across the project • Conduct code reviews to maintain adherence to guidelines and high code quality • Communicate clear instructions to team members and help manage day-to-day operations • Communicate regularly with the client • Design, develop, and maintain robust and scalable Spark applications • Write clean, maintainable, and efficient code • Optimize code for performance and scalability • Collaborate with cross-functional teams to deliver high-quality software solutions • Identify and resolve technical issues to ensure application reliability and performance • Create and maintain comprehensive documentation for code, processes, and workflows • Provide technical leadership, mentoring, coaching, and lead by example

🎯 Requirements

• 5+ years of hands-on experience in software development • Extensive experience with Apache Spark, including Databricks and/or Azure Synapse/Fabric • Proficiency in Python • Strong data manipulation skills using Pandas/Polars or similar • Understanding of columnar data storage formats, particularly Parquet • Practical experience using Delta Tables • Expertise in data processing, analysis, and transformation workflows • Strong analytical and problem-solving abilities • Detail-oriented mindset • Ability to balance standardized processes with flexibility to meet project goals • Excellent organizational and self-management skills • Ability to prioritize tasks, structure workload, and meet tight deadlines • Understanding of microservices architecture and implementation in scalable systems • Upper-Intermediate English level • Experience with Azure Cloud services or other major cloud platforms, including Service Bus, Data Lake, Blob Storage, Redis, and similar offerings • Familiarity with FastAPI • Expertise in Docker and Kubernetes

🏖️ Benefits

• Remote work arrangement • GDPR-compliant handling and secure storage of candidate information