Lead Data Engineer, ADB

🔥 19 hours ago

🇵🇹 Portugal – Remote

⏰ Full Time

🟠 Senior

🚰 Data Engineer

👻 Ghost score 12%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Bonapolia

WebsiteLinkedInAll Job Openings

11 - 50 employees

Founded 2018

💼 Consulting

📣 Marketing

📦 Logistics

Consulting • Marketing • Logistics

Bonapolia is a recruitment and talent-matching firm focused on connecting candidates with technology and engineering roles through a candidate-centric, client-partner approach. The company operates a global, largely remote job marketplace and offers career counseling, interview coordination, and relocation support (notably to Portugal) while building long-term relationships with clients to deliver hired talent efficiently. Bonapolia emphasizes scalable boutique recruitment services, training support for employees, and a streamlined application/connect process for job seekers.

📋 Description

• Define and enforce best practices and coding standards across the project • Conduct thorough code reviews to maintain high code quality • Work independently and collaboratively with the team • Communicate clear instructions to team members and help manage day-to-day operations • Communicate regularly with the client • Design, develop, and maintain robust and scalable Spark applications • Write clean, maintainable, and efficient code • Optimize code for performance and scalability • Collaborate with cross-functional teams to deliver high-quality software solutions • Identify and resolve technical issues • Create and maintain comprehensive documentation for code, processes, and workflows

🎯 Requirements

• 5+ years of hands-on experience in software development • Practical experience developing SQL stored procedures and migrating them into Spark SQL or PySpark environments • Extensive expertise using PySpark on Databricks, including Delta tables, cluster management, and workflow automation • Proven track record of optimizing Spark performance within production-level projects • Strong proficiency in Python for complex data manipulation using libraries such as Polars or Pandas • Solid understanding of columnar data storage formats, particularly Parquet, with practical experience using Delta Tables • Proven expertise in data processing, analysis, and transformation workflows • Strong analytical and problem-solving abilities with a detail-oriented mindset • Practical and pragmatic approach to balancing standardized processes with flexibility to meet project goals • Solid understanding of microservices architecture and its implementation in scalable systems • English level Advanced • Nice to have: experience with Azure Cloud services or other major cloud platforms, including Service Bus, Data Lake, Blob Storage, Redis, and other SaaS offerings • Nice to have: familiarity with FastAPI • Nice to have: expertise in Docker and Kubernetes