Parvana
Recruitment • Telecommunications • Finance
Parvana is an IT recruitment specialist, focusing on the fields of Software Development, Finance, and Telecommunications. With a presence in both South Africa and the United Kingdom, Parvana offers a global perspective in delivering personalized and efficient recruitment services. Their dedicated team of skilled professionals assists candidates with CV preparation, interview coaching, and career advice, ensuring a value-added experience in the job market.
Data Engineer
Job not on LinkedIn
August 15
Parvana
Recruitment • Telecommunications • Finance
Parvana is an IT recruitment specialist, focusing on the fields of Software Development, Finance, and Telecommunications. With a presence in both South Africa and the United Kingdom, Parvana offers a global perspective in delivering personalized and efficient recruitment services. Their dedicated team of skilled professionals assists candidates with CV preparation, interview coaching, and career advice, ensuring a value-added experience in the job market.
📋 Description
• Analyzes complex customer data to determine integration needs • Develops and tests scalable data integration/transformation pipelines using PySpark, SparkSQL, and Python • Contributes to the codebase through coding, reviews, validation, and complex transformation logic • Automates and maintains data validation and quality checks • Collaborates with FPA, data engineers, and developers to align solutions with financial reporting and business objectives • Participates in solution architecture and technical discussions, refining user stories and acceptance criteria • Utilizes modern data formats/platforms (Parquet, Delta Lake, S3/Blob Storage, Databricks) • Partners with the product team to ensure accurate customer data reflection and provide feedback based on data insights
🎯 Requirements
• 5+ years of experience as a Data Analytics Engineer • Strong Python, PySpark, Notebook, and SQL coding skills, especially with Databricks and Delta Lake • Proven ability to build and deploy scalable ETL pipelines to cloud production environments using CI/CD • Experience with Agile/Scrum, data quality concepts, and excellent communication • Cloud environment (Azure, AWS) and Infrastructure as Code (Terraform, Pulumi) experience beneficial • Telecoms industry or consulting experience, plus accounting knowledge, is a plus
Apply NowSimilar Jobs
December 8, 2024
1Nebula seeks a Cloud Data Engineer to manage and develop data solutions. Ensure data supports the organization's business goals.
AWS
Azure
Cloud
ETL
MySQL
Postgres