Grupo QuintoAndar - Staff Data Platform Engineer
April 9
Description
• Being a reference for your team • Discussing business and engineering requirements with analysts, engineers, and various stakeholders at a deep level, while anticipating risks • Defining a software development process that helps your team be more productive • Building an excellent team by recruiting great talents and helping them grow • Being willing to be hands-on when necessary • Drives execution by organizing teamwork, setting goals, and holding the team accountable • Is effective at finding ways to leverage team productivity, facilitating their technical work • Specializes in Big Data technologies, solutions, and concepts (Spark, Hadoop, Hive, MapReduce) and multiple languages (YAML, Python) • Proficiency in Python, or one of the major programming languages, and passionate about writing clean and maintainable code. You might even be a Software Engineer with a focus or passion for data-driven solutions • Understands the data lifecycle and concepts such as lineage, governance, privacy, retention, anonymization, etc. • Excellent communication skills, proactively sharing and seeking context to collaborate with different teams • Be capable of guiding data engineering teams to develop projects with broad technical scope, including solutions that impact the business domains of various tribes • Be an expert in building large-scale data platforms for big datasets and teams, using Big Data technologies such as Spark, Trino, Hive, Datahub, Superset, Ranger, etc • Be fluent in AWS and GCP cloud resources • Have strong experience with Apache Airflow or other data workflow tools • Have strong experience with columnar storage solutions and/or data lakehouse concepts • Have knowledge in infrastructure areas such as containers and orchestration (Kubernetes, ECS), CI/CD strategies, infrastructure as code (Terraform), observability (Prometheus, Grafana), among others • Understand how optimization works in various scenarios and how it can be improved, such as query performance, service scalability, and cluster management • Be curious about rapidly evolving technologies in the field of data engineering and be eager to learn and master them, bringing significant impact to our team
Requirements
• 11 paid holidays • Generous Accrued Time Off increasing with years of service • Generous paid sick time • Annual day of service
Benefits
• Competitive salary package • Bonus • Meal allowance ("Flash benefícios") • Health plan • Dental plan (optional) • Life insurance • Daycare subsidy • Subsidy to sports practicing (Gympass) • Extended maternity and paternity leave • Reserved room for breast-feeding*
Apply Now