DataOps Engineer
April 24
Description
• Work closely with the data team to build, scale, and optimize the Trustly big data environment, including the data lake setup, AWS infrastructure stack, BI data warehouse, and automation/visualization tools • Implement ETL processes and QA checks to ensure data in the data lake is accurate and up to date • Implement data pipelines to automate the timely delivery of customer reporting and dashboards • Partner with DevOps to ensure our environment and tools are compliant with security protocols • Partner with data scientists to productionalize machine learning models • Documentation of data flows, architectural setup, and data model
Requirements
• Bachelor's or Master's degree in IT/Math/CS/Engineering or other technical discipline • Successful history of building big data pipelines, and data sets • Experience with AWS cloud services (DMS, EC2, EMR, RDS) and big data tools (Redshift) • Desirable experience with Spark and Delta Lake • Experience with relational databases (preferably Postgres), strong SQL coding, data modeling, data warehouses • Experience with IaC, Terraform, etc • Desirable experience with Kubernetes, Docker • Experience with CI/CD • Experience with automation and workflow management tools (e.g. Airflow, kubeflow) • Intermediate Python programming skills
Benefits
• Bradesco health and dental plan, for you and your dependents, with no co-payment cost • Life insurance with differentiated coverage • Meal voucher and supermarket voucher • Home Office Allowance • Gympass - Platform that gives access to spaces for physical activities and online classes • Trustly Club - Discount at educational institutions and partner stores • Monthly happy hours with iFood coupon • English Program - Online group classes with a private teacher • Extended maternity and paternity leave • Birthday Off • Flexible hours/Home Office - our culture is remote-first! You can work in every city in Brazil • Welcome Kit - We work with Apple equipment (Macbook Pro, iPhone) and we send many more treats! Spoiler alert: Equipment can be purchased by you according to internal criteria • Annual premium - As a member of our team, you are eligible to receive an annual bonus, at the company's discretion, based on the achievement of our KPI's and individual performance • Referral Program - If you refer a candidate and we hire the person, you will receive a reward for that!
Apply Now