Senior Data Engineer - Data Insights (Remote)

April 12

Cloudbeds

WebsiteLinkedInAll Job Openings

More Reservations. Happier Guests.

Technology • Software • Hotels • Property Management Software • Hostels

501 - 1000

💰 $150M Series D on 2021-11

Description

• BS or MS in computer science or a related technical field. • Proven experience as a big data engineer or a similar role, with a deep understanding of big data technologies, frameworks, and best practices. • Designing and implementing large-scale, distributed data processing systems using technologies such as Apache Hadoop, Apache Spark, or Apache Flink. • Developing and optimizing data pipelines and workflows for ingesting, storing, processing, and analyzing large volumes of structured and unstructured data. • Building and maintaining data infrastructure, including data lakes, data warehouses, and real-time streaming platforms. • Designing and implementing data models and schemas for efficient data storage and retrieval. • Ensuring the scalability, availability, and fault-tolerance of big data systems through proper configuration, monitoring, and performance tuning. • Identifying and evaluating new technologies, tools, and frameworks to improve the efficiency and effectiveness of big data processing. • Implementing data security and privacy measures to protect sensitive information throughout the data lifecycle. • Knowledge of distributed computing principles and technologies, such as HDFS, YARN, and containerization (e.g., Docker, Kubernetes). • Understanding of real-time streaming technologies and frameworks, such as Kafka (Confluent) or Apache Flink. • Strong problem-solving skills and ability to optimize and tune big data processing systems for performance and scalability. • Excellent communication and teamwork skills to collaborate with cross-functional teams and stakeholders.

Requirements

• Leadership skills: guiding and mentoring junior members, coordinating projects and collaborating with other teams. • Problem solving: Dealing with complex challenges, optimizing data pipelines and ensuring data quality and troubleshooting issues. • Domain Knowledge: Having understanding of the hospitality industry can greatly enhance your ability to design and build effective data pipelines. • Data Architecture Expertise: Contributing to designing data architecture and system and having a deep understanding of data storage and ability to design a robust, scalable and maintainable architecture is a valuable skill. • Performance Optimization: Being able to optimize the performance of data pipelines is a crucial skill such as query optimization, indexing, caching and data partitioning and sharding. • Data Governance and compliance: Having an understanding of different data governance principles and compliance regulations such as GDPR and HIPAA is very important. • Programming knowledge: Knowledge of Python and SQL is essential, familiarity with Java and other languages is a plus. • Experience working with a remote-first and globally distributed team. • Experience with CI/CD tooling, including GitHub Actions and Build Workflows. • Knowledge of Confluent and AWS.

Benefits

• Hire the best people around the world • Emphasize the value of results over hours put in • Provide flexibility in working hours and locations • Foster an inclusive environment that celebrates bold thinking and diverse perspectives • Offer open vacation policies, free LinkedIn Learning, and other benefits that promote well-being and professional development.