Senior Backend Software Engineer, Data Pipelines (REMOTE - Palo Alto, CA)
December 20, 2023
🇺🇸 United States – Remote
💵 $150k - $200k / year
⏰ Full Time
🟠 Senior
🔙 Backend Engineer
🗽 H1B Visa Sponsor
Loading...
Description
• As a Senior Backend Software Engineer, Data Pipelines, you will be responsible for the design and development of complex data processing workflows and for performing batch processing of large amounts of structured and semi-structured data in cloud-native environments. You will do this by leveraging Kafka for asynchronous queues, Docker for containerization, and Kubernetes for orchestration, to achieve high levels of efficiency, scalability, and reliability.
Requirements
• Solid experience with Golang (Must-Have) developing highly-available and scalable production-level code to build microservices, batch architectures, and lambda expressions • Excellent understanding of data structures; You’re not challenged by keeping a flow of data structures in-memory • Experience working with multiple file formats (CSV, JSON, Parquet, Avro, Delta Lake et al.) • Knowledge of data warehouse technical architectures, Docker and Kubernetes infrastructure components, and how to develop secure ETL pipelines • Experience in pub/sub modes like Kafka • Experience working in a Big Data environment (Hadoop, Spark, Hive, Redshift et al.) • Experience with relational and non-relational databases • Experience building real-time streaming data pipelines is a plus
Benefits
• Work from home expense (U.S., Canada, and Australia) • Excellent Health, Dental, and Vision Insurance Options (Varies by Country) • Vanguard 401k • Very generous PTO • Flexible Hours • Generous Equity • Pay: A base salary range of $150,000 - $200,000 can be expected for this role in the San Francisco/Bay Area. You could also be entitled to receive an additional incentive bonus or variable pay, equity, and benefits. Skyflow operates from a place of high trust and transparency; we are happy to disclose the pay range for our open roles that best align with your needs. Exact compensation may vary based on skills, experience, education, and location. • At Skyflow, we believe that diverse teams are the strongest teams. We invite applicants of all genders, races, ethnicities, nationalities, ages, religions, sexual orientations, disability statuses, educational experiences, family situations, and socio-economic backgrounds.
Apply Now
