Staff Software Engineer – Cloud Platform, Kafka

🕒 il y a 21 jours

🏄 California – Distant

🏄 California – Remote

💵 $136 000 - $265 700 / an

⏰ Temps Plein

🔴 Expert

🧑‍💻 Développeur Full-Stack

🦅 Parrain de Visa H1B

Cette entreprise a parrainé des visas H1B par le passé.

Postuler Maintenant

Trouver des Emplois à Distance Similaires

Recevoir des emails pour des emplois à distance

📊 Vérifiez votre score de CV pour ce poste

Améliorez vos chances d'obtenir un entretien en vérifiant votre score de CV avant de postuler.

Télécharger le CV

Calix

Site WebLinkedInTous les Emplois

1001 - 5000 employés

Fondée en 2000

📡 Télécommunications

☁️ SaaS

🏢 Entreprise

💰 €50 000 000 Venture Round en 2009-08

Telecommunications • SaaS • Enterprise

Calix est un fournisseur de solutions complètes qui se concentre sur l'accompagnement des fournisseurs de services de haut débit (BSP) pour simplifier, innover et développer leurs activités. Grâce à sa plateforme de haut débit avancée, Calix propose des technologies comme le 10G-PON, le 5G, le Wi-Fi 7 et plus encore pour améliorer les opérations réseau, réduire les temps d'arrêt et améliorer l'expérience des abonnés. L'entreprise propose des services gérés tels que SmartLife et SmartHome, qui aident les abonnés à gérer, sécuriser et améliorer leur style de vie connecté. Calix dessert différents types de fournisseurs, y compris les opérateurs téléphoniques, les câblo-opérateurs et les services municipaux, les aidant à fournir une connectivité haut débit essentielle et à transformer l'accès communautaire aux services numériques. Avec un accent sur la technologie cloud, l'analytique et l'orientation en matière de transformation, Calix permet aux fournisseurs de services de prospérer à l'ère numérique.

Description

• Design, provision, and manage Apache Kafka clusters (self-managed on GCP/AWS or via Confluent Platform / MSK). • Configure and tune brokers, ZooKeeper/KRaft, topics, partitions, replication factors, and retention policies for high throughput and low latency. • Perform cluster upgrades, rolling restarts, and broker replacements with zero downtime. • Implement and manage Kafka Connect pipelines for data ingestion and egress across heterogeneous systems. • Administer Kafka Streams and ksqlDB deployments for real-time stream processing workloads. • Maintain Schema Registry and enforce schema governance standards across teams. • Define and track SLIs/SLOs for consumer lag, throughput, end-to-end latency, and broker health. • Design and implement cloud infrastructure using IaC – Terraform • Build automated deployment pipelines for Kafka configuration changes using GitOps workflows (ArgoCD, Flux). • Create self-service tooling and runbooks to reduce toil for development teams. • Automate topic provisioning, ACL management, and schema registration via APIs and CLI tooling. • Integrate tools like GitLab CI/CD, or Cloud Build for automated testing and deployment. • Ensure seamless integration of data pipelines with other GCP services like Big Query, Cloud Storage. • Monitor and Optimize performance, reliability, and cost of Kafka and streaming pipelines • Implement security best practices for GCP resources, including IAM policies, encryption, and network security. • Ensure Observability is an integral part of the infrastructure platforms and provides adequate visibility about their health, utilization, and cost. • Collaborate extensively with cross functional teams to understand their requirements; educate them through documentation/trainings and improve the adoption of the platforms/tools.

🎯 Exigences

• 10+ years of overall experience in DevOps cloud engineering, or data engineering. • 5+ years of experience in Kafka at production scale. • Deep expertise in Kafka internals: replication protocol, log compaction, consumer group coordination, partition leadership, and KRaft mode • Proficiency with container orchestration (Kubernetes / Helm) and deploying Kafka via Strimzi, Confluent Operator, or equivalent • Strong understanding of networking (VPC, peering, private endpoints, DNS, load balancing) in cloud environments. • Hands-on experience with Kafka Connect, Schema Registry, and at least one stream processing framework (Kafka Streams, Flink, Spark Structured Streaming). • Proficiency in Google Cloud Platform (GCP) services, including Dataflow, Pub/Sub, Kafka, Dataproc, Big Query, and Cloud Storage. • Expertise in Infrastructure as Code (IaC) tools like Terraform or Cloud Deployment Manager. • Familiarity with data orchestration tools like Apache Airflow or Cloud Composer. • Experience with CI/CD tools like Jenkins, GitLab CI/CD, or Cloud Build. • Knowledge of containerization and orchestration tools like Docker and Kubernetes. • Strong scripting skills for automation (e.g., Bash, Python). • Experience with monitoring tools like Cloud Monitoring, Prometheus, and Grafana. • Familiarity with logging tools like Cloud Logging or ELK Stack. • Strong problem-solving and analytical skills. • Excellent communication and collaboration abilities. • Ability to work in a fast-paced, agile environment.

🏖️ Avantages

• As a part of the total compensation package, this role may be eligible for a bonus.