Senior Data Engineer

November 7

Apply Now

Receive Emails with Similar Jobs

Ciklum

WebsiteLinkedInAll Job Openings

Artificial Intelligence • B2B • Enterprise

Ciklum is a global digital engineering and AI-enabled product and platform services company that helps enterprises design, build, and scale AI-infused software, cloud, data, and automation solutions. It combines UX and product design with engineering, DevOps, data engineering, responsible AI, and edge/IoT capabilities to move pilots into production and deliver enterprise-ready outcomes across industries such as banking, retail, healthcare, hi-tech, automotive, and travel. Ciklum emphasizes platform-agnostic, scalable solutions—covering AI incubators, conversational AI, agentic automation, cloud and edge services, XR/AR/VR, and digital assurance—focused on transforming workflows and customer experiences for B2B enterprise clients.

1001 - 5000 employees

Founded 2002

🤖 Artificial Intelligence

🤝 B2B

🏢 Enterprise

📋 Description

• Build & Own: Design, build, and operate our core AIOps and analytics platform on Kubernetes (starting with EKS) • Scale Data Ingestion: Implement and optimize large-scale data ingestion pipelines using AWS EMR and Spark to handle massive initial data loads • Manage Analytics DB: Own and operate our self-managed OpenSearch cluster on Kubernetes (using the K8s operator), ensuring its performance, reliability, and scalability as our primary analytics database • Optimize for Cost & Scale: Design and implement robust data lifecycle management and tiering strategies, automatically moving data to cheaper, object based storage (like S3) to support huge data volumes affordably • Implement AIOps: Get hands-on implementing and integrating AI, machine learning, and generative AI into our platform. You will build solutions for anomaly detection (e.g., security threats, budget spikes) and enable users to interact with the platform using natural language prompts, all leveraging OpenSearch native technologies • Drive Multi-Cloud Strategy: Evolve the platform's implementation to support multiple cloud providers beyond AWS, enabling our SaaS and BYOC (Bring Your Own Cloud) models • Deliver Insights: Continuously improve our data processing and models to provide new and deeper insights to our customers through our custom-built UI

🎯 Requirements

• Senior-Level Experience: Significant (e.g., 7+ years) experience as a hands-on data engineer, with a proven track record in a Staff, Principal, or equivalent senior implementor role • Kubernetes Expertise: Deep, hands-on experience building, deploying, and managing data-intensive applications on Kubernetes (EKS preferred) • OpenSearch/Elasticsearch Mastery: Proven experience running and scaling OpenSearch (or Elasticsearch) in a large-scale, self-managed production environment. Experience with the K8s operator is a major plus • Large-Scale Data Pipelines: Proven experience building, scaling, and optimizing complex, large-scale data pipelines in a production environment • Data Optimization & Cost Management: Demonstrable experience in optimizing complex data workflows and implementing data lifecycle/tiering policies to manage and reduce storage costs • Cloud Proficiency: Strong knowledge of the AWS ecosystem (EMR, S3, EKS, etc.) • Strong Coder: Proficiency in a relevant programming language (e.g., Python, Scala, or Java) • Collaboration: Excellent communication and collaboration skills, with a passion for working as part of a high-performing team

🏖️ Benefits

• Regular salary reviews based on performance • Corporate events including webinars, offline parties, and meetups • Internal Mobility Program • Tailored education path including full access to Udemy and company-paid certifications • 25 paid days off including 20 business days of vacation per calendar year plus 5 undocumented sick leave days • Additional health insurance • 100% company-covered Multisport card with family discounts available