Principal Software Engineer – Data Engineering, Cloud

Job not on LinkedIn

November 12

🏄 California – Remote

Although this job is listed in California, this company may be open to hiring remote in other states.

💵 $150k - $300k / year

⏰ Full Time

🔴 Lead

🚰 Data Engineer

Apply Now

Receive Emails with Similar Jobs

Three Ventures Technology, Inc.

WebsiteLinkedInAll Job Openings

B2B • Consulting • Analytics

Three Ventures Technology, Inc. is a strategic analytics and technology consulting firm that partners with clients to unlock data-driven growth through innovative solutions. The company specializes in areas such as data and analytics, cloud transformation, marketing analytics, and API development. Committed to turning customer data into actionable insights, Three Ventures offers services like data visualization, tag management, CRM consulting, cloud security and compliance, and enhanced marketing operations. Trusted by a diverse range of clients, Three Ventures leverages expertise in platforms such as Google Analytics, AWS, Microsoft Azure, and OpenAI, to deliver customized services that meet essential business objectives while fostering sustainable relationships.

11 - 50 employees

🤝 B2B

📋 Description

• Architect, design, and maintain high quality code in Python • Design data pipelines that can consume from various systems in different shapes and sizes, including but not limited to Kafka, sensors, real time streams, and data lakes • Be well versed in AWS, Azure, container based applications, and Kubernetes • Work on different types of data engineering workloads, such as incremental, delta, and single source of truth patterns • Review and approve PRs across services and SDKs with deep context and constructive feedback • Rapidly prototype, scaffold systems, and break down complex architectures into modular subsystems and micro-services • Lead and foster a high code quality culture within the organization, while carefully implementing software design patterns, messaging patterns and architectures • Own technical strategy for scalable cloud infrastructure across AWS, Azure and multi-cloud setups • Contribute to decision making on "build vs buy," especially around open source and commercial tools • Build integrations and abstractions around customers’ legacy business systems such as SAP and GIS • Help create and deploy modern data pipelines, APIs and SDKs • Drive automation first thinking across environments, pipelines, and deployments • Maintain high quality, reliable data engineering pipelines • Actively participate in customer engagements, translating feedback into product and platform improvements • Build tools and interfaces with UX sensitivity, working with the product design team focusing on user centric business software • Mentor junior engineers in multiple time zones and collaborate cross functionally with product, data science, and customer success teams • Create low latency, high throughput systems

🎯 Requirements

• 8+ years of full time software engineering experience, including in staff, lead, or architect level roles • Deep experience with cloud native architecture and developing applications on Cloud, especially on AWS (must be hands on) and Azure • Well versed in Databricks, Delta Lake, Apache Kafka, Airflow, and DAGs • Strong Python skills preferred, experience in multiple programming languages highly valued • Experience with containers, CI/CD pipelines, and modern cloud tooling • Demonstrated ability to design and ship cloud applications at scale with low latency, auto-scaling, and request routing capabilities • Familiarity with SDK development, API design (both consuming and building), and schema-less DBs • Comfortable navigating both relational and NoSQL database architectures • Track record of building high quality, open source or enterprise grade software • Background working in high caliber tech companies or open source centric environments (e.g., Databricks, Hugging Face, Replicate) • Solid understanding of software design patterns, cloud architectures and messaging patterns.

🏖️ Benefits

• Health insurance • 401(k) plan • Paid time off • Remote work options • Professional development