Senior Data Platform Engineer

Job not on LinkedIn

September 30

🗽 New York – Remote

Although this job is listed in New York, this company may be open to hiring remote in other states.

⏰ Full Time

🟠 Senior

🏗️ Platform Engineer

🦅 H1B Visa Sponsor

Apply Now

Receive Emails with Similar Jobs

Dataiku

WebsiteLinkedInAll Job Openings

Dataiku is the platform for Everyday AI, systemizing the use of data for exceptional business results. Organizations that use Dataiku elevate their people (whether technical and working in code or on the business side and low- or no-code) to extraordinary, arming them with the ability to make better day-to-day decisions with data.More than 450 companies worldwide use Dataiku to systemize their use of data and AI, driving diverse use cases from fraud detection to customer churn prevention, predictive maintenance to supply chain optimization, and everything in between.

1001 - 5000 employees

💰 $400M Series E on 2021-08

📋 Description

• Be an expert level engineer within the Dataiku Platform including Platform Automation, GenAI Capabilities, Plugin Development, maintenance & troubleshooting • Be an expert  level engineer within Snowflake for data engineering and security/governance features • Build & maintain GenAI Platform solutions focused on security and governance for engineering delivery • Build & maintain Python & SQL based platform automation process • Build & maintain DataOps process for SDLC delivery • Build & maintain data quality metrics & observability to help drive data quality standards • Build & maintain administration systems and applications for monitoring, alerting, data observability, access management, platform metrics, and end user transparency • Assist Data Engineering with building python & SQL data replication & data pipelines on large & often complex data sets • Design data models for both short term and long term use cases to support data warehouse scalability • Identify opportunities for improvements & optimization for greater scalability & delivery velocity • Collaborate with engineers within GenAI Engineering & Analytics Engineering to build scalable solutions within the Data Platform • Perform root cause analysis on often complex errors to help ensure data pipeline availability • Help drive technical & architectural decisions on the data platform including decisions on data architecture, data engineering processes, data quality frameworks, data access security & governance frameworks, DataOps processes & data consumption models. • Help test new features in Dataiku and partner tools to both provide feedback internally and determine value towards internal analytics & data platform integration • Work closely with key stakeholders across the organization including Infra, embedded analytics teams, Product and Engineering to help foster both technical implementations & requirements gathering • Promote the Data Platform internally, help train & mentor others within the organization with technical excellence, & provide support on data & platform related inquiries • Proactively drive innovation internally with dedicated innovation time & projects that aim to be transformational for either the platform, team or company as a whole. • Actively contribute to the expertise level and competencies of the EDA Team and participate in the creation and support of data development standards and best practices.

🎯 Requirements

• Experience & a strong understanding of GenAI development, security & governance concepts a must • 5+ years of relevant experience in Data Engineering / Data Platform Engineering /Data Architecture • Expert level SQL & Python is a must. • Experience in Dataiku DSS is a strong plus. • Prior experience with Snowflake required • Prior experience with DevOps technologies such as Github Actions, Azure DevOps or Jenkins • Strong understanding of data architecture & data modeling concepts • Prior experience building and maintaining replication & data pipelines in a cloud data warehouse or data lake environment • Strong analytical mindset; proactively clarifies ambiguous problems, challenges assumptions, and proposes pragmatic solutions. • Works effectively with complex stakeholders, translating vague asks into clear, testable requirements. • Excellent written and verbal communication with senior audiences; articulates business value, data products, and platform capabilities; produces precise, concise documentation. • Demonstrated ownership in remote, fast-paced environments: manages multiple projects, adapts to different roles, mentors peers, and invests in continuous learning & knowledge-sharing.