Senior Data Engineer

November 20

Apply Now

Receive Emails with Similar Jobs

Drata

WebsiteLinkedInAll Job Openings

Cybersecurity • Compliance • SaaS

Drata is a security and compliance automation platform that continuously monitors and collects evidence of a company’s security controls, streamlining workflows to ensure audit-readiness. The platform provides solutions for startups, growth, and enterprise companies to scale and enhance their compliance programs. It covers a variety of frameworks including SOC 2, ISO 27001, HIPAA, GDPR, and FedRAMP. Drata offers integrations with various systems and promotes automation and customization in managing compliance processes, helping companies maintain compliance effortlessly through adaptive automation and deep integrations with existing IT ecosystems.

201 - 500 employees

Founded 2020

🔒 Cybersecurity

📋 Compliance

☁️ SaaS

💰 $100M Series B on 2021-11

📋 Description

• Develop and maintain robust data models and schema designs. • Design and develop complex data pipelines for efficient and scalable data processing. • Optimize data infrastructure and enhance overall system performance. • Advanced programming skills (Python, Java, or equivalent) for data processing and analysis tasks. • Implement and optimize algorithms for data transformation, cleansing, and enrichment. • Drive the adoption of best practices in data governance, security, and management. • Collaborate with Software Engineers to integrate data analytics solutions into production systems. • Apply machine learning techniques to extract insights and patterns from large datasets. • Collaborate with cross-functional teams to understand business requirements and provide data-driven solutions. • Formulate the right metrics and definitions of success to drive quality, efficiency, cost, timeliness and understanding the source data. • Develop and maintain documentation for data processes, pipelines, and models. • Engage with LLM models, showcasing your capacity to work with cutting-edge AI technologies. Continuously stay up-to-date on industry trends and advancements in data engineering and analytics.

🎯 Requirements

• 8+ years of advanced SQL development experience coupled with robust Python or Java programming capabilities. • 4+ years of hands-on experience with data warehousing technologies (Snowflake, BigQuery, Redshift). • 3+ years of experience working with streaming using Spark or Flink or Kafka or NoSQL or relevant technologies • Extensive experience building and optimizing large-scale ETL pipelines, data modeling and schema design. Including CDC, structured and unstructured data. • A fearless attitude towards technological change and a drive to thrive in fast-paced, dynamic settings. • You have strong dedication to code quality, automation and operational excellence: CI/CD pipelines, unit/integration tests. • Demonstrated experience in building working in AWS, web services and/or working with ML pipelines and LLM models. • Bachelor's degree in Computer Science, Engineering, Mathematics, Statistics, Operations Research, Data Science or related field. • Solid understanding of data security and compliance requirements. • Effective communication skills, conveying complex technical concepts to non-technical stakeholders. • Ability to thrive in a fast-paced, high-growth startup environment with a balance of autonomy and collaboration.

🏖️ Benefits

• Health & Wellness: 100% coverage for medical, dental, and vision - employee and dependents. • Learning & Development: $500 annually towards personal development opportunities. • Unlimited PTO: Unlimited vacation policy for strong, fully charged batteries. • 16 Weeks Paid Parental Leave: An inclusive policy to ensure you have time with your newborn, newly adopted, or foster child (available after six months of employment) • Work Remotely: Flexible hours and work from home (especially these days!) • 401K: Reach your financial goals while reducing your taxes • HSA, FSA, & DCFSA: Pre-tax savings plans for healthcare and dependent care.