Databricks Architect

🕒 April 20

🇺🇸 United States – Remote

⏰ Full Time

🟠 Senior

🔴 Lead

🏛️ Architect

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

Apply Now

Find Similar Remote Jobs

Receive Emails For Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Tiger Analytics

WebsiteLinkedInAll Job Openings

1001 - 5000 employees

Founded 2011

🤖 Artificial Intelligence

🤝 B2B

Artificial Intelligence • B2B • Consulting

Tiger Analytics is a leading AI and analytics consulting firm that specializes in leveraging data science and machine learning to provide strategic business insights across various industries. They offer services in data strategy, AI engineering, and business intelligence to enable data-driven decision-making and digital transformation for their clients. Tiger Analytics collaborates with top technology partners like Microsoft, Google Cloud, and AWS to deliver cutting-edge solutions. They serve a diverse range of sectors including consumer packaged goods, healthcare, and finance, helping businesses operationalize insights and differentiate with AI and machine learning technologies.

📋 Description

• Design and implement scalable, end-to-end data solutions for ETL, real-time streaming, and machine learning workloads on the Databricks platform • Provide technical leadership and strategic guidance on Databricks adoption, including developing reference architectures and best practices. • Ensure optimal performance by tuning Spark jobs, optimizing data pipelines, and resolving complex technical issues. • Architect, develop, and debug PySpark jobs and data models, integrating Databricks with cloud services such as AWS S3, EMR, and Lambda • Implement and enforce data governance, security, and access control policies (e.g., encryption, auditing) on the Databricks environment

🎯 Requirements

• 12+ years of experience in Architecture, design and data engineering development of large-scale data ecosystems. • Databricks Design and Architecture: Design and architect scalable and secure Databricks solutions platform, optimizing performance, cost, and reliability. • Hands on Databricks/Dataops Architect that can help reduce consumption, and improve performance issues. Can help build monitoring tools. • Good exposure to AWS. Strong comm and leadership skills and Self driven and work independently. • Experience in Performance initiatives and drive recommendations (identify tuning opportunities, creation of performance environment etc. • Experience with hadoop environment. • Core Skills:- Databricks platform knowledge, Unity Catalog migration implementation exposure, Spark Streaming pipeline design exposure

🏖️ Benefits

• Significant career development opportunities exist as the company grows. • Unique opportunity to be part of a small, fast-growing, challenging, and entrepreneurial environment, with a high degree of individual responsibility.