ADF Lead, Data Bricks, Snowflake

Job not on LinkedIn

🔥 0 minutes ago

🌲 Oregon – Remote

🌲 Oregon – Remote

💵 $120k / year

⏰ Full Time

🟠 Senior

📊 Data Scientist

Apply Now

Find Similar Remote Jobs

Receive Emails For Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Affinity Outsourcing Limited

WebsiteLinkedInAll Job Openings

51 - 200 employees

Founded 2010

🤝 B2B

💸 Finance

☁️ SaaS

B2B • Finance • SaaS

Affinity Outsourcing Limited is a premier provider of outsourced accounting services specifically designed for UK accountants. Established in 1960, the company specializes in key areas such as bookkeeping, payroll processing, tax return preparation, and management accounts support. With a dedicated team both in the UK and India, Affinity Outsourcing focuses on delivering comprehensive accounting solutions, allowing firms to streamline their operations while ensuring compliance with the latest financial regulations.

📋 Description

• Designing and building the data Ingestion Pipeline • Designing, building and maintain large, complex data processing pipelines using Databricks and Azure Data Factory in Azure to meet enterprise Data requirements • Providing operational and functional support on creating, storing, managing, and maintaining enterprise data • Identifying, designing, and implement internal process improvements • Building the infrastructure required for extraction, transformation, and loading of data from a wide variety of cloud and on-premises data sources • Working with stakeholders including to assist with data-related technical issues and support their data infrastructure needs • Working closely with data architecture, data governance and data analytics teams to ensure pipelines adhere to enterprise standards, usability, and performance

🎯 Requirements

• 10+Years of Exp • Experience in building Meta data driven framework using Databricks • Experience in Snow-Pipe and Snow-SQL • Write complex SQL queries, stored procedures, and user-defined functions in Snowflake to support data processing and analytics requirements • Optimize SQL code and query performance by understanding query execution plans, indexing strategies, and query optimization techniques • Implement data quality checks and validation processes to ensure the accuracy, consistency, and integrity of data in Snowflake • Collaborate with data governance teams to enforce data quality standards and compliance with data regulations • Implement and maintain data security measures in Snowflake to ensure data privacy and compliance