Senior Data Engineer

🔥 1 minute ago

🇮🇳 India – Remote

⏰ Full Time

🟠 Senior

🚰 Data Engineer

Where this job comes from

Posted on NorthBay Solutions's careers page, not through a job board

First seen by Remote Rocketship 1 minute ago

Logo of NorthBay Solutions

NorthBay Solutions

201 - 500 employees

Founded 2007

💼 Consulting

🏥 Healthcare

📦 Logistics

Consulting • Healthcare • Logistics

NorthBay Solutions is a fast-growing AWS-focused consulting firm that specializes in cloud migration, AI & machine learning, data lake and analytics solutions, and managed services. With over ten years of experience and AWS competency certifications, they navigate the complexities of modern cloud infrastructures to help businesses achieve their goals effectively. NorthBay Solutions provides tailored strategies for cloud application development, DevOps enablement, and data modernization, ensuring robust support for various industries such as healthcare, finance, and education.

📋 Description

• Design, develop, and maintain scalable data platforms and data pipelines on Microsoft Azure • Build and optimize batch and real-time data ingestion frameworks from structured and unstructured data sources • Design and implement data lake, data warehouse, and lakehouse architectures • Develop and manage ETL/ELT processes using modern cloud-native data engineering practices • Implement data transformation, cleansing, validation, and quality frameworks • Collaborate with business stakeholders, data analysts, data scientists, and application teams • Optimize data storage, processing, and query performance across enterprise data platforms • Implement security, governance, monitoring, and compliance best practices across Azure environments • Support integration of data platforms with AI/ML, business intelligence, and enterprise applications • Participate in architecture reviews, code reviews, troubleshooting, and technical mentoring • Ensure high availability, scalability, and operational excellence of data platforms and pipelines

🎯 Requirements

• 8–10+ years of experience in Data Engineering, Data Warehousing, and Enterprise Data Platform development • Strong hands-on experience with Microsoft Azure Data Services • Expertise in Azure Data Factory (ADF), Azure Synapse Analytics, Azure Data Lake Storage (ADLS Gen2), and Azure SQL Database • Experience building and managing large-scale ETL/ELT pipelines and data integration solutions • Strong proficiency in SQL, query optimization, and database performance tuning • Hands-on experience with PySpark, Apache Spark, and distributed data processing frameworks • Strong programming skills in Python, Scala, or Java • Experience with dimensional modeling, data warehousing concepts, and modern lakehouse architectures • Experience working with structured, semi-structured, and unstructured data • Strong understanding of data governance, data quality, metadata management, and security best practices • Experience with REST APIs, data integration patterns, and enterprise system connectivity • Hands-on experience with Git, CI/CD pipelines, and DevOps practices • Microsoft Fabric, OneLake, Dataflows, and Fabric Data Engineering workloads preferred • Databricks, Delta Lake, and lakehouse implementation experience preferred • Knowledge of Azure Event Hubs, Apache Kafka, or Azure Stream Analytics preferred • Experience supporting AI/ML and advanced analytics workloads preferred • Familiarity with Power BI datasets, semantic models, and enterprise reporting architectures preferred • Experience with Microsoft Purview preferred • Microsoft Azure Data Engineering certifications highly preferred • Experience working in Agile/Scrum environments preferred • Exposure to MLOps and DataOps practices • Knowledge of Docker and Kubernetes • Experience with Infrastructure as Code, including Terraform, ARM Templates, or Bicep • Familiarity with Snowflake, BigQuery, or other cloud data warehouse platforms • Experience with enterprise-scale data migration and modernization projects • Understanding of Generative AI, Vector Databases, and data platforms supporting AI workloads

🏖️ Benefits

• Critical experience on cutting-edge technology projects • Environment that encourages high-quality performance • Opportunities to work with sophisticated Web 3.0 blockchain, block commerce, and streaming media solutions • Full-time, permanent employment

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 Yesterday

Shuru

51 - 200

🤖 Artificial Intelligence

🤝 B2B

🏢 Enterprise

Senior Data Engineer building scalable multi-cloud data platforms and pipelines for Shuru’s AI-driven technology solutions. Leading architecture, reliability, and engineering best practices.

🕒 Yesterday

TransUnion

10,000+ employees

💼 Consulting

📣 Marketing

📦 Logistics

Senior Data Consultant building GCP data pipelines, dashboards, and streaming platforms for TransUnion’s fraud prevention solutions. Enabling fraud detection, analytics, and real-time decisioning.

🕒 2 days ago

Akamai Technologies

5001 - 10000

🔒 Cybersecurity

Senior Data Engineer building scalable SQL/Python pipelines, dimensional models, and Tableau dashboards. Enabling enterprise decision-making through governed data architecture and actionable insights.

🕒 6 days ago

Firmable

51 - 200

🤝 B2B

☁️ SaaS

🤖 Artificial Intelligence

Data Engineer building production data pipelines and LLM workflows for Firmable’s global company and people data platform. Scaling enrichment, matching, deduplication, evaluation, and cost controls across billions of records.

🕒 6 days ago

Firmable

51 - 200

🤝 B2B

☁️ SaaS

🤖 Artificial Intelligence

Senior Data Engineer designing Snowflake data platforms and LLM pipelines for Firmable's company-data products. Owning evaluations, entity resolution, model governance and billion-row warehouse performance.

Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok