Senior Azure Data Engineer

Job not on LinkedIn

🕒 6 days ago

🌽 Illinois – Remote

🌽 Illinois – Remote

⏳ Contract/Temporary

🟠 Senior

☁️ Cloud Engineer

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

DATAMAXIS, Inc

WebsiteLinkedInAll Job Openings

51 - 200 employees

🤖 Artificial Intelligence

🔒 Cybersecurity

☁️ SaaS

Artificial Intelligence • Cybersecurity • SaaS

DATAMAXIS, Inc is a company that specializes in transforming big data into actionable insights for competitive advantage, market growth, and customer satisfaction. They provide services in artificial intelligence, machine learning, digital transformation, cyber security, and analytics. DATAMAXIS helps organizations use data to make informed decisions, minimize cyber risks, and digitize business processes. The company offers data engineering, data governance, business intelligence, data monetization, cloud solutions, and strategic staffing services. With expertise in both traditional and modern data architectures, DATAMAXIS supports various industries including insurance, automobile, and government sectors. They are also known for their cyber security analytics solutions which help protect against intrusions and data loss, while complying with security requirements for government organizations.

📋 Description

• Design and build robust, reusable, parameter-driven ingestion and transformation pipeline using Azure Data Factory, Synapse Pipelines, Data Bricks and/or Microsoft Fabric Data Factory. • Implement medallion architecture (Bronze / Silver / Gold) on Azure Data Lake Storage Gen2 using Delta Lake, Parquet, and structured streaming patterns. • Build performant ELT workflows that leverage pushdown to source systems (Synapse Dedicated SQL Pool, Azure SQL, Teradata) where appropriate. • Develop and optimize PySpark notebooks and jobs on Azure Databricks or Synapse Spark. • Design dimensional models (Kimball star/snowflake) and data vault patterns for analytics consumption. • Implement Slowly Changing Dimensions (Type 1/2/3), Change Data Capture, and late-arriving data patterns. • Tune distributed SQL workloads in Synapse Dedicated SQL Pool / Fabric Warehouse, including distribution keys, partitioning, and clustered column store indexes. • Implement CI/CD for data pipelines using Azure DevOps (YAML pipelines, ARM/Bicep/Terraform) across Dev / SIT / UAT / Prod environments. • Instrument pipelines with robust logging, auditing, and monitoring using Azure Monitor, Log Analytics, and KQL. • Define and enforce coding standards, code review practices, branching strategies, and release management. • Lead or contribute to legacy-to-cloud migrations — e.g., Informatica PowerCenter to Azure Data Factory, on-premises Teradata / Oracle / SQL Server to Synapse or Fabric. • Perform workload assessment, capacity planning, and cost modeling for target-state architectures. • Production incident response for critical pipelines.

🎯 Requirements

• Deep hands-on expertise with Azure Data Factory: pipelines, datasets, linked services, triggers, parameterization, mapping data flows, and all three Integration Runtime types (Azure, Self hosted, SSIS). • Strong Experience in Data Bricks and PySpark. • Production experience with one or more of: Azure Synapse Analytics (Dedicated and Serverless SQL Pools, Spark Pools) OR Azure Databricks (Delta Lake, Unity Catalog) OR Microsoft Fabric (Warehouse, Lakehouse, OneLake). • Strong working knowledge of Azure Data Lake Storage Gen2 (hierarchical namespace, RBAC + ACLs, lifecycle management, security). • Experience with Azure Key Vault, Azure AD / Entra ID (including managed identities and service principals), and private networking (VNet integration, private endpoints). • Monitoring and troubleshooting with Azure Monitor, Log Analytics, and KQL. • Advanced SQL — window functions, CTEs, query optimization, execution plan analysis, performance tuning. • Strong Python for data engineering — pandas, PySpark, REST API integration, unit testing (pytest). • Proficient in T-SQL; familiarity with Spark SQL, KQL, PowerShell, and Bash shell scripting. • 5+ years of data warehouse development experience. • 5+ years of data modeling experience using ERWIN or similar tools. • 2+ years of experience with Azure Data Factory and Snowflake. • Medicaid Domain Knowledge is a plus.

🏖️ Benefits

• Health insurance • 401(k) matching • Flexible work hours • Professional development opportunities