Senior Data Engineer – AWS, Databricks

Job not on LinkedIn

🕒 2 days ago

⚜️ Louisiana – Remote

⚜️ Louisiana – Remote

💵 $111.2k - $150.4k / year

⏰ Full Time

🟠 Senior

☁️ Cloud Engineer

👻 Ghost score 19%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

LouisianaNOW.Jobs

WebsiteLinkedInAll Job Openings

51 - 200 employees

🎯 Recruiter

🏪 Marketplace

Recruitment • Marketplace

LouisianaNOW. Jobs is a regional jobs portal and talent attraction site focused on connecting job seekers to employers and economic opportunities across Louisiana. The site highlights regional communities, industry sectors, current employers who are hiring, career advice articles, and job listings, and appears to be operated or supported by LED FastStart (Louisiana Economic Development). It’s positioned as a marketplace that promotes Louisiana’s growing industries and helps match talent with local openings and employer investment announcements.

📋 Description

• Develop and implement a scalable, secure, cloud-based data platform supporting operational data, reporting, and analytics • Align data platforms with federal security requirements, judiciary architecture standards, data governance policies, and modernization initiatives • Engineer multi-tenant cloud environments supporting hybrid/on-premises systems and multiple database architectures • Produce and maintain dimensional data models for data marts and data products • Develop and maintain downstream data marts, consumable data, ETL/ELT processes, reports, and dashboards • Create and maintain STTMs, data models, design documents, testing documents, runbooks, workflows, and other technical documentation • Develop, deploy, and maintain data presentations and reports using customer-selected visualization tools • Support the Data and Technology Enabler Roadmap across data engineering, reporting/analytics, and AI/ML use cases • Design and develop data ingestion and ETL/ELT pipelines for enterprise sources and near-real-time or batch workloads • Implement reusable data services supporting analytics, reporting, downstream data marts, and gold layers • Collaborate with architects to implement logical and physical data models in cloud platforms such as Databricks • Develop secure, testable, high-quality code • Support CMM Data Classification Standards through workshops, security controls, metadata requirements, and system integration • Configure metadata structures, workflows, automation, security settings, ingestion processes, and catalog attributes • Create training, job aids, and communications for user adoption • Integrate pipelines with cloud services, messaging, and storage components • Implement data quality checks, validations, and error handling • Optimize pipeline performance, scalability, and cost efficiency • Support CI/CD deployments, automated testing, and promotion across environments • Participate in code reviews, design reviews, and sprint ceremonies • Resolve incidents and perform root cause analysis for pipeline failures • Ensure deliverables meet federal security, governance, and audit requirements • Operate in an Agile federal delivery environment across multiple scrum teams • Collaborate with architects, DBAs, business analysts, and QA personnel • Execute data migration, archival, and disaster recovery strategies with Data Architecture, Data Governance, and Migration teams • Deliver migration documentation for scripts, transformations, and validation results • Support failover testing and disaster recovery drills • Implement operational databases, document storage, indexing services, schemas, and secure data APIs using infrastructure as code

🎯 Requirements

• Required: Bachelor’s degree in Data Science or closely-related discipline • 5+ years of specialized experience with AWS Cloud and Databricks • Deep, hands-on experience with core AWS data storage, compute, and serverless tools • Deep, hands-on experience with Databricks, Apache Spark, and Delta Lake • Advanced proficiency in Python, PySpark, SQL, and data transformation techniques • Proficiency with ETL/ELT frameworks • Familiarity with Git, containerization, CI/CD, and data governance frameworks such as Unity Catalog • Hands-on experience building enterprise-scale data pipelines • Experience with streaming or near-real-time data ingestion • Familiarity with data governance, metadata, and classification standards • Experience with system security best practices • Experience building and migrating software and IT services to align with strategic business needs and goals • Experience researching advanced technologies to support business needs • Experience identifying and applying industry tools, solutions, methods, best practices, and emerging technologies • Familiarity with Agile/Scrum delivery environments • Experience working in regulated or compliance-driven environments • Excellent presentation and communication skills • Consultant mindset and ability to work with high-level customer stakeholders • Strong analytical and problem-solving skills • Ability to work effectively independently and as part of a team • Experience mentoring junior data engineers • Must pass a background check to obtain Public Trust • Must provide onsite fingerprinting at a designated facility • Must be a US Person: Green Card Holder, US Permanent Resident Alien, Refugee, Asylee, or US Citizen • Preferred certifications: Databricks Certified Data Professional, AWS Certified Data Analytics - Specialty, AWS Certified Solutions Architect - Professional, or AWS Certified Data Engineer

🏖️ Benefits

• AI-powered career tool identifying career steps and learning opportunities • Internal mobility team supporting career goals • Comprehensive benefits and wellness packages • 401(k) with company match • Competitive pay • Paid time off, including vacation, sick, personal time, holidays, paid parental, military, bereavement, and jury duty leave • 15 days of paid leave per calendar year for new employees • 10 paid holidays per year • Up to 160 hours of paid family leave in a rolling 12-month period for eligible employees • Medical plan options, including plans with Health Savings Accounts • Dental plan options • Vision plan • Short- and long-term disability benefits • Life insurance • Accidental death and dismemberment insurance • Personal accident insurance • Critical illness insurance • Business travel and accident insurance • Full flex work weeks where possible • Award-winning culture of innovation • Military-friendly workplace

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume