Data Engineer

🔥 2 minutes ago

🇺🇸 United States – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

🚰 Data Engineer

👻 Ghost score 10%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Illumination Works

WebsiteLinkedInAll Job Openings

51 - 200 employees

Founded 2006

💼 Consulting

📦 Logistics

📣 Marketing

Consulting • Logistics • Marketing

Illumination Works is a company focused on digital transformation and data innovation, specializing in solving complex data challenges and providing actionable insights for better decision-making. The firm excels in data engineering, data science, and software and cloud engineering, offering a range of solutions from machine learning and natural language processing to data visualization and predictive analytics. By prioritizing user-centric design and innovation, Illumination Works helps organizations harness the power of their data to drive efficiency and unlock new business opportunities.

📋 Description

• Develop, maintain, and enhance data pipelines using Python, SQL, and Databricks • Develop and maintain Databricks notebooks supporting data ingestion, transformation, and delivery • Design and maintain data tables, schemas, and Delta Lake structures for analytics and data science requirements • Work closely with data scientists to understand data requirements and modify pipelines, tables, and data structures as needs evolve • Develop complex SQL queries using joins, aggregations, window functions, and other advanced techniques • Integrate and transform data from multiple structured and semi-structured data sources • Support data quality through validation, troubleshooting, and resolution of data issues • Optimize data pipelines, SQL queries, and data structures for performance • Document data sources, transformations, data flows, schemas, and pipeline configurations • Collaborate with data scientists, engineers, analysts, and business stakeholders to deliver data solutions supporting mission requirements

🎯 Requirements

• 4+ years of experience as a Data Engineer or in a similar data-focused role • Advanced SQL skills, including complex joins, aggregations, window functions, and transformations • Proficiency with Python for data engineering and transformation • Hands-on experience with Databricks, including development and maintenance of notebooks and data pipelines • Experience developing and maintaining ETL/ELT pipelines and data integration workflows • Experience with Delta Lake • Experience with database design, data modeling, schema development, and data-centric documentation • Experience integrating and transforming data from multiple data source types • Experience troubleshooting data issues and optimizing queries and pipelines • Strong analytical and problem-solving skills • Excellent verbal and written communication skills and ability to collaborate effectively with technical and business stakeholders • Bachelor's degree in Computer Science, Mathematics, Data Science, Engineering, or a comparable academic discipline • Must hold an active Secret clearance with eligibility for Top Secret • U.S. Citizenship required • Must successfully pass required background screening and drug testing • Preferred: Experience supporting data scientists and advanced analytics or machine learning use cases • Preferred: Functional knowledge of Department of Defense, War, or U.S. Air Force data sources and systems • Preferred: Experience working with logistics, supply chain, maintenance, or other operational data • Preferred: CompTIA Security+ certification • Preferred: Top Secret clearance

🏖️ Benefits

• Market-competitive salary • Generous PTO package • Comprehensive medical insurance • Dental insurance • Vision insurance • Life insurance • 401K • Short-term disability insurance • Long-term disability insurance • Fun and engaging culture • Training opportunities to keep you up to speed on the latest technologies