Senior Big Data Engineer

🕒 June 30

🌽 Illinois – Remote

🌽 Illinois – Remote

💵 $160.5k - $200k / year

⏰ Full Time

🟠 Senior

🚰 Data Engineer

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Circana

WebsiteLinkedInAll Job Openings

5001 - 10000 employees

🤝 B2B

💼 Consulting

B2B • Consulting

Circana is a market research company that specializes in measuring and accelerating demand for brands. They utilize big data and an AI data-visualization platform to tackle complex business challenges, guiding clients through innovation and meeting consumer demand. With over a century of combined experience from their legacy as IRI and NPD, Circana serves more than 7,000 global brands and retailers, providing insights into both online and in-store purchasing behavior. Their expertise is recognized by prominent media outlets including Bloomberg, CNBC, and The New York Times.

📋 Description

• Senior Big Data Engineer responsible for designing, building, and delivering scalable big data and ETL solutions. • Support projects at various and unanticipated client worksites throughout the U.S. • Work closely with cross-functional teams to develop, test, and deploy data solutions. • Design and implement highly scalable ETL applications on Hadoop and Big Data ecosystems. • Develop new scripts, tools, and methodologies for ETL workflows. • Deliver big data projects using Spark, Python, Scala, SQL, and Hive. • Prepare technical design documents for solutions and write well-documented code.

🎯 Requirements

• Bachelor’s degree in Computer Science or Information Systems or Computer Engineering or any Engineering or related field plus 5 years of progressive experience as a Software Engineer/Developer or in Software Development required. • experience writing ETL Spark applications in PySpark or Scala • spark architecture, data frames, tuning spark • relational databases (Oracle, PostgreSQL) • Python, SQL HQL, Hive • Data Bricks • managing software systems using Hadoop, MapReduce, HDFS and all included services • experience with distributed computing principles • Big Data querying tools (Hive) • data-warehousing & data-modeling techniques • Core Java, Linux, SQL, scripting languages • Cloud platforms (Azure) • integration of data from multiple data sources • Lambda Architecture.

🏖️ Benefits

• paid time off • medical/dental/vision insurance • 401(k)