Senior Big Data Engineer

🔥 13 hours ago

🌽 Illinois – Remote

🌽 Illinois – Remote

💵 $160.5k - $200k / year

⏰ Full Time

🟠 Senior

🚰 Data Engineer

Apply Now

Find Similar Remote Jobs

Receive Emails For Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Circana

WebsiteLinkedInAll Job Openings

5001 - 10000 employees

At Circana, we measure and accelerate demand. It’s that simple. We partner with brands to address their toughest business challenges through a combination of our big data, AI data-visualization platform, and deep expertise across more than 25 industries. Our clients count on us to guide them on their next steps, and the steps after that, so they can innovate, meet consumer demand, and grow.

📋 Description

• Senior Big Data Engineer responsible for designing, building, and delivering scalable big data and ETL solutions. • Support projects at various and unanticipated client worksites throughout the U.S. • Work closely with cross-functional teams to develop, test, and deploy data solutions. • Design and implement highly scalable ETL applications on Hadoop and Big Data ecosystems. • Develop new scripts, tools, and methodologies for ETL workflows. • Deliver big data projects using Spark, Python, Scala, SQL, and Hive. • Prepare technical design documents for solutions and write well-documented code.

🎯 Requirements

• Bachelor’s degree in Computer Science or Information Systems or Computer Engineering or any Engineering or related field plus 5 years of progressive experience as a Software Engineer/Developer or in Software Development required. • experience writing ETL Spark applications in PySpark or Scala • spark architecture, data frames, tuning spark • relational databases (Oracle, PostgreSQL) • Python, SQL HQL, Hive • Data Bricks • managing software systems using Hadoop, MapReduce, HDFS and all included services • experience with distributed computing principles • Big Data querying tools (Hive) • data-warehousing & data-modeling techniques • Core Java, Linux, SQL, scripting languages • Cloud platforms (Azure) • integration of data from multiple data sources • Lambda Architecture.

🏖️ Benefits

• paid time off • medical/dental/vision insurance • 401(k)