AWS Data Engineer

Job not on LinkedIn

December 27, 2024

🤠 Texas – Remote

Although this job is listed in Texas, this company may be open to hiring remote in other states.

⏰ Full Time

🟡 Mid-level

🟠 Senior

🚰 Data Engineer

Apply Now

Receive Emails with Similar Jobs

Scalepex

WebsiteLinkedInAll Job Openings

B2B • HR Tech • Artificial Intelligence

Scalepex is a minority-owned company that specializes in talent solutions to help businesses scale and achieve their strategic goals. Leveraging a combination of creativity, strategy, and execution, Scalepex uses a unique AI platform to enhance the quality of talent, providing staffing and placement services to industries such as technology, finance, healthcare, and more. Their approach focuses on individualized support, cost management, and strategic consultation across areas like mergers and acquisitions, software development, data enablement, and more. With a strong emphasis on social responsibility, Scalepex aims to connect underserved communities with world-class opportunities, ensuring both client success and personal and professional satisfaction for their team members.

51 - 200 employees

🤝 B2B

👥 HR Tech

🤖 Artificial Intelligence

📋 Description

• Why Scalepex? • Scalepex is a dynamic services firm specializing in providing solutions for premium brands. • Join the Innovation Frontier at Scalepex! • We are seeking an experienced AWS Data Engineer with a strong background in building scalable data solutions and expertise in utilities-related datasets. • The ideal candidate will have at least 5 years of experience in data engineering, • design, develop, and optimize data pipelines to support analytics in the utilities industry. • Key Responsibilities • Develop scalable pipelines using AWS services (e.g., Glue, S3, Redshift) to process large datasets. • Use AWS Step Functions to orchestrate workflows across data pipelines; experience with Airflow is acceptable. • Implement ETL/ELT processes using PySpark, Python, and Pandas. • Ensure reliability, scalability, and performance in handling large-scale utility data. • Use AWS Lambda functions to build serverless solutions. • Design data models tailored for utilities use cases. • Monitor and improve the performance of data pipelines. • Implement robust security measures to protect sensitive utility data.

🎯 Requirements

• Minimum of 5 years of experience in data engineering • Proficiency in AWS services such as Step Functions, Lambda, Glue, S3, DynamoDB, and Redshift. • Strong programming skills in Python with experience using PySpark and Pandas for large-scale data processing. • Hands-on experience with distributed systems and scalable architectures. • Knowledge of ETL/ELT processes for integrating diverse datasets into centralized systems. • Familiarity with utilities-specific datasets (e.g., smart meters, energy grids) is highly desirable. • Strong analytical skills with the ability to work on unstructured datasets. • Knowledge of data governance practices to ensure accuracy, consistency, and security of data. • Strong experience in AWS data engineering • Ability to work independently • Ability to work with a cross-functional teams, including interfacing and communicating with business stakeholders • Professional oral and written communication skills • Strong problem solving and troubleshooting skills with experience exercising mature judgement • Excellent teamwork and interpersonal skills • Ability to obtain and maintain the required clearance for this role