Unison Consulting
Specialists in Risk Management Consulting, Technology Consulting and Products(Risk Insight and Risk Analytics)
Fermat ALM Implementation • Risk Management Systems Integerators • EDW and DWH • Risk MIS System implementations • Risk Insight
201 - 500
Data Engineer with Python /Pyspark
December 21, 2023
Loading...
Unison Consulting
Specialists in Risk Management Consulting, Technology Consulting and Products(Risk Insight and Risk Analytics)
Fermat ALM Implementation • Risk Management Systems Integerators • EDW and DWH • Risk MIS System implementations • Risk Insight
201 - 500
Description
• Develop and implement data pipelines for ingesting and collecting data from various sources into a centralized data platform. • Develop and maintain ETL jobs using AWS Glue services to process and transform data at scale. • Optimize and troubleshoot AWS Glue jobs for performance and reliability. • Utilize Python and PySpark to efficiently handle large volumes of data during the ingestion process. • Proficiency in Python and PySpark. • Strong knowledge of data engineering concepts and best practices. • Hands-on experience with AWS Glue and other AWS services. • Experience with big data technologies and distributed computing. • Familiarity with database management systems (SQL and NoSQL). • Understanding of ETL processes and data modeling. • Excellent problem-solving and analytical skills. • Strong communication and collaboration skills. • Bachelor's degree in Computer Science, Information Technology, or a related field.
Requirements
• Develop and implement data pipelines for ingesting and collecting data from various sources into a centralized data platform. • Develop and maintain ETL jobs using AWS Glue services to process and transform data at scale. • Optimize and troubleshoot AWS Glue jobs for performance and reliability. • Utilize Python and PySpark to efficiently handle large volumes of data during the ingestion process. • Proficiency in Python and PySpark. • Strong knowledge of data engineering concepts and best practices. • Hands-on experience with AWS Glue and other AWS services. • Experience with big data technologies and distributed computing. • Familiarity with database management systems (SQL and NoSQL). • Understanding of ETL processes and data modeling. • Excellent problem-solving and analytical skills. • Strong communication and collaboration skills. • Bachelor's degree in Computer Science, Information Technology, or a related field.
Benefits
• Remote work • Full time
Apply Now
