Data Engineer, Databricks

Vaga não está no LinkedIn

🕒 Março 20

Candidatar-se

Encontrar Vagas Remotas Similares

Receber Emails de Vagas Remotas

📊 Verifique sua pontuação de currículo para esta vaga

Melhore suas chances de conseguir uma entrevista verificando sua pontuação de currículo antes de se candidatar.

Enviar Currículo

Horizon Industries, Limited

SiteLinkedInTodas as Vagas

201 - 500 funcionários

Fundada em 1996

🤝 B2B

☁️ SaaS

🔒 Cibersegurança

B2B • SaaS • Cybersecurity

Horizon Industries, Limited é uma corporação de serviços de TI e consultoria de gestão que oferece um ciclo completo de suporte através da análise de estratégia empresarial, desenvolvimento e implementação de sistemas de negócios e suporte operacional. A empresa foca em capacidades de transformação digital aproveitando sua expertise em Automação de Processos Robóticos (RPA) e Inteligência Artificial (IA), oferecendo soluções personalizadas para atender às necessidades únicas de seus clientes. A Horizon Industries é comprometida com a qualidade, utilizando princípios de gestão estabelecidos como CMMI e ISO, e oferece serviços que incluem suporte de TI, gestão de programas e soluções de cibersegurança nos EUA e internacionalmente.

Descrição

• Build end-to-end implementation of multiple ETL/ELT pipelines, demonstrating efficient data transformation and ingest patterns to move raw data from data producers to an enterprise data ecosystem, with a focus on performance and reliability • Assess and understand the ETL jobs, workflows, BI tools, and reports • Address technical inquiries concerning customization, integration, enterprise architecture and general feature / functionality of data products • Experience in crafting database / data warehouse solutions in the cloud (Preferably AWS, Azure, Alternatively GCP) • Key must have skill sets – Python, SQL, Databricks, AWS Data Services • Experience with message queuing, stream processing, and highly scalable ‘big data’ data stores • Experience manipulating, processing, and extracting value from large, disconnected datasets • Experience manipulating structured and unstructured data for analysis • Experience with data modeling tools and processes • Experience aggregating and transforming data from multiple datasets to create data products • Support an Agile software development lifecycle

🎯 Requisitos

• Ability to hold a position of public trust with the US government. • S. in Computer Science or equivalent • 4+ years' experience in data engineering and big data. At least 2 years' of professional services experience interacting directly with clients. • Big data tools: Hadoop, Spark, Kafka, etc. • Relational SQL and NoSQL databases and experience working with relational databases • AWS cloud services: EC2, S3, RDS, Glue, Step Functions, Lamda, EMR, DynamoDB, DocumentDB, Redshift, Aurora, Athena • Data Platforms: Databricks • Data streaming systems: Batch,Kafka, Storm, Spark-Streaming, etc. • Languages: Python, R, Scala, Go • Ability to inspect existing data pipelines, discern their purpose and functionality, and re-implement them efficiently in Databricks. • Extensive knowledge of data warehousing concepts and hands-on experience deploying pipelines using Databricks **a must • Data modeling and database design skills and knowledge of version control • Excellent verbal and written communication skills • Experience architecting scalable and fault-tolerant data solutions across Azure, AWS, and Databricks • Databricks Data Engineer Professional certification a plus. • Preference for candidates with Databricks Professional certifications

🏖️ Benefícios

• A comprehensive benefits package including healthcare (medical, dental, vision and disability) • a 401k program where you are 100% vested from day one with an employer match after 90 days. • an Educational Assistance program. • a Student Loan Repayment Program • Gym Reimbursement Program. • Paid Time off • Dynamics, passionate, multi-disciplinary team of creative minds to work with, and many more.