Solution Architect – Databricks

Job not on LinkedIn

🔥 0 minutes ago

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Allwyn Corporation

WebsiteLinkedInAll Job Openings

51 - 200 employees

Founded 2003

🤖 Artificial Intelligence

🏢 Enterprise

🤝 B2B

Artificial Intelligence • Enterprise • B2B

Allwyn Corporation is a US-headquartered technology consulting and services firm focused on helping organizations modernize IT and leverage data to drive operational efficiency. The company offers AI & Machine Learning, data analytics and business intelligence, enterprise applications, IT modernization, agile software delivery, low-code development, offshore delivery, and SATCOM engineering services. Allwyn positions itself as a partner for public-sector and utility leaders seeking digital transformation and cites customer success (e. g. , IBTS) for modernizing government-facing applications. Headquarters are in Herndon, VA with offices in New York and an offshore delivery center in Hyderabad, India.

📋 Description

• Design end-to-end cloud-native data architectures using AWS and Databricks • Architect scalable batch and real-time data processing solutions using Apache Kafka and streaming technologies • Lead the design and implementation of enterprise data engineering pipelines and data platforms • Define architecture standards, best practices, and governance for data integration and analytics solutions • Collaborate with business stakeholders to translate business requirements into scalable technical solutions • Provide technical leadership and architectural guidance to development teams throughout the SDLC • Optimize data pipelines for performance, scalability, security, and cost efficiency • Design data models and integration strategies for structured and semi-structured data • Ensure solutions adhere to enterprise security, compliance, and reliability standards • Evaluate emerging technologies and recommend innovative solutions to improve business capabilities • Support cloud migration and modernization initiatives • Mentor engineers and conduct architecture and design reviews

🎯 Requirements

• 8+ years of experience in software, data engineering, or solution architecture • Strong experience designing enterprise data platforms on AWS • Hands-on expertise with Databricks and the Lakehouse architecture • Experience implementing Apache Kafka for real-time event streaming • Strong background in Data Engineering, including ETL/ELT pipeline development • Experience building scalable real-time and streaming data processing solutions • Strong understanding of distributed systems and cloud architecture principles • Experience with SQL, Python, or Scala • Knowledge of CI/CD, Infrastructure as Code, and cloud-native development practices • Excellent communication and stakeholder management skills • Databricks Certified Data Engineer Professional • Experience with AI/ML platforms or deploying machine learning solutions into production is preferred • Experience with Delta Lake, Spark Structured Streaming, or similar technologies is preferred • AWS Certification (Solutions Architect or Data Analytics) is preferred • Experience with Terraform, Kubernetes, or Docker is a plus