Senior Engineering Manager – Accelerated Compute Memory Systems

Job not on LinkedIn

October 9

🗽 New York – Remote

Although this job is listed in New York, this company may be open to hiring remote in other states.

⏰ Full Time

🟠 Senior

👮‍♀️ Software Engineering Manager

Apply Now

Receive Emails with Similar Jobs

Pryon

WebsiteLinkedInAll Job Openings

Artificial Intelligence • Enterprise • Technology

Pryon is an innovative company specializing in artificial intelligence solutions for enterprises. They offer a suite of tools such as their Ingestion Engine, Retrieval Engine, and Generative Engine, which are designed to transform large quantities of data into structured, retrievable information. Their tools can be paired with Generative LLMs to enhance retrieval-augmented generation, providing accurate and instant answers. Pryon serves diverse sectors, including technology, energy, defense, government, and non-profit organizations, improving efficiency and decision-making processes. By leveraging AI, Pryon reduces information retrieval times and enhances organizational responsiveness and resilience.

51 - 200 employees

🤖 Artificial Intelligence

🏢 Enterprise

💰 Series A on 2023-01

📋 Description

• Build and lead a team delivering the ingestion, retrieval, and inference layers that will power mission-critical deployments for commercial and federal entities with millions of public users. • Architect and deliver horizontally scalable, fault-tolerant systems capable of handling billions of documents and burst loads of 30K+ concurrent users. • Guide implementation of multimodal ingestion pipelines (eg PDF, HTML, DOCX, JSON, XML, PPTX, TIFF). • Oversee design and optimization of LLM-driven data ingestion and retrieval workflows. • Own optimization and tuning of high-throughput, low-latency production environments via async orchestration frameworks. • Establish performance benchmarking, compliance frameworks, and automated testing for scale. • You will balance technical leadership with people leadership, guiding architecture decisions, while also scaling and mentoring a high-performing team. • Collaborate cross-functionally with Product, Executive Leadership, and Customer Success.

🎯 Requirements

• 10+ years in software engineering, 5+ years in management roles with large-scale AI/ML systems and infrastructure. • Expert-level proficiency in Python and Golang, with 5+ years building production distributed systems. • Experience with orchestration frameworks (Kubernetes, Ray, Dask). • Proficiency with vector databases (Pinecone, Weaviate, Qdrant, or similar). • Experience with message queuing systems (Kafka, Pulsar, RabbitMQ). • In-depth knowledge and hands on experience building scalable distributed architectures and high-performance compute systems. • Proven experience in multimodal ingestion pipelines within RAG platforms. • Direct experience in designing, fine-tuning, and optimizing LLMs for ingestion and retrieval workloads. • Previous success managing engineering teams delivering production-grade, HPC-scale RAG systems. • Deep understanding of infra domains: compute, storage, networking, observability, security, disaster recovery, and cost management. • Familiarity with HPC cluster management softwares such as Slurm. • Familiarity with cloud platforms (AWS, Azure, GCP) and/or on-prem datacenter operations.

🏖️ Benefits

• Remote first organization • 100% Company paid Health/Dental/Vision benefits for you and your dependents • Life Insurance, Short-term and Long-term Disability • 401k • Unlimited PTO