Senior/Principal Local LLM & Generative AI Platform Engineer

🕒 il y a 1 mois

🇺🇸 États-Unis – Télétravail

⏰ Temps Plein

🟠 Senior

🏗️ Ingénieur Plateforme

🗣️🇺🇸🇬🇧 Anglais requis

D'où vient cette offre

Publiée sur la page carrières de Parallel Wireless, pas via un site d'emploi

Repérée par Remote Rocketship il y a 1 mois

Toujours ouverte sur le site de Parallel Wireless. Vérifiée il y a 2 heures.

Logo of Parallel Wireless

Parallel Wireless

501 - 1000 employés

Fondée en 2012

📡 Télécommunications

🔧 Matériel

Telecommunications • Hardware

Parallel Wireless est une entreprise technologique qui révolutionne les solutions d'infrastructure sans fil innovantes grâce à sa technologie OpenRAN. L'entreprise se concentre sur la fourniture de réseaux sans fil rentables et flexibles couvrant toutes les générations de réseaux, du 2G au 5G. Parallel Wireless vise à aider les opérateurs mobiles en fournissant une couverture dans les zones urbaines, suburbaines et rurales, tout en améliorant la capacité et la performance à l'aide d'approches basées sur le cloud et pilotées par logiciel. Grâce à leur technologie OpenRAN, ils peuvent déployer des réseaux macro, Massive MIMO et Small Cell, offrant des capacités 5G avancées et facilitant la migration et la mise à niveau technologique. Connue pour réduire les complexités et les coûts opérationnels, Parallel Wireless permet une gestion de réseau dynamique et automatisée ainsi que des analyses. Leur mission consiste à promouvoir des solutions sans fil modernes qui assurent un accès étendu et équitable à une connectivité avancée dans le monde entier.

Description

• Own the architecture and technical roadmap for a secure, reliable, and maintainable local LLM platform deployed in Parallel Wireless-controlled infrastructure • Partner with engineering, product, support, IT, information security, legal, and domain experts to prioritize high-value use cases and translate them into measurable product and platform requirements • Build a modular inference and model-gateway layer with stable APIs, model routing, streaming, concurrency controls, quotas, and interchangeable models or serving backends • Evaluate open-weight language, code, embedding, reranking, and multimodal models against company-specific tasks; document provenance, licenses, limitations, security posture, hardware needs, and total cost of ownership • Optimize serving across CPU, GPU, and accelerator resources using continuous batching, caching, parallelism, quantization, and right-sized context limits • Design and operate RAG and enterprise-search pipelines for approved repositories, wikis, tickets, standards, design documents, test results, logs, and support content • Enforce source-system permissions throughout ingestion and retrieval; integrate identity, SSO, RBAC, secrets management, and audit logging • Establish versioned evaluation datasets and automated offline and online evaluation for retrieval quality, groundedness, factual accuracy, citation quality, code correctness, task completion, latency, safety, and refusal behavior • Create release gates and reproducible regression tests; support canary releases, rollback, and approval paths • Implement end-to-end observability for model and agent workflows, including traces, errors, latency, throughput, queue time, resource utilization, saturation, availability, and user feedback • Design safe tool-calling and agent workflows with least-privilege access, sandboxing, validation, bounded execution, human approval, and traceability • Integrate the platform with developer environments, source-control and CI workflows, knowledge systems, ticketing systems, and internal applications through SDKs, APIs, and reference implementations • Build production foundations including CI/CD, configuration and model registries, backups, disaster recovery, capacity planning, vulnerability management, incident response, and lifecycle policies • Protect proprietary and personal information through network isolation, encryption, retention controls, redaction, secure logging, and defenses against prompt injection, data poisoning, unsafe output handling, and model-supply-chain risks • Determine when prompting or retrieval improvements suffice and when fine-tuning, distillation, or other adaptation is justified • Enable adoption through documentation, examples, training, office hours, telemetry, and structured feedback • Communicate architecture decisions, quality evidence, risk, capacity, and roadmap tradeoffs to technical and business stakeholders

🎯 Exigences

• BSc or MSc in Computer Science, Computer Engineering, Electrical Engineering, Data Science, or a related field, or equivalent practical experience • Typically 7+ years of hands-on experience in production software, ML platform, search, data, or infrastructure engineering, including meaningful recent experience shipping LLM-powered systems; exceptional candidates with equivalent depth are welcome • Strong Python engineering skills and experience designing maintainable APIs, services, libraries, and data pipelines • Strong understanding of transformer-based language models and production inference, including tokenization, context management, batching, KV caching, parallelism, quantization, structured output, tool calling, and common model failure modes • Demonstrated experience building production RAG or enterprise-search systems using embeddings, vector and/or lexical search, metadata filtering, reranking, source attribution, and systematic retrieval evaluation • Experience defining task-specific LLM evaluations using representative datasets, strong baselines, domain-expert review, automated metrics, human feedback, error analysis, and regression thresholds • Experience deploying and operating containerized services on Linux using Docker and Kubernetes or an equivalent orchestration environment • Practical experience with GPU-backed model serving, performance profiling, capacity planning, monitoring, and reliability engineering • Strong knowledge of distributed-system fundamentals, authentication and authorization, API security, secrets handling, encryption, auditability, and data lifecycle controls • Experience with Git, automated testing, CI/CD, infrastructure as code, observability, and production incident response • Experience with Go, Java, or C/C++ is an advantage • Experience operating LLMs in on-premises, private-cloud, restricted-network, or air-gapped environments is nice to have • Experience with inference runtimes and serving systems such as vLLM, SGLang, TensorRT-LLM, llama.cpp, Ray Serve, KServe, or Triton is nice to have • Experience optimizing inference on NVIDIA and/or AMD GPUs using CUDA, ROCm, profiling tools, tensor parallelism, pipeline parallelism, speculative decoding, prefix/KV caching, or related techniques is nice to have • Experience with model and experiment registries, LLM tracing and evaluation platforms, vector databases, hybrid-search engines, and production data-orchestration frameworks is nice to have • Experience with LoRA/QLoRA, dataset curation, synthetic-data generation, distillation, and post-training evaluation is nice to have • Experience building code intelligence, repository-aware assistants, developer tools, or IDE and CI integrations for large C/C++ and Python codebases is nice to have • Familiarity with Active Directory or another enterprise identity provider, fine-grained document authorization, data-loss prevention, secure software supply chains, model licensing, and AI governance is nice to have • Experience red-teaming LLM or agent systems is nice to have • Knowledge of telecommunications, 3GPP, RAN/Open RAN, cloud-native network functions, or technical-support workflows is nice to have • Contributions to relevant open-source AI, search, MLOps, or infrastructure projects are nice to have

Postuler Maintenant

📊 Vérifiez votre score de CV pour ce poste

Améliorez vos chances d'obtenir un entretien en vérifiant votre score de CV avant de postuler.

Emplois Similaires

🕒 il y a 1 mois

AIS (Applied Information Sciences)

501 - 1000

💼 Conseil

🏥 Santé

🛡️ Assurance

AI Foundry Platform Engineer building and operating secure Azure Government AI platforms for enterprise clients. Automating deployments, networking, identity, monitoring, and governance.

🇺🇸 États-Unis – Télétravail

💵 $117 000 - $177 000 / an

⏰ Temps Plein

🟡 Intermédiaire

🟠 Senior

🏗️ Ingénieur Plateforme

🗣️🇺🇸🇬🇧 Anglais requis

🕒 il y a 1 mois

OnePay

501 - 1000

💳 Fintech

🏦 Banque

₿ Crypto

Quality Platform Engineer building scalable test automation infrastructure for OnePay’s consumer fintech platform. Improving testing coverage, observability, and deployment confidence across web, mobile, and backend teams.

🇺🇸 États-Unis – Télétravail

💵 $150 000 - $220 000 / an

💰 €300 000 000 Series unknown en 2025-01

⏰ Temps Plein

🟡 Intermédiaire

🟠 Senior

🏗️ Ingénieur Plateforme

🦅 Parrain de Visa H1B

infoinfo

🗣️🇺🇸🇬🇧 Anglais requis

🕒 il y a 1 mois

MedAdvisor Solutions US

201 - 500

🏥 Santé

💼 Conseil

⚕️ Assurance santé

AI Platform Engineer building Adheris’s greenfield healthcare platform from the ground up. Applying production engineering and agentic AI tools alongside engineering leadership.

🇺🇸 États-Unis – Télétravail

💵 $135 000 - $150 000 / an

⏰ Temps Plein

🟡 Intermédiaire

🟠 Senior

🏗️ Ingénieur Plateforme

🗣️🇺🇸🇬🇧 Anglais requis

🕒 il y a 1 mois

LottieFiles

51 - 200

📣 Marketing

💼 Conseil

Senior Platform Engineer building LottieFiles’ federated GraphQL gateway, gRPC, and authentication services. Improving developer experience, observability, scalability, and platform reliability.

🇺🇸 États-Unis – Télétravail

💰 €37 000 000 Series B en 2022-05

⏰ Temps Plein

🟠 Senior

🏗️ Ingénieur Plateforme

🗣️🇺🇸🇬🇧 Anglais requis

🕒 il y a 1 mois

General Dynamics Information Technology

10 000+ employés

💼 Conseil

🏥 Santé

📦 Logistique

Databricks Platform Engineer building and governing cloud data platforms for GDIT’s U.S. federal courts modernization program. Automating pipelines, security, observability, and performance.

🗣️🇺🇸🇬🇧 Anglais requis

Développé par Lior Neu-ner. J'aimerais beaucoup recevoir vos retours — contactez-moi en DM ou par e-mail support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok