NEAR AI
11 - 50 employees
Founded 2017
🤖 Artificial Intelligence
🔒 Cybersecurity
🏢 Enterprise
Artificial Intelligence • Cybersecurity • Enterprise
NEAR AI is a privacy-first AI infrastructure company that runs confidential inference and autonomous AI agents for enterprises, governments, and AI applications. Its NEAR AI Cloud and IronClaw agent framework execute models and workflows inside hardware-enforced Trusted Execution Environments (TEEs) with cryptographic isolation, zero operator access, and hardware-signed attestation for independent verification. NEAR AI offers a turnkey platform for deploying private models, automating repetitive operations, integrating with internal tools (Slack, email, Notion), and serving regulated or sovereign workloads via a marketplace of agents for finance, legal, ops, research and security.
LLM Inference Engineer
🔥 0 minutes ago
📊 Check your resume score for this job
Improve your chances of getting an interview by checking your resume score before you apply.
NEAR AI
11 - 50 employees
Founded 2017
🤖 Artificial Intelligence
🔒 Cybersecurity
🏢 Enterprise
Artificial Intelligence • Cybersecurity • Enterprise
NEAR AI is a privacy-first AI infrastructure company that runs confidential inference and autonomous AI agents for enterprises, governments, and AI applications. Its NEAR AI Cloud and IronClaw agent framework execute models and workflows inside hardware-enforced Trusted Execution Environments (TEEs) with cryptographic isolation, zero operator access, and hardware-signed attestation for independent verification. NEAR AI offers a turnkey platform for deploying private models, automating repetitive operations, integrating with internal tools (Slack, email, Notion), and serving regulated or sovereign workloads via a marketplace of agents for finance, legal, ops, research and security.
📋 Description
• Architect and maintain production high-traffic LLM serving systems. • Optimize throughput, latency, and cost for leading open-source LLMs.
🎯 Requirements
• Strong hands-on experience in LLM inference, with expertise debugging and optimizing major inference engines such as SGLang, vLLM, or TensorRT. • Deep knowledge of state-of-the-art GPU architectures, and effectively exploit them using PyTorch, Triton, CuTe, CUDA, etc. • Proven track record in designing and maintaining end-to-end high-traffic LLM serving systems. • Strong problem-solving skills and ability to communicate technical ideas clearly.
Apply NowSimilar Jobs
🔥 6 hours ago
Senior Machine Learning Engineer specializing in NLP and LLM-powered models at Call Box. Lead the design and deployment of scalable AI-driven solutions in an exciting collaborative environment.
AWS
Azure
Cloud
Docker
Google Cloud Platform
Kubernetes
Python
PyTorch
Tensorflow
🔥 23 hours ago
AI/ML Research Engineer designing and implementing LLM training and evaluation pipelines. Collaborating with technical teams to improve foundation model performance at Innodata.
Python
PyTorch
Tensorflow
🕒 Yesterday
Co-Founder / CEO responsible for launching and scaling AI Infrastructure startups in a supportive environment. Engage with experienced entrepreneurs while developing a high-growth venture.
🇺🇸 United States – Remote
💰 $34.2M Series A - EWOR on 2025-04
⏰ Full Time
🟡 Mid-level
🟠 Senior
🗣️ LLM Engineer
🕒 Yesterday
Co-Founder / CCO leading an AI Infrastructure startup backed by experienced entrepreneurs. Building startup with coaching and funding support to reach significant revenues.
🇺🇸 United States – Remote
💰 $34.2M Series A - EWOR on 2025-04
⏰ Full Time
🟡 Mid-level
🟠 Senior
🗣️ LLM Engineer
🕒 5 days ago
Senior Software Engineer II at Honeycomb.io building observability solutions for AI workloads with tech stack in Go and React. Collaborating across teams to enhance product features with clear communication.
React
TypeScript
