AI Architect

Job not on LinkedIn

🕒 October 21

🇺🇸 United States – Remote

⏰ Full Time

🟠 Senior

🔴 Lead

🤖 AI Engineer

Where this job comes from

Posted on Insight Softmax Consulting's careers page ↗Insight Softmax Consulting's careers page, not through a job board

First seen by Remote Rocketship October 21

Still open on Insight Softmax Consulting's site. Checked 10 hours ago.

Apply Now
Logo of Insight Softmax Consulting

Insight Softmax Consulting

11 - 50 employees

Founded 2016

💼 Consulting

🤖 Artificial Intelligence

🤝 B2B

Consulting • Artificial Intelligence • B2B

Insight Softmax Consulting is a data-focused consulting firm that combines data science, software engineering, and high-performance computing to solve business and research problems end-to-end. They emphasize defining business problems first and then delivering solutions in data analytics, AI/ML (including generative AI and LLM training), and last-mile HPC infrastructure (cloud-native HPC, accelerated computing for CFD and advanced scientific workloads). The company also offers open-source expertise and services to make powerful compute and AI capabilities accessible to enterprises and research organizations. Offices are listed in San Francisco, USA and Zürich, Switzerland.

📋 Description

• Lead technical discovery with customers and translate business goals into AI platform architectures, phased roadmaps and effort estimates • Design inference serving platforms on Kubernetes and bare metal, including model serving, GPU scheduling and partitioning, autoscaling, multi-tenancy and capacity planning • Design AI gateway and routing layers with tenant-aware routing, model pools, budgets and quotas, rate limiting, observability and multi-site failover • Define reference architectures for multi-tenant GPU clouds, sovereign and air-gapped deployments, and hybrid cloud and on-premises estates • Advise on AI usage governance, including cost visibility, token accounting, audit, data handling and security posture for LLM services • Evaluate and recommend build, buy or compose decisions across open-source and commercial AI infrastructure components • Prototype, validate assumptions in a lab and review implementations delivered by AI and platform engineers • Own the technical quality of project outcomes • Represent Insight Softmax in customer architecture reviews, partner enablement sessions and executive readouts • Support pre-sales scoping and estimates • Reserve time each week for pre-sales support, internal platform work and mentoring

🎯 Requirements

• At least 8 years in infrastructure, platform or ML engineering • At least 3 years designing and operating production AI or ML platforms at scale • Hands-on experience deploying LLM inference in production, including tensor and pipeline parallelism, batching, caching and performance tuning • Deep understanding of NVIDIA and AMD accelerators, drivers and runtimes, GPU scheduling on Kubernetes, high-speed interconnects and storage for AI workloads • Experience designing AI gateway or API management layers • Strong Kubernetes and Linux skills; able to read and debug the stack from the scheduler down to the node • Deep knowledge of at least one of AWS, GCP, or Azure; preferably AWS • Track record of leading architecture engagements with enterprise customers, including writing proposals, estimates and architecture documents that engineers can execute against • Clear written and spoken communication with both engineers and executives • 3 references will be required • Optional: Experience at an AI lab, AI-native company, neocloud, or building platform products for them • Optional: Multi-tenant GPU cloud design, Slurm or other batch schedulers, RAG, agentic systems, model evaluation, fine-tuning pipelines, air-gapped or FIPS deployments, Spectro Cloud Palette and PaletteAI, Run:ai, observability for AI services • Bonus: Python, Go or Rust; software engineering background; published talks, blog posts or open source contributions in AI infrastructure; using Linux as a primary desktop workstation environment

🏖️ Benefits

• Remote work environment • Occasional travel to customer sites in the US for architecture workshops, load tests and go-live reviews

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 October 20

Netflix

10,000+ employees

📱 Media

👥 B2C

Software Engineer building Netflix’s AI Platform for model creation, experimentation, and deployment. Developing ML tooling with researchers and data scientists at a global streaming service.

🇺🇸 United States – Remote

💵 $466k - $750k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

🤖 AI Engineer

🕒 October 20

Mysten Labs

51 - 200

🌐 Web 3

🎮 Gaming

₿ Crypto

Product Lead turning Mysten Labs’ AI-agent and blockchain infrastructure into customer-ready products. Driving discovery, prototyping, validation, commercialization, and go-to-market strategy.

🇺🇸 United States – Remote

💵 $185k - $270k / year

💰 Series B on 2022-09

⏰ Full Time

🔴 Lead

🤖 AI Engineer

🕒 October 20

Cornelis Networks

51 - 200

🤖 Artificial Intelligence

🔧 Hardware

🏢 Enterprise

Principal embedded firmware engineer architecting secure RISC-V firmware for Cornelis Networks’ AI/HPC networking silicon. Building trusted boot, engine bring-up, updates, and verification infrastructure.

🇺🇸 United States – Remote

💰 $29M Series B on 2022-11

⏰ Full Time

🔴 Lead

🤖 AI Engineer

🕒 October 20

Future

1001 - 5000

💼 Consulting

📣 Marketing

✈️ Travel

Applied AI Engineer building and deploying production LLM agents for Future’s personalized health platform. Improving AI reliability, evaluation, latency, and cost for real users.

🇺🇸 United States – Remote

💵 $215k - $250k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

🤖 AI Engineer

🕒 October 20

Speechify

51 - 200

🏥 Healthcare

🏨 Hospitality

📚 Education

Software Engineer building scalable audio-data pipelines for Speechify’s text-to-speech products. Improving datasets and data-processing systems for next-generation AI model training.

🇺🇸 United States – Remote

💵 $140k - $200k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

🤖 AI Engineer

Developed by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok