AI Engineer

Job not on LinkedIn

πŸ•’ October 27

πŸ‡ΊπŸ‡Έ United States – Remote

⏰ Full Time

🟑 Mid-level

πŸ€– AI Engineer

Where this job comes from

Posted on Insight Softmax Consulting's careers page β†—Insight Softmax Consulting's careers page, not through a job board

First seen by Remote Rocketship October 27

Still open on Insight Softmax Consulting's site. Checked 1 hour ago.

Apply Now
Logo of Insight Softmax Consulting

Insight Softmax Consulting

11 - 50 employees

Founded 2016

πŸ’Ό Consulting

πŸ€– Artificial Intelligence

🀝 B2B

Consulting β€’ Artificial Intelligence β€’ B2B

Insight Softmax Consulting is a data-focused consulting firm that combines data science, software engineering, and high-performance computing to solve business and research problems end-to-end. They emphasize defining business problems first and then delivering solutions in data analytics, AI/ML (including generative AI and LLM training), and last-mile HPC infrastructure (cloud-native HPC, accelerated computing for CFD and advanced scientific workloads). The company also offers open-source expertise and services to make powerful compute and AI capabilities accessible to enterprises and research organizations. Offices are listed in San Francisco, USA and ZΓΌrich, Switzerland.

πŸ“‹ Description

β€’ Deploy and operate LLM inference services on Kubernetes and bare-metal GPU clusters β€’ Implement model serving, autoscaling, GPU scheduling and performance tuning β€’ Build and operate AI gateway and routing layers with tenant keys, model pools, quotas, rate limits, caching, failover and usage metrics β€’ Implement RAG pipelines, agentic workflows, evaluation harnesses and customer-facing APIs β€’ Write production-quality Python services and infrastructure automation β€’ Instrument AI services for observability, including latency, throughput, token and cost accounting, and quality signals β€’ Run benchmarks and load tests and convert results into tuning changes and capacity recommendations β€’ Integrate AI services with customer identity, security and data systems β€’ Document deployments and hand over runbooks to customer and internal operations teams β€’ Support pre-sales, internal platform work and knowledge sharing β€’ Work directly in customer environments and deliver deployable systems, documentation and automation

🎯 Requirements

β€’ At least 4 years of software or platform engineering experience β€’ At least 2 years building and running LLM or ML services in production β€’ Hands-on experience with at least one inference server, such as vLLM, TensorRT-LLM, Triton or llm-d β€’ Experience running GPU workloads on Kubernetes β€’ Strong Python skills; ability to build services, CLIs and tested automation β€’ Working knowledge of Kubernetes, containers, Helm and GitOps workflows β€’ Strong Linux skills β€’ Deep knowledge of AWS, GCP or Azure; AWS preferred β€’ Experience with LLM application patterns including prompt and context management, retrieval, tool use, structured output and evaluation β€’ Ability to work independently inside a customer environment and communicate progress clearly β€’ Three references required

πŸ–οΈ Benefits

β€’ Remote work environment β€’ Occasional US travel opportunities for customer workshops, platform bring-up and go-live β€’ Pre-sales support, internal platform work and knowledge-sharing time β€’ Full-time position

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ•’ October 26

Zscaler

5001 - 10000

πŸ”’ Cybersecurity

☁️ SaaS

🏒 Enterprise

Sr. Staff Applied AI Engineer shaping GTM AI strategy and deploying secure, production-grade solutions. Zscaler operates a global Zero Trust cloud security platform.

πŸ‡ΊπŸ‡Έ United States – Remote

πŸ’΅ $180k - $225k / year

πŸ’° Secondary Market on 2017-11

⏰ Full Time

🟑 Mid-level

🟠 Senior

πŸ€– AI Engineer

πŸ•’ October 26

Sharecare

1001 - 5000

πŸ₯ Healthcare

πŸ’Ό Consulting

πŸ“£ Marketing

AI Engineer building agentic AI, machine learning, and data platforms for Sharecare's digital healthcare products. Owning safe, auditable systems that support patient care and enterprise workflows.

πŸ•’ October 23

ACT

501 - 1000

πŸ“š Education

🏒 Enterprise

🀝 Non-profit

Senior software engineer using AI coding tools to modernize ACT’s education and assessment platforms. Owning end-to-end delivery and advancing responsible AI development practices.

πŸ•’ October 22

Supermove

11 - 50

☁️ SaaS

πŸš— Transport

🏒 Enterprise

Forward Deployed Engineer deploying and improving AI agents for Supermove’s moving-company software platform. Building integrations, workflows, and production capabilities for enterprise customers.

πŸ•’ October 22

CDW

10,000+ employees

πŸ’Ό Consulting

πŸ₯ Healthcare

πŸ“š Education

AI networking consulting engineer implementing and validating InfiniBand, Ethernet, and RoCE fabrics for CDW clients. Supporting GPU clusters and distributed AI infrastructure.

πŸ‡ΊπŸ‡Έ United States – Remote

πŸ’΅ $77.3k - $108.3k / year

πŸ’° Post-IPO Equity on 2015-07

⏰ Full Time

🟑 Mid-level

🟠 Senior

πŸ€– AI Engineer

Built byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok