Senior AI Infrastructure Engineer

Job not on LinkedIn

🔥 1 hour ago

Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of TRM Labs

TRM Labs

201 - 500 employees

Founded 2018

₿ Crypto

📋 Compliance

🤝 B2B

Crypto • Compliance • B2B

TRM Labs is a blockchain intelligence company that provides transaction-monitoring, forensics, and compliance solutions for businesses and public-sector organizations dealing with cryptocurrencies. Their platform and products (examples: Compliance360, Investigation360, Seizure360, Supervision360, BlockInt API, MCP, wallet screening, Know-Your-Asset) help banks, crypto firms, regulators, law enforcement, and tax authorities detect, investigate, and block illicit crypto activity, support seizures, and meet AML/CTF and supervision requirements. TRM also offers training and certification (TRM Academy) and professional services such as incident response and capacity development.

📋 Description

• Build reusable CI/CD workflows for model training, evaluation, and deployment — integrating Langfuse, GitHub Actions, and experiment tracking, etc. • Automate model versioning, approval workflows, and compliance checks across environments. • Build out a modular and scalable AI infrastructure stack — including vector databases, feature stores, model registries, and observability tooling. • Partner with engineering and data science to embed AI models and agents into real-time applications and workflows. • Continuously evaluate and integrate state-of-the-art AI tools (e.g. LangChain, LlamaIndex, vLLM, MLflow, BentoML, etc.). • Drive AI reliability and governance, enabling experimentation while ensuring compliance, security, and uptime. • Build and enhance AI/ML Model Performance • Ensure data accuracy, consistency and reliability, leading to better model training and inferencing • Deploy infrastructure to support offline and online evaluation of LLMs and agents — including regression testing, cost monitoring, and human-in-the-loop workflows. • Enable researchers to iterate quickly by providing sandboxes, dashboards, and reproducible environments.

🎯 Requirements

• Write **high-quality, maintainable software** — primarily in Python, but we value engineering ability over language familiarity. • Have a strong background in **scalable infrastructure** including: • Containerization and orchestration (e.g. Docker, Kubernetes) • Infrastructure-as-code and deployment (e.g. Terraform, CI/CD pipelines) • Monitoring and logging frameworks (e.g. Datadog, Prometheus, OpenTelemetry) • Understand and implement **ML Ops best practices**, including: • Model versioning and rollback strategies • Automated evaluation and drift detection • Scalable model and agent serving infrastructure (e.g. vLLM, Triton, BentoML) • Deploy and maintain **LLM and agentic workflows** in production including: • Monitoring cost, latency, and performance • Capturing traces for analysis and debugging • Optimizing prompt/response flows with real-time data access • Demonstrate **strong ownership and pragmatism**, balancing infrastructure elegance with iterative delivery and measurable impact.

🏖️ Benefits

• TRM’s equity plan • flexible work arrangements • competitive benefits • wellness programs

Apply Now

Similar Jobs

🔥 1 hour ago

Restate

2 - 10

☁️ SaaS

🏢 Enterprise

🔌 API

Senior Cloud Infrastructure Engineer owning the infrastructure platform for Restate. Working on cloud infrastructure, distributed systems, and platform engineering in a fully remote position.

🇺🇸 United States – Remote

💵 $200k - $250k / year

💰 $7M Seed Round - Restate on 2024-06

⏰ Full Time

🟠 Senior

👷 Infrastructure Engineer

Cloud

Kubernetes

Rust

Terraform

Go

🔥 2 hours ago

Vesta

51 - 200

💳 Fintech

☁️ SaaS

🤝 B2B

Software Engineer scaling infrastructure for Vesta, a next-generation mortgage system. Building reliable systems for engineering velocity and platform reliability.

🇺🇸 United States – Remote

💵 $200k - $240k / year

💰 $30M Series A - Vesta on 2022-01

⏰ Full Time

🟡 Mid-level

🟠 Senior

👷 Infrastructure Engineer

AWS

Cloud

Docker

Google Cloud Platform

Kubernetes

Postgres

Terraform

Go

🔥 2 hours ago

vCluster

51 - 200

☁️ SaaS

🏢 Enterprise

AI Infrastructure Engineer managing GPU infrastructure and Kubernetes for client projects at vCluster Labs. Deploying scalable solutions while engaging with customers during the technical setup.

🇺🇸 United States – Remote

💵 $150k - $200k / year

💰 $24M Series A on 2024-05

⏰ Full Time

🟡 Mid-level

🟠 Senior

👷 Infrastructure Engineer

Distributed Systems

Kubernetes

Node.js

Python

Go

🔥 2 hours ago

Qualified Health

51 - 200

🏥 Healthcare

🤖 Artificial Intelligence

☁️ SaaS

Cloud / Infrastructure Engineer responsible for provisioning Azure environments for healthcare. Work with data modernization practice creating cloud infrastructure for AI applications.

🇺🇸 United States – Remote

💵 $160k - $210k / year

💰 $30M Seed on 2025-02

⏰ Full Time

🟡 Mid-level

🟠 Senior

👷 Infrastructure Engineer

Azure

Cloud

DNS

Firewalls

Terraform

🔥 4 hours ago

Pilot.com

51 - 200

💸 Finance

🤝 B2B

☁️ SaaS

Senior Software Engineer focused on building and maintaining infrastructure at Pilot. Collaborating with teams to ensure efficient and scalable development processes.

AWS

Python

Terraform