AI Platform Architect

🔥 12 hours ago

🇺🇸 United States – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

🔙 Backend Engineer

👻 Ghost score 10%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

NewRocket

WebsiteLinkedInAll Job Openings

501 - 1000 employees

💼 Consulting

🏥 Healthcare

🛡️ Insurance

Consulting • Healthcare • Insurance

NewRocket is a top global ServiceNow partner, providing a wide range of services and solutions to help enterprise leaders solve complex business problems. They specialize in advisory and transformation services, design and implementation, managed services, and more, focusing on improving customer and employee experiences through the use of the ServiceNow platform. Their solutions include platforms and integrations, security, risk, and resilience, as well as technology excellence. NewRocket serves a variety of industries including education, healthcare, financial services, and the public sector, among others, and is known for their expertise in UI and UX design as well as their ability to enhance workflows and improve business processes efficiently.

📋 Description

• Design, build, deploy, and maintain scalable platform capabilities for enterprise AI, machine learning, LLM, RAG, and agentic AI applications • Create reusable reference architectures, infrastructure patterns, deployment templates, integration components, and engineering standards • Build secure integrations with the Anthropic API, Claude models, enterprise data, APIs, workflow systems, and authorized tools • Establish CI/CD, LLMOps, MLOps, versioning, testing, release-management, rollback, monitoring, evaluation, and lifecycle-management practices • Support production AI services through incident response, troubleshooting, root-cause analysis, capacity planning, and service-level monitoring • Design and manage cloud infrastructure across AWS, Microsoft Azure, Google Cloud Platform, or client-approved environments • Implement infrastructure as code, containerized deployments, identity and access controls, security, privacy, logging, auditing, vulnerability management, disaster recovery, and business continuity • Build secure data-ingestion, transformation, indexing, retrieval, RAG, vector-search, and enterprise data-integration pipelines • Implement responsible AI safeguards, observability, tracing, output validation, source attribution, approval gates, and human-in-the-loop workflows • Build integrations between AI platforms, ServiceNow, enterprise APIs, identity providers, workflow tools, collaboration platforms, and line-of-business systems • Provide technical guidance and collaborate with AI Architects, AI/ML Engineers, Data Engineers, Product Engineering, ServiceNow developers, consultants, and client technology teams • Contribute to playbooks, runbooks, reference architectures, technical documentation, reusable modules, demos, architecture reviews, and customer workshops • Productionize Claude-powered and other enterprise AI solutions for secure, scalable, observable, governed use

🎯 Requirements

• 5+ years of experience in platform engineering, cloud engineering, DevOps, software engineering, data engineering, systems integration, or related technical roles • Hands-on experience designing and deploying cloud-native applications and services on AWS, Microsoft Azure, and/or Google Cloud Platform • Strong experience with CI/CD, Git-based workflows, automated testing, infrastructure as code, and production release processes • Experience with Docker, Kubernetes, serverless services, or comparable cloud-native platforms • Proficiency in Python, JavaScript/TypeScript, Java, Go, Bash, or similar programming and scripting languages • Experience designing and consuming REST APIs, integrating enterprise applications, and implementing authentication and authorization patterns • Hands-on experience with LLM-powered applications, generative AI services, AI/ML platforms, RAG systems, AI workflow automation, or related technologies • Familiarity with prompt and context engineering, token management, embeddings, vector search, RAG, structured outputs, tool use/function calling, evaluations, and model monitoring • Experience with logging, metrics, tracing, alerting, and incident management • Strong knowledge of cloud security, identity and access management, secrets management, network security, and secure software-development practices • Experience with relational databases, NoSQL databases, data warehouses, object storage, search platforms, or vector databases • Ability to work effectively in a fast-paced, collaborative, customer-oriented environment • Bachelor’s degree in Computer Science, Engineering, Information Systems, Data Science, or a related technical discipline; equivalent relevant professional experience will be considered • Preferred qualifications include hands-on Claude, Anthropic API, MCP, LLM frameworks, MLOps, vector databases, Kubernetes operations, ServiceNow, consulting, professional services, enterprise architecture, or client-facing technical delivery experience

🏖️ Benefits

• Diverse and inclusive workplace • Equal opportunity workplace and affirmative action employer • Disability accommodations available upon request • Relevant certifications in cloud platforms, Kubernetes, DevOps, security, data engineering, ServiceNow, AI/ML, or Anthropic technologies are a plus