AI Platform Architect

🔥 5 hours ago

🇺🇸 United States – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

🔙 Backend Engineer

👻 Ghost score 10%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

NewRocket

WebsiteLinkedInAll Job Openings

501 - 1000 employees

💼 Consulting

🏥 Healthcare

🛡️ Insurance

Consulting • Healthcare • Insurance

NewRocket is a top global ServiceNow partner, providing a wide range of services and solutions to help enterprise leaders solve complex business problems. They specialize in advisory and transformation services, design and implementation, managed services, and more, focusing on improving customer and employee experiences through the use of the ServiceNow platform. Their solutions include platforms and integrations, security, risk, and resilience, as well as technology excellence. NewRocket serves a variety of industries including education, healthcare, financial services, and the public sector, among others, and is known for their expertise in UI and UX design as well as their ability to enhance workflows and improve business processes efficiently.

📋 Description

• Design, build, deploy, and maintain scalable platform capabilities for enterprise AI, machine learning, LLM, RAG, and agentic AI applications • Create reusable reference architectures, infrastructure patterns, deployment templates, integration components, and engineering standards • Build secure integrations with the Anthropic API, Claude models, enterprise data, APIs, workflow systems, and authorized tools • Establish and operate CI/CD pipelines, LLMOps/MLOps capabilities, evaluation frameworks, monitoring, and lifecycle management • Manage cloud infrastructure, infrastructure-as-code, containers, Kubernetes, serverless services, identity, access, security, logging, and disaster recovery • Build data-ingestion, transformation, indexing, retrieval, and RAG pipelines • Implement responsible AI safeguards, observability, tracing, governance, auditability, and compliance controls • Build integrations between AI platforms, ServiceNow, enterprise APIs, identity providers, workflow tools, and line-of-business systems • Collaborate with AI Architects, engineers, data teams, ServiceNow teams, product engineering, and client stakeholders • Provide technical guidance, contribute to playbooks and documentation, and convert recurring client requirements into reusable platform features • Participate in technical discovery, architecture reviews, demos, implementation planning, and customer workshops • Support production operations, incident response, troubleshooting, root-cause analysis, capacity planning, and service-level monitoring

🎯 Requirements

• 5+ years of experience in platform engineering, cloud engineering, DevOps, software engineering, data engineering, systems integration, or related technical roles • Hands-on experience with AWS, Microsoft Azure, and/or Google Cloud Platform • Strong experience with CI/CD, Git-based workflows, automated testing, infrastructure as code, and production release processes • Experience with Docker, Kubernetes, serverless services, or comparable cloud-native platforms • Proficiency in Python, JavaScript/TypeScript, Java, Go, Bash, or similar programming and scripting languages • Experience designing and consuming REST APIs and implementing authentication and authorization patterns • Hands-on experience with LLM-powered applications, generative AI services, AI/ML platforms, RAG systems, or AI workflow automation • Familiarity with prompt and context engineering, token management, embeddings, vector search, RAG, structured outputs, tool use/function calling, evaluations, and model monitoring • Experience with logging, metrics, tracing, alerting, and incident management • Strong knowledge of cloud security, identity and access management, secrets management, network security, and secure software-development practices • Experience with relational databases, NoSQL databases, data warehouses, object storage, search platforms, or vector databases • Strong problem-solving, troubleshooting, communication, and documentation skills • Ability to work effectively in a fast-paced, collaborative, customer-oriented environment • Bachelor’s degree in Computer Science, Engineering, Information Systems, Data Science, or a related technical discipline; equivalent relevant professional experience will be considered

🏖️ Benefits

• Diverse and inclusive workplace • Equal opportunity workplace and affirmative action employer • Disability accommodation support