AI Platform Engineer-Anthropic-US East

• AI Platform Engineer-Anthropic
• AI Foundry | New Rocket

Location

• [Location / Hybrid / Remote]
• Travel based on client and business needs
• Reports to: Global AI Center of Excellence Lead / AI Platform Architect
• About New Rocket

New Rocket is the AI-first Elite Service Now Partner that activates real value on the Now Platform.

As a trusted advisor to enterprise leaders, we combine industry expertise, human-centered design, and enterprise-grade AI to help organizations navigate change and scale with confidence.

With two decades of experience guiding clients to realize the full potential of the Service Now AI Platform, New Rocket is one of the largest pure-play Service Now partners.

We are uniquely focused on enabling enterprises to adopt AI they trust—AI that delivers lasting business value.

New Rocket is proud to be an Anthropic partner/vendor.

Through this relationship, we are expanding our ability to help enterprise clients responsibly design, deploy, and scale AI solutions powered by Claude and other leading AI technologies.

Our AI Foundry teams apply Anthropic-aligned practices across prompt and context engineering, retrieval-augmented generation (RAG), agentic workflows, tool use, structured outputs, model evaluation, security, governance, and human-in-the-loop controls.

We #Go Beyond Workflows to create new kinds of experiences for our customers.

Come join our Crew!

Role Overview

New Rocket is seeking an experienced AI Platform Engineer to build, operate, and continuously improve the technical foundations that enable secure, reliable, scalable enterprise AI solutions.

This role combines cloud engineering, platform engineering, Dev Ops, MLOps/LLMOps, data-platform integration, and applied AI engineering.

The AI Platform Engineer will work closely with AI Architects, Forward Deployed AI Engineers, data engineers, Service Now teams, product engineering, and customer stakeholders to create reusable platforms, deployment patterns, controls, and operational capabilities for New Rocket’s Anthropic and enterprise AI business.

You will help establish the infrastructure and engineering practices required to move AI solutions from prototype to governed production use.

This includes enabling Claude and other LLM-powered applications; supporting RAG and agentic workflows; integrating enterprise data and tools; implementing observability and evaluation; and maintaining strong security, privacy, and governance controls.

The ideal candidate is a hands‑on engineer who is comfortable working across cloud infrastructure, APIs, CI/CD, data systems, containers, AI application frameworks, and enterprise security requirements.

You are equally motivated by building reusable internal capabilities and solving practical customer‑delivery challenges.

Key Responsibilities

• AI Platform Architecture & Engineering
• Design, build, deploy, and maintain scalable platform capabilities that support enterprise AI, machine learning, LLM, RAG, and agentic AI applications.
• Create reusable reference architectures, infrastructure patterns, deployment templates, integration components, and engineering standards for New Rocket’s AI Foundry.
• Build platform capabilities that enable AI applications to securely connect to enterprise data, APIs, workflow systems, and authorized tools.
• Partner with AI Architects and Forward Deployed AI Engineers to translate client needs into reliable, supportable technical platform designs.
• Support the technical evolution of New Rocket’s AI intellectual property, including the New Rocket Intelligence Platform, Data Intelligence Platform, Value Realization Dashboard, Agent Packs, and reusable AI accelerators.
• Evaluate and recommend cloud, data, AI, observability, orchestration, and security technologies that improve delivery speed, quality, scalability, and cost efficiency.
• Anthropic, Claude & LLM Platform Enablement
• Build and maintain secure, reusable integrations with the Anthropic API, Claude models, and other approved AI services.
• Enable LLM-powered applications through standardized patterns for authentication, model access, prompt and context management, structured outputs, tool use, logging, error handling, and rate‑limit management.
• Support Claude-based enterprise use cases involving document analysis, knowledge assistance, workflow automation, agentic task execution, summarization, classification, and decision support.
• Develop technical patterns for long‑context workflows, document processing, RAG, structured data extraction, and model‑driven automation.
• Support secure Model Context Protocol (MCP) and comparable tool‑integration patterns that allow AI applications to access approved enterprise systems and data safely.
• Stay current on Anthropic platform capabilities, product releases, security guidance, technical enablement, and responsible AI practices.
• Complete relevant Anthropic partner training and enablement as available and help translate learning into reusable New Rocket engineering standards.
• LLMOps, MLOps & AI Operations
• Establish and operate CI/CD pipelines for AI applications, model configurations, prompts, evaluation assets, infrastructure, and integration services.
• Implement versioning, testing, release‑management, rollback, and change‑control practices for AI solutions.
• Build and maintain LLMOps and MLOps capabilities, including model/prompt configuration management, evaluation pipelines, deployment automation, monitoring, and lifecycle management.
• Develop automated evaluation and regression‑testing frameworks to measure AI quality before and after releases.
• Support production operations for AI services, including incident response, troubleshooting, root‑cause analysis, capacity planning, and service‑level monitoring.
• Define and monitor operational metrics such as availability, latency, throughput, token consumption, model cost, tool‑call success rates, task‑completion rates, and error rates.
• Improve platform reliability, performance, resilience, and cost efficiency through automation, tuning, and operational improvements.
• Cloud Infrastructure, Dev Ops & Security
• Design and manage cloud infrastructure across AWS, Microsoft Azure, Google Cloud Platform, or client‑approved environments.
• Build and maintain infrastructure using infrastructure‑as‑code tools such as Terraform, Cloud Formation, Bicep, Pulumi, or comparable technologies.
• Implement containerized application and AI‑service deployments using Docker, Kubernetes, serverless services, and cloud‑native application patterns.
• Develop secure CI/CD workflows using Git‑based source control, automated testing, artifact management, secrets management, and policy controls.
• Implement identity, access, and authentication patterns, including role‑based access control, least‑privilege access, API security, service accounts, and credential rotation.
• Partner with security, compliance, and client teams to ensure AI platforms align with enterprise security, privacy, regulatory, and data‑residency requirements.
• Implement logging, monitoring, auditing, vulnerability management, disaster‑recovery, and business‑continuity practices for production AI services.
• Data Platform & RAG Enablement
• Build and support secure data‑ingestion, transformation, indexing, and retrieval pipelines for enterprise AI applications.
• Design platform patterns for RAG, including document ingestion, parsing, chunking, metadata enrichment, embeddings, vector stores, hybrid search, retrieval, reranking, and source attribution.
• Integrate AI applications with structured and unstructured enterprise data sources, including databases, data warehouses, document repositories, knowledge bases, Service Now, and third‑party Saa S platforms.
• Work with data engineers to establish data‑quality, lineage, cataloging, permissions, retention, and governance practices that support trustworthy AI.
• Enable appropriate data‑access controls so AI solutions retrieve and process only data the requesting user or service is authorized to access.
• Support data platforms and technologies such as Snowflake, Databricks, Postgre SQL, Mongo DB, Elasticsearch/Open Search, vector databases, and cloud storage services, as appropriate.
• Responsible AI, Governance & Observability
• Implement technical controls that support responsible, secure, and governable AI deployments.
• Build safeguards for sensitive‑data handling, data masking, content filtering, prompt injection, unsafe tool use, unauthorized access, and unintended agent behavior.
• Enable grounding, output validation, source attribution, confidence thresholds, fallback behavior, approval gates, and human‑in‑the‑loop workflows.
• Implement AI observability and tracing across prompts, model calls, retrieval pipelines, tool execution, workflow outcomes, latency, errors, costs, and user feedback.
• Partner with AI Architects and governance stakeholders to document platform standards, risk controls, operating procedures, and solution limitations.
• Support auditability and compliance requirements through appropriate logging, retention, access reviews, and operational documentation.
• Enterprise Integration & Service Now Enablement
• Build and maintain integration patterns between AI platforms, Service Now, enterprise APIs, identity providers, workflow tools, collaboration platforms, and line‑of‑business systems.
• Support technical enablement for Service Now AI and workflow experiences, including Integration Hub, Flow Designer, Virtual Agent, Now Assist, AI Agents, APIs, and knowledge‑management capabilities where applicable.
• Develop secure APIs, middleware services, event‑driven integrations, and automation components that support AI‑enabled workflows.
• Collaborate with Forward Deployed AI Engineers to troubleshoot complex client integrations and transition successful engagement solutions into reusable platform components.
• Collaboration & Technical Leadership
• Work closely with AI Architects, AI/ML Engineers, Data Engineers, Product Engineering, Service Now developers, Business Process Consultants, and client technology teams.
• Provide technical guidance on AI platform engineering, cloud architecture, Dev Ops, LLMOps, data integration, performance, and security best practices.
• Contribute to internal playbooks, runbooks, reference architectures, technical documentation, reusable modules, and knowledge‑sharing sessions.
• Identify recurring client requirements and convert them into scalable, productized platform features and accelerators.
• Participate in technical discovery, architecture reviews, demos, implementation planning, and customer workshops as needed.
• What Success Looks Like in the First 6 Months
• Establish or enhance reusable, secure deployment patterns for Claude‑powered and other enterprise AI applications.
• Deliver reliable cloud, integration, data, and observability capabilities that support multiple AI Foundry client engagements.
• Implement CI/CD, infrastructure‑as‑code, monitoring, and LLMOps practices that improve deployment speed, quality, and operational maturity.
• Enable secure RAG, tool‑use, and agentic AI patterns that integrate effectively with Service Now and enterprise ecosystems.
• Help productionize AI solutions through robust testing, evaluation, governance, access controls, and operational support practices.
• Contribute reusable platform components, reference architectures, and playbooks to the New Rocket Intelligence Platform, Data Intelligence Platform, and Agent Pack ecosystem.
• Build trusted working relationships across New Rocket engineering, delivery, product, AI, and client teams.
• Required Qualifications
• 5+ years of experience in platform engineering, cloud engineering, Dev Ops, software engineering, data engineering, systems integration, or related technical roles.
• Hands‑on experience designing and deploying cloud‑native applications and services on AWS, Microsoft Azure, and/or Google Cloud Platform.
• Strong experience with CI/CD, Git‑based workflows, automated testing, infrastructure as code, and production release processes.
• Experience with containerization and orchestration technologies such as Docker, Kubernetes, serverless services, or comparable cloud‑native platforms.
• Proficiency in Python, Java Script/Type Script, Java, Go, Bash, or similar programming and scripting languages.
• Experience designing and consuming REST APIs, integrating enterprise applications, and implementing authentication and authorization patterns.
• Hands‑on experience with LLM‑powered applications, generative AI services, AI/ML platforms, RAG systems, AI workflow automation, or related technologies.
• Familiarity with LLM application concepts, including prompt and context engineering, token management, embeddings, vector search, RAG, structured outputs, tool use/function calling, evaluations, and model monitoring.
• Experience with observability tools and practices, including logging, metrics, tracing, alerting, and incident management.
• Strong knowledge of cloud security, identity and access management, secrets management, network security, and secure software‑development practices.
• Experience working with data systems such as relational databases, No SQL databases, data warehouses, object storage, search platforms, or vector databases.
• Strong problem‑solving, troubleshooting, communication, and documentation skills.
• Ability to work effectively in a fast‑paced, collaborative, customer‑ oriented environment.
• Preferred Qualifications
• Anthropic & AI Platform Experience
• Hands‑on experience with Claude, the Anthropic API, Anthropic Console, Claude Code, or Anthropic technical guidance.
• Completion of Anthropic Academy learning, partner enablement, technical training, or equivalent Claude implementation experience.
• Experience with Model Context Protocol (MCP), secure tool integrations, agent gateways, or comparable methods for connecting AI applications to enterprise systems.
• Experience with LLM application frameworks and orchestration tools such as Lang Chain, Lang Graph, Llama Index, Semantic Kernel, Open AI Agents SDK, or comparable technologies.
• Experience implementing LLM evaluation, prompt/version management, AI tracing, guardrails, and AI observability platforms.
• Experience operating model gateways, API gateways, or AI‑service routing layers.
• MLOps, Data & Cloud Engineering
• Experience with MLOps platforms and tools such as MLflow, Sage Maker, Vertex AI, Azure Machine Learning, Databricks, Kubeflow, or comparable services.
• Experience with data engineering, ETL/ELT, streaming, data‑quality testing, data‑catalog capabilities.
• Experience with vector databases and enterprise search technologies such as Pinecone, Weaviate, pgvector, Open Search, Azure AI Search, or similar platforms.
• Experience with Terraform, Pulumi, Cloud Formation, Bicep, Helm, Argo CD, Git Hub Actions, Git Lab CI/CD, Azure Dev Ops, Jenkins, or comparable tooling.
• Experience with Kubernetes operations, service meshes, API management, event‑driven architecture, and microservices.
• Familiarity with Fin Ops practices and optimization of cloud, model, inference, storage, and data‑processing costs.
• Service Now & Enterprise Delivery
• Experience with Service Now architecture, development, integrations, platform operations, or workflow automation.
• Familiarity with Service Now APIs, Integration Hub, Flow Designer, Virtual Agent, Now Assist, AI Agents, CMDB, knowledge management, and enterprise data‑integration patterns.
• Experience working in consulting, professional services, enterprise architecture, or client‑facing technical delivery environments.

Education

• Bachelor’s degree in Computer Science, Engineering, Information Systems, Data Science, or a related technical discipline; equivalent relevant professional experience will be considered.
• Relevant certifications in cloud platforms, Kubernetes, Dev Ops, security, data engineering, Service Now, AI/ML, or Anthropic technologies are a plus.
• Why This Role Matters

The AI Platform Engineer provides the technical backbone for New Rocket’s AI Foundry and Anthropic business.

This role makes it possible for our teams and customers to move beyond isolated AI experiments and into secure, scalable, observable, and governed production solutions.

By creating reusable platforms and engineering standards for Claude‑powered AI, agentic workflows, enterprise data access, Service Now integrations, and responsible AI operations, you will help New Rocket deliver lasting business value—and scale trusted AI adoption across our clients.

#J-18808-Ljbffr