RAFAY + NVIDIA

From AI factory blueprint to running an AI cloud.

NVIDIA sets the standard for how AI factories are designed and built. The Rafay Platform turns that standard into governed, self-service offerings that your customers and teams use and pay for, from bare metal to tokens.

Rafay and NVIDIA partnership graphic
NVIDIA AI CLOUD READY

The Rafay Platform is NVIDIA AI Cloud Ready

The Rafay Platform meets NVIDIA’s software standard for operating production-grade AI cloud infrastructure. With NVIDIA Infra Controller, it gives neocloud and sovereign AI cloud operators a validated AI cloud platform from day one. Rafay is among the first independent software vendors to earn the designation.

READ THE ANNOUNCEMENT →
API-driven infrastructureKubernetes, VMs, Slurm and bare metal as services, through published APIs
Hard and soft multi-tenancyIsolation at the hardware and platform levels, with quotas and policy
Production AI workloadsToken-metered NVIDIA NIM microservices, NeMo libraries and AI Blueprints
Enterprise-grade controlsLifecycle management, security, compliance and real-time monitoring
WHY IT MATTERS

NVIDIA provides the AI factory components. The Rafay Platform runs them as a cloud business.

NVIDIA DSX and the NCP reference architecture give every operator the same blueprint for AI factory hardware and software. Turning that blueprint into revenue takes an operational layer on top.

The Rafay Platform is that layer. It brings NVIDIA infrastructure online, isolates each tenant, and delivers bare metal, VMs, Kubernetes, Slurm, Run:ai and token services from one self-service portal, with metering and billing on every service.

NVIDIA CLOUD PARTNER PATH

From GPU owner to NVIDIA Cloud Partner

NVIDIA cloud partner programs expect governed, multi-tenant services on NVIDIA reference designs. The Rafay Platform provides that software layer, so operators can meet each requirement without building it themselves.

READ THE NCP GUIDE →
01
NVIDIA Cloud Partner
Serve isolated capacity to paying tenants.
WITH RAFAYBare-metal automation, tenant segmentation, RBAC, and Kubernetes on bare metal and VMs.
02
Reference Platform NCP
Run on NVIDIA reference designs such as DSX OS.
WITH RAFAYDSX OS orchestration, tenant admin, quotas, audit, fleet upgrades, backup and DR.
03
Preferred and Exemplar
Sell productized services with consistent performance.
WITH RAFAYService catalogs, metering, white-label, air-gapped operation, Token Factory.
04
AI Cloud Partner
Show multi-tenant operations at rack scale.
WITH RAFAYAll of the above, as proof of operational quality.
NVIDIA CERTIFICATIONS AND VALIDATIONS

Recognized across the NVIDIA ecosystem

Few platforms work this closely with NVIDIA. The Rafay Platform is validated and certified across the stack, from GPU Kubernetes and virtualization to AI cloud software and enterprise AI factories.

Validated Compatibility with NVIDIA Run:ai
Automated deployment of NVIDIA Run:ai environments on governed Kubernetes.
NVIDIA-Validated GPU PaaS Reference Architecture
A validated architecture for delivering self-service NVIDIA GPU infrastructure and AI environments.
NVIDIA Enterprise AI Factory Ecosystem Integration
Orchestration, governance and self-service management for enterprise AI factory designs.
NVIDIA GPU Operator Validated Solution
A validated, repeatable way to deploy GPU-accelerated Kubernetes for AI and ML workloads.
NVIDIA-Certified Hypervisors
Virtualization certified for agentic and inference workloads, with near-bare-metal performance.
NVIDIA Inception Member
Access to NVIDIA technical resources, training and ecosystem collaboration.
Featured in the NVIDIA DSX Air Marketplace
A joint Rafay and Netris multi-tenancy lab, available to try in NVIDIA DSX Air.
RAFAY ACROSS THE NVIDIA STACK

How Rafay turns each NVIDIA component into a service

Available todayIn developmentDemonstrated

NVIDIA DSX brings reference designs and software together to design, simulate, build and operate AI factories. DSX OS is its open-source, modular software for running multi-tenant AI factory infrastructure. The Rafay Platform turns each DSX OS capability into a service operators can offer, with governance, quotas and audit logging on every one.

NVIDIA DSX OS
MODEL SERVING
Deploys models at scale as production inference services.
NVIDIA Dynamo and Grove, with NIM
Available today
With Rafay: model endpoints and per-token APIs through Token Factory, metered and billed.
WORKLOAD AND GPU ORCHESTRATION
Allocates and shares GPU capacity across distributed AI workloads.
LAUNCH PARTNER · OPEN-SOURCE NVIDIA RUN:AI
NVIDIA Run:ai
Available today
With Rafay: Run:ai as a governed, self-service tier in your own portal, at a price you set, with shared GPU pools, quotas and per-team charges.
KAI Scheduler
Available today
With Rafay: GPU environments customers or teams launch themselves, within limits and with usage-based charges.
NVIDIA Cloud Functions
Available today
With Rafay: AI services delivered on the same accounts and the same bill.
INFRASTRUCTURE OPERATIONS
Provisions, manages and operates AI factory infrastructure and compute.
NVIDIA Infra Controller and DOCA Platform Framework
Available today
With Rafay: isolated bare-metal servers as a product, attested and wiped between customers, with tenants isolated at the BlueField DPU.
HEALTH AND RESILIENCE
Identifies, contains and helps recover from workload and infrastructure issues.
NVSentinel
Available today
With Rafay: shared fleets kept healthy, with GPU faults caught and fixed automatically.
NVIDIA Cluster Readiness Engine
Available today
With Rafay: tenant GPU Kubernetes clusters burned in and certified before customers use them.
SECURITY AND CONFIDENTIAL COMPUTING
Establishes trust and protects AI workloads, data and infrastructure.
NVIDIA Attestation
In development
With Rafay: device integrity checks that support confidential computing for tenants.
OBSERVABILITY
Gives visibility into AI factory health, performance and operations.
NVIDIA Fleet Intelligence
In development
With Rafay: fleet-wide health and integrity insight, managed from one place.
ACCELERATED KUBERNETES FOUNDATION
Defines, configures, validates and deploys accelerated Kubernetes environments.
NVIDIA GPU Operator and AI Cluster Runtime
Available today
With Rafay: managed GPU Kubernetes clusters, launched with a single click and ready for tenants.
NVIDIA Kubernetes Engine (NVKE)
In development
With Rafay: NVKE clusters offered as a governed, metered Kubernetes service, with self-service, tenants, quotas and usage metering.
Across the rest of NVIDIA DSX
DSX SIM
Simulation to design, validate and operate AI factories before and after deployment.
NVIDIA DSX Air
Available today
With Rafay: the orchestration foundation for the AI-factory digital twin, so operators test services before hardware arrives.
NVIDIA Omniverse DSX Blueprint
Available today
With Rafay: AI factory digital twins deployed in one click.
DSX MAXLPS AND DSX FLEX
Performance per watt within a fixed power envelope, and AI workloads that adapt to grid signals.
NVIDIA DSX MaxLPS and Flex
In development
With Rafay: more tokens from every watt, with AI workloads that adapt to grid and pricing signals.

Why rack-scale systems need a new operating layer

NVIDIA NVL72 systems change what an AI cloud operator has to manage. The same rack-scale design carries forward to GB300 and Vera Rubin NVL72.

One 72-GPU machineEach GB200 or GB300 NVL72 rack joins 72 GPUs in a single NVLink domain. The whole rack is the unit of compute.
Too valuable to sit idleA liquid-cooled rack draws well over 100 kW, so every idle week is expensive. It has to be split safely and sold in the units customers want.
The software is modularDSX OS gives operators open building blocks for NVL72. Someone still has to assemble, run and sell them.

How it comes together

The Rafay Platform runs on NVIDIA DSX OS and Infra Controller, and turns NVL72 racks into services operators sell from one control plane.

What Rafay brings to NVIDIA rack-scale

What operators need to turn NVL72 racks into revenue, from one control plane.

NVL72 racks, managedGB200 and GB300 racks, trays and servers become managed inventory, with power, cooling and leak status.
NVIDIA Infra ControllerRafay runs it for secure bare-metal provisioning and tenant isolation on the BlueField DPU.
Rack-scale productsSell bare metal from one tray to a full NVL72 rack, plus VMs, Kubernetes clusters and tokens.
Every site, one cloudJoin sites anywhere into one cloud, with one portal and one bill.
See it at rack scale:Rafay on GB200 NVL72

Production deployments at scale

AolaniOne of the industry’s first NVIDIA DSX OS deployments on GB200 NVL72, with Rafay for multi-tenancy, orchestration and lifecycle
Sharon AISovereign, self-service AI cloud services across Asia-Pacific, built on Rafay’s implementation of NVIDIA DSX OS on NVIDIA Grace Blackwell-class GPUs.Read the case study

Telcos hold power, sites and trusted networks across a country. With the Rafay Platform on NVIDIA telco reference architectures, they turn that footprint into sovereign AI clouds and token-metered inference at the edge.

NVIDIA AI Grid
Demonstrated
With Rafay: token-metered inference distributed across telco and edge sites, run as one governed service. The NVIDIA AI Grid demo is powered by Rafay.
Telco AI: from connectivity to tokens
How telcos turn their networks, power and sites into sovereign AI clouds and token-metered revenue.

Not every NVIDIA estate runs on Kubernetes alone. The Rafay Platform also delivers Slurm and GPU virtual machines as self-service, multi-tenant services on NVIDIA infrastructure.

NVIDIA Base Command Manager and Slurm
Available today
With Rafay: BCM-based Slurm clusters delivered as elastic, multi-tenant HPC services.
NVIDIA-Certified Hypervisors
Available today
With Rafay: GPU virtual machines with near-bare-metal performance for inference and agentic workloads.
GPU PaaS Reference Architecture
Available today
With Rafay: a reference design for self-service NVIDIA GPU infrastructure, published with NVIDIA.

Ready to turn your NVIDIA infrastructure into revenue?