In the modern enterprise, Artificial Intelligence (AI) has moved from a "nice-to-have" experimental phase to a core business driver. However, for organizations in highly regulated sectors—such as banking, healthcare, and government—the path to AI adoption is fraught with security hurdles.
The primary concern is protecting sensitive data not just at rest or in transit, but in use. In the image below, the app uses a proprietary model which needs to be secured using confidential computing.
Traditional security measures often fall short when data must be decrypted to be processed by an AI model. This is where Confidential Computing changes the game, and why the joint integration between Fortanix and Rafay is a landmark development for the "AI Factory" of the future.
Consider a financial institution operating in a strictly regulated environment. They aim to be at the forefront of technology by deploying Speech-to-Text services (e.g. based on NVIDIA's Parakeet NIM) to boost internal productivity.
Because of the need for rapid deployments, it is common to want to partner with neo-clouds that can provide them with access to cutting edge GPU and associated AI infrastructure. However, the financial institution's compliance mandates are non-negotiable:
The integration combines Fortanix’s industry-leading data security with Rafay’s robust orchestration platform to create a turnkey solution for Confidential AI.
Fortanix provides the "vault" for AI workloads through its Confidential Computing Manager (CCM) and Data Security Manager (DSM).
This module creates and manages Confidential Virtual Machines (CVMs) and containers. It performs Composite Attestation, a process that verifies the integrity of the hardware, the BIOS, and the software stack before any sensitive data is processed.
This acts as a hardened Key Management System (KMS) and Hardware Security Module (HSM). It ensures that encryption keys are only released to the AI workload after the CCM has validated the attestation.
While Fortanix secures the what, Rafay handles the how. Rafay provides the automation and deployment scale required to manage these secure environments across distributed infrastructure.
Enable administrators to define "SKUs" for the application, the underlying form factor (VM, bare metal server, Kubernetes etc) and all necessary security configurations.
Through the Rafay platform, neoclouds can manage multiple tenants, manage data centers with heterogenous AI infrastructure, provide end users with a self service portal to launch and use the SKUs.
The true value of this integration is best seen through the simplified workflow it provides for different organizational personas.
The workflow begins with the SKU Creator. This persona defines the "blueprint" for the Speech-to-Text application/service. They work with the neo-cloud admin to ensure the environment has the correct NVIDIA GPUs (such as H100 or Blackwell) capable of supporting hardware-based Trusted Execution Environments (TEEs).
The Infrastructure Admin at the neo-cloud vendor uses Rafay to provision the underlying hardware and hypervisor. They ensure that the Fortanix node agents are in place to facilitate communication between the hardware powered secure enclaves and the Fortanix management plane.
For the developer or end user, the complexity is entirely abstracted away. They log into the Rafay Self Service Portal and click "Deploy" for the Speech-to-Text Virtual Machine.
In a few minutes, the system automatically:
The result is a running NVIDIA Parakeet model in the confidential VM, protected within a hardware-encrypted enclave, ready to process sensitive financial data.
This integration represents more than just a technical milestone; it is a blueprint for the Sovereign AI Factory. By removing the friction between "high security" and "high velocity," Fortanix and Rafay allow enterprises to:
Deploy the latest AI models (like those from NVIDIA or other proprietary vendors) without risking data exposure.
Automatically generate the attestation reports and audit trails required by compliance officers.
Move from a single pilot project to a global AI deployment using repeatable, scalable processes.
As AI continues to permeate every facet of business, the ability to run these workloads in a Confidential, Secure, and Sovereign manner will be the defining characteristic of successful digital transformation. The Fortanix and Rafay integration is leading that charge.
.png)
Rafay has joined Lenovo AI Innovators. Here's why the AI control plane matters for hybrid AI, with context from Lenovo's Noam Rosen at our Barcelona summit.
Read Now
At scale, AI training jobs fail every few hours, and each failure burns GPU-hours. Clockwork AI Fault Tolerance and AI Fabric Observability are now a turnkey option on the Rafay Platform. Turn them on once with a blueprint, and they apply across every GPU cluster in the fleet.
Read Now
A production RAG stack spans LLMs, embedding and reranking models, ingestion, and search. See how Rafay GPU PaaS turns the NVIDIA RAG Blueprint into a repeatable, self-service catalog offering for neoclouds.
Read Now
