AI & Data Science Workbench as a Service

Self-Service Access to AI Workbenches for Your Developers

Provide developers, data scientists, researchers, and all cloud users with self-service access to AI Workbenches using proven templates with guardrails included.

Get started now

Why AI Workbenches-as-a-Service?

Every modern enterprise is leveraging AI. Enterprises that streamline the process of learning and experimenting with AI by providing self-service for developers and data scientists gain significant benefits.

Speed AI Journey

Empower developers and datascientists to deploy AI environmentsthey need, when they need them.

Reduce Overhead

Reusable AI templates reduce theneed for platform and cloud teams toprovision environments repeatedly.

Simplify Maintenance

Platform teams now update andmaintain configurations via a set ofreusable templates.

Unique Rafay Capabilities for AI Workbenches-as-a-Service

Dozens of enterprise platform teams leverage these unique features to rapidly build AI Workbenches-as-a-service automation with Rafay and delight their developers.

Lifeycle Management

Secure self-service for namespaces

Users should be able to provision namespacesbut should not have access to resourcesoutside of their namespaces

Infrastructure as Code (IaC) support

Support for TF or GitOps first approaches, including private Git repos, that accelerate infrastructure deployment

Resource quotas for teams & applications

Define quotas to prevent noisy neighbor issues so total namespace resource requests do not exceed the configured limits

Management of namespace compliance

Easily manage compliance of pre-existing namespaces in the same manner (i.e. same guardrails) as new namespaces

Integrate with continuous delivery

Work with CD tools like Argo, enforcing guardrails (e.g. quotas, network policies) on namespaces created out of band

Centralized visibility into namespaces

Use cross account and cross cloud visibility to manage complex multi-cloud environments across teams, geos, and domains

Streamlined disaster recovery

Leverage one step workflows to quickly and safely restore data from backups during disaster recovery events

Developer Self-Service

Flexible interfaces

Ability to consume the platform through the preferred interface: UI, Backstage, GitOps or CMDBs (e.g. ServiceNow)

Simple, streamlined process for requesting compute

No time consuming ticket driven process where the Platform team has to manually provision namespaces

Visualization of namespace resources

View into “what resources” are violating policies so that it is easy to remediate and course correct (for future actions)

Streamlined experience for kubectl access

To help with scenarios such as:
Application right sizing exercise
Requesting platform team for additional computer

Repository of approved applications

Integrated, low touch experience for installing applications that have been scanned for vulnerabilities etc.

Governance

Network policies for namespace isolation

Enforce network policies so that namespaces belonging to different teams cannot communicate with each other

Just in Time (JIT) user identity driven access

Implement RBAC at scale with your Identity Provider, without implementing expensive solutions (bastion, VPN, etc.) so users access only their namespaces.

Centralized kubectl access audits

Centralized visibility into user actvities + ability to export audits to an external system (e.g. Splunk, Datadog)

Chargeback and showback

Collect cluster utilization metrics for chargeback / showback models, including sharing costs across tenants for unallocated resources and common services

Identify underutilized namespaces

Collect of Granular utilization metrics from namespaces to show usage by CPU, Memory

Centralized policy enforcement

Enforce policies for security, reliability and operational efficiency, with centralized visibility into policy violations

Compliance benchmarks

Run periodic scans against benchmarks (CIS, NSA hardening recommendations etc.) and centrally aggregate the benchmark reports

Deployment Features

SaaS based

The default option – providing maximum efficiency and reliability for mature and growing customers

Self-hosted

A self-hosted, airgapped option may be necessary for highly regulated industries

Multi-tenant

“Namespace as a service” across multiple teams, with isolation and tight access controls

Unique Rafay Capabilities for AIWorkbenches-as-a-Service

Dozens of enterprise platform teams leverage these unique features to rapidly build AI Workbenches-as-a-service automation with Rafay and delight their developers.

Workbench: KubeFlow with Amazon EKS

Environment
Kubernetes
LLM
AI Workbench with KubeFlow on AWS
Template

GenAI on EKS

Environment
Bedrock models running on Amazon EKS
Template

GenAI on EKS

Environment
Bedrock models running on Amazon EKS
Template

RAG: Anthropic Claude on AWS Bedrock

Environment
Kubernetes
LLM
Retrieval Augmented Generation for Claude on AWS
Template

RAG: Cohere on AWS Bedrock

Environment
Kubernetes
LLM
Retrieval Augmented Generation for Cohere on AWS
Template

RAG: Llama-2 on AWS

Environment
Kubernetes
LLM
Retrieval Augmented Generation for Llama-2 on AWS
Template

RAG: Mistral on AWS

Environment
Kubernetes
LLM
Retrieval Augmented Generation for Mistral on AWS
Template

RAG: Zephyr on AWS

Environment
Kubernetes
LLM
Retrieval Augmented Generation for Zephyr on AWS
Template

RAG: Llama-2 on OCI

Environment
Kubernetes
LLM
Retrieval Augmented Generation for Claude on OCI
Template

RAG: Mistral on OCI

Environment
Kubernetes
LLM
Retrieval Augmented Generation for Mistral on OCI
Template

RAG: Zephyr on OCI

Environment
Kubernetes
LLM
Retrieval Augmented Generation for Zephyr on OCI
Template

Finetuning: Llama-2 on AWS

Environment
Kubernetes
LLM
Finetuning Llama-2 on AWS
Template

Finetuning: Mistral on AWS

Environment
Kubernetes
LLM
Finetuning Mistral on AWS
Template

Finetuning: Llama-2 on OCI

Environment
Kubernetes
LLM
Finetuning Llama-2 on OCI
Template

Finetuning: Mistral on OCI

Environment
Kubernetes
LLM
Finetuning Mistral on OCI
Template

Co-Pilot: Wizardcoder on AWS

Environment
Kubernetes
LLM
Retrieval Augmented Generation for Claude on OCI
Template

Co-Pilot: Wizardcoder on OCI

Environment
Kubernetes
LLM
Generative AI Co-Pilot with Wizardocder on OCI
Template

RLHF/DPO: Wizardcoder on AWS

Environment
Kubernetes
LLM
Optimizing LLMs using Wizardocder on AWS
Template

RLHF/DPO: Wizardcoder on OCI

Environment
Kubernetes
LLM
Optimizing LLMs using Wizardocder on OCI
Template

Code Generation: Wizardcoder on AWS

Environment
Kubernetes
LLM
Code Generation using Wizardocder on AWS
Template

Code Generation: Wizardcoder on OCI

Environment
Kubernetes
LLM
Code Generation using Wizardocder on OCI
Template

Speech-To-Text: Whisper on AWS

Environment
Kubernetes
LLM
Convert Speed To Text Using Whisper on AWS
Template

Speech-To-Text: Whisper on OCI

Environment
Kubernetes
LLM
Convert Speed To Text Using Whisper on OCI
Template

Workbench: Jupyter Notebook with Amazon EKS

Environment
Kubernetes
LLM
AI Workbench with Jupyter Notebook on AWS
Template

Workbench: MLFlow with Amazon EKS

Environment
Kubernetes
LLM
AI Workbench with MLFLow on AWS
Template

HPC: SLURM on AWS

Environment
Kubernetes
LLM
Deploy SLURM on AWS
Template

Stateless, Springboot (Java) Application Env

Environment
Kubernetes
Template for stateless, SpringBoot (Java) apps with Postgres-RDS
Template

Stateless, Django (Python) Application Env

Environment
Kubernetes
Template for stateless, Django (Python) apps with Postgres-RDS
Template

Stateless, NodeJS Application Env

Environment
Kubernetes
Template for stateless, Node (JavaScript) apps with Postgres-RDS
Template

Stateless, GoLang Application Env

Environment
Kubernetes
Template for stateless, GoLang apps with Postgres-RDS
Template

Stateful, Springboot (Java) Application Env

Environment
Kubernetes
Template for stateful SpringBoot (Java) apps with MongoDB in Kubernetes
Template

Multi-tenant ArgoCD

Template for ArgoCD pipelines across multiple teams and clusters
Template

NaaS on EKS

Environment
Kubernetes
Elastic Kubernetes Service on Amazon Web Services
Template

NaaS on Azure

Environment
Kubernetes
Azure Kubernetes Service on Azure
Template

NaaS on GCP

Environment
Kubernetes
Google Kubernetes Engine on Google Cloud Platform
Template

NaaS on vSphere

Environment
Kubernetes
vShpere in Private Data Center
Template

NaaS on Upstream Kubernetes

Environment
Kubernetes
Upstream Kubernetes in Private Data Center, Bare Metal, Edge
Template

Stateless, Springboot (Java) Application Env

Environment
Kubernetes
AI Workbench with KubeFlow on AWS
Template

Stateless, Django (Python) Application Env

Environment
Kubernetes
Template for stateless, Django (Python) apps with Postgres-RDS
Template

Stateless, NodeJS Application Env

Environment
Kubernetes
Template for stateless, Node (JavaScript) apps with Postgres-RDS
Template

Stateless, GoLang Application Env

Environment
Kubernetes
Template for stateless, GoLang apps with Postgres-RDS
Template

CaaS on GCP

Environment:
Technology
Google Kubernetes Engine on Google Cloud Platform
Template

CaaS on vCluster

Environment
Technology
vCluster on any Kubernetes
Template

CaaS on vSphere

Environment
Technology
vSphere in Private Data Center
Template

CaaS on EKS

Environment:
Technology
Elastic Kubernetes Service on Amazon Web Services
Template

CaaS on ECS

Environment:
Technology
Elastic Kubernetes Service on Amazon Web Services
Template

CaaS on Azure

Environment:
Technology
Azure Kubernetes Service on Azure
Template

CaaS on Upstream Kubernetes

Environment
Technology
Upstream Kubernetes in Private Data Center, Bare Metal, Edge using PhoenixNAP
Template

CaaS on OKE

Environment
Technology
Clusters Using Oracle Container Engine for Kubernetes (OKE)
Template
Download the WhitePaper

10 Multi-Tenancy Best Practices for Namespaces as a Service (NaaS)

Delve into Kubernetes multi-tenancy best practices to leveraging namespaces effectively for improved resource utilization and cost efficiency.

"We are able to deliver new, innovative products and services to the global market faster and manage them cost-effectively with Rafay"

Joe Vaughan
CTO, Moneygram

"We are able to deliver new, innovative products and services to the global market faster and manage them cost-effectively with Rafay"

Joe Vaughan
CTO, Moneygram

"We are able to deliver new, innovative products and services to the global market faster and manage them cost-effectively with Rafay"

Joe Vaughan
CTO, Moneygram

Want to Start Now?

See for yourself how Rafay delivers the automation developers and operations want with the right level of standardization, control and governance platform teams need!