Author

Mohan Atreya

Fine-Tuning AI Models with Tuning-as-a-Service Platforms

The adoption of AI models across enterprises has accelerated in recent years, with businesses leveraging artificial intelligence to streamline operations, improve customer interactions, and gain actionable insights. However, out-of-the-box AI solutions often lack the specificity and precision required for specialized tasks, which is where fine-tuning becomes essential.

Read Now

Unlocking the Potential of Inference as a Service for Scalable AI Operations

As artificial intelligence (AI) becomes more integral to business operations, organizations face mounting challenges in deploying models efficiently while keeping up with real-time performance demands. Traditional AI model deployment methods involve complex infrastructure management, requiring IT operations to handle everything from GPU provisioning to monitoring performance.

Read Now

Unlocking GPU Infrastructure Orchestration with Rafay

Platform teams today face mounting pressure to deploy, scale, and optimize GPU resources for complex AI workloads across hybrid and multi-cloud environments. Thankfully, Rafay enables customers to deploy a GPU PaaS that offers a streamlined solution, equipping enterprises with the tools to orchestrate GPU infrastructure seamlessly and efficiently.

Read Now

Inference as a Service: Optimizing AI Workflows

The Role of Inference-as-a-Service in AI Model Deployment Deploying AI models across multi-cloud environments presents a range of challenges, from ensuring consistent performance to managing complex infrastructure. Organizations often struggle with balancing workloads, scaling resources, and maintaining model uptime across different platforms.

Read Now

GPU Infrastructure: Key Components and Optimization Strategies

As industries increasingly rely on data-intensive processes and real-time analytics, GPU infrastructure has become essential for supporting advanced, high-performance workloads. From artificial intelligence (AI) applications and machine learning (ML) models to data analytics and high-performance computing (HPC), GPU-based systems power some of the most complex applications.

Read Now

Break Glass Workflows for Developer Access to Kubernetes Clusters - Introduction

In any large-scale, production-grade Kubernetes setup, maintaining the security and integrity of the clusters is critical. However, there are exceptional circumstances—such as production outages or critical bugs—where developers need emergency access to a Kubernetes cluster to resolve issues.

Read Now

GPU Clock Explained: Understanding the SM Clock Metric

In the previous blog , we discussed why tracking and reporting GPU Memory Utilization metrics matters. In this blog, we will dive deeper into another critical GPU metric i.

Read Now

GPU Metrics: Understanding GPU Framebuffer

In the previous blog , we discussed why tracking and reporting GPU power usage matters. In this blog, we will dive deeper into another critical GPU metric i.

Read Now

GPU Metrics: Understanding GPU Memory Utilization

In the introductory blog on GPU metrics, we discussed about the GPU metrics that matter and why they matter. In this blog, we will dive deeper into one of the critical GPU metrics i.

Read Now

GPU Metrics: Understanding GPU Power Usage and Efficiency

In the previous blog , we discussed why tracking and reporting GPU SM Clock metrics matters. In this blog, we will dive deeper into another critical GPU metric i.

Read Now

What GPU Metrics to Monitor and Why?

With the increasing reliance on GPUs for compute-intensive tasks such as machine learning, deep learning, data processing, and rendering, both infrastructure administrators and users of GPUs (i. e.

Read Now

PyTorch vs. TensorFlow: A Comprehensive Comparison

When it comes to deep learning frameworks, PyTorch and TensorFlow are two of the most prominent tools in the field. Both have been widely adopted by researchers and developers alike, and while they share many similarities, they also have key differences that make them suitable for different use cases.

Read Now

User Access Reports for Kubernetes

Access reviews are required and mandated by regulations such as SOX, HIPAA, GLBA, PCI, NYDFS, and SOC-2. Access reviews are critical to help organizations maintain a strong risk management posture and uphold compliance.

Read Now

EC2 vs. Fargate for Amazon EKS: A Cost Comparison

When it comes to running workloads on Amazon Web Services (AWS), two popular choices are Amazon Elastic Compute Cloud (EC2) and AWS Fargate. Both have their merits, but understanding their cost implications is crucial for making an informed decision.

Read Now

CPU vs GPU: What’s the Difference for AI/ML Workloads?

This is a multi-series blog on GPUs, how they intersect with Kubernetes and containers. In this blog, we will discuss how CPUs and GPUs are architecturally similar and different.

Read Now

What is JupyterHub? A Beginner’s Guide

This is part of a blog series on AI/Machine Learning. In the previous blog , we discussed Jupyter Notebooks, how they are different and the challenges organizations run into at scale with it.

Read Now

Introduction to Jupyter Notebooks

Jupyter Notebook is open-source software created and maintained by the Jupyter community . A Jupyter notebook allows for the creation and sharing of documents with code and rich text elements .

Read Now

Introducing Rafay’s Generative AI based Copilot

As part of our early March 2024 release, we opened up Rafay’s Generative AI based Copilot to our customers. For the folks that are active readers of our product blogs, you will recognize that this is the result of a GenAI focused Hackathon we ran in late 2023.

Read Now

Resize and Right Size Applications on Kubernetes

It is a well understood fact on Kubernetes that there is a significant amount of wastage of expensive cloud/infrastructure because of over provisioned applications. In this blog, we will look at how app developers and platform teams can save their organizations millions of dollars by right-sizing their applications using a free , open-source tool appropriately called resize that we recently developed for our customers.

Read Now

Choosing Between Amazon ECS and EKS

We frequently get asked by users that are currently on AWS whether they should be using Amazon ECS or EKS to deploy and operate their containerized applications. Since this is such a common question and the answers are somewhat nuanced, we wanted to share our thoughts and recommendations for the benefit of all users.

Read Now

HashiCorp's New License: Impact on Rafay's Native Integration

Last week, HashiCorp announced that they would be adopting the Business Source License for future releases of its products. In this blog, we describe how and if this impacts Rafay customers.

Read Now

Integrated FinOps Role for Cost Management

In our June 2023 release , we added support for a new turnkey role in the Rafay Kubernetes Operations Platform specifically targeted at users in a FinOps function. This new role allows the FinOps team to access and view cost and usage data in the Rafay Kubernetes Operations Platform.

Read Now

Product

Rafay's (AI) Hackathon 2023: Product Advancements To Improve Our Customers' Experience & Our Internal Efficiencies

We just wrapped up our annual hackathon earlier this month. The theme and focus for this hackathon was AI and Generative AI and our teams had the opportunity to prototype and demonstrate fascinating solutions esp.

Read Now

AI/ML Superpowers for Kubernetes Troubleshooting

In the last two blogs ( part 1 and part 2 ), we discussed the challenges customers face with running AI/ML on Kubernetes and innovative solutions to address these challenges. In this blog, we will flip this on its head and look at how AI/ML can make Kubernetes easier to use and operate.

Read Now