Latest Articles
Benchmarks
RTX PRO 6000 vs Datacenter GPUs: Is the new RTX an H100 killer?
I benchmarked RTX PRO 6000 against H100 and H200 datacenter GPUs for LLM inference. The PRO 6000 beats the H100 on single-GPU workloads at 28% lower cost per token, but NVLink-equipped datacenter GPUs pull ahead 3-4x for large models requiring 8-way tensor parallelism.
Dmitry Trifonov
November 27, 2025
Tutorials
How to Set Up ComfyUI with Cloud Storage for Portable AI Experiments
Learn how to set up ComfyUI with cloud storage to create portable, reproducible image-generation workflows that sync seamlessly across multiple machines.
Slawomir Strumecki
November 1, 2025
Tutorials
How to Mount Cloud Storage on a VM (Google Drive, GCS, S3)
Learn how to mount Google Drive, Google Cloud Storage, and AWS S3 on Linux VMs using rclone, gcsfuse, and s3fs. Step-by-step guide with authentication, mounting commands, and performance tuning.
Slawomir Strumecki
October 22, 2025
Tutorials
Feel the Power: Run ComfyUI on Cloud GPUs - Full VM Setup Guide
Launch ComfyUI on a GPU-powered Ubuntu VM in under three minutes. Step-by-step commands to install Docker, configure GPU access, and add your first model checkpoint.
Heiko Polinski
October 15, 2025
Tutorials
ComfyUI in the Cloud: Set Up in Under 2 Minutes
Learn how to rent a GPU for ComfyUI with this quick setup guide. Deploy an RTX 5090, connect, and start generating images in under two minutes. No subscription required.
Heiko Polinski
October 14, 2025
Benchmarks
RTX 4090 vs RTX 5090 vs RTX PRO 6000: Comprehensive LLM Inference Benchmark
I benchmarked RTX 4090, RTX 5090, and RTX PRO 6000 GPUs across multiple configurations (1x, 2x, 4x) for LLM inference throughput using vLLM. This comprehensive benchmark reveals which GPU configuration offers the best performance and cost-efficiency for different model sizes.
Dmitry Trifonov
October 9, 2025
Benchmarks
Benchmarking LLM Inference on RTX 4090, RTX 5090, and RTX PRO 6000
We ran a series of benchmarks across multiple GPU cloud servers to evaluate their performance for LLM workloads, specifically serving LLaMA and Qwen models and on RTX 4090, RTX 5090, and RTX PRO 6000 GPUs.
Natalia Trifonova
September 23, 2025
AI Tools & Workflows
Building a Community LLM Exchange
Learn how to build a community LLM exchange: connect model providers and users via unified APIs, endpoint sharing, routing logic, and open infrastructure.
Dmitry Trifonov
September 12, 2025
Infrastructure & DevOps
Evolution of GPU Programming
A semi serious, nostalgia induced, journey through the history of GPU programming from making brick walls look bumpy in 2000 to optimizing attention mechanism in LLM models in 2025...
Dmitry Trifonov
September 3, 2025
Tutorials
Host Setup for Qemu KVM GPU Passthrough with VFIO on Linux
GPU passthrough shouldn’t feel like sorcery. If you’ve ever lost a weekend to half-working configs, random resets, or a guest that only boots when the moon is right, this guide is for you.
Dmitry Trifonov
August 22, 2025
AI Tools & Workflows
How to Give Your RTX GPU Nearly Infinite Memory for LLM Inference
Network-Attached KV Cache for Long-Context, Multi-Turn Workloads. Let's be honest — we can't afford an H100. Learn how to extend your RTX GPU's effective memory using innovative KV cache offloading techniques.
Natalia Trifonova
August 10, 2025
Infrastructure & DevOps
Bug Bounty: NVidia Reset Bug
Hey everyone — we're building a next-gen GPU cloud for AI developers at CloudRift, and we've run into a frustrating issue that's proven nearly impossible to debug. We're turning to the community for help.
Dmitry Trifonov
August 6, 2025
Tutorials
From Zero to GPU: Creating a dstack Backend for CloudRift
If you’ve ever wished you could plug your own GPU infrastructure into dstack instead of relying on the default cloud providers, you’re not alone. In t...
Slawomir Strumecki
July 30, 2025
Benchmarks
Choosing Your LLM Powerhouse: A Comprehensive Comparison of Inference Providers
Compare top LLM inference providers for performance, cost, and scalability. Find the best GPU cloud to run your AI models with speed and flexibility.
Natalia Trifonova
July 8, 2025
AI Tools & Workflows
AI tools for designers who don’t code (yet)
Explore the best AI tools adn communities for designers who don’t code. Discover how AI can boost creativity, streamline design work, and speed up workflows.
Heiko Heilig
June 23, 2025
Tutorials
How to run Oobabooga WebUI on a rented GPU
Learn how to run Oobabooga WebUI on a rented GPU. Step-by-step guide to deploy your own local LLM in the cloud using RTX 4090 or RTX 5090 GPUs without managing infrastructure.
Heiko Heilig
May 23, 2025
AI Tools & Workflows
How to Leverage Cloud-hosted LLM and Pay Per Usage?
Learn how to use CloudRift's LLM-as-a-Service with pay-per-token pricing. Access powerful language models via API without managing infrastructure, paying only for what you use.
Dmitry Trifonov
May 21, 2025
Tutorials
Godot Game Server with Chat Bots
Learn how to build a Godot game server with AI chat bots using Ollama API and GPU capabilities. Complete tutorial for integrating LLM communication into multiplayer games.
Slawomir Strumecki
May 7, 2025
Tutorials
Godot Game Server
Learn how to run a dedicated Godot game server using CloudRift. Complete guide to deploying multiplayer Godot games with Docker containers for easy scalability.
Slawomir Strumecki
May 3, 2025
Tutorials
How to Rent a GPU for ComfyUI: Complete Setup Guide
A complete guide to rent a GPU for ComfyUI. Learn how to launch ComfyUI on rented RTX 4090 or RTX 5090 GPUs with step-by-step instructions for both template and CLI setups.
Heiko Heilig
April 17, 2025
Tutorials
How to Develop your First (Agentic) RAG Application?
Developing a board-game assistant. No Vibes and Fully Local. In this tutorial, I will show how to create a simple chatbot with RAG running on your local machine.
Natalia Trifonova
April 16, 2025
AI Tools & Workflows
So you're curious about open source AI (and a little intimidated)?
A guide for designers and creatives exploring open source AI. You don't need to be a technical expert to get started - just curious enough to look like a newbie sometimes.
Heiko Heilig
April 16, 2025
AI Tools & Workflows
UnSaaS your Stack with Self-hosted Cloud IDEs
Save money on cloud GPUs for AI development with self-hosted cloud IDEs. Learn how to set up Jupyter Lab and VS Code on rented GPU instances for cost-effective AI development.
Dmitry Trifonov
April 15, 2025
Tutorials
How to Rent a GPU-Enabled Machine for AI Development
This tutorial explains how to rent a GPU-enabled machine and configure a development environment with CloudRift using Jupyter Lab or VS Code.
Dmitry Trifonov
April 11, 2025
AI Tools & Workflows
Prompting DeepSeek: How smart is it, really?
DeepSeek-R1 is a new and powerful AI model that is said to perform on par with leading models from companies like OpenAI but at a significantly lower cost.
Dmitry Trifonov
February 25, 2025
Tutorials
How to develop your first LLM app? Context and Prompt Engineering
In this tutorial, we will develop a simple LLM-based application for rehearsal. We will supply text to the app, like a chapter of the book, and the app will ask us a question about the text.
Dmitry Trifonov
September 22, 2024
Tutorials
How to run Oobabooga in Docker?
This is a short tutorial describing how to run Oobabooga LLM web UI with Docker and Nvidia GPU.
Dmitry Trifonov
September 14, 2024
Tutorials
How to start development with LLM?
Starting in any hot field may feel overwhelming. Let me help my fellow developers navigate it and describe a few good starter tools: LM Studio, Ollama, Open WebUI, and Oobabooga.
Dmitry Trifonov
September 14, 2024
graphic-design
A Transformative Journey? Why Certificates Won't Make You a Better Designer
The real value of education isn't in the certificate you receive at the end, but in the knowledge and skills you gain. Stop collecting credentials and start collecting capabilities.
Heiko Heilig
September 9, 2024