Demo

NVIDIA ChatRTX

Your Personalized AI Chatbot

What Is ChatRTX?

ChatRTX is a demo app that lets you personalize a GPT large language model (LLM) connected to your own content—docs, notes, images, or other data. Leveraging retrieval-augmented generation (RAG), TensorRT-LLM, and RTX acceleration, you can query a custom chatbot to quickly get contextually relevant answers. And because it all runs locally on your Windows RTX PC or workstation, you’ll get fast and secure results.

Chat With Your Files

ChatRTX supports various file formats, including txt, pdf, doc/docx, jpg, png, gif, and xml. Simply point the application at the folder containing your files and it'll load them into the library in a matter of seconds.

Talk to ChatRTX

ChatRTX features an automatic speech recognition system that uses AI to process spoken language and provide text responses with support for multiple languages. Simply click the microphone icon and talk to ChatRTX to get started.

Photo and Image Search

Let ChatRTX do the work—sort through your photo albums with a simple text or voice search, keeping everything private and hassle-free.

See It In Action

Introducing ChatRTX

ChatRTX Update: Voice, Image, and new Model Support

Download NVIDIA ChatRTX

Simply download, install, and start chatting right away.

System Requirements

Platform Windows
GPU NVIDIA GeForce™ RTX 30 or 40 Series GPU or NVIDIA RTX™ Ampere or Ada Generation GPU with at least 8GB of VRAM
RAM 16GB or greater
OS Windows 11
Driver 535.11 or later
File Size 12GB

Support

Chat for Developers

The ChatRTX tech demo is built from the TensorRT-LLM RAG developer reference project available from GitHub. Developers can use that reference to develop and deploy their own RAG-based applications for RTX, accelerated by TensorRT-LLM.

Further With AI, Faster on RTX

Get next-level AI performance on GeForce RTX and NVIDIA RTX GPUs. From enhanced creativity and productivity to blisteringly fast gaming, the ultimate in AI power on Windows PCs is on RTX.

Explore NVIDIA’s generative AI developer tools and enterprise solutions.

Notify Me When Chat With RTX is Available