Nvidia's New AI Chatbot Doesn't Need the Internet

Nvidia has released a demo of a new AI chatbot that runs locally on certain PCs with GeForce RTX. The demo app, called Chat with RTX, can be downloaded for free and lets users run an AI chatbot personalized with their own content on their computers.

Also: The best AI chatbots: ChatGPT and other noteworthy alternatives

Powered by Nvidia's TensorRT-LLM software, the app can generate content and can be trained on content the user chooses, including .txt, .pdf, .doc/.docx and .xml files, and even URLs pointing to YouTube videos.

Once they have chosen content to train the bot on, users can start asking it personalized questions about that content. For example, the bot can summarize the step-by-step instructions in a YouTube how-to video, or tell the user which type of batteries are on their shopping list.