A new update for Nvidia ChatRTX, Nvidia’s visual computing platform that provides game developers with real-time, cinematic-quality rendering, is available for download today. The update expands the technical demo capabilities and supported LLM models for RTX-enabled AI applications.
Announced for the first time and presented at GTC 2024 Earlier in March, the update adds several new features. ChatRTX now has a larger list of supported LLMs, including Gemma, Google’s latest LLM, and ChatGLM3, an open, bilingual (English and Chinese) LLM, giving users additional flexibility.
New photo support allows ChatRTX users to easily search and interact locally with their own photo data without the need for complex metadata labeling, thanks to Contrast Image Language Pretraining (CLIP) from OpenAI.
ChatRTX users can now speak with their own data, with added support for Whisper, an AI automatic speech recognition system that now allows ChatRTX to understand verbal speech.
ChatRTX today enables users to unleash the power of AI on their RTX-equipped PCs, leveraging the accelerated performance of TensorRT-LLM software and NVIDIA RTX. And everything is done locally on your PC, so your data is secure. Additionally, it is available on GitHub as a free reference project, allowing developers to explore and extend AI applications using RAG technology for even more diverse use cases.
You can find more information on the embargoed AI Decoded blog, as well as a new update for the RTX Remix beta that adds DLSS 3.5 with Ray Reconstruction.