Gigabyte Gigabyte Corp. has officially launched its new local AI model training and tuning utility to work with a new range of AI-targeted hardware. Using the new utility with Gigabyte’s recommended hardware, users can locally train and tune AI models with up to 236 billion parameters or more. Previously, training an AI model of this size typically required the help of a remote data center.
The new Linux-based AI TOP utility works with Gigabyte hardware and was explicitly designed to run AI models. The list includes motherboards, AI TOP Brand SSD Drivesgraphics cards and power supplies. Currently, the dedicated site only includes one power supply and one motherboard. It also lists two SSDs and three graphics cards.
According to the press release, other Gigabyte graphics cards are expected to work with AI TOP. These include Gigabyte’s Nvidia GeForce RTX 40 series graphics cards, AMD Radeon RX 7900 series, Radeon Pro W7900 and W7800 series.
AI TOP is already configured to support over 70 open source LLM models on Hugging Face. These include Baichuan 2, Distill-GPT2, GLM4, Llama 2, and Llama 3, among others. While Hugging Face lists over 770,000 different models, the selection in AI TOP is limited by several factors, including memory capacity limitations in what is effectively still desktop PC hardware.
By fine-tuning the AI model locally, users can be more confident that their sensitive data remains secure and private while the model is being trained. Users don’t need AI programming skills to use the tool, and a dashboard makes it easy to monitor hardware load states and training quality.
Gigabyte has simplified what used to be sophisticated control parameters for training AI models into customizable settings and easy-to-use fine-tuning options. It provides what Gigabyte calls a “friendly graphical user interface” to help beginners and more experienced users understand the information and settings.
Gigabyte’s software also includes its AI TOP Tutor, an AI technology to help with AI TOP solution consultation, installation tips, and technical support for both beginners and advanced AI model operators. The utility only runs on Linux and is available as a free download from Gigabyte’s webpage.
