What fun is having an AI workstation if you don’t dive deeply into what makes AI work. Inference is maybe 98% of AI tasks from image generation to machine learning and even basic chats and summaries. We rely on model makers to do the heavy lifting and provide models that we can use, either in the cloud or locally.
In my previous articles I discussed the balance between model quality and hardware requirements for running AI models locally. For this article I wanted to discuss software and how my AI Workstation build was designed to work with the software packages and how I can switch between them to complete certain tasks.
In this review we will be looking at the Aorus X870E Elite X3D Ice motherboard. This board features an AMD X870E chipset supporting AM5 processors and comes with the X3D refresh features and the extremely swank ICE color combo.
One of the constants in the enthusiast PC world is that builds change and in this episode the duo discuss the recent cooling upgrades made to the Podcast and Stream Machine used in the Hardware Asylum Labs followed by an introduction to a new keyboard project for the cyberdeck build.
Subscribe Options: RSS (MP3) / iTunes (MP3)
Fine-Tuning LLMs on a Local Multi-GPU AI WorkstationSoftware Choices for a Multi-GPU AI WorkstationASRock Steel Legend 360 LCD Liquid CPU Cooler Review @ ThinkComputersASRock Radeon RX 9070 XT Taichi White OC @ TechPowerUpCORSAIR MAKR PRO 75 Hall Effect DIY Keyboard Review @ Funky Kit ReviewdarkFlash Explore DE360 @ TechPowerUpAorus X870E Elite X3D Ice Motherboard ReviewCrimson Desert Performance Benchmark ReviewHighPoint Announces Rocket 1604L: The World’s Most Compact PCIe Gen5 x16 Retimer AIC for AI and Industrial EdgeTurboQuant - the Pied Piper Technology for AI