I see the raise of popularity of Linux laptops so the hardware compatibility is ready out of the box. However I wonder how would I build PC right know that has budget - high end specification. For now I’m thinking
- Case: does not matter
- Fans: does not matter
- PSU: does not matter
- RAM: does not matter I guess?
- Disks: does not matter I guess?
- CPU: AMD / Intel - does not matter but I would prefer AMD
- GPU: AMD / Intel / Nvidia - for gaming and Wayland - AMD, for AI, ML, CUDA and other first supported technologies - Nvidia.
And now the most confusing part for me - motherboard… Is there even some coreboot or libreboot motherboard for PC that supports “high end” hardware?
Let’s just say also a purpose of this Linux PC. Choose any of these
- Blender 3D Animation rendering
- Gaming
- Local LLM running
If you have some good resources on this also let me know.
This only matters if you are running large models. If you stick with Mistral sized models you don’t need nearly as much hardware.
These days, there are amazing “middle sized” models like Qwen 14B, InternLM 20B and Mistral/Codestral 22B that are such a massive step over 7B-9B ones you can kinda run on CPU. And there are even 7Bs that support a really long context now.
IMO its worth reaching for >6GB of VRAM if LLM running is a consideration at all.