is the mac mini really that good? running 12-14b models on my radeon rx 7600xt is ok’ish but i do “feel it” while running 7-8b models sometimes just doesn’t feel enough. I wonder where does mac mini land in here.
muppeth
- 0 Posts
- 3 Comments
Joined 2 years ago
Cake day: December 22nd, 2023
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
Wow! very cool rack you got there. I too started using mini pcs for local test servers or general home servers. But unlike yours mine are just dumped behind the screen on my desk (3 in total). For LLM stuff atm I use 16GB radeon but thats connected to my desktop. In the future I would love to build a proper rack like yours and perhaps move the GPU to a dedicated minipc.
As for the upgrades, like what others stated already, I would just go for more pc’s rather then rpi.
Interesting. Is there a non-apple solution like this?