How would you set up a local environment with one 128 GB RAM Max 3 MacBook Pro and another 128 GB RAM Max 5 MacBook Pro?
I now have both MBPs and was thinking about hosting some 27B Q8 models. Unfortunately, as far as I know, EXO is not an option when the two are not using the same hardware (Thunderbolt 4 and 5, respectively). I would like to know your thoughts about it, thanks in advance.
Read the full story at r/LocalLLM ↗