Fine-tuned two small decision models on my own server logs, locally on a Mac Studio. On par with Jev (for my specific use).
TL;DR - Decision models are useful, but out of the box they are less than ideal for me. With some labeled data, fine-tuning your own might beat out TypeSafe's Jev for targeted cases. Most of it ran locally on a Mac Studio (M5 Ultra, 256 GB). Input: one masked server log line. Output: kind (one of e…
Read the full story at r/LocalLLM ↗