is there anything like a community driven/contributed open dataset for pre/mid/post training? something like what the big labs have but is open and people can contribute agent tokens (folding@home style) to improving so we get better open models?
was thinking about this recently. a large barrier to entry besides compute of course is a massive high quality clean dataset for pre/mid/post training. seems like an open version of something like this would be super useful for smaller labs who cant afford it or have poor data. if something like th…
Read the full story at r/singularity ↗