@nicolay

When building finetuning datasets, don't cherry-pick only the "good" examples! Relabel & fix bad ones to cover your full input space. A bit of noise is OK as long as examples are correct on average.

0 reply

0 recast

0 reaction