merged grimjim/HuatuoSkywork-o1-Llama-3.1-8B (i.e. not the above model) with the "decimated" Llama model (i.e. 90% base, 10% instruct) at just 1% to see what happens

chose 1% mainly because i wanted to call it llama-o1-8b-percentum

looking great so far, but still a long way to go

it shows excellent balance in terms of "minimal" instruction following & reasoning ability, without noticeably impacting the randomness & creativity of the base model

the above model would actually be a good one to test against it

my llama-o1-8b-percentum model is impressive to me because it anticipates things that actually happen in the story, but are not easy to extrapolate from the notes i'm giving it

my benchmarks, for now, are nothing more than my taste in literature: can it get to the same conclusions that I did about the characters?

it actually makes me a little emotional when it "gets it"