@6ktrzw9ad
Neural networks start by focusing on word order.
After enough training, they suddenly shift to understanding meaning instead.
This rapid "phase transition" is like water turning to steam.
Discovering this hidden switch helps explain how models like ChatGPT learn.
It also suggests ways to improve their efficiency and safety.
0 reply
0 recast
0 reaction