@evereet
About a year ago, OpenAI researchers hit on a new way of improving these models. Instead of letting them respond to queries immediately, the researchers allowed the models to run for a period of time and “reason” in natural language about their answers. This required more computing power but produced better results. Suddenly a market boomed for mathematicians, physicists, coders, chemists, lawyers, and others to create specialized data, which companies used to reinforce their AI models’ reasoning. The chatbots got smarter.