notdevin

Gary Marcus argues that LLMs aren’t as good as a calculator based on their inconsistencies. I’m not convinced the tool Gary is thinking about is the same tool as what an LLM is useful for. It could be true that his ideal model is absolutely better but based on the way he’s so afraid of things given the words he uses, I doubt it

Gary Marcus argues that LLMs aren’t as good as a calculator based on their inconsistencies. I’m not convinced the tool Gary is thinking about is the same tool as what an LLM is useful for. It could be true that his ideal model is absolutely better but based on the way he’s so afraid of things given the words he uses, I doubt it

https://open.spotify.com/episode/7DGxH45T1S6iuVMdS88D1k?si=ZYMk-3XiRfmas9BxcSvVbQ&t=756&context=spotify%3Aplaylist%3A37i9dQZF1FgnTBfUlzkeKt

Catch me on X, notifications are off here 
@devinjelliot

What if the inconsistencies with LLMs are sorted out, I doubt there will be any comparison whatsoever

Medical student || music lover || Artist ||nature lover|| Food Lover. 🌸

I don’t think you can sort out the inconsistencies and still have a useful model. How do you mean sort out here?

Why Is Gary being really optimistic about AGI happening.. I feel he doesn’t really know how things work, because if he does clearly, he would know it is complex and mythical and also let’s keep being hopeful on RAG and chain of thoughts to smooth things out

Models are trying to predict the next tokens to a prompt, almost by definition, prompts are missing some amount of data -> “take that to the table over there” in the context of a restaurant = N number of humans at table getting food(this is the data that’s missing in my example)

Our spoken language isn’t a formal language, in the technical sense, so there is no absolute mapping of words to meaning -> non deterministic answers. RAG and Chain of Thought clearly help to smooth over these issues. This is why I don’t understand why Gary Marcus takes this view. Also relates to why I think AGI is a poor conjecture

Oh I thought the inconsistencies could be resolved .. didn’t know the usefulness of the model relies on it inconsistencies