Nonsense is a more effective organizing tool than the truth.
Anyone can believe in the truth.
But to believe in nonsense is an unforgeable demonstration of loyalty. It serves as a uniform, and if you have a uniform, you have an army.
Anyone can believe in the truth.
But to believe in nonsense is an unforgeable demonstration of loyalty. It serves as a uniform, and if you have a uniform, you have an army.
👍11🤡3🤣3❤1👏1🤓1
Karpathy’s “Baby GPT” Experiment
This is a baby GPT with two tokens 0/1 and context length of 3, viewing it as a finite state markov chain. It was trained on the sequence "111101111011110" for 50 iterations. The parameters and the architecture of the Transformer modifies the probabilities on the arrows. Nodes represent text inputs and ouputs at each step.
Google Colab
This is a baby GPT with two tokens 0/1 and context length of 3, viewing it as a finite state markov chain. It was trained on the sequence "111101111011110" for 50 iterations. The parameters and the architecture of the Transformer modifies the probabilities on the arrows. Nodes represent text inputs and ouputs at each step.
Google Colab
👍12❤2🔥2
“Bing tried to email me”
“Cosplaying a conversation” — Finally a name we can use to refer to the failure mode where these LLMs pretend to have done some external action, when they don’t actually have the ability to do that external action at all?
“Cosplaying a conversation” — Finally a name we can use to refer to the failure mode where these LLMs pretend to have done some external action, when they don’t actually have the ability to do that external action at all?
👍5❤1