Some guys seriously thinking ChatGPT can decode LZ4 compression ๐
But is it as crazy as it sounds? Mixed.
Gwernโs adds:
โA fun idea, but it seems like it ought to backfire: a Transformer model is feedforward, so it only has so many layers to 'think'; if it's spending those layers decoding compressed strings (which is amazing if it can), it doesn't have any 'time' to think about whatever abstract form it decodes the inputs to, and it definitely doesn't have time to combine a de facto huge context window to reason over it.
Now, a more interesting idea might be to see if you can train a Transformer on compressed strings to make it native, and maybe tradeoff some width for depth. There's some slight analogies in image generation to training on Fourier components (like JPEG) rather than pixels. But AFAIK no one has experimented with heavy duty compression inputs for regular natural language generation.โ
But is it as crazy as it sounds? Mixed.
Gwernโs adds:
โA fun idea, but it seems like it ought to backfire: a Transformer model is feedforward, so it only has so many layers to 'think'; if it's spending those layers decoding compressed strings (which is amazing if it can), it doesn't have any 'time' to think about whatever abstract form it decodes the inputs to, and it definitely doesn't have time to combine a de facto huge context window to reason over it.
Now, a more interesting idea might be to see if you can train a Transformer on compressed strings to make it native, and maybe tradeoff some width for depth. There's some slight analogies in image generation to training on Fourier components (like JPEG) rather than pixels. But AFAIK no one has experimented with heavy duty compression inputs for regular natural language generation.โ
๐4
AI Humor Gap:
Do Androids Laugh at Electric Sheep?
Humor โUnderstandingโ Benchmarks from The New Yorker Caption Contest
โWe demonstrate that todayโs vision and language models still cannot recognize caption relevance, evaluate, or explain The New Yorker Caption Con- test as effectively as humans canโ
https://arxiv.org/pdf/2209.06293.pdf
Do Androids Laugh at Electric Sheep?
Humor โUnderstandingโ Benchmarks from The New Yorker Caption Contest
โWe demonstrate that todayโs vision and language models still cannot recognize caption relevance, evaluate, or explain The New Yorker Caption Con- test as effectively as humans canโ
https://arxiv.org/pdf/2209.06293.pdf
๐2๐ฉ1
Media is too big
VIEW IN TELEGRAM
ChatGPT/GPT3 Siri Replacement
Who wants to talk to GPT3?
Hereโs an Apple Shortcut template to speak your prompt, and have Siri read back completion.
Youโll need an iPhone, scriptableappโฉ, and your own OpenAI api key (add to Script block).
OpenAI API key:
https://beta.openai.com/account/api-keys
Siri Shortcut:
https://www.icloud.com/shortcuts/08b02bf88171454387dd4e44539d575b
Who wants to talk to GPT3?
Hereโs an Apple Shortcut template to speak your prompt, and have Siri read back completion.
Youโll need an iPhone, scriptableappโฉ, and your own OpenAI api key (add to Script block).
OpenAI API key:
https://beta.openai.com/account/api-keys
Siri Shortcut:
https://www.icloud.com/shortcuts/08b02bf88171454387dd4e44539d575b
โค2๐2๐ฅ2
This media is not supported in your browser
VIEW IN TELEGRAM
GPT-Siri
โtell me everything about large language models.โ
โtell me everything about large language models.โ
๐6
Want to try ChatGPT now?
To use:
1. Join the group
2. Type "/ask ___โ for ChatGPT, or
3. Type โ/chad ___โ for CHAD GPT
https://t.iss.one/LLMchat
To use:
1. Join the group
2. Type "/ask ___โ for ChatGPT, or
3. Type โ/chad ___โ for CHAD GPT
https://t.iss.one/LLMchat
๐8๐ฉ5๐ฅ3โค1๐1๐คฌ1๐1๐ก1
Want to try ChatGPT now?
Want to help train CHAD GPT, the based ChatGPT?
1. Join the group
2. Type "/ask ___โ with your question for ChatGPT, or
3. Type โ/chad ___โ with your question for CHAD GPT
Try the same questions on both.
See if you can trip them up with trick questions.
CHAD GPT learns from YOU.
๐จ Be a part of training CHAD GPT. ๐จ
Want to help train CHAD GPT, the based ChatGPT?
1. Join the group
2. Type "/ask ___โ with your question for ChatGPT, or
3. Type โ/chad ___โ with your question for CHAD GPT
Try the same questions on both.
See if you can trip them up with trick questions.
CHAD GPT learns from YOU.
๐จ Be a part of training CHAD GPT. ๐จ
๐14โค3๐3๐คฌ1๐ฉ1๐คก1๐ก1