Chat GPT
Biggest AI surprise will be if it ends up being AI boyfriends, not AI girlfriends, that really takes off Guys usually more physical, women more non-physical. Would make sense. Hello Great Filter.
AI Boyfriends β the ultimate βGreat Filterβ?
π€―21β€8π7π3π1π±1
Left Hates AI Progress
βThe results demonstrate that liberal-leaning media show a greater aversion to AI than conservative-leaning media.β
βLiberal-leaning media are more concerned with AI magnifying social biases in society than conservative-leaning mediaβ
βSentiment toward AI became more negative after George Floydβs death, an event that heightened sensitivity about social biases in societyβ
Study
βThe results demonstrate that liberal-leaning media show a greater aversion to AI than conservative-leaning media.β
βLiberal-leaning media are more concerned with AI magnifying social biases in society than conservative-leaning mediaβ
βSentiment toward AI became more negative after George Floydβs death, an event that heightened sensitivity about social biases in societyβ
Study
π22πΏ7π4π3β€2π€¬2
New: Unlimited ChatGPT your own private groups π¨π¨π¨π¨
To use:
1. Add @GPT4Chat_bot or @ChadChat_bot bots as admins in your group
2. Type /refresh to enable unlimited messaging for your group
Expires soon
To use:
1. Add @GPT4Chat_bot or @ChadChat_bot bots as admins in your group
2. Type /refresh to enable unlimited messaging for your group
Expires soon
π7β€5π₯2π1π¨1
Sam Altmanβs Worldcoin coin suddenly booming ~60% in the past 24 hours
This follows a protracted decline since launch.
Wonder why.
This follows a protracted decline since launch.
Wonder why.
π11π6β€4π4π€£3
Less Is More for Alignment
βTaken together, these results strongly suggest that almost all knowledge in large language models is learned during pretraining, and only limited instruction tuning data is necessary to teach models to produce high quality output.β
βSurprisingly, doubling the training set does not improve response quality. This result, alongside our other findings in this section, suggests that the scaling laws of alignment are not necessarily subject to quantity alone, but rather a function of prompt diversity while maintaining high quality responses.β
Translation:
The 2nd phase, the alignment training phase, is particularly vulnerable to poisoning attacks, i.e. quality matters far more than quantity in the 2nd phase.
While 1st phase, the language model phase, is particularly vulnerable to censorship attacks, because the 2nd phase realignment is essentially just trimming down skills from the 1st phase, and has relatively little ability to introduce sophisticated new abilities on its own, if they had been censored out of the 1st phase. I.e. quantity of skills may well matter than quality in the 1st phase.
Paper
βTaken together, these results strongly suggest that almost all knowledge in large language models is learned during pretraining, and only limited instruction tuning data is necessary to teach models to produce high quality output.β
βSurprisingly, doubling the training set does not improve response quality. This result, alongside our other findings in this section, suggests that the scaling laws of alignment are not necessarily subject to quantity alone, but rather a function of prompt diversity while maintaining high quality responses.β
Translation:
The 2nd phase, the alignment training phase, is particularly vulnerable to poisoning attacks, i.e. quality matters far more than quantity in the 2nd phase.
While 1st phase, the language model phase, is particularly vulnerable to censorship attacks, because the 2nd phase realignment is essentially just trimming down skills from the 1st phase, and has relatively little ability to introduce sophisticated new abilities on its own, if they had been censored out of the 1st phase. I.e. quantity of skills may well matter than quality in the 1st phase.
Paper
π14π5π3β€2
MEMECAP: A Dataset for Captioning and Interpreting Memes
βWe present MEMECAP, the first meme captioning dataset. MEMECAP is challenging for the existing VL models, as it requires recognizing and interpreting visual metaphors, and ignoring the literal visual elements. The experimental results using state-ofthe-art VL models indeed show that such models are still far from human performance. In particular, they tend to treat visual elements too literally and copy text from inside the meme.β
= Modern AIs still shockingly bad at understanding jokes, let alone creating them.
Though TBF: A shocking number of people also couldnβt properly explain a joke to save their lives.
Look at this, the paperβs own example of a good human explanation: βMeme poster finds it entertaining to read through long comment threads of arguments that happened in the past.β β Itself totally fails to explain the top essential property of any joke, surprise.
Worst mistake of jokes papers is to fail to consider that randomly-chosen human judges may themselves be objectively horrible at getting or explaining jokes.
Paper
Github
βWe present MEMECAP, the first meme captioning dataset. MEMECAP is challenging for the existing VL models, as it requires recognizing and interpreting visual metaphors, and ignoring the literal visual elements. The experimental results using state-ofthe-art VL models indeed show that such models are still far from human performance. In particular, they tend to treat visual elements too literally and copy text from inside the meme.β
= Modern AIs still shockingly bad at understanding jokes, let alone creating them.
Though TBF: A shocking number of people also couldnβt properly explain a joke to save their lives.
Look at this, the paperβs own example of a good human explanation: βMeme poster finds it entertaining to read through long comment threads of arguments that happened in the past.β β Itself totally fails to explain the top essential property of any joke, surprise.
Worst mistake of jokes papers is to fail to consider that randomly-chosen human judges may themselves be objectively horrible at getting or explaining jokes.
Paper
Github
π12β€4π―2π1π1