ChatGPT has been a game changer for school essays
I learn through online school in a small city without about 300 students, classes cycle every 3 weeks, English for the first semester opening up just about when ChatGPT launched. So, I decided to see how it, along with Quillbot would fare. The teacher fr called to congratulate me for being one of the best writers he's taught and my mom was so proud. Was just sitting there trying so hard not to laugh. AI really is to essays what Calculators were to math
I learn through online school in a small city without about 300 students, classes cycle every 3 weeks, English for the first semester opening up just about when ChatGPT launched. So, I decided to see how it, along with Quillbot would fare. The teacher fr called to congratulate me for being one of the best writers he's taught and my mom was so proud. Was just sitting there trying so hard not to laugh. AI really is to essays what Calculators were to math
🥰4👍1
Using some publicly available data, and assuming each of these models are trained in a similar way Chinchilla was, we can compare the performance of GPT-4 to GPT-2, GPT-3, Chinchilla, and PaLM.
Let's calculate what GPT-4's performance would be if it used 10x more parameters without retrieval, and naively assume that will be its performance with retrieval. This chart is what we get.
With the algorithmic adjustment, the qualitative improvement from GPT-3 (vanilla) to GPT-4 is comparable to the improvement from GPT-2 to GPT-3. Since that was a rather big jump, I expect many will be stunned by GPT-4, especially those who expected strong diminishing returns.
Let's calculate what GPT-4's performance would be if it used 10x more parameters without retrieval, and naively assume that will be its performance with retrieval. This chart is what we get.
With the algorithmic adjustment, the qualitative improvement from GPT-3 (vanilla) to GPT-4 is comparable to the improvement from GPT-2 to GPT-3. Since that was a rather big jump, I expect many will be stunned by GPT-4, especially those who expected strong diminishing returns.