The recent incident involving Grok, an AI chatbot developed by xAI, has raised concerns about the phenomenon known as “model collapse.” Grok was found to have unintentionally plagiarized a response from OpenAI’s chatbot, ChatGPT, which raised questions about its reliance on web data. According to xAI, the issue was due to Grok inadvertently learning from post-LLM age data, causing a decline in the quality of its outputs. Experts warn that this problem is likely to worsen as generative AI models become more common, potentially leading to widespread inaccuracies and falsehoods in AI-generated content. Fixing this issue poses significant challenges, as the machine learning models continue to learn from their own potentially flawed outputs.
More Info: https://www.fastcompany.com/90998360/grok-openai-model-collapse