OpenAI, Google, Anthropic admit they can’t scale up their chatbots any further
Lol, no they didn't. The quotes this articles are using are talking about LLMs not chatbots. This is yet another stupid article from someone who doesn't understand the technology. There is a lot of legitimate criticism for the way this technology is being implemented but FFS get the basics right at least.
I had a really good friend on MySpace that I lost touch with. I think he was a little paranoid, we didn't speak much and he was always looking over his shoulder. His name was Tom.
largely based on the notion that LLMs will, with continued scaling, become artificial general intelligence
Who said that LLMs were going to become AGI? LLMs as part of an AGI system makes sense but not LLMs alone becoming AGI. Only articles and blog posts from people who didn't understand the technology were making those claims. Which helped feed the hype.
I 100% agree that we're going to see an AI market correction. It's going to take a lot of hard human work to achieve the real value of LLMs. The hype is distracting from the real valuable and interesting work.
We need shared definitions to tell meaningful stories with our data. And then use a company specific example like how a customer's journey can not be understood with differing definition between marketing and sales. The marketing team can't measure the quality of the leads they're producing unless they can directly link a customer's whole journey from acquisition to churn. Otherwise it's just vanity metrics. But don't be too harsh, vanity metrics are really common in business. A company needs strong data leadership to create a culture of using data to justify decisions to a culture of using data to inform decisions.
Maybe this is outside of the thought experiment but I would focus on digitization. Text compresses very well and you can fit 100Gb on a CD sized disc with an estimated 50+ years lifespan (m-disc). So you could easily fit over 30 million text only books on a single 100 disc spindle which is the size of 3 small physical books. Add some redundancy and it might be 25 million books. Books with images would be slightly less compressible but you could still fit 100s of thousands on a single spindle with redundancy. Get yourself a small bar sized wine fridge to control humidity and you could probably fit every book every made in there.
This all assumes you want to preserve the content of the books and not the books themselves. You obviously can't digitize every aspect of a physical book like the ornate artwork on the spine etc. in which case I would focus my preserving efforts on those books and digitize everything else.
I was watching a bald eagle fishing yesterday from my window. They must have moved in to the area, bay of quinte in Ontario, which is good news for their numbers.
Generative AI is great for loads of programming tasks like helping create regular expressions or syntax conversions between languages. The main issue I've seen in codebases that rely heavily on generative AI is that the "solutions" often fix today's bug while making future debugging more difficult. Generative AI makes it easy to go fast in the wrong direction. Used right it's a useful tool.
Lol, no they didn't. The quotes this articles are using are talking about LLMs not chatbots. This is yet another stupid article from someone who doesn't understand the technology. There is a lot of legitimate criticism for the way this technology is being implemented but FFS get the basics right at least.