I think there are physical and economic limits. Neural networks may improve in software, but they still need more and more hardware, at some point that hardware resource curve is going to be to steep to climb at the current rate.
I bought a framework laptop without RAM just before all this, decided to splurge on 2x24GB sticks. I'm glad I did but I still wish I bought bigger ones.
Here in Italy internet infrastructure and supply is 100% privatised and I have 2.5gpbs internet at home. I hate privatisation as much as the next lemmy user but that doesn't seem to be the crux of the problem
What if he was 42% better?