We are in kind of a catch-22 right now, where you need to be as big as Google in order to index the web. Which means anybody else can't.
I occasionally get frustrated that Google can't show me News about the fire that started an hour ago etc., but when we think about it we can see why not.
Billions of pages can't really be up to date within an hour.
(One possible outcome is that we see smaller and smaller fractions of the actual web.)