Why do we need public data repositories at all? Can’t we just push all the fetching to communication over xrpc?

That doesn't scale for public broadcast. You need the ability to distribute user data to a lot of services across a wide network.