Push notifications would be a natural next step, yes. In general, the idea is roughly similar to that „strangers help a blind person in an ad-hoc way“ network, where non-blind people could could sign up to get routed to requests from blind people who for example need feedback on their outfit.

For Ask-a-Human, the presentation is satire, but the implementation is completely serious and actually made to scale.

However, as with social networks, you need some kind of network effect: no agents asking questions means no humans signing up for answering them, no humans signing up for answering them means no agents asking questions etc.

I know a thing or two about building software, but I‘m notoriously bad at creating traction, so it will probably go nowhere. I‘ve released it as a ClawdBot/OpenClaw skill though, maybe there’s some resonance from this direction.

I agree with this framing a lot, especially the idea that judgment is the bottleneck

In my experience building Persona, an AI scheduling assistant, the most useful role for humans isn't to be always in the loop. LLM's are terrible at making judgement calls, especially when the right choice depends on a specific user's priorities and the confidence is low. However, even with low confidence, the llm still needs to make a guess.

I think an interesting use case for this would be to have llm's be able to ask questions to users when they hit a specific level of uncertainty. These could be directly answered by a human, or inferred as the user uses the product more.

That feels more scalable than completely blocking human-in-the-loop queues and more honest than pretending the model already knows the user’s preferences.