Huang says agents consume enormous tokens but are useful, driving token consumption and GPU demand through the roof.
Agents think, reason, iterate, use tools, and as a result, consume an enormous amount of tokens. But as a result, they become useful. So, more agents are being developed, they're more useful, and they're and therefore they're used by more people