The productivity increases are real for office work. Absolutely not for 'generative' tasks - using them to do anything that takes a modicum of thought is a recipe for frustration and burned time - but they make pretty good search engines for unstructured information.
Now, you don't need a whole-ass model for that, a vector database would do just fine, but since everyone rushed to hook the models in to all their repos and internal wikis it is a convenient omni-search tool.
Now was that worth all the bullshit over the last 4 years as the bubble inflated? Not at all. But it is a real use case and has real value.
I even have leaders now pushing everyone to keep their docs up to date and to make sure tables have metadata fields and such so that agents can make best use of the information. This is particularly hilarious to me because they didn't care to make this investment when people would benefit, but doing it now makes my life easier anyway.