Sector based unions would be concentrating too much power, this leads to corruption. Unions are a response to the power of large companies, not every business is a large corporation and unions aren't required in many cases. And how would that even work? People are required to be in a union even if they don't want to be?
If you have a bunch of small businesses in a community workers have the option to work for another company if they feel their workplace is treating them unfairly. Now add a monolithic union that everyone is required to be a part of, there's now a union that can bully the small businesses. This creates an uneven power dynamic, and you essentially just have a massive union that's running these businesses. It wouldn't be any different from a large corporation taking over the small businesses.
Large monolithic entities tend to be prone to corruption. There's just too much money involved for that not to be the case. A company could offer a life changing amount of money to some key people in the union leadership so they look the other way about how they do things, and maybe be a little more harsh towards their competitors. When there's too much money involved all kinds of corruption becomes possible while if it's a smaller union a company is probably better off just paying the workers more money and improving working conditions rather than bribing the union leadership.
If a 1 dollar per hour pay increase is going to cost an industry billions of dollars, it becomes very tempting to pay some bribes to avoid paying those billions. If a pay increase is going to cost a company a few million, they're more likely to pay that money to the workers rather than attempting to bribe the union leadership.