I wish Prowlarr supported having a pool of generic indexers that are regularly speed tested and only the top X are used for actual queries (one random query an hour to check response time shouldn't hurt, and external searches can also provide for this statistic), either based on count/percentage or maximum response time.
That would alleviate the long queries on a very dynamic approach.