Obviously there’s nothing wrong with finding everything first and putting them after but the game isn’t designed as though doing otherwise is playing it wrong
IMO it is, because the objective isn't just to solve all four categories, but also to solve them in order, purple first, yellow last. Which is very hard to do if you don't solve it all first.