not clear what you are asking for
On the actual OSM website, on the official OSM front-end. https://www.openstreetmap.org/
That, to me, makes it more than "just" a database.
most of them should have their own user-friendly search features
I tried CoMaps, and my search for "bike parking" seems to have worked perfectly...once I figured out the trick to it (which is to ignore all the regular results that come up, and press the small "view on map" icon). Water seemed...less consistent, though that might be because of some weirdness with how things are classified. It led me to notice there seem to be 3 separate ways taps might be labelled... man_made=water_tap (as well as man_made=drinking_fountain), drinking_water=yes, and (the only one I was previously aware of) amenity=drinking_water.
It's more than a little frustrating that this means that unless every editor is consistently applying all three results, different subsets will turn up on any given search. And this is made worse by OSM's front end, while creating a Point, including "water tap" and "drinking water", depending on what you search for.
edit: wait, I found another related tag. fountain=bubbler