My VPS has S3 bucket compatibility (Not an Amazon VPS btw)

I'm looking to store files, mostly videos, photos, and document files. Are there any good apps for connecting and using S3 buckets for this?

The reason I want to use buckets its because they're cheaper than me paying for a full VPS, and less time and for me managing cloud storage software such as Nextcloud.

I found Owlfiles for Android to look awesome but is not FOSS.

Cyberduck FOSS and for computers (I'm using Linux), but doesn't give media previews like Owlfiles.

I'm looking replacement for both of these would be appreciated.