Here’s the logic:
wget --mirror --convert-links --adjust-extension --page-requisites --no-parent https://example.com

you are viewing a single comment's thread
view the rest of the comments
[–] 25 points 6 months ago

Are you aware of the Piefed API? It's provided specifically to allow building front-ends and bots while avoiding scrapping.

  • source