… I figured if I constrained it I could make this a framework/toolkit.
I’m well on the way with this! I have a nice CLI scraping tool. Grabs and saves all the JSON.
In theory I can just layer my little web app code on top and be done! Yay!
However, I recently found Pagefind – a static site search library: https://pagefind.app/
I wanted to integrate this. BUT it crawls HTML pages.
So I’m wondering if I need to to save and serve HTML instead of JSON.