From 107f93b621ac3829e7aae687ede72473b5dad071 Mon Sep 17 00:00:00 2001 From: dvs1 Date: Sun, 16 Mar 2025 17:59:41 +1000 Subject: Spped things up by not downloading or converting things that didn't change. --- TODO.md | 9 --------- 1 file changed, 9 deletions(-) (limited to 'TODO.md') diff --git a/TODO.md b/TODO.md index ea36e19..518cacc 100644 --- a/TODO.md +++ b/TODO.md @@ -4,15 +4,6 @@ Make it perphekd! ## Do these -Check the timestamps on the files, only update if source is newer than destination. Meh, it's already 600 times faster than the pandoc version. - -- One quirk to watch for is if a URL path changes, the docs that have that URL need to be redone. -- pandoc is a lot slower though, so do this for sure when dealing with that. -- When scraping the web sites, they tend to be dynamically generated with no useful timestamp on them. -- The web site scrape happens locally anyway, I can compare source file timestamps. -- + So check timestamps when "downloading" the original, and before running pandoc on the result. Think that's the most time consuming steps. -- + Since this only stops updates of existing files, URLs changing are not a problem. - Add atom feed for single page. Alas cgit only seems to have ATOM feed on the whole repo, not individual files. - However, once timestamps are sorted, I can use that code to generate (static?) RSS and ATOM feeds, and create page histories using diffs. -- cgit v1.1