revise startup, address urls pointing to same sha256 and support mirrors (upstream and in opam file) #24

Merged

hannes merged 7 commits from startup into main

2024-11-20 10:38:22 +00:00

Author	SHA1	Message	Date
Reynir Björnsson	a9c249ea86	Use Map.fold over List.fold_left ... (Map.bindings _)	2024-11-19 16:26:02 +01:00
Reynir Björnsson	ec45a6a77a	Prioritize mirrors over upstream caches Also expand on the semantics of --upstream-cache.	2024-11-19 16:04:08 +01:00
Hannes Mehnert	62d62420b7	remove some logs	2024-11-14 19:39:38 +01:00
Hannes Mehnert	da4533c2d3	uniquify urls in respect to sha256 checksums (#21 ) this reduces 19139 urls down to 18563 urls	2024-11-14 19:25:14 +01:00
Hannes Mehnert	6a0ae2bcab	take mirrors into account (#13 ) and allow upstream-caches (#5 ) This is done by introducing a set of alternative download locations.	2024-11-14 17:40:22 +01:00
Hannes Mehnert	c376a4b70e	checked: do on file-by-file basis, incrementally	2024-11-14 16:58:20 +01:00
Hannes Mehnert	4481923ade	revise startup (as proposed in #18 ): - recover git (from disk or download) - make index.tar.gz - start web service - check disk (unless skip-verify-sha256) - dump git state - start downloads - enable update job, and hook	2024-11-14 16:36:10 +01:00