Hannes Mehnert hannes
  • Joined on 2024-08-21
hannes commented on issue robur/opam-mirror#5 2024-11-20 10:38:51 +00:00
Idea: Be able to use one or more upstream caches

done in #24

hannes closed issue robur/opam-mirror#5 2024-11-20 10:38:51 +00:00
Idea: Be able to use one or more upstream caches
hannes pushed to main at robur/opam-mirror 2024-11-20 10:38:24 +00:00
2edc311a33 Merge pull request 'revise startup, address urls pointing to same sha256 and support mirrors (upstream and in opam file)' (#24) from startup into main
a9c249ea86 Use Map.fold over List.fold_left ... (Map.bindings _)
ec45a6a77a Prioritize mirrors over upstream caches
62d62420b7 remove some logs
da4533c2d3 uniquify urls in respect to sha256 checksums (#21)
Compare 8 commits »
hannes deleted branch startup from robur/opam-mirror 2024-11-20 10:38:24 +00:00
hannes merged pull request robur/opam-mirror#24 2024-11-20 10:38:22 +00:00
revise startup, address urls pointing to same sha256 and support mirrors (upstream and in opam file)
hannes commented on pull request robur/git-kv#5 2024-11-20 10:22:30 +00:00
of_octets: create ring buffer earlier to avoid missing data

still remaining is an issue that git-kv restore takes ~30 minutes for opam-repository on my laptop... I'd hope we can get a 100x speedup somehow ;)

hannes commented on issue robur/opam-mirror#23 2024-11-20 09:34:41 +00:00
invalid pack file
hannes closed issue robur/opam-mirror#23 2024-11-20 09:34:41 +00:00
invalid pack file
hannes created pull request robur/git-kv#5 2024-11-20 09:34:30 +00:00
of_octets: create ring buffer earlier to avoid missing data
hannes created branch fix-of-octets in robur/git-kv 2024-11-20 09:33:16 +00:00
hannes pushed to fix-of-octets at robur/git-kv 2024-11-20 09:33:16 +00:00
bcd49ccfcf of_octets: create ring buffer earlier to avoid missing data
hannes commented on pull request robur/opam-mirror#24 2024-11-19 14:03:00 +00:00
revise startup, address urls pointing to same sha256 and support mirrors (upstream and in opam file)

We keep the url in the map as key, and just carry around a set of other urls for the same artifact.

Not sure whether it is worth to have the url as key in the map anymore, though we discovered…

hannes commented on pull request robur/opam-mirror#24 2024-11-19 14:01:27 +00:00
revise startup, address urls pointing to same sha256 and support mirrors (upstream and in opam file)

Indeed, currently it is a List.fold_left of "HM.bindings hm". So yes, this could be nicer code. :)

hannes commented on pull request robur/opam-mirror#24 2024-11-19 14:00:23 +00:00
revise startup, address urls pointing to same sha256 and support mirrors (upstream and in opam file)

And please feel free to push the documentation updates directly to the branch.

hannes commented on issue robur/opam-mirror#19 2024-11-19 13:59:03 +00:00
swapfs error handling: not enough space

I think we need a rethink about failure behaviour and (recoverable) errors...

There's not only the swapfs, but then we have mimic errors "no connection found" (which I guess we should retry to…

hannes commented on pull request robur/opam-mirror#24 2024-11-19 13:54:57 +00:00
revise startup, address urls pointing to same sha256 and support mirrors (upstream and in opam file)

actually, if I'm not misguided, we first go to the source, and only thereafter to mirror(s). Is this a good semantics?

hannes pushed to startup at robur/opam-mirror 2024-11-14 18:39:44 +00:00
62d62420b7 remove some logs
hannes commented on pull request robur/opam-mirror#24 2024-11-14 18:34:37 +00:00
revise startup, address urls pointing to same sha256 and support mirrors (upstream and in opam file)

not doing upstream csums here since we did that for the previous entry already. downside is if there's an artifact that has some hashes in some file, and more hashes in another file, we won't get the other hashes.

hannes commented on pull request robur/opam-mirror#24 2024-11-14 18:33:22 +00:00
revise startup, address urls pointing to same sha256 and support mirrors (upstream and in opam file)

this code, using a global hashtable, is ugly and should be revised.

hannes pushed to startup at robur/opam-mirror 2024-11-14 18:25:38 +00:00
da4533c2d3 uniquify urls in respect to sha256 checksums (#21)
6a0ae2bcab take mirrors into account (#13) and allow upstream-caches (#5)
Compare 2 commits »