Commit graph

93 commits

Author SHA1 Message Date
bc7f47836e Use GPTar table
We expect the disk to be formatted already.
2024-10-04 16:03:54 +02:00
534292ec3f Merge pull request 'Remove unnecessary complexity' (#2) from opam-checksums into main
Reviewed-on: #2
2024-10-03 22:10:08 +00:00
02f9c2f9c7 Remove unnecessary complexity
Opam 2 only supports md5, sha256 and sha512. We don't need the extra
complexity of other hash algorithms. Opam 2 will fail to parse such an
opam file anyway.
2024-10-03 18:10:21 +02:00
a99f7f65a3 Merge pull request 'Upgrade opam-mirror' (#1) from with-new-tar into main
Reviewed-on: #1
2024-10-03 13:42:12 +00:00
6490801ce1 Update dependencies, refactor
- Tar.3.0.0 was released! So we can drop the pin and depend on it
  directly.
- Use digestif in favor of the bygone mirage-crypto hash
- Move most of the hashing logic into archive_checksum.ml
- When checking the checksum we should check the checksum chosen, too. I
  believe this was a bug that was hidden due to opam packages always
  using one of md5, sha256 or sha512 for checksums.
2024-10-03 14:37:37 +02:00
1b1414c5ca Fix the compilation of the unikernel with the last version of ocaml-tar 2024-08-01 13:50:12 +02:00
8fc8f1c62d Update the unikernel with the new version of tar 2024-07-31 14:54:26 +02:00
c2ffbdb891 Update to mirage.4.6.0 2024-07-15 12:22:57 +02:00
e002bf8730 Merge pull request 'Set upper bound on mirage-block-partition' (#29) from partition-bounds into main
Reviewed-on: #29
2024-03-21 10:35:14 +00:00
61be0a3ff5 Set upper bound on mirage-block-partition
In preparation of a breaking change.
2024-03-21 11:24:47 +01:00
b3a74b0c1d Merge pull request 'mirage-kv 6.0.1' (#27) from mirage-kv-6 into main
Reviewed-on: https://git.robur.io/robur/opam-mirror/pulls/27
2023-05-28 14:31:10 +00:00
bbb3d2336a avoid gmp dependency in config.ml -- this is just a dune cache issue 2023-05-27 19:19:27 +02:00
1ebf370a4f compiles now 2023-05-02 16:13:43 +02:00
Robur
fd8ce3be03 more wip 2023-05-02 12:03:25 +00:00
ebeadf69d8 Skip unavailable packages 2023-02-08 16:30:56 +01:00
adf6564385 Print error and exit if we can't get commit id 2023-02-08 16:30:30 +01:00
8c7e71127f Try to remove files before marking for deletion
You know, it might just work...
2023-02-08 16:29:55 +01:00
1a6c6b8f9d Return error on bad checksum when finalizing write 2023-01-31 10:27:25 +01:00
a3128e1de5 Add new hash mismatches 2023-01-26 09:37:17 +01:00
8e326ecbc5 WIP partial writes
If possible, downloads are streamed to disk in the /pending/ directory
in the tar filesystem. If the download is successful and the checksums
match the file is renamed to its sha256 hash. Otherwise, it is moved
under /to-delete/ so it can be deleted by an operator.

Before downloading we check if it has been downloaded before, but we
need to check as well if it is being downloaded (in /pending/) or if we
unsuccessfully downloaded it before (e.g. failed checksum, stored in
/to-delete/).

It is not very elegant code, and it could do with a thorough review or
rewrite.
2023-01-25 11:34:31 +01:00
b76f2997f5 Migrate to mirage-kv 6 2023-01-23 09:13:42 +01:00
93c490bcb5 Update to mirage.4.3.1 and its alpn_client 2023-01-20 14:46:22 +01:00
c46f15baa3 Merge pull request 'Log before and after restoring/fetching git state' (#26) from log-before-git-operation into main
Reviewed-on: https://git.robur.io/robur/opam-mirror/pulls/26
2022-11-17 12:30:07 +00:00
b0eb816a68 Log before and after restoring/fetching git state
This may take quite a while, and the application is unresponsive
meanwhile.
2022-11-17 12:12:15 +01:00
22da980482 git-kv is released now, no need for the pin anymore 2022-11-04 10:24:58 +01:00
2f8fba436c Merge pull request 'update for the released http-mirage-client' (#25) from http-mirage-client-released into main
Reviewed-on: https://git.robur.io/robur/opam-mirror/pulls/25
2022-11-03 12:25:04 +00:00
c6e8c6cf77 update for the released http-mirage-client 2022-11-02 22:19:03 +01:00
878ecab0b2 Merge pull request 'if --verify is passed, don't use the md5s/sha512s from disk, instead re-create them' (#24) from trash-md5-sha512-on-verify into main
Reviewed-on: https://git.robur.io/robur/opam-mirror/pulls/24
2022-10-28 12:59:33 +00:00
d143e9b766 as suggested by @reynir: verify -> verify_sha256 2022-10-28 14:58:58 +02:00
1ff5c7e1b6 if --verify is passed, don't use the md5s/sha512s from disk, instead re-create them 2022-10-28 13:57:30 +02:00
062f4d048d Merge pull request 'Add a boot argument to ignore the local git state' (#21) from ignore-local-git into main
Reviewed-on: https://git.robur.io/robur/opam-mirror/pulls/21
2022-10-26 16:33:25 +00:00
0d5745b340 Add a boot argument to ignore the local git state 2022-10-26 18:32:43 +02:00
0e048549a1 Merge pull request 'Upgrade opam-mirror with last release of git and new version of git-kv' (#23) from upgrade into main
Reviewed-on: https://git.robur.io/robur/opam-mirror/pulls/23
2022-10-26 16:32:14 +00:00
c4a95d9614 hex comes from git_http but it is used by the application, it's better to depend on it explicitely 2022-10-21 18:02:09 +02:00
7d1c9b0814 Fix the compilation of opam-mirror with lastest version of packages 2022-10-21 15:56:20 +02:00
7d3ab77494 Use the last release of tar-mirage 2022-10-21 15:35:15 +02:00
5f761b38fb Upgrade opam-mirror with last release of git and new version of git-kv 2022-10-20 16:09:05 +02:00
fdbce68140 require paf 0.2.0+ 2022-10-05 14:27:37 +02:00
f3478aea02 Merge pull request 'adapt to new paf' (#20) from paf-02 into main
Reviewed-on: https://git.robur.io/robur/opam-mirror/pulls/20
2022-10-05 12:26:51 +00:00
e177cb156d adapt to new paf 2022-09-29 14:40:50 +02:00
1b86e6de78 remove pin of mirage-block-partition and oneffs (now in opam) 2022-09-29 00:12:42 +02:00
32812be82b Merge pull request 'Rename partition devices so they are shadowed' (#19) from refactor-partition-naming into main
Reviewed-on: https://git.robur.io/robur/opam-mirror/pulls/19
2022-09-28 13:00:41 +00:00
3e946395aa Rename partition devices so they are shadowed 2022-09-28 11:18:17 +02:00
9b02dfdd88 solo5-elftool fixed now 2022-09-28 10:41:46 +02:00
fd94550434 Merge pull request 'use git-kv on store to dump and restore the git commit' (#17) from also-store-git into main
Reviewed-on: https://git.robur.io/robur/opam-mirror/pulls/17
2022-09-27 20:44:04 +00:00
c6feb78653 more failures 2022-09-27 19:02:17 +02:00
b9003fb91d add a list of urls not to try to download (since they fail or have bad checksums) 2022-09-27 18:56:08 +02:00
5e427897be use git-kv on store to dump and restore the git commit 2022-09-27 17:24:37 +02:00
83d494c433 Merge pull request 'read the data in chunks and send them chunk-wise' (#16) from partial-read into main
Reviewed-on: https://git.robur.io/robur/opam-mirror/pulls/16
2022-09-27 14:54:36 +00:00
8bdfb19e6f use read_partial in init as well for checksum computation 2022-09-27 16:25:57 +02:00