nrabulinski/attic
1
1
Fork 1
Code Issues Pull requests Packages Projects Releases Wiki Activity
%!d() commits 1 branch 0 tags 746 KiB
Commit graph

74 commits

Author SHA1 Message Date
Zhaofeng Li 443ceac40f server: Upsert object row on conflict 
Upsert instead of doing delete+insert or ignoring the specific error.

Fixes #132.
 2024-08-13 07:39:38 -06:00
Cole Helbling 903fb4e39e fixup: stream error logging 
The call to `into_inner()` discards the wrapper type constructed by
`map_err()`. So instead, `map_err()` the actual stream, and call
`Body::from_stream` on the wrapped stream.
 2024-07-26 10:21:52 -07:00
A cursed quail 759dbc9f7e
sqlite-specific performance tuning 2024-06-08 22:05:37 -05:00
Zhaofeng Li 14cb5f9e46 Trivial semver-incompatible upgrades 2024-06-01 13:47:27 -06:00
Zhaofeng Li 9a6b2cbf1d server: Upgrade aws-sdk-rust 2024-06-01 13:47:27 -06:00
Zhaofeng Li bc22e00a3b server: Upgrade to Axum 0.7 2024-06-01 13:47:27 -06:00
Zhaofeng Li 0558269391
Merge pull request #137 from cole-h/log-stream-errors 
Log stream errors
 2024-06-01 08:17:54 -06:00
Cole Helbling a4f2cae9dd Log stream errors 2024-05-28 11:32:43 -07:00
Parnell Springmeyer d3ffcf885c
Choose a more sensible limit for MySQL, suggested by @baloo 2024-02-28 14:06:31 -08:00
Parnell Springmeyer 2705d1d90b
Limit the chunk finding query, not the GC mark query 2024-02-28 12:53:27 -08:00
Parnell Springmeyer 47f17e0900
gc.rs: LIMIT number of orphan_chunk_ids; fixes #115 2024-02-28 10:37:36 -08:00
Zhaofeng Li 9a9e2c0ce1
Merge pull request #98 from Mic92/sharding 
implement sharding
 2024-01-01 09:17:18 -07:00
Zhaofeng Li 7b133bca83 server: Upgrade sea-orm to 0.12.10 
Co-authored-by: Francesco Gazzetta <fgaz@fgaz.me>
 2023-12-18 09:28:58 -07:00
Zhaofeng Li ab4040a267 Trivial semver-incompatible upgrades 
Co-authored-by: Francesco Gazzetta <fgaz@fgaz.me>
 2023-12-18 09:28:43 -07:00
Zhaofeng Li 9c79f6f5cb server: Upgrade aws-sdk-rust 
Co-authored-by: Francesco Gazzetta <fgaz@fgaz.me>
 2023-12-18 09:28:43 -07:00
Cole Helbling 26234c294a cargo fmt 2023-12-18 09:28:43 -07:00
Jörg Thalheim 484e38094c implement sharding 
didn't actually tested the code
 2023-11-11 07:37:17 +01:00
Zhaofeng Li f4cf5704d6 Fix lint 
get_or_insert_permission_mut returns a mut reference.

Fixes #77.
 2023-08-13 18:23:30 -06:00
Travis Staton 91d8bd5cdc
fix chunk deletion bug 
fetch all deleted chunks, not just the ones that just transitioned
 2023-06-25 13:51:26 -04:00
Zhaofeng Li 564b4be0f9 Update sea-orm to 0.11.3 
This commit drops support of Nixpkgs 22.11. Users should upgrade to
23.05 or use the pinned nixpkgs version in the flake.
 2023-06-12 18:52:16 -06:00
Zhaofeng Li 2d0aeefd2f Trivial semver-incompatible upgrades 2023-05-28 15:23:45 -06:00
Zhaofeng Li 1b980a9640 server: Upgrade async-compression 2023-05-28 15:23:45 -06:00
Zhaofeng Li 1a0116fee8 server: Upgrade aws-sdk-rust 2023-05-28 15:23:45 -06:00
Zhaofeng Li 6489d775ae Update deps 2023-05-28 15:23:45 -06:00
Charlotte 🦝 Delenk c686b2c1ea
Increase narinfo size limit to 1MiB 
I was still encountering failures due to narinfo files being too large,
even with the increased 64kiB limit. This commit increases it to 1MiB
which is hopefully larger than any “reasonable” derivation, while also
not being too large for the server to keep in memory at once.
 2023-04-06 10:03:00 +01:00
Zhaofeng Li 94a1d44a10 server: Only read PUT payload up to the claimed size 2023-03-21 18:45:34 -06:00
Zhaofeng Li ba8bd5d66c Thanks clippy 2023-03-21 18:45:34 -06:00
Zhaofeng Li 22626efd35 Trivial semver-incompatible upgrades 2023-03-05 11:05:11 -07:00
Zhaofeng Li c3c7c10c05 Upgrade toml 2023-03-05 11:05:11 -07:00
Zhaofeng Li 97285de54f Upgrade base64 2023-03-05 11:05:11 -07:00
Zhaofeng Li 7f62e92d71 server: Upgrade fastcdc 2023-03-05 11:05:11 -07:00
Zhaofeng Li b6002b413c server: Upgrade aws-sdk-rust 2023-03-05 11:05:11 -07:00
Zhaofeng Li 18ca2cf29a Update deps 2023-03-05 11:05:11 -07:00
Zhaofeng Li 863f8dcca3 Revert "server: Allow configuring max database connections" 
Causes issues with SQLite. To be investigated further.

This reverts commit 9fdec3397d.
 2023-02-11 01:42:14 -07:00
Zhaofeng Li 9fdec3397d server: Allow configuring max database connections 
We set it to 20 by default. The SQLx default is 10.
 2023-02-11 01:16:55 -07:00
Zhaofeng Li a2bc969594 rustfmt 2023-01-29 12:01:54 -07:00
Zhaofeng Li a113845095 server/upload_path: Remove already fixed FIXME 2023-01-29 12:01:54 -07:00
Zhaofeng Li 3c8bebf6b5 upload-path: Support including the upload info as part of the PUT body 
Often times there are tight limits on how large headers can be.
 2023-01-29 12:01:54 -07:00
Zhaofeng Li 00c3024c41 server: Use the same read_chunk_async implementation 2023-01-29 12:01:54 -07:00
Zhaofeng Li 33d8dfabbd Use common constant for X-Attic-Nar-Info header 2023-01-29 12:01:54 -07:00
Zhaofeng Li 44e179362b server/binary_cache: No need to fetch all chunks for narinfo 2023-01-26 23:17:45 -07:00
Zhaofeng Li 8b52796dcb server/upload_path: Create chunkrefs during the upload 2023-01-17 14:10:27 -07:00
Zhaofeng Li 5b42839f58 Expose deduplication ratio to client 2023-01-17 14:10:27 -07:00
Zhaofeng Li 19111317f7 server/chunking: Add a couple of test cases on buffer size boundaries 2023-01-17 14:10:27 -07:00
Zhaofeng Li 99202303be Fix build with nixpkgs 22.11 
We temporarily patch sea-orm to build with a lower MSRV.
 2023-01-16 14:14:14 -07:00
Charlotte 🦝 Delenk c2d1a98e3d
fix null insertion in chunkref table 2023-01-16 14:29:11 +01:00
Charlotte 🦝 Delenk fb77c7eb2b
config.rs: Add env variable for db url 2023-01-15 18:38:28 +01:00
Zhaofeng Li fb1101f54d server/upload-path: Set completeness hint when NAR is deduplicated 2023-01-14 23:55:11 -07:00
Zhaofeng Li e8f9f3c04b Add support for chunking 2023-01-14 23:55:10 -07:00
Zhaofeng Li 93a38d1b1e Move read_chunk_async to attic 2023-01-14 23:55:10 -07:00