Skip to content

storage/s3: reduce unnecessary retries, add cleanup for legacy storage - #3450

Merged
syphar merged 2 commits into
rust-lang:mainfrom
syphar:clean-storage
Aug 18, 2026
Merged

syphar merged 2 commits into
rust-lang:mainfrom
syphar:clean-storage

Conversation

@syphar

@syphar syphar commented Aug 18, 2026

Copy link
Copy Markdown
Member

When running the repackage command (that converted legacy single-file to archive-storage) I had regular errors in the cleanup phase. Since that was was only tried after everything else is finished, that wasn't an issue for the conversion itself.

The error I was was from the AWS SDK, and about a mismatchin the XML schema when running delete_prefix. Currently I don't know why that error happened.

But: I checked an bucket-inventory (= file-list for the whole bucket), and there are plenty of remaining rustdoc or source files.

This command tries to clean these up. Likely I'll run into the same XML encoding errors, but no I'll print the file-list / error list to be able to debug these better.

Before actually running the delete, I'll --dry-run the command, and inspect the resulting file-list.

@syphar syphar self-assigned this Aug 18, 2026
@github-actions github-actions Bot added the S-waiting-on-review Status: This pull request has been implemented and needs to be reviewed label Aug 18, 2026
@syphar

syphar commented Aug 18, 2026

Copy link
Copy Markdown
Member Author

r? @GuillaumeGomez

audit failure fixed in #3451

@syphar
syphar marked this pull request as ready for review August 18, 2026 13:17
@syphar
syphar requested a review from a team as a code owner August 18, 2026 13:17
@GuillaumeGomez

Copy link
Copy Markdown
Member

Looks good to me, thanks!

@syphar
syphar merged commit 06b75ab into rust-lang:main Aug 18, 2026
13 of 14 checks passed
@syphar
syphar deleted the clean-storage branch August 18, 2026 14:09
@github-actions github-actions Bot added S-waiting-on-deploy This PR is ready to be merged, but is waiting for an admin to have time to deploy it and removed S-waiting-on-review Status: This pull request has been implemented and needs to be reviewed labels Aug 18, 2026
@syphar syphar changed the title storage/s3: reduce unnecessary retries storage/s3: reduce unnecessary retries, add cleanup for legacy storage Aug 18, 2026
@syphar syphar removed the S-waiting-on-deploy This PR is ready to be merged, but is waiting for an admin to have time to deploy it label Aug 20, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants