Spurious failure on a server - can't find crate clap_derive

[ZuseZ4]

Summary

This is the second time I'm encountering the issue, so I guess it's worth reporting.

Command used

./x.py test --stage 1 tests/codegen/gpu_offload/gpu_host.rs

Expected behaviour

compile rustc

Actual behaviour

bootstrap fails early due to

downloading https://static.rust-lang.org/dist/2025-06-24/rustc-beta-x86_64-unknown-linux-gnu.tar.xz
######################################################################################################################################################################################################################################################### 100.0%
downloading https://static.rust-lang.org/dist/2025-06-24/cargo-beta-x86_64-unknown-linux-gnu.tar.xz
######################################################################################################################################################################################################################################################### 100.0%
extracting /other_path/prog/rust/build/cache/2025-06-24/rust-std-beta-x86_64-unknown-linux-gnu.tar.xz
extracting /other_path/prog/rust/build/cache/2025-06-24/cargo-beta-x86_64-unknown-linux-gnu.tar.xz
extracting /other_path/prog/rust/build/cache/2025-06-24/rustc-beta-x86_64-unknown-linux-gnu.tar.xz
Building bootstrap
   Compiling proc-macro2 v1.0.89
   Compiling unicode-ident v1.0.13
   Compiling memchr v2.7.4
   Compiling typenum v1.17.0
   Compiling version_check v0.9.5
   Compiling libc v0.2.172
   Compiling shlex v1.3.0
   Compiling rustix v1.0.7
   Compiling serde v1.0.215
   Compiling regex-syntax v0.8.5
   Compiling crossbeam-utils v0.8.20
   Compiling bitflags v2.6.0
   Compiling linux-raw-sys v0.9.3
   Compiling cfg-if v1.0.0
   Compiling pkg-config v0.3.31
   Compiling heck v0.5.0
   Compiling clap_lex v0.7.2
   Compiling anstyle v1.0.10
   Compiling log v0.4.22
   Compiling serde_json v1.0.132
   Compiling same-file v1.0.6
   Compiling semver v1.0.23
   Compiling ryu v1.0.18
   Compiling bootstrap v0.0.0 (other_path/prog/rust/src/bootstrap)
   Compiling cpufeatures v0.2.15
   Compiling itoa v1.0.11
   Compiling home v0.5.9
   Compiling termcolor v1.4.1
   Compiling cc v1.2.23
   Compiling walkdir v2.5.0
   Compiling clap_builder v4.5.20
   Compiling generic-array v0.14.7
   Compiling aho-corasick v1.1.3
   Compiling object v0.36.5
   Compiling cmake v0.1.54
   Compiling lzma-sys v0.1.20
   Compiling regex-automata v0.4.9
   Compiling crossbeam-epoch v0.9.18
   Compiling quote v1.0.37
   Compiling syn v2.0.87
   Compiling crossbeam-deque v0.8.5
   Compiling filetime v0.2.25
   Compiling xz2 v0.1.7
   Compiling bstr v1.10.0
   Compiling block-buffer v0.10.4
   Compiling crypto-common v0.1.6
   Compiling digest v0.10.7
   Compiling sha2 v0.10.8
   Compiling globset v0.4.15
   Compiling opener v0.5.2
   Compiling xattr v1.5.0
   Compiling fd-lock v4.0.4
   Compiling tar v0.4.43
   Compiling ignore v0.4.23
   Compiling toml v0.5.11
   Compiling clap_derive v4.5.18
   Compiling serde_derive v1.0.215
   Compiling clap v4.5.20
error[E0463]: can't find crate for `clap_derive`
  --> /server_path/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/clap-4.5.20/src/lib.rs:91:9
   |
91 | pub use clap_derive::{self, Args, Parser, Subcommand, ValueEnum};
   |         ^^^^^^^^^^^ can't find crate

For more information about this error, try `rustc --explain E0463`.
error: could not compile `clap` (lib) due to 1 previous error
warning: build failed, waiting for other jobs to finish...
failed to run: /other_path/prog/rust/build/x86_64-unknown-linux-gnu/stage0/bin/cargo build --manifest-path /other_path/prog/rust/src/bootstrap/Cargo.toml -Zroot-dir=/other_path/prog/rust
Build completed unsuccessfully in 0:00:17

Bootstrap configuration (bootstrap.toml)

configure-args = ['--enable-llvm-link-shared', '--enable-llvm-plugins', '--enable-llvm-enzyme', '--release-channel=nightly', '--enable-llvm-assertions', '--enable-clang', '--enable-lld', '--enable-option-checking', '--enable-ninja', '--disable-docs']

Highly likely unrelated to Enzyme, I have had it in different configs.

Operating system

HEAD

A few commits on top of

f3226b4

Additional context

Usually happens after rebasing and working on branches for a while.
I think it's related to my home dir running out of disk quota. However, even after cleaning up and having enough space, I am not sure how to recover from here.

Build Log

<log>

[ZuseZ4]

Things I tried

1. make space on my home to be below my quota
2. rm -rf ~/.cargo/registry/*
3. remove the build folder for rust under rust/build
4. rustup update (stable/nightly)
5. rustup remove rust-src (since it was blocking the update in 4))

[ZuseZ4]

Solved, I still had a buggy default C compiler loaded because my setup script didn't run properly due to the limited disk space.