I missed this but Gentoo Linux allows you to bootstrap the rustc compiler using a regular C++ compiler via mrustc. You should be able to build the entire Rust toolchain from source without having to rely on a rustc binary distribution if you wish so.
https://wiki.gentoo.org/wiki/User:Trickygnome/Rust_from_sources_installation
