Simplify #4409

Job	Run time
build-macos	4m 55s
build-distros (alpine)	17m 50s
build-multi-archs	20m 6s
build-distros (archlinux)	18m 36s
build-sanitizers	10m 47s
build-distros (debian:11)	11m 58s
build-sanitizers (-DMOLD_USE_ASAN=On)	13m 57s
build-windows	25m 6s
build-distros (fedora)	13m 7s
build-sanitizers (-DMOLD_USE_TSAN=On)	24m 34s
build-distros (gentoo/stage3)	21m 3s
build-distros (opensuse/tumbleweed)	13m 30s
build-freebsd	16m 19s
build-distros (ubuntu:22.04)	12m 11s
build-msys	12m 3s
	3h 56m 2s

Provide feedback