I don't know about the details there but that does not sound
unfixable to be.
In theory yes, in practice I don't think this will be fixed any time soon,
I'd even say that fixing that is a prerequisite to allow
archs that run on "slow" hardware to become primary.
… I have to wholeheartedly agree with you on this part. It's just not
possible to wait for those glacially slow ARM builders to complete their
builds. Even the "enterprise class" hardware being discussed is going to be