The Monster Is Already Out of the Box

AI safety researchers want to use formal mathematics to contain increasingly powerful AI systems. The idea is elegant. The obstacles are…