Agreed, the IoD claim was just propaganda, designed to distort.
However, it's not about numbers since many would have little or no effect if they moved. It's the importance of those who do move that counts, and losing the UK based motor industry, if it happened, would be a very serious loss...