The hatter was Mad not because of lead poisoning in the lining of his hat but because of the entrance to the void that it held inside. He kept it around because the horrifying aberrations inside just loved serving tea. You just have to try their chai. You'll simply lose your head over how good it is.