Got an odd situation. I hook up the battery and the alternator light stays on. Crank the car and it goes off. Turn off the key and remove it. Light comes back on. I thought maybe voltage regulator. Nope put a new one on and it didn't fix it. What would you guys think. I have a new ignition switch. Thinking about installing it. Any help would be appreciated.

Other than bare wires in the steering column doing strange things, that is probably your best bet.
Does it go away when you turn the wheel?