No, he didn't throw Lottiemouth against the wall (or out the door).
Bush is aware of Lott's radioactive fate, so I can only believe the White House stands where it does for a reason (of which I'm presently unaware). Lott's departure would make me happier - and clearly offers a chance for both damage control and new leadership - but I trust Bush.