Funnily enough, the first book in which I read this recipe was written by a professional baker who also promulgates this view.
Letting it cool a bit, and then starting in on it does seem to leave the rest of the loaf a little better. I think we have a compromise here: let it cool till Heroes is finished seems to work quite well.
(The loaves hit the oven, then we start watching Heroes. When the bell goes, we pause the program.)