Perhaps music would be better because there won't be a part of your mind that is actively listening and trying to extract meaning. That being said, I sometimes have to switch even the music off if I need a high level of focus.

Depends entirely on the work. If it does not require concentration, I don't think it matters at all.

If it affects your ability to concentrate and focus it obviously is a problem and I think you should just stop entirely.