Thanks for the response. It's on a notebook (IDT 92HD73C1 Audio) running Windows 7 x64. It happens after a stop/pause.
I just tried on another PC (also Win 7 x64) and it doesn't have this issue. The user of the app I've written hasn't complained either, so perhaps I'll just put it down to the poor inbuilt sound card driver.