Yes. Because disposing of these objects is still confusing to me (the how and when) and also because my app will only ever play one file at a time anyway, I moved the instancing to the form level to only ever user the one instance of those things across the board, and dispose of them all on form close. I just need to do it all without ever calling anything else as "New" that needs additional disposal.
Public Player = New WaveOutEvent()
Public wave As NAudio.Wave.WaveFileReader
Public output As NAudio.Wave.AsioOut