When you're done, you can use Mix_FreeChunk() to free memory used by samples, and Mix_FreeMusic() to free memory taken up by songs.
Finally, use Mix_CloseAudio() to close the mixer.
Now let's see... err, hear... an example.