After playing around with fades and such, I've finally found a solution:
To avoid any blips or weird audio effects after a fade out, create a clip of silence, and actually insert the clip of silence in the gaps between the faded audio clips. Then the continuous audio track will function well.
(Having blank spaces between the audio clips doesn't work.)