  Emulating the human ability to solve the cocktail party problem, i.e., focus
on a source of interest in a complex acoustic scene, is a long standing goal of
audio source separation research. Much of this research investigates separating
speech from noise, speech from speech, musical instruments from each other, or
sound events from each other. In this paper, we focus on the cocktail fork
problem, which takes a three-pronged approach to source separation by
separating an audio mixture such as a movie soundtrack or podcast into the
three broad categories of speech, music, and sound effects (SFX - understood to
include ambient noise and natural sound events). We benchmark the performance
of several deep learning-based source separation models on this task and
evaluate them with respect to simple objective measures such as
signal-to-distortion ratio (SDR) as well as objective metrics that better
correlate with human perception. Furthermore, we thoroughly evaluate how source
separation can influence downstream transcription tasks. First, we investigate
the task of activity detection on the three sources as a way to both further
improve source separation and perform transcription. We formulate the
transcription tasks as speech recognition for speech and audio tagging for
music and SFX. We observe that, while the use of source separation estimates
improves transcription performance in comparison to the original soundtrack,
performance is still sub-optimal due to artifacts introduced by the separation
process. Therefore, we thoroughly investigate how remixing of the three
separated source stems at various relative levels can reduce artifacts and
consequently improve the transcription performance. We find that remixing music
and SFX interferences at a target SNR of 17.5 dB reduces speech recognition
word error rate, and similar impact from remixing is observed for tagging music
and SFX content.
