Go over to the system tray and right-click on the volume icon. From the list of options, select ‘Open Volume Mixer’ Clicking ... and Video-conferencing app Zoom, and I have muted the former.

Click on Open Volume Mixer. Click the volume icon of devices and apps to toggle mute or unmute per requirement. Press Windows key + G to open Game Bar. In the Audio overlay, click the volume icon ...