The good news is that the same application can now be installed on Windows 11 Stable without having to join a beta testing program for the operating system. Microsoft had earlier released a new media player for Windows 11 Insiders, which replaced the Groove Music application and can play both audio and video files. Since the new Media Player is now available for everyone, you can download it for your Windows 11 PC from the given link below, in case you had uninstalled it: That said, Windows 10 stills come with 2 separate apps for videos and audio and do not support the new Media Player like Windows 11. Now you can play your videos and your audio using a single app.
Update: The new and improved Media Player now comes preinstalled with Windows 11 and removes both the legacy Windows Media Player as well as Groove Music.