It turns out you need to click on the red close button… You know UX is badly designed when you find yourself googling “how to close apple music mini player” lol.

Which makes it extra weird when I run into apallingly badly designed UX. I clicked on the album artwork simply to see what would happen (this opens a much more useful view on Spotify btw). It opened the mini player with seemingly no way to return to the previous window.