TIL: you can avoid Apple Music from launching when you press the play / pause key
TIL: you can avoid Apple Music from launching when you press the play / pause key by unloading a launch agent:
launchctl unload -w /System/Library/LaunchAgents/com.apple.rcd.plist
Update: sadly this also means you can't use the play / pause button for Spotify.