Just say Alexa stop playing on [name of the dot upstairs].
Or you can say Alexa move my music to [name of the dot downstairs].
If you don't know the name of your devices, physically get in front of the Echo device and say, Alexa what is the device name. Alexa will reply with the device name that you are speaking to.