I tried your "say off via the app" technique but didn't work. I wonder if your Echo actually heard your command, not app on phone?
Alternatively, I was able to start new music on a speaker via the app. Pick your music, pick your device - viola! As you pointed out, it's good they have the little volume indicator to show what's playing. It just seems the path to do these things is a bit unclear.