I never found a way to do it with an alarm. It does work if you create a scheduled routine. You need to set the name of what you want to play to something like "Playlist Name Playlist Shuffled". Use "Amazon Music" as the provider if it is one of the standard playlists or "My Library" if it is one of your own.