Found a work around.
Powered up the old switch long enough to rename it 1234, did a rediscover with alexa so now there is only 1 called bedroom lights. I then reset that old switch to defaults, powered it down, and told alexa to forget that one.
If it comes back it wont matter, not sure what someone would do in a scenario like this where the old switch had died and couldnt be renamed, but its working now.