I had this problem and found the only thing that worked was saying "Alexa, turn on Do Not Disturb".
Otherwise, I could not find an answer to turn off the never-ending yellow flashing notification ring or how to get Alexa to disable incoming message visual alerts/notifications.
If anyone solves this one, please let me know!