In the Alexa app, there's a separate setting for alarm volume. This is not the same volume setting for other things like Alexa responses or when you play music. In the app, tap devices icon (bottom right), Echo & Alexa icon (at the top), select your Echo device, Sounds, then you'll see the different volume settings. The first setting is the volume for Alarms, Notifications, & Timers.