Oh ok I got it. My phone has fingerprint scanner and when I use it, it unlocks my phone and launch alexa app. The icon stay in the background until you clear it. I have a clear all option and when I click that, the icon disappears.
It's still new though coz I always unlock my phone like that and it's only now that I see that icon pop up.