are you linked to a phone carrier in the alexa app? If so, you can answer using alexa and not the phone by saying: Alexa answer call.
Or you can pick up your phone and answer like normal. It should stop the announcement. I do not think there is a way to do what you want other than tell alexa to lower the volume.