There are dozens of brands of connected light bulbs. Many of them work with Alexa but just as many do not. The ones that do not work with Alexa can only be controlled by its accompanying app and nothing else.
But if you want to be absolutely sure that they work with Alexa, you must look for the words "works with Alexa" in its product description.