victorytea,
I have a similar setup. I have a 2 bulb lamp on a switch that I wanted to control. Each bulb needs its own name. I call them Left Light and Right Light on the Hue app. In the Alexa app, I have each bulb and I set a group where I named the lamp itself Window (its a lamp by a window). The Window group includes both bulbs. I can now tell Alexa to turn the Window on or off, Window at 75% etc. If I want to control each bulb, I say Alexa Left Light off or Right Light 50%.
I have an additional group called Floor which is the 2 bulbs and a switch running another lamp. I can now turn off 5 total bulbs with one command Alexa turn off Floor.