Have you done this?
Sign in to your Audible account on the desktop site using your Audible username (e.g., audioguy11) ...
Hover your mouse over Hi, (Username)! at the top-right.
Click Account Details from the drop-down menu (or click that link).
Click on Merge your Audible account with your Amazon account at the bottom of the screen.