First ... If you are specifically asked, be truthful. I've got a NRA bumper sticker on my truck and I was asked twice. Once the "no" answer ended everything, and the second time, the "no" answer sparked a gun conversation. That officer later joined my gun club. I've never been stopped while carrying.
Second, if you need to brush past the firearm to access your wallet and credentials, I'd pause to inform the officer. (I'm left handed and carry my wallet in my rear pocket.)
In any other circumstance, I'd say as little as possible.