Does he know?
Does your psychiatrist know that you are on strong pain killers? Why are are you on them?
Why are you being referred to a neurologist? Just for being sedated appearing?--probably not.
I would suggest talking to your psychiatrist adn find out why you are being referred. Communication is so important and too often feels are hurt because we don't communicate. Best of luck to you.