Is atenolol causing the tingling feeling in my hand?

Very unlikely. Almost certainly not. Tingling ("paresthesia" is the medical term) is indicative of peripheral nerve dysfunction. There are many causes. In the hand, carpal tunnel is common but there are many other possibilities.