Why am I not breathing hard during my workout?

Not enough. Because you are likely not exerting enough. If you are doing cardio - target hr should be 220-age. If lifting... You are likely not lifting heavy enough weights or not performing enough reps.