Could there be a difference between muscle fatigue and muscle weakness?

Not really. Muscle weakness refers to the actual strength of a muscle. You improve weakness with specific exercises to hypertrophy the muscle. Muscle fatigue refers more to the endurance of a muscle. The weaker a muscle is, the earlier it will fatigue. It's really a matter of splitting hairs in definition.