This is an exciting time for you and him, but you need to be careful.
If he falls (and sooner or later he will) how he falls will determine whether or not he gets hurt. Most stumbles to the floor will scare him more than hurt, but things like tables with sharp edges and breakable objects he can get to can cause problems. Time to baby-proof the house. Good luck!