The horse exerts a force on the ground.
Now, according to third law of motion, the ground should also exert the same force on the horse.
The ground pushes the horse forward with the same force with which the horse pushed the ground. In this way, the horse advances forward.
Hope it helped ! :)