I had to stay, dismount, swim, and ride the 2nd one over, too. Horse swimming is not bad, imo, but yea jungles swam before iirc? It's way better than human swimming at 0. Haha can't even get out of the water. I almost drowned swimming across the river to get my other horse.
SV logic = you swim...