... does my insurance pay for the damages to that vehicle, or does the insurance of the owner pay for it?

Coverage on the vehicle would be primary. Generally, your coverage would be excess. If there is no collision or Comprehensive Coverage on the vehicle and you have that coverage under your policy, your coverage would extend to the damaged vehicle.