Video tracking of a horse race to display race stats

I'm looking to achieve something similar to this https://www.youtube.com/watch?v=dMr6UqgoUf0

I want to be able to provide a video with horse names, numbers and silks. You need to be able to track each horse and jockey combination and map the name/number to the horse.
This will need to output some metrics of each horse position on the video, and know which direction the horses are travelling to account for changing cameras and angles.

The end goal is I want to be able provide a live video and display on the video each runner number ordered by their current position in the race.