A car has been seized by police after the driver "caused distress" to horses and riders in an Isle of Wight village.