It's a very, very low risk activity. The warts on someone's hands are not the same type of warts that infect the genitals, so that isn't really a concern. However, if the person has cuts, sores, or open wounds on their hands, and then inserts their hand into your vagina, there would be a possibility that some of their blood could possibly transmit an STI, if they have one.