Well there are many different types of clothes; silk,cotton, wool, and synthetic materials are some of them. There can be insects like moths or the silverfish which can make small holes in your clothes. these can be stitched, explaining it to be physical change only if the human stitches it. clothes can also be burnt while cooking (silk) so the burnt thing cant be redone so chemical.