Mine are inboard for that exact reason. Pulled out many twigs / small branches caught between the rim flange and the wheel. If my stems were on the outside without welded protection hoops, they definitely would be damaged.
IMHO, if you bought it to get it dirty and don’t have hoops, leave them...