If somebody does park you in, and the hitch ball is in the way, why not just take the damn thing out? As previously stated, it only takes a few seconds.
Whether or not you decide to put in back in, leave it in the street, leave a note, etc... the problem is easily solved. No need to wait for them to return.