Not really. While it's unlikely you'll be challenged if concealed, the less you push it, the less likely a challenge is. And say rambunctious kids running around bump into you and discover your gun. The more reasonable you are in interpreting the from-vehicle-to-apartment-and -back limitation, the more likely you succeed in relying on it.
It would not grieve me personally to divert from a direct path to ppick up mail, depending on how much diversion, but I wouldn't push it farther than that myself.