I know you already found your solution. Mine was to use the street address of the post office and my PO box as an "apartment number"
So, instead of:
PO box 1234
Tinytown, USA 90210
I write it:
8675309 Jenny Rd.
Apt. 1234
Tinytown, USA 90210
Nobody has caught on yet.