There are arm bands for iPods so that you can wear it while working out. In your case, you could wear it while scrubbing floors. But that wouldn't help with keys. If you wear a belt, you could hook the phone and keys on to the belt. Or you could wear shirts/jackets that have pockets.

Or what about a well-fashioned garter? ;)