I gave up handbags about 8 years ago, and now routinely wear a belt-pack (what Americans call "fanny packs", but I wear it in front) instead. It leaves my hands free, and I never have to worry about walking off and forgetting it; it also carries everything I really need* without collecting random stuff that ends up weighing a ton! The only thing I miss about a purse is that I could carry a paperback in it.

* Wallet, personal checkbook, business checkbook, keys, pen, nail file/clippers, lip gloss, mini-multitool, thumb drive, business cards, spare ponytail-wrap, folding fan, cellphone, measuring tape.