As long as coins have existed in society, we of course needed a money pouch for carrying our coins.

The oldest known purse was found with Ötzi the Iceman who lived around 3,300 BC.  Another early example is on Egyptian hieroglyphs, which clearly show pouches worn around the waist.

It is said that from the Middle Ages to around 1900, Rottweiler dogs were used by travelling butchers.  They guarded money pouches tied around their necks. Unlikely to be a fact but fun none the less.

During medieval times, people carried around drawstring leather pouches. These were made from animal skins, bladders or woven fabric. They were called almoners , alms bags, geldkatze or chazza. These were obviously used for holding coins among other things. 

By the 15th century,  both men and women alike were using coin purses, and they had become quite a status symbol. The quality of the bag, the material, the embroidery as ell as the silver or gold baubles hanging from it helped to show off the wealth and station of the bearer.