What you want to do is get your old rubber one and cut say 2cm from the bottom round in a circle, giving you a rubber circle.
Then attach the bottom of your leather one to this (either sew or I used double sided tape) then the rubber holds it all neatly in place

Works like a charm and has lasted me over 18 months