Anybody else have a problem with unlocking their drivers door in cold weather?

Everytime we get a major frost my drivers door won't unlock, I have to climb through the passenger side and wrench the handle open.

Any ideas why? Can't hear any water in the door. Thanks.