Golfing in the Cold

Why are the doors always freeze my VW Golf 2006? Sometimes, even when it is not all that cold outside!?
pulverized hinges with silicone still does not seem to help.
stamps not spray the hinges with a silicone spray
vw golf 2 diesel, cold start