Riding at this time of year can be unpleasant as the low temperature me wind chill can greatly affect your body temperature.
Think layers. Look to have two thin layers under a good wind stopper / winter cycling jacket. Go for a wicking layer to absorb the sweat as although it might be cold, you will still sweet as the body wants to keep you warm. Look to get a thermal layer next – such a Marino wool. This wil help trap the heat and keep you warm.