Start with a T-shirt, and layer a sweater or fleece over it. If you tend to get cold easily, add another long-sleeved shirt underneath or a lightweight down jacket.
This will allow you to adjust your layers depending on the weather conditions.
For more information on equipment for beginners, please see
here.