I love cycling shorts, socks, and gloves. I wore cycling jersey's and found them problematic in many ways. They do not allow sunlight though, hence riders develop a farmer's tan. They are tight around big biceps, so I am unable to wear them. Additionally they don't feel as comfortable as cotton t-shirts.
If you ride in a pack you will need a jersey ( noone will allow t shirts riders in a pack ). However try cotton shirts if you are on your own. I believe they are best for cycling.