What to wear?

I find it difficult to judge what to wear on a bike trip when the weather is neither really cold or hot. I either seem to sweat away in a waterproof or get chilled by wind blowing through me if I don't wear one. When I'm on my hybrid I can just pack things away in my pannier, but on my road bike I have to check the forecast and plan ahead. I've recently bought a packable Endura Photon waterproof breathable jacket (pictured), which is small, light but a bit sweaty. It can easily pack into a back pocket though. I've also got a warm cycling jersey, but wearing both would be too hot. My other alternative is a heavier softshell waterproof with underarm vents (belonging to my wife), which feels comfy most weathers. Then there's my rather rubbery waterproof, which is good in the cold.

I've also just invested in a pair of lighter weight gloves, as it's too warm now for my lined waterproof ones, and a bit too cold for fingerless. My feet seem ok without overshoes on now, unless it rains, although I've seen a few people wearing them this week. So just 2 pairs of socks do the trick, and I can always take a pair off. I feel like Goldilocks!