Assuming the circuit is unchanged from when Scaly did his wiring diagram.......
When you pull the clutch in, it provides an earth to the starter relay, allowing it to operate.
When the clutch is out, the starter relay gets its earth through the clutch switch from the neutral switch. So:
1/ If the neutral light is operating correctly, then there could be a disconnection in the wire between the clutch switch and the neutral switch, OR - far more likely - the "make when clutch released" contacts inside the clutch switch are dirty, as cstorckiii suggests.
2/ If the neutral light is NOT operating correctly, then the wire to the neutral switch is disconnected, or the neutral switch itself is faulty.
My bet is on option 1/, caused by a faulty clutch switch. I've never tried to take mine to bits - perhaps someone can give guidance on that?