To me it's a relative risk thing. In some situations I carry, usually at night when I'm on foot alone - other night conditions I also carry.
During the day I usually don't. While I know anything can happen anytime, realistically night, in my neighborhood - especially on foot - has enough increased risk for me that I want to.
Other times, usually it would be very, very unlikely a violent crime against me would occur - it could, but so could a zillion other things -so the negatives about CCW for me then, weight of the gun all the time, the risks legally etc. outweigh the benefits.
Look at your own situation realistically. What actual risk are you entailing by not carrying? That can help to make a decision.