Personally, giving up caffeine was an overall very positive thing. It sucked a lot at first, and for a few weeks I was so tired. Actually crashed my car from falling asleep.
However, eventually I felt I had more energy than before. I seem to be doing okay when others are dragging.