A definite YES it is worth it. Every job has a downside otherwise it would not be a job and people would not be paying someone else to do it. The downside to driving would probably be the hassle you might get loading/unloading at your RDC or customer location (which to be honest is probably about 10/20% of the days work time), after that it is the open road and away you go usually in your own relaxed time at your own pace.
Better make it 12 - 1 to the YES