I think our lungs are more resilient than that. They say that 15 years after you quit smoking, your heart disease risk is similar to that of a non-smoker. Second-hand smoking isn't even that.
I don't do it, but I think that the occasional cigar is harmless, and even if it is a regular thing...