I seem to recall that your little man is still tiny? At less than a couple of months old, I wouldn't be ready to leave the baby either. I would maybe consider asking a grandparent to come in and help out with the two of you there. Your wife could still nurse, and the grandparent do everything...