Since the old man is secretly smoking, he knows that the children are against him. Since this is the case, it is better to spend more time with the old man and less time leaving her alone so that he doesn't have a chance to smoke. And with the family talking and laughing, the old man might also temporarily forget to smoke.