If you are still in the muscle training stage, it will definitely affect you. Insufficient intake of protein has a great influence on muscle shaping; If you achieve the goal of gaining muscle, but only in the maintenance stage, it won't have much impact.
In addition, muscles won't fall off, as long as you promise to train regularly.