Mental stress, depression, worry, poor sleep, unscientific diet and so on will all lead to sub-health.
Male endocrine disorder refers to high estrogen and low androgen, which can also lead to hair loss.
Sub-health or endocrine disorders are not necessarily related to whether you have contacted women or not.
If you are upset and depressed because you don't touch women, you may accelerate hair loss.
If it doesn't matter to you whether you have contact with women or not, it won't lead to hair loss or endocrine disorders.