Hyperactive prolactin cells in the pituitary gland are responsible for excess prolactin in men. These cells may grow into a tumor on the pituitary gland which is known as prolactinoma. Some men with excessive prolactin might have enlarged breasts, and the condition is known as gynecomastia. Decrease in body hair, fatigue, depression, and headaches or vision loss (as the tumor presses against the optic nerve in the brain) may also be noticed as symptoms of prolactinoma.