Actually you're right I do remember hearing that. But I know they mostly relate the goat to aries. Since that's supposed to represent birth/creation since it's the first sign in the zodiac. and supposedly the uterus and ovaries.
ah i didn't know that i'm not familiar with astrology. you may have gotten the signs (image) mixed up, aries is the ram but the sign looks more like a goat than capricons sign.