I would tend to agree, but I would guess that even in that era comic books were more popular with males. If we look at pedigree collections where the original owner was known, the vast majority of original owners were males.
And you're right, @Telegan, by the mid 80s only the nerdiest of the nerdy males were collecting comics. I attend local cons in the Detroit area throughout the late 80s and I never saw a girl or woman at any of them buying comics with the exception of mothers buying comics for their sons.