The answer is that these two kinds of variation are basically uncoupled. What about the morphological differences between males and females of a single species? What about organisms such as the Gobi fish that can change their sexual characters? What about organisms that get held in a juvenile form in some circumstances? What about plants that produce different leaves in different environments? What about similar organisms with different genotypes? We will get confused if we let these issues overwhelm us!