Cytoplasmic male sterility (CMS) arises from the incompatibility between the nucleus and cytoplasm as typical representatives of the chimeric structures in the mitochondrial genome (mitogenome), which has been extensively applied for hybrid seed production in various crops. The frequent occurrence of chimeric mitochondrial genes leading to CMS is consistent with the mitochondrial DNA (mtDNA) evolution. The sequence conservation resulting from faithfully maternal inheritance and the chimeric structure caused by frequent sequence recombination have been defined as two major features of the mitogenome. However, when and how these chimeric mitochondrial genes appear in the context of the highly conserved reproduction of mitochondria is an enigma. This review, therefore, presents the critical view of the research on CMS in plants to elucidate the mechanisms of this phenomenon. Generally, distant hybridization is the main mechanism to generate an original CMS source in natural populations and in breeding. Mitochondria and mitogenomes show pleomorphic and dynamic changes at key stages of the life cycle. The promitochondria in dry seeds develop into fully functioning mitochondria during seed imbibition, followed by massive mitochondria or mitogenome fusion and fission in the germination stage along with changes in the mtDNA structure and quantity. The mitogenome stability is controlled by nuclear loci, such as the nuclear gene Msh1. Its suppression leads to the rearrangement of mtDNA and the production of heritable CMS genes. An abundant recombination of mtDNA is also often found in distant hybrids and somatic/cybrid hybrids. Since mtDNA recombination is ubiquitous in distant hybridization, we put forward a hypothesis that the original CMS genes originated from mtDNA recombination during the germination of the hybrid seeds produced from distant hybridizations to solve the nucleo-cytoplasmic incompatibility resulting from the allogenic nuclear genome during seed germination.