Canker caused by ascomycetous Valsa species are among the most destructive diseases of woody plants worldwide. These pathogens are distinct from other pathogens because they only effectively attack tree bark in the field. To unravel the potential adaptation mechanism of bark colonization, we examined the genomes of Valsa mali and Valsa pyri that preferentially infect apple and pear, respectively. We reported the 44.7 and 35.7 Mb genomes of V. mali and V. pyri, respectively. We also identified the potential genomic determinants of wood colonization by comparing them with related cereal pathogens. Both genomes encode a plethora of pathogenicity-related genes involved in plant cell wall degradation and secondary metabolite biosynthesis. In order to adapt to the nutrient limitation and low pH environment in bark, they seem to employ membrane transporters associated with nitrogen uptake and secrete proteases predominantly with acidic pH optima. Remarkably, both Valsa genomes are especially suited for pectin decomposition, but are limited in lignocellulose and cutin degradation. Besides many similarities, the two genomes show distinct variations in many secondary metabolism gene clusters. Our results show a potential adaptation of Valsa canker pathogens to colonize woody bark. Secondary metabolism gene clusters are probably responsible for this host specificity.