A new tool for entry and analysis of virulence data for plant pathogens
Abstract
The methods of Habgood (1970) and Gilmour (1973) for the assignment of pathogen race names are discussed and the advantages of a reversed octal system, based on Gilmour's octal code, are emphasized. A new spreadsheet, ‘HaGiS’, exploits these two designation systems to provide user‐friendly and fast access to some routine steps in the analysis of virulence data for plant pathogen populations. It produces graphs and tables for frequency distributions (of pathotypes, isolate complexities and cultivar susceptibilities); sorted lists (e.g. of the races ranked by predominance); indices (of sample diversity and of pathogenicity for each differential cultivar); and coloured proximity matrices. Use of HaGiS requires knowledge of only a few basic functions of MS Excel 97®. All graphs, tables, indices and matrices are generated automatically and displayed by switching to the corresponding worksheet. In addition to data analysis, the spreadsheet is convenient for the entry of experimental data, allowing for all commonly used assessment scales.
Introduction
Physiological races of plant pathogens are routinely characterized by their spectrum of pathogenicity for a defined set of differential host cultivars and various methods of naming the races have been developed. The system proposed by 5) and particularly its modification by 2) are considered to be useful because the race name produced contains coded information for the virulence of the race. Utilizing these codes, a spreadsheet, HaGiS (Habgood–Gilmour), was produced in MS Excel 97® for the entry and evaluation of pathogenicity data and is available free of charge upon request.
The major properties of the two naming systems are summarized, emphasizing the advantages of Gilmour's octal code. The main features of the new spreadsheet, which aims at standardizing and simplifying some frequently recurring steps in virulence analysis of plant pathogens, are also described.
Habgood's designation method
In the simplest case, pathogenicity can be rated on a dichotomous scale, assigning 0 for avirulence on a differential and 1 for virulence. Each pathogen isolate is classified by its disease reactions on a given differential set, resulting in a sequence of 0s and 1s, the ‘pathotype vector’. 5) proposed that the series of zeros and ones can be regarded as a binary number, whose value is converted into its decimal (decanary) representation, giving a binary/decanary code. The number derived in the decanary conversion then serves as a race name for that particular pathotype and translation back to the binary code reveals the spectrum of virulence.
Habgood originally suggested listing the cultivars of the differential set from right to left, i.e. with the lowest numbered differential on the right, and calculating the binary value of the observed virulence in the conventional manner as the inner product P→ · W→ of the pathotype vector P→ and the weight vector W→ = (2(n − 1), …, 21, 20) of proper dimension. Following 8) we prefer a modified but equivalent notation, in which the order of weights is reversed, i.e. w→ = (20, 21, …, 2(n−1)), and the list of cultivars is presented in the ‘more natural’ order, written from left to right. Given a differential set of n = 12 cultivars A, B, C, …, L, for example, in which all cultivars except D, E, K and L are susceptible to an isolate, i.e. we obtain the pathotype vector p→ = (1, 1, 1, 0, 0, 1, 1, 1, 1, 1, 0, 0) and assign ‘999’ as race name, because the corresponding inner product p→ · w→ equals 1.20 + 1.21 + 1.22 + 0.23 + 0.24 + 1.25 + 1.26 + 1.27 + 1.28+ 1.29 + 0.210 + 0.211 = 999. The short race name ‘999’ carries the same information as the lengthy pathotype vector p→.
The binary/decanary nomenclature of 5) eliminated several drawbacks of earlier notations ( 3). Some of its merits are: (1) isolates of different pathotypes are readily distinguishable by name and easily sorted numerically; (2) neither specific mechanisms nor knowledge of the genetics underlying host–pathogen interactions is required; (3) results from different surveys employing the same differentials are fully compatible; (4) for each race, the associated susceptibility pattern can be recovered completely from its coded name; (5) once the set of differentials and their linear arrangement are fixed, the naming system is exhaustive, i.e. names are provided for all possible races that can be diagnosed within the differential set; (6) differential sets can be extended, although race names will change for isolates virulent to newly added cultivars.
Generalization to more than two categories
Sometimes it is desirable to avoid the restrictions of dichotomous rating of virulence into only two classes and to expand the scale into three, where differentials are classified as resistant, intermediate or susceptible, or into more classes for a more precise record of observed infection types. The binary/decanary code can easily be generalized in this direction by substituting the power‐of‐two weights by power‐of‐three or higher weights. To indicate the number of categories in the rating scale, binary/‐, tertiary/‐ and quaternary/decanary classifications can be proposed. Where there are three classes, pathotype vectors with 0s, 1s and 2s, e.g. vector (1, 2, 1, 2, 0) would receive the reverse tertiary/decanary race name 70, because 1.30+ 2.31 + 1.32+ 2.33 + 0.34 = 70. It is clear that this number could also arise in a two‐celled classification system. In order to avoid ambiguities the underlying code should always be stated explicitly.
Drawbacks of the naming system
Because of its advantages, the binary/decanary system was well accepted and widely used, and was applied to several different fungal pathogens, e.g. rusts, mildews and potato blight ( 5; 8). However, over time several difficulties with this notation became apparent, especially in surveys with large differential sets: (1) the lack of direct correspondence between race names and susceptibility patterns makes the recovery of pathotypes cumbersome, even for medium‐sized differential sets; (2) relations within and between pathogen isolates are not easily recognized. Similarities, differences and subpatterns are not obvious from the names. Compare for example the above race ‘999’ with race ‘2023’. These are quite divergent names for two very similar pathogen races, which differ in their reaction on only one of 12 differential cultivars whereas races 2023 and 2048 appear much closer by name, but in fact differ in their virulence on 10 of 12 cultivars; (3) compatibility is poor for results from studies with extended differential sets because addition of new cultivars will change race names substantially if a virulent isolate is found; (4) for incomplete data, the binary/decanary code fails, and no meaningful name can be assigned if the disease reaction is missing for any cultivar.
Gilmour's triplet code
Fortunately, the problems encountered with Habgood's method can be overcome by a small but powerful modification. Instead of representing the binary values decimally, 2) proposed the use of octal numbers. This amounts to breaking down the series of 0s and 1s into groups of three. Consequently the binary values of all resulting triplets will fall within the range from 0 to 7, and may be represented entirely by octal digits. Table 1 lists the possible pathotypes for a cultivar triplet (A, B, C) and their reverse octal designations. For example, two virulences in a triplet can arise in three different ways, which result in the octal digits 3 (virulent on A and B), 5 (virulent on A and C), or 6 (virulent on B and C). The reverse octal system is used to keep the order of cultivars from left to right and then to reverse the corresponding weight vectors. 2) originally proposed the non‐reversed octal code; however both versions are equivalent.
Whilst the binary/octal code preserves all the benefits of the binary/decanary naming system, it avoids the inherent problems of the latter: (1) octal race names display relationships between races more clearly. The fictitious reverse binary/decanary races 999, 2023 and 2048, for example, are labelled 7471, 7473 and 0004 in their reverse octal form. The closeness of pathotypes 7471 and 7473, and their distance from race 0004, are now evident and well reflected in their race names; (2) the triplet‐based system allows comparisons between same‐position digits: for example, races 7471 and 7473 match in three positions indicating identical susceptibilities for three triplets, i.e. in the first nine cultivars; (3) because of this same‐position compatibility, it also becomes meaningful and often useful to sort binary/octal race names with respect to any single position of interest; (4) in the binary/octal nomenclature, only eight different patterns, shown for the reverse binary/octal code in Table 1, must be memorized in order to diagnose the original virulence reactions for each triplet, e.g. 7471 and 7473 only disagree in their last digit, which corresponds with the triplet (J, K, L). Now, reverse binary/octal ‘1’ translates into (1, 0, 0) and ‘3’ into (1, 1, 0), hence their only difference lies in cultivar K; (5) the new designation method is open‐ended, i.e. compatibility between studies is preserved, even if, in some of them, the differential sets were extended; (6) in contrast to binary/decanary, the binary/octal system accommodates missing information, as long as only a few triplets are affected (corresponding digits are then marked by underscores as defective, 3). Nondefective digits stay unchanged and can be evaluated without restrictions; (7) octal names strongly reflect the linear arrangement of differentials. 3) therefore emphasized the importance of carefully selecting the order of cultivars in the set, for which they discuss a number of valuable criteria.
The binary/octal modification ( 2) apparently constitutes a substantial improvement over the binary/decanary code, as illustrated by the advantages discussed above. Applications to rust, mildew, and leaf blotch can be found in 1) and in 3). The binary/decanary and binary/octal systems were both published in the early seventies in Nature ( 5; 2). Nevertheless, Gilmour's method still seems to be much less well known, and was therefore independently reintroduced several times in the past ( 1; 8).
The new spreadsheet
The Habgood–Gilmour Spreadsheet (HaGiS) is designed as a tool for the convenient entry of pathogenicity data by personal computer (PC). Entered raw data are immediately converted into pathotype vectors, and associated reverse binary/octal and reverse binary/decanary race names are calculated. At the same time, HaGiS provides selected characteristics of the given data set. The program currently offers 12 different sheets, labelled according to their function, e.g. ‘data‐entry’, ‘print SG’, ‘Fig. C’, or ‘conv’. The user starts in ‘data‐entry’ by specifying the range of the assessment scale and its partition into categories. For instance an assessment scale from 0 to 4 is usually partitioned into the classes avirulent (0, 1 or 2) and virulent (3 or 4). At least two classes are required, and up to four (quaternary) may be defined. The program can handle such commonly used assessment scales as 0–4, 0–9, or 0–100. The maximum size of the differential set is currently limited to 25 cultivars, but no restrictions apply to their linear arrangement. Two rows in the data table are reserved for entry of cultivar names, one column for isolate names, and one column on the right end of the table for a control line or successful infection check. User input is only permitted in specifically marked (green) areas. All input undergoes a consistency check, and detected inconsistencies are reported through error messages (e.g. no value outside the corresponding user‐defined range will be accepted).
Once the data are entered into the data‐entry sheet various tables, figures and statistics describing the sample can be viewed in other sheets. The table toolbar at the bottom of the screen displays the names of all available sheets. In some sheets, the user will find the tables and graphs derived from the data set already produced. In other sheets, the corresponding features will be generated as soon as the sheet is selected.
The sheets labelled with the prefix ‘print’ supply different tables in printable form:
•print SG documents the original susceptibility raw data with corresponding reverse binary/octal race names and associated virulence complexities
•print SH contains the same information, but with reverse binary/decanary race names
•print PG lists the pathotype vectors (derived according to the user‐defined categories) together with their reverse binary/octal race names and complexities
Sheets labelled with the prefix ‘Fig.’ display frequency distributions in graphs and tables, supplemented with appropriate indices (means, standard errors, or diversity measures):
•Fig. C shows the sample distribution of complexities as a histogram and a table. Sample mean, standard deviation and standard error are provided
•Fig. S displays the susceptibility distribution of cultivars as a histogram and a table. Various indices are provided
•Fig. P(all) contains, in graphical and tabular form, the distribution of all pathotypes (races) found in the sample, as well as the values of several diversity indices and a table where races are ranked according to their predominance
•Fig. P(gt1) displays the same features as Fig. P(all), but excludes all races with fewer than two occurrences in the sample
The third group of sheets is concerned with comparisons between pathotypes or cultivars:
•virdif provides another option to compare races by determining their departure from the pathotype pattern of the most frequent race in the given sample
•pairw generates a proximity matrix for pairs of pathotypes. The user can select different proximity measures, such as Dice or Russell‐Rao. An additional colouring option helps to identify pairs of pathotypes with extremely low or extremely high similarity
Sometimes only the race name of a pathogen is known but one is interested in the associated virulence pattern. A conversion sheet is therefore included:
•conv decodes reverse binary/octal (or reverse binary/decanary) names back to the underlying pathotype vectors; it also converts between the octal and decanary names. The ‘conv’ sheet also provides an additional tool for converting binary/octal to reverse binary/octal names
Discussion
The introduction of binary/decanary classification ( 5) significantly simplified the representation and analysis of pathogenicity data. 11) used this code and developed the computer program VIRULA (VIRULence Analysis), specifically designed to process virulence data. VIRULA is a DOS‐based program, written in Turbo Pascal, that performs various descriptive and inference‐statistical procedures. As intended by its authors, VIRULA has contributed in the past to the unification of methodological approaches in the analysis of virulence data. However, since the publication of VIRULA, hardware and software of PCs has improved significantly and it now seems worthwhile to design a new program that takes greater advantage of the latest developments in PC technology. The HaGiS program is such an attempt, to provide a tool for entry and analysis of pathogenicity data.
HaGiS is developed in Microsoft Excel 97, which combines the user‐friendly interface of Windows with the benefits of a spreadsheet and was chosen primarily because of its widespread availability. Consequently no special HaGiS commands have to be learned to handle the software; familiarity with a few basic functions of Excel is sufficient. The program is designed to be as flexible as possible with respect to assessment scale, scale partitioning, and sample size, as well as to the number and order of differential hosts. The development of HaGiS in Excel allows users to make many adjustments to serve their individual needs.
The purpose of HaGiS is dual. It is convenient for data entry; and it offers a first overview of the data by means of graphical and numerical representation. Without elaborate programming or other time‐consuming preparations, the user can instantly browse through various readily available sheets displaying the input data and offering a choice of distinct figures, tables, indices, and statistics. Currently, descriptive methods dominate the selection, but in the future it is intended to implement additional inference‐statistical procedures. For more complex analytical procedures the entered data set can be transferred easily to other appropriate software packages.
HaGiS can be requested by E‐mail from gh75@agrar.uni‐giessen.de or downloaded from the web site http://www.uni‐giessen.de/∼gh75/hagis.htm, where a short, illustrated manual provides further explanations and instructions. Users are encouraged to send us their comments and suggestions by E‐mail.
Acknowledgements
We gratefully acknowledge Lothar Langer, Rod Snowdon, Santani Teng and Jörn Pons‐Kühnemann for their valuable assistance and critical reading of the manuscript.
Appendix
The following section provides additional definitions, references and information concerning the set of indices and coefficients utilized in the HaGiS program. We start by introducing some notation used in subsequent formulas:
Ntotal number of isolates in the sample
Dnumber of differentials
MAXupper limit of the (user‐defined) assessment scale
aδ jassessment rating of the pathogenicity of isolate j against differential δ
Rnumber of distinct races (pathotypes) detected in the sample
niobserved number of isolates of race i in the sample
Pi = ni/Nproportion of isolates of race i in the sample
ln xnatural logarithm of x
The Fig. S‐sheet calculates for each differential δ (with δ = 1, 2, …, D) the corresponding Pathogenicity Index PI%, where PIδ = Σaδj (MAX.N), i.e. with respect to a differential δ the assessment ratings aδj of isolates j = 1, 2, …, N are summed, then divided by the product MAX times N. See 12).
The P(all)‐sheet contains the following five commonly used diversity indices:
1 the Simple Index Q = R/N.
2 the Gleason Index G = (R − 1) ln N.
3 the Shannon Index H = −ΣPi. ln Pi, i = 1, 2, …, R. The values of H can range from 0 to ln R.
4 the Evenness Index EH = H ln R, i.e. the normalized version of Shannon's H, obtained by division through Hmax = ln R.
5 the Simpson Diversity Index S = 1 − Σ(n2i − ni)/(N2 − N), i.e. the probability of obtaining two distinct pathotypes when randomly drawing two isolates from the sample.
The concept of diversity incorporates several aspects, two of which are ‘richness’ (i.e. the total number of distinct races) and ‘evenness’ (i.e. the degree of predominance of some races). In that sense Q and G measure only richness, and EH only evenness, while H and S each measure a combination of both aspects of diversity. With respect to sample size, Q and H are highly sensitive, and therefore not recommended for comparisons between samples of substantially divergent sizes. A detailed discussion can be found in 4) and in 10), for more recent developments, see 9) and 7).
The virdif‐sheet provides for each race i the virulence difference Vi, defined as the number of disagreements in pathogenicity between race i and the sample's most frequent (dominant) race i0. For any dichotomous scale, pathotype vectors may be coded by sequences of zeros and ones, i.e. all vector components are 0s or 1s. The corresponding virulence difference can therefore be calculated by Vi = Σ ∣ pδ − qδ ∣, where pδ and qδ, with δ = 1, 2, …, D, denote the components of the pathotype vectors p and q of races i and i0, respectively.
The pairw‐sheet generates a proximity matrix for all pathotype pairs. HaGiS offers a choice of six proximity measures (coefficients), each based on the same 2 × 2‐contingency table with the following entries: cell a (cell d) contains the number VV (AA) of differentials to which both races i and j are virulent (avirulent), cell b (cell c) contains the number AV (VA) of differentials to which race i is avirulent (virulent) and race j is virulent (avirulent), respectively. Note that D = VV + AV + VA +AA. The available measures are defined as follows, see e.g. 6):
1 the Dice coefficients
D 1% = 100.2AA/(AV + VA + 2AA) and
D 2% = 100.2 VV/(2VV + AV + VA).
2 the Russell–Rao coefficients
RR 1% = 100.AA/D and RR2% = 100.VV/D.
3 the Simple match and Simple mismatch coefficients
Sma% = 100.(VV + AA)/D and
Smis% = 100.(AV + VA)/D.
The displayed sample averaged– is calculated by d– = (1/N2) Σi,jfi.fj.d(i, j) where d(i, j) is the proximity value of races i and j computed according to the formula of the selected coefficient, fi and fj are the number of occurrences of races i and j, respectively.
References
Citing Literature
Number of times cited according to CrossRef: 32
- Edyta Paczos-Grzęda, Sylwia Sowa, Virulence Structure and Diversity of Puccinia coronata f. sp. avenae P. Syd. & Syd. in Poland During 2013 to 2015 , Plant Disease, 10.1094/PDIS-10-18-1820-RE, (PDIS-10-18-1820), (2019).
- Austin G. McCoy, Zachary Noel, Adam H. Sparks, Martin Chilvers, hagis, an R Package Resource for Pathotype Analysis of Phytophthora sojae Populations Causing Stem and Root Rot of Soybean , Molecular Plant-Microbe Interactions, 10.1094/MPMI-07-19-0180-A, (MPMI-07-19-0180), (2019).
- Antonín Dreiseitl, Great pathotype diversity and reduced virulence complexity in a Central European population of Blumeria graminis f. sp. hordei in 2015–2017, European Journal of Plant Pathology, 10.1007/s10658-018-1593-6, 153, 1, (199-209), (2018).
- Japheth D. Weems, Carl A. Bradley, Exserohilum turcicum Race Population Distribution in the North Central United States , Plant Disease, 10.1094/PDIS-01-17-0128-RE, 102, 2, (292-299), (2018).
- Sylwia Magdalena Okoń, Tomasz Ociepa, Virulence structure of the Blumeria graminis DC.f. sp. avenae populations occurring in Poland across 2010–2013, European Journal of Plant Pathology, 10.1007/s10658-017-1220-y, 149, 3, (711-718), (2017).
- Aralbek Rsaliyev, Zhazira Pahratdinova, Shynbolat Rsaliyev, Characterizing the pathotype structure of barley powdery mildew and effectiveness of resistance genes to this pathogen in Kazakhstan, BMC Plant Biology, 10.1186/s12870-017-1130-3, 17, S1, (2017).
- H. M. Murithi, J. S. Haudenshield, F. Beed, G. Mahuku, M. H. A. J. Joosten, G. L. Hartman, Virulence Diversity of Phakopsora pachyrhizi Isolates From East Africa Compared to a Geographically Diverse Collection , Plant Disease, 10.1094/PDIS-10-16-1470-RE, 101, 7, (1194-1200), (2017).
- Antonin Dreiseitl, Heterogeneity of Powdery Mildew Resistance Revealed in Accessions of the ICARDA Wild Barley Collection, Frontiers in Plant Science, 10.3389/fpls.2017.00202, 8, (2017).
- Anmin Wan, Xianming Chen, Jonathan Yuen, Races of Puccinia striiformis f. sp. tritici in the United States in 2011 and 2012 and Comparison with Races in 2010 , Plant Disease, 10.1094/PDIS-10-15-1122-RE, 100, 5, (966-975), (2016).
- A. E. Dorrance, J. Kurle, A. E. Robertson, C. A. Bradley, L. Giesler, K. Wise, V. C. Concibido, Pathotype Diversity of Phytophthora sojae in Eleven States in the United States , Plant Disease, 10.1094/PDIS-08-15-0879-RE, 100, 7, (1429-1437), (2016).
- S. Stewart, A. E. Robertson, D. Wickramasinghe, M. A. Draper, A. Michel, A. E. Dorrance, Population Structure Among and Within Iowa, Missouri, Ohio, and South Dakota Populations of Phytophthora sojae , Plant Disease, 10.1094/PDIS-04-15-0437-RE, 100, 2, (367-379), (2016).
- Gordana Šurlan-Momirović, Kerstin Flath, Cristina Silvar, Gordana Branković, Doris Kopahnke, Desimir Knežević, Edgar Schliephake, Frank Ordon, Dragan Perović, Exploring the Serbian GenBank barley (Hordeum vulgare L. subsp. vulgare) collection for powdery mildew resistance, Genetic Resources and Crop Evolution, 10.1007/s10722-015-0246-2, 63, 2, (275-287), (2015).
- M. S. McLean, A. Martin, S. Gupta, M. W. Sutherland, G. J. Hollaway, G. J. Platz, Validation of a new spot form of net blotch differential set and evidence for hybridisation between the spot and net forms of net blotch in Australia, Australasian Plant Pathology, 10.1007/s13313-014-0285-8, 43, 3, (223-233), (2014).
- Fan-song ZENG, Li-jun YANG, Shuang-jun GONG, Wen-qi SHI, Xue-jiang ZHANG, Hua WANG, Li-bo XIANG, Min-Feng XUE, Da-zhao YU, Virulence and Diversity of Blumeria graminis f. sp. tritici Populations in China, Journal of Integrative Agriculture, 10.1016/S2095-3119(13)60669-3, 13, 11, (2424-2437), (2014).
- B. Klocke, K. Flath, T. Miedaner, Virulence phenotypes in powdery mildew (Blumeria graminis) populations and resistance genes in triticale (x Triticosecale), European Journal of Plant Pathology, 10.1007/s10658-013-0257-9, 137, 3, (463-476), (2013).
- A. Dreiseitl, R. A. Fowler, G. J. Platz, Pathogenicity of Blumeria graminis f. sp. hordei in Australia in 2010 and 2011, Australasian Plant Pathology, 10.1007/s13313-013-0227-x, 42, 6, (713-721), (2013).
- M. A. Tucker, K. Jayasena, S. R. Ellwood, R. P. Oliver, Pathotype variation of barley powdery mildew in Western Australia, Australasian Plant Pathology, 10.1007/s13313-013-0226-y, 42, 5, (617-623), (2013).
- Leila Maria Costamilan, Cláudia Cristina Clebsch, Rafael Moreira Soares, Claudine Dinali Santos Seixas, Cláudia Vieira Godoy, Anne Elizabeth Dorrance, Pathogenic diversity of Phytophthora sojae pathotypes from Brazil, European Journal of Plant Pathology, 10.1007/s10658-012-0128-9, 135, 4, (845-853), (2012).
- Antonín Dreiseitl, Evsey Kosman, Virulence phenotypes of Blumeria graminis f. sp. hordei in South Africa, European Journal of Plant Pathology, 10.1007/s10658-012-0143-x, 136, 1, (113-121), (2012).
- Mark S. McLean, Barbara J. Howlett, T. Kelly Turkington, Greg J. Platz, Grant J. Hollaway, Spot Form of Net Blotch Resistance in a Diverse Set of Barley Lines in Australia and Canada, Plant Disease, 10.1094/PDIS-06-11-0477, 96, 4, (569-576), (2012).
- Gabriel A. Schachtel, Amos Dinoor, Antje Herrmann, Evsey Kosman, Comprehensive Evaluation of Virulence and Resistance Data: A New Analysis Tool, Plant Disease, 10.1094/PDIS-02-12-0114-SR, 96, 7, (1060-1063), (2012).
- Hong-xia Yuan, Jun-wei Sun, Wei-xing Yang, Xiao-ping Xing, Zhen-yue Wang, Ian T. Riley, Hong-lian Li, New pathotypes of Heterodera avenae (cereal cyst nematode) from winter wheat in Zhengzhou, Henan, China , Australasian Plant Pathology, 10.1071/AP09050, 39, 2, (107), (2010).
- Jing-huan ZHU, Jun-mei WANG, Qiao-jun JIA, Jian-ming YANG, Yi-jun ZHOU, Feng LIN, Wei HUA, Yi SHANG, Pathotypes and Genetic Diversity of Blumeria graminis f. sp. hordei in the Winter Barley Regions in China, Agricultural Sciences in China, 10.1016/S1671-2927(09)60277-7, 9, 12, (1787-1798), (2010).
- W. Dawit, K. Flath, W.E. Weber, E. Schumann, E. Kosman, Virulence and diversity of Puccinia striiformis f. sp. tritici in Ethiopia , Canadian Journal of Plant Pathology, 10.1080/07060660909507594, 31, 2, (211-219), (2009).
- C. D. Cruz, A. E. Dorrance, Characterization and Survival of Cercospora sojina in Ohio , Plant Health Progress, 10.1094/PHP-2009-0512-03-RS, 10, 1, (17), (2009).
- Y. Sun, S.M. Neate, S. Zhong, B.J. Steffenson, T.L. Friesen, Amplified fragment length polymorphism and virulence polymorphism in Puccinia hordei , Canadian Journal of Plant Pathology, 10.1080/07060660709507434, 29, 1, (25-34), (2007).
- Antonín Dreiseitl, Junmei Wang, Virulence and diversity of Blumeria graminis f.sp. hordei in East China, European Journal of Plant Pathology, 10.1007/s10658-007-9104-1, 117, 4, (357-368), (2007).
- Antonín Dreiseitl, Amos Dinoor, Evsey Kosman, Virulence and Diversity of Blumeria graminis f. sp. hordei in Israel and in the Czech Republic , Plant Disease, 10.1094/PD-90-1031, 90, 8, (1031-1038), (2006).
- D. K. Malvick, E. Grunden, Traits of Soybean-Infecting Phytophthora Populations from Illinois Agricultural Fields , Plant Disease, 10.1094/PDIS.2004.88.10.1139, 88, 10, (1139-1145), (2004).
- F. M. Abu-El Samen, G. A. Secor, N. C. Gudmestad, Variability in Virulence Among Asexual Progenies of Phytophthora infestans , Phytopathology, 10.1094/PHYTO.2003.93.3.293, 93, 3, (293-304), (2003).
- A. E. Dorrance, S. A. McClure, A. deSilva, Pathogenic Diversity of Phytophthora sojae in Ohio Soybean Fields , Plant Disease, 10.1094/PDIS.2003.87.2.139, 87, 2, (139-146), (2003).
- undefined Johnson, The use of binary and octal notation for designating races of plant pathogens, Plant Pathology, 10.1046/j.1365-3059.1999.00328.x, 48, 2, (159-160), (2002).




