Highlighted Text:
Show |
Hide
Full text loading...
Chapter 55 : Molecular Method Verification
Authors:
Donna M. Wolk1,
Elizabeth M. Marlowe2
VIEW AFFILIATIONS
HIDE AFFILIATIONS
Affiliations:
1: University of Arizona, College of Medicine, Department of Pathology and BIO5 Institute, Tucson, AZ 85724-5059;
2: Southern California Permanente Medical Group, Regional Reference Laboratories, North Hollywood, CA 91605
Content Type: Reference
Publication Year:
2011
Category: Clinical Microbiology; Bacterial Pathogenesis
Book DOI:
10.1128/9781555816834
Chapter DOI:
10.1128/9781555816834.ch55
MyBook is a cheap paperback edition of the original book and will be sold at uniform, low price.
Preview this chapter:
Molecular Method Verification, Page 1 of 2
< Previous page | Next page > /docserver/preview/fulltext/10.1128/9781555816834/9781555814977_Chap55-1.gif /docserver/preview/fulltext/10.1128/9781555816834/9781555814977_Chap55-2.gif
Abstract:
This chapter talks about aspects of molecular method verification as well as the common statistical analyses that are used during this process. Stevenson et al. showed how polymorphisms in the probe target can affect the performance of an herpes simplex virus (HSV) real-time PCR assay. Such polymorphisms can result in decreased sensitivity of an assay, which is critical for a cerebrospinal fluid (CSF) specimen. In this study using the crossing threshold (CT) as a cutoff for assay sensitivity, it was estimated that as many as 15% of the HSV type 1 (HSV-1)-positive and 7% of the HSV-2-positive specimens would be missed when comparing two real-time HSV PCRs based on commercially available analyte specific reagents (ASRs). The author's clinical laboratory research is, in essence, translational research, in which their purpose is to describe, explain, predict outcomes, and control their systems. The chapter focuses on those aspects of biostatistics that are relevant to the verification and validation of new laboratory assays. Clinical Laboratory Improvement Act (CLIA) has clear guidelines on the verification and validation of laboratory-developed tests (LDTs) and other non-FDA-approved/ cleared assays. Choices of statistical methods and methods for drawing conclusions on the accuracy are less defined. Analysis of method verification data may require collaboration with a statistician or use of software specifically designed for CLIA method verification such as EP Evaluator.
Citation:
Wolk D, Marlowe E.
2011.
Molecular Method Verification,
p 861-883.
In
Persing D, Tenover F, Tang Y, Nolte F, Hayden R, van Belkum A (ed),
Molecular Microbiology.
ASM Press, Washington, DC.
doi: 10.1128/9781555816834.ch55
Key Concept Ranking
- Real-Time PCR
- 0.69310915
- Hepatitis C virus
- 0.57245827
- Analytical Methods
- 0.562127
- Hepatitis B virus
- 0.5286426
0.69310915
Figures
Molecular Method Verification
[com.pub2web.rdf.cci.facet.ContentItem[id=http://asm.metastore.ingenta.com/content/author/10.1128/9781555816834.ch55-1,webId=/content/author/10.1128/9781555816834.ch55-1,properties={foaf_givenname=Donna M., foaf_name=Donna M. Wolk, foaf_surname=Wolk, pub_isAffiliatedWith=[com.pub2web.rdf.cci.facet.ContentItem[id=http://asm.metastore.ingenta.com/content/affiliation/10.1128/9781555816834.ch55-aff1]]}], com.pub2web.rdf.cci.facet.ContentItem[id=http://asm.metastore.ingenta.com/content/author/10.1128/9781555816834.ch55-2,webId=/content/author/10.1128/9781555816834.ch55-2,properties={foaf_givenname=Elizabeth M., foaf_name=Elizabeth M. Marlowe, foaf_surname=Marlowe, pub_isAffiliatedWith=[com.pub2web.rdf.cci.facet.ContentItem[id=http://asm.metastore.ingenta.com/content/affiliation/10.1128/9781555816834.ch55-aff2]]}]]
Citation:
Wolk D, Marlowe E.
2011.
Molecular Method Verification,
p 861-883.
In
Persing D, Tenover F, Tang Y, Nolte F, Hayden R, van Belkum A (ed),
Molecular Microbiology.
ASM Press, Washington, DC.
doi: 10.1128/9781555816834.ch55
/content/10.1128/9781555816834.ch55.ch55fig01
FIGURE 1
Depiction of a PCR efficiency calculation and graphical representation of PCR efficiency. Dose-response relationship for CT
values and microbe density depicts a linear and inversely proportional relationship at high microbe concentrations. Linear regression shows 99% correlation with linearity to the highest dilutions tested; however, a visual check of CT
values at 100 and 50 organisms per reaction depicts a breakdown in the precision of the data points at that concentration and may predict the microbial density at which assay linearity may begin to decline.
10.1128/9781555816834/f0865-01_thmb.gif
10.1128/9781555816834/f0865-01.gif
FIGURE 1
Depiction of a PCR efficiency calculation and graphical representation of PCR efficiency. Dose-response relationship for CT values and microbe density depicts a linear and inversely proportional relationship at high microbe concentrations. Linear regression shows 99% correlation with linearity to the highest dilutions tested; however, a visual check of CT values at 100 and 50 organisms per reaction depicts a breakdown in the precision of the data points at that concentration and may predict the microbial density at which assay linearity may begin to decline.
Citation:
Wolk D, Marlowe E.
2011.
Molecular Method Verification,
p 861-883.
In
Persing D, Tenover F, Tang Y, Nolte F, Hayden R, van Belkum A (ed),
Molecular Microbiology.
ASM Press, Washington, DC.
doi: 10.1128/9781555816834.ch55
/content/10.1128/9781555816834.ch55.ch55fig02
FIGURE 2
(A) Example of a ROC plot for an imaginary diagnostic test. The true-positive rate (sensitivity) is plotted against the false-positive rate (1—specificity) for every known threshold value. The dotted diagonal line shows the case when the test has no discriminatory power. A test that gives no false-positive or false-negative results has a curve that passes through the top left-hand corner (dotted line), i.e., the distributions of the test results in the two groups are completely separated, and the area under the concentration-time curve equals 1.0. (The test is perfect.) The double-headed arrow shows the effect of varying the threshold value. (B) Comparisons of ROC plots for different test methods; the top line has the highest discriminatory power.
10.1128/9781555816834/f0866-01_thmb.gif
10.1128/9781555816834/f0866-01.gif
FIGURE 2
(A) Example of a ROC plot for an imaginary diagnostic test. The true-positive rate (sensitivity) is plotted against the false-positive rate (1—specificity) for every known threshold value. The dotted diagonal line shows the case when the test has no discriminatory power. A test that gives no false-positive or false-negative results has a curve that passes through the top left-hand corner (dotted line), i.e., the distributions of the test results in the two groups are completely separated, and the area under the concentration-time curve equals 1.0. (The test is perfect.) The double-headed arrow shows the effect of varying the threshold value. (B) Comparisons of ROC plots for different test methods; the top line has the highest discriminatory power.
Citation:
Wolk D, Marlowe E.
2011.
Molecular Method Verification,
p 861-883.
In
Persing D, Tenover F, Tang Y, Nolte F, Hayden R, van Belkum A (ed),
Molecular Microbiology.
ASM Press, Washington, DC.
doi: 10.1128/9781555816834.ch55
/content/10.1128/9781555816834.ch55.ch55fig03
FIGURE 3
Illustration of a 2 × 2 table to diagram terms commonly used to describe assay performance during diagnostic method assessment. Fill in the boxes according to agreement status and calculate the column totals (down, up) or row totals (right, left), as indicated in
Fig. 2
B, to be used to calculate sensitivity, specificity, PPV, and NPV. Sensitivity = TP/(TP + FN) or a/ (a + c) × 100. Specificity = TN(FP + TN) or d/(d + b) × 100. PPV = TP/(TP + FP) or a/(a + b) × 100. NPV = TN/(TN + FP) or d/(d + c) × 100.
10.1128/9781555816834/f0867-01_thmb.gif
10.1128/9781555816834/f0867-01.gif
FIGURE 3
Illustration of a 2 × 2 table to diagram terms commonly used to describe assay performance during diagnostic method assessment. Fill in the boxes according to agreement status and calculate the column totals (down, up) or row totals (right, left), as indicated in Fig. 2 B, to be used to calculate sensitivity, specificity, PPV, and NPV. Sensitivity = TP/(TP + FN) or a/ (a + c) × 100. Specificity = TN(FP + TN) or d/(d + b) × 100. PPV = TP/(TP + FP) or a/(a + b) × 100. NPV = TN/(TN + FP) or d/(d + c) × 100.
Citation:
Wolk D, Marlowe E.
2011.
Molecular Method Verification,
p 861-883.
In
Persing D, Tenover F, Tang Y, Nolte F, Hayden R, van Belkum A (ed),
Molecular Microbiology.
ASM Press, Washington, DC.
doi: 10.1128/9781555816834.ch55
/content/10.1128/9781555816834.ch55.ch55fig04
FIGURE 4
(Top) Example of a medical decision interval defined by biologic and assay variability. Per CLSI MM06-A, the medical decision interval for HIV-1 quantitative assay is 0.5 log or threefold. Therefore, if the biological variability is already known to be 0.3 log, as in the case of HIV-1, then in order to meet the medical decision requirements for HIV treatment protocols, the assay precision must possess an SD of ≤0.2 log across the quantitative dynamic range. If this is true, the %CV will vary across the range, as in this example, which shows a 12% CV at 50 copies and a 4% CV at 50,000 copies. (Bottom) Example of establishment of quantitative control limits by determining ranges based on assay tolerance limits, which are 0.2 log10 SD for a hepatitis B virus midrange control (n = 28 replicates). Note: for numerical values <10, two decimals are displayed; for values >10, no significant figures are displayed.
10.1128/9781555816834/f0868-01_thmb.gif
10.1128/9781555816834/f0868-01.gif
FIGURE 4
(Top) Example of a medical decision interval defined by biologic and assay variability. Per CLSI MM06-A, the medical decision interval for HIV-1 quantitative assay is 0.5 log or threefold. Therefore, if the biological variability is already known to be 0.3 log, as in the case of HIV-1, then in order to meet the medical decision requirements for HIV treatment protocols, the assay precision must possess an SD of ≤0.2 log across the quantitative dynamic range. If this is true, the %CV will vary across the range, as in this example, which shows a 12% CV at 50 copies and a 4% CV at 50,000 copies. (Bottom) Example of establishment of quantitative control limits by determining ranges based on assay tolerance limits, which are 0.2 log10 SD for a hepatitis B virus midrange control (n = 28 replicates). Note: for numerical values <10, two decimals are displayed; for values >10, no significant figures are displayed.
Citation:
Wolk D, Marlowe E.
2011.
Molecular Method Verification,
p 861-883.
In
Persing D, Tenover F, Tang Y, Nolte F, Hayden R, van Belkum A (ed),
Molecular Microbiology.
ASM Press, Washington, DC.
doi: 10.1128/9781555816834.ch55
/content/10.1128/9781555816834.ch55.ch55fig05
FIGURE 5
Example of calibration curves showing a standard curve with increased variability at the low end of microbial density (expected versus actual IU/milliliter, purchased standards [0–6.7 log IU/ml], real-time PCR, hepatitis C virus). The Poisson distribution characterizes the behavior of analyte and precision at the LLOD.
10.1128/9781555816834/f0869-01_thmb.gif
10.1128/9781555816834/f0869-01.gif
FIGURE 5
Example of calibration curves showing a standard curve with increased variability at the low end of microbial density (expected versus actual IU/milliliter, purchased standards [0–6.7 log IU/ml], real-time PCR, hepatitis C virus). The Poisson distribution characterizes the behavior of analyte and precision at the LLOD.
Citation:
Wolk D, Marlowe E.
2011.
Molecular Method Verification,
p 861-883.
In
Persing D, Tenover F, Tang Y, Nolte F, Hayden R, van Belkum A (ed),
Molecular Microbiology.
ASM Press, Washington, DC.
doi: 10.1128/9781555816834.ch55
/content/10.1128/9781555816834.ch55.ch55fig06
FIGURE 6
Example of Bland-Altman plot analysis to characterize the log difference between two assays with relationship to different genotypes.
10.1128/9781555816834/f0869-02_thmb.gif
10.1128/9781555816834/f0869-02.gif
FIGURE 6
Example of Bland-Altman plot analysis to characterize the log difference between two assays with relationship to different genotypes.
Citation:
Wolk D, Marlowe E.
2011.
Molecular Method Verification,
p 861-883.
In
Persing D, Tenover F, Tang Y, Nolte F, Hayden R, van Belkum A (ed),
Molecular Microbiology.
ASM Press, Washington, DC.
doi: 10.1128/9781555816834.ch55
/content/10.1128/9781555816834.ch55.ch55fig07
FIGURE 7
Flow diagram depicting categories of results and options from a qualitative method verification. Describe data with descriptive statistics and 2×2 tables, and then analyze data with inferential statistics.
10.1128/9781555816834/f0874-01_thmb.gif
10.1128/9781555816834/f0874-01.gif
FIGURE 7
Flow diagram depicting categories of results and options from a qualitative method verification. Describe data with descriptive statistics and 2×2 tables, and then analyze data with inferential statistics.
Citation:
Wolk D, Marlowe E.
2011.
Molecular Method Verification,
p 861-883.
In
Persing D, Tenover F, Tang Y, Nolte F, Hayden R, van Belkum A (ed),
Molecular Microbiology.
ASM Press, Washington, DC.
doi: 10.1128/9781555816834.ch55
/content/10.1128/9781555816834.ch55.ch55fig08
FIGURE 8
Graphing the distribution of data. One can use histograms or curves to display data distribution in the form of frequency distributions, which are important to assess whether or not the data have a normal distribution, as depicted in the top diagram. If the data do not have a normal distribution (e.g., bottom diagram), one cannot use parametric statistics, like the t test, to compare the means; one must use nonparametric statistics. One can use box and whisker plots and quantiles (described in
Fig. 9
) to help assess the midpoint of the data.
10.1128/9781555816834/f0875-01_thmb.gif
10.1128/9781555816834/f0875-01.gif
FIGURE 8
Graphing the distribution of data. One can use histograms or curves to display data distribution in the form of frequency distributions, which are important to assess whether or not the data have a normal distribution, as depicted in the top diagram. If the data do not have a normal distribution (e.g., bottom diagram), one cannot use parametric statistics, like the t test, to compare the means; one must use nonparametric statistics. One can use box and whisker plots and quantiles (described in Fig. 9 ) to help assess the midpoint of the data.
Citation:
Wolk D, Marlowe E.
2011.
Molecular Method Verification,
p 861-883.
In
Persing D, Tenover F, Tang Y, Nolte F, Hayden R, van Belkum A (ed),
Molecular Microbiology.
ASM Press, Washington, DC.
doi: 10.1128/9781555816834.ch55
/content/10.1128/9781555816834.ch55.ch55fig09
FIGURE 9
Descriptive midpoint measurements, depicted in a box and whiskers plot, displaying the major quantiles. Outliers have undue influence on the mean; therefore, the mean may be misleading, depending on the magnitude of the variation from the median. This image depicts an example of a box and whiskers plot created from the distribution of an internal positive control cycle threshold value (IPC Ct
) produced when a real-time PCR assay was performed in different sample matrices. Quantiles are values at which a specific percentage of results fall below the value of the quantile in the sample set.
10.1128/9781555816834/f0876-01_thmb.gif
10.1128/9781555816834/f0876-01.gif
FIGURE 9
Descriptive midpoint measurements, depicted in a box and whiskers plot, displaying the major quantiles. Outliers have undue influence on the mean; therefore, the mean may be misleading, depending on the magnitude of the variation from the median. This image depicts an example of a box and whiskers plot created from the distribution of an internal positive control cycle threshold value (IPC Ct ) produced when a real-time PCR assay was performed in different sample matrices. Quantiles are values at which a specific percentage of results fall below the value of the quantile in the sample set.
Citation:
Wolk D, Marlowe E.
2011.
Molecular Method Verification,
p 861-883.
In
Persing D, Tenover F, Tang Y, Nolte F, Hayden R, van Belkum A (ed),
Molecular Microbiology.
ASM Press, Washington, DC.
doi: 10.1128/9781555816834.ch55
/content/10.1128/9781555816834.ch55.ch55fig10
FIGURE 10
The empirical rule. For data sets having a normal bell-shaped distribution, the following properties apply: about 68% of all values fall within 1 SD of the mean; about 95% of all values fall within 2 SD of the mean; and about 99.7% of all values fall within 3 SD of the mean.
10.1128/9781555816834/f0876-02_thmb.gif
10.1128/9781555816834/f0876-02.gif
FIGURE 10
The empirical rule. For data sets having a normal bell-shaped distribution, the following properties apply: about 68% of all values fall within 1 SD of the mean; about 95% of all values fall within 2 SD of the mean; and about 99.7% of all values fall within 3 SD of the mean.
Citation:
Wolk D, Marlowe E.
2011.
Molecular Method Verification,
p 861-883.
In
Persing D, Tenover F, Tang Y, Nolte F, Hayden R, van Belkum A (ed),
Molecular Microbiology.
ASM Press, Washington, DC.
doi: 10.1128/9781555816834.ch55
/content/10.1128/9781555816834.ch55.ch55fig11
FIGURE 11
Systematic error (bias) versus random error. A calculation can correct for a bias, but imprecision cannot be corrected by calculation. (Top left) Good precision with poor accuracy gives a biased result (the average is off center). (Top right) Poor precision and poor accuracy give a biased result (the average is off center). (Bottom left) Good precision and good accuracy give an unbiased result (the average is on center). (Bottom right) Poor precision with good accuracy gives an unbiased result (the average is on center).
10.1128/9781555816834/f0877-01_thmb.gif
10.1128/9781555816834/f0877-01.gif
FIGURE 11
Systematic error (bias) versus random error. A calculation can correct for a bias, but imprecision cannot be corrected by calculation. (Top left) Good precision with poor accuracy gives a biased result (the average is off center). (Top right) Poor precision and poor accuracy give a biased result (the average is off center). (Bottom left) Good precision and good accuracy give an unbiased result (the average is on center). (Bottom right) Poor precision with good accuracy gives an unbiased result (the average is on center).
Citation:
Wolk D, Marlowe E.
2011.
Molecular Method Verification,
p 861-883.
In
Persing D, Tenover F, Tang Y, Nolte F, Hayden R, van Belkum A (ed),
Molecular Microbiology.
ASM Press, Washington, DC.
doi: 10.1128/9781555816834.ch55
/content/10.1128/9781555816834.ch55.ch55fig12
FIGURE 12
A one-tailed t test in the positive direction. A one-tailed test determines whether a particular population parameter is larger than some predefined value. The t test uses one critical “t” value, defined from a table. If the sample mean falls outside the accepted area (95%), then the null is rejected (the area shaded in gray is the area for rejection of the null hypothesis).
10.1128/9781555816834/f0878-01_thmb.gif
10.1128/9781555816834/f0878-01.gif
FIGURE 12
A one-tailed t test in the positive direction. A one-tailed test determines whether a particular population parameter is larger than some predefined value. The t test uses one critical “t” value, defined from a table. If the sample mean falls outside the accepted area (95%), then the null is rejected (the area shaded in gray is the area for rejection of the null hypothesis).
Citation:
Wolk D, Marlowe E.
2011.
Molecular Method Verification,
p 861-883.
In
Persing D, Tenover F, Tang Y, Nolte F, Hayden R, van Belkum A (ed),
Molecular Microbiology.
ASM Press, Washington, DC.
doi: 10.1128/9781555816834.ch55
/content/10.1128/9781555816834.ch55.ch55fig13
FIGURE 13
(A) An x-y graph with regression analysis: in the simplest case, there are two variables, one explanatory (x) and one response variable (y), i.e., a change in x causes a change in y. It is always worth viewing your data (if possible) before performing regressions to get an idea as to the type of relationship (e.g., whether it is best described by a straight line or a curve). By looking at this scatter plot, it can be seen that variables x and y have a close relationship that may be reasonably represented by a straight line. This would be represented mathematically as y = a + bx + e, where a describes where the line crosses the y axis, b describes the slope of the line, and e is an error term that describes the variation of the real data above and below the line. Simple linear regression attempts to find a straight line that best fits the data, where the variation of the real data above and below the line is minimized. (B) Enlarged section of panel A, with residuals and fitted values shown. Assuming that variation in y is explained by variation of x, we can begin our regression. This output will tell us several things: the equation of the fitted line, formal information regarding the association of the variables, and how well the fitted line describes the data. There are two values: R
2 (the coefficient of determination), and r (the correlation coefficient). R
2 indicates the proportion of variance in one variable that can be explained by the variance in the other variable. If R
2 = 0.98, 98% of the change in y can be predicted by the changes in x. For the parameter, r is a measure of linear association (the degree of the relationship) for data with a normal distribution. For perfect positive linear correlations, r = 1.0; for a perfect negative linear correlation, r = –1.0 and the line slopes from the top right of the graph to the bottom left. Since not all relationships are linear, one must examine the data to assess if a straight line is the best fit for the data; in most laboratory evaluations, this will be the case. (C) The regression equation and its graphical depiction of the line of equality and the y intercept. The y intercept represents systematic bias of x to y quantitative comparison.
10.1128/9781555816834/f0879-01_thmb.gif
10.1128/9781555816834/f0879-01.gif
FIGURE 13
(A) An x-y graph with regression analysis: in the simplest case, there are two variables, one explanatory (x) and one response variable (y), i.e., a change in x causes a change in y. It is always worth viewing your data (if possible) before performing regressions to get an idea as to the type of relationship (e.g., whether it is best described by a straight line or a curve). By looking at this scatter plot, it can be seen that variables x and y have a close relationship that may be reasonably represented by a straight line. This would be represented mathematically as y = a + bx + e, where a describes where the line crosses the y axis, b describes the slope of the line, and e is an error term that describes the variation of the real data above and below the line. Simple linear regression attempts to find a straight line that best fits the data, where the variation of the real data above and below the line is minimized. (B) Enlarged section of panel A, with residuals and fitted values shown. Assuming that variation in y is explained by variation of x, we can begin our regression. This output will tell us several things: the equation of the fitted line, formal information regarding the association of the variables, and how well the fitted line describes the data. There are two values: R 2 (the coefficient of determination), and r (the correlation coefficient). R 2 indicates the proportion of variance in one variable that can be explained by the variance in the other variable. If R 2 = 0.98, 98% of the change in y can be predicted by the changes in x. For the parameter, r is a measure of linear association (the degree of the relationship) for data with a normal distribution. For perfect positive linear correlations, r = 1.0; for a perfect negative linear correlation, r = –1.0 and the line slopes from the top right of the graph to the bottom left. Since not all relationships are linear, one must examine the data to assess if a straight line is the best fit for the data; in most laboratory evaluations, this will be the case. (C) The regression equation and its graphical depiction of the line of equality and the y intercept. The y intercept represents systematic bias of x to y quantitative comparison.
Citation:
Wolk D, Marlowe E.
2011.
Molecular Method Verification,
p 861-883.
In
Persing D, Tenover F, Tang Y, Nolte F, Hayden R, van Belkum A (ed),
Molecular Microbiology.
ASM Press, Washington, DC.
doi: 10.1128/9781555816834.ch55
References
/content/book/10.1128/9781555816834.ch55
1.
Bachmann, L. M.,, R. G. Ter,, W. E. Weber, and, A. G. Kessels. 2008. Multivariable adjustments counteract spectrum and test review bias in accuracy studies. J. Clin. Epidemiol. 62: 357– 361.e2.
2.
Barbeau, J. M.,, J. Goforth,, A. M. Caliendo, and, F. S. Nolte. 2004. Performance characteristics of a quantitative TaqMan hepatitis C virus RNA analyte-specific reagent. J. Clin. Microbiol. 42: 3739– 3746.
3.
Birdsong, G. G. 2007. Testing the test: remediation is needed. Cancer 111: 461– 464.
4.
Bland, J. M.,, and D. G. Altman. 1986. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1: 307– 310.
5.
Bossuyt, P. M.,, and J. B. Reitsma. 2003. The STARD initiative. Lancet 361: 71.
6.
Bossuyt, P. M.,, J. B. Reitsma,, D. E. Bruns,, C. A. Gatsonis,, P. P. Glasziou,, L. M. Irwig,, J. G. Lijmer,, D. Moher,, D. Rennie, and, H. C. de Vet. 2003. Toward complete and accurate reporting of studies of diagnostic accuracy. The STARD initiative. Am. J. Clin. Pathol. 119: 18– 22.
7.
Bossuyt, P. M.,, J. B. Reitsma,, D. E. Bruns,, C. A. Gatsonis,, P. P. Glasziou,, L. M. Irwig,, D. Moher,, D. Rennie,, H. C. de Vet, and, J. G. Lijmer. 2003. The STARD statement for reporting studies of diagnostic accuracy: explanation and elaboration. Ann. Intern. Med. 138: W1– W12.
8.
Centers for Disease Control and Prevention. 2004. Clinical Laboratory Improvement Act, Subpart K, 493.1253. 7 July 2004. Centers for Disease Control and Prevention, Atlanta, GA.
9.
Centers for Disease Control and Prevention. 2004. Current CLIA Regulations. 7 July 2004. Centers for Disease Control and Prevention, Atlanta, GA.
10.
Clark, R. B.,, M. A. Lewinski,, M. J. Loeffelholz, and, R. J. Tibbetts. 2009. Cumitech 31A, Verification and Validation of Procedures in the Clinical Microbiology Laboratory. Coordinating ed., S. E. Sharp. ASM Press, Washington, DC.
11.
CLSI. 2005. User Verification of Performance for Precision and Trueness; Approved Guideline—Second Edition (EP15-A2). Clinical Laboratory Standards Institute, Wayne, PA.
12.
Crawford, J. M. 2007. Original research in pathology: judgment, or evidence-based medicine? Lab. Investig. 87: 104– 114.
13.
Dewitte, K.,, C. Fierens,, D. Stockl, and, L. M. Thienpont. 2002. Application of the Bland-Altman plot for interpretation of method-comparison studies: a critical investigation of its practice. Clin. Chem. 48: 799– 801.
14.
Germer, J. J.,, M. O. Qutub,, J. N. Mandrekar,, P. S. Mitchell, and, J. D. Yao. 2006. Quantification of hepatitis B virus (HBV) DNA with a TaqMan HBV analyte-specific reagent following sample processing with the MagNA pure LC instrument. J. Clin. Microbiol. 44: 1490– 1494.
15.
Glaser, A. N. 2001. High-Yield Biostatistics. Lippincott Williams & Wilkins, Philadelphia, PA.
16.
Green, T. A.,, C. A. Black, and, R. E. Johnson. 2001. In defense of discrepant analysis. J. Clin. Epidemiol. 54: 210– 215.
17.
Hadgu, A. 1999. Discrepant analysis: a biased and an unscientific method for estimating test sensitivity and specificity. J. Clin. Epidemiol. 52: 1231– 1237.
18.
Hadgu, A. 2000. Discrepant analysis is an inappropriate and unscientific method. J. Clin. Microbiol. 38: 4301– 4302.
19.
Ihorst, G.,, J. Forster,, G. Petersen,, H. Werchau,, A. Rohwedder, and, M. Schumacher. 2007. The use of imperfect diagnostic tests had an impact on prevalence estimation. J. Clin. Epidemiol. 60: 902– 910.
20.
Issa, N. C.,, M. J. Espy,, J. R. Uhl, and, T. F. Smith. 2005. Sequencing and resolution of amplified herpes simplex virus DNA with intermediate melting curves as genotype 1 or 2 by LightCycler PCR assay. J. Clin. Microbiol. 43: 1843– 1845.
21.
Jennings, L.,, V. M. Van Deerlin, and, M. L. Gulley. 2009. Recommended principles and practices for validating clinical molecular pathology tests. Arch. Pathol. Lab. Med. 133: 743– 755.
22.
Laposata, M.,, and A. Dighe. 2007. “Pre-pre” and “post-post” analytical error: high-incidence patient safety hazards involving the clinical laboratory. Clin. Chem. Lab. Med. 45: 712– 719.
23.
Leeflang, M. M.,, K. G. Moons,, J. B. Reitsma, and, A. H. Zwinderman. 2008. Bias in sensitivity and specificity caused by data-driven selection of optimal cutoff values: mechanisms, magnitude, and solutions. Clin. Chem. 54: 729– 737.
24.
Liang, S. L.,, M. T. Lin,, M. J. Hafez,, C. D. Gocke,, K. M. Murphy,, L. J. Sokoll, and, J. R. Eshleman. 2008. Application of traditional clinical pathology quality control techniques to molecular pathology. J. Mol. Diagn. 10: 142– 146.
25.
McAdam, A. J. 2000. Discrepant analysis: how can we test a test? J. Clin. Microbiol. 38: 2027– 2029.
26.
McQueen, M. 2003. Evidence-based laboratory medicine: addressing bias, generalisability and applicability in studies on diagnostic accuracy. The STARD initiative. Clin. Chem. Lab. Med. 41: 1.
27.
NCCLS. 2003. Quantitative Molecular Methods for Infectious Diseases. NCCLS Document MM6-P. Approved Guideline. NCCLS, Wayne, PA.
28.
NCCLS. 2004. Evaluation of Precision Performance of Clincial Chemistry Devices. NCCLS Document EP5-A2. NCCLS, Wayne, PA.
29.
Pagano, M.,, and K. Gauvreau. 2000. Principles of Biostatistics. Duxbuty, Pacific Grove, CA.
30.
Rhoads, D. G. 2008. EP Evaluator, Release 8 Users Manual. Data Innovations, South Burlington, VT.
31.
Rhoads, D. G. 2008. Lab Statistics, Fun and Easy. Data Innovations, South Burlington, VT.
32.
Sarrazin, C.,, B. C. Gartner,, D. Sizmann,, R. Babiel,, U. Mihm,, W. P. Hofmann,, M. von Wagner, and, S. Zeuzem. 2006. Comparison of conventional PCR with real-time PCR and branched DNA-based assays for hepatitis C virus RNA quantification and clinical significance for genotypes 1 to 5. J. Clin. Microbiol. 44: 729– 737.
33.
Sternberg, M. 2001. Discrepant analysis is still at large. J. Clin. Microbiol. 39: 826– 827.
34.
Stevenson, J.,, W. Hymas, and, D. Hillyard. 2005. Effect of sequence polymorphisms on performance of two realtime PCR assays for detection of herpes simplex virus. J. Clin. Microbiol. 43: 2391– 2398.
35.
U.S. Food and Drug Administration. 2007. Guidance for Industry and FDA Staff Commercially Distributed Analyte Specific Reagents (ASRs). U.S. Food and Drug Administration, Rockville, MD. http://www.fda.gov/MedicalDevices/DeviceRegulationandGuidance/GuidanceDocuments/ucm078423.htm
36.
Westgard, J. O.,, P. L. Barry,, M. R. Hunt, and, T. Groth. 1981. A multi-rule Shewhart chart for quality control in clinical chemistry. Clin. Chem. 27: 493– 501.
37.
Westgard, J. O.,, and T. Darcy. 2004. The truth about quality: medical usefulness and analytical reliability of laboratory tests. Clin. Chim. Acta 346: 3– 11.
38.
Westgard, J. O.,, and S. A. Westgard. 2006. The quality of laboratory testing today: an assessment of sigma metrics for analytic quality using performance data from proficiency testing surveys and the CLIA criteria for acceptable performance. Am. J. Clin. Pathol. 125: 343– 354.
39.
Wolff, D. J.,, D. L. Heaney,, P. D. Neuwald,, K. A. Stellrecht, and, R. D. Press. 2009. Multi-site PCR-based CMV viral load assessment-assays demonstrate linearity and precision, but lack numeric standardization: a report of the Association for Molecular Pathology. J. Mol. Diagn. 11: 87– 92.
Tables
Molecular Method Verification
[com.pub2web.rdf.cci.facet.ContentItem[id=http://asm.metastore.ingenta.com/content/author/10.1128/9781555816834.ch55-1,webId=/content/author/10.1128/9781555816834.ch55-1,properties={foaf_givenname=Donna M., foaf_name=Donna M. Wolk, foaf_surname=Wolk, pub_isAffiliatedWith=[com.pub2web.rdf.cci.facet.ContentItem[id=http://asm.metastore.ingenta.com/content/affiliation/10.1128/9781555816834.ch55-aff1]]}], com.pub2web.rdf.cci.facet.ContentItem[id=http://asm.metastore.ingenta.com/content/author/10.1128/9781555816834.ch55-2,webId=/content/author/10.1128/9781555816834.ch55-2,properties={foaf_givenname=Elizabeth M., foaf_name=Elizabeth M. Marlowe, foaf_surname=Marlowe, pub_isAffiliatedWith=[com.pub2web.rdf.cci.facet.ContentItem[id=http://asm.metastore.ingenta.com/content/affiliation/10.1128/9781555816834.ch55-aff2]]}]]
Citation:
Wolk D, Marlowe E.
2011.
Molecular Method Verification,
p 861-883.
In
Persing D, Tenover F, Tang Y, Nolte F, Hayden R, van Belkum A (ed),
Molecular Microbiology.
ASM Press, Washington, DC.
doi: 10.1128/9781555816834.ch55
/content/10.1128/9781555816834.ch55.ch55tab01
TABLE 1
Test selection summary
TABLE 1
Test selection summary
Citation:
Wolk D, Marlowe E.
2011.
Molecular Method Verification,
p 861-883.
In
Persing D, Tenover F, Tang Y, Nolte F, Hayden R, van Belkum A (ed),
Molecular Microbiology.
ASM Press, Washington, DC.
doi: 10.1128/9781555816834.ch55
/content/10.1128/9781555816834.ch55.ch55tab02
TABLE 2
Requirements for verification of molecular microbiology assays
a
TABLE 2
Requirements for verification of molecular microbiology assays a
Citation:
Wolk D, Marlowe E.
2011.
Molecular Method Verification,
p 861-883.
In
Persing D, Tenover F, Tang Y, Nolte F, Hayden R, van Belkum A (ed),
Molecular Microbiology.
ASM Press, Washington, DC.
doi: 10.1128/9781555816834.ch55
/content/10.1128/9781555816834.ch55.ch55tab03
TABLE 3
Overview of association methods
TABLE 3
Overview of association methods
Citation:
Wolk D, Marlowe E.
2011.
Molecular Method Verification,
p 861-883.
In
Persing D, Tenover F, Tang Y, Nolte F, Hayden R, van Belkum A (ed),
Molecular Microbiology.
ASM Press, Washington, DC.
doi: 10.1128/9781555816834.ch55