Chemistry, Manufacturing and Controls Community

  • 1.  Uncertainty in Measurements

    Posted 3 days ago

    All measured values are wrong, but some are useful.

    One score and 13 years ago the Bureau International des Poids et Mesures (BIPM), in conjunction with the IEC, IFCC, ISO, IUPAC, OIML, published the "Guide to the Expression of Uncertainty in Measurement" (GUM). This document defined a reportable measurement as Y ± ku, where Y is a plausible estimate of the unknowable true value of the quantity intended to be measured (the measurand), u is a quantitative estimate of the uncertainty of the measurement process, and k specifies the level of plausibility associated with the estimated uncertainty, where k = 1 (plausible), k = 2 (highly plausible), k = 3 (very highly plausible). This concept has not been embraced by the general public, journalists, and many technical personnel involved in the production and regulation of pharmaceutical products, all of whom still blissfully assume that the reportable value for a measurement is some single numerical "best estimate" and who frequently misunderstand or are ignorant of the fact that such a "best estimate" is at best a fuzzy number that could plausibly be somewhat different because this "best estimate" is the product of a fallible measurement process that always produces results with some associated uncertainty-and that they are duty-bound to also simultaneously report their "best estimate" of this uncertainty! Over ten years ago I and coauthors presented a history of the development of the concept of measurement uncertainty for an audience of statisticians ["A Historical Perspective on Analytical Measurement Uncertainty: From Cotes, Laplace and Gauss to GUM and Implications for Current Practice." Presented at the Midwest Biopharmaceutical Statistics Workshop, Ball State University, Muncie, IN, May 18–20, 2015] and later I wrote a "sermon" on this topic [William R. Porter, "Are You Uncertain About Uncertainty?" J GXP Compliance 21(3) (May 30, 2017)], both attached below. My question to the community is how successful have you been in educating others about the concept of measurement uncertainty and the need to report an estimate of uncertainty in conjunction with each reported "best estimate" of the "measurand"? What works?



    ------------------------------
    William Porter Ph.D.
    Retired
    Peak Process Performance Partners LLC
    Vernon Hills IL
    [email protected]

    Disclaimer: Opinions expressed are solely my own and do not express the views or opinions of my employer.
    ------------------------------


  • 2.  RE: Uncertainty in Measurements

    Posted 3 days ago

    Thanks for this, William - very timely given the requirement to calculate the confidence intervals associated with point estimates of accuracy and precision during method validation (ICH Q2 (R2)).  Historically, the industry has not paid much attention to linking method validation acceptance criteria to the allowable error in the parameter measured.  This is now changing, and the concept of target measurement uncertainty provides a sound basis for demonstrating that a method is suitable for use, bearing in mind the allowable error in measurement.  The go-to text on measurement uncertainty is the joint Eurachem/CITAC guide "Quantifying Uncertainty in Analytical Measurement" - https://www.eurachem.org/index.php/publications/guides/quam.  



    ------------------------------
    Mark Powell PhD
    Director
    Mark Powell Scientific Limited
    NESTON
    [email protected]

    Disclaimer: Opinions expressed are solely my own and do not express the views or opinions of my employer.
    ------------------------------



  • 3.  RE: Uncertainty in Measurements

    Posted 3 days ago

    Of course the QUAM is the go-to guide for professionals responsible for ensuring the adoption of measures to incorporate uncertainty estimation in method validation. But diving into the QUAM is a little like diving into the deep end of a swimming pool if you are just learning how to swim. Fortunately, the UK's National Physical Laboratory's Stephanie Bell wrote a masterly Beginner's Guide to Uncertainty in Measurement (https://eprintspublications.npl.co.uk/1568/1/MGPG11.pdf ), which may not be familiar to many folk just getting started. I'm hoping that other community members may have identified similar very basic publications useful for training the uninitiated.



    ------------------------------
    William Porter Ph.D.
    Retired
    Peak Process Performance Partners LLC
    Vernon Hills IL
    [email protected]

    Disclaimer: Opinions expressed are solely my own and do not express the views or opinions of my employer.
    ------------------------------



  • 4.  RE: Uncertainty in Measurements

    Posted 2 days ago
    I have a suggestion. Many of us in this group face data uncertainty when preparing regulatory submissions. How about creating a mini course based on ICH and other sources identified during this conversation? Creating this course could benefit both our community and regulatory affairs professionals.
    Best,

    R. Falcone, Ph.D., FRAPS, FTOPRA





  • 5.  RE: Uncertainty in Measurements

    Posted 2 days ago

    Good idea, Robert. Also, I wonder if the USP might be interested in developing online tools in this area.



    ------------------------------
    Mark Powell PhD
    Director
    Mark Powell Scientific Limited
    NESTON
    [email protected]

    Disclaimer: Opinions expressed are solely my own and do not express the views or opinions of my employer.
    ------------------------------



  • 6.  RE: Uncertainty in Measurements

    Posted 2 days ago
    We can ask them, EP, and ICH. If there is consensus to develop this idea further, I suggest we get together to refine the concept.
    Rob