Back to Journals » Risk Management and Healthcare Policy » Volume 17

Navigating Quality Assessment Hurdles in Clinical Laboratory Services: A Comprehensive Review in Resource-Limited Settings

Authors Cherie N , Deress T , Berta DM , Chane E , Teketelew BB , Adane K , Nigus M

Received 3 December 2023

Accepted for publication 28 February 2024

Published 5 March 2024 Volume 2024:17 Pages 497—504

DOI https://doi.org/10.2147/RMHP.S453020

Checked for plagiarism Yes

Review by Single anonymous peer review

Peer reviewer comments 2

Editor who approved publication: Dr Gulsum Kubra Kaya



Negesse Cherie,1 Teshiwal Deress,1 Dereje Mengesha Berta,2 Elias Chane,3 Bisrat Birke Teketelew,2 Kasaw Adane,1 Mesele Nigus1

1Department of Quality Assurance and Laboratory Management, School of Biomedical and Laboratory Sciences, College of Medicine and Health Sciences, University of Gondar, Gondar, Ethiopia; 2Department of Hematology and Immunohematology, School of Biomedical and Laboratory Sciences, College of Medicine and Health Sciences, University of Gondar, Gondar, Ethiopia; 3Department of Clinical Chemistry, School of Biomedical and Laboratory Sciences, College of Medicine and Health Sciences, University of Gondar, Gondar, Ethiopia

Correspondence: Negesse Cherie, Tel +251 962-712-572, Email [email protected]

Abstract: External quality assessment is the process of evaluating the performance of a laboratory and the competence of professionals. Participation in EQA and standardizing the quality of laboratory services are a mandatory requirements for accreditation. This review is aimed at identifying and discussing challenges that hinder the effective implementation of an EQA program in countries with resource limited setting. To obtain abundant information, articles were identified by searching the literature publishedin English using the National Library of Medicine, PubMed, Science Direct and AMC digital library databases. The articles identified in the references were manually searched and included. After the article was identified, it was imported to Endnote version 8.1 and exported to Microsoft Word for citation. Based on this review, the major identified challenges that hinder the implementation of an EQA program include the high cost of control materials, malfunction and lack of maintenance for equipment failure and breakdown, a knowledge gap among laboratory professionals, noncommutability of control samples, and difficulty in assigning target values. In addition, failing to participate in EQA and failing to take corrective action are the major challenges identified. As a result, applying to an EQA program in resource-limited counties was highly challenging. To attain high performance in the laboratory and to provide quality laboratory service for patient care, the EQA supplier and the user laboratory must pay attention to these issues and take appropriate corrective actions for ongoing quality improvement and accreditation.

Keywords: external quality assessment, proficiency testing, challenge, resource-limited countries

Introduction

Assessing and standardizing the quality of laboratory services and making corrections enables efficient delivery of healthcare services.1–3 Internal quality control and External Quality Assessment (EQA) are complementary components of the quality assurance process and are crucial for quality management, process improvement, and the provision of high-quality health care.4,5 Participation and improvement in analytical quality through EQA guarantee good laboratory performance.6

The EQA is a system of periodic evaluations of overall laboratory performance against the expected standard requirements of a specific discipline.7,8 It evaluates trueness, intra- and interlaboratory variations, and linearity; distinguishes between methods; and tracks ongoing harmonization efforts.5,9–11 It is a process in which commutable samples are sent regularly to members of a group of laboratories for analysis, and the results are compared with the anticipated target value or between laboratories in the group and/or with a given value and reported to the participating laboratories.12 Most commonly, this can be implemented through proficiency testing (PT) because the majority of laboratory tests are conducted and most laboratory professionals are familiar with the procedure.13 The EQA programme addresses the preanalytical, analytical, and postanalytical processes of the laboratory.14

External quality assessment is a crucial part of a laboratory’s overall quality management system (QMS) and is mandated by the Clinical and Laboratory Standards Institute and the International Organization for Standardization (ISO) 15189 accreditation.15–17 The external quality assessment aims to address their inadequacies through interlaboratory comparisons and ensures the validity of test results.18 The application of an EQA ensures the quality and standardization of laboratory test results and is vital for developing best practices for EQA providers.11 All diagnostic laboratory services can participate in the EQA program to guarantee the accuracy and dependability of the diagnostic operations carried out by a laboratory.19,20

An effective EQA programme is the result of all the activities and procedures performed in medical laboratories to improve the consistency and relevance of test results.1 To guarantee quality, EQA addresses the analytical procedures, the acquisition and maintenance of equipment and reagents, employee training, and result reporting and interpretation.21,22 An international standard has been published that specifies management requirements and mandates that EQA providers set up and run such programs.23

Nevertheless, public health laboratories in resource-limited countries have recently begun to use national and worldwide QMSs to deliver quality laboratory services, including involvement in EQA programs. However, participation alone does not ensure analytical quality; rather, laboratory management and personnel must make concerted efforts to increase quality by addressing any gaps through EQA feedback.24 However, in developing nations, there is a limited understanding of the significance of adopting laboratory testing quality for patient care. As a result, governments must understand the significance of laboratory tests and dedicate sufficient resources to ensuring quality.6 To achieve this goal, a national quality testing programme needs to be established, local programme management competence needs to grow, and whenever possible, local proficiency test item preparation needs to be encouraged.25 This review is aimed at illustrating EQA challenges and providing combined information for policymakers to establish local PT programmes and for researchers to conduct further root cause analysis studies.

Methods

This review aims to identify and discuss the challenges affecting the application of EQA by narrating different literature and providing comprehensive information for readers, researchers, and policymakers. To achieve this objective, we used basic searching methods to identify the literature published in English using key searching terms such as challenges, external quality assessment, proficiency testing, and resource-limited countries at the National Library of Medicine, PubMed, Science Direct, and AMC digital library databases. The articles identified in the references were manually searched and included. After the article was identified, it was imported to Endnote version 8.1 and exported to Microsoft Word for citation.

Challenges to External Quality Assessment

The laboratory services in resource-limited countries suffer from insufficiencies in consumables, basic equipment, skilled employees, training programs, logistical assistance, and national standard quality evaluation.26 Most public health laboratories in resource-limited countries provide services but are less likely to support an effective healthcare system. This is because of outdated infrastructure, poor development and application of quality management systems, and insufficient involvement in EQA programs.27 Participation in the EQA program in resource-limited countries faced different challenges, including sample commutability and assigned target values; transportation and shipment; expenses from the EQA program; equipment and reagent supplies; awareness and motivation of laboratory professionals; and utilization of feedback, which has a direct impact on the implementation of the EQA.

Infrastructure and Technology

Major challenges facing laboratory services in underdeveloped settings include weak infrastructure, human capacity shortages, a lack of laboratory policies, strategic plans and integrated national quality management systems. The infrastructure of national laboratories in resource-constrained countries declines precipitously at each subsequent laboratory tier level, and national governments’ oversight of laboratories is dispersed. With time, there will be fewer updates to the physical infrastructure of laboratories, including upkeep of already existing facilities and the creation of desperately required facilities.

Laboratory Equipment and Consumables

Technological advancements in performance measurements are required to reduce errors in data processing, analysis, and presentation.28 Nevertheless, even if technology has the ability to assist EQA programs, their execution is frequently difficult and can provide fewer than ideal outcomes.29 The adoption of these technologies is influenced by political and economic factors, organizational characteristics and leadership.30

The utilization of laboratory reagents and equipment is the basis for providing clinical laboratory services. However, the main issues that resulted in a laboratory service interruption and further impacted the implementation of an EQA program were malfunction, lack of maintenance, and a shortage of consumables.31,32 Depending on the organization, between 50 and 96% of the medical equipment in low-income nations is broken and not in use.32 The challenges that affect the implementation of EQA include laboratory equipment failure and downtime due to stockouts of reagents, improper handling and use of medical equipment, frequent power failures, aging equipment, inadequate operator training, lack of preventive maintenance, shortage of spare parts, insufficient maintenance capacity, and little knowledge of sophisticated equipment as contributing factors to equipment breakdowns.33–35

EQA Sample Management

Patients may be misdiagnosed incorrectly due to bias in the results reported from various laboratories using the same measurement tool. When commutable samples are used to identify these discrepancies, this risk can be decreased by adopting EQA programs. Variations may result from assay imprecision, variations in analytical specificity, individual laboratory procedures, or the traceability of the calibrators.36–38 However, the preparation of ideal EQA material is limited due to the large number of samples required for a large number of participating laboratories. Moreover, the quality of stained smear images deteriorates, which results in difficulty in assessing staining capability.39,40

Another challenge for the provision of EQA for laboratory testing is the choice of assay material for automated cell counting. Because of the inherent contradiction between material commutability and stability, as well as the lack of verified reference materials and techniques available for tracing results, there is no optimal assay material for automated cell counting.41,42 Furthermore, as EQA products are not approved control materials, the participating laboratories are not permitted to use them as controls for diagnostic tests. The European Union’s Vitro Diagnostic Device Directive expressly exempts the EQA sample distribution, which is not included in the diagnostic laboratory as a clinical test control.43

Using verified commutable samples and assigning a target value determined from a reference measurement method or by comparison with an approved reference material are the two main components of an efficient EQA program.39 When the results from many methods are comparable to those from patient samples containing the same number of analytes, the EQA sample is considered commutable.37,44,45 Nevertheless, cost-effectively attaining commutability poses a challenge for EQA providers when developing fit-for-purpose EQA materials.12 The need for large sample volumes, a wide range of concentrations of the measurand, and sample stability has led providers to use materials treated with stabilizers and supplemented with materials of human or nonhuman origins, leading to EQA samples that are not commutable with authentic clinical samples.37,46 It is impossible to assess method accuracy in the absence of commutable samples. Using the same procedure and assuming matrix-related bias, peer groups or participant groups are used to evaluate and classify laboratories because it is not feasible to compare them to the same given value.44,47,48

Assigning a target value for noncommutable EQA samples is a challenge. A reference measurement method is less helpful when sample commutability is unknown because it is impossible to distinguish between a calibration bias and a matrix-related bias of uncertain size when deviation from the target value occurs.49 Under these circumstances, the target value is the peer group mean or median after the outlier is excluded; however, the size of the peer group affects this value; larger peer groups will have a greater influence on the target value; the value may vary based on the proportion of participants using different measurement procedures; and the target value is probably inappropriate.39,50

Logistics and Supply Chain of EQA Samples

To maintain the integrity of the EQA samples throughout transportation, ISO/IEC 17043 mandates that EQA suppliers set up and oversee these circumstances.51 It must be packaged in compliance with international and national hazardous material rules. These packing techniques should be used, and indicator strips in packages containing EQA samples should be used to regularly check transportation temperatures.51,52 However, there has not been a regular definition or monitoring of transportation temperatures for EQA samples. The unseasonably warm temperatures were the cause of the temperature failure. Moreover, determining the appropriate packaging temperature to accommodate predefined transportation temperatures for all the EQA samples was time-consuming.51–53 In addition, the delivery of EQA samples may sometimes be delayed. Furthermore, frequent changes in address by the participants and/or contact persons not informed regularly to the PT provider hinder smooth delivery of EQA samples as well as important communication regarding the EQA scheme.40

Financial Constraints

Another hurdle for the participation and implementation of an EQA program is the allocation of sufficient budgets and resources. Clinical laboratories in resource-limited settings are expected to cost $512,751, or 32% of the overall cost of quality. Approximately 94% of the overall quality cost was incurred in developing and adhering to procedures that guarantee good laboratory practices and support high-quality results.54 The costs and registration fees for an EQA scheme should not be underestimated.15,55 Exorbitant registration costs have the potential to induce withdrawal from EQA participation, which could undermine accreditation by exposing errors that go undetected or delay the detection of testing issues. To guarantee that adequate effort can be placed into the selection and validation of samples as well as the evaluation of EQA outcomes, EQA providers must have a sizeable budget. Establishing an organization to promote patient safety-oriented educational EQA programs is advised.56,57

The main expenses for managing an EQA program were pay and benefits (52%), costs associated with the EQA survey materials (15%), shipping costs (10%), and travel costs (4%). The capacity to predict shipping costs and the practicalities of shipping, including customs and broker fees, were major obstacles to EQA participation in resource-limited nations, such as Ethiopia. Depending on the location in question and the material hazard classification, shipping prices can vary by a factor of more than ten.58 Based on the quantity of survey materials, the cost of a typical laboratory that offers regular shipping along with basic chemical, hematological, and serological tests may vary from $3000 to $5000 each year.49

Staff Awareness and Motivation

An effective EQA necessitates appropriate staff involvement and reported evaluation. It is expected that EQA providers will communicate with and be aware of the departmental head to notify the laboratory in the event of performance problems. General laboratory personnel should be aware of the performance of the laboratory and any emerging difficulties. It is imperative to establish channels of communication for EQA performance and difficulties within laboratories.11 However, the major challenge for the implementation of an EQA program is that most employees lack knowledge and expertise, and they do not fully understand the objective of PT, which leads to a failure to identify gaps based on EQA feedback.15,27

The challenges affecting the implementation of EQA include institutional factors, such as a lack of adequate facilities, a scarcity of qualified workers, and a lack of laboratory policies, strategic plans, and integrated national quality management systems.59,60 Although the aforementioned issues are obstacles to the efficient use of PT, no regulatory bodies or national central laboratories are responsive to these problems, possibly because regulatory bodies are not under scrutiny of the low performance of the laboratory.

Future Opportunities

Additional updates will be made to the EQAP tool. A more robust assurance of superior program management must be provided via scheme accreditation. The significant steps include validating EQA program sample sets, applying statistical evaluation techniques, and drawing inferences about participant or method performance. Laboratory performance is considered valid only when impermeable sample data and statistical methods are present.61,62

The EQA schemes can develop into more creative setups and lack an asset framework. Traditional EQA systems evaluates performance at the laboratory level; however, current problems, such as variations in staining performance and interpretation, call for a change to the evaluation of individual participation.63 Individual-based EQA programmes strive to improve practices through training and offer the opportunity to identify issues that are specific to individuals.64 The training of laboratory staff to operate at their best daily may benefit from this kinds of EQA strategy.

The issue of not wishing to employ false samples, which may differ from routine cases, and the lack of material from real samples are also avoided by using digital technology. All pathologists are capable evaluating real samples and interpreting real cases complete with all the complexities and potential hazards, even in the situation of minimal tissue. Furthermore, the most recent developments in machine learning and artificial intelligence in pathology have led to more accurate diagnosis, prognosis, treatment prediction, and detection, minimizing interindividual variability.65–67

Web applications will further improve the service of the EQA program; electronic replies and images imitating a microscopic view offer new possibilities for cytology, histopathology, and the bone marrow EQA program. It is also better to use photographs of urine sediments and videos of sperm motility. International collaboration with European EQA organizers offers opportunities to exchange experiences, share common sample materials, and establish international schemes. This approach offers unique opportunities to improve the quality of programs.

Conclusion

We conclude from this analysis that there are several obstacles to overcome when applying or implementing an EQA program in clinical laboratory services. The majority of the difficulties found fall under the category of external difficulties and involve managing and preparing samples, allocating funds and supplies, shipping, and transporting goods. Other issues that were shown to be related to internal issues included employee engagement, equipment validation and maintenance, and integrated national management systems. Overcoming these obstacles through Establishing national EQA program and providing training about quality management system for laboratory professionals is vital for better quality of laboratory results and continuous improvement.

Abbreviations

EQA, External Quality Assessment; ISO, International Organization for Standardization; PT, Proficiency Testing; QMS, Quality Management System.

Data Sharing Statement

The data used to support the findings of this review are available from different articles obtained by searching the literature published in English using the National Library of Medicine, PubMed, Google Scholar, and Google Scholar databases.

Acknowledgments

The authors would like to acknowledge the authors of the articles included in this review

Author Contributions

All authors made a significant contribution to the work reported, whether that is in the conception, study design, execution, acquisition of data, analysis and interpretation, or in all these areas; took part in drafting, revising or critically reviewing the article; gave final approval of the version to be published; have agreed on the journal to which the article has been submitted; and agree to be accountable for all aspects of the work.

Funding

There is no funding to report.

Disclosure

The authors declare no conflicts of interest in this work.

References

1. World Health Organization. SEA/RC49/12-Quality Assurance in Laboratory Practices. WHO Regional Office for South‒East Asia; 1996.

2. Peter TF, Shimada Y, Freeman RR, Ncube BN, Khine -A-A, Murtagh MM. The need for standardization in laboratory networks. Am J Clin Pathol. 2009;131(6):867–874. doi:10.1309/AJCPCBMOHM7SM3PJ

3. Bonini P, Plebani M, Ceriotti F, Rubboli F. Errors in laboratory medicine. Clin Chem. 2002;48(5):691–698. doi:10.1093/clinchem/48.5.691

4. World Health Organization. SEA/RC49/20-Report of the Forty-Ninth Session, Chiang Mai, Thailand. World Health Organization; 1996.

5. Ceriotti F. The role of external quality assessment schemes in monitoring and improving the standardization process. Clin Chim Acta. 2014;432:77–81. doi:10.1016/j.cca.2013.12.032

6. World health Organization. WHO Manual for Organizing a National External Quality Assessment Programme for Health Laboratories and Other Testing Sites. World health Organization; 2016.

7. Grimont PA, Weill F-X. Antigenic formulae of the Salmonella serovars. In: WHO Collaborating Center for Reference and Research on Salmonella. Vol. 9. World Health Organization; 2007:1–166.

8. Banoo S, Bell D, Bossuyt P, et al. Evaluation of diagnostic tests for infectious diseases: general principles. Nat Rev Microbiol. 2007;5(Suppl 11):S21–S31. doi:10.1038/nrmicro1523x

9. Plebani M. Harmonization in laboratory medicine: the complete picture. Clin Chem Lab Med. 2013;51(4):741–751. doi:10.1515/cclm-2013-0075

10. Ceriotti F, Cobbaert C. Harmonization of external quality assessment schemes and their role–clinical chemistry and beyond. Clin Chem Lab Med. 2018;56(10):1587–1590. doi:10.1515/cclm-2018-0265

11. James D, Ames D, Lopez B, Still R, Simpson W, Twomey P. External quality assessment: best practice. J Clin Pathol. 2014;67(8):651–655. doi:10.1136/jclinpath-2013-201621

12. Miller WG. The role of proficiency testing in achieving standardization and harmonization between laboratories. Clin Biochem. 2009;42(4–5):232–235. doi:10.1016/j.clinbiochem.2008.09.004

13. Martinez A, Balandrano S, Parissi A, et al. Evaluation of new external quality assessment guidelines involving random blinded rechecking of acid-fast bacilli smears in a pilot project setting in Mexico. Int J Tuberc Lung Dis. 2005;9(3):301–305.

14. Ibrahim F, Dosoo D, Kronmann KC, et al. Good clinical laboratory practices improved proficiency testing performance at clinical trials centers in Ghana and Burkina Faso. PLoS One. 2012;7(6):e39098. doi:10.1371/journal.pone.0039098

15. Sciacovelli L, Secchiero S, Padoan A, Plebani M. External quality assessment programs in the context of ISO 15189 accreditation. Clin Chem Lab Med. 2018;56(10):1644–1654. doi:10.1515/cclm-2017-1179

16. QMS24 C. Using proficiency testing and alternative assessment to improve medical laboratory quality. In: Madison. WI, USA: CLSI; 2016.

17. Nah E-H, Cho S, Kim S, et al. International organization for standardization (ISO) 15189. Ann Lab Med. 2017;37(5):365–370. doi:10.3343/alm.2017.37.5.365

18. Woods GL, Ridderhof JC. Quality assurance in the mycobacteriology laboratory: quality control, quality improvement, and proficiency testing. Clinics Lab Med. 1996;16(3):657–675. doi:10.1016/S0272-2712(18)30260-9

19. Hastings RJ, Maher EJ, Quellhorst-Pawley B, Howell RT. An internet-based external quality assessment in cytogenetics that audits a laboratory’s analytical and interpretative performance. Eur J Hum Genet. 2008;16(10):1217–1224. doi:10.1038/ejhg.2008.82

20. Howell R, Hastings R. The current scope of cytogenetics external quality assessment schemes and key recommendations for harmonization of external quality assessment in Europe. In: EuroGentest Network of Excellence Project; 2006.

21. Baldeshwiler AM. History of FDA good laboratory practices. Qual Assur J. 2003;7(3):157–161. doi:10.1002/qaj.228

22. Co-operation OfE, Development. OECD Guidelines for Quality Assurance in Molecular Genetic Testing. OCDE; 2007.

23. Ghernaout D, Aichouni M, Alghamdi A. Overlapping ISO/IEC 17025: 2017 into big data: a review and perspectives. Int J Sci Qual Anal. 2018;4(3):83–92.

24. Laboratories WHOWGo QAoH. External Quality Assessment of Health Laboratories: Report on a WHO Working Group, Brussels, 4–7 December 1979. Vol. 36. Regional Office for Europe, World Health Organization; 1981.

25. Stevens W, Gous N, Ford N, Scott LE. Feasibility of HIV point-of-care tests for resource-limited settings: challenges and solutions. BMC Med. 2014;12(1):1–8. doi:10.1186/s12916-014-0173-7

26. Petti CA, Polage CR, Quinn TC, Ronald AR, Sande MA. Laboratory medicine in Africa: a barrier to effective health care. Clinl Infect Dis. 2006;42(3):377–382. doi:10.1086/499363

27. Gurmessa A, Sisay A. Proficiency test feedback utilization at government hospitals laboratory, Addis Ababa, Ethiopia. Med Diagn Methods. 2017;6(258):2.

28. Walshe K, Smith J. Healthcare Management. McGraw-Hill Education (UK); 2011.

29. van Limburg M, van Gemert-Pijnen JE, Nijland N, Ossebaard HC, Hendrix RM, Seydel ER. Why business modeling is crucial in the development of eHealth technologies. J Med Int Res. 2011;13(4):e124. doi:10.2196/jmir.1674

30. Greenhalgh T, Wherton J, Papoutsi C, et al. Beyond adoption: a new framework for theorizing and evaluating nonadoption, abandonment, and challenges to the scale-up, spread, and sustainability of health and care technologies. J Med Int Res. 2017;19(11):e8775. doi:10.2196/jmir.8775

31. Mate KS, Rooney AL, Supachutikul A, Gyani G. Accreditation as a path to achieving universal quality health coverage. Globalization Health. 2014;10(1):1–8. doi:10.1186/s12992-014-0068-6

32. Belete R, Cheneke W, Getachew A, Abdu A. Challenges of Clinical chemistry analyzers utilization in public hospital laboratories of selected zones of Oromia Region, Ethiopia: a Mixed Methods Study. Biomed J Sci Tech Res. 2021;34(4):26957–26964. doi:10.26717/BJSTR.2021.34.005584

33. Mekonnen A, Gurmessa A, Kebede A, Kedir S, Likinew W, Yenealem D. Performance of international external quality assessment scheme participant laboratories in Ethiopia (2016–2018). Am J Lab Med. 2020;5(5):131–138. doi:10.11648/j.ajlm.20200505.11

34. Perry L, Malkin R. Effectiveness of Medical Equipment Donations to Improve Health Systems: How Much Medical Equipment is Broken in the Developing World? Vol. 49. Springer; 2011:719–722.

35. Wamai RG. Reviewing Ethiopia’s health system development. Population. 2004;75:31.

36. Norling A, Bökman CF, Göransson E, et al. Evaluating commutability of control materials in three nordic external quality assessment schemes for lipoproteins. J Appl Lab Med. 2021;6(6):1580–1591. doi:10.1093/jalm/jfab058

37. Badrick T, Miller WG, Panteghini M, et al. Interpreting EQA—understanding why commutability of materials matters. Clin Chem. 2022;68(4):494–500. doi:10.1093/clinchem/hvac002

38. Sandle LN. The management of external quality assurance. J Clin Pathol. 2005;58(2):141–144. doi:10.1136/jcp.2003.015545

39. Miller WG, Jones GR, Horowitz GL, Weykamp C. Proficiency testing/external quality assessment: current challenges and future directions. Clin Chem. 2011;57(12):1670–1680. doi:10.1373/clinchem.2011.168641

40. Wattal C, Oberoi JK, Goel N, Datta S, Raveendran R, Prasad KJ. Experience of Indian association of medical microbiology external quality assurance scheme center, New Delhi: challenges and quality assessment of clinical microbiology laboratories. Indian J Med Microbiol. 2019;37(2):163–172. doi:10.4103/ijmm.IJMM_19_356

41. Berge Kristensen GB, Meijer P. Interpretation of EQA results and EQA-based trouble shooting. Biochem Med. 2017;27(1):49–62. doi:10.11613/BM.2017.007

42. De la Salle B. Survey material choices in hematology EQA: a confounding factor in automated counting performance assessment. Biochem Med. 2017;27(1):63–72. doi:10.11613/BM.2017.008

43. Hastings RJ, Howell RT. The importance and value of EQA for diagnostic genetic laboratories. J Community Genet. 2010;1(1):11–17. doi:10.1007/s12687-010-0009-x

44. Valdivieso-Gómez V, Aguilar-Quesada R. Quality management systems for laboratories and external quality assurance programs. InTech. 2018;22:21.

45. Miller WG, Myers GL, Rej R. Why Commutability Matters. Vol. 52. Oxford University Press; 2006:553–554.

46. Miller WG. Specimen materials, target values and commutability for external quality assessment (proficiency testing) schemes. Clin Chim Acta. 2003;327(1–2):25–37. doi:10.1016/S0009-8981(02)00370-4

47. Miller WG, Myers GL, Ashwood ER, et al. State of the art in trueness and interlaboratory harmonization for 10 analytes in general clinical chemistry. Arch Pathol Lab Med. 2008;132(5):838–846. doi:10.5858/2008-132-838-SOTAIT

48. Vesper HW, Miller WG, Myers GL. Reference materials and commutability. Clin Biochem Rev. 2007;28(4):139.

49. Timan IS, Aulia D, Santoso W. External quality assessment scheme and laboratory accreditation in Indonesia. Rinsho Byori Jap J Clin Pathol. 2002;50(2):126–130.

50. Braga F, Infusino I, Panteghini M. Performance criteria for combined uncertainty budget in the implementation of metrological traceability. Clin Chem Lab Med. 2015;53(6):905–912. doi:10.1515/cclm-2014-1240

51. Gun-Munro J. The challenges and benefits of implementing the requirements of ISO/IEC 17043 by PT/EQA providers. Accredit Qual Assur. 2012;17(4):363–370. doi:10.1007/s00769-012-0887-1

52. Wong S-K. Performance evaluation for proficiency testing with a limited number of participants. Accredit Qual Assur. 2011;16(11):539–544. doi:10.1007/s00769-011-0816-8

53. de Albano FM, ten Caten CS. Proficiency tests for laboratories: a systematic review. Accredit Qual Assur. 2014;19(4):245–257. doi:10.1007/s00769-014-1061-8

54. Elbireer A, Gable AR, Jackson JB. Cost of quality at a clinical laboratory in a resource-limited country. Lab Med. 2010;41(7):429–433. doi:10.1309/LMCZ0ZFR80QWIBEM

55. Thompson M, Ellison SL, Wood R. The International Harmonized Protocol for the proficiency testing of analytical chemistry laboratories (IUPAC Technical Report). Pure Appl Chem. 2006;78(1):145–196. doi:10.1351/pac200678010145

56. Thunnissen E, Bubendorf L, Dietel M, et al. EML4-ALK testing in non-small cell carcinomas of the lung: a review with recommendations. Virchows Archiv. 2012;461:245–257. doi:10.1007/s00428-012-1281-4

57. Tembuyser L, Dequeker EM. Endorsing good quality assurance practices in molecular pathology: risks and recommendations for diagnostic laboratories and external quality assessment providers. Virchows Archiv. 2016;468:31–41. doi:10.1007/s00428-015-1839-z

58. Saxena R, Katoch S, Srinivas U, Rao S, Anand H. Impact of external hematology proficiency testing programme on quality of laboratories. Indian J Med Res. 2007;126(5):428–432.

59. Birx D, de Souza M, Nkengasong JN. Laboratory challenges in the scaling up of HIV, TB, and malaria programs: the interaction of health and laboratory systems, clinical research, and service delivery. Am J Clin Pathol. 2009;131(6):849–851. doi:10.1309/AJCPGH89QDSWFONS

60. Vitoria M, Granich R, Gilks CF, et al. The global fight against HIV/AIDS, tuberculosis, and malariacurrent status and future perspectives. Am J Clin Pathol. 2009;131(6):844–848. doi:10.1309/AJCP5XHDB1PNAEYT

61. Guide I. Annex A: Proficiency Testing by Interlaboratory Comparisons–Part 1: Development and Operation of Proficiency Testing Schemes. Genf: International Standard Organization; 1996.

62. Middle JG, Libeer J-C, Malakhov V, Penttilä I. Characterisation and evaluation of external quality assessment scheme serum. Discussion paper from the European External Quality Assessment (EQA) Organisers Working Group C. Clin Chem Lab Med. 1998;36(2):119–130. doi:10.1515/CCLM.1998.023

63. Brunnström H, Johansson A, Westbom-Fremer S, et al. PD-L1 immunohistochemistry in clinical diagnostics of lung cancer: interpathologist variability is higher than assay variability. Mod Pathol. 2017;30(10):1411–1421. doi:10.1038/modpathol.2017.59

64. England N. Pathology Quality Assurance Review. Leeds, UK: NHS England; 2014.

65. K-h Y, Zhang C, Berry GJ, et al. Predicting non-small cell lung cancer prognosis by fully automated microscopic pathology image features. Nat Commun. 2016;7(1):12474. doi:10.1038/ncomms12474

66. Akbar S, Peikari M, Salama S, Panah AY, Nofech-Mozes S, Martel AL. Automated and manual quantification of tumor cellularity in digital slides for tumor burden assessment. Sci Rep. 2019;9(1):14099. doi:10.1038/s41598-019-50568-4

67. Bera K, Schalper KA, Rimm DL, Velcheti V, Madabhushi A. Artificial intelligence in digital pathology—new tools for diagnosis and precision oncology. Nat Rev Clin Oncol. 2019;16(11):703–715. doi:10.1038/s41571-019-0252-y

Creative Commons License © 2024 The Author(s). This work is published and licensed by Dove Medical Press Limited. The full terms of this license are available at https://www.dovepress.com/terms.php and incorporate the Creative Commons Attribution - Non Commercial (unported, v3.0) License. By accessing the work you hereby accept the Terms. Non-commercial uses of the work are permitted without any further permission from Dove Medical Press Limited, provided the work is properly attributed. For permission for commercial use of this work, please see paragraphs 4.2 and 5 of our Terms.