Back to Journals » Patient Preference and Adherence » Volume 16

Information-Seeking Strategies of People with Multiple Sclerosis in Spain: The INFOSEEK-MS Study

Authors Higueras Y, Salas E, Meca-Lallana V, Carrascal Rueda P , Rodríguez De la Fuente O, Cabello-Moruno R, Maurino J , Ruiz Díaz MÁ 

Received 28 October 2021

Accepted for publication 15 December 2021

Published 11 January 2022 Volume 2022:16 Pages 51—60

DOI https://doi.org/10.2147/PPA.S344690

Checked for plagiarism Yes

Review by Single anonymous peer review

Peer reviewer comments 2

Editor who approved publication: Dr Johnny Chen



Yolanda Higueras,1 Elisa Salas,2 Virginia Meca-Lallana,3 Pedro Carrascal Rueda,4 Ofir Rodríguez De la Fuente,5 Rosana Cabello-Moruno,2 Jorge Maurino,2 Miguel Ángel Ruiz Díaz6

1Department of Neurology, Instituto de Investigación Sanitaria Gregorio Marañón, Madrid, Spain; 2Medical Department, Roche Pharma, Madrid, Spain; 3Department of Neurology, Hospital Universitario La Princesa, Madrid, Spain; 4Esclerosis Múltiple España, Madrid, Spain; 5Department of Neurology, Hospital Universitario Puerta de Hierro, Madrid, Spain; 6Universidad Autónoma de Madrid, Madrid, Spain

Correspondence: Elisa Salas
Medical Department, Roche Pharma, Calle Ribera del Loira, 50, Madrid, 28042, Spain
Tel +34 913248173
Email [email protected]

Purpose: Patients with multiple sclerosis (MS) are increasingly demanding access to reliable information regarding their disease. The objective of the INFOSEEK-MS study was to assess what are the strategies people with MS use when searching for information on their disease, including sources, frequency, reliability, and preferred content.
Patients and Methods: A non-interventional, cross-sectional study was conducted. Patients with a diagnosis of MS according to the 2010 McDonald criteria were included. The InfoSeek questionnaire was used to assess patients’ strategies when seeking information about the disease. Clinical characteristics and other variables, including disability, quality of life, fatigue, cognition, anxiety and depression, were analysed using the Expanded Disability Status Scale (EDSS), Multiple Sclerosis Impact Scale (MSIS-29), 5-item Modified Fatigue Scale (MFIS-5), Symbol Digit Modalities Test (SDMT), and Hospital Anxiety and Depression Scale (HADS), respectively.
Results: Three hundred and two patients were studied (mean age: 42.3 ± 10 years, 64% female, mean disease duration: 9.6 ± 7.0 years, 90% with relapsing-remitting MS, and mean EDSS score: 2.6 ± 1.9). The internet (either via mobile or computer) is a frequently reported source of information. Lifestyle-related information (67.2%), research and emerging treatments (63.6%), symptom control (49.7%), sharing experiences with other patients (46.4%), and disease prognosis (46.4%) were the most searched topics. Neurologists and nurses were the most trusted source of information. Younger patients and higher SDMT scores were associated with all search resources (M = 37.7 and M = 49.97, respectively). The frequency of searches was related to the number of relapses (R2 = 0.07), EDSS (R2 = 0.14), MSIS-29 physical and psychological components (R2 = 0.132) and inversely with depression (R2 = 0.132).
Conclusion: Although healthcare professionals are considered the most reliable source of information for people with MS, searching for information on the Internet is very frequent. An individualized information strategy considering the different factors involved is needed.

Keywords: multiple sclerosis, information sources, internet, quality of life, healthcare professionals

Introduction

Multiple sclerosis (MS) is a chronic autoimmune and neurodegenerative disease of the central nervous system that mainly affects young adults.1

The Pew Research Center conducted a survey among 3015 adults in the US in 2016 to explore how people approach facts and information.2 Almost half of the participants (49%) were relatively disinterested and unenthusiastic about the information or the possibility of acquiring further training, especially in relation to digital information. Another 38% had relatively strong interest and trust in information sources and learning. Due to the heterogeneity of MS clinical presentation and the unpredictability of the disease course, patients commonly turn to the Internet and social media to better understand their disease.3,4 It has been suggested how relevant it is to increase disease-related knowledge, since it is correlated with the decision-making process and better quality of life of people with MS.2,5,6

The aim of the INFOSEEK-MS study is to evaluate the way people with MS search for information and the type and peculiarities of the information preferred by MS patients in Spain. We study other variables that may influence the information sources and search strategies.

Methods

INFOSEEK-MS is a non-interventional, cross-sectional study conducted at 18 hospital-based neuro-immunology units in Spain. Eligibility criteria included adult patients diagnosed with MS according to the 2010 revised McDonald criteria and an EDSS score of 0 to 6.0. Excluded patients were those unable to understand the study questionnaire in the investigator’s opinion. The study consisted of a single visit for patient inclusion after signing the informed consent. It was conducted in accordance with the ethical principles of the Declaration of Helsinki and was approved by the institutional review board of the Hospital Universitario Gregorio Marañón (Madrid, Spain).

Design of the InfoSeek Questionnaire

A multidisciplinary research team of a neuropsychologist, two neurologists, an MS nurse, two research managers, a patient organization representative, and a psychometrician participated in the study design and the development of a specific questionnaire to characterize the information needs and preferred sources among MS patients.7 After literature review for content extraction and thorough conceptual discussion, a 17-item version of the self-reported InfoSeek questionnaire was proposed (See Figure 1), containing 8 main dimensions: 1) MS information channels and search frequency, 2) MS resources frequency of use, 3) Activities related to MS management, 4) Type of information searched, 5) Clinical expert consultation frequency, 6) Involvement with patient groups, 7) MS topic relevance, and 8) Quality of information (see Appendix 1). The instrument was pilot-tested in 15 MS patients to assess acceptability, face validity, and item understanding.7

Figure 1 Scheme of the InfoSeek questionnaire construction and validation.

Outcome Measures

The primary outcome was to search strategies, information sources, and communication channels that MS patients use when seeking information about their disease through the InfoSeek questionnaire. The following variables were also assessed:

  • Disability: The Expanded Disability Status Scale (EDSS) is a clinician-rated instrument to quantify and monitor changes in the level of disability over time.8 The EDSS ranges from 0 to 10 in 0.5 unit increments that represent higher levels of disability.
  • Cognition: The Symbol and Digit Modalities Test (SDTM) is a screening tool to measure cognitive impairment, measuring the patient’s attention, concentration, and speed of information.9 It is a 90-second cognitive test in which patients must quickly indicate the digits that correspond to rows of symbols based on a key of pairings between digits and symbols. Scores are established on the number of correct answers.
  • Fatigue: The Modified Fatigue Impact Scale Five-Item Version (MFIS-5) is a brief, self-administered questionnaire for assessing the impact of fatigue on cognitive, physical, and psychosocial function during the past four weeks.10 The MFIS-5 scores each item on a 5-point Likert scale from 0 (never) to four (almost always). The total score ranges from 0 to 20, with a higher score indicating more severe fatigue.
  • Health-related Quality of Life (HRQol): The Multiple Sclerosis Impact Scale (MSIS-29) is a self-report questionnaire for measuring the impact of MS on people’s lives, comprising two subscales: a 20-item physical impact and a 9-item psychological impact scale.11 Items are rated using 4-point response categories: not at all, a little, moderately, and significantly. Scores on the physical and the psychological impact scale can range from 20 to 80 and from 9 to 36, respectively. Higher scores indicate a greater impact.
  • Mood and anxiety: The Hospital Anxiety and Depression Scale (HADS) is a 14-items self-administered questionnaire that provides seven items related to anxiety and seven related to depression, the possible score range from 0 to 21 for either, and it is categorized into non-cases (0 to 7), potential cases (8 to 10), and probable cases (>10).12
  • Shared decision-making: The 9-item Shared Decision-Making Questionnaire (SDM-Q-9) is a self-assessment tool for measuring patients’ perceived level of involvement in decision-making related to their treatment and care.13 The SDM-Q-9 scores each item on a 6-point Likert scale from 0 (completely disagree) to five (completely agree). The raw total score ranges from 0 to 45. A linear transformation of the scale should be done to obtain a range from 0 to 100, with higher values indicating a greater extent of shared decision-making.

Statistical Analysis

An overall description is made for the variables included in the study. Absolute and relative frequency distributions of qualitative variables are presented, as well as measures of central tendency and dispersion (mean, standard deviation, median, minimum, and maximum values) of quantitative variables. Ninety-five percent confidence intervals (CI) are presented for the main quantitative variables of results associated with the primary objective and the main secondary variables. T-Tests are used to compare means for pairs of independent groups on quantitative variables and ANOVA for more than two groups.

Cluster analysis was used to identify profiles within parcels of dichotomous items, like for type of resource used to access the internet. To assess whether different internet resources were used differently by patients to search for information on MS, and exploratory factor analysis was carried out with questions corresponding to the frequency of information search in each resource. Linear regression models were used to identify predictors of internet resources usage.

The sample size was determined by the number of items included in the InfoSeek questionnaire (10–20 items). The psychometric literature recommends a minimum of 4 to 15 subjects per item in the questionnaire.14 In our case, a maximum length of 20 items has been settled, and a sample size between 80 and 300 subjects would be recommended; it was also deemed necessary for a sample composed by 150–300 individuals to obtain solid estimates of item loadings, item variances and covariances, and the structural solution.15

Results

A total of 302 patients were included. Socio-demographic and clinical characteristics of the participants are shown in Table 1.

Table 1 Sociodemographic and Clinical Characteristics

Internet Use

Only 2.6% of participants did not have access to or did not use the Internet. The most frequent access types were mobile phones (86.1%) and personal computers (PC) (79.1%), while 11.9% used public sites. Twenty-two percent of participants did not use the Internet for MS related topics, and from those who did, a 39.1% consulted yearly, 22.8% monthly, 11.9% weekly, and 3.3% daily.

Information Sources

Two types of information sources used for the search of MS were explored: the first related to the use of the Internet and the second to healthcare professionals consulted. Concerning the first one, 17.2% of MS patients did not use any source, while the other 82.8% used between one and eight, being one source (23.5%) and two sources (24.2%) the most common. Sources more frequently used for MS information were browsers (70.9%), social networks (37.4%), and patient association web pages (38.4%). Fewer patients used discussion groups or forum (23.5%), newsletters (21.5%), pharmaceutical web pages for patients (10.9%), and online communities (10.9%). Additionally, 9.6% manifest to use other sources for gathering information about MS.

Regarding the frequency of use, general web-searchers were used monthly or yearly (57%) by most patients followed by daily/weekly (13.9%), while 29.5% never used them. For the rest of the sources, such as online communities, social networks, discussion forums or patients´ organizations, the most common frequency participants informed was “not use them at all” (between 61.6% and 89.1%), while those using them reported monthly or yearly frequency most commonly (7.6–27.1%) (See Figure 2).

Figure 2 Internet channels frequency of use for multiple sclerosis information search (never used excluded).

Related to the specialized sources rated with at least sufficient quality, the most consulted is the one offered by the neurologist (100%), followed by a nurse (67.4%), an ophthalmologist (40.2%), online information (44.9%) and psychologist (36,9%). Less consulted were patients’ organizations (25.2%), rehabilitation physicians (23.9%), physiotherapist (21.6%), and other MS patients or support groups (20.6%). Likewise, around 22% of MS patients received or had access to a specialized periodical publication, although the 78% did not consult them.

Type of Information Searched

The results showed that most of the participants searched for three (12.6%) and four (10.6%) different topics about MS. It is worth pointing out that 12.9% of participants indicated that they searched no topics at all.

The most consulted topics were as follows: information about healthy habits (67.2%), new treatments and MS research (63.6%), symptom control (49.7%), other patient experiences (46.4%), and disease prognosis (46.4%). The most frequent periodicity for refreshing information is once a year (13–31%) and monthly (10–21%), depending on the topic. In relation to this search frequency, topics most recently updated with daily searchers were healthy habits (6%), social experiences from other patients (4.6%), new treatment options (4%), and psychological health management (2.6%) (See Figure 3). However, the most frequent option was not to seek information, ranging from 36% for seeking new treatments to 68% for administrative procedures and 71% for opinions about existing treatments. Reasons for not searching for any information about the disease (n = 176) were not finding reliable information (36.4%) and not wanting to know more about the condition (30.7%). Some delegated on other family members (9%) or could not find what they needed (8%) in scarce cases.

Figure 3 Frequency of use on different multiple sclerosis topics.

Importance of the Information

Quality of life (81%), emerging treatments and research (79%), current treatments (75%), disease progression (64%), disease prognosis (56%), physiotherapy (55%) and symptom control (52%) were the most relevant topics.

Information Reliability

Resource reliability was a relevant aspect for almost half of patients, usually searching for different sources to increase reliability (49%) or not using sources they would not consider reliable (44%). Participants were rated as “excellent quality information”, the information provided by neurologists (66.6%), followed by nurses (38.7%) and psychologists (19.2%). Online information was only rated as “sufficient” by 25.8% of the participants (see Figure 4).

Figure 4 Average quality attributed to different specialized sources.

Patient Organizations

Approximately one in five participants (22.5%) regularly attended a patient organization. These people (n = 67) sought to improve their quality of life (70%), use physiotherapy services (63%) and psychological support (49%). Other less frequent reasons were seeking information about the disease (36%), awareness and advocacy (28%) and help in finding a job (13%).

Lack of awareness of the services offered and the fear of encountering people with severe disability were the main reasons not to turning to patients´ organizations (n = 231). Half of the participants consulted would like to engage in self-support groups online and 33% in person, while 31% do not manifest to have interest in these activities.

Healthcare Support

Ninety-nine percent of participants were managed by a neurologist, and 57% were also seen by general practitioners. In 62% of cases, a telephone or e-mail service was available to patients at the health service they visited. More details are summarized in Table 2.

Table 2 Healthcare Support

Relationship Between Patient Characteristics and Information-Seeking Strategies

Internet Access and Use

Five different patterns have been identified concerning access to the Internet: a) 58% use all available resources simultaneously, including public access, b) 17% only use mobile phone, c) 10% only use PC, d) 10% use mobile and PC indistinctively, and e) 4% did not use Internet at all.

Age

There was a relationship between age and the type of Internet access (F = 5.17, p < 0.001). The group that did not use the Internet was older (M = 49.7) but similar to those using only PC (M = 46.3). Those using all the available methods were younger (M = 37.3) but only differed from those who barely used it. Possibly due to the mediating effect of age, a similar pattern was found for disease duration.

Relapses and Disability

The number of relapses was not statistically related to the type of Internet access, with the only difference of a single case with four relapses and not using the Internet. There was no relation between the Internet access and the EDSS score (F = 1.26, p = 0.287).

Emotional Status, Quality of Life, and Fatigue

The type of Internet access was not related to other health indicators: anxiety (p = 0.199), depression (p = 0.449), health-related quality of life (p = 0.488), mental component (p = 0.184), and fatigue (p = 0.725).

Cognition

We found statistically significant differences in mental processing speed as measured by the SDMT between usage profiles (F = 13.59, p < 0.001), although all groups scored above the cut-off point on average. The group that did not use the Internet scored lower on the SDMT (M = 30.9). Those using only mobile phone (M = 38.0) or PC (M = 41.6) had similar scores, and those using all available resources scored higher (M = 49.97).

Older age (p = 0.005) and longer disease duration (p = 0.020) were associated with not using the internet for information seeking. Physical (p = 0.033) and psychological (p = 0.017) components score of the MSIS-29 and MFIS-5 score (p = 0.042) were associated with information seeking.

Type of Resources and Frequency of Use

Two clusters of information resources were identified with relatively high correlation (r = 0.469). The first cluster grouped specialized resources (patient webs, on-line communities, discussion boards, patient associations) and the second one grouped more general resources (search engines, social networks, and general internet).

The variables that were associated with the most frequent use of specialized resources were the number of relapses (p = 0.0039, R2=0.06), and the physical component score of the MSIS-29 (p < 0.001, R2=0.084). On the other hand, the predictor variables for the frequency of general resource use were the number of relapses (p = 0.010, R2=0.07), EDSS score (p = 0.022, R2=0.14), MSIS-29 physical (p = 0.004, R2=0.132) and psychological components scores (p = 0.022, R2=0.132) and with negative sign depressive symptoms (p = 0.022, R2=0.132).

Discussion

The INFOSEEK-MS study allowed us to gather data about search strategies, information sources, and communication channels that MS patients usually use when seeking information on their health condition using the ad-hoc InfoSeek questionnaire. We found that, in a representative sample of MS patients in Spain, they frequently used the web to search. The majority utilized both a mobile phone and a PC to access the web less than once a month. Interestingly, 13% of participants declared they searched nothing about MS on the web; the reasons were their feelings about the lack of reliability of website information and/or the lack of interest to know more about MS. This aspect must raise a red flag about data quality on the web and lead professionals toward reliable website-sharing resources. An excellent example is the creation of SMsocialnetwork.com, a medically supervised Italian web community that filters the quality of information.16 Lavorgna et al reported that patients found this resource very useful because they found only verified medical information and helped participants to better cope with health-related problems.16,17

Regarding the contents of the search, our patients focused on healthy habits, information about new treatments and how to deal with MS symptoms. These results are in line with those previously published.5,18–20 Brigo et al assessed search behaviour associated with the term MS in English-speaking countries using Google Trends.19 Most searches were related to causes and symptoms, and most peaks in search volume corresponded to news of celebrities having MS.

Based on the type of Internet access, we defined five groups. There was a relationship between age, Internet access and disease duration, being the youngest and fewer years from diagnosis who used all types of access (mobile and PC) and the oldest and longer years from diagnosis those who did not use Internet or only use PC. The type of Internet access was related to cognitive status. Those with higher SDMT scores used all resources for searching, whereas those with lower scores did not search the Internet. A predictive model based on frequency of use of information resources showed that patients with higher disease progression (number of relapses, EDSS score) tend to use resources more frequently. Patients with a greater impact on their quality of life (either physical or psychological) tend to search for information more frequently, except for subjects with a higher degree of depression, who tend to search less frequently.

Participants consulted an MS professional, almost all of them with a neurologist and at least twice a year. When they did, 32.8% did not ask questions and prefer the medical team to inform them about the disease. Out of the neurologist consultancy, most patients had another way to contact their medical group (ie, e-mail and/or telephone line), perceived as a helpful resource. Only a quarter of the participants visited patients’ organizations regularly.

Although most people today use the Internet as a source of health information, people with MS considered the neurologist offers excellent quality information and were concerned about the reliability of the data obtained in other ways. When asked about the importance they provide to specific topics, the most relevant was quality of life, following current and future treatments for MS and how to deal with the disease. Similar findings were found by Chi et al21 where laypeople searched for information about MS on the web only if they considered the data had a low impact on their lives, otherwise they still trusted healthcare professionals to get information with a high impact.

This study has limitations inherent to its observational design. However, to reduce selection bias and to have a representative sample, the patient’s inclusion was consecutive and unselected in neurology units throughout Spain. Although the sample size was reached, not all patients provided complete information on all the study questions and variables. The treatment of missing values by pairwise comparison made it possible to take advantage of the maximum information available in each analysis. The INFOSEEK-MS study is the first approach on information preferences for MS patients in Spain, and further research is needed.

Conclusions

The INFOSEEK-MS study showed that healthcare providers are the first and most trustworthy source of information and the Internet is a widely used tool by the MS population in Spain. Multidisciplinary teams managing MS should be involved in ensuring quality and truthful content on the internet and networks. Individualized information given by healthcare professionals may help patient´s management of the disease.

Acknowledgments

The authors would like to thank all the people with MS who participated in the study as well as their families and medical team. The INFOSEEK-MS Study Group: Eduardo Agüera (Hospital Universitario Reina Sofía, Córdoba), Yolanda Aladro-Benito (Hospital Universitario de Getafe, Getafe), Amaya Álvarez de Arcaya (Hospital Universitario de Araba, Vitoria), Rafael Arroyo (Hospital Quirónsalud, Madrid), Antonio Belenguer (Hospital General Universitario de Castellón, Castellón), Laura Borrega (Hospital Universitario Fundación Alcorcón, Alcorcón), Antonio Candeliere-Merlicco (Hospital Rafael Méndez, Lorca), Pilar Casquero (Hospital General Mateu Orfila, Maó), Pedro Serrano-Castro (Hospital Regional Universitario de Málaga, Málaga), María del Carmen Fernández-Moreno (Hospital Universitario Nuestra Señora de Valme, Sevilla), Antonio García-Merino (Hospital Universitario Puerta del Hierro, Madrid), Nicolás Herrera-Varo (Hospital Universitario de Burgos, Burgos), Cristina Íñiguez (Hospital Clínico Universitario Lozano Blesa, Zaragoza), Lamberto Landete (Hospital Universitario Dr Peset, Valencia), María L Martínez-Ginés (Hospital Universitario Gregorio Marañón, Madrid), Virginia Meca-Lallana (Hospital Universitario La Princesa, Madrid), Amelia Mendoza-Rodríguez (Complejo Asistencial de Segovia, Segovia) and Cristina Ramo-Tello (Hospital Universitario Germans Trias i Pujol, Badalona). This study was funded by Roche Pharma Medical Department, Spain. The abstract of this article was presented at the European Conference of the International Society of Pharmacoeconomics and Outcomes Research (ISPOR) as a poster presentation with interim findings (PND138, November 2018, Barcelona, Spain).

Author Contributions

All authors made a significant contribution to the work reported, whether that is in the conception, study design, execution, acquisition of data, analysis and interpretation, or in all these areas; took part in drafting, revising or critically reviewing the article; gave final approval of the version to be published; have agreed on the journal to which the article has been submitted; and agree to be accountable for all aspects of the work.

Funding

This study was funded by Roche Pharma Medical Department, Spain.

Disclosure

ES, RC-M, and JM are employees of Roche Pharma, Spain. YH reports personal fees from Roche, medical writing support from Roche, during the conduct of the study; personal fees from Merck, Novartis, Teva, and Sanofi Genzyme, outside the submitted work. MÁRD reports on the Institutional Research Agreement from Pfizer and Medtronic, outside the submitted work. The authors report no other conflicts of interest in this work.

References

1. McGinley MP, Goldschmidt CH, Rae-Grant AD. Diagnosis and treatment of multiple sclerosis: a review. JAMA. 2021;325(8):765–779. doi:10.1001/jama.2020.26858

2. Horrigan J. How people approach facts and information; 2017. Available from: https://www.pewresearch.org/internet/2017/09/11/how-people-approach-facts-and-information/. Accessed June 30, 2021.

3. Köpke S, Solari A, Khan F, Heesen C, Giordano A. Information provision for people with multiple sclerosis. Cochrane Database Syst Rev. 2014;21(4):CD008757. doi:10.1002/14651858.CD008757.pub2

4. Nissen N, Lemche J, Reestorff CM, et al. The lived experience of uncertainty in everyday life with MS. Disabil Rehabil. 2021:1–7. doi:10.1080/09638288.2021.1955302

5. Strober LB. Personality in multiple sclerosis (MS): impact on health, psychological well-being, coping, and overall quality of life. Psychol Health Med. 2017;22(2):152–161. doi:10.1080/13548506.2016.1164321

6. Colombo C, Confalonieri P, Rovaris M, et al. The IN-DEEP project “INtegrating and Deriving Evidence, Experiences, Preferences”: a web information model on magnetic resonance imaging for people with multiple sclerosis. J Neurol. 2020;267(8):2421–2431. doi:10.1007/s00415-020-09864-7

7. Meca-Lallana V, Branas M, Higueras Y, et al. Patients´ information sources and needs in multiple sclerosis: the INFOSEEK-MS questionnaire. Value Health. 2017;20(9):PA726. doi:10.1016/j.jval.2017.08.1964

8. Kurtzke JF. Rating neurologic impairment in multiple sclerosis: an expanded disability status scale (EDSS). Neurology. 1983;33(11):1444–1452. doi:10.1212/wnl.33.11.1444

9. Lopez-Gongora M, Querol L, Escartin A. A one-year follow-up study of the Symbol Digit Modalities Test (SDMT) and the Paced Auditory Serial Addition Test (PASAT) in relapsing-remitting multiple sclerosis: an appraisal of comparative longitudinal sensitivity. BMC Neurol. 2015;15(1):40. doi:10.1186/s12883-015-0296-2

10. Meca-Lallana V, Branas-Pampillon M, Higueras Y, et al. Assessing fatigue in multiple sclerosis: psychometric properties of the five-item Modified Fatigue Impact Scale (MFIS-5). Mult Scler J Exp Transl Clin. 2019;5(4):2055217319887987. doi:10.1177/2055217319887987

11. Hobart J, Lamping D, Fitzpatrick R, Riazi A, Thompson A. The Multiple Sclerosis Impact Scale (MSIS-29): a new patient-based outcome measure. Brain. 2001;124(Pt 5):962–973. doi:10.1093/brain/124.5.962

12. Zigmond AS, Snaith RP. The hospital anxiety and depression scale. Acta Psychiatr Scand. 1983;67(6):361–370. doi:10.1111/j.1600-0447.1983.tb09716.x

13. Ballesteros J, Moral E, Brieva L, Ruiz-Beato E, Prefasi D, Maurino J. Psychometric properties of the SDM-Q-9 questionnaire for shared decision-making in multiple sclerosis: item response theory modelling and confirmatory factor analysis. Health Qual Life Outcomes. 2017;15(1):017–0656. doi:10.1186/s12955-017-0656-2

14. Everitt BS. Multivariate analysis: the need for data, and other problems. Br J Psychiatry. 1975;126(3):237–240. doi:10.1192/bjp.126.3.237

15. MacCallum RC, Widaman KF, Zhang S, Hong S. Sample size in factor analysis. Psychol Methods. 1999;4(1):84–99. doi:10.1037/1082-989x.4.1.84

16. Lavorgna L, De Stefano M, Sparaco M, et al. Fake news, influencers and health-related professional participation on the web: a pilot study on a social-network of people with multiple sclerosis. Mult Scler Relat Disord. 2018;25:175–178. doi:10.1016/j.msard.2018.07.046

17. Lavorgna L, Russo A, De Stefano M, et al. Health-related coping and social interaction in people with multiple sclerosis supported by a social network: Pilot Study with a New Methodological Approach. Interact J Med Res. 2017;6(2). doi:10.2196/ijmr.7402

18. Bishop M, Rumrill S, McDaniels B, et al. Information and resources important to the quality of life of people living with multiple sclerosis. Aust J Rehabil Couns. 2020;26(2):92–104. doi:10.1017/jrc.2020.17

19. Brigo F, Lochner P, Tezzon F, Nardone R. Web search behavior for multiple sclerosis: an infodemiological study. Mult Scler Relat Disord. 2014;3(4):440–443. doi:10.1016/j.msard.2014.02.005

20. Lavorgna L, Ippolito D, Esposito S, Tedeschi G, Bonavita S. A disease in the age of the web: how to help people with multiple sclerosis in social media interaction. Mult Scler Relat Disord. 2017;17:238–239. doi:10.1016/j.msard.2017.08.017

21. Chi Y, He D, Han S, Jiang J. What sources to rely on? Laypeople’s source selection in online health information seeking. CHIIR´18: Proceedings of the 2018 Conference on Human Information Interaction & Retrieval; 2018:233–236. doi:10.1145/3176349.3176881

Creative Commons License © 2022 The Author(s). This work is published and licensed by Dove Medical Press Limited. The full terms of this license are available at https://www.dovepress.com/terms.php and incorporate the Creative Commons Attribution - Non Commercial (unported, v3.0) License. By accessing the work you hereby accept the Terms. Non-commercial uses of the work are permitted without any further permission from Dove Medical Press Limited, provided the work is properly attributed. For permission for commercial use of this work, please see paragraphs 4.2 and 5 of our Terms.