Abstract
Introduction: Wearable devices have been used to characterize physical activity in multiple sclerosis (MS). The objectives of this study were to advance the literature on the utility of free-living physical activity tracking from secondary analyses of a pilot study in MS patients. Method: The original observational study was conducted in participants with MS at PatientsLikeMe (www.PatientsLikeMe.com), an online network of patients with chronic diseases. Participants completed a baseline self-assessment, and received a Fitbit OneTM wearable device with instructions to upload data. Eligible participants (1) self-reported MS, (2) logged on to the PatientsLikeMe website 90 days prior to enrollment, and (3) consented to participate electronically. Participants (1) < 18 years, (2) living outside the United States, and (3) requiring wheelchair assistance for most daily activities were excluded. The secondary analyses were limited to participants with complete data on MS type, disease duration, and Multiple Sclerosis Rating Scale (MSRS) and at least 7 days of wearable data. Step count was used as a measure of physical activity. Results: The analysis cohort of 114 participants uploaded a mean of 20.1 days of wearable data over the 23-day study (87% adherence); participants averaged 4,393 steps per day. The mean age of participants was 52 years, predominantly female (75%), relapsing-remitting type (79%), with mean disease duration of 16 years. Mean MSRS score within 30-day of baseline was 32; 72% reported mild-moderate walking disability. The reliability of step count measured by intraclass correlation was 0.55 for a single day, ≥0.7 for 2-day average, and ≥0.9 for 7-day average. After controlling for covariates, self-reported disease severity (MSRS quartile) was an independent predictor of step count (p < 0.001). Least square means (LS means) for participants that were least disabled (lowest quartile) was 5,937 steps, which was significantly higher than participants in the second, third, and fourth quartiles (4,570, 3,490, and 3,272, respectively). Similarly, LS means of participants with no ambulatory disability (measured by MSRS walk component) was 6,931 steps, significantly higher than participants with greater disability (4,743, 4,394, 2,727 steps for symptomatic, mild, and moderate disability, respectively, p < 0.001). Discussion: Using an interactive platform, this study captured free-living mobility data in MS patients. Important metrics such as the use of a minimum of 2-day estimates and self-reported disability were found to be robust indicators and correlates, respectively, of participant activity levels. Further triangulation of such metrics may reduce the burden on patients, clinicians, and researchers when monitoring clinical status.
Introduction
Digital technology has been used regularly by patients and practitioners to facilitate disease and symptom management [1]. More recently, the landscape of digital health technology has expanded to mobile health, health information technology, telehealth, telemedicine, and medical and consumer-grade devices [2]. Such technologies enable providers to capture meaningful information about each patient, which facilitate data-driven individualized assessment and management. These technologies also enable patients and consumers to efficiently manage and track their health- and wellness-related activities.
Among available technologies, wearable activity monitors have been widely adopted for health and wellness monitoring [3]. Due to the ease of access to free-living mobility data in a real-world environment, wearable activity monitors may provide insight into the progression and impact of illnesses [4, 5]. Studies have shown that activity monitors can detect differences in mobility between ostensibly healthy elderly or adult populations relative to elderly with reduced mobility [6]. With the advancement in wearable technology, devices can passively and objectively measure high-resolution mobility data, as opposed to subjective questionnaires and observations which are subject to bias of self-reporting or shorter duration of formal testing [7, 8]. This has led to increasing research on consumer activity monitors. A targeted PubMed database search limited to publications on wearable devices manufactured by FitbitTM in 2017 identified over a hundred articles. The studies cover three broad core topics: (1) the validity, reliability, and usability of activity monitors to measure health states in healthy and disease populations, (2) the utility in generating clinical relevant data at the point of care, (3) integration into health promotion, disease prevention, and behavior change programs. With respect to validity and reliability, studies have demonstrated acceptable measurement properties of activity monitors [9], although limitations were noted in populations with low walking speed [10]. User acceptance of consumer activity trackers is high as a result of the technological improvements in functionality, appeal, and form factor [11, 12]. As for the impact at point of care, a recent study by Birkeland et al.[13] illustrated that wearable device-determined step count was able to determine treatment effect in patients with coronary microvascular dysfunction. The specific role of activity monitors at the point of clinical care has been reported in oncology, COPD, and other chronic medical conditions [8]. Further, a pooled analysis of randomized trials that includes activity monitor-based counselling reported significant improvements in several health markers (hemoglobin A1c, systolic blood pressure, and body mass index) in patients with type 2 diabetes [14].
Accordingly, there has been increasing attention on the use of consumer activity monitoring devices with multiple sclerosis (MS). MS is a disease characterized by damage to the myelin sheath that encapsulates neuronal projections in the central nervous system, causing transient or progressive debilitating symptoms and disability including ambulatory difficulties. Digital markers of MS have been extensively studied for symptom tracking, wearables such as accelerometers, gyroscopes, eye-trackers, grip sensors, and multisensors [15]. In other neurological diseases such as Parkinson disease, stroke, dementia, traumatic brain injury, and ataxia, studies have shown associations between activity tracking devices and other mobility assessments [16]. The importance of mobility in MS is irrefutable both as an assessment of overall health status and a component of disease management [17].
In MS, decreased ambulatory activity assessed via remote monitoring is associated with greater disability and lower quality of life [18]. Studies have shown ambulatory monitoring to be a reliable and valid outcome measure of activity levels in people with neurological diseases [19]. In MS patients, the number of daily steps has been shown to be a reliable and valid indicator of free-living walking behavior [20]. MS patients that are male, unemployed, have a high school education or less, and experience MS that is progressive, with higher levels of disability, or of longer duration take fewer steps per day [21]. Lower daily step counts are associated with greater impairment as measured by the Expanded Disability Status Scale (EDSS) and are moderately correlated with other measures of walking behavior such as oxygen cost of walking, the six-minute walk test, Multiple Sclerosis Walking Scale (MSWS), and Patient Determined Disease Steps (PDDS) scale [18, 22]. Clinically meaningful changes as measured by 1-point change in PDDS and 10-point change in MSWS can be detected in as little as a change of 800 steps per day [22].
Activity-monitoring devices that objectively record free-living walking behavior via motion sensors worn on the body may be a potential metric for quantifying ambulation and overall health status of MS patients [4], but the state of the field should be currently regarded as in a validation phase [18]. There is a continued need for more evidence of usage in real-world settings; larger samples, broader functional ranges, and appropriate metrics to gain greater confidence in the use of activity monitors in tracking and managing MS. For example, Norris et al.[23] found that to calculate a reliable mean daily step count in unaided walking, a minimum of any random 2-day combination is required. However, that study was conducted with a relatively small sample of MS patients that were not highly functioning.
To understand the real-world usage of commercially available activity-monitoring devices, this study is a secondary analysis of data obtained from PatientsLikeMe (www.PatientsLikeMe.com) study with members of an MS online community. Utilizing data from an earlier feasibility study of wearable activity tracking with MS, this study involved a secondary analysis to: (1) examine the reliability of physical activity data obtained from consumer-grade activity monitors in a free-living environment; (2) characterize participants based on activity patterns by age, gender, disease duration, and MS type; (3) explore the relationship between the Multiple Sclerosis Rating Scale (MSRS, a patient-reported disease severity measure) and the number of steps captured by a wearable activity monitor; and (4) compare age-related change in activity in the participant cohort relative to the general population and other disease cohorts.
Materials and Methods
Original Observational Study
Participants
In the present investigation, secondary analyses were derived from an earlier observational study in which participants were enrolled from the PatientsLikeMe member community. More information on the original study has been described elsewhere [24]. The following section will describe the original study briefly, and the subsequent sections will describe the secondary analysis that is the subject of this paper.
PatientsLikeMe is an online research platform, designed to allow platform members to share data about their conditions, treatments, symptoms, and comorbidities through structured data collection, but with some features of an online social network [25]. Members join the site with the understanding that they may be periodically invited to participate in research studies. The concordance of patient-reported data shared by MS patients on the website with medical claims data has been investigated and reported in an earlier publication [26].
The original observational study was conducted in June and July 2014. Participants reporting MS on their online profiles were recruited and consented, and provided with a consumer-grade activity monitor (Fitbit OneTM; www.fitbit.com) for capturing their physical activity over an observational period of 3-4 weeks. The study recruitment was noteworthy in terms of speed: the cohort of 203 patients was recruited online in just over a day from a pool of highly engaged participants. In addition to physical activity data, this cohort self-reported their medical history on the PatientsLikeMe platform.
Procedures
Informed Consent. Participants who fit the screening criteria were directed to an informed consent page, where a written statement of research information with the informed consent was presented. The statement of research information was also sent to participants when they received their wearable devices by postal mail. The research protocol received ethical approval by the New England Institutional Review Board (NEIRB) on June 6, 2014.
Activity Monitoring. Fitbit OneTM devices were mailed to participants with instructions on activation and authorization of data sharing between the manufacturer and PatientsLikeMe. This authentication granted research personnel permission to access their real-time device data. The device automatically transmits activity data to Fitbit servers when in proximity of the patient’s Bluetooth®-enabled computer or smartphone. Daily data were downloaded from Fitbit through their public web service using an application program interface. Participants were asked to wear the devices during their daily activities and charge the devices as needed. Daily step count data were collected for all participants. The Fitbit OneTM has been shown to be a valid and reliable indicator of step counts [15, 16].
Patient Communications. A guide for participation was sent to participants via email and included in print form with their device shipments. Instructions included a stepwise guide on how to authorize and upload data. The authorization process required patients to log on the website and activate a data sharing button which permitted the investigators to obtain Fitbit data via the manufacturers application program interface. The uploading process transferred their activity data to a dashboard using Bluetooth Low Energy (BLE) technology which sync with phones, tablets, and certain computers (some computers required a Fitbit dongle to be plugged in for uploads). Users were sent periodic email reminders throughout the study period. These emails included information on how to use the devices, instructions on how to authenticate the device, contact information for study personnel, as well as reminders to update MSRS on their PatientsLikeMe profiles. This study established a framework for deploying an activity tracker for longitudinal data collection, 80% of participants were able to authorize data sharing and upload data.
Measures
Data used for analyses were collected via electronic surveys at baseline, the PatientsLikeMe platform, and from Fitbit OneTM. The measures for our analyses are described below.
Patient Characteristics. Demographic information (age, gender) and MS-specific characteristics (MS type, disease duration) were obtained from their PatientsLikeMe profiles upon study enrollment.
Multiple Sclerosis Rating Scale. The MSRS is an instrument that measures functional disability in MS and includes seven items that assess walking, upper limb function, vision, speech, swallowing, thinking/memory/cognition, sensation/burning/pain (Appendix). The properties of the instrument have been validated and published elsewhere [27]. For analyses, we used data from participants that reported MSRS within 30 days of the baseline assessment.
Device Data. Fitbit OneTM Activity Monitoring device, manufactured by Fitbit, San Francisco, CA (http://www.fitbit.com/), was used to measure physical activity. The device clips on to an individual’s belt, pocket, or bra and contains a 3-axis accelerometer that determines threshold of steps based on motion patterns that are most indicative of people walking. The device has wireless automatic syncing features compatible with smartphone, tablet, or computer and has a battery life of approximately 14 days. The following information was collected from participants using the Fitbit OneTM device: (1) activation/authentication of the device, (2) number of steps taken per day, (3) distance, (4) calories burned per day (based on self-reported data), (5) “active” min – time of day, days of week (calculated for activities at or above about 3 metabolic equivalents after 10 min of continuous moderate-to-intense activity). (6) sleep (duration of sleep, number of awakenings throughout the night), (7) floors, and (6) timestamp and dates of readings. For our secondary data analyses, step count was used as the main proxy outcome for physical activity.
Secondary Data Analysis
Participant Selection for Secondary Analysis
Participant data for this study were drawn from the existing data set generated by the feasibility study mentioned above. The inclusion criteria in the observational study were: (1) participants self-reporting MS as a condition on their PatientsLikeMe profile, (2) ≥1 PatientsLikeMe website login within the past 90 days, and (3) consent to participate in the study for 3–4 weeks. Participants were excluded if they: (1) were < 18 years of age at baseline, (2) lived outside the United States, or (3) required wheelchair assistance for most of their daily activities.
Three hundred and eighty-five (n = 385) of invited PatientsLikeMe users with MS (n = 1,600) responded to the study invitation; 248 respondents met the study criteria based on their responses to the screener via a brief survey. Of the 248 eligible participants that received activity trackers, 203 (82%) activated the device with the Fitbit website and authorized PatientsLikeMe to access their activity data. Age and gender composition of those that authorized and uploaded data were comparable to those who did not. Those who did not authorize devices and upload data reported higher MSRS score (mean = 40) than those who authorized devices and uploaded data (mean = 31), suggesting that participants with more severe MS were more likely to drop out.
For the secondary analyses, we included data only from participants who: (1) self-reported MSRS within 30 days of their baseline assessment on the PatientsLikeMe website, (2) had complete data on MS type and duration, and (3) produced at least 7 days of wearable device data. The last criterion was based on high data reliability at this level of reporting (Fig. 1).
Reliability of wearable measured physical activity (step count): intraclass correlation coefficient (ICC) based on the average number of days (n = 203). ICC for an average score = between-subject variability/(between-subject variability + within-subject variability/m), where m is the number of measures (days).
Reliability of wearable measured physical activity (step count): intraclass correlation coefficient (ICC) based on the average number of days (n = 203). ICC for an average score = between-subject variability/(between-subject variability + within-subject variability/m), where m is the number of measures (days).
Data Processing and Transformation
Initial reviews were performed to examine data density, outliers, and unreasonable values. First, day-level physical activity data (step count) were obtained for all participants for the first 25 days in the study. Activity data from the first and last day were removed as these data points may be reflective of a partial day (e.g., participant connects a device the first time on the second half of the day) or may not completely get synchronized or uploaded for the last day. Second, patient-level means and standard deviation of step count were computed for all available days. Day-level data were considered outliers if the values were ±3 standard deviation of the patient-level mean. Third, reliability of mean step count data was measured by the intraclass correlation coefficient (ICC) based on repeated-measures analyses of step count data using a one-way random effects model. ICC for a single step count was estimated as the proportion of total variance in the observed measurements that is due to true differences between participants [ICC = between-subject variability/(between-subject variability + within-subject variability)]. The ICC for mean score for more than one measurement was estimated using the Spearman-Brown prophecy formula, which approximates the reliability of a mean measure [ICC = between-subject variability/(between-subject variability + within-subject variability)/(number of repeated measures)]. Participants with less than 7 days of data were excluded based on an ICC ≥0.90 (excellent reliability) that corresponds to a mean of 7-day measurements. Further, these participants were less compliant and are likely to be sporadic users. The remaining data were used to create a patient-level activity measure (mean, standard deviation, median of step count). Patient-level mean step count was used as a proxy for overall physical activity.
Data Analyses
Primary Analyses. Descriptive statistics (mean, standard deviation, frequency, percentage) were computed on baseline patient demographic and disease characteristics. Spearman correlation coefficients were computed to examine the association between patient characteristics with physical activity estimates (mean, median step count). Univariate analyses were conducted to test the association between measured physical activity (mean step count) and patient characteristics (age, gender, disease duration, MS type, MSRS). Separate univariate models were constructed with mean step count as the dependent variable and each correlate as the independent variable. Multivariable analyses were constructed with mean step count as the dependent variable and age, gender, disease duration, MS type and last-reported MSRS as the independent variables. Separate multivariable models were constructed with MSRS overall (quartile split) and MSRS walk component score. Univariate and multivariable models were run using the general linear model (PROC GLM) procedure in SAS 9.4 [28]. The type III sum squares were reported, and least square (LS) means were reported as the effect size. Finally, while not directly comparable, physical activity was compared between our MS study population and other general and chronic disease population-based estimates from publicly available data sources [29].
Sensitivity Analyses. These analyses were performed to determine the robustness of the statistical models by examining the extent to which results were affected by changing the model parameters. The changes in the model parameters that were examined were: (a) median step count as the outcome (dependent variables), (b) retaining outlier values. All analyses were two-tailed, and the level of significance was set at α = 0.05. Data analyses were conducted in SAS 9.4 [28].
Results of Secondary Analysis
Participants
After excluding participants with less than 7 days of data upload and participants with missing data on MSRS and disease duration, the final sample for secondary data analyses consisted of 114 participants (Fig. 2).
In the final cohort, participants uploaded a mean 20.1 days of data over the 23-day study (87% adherence); most uploaded data for 14 days or more (92%); 68% uploaded data for 21 days or more (Fig. 2). The sample mean of estimated mean daily step count was 4,393 (SD = 2,603), and the median was 4,274 (SD = 2,791).
The mean age of eligible participants was 52 years (SD = 9), the majority were female (75%), relapsing-remitting type (79%) with a mean disease duration of 16 years (SD = 10). MSRS score within 30-day of baseline was 32 (SD = 16) with 72% reporting mild-moderate walking disability (Table 1).
Reliability of Wearable Measured Physical Activity (Step Count)
Analyses illustrated in Figure 1 show that the reliability estimates of the average of step count as measured by ICC increased with more days of data. Reliability for a single day step count data was 0.55. The cutoff for acceptable reliability (≥0.7) was attained when 2 days were averaged, and excellent reliability (≥0.9) was attained when 7 days were averaged [30].
Correlates of Physical Activity
Mean step count correlated with total MSRS (ρ = –0.40, p < 0.001), as well as the walk component of MSRS (ρ = –0.39, p < 0.001), indicating lower step count for those with greater disability. Similar correlations were observed between median step count and MSRS (total score ρ = –0.41, p < 0.001; walk component ρ = –0.37, p < 0.001). Of note, the mean and median of patient step count demonstrated high correlation (ρ = 0.99, p < 0.001; Table 2).
Multivariable models testing the independent association of patient characteristics and MSRS with mean step count indicate the self-reported disability is an independent predictor of mean step count. After controlling for age, disease duration, gender, and MS type, estimated LS means of participants that were least disabled (lowest MSRS quartile) was 5,937 steps, which was significantly higher than the second, third, and fourth quartiles (4,570, 3,490, and 3,272 steps, respectively) (Table 3). Similarly, estimated LS means of participants with no ambulatory disability (measured by MSRS walk component) was 6,931 steps, which is significantly higher compared to participants with greater disability. Age, gender, disease duration and MS type were not independently associated with mean step count.
Correlates of free-living physical activity measured by mean step count for those that report MSRS within the past 30 days

Although not statistically significant, participants with relapsing-remitting MS were more active than those with secondary progressive and primary progressive MS. This may not always be the case, since some early stage secondary and primary progressive MS patients may be more active than relapsing-remitting MS patients. Further, given that relapses manifest with clinical worsening of symptoms, it is likely that relapsing-remitting patients will have greater within-subject variability in mobility.
Sensitivity Analyses
Sensitivity analyses were performed to determine the robustness of the statistical models by examining the extent to which results were affected by changing the model parameters. Sensitivity analyses revealed that the results were consistent after changing the model parameters to: (a) median step count as the outcome (dependent variables), and (b) retaining outlier values.
Physical Activity Relative to General and Other Chronic Disease Populations
While not directly comparable, reports from other publicly available studies indicate that our cohort of MS patients may be slightly less physically active compared to the general population but more active comparable to older patients with obstructive pulmonary disease (Table 4).
Comparison of physical activity between the MS study population, general population, and other chronic conditions

Participants in the 18–39 age group were less physically active than those in their fifth and sixth decades of life. Participants in the 60+ age group were also less physically active (Fig. 3). It should be noted that the studies cited differed with respect to the design, duration of observation, type of device used, and demographic composition compared to this study.
Comparison of age-related change in activity between the MS study population and the general population. Adjusted for gender, disease duration, last-reported Multiple Sclerosis Rating Scale score within past 30 days (quartile), and MS type.
Comparison of age-related change in activity between the MS study population and the general population. Adjusted for gender, disease duration, last-reported Multiple Sclerosis Rating Scale score within past 30 days (quartile), and MS type.
Discussion
The current study aimed to replicate and expand upon the published literature on the utility of free-living physical activity monitoring in MS. While physical activity measured by wearable devices has potential applications in characterizing, monitoring patients, and designing interventions, robust analytics on wearable device data is dependent on two critical factors: (1) successful adoption and compliance by patients and (2) reduction in the measurement error. For example, in a real-world setting, observations from some patients can reflect an erroneous characterization of true activity due to infrequent or sporadic use [31]. Further, physical activity is highly variable from day to day, and some studies have shown that activity patterns can vary by the day of the week and patient type [32].
This 3-week study revealed five major findings. First, averaging 2 days of step counts provides an adequate level of reliability (≥0.7), which approximates a very high level of reliability estimates when averaging data for an entire week (0.9). This was replicated by Norris et al. [23], who reported similar findings using an approach that examined reliability coefficients from random 2-day to 7-day averages. In addition, obtaining a stable measure of free-living walking activity based on pedometer use may require 7 days in healthy individuals [33], while more impaired populations such as incomplete spinal cord injury patients may require only 2 days of monitoring to achieve acceptably stable estimates [34]. This finding has practical implications with respect to utilizing wearable generated activity data in clinical research. For example, the overall real-world status of a patients’ mobility can be determined by obtaining data for about a week instead of continuous monitoring which minimizes the burden on the patient.
It is noteworthy that despite the ability to provide high-resolution quantitative data, these devices have specific limitations for widespread use in the clinical setting [35]. Among other factors, the need for a high rate of patient compliance with wearing the device all the time affects the use of data from pedometers and accelerometers. To be practical, for device use in the regular assessment of patients with MS, it is critical to reduce measurement error. Such a reduction in measurement error improves the ability to detect change and also improves the mathematical models to detect whether patients with true systematic differences can be distinguished from each other. Investigators have adopted several data management steps to reduce measurement error which include: (a) excluding data from users that do not use the device above a threshold value (e.g., ≥3 days/week, ≥8 h/day), (b) removing outlier data, and (c) averaging values for multiple days to improve reliability coefficients [32]. These guidelines are generally acceptable to improve data quality and better characterize patients’ ambulation.
Second, the characterization of participants based on activity patterns by age, gender, disease duration, and MS type did not uncover statistically significant independent associations with step count but directionally conformed to clinical presentations. For example, participants with relapsing-remitting MS were more active than participants with progressive MS. It should be noted, however, that relapsing events were not evaluated in the study. Given that relapses manifest with clinical worsening of symptoms, free-living activity monitoring has the potential of detecting the fluctuations in mobility during and between replacing events. Taken together, these findings suggest that physical active trackers can be applied to characterizing patient types based on their ambulatory function.
Third, we observed an independent association between subjective assessment of MS-disability, the MSRS, and objective data (steps count). Among several variables studied, self-reported disability was an independent predictor of mean step count. Low step count was associated with increased disability. This finding replicates previous findings of strong correlations between self-report and accelerometry measures for MS [36]. Studies have shown similar correlations between sensor data streams and functional rating scales for other neurological conditions, suggesting this could be an area for further exploration [16].
In addition, participants with no walking symptoms or disability averaged more than 2,000 steps per day compared to those that experience symptoms but did not have a disability, suggesting that the onset of symptom may be a driver of diminished physical activity. Similarly, studies that used MSWS and PDDS as anchor points to activity measures have found clinically meaningful change with a difference of 800 steps per day [36]. Future studies are warranted to evaluate the responsiveness of change in step counts in relation to change in their disease severity and disability.
Fourth, comparisons of age-related change in activity in the MS population relative to the general population and other disease cohorts indicate that our cohort of MS participants was slightly less physically active compared to the general population and comparable to patients on cardiac rehabilitation [37]. On comparing our study to a large population-based study in the general population [29], it is noteworthy that while the measured mean step count in our study was lower, the patterns in activity change with age were similar. Another cohort of MS was found to be more physically active, although the study included only 11 participants that were able to walk independently [4]. As expected, Motl et al. [38] found that MS patients were less physically active than adults without MS.
Finally, our engagement model offers an alternative to traditional clinical site-based studies and is worth consideration for future research. In contrast to time-intensive clinical studies, a large sample of patients was recruited in less than a day from several states in the US. Outreaching an online network of research-ready patients and providing access to an interactive platform enabled accelerated recruitment and efficient data collection on disease correlates and free-living mobility. Merits and demerits of this approach should be evaluated in future studies.
Studies in the last decade have laid the foundation for wearable technologies to support patients, clinicians, and the industry in MS. Patients can easily access inexpensive, attractive and user friendly consumer wearables to monitor their health and disease progression. Clinicians can use the technology to get a better understanding of the patients’ health in consultations. Further, such tools have the potential to support clinical decisions by identifying patients at risk of relapse and requiring interventions. A recent study in cystic fibrosis patients is piloting digital spirometers to identify patients at risk of exacerbations. For the industry, wearables offer a novel method of evaluating clinical benefit of treatment in the real-world setting. At the time of evolution of data science, advanced analytical tools, and artificial intelligence, the future of wearable technology in MS assessment and care is promising.
Limitations
The current study has several limitations. First, the original study was intended as a pilot study with limited data collected on the socioeconomic background, physical status, normal ambulation environment, behaviors, and demographic status of participants. Multivariable analyses were limited to data that were collected as part of the study and not all correlates on mobility in MS. Second, given the short period of data collection, continued assessment of these participants’ change over time was not performed. To our knowledge, at the time of this publication, no wearable study has successfully detected the progression of MS over time as a result of the challenges in longitudinal data collection. The engagement framework established in this study may facilitate large-scale recruitment and longitudinal data collection in patient-powered communities for future studies. Third, pedometer-based step counting does not characterize all movement disturbances (e.g., gait) in participants with MS [17]. Fourth, it is not possible to determine whether patient motivation/activation would be any different for populations who are less engaged in health information sharing. The comparisons with other studies are also potentially confounded by demographic differences, period of observation, behavioral reactivity, study design, and type of device used. Fifth, participants that opt into such patient platforms are predominantly female, more engaged, and technologically aware than most patients. The findings may not be generalizable to the MS population at large. The PatientsLikeMe MS population, however, is quite representative of the overall MS population [39]. Finally, a significant limitation is the absence of clinical and physician-generated data, e.g. Multiple Sclerosis Functional Composite (MSFC), provider-determined EDSS, MRI metrics, etc. The diagnosis is also patient reported. It should be noted, however, that another study conducted in a sample of MS patients in the PatientsLikeMe database found high concordance in diagnosis of MS when compared to an insurance claims database, supporting the validity of self-reported diagnosis as clinically diagnosed MS [26]. While this study did not intend to solicit physician-generated data, the absence must be acknowledged as an important limitation when interpreting the results.
Conclusion
In conclusion, this study advanced the current literature by engaging a range of MS patients that are members of an online research network, leveraging an interactive platform to collect Fitbit data remotely. Our engagement model offers an alternative to traditional clinical site-based studies. The use of an online network allowed rapid recruitment, integration of activity data with an existing data set containing demographics, disease symptoms, and treatments, and longitudinal patient involvement with research. The leveraging of such technology will be critical in efficiently capturing user activity metrics in real-world settings.
In addition, important metrics such as the use of a minimum of 2-day estimates and self-reported disability were found to be robust indicators and correlates, respectively, of participant activity levels. Because MS patients may be inconsistent in the use of devices as is seen in other populations, there will be a need to establish good estimates of activity in less than optimal conditions. Further exploration and triangulation of such metrics may reduce the burden on patients, clinicians, and researchers when monitoring clinical status.
Acknowledgement
We are grateful to the MS patient members of PatientsLikeMe for volunteering to participate in this study, Paul Wicks for recommendations regarding conceptual development and content in the paper, and Chris Curran for data analysis support.
Statement of Ethics
Independent ethics review was sought, and the study protocol received ethical approval from the New England Institutional Review Board (NEIRB) on June 6, 2014.
Disclosure Statement
At the time of manuscript preparation, P.D. was an employee of PatientsLikeMe and owns stock options in the company. E.C. and R.B. are employees of PatientsLikeMe and own stock options in the company. The PatientsLikeMe Research Team has received research funding (including conference support and consulting fees) from AbbVie, Accorda, Actelion, Amgen, AstraZeneca, Avanir, Biogen, Boehringer Ingelheim, Genzyme, Genentech, Janssen, Johnson & Johnson, Merck, Novartis, Pfizer, Sanofi, Takeda, and UCB. The PatientsLikeMe R&D team has received research grant funding from Kaiser Permanente, the Robert Wood Johnson Foundation, Sage Bionetworks, The AKU Society, and the University of Maryland. At the time of the manuscript submission, J.R. was an employee of Biogen and owns stock options in the company.
Funding Sources
This study was funded by Biogen.
Author Contributions
P.D. was involved in the conceptualization, contributed to the writing and revision, conducted data analysis, approved final content, and is accountable for all aspects of the work. E.C. was involved in the conceptualization, contributed to the writing and revision, reviewed the data analysis, approved final content of the paper, and is accountable for all aspects of the work. R.B. was involved in the conceptualization, contributed to the revision, reviewed the data analysis, approved final content of the paper, and is accountable for all aspects of the work. J.R. was involved in conceptualization, contributed to the revision, approved final content of the paper, and is accountable for all aspects of the work.