Skip to main content

Feasibility study into self-administered training at home using an arm and hand device with motivational gaming environment in chronic stroke

Abstract

Background

Assistive and robotic training devices are increasingly used for rehabilitation of the hemiparetic arm after stroke, although applications for the wrist and hand are trailing behind. Furthermore, applying a training device in domestic settings may enable an increased training dose of functional arm and hand training. The objective of this study was to assess the feasibility and potential clinical changes associated with a technology-supported arm and hand training system at home for patients with chronic stroke.

Methods

A dynamic wrist and hand orthosis was combined with a remotely monitored user interface with motivational gaming environment for self-administered training at home. Twenty-four chronic stroke patients with impaired arm/hand function were recruited to use the training system at home for six weeks. Evaluation of feasibility involved training duration, usability and motivation. Clinical outcomes on arm/hand function, activity and participation were assessed before and after six weeks of training and at two-month follow-up.

Results

Mean System Usability Scale score was 69 % (SD 17 %), mean Intrinsic Motivation Inventory score was 5.2 (SD 0.9) points, and mean training duration per week was 105 (SD 66) minutes. Median Fugl-Meyer score improved from 37 (IQR 30) pre-training to 41 (IQR 32) post-training and was sustained at two-month follow-up (40 (IQR 32)). The Stroke Impact Scale improved from 56.3 (SD 13.2) pre-training to 60.0 (SD 13.9) post-training, with a trend at follow-up (59.8 (SD 15.2)). No significant improvements were found on the Action Research Arm Test and Motor Activity Log.

Conclusions

Remotely monitored post-stroke training at home applying gaming exercises while physically supporting the wrist and hand showed to be feasible: participants were able and motivated to use the training system independently at home. Usability shows potential, although several usability issues need further attention. Upper extremity function and quality of life improved after training, although dexterity did not. These findings indicate that home-based arm and hand training with physical support from a dynamic orthosis is a feasible tool to enable self-administered practice at home. Such an approach enables practice without dependence on therapist availability, allowing an increase in training dose with respect to treatment in supervised settings.

Trial registration

This study has been registered at the Netherlands Trial Registry (NTR): NTR3669.

Background

In the chronic phase after stroke, most people still have motor problems [1], leading to difficulties in performing activities of daily living (ADL). Good arm and hand motor function is essential to perform ADL independently. Therefore, restoration of arm and hand function is a major objective in stroke rehabilitation. Research into motor relearning and cortical reorganization after stroke has provided a neurophysiological basis for those aspects that are important to stimulate restoration of arm function [2, 3]: functional exercises, at high intensity and with active involvement of the patient within a motivating environment [4, 5].

New ways of providing healthcare services, such as teleconsultation and remote monitoring and treatment in the patient’s home, often referred to as telerehabilitation, is widely considered as having a bright future in the framework of an innovative rehabilitative approach [6]. The use of a rehabilitation service within the home allows the user to exercise independently, in an intensive, active and functional way, in a familiar environment while having continuous access to training tools. This gives the patient a sense of control and autonomy, which might also contribute to a better treatment outcome [7]. To enhance high training adherence, exercises should be provided in a motivating training environment, for instance via computerized gaming including feedback about performance [8]. Furthermore, a computerized telerehabilitation service enables remote monitoring of movements and remote offline (indirect) supervision by a therapist. This should reduce the need for one-to-one treatment time and home visits. This can help relieve the pressure on today’s healthcare system which is challenged by an ageing society and increasing long-term conditions such as stroke [9]. It may also enable prolonged rehabilitation for those who may not be able to access it due to resource and service restrictions within the healthcare system. However, telerehabilitation for stroke is still in its infancy. Two reviews confirmed that only limited numbers of telerehabilitation studies in the stroke domain are currently available [10, 11]. More research is required including utilization [10], effectiveness and satisfaction [11] of telerehabilitation services after stroke. Thirteen of the 16 studies within both reviews involved telerehabilitation programs with direct, online supervision, such as videoconsulting or telephone calls. However, this still relies on therapist availability. Interestingly, both reviews did not address the effective training duration as performed by participants during the interventions, which is an essential factor in rehabilitation since this is (in relation to intensity of training) a prerequisite for motor relearning. In addition, this is of particular interest for studies involving remote treatment and offline supervision.

Developments in technology-mediated rehabilitation have made it possible to use rehabilitation robotics to provide safe and intensive training to people with mild to severe motor impairments after neurologic injury [12, 13]. Such devices can provide high-intensity, repetitive, task-specific, interactive training of the impaired upper extremity, and have the potential to more accurately quantify therapy and monitor patients’ progress. Rehabilitation robotics has been shown to be effective for the hemiparetic arm [14–20]. However, many training studies using robotic devices focus on either the proximal or distal arm only [14, 17, 21]. To improve independent use of the upper extremity in daily life, it is important to include functional movements of both the proximal and distal arm and hand into post-stroke training [22, 23]. Two examples are The Activities of Daily Living Exercise Robot (ADLER) [24] and Gentle/G system [25] which have the ability to train both reaching and grasping movements. A next step would be to use such technology at home to support self-administered training, without requiring direct therapist involvement continuously. This requires a training device to be compact and easily transportable.

The current study aims to address the previously mentioned aspects: using a dynamic wrist and hand orthosis in a motivational gaming environment for home rehabilitation to enable and support a high dose of self-administered training, facilitating both proximal and distal arm and hand exercises. In addition, participants are challenged to exercise at their maximum capacity. One of the major issues for the success of telerehabilitation concerns the question whether patients not only accept the technology and profit from it, but also whether they can effectively use the system, and in what dose. This is especially relevant in this study, in which participants were exposed to independent training at home, without direct supervision, using a device which physically interacts with the arm and hand. Since the technology-supported telerehabilitation system for the arm and hand was developed specifically for this study, the evaluation fits best within the first two stages of telemedicine evaluation. The first stage focuses on the feasibility and usability of the technology used in an experimental design with a small number of subjects. In the second stage, potential working mechanisms will be explored in a small group of subjects [26]. Therefore, the objective of this study was to examine feasibility (user acceptance, effective use) and potential clinical changes (in arm and hand function) of a technology-supported arm and hand training system at home in chronic stroke.

Methods

Participants

Three clinical sites in Europe (rehabilitation center Het Roessingh, Enschede, the Netherlands; IRCCS San Raffaele Pisana, Rome, Italy; and the University of Sheffield, Sheffield, United Kingdom) were involved in participant recruitment. Participants were recruited from local rehabilitation centers and regional hospitals and through private physical therapy providers. Inclusion criteria were: (1) patients had to be between 6 months and 5 years after stroke; (2) between 18 and 80 years of age; (3) clinically diagnosed with partial central paresis of the arm or hand due to stroke, but with at least 15° active elbow flexion and active finger flexion of at least a quarter of the passive range of motion; (4) living at home with internet access; (5) having a carer who is co-resident or closely involved in their care; (6) able to understand and follow instructions; (7) no additional orthopedic, neurological, or rheumatologic disease of the upper extremity; (8) and absence of severe neglect or (uncorrected) visual impairments. All participants provided written informed consent before participation. The study protocol was approved by the local ethics committees in all three sites.

Study design

This feasibility study has a longitudinal design. Participants trained at home for six weeks using the newly developed training system. Arm and hand function was evaluated one week before training (T01), within one week after training (T08), and at two-month follow-up after the end of training (T15). User acceptance (motivation and usability) was evaluated within one week after training (T08). The training dose was automatically stored by the system during the six weeks of training.

Intervention

Participants trained at home using games while they were supervised remotely, indirectly, by a healthcare professional (HCP). This means that the participant and the HCP do not need to be online at the same time. The HCPs involved in this study were trained clinical researchers (human movement scientists), physical therapists or occupational therapists. All participants were told that they could train at the time of day they preferred. The general recommendation for training was about 30 minutes of exercise per day, six days per week. They were allowed to practice additionally if they wished to. Firstly, two professionals installed and initialized the training system at the participant’s home. This involved checking that the system was fully operational and providing instructions to the participant and a family carer regarding safe usage. Instructions for usage were shown within the patient user interface of the system, and participants were also provided with a hard copy user manual. This user manual also included a telephone number which participants could call in case of technical failures or other needs for assistance of the system. During the first week following installation, the HCP contacted each participant twice to ensure their competence with the training system.

The training system (Fig. 1) developed within the SCRIPT (Supervised Care and Rehabilitation Involving Personal Telerobotics) project [27] comprised: (A) a computer, (B) a touchscreen, (C) the Saebo Mobile Arm Support (SaeboMAS) (Saebo Inc., Charlotte NC, USA) and (D) the SCRIPT dynamic wrist and hand orthosis [28]. The SaeboMAS was used for gravity compensation of the proximal arm. The wrist and hand orthosis is a custom-designed exoskeleton which fits onto the forearm and hand. The mechanical design of the orthosis, in combination with the use of the SaeboMAS, allowed movements of the arm, wrist and hand within functional ranges during training. Trunk movements were not constrained. The orthosis interacted physically with the participant by providing extension forces to the wrist and fingers via passive leaf springs and elastic tension cords [28]. The amount of support could be adjusted to provide more or less of an offset force, to enable participants to train to their maximal capacity, with as little support as possible. For safety reasons, this amount of support was set by the HCP at the start of the training, based on a simple test to reach and grasp a soft ball several times. The amount of support was increased (decreased) when this test was perceived to be too difficult (easy), in addition to the participant’s opinion about comfort. The orthosis was equipped with sensors [28] to measure the range of motion of the wrist and fingers, and connected to the computer to allow game control and feedback on performance. The computer contained all the software components needed to complete a training session, including a user interface and games. The patient user interface, which was managed via a touchscreen, allowed the participant to select a game, play the game, and review his or her performance history (game scores and training duration). It also enabled the participant to contact the HCP by sending a message.

Fig. 1
figure 1

Technology-supported training system. Left = training system in use at participant’s home, right = more detailed overview of specific components, a Computer containing user interface and games, b Touchscreen showing one of the games, c SaeboMAS, d SCRIPT wrist and hand orthosis

Three games with various categories were available for practice. The key gestures in the games were hand opening and closing (grasping), wrist flexion and extension, forearm pronation and supination, and elbow and shoulder movements (reaching). The integrated sensors in the orthosis enabled game control by active execution of gestures (for example wrist flexion or extension corresponded with an avatar diving under or jumping over obstacles on the screen) beyond a threshold of 80 % of the participant’s active range of motion. In this way, participants were challenged to exercise at their maximum capacity. This threshold was assessed prior to game playing through a calibration procedure of a few minutes, involving the gestures relevant for the game to be played. The main goals of the games were to provide a fun and engaging experience for interaction while assigning a task to the participant, and providing feedback about performance. In addition, visual (e.g. representation of scores during and after exercising) and auditory (e.g. applause and sound effects for correct movements) feedback was provided within the games to keep the participants motivated and engaged in training. The games consisted of various categories, which were classified in a schedule ranked according to increasing complexity. Games were considered more complex when they required multiple planes of movement (from 1D to 3D), when the number of gestures involved to control the game were increased, or when more difficult movements were needed (progression from proximal to distal movements, and gross to fine manipulation). This game difficulty schedule was used by the HCP weekly to provide the correct game categories to each participant. The HCP adjusted the training program remotely, by accessing the HCP user interface. The HCP visited this user interface daily, to check on potential messages from participants, and to follow the participants’ progress and training duration remotely. At that time, participants did not need to be online. If the HCP noticed no or low use, he or she sent a motivational message to the participant. The participant received this message the next time when he or she started a new training session. The decision to provide more complex categories of games was supported and verified by weekly home visits of the HCP to the participant’s home. During these weekly home visits participants performed a training session with the HCP of about 15 minutes of effective training. Above all, these visits were scheduled to answer potential questions, informally monitor progress, adjust the amount of support from the orthosis when needed, and encourage participants to practice more when training duration so far was low.

Evaluation

User acceptance

The frequency and duration of practice (effective use and excluding calibration or system setup procedures) were recorded automatically by the system and displayed in the user interface. Motivation and usability of the system during training as experienced by the participants was measured using the Intrinsic Motivation Inventory (IMI) and the System Usability Scale (SUS), respectively. The IMI is a questionnaire with several dimensions that provides qualitative information about the content and level of motivation that a participant experiences during an intervention [29, 30]. It is scored on a seven-point Likert scale ranging from ‘not at all true’ to ‘very true’. A neutral score on the IMI is four, and a higher score means a more positive result on motivation.

The SUS is a 10-item scale giving a global view of subjective experience of usability. Questions are scored on a five-point Likert scale ranging from ‘strongly agree’ to ‘strongly disagree’. Scores are translated to 0–100 %, with a higher score meaning better usability [31]. Interventions that score in the 90s are exceptional, scores in the 70s and 80s are promising, and with SUS scores below 50 one can be almost certain that the product or intervention will have usability difficulties in the field [32, 33]. Both the IMI and SUS were completed during the post-intervention evaluation measurement (T08).

Arm and hand function

Clinical tests were used to quantify general arm function, before and after training and at two-month follow-up. The scales used are valid, standardized assessments, which were applied according to their specific protocols. The Action Research Arm Test (ARAT) evaluates coordination, dexterity and upper extremity function on four subtests (grasp, grip, pinch, and gross arm movement). The maximum score is 57 points [34–36]. The upper extremity part of the Brunnstrom Fugl-Meyer assessment (FM) evaluates motor status and the degree of synergy-development in the upper extremity, with a maximum score of 66 [37, 38]. Separate scores were also calculated for proximal (maximum = 42 points) and distal components of the FM (maximum = 24 points). The Motor Activity Log (MAL) is a semi-structured interview specifically designed for hemiparetic stroke patients. It assesses the perceived use of the paretic arm and hand (amount of use and quality of movement) during activities of daily living [39]. The maximum score for both subsections is five points. The Stroke Impact Scale (SIS) is a questionnaire which assesses eight domains related to function, activities, and participation. Each domain score has a range of zero to hundred percent [40, 41]. A higher score indicates better quality of life after stroke.

Statistical analyses

Statistical analyses were performed using IBM SPSS Statistics 19 for Windows. All outcomes were inspected for normal distribution using histogram plots including normal curves and normal probability plots, and Shapiro-Wilk tests, prior to selection of appropriate statistical tests. Descriptive statistics (mean with standard deviation (SD) for normal distributed outcomes, or median with interquartile range (IQR) for non-parametric outcomes) were used to describe the participant characteristics and all outcome measures. Clinical variables over time were analyzed using mixed models repeated measures analysis with adjustments for multiple comparisons (Sidak), or the non-parametric equivalent, Friedman’s ANOVA. In case of significance for non-parametric variables, additional Wilcoxon Signed Ranks Test for multiple comparisons were performed, using adjusted P-values in accordance with the Holm-Bonferroni correction. Additionally, the relationship between training duration and training-induced changes was assessed with Pearson’s (or non-parametric Spearman’s) correlation coefficient. The level for significance was set at α < 0.05 for all statistical tests. When using the Holm-Bonferroni correction, significance levels corresponded with α < 0.0167, 0.025 and 0.05 (sorted in order of smallest to largest P-value, respectively).

Results

Participants

Twenty-four participants were included in the study. Three participants were lost during the study because of shoulder pain due to external causes, technical problems with the system, and a desire to not continue. No post-training data is available from these participants, and they were not included in data analysis. The characteristics of the remaining 21 participants are displayed in Table 1. The group involved 9.5 % mildly, 57.2 % moderately and 33.3 % severely affected stroke patients, based on a categorization of baseline FM score [42]. Data on the SIS are incomplete for two participants, so analysis for this outcome was performed over 19 participants.

Table 1 Participant characteristics at baseline

User acceptance

Figure 2 shows the main effects concerning user experience. Twenty-one participants used the system for six weeks, but with a large amount of variation in effective use between and within individuals. Mean training duration for the group, averaged per week over six weeks, was 105 minutes (SD = 66 minutes), whereas training duration ranged from 13 to 284 minutes per week across participants. In general, the motivation during training was positive, as reflected in the mean score on the IMI of 5.2 points (SD = 0.9 points). The mean score on the SUS is 69 % (SD = 17 %). On individual level, ten participants rated usability over 70 %, seven between 50 and 70 % and four below 50 %.

Fig. 2
figure 2

Individual results (colored lines) with group averages (dotted line) on user acceptance for a Training duration per week, c System Usability Scale and c Intrinsic Motivation Inventory 

Arm and hand function

The FM and SIS improved significantly after training (P = 0.002 and 0.004, respectively). Subsequent multiple comparison analysis showed significant improvements between T01 and T08, with a median improvement of 4 points for FM, and mean improvement of 3.7 points for SIS (Table 2). For FM, this was sustained at two-month follow-up with a median improvement of 3 points from T01 to T15, and showed a trend for SIS (mean improvement of 3.5 points), indicating improved quality of life after stroke. Considering specific SIS domains, the participants improved significantly on the domains strength (P = 0.004) and mobility (P = 0.014), and showed a trend for ADL (P = 0.077) after training. The proximal component of the FM showed a significant improvement over the training period (P = 0.012), with a mean improvement of 2.8 points between T01 and T08. This was sustained at two-month follow-up (3.1 points improvement overall). A trend was found for the distal component of the FM (P = 0.078). The other clinical outcomes showed no statistically significant changes after the six weeks of training or at follow-up (Table 2).

Table 2 Clinical outcome scores pre-training (T01), post-training (T08) and at follow-up (T15)

Examination of the individual scores of each participant (Fig. 3) shows that some participants showed substantial improvements on clinical outcomes. Eight of the 21 participants reached minimal clinically important differences (MCID) for FM of 10 % improvement [43]. ARAT scores showed less marked improvements, with three participants reaching the MCID of 10 % improvement [43]. Seventeen of the 21 participants reported improvements in quality of movement of the affected arm in daily life on the MAL, of which 14 also reported improved amount of use. Of those, seven achieved MCID improvements of 0.5 points [44] for amount of use, and five for quality of movement on the MAL.

Fig. 3
figure 3

Individual (colored lines) and group (grey bars) results of the clinical scales for a Fugl-Meyer assessment, b Action Research Arm Test, c Motor Activity Log Amount of Use, d Motor Activity Log Quality of Movement and E Stroke Impact Scale. Abbreviations: FM = Fugl-Meyer, ARAT = Action Research Arm Test, SIS = Stroke Impact Scale, MAL = Motor Activity Log, T01 = baseline measurement pre-training, T08 = evaluation measurement post-training, T15 = two-month follow-up evaluation measurement. *Missing data Stroke Impact Scale: T01 N = 20, T08 N = 21, and T15 N = 19

When examining the relationship between clinical outcome changes and training duration, a correlation was observed for dexterity. A moderate-strong, significant correlation was found between ARAT changes and training duration (Spearman’s rho = 0.686, P = 0.001) (Fig. 4), which means that a higher training duration is associated with a larger improvement in arm and hand dexterity.

Fig. 4
figure 4

Scatter plot of average training duration and changes in Action Research Arm Test score over training

Discussion

The current study is one of the first studies in which technology-supported arm and hand training is performed in the patient’s home, where participants independently used a training device for both the proximal and distal arm and hand, which physically interacted with the participants, without direct supervision of an HCP. The objective was to examine feasibility (in terms of user acceptance and effective use) and potential clinical changes of the use of the training system. Results showed high marginal usability with potential for application in the field and motivation during training was good, which was reflected in a fair amount of effective use of 105 minutes per week. In addition, arm function improved over training and was sustained at two-month follow-up. Taking into account cost estimates as calculated within the SCRIPT project [27], home training with indirect supervision seems not only to have clinical value, but could also be economically viable in comparison with conventional rehabilitation and even home training as applied in many research studies nowadays. Within one year, this technology-supported training for six weeks per patient can be more cost-efficient when compared to dose-matched conventional therapy in the clinic with direct supervision by a therapist. Remotely monitored and physically supported arm and hand training at home showing feasibility and potential clinical value implies that an approach without direct, online therapist supervision should have the potential to allow practice without dependence on therapist availability. This might enable increased dose of training with respect to supervised treatment in clinical settings. The results obtained in our study correspond with those found in another home-based study, recently published by Sivan et al. [45]. They evaluated the feasibility of a robotic device for proximal arm training that can be used independently at home by stroke survivors with upper limb weakness. On group level, they found a mean training duration of 520 minutes during the 8-week study (which is about 65 minutes per week), and improvements on FM and ARAT of 1 point and 3 points, respectively. These improvements are comparable to the findings reported here, although these were slightly less pronounced on function level compared to the present study [45].

A review by Coupar et al. [46] involved four studies of in-home telerehabilitation for the upper limb after stroke. They found home-based upper limb programs to be no more or no less effective for arm motor impairment outcomes compared to upper limb programs conducted in hospitals [46]. In all included studies, the patients were (remotely) supervised at a fixed time, and without examining the effective amount of self-administered training at home. This is similar to other studies, in which a therapist in the clinic conducted treatment sessions with patients located at home [47], or in a different room in the clinic [48, 49]. In those studies the training sessions were scheduled beforehand, with about five hours (or more) practice per week. In our study, the HCP visited the participants only once per week (of which maximal 15 minutes of effective training), and patients were able to make their own decisions about their training schedule, without further direct real-time supervision of a therapist. The rationale for this was to remove the training constraints, and increase therapy availability. However, this makes it difficult to compare the effective amount of training in the above-mentioned studies with our study. The achieved training duration of approximately 105 minutes per week (about 15 minutes per day on average) suggests that stroke patients do have the incentive to train independently at home. When comparing specifically with recent studies into home-based self-administered upper limb therapy programs after stroke, the presently recorded effective use equals or even exceeds the adherence in those studies [45, 50, 51]. It is important to note that this 15 minutes of training stored in the portal involved only effective training time, which does not take into account for example donning and doffing of the orthosis and the calibration procedure. The total time participants spent on the self-administered training in this study would therefore be higher.

Usability of the system was rated sufficient, but the system might need improvements, which will be taken into account for further development of the system. When the technology has matured more, this should be tested in a large cohort study or cohort multiple randomized controlled trial as the next stage in telemedicine evaluation [26], to investigate clinical effects and explore if the results found here are comparable to conventional rehabilitation. Products or interventions with SUS scores below 70 % should be considered a candidate for increased scrutiny and continued improvement [33]. On individual level, half of the participants rated usability over 70 %, which means that the technology will have good to excellent chances for acceptance in the field, whereas only four participants scored SUS below 50 % (a product or intervention will probably have usability difficulties) [32, 33]. One of the examples of usability issues encountered by participants was unstable recording of the arm movements in space, as measured by an inertial sensor, which did not allow participants to fluently control and play one of the games involving reaching movement. Remarkably, two of the four participants with low scores on usability still performed a fair amount of training per week (>80 minutes). These two participants were not accustomed to new technologies and computers and found it frustrating to interact with the orthosis, computer and games. Despite their initial reservations, they decided to continue the therapy. Moreover, the positive results on IMI on group level indicate that participants perceived the training to be interesting and they enjoyed engagement with the system, which emphasizes the potential of this type of training for involving stroke patients actively in (prolonged) training.

Although a direct comparison between self-administered home training and a control group receiving comparable conventional treatment is lacking in the present study, the improvements in motor function of the arm in the present study correspond with those found in other robot-aided studies in chronic stroke in a clinical setting [14, 15, 17], and with therapy programs for the upper limb performed at home [10, 45, 46]. The improvements in our study involved particularly proximal arm movements. It is conceivable that reduction of arm weight did contribute to the gains presented by the proximal part of the FM, which is similar to results presented in previous studies [52, 53]. On individual level, eight participants (three mildly, four moderately, one severely impaired participant) achieved MCID of 10 % improvement for FM. Remarkably, seven of the 21 participants reached MCID of MAL, indicating that a third of the patients perceived a better use of the arm in daily activities, even though this was not reflected in an improved capacity as measured by ARAT. Of these seven patients, three were moderately and four mildly impaired. Hence, it seems that mild to moderate impaired patients benefit most from the intervention, which corresponds with previously reported robot-aided upper limb exercise training after stroke [54]. Furthermore, it is important to keep in mind that this study was conducted with chronic stroke patients. Ideally, home-based training should be considered at an earlier stage, for example as soon as inpatient rehabilitation is finished. This likely involves patients in the (sub)acute phase as well, where larger treatment effects would be expected. Although some participants did achieve clinically relevant gains in arm and hand function, others did not, underlining the need for further examination of which factors (for example age, time post stroke, stroke severity, training adherence, personal characteristics etc.) are associated with better treatment outcomes. This will assist in identifying who would benefit most from technology-supported, self-administered training at home, and ultimately, to find out for which patients this kind of home-based training is most suitable.

Many training studies using technology supported devices focus on either the proximal [14, 54] or distal [21, 55] arm only. Important aspects of the current study are that it aimed to involve functional movements of both the proximal and distal arm and hand within motivating rehabilitation games during training. The games available for practice mostly required movements of the arm, wrist and hand in sequence, like reaching, followed by wrist flexion or extension, and then hand opening and closing. This may have played a role in the limited effect on activity level, because proximal and distal movements may not have been integrated optimally. Although the games specifically incorporated hand gestures, these were rather coarse with generic flexion and extension of the thumb and fingers, and they did not contain specific functional grasps representing the handling of various objects. The expectation is that when such aspects are incorporated more specifically, exercises become even more functional and task-specific, which is likely to further enhance the clinical impact, predominantly on activity level [22, 56]. Therefore, integration of proximal and distal arm movements simultaneously, together with more functional and a larger variety of grasps, should be considered more specifically when designing games or exercises with a diversity of complexity for application in a training system dedicated to self-administered practice.

Although the arm function improvements in this study were comparable to those achieved through other robot-aided studies, they are still modest. An important factor might be the effective training duration. Although the average training duration was promising with approximately 105 minutes per week, especially in the light of effective use in other research into self-administered training [45, 50, 51], strong interindividual differences were observed. Qualitative information obtained during home visits revealed that some of the patients returned back to work or had a busy daytime schedule, limiting the time they had for the training. It is known that dose of robot-assisted training [18, 57] and conventional stroke rehabilitation [4, 58] is an important factor for clinical improvement, although an optimal or minimal dose is not yet known. The advised dose of 30 minutes per day, 6 days per week in this study (which totals to 18 hours in six weeks) corresponds closely with the 16 hours of additional training recommended by Kwakkel et al. to achieve clinically relevant functional improvements [59]. Observations on individual cases concerning a higher training duration and clinical improvements suggest that if an increase in training duration can be established, more pronounced clinical improvements might be achieved. Six participants who showed marked improvements in FM score over training had a rather high training duration (>100 minutes per week), which was also supported by the significant correlation between training duration and improvements in dexterity. In addition, the incorporation of a high variety of games probably enhances motivation during training, which might further stimulate a higher effective training duration. Additional motivational strategies might be implemented to increase participants’ effective training time during self-administered training even more. Future studies might consider approaches from the field of psychology to further explore this potential.

Conclusions

In this study we evaluated the feasibility and potential clinical changes of self-administered and remotely monitored arm and hand training at home, with physical support from a dynamic wrist and hand orthosis and games representing exercises, in chronic stroke. Usability was perceived as sufficient and motivation was good, although issues were identified that need further improvements. Together with an effective use of 105 minutes per week, these findings indicate that home-based arm and hand training with physical support from a dynamic orthosis is a feasible tool to enable self-administered practice at home. Arm function improved, together with modest improvements in quality of life, indicating home-based arm and hand training can have clinical value, especially for mild to moderately impaired patients. By stressing the functional nature of the exercises even more in future applications, results on activity level may become more pronounced. Future research using a larger sample of participants including a control group should further examine ways to stimulate effective use and explore which factors are associated with better treatment outcomes, to identify those who would benefit most from this remotely supervised technology-supported training at home.

Abbreviations

ADL:

Activities of daily living

T01:

Evaluation measurement one week before training

T08:

Evaluation measurement within one week after training

T15:

Evaluation measurement at two-month follow-up

HCP:

Healthcare professional

SCRIPT:

Supervised Care & Rehabilitation Involving Personal Telerobotics

SaeboMAS:

Saebo Mobile Arm Support

IMI:

Intrinsic motivation inventory

SUS:

System usability scale

ARAT:

Action research arm test

FM:

Brunnstrom Fugl-Meyer assessment

MAL:

Motor activity log

SIS:

Stroke impact scale

SD:

Standard deviation

IQR:

Interquartile range

MCID:

Minimal clinically important differences

References

  1. Kwakkel G, Kollen BJ, van der Grond J, Prevo AJ. Probability of regaining dexterity in the flaccid upper limb: impact of severity of paresis and time since onset in acute stroke. Stroke. 2003;34(9):2181–6. doi:10.1161/01.STR.0000087172.16305.CD.

    Article  PubMed  Google Scholar 

  2. Schaechter JD. Motor rehabilitation and brain plasticity after hemiparetic stroke. Prog Neurobiol. 2004;73(1):61–72. doi:10.1016/j.pneurobio.2004.04.001.

    Article  PubMed  Google Scholar 

  3. Krakauer JW. Arm function after stroke: from physiology to recovery. Semin Neurol. 2005;25(4):384–95. doi:10.1055/s-2005-923533.

  4. Kleim JA, Jones TA. Principles of experience-dependent neural plasticity: implications for rehabilitation after brain damage. J Speech Lang Hear Res. 2008;51(1):S225–39. doi:10.1044/1092-4388(2008/018).

    Article  PubMed  Google Scholar 

  5. Fisher BE, Sullivan KJ. Activity-dependent factors affecting poststroke functional outcomes. Top Stroke Rehabil. 2001;8(3):31–44.

    Article  CAS  PubMed  Google Scholar 

  6. Hermens HJ, Vollenbroek-Hutten MMR. Towards remote monitoring and remotely supervised training. J Electromyogr Kinesiol. 2008;18(6):908–19. doi:10.1016/j.jelekin.2008.10.004.

    Article  PubMed  Google Scholar 

  7. Lupton D, Seymour W. Technology, selfhood and physical disability. Soc Sci Med. 2000;50(12):1851–62.

    Article  CAS  PubMed  Google Scholar 

  8. Burdea GC. Virtual rehabilitation—benefits and challenges. Methods Inf Med. 2003;42(5):519–23. doi:10.1267/METH03050519.

    CAS  PubMed  Google Scholar 

  9. Vugts CJ, van der Velden LFJ, Hingstman L, (NIVEL), van der Velde F, van der Windt W, (Prismant).Behoefteraming fysiotherapeuten 2002-2015. Utrecht: Nivel (http://www.nivel.nl) 2003.

  10. Johansson T, Wild C. Telerehabilitation in stroke care—a systematic review. J Telemed Telecare. 2011;17(1):1–6. doi:10.1258/jtt.2010.100105.

    Article  PubMed  Google Scholar 

  11. Laver KE, Schoene D, Crotty M, George S, Lannin NA, Sherrington C. Telerehabilitation services for stroke. Cochrane Database Syst Rev. 2013;12:CD010255. doi:10.1002/14651858.CD010255.pub2.

    PubMed  Google Scholar 

  12. Fasoli SE, Krebs HI, Hogan N. Robotic technology and stroke rehabilitation: translating research into practice. Top Stroke Rehabil. 2004;11(4):11–9.

    Article  PubMed  Google Scholar 

  13. Maciejasz P, Eschweiler J, Gerlach-Hahn K, Jansen-Troy A, Leonhardt S. A survey on robotic devices for upper limb rehabilitation. J Neuroeng Rehabil. 2014;11:3. doi:10.1186/1743-0003-11-3.

    Article  PubMed Central  PubMed  Google Scholar 

  14. Prange GB, Jannink MJ, Groothuis-Oudshoorn CG, Hermens HJ, Ijzerman MJ. Systematic review of the effect of robot-aided therapy on recovery of the hemiparetic arm after stroke. J Rehabil Res Dev. 2006;43(2):171–84.

    Article  PubMed  Google Scholar 

  15. Kwakkel G, Kollen BJ, Krebs HI. Effects of robot-assisted therapy on upper limb recovery after stroke: a systematic review. Neurorehabil Neural Repair. 2008;22(2):111–21. doi:10.1177/1545968307305457.

    Article  PubMed Central  PubMed  Google Scholar 

  16. Mehrholz J, Hadrich A, Platz T, Kugler J, Pohl M. Electromechanical and robot-assisted arm training for improving generic activities of daily living, arm function, and arm muscle strength after stroke. Cochrane Database Syst Rev. 2012;6:CD006876. doi:10.1002/14651858.CD006876.pub3.

    PubMed  Google Scholar 

  17. Basteris A, Nijenhuis SM, Stienen AH, Buurke JH, Prange GB, Amirabdollahian F. Training modalities in robot-mediated upper limb rehabilitation in stroke: a framework for classification based on a systematic review. J Neuroeng Rehabil. 2014;11(1):111. doi:10.1186/1743-0003-11-111.

    Article  PubMed Central  PubMed  Google Scholar 

  18. Lo AC, Guarino PD, Richards LG, Haselkorn JK, Wittenberg GF, Federman DG, et al. Robot-assisted therapy for long-term upper-limb impairment after stroke. N Engl J Med. 2010;362(19):1772–83. doi:10.1056/NEJMoa0911341.

    Article  CAS  PubMed  Google Scholar 

  19. Wagner TH, Lo AC, Peduzzi P, Bravata DM, Huang GD, Krebs HI, et al. An economic analysis of robot-assisted therapy for long-term upper-limb impairment after stroke. Stroke. 2011;42(9):2630–2. doi:10.1161/STROKEAHA.110.606442.

    Article  PubMed Central  PubMed  Google Scholar 

  20. Klamroth-Marganska V, Blanco J, Campen K, Curt A, Dietz V, Ettlin T, et al. Three-dimensional, task-specific robot therapy of the arm after stroke: a multicentre, parallel-group randomised trial. Lancet Neurol. 2014;13(2):159–66. doi:10.1016/S1474-4422(13)70305-3.

    Article  PubMed  Google Scholar 

  21. Balasubramanian S, Klein J, Burdet E. Robot-assisted rehabilitation of hand function. Curr Opin Neurol. 2010;23(6):661–70. doi:10.1097/WCO.0b013e32833e99a4.

    Article  PubMed  Google Scholar 

  22. Timmermans AA, Seelen HA, Willmann RD, Kingma H. Technology-assisted training of arm-hand skills in stroke: concepts on reacquisition of motor control and therapist guidelines for rehabilitation technology design. J Neuroeng Rehabil. 2009;6:1. doi:10.1186/1743-0003-6-1.

    Article  PubMed Central  PubMed  Google Scholar 

  23. Oujamaa L, Relave I, Froger J, Mottet D, Pelissier JY. Rehabilitation of arm function after stroke. Literature review. Ann Phys Rehabil Med. 2009;52(3):269–93. doi:10.1016/j.rehab.2008.10.003.

    Article  CAS  PubMed  Google Scholar 

  24. Wisneski KJ, Johnson MJ. Quantifying kinematics of purposeful movements to real, imagined, or absent functional objects: implications for modelling trajectories for robot-assisted ADL tasks. J Neuroeng Rehabil. 2007;4:7. doi:10.1186/1743-0003-4-7.

    Article  PubMed Central  PubMed  Google Scholar 

  25. Loureiro RC, Harwin WS, Lamperd R, Collin C. Evaluation of reach and grasp robot-assisted therapy suggests similar functional recovery patterns on proximal and distal arm segments in sub-acute hemiplegia. IEEE Trans Neural Syst Rehabil Eng. 2014;22(3):593–602. doi:10.1109/TNSRE.2013.2265263.

    Article  PubMed  Google Scholar 

  26. Jansen-Kosterink SM. The added value of telemedicine services for physical rehabilitation, PhD thesis. Enschede: University of Twente; 2014. http://dx.doi.org/10.3990/1.9789082319606.

    Book  Google Scholar 

  27. Amirabdollahian F, Ates S, Basteris A, Cesario A, Buurke J, Hermens H, et al. Design, development and deployment of a hand/wrist exoskeleton for home-based rehabilitation after stroke - SCRIPT project. Robotica. 2014;32(Special Issue 08):1331–46. doi:10.1017/S0263574714002288.

    Article  Google Scholar 

  28. Ates S, Lobo-Prat J, Lammertse P, van der Kooij H, Stienen AH. SCRIPT Passive Orthosis: design and technical evaluation of the wrist and hand orthosis for rehabilitation training at home. IEEE Int Conf Rehabil Robot. 2013;2013:1–6. doi:10.1109/ICORR.2013.6650401.

    Google Scholar 

  29. Ryan RM. Control and information in the intrapersonal sphere: an extension of cognitive evaluation theory. J Pers Soc Psychol. 1982;43(3):450–61. doi:10.1037/0022-3514.43.3.450.

    Article  Google Scholar 

  30. McAuley E, Duncan T, Tammen VV. Psychometric properties of the Intrinsic Motivation Inventory in a competitive sport setting: a confirmatory factor analysis. Res Q Exerc Sport. 1989;60(1):48–58.

    Article  CAS  PubMed  Google Scholar 

  31. Brooke J. SUS: A Quick and Dirty Usability Scale. In: Jordan PW, Thomas B, Weerdmeester BA, McClelland IL, editors. Usability Evaluation in Industry. London: Taylor & Francis. 1996.

  32. Bangor A, Kortum P, Miller J. Determining what individual SUS scores mean: adding an adjective rating scale. J Usability Stud. 2009;4(3):114–23.

    Google Scholar 

  33. Bangor A, Kortum PT, Miller JT. An empirical evaluation of the system usability scale. Int J Hum Comput Interact. 2008;24(6):574–94. doi:10.1080/10447310802205776.

    Article  Google Scholar 

  34. Lyle RC. A performance test for assessment of upper limb function in physical rehabilitation treatment and research. Int J Rehabil Res. 1981;4(4):483–92.

    Article  CAS  PubMed  Google Scholar 

  35. Carroll D. A quantitative test of upper extremity function. J Chronic Dis. 1965;18:479–91.

    Article  CAS  PubMed  Google Scholar 

  36. Yozbatiran N, Der-Yeghiaian L, Cramer SC. A standardized approach to performing the action research arm test. Neurorehabil Neural Repair. 2008;22(1):78–90. doi:10.1177/1545968307305353.

    Article  PubMed  Google Scholar 

  37. Fugl-Meyer AR, Jaasko L, Leyman I, Olsson S, Steglind S. The post-stroke hemiplegic patient. 1. A method for evaluation of physical performance. Scand J Rehabil Med. 1975;7(1):13–31.

    CAS  PubMed  Google Scholar 

  38. Deakin A, Hill H, Pomeroy VM. Rough guide to the Fugl-Meyer Assessment: upper limb section. Physiotherapy. 2003;89(12):751–63. http://dx.doi.org/10.1016/S0031-9406(05)60502-0.

    Article  Google Scholar 

  39. van der Lee JH, Beckerman H, Knol DL, de Vet HC, Bouter LM. Clinimetric properties of the motor activity log for the assessment of arm use in hemiparetic patients. Stroke. 2004;35(6):1410–4. doi:10.1161/01.STR.0000126900.24964.7e.

    Article  PubMed  Google Scholar 

  40. van de Port IGL, Leendes K, Sellmeijer D, Zuidgeest A, Kwakkel G. Betrouwbaarheids en concurrente validiteit van de Nederlandse Stroke Impact Scale 2.0 bij patienten met een CVA. Ned Tijdschrift Fysiotherapie. 2008;118(1):12–8.

    Google Scholar 

  41. Duncan PW, Wallace D, Lai SM, Johnson D, Embretson S, Laster LJ. The stroke impact scale version 2.0. Evaluation of reliability, validity, and sensitivity to change. Stroke. 1999;30(10):2131–40.

    Article  CAS  PubMed  Google Scholar 

  42. Luft AR, McCombe-Waller S, Whitall J, Forrester LW, Macko R, Sorkin JD, et al. Repetitive bilateral arm training and motor cortex activation in chronic stroke: a randomized controlled trial. JAMA. 2004;292(15):1853–61. doi:10.1001/jama.292.15.1853.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  43. van der Lee JH, Beckerman H, Lankhorst GJ, Bouter LM. The responsiveness of the Action Research Arm test and the Fugl-Meyer Assessment scale in chronic stroke patients. J Rehabil Med. 2001;33(3):110–3.

    Article  PubMed  Google Scholar 

  44. van der Lee JH, Wagenaar RC, Lankhorst GJ, Vogelaar TW, Deville WL, Bouter LM. Forced use of the upper extremity in chronic stroke patients: results from a single-blind randomized clinical trial. Stroke. 1999;30(11):2369–75.

    Article  PubMed  Google Scholar 

  45. Sivan M, Gallagher J, Makower S, Keeling D, Bhakta B, O’Connor RJ, et al. Home-based Computer Assisted Arm Rehabilitation (hCAAR) robotic device for upper limb exercise after stroke: results of a feasibility study in home setting. J Neuroeng Rehabil. 2014;11(1):163. doi:10.1186/1743-0003-11-163.

    Article  PubMed Central  PubMed  Google Scholar 

  46. Coupar F, Pollock A, Legg LA, Sackley C, van Vliet P. Home-based therapy programmes for upper limb functional recovery following stroke. Cochrane Database Syst Rev. 2012;5:CD006755. doi:10.1002/14651858.CD006755.pub2.

    PubMed  Google Scholar 

  47. Holden MK, Dyar TA, Schwamm L, Bizzi E. Virtual-environment-based telerehabilitation in patients with stroke. Presence: Teleoperators and Virtual Environments. 2005;14(2):214–33.

    Article  Google Scholar 

  48. Taub E, Lum PS, Hardin P, Mark VW, Uswatte G. AutoCITE: automated delivery of CI therapy with reduced effort by therapists. Stroke. 2005;36(6):1301–4. doi:10.1161/01.STR.0000166043.27545.e8.

    Article  PubMed  Google Scholar 

  49. Lum PS, Taub E, Schwandt D, Postman M, Hardin P, Uswatte G. Automated Constraint-Induced Therapy Extension (AutoCITE) for movement deficits after stroke. J Rehabil Res Dev. 2004;41(3A):249–58.

    Article  PubMed  Google Scholar 

  50. Donoso Brown EV, McCoy SW, Fechko AS, Price R, Gilbertson T, Moritz CT. Preliminary investigation of an electromyography-controlled video game as a home program for persons in the chronic phase of stroke recovery. Arch Phys Med Rehabil. 2014;95(8):1461–9.

    Article  PubMed Central  PubMed  Google Scholar 

  51. Standen PJ, Threapleton K, Connell L, Richardson A, Brown DJ, Battersby S, et al. Patients’ use of a home-based virtual reality system to provide rehabilitation of the upper limb following stroke. Phys Ther. 2014;11:11.

    Google Scholar 

  52. Amirabdollahian F, Loureiro R, Gradwell E, Collin C, Harwin W, Johnson G. Multivariate analysis of the Fugl-Meyer outcome measures assessing the effectiveness of GENTLE/S robot-mediated stroke therapy. J Neuroeng Rehabil. 2007;4:4. doi:10.1186/1743-0003-4-4.

    Article  PubMed Central  PubMed  Google Scholar 

  53. Prange GB, Kottink AI, Buurke JH, Eckhardt MM, van Keulen-Rouweler BJ, Ribbers GM et al. The effect of arm support combined with rehabilitation games on upper-extremity function in subacute stroke: a randomized controlled trial. Neurorehabil Neural Repair. 2014. doi:10.1177/1545968314535985

  54. Stein J, Krebs HI, Frontera WR, Fasoli SE, Hughes R, Hogan N. Comparison of two techniques of robot-aided upper limb exercise training after stroke. Am J Phys Med Rehabil. 2004;83(9):720–8.

    Article  PubMed  Google Scholar 

  55. Lum PS, Godfrey SB, Brokaw EB, Holley RJ, Nichols D. Robotic approaches for rehabilitation of hand function after stroke. Am J Phys Med Rehabil. 2012;91(11 Suppl 3):S242–54. doi:10.1097/PHM.0b013e31826bcedb.

    Article  PubMed  Google Scholar 

  56. Van Peppen RP, Kwakkel G, Wood-Dauphinee S, Hendriks HJ, Van der Wees PJ, Dekker J. The impact of physical therapy on functional outcomes after stroke: what’s the evidence? Clin Rehabil. 2004;18(8):833–62.

    Article  PubMed  Google Scholar 

  57. Burgar CG, Lum PS, Scremin AM, Garber SL, Van der Loos HF, Kenney D, et al. Robot-assisted upper-limb therapy in acute rehabilitation setting following stroke: Department of Veterans Affairs multisite clinical trial. J Rehabil Res Dev. 2011;48(4):445–58.

    Article  PubMed  Google Scholar 

  58. Kwakkel G. Impact of intensity of practice after stroke: issues for consideration. Disabil Rehabil. 2006;28(13–14):823–30. doi:10.1080/09638280500534861.

    Article  PubMed  Google Scholar 

  59. Kwakkel G, van Peppen R, Wagenaar RC, Wood Dauphinee S, Richards C, Ashburn A, et al. Effects of augmented exercise therapy time after stroke: a meta-analysis. Stroke. 2004;35(11):2529–39. doi:10.1161/01.STR.0000143153.76460.7d.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

The SCRIPT (Supervised Care & Rehabilitation Involving Personal Telerobotics) project was partly funded by the European Commission Seventh Framework Program under grant agreement no. FP7-ICT-288698. We are grateful to the SCRIPT consortium for their ongoing commitment and dedication to the project: University of Hertfordshire Higher Education Corporation (United Kingdom), R.U. Robots Limited (United Kingdom), The University of Sheffield (United Kingdom), University of Twente (the Netherlands), Roessingh Research and Development BV (the Netherlands), MOOG BV (the Netherlands), IRCCS San Raffaele Pisana (Italy), User Interface Design GmbH (Germany). Finally, we would like to thank the large number of stroke patients, their families and the healthcare professionals that were involved in the study and provided us with useful feedback during this project.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sharon M. Nijenhuis.

Additional information

Competing interests

The authors declare that they have no competing interests with respect to the research, authorship, or publication of this article.

Authors’ contributions

SMN performed the set-up and execution of the study overall and recruitment of Dutch participants, performed data acquisition and data collection across partners, along with data analysis, and was the primary composer of the manuscript. GBP provided feedback and expert guidance throughout the study. She developed the study design and contributed substantially to overall study set-up and execution, participant recruitment in the Netherlands, data acquisition and analysis and writing of the manuscript. PS, FI, NN and GM were involved in participant recruitment in Italy (PS, FI) and the United Kingdom (NN, GM), execution of the research and data acquisition locally. FA, HJH, and AHAS were involved in development and deployment of the training system. FA wrote software and control algorithms for the system, HJH was involved in designing user interfaces and decision support systems, AHAS designed and manufactured the wrist and hand orthosis. JHB and JSR were involved in development of the study design, provided feedback and expert guidance throughout the study and contributed to the structure and contents of the manuscript. All authors have been involved in critically revising the intellectual content of the manuscript and have approved the final version for publication.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Nijenhuis, S.M., Prange, G.B., Amirabdollahian, F. et al. Feasibility study into self-administered training at home using an arm and hand device with motivational gaming environment in chronic stroke. J NeuroEngineering Rehabil 12, 89 (2015). https://doi.org/10.1186/s12984-015-0080-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12984-015-0080-y

Keywords