You are viewing a javascript disabled version of the site. Please enable Javascript for this site to function properly.
Go to headerGo to navigationGo to searchGo to contentsGo to footer
In content section. Select this link to jump to navigation

Robot-assisted therapy for upper limb paresis after stroke: Use of robotic algorithms in advanced practice

Abstract

BACKGROUND:

Rehabilitation of stroke-related upper limb paresis is a major public health issue.

OBJECTIVE:

Robotic systems have been developed to facilitate neurorehabilitation by providing key elements required to stimulate brain plasticity and motor recovery, namely repetitive, intensive, adaptative training with feedback. Although the positive effect of robot-assisted therapy on motor impairments has been well demonstrated, the effect on functional capacity is less certain.

METHOD:

This narrative review outlines the principles of robot-assisted therapy for the rehabilitation of post-stroke upper limb paresis.

RESULTS:

A paradigm is proposed to promote not only recovery of impairment but also function.

CONCLUSION:

Further studies that would integrate some principles of the paradigm described in this paper are needed.

1Introduction

Upper limb paresis is the most common physical consequence of stroke (Sathian et al., 2011) and more than half of patients do not recover full upper limb function (Kong & Lee, 2013; K.B. Lee et al., 2015). The majority of recovery occurs during the first weeks after stroke (Wade et al., 1985) and the prognosis is poor if moderate to severe paresis persists three months post-stroke. Upper limb paresis considerably reduces activity and participation (Geyh et al., 2004) as well as the quality of life (Ramos-Lima et al., 2018) of those affected. The number of people affected by stroke is increasing and the social and economic impact is high, making recovery of upper limb function a major public health issue.

Rehabilitation aims at reducing neurological impairments in order to improve stroke survivors’ participation in activities and quality of life. That can be achieved through the stimulation of neuronal reorganization to enhance recovery beyond the natural course of spontaneous recovery. The main factors that affect plasticity are age at the time of stroke (younger subjects progress more quickly after stroke) and the training methods used (Kleim & Jones, 2008b). These factors have been well described by Kleim and Jones (2008) –who emphasized that training must be specific, repetitive and intensive and that patients should use their residual capacity with the aim to both improve it and to integrate it in daily living activities (Kleim & Jones, 2008b).

The benefits of specialised rehabilitation after upper limb paresis are widely recognised (Langhorne et al., 2011), even though no specific approach/treatment has yet been found to be more effective than another (Veerbeek et al., 2014).

However, robot-assisted therapy appears to promote upper limb recovery by providing the elements necessary to stimulate neuroplasticity and reduce motor impairment (Kwakkel et al., 2008b; Wu et al., 2021).

The aim of this article was not to provide a further systematic review on upper limb robotic rehabilitation after stroke but rather to discuss the principles of robot-mediated therapy as a pragmatic, evidence-based approach based on 10 years of experience with this therapy in subacute stroke patients.

2The principles of robot-assisted therapy

2.1High dose of training through a hyper repetitive therapy

In medicine, patients are administered specific doses of treatments according to certain criteria. In rehabilitation, the concept of dose remains poorly defined. In the literature, this term usually refers to the quantity of practice, and is expressed as the quantity of intended training time or total therapy time (Birkenmeier et al., 2010a; Byl et al., 2008; Lohse et al., 2014). More rarely, it is expressed as the time spent performing active movements (Host et al., 2014; Kaur et al., 2012), or the number of repetitions performed (Dorsch & Elkins, 2020; Feys et al., 1998; Lang et al., 2016). The latter two definitions are more precise since active movements are rarely performed throughout the whole therapy session.

Although it is widely accepted that a large number of active movement repetitions are required to induce neuronal changes, the specific dose of active movement has not been defined. Studies in animal models of stroke have shown that 400 to 600 repetitions of a challenging functional task must be performed per day to induce neuroplastic changes (Birkenmeier et al., 2010a; Kleim et al., 1998). A study in humans with stroke showed that over 100 daily repetitions of a finger exercise induced significant cortical reorganisation as well as functional improvement (Carey et al., 2007). However, the implementation of such quantities of practice within conventional rehabilitation sessions is a major challenge. Studies have shown that during conventional rehabilitation sessions, patients perform between 23 (Lang et al., 2009) and 32 (Kimberley et al., 2010) movement repetitions. A more recent study found a higher number (mean 86 movement repetitions per session) but with a large inter-individual variation (Vratsistas-Curto et al., 2021). These doses are far below those required for the cortical changes that lead to motor recovery (Cramer et al., 2019; Gassert & Dietz, 2018). A study of the dose-response relationship between the number of repetitions and recovery of impairment in patients with chronic stroke found no relationship when 100, 200 and 300 repetitions (per hourly session over a period of 8 weeks) were compared (Lang et al., 2016). The modest change in motor function observed in this study, independent of treatment dose, is likely due to the fact that more than 300 movements per session are necessary to induce significant cortical and clinical changes. However, the daily practice of hundreds of movements within conventional rehabilitation sessions is hardly feasible (Birkenmeier et al., 2010b; Lang et al., 2016), which explains that the number of movements performed during robot-assisted therapy sessions is far higher than the number performed during conventional therapy (Duret & Gracies, 2014).

Unlike conventional therapy, robotic devices can provide hyper-repetitive therapy at a reasonable cost (Blank et al., 2014) and without excessive fatigue reported in the literature. Furthermore, they can objectively quantify the number of movement repetitions performed, thus allowing measurement of the dose provided. Patients can perform between 280 and 1300 movements per session of robot-assisted therapy (Duret et al., 2018, 2019; Duret, Courtial, et al., 2015; Duret, Hutin, et al., 2015; Duret & Hutin, 2013; Flynn et al., 2020; Hsieh et al., 2011, 2018; Pila et al., 2017a, 2017b; Rodgers et al., 2017), on average over 600 movements per session (Duret et al., 2019; Duret, Hutin, et al., 2015; Duret & Hutin, 2013; Rodgers et al., 2019).

A pilot study compared 2 intensity-based groups (high vs low respectively 750–1000 and 375–500 movements) that performed wrist and forearm movements with a robotic device, to a control group and found a relationship between the number of movements on one hand and motor abilities and functional performance on the other hand.(Hsieh et al., 2011). The results showed that high intensity practice with a robot improved outcomes more than lower intensity practice.

2.2Difficulty and intensity: Non-dissociable factors

It is now well documented and established that the number of movements performed during robot-assisted therapy sessions is far higher than the number performed during conventional therapy (Duret & Gracies, 2014). Moreover, the performance of a large number of passive movements does not lead to motor recovery (Lynch et al., 2005). Consequently, active participation and the challenging nature of the exercises are critical contributors to the effectiveness of highly intensive treatment (Dromerick et al., 2006).

A therapy is often considered intensive if it involves many repetitions. However, Page et al. (2012) defined intensity as the “amount of physical or mental work put forth by the client during a particular movement or series of movements, exercise, or activity during a defined period of time” (Page et al., 2012). The concept of intensity therefore includes several elements: repetition, effort and challenge. This explains why performing a large number of passive movements is not sufficient for motor recovery (Lynch et al., 2005). Thus, an exercise can only be considered intense if it involves effort (Connell et al., 2018), and to ensure effort, the exercise must also be challenging. However, adapting exercises to ensure they are challenging whilst also being achievable is complex in stroke rehabilitation. Furthermore, according to Kukla’s theory of performance, a person’s engagement in an exercise also depends on their perception of the difficulty (Kukla, 1972). The intensity of therapy is therefore not simply related to the number of repeated movements; it refers more precisely to the level of effort produced by the person executing the task (Connell et al., 2018).

In conventional therapy, therapists usually try to match the difficulty of an exercise to the patient’s ability (Krebs & Hogan, 2006). To make an exercise easier, they may reduce the effects of gravity (by using suspension, forearm support, etc.) or provide manual guidance. However, “providing too much assistance may have negative consequences for (motor) learning” (Marchal-Crespo & Reinkensmeyer, 2009). It is important that the level of assistance is just sufficient to enable the patient to achieve the task, thus encouraging engagement and avoiding discouragement (Blank et al., 2014; Shirzad & Van der Loos, 2016). If the task is too difficult for the patient to achieve, this can have a negative effect on both performance and motor learning (Gendolla, 1999; Maier, Ballester, et al., 2019) and frustrate the patient; on the other hand, if it is not sufficiently challenging, this can lead to boredom (Pan et al., 2019). Moderate challenge is beneficial to learning, while a difficulty that is too low or too high can have a negative effect (Hodges et al., 2014). However, in conventional therapy, it is difficult to precisely measure the level of assistance required and provided.

Some robotic systems contain integrated adaptive algorithms specifically to ensure that the appropriate level of movement assistance is provided (Krebs et al., 2003). These assist-as-needed algorithms detect movement intention and provide only the amount of assistance required to perform the task (Emken et al., 2005; Krebs & Hogan, 2006). The precise control of the level of support and assistance, which is adjusted according to the patient’s motor output, ensures that the patient remains active (Wickens et al., 2013). This is important since many studies have shown a strong relationship between providing exercises of appropriate difficulty and active participation by the patient (Grosmaire & Duret, 2017; Krishnan et al., 2013; Shirzad & Van der Loos, 2016). Furthermore, training at an appropriate level encourages engagement and motivation (Levin, 2020). Guadagnoli et al. suggested that learning is optimal when the challenge point has been reached (Guadagnoli & Lee, 2004). It has also been shown that the learning of simple tasks can be improved by increasing their difficulty (van Vliet & Wulf, 2006). Engagement and effort are automatically measured by some robots (Blank et al., 2014), which is useful for the therapist to determine when and how exercises need to be progressed.

Nonetheless, the use of assistance algorithms to optimise patient participation remains questioned, particularly for those with milder impairments. Some patients rely on the assistance and become passive, a phenomenon known as “slacking” (Washabaugh et al., 2018). However, one of our studies highlighted that assistance did not systematically lead to slacking, even when patients performed a large number of movements (Duret et al., 2018).

Assist-as-needed robot training (Emken et al., 2005; Krebs & Hogan, 2006) seems particularly useful for patients with moderate to severe paresis who have difficulty generating movement and for whom it is challenging to provide exercises at an appropriate level. In one of our studies on seventeen subacute inpatients (age 53±18; 49±26 days post-stroke) who had received 16 robot-assisted sessions, we have shown that the increase in the Motricity index between the first and the last session was negatively correlated with the baseline Motricity index (r = –0.5, p = 0.0053). Furthermore, the increase in the number of repeated movements was also negatively correlated with the number of movements performed at the second session (r = –0.47, p = 0.0083). In addition, we found a 10% decrease in the assistance provided by the robot (Duret, Hutin, et al., 2015). Studies conducted by our group on human-robot interactions have confirmed that robotic assistance promotes active participation and corresponds to the therapy needs of patients with moderate to severe motor impairment (Duret, Courtial, et al., 2015; Grosmaire & Duret, 2017).

2.3The effect of contextual interference

Active participation can be encouraged and slacking prevented by limiting the possibility to anticipate the next movement. Some robotic systems present targets randomly (although the randomisation is organised so that each target appears the same number of times). It may be beneficial in the initial stage of stroke to practice repeated movements in a defined, blocked order; however, in later stages random practice promotes learning to a greater extent (Cauraugh & Kim, 2003). Furthermore, random learning has a longer-term effect (Smith et al., 2006). Performing tasks in a defined order promotes retention of information, while practicing in a random order promotes transfer, a phenomenon that is commonly referred to as the “contextual interference effect” (Shea & Morgan, 1979). Indeed, in everyday life, situations that are repeated in a defined order are rare. The use of contextual interference to train a task has been shown to promote transfer in stroke patients (Jo et al., 2020). Random practice forces the patient to pay more attention to the task. This type of practice thus makes training more intensive as it generates greater cognitive activity and effort than exercises provided in a defined order (Merbah & Meulemans, 2011). Engagement is thus increased and slacking is reduced.

2.4Other robotic algorithms and challenge-based controllers: Resistive exercises, error augmentation and constrained exercises

Although robotic therapy uses assistive algorithms (Basteris et al., 2014) which allow it to be used with a wide range of disabilities (Colombo & Sanguineti, 2018), other work modes are available. Some robotic systems include challenge-based controllers that allow the difficulty of the exercises to be modulated, for example, by varying the forces applied to the paretic upper limb, decreasing the level of assistance, or increasing the resistance or the range of movement (Mehrholz et al., 2018). Exercises can thus be progressed along a continuum, allowing the patient to be optimally challenged throughout the course of their rehabilitation (Guadagnoli & Lee, 2004; Marchal-Crespo & Reinkensmeyer, 2009). Three broad categories of challenge-based controllers have been developed to provide either counter-resistance, movement constraints or error augmentation (Marchal-Crespo & Reinkensmeyer, 2009). Exercises involving isometric and dynamic resistance can also be practiced, depending on the patient’s needs. For example, isometric exercises can be used to retrain shoulder stability in patients with severe impairment (with proximal robot modules) while dynamic resistance exercises aim to challenge patients with more movement capacity. These exercises are based on the results of studies (Morris et al., 2004; Weiss et al., 2000) that showed that strengthening the paretic upper limb improves motor function (Marchal-Crespo & Reinkensmeyer, 2009). However, dynamic resistance exercises may not be appropriate for more severely impaired patients as they require a minimal level of residual motor function (Stein et al., 2004). While assisted exercises are interesting for severe to moderate patients to promote active movements, constrained exercises can be proposed in moderate to mild patients since they allow to work on the quality of the movement. In these exercises the patient’s movement is constrained by a velocity-dependent clockwise curl force field (Rezazadeh & Berniker, 2019). Error augmentation modes have been designed to challenge patients with higher levels of motor ability, based on the rationale that errors are an essential component of neuroplasticity and motor learning (Abdollahi et al., 2011; Kawato, 1990). This type of algorithm increases trajectory errors made by the patient to encourage them to increase their efforts to produce a straight movement. Error augmentation increases intrinsic feedback, which is usually disrupted after a stroke (Israely & Carmeli, 2015). Several studies have shown that error-increasing therapy increases motor control compared to standard or error-reducing therapy (Israely & Carmeli, 2015; Liu et al., 2018). The amplification of errors is also thought to promote patient attention and motivation (Abdollahi et al., 2011; Wei et al., 2005).

Although these training modalities have obvious theoretical value to reduce motor impairment, few studies have evaluated their use in clinical practice since assistive modes of robot-assisted therapy are more commonly used (Basteris et al., 2014).

2.5Impairment-reducing rather than function-improving therapy

The main purpose of robot-assisted therapy is to deliver a high number of movement repetitions in a session of a similar duration to standard rehabilitation (45 min on average). A commonly reported limitation of robot-assisted therapy is that the exercises are not functional. Indeed, studies have shown poor transfer of improvements at the impairment level to activities of daily living (ADL) (Kwakkel et al., 2008a; Mehrholz et al., 2015; Veerbeek et al., 2017). However, ADL performance is not always improved by more functional training methods, as shown in a study of an 8-week, task-specific intervention (Waddell et al., 2017). Impairment-based rehabilitation has been superseded by the emergence of task-oriented therapies that are currently considered the gold standard (Krakauer & Cortés, 2018). Task-oriented therapy improves the functional performance of the upper limb (Langhorne et al., 2011; Thant et al., 2019); however in usual care, this approach may not be appropriate or possible for patients with minimal motor command unlike robot therapy that can target the more severely impaired stroke patients.

Several recent studies suggested that robotics can be integrated in clinical practice by translating impairment gains drawn from robotic training into function through combined therapy (Conroy et al., 2019; Hung et al., 2016). For example, Conroy et al. trained 45 chronic stroke patients stratified by Fugl-Meyer (FMA) impairment (mean 21±1.36) to 60 minutes of robot therapy (RT; n = 22) or 45 minutes of RT combined with 15 minutes therapist-assisted transition-to-task training for 12 weeks and found that the replacement of part of the robotic training with nonrobotic tasks did not reduce treatment effect and may benefit stroke-affected hand use and motor task performance (Conroy et al., 2019). Their results highlight the boosting effect of the transition-to-task sessions.

The RATULS study, conducted in 770 stroke patients, comparing 3 treatment modalities (robot-assisted training, an enhanced upper limb therapy program and usual care) over a period of 12 weeks, found no difference in upper limb function at 3 months (Rodgers et al., 2019). This confirms that the practice of non-functional exercises itself does not hinder functional recovery (Conroy et al., 2019; Hsieh et al., 2014; Hung et al., 2016). However, in order to improve function, authors advocated further research to find ways to translate the improvements in upper limb impairment seen with robot-assisted training into improvements in upper limb function and ADL by combining robot-assisted training with more functionally oriented therapy strategies.

2.6Interaction and provision of feedback to enhance motor learning

Intrinsic feedback is inherent to the task, generated by the movement and its consequences on the environment. Extrinsic feedback involves the use of an external artifice to increase a subject’s sensitivity to sensory events that accompany performance (Magill, 1993). The intrinsic feedback systems may be compromised due to impairment of sensory pathways after a stroke. (van Vliet & Wulf, 2006). Extrinsic feedback is commonly used by therapists to give patients additional information about their performance or method of goal attainment. Extrinsic feedback is useful only if it provides additional information to the intrinsic feedback. Verbal feedback from therapists about the outcome is useless when the information is inherent to the task (van Vliet & Wulf, 2006). Feedback can be provided as knowledge of performance (KP), which gives information about the quality of the movement, and knowledge of results (KR), which gives information about the error between the response produced and the goal (magnitude of error, direction of error). Cirstea et al. (2006, 2007) compared the effects of KP and KR in two studies and showed that during repeated practice, KP resulted in greater improvements in motor function (Cirstea et al., 2006; Cirstea & Levin, 2007). Rosati et al. (2011) demonstrated that during robot-assisted movement, appropriate auditory feedback promotes engagement, performance and learning of the exercise (Rosati et al., 2011). Several authors have used sensory feedback in combination with visual feedback and all have reported beneficial effects on motor function (Broeren et al., 2006; Coote et al., 2008; Sim et al., 2015). Feedback is an important factor in motor learning because it increases active participation by helping to maintain patient motivation (Balasubramanian et al., 2012; Stefan, 2000). Robotic devices provide both visual and auditory continuously throughout the exercise and also performance feedback that includes the magnitude of directional or target errors provided at a defined frequency and summarised at the end of the exercise.

2.7Segmental training in 2D or 3D

A major issue related to robot-assisted therapy is the transfer of improvements at the impairment level to activities of daily living and use of the arm in the real world (Mehrholz et al., 2018; Rodgers et al., 2019; Veerbeek et al., 2017). Most rehabilitation robots do not train the arm as a whole, but focus on one or two joints. Proximal robots offer targeted rehabilitation of the shoulder and elbow, while distal robots train forearm, wrist or finger movements. However, exoskeletons were developed with the intention of providing more functional therapy by training a greater number of degrees of freedom together in a larger, 3D workspace. However, studies have shown that they do not appear to provide any additional benefit in terms of functional recovery compared to impairment-based single-joint robots (Krebs, 2001; Krebs et al., 2008, 2015; Mehrholz et al., 2020; Milot et al., 2013; Veerbeek et al., 2017; Wu et al., 2021). This could be due to the fact that 2D robots are easier to use (S.H. Lee et al., 2020) and the exercises are easier to understand (Lledó et al., 2016), or could be explained by Bernstein’s theory that humans begin by reducing the number of degrees of freedom when learning a new motor task (Bernstein, 1967). Krebs et al. (2015) highlighted the paradox robotic devices with a small number of degrees of freedom actually reduce impairment and increase motor control across a larger number degrees of freedom (Krebs et al., 2015).

3A paradigm for the integration of robot-assisted therapy into rehabilitation

Based on current evidence in the literature and our 10 years of experience, we propose a plan for the optimal use of robotic devices as part of an upper limb rehabilitation program in patients with moderate to severe post-stroke upper limb paresis.

3.1Robotic assistance: As needed but not too much or too long!

Assist-as-needed robot therapy allows patients with severe motor impairment to actively participate in rehabilitation (Duret et al., 2014). This contrasts with other therapies developed over the last 20 years, such as constraint-induced therapy, which is limited to a small group of patients (10% eligibility) (Kwakkel et al., 2015) with moderate to mild upper limb motor impairment (Brunner et al., 2011; Duret, Hutin, et al., 2015; Wolf et al., 2002). The patient’s movement intention matches their execution thanks to the assistance provided by the robot (Brunner et al., 2011; Duret, Hutin, et al., 2015; Wolf et al., 2002). This form of positive reinforcement stimulates motivation and plays an important role in the early stages of motor learning (Sidarta et al., 2016). Robot-assisted therapy allows a large number of movements to be performed, and encourages active participation, despite the assistance (Grosmaire & Duret, 2017). Furthermore, the effort generated by the patient (major intensity parameter) is a key element that drives brain plasticity.

As the difficulty of the training has an important influence on its effectiveness (Pan et al., 2019), it seems obvious to us that even if our practice of robotic rehabilitation starts with the use of programs with assistance as needed, our goal is to propose exercises of appropriate difficulty, thus avoiding patients’ being bored or frustrated and losing motivation.

3.2Visual feedback (graphic interface) of results (active participation and motor performance) to increase motivation

One of the major advantages of robotic systems is the amount of information provided (i.e. feedback) on the patient’s performance during the exercises as well as throughout the training process. Change-sensitive kinematic indicators (Duret et al., 2016) that are complementary to clinical measures are widely used in research, but to our knowledge, no recommendations have been developed on the use of kinematic parameters to guide rehabilitation. However, unlike feedback given by the therapist during usual care, feedback generated by robotic systems is objective and provides information that cannot be provided in conventional rehabilitation; for example they can indicate the level of active participation (number of times the robot has initiated the movement in the patient’s place, time of initiation of the assistance, stiffness and power delivered by the robot) as well as performance (deviation of the trajectory from the ideal trajectory, distance to the target, movement performance time, maximum speed, average speed, smoothness). These indicators encourage the patient to improve their performance and can also be used by the therapist to determine when and how to progress the therapy.

Our approach is progressive. Initially, the therapist focuses the patient’s attention on the level of active participation by indicating the number of times the robot initiated the movement for them, or the power the robot used to assist the movement. The therapist then sets specific objectives relating to active participation to challenge the patient and increase their motivation. Once the patient is reassured that they can generate movement, the therapist continues to encourage active practice while changing the focus of the objectives to the quality of the movement, using accuracy feedback (such as deviation of the trajectory from the ideal trajectory, distance to the target, etc.) provided by the robot. The aim is to implement principles of motor skill learning by proposing a pattern of trade-offs between speed and accuracy that means that the patient must first generate a movement to the target, then increase speed execution before focusing on accuracy (by decreasing speed as a physical law) (Grosmaire & Duret, 2017; Lefebvre et al., 2015).

3.3Varying the exercises

Providing a variety of exercises within a session is important to limit boredom and disengagement. Furthermore, skill retention is improved by varied practice (Brewer et al., 2007). The exercises should involve both explicit (i.e. conscious practice) and implicit learning (i.e. the performance of motor tasks is done less consciously, more automatically). Implicit learning can be achieved through the use of games in a virtual environment (Brewer et al., 2007), in which the patient can use the motor skills already acquired in less pre-programmed, freer movements. Exercises involving implicit learning, which is generally spared after stroke (Pohl et al., 2006) seem to be just as effective as exercises based on explicit motor learning (Kal et al., 2016) but should therefore be used to diversify exercise conditions and stimulate the learning process. They have the advantage of minimising the involvement of cognitive functions and being robust over time (Steenbergen et al., 2010).

3.4Begin with a standard target order then randomize

During the first sessions, it is useful to choose exercises where the movements are performed in a predefined order to help the patient understand the task. Once this has been achieved, it may be preferable to present exercises which involve movements in a random order, to reduce automatization, maintain the patient’s attention and limit slacking. Presenting the targets in a random order also optimises the effect of contextual interference, increases the cognitive load intrinsic to the task and is therefore a means of intensifying practice (Hodges et al., 2014). However, for some patients with significant cognitive impairment it will be necessary to maintain the presentation of targets in a predefined order.

3.5Adaptation of target distance: Shorter, challenging movements rather than longer, assisted movements

It is more beneficial for patients to practice movements of smaller amplitude, but with a greater active participation, than the larger amplitude movements that require assistance to complete. We therefore remove the assistance as soon as the patient can produce even small amplitude movements. The aim is to challenge the patient to generate effort but avoid failure. We therefore reduce the movement amplitude so that the patient practices unassisted exercises within an achievable range. As the patient progresses, we increase the range of motion. based on the principle of Fitts’ law which indicates that the difficulty of the task performed is the direct relationship between the time to perform the task and the properties of the targets, i.e. their size and the distance between them (Paul M. Fitts, 1954; Zimmerli et al., 2012). In other words, increasing the distance to the target and/or decreasing the size of the targets increases the difficulty of the task.

3.6Alternating assisted and free movement and progressing to free movement

A useful strategy to gradually progress the patient while avoiding exercises that may be too difficult or that require too much energy and would demotivate the patient, is to alternate assist-as-needed exercises with exercises that require a significant amount of effort within the same session. We usually begin with one or two assisted exercises as a warm-up, then switch to free exercises before returning to assisted exercises as the patient tires. This dual modality period can be continued until the patient has sufficient endurance and capacity to complete an entire training session without assistance.

3.7Different modalities

As well as providing movement assistance, some robotic systems can generate force fields to counteract the trajectory or increase errors. While assist-as-needed modes compensate for a lack of motor ability, the aim of these modes is to stimulate adaptive plasticity, a process that complements assisted learning. Such methods are very difficult to implement in conventional therapy. After the initial phase, which involves quantitative rehabilitation, i.e. the practice of a large quantity of movements, of increasing amplitude, the aim in the next phase is to improve movement quality. Error-enhancing programmes amplify the visual presentation of lateral deviations from the ideal trajectory, thus encouraging movement accuracy by stimulating brain adaptive processes. Once this has been achieved, the patient can be progressed to modes in which force fields attempt to deviate their trajectory from the straight line. The perturbations thus force the patient to continually readapt their trajectory to the constraints produced by the machine. These exercises involve implicit learning.

The main characteristic of paresis is muscle weakness. Therefore, once the patient can perform a quality movement, it is important to increase their strength. Although robots were generally not specifically designed for strengthening, they often can provide exercises with progressive, dynamic resistance. The aim at this stage is to promote the patient’s ability to perform movements against gravity, which are necessary for activities of daily living.

3.8How long should sessions be?

As with conventional rehabilitation, there is no consensus on the duration of robot-assisted rehabilitation sessions. Although it is generally considered that “more is better” (Langhorne et al., 1996; Lohse et al., 2014), the optimal daily duration of an upper limb rehabilitation session has not been determined. In the literature, session durations relate to experimental protocols and vary greatly from one study to another, ranging from 20 minutes to 180 minutes per day (Yozbatiran & Francisco, 2019). In reality, the duration of rehabilitation sessions depends very much on the organisation within the specific centre. While specific sessions may be organised for robot-assisted therapy in clinical trials, in routine care it is uncommon for a specific session to be dedicated to robot-assisted therapy. Conventional therapy (physiotherapy and/or occupational therapy) sessions are often shortened to fit in robot-assisted therapy.

A retrospective study by our team that compared outcomes (Fugl-Meyer score) in patients in routine care who received 45 minutes of robotic rehabilitation with patients from a research protocol who received 30 minutes of robotic rehabilitation found no difference: patients in both groups performed over 600 movements per day with the robotic device (Pila et al., 2022). This result seems to be consistent with the work of Burgar et al. (2011), who compared 15 hours of robot-assisted rehabilitation to 30 hours of robot-assisted rehabilitation and 15 hours of additional routine care, and found no significant difference in change in Fugl-Meyer score between the groups both at post-treatment and the 6-month follow-up (Burgar et al., 2011). These results suggest that rather than defining a set duration of robot-assisted therapy, it is more relevant to set a number of movements of appropriate difficulty to achieve.

3.9Duration of the program: When to stop?

It is now widely accepted that early rehabilitation leads to better recovery (Paolucci et al., 2000). However, there are no recommendations on how long robot-assisted therapy should be performed for. The durations of robot-assisted therapy used in studies is very heterogenous, ranging from 2 to 12 weeks (Mehrholz et al., 2018). A program of 36 hours of robot-assisted therapy provided over 12 weeks to patients with chronic stroke found only modest improvement in motor impairments (A.C. Lo et al., 2010), suggesting that at least 36 sessions were needed to achieve motor improvements. A study by Pila et al. (2017) found that over 3 months of robot-assisted therapy was necessary to improve motor outcomes in the most severe subacute stroke patients (Pila et al., 2017b). These results were confirmed by a recent study by Daly et al. who evaluated the needed of long dose of treatment (5 hours of daily rehabilitation including 1.5 hours of robotics, 5 days a week since 12 weeks, i.e. 300 h) for chronic stroke with moderate/severe impairment, have shown a benefit of continuing rehabilitation up to 300 hours with greater functional gains in the second part of the treatment than in the first 150 hours (Daly et al., 2019). These results refute the notion of a motor recovery plateau that would occur as early as 3 to 6 months depending on the initial level of severity of motor deficiencies (Duncan & Sue Min Lai, 1997). We suggest therefore, that robot-assisted therapy should be continued for as long as necessary (adjusting the training to keep it challenging for the patient), until clinical and kinematic (robot-measured) outcomes reach a plateau.

4Discussion: A review of 10 years of clinical trials

Despite the continuing debate around the effectiveness of upper limb robot-assisted therapy (Chien et al., 2020; Rodgers et al., 2019), this treatment appears as an appropriate treatment dose to be administered in terms of the quantity of movements performed and the intensity of the exercises. Although many randomised studies and systematic reviews have been conducted on robot-assisted therapy (Bertani et al., 2017; Chien et al., 2020; K. Lo et al., 2017; Mehrholz et al., 2020; Zhang et al., 2017), an issue often raised is the heterogeneity of practices and poorly described interventions (Burgar et al., 2011).

Robot-assisted therapy as defined above corresponds fully to the current concepts of neuro-rehabilitation, based on the principles of motor learning (Maier, Rubio Ballester, et al., 2019) and has been shown to effectively improve motor recovery (Kleim & Jones, 2008a). It also improves patient motivation and participation (Morone et al., 2020). Despite the fact that robot-assisted therapy appears to be an appropriate treatment for motor recovery after stroke, after more than 20 years of use, the results are still questioned, and skepticism regarding the benefits and utility of robot-assisted therapy remains widespread among clinicians. Moreover, current guidelines for robotic rehabilitation after stroke did not provide clear clinical practice recommendations (Calabrò et al., 2021; Morone et al., 2021).

4.1What does the literature say?

Therapists’ fears that robot-assisted therapy might increase spasticity or shoulder pain seem to have been allayed. Indeed, this therapy is considered safe in subacute and chronic stroke patients, i.e. not deleterious to muscle tone and shoulder pain (Mehrholz et al., 2020). However, its effects on the reduction of spasticity remain controversial (Bertani et al., 2017; Veerbeek et al., 2017).

Overall, studies have shown that robot-assisted therapy in addition to usual care reduces upper limb motor impairment significantly more than conventional therapies, however, this improvement is minimal on functional capacity (Veerbeek et al., 2017; Wu et al., 2021). The results appear to differ according to the phase of stroke. A Cochrane review in 2015 found improvements of activities of daily living in patients with acute and subacute stroke but not in the chronic phase (Mehrholz et al., 2015) while three recent systematic reviews found that robot-assisted therapy was more effective than standard care in the chronic phase (Bertani et al., 2017; Wu et al., 2021; Zhang et al., 2017).

The application of additional care, i.e. conventional therapy plus supplementary therapy such as robotic therapy, is not always easy to achieve due to budget constraints, and we believe the clinical reality of robotic therapy is rather a partial substitution of conventional therapy time.

The partial substitution of usual care by robotic therapy in the acute (40 minutes out of 120 minutes conventional therapy per day were substituted by robot therapy) (Masiero et al., 2014) and sub-acute (conventional therapy was substituted by robot therapy for 25% of the total weekly rehabilitation time) (Dehem et al., 2019) phases also seems interesting as these combined programmes show comparable results.

The functional benefits of robot-assisted therapy are still controversial. The 2018 Cochrane review appeared to have closed the debate since it reported a high level of evidence that this therapy improved the ability to perform ADLs: however, the results of the RATULS study published just after the Cochrane review re-opened the debate (Mehrholz et al., 2018). This large multicentre study of 770 stroke patients with severe upper limb paresis in the subacute and chronic phase found no difference in upper limb functional abilities (assessed by the Action Research Action Test (Lyle, 1981)) at 3 months between a programme using robot-assisted therapy compared to a programme of intensive manual therapy of the upper limb and standard care (Rodgers et al., 2019). The improvements observed in upper limb motor function (impairment, assessed by the Fugl-Meyer assessment scale (Fugl-Meyer et al., 1975)) in patients who received robot-assisted therapy were not transferred to activities of daily living. However, the main objective of robot-assisted therapy is not the improvement of functional capacities but the use of motor learning principles to reduce impairment at the joints trained. Furthermore, the robotic device used in the RAUTLS study did not include distal rehabilitation or grip training (Hung et al., 2016). The authors therefore concluded that robotic therapy must be coupled with functional exercises in order to ensure a functional benefit (Rodgers et al., 2019).

Few studies have attempted to determine the patient groups who most benefit from robot-assisted therapy. However, it seems that it may be particularly effective in patients with more severe impairment. This was suggested in earlier studies (Conroy et al., 2011; Finley et al., 2005; MacClellan et al., 2005) and more recently in a retrospective study by our team (Duret, Hutin, et al., 2015). A recent meta-analysis also showed that the functional benefits of the therapy were more significant in patients with moderate to severe motor deficits (Wu et al., 2021).

Finally, a large variety of robotic devices has become available, further complicating the issue of effectiveness. Furthermore, not only are designs different (e.g. exoskeletons versus end-effectors, distal versus proximal robots), but also the methods of control vary, thus confounding the effects. A comparison of an end-effector robot and an exoskeleton in patients with chronic, moderate-to-severe stroke found that outcomes relating to activity and participation improved more in the group who trained with the end-effector (S.H. Lee et al., 2020). A systematic review also showed that only end-effectors reduced impairment more than conventional therapy (Wu et al., 2021).

4.2Combination is the key

As suggested by Bernhardt et al. (2019), it is time to accelerate the development of effective rehabilitation practices by designing evidence-based protocols, identifying target populations, providing precise descriptions of the content of interventions so that protocols can be reproduced using appropriate standardised clinical scales and objective movement analyses (Bernhardt & Mehrholz, 2019).

Rehabilitation robots should be part of the battery of tools available to clinicians to intensify the treatment of patients with the most severe motor deficiencies, as a synergistic complement to therapies based on the functional integration of the paretic upper limb in manual activities. This is the sense of the studies that showed positive results of combined treatments (Conroy et al., 2019; Hung et al., 2016). Brokaw et al. in a pilot cross-over design study compared the effects of equal doses of robotic and conventional therapy in chronic stroke patients with moderate to severe impairments (Brokaw et al., 2014). Patients were randomized to 12 hours of robotic or conventional therapy and then crossed over to the other therapy type after a 1-month washout period. They found that robot therapy improved motor coordination and range of movement, and that the results were enhanced when followed by conventional therapy to apply the improvements in a free environment. These findings suggest that robotic therapy may be a starter to prime motor recovery before functional integration. Conroy et al. confirmed this outcome more recently in 45 chronic stroke patients (Conroy et al., 2019).

4.3How to implement robot-assisted therapy for upper limb rehabilitation

Although there is no consensus on the content of an optimal programme using a robotic device (Burgar et al., 2011; Gassert & Dietz, 2018), it seems logical to imagine a challenging programme depending on the patient’s motor deficits. This programme of increasing difficulty implemented during a 30 minutes session could be as follows:

  • Practice of 500 large-amplitude movements with assistance-as-needed with a standardised (predictable) order of target presentation

  • Isometric resistance exercises to improve shoulder stability

  • Varied exercises (targeting both explicit and implicit learning)

  • Combination of assisted and unassisted short-amplitude exercises

  • Exercises with assistance-as-needed with targets presented randomly

  • Unassisted exercise with random targets and a progressive increase in amplitude

  • Exercises increasing errors to constrain at better movement quality

  • Force fields exercises to promote motor control

  • Dynamic resistance exercises

4.4Future of robotic rehabilitation?

The supporters of robotic therapy are trying to optimize the use of these devices to get the best out of them with a combination of robot-mediated training focused on disabilities in adjunct to more functional conventional therapies in order to transfer the benefits of one to the others which is our point of view.

Another way is to create different tools integrating the two treatment modalities, impairment reduction and ability enhancement, which seems to be the direction taken by the engineers.

The variety of devices on the market suggests future developments in robotics for improving functional capabilities in activities of daily living. Some research teams have added haptic feedback to robots in order to integrate more sensory input to approximate the sensations perceived during functional interactions in the real world (Aiple & Schiele, 2013; Elangovan et al., 2019; Mazzoleni et al., 2018). Others have integrated connected objects (Díez et al., 2016; Mizanoor Rahman, 2019). Some are developing versions that can be used at home so that rehabilitation can be continued in telecare or in autonomy at home (Alamdari & Krovi, 2015; Housley et al., 2018; Sivan et al., 2014). Other teams are seeking to add artificial intelligence to the robots in order to constantly evaluate the patient’s participation and propose a rehabilitation programme accordingly (Fazekas & Tavaszi, 2019). Finally, immersive virtual reality is another solution under development. All these concepts need clinical studies to see their impact on the recovery of patients after stroke, but it seems that robotics still has a bright future ahead.

5Conclusion

Rehabilitation using robotic devices is still a promising field of exploration in 2021; indeed, despite the sometimes disappointing results of well-conducted clinical studies, its optimal implementation is still ahead of us because the evidence-based use of all the potentialities of these toolboxes has not yet been really realised. Further studies that would integrate some principles of the paradigm described in this paper are needed.

Conflict of interest

The authors have no conflict of interest to declare.

Funding

This research did not receive any specific funding from public, commercial or non-profit funding bodies.

References

1 

Abdollahi, F. , Rozario, S. V. , Kenyon, R. V. , Patton, J. L. , Case, E. , Kovic, M. , & Listenberger, M. (2011). Arm control recovery enhanced by error augmentation. IEEE International Conference on Rehabilitation Robotics, 1-6. https://doi.org/10.1109/ICORR.2011.5975504

2 

Aiple, M. , & Schiele, A. (2013). Pushing the limits of the CyberGrasp for haptic rendering. 2013 IEEE International Conference on Robotics and Automation (ICRA), 3541-3546. https://doi.org/10.1109/ICRA.2013.6631073

3 

Alamdari, A. , & Krovi, V. (2015). Modeling and Control of aNovel Home-Based Cable-Driven Parallel Platform Robot: PACER. https://doi.org/10.13140/RG.2.1.2081.8404

4 

Balasubramanian, S. , Colombo, R. , Sterpi, I. , Sanguineti, V. , & Burdet, E. ((2012) ). Robotic assessment of upper limb motor function after stroke. American Journal of Physical Medicine and Rehabilitation, 91: (11 SUPPL.3), 255–269. https://doi.org/10.1097/PHM.0b013e31826bcdc1

5 

Basteris, A. , Nijenhuis, S. M. , Stienen, A. H. , Buurke, J. H. , Prange-Lasonder, G. B. , & Amirabdollahian, F. ((2014) ). Training modalities in robot-mediated upper limb rehabilitation in stroke: A framework for classification based on a systematic review. Journal of Neuroengineering and Rehabilitation, 11: (1), 111. https://doi.org/10.1186/1743-0003-11-111

6 

Bernhardt, J. , & Mehrholz, J. ((2019) ). Comment Robotic-assisted training after stroke: RATULS advances science. The Lancet, 6736: (19), 4–5. https://doi.org/10.1016/S0140-6736(19)31156-0

7 

Bernstein, N. A. (1967). The co-ordination and regulation of movements. (1st Englis). https://trove.nla.gov.au/work/21697091?q&versionId=209674501

8 

Bertani, R. , Melegari, C. , De Cola, M. C. , Bramanti, A. , Bramanti, P. , & Calabrò, R. S. ((2017) ). Effects of robot-assisted upper limb rehabilitation in stroke patients: A systematic review with meta-analysis. Neurological Sciences: Official Journal of the Italian Neurological Society and of the Italian Society of Clinical Neurophysiology, 38: (9), 1561–1569. https://doi.org/10.1007/s10072-017-2995-5

9 

Birkenmeier, R. L. , Prager, E. M. , & Lang, C. E. , ((2010) a). Translating animal doses of task-specific training to people with chronic stroke in 1-hour therapy sessions: A proof-of-concept study. Neurorehabilitation and Neural Repair, 24: (7), 620–635. https://doi.org/10.1177/1545968310361957

10 

Birkenmeier, R. L. , Prager, E. M. , & Lang, C. E. , ((2010) b). Translating animal doses of task-specific training to people with chronic stroke in -hour therapy sessions: A proof-of-concept study. Neurorehabilitation and Neural Repair, 24: (7), 620–635. https://doi.org/10.1177/1545968310361957

11 

Blank, A. A. , French, J. A. , Pehlivan, A. U. , & O’Malley, M. K. ((2014) ). Current trends in robot-assisted upper-limb stroke rehabilitation: Promoting patient engagement in therapy. Current Physical Medicine and Rehabilitation Reports, 2: (3), 184–195. https://doi.org/10.1007/s40141-014-0056-z

12 

Brewer, B. R. , McDowell, S. K. , & Worthen-Chaudhari, L. C. ((2007) ). Poststroke upper extremity rehabilitation: A review of robotic systems and clinical results. Topics in Stroke Rehabilitation, 14: (6), 22–44. https://doi.org/10.1310/tsr1406-22

13 

Broeren, J. , Dixon, M. , Sunnerhagen, K. S. , & Rydmark, M. ((2006) ). Rehabilitation after stroke using virtual reality, haptics (force feedback) and telemedicine. Studies in Health Technology and Informatics, 124: , 51–56. https://www.ncbi.nlm.nih.gov/pubmed/17108503

14 

Brokaw, E. B. , Nichols, D. , Holley, R. J. , & Lum, P. S. ((2014) ). Robotic therapy provides a stimulus for upper limb motor recovery after stroke that is complementary to and distinct from conventional therapy. Neurorehabilitation and Neural Repair, 28: (4), 367–376. https://doi.org/10.1177/1545968313510974

15 

Brunner, I. C. , Skouen, J. S. , & Strand, L. I. ((2011) ). Recovery of upper extremity motor function post stroke with regard to eligibility for constraint-induced movement therapy. Topics in Stroke Rehabilitation, 18: (3), 248–257. https://doi.org/10.1310/tsr1803-248

16 

Burgar, C. G. , Lum, P. S. , Scremin, A. M. , Garber, S. L. , Van der Loos, H. F. , Kenney, D. , & Shor, P. ((2011) ). Robot-assisted upper-limb therapy in acute rehabilitation setting following stroke: Department of Veterans Affairs multisite clinical trial. Journal of Rehabilitation Research and Development, 48: (4), 445–458. https://doi.org/10.1682/JRRD.2010.04.0062

17 

Byl, N. N. , Pitsch, E. A. , & Abrams, G. M. ((2008) ). Functional outcomes can vary by dose: Learning-based sensorimotor training for patients stable poststroke. Neurorehabilitation and Neural Repair, 22: (5), 494–504. https://doi.org/10.1177/1545968308317431

18 

Calabrò, R. S. , Sorrentino, G. , Cassio, A. , Mazzoli, D. , Andrenelli, E. , Bizzarini, E. , Campanini, I. , Carmignano, S. M. , Cerulli, S. , Chisari, C. , Colombo, V. , Dalise, S. , Fundarò, C. , Gazzotti, V. , Mazzoleni, D. , Mazzucchelli, M. , Melegari, C. , Merlo, A. , Stampacchia, G. , . . . (Cicerone), I. C. C. O. R. I. N. ((2021) ). Robotic-assisted gait rehabilitation following stroke: A systematic review of current guidelines and practical clinical recommendations. European Journal of Physical and Rehabilitation Medicine, 57: (3), 460–471. https://doi.org/10.23736/S1973-9087.21.06887-8

19 

Carey, J. R. , Durfee, W. K. , Bhatt, E. , Nagpal, A. , Weinstein, S. A. , Anderson, K. M. , & Lewis, S. M. ((2007) ). Comparison of finger tracking versus simple movement training via telerehabilitation to alter hand function and cortical reorganization after stroke. Neurorehabilitation and Neural Repair, 21: (3), 216–232. https://doi.org/10.1177/1545968306292381

20 

Cauraugh, J. H. , & Kim, S. B. ((2003) ). Stroke motor recovery: Active neuromuscular stimulation and repetitive practice schedules. Journal of Neurology, Neurosurgery and Psychiatry, 74: (11), 1562–1566. https://doi.org/10.1136/jnnp.74.11.1562

21 

Chien, W. T. , Chong, Y. Y. , Tse, M. K. , Chien, C. W. , & Cheng, H. Y. ((2020) ). Robot-assisted therapy for upper-limb rehabilitation in subacute stroke patients: A systematic review and meta-analysis. Brain and Behavior, 10: (8), 1–16. https://doi.org/10.1002/brb3.1742

22 

Cirstea, M. C. C. , & Levin, M. F. ((2007) ). Improvement of arm movement patterns and endpoint control depends on type of feedback during practice in stroke survivors. Neurorehabilitation and Neural Repair, 21: (5), 398–411. https://doi.org/10.1177/1545968306298414

23 

Cirstea, M. C. C. , Ptito, A. , & Levin, M. F. ((2006) ). Feedback and cognition in arm motor skill reacquisition after stroke. Stroke, 37: (5), 1237–1242. https://doi.org/10.1161/01.STR.0000217417.89347.63

24 

Colombo, R. , & Sanguineti, V. ((2018) ). Assistive controllers and modalities for robot-aided neurorehabilitation. In Rehabilitation Robotics. Elsevier Ltd. https://doi.org/10.1016/b978-0-12-811995-2.00005-9

25 

Connell, L. A. , Klassen, T. K. , Janssen, J. , Thetford, C. , & Eng, J. J. ((2018) ). Delivering intensive rehabilitation in stroke: Factors influencing implementation. Physical Therapy, 98: (4), 243–250.

26 

Conroy, S. S. , Whitall, J. , Dipietro, L. , Jones-Lush, L. M. , Zhan, M. , Finley, M. A. , Wittenberg, G. F. , Krebs, H. I. , & Bever, C. T. ((2011) ). Effect of gravity on robot-assisted motor training after chronic stroke: A randomized trial. Physical Medicine and Rehabilitation, 92: (11), 1754–1761. https://doi.org/10.1016/j.apmr.2011.06.016

27 

Conroy, S. S. , Wittenberg, G. F. , Krebs, H. I. , Zhan, M. , Bever, C. T. , & Whitall, J. ((2019) ). Robot-assisted arm training in chronic stroke: Addition of transition-to-task practice. Neurorehabilitation and Neural Repair, 33: (9), 751–761. https://doi.org/10.1177/1545968319862558

28 

Coote, S. , Murphy, B. , Harwin, W. , & Stokes, E. ((2008) ). The effect of the {GENTLE}/s robot-mediated therapy system on arm function after stroke. Clin Rehabil, 22: (5), 395–405. https://doi.org/10.1177/0269215507085060

29 

Cramer, S. C. , Dodakian, L. , Le, V. , See, J. , Augsburger, R. , McKenzie, A. , Zhou, R. J. , Chiu, N. L. , Heckhausen, J. , Cassidy, J. M. , Scacchi, W. , Smith, M. T. , Barrett, A. M. , Knutson, J. , Edwards, D. , Putrino, D. , Agrawal, K. , Ngo, K. , Roth, E. J. , . . . Janis, S. ((2019) ). Efficacy of home-based telerehabilitation vs in-clinic therapy for adults after stroke: A randomized clinical trial. JAMA Neurology, 76: (9), 1079–1087. https://doi.org/10.1001/jamaneurol.2019.1604

30 

Daly, J. J. , McCabe, J. P. , Holcomb, J. , Monkiewicz, M. , Gansen, J. , & Pundik, S. ((2019) ). Long-dose intensive therapy is necessary for strong, clinically significant, upper limb functional gains and retained gains in severe/moderate chronic stroke. Neurorehabilitation and Neural Repair, 33: (7), 523–537. https://doi.org/10.1177/1545968319846120

31 

Dehem, S. , Gilliaux, M. , Stoquart, G. , Detrembleur, C. , Jacquemin, G. , Palumbo, S. , Frederick, A. , & Lejeune, T. ((2019) ). Effectiveness of upper-limb robotic-assisted therapy in the early rehabilitation phase after stroke: A single-blind, randomised, controlled trial. Annals of Physical and Rehabilitation Medicine, 2018: , 2–9. https://doi.org/10.1016/j.rehab.2019.04.002

32 

Díez, J. A. , Catalán, J. M. , Lledó, L. D. , Badesa, F. J. , & Garcia-Aracil, N. ((2016) ). Multimodal robotic system for upper-limb rehabilitation in physical environment. Advances in Mechanical Engineering, 8: (9), 1–8. https://doi.org/10.1177/1687814016670282

33 

Dorsch, S. , & Elkins, M. R. ((2020) ). Repetitions and dose in stroke rehabilitation. Journal of Physiotherapy, 66: (4), 211–212. https://doi.org/10.1016/j.jphys.2020.04.001

34 

Dromerick, A. W. , Lum, P. S. , & Hidler, J. ((2006) ). Activity-Based Therapies. Topics in Stroke Rehabilitation, 4: (3), 428–438. https://doi.org/10.1016/j.nurx.2006.07.004

35 

Duncan, P. W. , & Sue Min Lai ((1997) ). Stroke recovery. Topics in Stroke Rehabilitation, 4: (3), 51–58. https://doi.org/10.1310/KYD7-HN2K-VGYG-8C98

36 

Duret, C. , Courtial, O. , & Grosmaire, A. -G. ((2016) ). Kinematic measures for upper limb motor assessment during robot-mediated training in patients with severe sub-acute stroke. Restorative Neurology and Neuroscience, 34: (2), 237–245. https://doi.org/10.3233/RNN-150565

37 

Duret, C. , Courtial, O. , Grosmaire, A. -G. , & Hutin, E. ((2014) ). Upper limb robot-assisted training after severe paresis in subacute stroke: An innovative paradigm to track motor performance. Annals of Physical and Rehabilitation Medicine, 57: , 12. https://doi.org/10.1016/j.rehab.2014.03.036

38 

Duret, C. , Courtial, O. , Grosmaire, A. -G. , & Hutin, E. ((2015) ). Use of a robotic device for the rehabilitation of severe upper limb paresis in subacute stroke: Exploration of patient/robot interactions and the motor recovery process. BioMed Research International, 2015: , 1–7. https://doi.org/10.1155/2015/482389

39 

Duret, C. , & Gracies, J. M. (2014). Does upper limb robot-assisted rehabilitation contribute to improve the prognosis of post-stroke hemiparesis? Revue Neurologique. https://doi.org/10.1016/j.neurol.2014.07.012

40 

Duret, C. , Grosmaire, A. -G. , & Koeppel, T. ((2018) ). Upper limb robot-assisted rehabilitation in sub-acute stroke: Slacking or engagement promotion? Evidence from patient-robot interactions analysis. Annals of Physical and Rehabilitation Medicine, 61: , e496. https://doi.org/10.1016/j.rehab.2018.05.1155

41 

Duret, C. , & Hutin, E. ((2013) ). Effects of prolonged robot-assisted training on upper limb motor recovery in subacute stroke. NeuroRehabilitation, 33: (1), 41–48. https://doi.org/10.3233/NRE-130926

42 

Duret, C. , Hutin, E. , Lehenaff, L. , & Gracies, J. M. ((2015) ). Do all sub acute stroke patients benefit from robot-assisted therapy? A retrospective study. Restorative Neurology and Neuroscience, 33: (1), 57–65. https://doi.org/10.3233/RNN-140418

43 

Duret, C. , Pila, O. , Grosmaire, A. -G. , & Koeppel, T. ((2019) ). Can robot-based measurements improve prediction of motor performance after robot-assisted upper-limb rehabilitation in patients with moderate-to-severe sub-acute stroke? Restorative Neurology and Neuroscience, 37: (2), 119–129. https://doi.org/10.3233/RNN-180892

44 

Elangovan, N. , Yeh, I. L. , Holst-Wolf, J. , & Konczak, J. (2019). A robot-assisted sensorimotor training program can improve proprioception and motor function in stroke survivors. IEEE International Conference on Rehabilitation Robotics, 660-664. https://doi.org/10.1109/ICORR.2019.8779409

45 

Emken, J. L. , Bobrow, J. E. , & Reinkensmeyer, D. J. ((2005) ). Robotic Movement Training as an Optimization Problem: Designing a Controller that Assists Only as Needed. th International Conference on Rehabilitation Robotics, 2005 ICORR, 2005: , 307–312. https://doi.org/10.1109/ICORR.2005.1501108

46 

Fazekas, G. , & Tavaszi, I. ((2019) ). The future role of robots in neuro-rehabilitation. Expert Reviewof Neurotherapeutics, 19: (6), 471–473. https://doi.org/10.1080/14737175.2019.1617700

47 

Feys, H. M. , De Weerdt, W. J. , Selz, B. E. , Cox Steck, G. A. , Spichiger, R. , Vereeck, L. E. , Putman, K. D. , & Van Hoydonck, G. A. ((1998) ). Effect of a therapeutic intervention for the hemiplegic upper limb in the acute phase after stroke: A single-blind, randomized, controlled multicenter trial. Stroke, 29: (4), 785–792. https://doi.org/10.1161/01.STR.29.4.785

48 

Finley, M. A. , Fasoli, S. E. , Dipietro, L. , Ohlhoff, J. , MacClellan, L. , Meister, C. , Whitall, J. , Macko, R. , Bever, C. T. , Krebs, H. I. , & Hogan, N. ((2005) ). Short-duration robotic therapy in stroke patients with severe upper-limb motor impairment. Journal of Rehabilitation Research and Development, 42: (5), 683–691. https://doi.org/10.1682/JRRD.2004.12.0153

49 

Flynn, N. , Froude, E. , Cooke, D. , & Kuys, S. (2020). Repetitions, duration and intensity of upper limb practice following the implementation of robot assisted therapy with sub-acute stroke survivors: An observational study. Disability and Rehabilitation: Assistive Technology, 1-6. https://doi.org/10.1080/17483107.2020.1807621

50 

Fugl-Meyer, A. R. , Jääskö, L. , Leyman, I. , Olsson, S. , & Steglind, S. ((1975) ). Fugl_Meyer_1975 The post-stroke hemiplegic patient 1 a method for evaluation of physicalperformance.pdf.. Scand J Rehabil Med, 7: (1), 13–31. https://files/2106/FuglMeyer 1975 - The post-stroke hemiplegic patient. 1. a methodfor evaluation of physical performance..pdf

51 

Gassert, R. , & Dietz, V. ((2018) ). Rehabilitation robots for the treatment of sensorimotor deficits: A neurophysiological perspective. Journal of NeuroEngineering and Rehabilitation, 15: (1), 1–15. https://doi.org/10.1186/s12984-018-0383-x

52 

Gendolla, G. H. E. ((1999) ). Self-relevance of performance, task difficulty, and task engagement assessed as cardiovascular response. Motivation and Emotion, 23: (1), 45–66. https://doi.org/10.1023/A:1021331501833

53 

Geyh, S. , Cieza, A. , Schouten, J. , Dickson, H. , Frommelt, P. , Omar, Z. , Kostanjsek, N. , Ring, H. , & Stucki, G. ((2004) ). ICF Core Sets for stroke. Journal of Rehabilitation Medicine, Supplement, 44: , 135–141. https://doi.org/10.1080/16501960410016776

54 

Grosmaire, A. -G. , & Duret, C. ((2017) ). Does assist-as-needed upper limb robotic therapy promote participation in repetitive activity-based motor training in sub-acute stroke patients with severe paresis? NeuroRehabilitation, 41: (1), 31–39. https://doi.org/10.3233/NRE-171454

55 

Guadagnoli, M. A. , & Lee, T. D. ((2004) ). Challenge point: A framework for conceptualizing the effects of various practice conditions in motor learning. Journal of Motor Behavior, 36: (2), 212–224. https://doi.org/10.3200/JMBR.36.2.212-224

56 

Hodges, N. J. , Lohse, K. R. , Wilson, A. , Lim, S. B. , & Mulligan, D. ((2014) ). Exploring the dynamic nature of contextual interference: Previous experience affects current practice but not learning. Journal of Motor Behavior, 46: (6), 455–467. https://doi.org/10.1080/00222895.2014.947911

57 

Host, H. H. , Lang, C. E. , Hildebrand, M. W. , Zou, D. , Binder, E. F. , Baum, C. M. , Freedland, K. E. , Morrow-Howell, N. , & Lenze, E. J. ((2014) ). Patient active time during therapy sessions in postacute rehabilitation: Development and validation of a new measure. Physical and Occupational Therapy in Geriatrics, 32: (2), 169–178. https://doi.org/10.3109/02703181.2014.915282

58 

Housley, S. N. , Fitzgerald, K. , & Butler, A. J. ((2018) ). Telerehabilitation Robotics: Overview of approaches and clinical outcomes. In Rehabilitation Robotics, Elsevier Ltd., pp. 333–346. https://doi.org/10.1016/b978-0-12-811995-2.00026-6

59 

Hsieh, Y. W. , Lin, K. C. , Horng, Y. S. , Wu, C. Y. , Wu, T. C. , & Ku, F. L. ((2014) ). Sequential combination of robot-assisted therapy and constraint-induced therapy in stroke rehabilitation: A randomized controlled trial. Journal of Neurology, 261: (5), 1037–1045. https://doi.org/10.1007/s00415-014-7345-4

60 

Hsieh, Y. W. , Lin, K. C. , Wu, C. Y. , Shih, T. Y. , Li, M. W. , & Chen, C. L. ((2018) ). Comparison of proximal versus distal upper-limb robotic rehabilitation on motor performance after stroke: A cluster controlled trial. Scientific Reports, 8: (1), 1–11. https://doi.org/10.1038/s41598-018-20330-3

61 

Hsieh, Y. W. , Wu, C. Y. , Liao, W. W. , Lin, K. C. , Wu, K. Y. , & Lee, C. Y. ((2011) ). Effects of treatment intensity in upper limb robot-assisted therapy for chronic stroke. Neurorehabilitation and Neural Repair, 25: (6), 503–511. https://doi.org/10.1177/1545968310394871

62 

Hung, C. S. , Hsieh, Y. W. , Wu, C. Y. , Lin, Y. T. , Lin, K. C. , & Chen, C. ((2016) ). The effects of combination of robot-assisted therapy with task-specific or impairment-oriented training on motor function and quality of life in chronic stroke. PM and R, 8: (8), 721–729. https://doi.org/10.1016/j.pmrj.2016.01.008

63 

Israely, S. , & Carmeli, E. (2015). Error augmentation as a possible technique for improving upper extremity motor performance after a stroke - a systematic review. Topics in Stroke Rehabilitation, 1945511915Y0000000007. https://doi.org/10.1179/1945511915Y.0000000007

64 

Jo, E. J. , Noh, D. H. , & Kam, K. Y. ((2020) ). Effects of contextual interference on feeding training in patients with stroke. Human Movement Science, 69: (2019), 102560. https://doi.org/10.1016/j.humov.2019.102560

65 

Kal, E. , Winters, M. , Van Kamp, J. , Der, Houdijk, H. , Groet, E. , Bennekom, C. , & Scherder, E. ((2016) ). Is implicit motor learning preserved after stroke? A systematic review with meta-analysis. PLoS ONE, 11: (12), 1–23. https://doi.org/10.1371/journal.pone.0166376

66 

Kaur, G. , English, C. , & Hillier, S. ((2012) ). How physically active are people with stroke in physiotherapy sessions aimed at improving motor function? A systematic review. Stroke Research and Treatment, 2012: . https://doi.org/10.1155/2012/820673

67 

Kawato, M. ((1990) ). Feedback-Error-Learning Neural Network for Supervised Motor Learning. In Advanced Neural Computers. Elsevier B.V. https://doi.org/10.1016/b978-0-444-88400-8.50047-9

68 

Kimberley, T. J. , Samargia, S. , Moore, L. G. , Shakya, J. K. , & Lang, C. E. ((2010) ). Comparison of amounts and types of practice during rehabilitation for traumatic brain injury and stroke. Journal of Rehabilitation Research and Development, 47: (9), 851–862. https://doi.org/10.1682/JRRD.2010.02.0019

69 

Kleim, J. A. , Barbay, S. , & Nudo, R. J. ((1998) ). Functional reorganization of the rat motor cortex following motor skill learning. Journal of Neurophysiology, 80: (6), 3321–3325. https://doi.org/10.1152/jn.1998.80.6.3321

70 

Kleim, J. A. , & Jones, T. A. , ((2008) a). Principles of experience-dependent neural plasticity: Implications for rehabilitation after brain damage. Journal of Speech, Language, and Hearing Research: JSLHR, 51: (1), S225–239. https://doi.org/10.1044/1092-4388(2008/018)

71 

Kleim, J. A. , & Jones, T. A. , ((2008) b). Principles of experience-dependent neural plasticity: Implications for rehabilitation after brain damage. Journal of Speech Language and Hearing Research, 51: (1), S225. https://doi.org/10.1044/1092-4388(2008/018)

72 

Kong, K. H. , & Lee, J. ((2013) ). Temporal recovery and predictors of upper limb dexterity in the first year of stroke: A prospective study of patients admitted to a rehabilitation centre. NeuroRehabilitation, 32: (2), 345–350. https://doi.org/10.3233/NRE-130854

73 

Krakauer, J. W. , & Cortés, J. C. ((2018) ). A non-task-oriented approach based on high-dose playful movement exploration for rehabilitation of the upper limb early after stroke: A proposal. NeuroRehabilitation, 43: (1), 31–40. https://doi.org/10.3233/NRE-172411

74 

Krebs, H. I. ((2001) ). Disturbances of higher level neural control - robotic applications in stroke. 4: , 4069–4074. https://doi.org/10.1109/IEMBS.2001.1019747

75 

Krebs, H. I. , & Hogan, N. ((2006) ). Therapeutic Robotics: A Technology Push: Stroke rehabilitation is being aided by robots that guide movement of shoulders and elbows, wrists, hands, arms and ankles to significantly improve recovery of patients. Proceedings of the IEEE. Institute of Electrical and Electronics Engineers, 94: (9), 1727–1738. https://doi.org/10.1109/JPROC.2006.880721

76 

Krebs, H. I. , Mernoff, S. , Fasoli, S. E. , Hughes, R. , Stein, J. , & Hogan, N. ((2008) ). A comparison of functional and impairment-based robotic training in severe to moderate chronic stroke: A pilot study. NeuroRehabilitation, 23: (1), 81–87.

77 

Krebs, H. I. , Palazzolo, J. J. , Dipietro, L. , Ferraro, M. , Krol, J. , Rannekleiv, K. , Volpe, B. T. , & Hogan, N. ((2003) ). Rehabilitation robotics: Performance-based progressive robot-assisted therapy. Autonomous Robots, 15: (1), 7–20. https://doi.org/10.1023/A:1024494031121

78 

Krebs, H. I. , Saitoh, E. , & Hogan, N. ((2015) ). Robotic therapy and the paradox of the diminishing number of degrees of freedom. Physical Medicine and Rehabilitation Clinics of North America, 26: (4), 691–702. https://doi.org/10.1016/j.pmr.2015.06.003

79 

Krishnan, C. , Kotsapouikis, D. , Dhaher, Y. Y. , & Rymer, W. Z. ((2013) ). Reducing robotic guidance during robot-assisted gait training improves gait function: A case report on a stroke survivor. Archives of Physical Medicine and Rehabilitation, 94: (6), 1202–1206. https://doi.org/10.1016/j.apmr.2012.11.016

80 

Kukla, A. ((1972) ). Foundations of an attributional theory of performance. Psychological Review, 79: (6), 454–470. https://doi.org/10.1037/h0033494

81 

Kwakkel, G. , Kollen, B. J. , & Krebs, H. I. , ((2008) a). Effects of robot-assisted therapy on upper limb recovery after stroke: A systematic review. Neurorehabilitation and Neural Repair, 22: (2), 111–121. https://doi.org/10.1177/1545968307305457

82 

Kwakkel, G. , Kollen, B. J. , & Krebs, H. I. , ((2008) b). Effects of robot-assisted therapy on upper limb recovery after stroke: A systematic review. In Neurorehabilitation and Neural Repair, 22: (2), 111–121. https://doi.org/10.1177/1545968307305457

83 

Kwakkel, G. , Veerbeek, J. M. , van Wegen, E. E. H. , & Wolf, S. L. ((2015) ). Constraint-induced movement therapy after stroke. The Lancet Neurology, 14: (2), 224–234. https://doi.org/10.1016/S1474-4422(14)70160-7

84 

Lang, C. E. , Macdonald, J. R. , Reisman, D. S. , Boyd, L. A. , Jacobson Kimberley, T. , Schindler-Ivens, S. M. , Hornby, T. G. , Ross, S. A. , & Scheets, P. L. ((2009) ). Observation of amounts of movement practice provided during stroke rehabilitation. Annals of Neurology, 80: (3), 1692–1698. https://doi.org/10.1016/j.apmr.2009.04.005

85 

Lang, C. E. , Strube, M. J. , Bland, M. D. , Waddell, K. J. , Cherry-Allen, K. M. , Nudo, R. J. , Dromerick, A. W. , & Birken. ((2016) ). Dose-response of task-specific upper limb training at least months post stroke: A Phase II, single-blind, randomized, controlled trial. Annals of Neurology, 80: (3), 342–354. https://doi.org/10.1002/ana.24734 Epub 2016 Aug 16

86 

Langhorne, P. , Bernhardt, J. , & Kwakkel, G. ((2011) ). Stroke rehabilitation. The Lancet, 377: (9778), 1693–1702. https://doi.org/10.1016/S0140-6736(11)60325-5

87 

Langhorne, P. , Wagenaar, R. , & Partridge, C. ((1996) ). Physiotherapy after stroke: More is better? Physiotherapy Research International: The Journal for Researchers and Clinicians in Physical Therapy, 1: (2), 75–88. https://doi.org/10.1002/pri.6120010204

88 

Lee, K. B. , Lim, S. H. , Kim, K. H. , Kim, K. J. , Kim, Y. R. , Chang, W. N. , Yeom, J. W. , Kim, Y. D. , & Hwang, B. Y. ((2015) ). Six-month functional recovery of stroke patients: A multi-time-point study. International Journal of Rehabilitation Research, 38: (2), 173–180. https://doi.org/10.1097/MRR.0000000000000108

89 

Lee, S. H. , Park, G. , Cho, D. Y. , Kim, H. Y. , Lee, J. Y. , Kim, S. , Park, S. B. , & Shin, J. H. ((2020) ). Comparisons between end-effector and exoskeleton rehabilitation robots regarding upper extremity function among chronic stroke patients with moderate-to-severe upper limb impairment. Scientific Reports, 10: (1), 1–8. https://doi.org/10.1038/s41598-020-58630-2

90 

Lefebvre, S. , Dricot, L. , Laloux, P. , Gradkowski, W. , Desfontaines, P. , Evrard, F. , Peeters, A. , Jamart, J. , & Vandermeeren, Y. ((2015) ). Neural substrates underlying stimulation-enhanced motor skill learning after stroke. Brain, 138: (1), 149–163. https://doi.org/10.1093/brain/awu336

91 

Levin, M. F. ((2020) ). What is the potential of virtual reality for post-stroke sensorimotor rehabilitation? Expert Review of Neurotherapeutics, 20: (3), 195–197. https://doi.org/10.1080/14737175.2020.1727741

92 

Liu, L. Y. , Li, Y. , & Lamontagne, A. ((2018) ). The effects of error-augmentation versus error-reduction paradigms in robotic therapy to enhance upper extremity performance and recovery post-stroke: A systematic review. Journal of NeuroEngineering and Rehabilitation, 15: (1), 1–25. https://doi.org/10.1186/s12984-018-0408-5

93 

Lledó, L. D. , Díez, J. A. , Bertomeu-Motos, A. , Ezquerro, S. , Badesa, F. J. , Sabater-Navarro, J. M. , & García-Aracil, N. ((2016) ). A comparative analysis of 2D and 3D tasks for virtual reality therapies based on robotic-assisted neurorehabilitation for post-stroke patients. Frontiers in Aging Neuroscience, 8: (AUG), 1–16. https://doi.org/10.3389/fnagi.2016.00205

94 

Lo, A. C. , Guarino, P. D. , Richards, L. G. , Haselkorn, J. K. , Wittenberg, G. F. , Federman, D. G. , Ringer, R. J. , Wagner, T. H. , Krebs, H. I. , Volpe, B. T. , Bever, C. T. , Bravata, D. M. , Duncan, P. W. , Corn, B. H. , Maffucci, A. D. , Nadeau, S. E. , Conroy, S. S. , Powell, J. M. , Huang, G. D. , & Peduzzi, P. ((2010) ). Robot-assisted therapy for long-term upper-limb impairment after stroke. The New England Journal of Medicine, 362: (19), 1772–1783. https://doi.org/10.1056/NEJMoa0911341

95 

Lo, K. , Stephenson, M. , & Lockwood, C. ((2017) ). Effectiveness of robotic assisted rehabilitation for mobility and functional ability in adult stroke patients: A systematic review. JBI Database of Systematic Reviews and Implementation Reports, 15: (12), 3049–3091. https://doi.org/10.11124/JBISRIR-2017-003456

96 

Lohse, K. R. , Lang, C. E. , & Boyd, L. A. ((2014) ). Is more better? Using metadata to explore dose-response relationships in stroke rehabilitation. Stroke, 45: (7), 2053–2058. https://doi.org/10.1161/STROKEAHA.114.004695

97 

Lyle, R. C. ((1981) ). A performance test for assessment of upper limb function in physical rehabilitation treatment and research. International Journal of Rehabilitation Research, 4: (4), 483–492. https://doi.org/10.1097/00004356-198112000-00001

98 

Lynch, D. , Ferraro, M. , Krol, J. , Trudell, C. M. , Christos, P. , & Volpe, B. T. ((2005) ). Continuous passive motion improves shoulder joint integrity following stroke. Clinical Rehabilitation, 19: (6), 594–599. https://doi.org/10.1191/0269215505cr901oa

99 

MacClellan, L. R. , Bradham, D. D. , Whitall, J. , Volpe, B. T. , Wilson, P. D. , Ohlhoff, J. , Meister, C. , Hogan, N. , Krebs, H. I. , & Bever, C. T. ((2005) ). Robotic upper-limb neurorehabilitation in chronic stroke patients. The Journal of Rehabilitation Research and Development, 42: (6), 717. https://doi.org/10.1682/JRRD.2004.06.0068

100 

Magill, R. (1993). Augmented feedback in skill acquisition. In Handbook of Research on Sport Psychology, Macmillian, pp. 193-212.

101 

Maier, M. , Ballester, B. R. , & Verschure, P. F. M. J. ((2019) ). Principles of neurorehabilitation after stroke based on motor learning and brain plasticity mechanisms. Frontiers in Systems Neuroscience, 13: , 13. https://doi.org/10.3389/fnsys.2019.00074

102 

Maier, M. , Rubio Ballester, B. , Duff, A. , Duarte Oller, E. , & Verschure, P. F. M. J. ((2019) ). Effect of specific over nonspecific VR-based rehabilitation on poststroke motor recovery: A systematic meta-analysis. Neurorehabilitation and Neural Repair, 33: (2), 112–129. https://doi.org/10.1177/1545968318820169

103 

Marchal-Crespo, L. , & Reinkensmeyer, D. J. ((2009) ). Review of control strategies for robotic movement training after neurologic injury. Journal of NeuroEngineering and Rehabilitation, 6: (1). https://doi.org/10.1186/1743-0003-6-20

104 

Masiero, S. , Armani, M. , Ferlini, G. , Rosati, G. , & Rossi, A. ((2014) ). Randomized trial of a robotic assistive device for the upper extremity during early inpatient stroke rehabilitation. Neurorehabilitation and Neural Repair, 28: (4), 377–386. https://doi.org/10.1177/1545968313513073

105 

Mazzoleni, S. , Battini, E. , Crecchi, R. , Dario, P. , & Posteraro, F. ((2018) ). Upper limb robot-assisted therapy in subacute and chronic stroke patients using an innovative end-effector haptic device: A pilot study. NeuroRehabilitation, 42: (1), 43–52. https://doi.org/10.3233/NRE-172166

106 

Mehrholz, J. , Pohl, M. , Platz, T. , Kugler, J. , & Elsner, B. ((2015) ). Electromechanical and robot-assisted arm training for improving generic activities of daily living, arm function, and arm muscle strength after stroke (Review) Electromechanical and robot-assisted arm training for improving generic activities of daily. The Cochrane Database of Systematic Reviews, 11: , 11. https://doi.org/10.1002/14651858.CD006876.pub3.Copyright

107 

Mehrholz, J. , Pohl, M. , Platz, T. , Kugler, J. , & Elsner, B. ((2018) ). Electromechanical and robot-assisted arm training for improving activities of daily living, arm function, and arm muscle strength after stroke. Cochrane Database of Systematic Reviews, 9: , CD006876. https://doi.org/10.1002/14651858.CD006876.pub5

108 

Mehrholz, J. , Pollock, A. , Pohl, M. , Kugler, J. , & Elsner, B. ((2020) ). Systematic review with network meta-analysis of randomized controlled trials of robotic-assisted arm training for improving activities of daily living and upper limb function after stroke. Journal of NeuroEngineering and Rehabilitation, 17: (1), 1–14. https://doi.org/10.1186/s12984-020-00715-0

109 

Merbah, S. , & Meulemans, T. ((2011) ). Learning a motor skill: Effects of blocked versus random practice a review. Psychologica Belgica, 51: (1), 15–48. https://doi.org/10.5334/pb-51-1-15

110 

Milot, M. -H. , Spencer, S. J. , Chan, V. , Allington, J. P. , Klein, J. , Chou, C. , Bobrow, J. E. , Cramer, S. C. , & Reinkensmeyer, D. J. ((2013) ). A crossover pilot study evaluating the functional outcomes of two different types of robotic movement training in chronic stroke survivors using the arm exoskeleton BONES. Journal of NeuroEngineering and Rehabilitation, 10: (1), 112. https://doi.org/10.1186/1743-0003-10-112

111 

Mizanoor Rahman, S. M. (2019). Graps Rehabilitation of Stroke Patients Through Object Manipulation with an Intelligent Power Assist Robotic System. In Proceedings of the Future Technologies Conference (FTC), pp. 244-259. https://doi.org/10.1007/978-3-030-32523-7_16

112 

Morone, G. , Cocchi, I. , Paolucci, S. , & Iosa, M. ((2020) ). Robot-assisted therapy for arm recovery for stroke patients: State of the art and clinical implication. Expert Review of Medical Devices, 17: (3), 223–233. https://doi.org/10.1080/17434440.2020.1733408

113 

Morone, G. , Palomba, A. , Martino Cinnera, A. , Agostini, M. , Aprile, I. G. , Arienti, C. , Paci, M. , Casanova, E. , Marino, D. , LA Rosa, G. , Bressi, F. , Sterzi, S. , Gandolfi, M. , Giansanti, D. , Perrero, L. , Battistini, A. , Miccinilli, S. , Filoni, S. , Sicari, M. , . . .Neurorehabilitation, “CICERONE” Italian Consensus Conference on Robotic in. ((2021) ). Systematic review of guidelines to identify recommendations for upper limb robotic rehabilitation after stroke. European Journal of Physical and Rehabilitation Medicine, 57: (2), 238–245. https://doi.org/10.23736/S1973-9087.21.06625-9

114 

Morris, S. L. , Dodd, K. J. , & Morris, M. E. ((2004) ). Outcomes of progressive resistance strenght training following stroke: A systematic review. Clinical Rehabilitation, 18: (1), 27–39. https://doi.org/10.1191/0269215504cr699oa

115 

Page, S. J. , Schmid, A. , & Harris, J. E. ((2012) ). Optimizing terminology for stroke motor rehabilitation: Recommendations from the American Congress of Rehabilitation Medicine Stroke Movement Interventions Subcommittee. Archives of Physical Medicine and Rehabilitation, 93: (8), 1395–1399. https://doi.org/10.1016/j.apmr.2012.03.005

116 

Pan, L. , Song, A. , Wang, S. , & Duan, S. ((2019) ). Experimental study on upper-limb rehabilitation training of stroke patients based on adaptive task level: A preliminary study. BioMed Research International, 2019: . https://doi.org/10.1155/2019/2742595

117 

Paolucci, S. , Antonucci, G. , Grasso, M. G. , Morelli, D. , Troisi, E. , Coiro, P. , & Bragoni, M. ((2000) ). Early versus delayed inpatient stroke rehabilitation. Arch Phys Med Rehabil, 81: (June), 695–700. https://doi.org/10.1053/apmr.2ooO.5583

118 

Paul M. F. ((1954) ). the information capacity of the human motor system in controlling the amplitude of movement. Journal of Experimental Psychology, 47: (6), 381–391. https://www2.psychology.uiowa.edu/faculty/mordkoff/InfoProc/pdfs/Fitts1954.pdf

119 

Pila, O. , Duret, F.-X. , Gracies, J.-M. , Bayle, N. , & Hutin, É. , ((2017) a). Pattern of improvement in upper limb pointing task kinematics after a -month training program with robotic assistance in stroke. Journal of NeuroEngineering and Rehabilitation Pattern, 14: (1), 1. https://doi.org/doi:10.1186/s12984-017-0315-1

120 

Pila, O. , Duret, C. , Laborne, F. X. , Gracies, J. M. , Bayle, N. , & Hutin, E. , ((2017) b). Pattern of improvement in upper limb pointing task kinematics after a -month training program with robotic assistance in stroke. Journal of NeuroEngineering and Rehabilitation, 14: (1), 105. https://doi.org/10.1186/s12984-017-0315-1

121 

Pila, O , Koeppel, T , Grosmaire, A.G , Duret, C. ((2022) ) Impact of dose of combined conventional and robotic therapy on upper limb motor impairments and costs in subacute stroke patients: A retrospective study, Front Neurol, 13, 770259. doi:10.3389/fneur.2022.770259. PMID: 35222240; PMCID: PMC8869251.

122 

Pohl, P. S. , McDowd, J. M. , Filion, D. , Richards, L. G. , & Stiers, W. ((2006) ). Implicit learning of a motor skill after mild and moderate stroke. Clinical Rehabilitation, 20: (3), 246–253. https://doi.org/10.1191/0269215506cr916oa

123 

Ramos-Lima, M. J. M. , Brasileiro, de I. C. , de Lima, T. L. , & Braga-Neto, P. ((2018) ). Quality of life after stroke: Impact of clinical and sociodemographic factors. Clinics, 73: , 1–7. https://doi.org/10.6061/clinics/2017/e418

124 

Rezazadeh, A. , & Berniker, M. ((2019) ). Force field generalization and the internal representation of motor learning. PLoS ONE, 14: (11), 1–17. https://doi.org/10.1371/journal.pone.0225002

125 

Rodgers, H. , Bosomworth, H. , Krebs, H. I. , van Wijck, F. , Howel, D. , Wilson, N. , Aird, L. , Alvarado, N. , Andole, S. , Cohen, D. L. , Dawson, J. , Fernandez-Garcia, C. , Finch, T. , Ford, G. A. , Francis, R. , Hogg, S. , Hughes, N. , Price, C. I. , Ternent, L. , . . . Shaw, L. ((2019) ). Robot assisted training for the upper limb after stroke (RATULS): A multicentre randomised controlled trial. The Lancet, 6736: (19), 1–12. https://doi.org/10.1016/S0140-6736(19)31055-4

126 

Rodgers, H. , Shaw, L. , Bosomworth, H. , Aird, L. , Alvarado, N. , Andole, S. , Cohen, D. L. , Dawson, J. , Eyre, J. , Finch, T. , Ford, G. A. , Hislop, J. , Hogg, S. , Howel, D. , Hughes, N. , Krebs, H. I. , Price, C. , Rochester, L. , Stamp, E. , . . . Wilkes, S. ((2017) ). Robot Assisted Training for the Upper Limb after Stroke (RATULS): Study protocol for a randomised controlled trial. Trials, 18: (1), 340. https://doi.org/10.1186/s13063-017-2083-4

127 

Rosati, G. , Oscari, F. , Reinkensmeyer, D. J. , Secoli, R. , Avanzini, F. , Spagnol, S. , & Masiero, S. ((2011) ). Improving robotics for neurorehabilitation: Enhancing engagement, performance, and learning with auditory feedback. IEEE. . . International Conference on Rehabilitation Robotics: [Proceedings], 2011: . https://doi.org/10.1109/ICORR.2011.5975373

128 

Sathian, K. , Buxbaum, L. J. , Cohen, L. G. , Krakauer, J. W. , Lang, C. E. , Corbetta, M. , Fitzpatrick, S. M. , & Fitzpatrick, S. M. ((2011) ). Neurological Principles and Rehabilitation of Action Disorders: Common Clinical Deficits. Neurorehabilitation and Neural Repair, 25: , 21S–32S. https://doi.org/10.1177/1545968311410941

129 

Shea, J. B. , & Morgan, R. L. ((1979) ). Contextual interference effects on the acquisition, retention, and transfer of a motor skill. Journal of Experimental Psychology: Human Learning and Memory, 5: (2), 179–187. https://doi.org/10.1037/0278-7393.5.2.179

130 

Shirzad, N. , & Van der Loos, H. F. M. (2016). Evaluating the user experience of exercising reaching motions with a robot that predicts desired movement difficulty. Journal of Motor Behavior, 1-16. https://doi.org/10.1080/00222895.2015.1035430

131 

Sidarta, A. , Vahdat, S. , Bernardi, N. F. , & Ostry, D. J. ((2016) ). Somatic and reinforcement-based plasticity in the initial stages of human motor learning. Journal of Neuroscience, 36: (46), 11682–11692. https://doi.org/10.1523/JNEUROSCI.1767-16.2016

132 

Sim, S. M. , Oh, D. W. , & Chon, S. C. ((2015) ). Immediate effects of somatosensory stimulation on hand function in patients with poststroke hemiparesis: A randomized cross-over trial. International Journal of Rehabilitation Research, 38: (4), 306–312. https://doi.org/10.1097/MRR.0000000000000126

133 

Sivan, M. , Gallagher, J. , Makower, S. , Keeling, D. , Bhakta, B. , O’Connor, R. J. , & Levesley, M. ((2014) ). Home-based Computer Assisted Arm Rehabilitation (hCAAR) robotic device for upper limb exercise after stroke: Results of a feasibility study in home setting. Journal of NeuroEngineering and Rehabilitation, 11: (1), 163. https://doi.org/10.1186/1743-0003-11-163

134 

Smith, M. A. , Ghazizadeh, A. , & Shadmehr, R. ((2006) ). Interacting adaptive processes with different timescales underlie short-term motor learning. PLoS Biology, 4: (6), e179. https://doi.org/10.1371/journal.pbio.0040179

135 

Steenbergen, B. , Kamp, J. , van der, Verneau, M. , Jongbloed-Pereboom, M. , & Masters, R. S. W. ((2010) ). Implicit and explicit learning: Applications from basic research to sports for individuals with impaired movement dynamics. Https://Doi.Org/10.3109/09638288.2010.497035, 32: (18), 1509–1516. https://doi.org/10.3109/09638288.2010.497035

136 

Stefan, K. ((2000) ). Induction of plasticity in the human motor cortex by paired associative stimulation. Brain, 123: (3), 572–584. https://doi.org/10.1093/brain/123.3.572

137 

Stein, J. , Krebs, H. I. , Frontera, W. R. , Fasoli, S. E. , Hughes, R. , & Hogan, N. ((2004) ). Comparison of two techniques of robot-aided upper limb exercise training after stroke. Am J Phys Med Rehabil, 83: (9), 720–728. https://doi.org/10.1097/01.PHM.0000137313.14480.CE

138 

Thant, A. A. , Wanpen, S. , Nualnetr, N. , Puntumetakul, R. , Chatchawan, U. , Hla, K. M. , & Khin, M. T. ((2019) ). Effects of task-oriented training on upper extremity functional performance in patients with sub-acute stroke: A randomized controlled trial. Journal of Physical Therapy Science, 31: (1), 82–87. https://doi.org/10.1589/jpts.31.82

139 

van Vliet, P. , & Wulf, G. ((2006) ). Extrinsic feedback for motor learning after stroke: What is the evidence? Disability and Rehabilitation, 28: (13-14), 831–840. https://doi.org/10.1080/09638280500534937

140 

Veerbeek, J. M. , Langbroek-Amersfoort, A. C. , van Wegen, E. E. H. , Meskers, C. G. M. , Kwakkel, G. , Wegen, E. E. H. , Van, Meskers, C. G. M. , & Kwakkel, G. ((2017) ). Effects of robot-assisted therapy for the upper limb after stroke: A systematic review and meta-analysis. Neurorehabilitation and Neural Repair, 31: (2), 107–121. https://doi.org/10.1177/1545968316666957

141 

Veerbeek, J. M. , van Wegen, E. , van Peppen, R. , van der Wees, P. J. , Hendriks, E. , Rietberg, M. , & Kwakkel, G. ((2014) ). What is the evidence for physical therapy poststroke? A systematic review and meta-analysis. PloS One, 9: (2), e87987. https://doi.org/10.1371/journal.pone.0087987

142 

Vratsistas-Curto, A. , Sherrington, C. , & McCluskey, A. ((2021) ). Dosage and predictors of arm practice during inpatient stroke rehabilitation: An inception cohort study. Disability and Rehabilitation, 43: (5), 640–647. https://doi.org/10.1080/09638288.2019.1635215

143 

Waddell, K. J. , Strube, M. J. , Bailey, R. R. , Klaesner, J. W. , Birkenmeier, R. L. , Dromerick, A. W. , & Lang, C. E. ((2017) ). Does task-specific training improve upper limb performance in daily life poststroke? Neurorehabilitation and Neural Repair, 31: (3), 290–300. https://doi.org/10.1177/1545968316680493

144 

Wade, D. T. , Wood, V. A. , & Hewer, R. L. ((1985) ). Recovery after stroke - The first 3 months. Journal of Neurology Neurosurgery and Psychiatry, 48: (1), 7–13. https://doi.org/10.1136/jnnp.48.1.7

145 

Washabaugh, E. P. , Treadway, E. , Brent Gillespiec, R. , David Remy, C. , & Krishnan, C. ((2018) ). Self-powered robots to reduce motor slacking during upper-extremity rehabilitation: A proof of concept study. Restorative Neurology and Neuroscience, 36: (6), 693–708. https://doi.org/10.3233/RNN-180830

146 

Wei, Y. , Bajaj, P. , Scheldt, R. , & Patton, J. ((2005) ). Visual error augmentation for enhancing motor learning and rehabilitative relearning. Proceedings of the 2005 IEEE 9th International Conference on Rehabilitation Robotics, 2005: , 505–510. https://doi.org/10.1109/ICORR.2005.1501152

147 

Weiss, A. , Suzuki, T. , Bean, J. , & Fielding, R. A. ((2000) ). High intensity strength training improves strength and functional performance after stroke. American Journal of Physical Medicine and Rehabilitation, 79: (4), 369–376. https://doi.org/10.1097/00002060-200007000-00009

148 

Wickens, C. D. , Hutchins, S. , Carolan, T. , & Cumming, J. ((2013) ). Effectiveness of part-task training and increasing-difficulty training strategies: A meta-analysis approach. Human Factors, 55: (2), 461–470. https://doi.org/10.1177/0018720812451994

149 

Wolf, S. L. , Blanton, S. , Baer, H. , Breshears, J. , & Butler, A. J. ((2002) ). Repetitive task practice: A critical review of constraint-induced movement therapy in stroke. The Neurologist, 8: (6), 325–338. https://doi.org/10.1097/01.nrl.0000031014.85777.76

150 

Wu, J. , Cheng, H. , Zhang, J. , Yang, S. , & Cai, S. ((2021) ). Robot-assisted therapy for upper extremity motor impairment after stroke: A systematic review and meta-analysis. In Physical Therapy, 101: (4). Oxford University Press. https://doi.org/10.1093/ptj/pzab010

151 

Yozbatiran, N. , & Francisco, G. E. ((2019) ). Robot-assisted therapy for the upper limb after cervical spinal cord injury. Physical Medicine and Rehabilitation Clinics of North America, 30: (2), 367–384. https://doi.org/10.1016/j.pmr.2018.12.008

152 

Zhang, C. , Li-Tsang, C. W. P. P. , & Au, R. K. C. C. ((2017) ). Robotic approaches for the rehabilitation of upper limb recovery after stroke: A systematic review and meta-analysis. International Journal of Rehabilitation Research. Internationale Zeitschrift Fur Rehabilitationsforschung. Revue Internationale De Recherches De Readaptation, 40: (1), 19–28. https://doi.org/10.1097/MRR.0000000000000204

153 

Zimmerli, L. , Krewer, C. , Gassert, R. , Müller, F. , Riener, R. , & Lünenburger, L. ((2012) ). Validation of a mechanism to balance exercise difficulty in robot-assisted upper-extremity rehabilitation after stroke. Journal of NeuroEngineering and Rehabilitation, 9: (1), 1–13. https://doi.org/10.1186/1743-0003-9-6