This paper focuses on the development of a model-based feedback controller to realize high versatility of fully actuated planar bipedal robotic walking. To conveniently define both symmetric and asymmetric walking patterns, we propose to use the left and the right legs for gait characterization. In addition to walking pattern tracking error, a biped's position tracking error in Cartesian space is included in the output function in order to enable high-level task planning and control such as multi-agent coordination. A feedback controller based on input–output linearization and proportional–derivative control is then synthesized to realize exponential tracking of the desired walking pattern as well as the desired global position trajectory. Sufficient stability conditions of the hybrid time-varying closed-loop system are developed based on the construction of multiple Lyapunov functions. In motion planning, a new method of walking pattern design is introduced, which decouples the planning of global motion and walking pattern. Finally, simulation results on a fully actuated planar biped show the effectiveness of the proposed walking strategy.
Introduction
There are a variety of approaches to realize bipedal robotic walking. One of the most frequently used methods is based on the zero moment point (ZMP) balance criterion [1,2]. Enforcing the ZMP criterion turns a biped into a fixed-based robot manipulator as it requires flat-footed walking, which results in limited walking speed.
The concept of viability has been introduced to walking control [3,4], and capturability has been proposed as a computationally feasible approximation of viability [5–8]. Because capturability is defined based on the viability of walking instead of the state of balance, the associated walking strategies may be less conservative than the ZMP-based approach.
Another approach to realizing bipedal robotic walking is based on nonlinear control theories and the concept of hybrid zero dynamics (HZD) [9–13]. With the HZD framework, the walking stabilization problem becomes a stabilization problem of the closed-loop control system. Orbitally, asymptotic stabilization of an underactuated walking biped with hybrid dynamics was first achieved based on feedback control under the assumption of finite time convergence during the continuous walking phase [9]. Later on, finite time stabilization was relaxed to sufficiently fast exponential stabilization, and the concepts of virtual constraints and HZD were introduced [12–14]. Because the HZD framework only specifies a general structure of walking dynamics, it can be applied to a variety of biped models. In addition to provable closed-loop stability of the control system, another advantage of the HZD-based approach is the achievable high walking speed. Furthermore, the walking strategy based on HZD has been extended to rough terrain walking [15], three-dimensional walking [16], and neutrally stable walking [17]. Besides the HZD framework, orbital stabilization of underactuated walking has also been realized based on transverse linearization [18–20].
For fully actuated walking, the HZD framework has been extended to achieve exponential tracking of the desired walking pattern as well as the desired walking speed [11,21,22]. However, because orbital stabilization cannot control a biped's global position trajectory in Cartesian space, only velocity tracking has been addressed. Therefore, satisfactory position tracking in Cartesian space is not guaranteed, and the walking versatility is limited. Controlling a biped's global position trajectory is desirable because it enables high-level task planning and control such as multi-agent coordination and obstacle avoidance.
Also, previous studies on orbital stabilization typically utilize the traditional support-swing gait characterization that describes a bipedal gait using the support and the swing legs. This gait characterization can be used to conveniently define symmetric gaits but not asymmetric gaits. Therefore, planning and control of asymmetric bipedal robotic gaits have not been fully investigated in previous studies. However, asymmetric gait tracking is potentially meaningful for related research areas such as motion planning and control of prosthetic devices and exoskeletons because asymmetric gaits are common in injured human walking.
In this study, exponential stabilization of fully actuated planar bipedal walking is realized with enhanced versatility as compared with the previous studies on orbital stabilization. The left–right gait characterization is utilized to describe a bipedal gait so as to conveniently define both symmetric and asymmetric gaits. Although this type of gait characterization has been previously adopted [23], planning and control of asymmetric walking have not been fully studied. Another benefit of the left–right gait characterization is that the states representing joint positions become continuous and well defined upon a swing-foot landing. In control design, input–output linearization is utilized to synthesize a controller to achieve exponential tracking of the desired global motion and walking pattern, and the closed-loop stability conditions are derived based on the construction of multiple Lyapunov functions [24]. In motion planning, a new method of walking pattern design is presented, which not only guarantees that the planned motion respects the impact events but also enables decoupled planning of the desired global position trajectory and the desired walking pattern. The proposed walking strategy is validated through simulated walking of a planar biped model with three revolute joints. Simulation results show that the proposed control design can achieve exponential tracking of the desired global position trajectory in Cartesian space as well as the desired walking pattern in the configuration space. A comparison with previous studies on orbital stabilization is also presented to validate the improved versatility.
In Sec. 2, the left–right gait characterization and the full-order hybrid walking dynamics are presented along with the tracking error of the desired position trajectory in Cartesian space and the desired walking pattern. A model-based feedback control law based on input–output linearization is presented in Sec. 3. In Sec. 4, the closed-loop stability is analyzed based on the construction of multiple Lyapunov functions. A new method of walking pattern design is proposed in Sec. 5, which enables decoupled planning of global motion and walking pattern. In Sec. 6, improved versatility of the proposed walking strategy as compared with previous studies is illustrated through simulations, and the effects of control gains on the closed-loop stability are analyzed.
Preliminary results of control design and stability analysis presented in this paper were initially reported in Ref. [25]. The present paper includes important results of motion planning and fully developed theorems on stability analysis, which were omitted from Ref. [25]. Also, a comparison with previous work on versatility is presented through simulations.
Problem Formulation
The objective of this study is to achieve exponentially stable walking with high versatility so that a fully actuated planar bipedal robot can exponentially track the desired walking pattern, both symmetric and asymmetric, as well as the desired global position trajectory in Cartesian space. In order to reach this goal, a bipedal gait is characterized by the left and the right legs instead of the traditional characterization by the support and the swing legs, the full-order hybrid walking dynamics are modeled under the left-right gait characterization, and the expressions of the walking pattern tracking error and the global position tracking error are derived.
Gait Characterization.
The traditional gait characterization describes a bipedal gait using the support and the swing legs [9,20,21]. Under the support-swing gait characterization, the states that represent positions and velocities of the support and the swing legs are always discontinuous at the end of a step because of the role switching of the support and the swing legs. Here, we utilize the left–right gait characterization to describe a bipedal gait. There are two main advantages of using the left and the right legs for gait characterization. First, the states that represent joint positions will be continuous and well defined upon an impact [23,26,27]. Although the states that represent joint velocities may still experience sudden jumps due to landing impacts, the definition of these states is at least consistent. Second, the left–right gait characterization enables planning and control of asymmetric gaits, which will be detailed in Secs. 3 and 5.
Hybrid Walking Dynamics With Impulse Effects.
In this study, a fully actuated planar biped with three revolute joints, identical legs, and massless thin feet is considered (see Fig. 1). There are two actuators at the hip and one at each ankle, and three of them are active at any moment except for the one at the swing ankle. Assume that the swing foot always lands flat and remains in static, full contact with the walking surface until the next landing occurs. Under this assumption, the biped is considered fully actuated during continuous phases because it has three degrees-of-freedom during continuous phases and three independent active actuators. Also, assume that the landing impact is a rigid-body contact with an impulse effect and that the double-support phase is instantaneous [9]. Without loss of generality, suppose that the swing leg length is adjustable. Otherwise, when the swing leg passes the support leg, the planar biped with a compass gait can only avoid scuffing the walking surface exactly at the vertical configuration of both legs [9].
where q1, q2, and q3 represent the joint angles of the left leg, the right leg, and the trunk with respect to the world coordinate frame OwXwZw, respectively.
where u1, u2, u3, and u4 are defined as in Fig. 1.
Based on the left–right gait characterization introduced in Sec. 2.1, a complete walking cycle (or, a stride) consists of two successive steps, which include two single-support phases (SSP) and two swing-foot landings. The two SSPs are the left-in-support SSP and the right-in-support SSP. The two swing-foot landings are the left-to-right-support landing and the right-to-left-support landing. System dynamics during the two SSPs are continuous time, but the swing-foot landings are modeled as impulse effects.
where the subscript i ∈ {L, R} indicates whether the left (L) or the right (R) leg is in support, is the swing foot height when the left leg is in support, and is the swing foot height when the right leg is in support (l is the leg length).
Tracking Error of the Desired Global Position Trajectory.
To accomplish complex tasks such as multi-agent coordination and obstacle avoidance, it is necessary for a biped to follow the desired travel path with the desired motion in Cartesian space, which can be formulated as a contouring control problem in general. By constructing an orthogonal global task coordinate frame along the desired travel path, the contour error and the motion along the desired travel path can be separately represented in two sets of coordinates, based on which contour error minimization and desired motion following along the contour can be decoupled into a stabilization problem and a trajectory tracking problem [29]. In this study, we want to solve this contouring control problem for the fully actuated planar biped model in Fig. 1, which reduces to the problem of position trajectory tracking along the Xw-axis because the Xw-axis is the only feasible travel path for the planar biped. The complete problem of contouring control will be considered in our future work on three-dimensional walking of fully actuated bipedal robots.
Let sd(t) denote the desired trajectory of s along the Xw-axis. Then, the tracking error of the desired global position trajectory sd(t) can be expressed as s − sd(t).
Then, the tracking error of qst − qstd(t) can be used to indicate the global position tracking error s − sd(t). If a control law is synthesized such that qst − qstd(t) is driven to zero exponentially, then the exponential tracking of the desired global position trajectory sd(t) is realized.
Tracking Error of the Desired Walking Pattern.
A walking pattern is defined as the relative evolution of a biped's joint positions with respect to a reference (or, encoding) variable in a complete walking cycle [9]. Tracking a preplanned walking pattern is desirable partly because the joint motion can be synchronized with respect to the reference variable. Furthermore, a proper walking pattern design can be utilized to construct the hybrid invariance of the desired motion, which will be detailed in Sec. 5.
where the functions will be determined with a new method of walking pattern design in Sec. 5.
Hence, the tracking error of the desired walking pattern is simply . If is exponentially driven to zero with a controller design, then exponential tracking of the desired walking pattern is realized.
Such a walking pattern is illustrated in Fig. 2. From the solid lines in Fig. 2, one can see that an asymmetric gait can be conveniently defined by differentiating the left and the right legs because and can be chosen independently. However, as shown by the dashed line in Fig. 2, the traditional walking characterization based on the support and the swing legs can at most represent a symmetric walking pattern where .
Feedback Control Based on Input–Output Linearization
The control objective of this study is to realize exponential tracking of the desired walking pattern in the configuration space as well as the desired position trajectory in Cartesian space. As the first step of our ongoing research, it is assumed that there are no modeling errors or disturbances, and input–output linearization is utilized to synthesize the needed controller to achieve the control objectives. Specifically, the swing leg and the trunk are driven to exponentially converge to the desired walking pattern encoded by the support leg angle, and the support leg is driven to realize exponential tracking of the desired motion in Cartesian space.
Note that the output function yi (i ∈ {L, R}) can be designed as three-dimensional because the biped has three independent active actuators. By exponentially driving the output function yi (i ∈ {L, R}) to zero, exponential tracking of the desired global motion sd(t) and the desired walking pattern (i ∈ {L, R}) can be realized simultaneously.
From Eq. (15), it can be known that Pi(qst) is always invertible.
where is proved to be invertible and .
where χ is the full state space, is a zero matrix, and is an identity matrix.
Stability Analysis
where the expressions of and can be derived from and yi and the expressions of the switching surfaces SL→R(t, x) and SR→L(t, x) can be obtained from Si and yi.
Without loss of generality, suppose that the walking process begins with the left leg in support and the right leg in the air at t = t0. Without loss of generality, suppose t0 = 0. Let and represent the actual moments of the kth left-to-right-support and the kth right-to-left-support impacts, respectively. Without loss of generality, assume . Let and denote the desired moments of the kth left-to-right-support impact assuming and the kth right-to-left-support impact assuming , respectively.
Properties of and are summarized in Theorem 1, which is introduced based on Lemma 2 in Ref. [31].
Theorem 1. Consider the fully actuated walking system in Eq. (24). Let the following conditions hold:
(A1) There is no beating effect at impacts.
(A2) The desired global position trajectory sd(t) is continuously differentiable and monotonically increasing for t > 0.
(A3) The function in Eq. (11) is continuously differentiable in qst.
Then, there exists a small neighborhood U of the point such that is a unique continuously differentiable function in U, where is the solution of with initial condition for and is the solution of with initial condition for . Also, has the following properties:
(P1) ; and
(P2) there exists a positive number Lτ such that .
Proof. By the definitions of and , the property (P1) holds. From the conditions (A1)–(A3) and Eqs. (3), (13), and (24), it can be known that the functions that define the continuous dynamics, the reset maps, and the switching surfaces are all continuously differentiable in t and x. Then, by the implicit function theorem, the property (P2) holds. ▪
We are now ready to present the main theorem.
Theorem 2. Let the conditions (A1)–(A3) hold. Assume that and hold for any k ∈ {1, 2,…}. Then, there exist positive-definite diagonal matrices KPi and KDi (i ∈ {L, R}) and a positive number δ such that the hybrid time-varying closed-loop system in Eq. (24) is locally exponentially stable for all .
Proof. Without loss of generality, suppose that the walking process begins with the left-in-support continuous phase.
Let VL(x) and VR(x) be the Lyapunov functions associated with the left-in-support and the right-in-support phases, respectively. When the walking process begins with the left-in-support continuous phase, the Kth step (K ∈{1, 3, 5…}) is a left-in-support phase and the Kth switching is a left-to-right-support switching. Let and (K ∈ {1, 3, 5,…}) denote the values of Lyapunov functions right after the Kth and the (K + 1)th switchings, respectively. By stability analysis via multiple Lyapunov functions [24], the overall system is exponentially stable if VL(x) and VR(x) are exponentially decreasing in the left-in-support and the right-in-support phases, respectively, and if and are both strictly decreasing sequences.
First, we prove that there exist positive-definite diagonal matrices KPi and KDi (i ∈ {L, R}) and a positive number δR such that for any .
where TK+1 is the moment of the actual (K + 1)th impact, and represent the values of x right before and after the (K + 1)th impact, respectively, and τK+1 is the moment of the desired (K + 1)th impact assuming x(t) = ∀t > TK.
where .
hold.
where and . Note that ΔτK is the desired duration of the (K + 1)th step, which is known right after the Kth actual impact occurs.
The stability conditions in Eqs. (46) and (47) indicate that the output function should converge to zero sufficiently fast so as to diminish the possible divergence caused by reset maps. In previous studies, rapidly exponential convergence of output function has been proposed to deal with the possible expansiveness of a landing impact [21], which can also be applied here to further increase the convergence rate.
In Sec. 5, it will be shown that the assumption of and in Theorem 2 will always hold for any K ∈ {1, 3, 5,…} if the desired walking pattern is designed properly.
Desired Walking Pattern Design
The desired walking motion qid(t, qst) (i ∈ {L, R}) in Eq. (13) is completely defined by the desired global position trajectory and the desired walking pattern. Suppose that the desired global position trajectory sd(t) is determined by the high-level task planner, which is continuously differentiable and monotonically increasing for t > 0. Then, the remaining task of motion planning is walking pattern design, which should guarantee that the desired motion qid(t, qst) will satisfy the following conditions:
(C1) and
(C2) forward walking direction;
(C3) ground-contact constraints including the friction cone and the unilateral constraint;
(C4) joint position and velocity limits; and
(C5) joint torque limits.
Since the last four conditions (C2)–(C5), can be easily met through trajectory optimization, they are not further discussed in this paper. The first condition (C1) essentially states that the desired gait should respect the reset map; i.e., if , then should always hold. As presented in Sec. 4, the first condition (C1) is important because it can greatly simplify the stability analysis of the hybrid time-varying closed-loop control system. However, the satisfaction of (C1) is not straightforward as it involves both the desired global position trajectory and the desired walking pattern.
In this section, a new method of walking pattern design is proposed, which guarantees that (C1) is always satisfied for any feasible sd(t) that is continuously differentiable and monotonically increasing for t > 0. This is advantageous because the high-level planning of the desired global position trajectory sd(t) and the low-level planning of the desired walking pattern represented by are decoupled for the satisfaction of (C1).
Hybrid Invariance of Desired Motion.
The condition (C1) can be decomposed into two parts. One part requires that the desired walking pattern should respect the reset map, which can be satisfied based on the same method of walking pattern design for constructing HZD [13]. The other part is tricky to meet, which requires that the desired position trajectory of the support leg should respect the reset map. As indicated in Eq. (7), the desired support-leg trajectory is updated at the beginning of each actual step, and thus it depends on when and where the last actual swing-foot touchdown occurs.
When the walking process begins with the left-in-support continuous phase, the Kth step (K ∈ {1, 3, 5…}) is a left-in-support step starting at , and the Kth desired switching is a left-to-right-support switching at . Suppose that the desired walking pattern has at least one intersection with the switching surface . Also, suppose that one of these intersections has left leg position at . In the following, we will develop the conditions on and the desired walking pattern (i ∈ {L, R}) such that in condition (C1) is satisfied for any K ∈ {1, 3, 5,…}.
From Eq. (7), the desired support-leg trajectory q1d(t) will increase monotonically within the Kth step if sd(t) is planned as feasible and monotonically increasing. Then, the Kth desired landing moment , if exists, can be uniquely determined from the equation .
where .
Walking Pattern Parameterization With Beziér Curves.
where q10 and q20 are the initial support-leg angles of the left-in-support and the right-in-support phases, respectively, determined by the desired walking pattern and the switching surfaces.
The functions have the following properties [12]:
- (1)
;
- (2)
;
- (3)
; and
- (4)
.
These properties can be utilized to construct hybrid invariance of the desired motion.
An Example of Walking Pattern Design With Third-Order Beziér Curves.
Simulation Results
In this section, a fully actuated planar biped with three revolute joints is simulated to show the validity of the proposed walking strategy. We first compare our proposed walking strategy with previous studies to show that we can achieve exponential position tracking in Cartesian space but the previous study can only achieve exponential velocity tracking. Then, a symmetric walking pattern is simulated with two different desired global position trajectories sd(t)–one with a constant walking speed and the other with a time-varying walking speed—to show the versatility of the proposed walking strategy. The simulation results also show that the desired gait respects the reset map regardless of the choice of sd(t) when the desired walking pattern is designed as introduced in Sec. 5. Furthermore, exponential tracking of an asymmetric walking pattern is illustrated through simulations. Finally, effects of the continuous-phase convergence rate on the closed-loop stability are analyzed through simulations, which validates the stability conditions in Sec. 4.
The simulated biped model is shown in Fig. 3. The definitions of l and r are illustrated in Fig. 3, and the masses m, MH, and MT are lumped at the center of each link.
Comparison With Previous Work on Orbital Stabilization.
In the previous work on orbital stabilization [11], the bipedal gait is characterized by the support and the swing legs. Thus, only a symmetric walking pattern can be exponentially tracked. Besides walking pattern tracking, another control objective of the previous work is velocity tracking in Cartesian space.
In order to compare our proposed walking strategy with the previous orbital stabilization [11], the desired walking pattern is chosen as the symmetric walking pattern in Fig. 4(a). The desired global position trajectory sd(t) is defined as monotonically increasing with a constant speed. Because the previous walking strategy focuses on velocity tracking in Cartesian space, its desired global motion is defined as .
The simulation results corresponding to the previous work are shown in Fig. 5. From Fig. 5, it is clear to see that exponential tracking of the desired symmetric walking pattern is achieved. However, there is always a nonzero steady-state tracking error of the desired global position trajectory sd(t), although the desired global velocity trajectory can be exponentially tracked.
In contrast, with our proposed walking strategy, we can realize exponential walking pattern tracking and exponential global position tracking, as shown in Fig. 6.
This comparison clearly illustrates that our proposed walking strategy can greatly improve walking versatility as compared with the previous work on orbital stabilization.
Exponential Tracking of Different Global Position Trajectories.
where W is the solution of the Lyapunov equation AW + WAT + Q = 0 with Q = I6 × 6 [30].
Figure 7 shows the results with sd(t) = 0.6t − 0.1(m), and Fig. 8 corresponds to . From the plots, we can see that exponential tracking of the desired hip trajectory sd(t) with either a constant or a time-varying walking speed is achieved under the same desired walking pattern. It shows that a walking pattern generated through the proposed gait design method in Sec. 5 can be automatically incorporated with an arbitrary hip trajectory sd(t) that is differentiable and monotonically increasing. Note that the Lyapunov function plot in Fig. 7 shows a relatively large jump at the first impact at t = 0.5 s while the one in Fig. 8 shows no significant jump at the first landing impact at t = 2 s. Because the desired global position trajectory in Fig. 8 has a much lower velocity in the first few seconds than that in Fig. 7, the duration of the first step is much longer in Fig. 8, which results in the much smaller trajectory tracking error right before the first impact and the much smaller jump of the Lyapunov function right after the first impact in Fig. 8.
Stable Asymmetric Walking.
As stated earlier, the left-right gait characterization enables planning and tracking of an asymmetric walking pattern, which is illustrated with simulation results in this subsection. Figure 9 shows simulated bipedal walking with the initial conditions in Eq. (68), the desired asymmetric walking pattern in Fig. 4(b), and the desired global position trajectory sd(t) = 0.6t − 0.1(m). The control parameters are chosen as KPL = KPR = diag[12, 12, 12] and KDL = KDR = diag[7, 7, 7], and the Lyapunov functions are defined as Eq. (69).
As shown in Fig. 9, the desired asymmetric walking pattern as well as the desired global position trajectory is exponentially tracked, which validates the high versatility of our proposed walking strategy.
Effects of Continuous-Phase Convergence Rate on Closed-Loop Stability.
Theorem 2 introduced in Sec. 4 indicates that the continuous-phase convergence rate determined by the PD gains should be sufficiently fast to guarantee the stability of the closed-loop hybrid dynamical system in Eq. (24). In this subsection, two sets of simulated bipedal walking (see Figs. 10 and 11) are presented under different PD gains. They share the same initial conditions, desired walking pattern, desired hip trajectory, and Lyapunov function definitions as in Fig. 9. However, the PD gains corresponding to Fig. 10 are larger than those in Fig. 9, and the PD gains corresponding to Fig. 11 are less than those in Fig. 9. Accordingly, it can be seen from Figs. 9–11 that the actual motion converges to the desired motion faster in Fig. 10 but slower in Fig. 11 as compared with Fig. 9. Therefore, this comparison validates Theorem 2 and shows that a higher convergence rate during the continuous phases results in faster closed-loop convergence.
Conclusion
In this paper, provably stable, fully actuated, planar bipedal robotic walking has been achieved with improved versatility as compared with previous studies. In order to define both symmetric and asymmetric walking patterns, the left and the right legs were used to characterize a bipedal gait. Under the left–right gait characterization, the full-order hybrid walking dynamics were modeled. With the output function designed as the global position tracking error and the walking pattern tracking error, an input–output linearizing controller was then synthesized to exponentially drive the output function to zero. Closed-loop stability conditions were analyzed based on the construction of multiple Lyapunov functions, which essentially requires that the continuous-phase convergence rate of the output function should be sufficiently fast in order to overcome the possible divergence caused by landing impacts. A new method of walking pattern design was proposed, which guarantees that the low-level planning of the desired walking pattern can be decoupled from the high-level planning of the desired global motion. Provable exponential stabilization and high versatility of the proposed walking strategy were validated with simulated bipedal walking.
Acknowledgment
Any opinion, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation.
Funding Data
Division of Information and Intelligent Systems, National Science Foundation (Grant No. IIS-0916807).