This paper studies the multiple timescale behavior that is induced by dynamic coupling between continuous-time and discrete-time systems, and that arises naturally in distributed networked systems. An order reduction method is proposed that establishes a mathematically rigorous separation principle between the fast evolution of the continuous-time dynamics and the slow updates of the discrete-time dynamics. Quantitative conditions on the discrete update rate are then derived that ensure the stability of the coupled dynamics based on the behavior of the isolated systems. The results are illustrated for a distributed network of satellites whose attitudes evolve continuously while communicating intermittently over the network.

## Introduction

In multi-agent systems, distributed graph-based protocols between agents are often coupled to dynamic weight evolution and tracking of the agents' own nonlinear dynamics. One approach to analyzing these types of complex systems is to assume that the agents' network communication occurs very quickly, leading to a set of coupled, continuous-time dynamics [1]. These purely continuous-time dynamics can then be collectively designed to achieve desirable behavior [2,3]. However, this approach can break down as the time between communication updates becomes too large, leading to instability [4,5]. An alternative approach is to view the updates over the network as occurring only intermittently. This produces an inherently hybrid-time character in the coupled dynamics, as shown in Fig. 1. Intuitively, if the agents move quickly relative to the slow discrete updates over the network, then they will reach their immediate goal, and the network dynamics will evolve as if the agents are always at their state-dependent equilibrium trajectory. This implies that, depending on the rate of updates, a decoupling is possible between the fast, continuous-time agent dynamics and the slow, discrete-time network dynamics that is based on the different characteristic timescales over which the subsystems evolve. Such a separation between the subsystem dynamics is useful because it has the potential to decrease the complexity of analyzing the coupled hybrid-time system, permitting the networked decision dynamics to be designed separately from the agents' dynamics. The question, then, is under what conditions is this separation valid?

Concepts from singular perturbation theory provide an effective approach for understanding such multiple timescale systems [6]. For purely continuous-time systems, singular perturbation theory describes how slow and fast behaviors are induced when a small parameter multiplies the time derivatives of a subset of the system states. The Tikhonov–Levinson theorem then gives conditions under which such a purely continuous-time system can be analyzed based on the properties of its isolated slow and fast dynamics [6,7]. Application of these conditions to networked dynamical systems, for example, has yielded graph-topological stability bounds for the consensus-tracking and state-dependent graph problems [8]. The success of the Tikhonov–Levinson conditions for simplified analysis of continuous-time systems with slow and fast behaviors has led to several extensions in the literature for different classes of systems. These include: (1) discrete-time systems [9], (2) differential inclusions [10], (3) impulsive differential equations [11,12], and (4) hybrid systems where the fast dynamics are constrained to evolve on a compact set [13,14]. However, by focusing on the role of a small parameter in inducing slow and fast behaviors, these extensions do not consider how the update rate can affect the behavior of coupled hybrid-time dynamics and allow their analysis to be simplified.

This paper addresses the described research gap. In particular, this work studies the role of the discrete update period on the properties of coupled continuous-time and discrete-time dynamics. The paper makes two main contributions. The first is a novel reduced-order modeling technique, based on concepts of perturbation and asymptotic theory, that provides mathematical rigor to the intuitive notion of a separation principle in such hybrid-time systems as the time between discrete updates grows. In particular, conditions are derived under which the design of the discrete-time dynamics can be separated from the behavior of the continuous-time dynamics, and asymptotic bounds on the error that this decoupled design introduces are explicitly computed in terms of the update period. In the context of networked systems, these conditions give insight into when a designer can choose the network-based update algorithm independently from the behavior of the individual agents. The second contribution is a set of quantitative conditions that give a lower bound on the update rate under which the coupled hybrid-time system is guaranteed to be stable, and which are based on stability properties of the decoupled systems. These techniques can be practically applied to understand the effects of implemented communication rates on the behavior of networked dynamical systems.

The structure of the paper is as follows: In Sec. 2, the hybrid-time system under study is defined. Section 3 then develops reduced-order models for the hybrid-time system and proves their efficacy under appropriate conditions. Next, Sec. 4 presents the method for finding quantitative stability bounds for the coupled hybrid-time dynamics. An application to a distributed network of satellites is illustrated in Sec. 5, and conclusions are presented in Sec. 6.

## Problem Formulation

where the vector of discrete-time states is $x\u2208Dx\u2286\mathbb{R}nx$, the vector of continuous-time states is $y\u2208Dy\u2286\mathbb{R}ny$, updates of the discrete-time system occur at distinct times *t*_{1}, *t*_{2},…, differences between these distinct times are lower-bounded by $tk\u2013tk\u20131\u2265\tau >0$ for $k\u2208{1,2,\u2026}$, and *μ* = 1/*τ* measures the corresponding fastest update rate. In the context of networked dynamical systems, for example, *y* describes the agent states while *x* encodes the network states that update at time *t _{k}*. Here, the dependence on

*μ*in the last argument of

*f*and

*g*captures possible changes in the vector fields due to a change in the update rate. Similarly, the dependence of

*x*

_{0}and

*y*

_{0}on

*μ*is included to capture possible changes in the initial conditions due to a different update rate being used. Of course,

*g*,

*f*,

*x*

_{0}, and

*y*

_{0}may not change with the update rate in a particular system, but including this potential dependency on the update rate allows the ensuing results to be applied to a wider class of systems. To pose a well-defined problem, assume that:

Assumption 1. *The functions g, f, x _{0}, and y_{0} are*$O(1)$

*as τ → ∞ in the domains D*.

_{y}and D_{x}Assumption 2. *The function g is continuously differentiable in all its arguments and the functions f, x _{0}, and y_{0} are Lipschitz in their arguments over the domains D_{y} and D_{x}.*

## Reduced-Order Modeling

In this section, two reduced-order models are formulated for the hybrid-time system (1). The validity of these models in approximating the behavior of Eq. (1) is then rigorously proven, justifying the separate design of the continuous-time agent dynamics from the discrete-time network decision dynamics. The reduced-order models are characterized as follows:

**Decision System.**Define the equilibrium trajectory of the isolated continuous-time agent dynamics as a known function $h:\u2009Dx\xd7\mathbb{R}+\u2192Dy$, which satisfies $h\u0307(p,t)=g(p,h(p,t),t;0)$ for

*p*∈

*D*and

_{x}*t*∈

*R*

_{+}. The decision system is then defined as

subject to $x\xaf(t0)=x0(0)$.

**Interval Correction System.**Define the

*k*th time interval between discrete-time updates as $Ik\u225c{t\u2208\mathbb{R}\u2009|\u2009tk\u2264t<tk+1}$ and the elapsed time within this interval as $\eta \u225ct\u2212tk$. The interval correction system is then defined separately for each interval $Ik$ as

subject to $y\u03020(0)=y0(0)\u2212h(x\xaf(t0),t0)$ for the first interval and $y\u0302k(0)=h(x\xaf(tk\u2212),tk)\u2212h(x\xaf(tk+),tk)$ otherwise, and where $x\xaf$ is the state vector of the decision system defined in Eq. (2).

*Remark* 1. The decision system (2) describes the reduced-order behavior of the isolated discrete-time network dynamics with the continuous-time agent dynamics always at their state-dependent equilibrium. Note that the system is purely discrete.

*Remark* 2. The interval correction system (3) describes the evolution of the isolated continuous agent dynamics toward the equilibrium trajectory between each set of consecutive discrete updates. The initial conditions are based on the state vector $x\xaf$ of the decision system alone. They are independent of the state of the interval correction system on any previous intervals. Note that the interval correction system describes purely continuous-time dynamics. The new time variable *η* is introduced here to make clear that solutions of Eq. (3) are dependent on the elapsed time and are defined only for a particular interval $Ik$.

*Remark* 3. The last argument of the vector fields *f* and *g* is set to zero in Eqs. (2) and (3) because the reduced-order models describe the dynamics in the limit of *τ* growing very large so that the discrete network updates always occur with the agents at their state-dependent equilibrium.

*Remark* 4. While the original dynamics (1) are fully coupled, the reduced-order models (2) and (3) obtain their triangular structure by exploiting the equilibrium trajectory $h(x\xaf,t)$.

With the reduced-order models defined in Eqs. (2) and (3), the next logical question is under what conditions these models provide an accurate description of the original coupled dynamics (1). To this end, the following lemma first provides conditions to ensure that the approximation provided by the reduced-order continuous-time interval dynamics remains close to the true continuous-time dynamics over the time interval $Ik$, given that the initial conditions of Eq. (3) and the state vector $x\xaf$ of the decision system (2) are both close to the true values of Eq. (1) at the start of the interval.

*For the dynamics (1) under Assumptions 1 and 2, further assume that the interval correction system (3) is uniformly asymptotically stable for all points*$x\xaf\u2208Dx$

*and the corresponding known trajectories*$h(x\xaf(tk+),t)$

*. Then, if*$y(tk)\u2212y\u0302k(0)\u2212h(x\xaf(tk+),tk)=o(1)$

*and*$x(tk+)\u2212x\xaf(tk+)=o(1)$

*in the limit τ → ∞, τ can be chosen large enough that*

*for all t in the time interval*$Ik={t\u2208\mathbb{R}\u2009|\u2009tk\u2264t<tk+1}$

*. Further, there is a t*

_{j}with t_{k}< t_{j}≤ t_{k+}_{1}such that*holds for all t**∈**[t _{j}, t_{k+}_{1}).*

*Proof.* The proof of the lemma follows three steps:

- (1)
Formulate the dynamics of the continuous-state approximation error over an interval as a perturbed version of the interval correction dynamics.

- (2)
Use the stability of the interval correction system and a converse Lyapunov theorem to obtain a Lyapunov function with certain desirable bounding properties for the interval correction dynamics.

- (3)
Use the interval correction dynamics' Lyapunov function as well as the form of the perturbation in dynamics of the continuous-state approximation error to obtain bounds on the norm of this approximation error.

The steps are detailed as follows:

*Step* 1. In the following, all instances of $x(tk+)$ will be written as *x* and all instances of $x\xaf(tk+)$ as $x\xaf$ for conciseness since both $x(tk+)$ and $x\xaf(tk+)$ are constant over the interval $Ik$ where the analysis is performed.

*p*∈

*D*by definition of the equilibrium trajectory. That is, the error dynamics may be written as

_{x}*G*= Δ

_{1}+ Δ

_{2}+ Δ

_{3}. Now, the first component of the perturbation satisfies

*M*≥ 0 since

*g*is continuously differentiable. The second component has the bound

*L*

_{4}≥ 0 since

*g*is Lipschitz in its last argument. The third component is then similarly bounded by

*L*

_{1}≥ 0 since

*g*is Lipschitz in its first argument. Therefore, the overall perturbation bounds

hold over the domain.

*Step*2. By assumption, the interval correction system (3) is uniformly asymptotically stable for each $x\xaf\u2208Dx$. Therefore, by the converse Lyapunov theorem [7, Theorem 4.16], there exists a Lyapunov function

*V*over some domain $DV={v\u2208\mathbb{R}n\u2009|\u2009\u2009\Vert v\Vert 2<r}$ for the dynamics that satisfies the inequalities $\alpha 1(\Vert v\Vert )\u2264V(\eta ,v)\u2264\alpha 2(\Vert v\Vert )$

and $\Vert \u2202V/\u2202v\Vert \u2264\alpha 4(\Vert v\Vert )$ for class $K$ functions *α _{i}* defined on [0,

*r*].

*β*

_{1}. Now, $\gamma (\eta )=M\beta 1(\Vert y\u0302k(0)\Vert ,\eta )$ and

*d*are both non-negative, continuous, and bounded for all 0 ≤

*η*≤

*t*

_{k}_{+1}–

*t*. Since $\Vert x\u2212x\xaf\Vert =o(1)$ and $\Vert v(0)\Vert =o(1)$,

_{k}*μ*can be chosen, dependent on

*r*(the same

*r*that defines

*D*) and for 0 ≤

_{V}*η*≤

*t*

_{k}_{+1}–

*t*, small enough that

_{k}*θ*< 1. Therefore, by Ref. [7, Lemma 9.3], for all $\Vert v(0)\Vert <\alpha 2\u22121(\alpha 1(r))$, trajectories of the approximation error system (4) satisfy

*β*

_{2}, some finite $\eta \xaf$, and

*α*

_{5}the class

*κ*function defined by

This gives the bound on $y(t)\u2212h(x\xaf,t)\u2212y\u0302k(t\u2212tk)$ for all *t _{k}* ≤

*t*<

*t*

_{k}_{+1}. Since Eq. (6) gives an asymptotically decaying bound on $\Vert y\u0302k\Vert $,

*τ*can be chosen large enough that there exists a

*t*with

_{j}*t*<

_{k}*t*≤

_{j}*t*

_{k}_{+1}such that $\Vert y\u0302k(t\u2212tk)\Vert =o(1)$ for

*t*≥

*t*and thus $y(t)\u2212h(x\xaf,t)=o(1)$ holds for all

_{j}*t*∈ [

*t*,

_{j}*t*

_{k}_{+1}).

*□*

In Lemma 1, the Landau “little-Oh” *o*(1) bounds on the approximation error of the continuous agent state over an interval can be interpreted as saying that this error decreases asymptotically as *τ* grows large even though the reduced-order model is not quite the same as the full model and the approximation starts from different initial conditions than the true dynamics. This is a result of the assumption of uniform asymptotic stability for Eq. (3), which allows the continuous dynamics to eventually evolve to a known trajectory when $x\xaf$ is known. As described by the following lemma, tighter bounds on this approximation error can be found under the more restrictive assumption of exponential stability for Eq. (3).

Lemma 2. *Under the conditions of Lemma 1, if instead the errors in initial conditions are*$O(\tau \u22121)$*and the interval correction system (3) is exponentially stable for all points*$x\xaf\u2208Dx$*and their corresponding known trajectories*$h(x\xaf(tk+),t)$*, then the o(1) bounds on the approximation in Lemma 1 are replaced by*$O(\tau \u22121)$*bounds.*

*Proof.* The proof adopts the same three-step structure as the proof of Lemma 1, with the following changes:

*Step* 1. Follows identically.

*Step* 2. By Ref. [7, Theorem 4.14], the conditions on the converse Lyapunov function *V* are satisfied with $\alpha i(\Vert v\Vert )=ci\Vert v\Vert 2$ for *i* = 1, 2, 3 and $\alpha 4(\Vert v\Vert )=c4\Vert v\Vert $ for positive constants *c*_{1}–*c*_{4}.

*Step*3. Since exponential stability holds, then the bound on $\Vert y\u0302k\Vert $ in Eq. (6) is of the form $\beta 1(\Vert y\u0302k(0)\Vert ,\eta )=k\Vert y\u0302k(0)\Vert e\u2212a\eta $. Further, $\u222b0\eta \gamma (\tau )d\tau \u22640\xb7\eta +\omega $ for some non-negative constant

*ω*. Define $a=1/2c3/c2>0$ and $p=exp\u2009(c4\omega /2c1)\u22651$, where the

*c*comes from the bounds converse Lyapunov function

_{i}*V*, and choose

*τ*large enough that $v(0)=y(tk)\u2212y\u0302k(0)\u2212h(x\xaf(tk+),tk)=O(\tau \u22121)$ satisfies $\Vert v(0)\Vert <r/p/c1/c2$ and small enough that $d<2c1ar/c4p$. By Ref. [7, Lemma 9.4], trajectories of the approximation error system (4) therefore satisfy the norm bound

whose first term is of $O(\tau \u22121)$ for all *η* ≥ 0 if $\Vert v(0)\Vert =O(\tau \u22121)$, and whose second term is of $O(\tau \u22121)$ because *d* is and since the integral is bounded for all *η* ≥ 0. This gives the bound on $y\u2212h(x\xaf,t)\u2212y\u0302k(t\u2212tk)$ for all *t _{k}* ≤

*t*<

*t*

_{k}_{+1}. Since $\Vert y\u0302k\Vert $ has an exponentially decaying bound in

*η*,

*τ*can be chosen large enough that there exists a

*t*with

_{j}*t*<

_{k}*t*≤

_{j}*t*

_{k}_{+1}such that $\Vert y\u0302k(t\u2212tk)\Vert =O(\tau \u22121)$, giving the desired bound on $y(t)\u2212h(x\xaf,t)$.

*□*

Under the more stringent condition of exponential stability for the interval correction system (3), the corresponding Landau “big-Oh” $O(\tau \u22121)$ bounds in Lemma 2 give a stricter statement of the rate of the approximation error's decrease as *τ* grows large. This is possible because exponential stability gives concrete time bounds for the evolution of *y* toward $h(x\xaf,t)$ in step 3 of the lemma.

With Lemmas 1 and 2 in place, the validity of approximating the coupled hybrid-time system (1) by dynamics of the reduced-order models (2) and (3) can now be determined.

*For the dynamics (1) under Assumptions 1 and 2, further assume that the interval correction system (3) is uniformly asymptotically stable for all points*$x\xaf\u2208Dx$

*and the corresponding known trajectories*$h(x\xaf(tk+),t)$

*. Then, for the reduced-order models*$x\xaf$

*and*$y\u0302$

*, respectively, characterized in Eqs.*

*(2)*

*and*

*(3)*

*, and any t*

_{f}≥ t_{0}, there exists a τ_{0}, 0 < τ_{0}< ∞, such that for all τ ≥ τ_{0}the approximations*are valid for all t*

*∈*

*[t*$Ik$

_{0}, t_{f}]. Further, for each interval*between discrete updates with t*

_{k}< t_{f}, there is a t_{j}with t_{k}< t_{j}≤ t_{k+}_{1}such that the approximation*holds for all t**∈**[t _{j}, t_{k+}_{1}).*

*Proof.* The proof uses induction to follow the error in the approximation for *x* over discrete updates, with the error in the *y* approximation bounded over the continuous-time intervals using Lemma (1).

*k*that $\Vert x(tk\u2212)\u2212x\xaf(tk\u2212)\Vert =o(1)$ and $\Vert y(tk\u2212\tau )\u2212h(x\xaf(tk\u2212),tk\u2212\tau )\Vert =o(1)$. Then, under the assumption of uniform asymptotic stability of Eq. (3),

*τ*can be always be chosen large enough that $\Vert y(tk)\u2212h(x\xaf(tk\u2212),tk\u2212)\Vert =o(1)$ by Lemma 1. Further, after the transition

*f*so that $\Vert x(tk+)\u2212x\xaf(tk+)\Vert =o(1)$. From the initial conditions and the assumption that

*x*

_{0}and

*y*

_{0}are $O(1)$ and Lipschitz, $\Vert x(t1\u2212)\u2212x\xaf(t1\u2212)\Vert =\Vert x(t0+)\u2212x\xaf(t0+)\Vert =\Vert x0(\mu )\u2212x0(0)\Vert =O(\mu )$ and $\Vert y(t0)\u2212y\u03020(0)\u2212h(x\xaf(t0+),t0)\Vert =\Vert y0(\mu )\u2212y0(0)\Vert =O(\mu )$, and are thus both

*o*(1). Therefore,

*τ*can be chosen large enough that the approximations

hold by induction for any finite number of discrete updates, and thus are valid for all *t* ∈ [*t*_{0}, *t _{f}*]. The bound on

*y*for

*t*∈ [

*t*,

_{j}*t*

_{k}_{+1}) then comes from application of Lemma 1.

*□*

Again, stricter bounds on the approximation errors may be found by assuming exponential stability of the interval correction system.

Corollary 1. *Under the conditions of Theorem 1, if the interval correction system (3) is instead exponentially stable for all points*$x\xaf\u2208Dx$*and their corresponding known trajectories*$h(x\xaf(tk+),t)$*, then the o(1) bounds on the approximation in Theorem 1 are replaced by*$O(\tau \u22121)$*bounds.*

*Proof.* The desired results follow identically to the proof of Theorem 1 by noting that (1) both $\Vert x0(\mu )\u2212x0(0)\Vert =O(\tau \u22121)$ and $\Vert y0(\mu )\u2212y0(0)\Vert =O(\tau \u22121)$ hold since *x*_{0} and *y*_{0} are Lipschitz, (2) the continuous-interval bounds given by Lemma 2 may be used instead of the bounds given by Lemma 1 since the stricter requirement of Eq. (3) being exponentially stable is met here. *□*

Theorem 1 provides a certificate that Eqs. (2) and (3) are good approximations of Eq. (1) as *τ* grows large, with the trajectories of the reduced-order approximations remaining asymptotically close to the trajectories of the full system. Intuitively, the error bounds grow smaller as the update period grows because the continuous-time agent dynamics have more time to reach their equilibrium trajectory, making the reduced-order models more accurate. Corollary 1 then provides stricter bounds on the approximation error by assuming exponential stability instead of asymptotic stability, as in Lemma 2. These results give mathematical rigor to the notion of a separation principle between the continuous-time and discrete-time dynamics, as desired.

## Stability Bounds on Communication Rate

For the purpose of implementation, quantitative bounds on *τ* are desirable that guarantee stability of the hybrid-time system (1). If the reduced-order discrete-time decision system (2) is designed assuming that the continuous-time dynamics are always at their state-dependent equilibrium, then too-frequent updates may lead to instability of the coupled dynamics (1). This is because at the time of the next update, the continuous-time states would not have had a chance to reach their new equilibrium and may in fact have initially moved away from this equilibrium due to nonminimum phase behavior [6, Chap. 6]. This section therefore details an approach to find sufficient lower bounds on *τ* above which the hybrid-time system is guaranteed to be stable under given conditions and using the stability properties of the individual reduced-order models.

subject to $y\u0303(t0)=y(t0)\u2212h(x(t0),t0)$ and valid for all time *t* ≥ *t*_{0}. This collection of states will be denoted in the following by $z\u225c[xT,\u2009y\u0303T]T$.

In order to derive explicit numerical conditions that guarantee stability of Eq. (7), it will be further assumed that

*The vector field f can be written as*$f(x,y\u0303+h(x,t),tk;\mu )=Kx+f\u0303(x,y\u0303,tk;\mu )$

*, where*$K\u2208\mathbb{R}nx\xd7nx$

*and*$f\u0303$

*is bounded over D*

_{x}and D_{y}as*with*$J11,\u2009E11\u2208\mathbb{R}nx\xd7nx,\u2009J12,\u2009E12\u2208\mathbb{R}nx\xd7ny$*, and*$J13,\u2009E13\u2208\mathbb{R}ny\xd7ny$

*The vector field g can be written as*$g(x,y\u0303+h(x,t),t;\mu )\u2212\u2202h(x,t)/\u2202t=Ay\u0303+g\u0303(x,y\u0303,t,\mu )$

*, where*$A\u2208\mathbb{R}ny\xd7ny$

*and*$g\u0303$

*is bounded over D*

_{x}and D_{y}as*with*$E21\u2208\mathbb{R}nx\xd7nx,\u2009E22\u2208\mathbb{R}nx\xd7ny$*, and*$R,\u2009E23\u2208\mathbb{R}ny\xd7ny$

*The jump in the*$y\u0303$

*states after a discrete update,*$\Delta h\u225ch(x(tk\u2212),tk)\u2212h(f(x(tk\u2212),y\u0303(tk\u2212)+h(x(tk\u2212),t),k;\mu ),tk)$

*, is bounded over D*

_{x}and D_{y}as*with*$J21\u2208\mathbb{R}nx\xd7nx,\u2009J22\u2208\mathbb{R}nx\xd7ny$*,* and $J23\u2208\mathbb{R}ny\xd7ny$.

Assumption 3 implies that the discrete *x* dynamics have a zero equilibrium when $y\u0303=0$ and *μ* = 0. This is reasonable as equilibrium of interest can be relocated to zero by a simple coordinate shift [7]. Assumption 4 allows $y\u0303$ to have a stable zero equilibrium when *μ* = 0, while Assumption 5 provides state-dependent bounds on the change in the continuous agent dynamics' state-dependent equilibrium trajectory due to a discrete update. Nonlinearities of these types are standard in the interconnected systems literature and cover a wide class of practical systems including the attitude dynamics of precision-pointing spacecraft [15, Chap. 6] and multimachine power systems [16,17].

With these assumptions in place, the following theorem now gives sufficient conditions under which the error dynamics (7) are stable about the origin. The approach uses the well-known theory of vector Lyapunov functions [18, Chap. 2], which allows stability properties of the isolated subsystems to be leveraged in the analysis by loosening the restrictions on scalar Lyapunov functions for hybrid systems [19].

*For the dynamics (7) under Assumptions 3–5, if for some*$\tau \u22c6=1/\mu \u22c6$

*there are matrices P*

_{1}, P_{2}> 0 and positive scalars d_{ij}, β, γ_{i}, κ_{i}such that the linear matrix inequalities (LMIs)*hold with*

*and*

*and such that*

*where ρ(**⋅**) denotes the spectral radius of a matrix; then the error dynamics (7) are stable about zero for all τ ≥ τ** ^{⋆}*.

*Proof.* The proof follows by construction of a vector Lyapunov function and analysis of the corresponding comparison system. To begin, assume the vector Lyapunov function $U(t)=[V1(t),\u2009V2(t)]T$ (see Ref. [18, Chap. 2], for example) with $V1=xTP1x$ and $V2=y\u0303TP2y\u0303$ and *P _{i}* > 0. Further assume that the LMIs are satisfied for some $\mu LMI\u22c6$. Since

*μ*comes into the LMIs through a positive semidefinite matrix, the LMIs are also satisfied for all $\mu \u2264\mu LMI\u22c6$, or equivalently all $\tau \u22651/\mu LMI\u22c6=\tau LMI\u22c6$.

*V*

_{1}, calculating the derivative for $t\u2208Ik$ yields

*x*only changes at the discrete jumps. Over jumps

*γ*

_{1}≥ 0, since $0\u2264\gamma 1[zTJ1z+\mu zTE1z\u2212\Vert f\u0303\Vert 2]$. Adding and subtracting

*d*

_{11}

*V*

_{1}and

*d*

_{12}

*V*

_{2}, where each

*d*

_{1}

*≥ 0, this can be further arranged as*

_{j}Since Φ ≤ 0, the inequality $V1(tk+)\u2264d11V1(tk\u2212)+d12V2(tk\u2212)$ therefore holds.

*V*

_{2}, the derivative along trajectories for $t\u2208Ik$ satisfy

Thus, $V2(tk+)\u2264d21V1(tk\u2212)+d22V2(tk\u2212)$ holds since Ψ ≤ 0.

*U*(

*t*) has been shown to satisfy

*v*≤

_{i}*u*for all

_{i}*i*. A comparison system for the dynamics is therefore

*u*(

*t*

_{0}) =

*U*(

*t*

_{0}). It follows from Ref. [18, Theorem 2.11] that the stability properties of the zero solution of Eq. (8) imply the corresponding stability properties of the error dynamics (7).

*u*at $t\u2208Ik$ as

*τ*→

*∞*

the condition is feasible if *d*_{11} + *d*_{12}(*κ*_{1}/*κ*_{2}) ≤ 1. Therefore, choosing $\tau \u22c6\u2265\tau LMI\u22c6$ such that $max|\lambda (D\u0303(\tau \u22c6))|\u22641$, and noting that $max|\lambda (D\u0303(\tau ))|$ is monotonic in *τ*, the original system (1) is stable for all $\tau \u2265\tau \u22c6$. *◻*

The results of Theorem 2 yield stability bounds for the hybrid-time system. The matrices in the LMIs are slack matrices that allow a simpler comparison system to be analyzed in the proof instead of the original dynamics. This comparison system is based on Lyapunov functions for the individual continuous-time and discrete-time dynamics. Of course, the acquired bounds may be conservative since they are based on particular Lyapunov functions. However, the outlined approach can be adapted if more information, such as more appropriate Lyapunov functions, are known for the reduced-order models.

## Application

This section presents an application of the paper's main results to the analysis of a distributed network of satellites. Using the approach detailed in Sec. 3, reduced-order models are derived that decouple the satellites' discrete-time leader–follower consensus protocol from their individual continuous-time attitude tracking dynamics when the update rate is slow. A bound on the update rate is then found that guarantees stability for the coupled hybrid-time system using the method of Sec. 4, and it is shown how update rates faster than this bound can cause instability.

Consider a group of satellites communicating intermittently over a network to distributively reach consensus on their attitude as illustrated in Fig. 2, where the *i*th satellite's attitude is represented by the modified Rodrigues parameters (MRPs) $\sigma i\u2208\mathbb{R}3$. Further assume that one satellite, the leader, has knowledge of the desired attitude *σ*_{desired} for the group. A distributed protocol for the *i*th satellite's reference attitude is then provided by the discrete leader–follower dynamics

*j*to agent

*i*in the satellites' undirected communication graph, $G$ [20]. Under appropriate closed-loop control [21, Chap. 8], the

*i*th satellite's attitude error kinematics are described by

where $\sigma \u0302i=\sigma i\u2212\sigma ref,i$, and where $g\u0303i$ accounts for the nonlinear effects of imperfect actuation in the control. This is a tracking controller that stabilizes to $hi(x,t)=[\sigma ref,iT,\u200901\xd73]T$ when *σ*_{ref,}* _{i}* is fixed.

*n*–1 rows of the matrix difference, and $L(G)$ is the satellite communication network's graph Laplacian $L(G)$. The dynamics (9) are of the form Eq. (1) and they satisfy the conditions of Theorem 1. Therefore, as shown in Fig. 3, the corresponding reduced-order models

given by Eqs. (2) and (3), respectively, become good approximations of the true dynamics as the minimum time *τ* between discrete updates increases. Here, the reduced-order decision dynamics for $x\xaf$ describe discrete-time leader–follower dynamics whose behavior is linked to the communication graph's topology.

*τ*that guarantees stability, first rewrite the dynamics (9) in terms of the error states $x\u0303=x\u22121\u2297\sigma desired$ and $y\u0303=y\u2212[(x\u0303+1\u2297\sigma desired)T,0]T$. Using $L(G)1=0$ (see Ref. [20], for example), the error dynamics are then

which is of the form Eq. (7). Now, for the satellite and network parameters defined in Table 1, Assumptions 1 and 3 of Theorem 2 are satisfied with

Parameter | Value |
---|---|

c_{1} | 0.4⋅ 1 |

c_{2} | 1 |

Δ | 0.4 |

$G$ | Barbell graph on 8 nodes |

Parameter | Value |
---|---|

c_{1} | 0.4⋅ 1 |

c_{2} | 1 |

Δ | 0.4 |

$G$ | Barbell graph on 8 nodes |

while Assumption 2 holds by assuming that $R\u2264(0.01)2\u2297I$. The LMIs and spectral radius inequality in Theorem 2 are then satisfied using the constants defined in Table 2, providing the bound $\tau \u22c6=33$ s. As expected, Fig. 4(a) shows that the hybrid-time system is stable when *τ* = 33 s. However, the bound given by any particular combination of parameters that satisfy Theorem 2 may be conservative. For these particular initial conditions, Fig. 4(b) demonstrates that the satellites exhibit unstable oscillations in their attitudes when *τ* = 10 s. In this particular case, the instability is due to a resonance phenomenon where the distributed decisions on new reference attitudes are made when satellites have overshot their previous reference attitudes. For large enough *τ*, however, the satellites' attitudes settle closer to their individual references, which allows the discrete leader–follower consensus protocol to evolve in a stable fashion as designed. This example illustrates the potential danger of too-frequent communication updates even for systems where the discrete network dynamics and continuous agent dynamics are stable when isolated.

Parameter | Value |
---|---|

P_{1} | I |

P_{2} | Solution to P_{2}A + AP_{2} + I = 0 |

d_{11} | 0.9750 |

d_{12} | 28.5469 |

d_{21} | 16.1391 |

d_{22} | 10.0091 |

Β | 310.9920 |

γ_{1} | 43.5036 |

γ_{2} | 3.7445 |

κ_{1} | 4.0752 × 10^{−9} |

κ_{2} | 0.3016 |

$\tau \u22c6$ | 33 s |

Parameter | Value |
---|---|

P_{1} | I |

P_{2} | Solution to P_{2}A + AP_{2} + I = 0 |

d_{11} | 0.9750 |

d_{12} | 28.5469 |

d_{21} | 16.1391 |

d_{22} | 10.0091 |

Β | 310.9920 |

γ_{1} | 43.5036 |

γ_{2} | 3.7445 |

κ_{1} | 4.0752 × 10^{−9} |

κ_{2} | 0.3016 |

$\tau \u22c6$ | 33 s |

## Conclusion

This paper examined the interactions between continuous-time and discrete-time dynamics often found in networked systems. First, a separation principle between the continuous-time agent dynamics and the discrete-time network dynamics was proven as the period between updates of the discrete system grows. Different asymptotic error bounds for the resulting reduced-order models were found based on the stability properties of the isolated continuous-time agent dynamics. Intuitively, these bounds grow tighter for a slower communication rate because the continuous-time system can evolve closer to its state-dependent equilibrium, yielding a more accurate trajectory in the reduced-order models. In the context of networked dynamical systems, this separation principle rigorously justifies the isolated design of discrete-time network dynamics and continuous-time agent dynamics. Next, a method was described for establishing quantitative upper bounds on the update rate below which the coupled hybrid-time system is guaranteed to be stable. The approach uses separate Lyapunov functions for the continuous-time agent dynamics and the discrete-time network dynamics to form a simpler comparison system that establishes stability of the coupled hybrid-time system when the bound is satisfied. When updates occur faster than this bound, however, the system can become unstable even if the decoupled network and agent dynamics are individually stable. This is because the agents no longer have adequate time to approach their reference trajectories before the next update, and may in fact initially diverge from their reference trajectories due to non-minimum phase behavior. An application where satellites intermittently communicate over a network to establish consensus on their attitudes illustrated these results.

## Funding Data

National Science Foundation (CAREER Award No. 155229).

## Nomenclature

- Times and Rates
*t*=_{k}time at the

*k*th update of the discrete-time system, s- $tk+$ =
time immediately following the

*k*th update of the discrete-time system, s- $tk\u2212$ =
time immediately preceding the

*k*th update of the discrete-time system, s*t*_{0}=initial time, s

*μ*=fastest update rate of the discrete-time system, 1/

*τ*, Hz- $\mu \u22c6$ =
sufficient upper bound on the update rate to guarantee stability of the coupled system, $1/\tau \u22c6$, Hz

*τ*=lower-bound on time between updates of the discrete-time system, s

- $\tau \u22c6$ =
sufficient lower-bound on

*τ*to guarantee stability of the coupled system, s

- Full Model Symbols
*D*=_{x}domain of the discrete-time state vector

*x**D*=_{y}domain of the continuous-time state vector

*y**f*=vector field of the discrete-time dynamics, mapping $Dx\xd7Dy\xd7\mathbb{N}\xd7\mathbb{R}+\u2192Dx$

*g*=vector field of the continuous-time dynamics, mapping $Dx\xd7Dy\xd7\mathbb{R}+\xd7\mathbb{R}+\u2192Dy$

*n*=_{x}dimension of the discrete-time state vector

*x**n*=_{y}dimension of the continuous-time state vector

*y**x*=discrete-time state vector of the dynamics

- $x(tk+)$ =
value of the discrete-time state vector

*x*at time $tk+$- $x(tk\u2212)$ =
value of the discrete-time state vector

*x*at time $tk\u2212$*x*_{0}(*μ*) =initial conditions of the discrete-time state vector

*x*, a function of the update rate*μ**y*=continuous-time state vector of the dynamics

- $y\u0303(t)$ =
error between the true continuous-time state vector

*y*(*t*) and the state-dependent equilibrium trajectory $h(x(tk+),t)$, defined for all*t*≥*t*_{0}*y*(*t*) =_{k}the value of the true continuous-state vector

*y*at the discrete-update at time*t*. Note that $y(tk)=y(tk+)=y(tk\u2212)$_{k}- $y\u0303(tk+)$ =
value of the error between the true continuous-time state vector

*y*and the state-dependent equilibrium trajectory $h(x(tk+),t)$ at time $tk+$- $y\u0303(tk\u2212)$ =
value of the error between the true continuous-time state vector

*y*and the state-dependent equilibrium trajectory $h(x(tk\u2212),t)$ at time $tk\u2212$*y*_{0}(*μ*) =initial conditions of the continuous-time state vector

*y*, a function of the update rate*μ**z*=collection of the state vectors

*x*and $y\u0303$

- Reduced Model Symbols
*h*(*p*,*t*) =equilibrium trajectory of the isolated continuous-time dynamics, mapping $(p,t)\u2208Dx\xd7\mathbb{R}+\u2192Dy$

- $Ik$ =
time interval between

*t*(inclusive) and_{k}*t*_{k}_{+1}(exclusive)- $x\xaf$ =
state vector of the reduced-order discrete-time decision system

- $x\xaf(tk+)$ =
value of the reduced-order discrete-time decision system state vector $x\xaf$ at time $tk+$

- $x\xaf(tk\u2212)$ =
value of the reduced-order decision system state vector $x\xaf$ at time $tk\u2212$

- $y\u0302k$ =
state vector of the reduced-order continuous-time interval correction system defined on the interval $Ik$, a function of the elapsed time

*η*within the interval- $y\u0302k(0)$ =
value of the state vector $y\u0302k$ of the

*k*th interval correction system at*η*= 0*η*=elapsed time within the time interval $Ik,\u2009t\u2212tk$