引言

上一篇博客粗略地讲了最优控制中不同情形下泛函取得极值的必要条件。但是那个所谓的“泛函”是比较抽象的，这个博客将会细化这个问题，并且将问题具象化为：如何使用变分法求解最优控制问题。即：最小化
J=φ[x(t1),t1]+∫t0t1L(x,u,t)dtJ=\\varphi\\left[x(t_1),t_1\\right]+\\int_{t_0}^{t_1}{L(x,u,t)}dtJ=φ[x(t1​),t1​]+∫t0​t1​​L(x,u,t)dt
其中，$\phi (\cdot )$是末端状态惩罚项，$u$是控制输入，并且系统要时时刻刻满足微分方程约束 x˙=f(x,t)\\dot{x}=f(x,t)x˙=f(x,t)。

与上一个博客类似，这里还是分几种情况分别叙述。注意：所有的最优控制问题的初始时刻和初始状态都是已知的，这是合理且必须的 (啥时候开始、在哪开始都不知道，还玩个啥…)。

1. 末段时刻固定的最优问题解

这类问题的数学描述为：
u∗=arg min⁡uφ[x(t1)]+∫t)t1L(x,u,t)dts.t.x˙=f(x,u,t),x0=x(t0),ψ[x(t1)]=0\\begin{align} \\begin{aligned} u^* &= \\argmin_{u}{\\varphi\\left[x(t_1)\\right]+\\int_{t_)}^{t_1}{L\\left(x,u,t\\right)}dt}\\\\ & s.t.\\quad\\dot{x}=f(x,u,t),x_0=x(t_0),\\psi\\left[x(t_1)\\right]=0 \\end{aligned} \\end{align} u∗​=uargmin​φ[x(t1​)]+∫t)​t1​​L(x,u,t)dts.t.x˙=f(x,u,t),x0​=x(t0​),ψ[x(t1​)]=0​​​
这实际上是一个带有等式约束的泛函极值的问题。他可以通过引入拉格朗日乘子 $\gamma$ 和 $\lambda (t)$，构造广义泛函 JaJ_aJa​，并定义哈密尔顿函数的方法来解决。

构造广义泛函如下：
Ja=φ(x1)+γψ(x1)+∫t)t1{L(x,u,t)+λ[f(x,u,t−x˙)]}dt\\begin{align} \\begin{aligned} J_a &= \\varphi\\left(x_1\\right)+\\gamma\\psi(x_1)+\\int_{t_)}^{t_1}{\\left\\{L\\left(x,u,t\\right)+\\lambda\\left[f(x,u,t-\\dot{x})\\right]\\right\\}}dt \\end{aligned} \\end{align} Ja​​=φ(x1​)+γψ(x1​)+∫t)​t1​​{L(x,u,t)+λ[f(x,u,t−x˙)]}dt​​​
定义哈密尔顿函数 (Hamiltonian function) 如下：
H(x,u,λ,t)=L(x,u,t)+λf(x,u,t)\\begin{align} \\begin{aligned} H(x,u,\\lambda,t)=L(x,u,t)+\\lambda f(x,u,t) \\end{aligned} \\end{align} H(x,u,λ,t)=L(x,u,t)+λf(x,u,t)​​​
将哈密尔顿函数代入 (2)，并进行一次分部积分有：
Ja=φ(x1)+γψ(x1)+∫t0t1H(x,u,γ,λ)−λx˙dt=φ(x1)+γψ(x1)−λx∣t0t1+∫t0t1H(x,u,γ,λ)+λ˙xdt\\begin{align} \\begin{aligned} J_a &= \\varphi\\left(x_1\\right)+\\gamma\\psi(x_1)+\\int_{t_0}^{t_1}{H(x,u,\\gamma,\\lambda)-\\lambda\\dot{x}}dt\\\\ &=\\varphi\\left(x_1\\right)+\\gamma\\psi(x_1)-\\left.\\lambda x\\right|_{t_0}^{t_1}+\\int_{t_0}^{t_1}{H(x,u,\\gamma,\\lambda)+\\dot{\\lambda}x}dt \\end{aligned} \\end{align} Ja​​=φ(x1​)+γψ(x1​)+∫t0​t1​​H(x,u,γ,λ)−λx˙dt=φ(x1​)+γψ(x1​)−λx∣t0​t1​​+∫t0​t1​​H(x,u,γ,λ)+λ˙xdt​​​
这里需要计算 JaJ_aJa​ 的变分，注意 JaJ_aJa​ 仅仅会受 $\delta x$ 和 $\delta u$ 影响，而不会受 $\lambda$ 和 $\gamma$ 影响。这里推导一次，剩下的都类似~~
Ja(x+δx,u+δu)=φ(x1+δx1)+γψ(x1+δx1)−λ(x+δx)∣t0t1+∫t0t1H(x+δx,u+δu,γ,λ)+λ˙(x+δx)dt\\begin{align} \\begin{aligned} J_a(x+\\delta x,u+\\delta u) &= \\varphi(x_1+\\delta x_1)+\\gamma\\psi(x_1+\\delta x_1)-\\left.\\lambda (x+\\delta x)\\right|_{t_0}^{t_1}\\\\ &+\\int_{t_0}^{t_1}{H(x+\\delta x,u+\\delta u,\\gamma,\\lambda)+\\dot{\\lambda}(x+\\delta x)}dt \\end{aligned} \\end{align} Ja​(x+δx,u+δu)​=φ(x1​+δx1​)+γψ(x1​+δx1​)−λ(x+δx)∣t0​t1​​+∫t0​t1​​H(x+δx,u+δu,γ,λ)+λ˙(x+δx)dt​​​
太长了，写不下，(5) 中第一行记为 Ja1(x+δx,u+δu)=Ja1~J_{a_1}(x+\\delta x,u+\\delta u)=\\tilde{J_{a_1}}Ja1​​(x+δx,u+δu)=Ja1​​~​，第二行记为 Ja2(x+δx,u+δu)=Ja2~J_{a_2}(x+\\delta x,u+\\delta u)=\\tilde{J_{a_2}}Ja2​​(x+δx,u+δu)=Ja2​​~​。则有
Ja1~=φ(x1+δx1)+γψ(x1+δx1)−λx∣t0t1−λ(t1)δx1=φ(x1)+∂φ∂x∣x=x1δx1+γψ(x1)+γ∂ψ∂x∣x=x1δx1\\begin{align} \\begin{aligned} \\tilde{J_{a_1}} &= \\varphi(x_1+\\delta x_1)+\\gamma\\psi(x_1+\\delta x_1)-\\left.\\lambda x\\right|_{t_0}^{t_1}-\\lambda(t_1)\\delta x_1\\\\ &=\\varphi(x_1)+\\left.\\frac{\\partial\\varphi}{\\partial x}\\right|_{x=x_1}\\delta x_1+\\gamma\\psi(x_1)+\\left.\\gamma\\frac{\\partial\\psi}{\\partial x}\\right|_{x=x_1}\\delta x_1 \\end{aligned} \\end{align} Ja1​​~​​=φ(x1​+δx1​)+γψ(x1​+δx1​)−λx∣t0​t1​​−λ(t1​)δx1​=φ(x1​)+∂x∂φ​​x=x1​​δx1​+γψ(x1​)+γ∂x∂ψ​​x=x1​​δx1​​​​
Ja2~=∫t0t1H(x+δx,u+δu,γ,λ)+λ˙(x+δx)dt=∫t0t1H(x,u,γ,λ)+λ˙xdt+∫t0t1∂H∂xδx+∂H∂uδu+λ˙δxdt\\begin{align} \\begin{aligned} \\tilde{J_{a_2}} &= \\int_{t_0}^{t_1}{H(x+\\delta x,u+\\delta u,\\gamma,\\lambda)+\\dot{\\lambda}(x+\\delta x)}dt\\\\ &=\\int_{t_0}^{t_1}{H(x,u,\\gamma,\\lambda)+\\dot{\\lambda}x}dt+\\int_{t_0}^{t_1}{\\frac{\\partial H}{\\partial x}\\delta x+\\frac{\\partial H}{\\partial u}\\delta u +\\dot{\\lambda}\\delta x}dt \\end{aligned} \\end{align} Ja2​​~​​=∫t0​t1​​H(x+δx,u+δu,γ,λ)+λ˙(x+δx)dt=∫t0​t1​​H(x,u,γ,λ)+λ˙xdt+∫t0​t1​​∂x∂H​δx+∂u∂H​δu+λ˙δxdt​​​
则 JaJ_aJa​ 的变分为：
δJa=Ja1~+Ja2~−Ja=[∂φ∂x+γ∂ψ∂x−λ(t1)∣t=t1,x=x1]δx1+∫t0t1[∂H∂x+λ˙]δx+∂H∂uδudt\\begin{align} \\begin{aligned} \\delta J_a&=\\tilde{J_{a_1}}+\\tilde{J_{a_2}}-J_a\\\\ &=\\left[\\left.\\frac{\\partial\\varphi}{\\partial x} + \\gamma\\frac{\\partial\\psi}{\\partial x} - \\lambda(t_1)\\right|_{t=t_1,x=x_1}\\right]\\delta x_1\\\\ &+\\int_{t_0}^{t_1}{\\left[\\frac{\\partial H}{\\partial x}+\\dot{\\lambda}\\right]\\delta x+\\frac{\\partial H}{\\partial u}\\delta u}dt \\end{aligned} \\end{align} δJa​​=Ja1​​~​+Ja2​​~​−Ja​=[∂x∂φ​+γ∂x∂ψ​−λ(t1​)​t=t1​,x=x1​​]δx1​+∫t0​t1​​[∂x∂H​+λ˙]δx+∂u∂H​δudt​​​
很自然地，(8) 若要恒等于零，那么必须有以下必要条件成立
∂H(x∗,u∗,λ∗,t)∂x+λ∗˙(t)=0\\begin{align} \\begin{aligned} \\frac{\\partial H\\left(x^*,u^*,\\lambda^*,t\\right)}{\\partial x}+\\dot{\\lambda^*}(t)=0 \\end{aligned} \\end{align} ∂x∂H(x∗,u∗,λ∗,t)​+λ∗˙(t)=0​​​
∂H(x∗,u∗,λ∗,t)∂u=0\\begin{align} \\begin{aligned} \\frac{\\partial H\\left(x^*,u^*,\\lambda^*,t\\right)}{\\partial u}=0 \\end{aligned} \\end{align} ∂u∂H(x∗,u∗,λ∗,t)​=0​​​
∂φ[x∗(t)]∂x+γ∗∂ψ[x∗(t)]∂x−λ∗(t)∣t=t1=0\\begin{align} \\begin{aligned} \\left.\\frac{\\partial\\varphi\\left[x^*(t)\\right]}{\\partial x} + \\gamma^*\\frac{\\partial\\psi\\left[x^*(t)\\right]}{\\partial x} - \\lambda^*(t)\\right|_{t=t_1}=0 \\end{aligned} \\end{align} ∂x∂φ[x∗(t)]​+γ∗∂x∂ψ[x∗(t)]​−λ∗(t)​t=t1​​=0​​​
同时，根据 (3) 中 哈密尔顿函数的定义，有
x˙∗=f(x∗,u∗,t)=∂H(x∗,u∗,λ∗,t)∂λ\\begin{align} \\begin{aligned} \\dot{x}^*=f\\left(x^*,u^*,t\\right)=\\frac{\\partial H\\left(x^*,u^*,\\lambda^*,t\\right)}{\\partial \\lambda} \\end{aligned} \\end{align} x˙∗=f(x∗,u∗,t)=∂λ∂H(x∗,u∗,λ∗,t)​​​​

1.1 末端时刻固定，末端状态固定的最优控制的必要条件

1. 正则方程：
   λ∗˙(t)=−∂H(x∗,u∗,λ∗,t)∂xx∗˙(t)=∂H(x∗,u∗,λ∗,t)∂λ\\begin{align} \\begin{aligned} & \\dot{\\lambda^*}(t)=-\\frac{\\partial H\\left(x^*,u^*,\\lambda^*,t\\right)}{\\partial x}\\\\ & \\dot{x^*}(t)=\\frac{\\partial H\\left(x^*,u^*,\\lambda^*,t\\right)}{\\partial \\lambda} \\end{aligned} \\end{align} ​λ∗˙(t)=−∂x∂H(x∗,u∗,λ∗,t)​x∗˙(t)=∂λ∂H(x∗,u∗,λ∗,t)​​​​
2. 控制方程
   ∂H(x∗,u∗,λ∗,t)∂u=0\\begin{align} \\begin{aligned} \\frac{\\partial H\\left(x^*,u^*,\\lambda^*,t\\right)}{\\partial u}=0 \\end{aligned} \\end{align} ∂u∂H(x∗,u∗,λ∗,t)​=0​​​
3. 边界条件 ($\\psi $函数没了，$\\delta x_1$ 也没了)
   x∗(t0)=x0,x∗(t1)=x1\\begin{align} \\begin{aligned} x^*(t_0)=x_0,\\quad x^*(t_1)=x_1 \\end{aligned} \\end{align} x∗(t0​)=x0​,x∗(t1​)=x1​​​​

1.2 末段时刻固定，终端状态自由的最优控制的必要条件

1. 正则方程：
   λ∗˙(t)=−∂H(x∗,u∗,λ∗,t)∂xx∗˙(t)=∂H(x∗,u∗,λ∗,t)∂λ\\begin{align} \\begin{aligned} & \\dot{\\lambda^*}(t)=-\\frac{\\partial H\\left(x^*,u^*,\\lambda^*,t\\right)}{\\partial x}\\\\ & \\dot{x^*}(t)=\\frac{\\partial H\\left(x^*,u^*,\\lambda^*,t\\right)}{\\partial \\lambda} \\end{aligned} \\end{align} ​λ∗˙(t)=−∂x∂H(x∗,u∗,λ∗,t)​x∗˙(t)=∂λ∂H(x∗,u∗,λ∗,t)​​​​
2. 控制方程
   ∂H(x∗,u∗,λ∗,t)∂u=0\\begin{align} \\begin{aligned} \\frac{\\partial H\\left(x^*,u^*,\\lambda^*,t\\right)}{\\partial u}=0 \\end{aligned} \\end{align} ∂u∂H(x∗,u∗,λ∗,t)​=0​​​
3. 横截条件 (因为终端状态自由，所以 $\psi$ 那个就没了)
   ∂φ[x∗(t1)]∂x=λ∗(t1)x∗(t0)=x0\\begin{align} \\begin{aligned} &\\frac{\\partial\\varphi\\left[x^*(t_1)\\right]}{\\partial x} = \\lambda^*(t_1)\\\\ &x^*(t_0)=x_0 \\end{aligned} \\end{align} ​∂x∂φ[x∗(t1​)]​=λ∗(t1​)x∗(t0​)=x0​​​​

1.2 末段时刻固定，终端状态受约束的最优控制的必要条件

1. 正则方程：
   λ∗˙(t)=−∂H(x∗,u∗,λ∗,t)∂xx∗˙(t)=∂H(x∗,u∗,λ∗,t)∂λ\\begin{align} \\begin{aligned} & \\dot{\\lambda^*}(t)=-\\frac{\\partial H\\left(x^*,u^*,\\lambda^*,t\\right)}{\\partial x}\\\\ & \\dot{x^*}(t)=\\frac{\\partial H\\left(x^*,u^*,\\lambda^*,t\\right)}{\\partial \\lambda} \\end{aligned} \\end{align} ​λ∗˙(t)=−∂x∂H(x∗,u∗,λ∗,t)​x∗˙(t)=∂λ∂H(x∗,u∗,λ∗,t)​​​​
2. 控制方程
   ∂H(x∗,u∗,λ∗,t)∂u=0\\begin{align} \\begin{aligned} \\frac{\\partial H\\left(x^*,u^*,\\lambda^*,t\\right)}{\\partial u}=0 \\end{aligned} \\end{align} ∂u∂H(x∗,u∗,λ∗,t)​=0​​​
3. 横截条件 (因为终端状态受 $\psi$ 函数约束，所以 $\psi$ 又回来了)
   ∂φ[x∗(t1)]∂x+∂ψ[x∗(t1)]∂xγ∗=λ∗(t1)x∗(t0)=x0,ψ[x∗(t1)]=0\\begin{align} \\begin{aligned} &\\frac{\\partial\\varphi\\left[x^*(t_1)\\right]}{\\partial x}+\\frac{\\partial \\psi\\left[x^*(t_1)\\right]}{\\partial x}\\gamma^* = \\lambda^*(t_1)\\\\ &x^*(t_0)=x_0,\\quad \\psi\\left[x^*(t_1)\\right]=0 \\end{aligned} \\end{align} ​∂x∂φ[x∗(t1​)]​+∂x∂ψ[x∗(t1​)]​γ∗=λ∗(t1​)x∗(t0​)=x0​,ψ[x∗(t1​)]=0​​​

2. 末段时刻自由的最优控制问题解

算了，还是写一遍吧，万一以后我忘了，还能回来查。终端时刻自由比终端时刻固定多了一个终端时刻的变分 δt1\\delta t_1δt1​。
Ja(x+δx,u+δu,t1+δt1)=φ(x1+δx1,t1+δt1)+γψ(x1+δx1,t1+δt1)+∫t0t1+δt1H(x+δx,u+δu,γ,λ)−λ(x˙+δx˙)dt\\begin{align} \\begin{aligned} J_a(x+\\delta x,u+\\delta u,t_1+\\delta t_1)&=\\varphi(x_1+\\delta x_1,t_1+\\delta t_1)+\\gamma\\psi(x_1+\\delta x_1,t_1+\\delta t_1)\\\\ &+\\int_{t_0}^{t_1+\\delta t_1}{H(x+\\delta x,u+\\delta u,\\gamma,\\lambda)-\\lambda(\\dot{x}+\\delta \\dot{x})}dt \\end{aligned} \\end{align} Ja​(x+δx,u+δu,t1​+δt1​)​=φ(x1​+δx1​,t1​+δt1​)+γψ(x1​+δx1​,t1​+δt1​)+∫t0​t1​+δt1​​H(x+δx,u+δu,γ,λ)−λ(x˙+δx˙)dt​​​
同理，令 (19) 中第一行记为 Ja1~\\tilde{J_{a_1}}Ja1​​~​，第二行记为 Ja2~\\tilde{J_{a_2}}Ja2​​~​，则有
δJa1~=φ(x1+δx1,t1+δt1)+γψ(x1+δx1,t1+δt1)=∂φ∂x∣x=x1δx1+∂φ∂t1δt1+γ∂ψ∂x∣x=x1δx1+γ∂ψ∂t1δt1\\begin{align} \\begin{aligned} \\delta\\tilde{J_{a_1}} &= \\varphi(x_1+\\delta x_1,t_1+\\delta t_1)+\\gamma\\psi(x_1+\\delta x_1,t_1+\\delta t_1) \\\\ &= \\left.\\frac{\\partial\\varphi}{\\partial x}\\right|_{x=x_1}\\delta x_1+\\frac{\\partial\\varphi}{\\partial t_1}\\delta t_1+\\gamma\\left.\\frac{\\partial\\psi}{\\partial x}\\right|_{x=x_1}\\delta x_1+\\gamma\\frac{\\partial\\psi}{\\partial t_1}\\delta t_1 \\end{aligned} \\end{align} δJa1​​~​​=φ(x1​+δx1​,t1​+δt1​)+γψ(x1​+δx1​,t1​+δt1​)=∂x∂φ​​x=x1​​δx1​+∂t1​∂φ​δt1​+γ∂x∂ψ​​x=x1​​δx1​+γ∂t1​∂ψ​δt1​​​​
类似地，
δJa2~=∫t0t1+δt1H(x+δx,u+δu,γ,λ)−λ(x˙+δx˙)dt−∫t0t1H(x,u,γ,λ)+λx˙dt=∫t0t1H(x+δx,u+δu,γ,λ)−λ(x˙+δx˙)−H(x,u,γ,λ)−λx˙dt+∫t1t1+δt1H(x+δx,u+δu,γ,λ)−λ(x˙+δx˙)dt=∫t0t1∂H∂xδx+∂H∂uδu−λδx˙dt+[H(x1+θδx1,u+θδu,γ,λ)−λx˙1]δt1=−λδx(t1)+∫t0t1(∂H∂x+λ˙)δx+∂H∂uδudt+[H(x1,u,γ,λ)−λx˙1]δt1\\begin{align} \\begin{aligned} \\delta\\tilde{J_{a_2}} &= \\int_{t_0}^{t_1+\\delta t_1}{H(x+\\delta x,u+\\delta u,\\gamma,\\lambda)-\\lambda(\\dot{x}+\\delta \\dot{x})}dt\\\\ &-\\int_{t_0}^{t_1}{H(x,u,\\gamma,\\lambda)+\\lambda\\dot{x}}dt\\\\ &= \\int_{t_0}^{t_1}{H(x+\\delta x,u+\\delta u,\\gamma,\\lambda)-\\lambda(\\dot{x}+\\delta \\dot{x})-H(x,u,\\gamma,\\lambda)-\\lambda\\dot{x}}dt\\\\ &+\\int_{t_1}^{t_1+\\delta t_1}{H(x+\\delta x,u+\\delta u,\\gamma,\\lambda)-\\lambda(\\dot{x}+\\delta \\dot{x})}dt\\\\ &=\\int_{t_0}^{t_1}{\\frac{\\partial H}{\\partial x}\\delta x+\\frac{\\partial H}{\\partial u}\\delta u-\\lambda\\delta \\dot{x}}dt+\\left[H(x_1+\\theta\\delta x_1,u+\\theta\\delta u,\\gamma,\\lambda)-\\lambda\\dot{x}_1\\right]\\delta t_1\\\\ &=-\\lambda\\delta x(t_1)+\\int_{t_0}^{t_1}{\\left(\\frac{\\partial H}{\\partial x}+\\dot{\\lambda}\\right)\\delta x+\\frac{\\partial H}{\\partial u}\\delta u}dt+\\left[H(x_1,u,\\gamma,\\lambda)-\\lambda\\dot{x}_1\\right]\\delta t_1 \\end{aligned} \\end{align} δJa2​​~​​=∫t0​t1​+δt1​​H(x+δx,u+δu,γ,λ)−λ(x˙+δx˙)dt−∫t0​t1​​H(x,u,γ,λ)+λx˙dt=∫t0​t1​​H(x+δx,u+δu,γ,λ)−λ(x˙+δx˙)−H(x,u,γ,λ)−λx˙dt+∫t1​t1​+δt1​​H(x+δx,u+δu,γ,λ)−λ(x˙+δx˙)dt=∫t0​t1​​∂x∂H​δx+∂u∂H​δu−λδx˙dt+[H(x1​+θδx1​,u+θδu,γ,λ)−λx˙1​]δt1​=−λδx(t1​)+∫t0​t1​​(∂x∂H​+λ˙)δx+∂u∂H​δudt+[H(x1​,u,γ,λ)−λx˙1​]δt1​​​​
这里需要复习一下，上篇博客第二个图对应的近似公式：
δx(t1)=δx1−x˙(t1)⋅δt1\\delta x(t_1)=\\delta x_1-\\dot{x}(t_1)\\cdot\\delta t_1δx(t1​)=δx1​−x˙(t1​)⋅δt1​
把它带入到 (21) 中，进而，
δJa=δJa1~+δJa2~=∂φ∂x∣x=x1δx1+∂φ∂t1δt1+γ∂ψ∂x∣x=x1δx1+γ∂ψ∂t1δt1−λδx1+∫t0t1(∂H∂x+λ˙)δx+∂H∂uδudt+[H(x1,u,γ,λ)−λx˙1]δt1=[∂φ(x1)∂x1+γ∂ψ(x1)∂x1−λ(t1)]δx1+[∂φ(t1)∂t1+γ∂ψ(t1)∂t1+H(t1)]δt1+∫t0t1(∂H∂x+λ˙)δx+∂H∂uδudt\\begin{align} \\begin{aligned} \\delta J_a &= \\delta\\tilde{J_{a_1}}+\\delta\\tilde{J_{a_2}}\\\\ &= \\left.\\frac{\\partial\\varphi}{\\partial x}\\right|_{x=x_1}\\delta x_1+\\frac{\\partial\\varphi}{\\partial t_1}\\delta t_1+\\gamma\\left.\\frac{\\partial\\psi}{\\partial x}\\right|_{x=x_1}\\delta x_1+\\gamma\\frac{\\partial\\psi}{\\partial t_1}\\delta t_1\\\\ &-\\lambda\\delta x_1+\\int_{t_0}^{t_1}{\\left(\\frac{\\partial H}{\\partial x}+\\dot{\\lambda}\\right)\\delta x+\\frac{\\partial H}{\\partial u}\\delta u}dt+\\left[H(x_1,u,\\gamma,\\lambda)-\\lambda\\dot{x}_1\\right]\\delta t_1\\\\ &=\\left[\\frac{\\partial\\varphi(x_1)}{\\partial x_1}+\\gamma\\frac{\\partial\\psi(x_1)}{\\partial x_1}-\\lambda(t_1)\\right]\\delta x_1+\\left[\\frac{\\partial\\varphi(t_1)}{\\partial t_1}+\\gamma\\frac{\\partial\\psi(t_1)}{\\partial t_1}+H(t_1)\\right]\\delta t_1\\\\ &+\\int_{t_0}^{t_1}{\\left(\\frac{\\partial H}{\\partial x}+\\dot{\\lambda}\\right)\\delta x+\\frac{\\partial H}{\\partial u}\\delta u}dt \\end{aligned} \\end{align} δJa​​=δJa1​​~​+δJa2​​~​=∂x∂φ​​x=x1​​δx1​+∂t1​∂φ​δt1​+γ∂x∂ψ​​x=x1​​δx1​+γ∂t1​∂ψ​δt1​−λδx1​+∫t0​t1​​(∂x∂H​+λ˙)δx+∂u∂H​δudt+[H(x1​,u,γ,λ)−λx˙1​]δt1​=[∂x1​∂φ(x1​)​+γ∂x1​∂ψ(x1​)​−λ(t1​)]δx1​+[∂t1​∂φ(t1​)​+γ∂t1​∂ψ(t1​)​+H(t1​)]δt1​+∫t0​t1​​(∂x∂H​+λ˙)δx+∂u∂H​δudt​​​
与之前同理，若要实现最优控制，那么两部分变分必须都恒为零才行。下边分别讨论