tKgddlZddlZddlZddlZddlmZmZmZddlm Z m Z m Z m Z m Z mZddlZddlZddlmZddlmZddlmZddlmZmZgd ZGd d eZd Zd ZdZdZ e!djEdjEZ#dZ$ d9dZ%e$e% d:dZ&GddZ'GddZ(GddZ)dZ*Gdde(Z+Gdd Z,d!jEe#d"<Gd#d$e+Z-Gd%d&e-Z.Gd'd(e+Z/Gd)d*e+Z0Gd+d,e+Z1Gd-d.e+Z2Gd/d0e(Z3d1Z4e4d2e-Z5e4d3e.Z6e4d4e/Z7e4d5e1Z8e4d6e0Z9e4d7e2Z:e4d8e3Z;y);N)asarraydotvdot)normsolveinvqrsvd LinAlgError)get_blas_funcs)copy_if_needed)getfullargspec_no_self)scalar_search_wolfe1scalar_search_armijo) broyden1broyden2anderson linearmixing diagbroydenexcitingmixing newton_krylov BroydenFirstKrylovJacobianInverseJacobian NoConvergenceceZdZdZy)rz\Exception raised when nonlinear solver fails to converge within the specified `maxiter`.N)__name__ __module__ __qualname____doc__Z/home/alanp/www/video.onchill/myenv/lib/python3.12/site-packages/scipy/optimize/_nonlin.pyrrs r#rcHtj|jSN)npabsolutemaxxs r$maxnormr,$s ;;q>   r#ct|}tj|jtjst|tj S|S)z:Return `x` as an array, of either floats or complex floatsdtype)rr' issubdtyper/inexactfloat64r*s r$ _as_inexactr3(s7 A =="** -q ++ Hr#ctj|tj|}t|d|j}||S)z;Return ndarray `x` as same array subclass and shape as `x0`__array_wrap__)r'reshapeshapegetattrr5)r+x0wraps r$ _array_liker;0s8 1bhhrl#A 2')9)9 :D 7Nr#ctj|js#tjtjSt |Sr&)r'isfiniteallarrayinfr)vs r$ _safe_normrB7s2 ;;q>   xx 7Nr#z F : function(x) -> f Function whose root to find; should take and return an array-like object. xin : array_like Initial guess for the solution a iter : int, optional Number of iterations to make. If omitted (default), make as many as required to meet tolerances. verbose : bool, optional Print status to stdout on every iteration. maxiter : int, optional Maximum number of iterations to make. If more are needed to meet convergence, `NoConvergence` is raised. f_tol : float, optional Absolute tolerance (in max-norm) for the residual. If omitted, default is 6e-6. f_rtol : float, optional Relative tolerance for the residual. If omitted, not used. x_tol : float, optional Absolute minimum step size, as determined from the Jacobian approximation. If the step size is smaller than this, optimization is terminated as successful. If omitted, not used. x_rtol : float, optional Relative minimum step size. If omitted, not used. tol_norm : function(vector) -> scalar, optional Norm to use in convergence check. Default is the maximum norm. line_search : {None, 'armijo' (default), 'wolfe'}, optional Which type of a line search to use to determine the step size in the direction given by the Jacobian approximation. Defaults to 'armijo'. callback : function, optional Optional callback function. It is called on every iteration as ``callback(x, f)`` where `x` is the current solution and `f` the corresponding residual. Returns ------- sol : ndarray An array (of similar array type as `x0`) containing the final solution. Raises ------ NoConvergence When a solution was not found. ) params_basic params_extracN|jr|jtz|_yyr&)r! _doc_parts)objs r$_set_docrHus {{kkJ. r#c | tn| } t|||| || }tfd}j}t j |tj }||}t|}t|}|j|j|||||dz}nd|jdzz}| durd} n| durd} | d vr td d }d }d }d}t|D]C}|j|||}|rnDt|||z}|j!|| }t|dk(r td| rt#||||| \}}}}nd}||z}||}t|}|j%|j|| r | ||||dzz|dzz }||dzz|kr t||}nt|t'|||dzz}|}|st(j*j-d|| ||fzt(j*j/F|rt1t3|d}| r)|j4|||dk(ddd|d}t3||fSt3|S)a Find a root of a function, in a way suitable for large-scale problems. Parameters ---------- %(params_basic)s jacobian : Jacobian A Jacobian approximation: `Jacobian` object or something that `asjacobian` can transform to one. Alternatively, a string specifying which of the builtin Jacobian approximations to use: krylov, broyden1, broyden2, anderson diagbroyden, linearmixing, excitingmixing %(params_extra)s full_output : bool If true, returns a dictionary `info` containing convergence information. raise_exception : bool If True, a `NoConvergence` exception is raise if no solution is found. See Also -------- asjacobian, Jacobian Notes ----- This algorithm implements the inexact Newton method, with backtracking or full line searches. Several Jacobian approximations are available, including Krylov and Quasi-Newton methods. References ---------- .. [KIM] C. T. Kelley, "Iterative Methods for Linear and Nonlinear Equations". Society for Industrial and Applied Mathematics. (1995) https://archive.siam.org/books/kelley/fr16/ N)f_tolf_rtolx_tolx_rtoliterrcVtt|jSr&)r3r;flatten)zFr9s r$funcznonlin_solve..funcs#1[B/0199;;r#rdTarmijoF)NrUwolfezInvalid line searchg?gH.?g?gMbP?)tolrz[Jacobian inversion yielded zero vector. This indicates a bug in the Jacobian approximation.?z%d: |F(x)| = %g; step %g z0A solution was found at the specified tolerance.z:The maximum number of iterations allowed has been reached.)rrY)nitfunstatussuccessmessage)r,TerminationConditionr3rPr' full_liker@r asjacobiansetupcopysize ValueErrorrangecheckminr_nonlin_line_searchupdater)sysstdoutwriteflushrr; iteration) rRr9jacobianrNverbosemaxiterrJrKrLrMtol_norm line_searchcallback full_outputraise_exception conditionrSr+dxFxFx_normgammaeta_max eta_tresholdetanr\rWs Fx_norm_neweta_Ainfos `` r$ nonlin_solverzsZ#*wH$5+0*.X?I RB< A a B aB2hG(#H NN1668R&  QhG166!8nGd   33.// EGL C 7^Q+  #s7{#nnRSn) ) 8q=./ / $7aR8C%E !Aq"kABAaBr(K"%  QO Q&!3 36>L (gu%Cgs5%Q,78C  JJ  :8B<>$$ % JJ   UX  Ar 23 3F ** !Q; , 3% & 1b!4''1b!!r#cl dg|gt|dzgttz d fd  fd}|dk(rt |dd|\}} } n|dk(rt dd | \}} d }|zz|dk(rd}n}t|} ||| fS) NrrYc| dk(rdS |zz}|}t|dz}|r| d<|d<|d<|S)NrrY)rB) rstorextrApryrStmp_Fxtmp_phitmp_sr+s r$phiz _nonlin_line_search..phis_ a=1:  2X H qM1  E!HGAJF1Ir#c^t|zdzz}||zd|z |z S)NrF)r)abs)rdsrrdiffs_norms r$derphiz#_nonlin_line_search..derphi#s9!fvo!U *AbD&Q/255r#rV{Gz?)xtolaminrU)rrX)T)rrr)rSr+rzry search_typersminrrphi1phi0r{rrrrrs`` ` ` @@@@@r$riris CETFBx{mG !WtBx F  6g,S&'!*26TC 4  &sGAJ ,024 y  AbDAE!H} AY !W2hG aW r#c*eZdZdZdddddefdZdZy)r_z Termination condition for an iteration. It is terminated if - |F| < f_rtol*|F_0|, AND - |F| < f_tol AND - |dx| < x_rtol*|x|, AND - |dx| < x_tol NcD|0tjtjjdz}|tj}|tj}|tj}||_||_||_||_||_ ||_ d|_ d|_ y)NgUUUUUU?r) r'finfor2epsr@rLrMrJrKrrNf0_normro)selfrJrKrLrMrNrs r$__init__zTerminationCondition.__init__Js =HHRZZ(,,6E >VVF =FFE >VVF       r#c|xjdz c_|j|}|j|}|j|}|j||_|dk(ry|jd|j|jkDzSt ||j kxr||j z |jkxr#||jkxr||jz |kS)NrrrY) rorrrNintrJrKrLrM)rfr+ryf_normx_normdx_norms r$rgzTerminationCondition.checkbs !11))B- << !DL Q; 99 23 3Fdjj(;t{{*dll:;4::-:#DKK/69< .__array__s'$$'A%%IJJ||~%r#NN)itemsresetattrhasattr)rkwnamesnamevaluers r$rzJacobian.__init__sb888:KD%5  !>!EFF dBtH- & 4 # & $r#ct|Sr&)rrs r$aspreconditionerzJacobian.aspreconditioners t$$r#ctr&NotImplementedErrorrrArWs r$rzJacobian.solve!!r#cyr&r"rr+rRs r$rjzJacobian.update r#c||_|j|jf|_|j|_|jj t j ur|j||yyr&)rSrdr7r/ __class__rbrrjrr+rRrSs r$rbzJacobian.setupsQ ffaff% WW >>  8>> 1 KK1  2r#Nr) rrr r!rrrrjrbr"r#r$rr}s!#J& %" r#rc2eZdZdZedZedZy)rc||_|j|_|j|_t |dr|j |_t |dr|j |_yy)Nrbr)rprrrjrrbrr)rrps r$rzInverseJacobian.__init__sN  nn oo 8W %!DJ 8X &#??DL 'r#c.|jjSr&)rpr7rs r$r7zInverseJacobian.shape}}"""r#c.|jjSr&)rpr/rs r$r/zInverseJacobian.dtyperr#N)rrr rpropertyr7r/r"r#r$rrs/+####r#rc 0tjjjt t rSt jrtt rSt tjrjdkDr tdtjtjjdjdk7r tdt fdfddfd dfd j j Stjj#r_jdjdk7r td t fd fd dfd dfd j j St%dr{t%drot%drct t'dt'dj(t'dt'dt'dj jSt+rGfddt }|St t,r6t/t0t2t4t6t8t:t<St?d)zE Convert given object to one suitable for use as a Jacobian. rYzarray must have rank <= 2rrzarray must be squarect|Sr&)rrAJs r$zasjacobian..s Qr#cLtjj|Sr&)rconjTrs r$rzasjacobian..s#affhjj!*.s uQ{r#cLtjj|Sr&)rrrrs r$rzasjacobian..saffhjj!0Dr#)rrrrr/r7zmatrix must be squarec|zSr&r"rs r$rzasjacobian..s Qr#c>jj|zSr&rrrs r$rzasjacobian..s!&&(**q.r#c|Sr&r"rArWrspsolves r$rzasjacobian..s wq!}r#cFjj|Sr&rrs r$rzasjacobian..s A0Fr#r7r/rrrrrjrb)rrrrrjrbr/r7cDeZdZdZdfd ZfdZdfd ZfdZy)asjacobian..Jacc||_yr&r*rs r$rjzasjacobian..Jac.updates r#c|j}t|tjr t ||St j j|r ||StdNzUnknown matrix type) r+ isinstancer'ndarrayrscipysparseissparsererrArWmrrs r$rzasjacobian..Jac.solvesTdffIa, A;&\\**1-"1a=($%:;;r#c|j}t|tjr t ||St j j|r||zStdr) r+rr'rrrrrrerrArrs r$rzasjacobian..Jac.matvec sQdffIa,q!9$\\**1-q5L$%:;;r#c:|j}t|tjr$t |j j |Stjj|r!|j j |Stdr) r+rr'rrrrrrrrers r$rzasjacobian..Jac.rsolvesjdffIa, Q//\\**1-"1668::q11$%:;;r#c2|j}t|tjr$t |j j |Stjj|r|j j |zStdr) r+rr'rrrrrrrrers r$rzasjacobian..Jac.rmatvecsgdffIa,qvvxzz1--\\**1-668::>)$%:;;r#Nr)rrr rjrrrr)rrsr$Jacrs  < < < >r#ceZdZdZdZdZy)GenericBroydenctj||||||_||_t |drC|j 6t |}|r!dtt |dz|z |_yd|_yyy)Nalpha?rrX)rrblast_flast_xrrrr))rr9f0rSnormf0s r$rbzGenericBroyden.setup9sntRT*  4 !djj&8"XF T"Xq!11F:   '9 !r#ctr&rrr+rrydfrdf_norms r$_updatezGenericBroyden._updateGrr#c ||jz }||jz }|j||||t|t|||_||_yr&)rr rr)rr+rrrys r$rjzGenericBroyden.updateJsH _ _ Q2r48T"X6  r#N)rrr rbrrjr"r#r$rr8s !"r#rczeZdZdZdZedZedZdZdZ ddZ ddZ d Z dd Z d Zd ZdZddZy ) LowRankMatrixz A matrix represented as .. math:: \alpha I + \sum_{n=0}^{n=M} c_n d_n^\dagger However, if the rank of the matrix reaches the dimension of the vectors, full matrix representation will be used thereon. cX||_g|_g|_||_||_d|_yr&)rcsrrr/ collapsed)rrrr/s r$rzLowRankMatrix.__init__]s,  r#ctgd|dd|gz\}}}||z}t||D]#\}} || |} ||||j| }%|S)N)axpyscaldotcr)r ziprd) rArrrrrrwcdas r$_matveczLowRankMatrix._matvecesh)*B*,Ra&A3,8dD AIBKDAqQ AQ1661%A r#c Jt|dk(r||z Stddg|dd|gz\}}|d}|tjt||jz}t |D].\}} t |D]\} } ||| fxx|| | z cc<0tj t||j} t |D]\} } || || | <| |z} t|| } ||z } t|| D]\} }|| | | j| } | S)Evaluate w = M^-1 vrrrNrr.) lenr r'identityr/ enumeratezerosrrrd)rArrrrrc0Airjrqrqcs r$_solvezLowRankMatrix._solveos& r7a<U7N$VV$4b!fslC d U BKKBrxx8 8bMDAq!" 1!A#$q!*$&" HHSWBHH -bMDAq1:AaD" U  !QK eGQZEArQ166B3'A r#c|j tj|j|Stj ||j |j |jS)zEvaluate w = M v)rr'rrr rrrrrAs r$rzLowRankMatrix.matvecsD >> %66$..!, ,$$Q DGGTWWEEr#c|j8tj|jjj |St j |tj|j|j|jS)zEvaluate w = M^H v) rr'rrrrr rrrr/s r$rzLowRankMatrix.rmatvecs\ >> %66$..**//115 5$$Q (;TWWdggNNr#c|jt|j|Stj||j|j |j S)r")rrrr-rrrrs r$rzLowRankMatrix.solves@ >> %+ +##Atzz477DGGDDr#c|j.t|jjj|Stj |t j|j|j|jS)zEvaluate w = M^-H v) rrrrrr-r'rrrrs r$rzLowRankMatrix.rsolvesX >> %))..0!4 4##Arwwtzz':DGGTWWMMr#cX|j5|xj|dddf|dddfjzz c_y|jj||jj|t |j|j kDr|jyyr&)rrrappendrr#rdcollapse)rrrs r$r4zLowRankMatrix.appends{ >> % NNa$i!DF)..*:: :N  q q tww~O%& (   MM99=nN%& ( >> %>> ! ZZ DFF$**= =)DAq !AdF)Ad1fINN,, ,B* r#cntj|t|_d|_d|_d|_y)z0Collapse the low-rank matrix to a full-rank one.)rcN)r'r?r rrrrrs r$r5zLowRankMatrix.collapses)$^< r#c|jy|dkDsJt|j|kDr|jdd=|jdd=yy)zH Reduce the rank of the matrix by dropping all vectors. Nrrr#rrrranks r$restart_reducezLowRankMatrix.restart_reducesG >> % axx tww<$    r#c|jy|dkDsJt|j|kDr4|jd=|jd=t|j|kDr3yy)zK Reduce the rank of the matrix by dropping oldest vectors. Nrr>r?s r$ simple_reducezLowRankMatrix.simple_reducesT >> % axx$''lT!  $''lT!r#c|jy|}||}n|dz }|jr"t|t|jd}t dt||dz }t|j}||kryt j |jj}t j |jj}t|d\}}t||jj}t|d\} } } t|t| }t|| jj}t|D]J} |dd| fj|j| <|dd| fj|j| <L|j|d=|j|d=y) a Reduce the rank of the matrix by retaining some SVD components. This corresponds to the "Broyden Rank Reduction Inverse" algorithm described in [1]_. Note that the SVD decomposition can be done by solving only a problem whose size is the effective rank of this matrix, which is viable even for large problems. Parameters ---------- max_rank : int Maximum rank of this matrix after reduction. to_retain : int, optional Number of SVD components to retain when reduction is done (ie. rank > max_rank). Default is ``max_rank - 2``. References ---------- .. [1] B.A. van der Rotten, PhD thesis, "A limited memory Broyden method to solve high-dimensional systems of nonlinear equations". Mathematisch Instituut, Universiteit Leiden, The Netherlands (2003). https://web.archive.org/web/20161022015821/http://www.math.leidenuniv.nl/scripties/Rotten.pdf NrYrreconomic)modeF) full_matrices)rrrhr#r)r'r?rrr rrr rrfrc) rmax_rank to_retainrr+rCDRUSWHks r$ svd_reducezLowRankMatrix.svd_reducesc: >> %    AAA 77As4771:'A 3q!A#;  L q5  HHTWW    HHTWW   !*%1 13388: q.1b 3r7O 24499; qA1Q3DGGAJ1Q3DGGAJ GGABK GGABKr#rrr&)rrr r!r staticmethodr r-rrrrr4rr5rArCrQr"r#r$rrRsj6F O E N "  ?r#ra alpha : float, optional Initial guess for the Jacobian is ``(-1/alpha)``. reduction_method : str or tuple, optional Method used in ensuring that the rank of the Broyden matrix stays low. Can either be a string giving the name of the method, or a tuple of the form ``(method, param1, param2, ...)`` that gives the name of the method and values for additional parameters. Methods available: - ``restart``: drop all matrix columns. Has no extra parameters. - ``simple``: drop oldest matrix column. Has no extra parameters. - ``svd``: keep only the most significant SVD components. Takes an extra parameter, ``to_retain``, which determines the number of SVD components to retain when rank reduction is done. Default is ``max_rank - 2``. max_rank : int, optional Maximum rank for the Broyden matrix. Default is infinity (i.e., no rank reduction). broyden_paramscFeZdZdZd dZdZdZd dZdZd dZ d Z d Z y) ra Find a root of a function, using Broyden's first Jacobian approximation. This method is also known as \"Broyden's good method\". Parameters ---------- %(params_basic)s %(broyden_params)s %(params_extra)s See Also -------- root : Interface to root finding algorithms for multivariate functions. See ``method='broyden1'`` in particular. Notes ----- This algorithm implements the inverse Jacobian Quasi-Newton update .. math:: H_+ = H + (dx - H df) dx^\dagger H / ( dx^\dagger H df) which corresponds to Broyden's first Jacobian update .. math:: J_+ = J + (df - J dx) dx^\dagger / dx^\dagger dx References ---------- .. [1] B.A. van der Rotten, PhD thesis, \"A limited memory Broyden method to solve high-dimensional systems of nonlinear equations\". Mathematisch Instituut, Universiteit Leiden, The Netherlands (2003). https://web.archive.org/web/20161022015821/http://www.math.leidenuniv.nl/scripties/Rotten.pdf Examples -------- The following functions define a system of nonlinear equations >>> def fun(x): ... return [x[0] + 0.5 * (x[0] - x[1])**3 - 1.0, ... 0.5 * (x[1] - x[0])**3 + x[1]] A solution can be obtained as follows. >>> from scipy import optimize >>> sol = optimize.broyden1(fun, [0, 0]) >>> sol array([0.84116396, 0.15883641]) NcLtj|_d_|tj }|_t|trdn |dd|d}|dz fz|dk(r fd_ y|dk(r fd_ y|dk(r fd _ ytd |z) Nr"rrr c6jjSr&)r;rQ reduce_paramsrsr$rz'BroydenFirst.__init__..}s#5477#5#5}#Er#simplec6jjSr&)r;rCrWsr$rz'BroydenFirst.__init__..s#8477#8#8-#Hr#restartc6jjSr&)r;rArWsr$rz'BroydenFirst.__init__..s#9477#9#9=#Ir#z"Unknown rank reduction method '%s') rrrr;r'r@rHrr_reducere)rrreduction_methodrHrXs` @r$rzBroydenFirst.__init__ls%   vvH  & ,M,QR0M/2 !A-7 u $EDL  )HDL  *IDLA-./ /r#ctj||||t|j |jd|j |_y)Nr)rrbrrr7r/r;rs r$rbzBroydenFirst.setups8T1a. TZZ]DJJGr#c,t|jSr&)rr;rs r$rzBroydenFirst.todenses477|r#c|jj|}tj|j sL|j |j |j|j|jj|S|Sr&) r;rr'r=r>rbr rrS)rrrWrs r$rzBroydenFirst.solves\ GGNN1 {{1~!!# JJt{{DKK ;77>>!$ $r#c8|jj|Sr&)r;rrrs r$rzBroydenFirst.matvecsww}}Qr#c8|jj|Sr&)r;rrrrWs r$rzBroydenFirst.rsolveswwq!!r#c8|jj|Sr&)r;rrds r$rzBroydenFirst.rmatvecsww~~a  r#c|j|jj|}||jj|z }|t ||z } |jj || yr&)r]r;rrrr4 rr+rryrrrrArrs r$rzBroydenFirst._updatesU  GGOOB  # # R O q!r#)Nr[Nr) rrr r!rrbrrrrrrr"r#r$rr6s13j/4H "!r#rceZdZdZdZy)raK Find a root of a function, using Broyden's second Jacobian approximation. This method is also known as "Broyden's bad method". Parameters ---------- %(params_basic)s %(broyden_params)s %(params_extra)s See Also -------- root : Interface to root finding algorithms for multivariate functions. See ``method='broyden2'`` in particular. Notes ----- This algorithm implements the inverse Jacobian Quasi-Newton update .. math:: H_+ = H + (dx - H df) df^\dagger / ( df^\dagger df) corresponding to Broyden's second method. References ---------- .. [1] B.A. van der Rotten, PhD thesis, "A limited memory Broyden method to solve high-dimensional systems of nonlinear equations". Mathematisch Instituut, Universiteit Leiden, The Netherlands (2003). https://web.archive.org/web/20161022015821/http://www.math.leidenuniv.nl/scripties/Rotten.pdf Examples -------- The following functions define a system of nonlinear equations >>> def fun(x): ... return [x[0] + 0.5 * (x[0] - x[1])**3 - 1.0, ... 0.5 * (x[1] - x[0])**3 + x[1]] A solution can be obtained as follows. >>> from scipy import optimize >>> sol = optimize.broyden2(fun, [0, 0]) >>> sol array([0.84116365, 0.15883529]) c|j|}||jj|z }||dzz } |jj|| yNrY)r]r;rr4ris r$rzBroydenSecond._updatesF   # #  N q!r#N)rrr r!rr"r#r$rrs 0dr#rc,eZdZdZddZddZdZdZy) ra Find a root of a function, using (extended) Anderson mixing. The Jacobian is formed by for a 'best' solution in the space spanned by last `M` vectors. As a result, only a MxM matrix inversions and MxN multiplications are required. [Ey]_ Parameters ---------- %(params_basic)s alpha : float, optional Initial guess for the Jacobian is (-1/alpha). M : float, optional Number of previous vectors to retain. Defaults to 5. w0 : float, optional Regularization parameter for numerical stability. Compared to unity, good values of the order of 0.01. %(params_extra)s See Also -------- root : Interface to root finding algorithms for multivariate functions. See ``method='anderson'`` in particular. References ---------- .. [Ey] V. Eyert, J. Comp. Phys., 124, 271 (1996). Examples -------- The following functions define a system of nonlinear equations >>> def fun(x): ... return [x[0] + 0.5 * (x[0] - x[1])**3 - 1.0, ... 0.5 * (x[1] - x[0])**3 + x[1]] A solution can be obtained as follows. >>> from scipy import optimize >>> sol = optimize.anderson(fun, [0, 0]) >>> sol array([0.84116588, 0.15883789]) Nctj|||_||_g|_g|_d|_||_yr&)rrrMryrr|w0)rrrpros r$rzAnderson.__init__/s:%  r#c|j |z}t|j}|dk(r|Stj||j }t |D]}t|j||||<  t|j|}t |D]7}||||j||j|j|zzzz }9|S#t$r#|jdd=|jdd=|cYSwxYwNrr.) rr#ryr'emptyr/rfrrrrr ) rrrWryrdf_frPr|rs r$rzAnderson.solve8sjj[] L 6Ixx)qA4771:q)DG $&&$'EqA %(DGGAJDGGAJ)>>? ?B    I  s;C)DDc B| |jz }t|j}|dk(r|Stj||j }t |D]}t|j||||< tj||f|j }t |D]}t |D]}t|j||j||||f<||k(s4|jdk7sD|||fxxt|j||j||jdzz|jzzcc<t||} t |D]7} || | |j| |j| |jz zzz }9|S)Nrr.rY) rr#ryr'rsr/rfrrrpr) rrryrrtrPbr)r*r|rs r$rzAnderson.matvecOs_R ] L 6Ixx)qA4771:q)DG HHaV177 +qA1Xdggaj$''!*5!A#6dgglacFd4771:twwqz:477A:EdjjPPF aqA %(DGGAJDJJ)>>? ?B r#c8|jdk(ry|jj||jj|t |j|jkDrY|jj d|jj dt |j|jkDrYt |j}t j||f|j}t|D][} t| |D]J} | | k(r|jdz} nd} d| zt|j| |j| z|| | f<L]|t j|djjz }||_y)Nrr.rYr)roryr4rr#popr'r&r/rfrprtriurrr) rr+rryrrrrrr)r*wds r$rzAnderson._updatefs- 66Q;  r r$''lTVV# GGKKN GGKKN$''lTVV# L HHaV177 +qA1a[6!BBB$TWWQZ <<!A# ! RWWQ]__ ! ! ##r#)Nrr)rrr r!rrrrr"r#r$rrs+L..r#rcFeZdZdZd dZdZd dZdZd dZdZ d Z d Z y) ra, Find a root of a function, using diagonal Broyden Jacobian approximation. The Jacobian approximation is derived from previous iterations, by retaining only the diagonal of Broyden matrices. .. warning:: This algorithm may be useful for specific problems, but whether it will work may depend strongly on the problem. Parameters ---------- %(params_basic)s alpha : float, optional Initial guess for the Jacobian is (-1/alpha). %(params_extra)s See Also -------- root : Interface to root finding algorithms for multivariate functions. See ``method='diagbroyden'`` in particular. Examples -------- The following functions define a system of nonlinear equations >>> def fun(x): ... return [x[0] + 0.5 * (x[0] - x[1])**3 - 1.0, ... 0.5 * (x[1] - x[0])**3 + x[1]] A solution can be obtained as follows. >>> from scipy import optimize >>> sol = optimize.diagbroyden(fun, [0, 0]) >>> sol array([0.84116403, 0.15883384]) Nc<tj|||_yr&rrrrrs r$rzDiagBroyden.__init__% r#ctj||||tj|jdfd|j z |j |_y)Nrrr.)rrbr'fullr7rr/rrs r$rbzDiagBroyden.setupsAT1a.$**Q-)1tzz>Lr#c"| |jz Sr&rrfs r$rzDiagBroyden.solverDFF{r#c"| |jzSr&rrds r$rzDiagBroyden.matvecrr#c>| |jjz Sr&rrrfs r$rzDiagBroyden.rsolverDFFKKM!!r#c>| |jjzSr&rrds r$rzDiagBroyden.rmatvecrr#cBtj|j Sr&)r'diagrrs r$rzDiagBroyden.todenseswwwr#c`|xj||j|zz|z|dzz zc_yrlrr s r$rzDiagBroyden._updates* 2r >2%gqj00r#r&r rrr r!rrbrrrrrrr"r#r$rrs1&PM"" 1r#rc@eZdZdZd dZd dZdZd dZdZdZ d Z y) ra Find a root of a function, using a scalar Jacobian approximation. .. warning:: This algorithm may be useful for specific problems, but whether it will work may depend strongly on the problem. Parameters ---------- %(params_basic)s alpha : float, optional The Jacobian approximation is (-1/alpha). %(params_extra)s See Also -------- root : Interface to root finding algorithms for multivariate functions. See ``method='linearmixing'`` in particular. Nc<tj|||_yr&r~rs r$rzLinearMixing.__init__rr#c"| |jzSr&rrfs r$rzLinearMixing.solver$**}r#c"| |jz Sr&rrds r$rzLinearMixing.matvecrr#cH| tj|jzSr&r'rrrfs r$rzLinearMixing.rsolver"''$**%%%r#cH| tj|jz Sr&rrds r$rzLinearMixing.rmatvecrr#ctjtj|jdd|jz S)Nr)r'rrr7rrs r$rzLinearMixing.todenses,wwrwwtzz!}bm<==r#cyr&r"r s r$rzLinearMixing._updaterr#r&r) rrr r!rrrrrrrr"r#r$rrs*,&&> r#rcFeZdZdZd dZdZd dZdZd dZdZ d Z d Z y) ra Find a root of a function, using a tuned diagonal Jacobian approximation. The Jacobian matrix is diagonal and is tuned on each iteration. .. warning:: This algorithm may be useful for specific problems, but whether it will work may depend strongly on the problem. See Also -------- root : Interface to root finding algorithms for multivariate functions. See ``method='excitingmixing'`` in particular. Parameters ---------- %(params_basic)s alpha : float, optional Initial Jacobian approximation is (-1/alpha). alphamax : float, optional The entries of the diagonal Jacobian are kept in the range ``[alpha, alphamax]``. %(params_extra)s NcXtj|||_||_d|_yr&)rrralphamaxbeta)rrrs r$rzExcitingMixing.__init__s%%    r#ctj||||tj|jdf|j |j |_yrr)rrbr'rr7rr/rrs r$rbzExcitingMixing.setups=T1a.GGTZZ],djj K r#c"| |jzSr&rrfs r$rzExcitingMixing.solver$))|r#c"| |jz Sr&rrds r$rzExcitingMixing.matvecrr#c>| |jjzSr&rrrfs r$rzExcitingMixing.rsolve!r$)).."""r#c>| |jjz Sr&rrds r$rzExcitingMixing.rmatvec$rr#cFtjd|jz S)Nr)r'rrrs r$rzExcitingMixing.todense'swwr$))|$$r#c ||jzdkD}|j|xx|jz cc<|j|j|<tj|jd|j |jy)Nr)out)rrrr'clipr)rr+rryrrrincrs r$rzExcitingMixing._update*s\}q  $4::%:: 4%  1dmm;r#)NrXrrr"r#r$rrs04 L##%>> from scipy.optimize import BroydenFirst, KrylovJacobian >>> from scipy.optimize import InverseJacobian >>> jac = BroydenFirst() >>> kjac = KrylovJacobian(inner_M=InverseJacobian(jac)) If the preconditioner has a method named 'update', it will be called as ``update(x, f)`` after each nonlinear step, with ``x`` giving the current point, and ``f`` the current function value. outer_k : int, optional Size of the subspace kept across LGMRES nonlinear iterations. See `scipy.sparse.linalg.lgmres` for details. inner_kwargs : kwargs Keyword parameters for the "inner" Krylov solver (defined with `method`). Parameter names must start with the `inner_` prefix which will be stripped before passing on the inner method. See, e.g., `scipy.sparse.linalg.gmres` for details. %(params_extra)s See Also -------- root : Interface to root finding algorithms for multivariate functions. See ``method='krylov'`` in particular. scipy.sparse.linalg.gmres scipy.sparse.linalg.lgmres Notes ----- This function implements a Newton-Krylov solver. The basic idea is to compute the inverse of the Jacobian with an iterative Krylov method. These methods require only evaluating the Jacobian-vector products, which are conveniently approximated by a finite difference: .. math:: J v \approx (f(x + \omega*v/|v|) - f(x)) / \omega Due to the use of iterative matrix inverses, these methods can deal with large nonlinear problems. SciPy's `scipy.sparse.linalg` module offers a selection of Krylov solvers to choose from. The default here is `lgmres`, which is a variant of restarted GMRES iteration that reuses some of the information obtained in the previous Newton steps to invert Jacobians in subsequent steps. For a review on Newton-Krylov methods, see for example [1]_, and for the LGMRES sparse inverse method, see [2]_. References ---------- .. [1] C. T. Kelley, Solving Nonlinear Equations with Newton's Method, SIAM, pp.57-83, 2003. :doi:`10.1137/1.9780898718898.ch3` .. [2] D.A. Knoll and D.E. Keyes, J. Comp. Phys. 193, 357 (2004). :doi:`10.1016/j.jcp.2003.08.010` .. [3] A.H. Baker and E.R. Jessup and T. Manteuffel, SIAM J. Matrix Anal. Appl. 26, 962 (2005). :doi:`10.1137/S0895479803422014` Examples -------- The following functions define a system of nonlinear equations >>> def fun(x): ... return [x[0] + 0.5 * x[1] - 1.0, ... 0.5 * (x[1] - x[0]) ** 2] A solution can be obtained as follows. >>> from scipy import optimize >>> sol = optimize.newton_krylov(fun, [0, 0]) >>> sol array([0.66731771, 0.66536458]) Nc J||_||_ttjj j tjj jtjj jtjj jtjj jtjj jj|||_ t||j|_|jtjj jur<||jd<d|jd<|jjddnR|jtjj j tjj j tjj jfvr|jjddn|jtjj jur||jd<d|jd<|jjd g|jjd d |jjd d |jjdd|j#D]6\}}|j%dst'd|z||j|dd<8y)N)bicgstabgmreslgmrescgsminrestfqmr)rrror[rrratolrouter_kouter_vprepend_outer_vTstore_outer_AvFinner_zUnknown parameter %s)preconditionerrrrrrrrrrrrgetmethod method_kw setdefaultgcrotmkr startswithre) rrr inner_maxiterinner_Mrrkeyrs r$rzKrylovJacobian.__init__s4% \\((11,,%%++<<&&-- ##''<<&&--,,%%++ c&&! mt7J7JK ;;%,,--33 3(5DNN9 %()DNN9 % NN % %fa 0 [[U\\0088"\\0099"\\004466 NN % %fa 0 [[ELL//66 6(/DNN9 %()DNN9 % NN % %i 4 NN % %&7 > NN % %&6 > NN % %fa 0((*JC>>(+ !7#!=>>&+DNN3qr7 #%r#ct|jj}t|jj}|jtd|ztd|z |_y)Nr)rr9r)r romega)rmxmfs r$_update_diff_stepz KrylovJacobian._update_diff_stepsO \    \   ZZ#a*,s1bz9 r#cft|}|dk(rd|zS|j|z }|j|j||zz|jz |z }t j t j|s3t j t j|r td|S)Nrz$Function returned non-finite results) rrrSr9r r'r>r=re)rrAnvscrbs r$rzKrylovJacobian.matvecs !W 7Q3J ZZ"_ YYtwwA~ & 0B 6vvbkk!n%"&&Q*@CD Dr#cd|jvr-|j|j|fi|j\}}|S|j|j|fd|i|j\}}|S)Nrtol)rrop)rrhsrWsolrs r$rzKrylovJacobian.solvesg T^^ ## DGGSCDNNCIC $ DGGSMsMdnnMIC r#c||_||_|j|j4t |jdr|jj ||yyy)Nrj)r9r rrrrj)rr+rs r$rjzKrylovJacobian.updatesZ      *t**H5##**1a06 +r#ctj||||||_||_tj j j||_|j1tj|jjdz|_ |j|j5t!|jdr|jj|||yyy)Nrrb)rrbr9r rrraslinearoperatorrrr'rr/rrrr)rr+rrSs r$rbzKrylovJacobian.setupstQ4(,,%%66t< :: !''*..48DJ      *t**G4##))!Q55 +r#)NrN r) rrr r!rrrrrjrbr"r#r$rr5s2cJCE')-,^: 16r#rc Lt|j}|\}}}}}}} tt|t | d|} dj | D cgc] \} } | d| c} } } | rd| z} dj | D cgc] \} } | d| c} } }|r|dz}|rt d|zd}|t|| |j|z}i}|jtt||||}|j|_ t||Scc} } wcc} } w)a Construct a solver wrapper with given name and Jacobian approx. It inspects the keyword arguments of ``jac.__init__``, and allows to use the same arguments in the wrapper function, in addition to the keyword arguments of `nonlin_solve` Nz, =zUnexpected signature %sa def %(name)s(F, xin, iter=None %(kw)s, verbose=False, maxiter=None, f_tol=None, f_rtol=None, x_tol=None, x_rtol=None, tol_norm=None, line_search='armijo', callback=None, **kw): jac = %(jac)s(%(kwkw)s **kw) return nonlin_solve(F, xin, jac, iter, verbose, maxiter, f_tol, f_rtol, x_tol, x_rtol, tol_norm, line_search, callback) )rrjackwkw)_getfullargspecrlistrr#joinrerrrjglobalsexecr!rH)rr signatureargsvarargsvarkwdefaults kwonlyargs kwdefaults_kwargsrPrAkw_strkwkw_strwrappernsrSs r$_nonlin_wrapperrs4  -I@I=D'5(J A #dCM>?+X6 7F YY8A1#Qqe 8 9F yy8AQCq*89Hd?2Y>??G$6s||"*,,G BIIgi" d8D;;DL TN K;99s D D rrrrrrr) rNFNNNNNNrUNFT)rUg:0yE>r)rs $$??'+FC J I    (P a1 h/ ?DKO?C48P"f FJ!*Z9<9<@EEP##&Y?@X4IIX * + 0o>od9L9@U~UxA1.A1H+ >+ \8<^8<~C6XC6T)X :| 4 :} 5 :x 0~|< m[9  !1>B@ r#