GMRES vs Newton-GMRES for Solving nonlinear PDE'sNewton-Raphson method for nonlinear partial differential equationsSolving a nonlinear algebraic system that includes a linear termIs it possible to solve nonlinear PDEs without using Newton-Raphson iteration?Solving a system of nonlinear equations with an ODE solver is faster than with the Newton method?Newton iteration applied to nonlinear PDESolving this nonlinear system of equationsNumerically solving a system of stiff nonlinear PDEsNewton method for a nonlinear system of time-independent PDEsNonlinear system with diagonal nonlinearityResidual value goes to NaN while solving a system of nonlinear equations

Can a black dragonborn's acid breath weapon destroy objects?

What makes Ada the language of choice for the ISS's safety-critical systems?

What makes an item an artifact?

Should I give professor gift at the beginning of my PhD?

Taxi Services at Didcot

An average heaven where everyone has sexless golden bodies and is bored

Do simulator games use a realistic trajectory to get into orbit?

What language is the software written in on the ISS?

What is the `some` keyword in SwiftUI

Preventing Employees from either switching to Competitors or Opening Their Own Business

Frame failure sudden death?

How Can I Tell The Difference Between Unmarked Sugar and Stevia?

Can someone help me to understand this sentence? "Apple Inc. tumbled as the companies appear set to undergo U.S. antitrust probes"

"You've got another thing coming" - translation into French

Is it a problem if <h4>, <h5> and <h6> are smaller than regular text?

How would a aircraft visually signal "in distress"?

Is it possible to 'live off the sea'

Should an arbiter claim draw at a K+R vs K+R endgame?

How can drunken, homicidal elves successfully conduct a wild hunt?

At what point in time did Dumbledore ask Snape for this favor?

What are the peak hours for public transportation in Paris?

Implement Homestuck's Catenative Doomsday Dice Cascader

What's the largest optical telescope mirror ever put in space?

Watts vs. Volt Amps



GMRES vs Newton-GMRES for Solving nonlinear PDE's


Newton-Raphson method for nonlinear partial differential equationsSolving a nonlinear algebraic system that includes a linear termIs it possible to solve nonlinear PDEs without using Newton-Raphson iteration?Solving a system of nonlinear equations with an ODE solver is faster than with the Newton method?Newton iteration applied to nonlinear PDESolving this nonlinear system of equationsNumerically solving a system of stiff nonlinear PDEsNewton method for a nonlinear system of time-independent PDEsNonlinear system with diagonal nonlinearityResidual value goes to NaN while solving a system of nonlinear equations













1












$begingroup$


Often when numerically solving nonlinear PDE's using method of lines approach with an implicit integrator a system of nonlinear equations have to be solved.
To be more specific, let's say we have simple backward Euler method:
beginalign
y^n=y^n+1-h f(y^n+1,t)= G(y^n+1,t)
endalign

From the available literature, it seems the most common approach is using an Newton-GMRES method to solve the nonlinear system, especially if it is stiff.
As far as I can understand GMRES is used because it is a matrix-free method and so also works with vector functions which is good when approximating the Jacobian with finite differences.



My question is then, why not just use the GMRES to solve the initial problem?
I see no reason why GMRES couldn't solve this for $y^n+1$ when for the Newton-GMRES we solve the system:
beginalign
H(y^n+1_k) &= y^n+1_k-y^n-h f(y^n+1_k,t)rightarrow 0 text for krightarrow infty\
Jv &simeq fracH(y^n+1_k+epsilon v)-H(y^n+1_k))epsilon simeq -H(y^n+1_k)\
y^n+1_k+1&=y^n+1_k+v
endalign

where the GMRES is used for the second part to find $v$. I don't see why solving for $v$ with GMRES followed by the Newton step should be easier/better than solving the general system in the top for $y^n+1$ using GMRES? Does the finite difference approximation to the Jacobian have better properties compared the the general system $y^n=G(y^n+1,t)$?










share|cite|improve this question











$endgroup$
















    1












    $begingroup$


    Often when numerically solving nonlinear PDE's using method of lines approach with an implicit integrator a system of nonlinear equations have to be solved.
    To be more specific, let's say we have simple backward Euler method:
    beginalign
    y^n=y^n+1-h f(y^n+1,t)= G(y^n+1,t)
    endalign

    From the available literature, it seems the most common approach is using an Newton-GMRES method to solve the nonlinear system, especially if it is stiff.
    As far as I can understand GMRES is used because it is a matrix-free method and so also works with vector functions which is good when approximating the Jacobian with finite differences.



    My question is then, why not just use the GMRES to solve the initial problem?
    I see no reason why GMRES couldn't solve this for $y^n+1$ when for the Newton-GMRES we solve the system:
    beginalign
    H(y^n+1_k) &= y^n+1_k-y^n-h f(y^n+1_k,t)rightarrow 0 text for krightarrow infty\
    Jv &simeq fracH(y^n+1_k+epsilon v)-H(y^n+1_k))epsilon simeq -H(y^n+1_k)\
    y^n+1_k+1&=y^n+1_k+v
    endalign

    where the GMRES is used for the second part to find $v$. I don't see why solving for $v$ with GMRES followed by the Newton step should be easier/better than solving the general system in the top for $y^n+1$ using GMRES? Does the finite difference approximation to the Jacobian have better properties compared the the general system $y^n=G(y^n+1,t)$?










    share|cite|improve this question











    $endgroup$














      1












      1








      1





      $begingroup$


      Often when numerically solving nonlinear PDE's using method of lines approach with an implicit integrator a system of nonlinear equations have to be solved.
      To be more specific, let's say we have simple backward Euler method:
      beginalign
      y^n=y^n+1-h f(y^n+1,t)= G(y^n+1,t)
      endalign

      From the available literature, it seems the most common approach is using an Newton-GMRES method to solve the nonlinear system, especially if it is stiff.
      As far as I can understand GMRES is used because it is a matrix-free method and so also works with vector functions which is good when approximating the Jacobian with finite differences.



      My question is then, why not just use the GMRES to solve the initial problem?
      I see no reason why GMRES couldn't solve this for $y^n+1$ when for the Newton-GMRES we solve the system:
      beginalign
      H(y^n+1_k) &= y^n+1_k-y^n-h f(y^n+1_k,t)rightarrow 0 text for krightarrow infty\
      Jv &simeq fracH(y^n+1_k+epsilon v)-H(y^n+1_k))epsilon simeq -H(y^n+1_k)\
      y^n+1_k+1&=y^n+1_k+v
      endalign

      where the GMRES is used for the second part to find $v$. I don't see why solving for $v$ with GMRES followed by the Newton step should be easier/better than solving the general system in the top for $y^n+1$ using GMRES? Does the finite difference approximation to the Jacobian have better properties compared the the general system $y^n=G(y^n+1,t)$?










      share|cite|improve this question











      $endgroup$




      Often when numerically solving nonlinear PDE's using method of lines approach with an implicit integrator a system of nonlinear equations have to be solved.
      To be more specific, let's say we have simple backward Euler method:
      beginalign
      y^n=y^n+1-h f(y^n+1,t)= G(y^n+1,t)
      endalign

      From the available literature, it seems the most common approach is using an Newton-GMRES method to solve the nonlinear system, especially if it is stiff.
      As far as I can understand GMRES is used because it is a matrix-free method and so also works with vector functions which is good when approximating the Jacobian with finite differences.



      My question is then, why not just use the GMRES to solve the initial problem?
      I see no reason why GMRES couldn't solve this for $y^n+1$ when for the Newton-GMRES we solve the system:
      beginalign
      H(y^n+1_k) &= y^n+1_k-y^n-h f(y^n+1_k,t)rightarrow 0 text for krightarrow infty\
      Jv &simeq fracH(y^n+1_k+epsilon v)-H(y^n+1_k))epsilon simeq -H(y^n+1_k)\
      y^n+1_k+1&=y^n+1_k+v
      endalign

      where the GMRES is used for the second part to find $v$. I don't see why solving for $v$ with GMRES followed by the Newton step should be easier/better than solving the general system in the top for $y^n+1$ using GMRES? Does the finite difference approximation to the Jacobian have better properties compared the the general system $y^n=G(y^n+1,t)$?







      pde nonlinear-equations newton-method implicit-methods gmres






      share|cite|improve this question















      share|cite|improve this question













      share|cite|improve this question




      share|cite|improve this question








      edited 8 hours ago









      Anton Menshov

      4,62121872




      4,62121872










      asked 8 hours ago









      RasmusRasmus

      432




      432




















          1 Answer
          1






          active

          oldest

          votes


















          3












          $begingroup$

          The reason is that GMRES can only be used for solving linear equations, i.e. equations of the form $Ax=b$, where $A$ is some matrix and $x,b$ are vectors. What GMRES does, essentially, is it approximates multiplication by the matrix $A^-1$ using a matrix polynomial of $A$.



          In this case (I assume) $f(y^n+1,t)$ is not necessarily linear in the vector $y^n+1$, and so $y^n=G(y^n+1,t)$ can't be written in the form $y^n=A(t)y^n+1$, where $A(t)$ is a matrix-valued function of time. So you can't use GMRES directly.



          The "Newton step" is actually the formation of the linear system of equations with the Jacobian; the point of Newton's method is that it approximates the solution of a nonlinear equation with the solution of a sequence of linear equations. GMRES is just a tool that is used to implement Newton's method.






          share|cite|improve this answer








          New contributor



          bgav is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
          Check out our Code of Conduct.





          $endgroup$













            Your Answer








            StackExchange.ready(function()
            var channelOptions =
            tags: "".split(" "),
            id: "363"
            ;
            initTagRenderer("".split(" "), "".split(" "), channelOptions);

            StackExchange.using("externalEditor", function()
            // Have to fire editor after snippets, if snippets enabled
            if (StackExchange.settings.snippets.snippetsEnabled)
            StackExchange.using("snippets", function()
            createEditor();
            );

            else
            createEditor();

            );

            function createEditor()
            StackExchange.prepareEditor(
            heartbeatType: 'answer',
            autoActivateHeartbeat: false,
            convertImagesToLinks: false,
            noModals: true,
            showLowRepImageUploadWarning: true,
            reputationToPostImages: null,
            bindNavPrevention: true,
            postfix: "",
            imageUploader:
            brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
            contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
            allowUrls: true
            ,
            onDemand: true,
            discardSelector: ".discard-answer"
            ,immediatelyShowMarkdownHelp:true
            );



            );













            draft saved

            draft discarded


















            StackExchange.ready(
            function ()
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fscicomp.stackexchange.com%2fquestions%2f32788%2fgmres-vs-newton-gmres-for-solving-nonlinear-pdes%23new-answer', 'question_page');

            );

            Post as a guest















            Required, but never shown

























            1 Answer
            1






            active

            oldest

            votes








            1 Answer
            1






            active

            oldest

            votes









            active

            oldest

            votes






            active

            oldest

            votes









            3












            $begingroup$

            The reason is that GMRES can only be used for solving linear equations, i.e. equations of the form $Ax=b$, where $A$ is some matrix and $x,b$ are vectors. What GMRES does, essentially, is it approximates multiplication by the matrix $A^-1$ using a matrix polynomial of $A$.



            In this case (I assume) $f(y^n+1,t)$ is not necessarily linear in the vector $y^n+1$, and so $y^n=G(y^n+1,t)$ can't be written in the form $y^n=A(t)y^n+1$, where $A(t)$ is a matrix-valued function of time. So you can't use GMRES directly.



            The "Newton step" is actually the formation of the linear system of equations with the Jacobian; the point of Newton's method is that it approximates the solution of a nonlinear equation with the solution of a sequence of linear equations. GMRES is just a tool that is used to implement Newton's method.






            share|cite|improve this answer








            New contributor



            bgav is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
            Check out our Code of Conduct.





            $endgroup$

















              3












              $begingroup$

              The reason is that GMRES can only be used for solving linear equations, i.e. equations of the form $Ax=b$, where $A$ is some matrix and $x,b$ are vectors. What GMRES does, essentially, is it approximates multiplication by the matrix $A^-1$ using a matrix polynomial of $A$.



              In this case (I assume) $f(y^n+1,t)$ is not necessarily linear in the vector $y^n+1$, and so $y^n=G(y^n+1,t)$ can't be written in the form $y^n=A(t)y^n+1$, where $A(t)$ is a matrix-valued function of time. So you can't use GMRES directly.



              The "Newton step" is actually the formation of the linear system of equations with the Jacobian; the point of Newton's method is that it approximates the solution of a nonlinear equation with the solution of a sequence of linear equations. GMRES is just a tool that is used to implement Newton's method.






              share|cite|improve this answer








              New contributor



              bgav is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
              Check out our Code of Conduct.





              $endgroup$















                3












                3








                3





                $begingroup$

                The reason is that GMRES can only be used for solving linear equations, i.e. equations of the form $Ax=b$, where $A$ is some matrix and $x,b$ are vectors. What GMRES does, essentially, is it approximates multiplication by the matrix $A^-1$ using a matrix polynomial of $A$.



                In this case (I assume) $f(y^n+1,t)$ is not necessarily linear in the vector $y^n+1$, and so $y^n=G(y^n+1,t)$ can't be written in the form $y^n=A(t)y^n+1$, where $A(t)$ is a matrix-valued function of time. So you can't use GMRES directly.



                The "Newton step" is actually the formation of the linear system of equations with the Jacobian; the point of Newton's method is that it approximates the solution of a nonlinear equation with the solution of a sequence of linear equations. GMRES is just a tool that is used to implement Newton's method.






                share|cite|improve this answer








                New contributor



                bgav is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
                Check out our Code of Conduct.





                $endgroup$



                The reason is that GMRES can only be used for solving linear equations, i.e. equations of the form $Ax=b$, where $A$ is some matrix and $x,b$ are vectors. What GMRES does, essentially, is it approximates multiplication by the matrix $A^-1$ using a matrix polynomial of $A$.



                In this case (I assume) $f(y^n+1,t)$ is not necessarily linear in the vector $y^n+1$, and so $y^n=G(y^n+1,t)$ can't be written in the form $y^n=A(t)y^n+1$, where $A(t)$ is a matrix-valued function of time. So you can't use GMRES directly.



                The "Newton step" is actually the formation of the linear system of equations with the Jacobian; the point of Newton's method is that it approximates the solution of a nonlinear equation with the solution of a sequence of linear equations. GMRES is just a tool that is used to implement Newton's method.







                share|cite|improve this answer








                New contributor



                bgav is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
                Check out our Code of Conduct.








                share|cite|improve this answer



                share|cite|improve this answer






                New contributor



                bgav is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
                Check out our Code of Conduct.








                answered 7 hours ago









                bgavbgav

                311




                311




                New contributor



                bgav is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
                Check out our Code of Conduct.




                New contributor




                bgav is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
                Check out our Code of Conduct.





























                    draft saved

                    draft discarded
















































                    Thanks for contributing an answer to Computational Science Stack Exchange!


                    • Please be sure to answer the question. Provide details and share your research!

                    But avoid


                    • Asking for help, clarification, or responding to other answers.

                    • Making statements based on opinion; back them up with references or personal experience.

                    Use MathJax to format equations. MathJax reference.


                    To learn more, see our tips on writing great answers.




                    draft saved


                    draft discarded














                    StackExchange.ready(
                    function ()
                    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fscicomp.stackexchange.com%2fquestions%2f32788%2fgmres-vs-newton-gmres-for-solving-nonlinear-pdes%23new-answer', 'question_page');

                    );

                    Post as a guest















                    Required, but never shown





















































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown

































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown







                    Popular posts from this blog

                    Invision Community Contents History See also References External links Navigation menuProprietaryinvisioncommunity.comIPS Community ForumsIPS Community Forumsthis blog entry"License Changes, IP.Board 3.4, and the Future""Interview -- Matt Mecham of Ibforums""CEO Invision Power Board, Matt Mecham Is a Liar, Thief!"IPB License Explanation 1.3, 1.3.1, 2.0, and 2.1ArchivedSecurity Fixes, Updates And Enhancements For IPB 1.3.1Archived"New Demo Accounts - Invision Power Services"the original"New Default Skin"the original"Invision Power Board 3.0.0 and Applications Released"the original"Archived copy"the original"Perpetual licenses being done away with""Release Notes - Invision Power Services""Introducing: IPS Community Suite 4!"Invision Community Release Notes

                    Canceling a color specificationRandomly assigning color to Graphics3D objects?Default color for Filling in Mathematica 9Coloring specific elements of sets with a prime modified order in an array plotHow to pick a color differing significantly from the colors already in a given color list?Detection of the text colorColor numbers based on their valueCan color schemes for use with ColorData include opacity specification?My dynamic color schemes

                    Tom Holland Mục lục Đầu đời và giáo dục | Sự nghiệp | Cuộc sống cá nhân | Phim tham gia | Giải thưởng và đề cử | Chú thích | Liên kết ngoài | Trình đơn chuyển hướngProfile“Person Details for Thomas Stanley Holland, "England and Wales Birth Registration Index, 1837-2008" — FamilySearch.org”"Meet Tom Holland... the 16-year-old star of The Impossible""Schoolboy actor Tom Holland finds himself in Oscar contention for role in tsunami drama"“Naomi Watts on the Prince William and Harry's reaction to her film about the late Princess Diana”lưu trữ"Holland and Pflueger Are West End's Two New 'Billy Elliots'""I'm so envious of my son, the movie star! British writer Dominic Holland's spent 20 years trying to crack Hollywood - but he's been beaten to it by a very unlikely rival"“Richard and Margaret Povey of Jersey, Channel Islands, UK: Information about Thomas Stanley Holland”"Tom Holland to play Billy Elliot""New Billy Elliot leaving the garage"Billy Elliot the Musical - Tom Holland - Billy"A Tale of four Billys: Tom Holland""The Feel Good Factor""Thames Christian College schoolboys join Myleene Klass for The Feelgood Factor""Government launches £600,000 arts bursaries pilot""BILLY's Chapman, Holland, Gardner & Jackson-Keen Visit Prime Minister""Elton John 'blown away' by Billy Elliot fifth birthday" (video with John's interview and fragments of Holland's performance)"First News interviews Arrietty's Tom Holland"“33rd Critics' Circle Film Awards winners”“National Board of Review Current Awards”Bản gốc"Ron Howard Whaling Tale 'In The Heart Of The Sea' Casts Tom Holland"“'Spider-Man' Finds Tom Holland to Star as New Web-Slinger”lưu trữ“Captain America: Civil War (2016)”“Film Review: ‘Captain America: Civil War’”lưu trữ“‘Captain America: Civil War’ review: Choose your own avenger”lưu trữ“The Lost City of Z reviews”“Sony Pictures and Marvel Studios Find Their 'Spider-Man' Star and Director”“‘Mary Magdalene’, ‘Current War’ & ‘Wind River’ Get 2017 Release Dates From Weinstein”“Lionsgate Unleashing Daisy Ridley & Tom Holland Starrer ‘Chaos Walking’ In Cannes”“PTA's 'Master' Leads Chicago Film Critics Nominations, UPDATED: Houston and Indiana Critics Nominations”“Nominaciones Goya 2013 Telecinco Cinema – ENG”“Jameson Empire Film Awards: Martin Freeman wins best actor for performance in The Hobbit”“34th Annual Young Artist Awards”Bản gốc“Teen Choice Awards 2016—Captain America: Civil War Leads Second Wave of Nominations”“BAFTA Film Award Nominations: ‘La La Land’ Leads Race”“Saturn Awards Nominations 2017: 'Rogue One,' 'Walking Dead' Lead”Tom HollandTom HollandTom HollandTom Hollandmedia.gettyimages.comWorldCat Identities300279794no20130442900000 0004 0355 42791085670554170004732cb16706349t(data)XX5557367