What is the best option for High availability on a data warehouse?High Availability for postgresqlAvailability mode - manual failover mode, best practice for availability mode?Data warehouse server. How do you calculate RAM/CPU specifications?I'm confused about High Availability/Always OnHigh Availability Options For SQL ServerHigh availability database switchoverBest way to capture changes on OLTP for Data Warehouse: Create/Update column or CDCNetwork Maintenance and High Availability Group Prep

Why do all fields in a QFT transform like *irreducible* representations of some group?

Are illustrations in novels frowned upon?

Can't stopover at Sapporo when going from Asahikawa to Chitose airport?

Why don't electrons take the shorter path in coils?

Can you feel passing through the sound barrier in an F-16?

Is there any practical application for performing a double Fourier transform? ...or an inverse Fourier transform on a time-domain input?

Cross-referencing enumerate item

What is this symbol: semicircles facing eachother

Would it be possible to have a GMO that produces chocolate?

How to use "Du hast/ Du hattest'?

How should I face my manager if I make a mistake because a senior coworker explained something incorrectly to me?

Justifying the use of directed energy weapons

Shouldn't the "credit score" prevent Americans from going deeper and deeper into personal debt?

Why were the crew so desperate to catch Truman and return him to Seahaven?

Is my soulless catatonic body a valid target for the Imprisonment spell?

Potential new partner angry about first collaboration - how to answer email to close up this encounter in a graceful manner

Would this system work to purify water?

Can pay be witheld for hours cleaning up after closing time?

Efficiently pathfinding many flocking enemies around obstacles

What are some interesting features that are common cross-linguistically but don't exist in English?

Is a player able to change alignment midway through an adventure?

Mathematical uses of string theory

What professions would a medieval village with a population of 100 need?

What magic extends life or grants immortality?



What is the best option for High availability on a data warehouse?


High Availability for postgresqlAvailability mode - manual failover mode, best practice for availability mode?Data warehouse server. How do you calculate RAM/CPU specifications?I'm confused about High Availability/Always OnHigh Availability Options For SQL ServerHigh availability database switchoverBest way to capture changes on OLTP for Data Warehouse: Create/Update column or CDCNetwork Maintenance and High Availability Group Prep






.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty margin-bottom:0;








4















I have a customer who have an existing 1.5Gb data warehouse and are currently planning for a complete refresh of the DW on a new environment. Their infrastructure manager has organised 2 servers with SQL 2017 standard on each and has now asked me to plan a HA/DR plan for the new DW database/instance.



I immediately thought of using AlwaysOn Availability Groups, although I have never used them before, and none of the articles I read talk about typical data warehouse workloads - it's all OLTP applications. With a large daily ETL process and a smaller intra-day ETL process running on their current DW, will that have an impact on how we approach this?



Thanks - any help to point me in the right direction here would be beneficial!










share|improve this question









New contributor



Nick Baker is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
















  • 1





    IMHO, Always On is for OLTP. Also, for Always On AG you need to have Enterprise edition which means $$$. You can run Always On fail-over cluster instances on Standard edition though, and basic availability groups Ref Docs. Though he stated HA/DR, does he really just want DR? This would change the suggestions. What's the RPO and RTO for this DW?

    – scsimon
    8 hours ago












  • Hi Nick, welcome to dba.SE. Is the focus on a single database or multiple databases? As @scsimon mentioned, when using standard edition you would only be able to use 'Basic Always On availability groups'. This can work depending on some other factors. (E.G. with multiple databases in different basic AG's, some db's might be primary and other databases might be secondary on the same instance.)

    – Randi Vertongen
    8 hours ago












  • Thanks - he mentioned DR, but he's flexible. In fact the term he used was 'HA-ish' so I think he's open to various sensible suggestions. I hadn't considered failover clusters - my lack of understanding as primarily a developer, not a DBA. I'll look into that.

    – Nick Baker
    6 hours ago

















4















I have a customer who have an existing 1.5Gb data warehouse and are currently planning for a complete refresh of the DW on a new environment. Their infrastructure manager has organised 2 servers with SQL 2017 standard on each and has now asked me to plan a HA/DR plan for the new DW database/instance.



I immediately thought of using AlwaysOn Availability Groups, although I have never used them before, and none of the articles I read talk about typical data warehouse workloads - it's all OLTP applications. With a large daily ETL process and a smaller intra-day ETL process running on their current DW, will that have an impact on how we approach this?



Thanks - any help to point me in the right direction here would be beneficial!










share|improve this question









New contributor



Nick Baker is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
















  • 1





    IMHO, Always On is for OLTP. Also, for Always On AG you need to have Enterprise edition which means $$$. You can run Always On fail-over cluster instances on Standard edition though, and basic availability groups Ref Docs. Though he stated HA/DR, does he really just want DR? This would change the suggestions. What's the RPO and RTO for this DW?

    – scsimon
    8 hours ago












  • Hi Nick, welcome to dba.SE. Is the focus on a single database or multiple databases? As @scsimon mentioned, when using standard edition you would only be able to use 'Basic Always On availability groups'. This can work depending on some other factors. (E.G. with multiple databases in different basic AG's, some db's might be primary and other databases might be secondary on the same instance.)

    – Randi Vertongen
    8 hours ago












  • Thanks - he mentioned DR, but he's flexible. In fact the term he used was 'HA-ish' so I think he's open to various sensible suggestions. I hadn't considered failover clusters - my lack of understanding as primarily a developer, not a DBA. I'll look into that.

    – Nick Baker
    6 hours ago













4












4








4








I have a customer who have an existing 1.5Gb data warehouse and are currently planning for a complete refresh of the DW on a new environment. Their infrastructure manager has organised 2 servers with SQL 2017 standard on each and has now asked me to plan a HA/DR plan for the new DW database/instance.



I immediately thought of using AlwaysOn Availability Groups, although I have never used them before, and none of the articles I read talk about typical data warehouse workloads - it's all OLTP applications. With a large daily ETL process and a smaller intra-day ETL process running on their current DW, will that have an impact on how we approach this?



Thanks - any help to point me in the right direction here would be beneficial!










share|improve this question









New contributor



Nick Baker is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.











I have a customer who have an existing 1.5Gb data warehouse and are currently planning for a complete refresh of the DW on a new environment. Their infrastructure manager has organised 2 servers with SQL 2017 standard on each and has now asked me to plan a HA/DR plan for the new DW database/instance.



I immediately thought of using AlwaysOn Availability Groups, although I have never used them before, and none of the articles I read talk about typical data warehouse workloads - it's all OLTP applications. With a large daily ETL process and a smaller intra-day ETL process running on their current DW, will that have an impact on how we approach this?



Thanks - any help to point me in the right direction here would be beneficial!







availability-groups sql-server-2017 data-warehouse high-availability disaster-recovery






share|improve this question









New contributor



Nick Baker is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.










share|improve this question









New contributor



Nick Baker is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.








share|improve this question




share|improve this question








edited 8 hours ago









Randi Vertongen

8,1253 gold badges11 silver badges31 bronze badges




8,1253 gold badges11 silver badges31 bronze badges






New contributor



Nick Baker is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.








asked 8 hours ago









Nick BakerNick Baker

213 bronze badges




213 bronze badges




New contributor



Nick Baker is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.




New contributor




Nick Baker is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.












  • 1





    IMHO, Always On is for OLTP. Also, for Always On AG you need to have Enterprise edition which means $$$. You can run Always On fail-over cluster instances on Standard edition though, and basic availability groups Ref Docs. Though he stated HA/DR, does he really just want DR? This would change the suggestions. What's the RPO and RTO for this DW?

    – scsimon
    8 hours ago












  • Hi Nick, welcome to dba.SE. Is the focus on a single database or multiple databases? As @scsimon mentioned, when using standard edition you would only be able to use 'Basic Always On availability groups'. This can work depending on some other factors. (E.G. with multiple databases in different basic AG's, some db's might be primary and other databases might be secondary on the same instance.)

    – Randi Vertongen
    8 hours ago












  • Thanks - he mentioned DR, but he's flexible. In fact the term he used was 'HA-ish' so I think he's open to various sensible suggestions. I hadn't considered failover clusters - my lack of understanding as primarily a developer, not a DBA. I'll look into that.

    – Nick Baker
    6 hours ago












  • 1





    IMHO, Always On is for OLTP. Also, for Always On AG you need to have Enterprise edition which means $$$. You can run Always On fail-over cluster instances on Standard edition though, and basic availability groups Ref Docs. Though he stated HA/DR, does he really just want DR? This would change the suggestions. What's the RPO and RTO for this DW?

    – scsimon
    8 hours ago












  • Hi Nick, welcome to dba.SE. Is the focus on a single database or multiple databases? As @scsimon mentioned, when using standard edition you would only be able to use 'Basic Always On availability groups'. This can work depending on some other factors. (E.G. with multiple databases in different basic AG's, some db's might be primary and other databases might be secondary on the same instance.)

    – Randi Vertongen
    8 hours ago












  • Thanks - he mentioned DR, but he's flexible. In fact the term he used was 'HA-ish' so I think he's open to various sensible suggestions. I hadn't considered failover clusters - my lack of understanding as primarily a developer, not a DBA. I'll look into that.

    – Nick Baker
    6 hours ago







1




1





IMHO, Always On is for OLTP. Also, for Always On AG you need to have Enterprise edition which means $$$. You can run Always On fail-over cluster instances on Standard edition though, and basic availability groups Ref Docs. Though he stated HA/DR, does he really just want DR? This would change the suggestions. What's the RPO and RTO for this DW?

– scsimon
8 hours ago






IMHO, Always On is for OLTP. Also, for Always On AG you need to have Enterprise edition which means $$$. You can run Always On fail-over cluster instances on Standard edition though, and basic availability groups Ref Docs. Though he stated HA/DR, does he really just want DR? This would change the suggestions. What's the RPO and RTO for this DW?

– scsimon
8 hours ago














Hi Nick, welcome to dba.SE. Is the focus on a single database or multiple databases? As @scsimon mentioned, when using standard edition you would only be able to use 'Basic Always On availability groups'. This can work depending on some other factors. (E.G. with multiple databases in different basic AG's, some db's might be primary and other databases might be secondary on the same instance.)

– Randi Vertongen
8 hours ago






Hi Nick, welcome to dba.SE. Is the focus on a single database or multiple databases? As @scsimon mentioned, when using standard edition you would only be able to use 'Basic Always On availability groups'. This can work depending on some other factors. (E.G. with multiple databases in different basic AG's, some db's might be primary and other databases might be secondary on the same instance.)

– Randi Vertongen
8 hours ago














Thanks - he mentioned DR, but he's flexible. In fact the term he used was 'HA-ish' so I think he's open to various sensible suggestions. I hadn't considered failover clusters - my lack of understanding as primarily a developer, not a DBA. I'll look into that.

– Nick Baker
6 hours ago





Thanks - he mentioned DR, but he's flexible. In fact the term he used was 'HA-ish' so I think he's open to various sensible suggestions. I hadn't considered failover clusters - my lack of understanding as primarily a developer, not a DBA. I'll look into that.

– Nick Baker
6 hours ago










2 Answers
2






active

oldest

votes


















5















Most data warehouses are in Simple recovery model, and most true HA solutions require Full recovery (AGs, Mirroring). The minimum for Log Shipping is Bulk Logged, but that's not really true HA since there's no automatic failover.



If that's the case for yours (because really, a data warehouse in Full recovery is banana-town-crazy), your best bet would be a Failover Cluster.



It doesn't care what recovery model your databases are in, since it's more reliant on Windows than SQL Server. Your SQL Server just has the option to live on different nodes in the cluster if something goes amok with one. The one requirement of this technology is using shared storage, like a SAN.



You get automatic failover in most situations, but no readable replica (you don't get that with BAG, either). With Standard Edition, you're limited to a two node cluster, but that shouldn't be a big deal.



Failover Clusters are also a lot easier to manage if you're not too savvy with SQL Server. You really need basic Windows sysadmin skills. AGs can be a tough cookie when they go down, or when a patch goes bad (which sadly happens rather often).






share|improve this answer

























  • Awesome thanks that is exactly right - simple recovery model all the way. I had wondered about the impact of changing that just for this. I'll do some more reading on failover clusters thanks.

    – Nick Baker
    6 hours ago


















0















I can see your have SQL Server 2017 STandard Edition, so you can use the Basic Always On availability groups for a single database.



Please check the details here : Click here



Limitations






share|improve this answer



























    Your Answer








    StackExchange.ready(function()
    var channelOptions =
    tags: "".split(" "),
    id: "182"
    ;
    initTagRenderer("".split(" "), "".split(" "), channelOptions);

    StackExchange.using("externalEditor", function()
    // Have to fire editor after snippets, if snippets enabled
    if (StackExchange.settings.snippets.snippetsEnabled)
    StackExchange.using("snippets", function()
    createEditor();
    );

    else
    createEditor();

    );

    function createEditor()
    StackExchange.prepareEditor(
    heartbeatType: 'answer',
    autoActivateHeartbeat: false,
    convertImagesToLinks: false,
    noModals: true,
    showLowRepImageUploadWarning: true,
    reputationToPostImages: null,
    bindNavPrevention: true,
    postfix: "",
    imageUploader:
    brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
    contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
    allowUrls: true
    ,
    onDemand: true,
    discardSelector: ".discard-answer"
    ,immediatelyShowMarkdownHelp:true
    );



    );






    Nick Baker is a new contributor. Be nice, and check out our Code of Conduct.









    draft saved

    draft discarded


















    StackExchange.ready(
    function ()
    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdba.stackexchange.com%2fquestions%2f245995%2fwhat-is-the-best-option-for-high-availability-on-a-data-warehouse%23new-answer', 'question_page');

    );

    Post as a guest















    Required, but never shown

























    2 Answers
    2






    active

    oldest

    votes








    2 Answers
    2






    active

    oldest

    votes









    active

    oldest

    votes






    active

    oldest

    votes









    5















    Most data warehouses are in Simple recovery model, and most true HA solutions require Full recovery (AGs, Mirroring). The minimum for Log Shipping is Bulk Logged, but that's not really true HA since there's no automatic failover.



    If that's the case for yours (because really, a data warehouse in Full recovery is banana-town-crazy), your best bet would be a Failover Cluster.



    It doesn't care what recovery model your databases are in, since it's more reliant on Windows than SQL Server. Your SQL Server just has the option to live on different nodes in the cluster if something goes amok with one. The one requirement of this technology is using shared storage, like a SAN.



    You get automatic failover in most situations, but no readable replica (you don't get that with BAG, either). With Standard Edition, you're limited to a two node cluster, but that shouldn't be a big deal.



    Failover Clusters are also a lot easier to manage if you're not too savvy with SQL Server. You really need basic Windows sysadmin skills. AGs can be a tough cookie when they go down, or when a patch goes bad (which sadly happens rather often).






    share|improve this answer

























    • Awesome thanks that is exactly right - simple recovery model all the way. I had wondered about the impact of changing that just for this. I'll do some more reading on failover clusters thanks.

      – Nick Baker
      6 hours ago















    5















    Most data warehouses are in Simple recovery model, and most true HA solutions require Full recovery (AGs, Mirroring). The minimum for Log Shipping is Bulk Logged, but that's not really true HA since there's no automatic failover.



    If that's the case for yours (because really, a data warehouse in Full recovery is banana-town-crazy), your best bet would be a Failover Cluster.



    It doesn't care what recovery model your databases are in, since it's more reliant on Windows than SQL Server. Your SQL Server just has the option to live on different nodes in the cluster if something goes amok with one. The one requirement of this technology is using shared storage, like a SAN.



    You get automatic failover in most situations, but no readable replica (you don't get that with BAG, either). With Standard Edition, you're limited to a two node cluster, but that shouldn't be a big deal.



    Failover Clusters are also a lot easier to manage if you're not too savvy with SQL Server. You really need basic Windows sysadmin skills. AGs can be a tough cookie when they go down, or when a patch goes bad (which sadly happens rather often).






    share|improve this answer

























    • Awesome thanks that is exactly right - simple recovery model all the way. I had wondered about the impact of changing that just for this. I'll do some more reading on failover clusters thanks.

      – Nick Baker
      6 hours ago













    5














    5










    5









    Most data warehouses are in Simple recovery model, and most true HA solutions require Full recovery (AGs, Mirroring). The minimum for Log Shipping is Bulk Logged, but that's not really true HA since there's no automatic failover.



    If that's the case for yours (because really, a data warehouse in Full recovery is banana-town-crazy), your best bet would be a Failover Cluster.



    It doesn't care what recovery model your databases are in, since it's more reliant on Windows than SQL Server. Your SQL Server just has the option to live on different nodes in the cluster if something goes amok with one. The one requirement of this technology is using shared storage, like a SAN.



    You get automatic failover in most situations, but no readable replica (you don't get that with BAG, either). With Standard Edition, you're limited to a two node cluster, but that shouldn't be a big deal.



    Failover Clusters are also a lot easier to manage if you're not too savvy with SQL Server. You really need basic Windows sysadmin skills. AGs can be a tough cookie when they go down, or when a patch goes bad (which sadly happens rather often).






    share|improve this answer













    Most data warehouses are in Simple recovery model, and most true HA solutions require Full recovery (AGs, Mirroring). The minimum for Log Shipping is Bulk Logged, but that's not really true HA since there's no automatic failover.



    If that's the case for yours (because really, a data warehouse in Full recovery is banana-town-crazy), your best bet would be a Failover Cluster.



    It doesn't care what recovery model your databases are in, since it's more reliant on Windows than SQL Server. Your SQL Server just has the option to live on different nodes in the cluster if something goes amok with one. The one requirement of this technology is using shared storage, like a SAN.



    You get automatic failover in most situations, but no readable replica (you don't get that with BAG, either). With Standard Edition, you're limited to a two node cluster, but that shouldn't be a big deal.



    Failover Clusters are also a lot easier to manage if you're not too savvy with SQL Server. You really need basic Windows sysadmin skills. AGs can be a tough cookie when they go down, or when a patch goes bad (which sadly happens rather often).







    share|improve this answer












    share|improve this answer



    share|improve this answer










    answered 7 hours ago









    Erik DarlingErik Darling

    26.2k13 gold badges81 silver badges131 bronze badges




    26.2k13 gold badges81 silver badges131 bronze badges















    • Awesome thanks that is exactly right - simple recovery model all the way. I had wondered about the impact of changing that just for this. I'll do some more reading on failover clusters thanks.

      – Nick Baker
      6 hours ago

















    • Awesome thanks that is exactly right - simple recovery model all the way. I had wondered about the impact of changing that just for this. I'll do some more reading on failover clusters thanks.

      – Nick Baker
      6 hours ago
















    Awesome thanks that is exactly right - simple recovery model all the way. I had wondered about the impact of changing that just for this. I'll do some more reading on failover clusters thanks.

    – Nick Baker
    6 hours ago





    Awesome thanks that is exactly right - simple recovery model all the way. I had wondered about the impact of changing that just for this. I'll do some more reading on failover clusters thanks.

    – Nick Baker
    6 hours ago













    0















    I can see your have SQL Server 2017 STandard Edition, so you can use the Basic Always On availability groups for a single database.



    Please check the details here : Click here



    Limitations






    share|improve this answer





























      0















      I can see your have SQL Server 2017 STandard Edition, so you can use the Basic Always On availability groups for a single database.



      Please check the details here : Click here



      Limitations






      share|improve this answer



























        0














        0










        0









        I can see your have SQL Server 2017 STandard Edition, so you can use the Basic Always On availability groups for a single database.



        Please check the details here : Click here



        Limitations






        share|improve this answer













        I can see your have SQL Server 2017 STandard Edition, so you can use the Basic Always On availability groups for a single database.



        Please check the details here : Click here



        Limitations







        share|improve this answer












        share|improve this answer



        share|improve this answer










        answered 8 hours ago









        Ramakant DadhichiRamakant Dadhichi

        1,2875 silver badges21 bronze badges




        1,2875 silver badges21 bronze badges























            Nick Baker is a new contributor. Be nice, and check out our Code of Conduct.









            draft saved

            draft discarded


















            Nick Baker is a new contributor. Be nice, and check out our Code of Conduct.












            Nick Baker is a new contributor. Be nice, and check out our Code of Conduct.











            Nick Baker is a new contributor. Be nice, and check out our Code of Conduct.














            Thanks for contributing an answer to Database Administrators Stack Exchange!


            • Please be sure to answer the question. Provide details and share your research!

            But avoid


            • Asking for help, clarification, or responding to other answers.

            • Making statements based on opinion; back them up with references or personal experience.

            To learn more, see our tips on writing great answers.




            draft saved


            draft discarded














            StackExchange.ready(
            function ()
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdba.stackexchange.com%2fquestions%2f245995%2fwhat-is-the-best-option-for-high-availability-on-a-data-warehouse%23new-answer', 'question_page');

            );

            Post as a guest















            Required, but never shown





















































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown

































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown







            Popular posts from this blog

            Canceling a color specificationRandomly assigning color to Graphics3D objects?Default color for Filling in Mathematica 9Coloring specific elements of sets with a prime modified order in an array plotHow to pick a color differing significantly from the colors already in a given color list?Detection of the text colorColor numbers based on their valueCan color schemes for use with ColorData include opacity specification?My dynamic color schemes

            Invision Community Contents History See also References External links Navigation menuProprietaryinvisioncommunity.comIPS Community ForumsIPS Community Forumsthis blog entry"License Changes, IP.Board 3.4, and the Future""Interview -- Matt Mecham of Ibforums""CEO Invision Power Board, Matt Mecham Is a Liar, Thief!"IPB License Explanation 1.3, 1.3.1, 2.0, and 2.1ArchivedSecurity Fixes, Updates And Enhancements For IPB 1.3.1Archived"New Demo Accounts - Invision Power Services"the original"New Default Skin"the original"Invision Power Board 3.0.0 and Applications Released"the original"Archived copy"the original"Perpetual licenses being done away with""Release Notes - Invision Power Services""Introducing: IPS Community Suite 4!"Invision Community Release Notes

            François Viète Contents Biography Work and thought Bibliography See also Notes Further reading External links Navigation menup. 21Google Bookspp. 75–77Google BooksDe thou (from University of Saint Andrews)ArchivedGoogle BooksGoogle BooksGoogle BooksGoogle booksGoogle Bookscc-parthenay.frL'histoire universelle (fr)Universal History (en)ArchivedAdsabs.harvard.eduPagesperso-orange.frArchive.orgChikara Sasaki. Descartes' mathematical thought p.259Google BooksGoogle BooksGoogle Bookspp. 152 and onwardGoogle BooksGoogle BooksScribd.comGoogle Books1257-7979Google BooksGoogle BooksGoogle BooksGoogle BooksGoogle BooksGoogle BooksGallica.bnf.frGoogle BooksGoogle Books"François Viète"Francois Viète: Father of Modern Algebraic NotationThe Lawyer and the GamblerAbout TarporleySite de Jean-Paul GuichardL'algèbre nouvelle"About the Harmonicon"cb120511976(data)1188044800000 0001 0913 5903n82164680ola2013766880073431702w6vt1sb70287374827140948071409480