Skip to content
    Moz logo Menu open Menu close
    • Products
      • Moz Pro
      • Moz Pro Home
      • Moz Local
      • Moz Local Home
      • STAT
      • Moz API
      • Moz API Home
      • Compare SEO Products
      • Moz Data
    • Free SEO Tools
      • Domain Analysis
      • Keyword Explorer
      • Link Explorer
      • Competitive Research
      • MozBar
      • More Free SEO Tools
    • Learn SEO
      • Beginner's Guide to SEO
      • SEO Learning Center
      • Moz Academy
      • SEO Q&A
      • Webinars, Whitepapers, & Guides
    • Blog
    • Why Moz
      • Agency Solutions
      • Enterprise Solutions
      • Small Business Solutions
      • Case Studies
      • The Moz Story
      • New Releases
    • Log in
    • Log out
    • Products
      • Moz Pro

        Your all-in-one suite of SEO essentials.

      • Moz Local

        Raise your local SEO visibility with complete local SEO management.

      • STAT

        SERP tracking and analytics for enterprise SEO experts.

      • Moz API

        Power your SEO with our index of over 44 trillion links.

      • Compare SEO Products

        See which Moz SEO solution best meets your business needs.

      • Moz Data

        Power your SEO strategy & AI models with custom data solutions.

      Save big on Moz Pro!
      Limited time offer

      Save big on Moz Pro!

      See pricing
    • Free SEO Tools
      • Domain Analysis

        Get top competitive SEO metrics like DA, top pages and more.

      • Keyword Explorer

        Find traffic-driving keywords with our 1.25 billion+ keyword index.

      • Link Explorer

        Explore over 40 trillion links for powerful backlink data.

      • Competitive Research

        Uncover valuable insights on your organic search competitors.

      • MozBar

        See top SEO metrics for free as you browse the web.

      • More Free SEO Tools

        Explore all the free SEO tools Moz has to offer.

      Access the Moz API for less
      Save on Moz Data

      Access the Moz API for less

      Hurry - ends Dec 13th!
    • Learn SEO
      • Beginner's Guide to SEO

        The #1 most popular introduction to SEO, trusted by millions.

      • SEO Learning Center

        Broaden your knowledge with SEO resources for all skill levels.

      • On-Demand Webinars

        Learn modern SEO best practices from industry experts.

      • How-To Guides

        Step-by-step guides to search success from the authority on SEO.

      • Moz Academy

        Upskill and get certified with on-demand courses & certifications.

      • SEO Q&A

        Insights & discussions from an SEO community of 500,000+.

      Save 20% on all Moz Academy courses
      Limited time offer

      Save 20% on all Moz Academy courses

      Level up your SEO
    • Blog
    • Why Moz
      • Small Business Solutions

        Uncover insights to make smarter marketing decisions in less time.

      • Agency Solutions

        Earn & keep valuable clients with unparalleled data & insights.

      • Enterprise Solutions

        Gain a competitive edge in the ever-changing world of search.

      • The Moz Story

        Moz was the first & remains the most trusted SEO company.

      • Case Studies

        Explore how Moz drives ROI with a proven track record of success.

      • New Releases

        Get the scoop on the latest and greatest from Moz.

      Explore Moz updates & save up to 40%
      Big Savings!

      Explore Moz updates & save up to 40%

      See the latest
    • Log in
      • Moz Pro
      • Moz Local
      • Moz Local Dashboard
      • Moz API
      • Moz API Dashboard
      • Moz Academy
    • Avatar
      • Moz Home
      • Notifications
      • Account & Billing
      • Manage Users
      • Community Profile
      • My Q&A
      • My Videos
      • Log Out

    The Moz Q&A Forum

    • Forum
    • Questions
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. Home
    2. Community
    3. Moz News
    4. Moz Pro, our web crawler, and sites that use SNI (804 HTTPS SSL) error

    Moz Pro, our web crawler, and sites that use SNI (804 HTTPS SSL) error

    Moz News
    32
    73
    21766
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with question management privileges can see it.
    • fivefifty
      fivefifty last edited by

      Hello:

      Have a clarifying question: using this site:  https://globalsign.ssllabs.com/analyze  one of our sites got the following status:

      HTTP Strict Transport Security (HSTS) with long duration deployed on this server.

      and not this one:

      This site works only in browsers with SNI support.

      However, we recently received this error through Moz:

      Error Code 804: HTTPS (SSL) Error Encountered
      Your page requires an SSL security certificate to load (using HTTPS), but the Moz Crawler encountered an error when trying to load the certificate.

      Please advise if the HTTP Strict Transport Security (HSTS) also causes the Error Code 804: HTTPS (SSL) Error Encountered in Moz?

      Thank You

      DavidLee 1 Reply Last reply Reply Quote 0
      • DavidLee
        DavidLee @etiennebeneke last edited by

        Anytime! 🙂

        1 Reply Last reply Reply Quote 0
        • etiennebeneke
          etiennebeneke @DavidLee last edited by

          Brilliant David,

          I appreciate the lengths you have gone to get more info on my issue. I will get the host to address this. Thanks very much!

          Etienne

          DavidLee 1 Reply Last reply Reply Quote 1
          • DavidLee
            DavidLee @etiennebeneke last edited by

            Hi Etienne

            I checked the campaign you have with the 902 response and the issue is with your host blocking AWS IPs. I could not find any SSL or SNI errors for the domain.

            You will want to reach out to your hosting provider to make sure they are not blocking any AWS IP ranges. Our IPs are dynamic so we will not be able to provide a range for you.

            There are also other issues with the SSL configuration which will need to be looked at which could result in different errors once the IPs are unblocked.

            http://www.screencast.com/t/b8qEdNah

            You can run a test here for any SSL domain: https://globalsign.ssllabs.com/analyze.html

            Hope this helps!

            etiennebeneke 2 Replies Last reply Reply Quote 2
            • jon.white
              jon.white @etiennebeneke last edited by

              Hello Etienne - sorry to hear this.

              Have you checked in with help@moz.com yet? They might be able to fix your problem.

              1 Reply Last reply Reply Quote 0
              • etiennebeneke
                etiennebeneke last edited by

                Hi Jon

                Same problem this side, not sure if it's SNI. First we had 904 server error and then 902. Our site has not been crawled by RogerBot since 9 Oct when we switched from HTTP to HTTPS.

                I am hoping for the best as I cannot use the full functionality of MOZ at the moment as we have one crawl error which completely keeps me in the dark as a SEO.

                Many thanks
                Etienne

                jon.white DavidLee 2 Replies Last reply Reply Quote 0
                • planetargon
                  planetargon Subscriber last edited by

                  Do you have a rough ETA on the new crawler? Being without useful crawl data for several months has been painful

                  1 Reply Last reply Reply Quote 3
                  • TrueluxGroup
                    TrueluxGroup @jon.white last edited by

                    Can you recommend any suitable alternatives for web crawling our site while your new crawler is in development.

                    We already use screaming frog but it would be handy to have something that flagged up any problems like MOZ did with our other sites.

                    Cheers 😄

                    1 Reply Last reply Reply Quote 1
                    • AaronHemmelgarn
                      AaronHemmelgarn @DavidLee last edited by

                      OK great, thank you.

                      1 Reply Last reply Reply Quote 0
                      • DavidLee
                        DavidLee @AaronHemmelgarn last edited by

                        Yes the sign up link is in the very first post by Jon

                        The link is http://goo.gl/forms/LCvL9Ix8JDHfbAvr1

                        AaronHemmelgarn 1 Reply Last reply Reply Quote 2
                        • AaronHemmelgarn
                          AaronHemmelgarn @DavidLee last edited by

                          Hi @David,

                          You mention a beta, is there someplace that we signup? I am a Moz Pro account holder and haven't seen anything offered or an e-mail.

                          Please provide steps for signup, as currently we have clients that we can't crawl and still paying for Moz.

                          DavidLee 1 Reply Last reply Reply Quote 1
                          • DavidLee
                            DavidLee @TrueluxGroup last edited by

                            Hello!

                            I can confirm your site does use SNI which can be checked at https://globalsign.ssllabs.com/analyze.html?d=www.honesthouse.co.uk&latest

                            If anyone else is unsure about your own site, you can use the above link, replace the URL and click on any server results which will confirm SNI status shown here: http://www.screencast.com/t/GLzjD7gjzjR

                            As for any workaround, other than disabling SNI completely, the quickest option to get crawled would be to sign up for the beta.

                            Jon will keep everyone posted with any new status and I can assure you this is our top priority feature we are working on.

                            AaronHemmelgarn 1 Reply Last reply Reply Quote 2
                            • TrueluxGroup
                              TrueluxGroup @jon.white last edited by

                              Hi Jon,

                              I think we might have the same problem.

                              Our site is https://www.honesthouse.co.uk/ and we're getting the 804 SSL error too 😞

                              Is there anything we can do?

                              Cheers

                              DavidLee 1 Reply Last reply Reply Quote 0
                              • jon.white
                                jon.white @AaronHemmelgarn last edited by

                                Hello Aaron!  Unfortunately I am unable to provide a date - mainly because if I did, I would be guessing, and I don't think that is helpful.  We used to commit dates to releases, and we stopped, simply because our software is too complex to estimate accurately.

                                I will say it is close, I sent an email update earlier this week to all who sign up for the beta, I have included this below, it has a little more color:

                                Thank you for signing up for the Moz Pro Site Crawl beta.  I wanted to give you all an update since it has taken us a little longer to get the beta ready for testing.  We were hoping to have it out here by MozCon (this week) but we are slightly behind.  In the interest of transparency:

                                • our current crawler does not support SNI (as you well know) and is simply too old and fragile to make meaningful updates to, so we decided in Q1 of this year to re-write our crawler
                                • the new re-written crawler will support SNI, be much faster and more reliable, and support many more configuration options inc. crawl speed, includes/excludes, UA (though some of these will not be available for the first beta)
                                • we will also be giving the UX and UI of the crawl a revamp in combination with this crawler
                                • whilst the SNI support works right now, we are ironing out some issues with the other parts of the crawler before we feel comfortable releasing it in beta
                                • we had hoped we would be able to show off the beta at MozCon this week but some recent changes have slowed us a little
                                • we will be offering a second free-trial for those who are not current customers and wish to try it again when it is ready

                                I appreciate your patience, we are very close and hope to have something soon.

                                TrueluxGroup 2 Replies Last reply Reply Quote 0
                                • AaronHemmelgarn
                                  AaronHemmelgarn last edited by

                                  Do we have a beta timeframe yet? It's been 3 months since the announcement that SNI crawl ability is coming and still no release. I have a very large client that I can't crawl their site. As a development company I can understand that good code takes time, but 3 solid months and really a over a year is what we're really looking at that Moz has known this was an issue.

                                  Please provide us (as customers) with a solid date that SNI will be supported. I don't think that's too much to ask.

                                  jon.white 1 Reply Last reply Reply Quote 2
                                  • RobinGeall
                                    RobinGeall last edited by

                                    And a vote from me too Jon, I would need to this before converting from trial.

                                    Good luck with it.

                                    1 Reply Last reply Reply Quote 2
                                    • John-Sharkey
                                      John-Sharkey last edited by

                                      Just another vote to see this happen.  I use SNI on some sites and a must have to be able to use Moz.

                                      As a side not, I am not seeing any Google crawl errors in using SNI, at least not in Google Search Console.

                                      1 Reply Last reply Reply Quote 0
                                      • jon.white
                                        jon.white @Globalgraphics last edited by

                                        Hi Phil - sorry you are seeing those errors.  I do not have a firm date, it will likely be in the next few weeks though.

                                        IWaldron 1 Reply Last reply Reply Quote -1
                                        • Globalgraphics
                                          Globalgraphics Subscriber last edited by

                                          Hi Jon, Do you have an update as to when the new crawler will be available. We have just started getting 804 HTTPS SSL error's for one of our sites.

                                          jon.white 1 Reply Last reply Reply Quote 0
                                          • jon.white
                                            jon.white @matthewnmartin last edited by

                                            Thank you. I look forward to sharing something.

                                            spadedesign 1 Reply Last reply Reply Quote 0
                                            • matthewnmartin
                                              matthewnmartin @jon.white last edited by

                                              Great, we would like to participate as some results are better than nothing. We filled out the form so i suppose we wait.

                                              jon.white 1 Reply Last reply Reply Quote 0
                                              • jon.white
                                                jon.white last edited by

                                                Thanks for your response.

                                                Firstly, I empathize with your decision to cancel, and I hope we can win you back in the future.

                                                In terms of why a customer might participate. Many of our customers who have SNI problems are still Moz customers, and still use our Rankings, Links and Keyword Research tools.  In this case, they would also be able to get some crawl data (albeit in a beta form) as a temporary fix whilst we finish the crawler.  We had already planned to launch a beta with select customers, we think this might also help us help some customers who are having struggles with our product.  But I realize this route is not for everyone.

                                                Please let me know if there is any other feedback you guys have about Moz.  jon@moz.com

                                                matthewnmartin 1 Reply Last reply Reply Quote 1
                                                • matthewnmartin
                                                  matthewnmartin last edited by

                                                  Thank you for the update. We have several sites that cannot be crawled and after a lot of investigation have concluded we would need to cancel Moz. I'm glad this is being released and submitted the form to be contacted regarding the Beta Testing.

                                                  I am curious though, what is in it for us? As of now we are paying for a service that does not work. I seriously doubt we will be interested in continuing to pay for a service just to be a test dummy (which one of the requirements is a paid account, unless I am misunderstanding).

                                                  Either way, we are excited about the solution and interested in learning more.

                                                  Thanks.

                                                  1 Reply Last reply Reply Quote 5
                                                  • 1
                                                  • 2
                                                  • 2 / 2
                                                  • First post
                                                    Last post

                                                  Got a burning SEO question?

                                                  Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.


                                                  Start my free trial


                                                  Browse Questions

                                                  Explore more categories

                                                  • Moz Tools

                                                    Chat with the community about the Moz tools.

                                                  • SEO Tactics

                                                    Discuss the SEO process with fellow marketers

                                                  • Community

                                                    Discuss industry events, jobs, and news!

                                                  • Digital Marketing

                                                    Chat about tactics outside of SEO

                                                  • Research & Trends

                                                    Dive into research and trends in the search industry.

                                                  • Support

                                                    Connect on product support and feature requests.

                                                  • See all categories

                                                  Related Questions

                                                  • Tom.Capper

                                                    Moz Q&A is closing, December 12th 2024

                                                    moz

                                                    After more than 13 years, and tens of thousands of questions, we’re finally closing Moz Q&A. Whilst we’re not completely removing the content - many posts will still be possible to view - we’re locking both new posts and new replies. Why? The truth is that the conversation has moved elsewhere. Sites like Twitter, Reddit, and more recently BlueSky and LinkedIn, have largely replaced specialist forums. At the same time, the challenge of moderating a platform like this has become more difficult, and of course, we’re SEOs, and the sheer quantity of new pages generated, often by malicious actors, has its challenges in terms of what it does to the profile of our site. Forums are still an opportunity for many sites, in SEO and more broadly, but the calculus no longer works for Moz. Where can I ask my question instead? If you’re a customer or currently evaluating a free trial, you can reach out directly with questions about the product to our customer support team here. If you want to learn more about SEO, you can check our learning resources here, and we also offer the Moz Academy. If you just want to hang out, you can also still find us on X, BlueSky, or LinkedIn. Thank you We’re grateful to everyone who has contributed to Moz Q&A over the years. It’s been a blast, and we hope this isn’t the last time we’ll see you here on the Moz site.

                                                    Moz News | | Tom.Capper
                                                    1
                                                  • somialvi

                                                    How to use Free Ai tools online

                                                    aitoolsonlinefree aitoolstonlinefree ai tools online free age calculator fancy text generator

                                                    Go to Google and search "aitoolstonlinefree. com" Enter a lot of free AI tools as per your need. And a lot of tools are coming soon...
                                                    ss 1 homepage.PNG

                                                    Moz News | | somialvi
                                                    0
                                                  • KristinaKeyser

                                                    Moz Acquired by iContact Marketing Corp

                                                    Exciting news, Moz fans! We are thrilled to announce that Moz has been acquired by iContact Marketing Corp! Check out Sarah and Michael's chat discussing the details in our blog post here, and please celebrate with us as we chart the future of Moz together.

                                                    Moz News | | KristinaKeyser
                                                    2
                                                  • ChiarynMiranda

                                                    Check out our new Performance Metrics beta in the Site Crawl tool in Campaigns

                                                    Hi there, You’re probably aware of Google’s upcoming algorithm update, which includes Core Web Vitals as a ranking factor and will now be released throughout summer 2021. With this announcement, it’s important that modern SEOs prioritize steps to ensure their site’s are user-(and search engine-)friendly. To help you get ahead of this, I’m super excited to announce our Performance Metrics beta – available for Pro customers on all plans, up to 6,000 pages per Campaign per month.
 You can check it out here. In the beta, you can streamline your technical audit workflows and analyze thousands of URLs of your choosing for Core Web Vitals and other performance metrics. You can also: Analyze performance on an ad-hoc basis, separate from full site audits Report on performance across mobile and desktop, at scale Understand performance in the context of other search data, like Page Authority, other crawl issues, and top pages from traffic See a breakdown of how many pages require fixes, need some improvement, or look good Filter and manipulate your performance data with CSV exports Analyze individual page reports for Core Web Vitals and additional performance metrics. Deep-dive into the opportunities on how to fix issues Receive powerful prioritization recommendations We have a list of features and functionality on our roadmap, but we'd love to hear your thoughts! Go check it out, analyze your important pages for performance, and comment below! Got questions? I’m also here to help. Also make sure to check out other helpful resources, like our Help Hub documentation, Learn Center content, announcement blog post, or our webinar “Make Core Web Vitals Your Competitive Advantage” with Moz’s Senior Search Scientist Tom Capper (recorded live on April 27.).

                                                    Moz News | | ChiarynMiranda
                                                    2
                                                  • jacob.butler

                                                    April 15, 2021, we'll be sunsetting Brand Mentions Monitoring in Campaigns and Keyword Explorer

                                                    You heard from me back in the fall about our plan to shift away from brand and mentions monitoring as a standalone feature when we made the decision to sunset Fresh Web Explorer. Based on customer feedback and usage trends we’ve decided to move forward with sunsetting the Mentions without Links feature within Campaigns and the Mentions module at the bottom of the Keyword Overview page in Keyword Explorer as well. This functionality has become a relic of the past and no longer provides as much value as it once did, nor as much value as other solutions in the market (or in Moz Pro) do for link building. On April 15th, we’ll be saying our final goodbye in order to make room for more valuable and innovative features on the horizon. We plan to add a better way to find easy link wins with Link Intersect. Currently found in Link Explorer, having this powerful research tool built directly into your Moz Pro Campaign (as well as Link Explorer) will make it much easier to find and report on who’s linking to your competitors’ sites, but not to yours–giving you the keys to understand which pages/content are attracting links from authoritative sites and identify sources for link outreach. If this planned sunset will pose a major disruption to your work, please let our Help Team know so we can do our best to accommodate. If you have questions, this is the place to be. I’m ready with answers!

                                                    Moz News | | jacob.butler
                                                    1
                                                  • Roxana_Nelson

                                                    MozBar Login Change Update + Firefox Temporarily Disabled

                                                    Hello! I wanted to give you all a heads up about some changes we will be making to the MozBar very soon. We will be making an update to the MozBar that will require you to log in with either a free Community account or with your Moz subscription to access link metrics. Don’t worry! We will never charge you for link metrics in the MozBar. Why are we making this change?
                                                    The MozBar has historically made use of a free endpoint in our Mozscape API. Unfortunately, over time, we have been experiencing increasing levels of abuse on this endpoint. For a long time, we were able to manage this mis-use but recently we have reached a tipping point whereby this malicious traffic is starting to degrade other legitimate API traffic and cause performance issues within our products. By asking you to log in to the MozBar with either a free Community account or a Moz subscription, we can ensure only authenticated users are able to use the MozBar. Also, if you don’t need link metrics, you can still use the MozBar. Logged out users will still be able to access on-page information. A note to Firefox users
                                                    With this change, we will temporarily disable the Firefox version of the MozBar. You may have noticed that the Firefox and Chrome versions of the MozBar are not the same. This is due to Mozilla’s review process, and us being unable to get new versions approved despite multiple attempts. Good news on the horizon! Firefox will start accepting Chrome-based extensions with the release of Firefox v48, which means soon there will be one version of the MozBar. When v48 is released, we will re-enable the MozBar in Firefox. In the meantime you can use the free Google Chrome version. Thank you for your understanding while we make these changes in the MozBar! Please feel free to let us know what you think, or ask questions, in the comments below. Thanks!
                                                    Roxana

                                                    Moz News | | Roxana_Nelson
                                                    11
                                                  • IanWatson

                                                    Our new index is live, and things are looking great for the new year!

                                                    Happy to announce to you all that our new Mozscape Index is fully live. We were so excited to beat our target date two months in a row and deliver the update early. Unfortunately, we ran into some minor crawl hang-ups towards the end and a now-identified upload issue -- that being said we are still very pleased with this most recent index, albeit being a day or so late. The December release has nearly 181 billion URLs, 5.5 billion subdomains and just over 1.25 trillion links*. Best of all, the crawl issues of previous months appear to be a dust in the wind and we are looking solid as ever on the backend. We hope the work we are doing helps better reflect the hard work you all are putting in to grow your clients and your own websites. Looking forward to another successful release a month from now! Happy Holidays! *More in-depth details on the index can be found here: December 15, 2015 Index Update **If you have seen any  Domain Authority and Page Authority drops since the index release, please see Rand's post on DA/PA fluctuation for more

                                                    Moz News | | IanWatson
                                                    6
                                                  Moz logo
                                                  • Contact
                                                  • Community
                                                  • Free Trial
                                                  • Terms & Privacy
                                                  • Accessibility
                                                  • Jobs
                                                  • Help
                                                  • What's New
                                                  • News & Press
                                                  • MozCon
                                                  © 2021 - 2024 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.

                                                  Looks like your connection to Moz was lost, please wait while we try to reconnect.