Live indexing for Bing & Google coming to Yoast SEO

As we announced at YoastCon, we’re working together with Bing and Google to allow live indexing for everyone who uses Yoast SEO. In an update currently planned for the end of March, we’ll allow users to connect their sites to MyYoast, our customer portal. After that we’ll roll out live indexing, which means every time you publish, update, or delete a post, that will be reflected almost instantly into Bing and Google’s indices.

How does this work?

When you connect your site to MyYoast, you’ll authorize it to send messages back and forth. One of the types of messages that will be sent will be when you publish, update or delete anything on your site. We’ll pass that notification on to Bing, and Bing will check the changes within approximately one minute of you hitting the button.

You will not need to connect your site to Bing Webmaster Tools to do this. It’s all handled automatically. For Google the details on this are not entirely determined yet, but a Google Search Console account will probably be required.

We do, of course, recommend making use of both Bing Webmaster Tools and Google Search Console as they can give good insight into why your site is or is not performing well in the search engines.

If you’re reading this on Thursday (Feb 7, 2019), you might still catch one of Bing’s principal engineers, Arnold Overwijk, discuss this live at YoastCon through our live stream on Friday.

The post Live indexing for Bing & Google coming to Yoast SEO appeared first on Yoast.

Weekly SEO recap: Facebook search, Yahoo! & Google

This was quite the week in terms of search engine events. Yahoo! & Google doing a deal, Bing losing a key person, Google in yet another lawsuit, etc. etc. etc. And while all that seemed so important Thursday afternoon as I was writing this post, Facebook dropped the bomb of improving its search dramatically. Let’s dive in!

Joost's weekly SEO recap

Yahoo! has a search deal with Google, again

Yahoo!, which got its results and ads purely from Bing for quite a while, now has a deal with Google too. It said:

In October, the Company reached an agreement with Google that provides Yahoo with additional flexibility to choose among suppliers of search results and ads.

Google could serve these results for Yahoo! in a specific set of countries / regions:

Yahoo may use Google’s services on Yahoo’s owned and operated properties (“Yahoo Properties”) and on certain syndication partner properties (“Affiliate Sites”) in the United States (U.S.), Canada, Hong Kong, Taiwan, Singapore, Thailand, Vietnam, Philippines, Indonesia, Malaysia, India, Middle East, Africa, Mexico, Argentina, Brazil, Colombia, Chile, Venezuela, Peru, Australia and New Zealand.

Notice anything in that list? Hell yeah. Europe is missing. Let me put on my tin foil hat for a wee bit and say that maybe, just maybe, Google and Yahoo! knew that doing this in Europe would raise some serious anti competitive alarms with the European Union. Where have we heard that story before? Anyway…. The most comprehensive coverage of this story is to be found on SearchEngineLand.

Yahoo! has its own mobile algorithm?

You’d think Yahoo! has enough choices now, as it can chose between Bing and Google to serve its results. But apparently, it has its own mobile algorithm and serves its own mobile search results. This explains, at least in part, why Yahoo! is still crawling the web. I’m curious to see where this goes… Could be big, as Yahoo! is one of the few companies on the planet right now with the cash and the knowledge to actually build a search engine that matters.

There are a few other companies that could do search and do it well though… One of them being Facebook.

Facebook search gets real

Facebook just dropped a very splendid little bomb. It improved its search capabilities dramatically. This video speaks boatloads about their ideas for this.

I can’t stress enough how important this is. Google already has a problem with the amount of mobile searches people do, this will only decrease that number of searches. Because people don’t search less on mobile, they search elsewhere.

Facebook has a ton of data to search through. According to the Verge, Facebook has 2 trillion posts in its index. Personalized search (search adapted to your behavior, friends, etc.), which for Google has been something they’ve needed to grow into over the last few years, is something that comes very natural to Facebook. In fact, it would probably suffer if it had to make un-personalized search results.

This has a profound impact on how you share on Facebook: no longer can you just write something interesting. No, you should really make sure that your target keywords are shown in your Facebook description and in the title of your article as it’s shared on Facebook.

Bing suffers a loss

Bing is the little kid crying in the corner on all of this of course. They’ve also just lost one of their finest. My good friend Duane Forrester, their head of webmaster relations, is dropping the mic (his choice of image, obviously).

In this picture, taken at SEOktoberfest this year, Duane is the guy on the right, next to my wife Marieke:

Duane is the guy on the right, next to my wife Marieke.

Duane was the last man standing in terms of search engines talking to webmasters. Google’s Matt Cutts has been on extended leave for what seems like forever now and Duane was one of the very few that had actually seen the inside of running a search engine and also had true SEO experience. I hope Microsoft replaces him with someone capable.

Luckily I know I will see Duane again at SEOktoberfest next year and I wish him all the best in his new endeavors!

Other Google updates

The NY Times reports that Deutsche Telekom (the parent company to T-Mobile) is starting a new antitrust case against Google in the EU. This adds on to the already quite big stack of complaints against Google in Europe.

I’m waiting for the next court case now, the one in which Google and its sibling company Youtube are said to be abusing their market dominance to bring more paid subscribers to YouTube. Because that also happened this week; YouTube became a competitor to Netflix.

Finally, it looks like Google let loose a few more Pandas this week.

That’s it, see you next week!

joost signature

Weekly SEO Recap: Panda U-Turns, Yandex penalizes and Bing launches new tools

Joost's weekly SEO recapNew iPhones! Search news? Oh right… So… About that search news. Panda’s making U-turns, Yandex penalizing sites for selling links, Bing offering new keyword tools and more!

What happened to Panda?

Google announced a Panda 4.2 update that’d “very slowly” roll out a while back, we covered that. It seems as though, according to this post by Barry Schwartz at SearchEngineLand, the update has been reversed.

It could be that Google’s continuous user testing started giving lower ratings for their search results, indicating that Panda 4.2 was, in fact, not an improvement. Google didn’t comment, but it seems a plausible hypothesis. Looking at some sites myself in SearchMetrics, I definitely see… Weird behavior, visibility going up and coming down again, which could support this hypothesis.

Yandex penalizing link sellers

Yandex has announced that they’ve penalized a bunch of sites for selling links. I’ll spare you a link to the Russian blog post (oops you got it anyway) and give you a link to SearchEngineLand instead. It makes a ton of sense to make these kinds of adjustments, but it’s funny to see them come out of Yandex, who actually announced with some fanfare at the end of 2013 that they would stop using links (for certain commercial queries).

I think it shows how important links are to ranking algorithms and how hard they are to replace. So much that it’s worth cleaning up the signal by making adjustments like this.

Bing launched a new keyword planner

We write a lot about keyword research, as it is, truly, the basis of SEO. So when new tools arrive that help you do keyword research, I always get excited. Even more so when created by Bing as, historically, even though Bing drives far less search traffic, their keyword research tools have always been among the best in the business.

Bing announced a new keyword planner on Wednesday, available in your Bing Ads account. It’s worth creating a Bing Ads account just for that. There are historical statistics in there, suggestions for more keywords etc. etc. Of course, the best tool in doing keyword research is still your brain, but tools like these can help you get new ideas.

Index count in Google Search Console

One of the things you might be keeping an eye on while optimizing a site is the Index Status in Google’s Search Console. It shows the number of indexed pages for a site, and will usually remain static if you’re not doing too much. So it’s weird when that graph spikes or dips suddenly. Recently, it did, this is the graph for yoast.com:

search console status

Turns out that Google had a bug (the dip) and then changed how they calculate this number (the spike). There’s an “explanation” by Google here, but it doesn’t make sense, they just changed it. I’m hoping it’ll stay stable at the “new normal”, as that ways it’s the most reliable.

That’s it, see you next week!

joost signature

This post first appeared as Weekly SEO Recap: Panda U-Turns, Yandex penalizes and Bing launches new tools on Yoast. Whoopity Doo!

Weekly SEO Recap: Search landscape changes

Joost's weekly SEO recapThis weeks news has some drastic changes to the search landscape that could mean… Well, anything really. There’s also some smaller news about Google which is worth mentioning, so let’s dive in:

Microsoft Bing to power AOL Search

AOL Search, while relatively small, is still a thing. Microsoft just signed a deal to power it for the next 10 years, while giving a big part of their ads business to AOL. What’s more surprising to me is this news that came out on the side: Bing is now sustainable in itself. Microsoft has been pouring money into it for quite a while, as far as “we” knew, but now apparently “It’s a multibillion dollar business, and it does pay for itself”. Good news as that means they’ll keep on competing with Google!

Yahoo! testing Google

Yahoo! is testing Google as a provider for it’s search results, instead of Bing. First noticed by Aaron Wall at SEOBook, this could have quite some impact. SEOs should really watch what happens here mostly because it impacts how much traffic a good ranking in Google will give you. The reasoning is probably simple: Google ads are worth much more than Bing ads, so this would increase Google’s revenue. The fact that Yahoo’s Marissa Mayer is an ex-Googler probably doesn’t hurt in this deal either.

DuckDuckGo expanding

To show that search is alive and vibrant even outside these three historical enemies, DuckDuckGo is expanding their “suggest” feature to 34 new regions. They’re not exactly a big traffic driver yet, but I’m very happy to see other options grow slowly too.

Google becoming smart about Search Console

Google has put out some questions that are interesting as they show what they’re thinking about. This post has details, but this sentence specifically made me happy “To view a combined Search Analytics report that includes different URL versions of your site (http and https).” Yes. Please. www and non-www too and we’re about done if we can also verify them all at once.

The Panda is a “couple of weeks” away, we think

Nothing more fun than guessing when a new update is going to hit. People at Google estimating when it might happen are usually wrong, but the latest is “a couple of weeks“. We’ll see. Just know that it’s coming. Just like Winter.

Google in other languages

If you think about how Google’s algorithm works a lot, you’re bound to think “but how does that work in language X”. Welcome to the world of a polyglot. This post has some interesting insights.

SEO at Pinterest

I’ve been meaning to share this article (which was written in January) for a while, and keep forgetting. It details how Pinterest experiments with SEO. Fun read, might give you some ideas for testing.

 

That’s it, see you next week!

joost signature

This post first appeared as Weekly SEO Recap: Search landscape changes on Yoast. Whoopity Doo!

Weekly SEO Recap: Google & HTTPS, Bing no longer nice

Joost's weekly SEO recapAn interesting week this one, including an update that seems to have quite a bit of impact. There are also some nice new features in Google Trends, possible labels for slow loading sites and some more annoying news about Bing and keywords.

A Google update

It wasn’t Panda, it wasn’t Penguin, though both are still “to come”, but this week we had an update that gave several people in the SEO industry a shudder. Mozcast, which measures changes in the search results for a fixed set of keywords and calculates a “temperature” based on that, had one of its “warmest” days ever.

Dr Pete over at Moz wrote a post, thinking this change could be related to the HTTPS changes Google did earlier. This was quickly refuted by Googler Gary Illyes on Twitter. And of course, most SEO bloggers stopped thinking at that point and just wrote down that it wasn’t HTTPS related. I disagree with that. I think Googlers don’t necessarily always know anymore what causes something to happen.

Google’s algorithms are, in part, self-learning. They automatically determine factors that cause a site to be trusted. This week, Wikipedia started moving to HTTPS entirely. If more and more sites that Google trusts, like Wikipedia, the FBI and now also Reddit, all are on HTTPS, that factor might automatically become more important, simply because of that machine learning. So while Googlers might say they haven’t changed the algorithm, the algorithm might have changed itself. Note that Gary’s tweet said “AFAIK”. They do that more and more when talking about the algorithm. Simply because they don’t always know.

Of course, this is just a theory, and it would not explain all of the changes, but nothing ever does. My own thoughts on HTTPS haven’t changed much since January last year.

More Google news

Google did more this week. Google Trends got a nice update, including both real time data and data for YouTube. You should definitely just have a play with that for a bit. This Wired piece on it is good. Another interesting bit was that Google UK confirmed that more than half of their searches and YouTube views now happen on mobile. Have I reminded you to get your site ready for mobile enough now?

There was some fuzz the last few weeks about a Google backed company getting a penalty and then being reinstated in the search results within a week. Apparently John Mueller of Google said that everyone could get back this quickly. All you have to do is do a “fantastic job of cleaning these things up” and send in a “great” reconsideration request. I’ve spoken to a few SEO’s who do cleanups for sites that got penalized the same way this company did. No one had ever seen it happen, but that doesn’t mean it’s impossible.

Google is once again testing a “Slow to load” label in the search results. It’s hard to reproduce tests like that, probably in part because where I spend most of my time online, at work and at home, I have either 4G Internet or a 200 mbit fiber connection. Doesn’t really make sense for Google to show that label on those connections.

Another update from Gary Illyes making me kinda scared was this one. He said this:

Please be mindful with noindex directives and remember that most search engines will honour it, even if it’s in the BODY element.

Which brings back all sorts of bad thoughts in me, wanting to leave meta robots noindex elements in comments on posts. It’s a good reminder nonetheless. Another tweet from Gary pointed to new breadcrumbs documentation, unfortunately it doesn’t answer some of the questions I had from the old documentation so I’ve send another email to Google.

Bing stops being nice

I’ve always had a soft spot for Bing, in part because they employ Duane Forrester, who is a great guy doing Webmaster outreach there. I have to admit they’ve made me lose some of those warm feelings this week when they announced they were no longer going to pass on search queries (part of them also moving to HTTPS completely). In their words:

to further protect our users’ privacy, we will not include the used query terms.

I think that’s nonsense, because just like Google, they will give them to advertisers. I wrote a scathing piece about that on SEObook when Google announced that in 2011. This is no different. Of course Bing doesn’t really send most sites that much traffic anyway, so most of you won’t (and/or shouldn’t) care.

That’s it for this week!

We still have an action on our site reviews, for a little while longer you can get $100 off. See you next week!

joost signature

This post first appeared as Weekly SEO Recap: Google & HTTPS, Bing no longer nice on Yoast. Whoopity Doo!

Bing Webmaster Tools: Security, Widgets and Messages

Bing Webmaster Tools: Security, Widgets and MessagesCompared to the first three sections, the last three are relatively small. In this final post in our series on Bing Webmaster Tools we will go over Security, Malware and Messages and share our findings.

Security

Making sure your website is secure is of course really important. We have already emphasized this on our page on WordPress security, of course. This section is about the security alerts in Bing Webmaster Tools.

Malware

Malware is software that is intended to damage or disable computers and computer systems. For a website, this usually means software that is left on your website, usually in a file on your server. It’s software that is left there without your knowledge. If you find an alert in Bing Webmaster Tools about malware on your website, you should clean your site as soon as possible.

Bing Webmaster Tools divides the malware into two categories: malware found on the page and malware reference found on the page. In the first case, there is an immediate issue to be solved on the page with the listed URL, in the second case, there is a resource linked on the page at that URL that has malware. The page itself isn’t infected in that last case.

Bing Webmaster Tools lists a couple of malware issues:

  • Malware Network Reference: any trace of a known malware distribution network is detected on your website.
  • Browser Exploit: malicious browser exploit detected, which may cause unsolicited execution of external code.
  • Malicious JavaScript: in a page or one of its attached script of frames, malicious JavaScript is detected (f.i. a spammy redirect).
  • Malicious ActiveX: ActiveX interactions seem to trigger malicious activity.
  • Heapspray: Bing detected a potential preparation for a browser exploit via a heapspray.  Heapspraying is a technique used in exploits to facilitate arbitrary code execution.
  • Malware Found on Adjacent Pages: URL is in a folder or subdomain containing malware.
  • Malware Reported by External Source: external sources reported that malware, obviously.

Sucuri is our and your friend in this. Hire these guys to clean up your site. After that, you want to address the vulnerability that allowed the malware to be installed. Simply download the Sucuri plugin and follow their step by step instructions and guidance on how to secure your website (sections Hardening and Post-Hack in that plugin).

And only after this, you should Request a Review in Bing Webmaster Tools to have them check again for the presence of malware.

Track Certificates beta

Yet another beta in Bing Webmaster Tools: Track Certificates. This page will tell you all about the certificates that were requested by people visiting your site. The main purpose of that list is so you’ll be able to spot unexpected or suspicious certificates, so you can report them to Microsoft using the Report link.

This will also include security certificates like the ones we have on our website:

Bing Webmaster Tools: Track Certificates

Widgets

In their competition struggle with Google, Bing has released a number of additions for your website that should make your life better. Two of these are in Bing Webmaster Tools and we’ll discuss both briefly.

Knowledge Widget beta

Bing explains the knowledge widget like this:

For the first time, we empowered every webmaster to use the entity data from the Bing Knowledge repository. Since then, webmasters have added the embed code to thousands of pages to enhance their websites with the rich entity information from the Bing Knowledge system.

Yes, the Bing Knowledge information is similar to the Knowledge Graph in Google (Bing added it first, by the way). It’s a separate block of content but now on your website itself! It works really simple: while the visitor goes over your website, the widget detects related entities in real time, marking them with a little Bing charm. Now I do understand the social value, but feel that this is a bit like the pop-up ads in texts / on links that were briefly popular a couple of years ago. But hey, I might be wrong. Bing tells us that this is improving engagement, time-on-site, and user satisfaction.

Adding the widget is simple: add your URL, copy the provided code and paste it for instance right before the </body> tag in your template. Options are available for displaying images, images and links, just links. Besides that, there is an option to only activate the Bing Knowledge information on text selection by a user. It looks like this (example from Bing itself):

Bing Webmaster Tools: Knowledge Widget

It’s a collapsible sidebar on your website.

At the moment of writing, this is only available for English entities.

Translator Widget

This Translator Widget could be useful, and is similar to the Google Translate option that is on a lot of websites. It only requires a simple copy/paste action and you are good to go. There is even a WordPress plugin to help you out.

You can set the language of your website, and tell Bing to automatically translate based upon the visitor’s browser language, or have the visitor pick the language himself.

I’m not a big fan of these widgets, Google or Bing. I understand that these are ‘convenient’, but rather see people putting some effort (or money) in a decent translation. Go read our post on hreflang. It’s not that hard.

Messages

Preferably this section looks like this:

bwt-no-messages

Bing sends five types of messages:

  • Administrator: if anything changes to the Bing Webmaster Tools service, the administrator will inform you about it.
  • Crawl errors: if an error occurs during the crawl of your website, Bing Webmaster Tools will automatically tell you about it.
  • Index issues: if Bingbot has any problem indexing your site, a message will be sent as well.
  • Malware: following the section on Malware, you’ll receive a message here that malware has been found.
  • Bing Ads: automatically generated messages about Bing Ads.

The Current and Archived sections at Messages are self-explanatory.

Bing Webmaster Tools: It’s a wrap!

With this post, we conclude our series on Bing Webmaster Tools. We have compared Bing Webmaster Tools to Google Webmaster Tools a couple of times during these four posts. Is that a fair comparison? For me it was like having Skippy sandwiches every day and then trying a jar of Peanut Butter & Co. It’s different, but the same product. One could say variety is the spice of life, but in this case I tend stick to Google Webmaster Tools for the larger scale and user base, although the Markup Validator tool in Bing Webmaster Tools will come in handy now and then for quick checks!

For more reading on Webmaster Tools, please find all our related articles here.

This post first appeared as Bing Webmaster Tools: Security, Widgets and Messages on Yoast. Whoopity Doo!

Bing Webmaster Tools: Diagnostics & Tools

Bing Webmaster Tools: Diagnostics & ToolsBing Webmaster Tools provides a number of tools to analyze your website. Somehow, they managed to squeeze these into one page in Bing Webmaster Tools as the dashboard page for the section Diagnostics & Tools. Fortunately, all tools also have a separate page…
In this post, we will go over all tools and tell you how to use these to your advantage.

This is already our third article on Bing Webmaster Tools. In case you have missed the first two, go read these here:

Keyword Research beta

Out of the five tools described in this article, Bing classifies most as ‘beta’. With all these tools, we also have to keep in mind that we are dealing with data from organic search at Bing. Let’s start with the Keyword Research tool:

Bing Webmaster Tools: Keyword Research

I have tested this tool using a number of WordPress SEO related keywords for our website. As you can see, you can set a country and language, as well as a time frame from your research. I chose the US, US English and changed the default last 30 days to January 2015. Note that, as with Google Webmaster Tools, there is a gap between today and the end of your data; Bing Webmaster Tools goes up to 3 days ago.

The tiny ‘Strict’ option in there is to determine whether you want the research to be done for exact phrases or phrases containing the keyword. As I’d like to investigate general keywords (WordPress, plugin, seo), I have left this option unchecked:

Bing Webmaster Tools: Keyword Planner

All results can be sorted, by the way. Just click the (blue) title of a column. First thing that comes to mind is that the Google Keyword Planner shows 550K searches for WordPress in January 2015. Bing Webmaster Tools shows 60K. We’ve already mentioned that the search volume in Google’s keyword planner isn’t always useful, and the same must apply to these Bing numbers.

Buy KeywordThe $-icon behind the keyword is a hint. You can actually buy the keyword here directly. That’s pretty straightforward :)

I still feel that if you properly optimize your website, you can get more clicks as well from organic results. Not trying to ruin your revenue model here, Bing. Paid results seem to work fine if you have narrowed down your niche and target these specific visitors. If the ad / paid result tells me what I need (to know), I’ll click it without a doubt.

In the first table, you see search volume and trends. These are not just going up, by the way :) If you choose a longer period of time, it also won’t be just a straight line :) It will tell you what the rise or drop in search volume is as well.

You can click all the results, but doing so will just filter the results, it won’t give you more details. By the way, just to be complete, you must have seen the Suggestions as well in the screenshots above. These keywords are additional keywords, related to your original keyword by relevancy.

It’s a nice tool, but being used to the keyword tools we normally use, this isn’t one I’ll use very often. Perhaps the release version will have some features that will make it more attractive?

Link Explorer

This is Bing’s alternative for MajesticSEO, OpenSiteExplorer and more backlink tools like that. It allows you to find all backlinks known to Bing for any site. It has a few filters:

  • Filter by site: only pages on your website linking to that URL.
  • Anchor text: only links that use this anchor text.
  • Additional query: only pages that link and that rank for the search keyword as well.
  • Scope: links to the URL entered only or all pages from that domain.
  • Source: only links from the site at hand (internal) or all links to that URL (external).

For that last one, you probably want to use the inbound link tool at Reports & Data instead. It’s more comprehensive and for instance provides you with the exact anchor text for each link.

The result of the Link Explorer tool is something like this:

Bing Webmaster Tools: Link Explorer

Clicking the Source URL will perform a link analysis in Bing Webmaster Tools for that domain, clicking the title will get you to the website itself.

What I am missing here is total search volumes, and some more details on the domain. MajesticSEO adds Trust and Citation flow, Moz’ OpenSiteExplorer adds both page and domain authority. Right now, the filters are what making this section on Bing Webmaster Tools interesting, not per se the (outcome of the) general exploration. if I wanted to check all the pages that link to our domain using “WordPress plugins”, this tool works fine.

Fetch as Bingbot beta

Like Fetch as Google, this will tell you how the search engine bot sees your website. Simply enter your URL and click Fetch:

Bing Webmaster Tools: Fetch as Bingbot

After the fetch is done, status will change from Pending to Completed. Now you can click the Status and see how Bing sees your website (clicking the URL will simply get you to the page itself). Where Google Webmaster Tools actually renders your website as well, Bing displays the server response and your source code, as seen by Bingbot, of course. It will tell you if a page is redirected, or blocked by your robots.txt, for example.

Markup Validator beta

I really like this one, to be honest. As it is totally unrelated to search traffic in terms of volume, this tools is a nice substitute for Google’s Rich Snippet Test tool. I don’t know if it is just getting used to something new, but I liked the clean setup of that Google tool like it was a few weeks ago. Bing tells me just what I need to know; is schema.org implemented correctly?

Bing Webmaster Tools: Rich Snippets Test

It is. It will also tell you about RDFa, which you still want to use for breadcrumbs, for instance. Nice extra is that this Bing Webmaster tool also extracts the OpenGraph data.

And yes, I understand the new Google test tool explains what is wrong (according to Google, that is*), but if you just want to see what schema.org / RDFa / OpenGraph is on a page, this tool actually works just fine!

* The Rich Snippet Test tool keeps on telling me to link the last element in my breadcrumbs, but why should I link to the page the visitor is already on? From a UX stand, that seems odd…

SEO Analyzer beta

There we go: Bing Webmaster Tools gives you a free SEO analyzer to cover all the basics (for more in depth analysis, check our site reviews).

You can simply insert a URL and see what basics can be improved. This is very much like the HTML Improvements in Google Webmaster Tools. There is also some overlap with the SEO Reports in Bing Webmaster Tools, but the SEO analyzer is a single page analyzing tool.

Bing Webmaster Tools: SEO Analyzer

It will tell you if H1’s are missing, which images lack ALT tags and for instance if a page is missing language information. I especially like the way it is displayed, with a direct reference to the ‘error’ on the Analyzed tab on the right:

Bing Webmaster Tools: Missing ALT tag

Two things to keep in mind when using the SEO Analyzer:

  • SEO Analyzer, unlike Bingbot, will ignore robots.txt directives, so you can basically check any page on your site.
  • SEO Analyzer follows any redirect and analyzes the page it end up on. It will tell you that a redirect is detected and followed (right below the SEO Suggestions).

Verify Bingbot Tool

So why would you want to know what IP address the Bingbot is? Well, the Bingbot might be ‘overcrawling’ your website, unintendedly sending more than the usual server load your way. With this tool, you can verify if the IP address that is causing this load, is indeed Bingbot, which is needed for your support request. By the way, Bing does respect that crawl-delay line in your robots.txt. That might already help.

It seems to me that this tools should be incorporated in a workload. The fact that it is displayed here as a separate section, seems a bit too much honor for that tool.

Site Move

If you are moving your site to a new domain, be sure to let Bing Webmaster Tools know. It’s pretty easy:

Bing Webmaster Tools: Site Move

Just make sure both sites are verified. This can be done for entire domains, subdomains and directories. If you are moving a larger part of your website, like yoast.com/plugins to yoast.com/wp-plugins, this is also the section where you can see if all went well. Note that this is just a notification, it has nothing to do with actually moving a site or directory.

That’s section three of Bing Webmaster Tools

When comparing Bing Webmaster Tools to Google Webmaster Tools (and of course we do), this section holds some nice surprises. As mentioned, I like the simplicity of the Rich Snippet test, and the way the SEO Analyzer highlights the improvements on your page.

As mentioned in our earlier posts, I’d never replace Google Webmaster Tools entirely by Bing Webmaster Tools, but a combination of might have its benefits. In the next post in this series, we will cover the remaining three sections of Bing Webmaster Tools we’d like to discuss: Security, Widgets and Messages.

This post first appeared as Bing Webmaster Tools: Diagnostics & Tools on Yoast. Whoopity Doo!

Bing Webmaster Tools: Reports and Data

Bing Webmaster Tools: Reports & DataIn this second Bing Webmaster Tools post in our series on Webmaster Tools, the focus is on reporting. We’ll be going over a number of pages, and try to explain what information is available and how this can help you improve your website. Or get new insights about your audience, of course. This section is called: Reports and Data.

Note that although we very much like the ‘broader’ setup of Bing Webmaster Tools, I personally tend to use Google Webmaster Tools first for one simple reason. Google dominates the search engine market. There is data from much more users in Google Webmaster Tools. Having said that, there are a lot of things in Bing Webmaster Tools that could be used to further improve Google Webmaster Tools. Now let’s go over the different chapters in this section of Bing Webmaster Tools.

Site activity

As you can see in the graph below (upper right corner), Bing Webmaster Tools combines data from Yahoo! and Bing for these stats. It also painfully highlights the difference in use of the webmaster tools: as you can see, our website gets around 80 clicks a day from Bing and Yahoo!, compared to about 9,000 clicks on average per day from Google.

Bing Webmaster Tools: Site Activity

In the chart, you can also choose to show a number of other things:

  • Clicks from Search
  • Appeared in Search
  • Pages Crawled
  • Crawl Errors
  • Total Pages indexed

It’s nice to align the number of pages crawled and the crawl errors, but as with most graphs like this, it’s the trend that matter the most to me here. If all of a sudden the graph flatlines at zero (except at the crawl errors), there must be something wrong.

Page Traffic

Let’s start with the main table here:
Bing Webmaster Tools: Page Traffic
There is a lot going on here, right? All the arrows and numbers tell you what happened with for instance the Clicks from Search, and how often you appeared in search. For your convenience, Bing has divided the clicks by the appearances, giving you the click-through rate (CTR).

The average search click position tells you the position your result was when clicked, on average. The trend is key here. If the average position gets closer to #1, you know you are doing well, as your page is increasing it’s ranking for ‘that’ search term. This highlights the main issue: you need to combine this with the Search Keywords in the last column to be useful. Just click View, as Bing Webmaster Tools presents these keywords in a convenient popup:

Bing Webmaster Tools: Traffic Details

Who’s ‘youst’, right? I can’t get used to that downwards pointing arrow with a number, it’s like we dropped 675 clicks. But that’s not what is meant. We had 675 clicks from Bing search result pages to our homepage where the search keyword was ‘yoast’, and that is a drop from the beginning of the selected time period.

This is also where you can check the performance per position in the search result pages. Just click the ‘+’ in front of the keyword:

Bing Webmaster Tools: Traffic Details, positions

Back to the main table for your Page Traffic. The last column we haven’t mentioned yet is Average Search Appearance Position. In most if not all cases, this number is higher than the average click position, simply because we all know the higher the position, the more clicks.

Index Explorer

This is your Mac Finder or Windows Explorer for all things Bing found in your website or site’s structure. It’s how Bing sees your site. You can see files Bing considers 301 Redirects or 404 Error pages, for instance. There are a number of filters here, listed as the blue links below. Next to that, you can use some custom options:

Bing Webmaster Tools: Index Explorer, robots.txt

Strange thing is that our robots.txt is actually updated a while ago already. Where Google tends to find these updates within a day, sometimes hour, Bing still shows some old content in here. We re-fetched the robots.txt during the writing of this article, just to make sure. The fetch shows the current content of our robots.txt. I’m sure Bing Webmaster Tools will find that eventually.

Search Keywords

Much like the Page Traffic table, this table shows you the number of clicks from search results in Bing, as well as all other things explained there. It are keywords instead of URLs in this table, but that is the main difference.

Bing Webmaster Tools: Search Keywords

As you can see, that last column is different. You can view the pages instead of keywords (at Page Traffic). So it’s basically the same table, but the other way around :) Use to your preference, so to speak.

SEO Reports

Why order a site review when you have Bing SEO Reports. [promo] Well, for one thing, we tell you much more about stuff from speed to design, from content to social. [/promo] Bing SEO Reports in beta, but does provide some nice insights. We need to work on our meta descriptions, according to this overview:

Bing Webmaster Tools: SEO Reports

I especially like the fact that Bing tells you how they consider these suggestions to influence your SEO. Bing agrees with Google that meta descriptions are like invites to your website that should have a clear message about the contents of the page and tells that the severity of these meta descriptions is high. The fact that the meta description is missing, isn’t bad* per se, but it’s good to know where these are missing. You can easily click the suggestion title to find the pages these should be added.

Bing Webmaster Tools has taken the time to add a proper explanation to all these suggestions:

Bing Webmaster Tools: SEO Analysis Detail

If you click one of the (50, it’s limited to that) links on that Detail page, you’ll be taken to a SEO Analyzer (also in beta). More on that SEO Analyzer in our next post on Bing Webmaster Tools.

It seems our knowledge base – we’re using HelpScout’s awesome Docs – is missing meta language information. I can imagine that being so due to their global user base. In that case it’s a good thing language isn’t templated.

All in all, this is a very useful section you can use for some basic SEO check of your website.

* in case you can’t come up with a proper meta description, let Bing (or Google) decide. Both will create a meta description that in most cases is constructed from a text snippet containing the keyword used in search. This can be beneficial for conversion, as you will understand.

Again, the details make this a useful section. On the dashboard page of this section, the total number of inbound links (links to your website), doesn’t say much, unless there is a break in the trend. Right below the graph, you’ll find target pages. Clicking one of these gives you an overview of the pages linking your specific page:

Bing Webmaster Tools: Link details

As you can see, this includes the anchor text. There are up to 20,000 external pages listed. As the popup isn’t suitable for that number of links, the export option in the upper right of the popup comes in really handy for further analysis. Bing Webmaster Tools offers that export option on almost all pages, by the way.

Crawl Information

This is a quick overview of error codes (like 404, 502), Redirects (301, 302), DNS failures, connection timeouts and robots.txt exclusions. All is grouped per category:

Bing Webmaster Tools: Crawl Information

Click the row marked with * in Bing Webmaster Tools to find all URLs that resulted in that error, are redirected, etc. It’s nice to see if all pages you have excluded are indeed excluded, for instance. Clicking a link in this table isn’t providing more information, but gets you to the page at hand to check f.i. if the error or redirect still exists. As mentioned right above the table, Bing refers you to the Index Explorer for more details. It would be nice if I could mark a 404 as fixed here, by the way (in case any of the Bing people reads this).

Malware

Score.

Bing Webmaster Tools: Malware

In case Bing detects any malware on your website, it will list the URLs of potentially infected pages here.
Malware (short for malicious software) is “any software used to disrupt computer operation, gather sensitive information, or gain access to private computer systems.” (Wikipedia). Of course you don’t want that on your website.

In the unwanted case you have some URLs listed here, fix the malware or have our friends at Sucuri clean this up, and Request a Review via this same section in Bing Webmaster Tools.

That concludes this section in Bing Webmaster Tools

To round things up, the Reports & Data section in Bing Webmaster Tools gives you a lot to work with. Be sure to add your site to Bing Webmaster Tools and check this section to learn more about what can be improved for your website.

If you have any additions or remarks, these are more than welcome. If you are an absolute Bing adept, please let us know what hidden gems you have found in the Reports & Data section in Bing Webmaster Tools!

This post first appeared as Bing Webmaster Tools: Reports and Data on Yoast. Whoopity Doo!

Bing Webmaster Tools: Configure My Site

Bing Webmaster Tools - Configure My SiteWe recently did a series about Google Webmaster Tools. So we thought it was time to do a series about Bing Webmaster Tools as well. Bing isn’t that big in The Netherlands, or Europe, for that matter, but it still holds some ground in the US. The most important reason, however, is we think Bing Webmaster Tools is pretty awesome. It offers some really nice tools and details you, unfortunately, won’t find in Google Webmaster Tools (anymore).

In this post we’ll go into the first main menu item of Bing Webmaster Tools and its subitems. But first, we’ll explain how you can set it up for your own site!

Setting up Bing Webmaster Tools

Since Bing Webmaster Tools is probably less known than its Google counterpart, we’ll let you know how to set it up! So lets start with the beginning.

You need a Microsoft Live account

Don’t worry, this doesn’t mean you’ll need an @outlook.com or @hotmail.com email address. You can actually use any email address you like. Go here to sign up for a Live account and just follow the steps.

Once you have a Live account, you can go to Bing Webmaster Tools and sign in with the account you just created.

Add your site

After logging in to your Bing Webmaster Tools, you obviously need to add your site:

Bing Webmaster Tools - Add your site

Fill in your website’s URL here and click ADD. This will take you to this screen:

Bing Webmaster Tools - Add your site and sitemap

If you already have a sitemap and you’re aware of it, you can fill in the sitemap here as well. We recommend just leaving the last option on the default, for now. Now you can click the “ADD” button again. Doing this will take you to the following screen:

Bing Webmaster Tools - Verify ownership

And this is where the fun comes in. All of this might seem very technical and way over your head. However, if you’re using our WordPress SEO plugin, this is all very easy. Simply copy the entire part in the grey bar and paste it in our plugin here:

WordPress SEO Setting up Bing Webmaster Tools

Hit “Save Changes” and it’ll remove everything it won’t need, just your ‘key’ will remain. After that hit verify back in the Bing Webmaster Tools setup. If you have some caching, this might not work instantaneously; clear your cache or wait for a bit until you can verify it.

Once you’ve verified it, you’ll be able to access your Bing Webmaster Tools!

Configure My Site

When clicking the ‘Configure My Site’ menu item, you’ll be taken to a dashboard overview of all that you can do in this menu item. You can even do most things right there in the dashboard, which makes it the go to place, once you know what it all does ;)

So lets get to explaining what you can play with in Bing Webmaster Tools.

Sitemaps

The sitemaps menu item is about just that: sitemaps. Here you can (re)submit, remove or export sitemaps. Adding a sitemap is simple, just copy the sitemap’s URL, paste it in the appropriate bar and hit Submit. As with Google, if you have multiple sitemaps under a sitemap index (as our WordPress SEO plugin does for you), you just have to add the sitemap index.

If you’ve added a sitemap index, just clicking that index sitemap’s link will take you to all underlying sitemaps. You can also see whether any errors occurred when crawling your sitemap, when it was last crawled and how many URLs were submitted through the sitemaps, for instance.

Submit URLs

In this section you can add URLs of pages that you think are important directly into the Bing index. This feature is limited to 10 links a day and 50 links a month per domain. Whether this actually makes sure your content is indexed more quickly than through your sitemaps, for instance, remains a bit unclear.

Ignore URL Parameters

URL Parameters are anything after the normal URL, so usually anything after a question mark in your URL. If you want Bing to ignore any of these parameters, you can tell them here. Just to be clear: this will ignore only the parameters, it’ll literally remove the parameters from the URL before adding the page to the index. So this does not mean any URLs with these parameters will not be indexed, you should do that in the Block URLs section.

A URL with parameters is actually viewed as a different URL as the same one without parameters. So “https://yoast.com/?utm_source=” etc… would actually be considered a different URL than just “https://yoast.com/”, even though they end up at the same place. So using this feature can prevent duplicate content.

Crawl Control

This is one of the more nifty tools in the Configure My Site section of Bing Webmaster Tools. You can tell Bing when to crawl your site more and when to crawl it less:

Crawl Control Bing Webmaster Tools

They have some preset crawl rates, which are made to prevent an overload of your server. So when your site is busy, they’ll crawl your site less, and when it’s less busy, they’ll crawl more. However, you can also set a custom crawl rate. Just click in the graph to increase or decrease the crawl rate.

Note: If you have any info on crawl rate specified in your robots.txt, that will take precedence over anything you set up here.

Deep links are the Bing equivalent of Google’s Site Links. If you don’t know what those are either, they’re all the links in the pink block:

Bing Webmaster Tools - Deep Links

In the Deep Links section you can block pages from showing up there. What’s nice about Bing here, is that they allow you to remove the URL showing as a deep link for all URLs, a specific URL or even for a specific country or region.

What’s not so nice about Bing here is that they limited this block to 90 days. The block can be extended, but that means you have to revisit your webmaster tools every 3 months to extend the block you set.

Block URLs

The Block URLs section is very similar to the Deep Links section, in that it blocks URLs from showing up in the Bing search results. Adding a URL here will block the URL from showing up anywhere in the search results of Bing, though.

Annoyingly, they’ve again set the block to a maximum of 90 days, so you should only use this feature if you’ve just deleted a page from your site. Any permanent pages you want to block should be blocked in robots.txt.

Page Preview

The page preview is just that: a preview of your page. Bing doesn’t show this page preview everywhere, but they do in for example Bing Smart Search in Windows. You can tell Bing to refresh or remove the preview of a specific URL here. Just fill in the URL and click Fetch. You’ll then be given a choice to either block the preview or refresh it.

Disavow Links

Here you can disavow links you got from other websites. If you don’t know what disavowing a link means, read the post by Michiel on cleaning up bad backlinks. The best feature here by far is that you’re able to disavow not only a single page link, but also complete directories or domains. This can save you a lot of time when cleaning up your backlinks.

Geo-Targeting

In this section you can set a geo-targeting for your domain, subdomain, directory or page. Geo-targeting means you tell Bing the part of your website you selected is meant for a specific region or country. For instance, if we had a German version of yoast.com under yoast.com/de/, we’d set the geo-targeting for the yoast.com/de/ directory to Germany. This doesn’t mean it won’t show in Bing results in other countries, it just makes it more clear to Bing what people should be seeing the content.

One note about this: although you can set geo-targeting for your domain, if your domain has a country-code (.nl, .de, .co.uk for instance), geo-targeting your entire domain won’t work. Directories and pages can still be geo-targeted.

Verify ownership

If you need to verify your website again, you can do so here.

Connected Pages

Under Connected Pages you can tell Bing any social media presences you have elsewhere. By connecting these pages to Bing Webmaster Tools, you’ll be given quite some nice insights. For instance, we’re able to see how many times our twitter account appeared in search and how many times people clicked those appearances. We can even see what keywords people used to get our twitter account to appear, how many backlinks our twitter account (or status updates) has and what anchor texts were used for those links.

App Linking

Here you can link any apps you’ve connected in the Connected Pages section to Bing search results on Windows and Windows Phone. As we don’t have any experience with apps, I’d love to hear your thoughts on what this does exactly! ;)

Users

Here you can manage the users that have access to Bing Webmaster Tools for the current site.

What do you think?

Although Bing is definitely used less than Google, their Webmaster Tools are actually pretty awesome. So if Bing gives you a relevant amount of traffic to your site, it’s definitely something you should check out!

Do you agree? Let me know in the comments!

The next post on the next main menu item in Bing Webmaster Tools, written by Michiel, will be published tomorrow.

This post first appeared as Bing Webmaster Tools: Configure My Site on Yoast. Whoopity Doo!