Senin, 19 April 2010

Help Google index your videos

Webmaster Level: All

The single best way to make Google aware of all your videos on your website is to create and maintain a Video Sitemap. Video Sitemaps provide Google with essential information about your videos, including the URLs for the pages where the videos can be found, the titles of the videos, keywords, thumbnail images, durations, and other information. The Sitemap also allows you to define the period of time for which each video will be available. This is particularly useful for content that has explicit viewing windows, so that we can remove the content from our index when it expires.

Once your Sitemap is created, you can can submit the URL of the Sitemap file in Google Webmaster Tools or through your robots.txt file.

Once we have indexed a video, it may appear in our web search results in what we call a Video Onebox (a cluster of videos related to the queried topic) and in our video search property, Google Videos. A video result is immediately recognizable by its thumbnail, duration, and a description.

As an example, this is what a video result from CNN.com looks like on Google:


We encourage those of you with videos to submit Video Sitemaps and to keep them updated with your new content. Please also visit our recently updated Video Sitemap Help Center, and utilize our Sitemap Help Forum. If you've submitted a Video Sitemap file via Webmaster Tools and want to share your experiences or problems, you can do so here.

The art of search results

We’re always honored and often surprised by the many ways people can be inspired by Google. Take for example artist Ken Solomon, who has done a series of watercolors of Google Image Search results, like this one:

Ken's "Google Portrait - Warhol 2"

Just as societies preserve important documents and works of art, archivists and historians are now developing ways to preserve digital ephemera, from tweets to book drafts, as part our cultural and global history. On a small scale, Ken is doing just that, and we’re intrigued by his creative method of preserving moments in time. We may not have majored in art history, but we like the “meta” quality of Ken’s paintings of search results for pop artists. From Brillo pad boxes to Google in under 25 moves...?

You can see more of Ken’s work on his website. And if you live in New York, Ken is exhibiting these pieces in a one-man show at the Josée Bienvenu Gallery until May 15.

Soaring into the cloud

Nearly 400 IT executives joined us last week for a discussion on the future of enterprise IT at Atmosphere, our first cloud computing summit at the Googleplex. It was an exciting day of conversation and debate about the power of the cloud. If you’re interested in seeing it for yourself, you can watch the public talks online:
  • Improving collaboration: Our opening keynote announced the next generation of Google Docs, setting the stage for an inspiring roster of visionary thinkers.
  • Forces for change: Author Geoffrey Moore and analyst Mary Meeker reflected on the role of IT and the emerging trends driving its evolution.
  • Cloud adopters: Executives from Google Apps users Motorola, MeadWestvaco, Seagate and Genentech shared their experiences migrating thousands of employees to what Motorola Mobile Devices VP of IT Walt Oswald termed “the new world of IT.” (You can learn more about why businesses have gone Google on the Google Apps YouTube channel.)
  • Expanding horizons: Cloud computing pioneers Marc Benioff, the founder and CEO of Salesforce.com, and Werner Vogels, the CTO of Amazon.com, expounded on the newest insights and innovations from their businesses.
  • Google product highlights: Google’s product leaders showcased some of the latest features in Google Apps, Chrome OS, Android and search, while Vint Cerf, Alan Eustace and Jeff Huber explored our vision for enterprise computing.
  • Beyond IT: Scientist Janine Benyus delighted the audience with her explanation of the biological imperatives for collaboration, and reminded us all that “life is a team sport.”
Atmosphere concluded with a public discourse between Eric Schmidt and Forbes National Editor Quentin Hardy:



The complete set of Atmosphere videos is now online, and you can learn more about our cloud computing solutions for businesses on the Google Apps website. We want to thank all those who participated in Atmosphere for their contributions to this unique experience!

Update 8:41PM: Removed video.
Update 4/20/2010: Added corrected video.

Controversial content and free expression on the web: a refresher

Two and a half years ago, we outlined our approach to removing content from Google products and services. Our process hasn’t changed since then, but our recent decision to stop censoring search on Google.cn has raised new questions about when we remove content, and how we respond to censorship demands by governments. So we figured it was time for a refresher.

Censorship of the web is a growing problem. According to the Open Net Initiative, the number of governments that censor has grown from about four in 2002 to over 40 today. In fact, some governments are now blocking content before it even reaches their citizens. Even benign intentions can result in the specter of real censorship. Repressive regimes are building firewalls and cracking down on dissent online -- dealing harshly with anyone who breaks the rules.

Increased government censorship of the web is undoubtedly driven by the fact that record numbers of people now have access to the Internet, and that they are creating more content than ever before. For example, over 24 hours of video are uploaded to YouTube every minute of every day. This creates big challenges for governments used to controlling traditional print and broadcast media. While everyone agrees that there are limits to what information should be available online -- for example child pornography -- many of the new government restrictions we are seeing today not only strike at the heart of an open Internet but also violate Article 19 of the Universal Declaration of Human Rights, which states that: “Everyone has the right to freedom of opinion and expression; this right includes freedom to hold opinions without interference and to seek, receive and impart information and ideas through any media and regardless of frontiers.”

We see these attempts at control in many ways. China is the most polarizing example, but it is not the only one. Google products -- from search and Blogger to YouTube and Google Docs -- have been blocked in 25 of the 100 countries where we offer our services. In addition, we regularly receive government requests to restrict or remove content from our properties. When we receive those requests, we examine them to closely to ensure they comply with the law, and if we think they’re overly broad, we attempt to narrow them down. Where possible, we are also transparent with our users about what content we have been required to block or remove so they understand that they may not be getting the full picture.

On our own services, we deal with controversial content in different ways, depending on the product. As a starting point, we distinguish between search (where we are simply linking to other web pages), the content we host, and ads. In a nutshell, here is our approach:

Search is the least restrictive of all our services, because search results are a reflection of the content of the web. We do not remove content from search globally except in narrow circumstances, like child pornography, certain links to copyrighted material, spam, malware, and results that contain sensitive personal information like credit card numbers. Specifically, we don’t want to engage in political censorship. This is especially true in countries like China and Vietnam that do not have democratic processes through which citizens can challenge censorship mandates. We carefully evaluate whether or not to establish a physical presence in countries where political censorship is likely to happen.

Some democratically-elected governments in Europe and elsewhere do have national laws that prohibit certain types of content. Our policy is to comply with the laws of these democratic governments -- for example, those that make pro-Nazi material illegal in Germany and France -- and remove search results from only our local search engine (for example, www.google.de in Germany). We also comply with youth protection laws in countries like Germany by removing links to certain material that is deemed inappropriate for children or by enabling Safe Search by default, as we do in Korea. Whenever we do remove content, we display a message for our users that X number of results have been removed to comply with local law and we also report those removals to chillingeffects.org, a project run by the Berkman Center for Internet and Society, which tracks online restrictions on speech.

Platforms that host content like Blogger, YouTube, and Picasa Web Albums have content policies that outline what is, and is not, permissible on those sites. A good example of content we do not allow is hate speech. Our enforcement of these policies results in the removal of more content from our hosted content platforms than we remove from Google Search. Blogger, as a pure platform for expression, is among the most open of our services, allowing for example legal pornography, as long as it complies with the Blogger Content Policy. YouTube, as a community intended to permit sharing, comments, and other user-to-user interactions, has its Community Guidelines that define its own rules of the road. For example, pornography is absolutely not allowed on YouTube.

We try to make it as easy as possible for users to flag content that violates our policies. Here’s a video explaining how flagging works on YouTube. We review flagged content across all our products 24 hours a day, seven days a week to remove offending content from our sites. And if there are local laws where we do business that prohibit content that would otherwise be allowed, we restrict access to that content only in the country that prohibits it. For example, in Turkey, videos that insult the founder of modern Turkey, Mustafa Ataturk, are illegal. Two years ago, we were notified of such content on YouTube and blocked those videos in Turkey that violated local law. A Turkish court subsequently demanded that we block them globally, which we refused to do, arguing that Turkish law cannot apply outside Turkey. As a result YouTube has been blocked there.

Finally, our ads products have the most restrictive policies, because they are commercial products intended to generate revenue.

These policies are always evolving. Decisions to allow, restrict or remove content from our services and products often require difficult judgment calls. We have spirited debates about the right course of action, whether it’s about our own content policies or the extent to which we resist a government request. In the end, we rely on the principles that sit at the heart of everything we do.

We’ve said them before, but in these particularly challenging times, they bear repeating: We have a bias in favor of people's right to free expression. We are driven by a belief that more information means more choice, more freedom and ultimately more power for the individual.

Imagery for Qinghai, China earthquake

(Cross-posted from the Google LatLong Blog)

On Tuesday, April 13, a powerful 6.9 earthquake shook the province of Qinghai, China, resulting in widespread destruction and the loss of more than 1,700 lives. Working closely with GeoEye, we’ve been able to acquire some high resolution post-earthquake imagery, which vividly illustrates the magnitude of this tragic event.

(click image to view full-size; click here to view in Google Earth)

To see more of this imagery, you can download the KML here and open it in Google Earth.

In addition, an international team, including many of our Chinese Googlers, have worked to create a Crisis Response page for the earthquake with several additional resources:
  • The China Person Finder tool, which can be used to submit or search for information about individuals who may have been affected. It is available in Simplified Chinese, Traditional Chinese and English, and is accessible on mobile. We encourage organizations and media sites to embed the gadget on their sites and help spread the word.
  • Google News and real-time search, which features posts to Twitter and other sources. This provides the latest information from authoritative sources and people on the ground.
  • A My Map to help users contribute data about Qinghai, such as the conditions in specific areas and rescue efforts underway.
The Chinese version of this page can be accessed from a link on our homepages on google.com.hk and google.com.tw, and we will continue to update the pages as more materials become available.

Updated malware feature in Webmaster Tools

Webmaster Level: All

A little over six months ago we released a new malware diagnostic tool in Webmaster Tools with the help of Lucas Ballard from the anti-malware team. This feature has been a great success; many of you were interested to know if Google had detected malicious software in your site, and you used the tool's information to find and remove that malware and to fix the vulnerabilities in your servers.

Well, a few days ago we promoted the malware diagnostics tool from Labs to a full Webmaster Tools feature. You can now find it under the Diagnostics menu. Not only that, we also added support for malware notifications. As you may already know, if your site has malware we may show a warning message in our search results indicating that the site is potentially harmful. If this is the case, you should remove any dangerous content as soon as possible and patch the vulnerabilities in your server. After you've done that, you can request a malware review in order to have the warning for your site removed. What's new in our latest release is that the form to request a review is now right there with the rest of the malware data:

Screenshot of the new malware feature in Webmaster Tools

We've also made several other improvements under the covers. Now the data is updated almost four times faster than before. And we've improved our algorithms for identifying injected content and can pinpoint exploits that were difficult to catch when the feature first launched.

On the Webmaster Tools dashboard you'll still see a warning message when you have malware on one of your sites. This message has a link that will take you directly to the malware tool. Here at Google we take malware very seriously, and we're working on several improvements to this feature so that we can tell you ASAP if we detect that your site is potentially infected. Stay tuned!

For more details, check out the Malware & Hacked sites help forum.


Jumat, 16 April 2010

This week in search 4/16/10

This is one of a regular series of posts on search experience updates. Look for the label This week in search and subscribe to the series. - Ed.

Rich Snippets for recipes
Rich Snippets are the brief annotations you see beneath search results that summarize what's on a webpage. In addition to Rich Snippets for reviews, people, video and events, this week we unveiled a new Rich Snippets format for recipes. This means that when your search results include sites with recipe content, you might see quick facts pertaining to the recipe in your search results, like preparation or cooking times, right on the search results page.

If you have a site with recipes and want to be sure Rich Snippets show up in search results for your page, check out our documentation on how to mark up recipe information as well as our general help articles on Rich Snippets. Bon appétit!

Example search: [baked ziti]

Enhancements to real-time search
This week, we launched a new feature in real-time search that gives you the ability to search and replay the public archive of tweets on Twitter. While real-time search usually focuses on what's happening now, our new feature is helpful for viewing the history of what happened in the past and how people reacted to a particular topic on Twitter. You can zoom into any point in time — from a year, to a month, to a half-hour — and "replay" tweets from as far back as February 11, 2010 (and soon, as far back as the very first tweet on March 21, 2006). To try this feature out, click “Show options” on the search results page, and then select “Updates.” You'll notice a new chart at the top of the page, where you'll be able to adjust the time range of the tweets you'd like to see. We hope you enjoy your trip down the 140-character memory lane.

Example search: [museum of modern art]

Oftentimes, there's great new content published to the web that everyone is talking about at one particular time. So, to help you find those sites, we also recently launched the top links for a set of update results, showcasing some of the top URLs that Twitter users are talking about based on a particular query. To view these links, click “Show options” on the search results page, and then select “Updates.” You'll see a list of links on the right-hand side based on your query.

Example search: [ipad]

Google Suggest and spell correction enhancements
We've recently made some enhancements that make it easier and faster for you to get the most relevant answer using Google search. We've begun to tailor Suggest to U.S. metro areas, so you'll find that the suggested queries are more locally relevant than they used to be. Try searching for [parks in], and you'll most likely see suggested search queries for parks that really are in your neck of the woods.

In addition, we've improved our spelling correction feature. Sometimes, when you search for something that we're highly confident you've misspelled, we'll take you directly to the search results page for the correct spelling without asking "Did you mean...?" This week, we made this feature available in 31 languages across over 180 domains across the globe. We've also made some changes to how this feature deals with misspelled names. We realized that often when you search for a person's name, you include descriptive words (say, the person's profession or company) that can provide valuable context. We use these extra descriptors to offer you better suggestions, so you should soon find this feature for names more useful.

Example search: [yuri lehner stanford]

Stay tuned for more updates next week.