Skip to main content Skip to secondary navigation
Main content start

Web searching -- now with SDR content!

We've enabled web crawling for SDR content. Find out more about what SDR content you can expect to find and where when searching the web.

One of the most frequently asked questions about depositing in the Stanford Digital Repository (SDR) is "will my content show up in web searches?" You use the SDR so you can share your work with others. It makes sense that you want to be sure people will find it when searching the web.

We are pleased to announce that we have enabled web crawling of PURL (persistent URL) pages for a core set of SDR deposits. We've included high-value and high-priority content whose depositors we know are eager to see their content made more discoverable on the web.

The following materials, totaling approximately 11,000 works and including text documents, research data, and video, are now open to web crawlers:


In addition to allowing crawling of the above materials, we've also updated our PURL pages to improve the chances that appropriate content will be picked up by Google Scholar and Google Dataset Search, and to provide rich results for video.

Check out some of our content that Google is now picking up, and an example of a dataset that is now being picked up by Google Dataset Search. 

We'll be continuing to monitor this content to see how our efforts are paying off and whether further enhancements are needed. We look forward to allowing the crawling of more or our content in the future!

In the meantime, happy searching!

If you're depositing content in the SDR and are eager to make sure it gets picked up by web crawlers, here are some things YOU can do to help improve the odds:


  • Give your item a unique title. (Hint: "Melina's Dataset" is not a unique title!)
  • Get a DOI for your work.
  • Include a detailed description of between 50 and 5000 characters.
  • Assign a license to your work.

More News Topics