 |
|
| URL | www.Archive.org |
|---|---|
| Type of site | Archive |
| Owner | Internet Archive |
| Created by | Brewster Kahle Bruce Gilliat |
| Launched | October 24, 2001[1] |
| Alexa rank |  227 (January 2013[update])[2] |
| Current status | Active |
The Wayback Machine is a digital time capsule created by the Internet Archive, a non-profit organization, based in San Francisco, California. It is maintained with content from Alexa Internet. The service enables users to see archived versions of web pages across time, which the Archive calls a "three dimensional index".
The name Wayback Machine is a reference to a segment from The Rocky and Bullwinkle Show in which Mr. Peabody and Sherman use a time machine called the "WABAC machine" (pronounced "Wayback") to witness, participate in, and, more often than not, alter famous events in history.[3][4]
Contents |
Origins, growth and storage [edit]
In 1996, Brewster Kahle, with Bruce Gilliat, developed software to crawl and download all publicly accessible World Wide Web pages, the Gopher hierarchy, the Netnews bulletin board system, and downloadable software.[5] The information collected by these "crawlers" does not include all the information available on the Internet since much of the data is restricted by the publisher or stored in databases that are not accessible. These "crawlers" also respect the robots exclusion standard for websites wishing to opt out of appearing in search results or being cached. To overcome inconsistencies in partially cached websites, Archive-It.org was developed in 2005 by the Internet Archive as a means of allowing institutions and content creators to voluntarily harvest and preserve collections of digital content, and create digital archives.
Information was kept on digital tape for five years, with Kahle occasionally allowing researchers and scientists to tap into the clunky database.[6] When the archive reached its five-year anniversary, it was unveiled and opened to the public in a ceremony at the University of California-Berkeley.
Snapshots usually become available more than 6 months after they are archived, or in some cases, even later, 24 months or longer. The frequency of snapshots is variable, so not all tracked web site updates are recorded. Intervals of several weeks or years sometimes occur.
After August 2008 sites had to be listed on the Open Directory in order to be included.[7] According to Jeff Kaplan of the Internet Archive in November 2010, other sites were still being archived,[8] but more recent captures would only become visible after the next major indexing, an infrequent operation.
As of 2009[update] the Wayback Machine contained approximately three petabytes of data and was growing at a rate of 100 terabytes each month;[9] the growth rate reported in 2003 was 12 terabytes/month. The data is stored on PetaBox rack systems manufactured by Capricorn Technologies.[10]
In 2009 the Internet Archive migrated its customized storage architecture to Sun Open Storage, and hosts a new data center in a Sun Modular Datacenter on Sun Microsystems' California campus.[11]
In 2011 a new, improved version of the Wayback Machine, with an updated interface and fresher index of archived content, was made available for public testing.[12]
In March 2011 it was said on the Wayback Machine forum that "The Beta of the new Wayback Machine has a more complete and up-to-date index of all crawled materials into 2010, and will continue to be updated regularly. The index driving the classic Wayback Machine only has a little bit of material past 2008, and no further index updates are planned, as it will be phased out this year."[13]
In January 2013 the company announced a ground-breaking milestone of 240 billion URLs.[14]
Use in legal evidence [edit]
Civil litigation [edit]
Netbula LLC v. Chordiant Software Inc. [edit]
In a 2009 case Netbula, LLC v. Chordiant Software Inc., defendant Chordiant filed a motion to compel Netbula to disable the robots.txt file on its web site that was causing the Wayback Machine to retroactively remove access to previous versions of pages it had archived from Nebula's site, pages which Chordiant believed would support its case.[15]
Netbula objected to the motion on the ground that defendants were asking to alter Netbula's web site and that they should have subpoenaed Internet Archive for the pages directly.[16] However, an employee of Internet Archive filed a sworn statement supporting Chordiant's motion, stating that it could not produce the web pages by any other means "without considerable burden, expense and disruption to its operations."[15]
Magistrate Judge Howard Lloyd in the Northern District of California, San Jose Division, rejected Netbula's arguments and ordered them to temporarily disable the robots.txt blockage in order to allow Chordiant to retrieve the archived pages that they sought.[15]
Telewizja Polska [edit]
In an October 2004 case, Telewizja Polska USA, Inc. v. Echostar Satellite, No. 02 C 3293, 65 Fed. R. Evid. Serv. 673 (N.D. Ill. Oct. 15, 2004), a litigant attempted to use the Wayback Machine archives as a source of admissible evidence, perhaps for the first time. Telewizja Polska is the provider of TVP Polonia and EchoStar operates the Dish Network. Prior to the trial proceedings, EchoStar indicated that it intended to offer Wayback Machine snapshots as proof of the past content of Telewizja Polska’s website. Telewizja Polska brought a motion in limine to suppress the snapshots on the grounds of hearsay and unauthenticated source, but Magistrate Judge Arlander Keys rejected Telewizja Polska’s assertion of hearsay and denied TVP's motion in limine to exclude the evidence at trial.[17][18] However, at the actual trial, district Court Judge Ronald Guzman, the trial judge, overruled Magistrate Keys' findings,[citation needed] and held that neither the affidavit of the Internet Archive employee nor the underlying pages (i.e., the Telewizja Polska website) were admissible as evidence. Judge Guzman reasoned that the employee's affidavit contained both hearsay and inconclusive supporting statements, and the purported webpage printouts themselves were not self-authenticating.[citation needed]
Patent law [edit]
The United States patent office and the European Patent Office, provided some additional requirements are met (e.g. providing an authoritative statement of the archivist), will accept date stamps from the Internet Archive as evidence of when a given Web page was accessible to the public. These dates are used to determine if a Web page is available as prior art for instance in examining a patent application.[19]
Limitations of utility [edit]
There are technical limitations to archiving a website, and as a consequence, it is possible for opposing parties in litigation to misuse the results provided by website archives. This problem can be exacerbated by the practice of submitting screen shots of web pages in complaints, answers or expert witness reports, when the underlying links are not exposed and therefore can contain errors. For example, archives like the Wayback Machine do not fill out forms and therefore do not include the contents of non-RESTful e-commerce databases in their archives.[20]
Legal status [edit]
In Europe the Wayback Machine could be interpreted to violate copyright laws. Only the content creator can decide where their content is published or duplicated, so the Archive would have to delete pages from its system upon request of the creator.[21] The exclusion policies for the Wayback Machine can be found in the FAQ section of the site. The Wayback Machine also retroactively respects robots.txt files, i.e. pages which are currently blocked to robots on the live web will be made temporarily unavailable from the archives as well.
A number of cases have been brought against the Internet Archive for its Wayback Machine archiving efforts. See Internet Archive controversies and legal disputes.
Search engine links [edit]
In 2005, Yahoo! Search began to provide links to other versions of pages archived on the Wayback Machine.[22]
See also [edit]
References [edit]
- ^ "The Internet Archive: Building an 'Internet Library'". Internet Archive. November 30, 2001. Retrieved May 12, 2013. "The Wayback Machine was unveiled on October 24th at Berkeley's Bancroft Library."
- ^ "Archive.org Site Info". Alexa Internet. Retrieved 2013-01-10.
- ^ Green, Heather (February 28, 2002). "A Library as Big as the World". BusinessWeek. Retrieved 2007-07-29.
- ^ TONG, JUDY (September 8, 2002). "RESPONSIBLE PARTY – BREWSTER KAHLE; A Library Of the Web, On the Web". New York Times. Retrieved 15 August 2011.
- ^ Kahle, Brewster. "Archiving the Internet". Scientific American – March 1997 Issue. Retrieved 19 August 2011.
- ^ Cook, John (November 1, 2001). "Web site takes you way back in Internet history". Seattle Post-Intelligencer. Retrieved 15 August 2011.
- ^ Internet Archive FAQ
- ^ Archive.org forum thread with response by Jeff Kaplan, last update November 07, 2010
- ^ Mearian, Lucas (March 19, 2009). "Internet Archive to unveil massive Wayback Machine data center". Computerworld.com. Retrieved 2009-03-22.
- ^ Kanellos, Michael (July 29, 2005). "Big storage on the cheap". CNET News.com. Archived from the original on 2007-04-03. Retrieved 2007-07-29.
- ^ "Internet Archive and Sun Microsystems Create Living History of the Internet". Sun Microsystems. March 25, 2009. Retrieved 2009-03-27.
- ^ "Updated Wayback Machine in Beta Testing". Archive.org. Retrieved 19 August 2011.
- ^ Beta Wayback Machine, in forum
- ^ http://blog.archive.org/2013/01/09/updated-wayback/
- ^ a b c LLoyd, Howard (October 2009). "Order to Disable Robots.txt" (PDF). Retrieved 2009-10-15.
- ^ Cortes, Antonio (October 2009). "Motion Opposing Removal of Robots.txt". Retrieved 2009-10-15.
- ^ Gelman, Lauren (November 17, 2004). "Internet Archive’s Web Page Snapshots Held Admissible as Evidence". Packets 2 (3). Retrieved 2007-01-04.
- ^ Howell, Beryl A. (February 2006). "Proving Web History: How to use the Internet Archive" (PDF). Journal of Internet Law: 3–9. Retrieved 2008-08-06.
- ^ Wynn W. Coggins (Fall 2002). "Prior Art in the Field of Business Method Patents - When is an Electronic Document a Printed Publication for Prior Art Purposes?". USPTO.
- ^ "Debunking the Wayback Machine". Archived from the original on 29 June 2010.
- ^ German lawyer about the Wayback Machine in a law paper, Journal of Internet Law: JurPC.
- ^ Gary Price (September 18, 2005). "Yahoo Cache Now Offers Direct Links to Wayback Machine". Search Engine Watch.
External links [edit]
A portion of the proceeds from advertising on Digplanet goes to supporting Wikipedia.
