# MOMspider System Avoid File: Lists URL prefixes to avoid or leaf. # New URL prefixes can be added when the program is not running. # The file format is: EntryType URLprefix [ExpireDate] # where EntryType = "Avoid" or "Leaf" # URLprefix = the full URL prefix for which this entry applies # ExpireDate = [*] for never expire # or [date] (see wwwdates.pl for valid date formats) Avoid http://www.wais.com/ [*] Avoid http://www.ncsa.uiuc.edu:8001/ [*] Avoid http://info.cern.ch:8001/ [*] Avoid http://www.contrib.andrew.cmu.edu:8001/sokoban/ [*] Avoid http://www.cs.indiana.edu/finger [*] Leaf http://www.ncsa.uiuc.edu/SDG/Software/Mosaic/Docs/whats-new.html [*] Leaf http://www.ncsa.uiuc.edu/SDG/Software/Mosaic/MetaIndex.html [*] Leaf http://info.cern.ch/hypertext/DataSources/ByAccess.html [*] Leaf http://info.cern.ch/hypertext/DataSources/bySubject/Overview.html [*] Leaf http://www.ics.uci.edu/Admin/ [*]