Yacy
From 24C3 Public Wiki
There will be a Yacy-Server in the Maschinenraum to index the web.
The created index will later be transfered to a public yacy-server to become part of the distributed hash table.
You may add sites that you would like us to crawl here:
sites to crawl
www.golem.de/
msdn2.microsoft.com/
www.microsoft.com/germany/msdn/library/default.mspx?mfr=true
link-lists to crawl
dmoz.org (and domains linked from there)
projekt.wifo.uni-mannheim.de/elmar/nav?firstLetter=B&dest=search.shoplist&page=9&rid=114&blocksize=20&erotic=off