Robots txt abuses by government agencies against transparency

From 33C3_Public_Wiki
Jump to: navigation, search
Description robots.txt often abused by government agencies against transparency measures to hide very specific information from search engines, often in order to mask results of relationship related to "name surname" search of high ranking officials or companies.

A research has been done on Italian public agencies and European Union to identify "what do they hide". A prototipe to re-index those into search engine by proxying requests has been developed.

Looking for hackers interested in making it a stable transparency opensource project  :-)

Slides To be done ASAP
Tags transparency, search, robots
Person organizing Fabio Pietrosanti (naif)
Language en - English
en - English
Duration 5
Desired session Day 3
Desired timeframe end


Ok for the slot 14.55