[Corpora-List] Web Content Extractor / Screen Scraper

[Eric Atwell]

Resty,

take a look at the CORPORA archive for web-as-corpus tools:

http://listserv.linguistlist.org/cgi-bin/wa?A2=ind0705&L=CORPORA&P=R1226&I=-3

"... You can use a web-as-corpus collection tool such as WWW-Bootcat,
a web-interface to Baroni's perl BootCat:
http://corpora.fi.muni.cz/bootcat/

or WeBoCa, a Java alternative by Leeds student Michael Drayson, an
extension of Andy Roberts' JBootCat: http://code.google.com/p/weboca/
..."

Eric Atwell, Leeds University


On Tue, 19 Jun 2007, Resty Cena wrote:


> Hello,

> I am looking for a free or open-source Windows utility/application that

> extract text-only rendered (not raw) contents of web pages, such as one

> would use for automatically scraping news feeds. Does anyone use such an

> application?

>

> Basically the application will be used to harvest texts on the internet to

> build a corpus.

>

> All the best,

> Resty

>