[Corpora-List] Searching Japanese corpora

Cyrus Shaoul cyrus.shaoul at ualberta.ca
Thu Dec 21 18:13:01 CET 2006


Hi Eric,

It is my understanding that it is possible to write the pronunciation of all
kanji and kanji compounds in both hiragana and katakana (and each
kanji/kanji compound can
have multiple pronunciations). In most types of written Japanese, it
would be uncommon to write the pronunciation for kanji, and there are
many words that are
always written in katakana or hiragana, and never in kanji, so when
searching for words, having a tool that
would automatically search for a kanji word and it's kana
representations at the same time would not
be that useful.

I should confess that there are some words that are written in both
kanji and kana with higher frequency, such as
some older loanwords, some place names, some proper names, some
low-frequency kanji, and a few other types of words.
I have a gut feeling that the number of words that fall into these
categories is not that large.

I don't know of any tools out there to do the kind of query you
mentioned, but it has been a few years since I
working on Japanese text. In the meantime, I can only suggest making
many queries, one with kanji/kanji compund and
others with the hiragana and katakana spellings of all the possible
pronunciations.

Yours,

Cyrus

http://www.psych.ualberta.ca/~westburylab/

Eric J. M. Smith wrote:

> Greetings,

>

> Following up on our recent thread about grep with Unicode, I'm curious

> about how people search for text in Japanese-language corpora.

>

> My understanding of Japanese is rudimentary, but is it not possible

> (potentially at least) for the same text to be written in hiragana,

> katakana, or kanji? In order to find all occurrences of a particular

> string in a corpus, would I have to do the search 3 times, once for

> each script? I assume that would be the case for something like grep.

> But are there more sophisticated query tools which abstract away the

> question of which script is actually used for data within the corpus?

>

> Thanks,

>

> Eric J. M. Smith

> Dept. of Linguistics

> University of Toronto

>






More information about the Corpora-archive mailing list