[Corpora-List] News from LDC

Linguistic Data Consortium ldc at ldc.upenn.edu
Tue Aug 25 21:07:39 CEST 2015

/In this newsletter:/** **

**Fall 2015 LDC Data Scholarship program - September 15 deadline approaching <#scholar> ** *LDC at Interspeech 2015 <#inter>*

*2013 Data Pack deadline is September 15 <#pack>*

*LDC co-organizes LSA2016 Pre-conference Workshop <#lsa> *

/New publications:/

*Arabic Learner Corpus <#learner>*

*GALE Phase 3 Arabic Broadcast Conversation Speech Part 1 <#speech>** *

*GALE Phase 3 Arabic Broadcast Conversation Transcripts Part 1 <#trans>*


*Fall 2015 LDC Data Scholarship program - September 15 deadline approaching *

Student applications for the Fall 2015 LDC Data Scholarship program are being accepted now through Tuesday, September 15, 2015, 11:59PM EST. The LDC Data Scholarship program provides university students with access to LDC data at no cost. This program is open to students pursuing both undergraduate and graduate studies in an accredited college or university. LDC Data Scholarships are not restricted to any particular field of study; however, students must demonstrate a well-developed research agenda and a bona fide inability to pay.

Students will need to complete an application which consists of a data use proposal and letter of support from their adviser. For further information on application materials and program rules, please visit the LDC Data Scholarship <https://www.ldc.upenn.edu/language-resources/data/data-scholarships> page.

Applicants can email their materials to the LDC Data Scholarship program <mailto:datascholarships at ldc.upenn.edu>.

*LDC at Interspeech 2015 *

LDC will once again be exhibiting at Interspeech, held this year September 7-10 in Dresden, Germany.Stop by booth 20 to learn more about recent developments at the Consortium and new publications.

Also, be on the lookout for the following presentations featuring LDC work:

The Effect of Spectral Slope on Pitch Perception: Jianjing Kuang

(UPenn) and Mark Liberman (LDC)

Monday 7 September, Poster Session 3-9, 11:00--13:00

Investigating Consonant Reduction in Mandarin Chinese with Improved

Forced Alignment: Jiahong Yuan and Mark Liberman (both LDC)

Wednesday 9 September, Oral Session 36-5, 17:50-18:10

LDC will post conference updates via our Twitter feed and Facebook page. We hope to see you there!

*2013 Data Pack deadline is September 15*

One month remains for not-for-profit and government organizations to create a custom data collection of eight corpora from among LDC's 2013 releases. Selection options include: 1993-2007 United Nations Parallel Text, Chinese Treebank 8.0, CSC Deceptive Speech, GALE Arabic and Chinese speech and text releases, Greybeard, MADCAT training data, NIST 2012 Open Machine Translation (OpenMT) evaluation and progress sets, and more. The 2013 Data Pack <https://catalog.ldc.upenn.edu/LDC2015MDP> is available for a flat rate of $3500 through September 15, 2015.

To license the Data Pack and select eight corpora, login or register for an LDC user account <https://catalog.ldc.upenn.edu/login> and add the 2013 Data Pack <https://catalog.ldc.upenn.edu/LDC2015MDP> and each of the eight data sets to your bin. Follow the check-out procedure, sign all applicable user agreements and select payment via wire transfer, purchase order or check. LDC will adjust the invoice total to reflect the data pack fee.

To pay via credit card, add the 2013 Data Pack <https://catalog.ldc.upenn.edu/LDC2015MDP> to your bin and check out using the system prompts. At the completion of the transaction, send an email to LDC <mailto:ldc at ldc.upenn.edu> indicating the eight data sets to include in your order.

*LDC co-organizes LSA2016 Pre-conference Workshop *

University of Arizona's Malcah Yeager-Dror and LDC's Chris Cieri are organizing the upcoming LSA 2016 workshop <https://www.ldc.upenn.edu/communications/workshops/lsa-2016-workshop> "Preparing your Corpus for Archival Storage". The session is sponsored by the National Science Foundation (BCS #1549994) and will be held on Thursday, January 7, 2016 in Washington, DC before the start of the 90th Annual Meeting of the Linguistic Society of America (LSA 2016 <http://www.linguisticsociety.org/event/lsa-2016-annual-meeting>).

The workshop will examine critical factors which must be considered when preparing data for comparison and sharing following on the topics discussed in the LSA 2012 workshop, "Coding for Sociolinguistic Archive Preparation". Invited speakers will discuss specific coding conventions for such factors as socioeconomic and educational speaker demographics, language choice, stance and footing.

There will be no additional registration fees to attend the session for those already taking part in the annual meeting. Students who are about to carry out their own fieldwork, or who have begun doing so, are eligible to apply for funding <https://www.ldc.upenn.edu/sites/www.ldc.upenn.edu/files/lsa2016workshop-student-application1.docx> by November 2, 2015 to help defray the extra costs for attending the workshop. For more information about the speakers and topics, visit LDC's workshop page <https://www.ldc.upenn.edu/communications/workshops/lsa-2016-workshop>.

*New publications*

(1) Arabic Learner Corpus <https://catalog.ldc.upenn.edu/LDC2015S10> was developed at the University of Leeds <http://www.leeds.ac.uk/> and consists of written essays and spoken recordings by Arabic learners collected in Saudi Arabia in 2012 and 2013. The corpus includes 282,732 words in 1,585 materials, produced by 942 students from 67 nationalities studying at pre-university and university levels. The average length of an essay is 178 words.

Two tasks were used to collect the written data, and participants had the choice to do one or both of them. In each of those tasks, learners were asked to write a narrative about a vacation trip and a discussion about the participant's study interest. Those choosing the first task generated a 40 minute timed essay without the use of any language reference materials. In the second task, participants completed the writing as a take-home assignment over two days and were permitted to use language reference materials.

The audio recordings were developed by allowing students a limited amount of time to talk about the topics above without using language reference materials.

The original handwritten essays were transcribed into an electronic text format. The corpus data consists of three types: (1) handwritten sheets scanned in PDF format; (2) audio recordings in MP3 format; and (3) textual unicode data in plain text and XML formats (including the transcribed audio and transcripts of the handwritten essays). The audio files are either 44100Hz 2-channel or 16000Hz 1-channel mp3 files.


(2) GALE Phase 3 Arabic Broadcast Conversation Speech Part 1 <https://catalog.ldc.upenn.edu/LDC2015S11> was developed by LDC and is comprised of approximately 123 hours of Arabic broadcast conversation speech collected in 2007 by LDC, MediaNet, Tunis, Tunisia and MTC, Rabat, Morocco during Phase 3 of the DARPA GALE (Global Autonomous Language Exploitation) program.

Corresponding transcripts are released as GALE Phase 3 Arabic Broadcast Conversation Transcripts Part 1 (LDC2015T16 <https://catalog.ldc.upenn.edu/LDC2015T16>).

Broadcast audio for the GALE program was collected at LDC's Philadelphia, PA USA facilities and at three remote collection sites. The combined local and outsourced broadcast collection supported GALE at a rate of approximately 300 hours per week of programming from more than 50 broadcast sources for a total of over 30,000 hours of collected broadcast audio over the life of the program.

The broadcast conversation recordings in this release feature interviews, call-in programs and roundtable discussions focusing principally on current events from the following sources: Abu Dhabi TV, Al Alam News Channel, Al Arabiya, Aljazeera, Al Ordiniyah, Dubai TV, Lebanese Broadcasting Corporation, Oman TV, Saudi TV, and Syria TV.

This release contains 149 audio files presented in FLAC <http://flac.sourceforge.net>-compressed Waveform Audio File format (.flac), 16000 Hz single-channel 16-bit PCM.


(3) GALE Phase 3 Arabic Broadcast Conversation Transcripts Part 1 <https://catalog.ldc.upenn.edu/LDC2015T16> was developed by LDC and contains transcriptions of approximately 123 hours of Arabic broadcast conversation speech collected in 2007 by LDC, MediaNet, Tunis, Tunisia and MTC, Rabat, Morocco during Phase 3 of the DARPA GALE (Global Autonomous Language Exploitation) program.

Corresponding audio data is released as GALE Phase 3 Arabic Broadcast Conversation Speech Part 1 (LDC2015S11 <https://catalog.ldc.upenn.edu/LDC2015S11>).

The transcript files are in plain-text, tab-delimited format (TDF) with UTF-8 encoding, and the transcribed data totals 733,233 tokens. The transcripts were created with the LDC-developed transcription tool, XTrans <https://www.ldc.upenn.edu/language-resources/tools/xtrans>, a multi-platform, multilingual, multi-channel transcription tool that supports manual transcription and annotation of audio recordings.

The files in this corpus were transcribed by LDC staff and/or by transcription vendors under contract to LDC. Transcribers followed LDC's quick transcription guidelines (QTR) and quick rich transcription specification (QRTR) both of which are included in the documentation with this release.


-- --

Ilya Ahtaridis Membership Coordinator -------------------------------------------------------------------- Linguistic Data Consortium Phone: 1 (215) 573-1275 University of Pennsylvania Fax: 1 (215) 573-2175 3600 Market St., Suite 810 ldc at ldc.upenn.edu Philadelphia, PA 19104 USA http://www.ldc.upenn.edu

-------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: text/html Size: 13938 bytes Desc: not available URL: <https://mailman.uib.no/public/corpora/attachments/20150825/b6c39ba9/attachment.txt>

More information about the Corpora mailing list