<!ENTITY % corp.1.components 'INCLUDE' >
<!ENTITY corp.contrib "
Guo Jin et al.
Institute of Systems Science (ISS)
National University of Singapore
Heng Mui Keng Terrace, Kent Ridge
Singapore 0511
Tel: (65) 7726381      FAX:  (65) 7782571
E-mail:  guojin@@iss.nus.sg
" >
<!ENTITY % corp.contrib.id "iss" >
<!ENTITY corp.title "PH--A Chinese Text Corpus for Syllable to Text Transcription">
<!-- files for inclusion in sourceinfo -->

<!NOTATION GB-coded-chinese SYSTEM -- GuoBiao (GB) coded chinese with
                                      word separators marked as 1 byte
                                      "/" character                   -->
<!NOTATION GB-ASCII-mix     SYSTEM -- GB and ASCII (MS Word for
						    Windows) mixture  -->
<!NOTATION C-program-code   SYSTEM -- C program code                  -->
<!NOTATION PostScript       SYSTEM -- PostScript file                 -->

<!ENTITY chi-001-01  PUBLIC
 	"-//HCRC, Univ. of Edinburgh//TEXT chi01a.doc//EN//" >
<!ENTITY chi-001-03  PUBLIC
 	"-//HCRC, Univ. of Edinburgh//TEXT chi01b.doc//EN//" NDATA C-program-code >
<!ENTITY chi-001-04  PUBLIC
 	"-//HCRC, Univ. of Edinburgh//TEXT chi01a.gb//EN//" NDATA GB-coded-chinese >
<!ENTITY chi-001-05  PUBLIC
 	"-//HCRC, Univ. of Edinburgh//TEXT chi01c.doc//EN//" NDATA C-program-code >
<!ENTITY chi-001-06  PUBLIC
 	"-//HCRC, Univ. of Edinburgh//TEXT chi01d.doc//EN//" NDATA GB-coded-chinese >
<!ENTITY chi-001-07  PUBLIC
 	"-//HCRC, Univ. of Edinburgh//TEXT chi01e.doc//EN//" NDATA GB-ASCII-mix >
<!ENTITY chi-001-08  PUBLIC
 	"-//HCRC, Univ. of Edinburgh//TEXT chi01f.doc//EN//" NDATA PostScript >

<!ENTITY corp.sourceinfo '
<p>The PH text corpus described here contains 3.75
million Chinese characters.  It is a collection of news from the
China&sq;s official Xinhua (New China) news agency during a period
from January 1990 to March 1991. It uses the GB character codesj with word and
phrase boundaries marked.
<p>We describe the components briefly here -- for more detail see chi01.edt.
<list>
<item n=chi01a.doc>
<p>An ISS technical report titled "PH--A Chinese Corpus for
Pinyin-Hanzi Transcription" which describes in detail the
criteria for collecting the Corpus, the origination of it,
the preprocessing on it, its format and some of its statistical
properties.  It&sq;s a must-be-read file.
The file "hanzi.doc" in the original subdirectory is in Microsoft Word for
Window (version 2.0) ".doc" format.  You need a PC compatible to read
it, or you may ask ISS directly for a hardcopy. The file included
here is a version of hanzi.doc with the non-ASCII
characters removed.
<p> &chi-001-01;
</item>
<item n=chi01b.doc>
<p>The C source code of "hanzi".  At UNIX environment, you can
generate the executable file "hanzi" by type the following line:

	cc hanzi.c -o hanzi

The hanzi executable file will generate the file "Hanzi.PH" and
"HanziCount.PH" from the file "Segment.PH".  To use it, just
type at system prompt the line:

	hanzi

HanziCount.PH is a GB ordered list of all Chinese characters
(Hanzi) and their number of occurrences (frequencies) in the
PH Corpus. It is generated by "hanzi" from "Segment.PH".

Hanzi.PH is the pure Chinese character (Hanzi) version of the
PH Corpus, i.e. it has the "/" word separator characters
stripped out of "Segment.PH". It&sq;s generated by "hanzi" from
"Segment.PH".  See also the file "hanzi.eci" for more information.
<p>
&chi-001-03;
</p>
</item>
<item n=chi01a.eci>
<p>The automatically segmented version of the PH Corpus.  The
segmentation mark is "/" (coded as 1 byte 2F (hex)).  

A fragment between two segmentation marks corresponds roughly  
to a word but we do not guarantee that because there is no 
well-formed definition for "word".  Also, although the 
segmentation process used here is not too bad compared with many
others, it works only based on the Liang NanYuan&sq;s (commercial) 
dictionary of about 50,000 entries, does not take into 
account any unknown words such as proper names, and is not 
smart enough to disambiguate some complex fragments.  A much
better version will be released later.
</item>
<item n=chi01c.doc>
<p>The C source code of the executable file "concord".  In an
UNIX environment, you can generate the executable file
"concord" by type the following line:

	cc concord.c -o concord

Concord is an executable file which you may use constantly to
analyze the usage of *keys*, such as characters, words,
phrases, or any short character strings, in contemporary
(mainland) Chinese. It&sq;s basically a KWIC (key word in
context) index with a few additional features.
<p>
&chi-001-05;
</p>
</item>
<item n=chi01d.doc>
<p>A sample key file for the concord.c program described above.
<p>
&chi-001-06;
</p>
</item>
<item n=chi01e.doc>
<p>Original version of hanzi.eci, containing Chinese characters
and tables of data. NB NOT included in SGMLS output as it
contains many non-sgml characters.
<p>
&chi-001-07;
</p>
</item>
<item n=chi01f.doc>
<p>Postscript file showing the GB character coding. NB this is a
big file and you will probably (on UNIX) need to use the -s option
to lpr when printing it. NB NOT included in SGMLS output.
<p>
&chi-001-08;
</p>
</item>
</list>
' >
<!ENTITY corp.langusage "&def.lang;&chi.lang;
<p>
GB 16-bit encoding is used.
</p>
" >
<!ENTITY % corp.lang " lang=chi" >
<!ENTITY corp.chan.mode "m" >
<!ENTITY corp.const.type "composite" >
<!ENTITY corp.dom.type "public" >
<!ENTITY corp.fact.type "fact" >
<!ENTITY corp.editorial
	"Minimally TEI compliant.  See chi01.edt for discussion" >

<!ENTITY corp.copyright "
Corpus collection and markup:
	Copyright 1992 Institute of Systems Science (ISS)
	National University of Singapore.
Original Texts:
	Copyright 1990-1991 Xinhua (New China) news agency.
Used with permission.

        Recipients of the PH corpus by signing the ECI/MCI User Agreement 
        thereby agree

        1. To use the PH corpus strictly for research purposes.

        2. NOT to re-distribute the material to others outside of their
        research group, and agree to inform all members of their research group
        who have access to this material, of the terms of this addendum 
        to the ECI/MCI User Agreement, and to ensure their compliance
        with them.

        3. Upon the completion of my research, when publishing results
        achieved using the PH corpus, for example in a Bulletin board,
        short notice or lengthy journal article, to attach in publishing
        a clear reference phrase such as ``the PH corpus (originally
        selected and processed by Guo Jin and his colleagues) is used
        in this research.''
" >
<!ENTITY corp.tagusage '' >

<!-- Component declarations -->

<!ENTITY comp.a.elec.title "PH--A Chinese Text Corpus for Syllable to Text Transcription" >
<!ENTITY comp.a.copyright "" >
<!ENTITY comp.a.bibl "
<title>PH--A Chinese Text Corpus for Syllable to Text Transcription</title>
<author>Guo Jin,  et al.</author>
<name type=city>Singapore</name>
<date>1992</date>
" >
<!ENTITY comp.a.tu "">
