Re: Tagging orthographic systems (was: (iso639.186) the

From: Rick McGowan (rmcgowan@apple.com)
Date: Wed Sep 13 2000 - 13:49:48 EDT


Tom Emerson wrote:

> One (well, the only) problem I have with explicit orthographic tagging
> is that it makes assumptions that a consistent orthography is being
> used throughout a document, which isn't necessarily the case. This is
> particularly prevalent in East Asian languages:

Well, the tags don't force one to tag an entire document with the same tag. They just provide a space. It's up to the document format to decide whether to tag a whole document or tag by language/orthography runs.

        Rick

 



This archive was generated by hypermail 2.1.2 : Tue Jul 10 2001 - 17:21:13 EDT
http://www.unicode.org/mail-arch/unicode-ml/Archives-Old/UML024/0284.html
www.unicode.org
crawl=CC-MAIN-2017-30
4818
application/http; msgtype=response
sha1:2NJ3ZX3JSCAPVNSATYUJID3QGP7T66SC
<urn:uuid:09e06a65-6b8c-4a31-b7b9-6079af934f61>
2017-07-24T19:21:21Z
216.97.88.9
text/html
sha1:Z3AYVFSYC4UMRLVBMGPHSY54ECCAKUF3
<urn:uuid:31c0e4d5-3eae-40e8-a041-175b0be4680c>
http://www.unicode.org/mail-arch/unicode-ml/Archives-Old/UML024/0284.html
response
<urn:uuid:78bb7884-6317-4b00-8a5e-d838e84ffaac>
robots: classic
hostname: ip-10-186-218-81.ec2.internal
software: Nutch 1.6 (CC)
isPartOf: CC-MAIN-2017-30
operator: Common Crawl Admin
description: Wide crawl of the web for July 2017
publisher: Common Crawl
format: WARC File Format 1.0
conformsTo: http://bibnum.bnf.fr/WARC/WARC_ISO_28500_version1_latestdraft.pdf