Hi,

On Wed, Mar 27, 2013 at 11:20 AM, Eric Lease Morgan <emor...@nd.edu> wrote:

> I have isolated a number of problem records. They all contain diacritics,
> but they do not have an "a" in position #9 of the leader --
> http://dh.crc.nd.edu/tmp/original.marc  Can someone verify that the file
> contains UTF-8 characters for me?
>

I've eyeballed it and confirm that the encoding of that file is UTF-8.

For these same records I have also added an "a" in position #9 and created
> a similar file -- http://dh.crc.nd.edu/tmp/fixed.marc


I've looked this over as well.


> Is it true that original.marc is not denoted correctly, but fixed.marc is
> denoted correctly?
>

Yes.  The Leader/09 must be set to 'a' if the character encoding in use is
UTF-8.

Regards,

Galen
-- 
Galen Charlton
gmcha...@gmail.com

Reply via email to
http://www.mail-archive.com/perl4lib%40perl.org/msg01681.html
www.mail-archive.com
crawl=CC-MAIN-2017-22
10588
application/http; msgtype=response
sha1:4MLSOVU37HVY4HRJHLZUCC47KUJE7VXK
<urn:uuid:0e2c2763-01b9-460c-8933-822a111ff9ad>
2017-05-27T21:28:36Z
72.52.77.8
text/html
sha1:IICEUWTGSGD3FYHKFAIR3K7G3MC74YQ5
<urn:uuid:3782b4e5-a7e2-4326-96cf-e082c3399ed0>
http://www.mail-archive.com/perl4lib%40perl.org/msg01681.html
response
<urn:uuid:e4b862e2-76dd-4773-839e-51bf37d28d83>
robots: classic
hostname: ip-10-185-224-210.ec2.internal
software: Nutch 1.6 (CC)/CC WarcExport 1.0
isPartOf: CC-MAIN-2017-22
operator: Common Crawl Admin
description: Wide crawl of the web for May 2017
publisher: Common Crawl
format: WARC File Format 1.0
conformsTo: http://bibnum.bnf.fr/WARC/WARC_ISO_28500_version1_latestdraft.pdf