[Net-z3950] Re: a Net::Z3950 v0.46 problem

Mike Taylor mike at indexdata.com
Wed Dec 8 13:15:15 CET 2004


I am forwarding this message from Yehui Zhang
<yxz at press.uchicago.edu>, which was for some reason discarded by the
mailing-list management software.  There are two more to come.

------- Start of forwarded message -------
Date: Mon, 06 Dec 2004 14:05:50 -0600
From: Yehui Zhang <yxz at press.uchicago.edu>
To: "Doran, Michael D" <doran at uta.edu>
Cc: <net-z3950 at indexdata.com>
Subject: RE: [Net-z3950] Re: a Net::Z3950 v0.46 problem
In-Reply-To: <9EE462CF4CE0344B80A997EBF590AC9F01192C7E at MAILFS1.uta.edu>

Hi Michael,

We only noticed the problem recently. And I believe it's not a problem of 
displaying, since I checked the octal values and they are not the same. I 
tried to use yaz-client to retrieve the MARC record as Mike suggested, but 
I got exactly the same result as Mike got, the French characters are not 
displaying correctly. Do you have any idea how this can be fixed?

Thank you very much for you help!
Yehui Zhang
- --------------------
Bibliovault Programmer
University of Chicago Press
(773)-702-9436

At 12:25 PM 12/6/2004 -0600, Doran, Michael D wrote:
>Hi Yehui,
>
> > However we run into a problem recently. Some of the French
> > characters are not appearing correctly after it's imported
>
>Do you mean 1) that you only noticed the problem recently, or 2) that 
>diacritics of previously harvested and imported records appeared 
>correctly, and you have only recently begun to have the problem of 
>corrupted data?  If it's #2, what has changed since the process was working OK?
>
> > ... we are still getting the corrupted data.
>
>I assume that the character set of the harvested records is MARC-8.  By 
>"corrupted" do you mean that 1) the characters do not display correctly, 
>or 2) that you have verified that the underlying encoding is incorrect 
>(i.e. by examining the hex values)?  If it's #1, what application are you 
>using to display the records?
>
>-- Michael
>
># Michael Doran, Systems Librarian
># University of Texas at Arlington
># 817-272-5326 office
># 817-688-1926 cell
># doran at uta.edu
># http://rocky.uta.edu/doran/
>
> > -----Original Message-----
> > From: net-z3950-bounces at indexdata.dk
> > [mailto:net-z3950-bounces at indexdata.dk] On Behalf Of Mike Taylor
> > Sent: Monday, December 06, 2004 9:29 AM
> > To: yxz at press.uchicago.edu
> > Cc: erg at press.uchicago.edu; net-z3950 at indexdata.com
> > Subject: [Net-z3950] Re: a Net::Z3950 v0.46 problem
> >
> > > Date:       Fri, 03 Dec 2004 13:04:32 -0600
> > > From:       Yehui Zhang <yxz at press.uchicago.edu>
> > >
> > > We have been using Z3950 module to harvest MARC records to our MySQL
> > > database. However we run into a problem recently. Some of the French
> > > characters are not appearing correctly after it's imported using
> > > function rawdata() or render(). I installed the newest version of
> > > Z3950 module which supports charset and language options, and set
> > > the charset to ISO-8859-1(and tried several other charset/language
> > > options), but we are still getting the corrupted data.
> >
> > Hi, Yehui.  I've had only a brief look at this, and it's not
> > immediately obvious to me what's going on.  As I am sure you know,
> > character-set issues are delicate at the best of times, and there
> > isn't really enough information here to let me solve the problem.
> >
> > It would be helpful if you could persaude the YAZ command-line client
> > ("yaz-client") to retrieve and display this MARC record correctly.
> > Despite some messing about with the "charset" and "marccharset"
> > commands, I still have not managed this.  (See attached script).  If
> > you can do so, I will be in a position to offer better advice; if you
> > can't, then the problem may be at the server's end.
> >
> >  _/|_ _______________________________________________________________
> > /o ) \/  Mike Taylor  <mike at indexdata.com>
> > http://www.miketaylor.org.uk
> > )_v__/\  "But what is it good for?" -- Engineer at the Advanced
> >       Computing Systems Division of IBM, 1965 commenting on the
> >       microchip.
> >
> > --
> >
> > $ yaz-client z3950.loc.gov:7090/Voyager
> > Connecting...OK.
> > Sent initrequest.
> > Connection accepted by v3 target.
> > ID     : 34
> > Name   : Voyager LMS - Z39.50 Server (YAZ Proxy)
> > Version: 1.13
> > Options: search present
> > Elapsed: 0.374033
> > Z> find @attr 1=7 0226510646
> > Sent searchRequest.
> > Received SearchResponse.
> > Search was a success.
> > Number of hits: 1
> > records returned: 0
> > Elapsed: 0.163926
> > Z> show 1
> > Sent presentRequest (1+1).
> > Records: 1
> > [VOYAGER]Record type: USmarc
> > 001 3468598
> > 005 19941101162839.5
> > 008 930209s1993    ilu      b    001 0 eng
> > 035    $9 (DLC)   93016456
> > 906    $a 7 $b cbc $c orignew $d 1 $e ocip $f 19 $g y-gencatlg
> > 955    $a pc to la00 02-09-93; lf08 02-09-93; lh06 02-10-93
> > (PQ143.U6 M...); lj04 02-11-93; aa00 02-12-93; CIP ver. lg15/
> > lg06 11-01-93
> > 010    $a    93016456
> > 020    $a 0226510638
> > 020    $a 0226510646 (pbk.)
> > 040    $a DLC $c DLC $d DLC
> > 043    $a n-us--- $a e-fr---
> > 050 00 $a PQ143.U6 $b M37 1993
> > 082 00 $a 840.9/3273 $2 20
> > 100 1  $a Mathy, Jean-Philippe.
> > 245 10 $a Extrãeme-Occident : $b French intellectuals and
> > America / $c Jean-Philippe Mathy.
> > 260    $a Chicago : $b University of Chicago Press, $c c1993.
> > 300    $a ix, 307 p. ; $c 24 cm.
> > 504    $a Includes bibliographical references (p. 289-297) and index.
> > 650  0 $a French literature $y 20th century $x History and criticism.
> > 651  0 $a United States $x Foreign public opinion, French.
> > 651  0 $a France $x Intellectual life $y 20th century.
> > 650  0 $a French literature $x American influences.
> > 651  0 $a America $x In literature.
> > 991    $b c-GenColl $h PQ143.U6 $i M37 1993 $p 00012523695 $t
> > Copy 1 $w BOOKS
> > nextResultSetPosition = 2
> > Elapsed: 0.131160
> > Z> charset latin1 latin1
> > Character set negotiation : latin1
> > Z> show 1
> > Sent presentRequest (1+1).
> > Records: 1
> > [VOYAGER]Record type: USmarc
> > 001 3468598
> > 005 19941101162839.5
> > 008 930209s1993    ilu      b    001 0 eng
> > 035    $9 (DLC)   93016456
> > 906    $a 7 $b cbc $c orignew $d 1 $e ocip $f 19 $g y-gencatlg
> > 955    $a pc to la00 02-09-93; lf08 02-09-93; lh06 02-10-93
> > (PQ143.U6 M...); lj04 02-11-93; aa00 02-12-93; CIP ver. lg15/
> > lg06 11-01-93
> > 010    $a    93016456
> > 020    $a 0226510638
> > 020    $a 0226510646 (pbk.)
> > 040    $a DLC $c DLC $d DLC
> > 043    $a n-us--- $a e-fr---
> > 050 00 $a PQ143.U6 $b M37 1993
> > 082 00 $a 840.9/3273 $2 20
> > 100 1  $a Mathy, Jean-Philippe.
> > 245 10 $a Extrãeme-Occident : $b French intellectuals and
> > America / $c Jean-Philippe Mathy.
> > 260    $a Chicago : $b University of Chicago Press, $c c1993.
> > 300    $a ix, 307 p. ; $c 24 cm.
> > 504    $a Includes bibliographical references (p. 289-297) and index.
> > 650  0 $a French literature $y 20th century $x History and criticism.
> > 651  0 $a United States $x Foreign public opinion, French.
> > 651  0 $a France $x Intellectual life $y 20th century.
> > 650  0 $a French literature $x American influences.
> > 651  0 $a America $x In literature.
> > 991    $b c-GenColl $h PQ143.U6 $i M37 1993 $p 00012523695 $t
> > Copy 1 $w BOOKS
> > nextResultSetPosition = 2
> > Elapsed: 0.120964
> > Z> marccharset latin1
> > Z> show 1
> > Sent presentRequest (1+1).
> > Records: 1
> > [VOYAGER]Record type: USmarc
> > convert from latin1 to latin1
> > 001 3468598
> > 005 19941101162839.5
> > 008 930209s1993    ilu      b    001 0 eng
> > 035    $9 (DLC)   93016456
> > 906    $a 7 $b cbc $c orignew $d 1 $e ocip $f 19 $g y-gencatlg
> > 955    $a pc to la00 02-09-93; lf08 02-09-93; lh06 02-10-93
> > (PQ143.U6 M...); lj04 02-11-93; aa00 02-12-93; CIP ver. lg15/
> > lg06 11-01-93
> > 010    $a    93016456
> > 020    $a 0226510638
> > 020    $a 0226510646 (pbk.)
> > 040    $a DLC $c DLC $d DLC
> > 043    $a n-us--- $a e-fr---
> > 050 00 $a PQ143.U6 $b M37 1993
> > 082 00 $a 840.9/3273 $2 20
> > 100 1  $a Mathy, Jean-Philippe.
> > 245 10 $a Extrãeme-Occident : $b French intellectuals and
> > America / $c Jean-Philippe Mathy.
> > 260    $a Chicago : $b University of Chicago Press, $c c1993.
> > 300    $a ix, 307 p. ; $c 24 cm.
> > 504    $a Includes bibliographical references (p. 289-297) and index.
> > 650  0 $a French literature $y 20th century $x History and criticism.
> > 651  0 $a United States $x Foreign public opinion, French.
> > 651  0 $a France $x Intellectual life $y 20th century.
> > 650  0 $a French literature $x American influences.
> > 651  0 $a America $x In literature.
> > 991    $b c-GenColl $h PQ143.U6 $i M37 1993 $p 00012523695 $t
> > Copy 1 $w BOOKS
> > nextResultSetPosition = 2
> > Elapsed: 0.119284
> > Z>
> >
> >
> >
> > _______________________________________________
> > Net-z3950 mailing list
> > Net-z3950 at indexdata.dk
> > http://www.indexdata.dk/mailman/listinfo/net-z3950
> >




- --===============0884630566==--
------- End of forwarded message -------





More information about the Net-z3950 mailing list
http://lists.indexdata.dk/pipermail/net-z3950/2004-December/000485.html
lists.indexdata.dk
crawl=CC-MAIN-2022-05
15585
application/http; msgtype=response
sha1:3JCPOAT3FP2YXBARDGKULSOTRMT3GXQC
<urn:uuid:6f06d2f5-d42a-4c01-9ac3-46550118b1ae>
2022-01-18T13:18:00Z
144.76.181.244
text/html
sha1:GCDOOBQ6CPEDMZNPFI2HF7FCAOXSLVIX
<urn:uuid:be8646ab-be80-44d7-8c62-0a7dbfe8efb1>
http://lists.indexdata.dk/pipermail/net-z3950/2004-December/000485.html
response
<urn:uuid:595e985c-2229-4c29-b9c1-668f5a2c998c>
isPartOf: CC-MAIN-2022-05
publisher: Common Crawl
description: Wide crawl of the web for January 2022
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-243
software: Apache Nutch 1.18 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.3-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: https://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/