Hi Takatsugu !
knok at daionet.gr.jp wrote:
Unfortunately, current stable Namazu has no support for all UTF-8
characters.
Does that mean that we're doomed ? ;)
I've got a few questions regarding the issues Arkadiusz pointed out in
his mail on 27th of June.
I'm making archives of a french newsgroup with mhonarc, I then generate
an index file with mknmz and use namazu as a search tool.
Recently I've reached more than 250 000 text files in my database. And
I've seen losts of these errors when using mknmz:
Malformed UTF-8 character (unexpected continuation byte XYZ, with no
preceding start byte) messages
and:
Wide character in print at /usr/bin/mknmz line 2475.
As a result, the answers to my queries are now always empty !!
With the full index:
http://ghanima.alarue.net/frcd/cgi-bin/namazu.cgi?query=test&idxname=frcd.temp
With a temporary index I'm currently rebuilding:
http://ghanima.alarue.net/frcd/cgi-bin/namazu.cgi?query=test&idxname=frcd
I've spent weeks and weeks generating my index file (the index is now
370Mo), so I'd need to know if I have to re-build the whole thing...
Would using the fedora patch solve my problem ? Is there a way to
"clean" the index ? A mknmz option perhaps ? (I've not found it btw)
Namazu is really a great tool (and thanks a lot for bringing it to us
!), but it would really be a pain if I had to build my index again...
For your info:
12/08 0:04 julio(_at_)gourdon /mnt/frcd% mknmz -C
Loaded rcfile: /etc/namazu/mknmzrc
System: linux
Namazu: 2.0.13
Perl: 5.008004
File-MMagic: 1.22
NKF: module_nkf
KAKASI: module_kakasi -ieuc -oeuc -w
ChaSen: module_chasen -j -F '%m '
Wakati: module_kakasi -ieuc -oeuc -w
Lang_Msg: en_IE
Lang: en_IE
Coding System: euc
CONFDIR: /etc/namazu
LIBDIR: /usr/share/namazu/pl
FILTERDIR: /usr/share/namazu/filter
TEMPLATEDIR: /usr/share/namazu/template
Supported media types: (22)
Unsupported media types: (11) marked with minus (-) probably missing
application in your $path.
- application/excel: excel.pl
application/ichitaro5: taro56.pl
application/ichitaro6: taro56.pl
- application/ichitaro7: taro7_10.pl
application/macbinary: macbinary.pl
- application/msword: msword.pl
- application/pdf: pdf.pl
application/postscript: postscript.pl
- application/powerpoint: powerpoint.pl
- application/rtf: rtf.pl
application/vnd.sun.xml.calc: ooo.pl
application/vnd.sun.xml.draw: ooo.pl
application/vnd.sun.xml.impress: ooo.pl
application/vnd.sun.xml.writer: ooo.pl
application/x-apache-cache: apachecache.pl
application/x-bzip2: bzip2.pl
application/x-compress: compress.pl
application/x-deb: deb.pl
- application/x-dvi: dvi.pl
application/x-gzip: gzip.pl
- application/x-js-taro: taro7_10.pl
- application/x-rpm: rpm.pl
- application/x-tex: tex.pl
- audio/mpeg: mp3.pl
message/news: mailnews.pl
message/rfc822: mailnews.pl
text/hnf: hnf.pl
text/html: html.pl
text/html; x-type=mhonarc: mhonarc.pl
text/plain
text/plain; x-type=rfc: rfc.pl
text/x-hdml: hdml.pl
text/x-roff: man.pl
zsh: 1803 exit 1 mknmz -C
Thanks a lot !
--
Julien Gourdon <julio(_at_)cnedra(_dot_)org>
C'Nedra