utf-8 invalid on diff

[skuda21]

when i try to make a diff about the changed file and local changes of head revision i get this error forever. UTF-8 valid data (hex: 74 72 75 6e 6b 2f 75 70 64 61 74 65 72 2e 70 79 09 28 72 65 76 69 73 69) followed by a UTF-8 invalid sequence (hex: f3 6e 3a 20)

ADDITIONAL INFORMATION: i am using kde 3.5.0 and spanish regional settings.

[skuda21]

i doesnt matters if i use kompare or internal diff, its the same result.

[alwin]

this failure is from subversion-lib. seems that somewhere in the code is a wrong conversion to utf8. Contains the filename some spanish characters? Or just the content.

[skuda21]

all the filenames that i try doesnt not contain spanish characters and the content either.

[bLuE]

This also happens to me but, when opening any repository. The data show on 'Valid' and 'Invalid' is also different from skuda21 but, it always the same data, no mater the repository.

I'm using SuSE 9.3 with kde 3.5.0 and Portuguese regional settings.

I also have a SuSE 10.0 box and, all works ok whith kdesvn-0.7.1

If you want to take a look at the repository, it is world readable at:

 svn://ruisantos.com/artemis

[alwin]

Ok, tnx - I'll try it and hopefully I'll find it where the wrong translation is done. But this moment the connection seems broken.

[alwin]

Hmpf. Of course it does not happen to me - is it possible you may try out the version from branch?

[bLuE]

I assume you mean that you want mew to compile a new svn from a souce repository, right? If so what branch do you want me to try out? vncppqt_qt4 ? If not, wich one?

I've been having problems with my ISP connection. sorry about that...

[alwin]

 http://www.alwins-world.de/repos/kdesvn/branches/rel_0_7

[bLuE]

I get an erro when compiling kio_svn. Here is the output:

make[3]: Entering directory `/home/rsantos/Desktop/temp/svn/KDESvn/branches/rel_0_7/src/kiosvn' /bin/sh ../../libtool --silent --tag=CXX --mode=link g++ -Wnon-virtual-dtor -Wno-long-long -Wundef -Wall -W -Wpointer-arith -Wwrite-strings -ansi -D_XOPEN_SOURCE=500 -D_BSD_SOURCE -Wcast-align -Wconversion -Wchar-subscripts -O2 -Wformat-security -Wmissing-format-attribute -fno-check-new -fno-common -fexceptions -o kio_ksvn.la -rpath /usr/local/kde/lib/kde3 -avoid-version -module -L/usr/X11R6/lib -L/usr/lib/qt3/lib -L/opt/kde3/lib -avoid-version -module -no-undefined -Wl,--no-undefined -Wl,--allow-shlib-undefined -R /opt/kde3/lib -R /usr/lib/qt3/lib -R /usr/X11R6/lib kiosvn.lo kiolistener.lo ../../src/svnfrontend/fronthelpers/libsvnfrontend_helpers.la ../../src/svncpp/libsvnwrapper.la ../../src/helpers/libhelper.la -lkio -lkparts -L/usr/lib -lapr-0 -lrt -lm -lcrypt -lnsl -lpthread -ldl -L/usr/lib -laprutil-0 -lgdbm -ldb-4.3 -lexpat -lneon -lssl -lcrypto -lz -lxml2 -lz -lpthread -lm -L/usr/lib -lsvn_client-1 -lsvn_wc-1 -lsvn_ra-1 -lsvn_delta-1 -lsvn_subr-1 -lkio /usr/lib/gcc-lib/i586-suse-linux/3.3.5/../../../../i586-suse-linux/bin/ld: cannot find -lldap collect2: ld returned 1 exit status make[3]: * [kio_ksvn.la] Error 1 make[3]: Leaving directory `/home/rsantos/Desktop/temp/svn/KDESvn/branches/rel_0_7/src/kiosvn' make[2]: * [all-recursive] Error 1 make[2]: Leaving directory `/home/rsantos/Desktop/temp/svn/KDESvn/branches/rel_0_7/src' make[1]: * [all-recursive] Error 1 make[1]: Leaving directory `/home/rsantos/Desktop/temp/svn/KDESvn/branches/rel_0_7' make: * [all] Error 2

Can you help me with this?

[alwin]

linking against ldap? Sometimes distributions are strange.... Think you require the ldap-devel package :/ Other hand: few minutes ago I found a possible reason for the above problems, it comes due modifications for compiling against qt4. I'd checked it into branch, would nice if both of you may try it. If it works I'll release 0.7.2 ASAP.

[bLuE]

It was the ldap package devel package that was missing. thnaks for it.

I tryed 0.7.2 and, it did not solve my problem...

Just keep in mind that I also have a SuSE10.0 box, running svn0.7.1, and accessing that same repository, that the SuSE9.3 working with svn0.7.1 cannot... Just trying to help you track the bad guy... :)

[alwin]

As I said: checked just a few minuts ago (fix in path.cpp/.hpp), may that you didn't get it 'cause it was after you're first try.

Adn may you send me both qconfig.h (eg, from SuSE 10 and SuSE 9.3)? May that I understand the difference between both installations.

skuda21: which distribution you're using? SuSE, too?

[skuda21]

Not, i am using Gentoo Linux 2005.1 with kernel 2.6.14-ck5, svn version 1.3.0_rc4 and kde 3.5.0, i have tested your kdesvn version from  http://www.alwins-world.de/repos/kdesvn/branches/rel_0_7 and i have the same problem.If you need from me any other test or a shell or any other thing lets me know.

[bLuE]

Alwin,

The lastest changes did not produce any noticable diference.

About the qconfig, here they are:

qconfig.h from SuSE9.3

/* Everything */

/* License information */ #define QT_PRODUCT_LICENSEE "Free" #define QT_PRODUCT_LICENSE "qt-free"

/* Build key */ #define QT_BUILD_KEY "i686 Linux g++-3.* full-config"

/* Machine byte-order */ #define Q_BIG_ENDIAN 4321 #define Q_LITTLE_ENDIAN 1234 #define Q_BYTE_ORDER Q_LITTLE_ENDIAN

/* Compile time features */ #define QT_LARGEFILE_SUPPORT 64 #define QT_POINTER_SIZE 4 #ifndef QT_NO_IM_EXTENSIONS # define QT_NO_IM_EXTENSIONS #endif

qconfig.h from SuSE10.0

/* Everything */

/* License information */ #define QT_PRODUCT_LICENSEE "Free" #define QT_PRODUCT_LICENSE "qt-free"

/* Build key */ #define QT_BUILD_KEY "i686 Linux g++-4 full-config"

/* Machine byte-order */ #define Q_BIG_ENDIAN 4321 #define Q_LITTLE_ENDIAN 1234 #define Q_BYTE_ORDER Q_LITTLE_ENDIAN

/* Compile time features */ #define QT_LARGEFILE_SUPPORT 64 #define QT_POINTER_SIZE 4 #ifndef QT_NO_IM_EXTENSIONS # define QT_NO_IM_EXTENSIONS #endif

diff between those two:

--- qconfig.h.suse93 2006-01-03 19:31:09.000000000 +0000 +++ qconfig.h.suse10 2005-11-23 22:18:25.000000000 +0000 @@ -5,7 +5,7 @@

#define QT_PRODUCT_LICENSE "qt-free"

/* Build key */

-#define QT_BUILD_KEY "i686 Linux g++-3.* full-config" +#define QT_BUILD_KEY "i686 Linux g++-4 full-config"

/* Machine byte-order */ #define Q_BIG_ENDIAN 4321

Hope it helps...

[alwin]

Ok, I have no idea any more this moment. I have the feeling that something goes wrong with your codepages 'cause I never got such reports from other SuSE 10 or Gentoo installations. What happens when you switch your locale to a english environment? Would it possible?

If all fails, I'll must setup more pointed exception-messages, eg., I'll try to put some information about subversion-function executed into debug-messages on console, may that that would get more clear when running from console.

but a hint: It could possible that you had compiled the latest from branch but executed the one from installation! The reason is that the real program is a shared lib. What to do?

Scenario: you checked out from branch. did a make -f Makefile.cvs; ./configure; make

after that do (from folder where Makefile.cvs is located):

cd src mkdir lib cd lib ln -s ../.lib kde3 cd ../ export KDEDIRS=pwd:$KDEDIR ./kdesvn

now kdesvn loads the shared lib fresh build and not that one from installation.

When installed from branch make sure you installed into the same place as before, possible that you have to restart kde then. You may check if it will load the right plugin then when open plugin in konqueror-filemanager and select "about kdesvn_part" from konqueror help menu.

Hope that this will help....

[bLuE]

SUCCESS - But strange...

1st:

Those final instructions for KDEDIRS Worked nicely but i had to replace 'ln -s ../.lib kde3' with 'ln -s ../.libs kde3'.

2nd:

Now, there is no svn part to look for in kdesvn help button. But it works...

Do you have any comment on this?

About your final comment: The problem was just with SuSE9.3. SuSE10.0 always worked.

[alwin]

1st:

Those final instructions for KDEDIRS Worked nicely but i had to replace 'ln -s ../.lib kde3' with 'ln -s ../.libs kde3'.

<<<<<<<<<< my failure - .libs is correct.

2nd:

Now, there is no svn part to look for in kdesvn help button. But it works...

<<<<<<<<< that "about kdesvn_part" is removed in kdesvn 0.7.2 - this will just shown when plugged in into other containers like konqueror or quanta. Means it is correct.

So, fine. Than one problem is fixed. skuda21: I found a possible reason for your problem, too a few minutes ago. Would great if you could test it.

But it is real strange that it just happens with your locale settings....... not with my (german).

[skuda21]

alwin i have the same problem with the last instructions, do i have any way to test if i am doing correctly, i cannot reload kde because i use gnome, the about says me that its kdesvn 0.7.2, i am doing all the stuff showed here: make -f Makefile.cvs; ./configure; make cd src mkdir lib cd lib ln -s ../.libs kde3 cd ../ export KDEDIRS=pwd:$KDEDIR ./kdesvn

[smilnok]

I've got the exact same problem using 0.8 (in debian unstable kde 3.5.2, french locale)

[alwin]

Ok, I checked it again and again. Disabled all automatic conversions. All string go trough utf8 conversion routines. So question: Did the same effect happen when switching the locale to another one, for instance english, or any other than spanish or frensh? I have moments I believe that there is a problem inside qt or subversion with some utf8 codes. Or a strange side effect between LC_LOCAL, KDE-region-setting and qt-utf8 translation or such. I don't know. I can not find any error nor I have an idea.

[smilnok]

hi again,

After upgrading my packages (debian unstable french locale) from kdesvn 0.8.0-1 to kdesvn_0.8.1-1_i386 everything is back to normal and working fine ...

cheers

[mariopal]

Hi,

I've translated KDEsvn to Spanish ('es.po now in trunk') and I have Debian unstable Spanish locale with KDE 3.5.2 and kdesvn 0.8.1-1, and I have the same problem. When I click on 'Diff (local)', I get this:

---

Datos UTF-8 v??lidos (hex: 61 6d 70 6c 65 73 2f 65 78 61 6d 70 6c 65 2e 63 09 28 72 65 76 69 73 69) seguidos de una secuencia UTF-8 inv??lida (hex: f3 6e 3a 20)

---

The last message is writing in Spanish, the translation is: "Valid UTF-8 data (hex: ...) followed by an invalid UTF-8 sequence (hex: ...)"

I think is a message from Subversion (spanish locale too).

Maybe this can help: I'd wrote this in a konsole and this is the result:

---

$ kdesvn exec diff example.c kdesvn: Execute a command package version in svnqt missmatched release version!

kdesvn: New SvnActionsData?() kdesvn: New SvnActionsData?() finished kdesvn: Urlpath: /home/mario/tmp/examples/example.c kdesvn: Url:  file:///home/mario/tmp/examples/example.c - path: /home/mario/tmp/examples/example.c kdesvn: Resulting url: /home/mario/tmp/examples/example.c kdesvn: Uri zum testen:  file:///home/mario/tmp/examples/example.c kdesvn: Local diff Datos UTF-8 v??lidos (hex: 61 6d 70 6c 65 73 2f 65 78 61 6d 70 6c 65 2e 63 09 28 72 65 76 69 73 69) seguidos de una secuencia UTF-8 inv??lida (hex: f3 6e 3a 20)

---

Watching the source, the 'missmatched release version' is because svnqt have version 0.8.0, and kdesvn have version 0.8.1.

The file 'example.c' that I try doesn't contain Spanish characters and the content either. If I write "svn diff example.c", there is no problems.

I've discover that the valid UTF-8 data in the message is this text: "amples/example.c (revisi"

And the invalid sequence is this: "ón:"

This last begin with a Spanish character!!

When I write "svn diff example.c", in the output I can see the word "revisión" translated to Spanish (with the 'o' acute):

---

$ svn diff example.c Index: example.c =================================================================== --- example.c (revisión: 1) +++ example.c (copia de trabajo) @@ -1,5 +1,7 @@

/*

example.c

+ + Some changes.

*/ #include <stdio.h>

---

If I move the Subversion Spanish .mo file in '/usr/share/locale/es/LC_MESSAGES/subversion.mo' to another place, all the Subversion messages are in English, and KDEsvn works fine.

It seem that Subversion localized to Spanish write internal text translated to Spanish (maybe converting to the charset ISO-8859-15 that I use in konsole) and KDEsvn can't handle it. I hope this can help to solve the bug.

Greetings.

[alwin]

May I got it resolved in rel 0.8.3 due changes of encoding special chars in urls?

[mariopal]

I'm sorry, I've tested with 0.8.3 (Debian package) and I have the same problem...

[alwin]

aye. I think found it - I used wrong string translation all the time inside backend, so it runs into trouble. with current trunk it should work now.

[mbiebl]

I just tested 0.9.0 which according to the Changelog should fix this problem. Unfortunately it does not. To reproduce the bug you can follow the instructions on  http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=369809

Try it with a locale like es_ES@euro and you should be able to trigger the bug.

[alwin]

I have no idea anymore. Seems that I may not use qt-translation-scheme instead of subversions char-translation.

[alwin]

*f.....* (sorry)

but seems that I found the reason. Libraries without workflow description are the hell. Simply forgot all the time the main init of the subversion library. Taking a look into the commandline client sometimes help....

[alwin]

Fix comes with next bugfix release