[wisam abbasi]

I am processing Arabic files using python
It works normally, but when I use the TK GUI to display the text it gives strings as follows:

äæÑãÈíÑÛ - ãä ÅíäíÓ ÈÇíÑ ÝÇÈÑ-ßÇÓÊá 
íÞæá ÃäØæä ÝæáÝÛÇäÛ ÛÑÇÝ Ýæä ÝÇÈÑ-ßÇÓÊáﾡ ÑÆíÓ ÇáãÄÓÓÉ ÇáÇáãÇäíÉ áÊÕäíÚ ÇáÇÏæÇÊ ÇáßÊÇÈíÉ ÇáÊí ÊÍãá ÇáÇÓã ÐÇÊåﾡ Åäå ÈÕÑÝ ÇáäÙÑ Úä ÇáÇäÊÑäÊ æÑÓÇÆá ÇáåÇÊÝ ÇáãÍãæá æÃÌåÒÉ ÇáßãÈíæÊÑ ÇáÊí íãßä ÍãáåÇ Ýí ÇáíÏ ÇáæÇÍÏɡ ÝÅä ÃÞáÇã ÇáÑÕÇÕ ÇáãÊæÇÖÚÉ ãÇ íÒÇá ÃãÇãåÇ ãÓÊÞÈá.

So, What's the problem?

[Motoma]

More than likely it is a font issue. Try setting the font manually to something you know can properly represent the character set you are using.

Disclaimer: I have no experience with programming in non-English languages.

[wisam abbasi]

Motoma, on 02 May 2011 - 11:54 AM, said:

More than likely it is a font issue. Try setting the font manually to something you know can properly represent the character set you are using.

Disclaimer: I have no experience with programming in non-English languages.

I've tried so, and it didn't work

[mi14chal]

Well you'll try to it:

text = u"Arabic text"

And after pass variable text to function will show this text.

[wisam abbasi]

mi14chal, on 02 May 2011 - 12:34 PM, said:

Well you'll try to it:

text = u"Arabic text"

And after pass variable text to function will show this text.

Ok, but what if you have somthing like this:

input=open('file.txt','r')
text=input.read()
input.close

and now you want to display the text

text=r(text)

will not work

[mi14chal]

Read the paragraph Reading UTF-8 Files on this website: http://www.evanjones...ython-utf8.html

[baavgai]

This worked:

s = u'\u0645\u0631\u062d\u0628\u0627 \u0627\u0644\u0639\u0627\u0644\u0645'

from Tkinter import *

root = Tk()

w = Label(root, text=s)
w.pack()

root.mainloop()

This didn't work:

open('dump', 'w').write(s)
s2 = open('dump', 'r').read()

This did:

open('dump', 'w').write(s.encode('UTF-8'))
s2 = codecs.open('dump', "r", "utf-8" ).read()

Hope this helps.

[wisam abbasi]

mi14chal, on 02 May 2011 - 01:22 PM, said:

Read the paragraph Reading UTF-8 Files on this website: http://www.evanjones...ython-utf8.html

I've tried the examples mentioned to Arabic strings, and here is the output:

s = "وسااام"
u = unicode( s, "utf-8" )
backToBytes = u.encode( "utf-8" )
print backToBytes

and here is the error:

Traceback (most recent call last):
  File "C:\Users\one.omary\Desktop\AJURL.pyw", line 2, in <module>
    u = unicode( s, "utf-8" )
UnicodeDecodeError: 'utf8' codec can't decode byte 0xe6 in position 0: invalid continuation byte
>>> 

[wisam abbasi]

baavgai, on 02 May 2011 - 01:32 PM, said:

This worked:

s = u'\u0645\u0631\u062d\u0628\u0627 \u0627\u0644\u0639\u0627\u0644\u0645'

from Tkinter import *

root = Tk()

w = Label(root, text=s)
w.pack()

root.mainloop()

This didn't work:

open('dump', 'w').write(s)
s2 = open('dump', 'r').read()

This did:

open('dump', 'w').write(s.encode('UTF-8'))
s2 = codecs.open('dump', "r", "utf-8" ).read()

Hope this helps.

I am confused I don't know if the problem in the coding or in me. It gives this error:

Exception in Tkinter callback
Traceback (most recent call last):
  File "C:\Python27\lib\lib-tk\Tkinter.py", line 1410, in __call__
    return self.func(*args)
  File "C:\Users\one.omary\Desktop\GP\Atext.pyw", line 75, in sos
    open('s.txt','w').write(s.encode('UTF-8'))
UnicodeDecodeError: 'ascii' codec can't decode byte 0xe4 in position 80: ordinal not in range(128)
>>> 

[wisam abbasi]