World: r3wp
[!REBOL3-OLD1]
older newer | first last |
Pekr 30-Oct-2009 [19272] | if in ascii, it will be loaded ok, no? |
Maxim 30-Oct-2009 [19273] | ascii is 127 bytes... we are talking about the upper 127 chars. |
Pekr 30-Oct-2009 [19274x4] | sqlab - how do you want to do the conversion automatically? How should R3 know, what code-page the script is in? Maybe we could use header field, and load could act uccording to it? |
Ascii is 255 ;-) | |
you trying to tell me, I can't load upper 127 bytes? | |
mmnt ... | |
Maxim 30-Oct-2009 [19278x2] | upper 127 are NOT ascii. |
they are different all around the world. | |
Pekr 30-Oct-2009 [19280x2] | holy crap, wtf? :-) |
It really does not work :-) I thought, that platform locale, as in R2, will be loadable, even without unicode. | |
Maxim 30-Oct-2009 [19282] | http://en.wikipedia.org/wiki/ASCII |
sqlab 30-Oct-2009 [19283] | R3 should not try to do that automatically, if I do not want that |
Maxim 30-Oct-2009 [19284x2] | the 256 char encodings are often mixed up since they used to be loosly refered to ANSI |
http://en.wikipedia.org/wiki/Windows-1252 | |
Pekr 30-Oct-2009 [19286] | so what is an option? load/as? What if my script contains string in various charset? |
sqlab 30-Oct-2009 [19287] | The systems I know before, had a default codepage and did use Unicode only as an option. I think it would have been enough, if R3 just added an Unicode datatype. But now it's probably too late. |
Maxim 30-Oct-2009 [19288x2] | R3 is unicode from A-Z. the code is unicode. |
but for data, I would like to have default encoding of my choice. | |
Pekr 30-Oct-2009 [19290] | It is really not good, that I can't load my own local codepage. How should I make my source-file UTF-8? My Notepad will not probably add any BOM header for me automatically ... |
Maxim 30-Oct-2009 [19291x3] | utf-8 needs no BOM... its only used as a signature. |
if you only use ascii (lower 127 chars) you will see no difference. | |
since rebol will load files as UTF-8 by default code doesn't need it. | |
Gabriele 30-Oct-2009 [19294] | guys, please, we are in 2009... how is it possible you're still using latin1... |
Maxim 30-Oct-2009 [19295x2] | hum... cause everything I use is ascii or latin-1 ? |
well, windows ANSI.. | |
sqlab 30-Oct-2009 [19297] | Even you live in 2009, most people are born in the last century. And many recipes, are older than the people, at least the good ones. (recipes for cooking food I mean:) |
PeterWood 30-Oct-2009 [19298] | ..and sticking to the old ways means living with the old problems ... like not knowing how to interprete characters properly ... like AlrME for example ... it assumes makes the assumption that all text in messages is encoded as though it was entered on your own machine. So messages from Mac users are incorrecly displayed on Windows machines and vice-versa. For me, moving to utf-8 is a much easier problem to live with than not being able to properly share text across different platforms. It may be different for you. |
Henrik 30-Oct-2009 [19299] | REBOL3's philosophy should be simple: UTF-8 is default. Anything else is possible, but must be optionally selected. |
sqlab 30-Oct-2009 [19300x3] | Livnig with the old problems means knowing the old solutions. Displaying text in windows is a different problem to loading programs. |
By the way, Ticket #0000589 leads still to a crash, even it was set to build again. | |
build = built | |
Maxim 30-Oct-2009 [19303] | re-open it. |
PeterWood 30-Oct-2009 [19304] | Loading programs are not totally immune from encoding problems. An unlikely but possible example: if name = "Ashley TrŸter" [print "Hello Ashley"] |
sqlab 30-Oct-2009 [19305x2] | Then I would prefer, that name and the string to compare have an unicode datatype, as in >> type? name == UTF-8. |
if name = U8{Ashley ... | |
Maxim 30-Oct-2009 [19307x2] | but utf-8 editors aren't rare nowadays, and using utf-8 sequences isn't hard... really, if you tuely want to keep using as ascii editor |
tuely = truely | |
sqlab 30-Oct-2009 [19309] | But they do not convert automatically .. |
Maxim 30-Oct-2009 [19310x6] | handling encoding is complex in any environment... I had a lot of "fun" handling encodings in php, which uses such a unicode datatype... its not really easier... cause you can't know by the text if its unicode or ascii or binary values unless you tell it to load a sequence of bytes AS one or the other. |
with mashup software its even worse... when done improperly, you end up with data with multiple encodings in the same document .... and then all hell breaks loose :-) | |
at least converging to utf-8, all scripts by all authors will work the same on all systems. | |
cause there is just ONE encoding. | |
but having some kind of default for read/write could be usefull, instead of having to add a refinement all the time, and force a script to expect a specific encoding. | |
then it would be easier to change it one place, do all I/O without the refinement. and less work for another to change encoding for the whole app and having to put conditionals everytime we use read/write. | |
Pekr 30-Oct-2009 [19316] | Max - so what is an easy solution for me, to load my local scripts on my local system, which contain czech alphabet signs > 127? |
Maxim 30-Oct-2009 [19317x4] | IIRC there was intended to have a header attribute specifying encodings for the script body... |
don't know if its implemented or not. | |
I put a suggestion on the blog about allowing user-creating encoding maps... otherwise, you can load it as binary in R3 and just convert the czech chars to utf-8 multi-byte sequences and convert the binary to string using decode. | |
is the czech encoding the standard windows ansi encoding? | |
PeterWood 30-Oct-2009 [19321] | Yes on Czach machines ..... I think its Windpws codepage 1250. I beleive the default codepage on most US machines is 1252 (MS's extended version of ISO-8859-1). |
older newer | first last |