r3wp [groups: 83 posts: 189283]
  • Home
  • Script library
  • AltME Archive
  • Mailing list
  • Articles Index
  • Site search
 

World: r3wp

[!REBOL3-OLD1]

Pekr
30-Oct-2009
[19272]
if in ascii, it will be loaded ok, no?
Maxim
30-Oct-2009
[19273]
ascii is 127 bytes... we are talking about the upper 127 chars.
Pekr
30-Oct-2009
[19274x4]
sqlab - how do you want to do the conversion automatically? How should 
R3 know, what code-page the script is in? Maybe we could use header 
field, and load could act uccording to it?
Ascii is 255 ;-)
you trying to tell me, I can't load upper 127 bytes?
mmnt ...
Maxim
30-Oct-2009
[19278x2]
upper 127 are NOT ascii.
they are different all around the world.
Pekr
30-Oct-2009
[19280x2]
holy crap, wtf? :-)
It really does not work :-) I thought, that platform locale, as in 
R2, will be loadable, even without unicode.
Maxim
30-Oct-2009
[19282]
http://en.wikipedia.org/wiki/ASCII
sqlab
30-Oct-2009
[19283]
R3 should not try to do that automatically, if I do not want that
Maxim
30-Oct-2009
[19284x2]
the 256 char encodings are often mixed up since they used to be loosly 
refered to  ANSI
http://en.wikipedia.org/wiki/Windows-1252
Pekr
30-Oct-2009
[19286]
so what is an option? load/as? What if my script contains string 
in various charset?
sqlab
30-Oct-2009
[19287]
The systems I know before, had a default codepage and did use Unicode 
only as an option.

I think it would have been enough, if R3 just added an Unicode datatype.
But now it's probably too late.
Maxim
30-Oct-2009
[19288x2]
R3  is unicode from A-Z.   the code is unicode.
but for data, I would like to have default encoding of my choice.
Pekr
30-Oct-2009
[19290]
It is really not good, that I can't load my own local codepage. How 
should I make my source-file UTF-8? My Notepad will not probably 
add any BOM header for me automatically ...
Maxim
30-Oct-2009
[19291x3]
utf-8 needs no BOM... its only used as a signature.
if you only use ascii (lower 127 chars)  you will see no difference.
since rebol will load files as UTF-8 by default code doesn't need 
it.
Gabriele
30-Oct-2009
[19294]
guys, please, we are in 2009... how is it possible you're still using 
latin1...
Maxim
30-Oct-2009
[19295x2]
hum... cause everything I use is ascii or latin-1 ?
well, windows ANSI..
sqlab
30-Oct-2009
[19297]
Even you live in 2009, most people are born in the last century.
And many recipes, are older than the people, 
at least the good ones. (recipes for cooking food I mean:)
PeterWood
30-Oct-2009
[19298]
..and sticking to the old ways means living with the old problems 
... like not knowing how to interprete characters properly ... like 
AlrME for example ... it assumes makes the assumption that all text 
in messages is encoded as though it was entered on your own machine. 
So messages from Mac users are incorrecly displayed on Windows machines 
and vice-versa.


For me, moving to utf-8 is a much easier problem to live with than 
not being able to properly share text across different platforms. 
It may be different for you.
Henrik
30-Oct-2009
[19299]
REBOL3's philosophy should be simple: UTF-8 is default. Anything 
else is possible, but must be optionally selected.
sqlab
30-Oct-2009
[19300x3]
Livnig with the old problems means knowing the old solutions.

Displaying text in windows is a different problem to loading programs.
By the way, Ticket #0000589  leads still to a crash, even it was 
set to build again.
build = built
Maxim
30-Oct-2009
[19303]
re-open it.
PeterWood
30-Oct-2009
[19304]
Loading programs are not totally immune from encoding problems. An 
unlikely but possible example:

if name = "Ashley TrŸter" [print "Hello Ashley"]
sqlab
30-Oct-2009
[19305x2]
Then I would prefer, that name and the string to compare have an 
unicode datatype, 
as in
>> type? name
== UTF-8.
if name = U8{Ashley ...
Maxim
30-Oct-2009
[19307x2]
but utf-8 editors aren't rare nowadays, and using utf-8 sequences 
isn't hard... really, if you tuely want to keep using as ascii editor
tuely = truely
sqlab
30-Oct-2009
[19309]
But they do not convert automatically ..
Maxim
30-Oct-2009
[19310x6]
handling encoding is complex in any environment... I had a lot of 
"fun" handling encodings in php, which uses such a unicode datatype... 
its not really easier... cause you can't know by the text if its 
unicode or ascii or binary values unless you tell it to load a sequence 
of bytes AS one or the other.
with mashup software its even worse... when done improperly, you 
end up with data with multiple encodings in the same document .... 
and then all hell breaks loose  :-)
at least converging to utf-8, all scripts by all authors will work 
the same on all systems.
cause there is just ONE encoding.
but having some kind of default for read/write could be usefull, 
instead of having to add a refinement all the time, and force a script 
to expect a specific encoding.
then it would be easier to change it one place, do all I/O without 
the refinement.  and less work for another to change encoding for 
the whole app and having to put conditionals everytime we use read/write.
Pekr
30-Oct-2009
[19316]
Max - so what is an easy solution for me, to load my local scripts 
on my local system, which contain czech alphabet signs > 127?
Maxim
30-Oct-2009
[19317x4]
IIRC there was intended to have a header attribute specifying encodings 
for the script body...
don't know if its implemented or not.
I put a suggestion on the blog about allowing user-creating encoding 
maps... otherwise, you can load it as binary in R3 and just convert 
the czech chars to utf-8 multi-byte sequences and convert the binary 
to string using decode.
is the czech encoding the standard windows ansi  encoding?
PeterWood
30-Oct-2009
[19321]
Yes on Czach machines ..... I think its Windpws codepage 1250. I 
beleive the default codepage on most US machines is 1252 (MS's extended 
version of ISO-8859-1).