World: r3wp

Your storing data in blocks into a file that is one large container 
block?

the virtual block acts like block. you can store any type of values 
in it (which are blocks or not)

So is a virtual block in essence a file?

yes

Is the whole file loaded into memory at once or is data read from 
it in chunks?

chuncks, i said no memory overhead, if not there is no interests 
to develop such scheme

so we can basically manage gigabyte sized blocks?

Yes, good.

So does it maintain the index order of the individual blocks within 
it?

yes Henrik, we can

yes Paul it uses 2 files: an index and the data

Oh, I see.

Steeve, I could use that. :-)

This is a bit like Tretbase.

so the data is a plain binary?

Tretbase uses data and a index.

yes Paul like your tretbase conception, the only difference is that 
it's a scheme and there is no new functions to deal with.
The programmer can continue to think is working with a block.

does rebdev work with chat from r3?

Cool Steeve.

Mchean, rebdev is chat. Same thing.

How is the  performance Steeve?

No Henrik, the data are stored like rebol values (not in binary or 
other obfuscated format).

It means that you can load the data files (with load %data) and you 
will load that whole block into memory.

Steeve&Paul where to read about I missed the point

About  what part Pavel?

Steeve, could the file be compressed or is that too much overhead 
or unfit for the scheme?

virtual block scheme

That is Steeve's design.

Mine is a bit different.

Henrik when i enter chat in R3 console i get Script error: chat has 
no value

is it available?

Paul, i can't test the perfs currently, because there is some remaining 
bugs in the file scheme, so that i have to open close the ports each 
time a value is append in the block.

Virutual block scheme? - I think it is going to be in R3.

OK

Yes, I konw how that is.

In Tretbase, I decide to incorporate a second method that uses just 
the data file and reads blocks from it.

It required that I had to create a block parser.

So it is essential like read/lines but instead it reads blocks.

mchean, it's only available in the latest alpha.

>> source chat
chat: make function! [[
    "Open REBOL DevBase forum/BBS." /local err
][
    print "Fetching chat..."
    if error? err: try [do http://www.rebol.com/r3/chat.rnone] [

        either err/id = 'protocol [print "Cannot load chat from web."] [do 
        err]
    ]
    exit
]]

Henrik, there is no need to automaticly compress the  data. If you 
want so, just append compressed data in the block.
>> append v-block compress data

Steeve, that takes up double size on disk, doesn't it?

don't see your point Henrik, double size compared with what ?

compared to an actual binary. you said, that data was stored as plain 
REBOL data in the file.

but if you want to store binary data, just add binary data, i do 
not any conversion, store your data int he format you want

thanks

hum, i see your point now henrik, yes even binary data are stored 
as rebol values, so that there take much more space.

yes, that's what I meant. :-)

perhaps i will add on option in the scheme to store data as pure 
binaries

it might be useful in cases where you want to store images and such.

right