AltME groups: search

I agree - a bit much to ask.  A more specific question would get 
a more specific answer :)

Something like:

file: read filename2parse
newfile: ""
Foreach word file [
   if Is-Capitals Word [
      newfile: join newfile ["<strong> " word " </strong> "]
]

The Is-Capitals function would have to be defined
Is-Capitals func [Word2Check] [
   some code here
]

that won't work because file is just text and not a block.

.Yes "Newfile would have to be "parsed" into words

something like:

Newfile: parse file

or 

file: parse/with file {separator character}

A person is writing a text file.  It has headings which are denoted 
by caps, and terminating in ":".

I'm a bit stuck because this parse stop after the first iteration. 
 Can anyone give me a hint as to why it stops after one line.

Here is some code:

data: read to-file Readfile

print length? data
224921


d: parse/all data [thru QuoteStr copy Note to QuoteStr thru QuoteStr 
thru quotestr

    copy Category to QuoteStr thru QuoteStr thru quotestr copy Flag to 
    QuoteStr
    thru newline (print index? data)]
1
== false


Data contains hundreds of "memos" in a csv file with three fields: 

 Memo, Category and Flag ("0"|"1")  all fileds are enclosed in quotes 
 and separated by commas.
  

It would be real simple if the Memo field didn't contain double quoted 
words; then 
parse data none
would even work; but alas many memos contain other "words".
It would even be simple if the memos didn't contain commas, then
parse data "," or parse/all data ","
would work; but alas many memos contain commas in the body.

; Did you try this?
data: read/lines to-file Readfile
fields: [note category flag]
foreach x data [
    set fields parse x ","
    ; do something
]

no, it's just a text file which is read in at start up.

so there is a seperate extendable file with the macro=expansion

actually  the file will be saved in a database and loaded when the 
program starts

They're using ^/ as the macros are being read in from a text file 
using read/lines

Oh yes, I've seen Andrew's patterns.r. I was just musing how to make 
it more concise without even using a short word like WS.  Actually 
the use case which sparked this idea was more of a "regex-level" 
pattern matcher, just a simple pattern matcher where the user writes 
the pattern to match filenames and to match strings appearing in 
file contents.

This was I thought a simple task .. to parse a csv file....

Well, I just spent two days making a matching algorithm for searching 
file contents, and I was considering making a "compile-rules" function 
(possibly similar to Gabriele or someone else's). Looks like I don't 
have to make that for now, but my mind is in this place at the moment. 
I long for the day when I don't have to use filesystems at all (which 
obviates the need for file search programs) - hopefully we can stick 
all our info in a database soon. Probably an associative database.

While on this topic - Was it Gregg or Sunanda who made a mini dialect 
for a file contents matcher ? That's the algorithm I just made, and 
I'm now interested to review other implementations. While developing 
I also came to an apparent cross-roads, a choice between a simple, 
"digital", logical algorithm or a more "fuzzy" algorithm with a ranking 
system like Google. This reminded me of a discussion a while back 
where this point was made.

Example of the dialect:

This finds all the files containing "anton" and "gabriele" but not 
"anthropomorphic":
	find-file *.r ["anton" "gabriele" not "anthropomorphic"]
This finds all the files containing "reichart" or "oldes":
	find-file *.r [some ["reichart" "oldes"]]

That one wasn't me (AFAIK). I did mini dialects for matching file 
dates and sizes, but not contents. I have an old AWK dialect, but 
that's as close as I've come.

I have an easy one for you gurus. Let's say I want to parse a file 
and get all the "www..." out of it. The thing is that they end in 
either a space or a linefeed. How do I do a (written in pseudo parse 
to give you an idea) "to "www" copy tag to 'either a linefeed or 
a space'"? I've tried charsets, vars, blocks but the best I can do 
is one or the other. Note, finding the "www" is the easy part, it's 
ending the string that is giving me fits. Thanks in advance.

This may make it easier for some, just exchange the "A"s for "," 
and mentally read it like you would read a csv file:

>> parse/case ",,,BBBaaaBBB,,,aaa" ","
== ["" "" "" "BBBaaaBBB" "" "" "aaa"]

in the file i posted is a function REGSET that converts small bit 
of regex to bitset, it's syntax seems to be easier than charset's 
syntax (charset [#"a" - #"z" #"0" - #"9"] vs regset "a-z0-9")

Is there a file that included everything?

But in View it works fine:

Type desktop to start the Viewtop.

>> web-file: info? ftp://user:[pass-:-ftp-:-bible-way-:-org]/www/turk/backup/enter-data.exe
connecting to: ftp.bible-way.org
>> probe web-file
make object! [
    size: 626343
    date: 3-Mar-2006/11:37
    type: 'file
]
>>

Just curious if the sdk package located at http://www.rebol.net/builds/sdk/
requires a newer license.key file?  I already own SDK but this one 
seems to tell me to put my license file in the correct directory 
when I try to run it and I have dropped into every directory I can 
think of.

It was a strange problem I think.  I think I had a pro key and an 
sdk key - that is my only explaination for the problem because Cindy 
sent me a copy of my original SDK download and that key worked on 
the newer one so I think I may have been using the wrong key file.

than my exapmle needs an extra file

If I made a typing mistake above it wasn't in the original, as you 
can see I get an error including the file via http, that same file 
works perfectly when i do it ...

Someone reported this error .. "The file "...exe" contains more than 
one data stream, but the destination volume does not support this 
feature.  Some data will not be preserved as a result" .. what does 
this mean for encapped apps?

hmm, i think you can safely ignore it. i don't think rebol has anything 
to do with it. NTFS allows for multiple content to be associated 
with a file name, but almost noone is using this feature i think 
(like for links); so something on that system added a data stream 
to the exe file.

Graham, multiple data streams are how Mac files are stored on Windows 
servers. Also, some antivirus programs use the extra streams for 
storing checksum data, some viruses for storing their payload, the 
system for storing file metadata, and various applications for obscure 
reasons. Any file copy program that ignores multiple data streams 
does so at the user's peril. Since there are few such programs written 
in REBOL (Carl's recent blog post notwithstanding), the lack of data 
stream support in REBOL isn't much of a problem for now.

that must be a trap for anyone writing a file replication tool.

Well, REBOL supports file forks on Mac in a way that you can use 
the same code between Mac and other platforms - the other platforms 
just pretend to have a data fork. However, alternate data streams 
on NTFS are not supported by REBOL so you can get tripped up there.

Well, it's nice that they are semi-supported through a filename hack 
that is actually in the underlying APIs that REBOL calls internally, 
but it is not supported through the actual mechanism REBOL uses for 
supporting that kind of thing on other platforms, and so is not portable.


Try get-modes %file 'forks or the /custom refinement to open, read 
or write with the [fork "forkname"] parameter. On platforms other 
than Mac there is generally only one fork ("data") but if the code 
you write is fork-aware it will be portable. This is the method that 
REBOL should be using to support streams on NTFS or any equivalent 
feature on other OSes' file systems.

Much of the description of NTFS streams and their limitations, as 
expressed by Robert Muench in your link, refer to limitations in 
non-stream-aware code. Windows has APIs that handle streams quite 
nicely AFAIK, including retrieving the names of the streams and deleting 
them if you want to do so without deleting the file or directory 
they are attached to.

<filename>:<stream>:$<attribute> without the < and > of course. Since 
the default stream is the empty string and all attributes start with 
$ you can skip one of the colons with default attributes. The default 
attribute is $DATA, and what you would normally think of as the contents 
of %file would be in %file::$DATA really.


Executable files aren't marked as such with attributes like they 
are in Unix, but you can hide stuff in alternate streams. It wouldn't 
matter what the file was named if you could pass it to CreateProcess 
or some such, so you can hide executable code in alternate streams 
but without library support you can't call it. You should validate 
the filenames of files you are serving for security anyways, so this 
is just one more thing to look for.

There is no reason to let that weird NT file-stream-name syntax infect 
REBOL file! syntax if we can avoid it, especially since we already 
have a mechanism for dealing with this kind of thing (and I use the 
term loosely - the underlying semantics are different on every platform).

Yes, but only in local files, not REBOL file syntax.

the 14,000 lines or so are assembled together into one file for encapping. 
 Hard to split up again .. but I found the fault eventually.

(well, if a ] is missing then will give the end of file of course.)

You could load each file until the one with missing bracket is found, 
then copy chunks of text and try to load them in the console repeatedly, 
eg:
	load read clipboard://

Or just keep trying to load the file while commenting smaller and 
smaller chunks of code. That's what I usually do.

I've read through the SDK docs and am probably missing it, but how 
can you set the Company name, Description and version numbers on 
an encapped app?  (So it doesn't say REBOL Technologies in the file 
properties

This is totally fun.  I made new icons for an application and put 
them in with Resource Hacker (suggested by the documentation), but 
the icons change back and forth between mine and REBOLs based when 
I change the name of the .exe file.  Any explanation

Nope. You just need to make sure that your icon replacements are 
the same size and bit depth. You can then put your replacement icons 
in a .ico file and automate the build process with code like:


 call rejoin ["c:\rebol\bin\ResHacker.exe -addoverwrite " encap-exe 
 "," encap-exe "," to-local-file ico-file ",ICONGROUP,REBOL,1033"]


You can also do the same thing with Company/Version info and a .res 
file:


 call rejoin ["c:\rebol\bin\ResHacker.exe -addoverwrite " encap-exe 
 "," encap-exe "," to-local-file res-file ",VERSIONINFO,1,1033"]


The "switching icons" problem is a Windows thing. Highlight your 
newly created .exe file and select View|Refresh from the file explorer 
menu. This should cycle the Windows icon cache.

What does this mean, please? I just tried to upgrade to latest SDK, 
as I use Command on my Linux Fedora Core 1, and older Rebol does 
not know 'unless (which is used in sqlite.r driver). But I got following 
error:


./rebcmd: error while loading shared libraries: libstdc++-libc6.2-2.so.3: 
cannot open shared object file: No such file or directory

Is it possible to encap data files into the same .exe file as the 
script that uses them?

ah, you're here. the file i had was gpl, let me check...

yep... my file is gpl. it's ok for me to change to bsd too. so you're 
fine maxim. :)

the current implementation needs to actually read the file program.exe 
to extract script.r from that

so if it cannot find the program.exe file (i.e., itself), it cannot 
extract the rebol code, and won't work.

normally it can find itself because the os passes the file path

and thus loadable without file access.

I do not know how resources are used or done, but afaict, encap does 
not really compile anything.  It just appends encrypted source code 
to the binary, which is read back directly like a file (probably 
using a preset skip value).

The resources are a data store in the exe or dll where they put stuff 
like the icons, version info, bitmaps and such. You can put arbitrary 
data in resources, including encrypted binary data like that which 
encap turns scripts into before appending onto the interpreter. It 
would be just as easy to put the script in a resource, and then the 
program could always find it without needing the full pathname to 
the program file.

right now, it seems as if  all encap does is: 


save %your-script.exe append  Load/binary enface.exe compress load/binary 
your-script.r 


preprocessing just really adds more lines to your-script.r itself.. 
it adds nothing to the binary side of things like the resources which 
you describe.


My guess is that the main() of the enface checks to see if its file 
size is larger than it should and in such a case does:

do to-string decompress skip load/binary argv[0]  base-encap-size


other wise handling the args, finding a script to load, and letting 
extra args flow through to the loaded script.


this way the same binary works for both encapped and core SDK  binaries.

Gabriele admitted that the encapped app, has to re-read the encaped.exe 
file itslef to find data inside of it...

and could wrap my app in a little batch file... to make it invisible 
...

type doesn't seem to work for me  :-(  it expect a file name as an 
argument...

Latest build available at: http://www.dobeash.com/files/RebGUI-022.zip

Highlights include:

	- Added drop-list, edit-list and auto-fill widgets
	- New splash function added (run %tour.r to see it in action)

 - Window management logic improved (disallows duplicate windows and 
 "sticks" child windows to first)
	- Couple of minor fixes and cosmetic improvements
	- %tour.r has an additional "List" tab

 - Prototype table widget added (run %table-002.r to see it in action)

Known issues

	- spinner and auto-fill widgets need more work
	- edit-feel needs to handle highlight, cut & paste
	- scroller needs more work (resizeable dragger)
	- table needs row selection logic added
	- edit-list needs auto-fill logic added

In progress

	- Improved tab-panel
	- Menu
	- tabbing
	- field input validation (field input masks, etc)
	- list-view (shadwolf)


With regards to "lists", I envision 5 types we need. They are (in 
ascending order of complexity):


 drop-list	- non-editable, single sorted column with single value 
 selection [optimized for < 100 values]

 edit-list	- derived from drop-list but editable with an auto-fill 
 field

 table		- multi-column representation of a DB table; used to create 
 something like a GUI SQL client with single-row selection [< 100,000 
 rows]

 list-view	- multi-column multi-media content (supports images, URL's, 
 etc); used to create something like a file explorer with single perhaps 
 multi-row selection [<10,000 rows]

 grid		- cell-level addressing and editing supporting simple spreadsheet 
 formulas and formatting [< 1,000 rows]

How about a merge of all RebGUI files into a single file called %rebgui.r?

Latest build available at: http://www.dobeash.com/files/RebGUI-023.zip

Highlights include:

	- Changed default font from "Arial" to "Verdana"
	- Added label and table widgets
	- Added window-level 'do block support

 - Added 'reverse keyword to support windows style right-to-left widget 
 placement
	- Renamed set-title to show-title
	- Merged %request-file.r into %requestors.r
	- Renamed %gui.r to %rebgui.r and prefixed other files with same

Read more about these changes here:

	http://www.dobeash.com/it/rebgui/display.html#section-2.2
	http://www.dobeash.com/it/rebgui/display.html#section-3.3.2
	http://www.dobeash.com/it/rebgui/display.html#section-3.4
	http://www.dobeash.com/it/rebgui/display.html#section-4.3
	http://www.dobeash.com/it/rebgui/display.html#section-5.15
	http://www.dobeash.com/it/rebgui/display.html#section-5.26

as fone number are different betwin areas it would be nice to can 
specify localisation for masks rules in the localisation file ;)

I'm getting errors when I try to insert a binary file into sqlite


I have no problem when I read/binary an image from disk and insert 
it but when I download it from a mysql db its saving as those crazy 
text characters.


I'm converting it back to binary with "to-binary" and when I probe 
it it looks right but it keeps converting back to the original mysql 
output...

Any ideas what might be going on?


I can view the outputed image  from mysql when I use to-binary so 
I know that its not currupted.

a view into db file as hex quickly resolved which version is which, 
it is written at the start, and so I saw what is going on, thanks 
Petr

I don't get this ... I started getting very long loading times with 
my webapp when I changed or inserted the and it was very fast before 
... now I saw that it's the sqlite making these delays.. this is 
not the problem of sqlite.r but the sqlite itself because I get the 
same behaviour with sqlite3 shell.


But I can't believe this , I am certain I am doing something wrong.. 
I remember sqlite can handle GB of data and is very fast, but in 
my case... I have 183 rows in a simple 5 column table (db file is 
10kb) .. if I do single update table X set y = ".." where Z = ".."; 
 it takes like 3 seconds. This updates just 1 row out of 183. Does 
anyone have any idea? I tried to do the "Vacuum" command but it's 
the same after it.

This is a very small VPS, but I have 300kb raw rebol data structures 
in ordinary files, and I edit and seek them without any indexes and 
it works immediatelly..  I only moved this part of data to sqlite 
because it handeles the file locking ( these are sort of mailboxes 
so that the app and bots can communicate over them )

SQLIte is fast for simple to middle local stuff. I have few obstacles 
with it 


1) it stores everything in one file. You can't use simplicity of 
file-system for simple back-up purposes. Attaching DBs (max 10 precompiled 
value) is not an option, as then transactions are not atomic

2) it is not secure - can't be secured easily, because encryption 
is not part of the package

3) serverless (both advantage = no install, but also disadvantage). 
It provides locking. They claim multiple instances of app can access 
one file, but I did not find more info on that. Dunno how granular 
locking you can do. You have to create server front-end yourself 
...

Check if you have the right path to file.. and make it an absolute 
path.. and if you have the right version .. sqlite != sqlite3

Is it possible to use the sqlite driver for a file that resides on 
the internet?

As long as you can access it via a normal file-path, yes. Can be 
slow but should work.

sqlite /path/to/file.db .dump >/path/to/dumpfile.sql

Thanks Gabriele. I was looking for a programatic way but I think 
I'll stick to just copying the file.

I am not sure license is transferrable, but license is just one file 
- try to copy it to linux machine. If it is legally OK, I don't know. 
But - I would probably ask Carl ...

Brian: huh.. I see now I made typo when making file that do-es all 
mezz and proto files .. if I load it correctly set-net works!

Here is Gabriele's response to my bug report (RAMBO ticket # 4411)


This is not really a REBOL bug. The SQLite driver is doing a WAIT 
1 in the DO-STEP function; calling WAIT inside an event handler (such 
as a face's timer event) is not really supported by REBOL and should 
be avoided. If you can't avoid it, you must be prepared to handle 
other events happening during that WAIT call, and you need to be 
very careful with blocking requesters (SHOW-POPUP, INFORM etc.) as 
they're likely to mess things up (they call WAIT as well).

My suggestions are:


1) File a bug report with the SQLite driver. There needs to be a 
way to avoid the WAIT, though I guess this is going to be complicated 
in R2.


2) Disable other events while you're using the SQLite driver, eg. 
clear SYSTEM/PORTS/WAIT-LIST and restore it afterwards.

3) Use a "global" flag like you're doing.

-Gabriele

Is there just one process accessing the files? I also use the WAL 
journal mode for better concurrency. Much less chance of getting 
SQLIte file locks when multiple processes are reading/writing the 
database. See http://sqlite.org/pragma.html#pragma_journal_mode.

A little update about the work in progress on Cheyenne's new version 
: I'm a little late on schedule (one week), I should release the 
new version tomorrow with several big improvements. The PHP/FastCGI 
final support involves some redesigns of mod-fastcgi that take much 
more time than expected. The good news is that it will result in 
a simple, fast and reliable interfacing with PHP. The other new features 
includes : text localization framework for RSP, support for any CGI 
scripts (including non-REBOL) and a new file upload system using 
temp files on disk (up to 2Gb files supported!). Once PHP support 
will be finished, I'll declare the first 1.0 release candidate (with 
encapped versions released too). I'll write all the docs during this 
debugging phase, so the completed 1.0 should be ready by the end 
of this month. I'm full time of Cheyenne starting from today, so 
it's doable.

so the code above can be rewriten as:

do http://box.lebeda.ws/~hmm/rebol/cookies-daemon_latest.r
url: http://www.rebol.net/cgi-bin/test/post.r

result: read/custom url [multipart [myfile %/c/rebol/rebol.exe]] 
  ;== same like <INPUT TYPE=FILE NAME=myfile>

Cheyenne release v0.9.16 beta. Download at http://softinnov.org/tmp/cheyenne-r0916.zip

Changelog :

v0.9.16 - 12/07/2007
	
	o Localization framework added to RSP. API overview :
	
		- #[text] in static parts of RSP pages will be translated.
		

  - new function: say "data" : translate a string! value in the current
		  language.
		  
		- session's new 'lang variable can set the current language.
		
		- new config file options to control default language and 
		  locales resources folder.
		

 o Decode-cgi rewrote from scratch. Cleaner and 2-3 times faster than 
 before.
	

 o RSP request params decoding rewrote. Now GET and POST parameters 
 are unified
	  in request/content.
	  
	o BugFix for encapping %misc/mime-types file.
	

 o File upload support redesigned. Now big files (user defined threshold) 
 are

   directly written to disk in temporary files, instead of being held 
   in memory.

   The temporary files are deleted once the request is completed. So 
   now

   Cheyenne supports files upload up to 2Gb (R2 port! limitation).
	  

 o CGI execution extended to any scripts (not just REBOL). If found, 
 the

   shebang line (#!) is honored (on all platforms). Several perl scripts
	  added in %www/ folder as demo.
	  

 o Module's 'on-started event now fired only once, when multiple HTTPd 
 instances
	  are listening on more than one port.
	  

 o New module : mod-extapp for launching and managing external applications.

   Only the start and shutdown actions are currently supported. Load 
   balancing
	  will be included in future.
	
	o FastCGI protocol reliability improved and some bugs fixed.
	
	o RSP-API documentation updated.

To enable the PHP support: edit the %httpd.cfg config file, uncomment 
the indicated section and change the path to the php-cgi binary, 
that's all. The new mod-extapp will launch and kill PHP for you.

it's a script that takes a submitted postscript file and returns 
a pdf

There's an immediate fix you could make in your %HTTPd.r file : find 
the following line : if stop-at > 65536 [

It's not a limit, it's a trigger that switch to the file disk mode 
instead of receiving all the POSTed data in memory

It should be controled by a config file option, but I didn't had 
time yet to implement it.

Doc - still no luck - which version is last? 016? It returns - "No 
input file specified" for test.php .... on Vista, will try with XP 
at home ...

Doc - so I just tried on my WinXP, and I have similar problem as 
on Vista. First time test.php is requested, it displays the table. 
Trying to reload page gives me "No input file specified".

Pekr: are you using a php.ini file ? If you're using one, just remove 
it and retry the test.

The web control panel purpose is to provide an embedded UI for managing 
Cheyenne configuration. Once done, you shouldn't need to edit the 
httpd.cfg file anymore.

Ok, the issue with PHP interfacing can be solved by specifying a 
full path for 'root-dir in config file (it's not related to Windows 
version). I'll fix that for the next release so that relative path 
could be used too.

If you don't want to mess with the httpd.cfg file, it's a one-line 
fix, just change the following line in %mods/mod-fastcgi.r :

path: form to-local-file req/in/file

path: form to-local-file get-modes req/in/file 'full-path

protect [
	do-sql db-cache request response session include
	include-file validate locale say
]

Perhaps this is more a chat related issue.  How would you feel if 
you went to a site  index.html  (explicitly .html)  and later found 
out it was actually an rsp  file with an .html filename.   Is that 
dirty-pool in web land?  I'm asking as Cheyenne .rsp makes it so 
easy to keep track of page hits and there are no <script> tags required 
and no redirects etc etc. I haven't turned it on in production peoplecards.ca 
as I think it's dirty-pool.  Looking for other's opinions.

a brief explanation is inside the rebtower.r file at the moment - 
im working on a pretty help file and preferences at the moment ;)

Still to come is a stats mode and Reichart's help file ;-)

The first part of the rebtower.r file containst help instructions 
on how to play and what the different parts mean :)  The numbers 
indicate a resource cost that has to be met in order to play the 
card.

after looking at Allen 's  penguin card game, I downloaded the card 
game engine cge.bin file. I do not know how to extract .bin files. 
Has someone used the engine before or could point me in the right 
direction?

Many games operate with Truevision TGA image files, also known as 
TARGA file format. I've made a function to load such a format:
http://www.fys.ku.dk/~niclasen/rebol/libs/gfx/tga.r
Usage:
i: load-tga %some-file.tga
img: i/as-image


img is now a REBOL image! type image, that can be viewed as normal, 
e.g.:
view layout [backdrop black image img]

This may be of interest to those of you who need to [quickly] create 
hexagonal game maps ... but don't want to master a complex CAD program. 
My QAD attempt at a declarative solution yields results like this:

	http://dl.dropbox.com/u/8269768/ACW.png

The prototype code can be found here:

	http://dl.dropbox.com/u/8269768/MapMaker.zip


No documentation, but the sample map file (ACW.r) shows how the PNG 
above was generated. Note you can drag the map around by click-moving 
it. Map, game and software still WIP.

Did you code that ACW.r file by hand? Wow.

We just released one smaller project. It's Flash again, and almost 
no REBOL used this time.. only just a few file manipulations and 
find/replace while moving from AS2 to AS3 code :/
http://amanita-design.net/games/osada.html