World: r3wp
[!REBOL3 Extensions] REBOL 3 Extensions discussions
older newer | first last |
Kaj 26-Jan-2011 [2065x2] | Exactly, so every program needs to test on which OS it runs and execute different IMPORT branches. So why not pull that into IMPORT itself? |
IMPORT uses the OS's dynamic library loader, which searches through the system's locations where libraries are registered. So you install R3 extensions there, in the system. If you use .rx extensions, they will be the only ones, awkwardly between lots of .so files on POSIX systems and lots of .dll files on Windows | |
BrianH 26-Jan-2011 [2067] | For one thing: system/options/default-suffix. For another thing, platform-specific stuff doesn't go in the mezzanines, it goes in the host code, as a (really strict) rule. For most code that needs extensions there is assumed to be a bit of platform-specificity, due to the nature of extensions. Nonetheless, this is why LOAD-EXTENSION is implemented in the host code, and why we can reference functions by word name. |
Kaj 26-Jan-2011 [2068] | I don't care if the implementation is in mezzanine or in the host. My question was if IMPORT can look for .so on POSIX and .dll on Windows? |
BrianH 26-Jan-2011 [2069] | Also, look at system/options/file-types. You can find the file extensions that are loaded as R3 extensions, and then go through them, adding them to your file's base name to find your file. Or you can add a one or two line platform-specific wrapper for your module code. |
Kaj 26-Jan-2011 [2070x2] | default-suffix is .reb and that is meant for a mezzanine module, not for an extension |
file-types contains "%.so extension" so we're halfway there, but IMPORT doesn't act on it | |
BrianH 26-Jan-2011 [2072] | You don't want IMPORT to do automatic lookup for more than one file extension because it's a potential security hole. For that matter, you should know if you're loading an extension instead of a module, because extensions could break the rules that REBOL source modules can't. And system/options/default-suffix can be set by your program. For that matter, the host code for LOAD-EXTENSION could translate .rx to .so on platforms that require .so and won't load .rx - that is a platform-specific restriction. |
Kaj 26-Jan-2011 [2073] | That's why I don't want to use .reb for extensions |
BrianH 26-Jan-2011 [2074] | I said system/options/default-suffix because it's settable, even at runtime, not to suggest that you can use .reb for your extensions. |
Kaj 26-Jan-2011 [2075] | That seems to me to be a much bigger security hole |
BrianH 26-Jan-2011 [2076] | It's program-local. The program should protect that setting if it is going to load untrusted code. |
Kaj 26-Jan-2011 [2077] | The translation of .rx to .so and .dll sounds like the proper solution |
BrianH 26-Jan-2011 [2078] | Not .dll - it would only be required on platforms with a restriction on filenames that can be loaded as libraries. On windows there are dozens of different suffixes that are all basically DLLs, including .exe, .ocx, .dpl, .cpl, etc. Not many platforms restrict the file suffixes of libraries. |
Kaj 26-Jan-2011 [2079x2] | I'm not so much concerned about the ability of the base operating systems, but all the tools out there that expect conventions |
If the problem wouldn't exist, then why define both .rx and .so in the first place? | |
BrianH 26-Jan-2011 [2081] | But in general extensions are considered to be unsafe and platform-specific unless they are embedded in the host. For that matter, they aren't even loadable by default, as a security setting. Cross-platform external extensions are expected to be rare, but just in case we have the .rx suffix if you want to use them in cross-platform code. |
Kaj 26-Jan-2011 [2082] | I don't have to disable any security to load extensions on POSIX |
BrianH 26-Jan-2011 [2083x2] | >> secure 'query SECURE is disabled |
Security doesn't work in a110. | |
Kaj 26-Jan-2011 [2085] | Sorry, that's just weird. I expect most extensions to be cross-platform |
BrianH 26-Jan-2011 [2086x2] | That is why we have .rx, for cross-platform extensions. They are supposed to stand out, so you know they're R3 extensions instead of normal libraries. For that matter, they are also supposed to support writing .rx loaders for built-in .dll or .so libraries that you didn't even write, even with the same name (except the suffix) in the same directory if you like. |
It's the same reason Windows has .dll, .exe, .ocx, .cpl, etc. All DLLs, but different expectations for what functions are exported and how they're called. | |
Kaj 26-Jan-2011 [2088] | Of the few tools I use, I already know one that I will have to modify for this non-standard extension |
BrianH 26-Jan-2011 [2089] | Which tool? I'm curious. Which platform has this restriction? |
Kaj 26-Jan-2011 [2090x2] | Builder on Syllable |
It's my own tool, so it's not a big deal, but people will run into tools that they can't easily modify | |
BrianH 26-Jan-2011 [2092] | Can Syllable load dynamic libraries with arbitrary file suffixes? |
Kaj 26-Jan-2011 [2093x2] | Yes, but as I said, that's not my main concern. It's the breaking of the convention that will trip up as-yet unknown tools |
And there may be other operating systems that are less flexible | |
BrianH 26-Jan-2011 [2095] | Those operating systems shouldn't add %.rx to file-types then - the code that sets that is in the host. Some platforms are less cross-platform than others. |
Kaj 26-Jan-2011 [2096] | That leaves the main problem that the user-level REBOL code is not cross-platform |
BrianH 26-Jan-2011 [2097] | Do you have a problem with making an embedded delayed extension that loads cURL dynamically when the extension is imported? This is supposed to be possible, and is the main reason for delayed modules and extensions. Then only programs with Needs: [curl] would initialize curl. |
Kaj 26-Jan-2011 [2098] | It's really quite simple: there are two worlds here, and if REBOL pretends to be cross-platform, it needs to bridge them |
BrianH 26-Jan-2011 [2099] | R3 external extensions don't pretend to be cross-platform; if they are, it's a bonus. Only embedded extensions pretend to be cross-platform. |
Kaj 26-Jan-2011 [2100] | That's a disaster, then. But it's really very simple to avoid it |
BrianH 26-Jan-2011 [2101] | This group here is where cross-platform starts going away. |
Kaj 26-Jan-2011 [2102x2] | Nonsense. R3 is cross-platform, cURL is cross-platform, and the extension compiled on Linux even runs on Syllable |
I haven't touched Windows in years, and I never wanted to be a Windows C programmer, but now I am, just because Oldes and Andreas compiled my extension on it | |
Pekr 26-Jan-2011 [2104] | what is the trouble here? Calling R3 extensions 'rx (btw I like the name) might not work with some tools, which expect certain suffixes? |
BrianH 26-Jan-2011 [2105] | R3 is cross-platform, and cURL is cross-platform, but both require a little work to make the platform distinctions go away. POSIX helps with this on POSIX platforms, but that's not everything. You can do a little extra work in your extension to make it work the same externally, so R3 code can't tell the difference, but if you want that to extend to filenames then you have to pick a cross-platform filename standard. Once the extension is loaded, embedded or delayed it can be referred to by module name. We don't want IMPORT to grab extensions in its module-paths lookup because that would make it possible to load an extension when you were looking for a safe module, so .rx and .so files aren't going to be in the search list unless your program sets system/options/default-suffix to .rx or .so, with the same security implications. |
Kaj 26-Jan-2011 [2106x4] | Yes, and literally the only platform distinction is the file extension |
I am fine with explicitly specifying an extension, just not with a forced file extension. How about IMPORT/EXTENSION ? | |
Do you have a problem with making an embedded delayed extension that loads cURL dynamically when the extension is imported? This is supposed to be possible, and is the main reason for delayed modules and extensions. Then only programs with Needs: [curl] would initialize curl. | |
Yes, I have a problem with that. It's way too much work for making a file extension dynamic, and it breaks most of my use cases | |
BrianH 26-Jan-2011 [2110] | There are many platforms that use the same file extensions, so you'll have to find a way to put the BSD .so files in another directory from the Linux .so files. The .rx extension just adds Windows and OSX to that. |
Kaj 26-Jan-2011 [2111] | That's merely a problem of organising download directories |
BrianH 26-Jan-2011 [2112x2] | I'm sorry that you got used to loading extensions without needing to turn off the security restrictions in R3. If it helps you to know, you can also specify modules to import on the command line, or put your platform-specific delayed module loads in %rebol.r. |
%rebol.r is sort of an addon to the host code. | |
Kaj 26-Jan-2011 [2114] | The security setting is not the issue here |
older newer | first last |