When Allegro CL starts, it maps the image, data, and shared objects to memory. With larger images and applications, this mapping has become a concern for programmers. In this collection of FAQ entries, we describe the issues surrounding heap placement.
Q 3.9-1) Sometimes Allegro CL, particularly large images, run out of memory or fail totally with a bus error or a segv. Why might this be happening?
Q 3.9-2) How is heap placement determined and what can go wrong?
Q 3.9-3) How does Lisp start up, in terms of shared-library linking and loading?
Q 3.9-4) What is the "Old Sun4" problem?
Q 3.9-5) How can I tell what addresses are being used in my process space?
Q 3-9.6) [Windows only] How do I move DLL in memory so that it doesn't conflict with the Lisp heap?
Q 3-9.7) What does the "Temporarily scaling back lisp reserved region from XXX to YYY bytes." mean?
Q 3.9-1) Sometimes Allegro CL, particularly large images, run out of memory or fail totally with a bus error or a segv. Why might this be happening?
A 3.9-1) There are problems with the memory mapping and locations of the Lisp and foreign (C) heaps in a running Lisp image. We refer to these problems collectively as the heap placement problem. While these problems are not in fact new, they are only triggered when the Lisp image is large (typically greater than 500 Mbytes). Only recently have such large images become common.
Q 3.9-2) How is heap placement determined and what can go wrong?
A 3.9-2) When Allegro CL starts up, space must be found for the following:
If you use 32 bit addressing (as Allegro CL does on most platforms), there are potentially 4 Gigabytes of address space. However, most operating systems only allow 31 bit addresses, so only 2 Gigabytes are really available. Locations near address 0 (the bottom) are usually used by OS or kernel related things. Allegro CL therefore usually tries to start at some OS-dependent location, typically x20000000, so there is about 1.6 Gigabytes potentially above that. That is plenty for an application that uses less than, say, 0.5 Gigabytes, but as the application grows to, say, 1.5 Gigabytes, finding enough space becomes problematic.
A further complication arises from mapping of shared libraries, including the Allegro CL shared library which has extension .pll. Most shared libraries have a location where they prefer to be mapped. In some cases, problems arise if they cannot be mapped in that location.
Finally, Lisp has an idea (provided by the lisp-heap-size argument to build-lisp-image (see building-images.htm) of how much space it will need. When Lisp starts up, it tries to "get" that amount of space. We put "get" in quotation marks because it does not have a platform-independent meaning. On some (Sparcs, e.g.) you can reserve space but, like a reserve credit line, it is only taken when actually needed. More precisely, on such machines, Allegro CL reserves that amount of space. The Operating System then precludes other programs from using the reserved address space, but does not map the reserved space to actual swap space. When reserved space is mapped to swap space, the space is then committed. This is fine on the machines that support the distinction between reserved and committed space, but some machines (HP's running HP-UX 10.20, machines running Linux, and IBM machines running AIX) do not. On these machines the space you need is committed as soon as asked for, and so specifying a large lisp-heap-size on those machines can cause excessive swap space usage if the committed space is not actually needed.
So , what might go wrong when Allegro CL starts up? The following might be problems:
Even though this problem may affect any user of Allegro CL or an Allegro CL application, it is mostly a problem with developers of programs which will be distributed to a user base. Users who have an Allegro CL distribution and use a particular machine can, perhaps with trial and error (and perhaps with assistance from Franz Inc.), figure out how to build an image that will work on that machine. But VAR's, say, who are preparing a distribution requiring large images which will be sent to many customers, each of whom may have a different machine configuration and different programs running, may find it difficult to produce a single image suitable for all potential users on a particular platform.
Programmers can affect heap placements using these arguments to build-lisp-image (see building-images.htm):
Improvements in heap location management made available staring in release 5.0.1 make the successful mapping of large images more likely, and make the providing of one image for all users on a particular platform easier to solve. But, any application that uses most of the available address space is in danger of running into machine constraints which make the application fail.
Q 3.9-3) How does Lisp start up, in terms of shared-library linking and loading?
A 3.9-3) This is a complicated answer. We start with some terminology:
- The ACL shared library: This shared-library holds the base ACL system, and is sometimes known by the term "acldll". On Windows it is known as aclxxx.dll, and on UNIX it is called libaclxxx.ext where xxx is a version number and .ext is either .sl or .so.
- System libraries: shared-libraries that are pre-linked into either the ACL shared-library or the executable that loads the ACL library, or any shared-library on which a system library is dependent. This is a broad definition of system library, and can include any user-supplied library that has been linked into the executable.
- User loaded libraries: These are libraries that are loaded with the Common Lisp LOAD function, but not pre-linked as are system libraries.
Now, there is a potential problem with the last step. If
then it is conceivable that there will be no swap left for the loading of the user libraries.
In this situation, it would be best for the executable to be programmed to pre-load the user librar(y/ies) so that the space is pre-allocated. (You do this by writing a customized main() that loads the needed libraries, see main.htm.) But this presents the possibility that the user library might break up the contiguous address space for the Lisp heap, especially on Windows. The problem in intractable in general, but solvable in individual cases.
Q 3.9-4) What is the "Old Sun4" problem?
A 3.9-4) There are some Sun4 machines which, although they can run late versions of Solaris 2.x, cannot mmap addresses in higher memory than approximately 0x10000000. It is problematic to build a Lisp image on one of these machines, because the Lisp and C heaps must be relatively small.
You can build a Lisp image that will run on all Sparcs running the appropriate levels of Solaris 2, but which will be limited in address space, if you build your Lisp image (using build-lisp-image, see building-images.htm, or generate-application, see delivery.htm) with the following parameters:
- :lisp-heap-start #x4000000
- :lisp-heap-size #xfa0000 ; 16 Mb
- :c-heap-start #xc000000
- :c-heap-size #xfa000 ; 1 Mb
If you want to build your Lisp so that it can grow, the C heap must be higher; with the "heap placement patch" it defaults to #x54000000. But this will also preclude any use of the resulting images on old Sun4s. We have left you with the choice to make, instead of making it for you.
Q 3.9-5) How can I tell what addresses are being used in my process space?
A 3.9-5) There is a C function in the lisp:
void memory_status_dump(char *file);
If you define a foreign call to this function and then call it while the lisp is running, it will give you a dump of every address in the process, and its status.
For example, on Windows:
USER(1): (ff:def-foreign-call (memory-status-dump "memory_status_dump") ()) MEMORY-STATUS-DUMP USER(2): (memory-status-dump "c:/tmp/mem.txt")
Then, c:/tmp/mem.txt will contain:
0 - ffff 65536 free ----
10000 - 10fff 4096 commit private rw--
11000 - 1ffff 61440 free ----
20000 - 20fff 4096 commit private rw--
21000 - 3fffff 4059136 free ----
400000 - 400fff 4096 commit image r---
401000 - 405fff 20480 commit image r-x-
406000 - 406fff 4096 commit image r---
407000 - 414fff 57344 commit image rw--
415000 - 415fff 4096 commit image r---
416000 - 41ffff 40960 free ----
420000 - 141bfff 16760832 reserve private
141c000 - 141cfff 4096 commit private rw-- (guard)
141d000 - 141ffff 12288 commit private rw--
1420000 - 1426fff 28672 commit private rw--
1427000 - 151ffff 1019904 reserve private
1520000 - 1520fff 4096 commit mapped rw--
1521000 - 152ffff 61440 reserve mapped
1530000 - 1545fff 90112 commit mapped r---
1546000 - 154ffff 40960 free ----
1550000 - 1573fff 147456 commit mapped r---
1574000 - 157ffff 49152 free ----
1580000 - 15c0fff 266240 commit mapped r---
15c1000 - 15cffff 61440 free ----
15d0000 - 15d2fff 12288 commit mapped r---
15d3000 - 15dffff 53248 free ----
15e0000 - 15e7fff 32768 commit mapped r-x-
15e8000 - 169ffff 753664 reserve mapped
16a0000 - 16a0fff 4096 commit mapped r-x-
16a1000 - 16a7fff 28672 reserve mapped
16a8000 - 16affff 32768 free ----
16b0000 - 16f2fff 274432 commit mapped r---
16f3000 - 170ffff 118784 free ----
1710000 - 17eafff 897024 commit mapped r-x-
17eb000 - 1a0ffff 2248704 reserve mapped
1a10000 - 1a10fff 4096 commit private rw--
1a11000 - 1a1ffff 61440 free ----
1a20000 - 1a20fff 4096 commit private rw--
1a21000 - 1a2ffff 61440 free ----
1a30000 - 1a30fff 4096 commit private rw--
1a31000 - 1a4ffff 126976 reserve private
1a50000 - 1a57fff 32768 commit private rw--
1a58000 - 1a5ffff 32768 reserve private
1a60000 - 1a67fff 32768 commit private rw--
1a68000 - 1b5ffff 1015808 reserve private
1b60000 - 1b61fff 8192 commit mapped r---
1b62000 - 1b6ffff 57344 free ----
1b70000 - 1b70fff 4096 commit private rw--
1b71000 - 1beffff 520192 reserve private
1bf0000 - 1bf2fff 12288 commit private rw--
1bf3000 - 1bfffff 53248 reserve private
1c00000 - 1c02fff 12288 commit private rw--
1c03000 - 1c0ffff 53248 reserve private
1c10000 - 2c07fff 16744448 reserve private
2c08000 - 2c08fff 4096 commit private rw-- (guard)
2c09000 - 2c0ffff 28672 commit private rw--
2c10000 - 1fd0ffff 487587840 free ----
1fd10000 - 1fff1fff 3022848 commit mapped r---
1fff2000 - 1fffffff 57344 free ----
20000000 - 20000fff 4096 commit mapped rw--
20001000 - 20005fff 20480 commit mapped rw-c
20006000 - 20006fff 4096 commit mapped rw--
20007000 - 2000cfff 24576 commit mapped rw-c
2000d000 - 2000dfff 4096 commit mapped rw--
2000e000 - 20013fff 24576 commit mapped rw-c
20014000 - 20014fff 4096 commit mapped rw--
20015000 - 2001efff 40960 commit mapped rw-c
2001f000 - 2001ffff 4096 commit mapped rw--
20020000 - 20021fff 8192 commit mapped rw-c
20022000 - 20026fff 20480 commit mapped rw--
20027000 - 20029fff 12288 commit mapped rw-c
2002a000 - 2002afff 4096 commit mapped rw--
2002b000 - 2004bfff 135168 commit mapped rw-c
2004c000 - 2004cfff 4096 commit mapped rw--
2004d000 - 2004efff 8192 commit mapped rw-c
2004f000 - 2004ffff 4096 commit mapped rw--
20050000 - 20053fff 16384 commit mapped rw-c
20054000 - 20054fff 4096 commit mapped rw--
20055000 - 20059fff 20480 commit mapped rw-c
2005a000 - 2005afff 4096 commit mapped rw--
2005b000 - 20081fff 159744 commit mapped rw-c
20082000 - 20082fff 4096 commit mapped rw--
20083000 - 20083fff 4096 commit mapped rw-c
20084000 - 20085fff 8192 commit mapped rw--
20086000 - 20091fff 49152 commit mapped rw-c
20092000 - 20092fff 4096 commit mapped rw--
20093000 - 20098fff 24576 commit mapped rw-c
20099000 - 20099fff 4096 commit mapped rw--
2009a000 - 2009cfff 12288 commit mapped rw-c
2009d000 - 2009dfff 4096 commit mapped rw--
2009e000 - 2009efff 4096 commit mapped rw-c
2009f000 - 200a0fff 8192 commit mapped rw--
200a1000 - 200aafff 40960 commit mapped rw-c
200ab000 - 200abfff 4096 commit mapped rw--
200ac000 - 200d7fff 180224 commit mapped rw-c
200d8000 - 200d8fff 4096 commit mapped rw--
200d9000 - 200dffff 28672 commit mapped rw-c
200e0000 - 202dffff 2097152 commit private rwx-
202e0000 - 202f5fff 90112 commit mapped rw-c
202f6000 - 202f6fff 4096 commit mapped rw--
202f7000 - 2030afff 81920 commit mapped rw-c
2030b000 - 2030cfff 8192 commit mapped rw--
2030d000 - 2030dfff 4096 commit mapped rw-c
2030e000 - 2030efff 4096 commit mapped rw--
2030f000 - 2032afff 114688 commit mapped rw-c
2032b000 - 2032bfff 4096 commit mapped rw--
2032c000 - 2033dfff 73728 commit mapped rw-c
2033e000 - 2033efff 4096 commit mapped rw--
2033f000 - 2036ffff 200704 commit mapped rw-c
20370000 - 20371fff 8192 commit mapped rw--
20372000 - 20372fff 4096 commit mapped rw-c
20373000 - 20373fff 4096 commit mapped rw--
20374000 - 20374fff 4096 commit mapped rw-c
20375000 - 20375fff 4096 commit mapped rw--
20376000 - 20376fff 4096 commit mapped rw-c
20377000 - 20383fff 53248 commit mapped rw--
20384000 - 20384fff 4096 commit mapped rw-c
20385000 - 20386fff 8192 commit mapped rw--
20387000 - 20387fff 4096 commit mapped rw-c
20388000 - 2038dfff 24576 commit mapped rw--
2038e000 - 20391fff 16384 commit mapped rw-c
20392000 - 2039dfff 49152 commit mapped rw--
2039e000 - 2039ffff 8192 commit mapped rw-c
203a0000 - 204bffff 1179648 commit private rwx-
204c0000 - 204c0fff 4096 commit mapped rw--
204c1000 - 204cefff 57344 commit mapped rw-c
204cf000 - 204dcfff 57344 commit mapped rw--
204dd000 - 204dffff 12288 commit mapped rw-c
204e0000 - 205cffff 983040 commit private rwx-
205d0000 - 205d7fff 32768 commit mapped rw-c
205d8000 - 205d8fff 4096 commit mapped rw--
205d9000 - 205d9fff 4096 commit mapped rw-c
205da000 - 205dcfff 12288 commit mapped rw--
205dd000 - 205dffff 12288 commit mapped rw-c
205e0000 - 2effffff 245497856 reserve private
2f000000 - 53ffffff 620756992 free ----
54000000 - 54003fff 16384 commit mapped rw-c
54004000 - 54004fff 4096 commit mapped rw--
54005000 - 5400ffff 45056 commit mapped rw-c
54010000 - 54ffffff 16711680 reserve private
55000000 - 6384ffff 243597312 free ----
63850000 - 63850fff 4096 commit image r---
63851000 - 6388afff 237568 commit image r-x-
6388b000 - 6388cfff 8192 commit image r---
6388d000 - 63890fff 16384 commit image rw--
63891000 - 63891fff 4096 commit image rw-c
63892000 - 63894fff 12288 commit image rw--
63895000 - 63898fff 16384 commit image rw-c
63899000 - 63899fff 4096 commit image rw--
6389a000 - 6389cfff 12288 commit image rw-c
6389d000 - 6389efff 8192 commit image rw--
6389f000 - 6389ffff 4096 commit image rw-c
638a0000 - 638b0fff 69632 commit image r---
638b1000 - 6bbfffff 137687040 free ----
6bc00000 - 6bc00fff 4096 commit image r---
6bc01000 - 6bc08fff 32768 commit image r-x-
6bc09000 - 6bc09fff 4096 commit image rw--
6bc0a000 - 6bc0afff 4096 commit image rw-c
6bc0b000 - 6bc0bfff 4096 commit image rw--
6bc0c000 - 6bc0dfff 8192 commit image rw-c
6bc0e000 - 6bc14fff 28672 commit image r---
6bc15000 - 7096ffff 81113088 free ----
70970000 - 70970fff 4096 commit image r---
70971000 - 70a12fff 663552 commit image r-x-
70a13000 - 70a13fff 4096 commit image rw--
70a14000 - 70a15fff 8192 commit image rw-c
70a16000 - 70a16fff 4096 commit image rw--
70a17000 - 70b17fff 1052672 commit image r---
70b18000 - 70bcffff 753664 free ----
70bd0000 - 70bd0fff 4096 commit image r---
70bd1000 - 70c0efff 253952 commit image r-x-
70c0f000 - 70c0ffff 4096 commit image rw--
70c10000 - 70c13fff 16384 commit image r---
70c14000 - 7118ffff 5750784 free ----
71190000 - 71191fff 8192 commit image r---
71192000 - 71192fff 4096 commit image r-x-
71193000 - 71194fff 8192 commit image rw--
71195000 - 71196fff 8192 commit image r---
71197000 - 7158ffff 4165632 free ----
71590000 - 71590fff 4096 commit image r---
71591000 - 715f3fff 405504 commit image r-x-
715f4000 - 715f4fff 4096 commit image rw--
715f5000 - 71616fff 139264 commit image r---
71617000 - 7769ffff 101224448 free ----
776a0000 - 776a0fff 4096 commit image r---
776a1000 - 776a2fff 8192 commit image r-x-
776a3000 - 776a3fff 4096 commit image r---
776a4000 - 776a4fff 4096 commit image rw--
776a5000 - 776a6fff 8192 commit image r---
776a7000 - 776affff 36864 free ----
776b0000 - 776b0fff 4096 commit image r---
776b1000 - 776bcfff 49152 commit image r-x-
776bd000 - 776befff 8192 commit image r---
776bf000 - 776bffff 4096 commit image rw--
776c0000 - 776c3fff 16384 commit image r---
776c4000 - 776cffff 49152 free ----
776d0000 - 776d0fff 4096 commit image r---
776d1000 - 776d1fff 4096 commit image r-x-
776d2000 - 776d7fff 24576 commit image r---
776d8000 - 779bffff 3047424 free ----
779c0000 - 779c0fff 4096 commit image r---
779c1000 - 779c2fff 8192 commit image r-x-
779c3000 - 779c3fff 4096 commit image r---
779c4000 - 779c4fff 4096 commit image rw--
779c5000 - 779c7fff 12288 commit image r---
779c8000 - 77a8ffff 819200 free ----
77a90000 - 77a90fff 4096 commit image r---
77a91000 - 77a96fff 24576 commit image r-x-
77a97000 - 77a97fff 4096 commit image r---
77a98000 - 77a98fff 4096 commit image rw--
77a99000 - 77a9afff 8192 commit image r---
77a9b000 - 77d7ffff 3035136 free ----
77d80000 - 77d80fff 4096 commit image r---
77d81000 - 77d9efff 122880 commit image r-x-
77d9f000 - 77da1fff 12288 commit image r---
77da2000 - 77da5fff 16384 commit image rw--
77da6000 - 77db1fff 49152 commit image r---
77db2000 - 77dbffff 57344 free ----
77dc0000 - 77dc0fff 4096 commit image r---
77dc1000 - 77deafff 172032 commit image r-x-
77deb000 - 77df4fff 40960 commit image r---
77df5000 - 77df5fff 4096 commit image rw--
77df6000 - 77df8fff 12288 commit image rw-c
77df9000 - 77dfafff 8192 commit image rw--
77dfb000 - 77dfefff 16384 commit image r---
77dff000 - 77e0ffff 69632 free ----
77e10000 - 77e10fff 4096 commit image r---
77e11000 - 77e56fff 286720 commit image r-x-
77e57000 - 77e5cfff 24576 commit image r---
77e5d000 - 77e5dfff 4096 commit image rw--
77e5e000 - 77e66fff 36864 commit image r---
77e67000 - 77e6ffff 36864 free ----
77e70000 - 77e70fff 4096 commit image r---
77e71000 - 77eb1fff 266240 commit image r-x-
77eb2000 - 77eb9fff 32768 commit image r---
77eba000 - 77ebafff 4096 commit image rw--
77ebb000 - 77ec3fff 36864 commit image r---
77ec4000 - 77ecffff 49152 free ----
77ed0000 - 77ed0fff 4096 commit image r---
77ed1000 - 77ef4fff 147456 commit image r-x-
77ef5000 - 77ef5fff 4096 commit image r---
77ef6000 - 77ef6fff 4096 commit image rw--
77ef7000 - 77efbfff 20480 commit image r---
77efc000 - 77efffff 16384 free ----
77f00000 - 77f00fff 4096 commit image r---
77f01000 - 77f3bfff 241664 commit image r-x-
77f3c000 - 77f44fff 36864 commit image r---
77f45000 - 77f46fff 8192 commit image rw--
77f47000 - 77f5dfff 94208 commit image r---
77f5e000 - 77f5ffff 8192 free ----
77f60000 - 77f60fff 4096 commit image r---
77f61000 - 77f9cfff 245760 commit image r-x-
77f9d000 - 77fa4fff 32768 commit image r---
77fa5000 - 77fa8fff 16384 commit image rw--
77fa9000 - 77fa9fff 4096 commit image rw-c
77faa000 - 77fbdfff 81920 commit image r---
77fbe000 - 77fbffff 8192 free ----
77fc0000 - 77fc0fff 4096 commit image r---
77fc1000 - 77fc3fff 12288 commit image r-x-
77fc4000 - 77fc4fff 4096 commit image r---
77fc5000 - 77fc5fff 4096 commit image rw--
77fc6000 - 77fc7fff 8192 commit image r---
77fc8000 - 77fcffff 32768 free ----
77fd0000 - 77fd0fff 4096 commit image r---
77fd1000 - 77fe6fff 90112 commit image r-x-
77fe7000 - 77fe9fff 12288 commit image r---
77fea000 - 77fedfff 16384 commit image rw--
77fee000 - 77feefff 4096 commit image r-x-
77fef000 - 77ff9fff 45056 commit image r---
77ffa000 - 77ffffff 24576 free ----
78000000 - 78000fff 4096 commit image r---
78001000 - 7802dfff 184320 commit image r-x-
7802e000 - 78034fff 28672 commit image r---
78035000 - 78035fff 4096 commit image rw--
78036000 - 78036fff 4096 commit image rw-c
78037000 - 78039fff 12288 commit image rw--
7803a000 - 7803afff 4096 commit image rw-c
7803b000 - 7803bfff 4096 commit image rw--
7803c000 - 7803ffff 16384 commit image r---
78040000 - 7f5effff 123404288 free ----
7f5f0000 - 7f6effff 1048576 reserve mapped
7f6f0000 - 7f6f6fff 28672 commit mapped r-x-
7f6f7000 - 7f7effff 1019904 reserve mapped
7f7f0000 - 7ffaffff 8126464 free ----
7ffb0000 - 7ffd3fff 147456 commit mapped r---
7ffd4000 - 7ffdcfff 36864 free ----
7ffdd000 - 7ffddfff 4096 commit private rwx-
7ffde000 - 7ffdefff 4096 commit private rwx-
7ffdf000 - 7ffdffff 4096 commit private rwx-
7ffe0000 - 7ffe0fff 4096 commit private r---
7ffe1000 - 7ffeffff 61440 reserve private ----
Committed: image: 5971968 (0x5b2000) other: 11370496 (0xad8000) Total: 17342464 (0x108a000)
Note that each section of memory is grouped by how it is currently mapped; the four characters at the end are flags, with a dash representing not available, and one of r, w, x, and c for read, write, execute and copy-on-write (shared until written, when it will get a private copy).
On Solaris, the output would like look:
Mappings: 52, from struct prmap_t in sys/procfs.h: 0x00000000 - 0x0000ffff 65536 free 0x00010000 - 0x00017fff 32768 ---r-x offset = 0 0x00018000 - 0x00025fff 57344 free 0x00026000 - 0x00029fff 16384 ---rwx offset = 24576 0x0002a000 - 0x00033fff 40960 -b-rwx offset = 0 0x00034000 - 0x03ffffff 66895872 free 0x04000000 - 0x04705fff 7364608 ---rwx offset = 24576 0x04706000 - 0x04771fff 442368 ---rwx offset = 0 0x04772000 - 0x04899fff 1212416 ---rwx offset = 7389184 0x0489a000 - 0x04a49fff 1769472 ---rwx offset = 0 0x04a4a000 - 0x53ffffff 1331388416 free 0x54000000 - 0x54005fff 24576 ---rwx offset = 9093120 0x54006000 - 0xfe6fffff 2859442176 free 0xfe700000 - 0xfe7a7fff 688128 ---r-x offset = 0 0xfe7a8000 - 0xfe7b5fff 57344 free 0xfe7b6000 - 0xfe7bffff 40960 ---rwx offset = 679936 0xfe7c0000 - 0xfe7d7fff 98304 ---rwx offset = 0 0xfe7d8000 - 0xfe801fff 172032 free 0xfe802000 - 0xfe803fff 8192 ---rwx offset = 0 0xfe804000 - 0xfe903fff 1048576 free 0xfe904000 - 0xfe905fff 8192 ---rwx offset = 0 0xfe906000 - 0xfea05fff 1048576 free 0xfea06000 - 0xfea07fff 8192 ---rwx offset = 0 0xfea08000 - 0xfeb07fff 1048576 free 0xfeb08000 - 0xfeb09fff 8192 ---rwx offset = 0 0xfeb0a000 - 0xfec09fff 1048576 free 0xfec0a000 - 0xfec0bfff 8192 ---rwx offset = 0 0xfec0c000 - 0xfed0bfff 1048576 free 0xfed0c000 - 0xfed0dfff 8192 ---rwx offset = 0 0xfed0e000 - 0xfee0dfff 1048576 free 0xfee0e000 - 0xfee0ffff 8192 ---rwx offset = 0 0xfee10000 - 0xfef0bfff 1032192 free 0xfef0c000 - 0xfef0dfff 8192 ---rwx offset = 0 0xfef0e000 - 0xfef0ffff 8192 free 0xfef10000 - 0xfef11fff 8192 ---rwx offset = 0 0xfef12000 - 0xff00dfff 1032192 free 0xff00e000 - 0xff00ffff 8192 ---rwx offset = 0 0xff010000 - 0xff0bffff 720896 free 0xff0c0000 - 0xff0ddfff 122880 ---r-x offset = 0 0xff0de000 - 0xff0ebfff 57344 free 0xff0ec000 - 0xff0effff 16384 ---rwx offset = 114688 0xff0f0000 - 0xff0f9fff 40960 ---rwx offset = 0 0xff0fa000 - 0xff0fffff 24576 free 0xff100000 - 0xff1a3fff 671744 ---r-x offset = 0 0xff1a4000 - 0xff1b1fff 57344 free 0xff1b2000 - 0xff1b9fff 32768 ---rwx offset = 663552 0xff1ba000 - 0xff1bbfff 8192 ---rwx offset = 0 0xff1bc000 - 0xff1e3fff 163840 free 0xff1e4000 - 0xff1e5fff 8192 ---rwx offset = 0 0xff1e6000 - 0xff1effff 40960 free 0xff1f0000 - 0xff1f3fff 16384 ---r-x offset = 0 0xff1f4000 - 0xff1fffff 49152 free 0xff200000 - 0xff27ffff 524288 ---r-x offset = 0 0xff280000 - 0xff28dfff 57344 free 0xff28e000 - 0xff297fff 40960 ---rwx offset = 516096 0xff298000 - 0xff29ffff 32768 ---rwx offset = 0 0xff2a0000 - 0xff2affff 65536 free 0xff2b0000 - 0xff2b1fff 8192 ---rwx offset = 0 0xff2b2000 - 0xff2bffff 57344 free 0xff2c0000 - 0xff2c3fff 16384 ---r-x offset = 0 0xff2c4000 - 0xff2d1fff 57344 free 0xff2d2000 - 0xff2d3fff 8192 ---rwx offset = 8192 0xff2d4000 - 0xff2dffff 49152 free 0xff2e0000 - 0xff2e7fff 32768 ---r-x offset = 0 0xff2e8000 - 0xff2f5fff 57344 free 0xff2f6000 - 0xff2f7fff 8192 ---rwx offset = 24576 0xff2f8000 - 0xff2fffff 32768 free 0xff300000 - 0xff307fff 32768 ---r-x offset = 0 0xff308000 - 0xff315fff 57344 free 0xff316000 - 0xff319fff 16384 ---rwx offset = 24576 0xff31a000 - 0xff31ffff 24576 free 0xff320000 - 0xff321fff 8192 --srwx offset = 0 0xff322000 - 0xff32ffff 57344 free 0xff330000 - 0xff345fff 90112 ---r-x offset = 0 0xff346000 - 0xff353fff 57344 free 0xff354000 - 0xff355fff 8192 ---rwx offset = 81920 0xff356000 - 0xff35ffff 40960 free 0xff360000 - 0xff365fff 24576 ---r-x offset = 0 0xff366000 - 0xff373fff 57344 free 0xff374000 - 0xff375fff 8192 ---rwx offset = 16384 0xff376000 - 0xff37ffff 40960 free 0xff380000 - 0xff387fff 32768 ---r-x offset = 0 0xff388000 - 0xff395fff 57344 free 0xff396000 - 0xff397fff 8192 ---rwx offset = 24576 0xff398000 - 0xff39ffff 32768 free 0xff3a0000 - 0xff3a1fff 8192 ---r-x offset = 0 0xff3a2000 - 0xff3affff 57344 free 0xff3b0000 - 0xff3cdfff 122880 ---r-x offset = 0 0xff3ce000 - 0xff3dbfff 57344 free 0xff3dc000 - 0xff3ddfff 8192 ---rwx offset = 114688 0xff3de000 - 0xff3dffff 8192 ---rwx offset = 0 0xff3e0000 - 0xff443fff 409600 free 0xff444000 - 0xff445fff 8192 ---rwx offset = 0 0xff446000 - 0xffbe5fff 7995392 free 0xffbe6000 - 0xffbeffff 40960 s--rwx offset = 4294942720
The problem with memory_status_dump is that it doesn't identify what object is being mapped into any particular address area. It seems reasonably intuitive what an "object" is by all of the maps on all architectures; each address range constitutes one mapping. However, it is impossible to tell what the objects actually are, and sometimes when two address ranges are exactly adjacent to each other, the higher address range is likely an extension of the lower address range. This is important in deciding what objects to try to identify when deciding how to move things around. For example, if the C heap starts at 0x54000000 and the map has two ranges next to each other, one from 0x54000000 to 0x54007fff and one from 0x54008000 (i.e 0x54007fff + 1) to 0x5401dfff, then it is likely that the C heap was extended once, and thus that if the C heap is moved it will take care of both address ranges.
For x86 Windows, we make available on our FTP site a program called psapiworkingsetdemo.exe, from the Microsoft Win32 SDK:
(If you are running Alpha Windows NT, it might be available on the CD-ROM for the Win32 SDK for that platform.) Download these into the same directory (required so the .exe can find the .dll). Then, startup Allegro CL and run psapiworkingsetdemo. psapiworkingsetdemo will bring up a window showing the names of the programs currently running. Click on `allegro.exe' (or `mlisp.exe' or `alisp.exe'), and in the lower pane you will be shown what items are using the memory visible to allegro.exe/mlisp.exe/alisp.exe.
For other platforms, the situation is more complicated, but there are usually operating system tools for interpreting the data.
Q 3-9.6) [Windows only] How do I move DLL in memory so that it doesn't conflict with the Lisp heap?
A 3.9-6) The preferred Lisp heap starting address is 0x20000000 on x86 Windows and 0x30000000 on Alpha Windows (the heap grows to higher memory addresses). If, using the ``psapiworkingsetdemo.exe'' program (discussed above, an x86 Windows application), you find that the Lisp heap cannot grow to the size that you desire because of a DLL that is in the way, you can use the `editbin' program from Microsoft Visual C++ to move the default base address of the DLL. For example, if foo.dll is in a bad location, according to psiworkingsetdemo, and you found foo.dll to live in the c:\winnt\system32 directory, then at a DOS prompt type (assuming 0x65000000 is the beginning of a free address range large enough to accomodate the DLL):
c: cd \winnt\system32 editbin foo.dll /rebase:base=0x65000000
and the next time Lisp starts up, Windows will try to locate foo.dll at 0x65000000 instead of the previous inconvenient address that interfered with the Lisp heap.
Note that the base address for a DLL is only advisory; if the space is already used, Windows will locate it to some other location. By right-clicking on a DLL and selecting "Quick View" (if Quick View support is installed), you can see (among other things) the base address currently assigned to the DLL.
Q 3-9.7) What does the "Temporarily scaling back lisp reserved region from XXX to YYY bytes." mean?
A 3-9.7) It means that some other program has grabbed part of the address space that Lisp intended to use. This message is much more common on Windows, where various programs can grab predefined address ranges in all running programs. The Iomega Zip/Jaz tools and PGP are two programs known to do this. There are four things that you can do to handle this situation:
The arguments to build-lisp-image that you will need to specify are
:lisp-heap-start,:lisp-heap-size,:c-heap-sizeand:c-heap-start.
Next FAQ topic: 4.1. Emacs-Lisp interface
Previous FAQ topic: 3.8 Building images
ɠCopyright 1998, 1999, 2000, 2002, 2004 Franz Inc., Berkeley, CA. All rights
reserved.
$Revision: 1.1.1.1 $