Ruby Hacking Guide/Garbage Collection

The Runtime Structure of a Program edit

Before diving into the content of this chapter, let us review the organization of memory at program execution time. This chapter will involve some low-level components of computer architecture, so familiarizing oneself with some basic concepts ahead of time will be required. Moreover, these concepts will be required for later chapters as well. Let's get them out of the way here.

Segments edit

Most C programs have the following components in their memory space:

  1. text area,
  2. a store of static and global variables,
  3. the machine stack,
  4. the heap.

The text area is where the code is stored. The second component should be clear. The machine stack is where functions' arguments and local variables are stacked. The heap is what is allocated by malloc().

Let's discuss the machine stack in detail. Being called a machine "stack", it obviously has a stack-like construction. In other words, we can keep adding new elements to the top. In practice values are added to the stack in individual int units but conceptually there is a larger unit called the stack frame.

Each stack frame corresponds to one function call. In other words, each function call will add one stack frame and a stack frame is taken off on return. If we extremely simplify this, the machine stack could look like Figure 1.

 the top
+-------------+
| stack frame | <-- the frame for the currently running function
+-------------+
| stack frame |
+-------------+
| stack frame |
+-------------+
| stack frame |
+-------------+
| stack frame |
+-------------+
 the bottom

Figure 1: The machine stack

In this figure we marked the extreme end of the stack "the top," but the machine stacks does not necessarily address frames from low to high. For example on x86 machines the stack grows from higher addresses to lower ones.

alloca() edit

With malloc() memory of arbitrary size can be allocated. alloca() is the machine stack version of this. However, memory allocated by alloca() does not need to be deallocated. Or, rather, it may be better to say that that the memory "gets" deallocated with the function's return. Thus alloca()-allocated values cannot be used as a function's return value. This is the same as saying "pointers to local variables cannot be returned."

All this is fine. It basically means that we can locally allocate arrays which change in length dynamically.

However there are environments where there is no native alloca(). Many would prefer to use an alloca() in those environments as well, so a function with the same behavior could be written in C. In this case, however, it may only be implemented to "not require deallocation," but may not necessarily be allocating memory on the machine stack. In fact, it normally would not do this. If it could do that, there may as well be a native implementation of alloca().

How can we implement alloca() in C? The most straight-forward implementation first allocates memory with malloc(). It then stores the caller function and the allocated address on a global list. Then the next time alloca() is called, if there is any memory that was allocated for a function which has already concluded, it can be free()'ed (see Figure 2).

+-----------+      +------------+
| main      |      | main       |
+-----------+      +------------+
| A         | ===> | A          |
+-----------+      +------------+
| B         |      | B          | mark that B -> alloca(32)
+-----------+      | alloca(32) | free the memory allocated for D
| C         |      +------------+
+-----------+
| D         |
| alloca(8) | mark that D -> alloca(8)
+-----------+

Figure 2: The behavior of a C implementation of alloca()

Ruby's missing/alloca.c is an implementation of just such an emulated alloca().

Outline edit

Now let's begin the main subject of this chapter, garbage collection.

Introducing GC edit

What GC does edit

Mark & sweep edit

Sweep & copy edit

Reference counting edit

Object management edit

struct RVALUE edit

Object heap edit

freelist edit

add_heap() edit

rb_newobj() edit

Mark edit

rb_gc_mark() edit

rb_gc_mark_children() edit

rb_gc() edit

The Ruby stack edit

Registers edit

mark_locations_array() edit

is_pointer_to_heap() edit

Register windows edit

The machine stack edit

Init_stack() edit

STACK_END edit

rb_gc_mark_locations() edit

Other root objects edit

Sweep edit

Special NODE handling edit

The finalizer edit

rb_gc_force_recycle() edit

Considerations edit

Memory deallocation edit

Generations of GC edit

Compaction edit

The volatile keyword in GC edit

Initialization codeflow edit

gc.c internals edit

Interpreter internals edit

Object Creation edit

The allocation framework edit

User-defined object creation edit

Data_Wrap_Struct() edit

Data_Get_Struct() edit

Problems with the allocation framework edit

<hline>

Comments, suggestions, and criticisms may be sent to Aoki MINERŌ <aamine@loveruby.net>. Please direct translation comments, suggestions, and criticisms to the translator of this chapter, mitcho (Michael Yoshitaka Erlewine) <mitcho@mitcho.com>.