Within the lexicon of Ultimate players, "brick" is known as where the offense starts after a pull lands out-of-bounds [VIII.B.6.d]. The name origin is unrelated to construction, or the type of wall an errant disc may hit.
The etymology of "brick" is named after a person - just like the Callahan. The penalty mark was first instituted in the mid-1980's by an Ultimate Tournament Director Louis Burke whose nickname was "brick."
Get it? Burke/Brick.
Before the brick rule was enacted, there was usually a re-pull.
[SOURCE: Ultimate Encyclopedia]