Hierarchy and Emergence
Posted by David Corfield
Many entities with which we deal can be said to fit into a hierarchical order:
- sound, vocable, word, utterance, conversation, discourse
- character, word, sentence, paragraph, chapter, book, encyclopaedia/collection
- sound wave, note, chord, phrase, passage, movement, symphony, style (Baroque, etc.)
- particle, molecule, molecular assembly, organelle, cell, cell assembly, organ, …
- …organism, herd/shoal, species
- …person, household, local community, nation state
Now you could claim that mathematics works best at the lower levels of these hierarchies, whereas narrative is the necessary tool to describe the higher levels. For example, we have a good mathematical theory of sound waves, but ask what Beethoven achieved with his Eroica symphony and we start talking about romanticism, Napoleon and the ideals of the French Revolution.
We can set anyone, or better a computer, the task of counting the relative frequency of the letters of the alphabet in a text, a reasonably educated person to count the frequency of metaphors, but we only listen to the subtle critic to learn about War and Peace, who will tell us among other things about the state of Russia at the time Tolstoy wrote it. Mathematics struggles to grasp reality as it climbs the hierarchy leaving us little better off than the numbering of the Eroica as Beethoven’s third symphony, or the count of the chapters of War and Peace.
We can use the power of a computer to overcome some of its limitations in getting the point of higher levels by its enormous calculating power operating algorithmically on vasts amounts of data. For example, set the task of accurately classifying web documents as being about finance or about sport, a machine learning algorithm may succeed by treating each document merely as a bag of words. Trained on sufficiently many documents it may learn to classify these well, but it certainly feels as though this hasn’t come about through the understanding of the words’ meaning.
For Polanyi, there’s an important point lurking here, which concern a feature current computers lack. To have an entity in your focal attention you must have its constituent parts in your subsidiary attention. You have to be able to see from the parts to the whole. As soon as you look focally at the parts, the whole disappears. So you can look at a page and just see letters and no words, or look at words and see no sentences. Polanyi reports the experience of reading a letter he had received, wishing to show it to his son, and only then remembering to check whether it was in a language the latter could understand. Meaning is gleaned without focal awareness of the words conveying it. To see the higher level once must indwell in its lower parts, as he puts it.
We can also arrange mathematical thought in a hierarchy:
- inference step/definition, theorem, paper, subject, branch, research programme
Yet again mathematics applies better to the lower levels, here in the shape of mathematical logic. At the top level we may chart the number of articles published for various programmes on the ArXiv, but we’d rather hear the story of a Grothendieck or a Connes. (For a great story by Raoul Bott about Morse theory see here.)
Three questions, and then some vague thoughts in reply:
- Does the type of mathematics which can be used typically vary up a hierarchy?
- Is there any commonality to the way the functioning of a level emerges from its parts, across and within hierarchies?
- Is something special introduced when dealing with the activities of humans?
The 2 April 1999 issue of Science had several interesting articles on complex systems and emergence. To the extent that there was a consensus on the necessary mathematics, nonlinear differential equations seemed to be thought to work best, for, e.g., gene and protein networks and species population levels.
Yet higher up the hierarchy still, Stephen Jay Gould asks about the history of life on Earth
How can a vector of historically unique events be viewed as primary data, or as bearers of theoretical interest?
Isn’t science a search for the timeless and quantifiable laws of nature? Isn’t the specification of a sequence of events no more than a narrative, a description of uniqueness worth little in an enterprise dedicated to experiment, repetition, and prediction?
and answers himself
Science is a pluralistic search to understand nature’s ways–and the narrative quality of historical sequences records a different aspect of nature accessible to legitimate methods beyond the stereotype.” (‘An Operational Definition of Directionality’ in The Philosophy of Biology, Hull and Ruse (eds.) OUP, p. 666)
But he does allow that one can find a directionality in evolution, e.g., that there is a tendency for the maximum flourishing point of a clade to occur later in its geological range the more recently it occurs. Then again, philosopher R. G. Collingwood would want to reserve the word ‘history’ for human affairs, taking our acts, res gestae he called them, to form qualitatively different sequences to the courses of events concerning other species.
On the other hand, we might heed Weyl
Perhaps the philosophically most relevant feature of modern science is the emergence of abstract symbolic structures as the hard core of objectivity behind – as Eddington puts it – the colorful tale of the subjective storyteller mind. (Philosophy of Mathematics and Natural Science, p.237)
We had a discussion a few months ago about whether category theory could get any grip on biological phenomena. One small resonance between some of the work mentioned there and the focal-subsidiary idea of Polanyi is the concept of a collection of lower elements being represented by a direct limit at the higher level.
On the other hand, Polanyi suggests the indwelling becomes more difficult the higher up a hierarchy you go. It may not be easy to extract a general law from moments in the motion of a stone, but it requires lower indwelling capacities than to understand what an animal is doing from its movements.
It’s curious that much work in ethology, and especially primatology, involving years of patient field work, is done with far more sensitivity to the subject at its highest level than occurs in many parts of psychology. Anthropology is more like ethology in this respect.
Complex Systems, Dictionaries, Bio-Theorems; Re: Hierarchy and Emergence
This subject enthralls me.
I’ll comment in narrative later, driven by my roughly 40 years involvement5 with Complex Systems research, in Biophysics, and what’s now called nanotechnology and Artificial Life, but first point to these recent references:
arXiv:0806.3710 [pdf, other]
Title: How Is Meaning Grounded in Dictionary Definitions?
Authors: A. Blondin Masse, G. Chicoisne, Y. Gargouri, S. Harnad, O. Picard, O. Marcotte
Comments: 8 pages, 3 figures, TextGraphs-3 Workshop at the 22nd International Conference on Computational Linguistics, Coling 2008, Manchester, 18-22 August, 2008
Subjects: Computation and Language (cs.CL); Databases (cs.DB)
Meaning cannot be based on dictionary definitions all the way down: at some point the circularity of definitions must be broken in some way, by grounding the meanings of certain words in sensorimotor categories learned from experience or shaped by evolution. This is the “symbol grounding problem.” We introduce the concept of a reachable set – a larger vocabulary whose meanings can be learned from a smaller vocabulary through definition alone, as long as the meanings of the smaller vocabulary are themselves already grounded. We provide simple algorithms to compute reachable sets for any given dictionary.
http://www.claymath.org/library/05report_featurearticle.pdf
The Clay Mathematics Institute has placed their library of publications online. Their most high-profile publication (other than the Millennium Problems) is Morgan and Tian’s write-up of the proof of the Poincare Conjecture.
They have an interesting article by Bernd Stermfels, Can Biology Lead to New Theorems? You can guess his answer from the fact that the article exists at all.
Nice intro, pretty pictures, subtle Math, and great buzzwords such as:
“the tree of life is an affine building.”
[Andreas Dress, Director, Institute for Computational Biology, Shanghai]