I saw a talk on TED a couple of years ago by cognitive scientist, Donald Hoffman. He presented his view that our perceptual faculties have evolved for our survival and not so much to preserve a likeness to whatever it is that is causing our perception. To some extent, this is an unremarkable hypothesis since we already know that the range of colours and sounds extends beyond that we can see and hear. What are sounds to us and other living things are basically air vibrations, and there is no sound in the void of outer space. We also know our perceptual systems are tricked by optical illusions.
But Hoffman's idea is more radical - he thinks that the world we perceive might bear no more resemblance to whatever causes our perceptions than a computer screen interface bears to the actual inner workings of the computer, i.e., none. Further, he believes that even scientific activity remains at the perceptual "user interface" and, for all intents and purposes, we remain within the matrix of our perceptual systems, with no perceptual access to reality. Even brains and neurons, as we study them, reside in the interface. This is not to say we are lost in a sea of perceptual illusion, however. He retains hope that mathematics and reason will guide us to scientific truths.
Variations on the idea that we cannot get beyond our modes of perception to experience reality directly have been advanced throughout the history of ideas. For the most part, these positions have been thought to entail that we simply do not know what is beyond the perceptual horizon and must leave aside any hopes of metaphysical insight; or that are grounds to believe that we are somehow trapped inside our heads, or that the world we see is a hallucination or a delusion; or that the world there is is really nothing other than the world we perceive - esse est percipi.
We end up with this set of positions only because our idea of reality is one that assumes a gulf between Mind and Nature.
The world is real (or it is nothing). I'm not saying that we perceive things as they would be without us. Why have we have assumed that's what reality is - the world as it is without us? The world we inhabit is a dynamic environment that includes us and within which we have considerable influence, for better or worse. A world without us is clearly an imaginary one. Without perceiving beings, the world wouldn't really look like anything. It has existed and could exist without us, and it will again one day, but as of now, here we are.
It's a simple truism. The world we perceive is the world in which we live. Our perceptions occur in nature, and they are more or less relevant to our purposes, whether those purposes be the pursuit of scientific knowledge, manipulating others, or obscuring something painful from our past. Perceptual veridicality is not true representation of a non-perceived world but has to do with with the horizon of our intentions.
Our idea of objectivity (our current one - the concept of objectivity has a history) is the idea of the world without us, a world imagined without involvement (taint) from any human intention or purpose. This has led us to frame reality as a principally spatial world of catalogued things whose interactions can be described in terms of the operation of forces acting according to laws of nature.
Our habit of conceptually freeze-framing phenomena in space and time in a way that favours spatial and mathematical representation is likely cognitively energy-saving but ontologically misleading. Perception is an active response to our present environment and we cannot remove ourselves from the world to understand it - why would we think we could? Does anyone know what the world would look like sub specie aeternitatis (from the POV of eternity)?
The conceptual freeze-frame is only a shorthand that we have somehow managed to reify because we see ourselves as so different from nature. Our own nature has been considered an impediment to objectivity. Nevertheless, we live in a dynamic symbiotic universe, not a world of disconnected things attracted by forces and governed by laws. We reify our conceptual models and assume tangible experience falls short.
The question of how the world is without our witnessing it is not possible to answer. That doesn't mean there is "some mysterious unknowable world" about which we have no direct or indirect information or that the existence of the world depends upon us perceiving it. The question is an error. The world we know more or less well is the world in which we came to be.
Showing posts with label ontology. Show all posts
Showing posts with label ontology. Show all posts
Wednesday, January 17, 2018
Imagining Reality
Labels:
cognitive science,
Daston,
Donald Hoffman,
epistemology,
evolution,
Gallison,
idealism,
objectivity,
ontology,
perception,
phenomenalism,
philosophy,
philosophy of science,
Realism,
reason,
science
Friday, September 7, 2012
The Relationship between Objectivity and Bureaucracy
In 2009, I posted a short blog entry, How Organizations Remain Bureaucratic. Here, I'd like to delve a bit further into what is pejoratively known as "bureaucracy" and tie the discussion to a broader cultural theme, one I'll call Fetishizing the Heuristic. The terminology is a bit academic, but apt, so I'll explain.
Heuristics are flexible guidelines, generally sane models, not meant to account for every contingency, but a pencilling in of a plan or set of criteria based on experience. (Maslow's Hierarchy, for example, was intended to be considered a flexible heuristic, but rarely is.)
To fetishize something means to idolize it...
So when a heuristic is idolized, the criteria embodied in a flexible guideline magically come to have a life of their own, alienated from the creative and reasonable minds that set them out. They become viewed as if they issue from a higher order of existence.
So, for example, a preliminary plan is developed that covers a time span, or evaluative criteria are set out provisionally. As soon as dates and scoring methods are assigned, it's as if these plans or criteria issued directly from an eternal source of objectivity, not from the minds of those composing them. (They become reified in processes, detached from the aim that inspired their development.)
The problem that arises is that once the guideline has been drawn up and numbers assigned to what started off as a provisional guideline, no counter-evidence from the actual world of objective reality will change the guideline. Where there is deviation, it will considered as a way of illustrating how things and people have failed to meet the criteria, not as evidence that the model needs adjusting.
Jack Martin of Simon Fraser University wrote in 1996 (in a no longer available newsletter of the American Psychological Association) lamenting how assessment criteria, never intended to be more than reasonable, flexible, useful guidelines, become irrationally narrowed and fixed once they are operationalized (assigned a numerical scale). This causes the quality and relevance of research in empirical psychology to degenerate.
Then, of course, these guidelines become embodied in institutional procedures - further alienated from the agents, the creative and reasonable minds of people in the organization, who would otherwise use their minds to question them, adjust them, and maintain their usefulness.
In practice, understanding how we can fetishize the heuristic should lead us to be more active in questioning and revising plans and criteria as necessary, understanding they issue from human needs and objectives.
The broader, more philosophical understanding is that a lot of the conceptual packaging we use to identify something as objective is faulty and needs to be revisited. We need to re-insert the awareness of our responsibility as agents into our plans and to adjust in an ongoing way to what is happening, rather than mechanizing thought in bureaucratic processes or bracketing ourselves out of existence while we follow an eternal diagram (our role in conceiving it, forgotten).
In a nutshell, don't treat a working hypothesis, guideline, process or model as if it issued from the heavens. After all, it's your model and you should have every right to correct it as more evidence becomes available - and there will always be more evidence, unless you are omniscient.
Heuristics are flexible guidelines, generally sane models, not meant to account for every contingency, but a pencilling in of a plan or set of criteria based on experience. (Maslow's Hierarchy, for example, was intended to be considered a flexible heuristic, but rarely is.)
To fetishize something means to idolize it...
So when a heuristic is idolized, the criteria embodied in a flexible guideline magically come to have a life of their own, alienated from the creative and reasonable minds that set them out. They become viewed as if they issue from a higher order of existence.
So, for example, a preliminary plan is developed that covers a time span, or evaluative criteria are set out provisionally. As soon as dates and scoring methods are assigned, it's as if these plans or criteria issued directly from an eternal source of objectivity, not from the minds of those composing them. (They become reified in processes, detached from the aim that inspired their development.)
The problem that arises is that once the guideline has been drawn up and numbers assigned to what started off as a provisional guideline, no counter-evidence from the actual world of objective reality will change the guideline. Where there is deviation, it will considered as a way of illustrating how things and people have failed to meet the criteria, not as evidence that the model needs adjusting.
Jack Martin of Simon Fraser University wrote in 1996 (in a no longer available newsletter of the American Psychological Association) lamenting how assessment criteria, never intended to be more than reasonable, flexible, useful guidelines, become irrationally narrowed and fixed once they are operationalized (assigned a numerical scale). This causes the quality and relevance of research in empirical psychology to degenerate.
Then, of course, these guidelines become embodied in institutional procedures - further alienated from the agents, the creative and reasonable minds of people in the organization, who would otherwise use their minds to question them, adjust them, and maintain their usefulness.
In practice, understanding how we can fetishize the heuristic should lead us to be more active in questioning and revising plans and criteria as necessary, understanding they issue from human needs and objectives.
The broader, more philosophical understanding is that a lot of the conceptual packaging we use to identify something as objective is faulty and needs to be revisited. We need to re-insert the awareness of our responsibility as agents into our plans and to adjust in an ongoing way to what is happening, rather than mechanizing thought in bureaucratic processes or bracketing ourselves out of existence while we follow an eternal diagram (our role in conceiving it, forgotten).
In a nutshell, don't treat a working hypothesis, guideline, process or model as if it issued from the heavens. After all, it's your model and you should have every right to correct it as more evidence becomes available - and there will always be more evidence, unless you are omniscient.
Labels:
bureaucracy,
business,
epistemology,
heuristics,
Koch,
management,
methodolatry,
objectivity,
ontology,
performance measurement,
philosophy,
planning,
quantophrenia,
reporting,
science
Tuesday, June 14, 2011
The constellations of philosophy?
Hypothesis:
The patterns of every socio-economic organization in history and the powers that maintain them are supported by a tacit ontology (myth/theory of what reality is) that underpins public discourse and the social narrative. This ontology serves to legitimate the social order in the same way as the ancient belief in the "divine right of kings" or "mandate of heaven". (Another metaphor that may work in place of the divine right of kings might be heavenly/stellar constellations. Ancient rites seem to have connected them.)
Philosophers are by trade apologists for or critics of the divine right of kings (i.e., the ontology that underpins the social narrative). It is changes in technology that occasion changes in the social narrative (and only indirectly philosophy) because technological change gives rise to the need for changes in the patterns of economic and thus social organization, which then calls forth a new narrative. Philosophers gain a following when they contribute to a sustaining narrative, or to one held onto by soon-to-be eclipsed powers (there's usually a lag...).
The patterns of every socio-economic organization in history and the powers that maintain them are supported by a tacit ontology (myth/theory of what reality is) that underpins public discourse and the social narrative. This ontology serves to legitimate the social order in the same way as the ancient belief in the "divine right of kings" or "mandate of heaven". (Another metaphor that may work in place of the divine right of kings might be heavenly/stellar constellations. Ancient rites seem to have connected them.)
Philosophers are by trade apologists for or critics of the divine right of kings (i.e., the ontology that underpins the social narrative). It is changes in technology that occasion changes in the social narrative (and only indirectly philosophy) because technological change gives rise to the need for changes in the patterns of economic and thus social organization, which then calls forth a new narrative. Philosophers gain a following when they contribute to a sustaining narrative, or to one held onto by soon-to-be eclipsed powers (there's usually a lag...).
Sunday, May 29, 2011
Initial Conditions and Predictability
According to physicist, Eugene Wigner (link to article), physics is possible because we are able to identify regularities in nature.
The world around us is of baffling complexity and the most obvious fact about it is that we cannot predict the future... It is, as Schrodinger has remarked, a miracle that in spite of the baffling complexity of the world, certain regularities in the events could be discovered. One such regularity, discovered by Galileo, is that two rocks, dropped at the same time from the same height, reach the ground at the same time. The laws of nature are concerned with such regularities...
This is surprising, he says, for a few reasons. The first is that it is true everywhere on earth and it will always be true, i.e., it is invariant. The second reason that it is surprising is that this invariance "is independent of so many conditions that could have an effect on it." It doesn't matter where on earth or by whom the rocks are dropped and "there are innumerable other conditions which are all immaterial from the point of view of the validity of Galileo's regularity." He says,
The irrelevancy of so many circumstances which could play a role in the phenomenon observed has also been called an invariance. However, this invariance is of a different character from the preceding one since it cannot be formulated as a general principle. The exploration of the conditions which do, and which do not, influence a phenomenon is part of the early experimental exploration of a field. It is the skill and ingenuity of the experimenter which show him phenomena which depend on a relatively narrow set of relatively easily realizable and reproducible conditions. (Italics added.)
This is important when it comes to understanding the surprising thing about making predictions. Wigner says, "the law of nature is contained in the statement that the length of time which it takes for a heavy object to fall from a given height is independent of the size, material, and shape of the body which drops."
Given certain "easily realizable and reproducible" Initial Conditions (ICs) and a Law of Nature (LN), then a Prediction will follow. (IC & LN) > P. However,
the laws of nature can be used to predict future events only under exceptional circumstances - when all the relevant determinants of the present state of the world are known. It is also in consonance with this that the construction of machines, the functioning of which he can foresee, constitutes the most spectacular accomplishment of the physicist. In these machines, the physicist creates a situation in which all the relevant coordinates are known so that the behavior of the machine can be predicted. Radars and nuclear reactors are examples of such machines.
The two important points I draw from the preceding exposition are:
- In order to apply a law to make a prediction you need to identify the relevant conditions (ICs).
- The ability to isolate phenomena whose regularity can be demonstrated with easily reproducible conditions cannot be summed up in a general principle.
To those two points I would also add an idea that I think follows from an insight of Stuart Kauffman, author of Reinventing the Sacred (linked on the sidebar) where he says, in analyzing mechanical systems,
physicists since Newton have put in the constraints..."by hand" as what are called the mathematical "boundary conditions" on a system, rather like the boundaries of a billiard table, that keep the balls from rolling off into infinity or under the table. Given the boundary conditions, physicists state the initial conditions, particles and forces, and solve the equations for the subsequent dynamics...
But in the real universe, we can ask, "Where do the constraints themselves come from?"(pp. 90-91) (italics added.)
Although in principle it might be possible to retroactively determine the sequence of events that gave rise to a naturally occurring phenomenon (then again, there's the problem of infinite regress), no one could specify the relevant conditions in advance of every phenomenon-to-be in this complex world. What would we be looking for?
Kauffman (link to book) discusses the evolution of life and considers Darwinian preadaptations; e.g., three bones in the jaw of an ancestral fish that become bones in the middle ear in species descended from it. At the time this ancient fish lived, was there any way to predict the role of its bones in later species, let alone what later species would emerge?
Kauffman (link to book) discusses the evolution of life and considers Darwinian preadaptations; e.g., three bones in the jaw of an ancestral fish that become bones in the middle ear in species descended from it. At the time this ancient fish lived, was there any way to predict the role of its bones in later species, let alone what later species would emerge?
This is not just an issue of complexity or chaos; i.e., sensitivity to initial conditions (a.k.a "the butterfly effect"). It is that, as Kauffman says, we can't prestate the relevant conditions (p. 139 ff). What potentials will become actualities? In Kauffman's view, this is not just an epistemic limitation, it is an ontological one. He says, "the evolution of life violates no law of physics, but cannot be reduced to physics." Not all of nature is law governed.
So it seems to Kauffman, and to me, that the "natural law" model of a mechanistic universe has limited applicability; i.e., to "phenomena which depend on a relatively narrow set of relatively easily realizable and reproducible conditions."
We cannot completely predict the future, and generally that idea gives me comfort. Nature has space to play.
We cannot completely predict the future, and generally that idea gives me comfort. Nature has space to play.
Also see P. Anderson, More is Different
Thursday, May 5, 2011
Another Blog - Art of Objectivity
If you'd looked at any of the posts headed "Change Discourse" and were wondering why this theme seems to have been discontinued, the reason is that I decided to start a new blog on this theme. The new blog is called "Art of Objectivity", because I believe objectivity to be more an art than a science, not that I claim to have mastered it.
The Art of Objectivity takes its title from an earlier post in this blog. There I'd said that "there is more risk in following methodology and discouraging reasoning than there is in allowing creative human thought."
The new blog undertakes a paleontology of our beliefs, with the assumption that we are not so much guided by rational self-interest but by either real or, more often today, ideological tribal loyalties, rooted in a vestigial need to support and reproduce the social order. I believe that the solution, if there is one, is not more methodology but more understanding that doesn't claim finality.
The Art of Objectivity takes its title from an earlier post in this blog. There I'd said that "there is more risk in following methodology and discouraging reasoning than there is in allowing creative human thought."
The new blog undertakes a paleontology of our beliefs, with the assumption that we are not so much guided by rational self-interest but by either real or, more often today, ideological tribal loyalties, rooted in a vestigial need to support and reproduce the social order. I believe that the solution, if there is one, is not more methodology but more understanding that doesn't claim finality.
Friday, April 22, 2011
Materialists aren't materialists.
We don't live in a "materialist" society. The prevailing views about what's real in the world are not based on a materialist philosophy, but on an inverted kind of transcendence, the decaying legacy of an ancient metaphorical, conceptual separation of heaven and earth. (This separation has evolved over history, but I'm starting with its most recent incarnation.)
Matter is not inert.
So, what is inverted transcendence? Think of it this way. Since ancient times, we have believed that the most knowable is the most real. The most profound way we have of knowing our world comes through the use of concepts and mathematics. Concepts and mathematical relationships describing nature are idealizations of patterns of regularity that we find in nature.
To get objective about nature, we have to arrange it so it fits our conceptual and mathematical tools, our idealizations of it. This has proven very successful in areas where researchers can control and eliminate local contingencies to get to the universally constant laws (such as laws of motion.) This is what allows people to build reliable machines. However, not all of nature is amenable to this approach to research (unless you think that nature is "nothing but" particles in motion; i.e., unless you privilege that one scale of things and stamp it with the label, Reality, and talk of building blocks, putting the methodological cart firmly before the ontological horse as is the wont of reductionists...)
Nature is not just particles in motion, it exists on many scales - it is ecosystems, tectonic plates smashing together, the act of breathing, rustling leaves, strange creatures swimming by vents in the ocean floor, reproducing, etc. These things have power to make changes in the world. Not all causality occurs at the level of sub atomic particles.
One cannot locate and eliminate local contingencies and make rigorously controlled experiments when studying human behaviour and other phenomena. All natural phenomena are complex. Human beings reduce natural phenomena to idealized mathematical objects, quantities and relations - particles in motion governed by natural laws.
So, from a scientific perspective, the matter we call objective reality is a conceptually reduced scale of existence - a useful idealization. Note the absence of any value ideal in those mathematical idealizations, though. Nature, as seen through the reductionist lens, has no purpose. So what are we transcending with our idealizations of matter? Our vitality? Our lived experiences? Our woes and joys? Certainly there is joy in the act of genuine discovery, but that's peripheral to the reductionistic project. More and more people talk of the next stage of evolution as a cyborg society, to my mind a symptom of the nihilism in the project. Even basic drive is purpose. Even this nihilism is purpose.
So what is inverted transcendence, as distinguished from materialism? Painted in an extreme kind of way, I'd say an inverted transcendence is one which focuses on reduced idealized matter, not on nature, and has as its point the reduction and idealization of nature, and the subjection of our human interests and cares to that model. Or perhaps I could put it this way: Heaven and earth became separated and nature was reduced to an idealized inert matter. It was virginalized. Next, heaven was eliminated from the picture of how the world is, leaving us with laws of nature or what Sheldrake calls "the ghost of the god of the world machine." (Have a listen to Minute 13:30 to 15:30 of his CBC podcast. I'm deeply skeptical of many of Sheldrake's explanations, but like his questions.)
Having shied from understanding material nature in its richness, we're not really asking or learning about ourselves in a way that situates us in nature, where we might gather the learning we need to adjust and make the right decisions. There is a loss of meaning. Meanwhile, we're inundated with products. We're all dressed up with nowhere to go, except to an ecological tipping point.
I don't think the solution to this strange nihilism is to reinstate some kind of theological or platonic heaven but to heal the split and come back to earth. To do that, we need to find a new way of looking at matter, while questioning what it is we wish to transcend.
Wednesday, March 23, 2011
It is a mistake to confuse methodology with objectivity
People use a variety of evaluative processes in business to ensure objectivity. But the dangerous fact is that these evaluative processes, these methodologies, even the most rigorous, are woefully insufficient to guarantee objectivity.
Why? There are three basic dangers in relying on method to ensure objectivity.
1. The normative dangers
The overarching danger attaching to evaluative models is the belief that we can use methodology as a legitimating device, even if our evaluative methodology has flaws. Furthermore, if any kind of injustice has resulted from the application of a methodology how can it even be called an injustice, if the "test" for justice is the methodology?
2. The epistemic dangers
I use staffing as a paradigmatic example because of its situation, which cross-cuts the human and the operational domains of management.
To ensure transparency and effectiveness, it is assumed that a method which permits the definition, measurement and testing of people's "competencies" will do the job. First, who guarantees that the definition of competencies is appropriate? What sanctions the applicable criterion? It depends on the motive - are the criteria sanctioned in terms of the business needs that the hire will meet or the efficiencies that the hiring process will meet? (If you have to think more than 5 seconds on that one, you're in trouble.)
Second, competency is not a feature of potential hires like the number of doors on a car. People are living, learning beings with potential and we can't screen for traits we haven't identified but might have found very valuable.
Competencies mean little without relationship to motivation to develop them further and opportunities to use them.
We have a collective Western habit of freeze-framing states and confusing the ability to label the frame with the ability to recognize the meaningful stuff in phenomena. Nothing living stands still, including the level of the abilities of your potential staff.
3. The ontological dangers
Empiricism is at pains to distinguish itself from teleology - the identification of ends. The underlying belief at stake is the idea that a grand purpose or design to everything is an anthropomorphic projection. This may or may not have clear import in certain areas of scientific research, but to carry that principle of wariness over into the types of planning whose purpose is to improve quality of life is ludicrous.
For example, in staffing (the most clear examples come from that domain, as I explained earlier), operationally defining merit criteria in terms of a screening methodology puts the methodological cart before the ontological horse. A competency is not an exhausively definable capacity, but a set of potentials that evolves over time. Efforts should be made to ensure fairness and objectivity, and to ensure thereby that the right person is selected for the job (i.e., the "telos" or end is that the essential criteria are connected to the needs of the job and the person's fitness for the role overall is assessed according to those ends). This connection is lost when the specific criteria become disconnected and itemized, and especially when they become too narrowly defined due to a different objective - the objective to manage the "empirical" screening process efficiently. Of course, divorced from its ends, efficiency has no meaning. This is neither fair nor effective.
I may have said this before, but it is clear that no matter how much “empirical evidence” we have, in the end it is our capacity for meaningful valuation that allows us to identify worthwhile goals and our capacity for reasoning that allows us to collect the relevant evidence in support of those and assess it. These two capacities are not separate, but deeply connected in us and contribute equally to the quality of our lives. My examples tend to be drawn from staffing because they are the most straightforward, but the underlying principles could apply to many areas public admin.
Going against the grain of the contemporary Zeitgeist, to ensure objectivity, and by extension, fairness, in people or program evaluation, we should be sure to use our capacities for meaningful valuation and reason to the best of our abilities.
Why? There are three basic dangers in relying on method to ensure objectivity.
1. The normative dangers
The overarching danger attaching to evaluative models is the belief that we can use methodology as a legitimating device, even if our evaluative methodology has flaws. Furthermore, if any kind of injustice has resulted from the application of a methodology how can it even be called an injustice, if the "test" for justice is the methodology?
2. The epistemic dangers
I use staffing as a paradigmatic example because of its situation, which cross-cuts the human and the operational domains of management.
To ensure transparency and effectiveness, it is assumed that a method which permits the definition, measurement and testing of people's "competencies" will do the job. First, who guarantees that the definition of competencies is appropriate? What sanctions the applicable criterion? It depends on the motive - are the criteria sanctioned in terms of the business needs that the hire will meet or the efficiencies that the hiring process will meet? (If you have to think more than 5 seconds on that one, you're in trouble.)
Second, competency is not a feature of potential hires like the number of doors on a car. People are living, learning beings with potential and we can't screen for traits we haven't identified but might have found very valuable.
Competencies mean little without relationship to motivation to develop them further and opportunities to use them.
We have a collective Western habit of freeze-framing states and confusing the ability to label the frame with the ability to recognize the meaningful stuff in phenomena. Nothing living stands still, including the level of the abilities of your potential staff.
3. The ontological dangers
Empiricism is at pains to distinguish itself from teleology - the identification of ends. The underlying belief at stake is the idea that a grand purpose or design to everything is an anthropomorphic projection. This may or may not have clear import in certain areas of scientific research, but to carry that principle of wariness over into the types of planning whose purpose is to improve quality of life is ludicrous.
For example, in staffing (the most clear examples come from that domain, as I explained earlier), operationally defining merit criteria in terms of a screening methodology puts the methodological cart before the ontological horse. A competency is not an exhausively definable capacity, but a set of potentials that evolves over time. Efforts should be made to ensure fairness and objectivity, and to ensure thereby that the right person is selected for the job (i.e., the "telos" or end is that the essential criteria are connected to the needs of the job and the person's fitness for the role overall is assessed according to those ends). This connection is lost when the specific criteria become disconnected and itemized, and especially when they become too narrowly defined due to a different objective - the objective to manage the "empirical" screening process efficiently. Of course, divorced from its ends, efficiency has no meaning. This is neither fair nor effective.
I may have said this before, but it is clear that no matter how much “empirical evidence” we have, in the end it is our capacity for meaningful valuation that allows us to identify worthwhile goals and our capacity for reasoning that allows us to collect the relevant evidence in support of those and assess it. These two capacities are not separate, but deeply connected in us and contribute equally to the quality of our lives. My examples tend to be drawn from staffing because they are the most straightforward, but the underlying principles could apply to many areas public admin.
Going against the grain of the contemporary Zeitgeist, to ensure objectivity, and by extension, fairness, in people or program evaluation, we should be sure to use our capacities for meaningful valuation and reason to the best of our abilities.
Wednesday, March 9, 2011
Change Discourse: An Aside on Planning and Evaluation
In large organizations, in the accepted practices of planning and evaluation, we are hampered by our inability to acknowledge unanticipated benefits, i.e., the creativity of what is proposed. We seem to be unable to value options that we haven't anticipated in advance or even to accommodate valuations of unanticipated options. What would count as legitimation in these instances? The unanticipated benefit cannot be considered relevant, based on pre-established criteria.
Why do we deprive ourselves of anything more than our presupposed potential? The standard (ontological and meta-ethical) notions of objectivity and fairness in evaluation are in need of a major rethink, especially in a complex, rapidly changing world where future potentiality becomes at least as important as present actualities. Adaptability and responsiveness are more important than adhering to artificial and outdated notions of objectivity, which for at least two millennia, have been more about projecting our conceptual filing cabinets on events than on encouraging openness to new an novel ideas and approaches. To add irony to insult, in today's variant, to mimic the successful model of reductionist science, it is assumed that the ability to assign a number to some evaluative criterion makes that criterion objective.
The difference between living and mechanical linear/reductionist notions of objectivity needs to be emphasized. In the linear/reductionist model, the relevant determinants of an event are isolated and identified in a rigorous way, such that they can be arranged and used in planning experiments and building machines. As successful as this method has been, however, according to scientists such as Eugene Wigner, the approach legitimately applies to only a small set of relatively easily manipulable things (which is why basic physics is about necessary laws and anything more complex is statistical at best at the lowest level of granularity.) The attempt to apply it to a large open-ended organization occasions the kinds of issues described by Burt Perrin (Paragraph 103).
Stuart Kauffman shows that a living system is one where the boundary conditions are intrinsic to the phenomena under investigation, which are not "placed by hand" as they are in a more mechanistic model. He further argues(cf. pp. 131-143) that there is "no way to pick out the relevant collective variables that will play a causal role in the further evolution" of living systems. (p.140-1) Nevertheless, we put our methodological carts before our ontological horses, and worse, we justify our aims based on our methods, rather than the reverse. This is not only reductionist. It reduces us.
Our model of measurement needs to change from a mechanical one to one that respects that we work in living systems. We need to use something a bit less pedantic than a pre-established list of specific criteria for evaluation and learn how to acknowledge context, the context being our actual overall aims in relation to what is being evaluated both now, and as they change, with learning, over time. We need to look at a higher level of granularity if we're really serious about innovation or getting beyond a nihilistic means-focused outlook (a hamster wheel). This will require a sea change at every juncture. Responsiveness and resiliency will be key.
Our model of measurement needs to change from a mechanical one to one that respects that we work in living systems. We need to use something a bit less pedantic than a pre-established list of specific criteria for evaluation and learn how to acknowledge context, the context being our actual overall aims in relation to what is being evaluated both now, and as they change, with learning, over time. We need to look at a higher level of granularity if we're really serious about innovation or getting beyond a nihilistic means-focused outlook (a hamster wheel). This will require a sea change at every juncture. Responsiveness and resiliency will be key.
Labels:
accountability,
business ethics,
change management,
charles taylor,
complexity,
eugene wigner,
evaluation,
legitimacy,
metrics,
oecd,
ontology,
perrin,
reductionism,
results,
stuart kauffman
Sunday, March 1, 2009
Concrete Deliverables: Watch out for Goal Displacement
Burt Perrin, in a report entitled, Implementing the Vision: Addressing Challenges to Results-Focused Management and Budgeting writes,
First, efficiencies, which numbers measure (more or less accurately), are not goals, but ways of achieving goals. Numbers are not targets, but for tracking. Second, as Perrin notes, "It does not always make sense to attempt to represent a complex initiative by just a very small number of quantitative indicators. There typically is an inverse relationship between what is important and what is easiest to count and to measure."
So as people focus on meeting the numbers and confuse the report for the result, they close off to the complexity of the situation, and actions become skewed to achieving "concrete deliverables" which could be anything but. What do we take to be objective today? Is it the evidence of the senses, all the flux and change that happens in real time? Well, not really! It is rather what can be measured, quantified and counted.
Getting the numbers right is not an easy matter. To count measure and something, you need to have a category or definition, which is a static mental compartment and sorting device. For example, in order to count employees, you first have to establish a category or definition of "employee" for your organization. If your definition of employee changes, your numbers will change, even if nothing "concrete" changes.
So now, the question about what constitutes objectivity moves up a level. How many of the categories and definitions we use are given and natural like mammal and bird and how many are social and historical like person or fiscal year? Many categories may seem self-evident but to what extent is our confidence in our categories due to social and historical factors, including learning, rather than natural ones? Have we arrived at the end of learning? Of course not.
When it comes to precision measurements and results, physics is the archetype. To discover physical laws, physicists have to establish that their results are reproducible. They need to determine what factors need to be controlled and what properties are internal to the phenomena under investigation. When developing tests they carefully articulate operational definitions, which define phenomena in mathematical terms. There is no algorithm or checklist procedure for these activities, and it takes a great deal of skill, knowledge and insight. You might say, there is an “art” to ensuring objectivity.
Scientists in areas such as biology and geology and even some areas of physics, are investigating things where there are innumerable factors that cannot be isolated and controlled. Scientists are beginning to question whether we have been acting as if something is real because it is measurable, rather than the reverse. (See for instance, Robert Laughlin's A Different Universe.) They emphasize the need to think of nature more as a dynamic complex system. This moves the question of what constitutes objectivity up yet another level because it means considering not just how we define something for the purposes of counting instances of it, but how we frame and contextualize it to distinguish relevant from irrelevant factors in understanding how it behaves and changes over time as a part of a system.
If anything is complex, human organizations, and especially public service organizations, are complex. How closely do the auditor's and comptroller's categories ally with those of the organizational or program strategist's? In the public service, how do you know when you have contributed to the public good? rather than burdened your employees with administrivialities and set them on the straight and narrow road to pursuing "concrete deliverables" that are anything but. Is being quantifiable a necessary quality of all worthwhile goals? How realistic is that?
Goal displacement occurs when indicators become the objective, where the focus is on “meeting the numbers” rather than doing what the program was created to do or improving actual outcomes. Thus it represents the distortion of program activities.In fact it is conceivable that working to meet number targets may even produce "perverse effects" such as serving those easiest to serve rather than those in most need, or focusing on procedural efficiencies to increase numbers (of transactions, say) rather than improving system efficiencies, which might decrease them. This occurs for two reasons.
First, efficiencies, which numbers measure (more or less accurately), are not goals, but ways of achieving goals. Numbers are not targets, but for tracking. Second, as Perrin notes, "It does not always make sense to attempt to represent a complex initiative by just a very small number of quantitative indicators. There typically is an inverse relationship between what is important and what is easiest to count and to measure."
So as people focus on meeting the numbers and confuse the report for the result, they close off to the complexity of the situation, and actions become skewed to achieving "concrete deliverables" which could be anything but. What do we take to be objective today? Is it the evidence of the senses, all the flux and change that happens in real time? Well, not really! It is rather what can be measured, quantified and counted.
Getting the numbers right is not an easy matter. To count measure and something, you need to have a category or definition, which is a static mental compartment and sorting device. For example, in order to count employees, you first have to establish a category or definition of "employee" for your organization. If your definition of employee changes, your numbers will change, even if nothing "concrete" changes.
So now, the question about what constitutes objectivity moves up a level. How many of the categories and definitions we use are given and natural like mammal and bird and how many are social and historical like person or fiscal year? Many categories may seem self-evident but to what extent is our confidence in our categories due to social and historical factors, including learning, rather than natural ones? Have we arrived at the end of learning? Of course not.
When it comes to precision measurements and results, physics is the archetype. To discover physical laws, physicists have to establish that their results are reproducible. They need to determine what factors need to be controlled and what properties are internal to the phenomena under investigation. When developing tests they carefully articulate operational definitions, which define phenomena in mathematical terms. There is no algorithm or checklist procedure for these activities, and it takes a great deal of skill, knowledge and insight. You might say, there is an “art” to ensuring objectivity.
Scientists in areas such as biology and geology and even some areas of physics, are investigating things where there are innumerable factors that cannot be isolated and controlled. Scientists are beginning to question whether we have been acting as if something is real because it is measurable, rather than the reverse. (See for instance, Robert Laughlin's A Different Universe.) They emphasize the need to think of nature more as a dynamic complex system. This moves the question of what constitutes objectivity up yet another level because it means considering not just how we define something for the purposes of counting instances of it, but how we frame and contextualize it to distinguish relevant from irrelevant factors in understanding how it behaves and changes over time as a part of a system.
If anything is complex, human organizations, and especially public service organizations, are complex. How closely do the auditor's and comptroller's categories ally with those of the organizational or program strategist's? In the public service, how do you know when you have contributed to the public good? rather than burdened your employees with administrivialities and set them on the straight and narrow road to pursuing "concrete deliverables" that are anything but. Is being quantifiable a necessary quality of all worthwhile goals? How realistic is that?
Subscribe to:
Posts (Atom)