This post is a follow-up to a debate at the IEHF Conference led by Dr Scott Steedman CBE, Director of Standards, BSI. That background has not been added yet, so the post may not be clear as it stands.
We 'know what good looks like' as regards the human-centred management
of people in enterprises. This note gives some pointers to that
literature, with an emphasis on Pfeffer and Sutton's work on Evidence
Based Management. A good summary can be found in the Happy Manifesto
by Henry Stewart. The first chapter is called "Enable People to Work at
Their Best". Perhaps using this knowledge to produce an inspriational
standard would help the cause.
We need to promote what ought to be
commonsense because it is overwhelmed by technocratic command and
control thinking and an obsession with 'leadership'. The zillions of
Something Management System standards promote the mechanistic
management of things. Whilst this might be useful, on the basis of
'what gets measured gets done', such mechanistic procedures exacerbate
some of the flaws in our society. A human-centred approach needs to be
promoted to at least restore the balance. Fortunately the wherewithal
to do this in a 'third generation' way have already been developed.
O'Reilly and Pfeffer have contrasted conventional strategy with values based strategy as follows:
[Based on: Hidden Value: How Great Companies Achieve Extraordinary Results With Ordinary People (Harvard Business School Press)]. I have had to deliver Value Plans working for BAE Systems - challenging and genuinely useful in my experience.
In
'The human equation: building profits by putting people first' Pfeffer
has shown that a human-centred approach yields long-term business
benefit.
We are overdue a paradigm change in the approach to
people and safety. The new view of system safety has been
well-developed by Woods, Dekker and others. 'How Complex Systems Fail' (pdf) would be a good starting point. The new paradigm has not taken hold (yet). Steven Shorrock has just written a terrific blog post on why this may be. Perhaps a standard would help.
There
is over sixty years of literature and practice on Socio-Technical
Systems - the conceptual foundation of ergonomics and human-centred approaches. A pointer to that
literature can be found here. In recent years, John Seddon's proprietary Vanguard
implementation of systems thinking has found success in the UK
public sector, producing benefits considerably in excess of a 20%
target.
I will conclude with Pfeffer and Sutton "The single
best diagnostic to see if an organization is innovating, learning, and
capable of turning knowledge into action is 'What happens when they
make a mistake?' "
Thursday, 18 April 2013
Saturday, 23 March 2013
Air Traveller User Experience (UX)
Air travellers are faced with conflicting stereotypes for document
scanners; face up or face down. The check-in machine shown here expects
my passport face-up.
The e-passport reader expects it face-down (which matches my expectation). This article says the future for boarding card readers is face up. Glasgow Airport has just installed face-down readers. It is clearly going to be a confusing mess for the next decade. Not life-threatening, but along with the security theatre, a signifier of the clueless authoritarianism that lurks behind the functionalist aesthetic.
A collection of recently-collected confusing iconography above (not air travel, but while travelling). The first sign does NOT mean that you are safe from flames in the lift. It is very unclear what the sign adds to the text in the second one. The bottom indicator was clear to the designer, I'm sure..
The picture above is from the Hamburg Metro at the airport. A true gem. To go to the city centre, you press button 3. Not that button 3 - the one on the screen.
UX is about more than just functionalism. Going through Heathrow, I was delighted to see this picture of Herne the Hunter.
The celebration of local mythology is to be welcomed , but does it have to be so functionalist? A more evocative image is this one:
The UX of air travel is affected by the sense of place. For British airports, it is adversely affected by a complete lack of any sense of place from a combination of soulless functionalism and relentless mercantilism. Glasgow Airport was (properly) designed by Basil Spence, who ".. wanted a design which helped the traveller to feel the adventure of flying from this particular airport”. Well, the feel of adventure has gone, and the design has been buried in extensions. It is still possible to see the back of the original terminal.
The good news is that Wetherspoons understand a sense of place. They have put up a poster to Spence and provided a place where you can appreciate the canopy (originally outside the building of course).
The e-passport reader expects it face-down (which matches my expectation). This article says the future for boarding card readers is face up. Glasgow Airport has just installed face-down readers. It is clearly going to be a confusing mess for the next decade. Not life-threatening, but along with the security theatre, a signifier of the clueless authoritarianism that lurks behind the functionalist aesthetic.
A collection of recently-collected confusing iconography above (not air travel, but while travelling). The first sign does NOT mean that you are safe from flames in the lift. It is very unclear what the sign adds to the text in the second one. The bottom indicator was clear to the designer, I'm sure..
The picture above is from the Hamburg Metro at the airport. A true gem. To go to the city centre, you press button 3. Not that button 3 - the one on the screen.
UX is about more than just functionalism. Going through Heathrow, I was delighted to see this picture of Herne the Hunter.
The celebration of local mythology is to be welcomed , but does it have to be so functionalist? A more evocative image is this one:
The UX of air travel is affected by the sense of place. For British airports, it is adversely affected by a complete lack of any sense of place from a combination of soulless functionalism and relentless mercantilism. Glasgow Airport was (properly) designed by Basil Spence, who ".. wanted a design which helped the traveller to feel the adventure of flying from this particular airport”. Well, the feel of adventure has gone, and the design has been buried in extensions. It is still possible to see the back of the original terminal.
The good news is that Wetherspoons understand a sense of place. They have put up a poster to Spence and provided a place where you can appreciate the canopy (originally outside the building of course).
Thursday, 19 July 2012
Is 'autonomy' a helpful aim for 'unmanned' platforms?
Building
'autonomous' platforms sounds exciting as an engineering challenge.
This post suggests that the concept may be sufficiently flawed that it
takes well-intentioned technical effort down a blind alley, and that a
somewhat less-exciting conceptual framework may end up supporting
greater technical advance.
Chapter 3 of Vincenti's classic book "What Engineers Know and How They Know It" is on Flying-Quality Specifications. The concepts of stability and control had to be re-thought. Essentially stability had been seen as a property of the aircraft on its own. This concept had to change to provide the pilot with adequate control. Flying qualities emerged as a concept that related to the aircraft-pilot system. I would give a better description, but someone hasn't returned my copy of the book. Changing the underlying concepts took a good decade of experimentation and pilot-designer interaction. My concern is that 'autonomy' as currently defined will hold back progress in the way that 'stability' did in the 1920's. The 2010 version of CAP722 (Unmanned Aircraft System Operations in UK Airspace – Guidance) is used as the reference on current thinking on 'autonomy'.
The advantage we have for 'autonomy' over stability in the 1920's is that there is a good body of work on human-automation interaction, supervisory control etc.going back sixty years that can be used. There is well-established work that can elaborate human-automation interaction beyond a simple 'autonomous' label, or a 'semi-autonomous' label (reminders of 'slightly pregnant' as a concept). For example,
CAP722 (3.5.1) states: 'The autonomy concept encompasses systems ranging in capability from those that can operate without human control or direct oversight (“fully autonomous”), through “semi-autonomous” systems that are subordinate to a certain level of human authority, to systems that simply provide timely advice and leave the human to make all the decisions and execute the appropriate actions'. 'Full Autonomy' is thus a self-defining no control zone (Grote). As a pre-requisite for such a zone, the transfer of responsibility from the operator at the sharp end to the relevant authority (e.g. the Design Authority, the Type Certificate Holder, the IPT Leader) needs to be clearly signalled to all concerned. The 2010 version of CAP 722 seems to leave responsibility at the sharp end, and the inevitable accusations of 'operator error' when things go wrong.
I leave the last words to Adm. Rickover:
"Responsibility is a unique concept: It can only reside and inhere in a single individual. You may share it with others but your portion is not diminished. You may delegate it but it is still with you. Even if you do not recognise it or admit its presence, you cannot escape it. If responsibility is rightfully yours, no evasion, or ignorance, or passing the blame can shift the burden to someone else. Unless you can point your finger at the man responsible when something goes wrong then you never had anyone really responsible."
Update: Project ORCHID seems to have the right approach, talking about degree of autonomy required for tasks, and providing digital assistants. Also, please note the agent based approach.
Update: It's nice to be ahead of Dangerroom. "The Pentagon doesn't trust its own robots". Problems of autonomy!
Chapter 3 of Vincenti's classic book "What Engineers Know and How They Know It" is on Flying-Quality Specifications. The concepts of stability and control had to be re-thought. Essentially stability had been seen as a property of the aircraft on its own. This concept had to change to provide the pilot with adequate control. Flying qualities emerged as a concept that related to the aircraft-pilot system. I would give a better description, but someone hasn't returned my copy of the book. Changing the underlying concepts took a good decade of experimentation and pilot-designer interaction. My concern is that 'autonomy' as currently defined will hold back progress in the way that 'stability' did in the 1920's. The 2010 version of CAP722 (Unmanned Aircraft System Operations in UK Airspace – Guidance) is used as the reference on current thinking on 'autonomy'.
The advantage we have for 'autonomy' over stability in the 1920's is that there is a good body of work on human-automation interaction, supervisory control etc.going back sixty years that can be used. There is well-established work that can elaborate human-automation interaction beyond a simple 'autonomous' label, or a 'semi-autonomous' label (reminders of 'slightly pregnant' as a concept). For example,
- Tom Sheridan defined five generic supervisory of functions planning, teaching (or programming the computer), monitoring, intervening and learning. These functions operate within three nested control loops.
- The Bonner-Taylor PACT framework for pilot authorisation and control of tasks can be used to describe operation in various modes.
- Work by John Reising , Terry Emerson and others developed design principles and approaches to Human-Electronic teamwork, using, inter alia, Asimov's Laws of Robotics.
- Recent work by Anderson et al on a constraint-based approach to UGV semi-autonomous control.
CAP722 (3.5.1) states: 'The autonomy concept encompasses systems ranging in capability from those that can operate without human control or direct oversight (“fully autonomous”), through “semi-autonomous” systems that are subordinate to a certain level of human authority, to systems that simply provide timely advice and leave the human to make all the decisions and execute the appropriate actions'. 'Full Autonomy' is thus a self-defining no control zone (Grote). As a pre-requisite for such a zone, the transfer of responsibility from the operator at the sharp end to the relevant authority (e.g. the Design Authority, the Type Certificate Holder, the IPT Leader) needs to be clearly signalled to all concerned. The 2010 version of CAP 722 seems to leave responsibility at the sharp end, and the inevitable accusations of 'operator error' when things go wrong.
I leave the last words to Adm. Rickover:
"Responsibility is a unique concept: It can only reside and inhere in a single individual. You may share it with others but your portion is not diminished. You may delegate it but it is still with you. Even if you do not recognise it or admit its presence, you cannot escape it. If responsibility is rightfully yours, no evasion, or ignorance, or passing the blame can shift the burden to someone else. Unless you can point your finger at the man responsible when something goes wrong then you never had anyone really responsible."
Update: Project ORCHID seems to have the right approach, talking about degree of autonomy required for tasks, and providing digital assistants. Also, please note the agent based approach.
Update: It's nice to be ahead of Dangerroom. "The Pentagon doesn't trust its own robots". Problems of autonomy!
Cognitive anti-patterns - more inputs
Don Norman's book “Things that make us smart” has Grudin’s Law: When
those who benefit are not those who do the work, then the technology is
likely to fail, or at least be subverted.
Amalberti's human error self-fulfilling prophecy: by regarding the human as a risk factor and delegating all safety-critical functions to technology as the presumed safety factor, the human is actually turned into a risk factor.
Gary Klein, Dave Snowden and Chew Lock Pin have listed 'useless advice' regarding anticipatory thinking. 'Useless advice' is pretty spot-on for anti-patterns. The useless advice is :
Robert Hoffman provides some laws about Complex and Cognitive Systems (CACS). The laws are not quite patterns/anti-patterns, but look capable of being worked into that framework. Woods and Hollnagel have developed them into patterns for Joint Cognitive Systems. A number of the laws relate to 'integration work'. The following seem relevant:
The Penny Foolish Law: Any focus on short-term cost considerations always comes with a hefty price down the road, that weighs much more heavily on the
shoulders of the users than on the shoulders of project managers.
The Cognitive Vacuum Law: When working as a part of a CACS, people will perceive patterns and derive understandings and explanations, and these are not
necessarily either veridical or faithful to the intentions of the designers. [bsj i.e. design intent needs to be explicit.]
Mr. Weasley’s Law: Humans should be supported in rapidly achieving a veridical and useful understanding of the “intent” and “stance” of the machines. Mr. Weasley states in the Harry Potter series, “Never trust anything that can think for itself if you can’t see where it keeps its brain.”
The Law of Stretched Systems: CACSs are always stretched to their limits of performance and adaptability. Interventions will always increase the tempo
and intensity of activity.
Rasmussen’s Law: In cognitive work within a CACS, people do not conduct tasks, they engage in context-sensitive, knowledge-driven choice among action
sequence alternatives. [bsj This links to Amalberti's 'ecological risk management'.]
Dilbert's Law: A human will not cooperate, or will not cooperate well with another agent if it is assumed that the other agent is not competent.
Law of Coordinative Entropy: Coordination costs, continuously. The success of new technology depends on how the design affects the ability to manage the costs of coordinating activity and maintaining or repairing common ground.
Law of Systems as Surrogates: Technology refl ects the stances, agendas, and goals of those who design and deploy the technology. Designs, in turn, refl ect the models and assumptions of distant parties about the actual diffi culties in real operations. For this reason, design intent is usually far removed from the actual conditions in which technology is used, leading to costly gaps between these models of work and the “real work.”
The Law of the Kludge: Work systems always require workarounds, with resultant kludges that attempt to bridge the gap between the original design objectives and current realities or to reconcile conflicting goals among workers.
The Law of Fluency: Well-adapted cognitive work occurs with a facility that belies the difficulty of resolving demands and balancing dilemmas. The adaptation process hides the factors and constraints that are being adapted to or around. Uncovering the constraints that fluent performance solves, and therefore seeing the limits of or threats to fluency, requires a contrast across perspectives.
Ned Hickling has challenged the universality of 'strong, silent automation is bad' i.e. Mr Weasley's Law does not apply all the time. Disagreeing with Ned is fine. Just one problem. It means you are wrong. A proper response will appear, but after some thoughts on 'autonomy'.
The answer is likely to make use of Grote's thinking on zones of no control, whereby it is recognized that there are areas of automation where the operator has no effective control (cf. Ironies of Automation). For these zones, the operator is not held accountable, and accountability is assigned to the design authority, the operating organization or other agencies as appropriate.
"It ain't what you don't know that gets you into trouble. It's what you know for sure that just ain't so." -- Mark Twain
Amalberti's human error self-fulfilling prophecy: by regarding the human as a risk factor and delegating all safety-critical functions to technology as the presumed safety factor, the human is actually turned into a risk factor.
Gary Klein, Dave Snowden and Chew Lock Pin have listed 'useless advice' regarding anticipatory thinking. 'Useless advice' is pretty spot-on for anti-patterns. The useless advice is :
- Gather more data.
- Use information technology to help analyze the data.
- Reduce judgment biases.
- Encourage people to keep an open mind.
- Appoint “devil’s advocates” to challenge thinking.
- Encourage vigilance.
Robert Hoffman provides some laws about Complex and Cognitive Systems (CACS). The laws are not quite patterns/anti-patterns, but look capable of being worked into that framework. Woods and Hollnagel have developed them into patterns for Joint Cognitive Systems. A number of the laws relate to 'integration work'. The following seem relevant:
The Penny Foolish Law: Any focus on short-term cost considerations always comes with a hefty price down the road, that weighs much more heavily on the
shoulders of the users than on the shoulders of project managers.
The Cognitive Vacuum Law: When working as a part of a CACS, people will perceive patterns and derive understandings and explanations, and these are not
necessarily either veridical or faithful to the intentions of the designers. [bsj i.e. design intent needs to be explicit.]
Mr. Weasley’s Law: Humans should be supported in rapidly achieving a veridical and useful understanding of the “intent” and “stance” of the machines. Mr. Weasley states in the Harry Potter series, “Never trust anything that can think for itself if you can’t see where it keeps its brain.”
The Law of Stretched Systems: CACSs are always stretched to their limits of performance and adaptability. Interventions will always increase the tempo
and intensity of activity.
Rasmussen’s Law: In cognitive work within a CACS, people do not conduct tasks, they engage in context-sensitive, knowledge-driven choice among action
sequence alternatives. [bsj This links to Amalberti's 'ecological risk management'.]
Dilbert's Law: A human will not cooperate, or will not cooperate well with another agent if it is assumed that the other agent is not competent.
Law of Coordinative Entropy: Coordination costs, continuously. The success of new technology depends on how the design affects the ability to manage the costs of coordinating activity and maintaining or repairing common ground.
Law of Systems as Surrogates: Technology refl ects the stances, agendas, and goals of those who design and deploy the technology. Designs, in turn, refl ect the models and assumptions of distant parties about the actual diffi culties in real operations. For this reason, design intent is usually far removed from the actual conditions in which technology is used, leading to costly gaps between these models of work and the “real work.”
The Law of the Kludge: Work systems always require workarounds, with resultant kludges that attempt to bridge the gap between the original design objectives and current realities or to reconcile conflicting goals among workers.
The Law of Fluency: Well-adapted cognitive work occurs with a facility that belies the difficulty of resolving demands and balancing dilemmas. The adaptation process hides the factors and constraints that are being adapted to or around. Uncovering the constraints that fluent performance solves, and therefore seeing the limits of or threats to fluency, requires a contrast across perspectives.
Ned Hickling has challenged the universality of 'strong, silent automation is bad' i.e. Mr Weasley's Law does not apply all the time. Disagreeing with Ned is fine. Just one problem. It means you are wrong. A proper response will appear, but after some thoughts on 'autonomy'.
The answer is likely to make use of Grote's thinking on zones of no control, whereby it is recognized that there are areas of automation where the operator has no effective control (cf. Ironies of Automation). For these zones, the operator is not held accountable, and accountability is assigned to the design authority, the operating organization or other agencies as appropriate.
"It ain't what you don't know that gets you into trouble. It's what you know for sure that just ain't so." -- Mark Twain
Friday, 13 July 2012
Monday, 9 July 2012
Managerialism
Evolutionary managerialism - our current situation as a development of past bad habits
The wikipedia entry for managerialism is pretty good. It cites a definition by Robert R Locke.
"What occurs when a special group, called management, ensconces itself systemically in an organization and deprives owners and employees of their decision-making power (including the distribution of emolument), and justifies that takeover on the grounds of the managing group's education and exclusive possession of the codified bodies of knowledge and know-how necessary to the efficient running of the organization."
Locke's principal writing on the topic seems to be here, as 'Managerialism and the Demise of the Big Three' (pdf), and the book 'Confronting Managerialism'. The Big Three are the US automobile makers, and their demise is seen as being brought about by the Japanese management approach. Locke lays blame at the door of of neoclassical economics and business school teaching.
This view of managerialism has strong precursors. Pfeffer and Sutton have pointed out the problems of US MBAs, what and how they teach. Mintzberg's 'Strategy Safari' has an account of the demise of the British motorcycle industry and Honda's success, including this quote from Hopwood:
"In the early 1960s the Chief Executive of a world famous group of management consultants tried hard to convince me that it is ideal that top level management executives should have as little knowledge as possible relative to the product. This great man really believed that this qualification enabled them to deal efficiently with all business matters in a detached and uninhibited way."
This ideal sounds like a job description of a UK generalist civil servant - still not dead 44 years after Fulton. Rory Stewart has written about managerialism in a number of public organizations e.g. here and here.
A proper 21st Century dystopian view of managerialism as an entity in itself
Bruce Sterling has given a good description of a dystopian future as 'favela chic', a talk beautifully visualised here. The connections between science fiction dystopia and collapsonomics are all too realistic for comfort.
The full horrors of managerialism as embodied in current global corporate capitalism have been captured in contemporary language by Rao, as 'The Gervais Principle', which starts with one of my favourite Hugh McLeod cartoons. The life cycle diagram seems to map well onto the more traditional life cycle at Adizes.
Rao's Guerilla Guide to Social Business is also available for download and is bang on the money. It includes a wonderful take on KM.
Managerialism and safety management
Managerialism appears to have penetrated safety management. One consequence is a concentration on hazards that are easily managed, at the expense of systemic hazards that require a resilient, learning, sensemaking approach. The sensemaking approach is set out in the 'The Learning School' in Mintzberg, or Weick and Sutcliffe (this link takes you to a great resource on High Reliability Organizations) and their book.
Managerialism in a safety context has been parodied all too accurately by The Daily Mash here.
In a safety management context, managerialism looks deceptively innocent. The diagrams below look fine at first sight. Everything is organized. That is the problem. Being organized is vital, but it is not enough. Where, on these diagrams, can we find crew input, sensemaking, informal learning, trying things out? Not in 'the system'. This is the most difficult challenge facing the move to resilience.
The wikipedia entry for managerialism is pretty good. It cites a definition by Robert R Locke.
"What occurs when a special group, called management, ensconces itself systemically in an organization and deprives owners and employees of their decision-making power (including the distribution of emolument), and justifies that takeover on the grounds of the managing group's education and exclusive possession of the codified bodies of knowledge and know-how necessary to the efficient running of the organization."
Locke's principal writing on the topic seems to be here, as 'Managerialism and the Demise of the Big Three' (pdf), and the book 'Confronting Managerialism'. The Big Three are the US automobile makers, and their demise is seen as being brought about by the Japanese management approach. Locke lays blame at the door of of neoclassical economics and business school teaching.
This view of managerialism has strong precursors. Pfeffer and Sutton have pointed out the problems of US MBAs, what and how they teach. Mintzberg's 'Strategy Safari' has an account of the demise of the British motorcycle industry and Honda's success, including this quote from Hopwood:
"In the early 1960s the Chief Executive of a world famous group of management consultants tried hard to convince me that it is ideal that top level management executives should have as little knowledge as possible relative to the product. This great man really believed that this qualification enabled them to deal efficiently with all business matters in a detached and uninhibited way."
This ideal sounds like a job description of a UK generalist civil servant - still not dead 44 years after Fulton. Rory Stewart has written about managerialism in a number of public organizations e.g. here and here.
A proper 21st Century dystopian view of managerialism as an entity in itself
Bruce Sterling has given a good description of a dystopian future as 'favela chic', a talk beautifully visualised here. The connections between science fiction dystopia and collapsonomics are all too realistic for comfort.
The full horrors of managerialism as embodied in current global corporate capitalism have been captured in contemporary language by Rao, as 'The Gervais Principle', which starts with one of my favourite Hugh McLeod cartoons. The life cycle diagram seems to map well onto the more traditional life cycle at Adizes.
Rao's Guerilla Guide to Social Business is also available for download and is bang on the money. It includes a wonderful take on KM.
Managerialism and safety management
Managerialism appears to have penetrated safety management. One consequence is a concentration on hazards that are easily managed, at the expense of systemic hazards that require a resilient, learning, sensemaking approach. The sensemaking approach is set out in the 'The Learning School' in Mintzberg, or Weick and Sutcliffe (this link takes you to a great resource on High Reliability Organizations) and their book.
Managerialism in a safety context has been parodied all too accurately by The Daily Mash here.
In a safety management context, managerialism looks deceptively innocent. The diagrams below look fine at first sight. Everything is organized. That is the problem. Being organized is vital, but it is not enough. Where, on these diagrams, can we find crew input, sensemaking, informal learning, trying things out? Not in 'the system'. This is the most difficult challenge facing the move to resilience.
Wednesday, 4 July 2012
Cognitive Anti-Patterns 1
Something went wrong with the previous post in Blogger so a slightly revised version published here.
Anti-patterns are discussed here and here. Jim Coplien states: "an anti-pattern is something that looks like a good idea, but which backfires badly when applied". SEI has published a document (pdf) with system archetypes - using archetypes to beat the odds. These archetypes (which have origins in ITIL) are very similar to anti-patterns. They are also nicely set out here.
The early recognition and countering of anti-patterns is an extremely valuable skill that is rarely taught, and is probably not very hard to acquire. I suspect that it is not taught often is because it sees what might pretentiously be called knowledge work as a craft or skill. On the contrary, this sort of diagnostic skill is at the heart of expertise. It all appears very negative, unfortunately, but this is the case with all risk management. Are there opportunities to complement these risks? Possibly. Not the subject of this post though. The list looks like it has a real down on automation. This in no way puts it near Marcuse' 'One Dimensional Man' or the Unabomber Manifesto. It is just a reflection of the prevalence of technology-push in our current society.
This post does not (yet) have well formulated anti-patterns, just some starting points and first drafts.
Starting points
Gary Klein offered three great 'unintelligent system anti-patterns' in this document (pdf).
1. That people predictably transfer learning from one situation to another.
2. That learners are passive receivers of wisdom - vessels into which knowledge is poured.
3. That learning is the strengthening of bonds between stimuli and correct responses.
4. That learners are blank slates on which knowledge is inscribed.
5. That skills and knowledge, to be transferable to new situations, should be acquired independent of their contexts of use.
First drafts
People are just a source of error that needs to be minimised. The alternative is to recognize that people (also) 'make safety'.
Accidents are usually the result of human error. The alternative is to see human error as an outcome (rather than a 'cause'), a sign that something is wrong with the system (Sidney Dekker).
Safe systems are usually safe. The alternative is that safe systems usually run broken.
Cycle of error (Cook and Woods). After an incident, 'things need tightening up, lessons must be learned'. Organizational reactions to failure focus on human error. The reactions to failure are: blame & train, sanctions, new regulations, rules, and technology. These interventions increase complexity and introduce new forms of failure.
Providing feedback on operational performance can be bad for morale and is best not done.
Rationality/logic/MEU is the benchmark for human decision making. The alternative is "reasoning is not about truth but about convincing others when trust alone is not enough. Doing so may seem irrational, but it is in fact social intelligence at its best." Gerd Gigerenzer, or "Man is not a rational animal, he is a rationalizing animal". Robert A Heinlein.
People are information processors, like computers. The alternative is to recognise the role of narrative, metaphore etc.
Cognitive biases are useful aids to people making decisions.
Human cognition is a higher mental function, and the lizard brain and emotions should not be involved.
People without emotional influence make better decisions.
Bull (Norman Dixon). Being clean and tidy is vital, whether it is polished brass, dress codes or tidy desks.
The important aspect of human decision making is the 'moment of choice' . Design and operational aspects should be focused on this. The alternatives include a narrative approach (Rao).
Automate what you can and leave the operator to do the rest (job design by left-overs). Supervisory control is a good model for job design. The human-centred automation alternative is to design a human-machine team to avoid cogminutia fragmentosa.
Automation reduces workload.
Automation improves performance.
Automation reduces staffing requirements.
Strong, silent automation is good (Dave Woods).
There are no UNK-UNK failure modes (Tom Sheridan), so we do not need to design or plan for them.
Regulations, rules and procedures will work as intended without reactive or cumulative effects. Technology improves safety. The alternative is to consider the reactive effects of their introduction, including risk compensation, and to remember that the people at the sharp end make continuing judgments balancing risk, profitability, workload (ETTO).
People will obey the rules in potentially high hazard systems just because they are there.
Procedures can be expected to cover all circumstances. Risk management can be comprehensive. Things will go according to the plan, so it is worth having a really detailed plan, and not investing in preparedness. The alternative is "In preparing for battle I have always found that plans are useless, but planning is indispensable" D D Eisenhower.
Providing unnecessary data 'just in case', whether it is a fourteen page checklist, a handful of alarm channels, or an overfilled tactical display. Planned information overload has adverse consequences (see operator error).
Chartjunk is a good basis for display design. The flows through a system (the 'big picture') can be presented as disjointed bullet points (Tufte).
Work can be divided by procurement or organizational boundaries, leading to stovepipe sub-systems, and the crew doing the 'integration work'.
Training can fix design problems.
Anti-patterns are discussed here and here. Jim Coplien states: "an anti-pattern is something that looks like a good idea, but which backfires badly when applied". SEI has published a document (pdf) with system archetypes - using archetypes to beat the odds. These archetypes (which have origins in ITIL) are very similar to anti-patterns. They are also nicely set out here.
The early recognition and countering of anti-patterns is an extremely valuable skill that is rarely taught, and is probably not very hard to acquire. I suspect that it is not taught often is because it sees what might pretentiously be called knowledge work as a craft or skill. On the contrary, this sort of diagnostic skill is at the heart of expertise. It all appears very negative, unfortunately, but this is the case with all risk management. Are there opportunities to complement these risks? Possibly. Not the subject of this post though. The list looks like it has a real down on automation. This in no way puts it near Marcuse' 'One Dimensional Man' or the Unabomber Manifesto. It is just a reflection of the prevalence of technology-push in our current society.
This post does not (yet) have well formulated anti-patterns, just some starting points and first drafts.
Starting points
Gary Klein offered three great 'unintelligent system anti-patterns' in this document (pdf).
- The Man behind the Curtain (from the Wizard of Oz). Information technology usually doesn’t let people see how it reasons; it’s not understandable. The alternative is to design a 'human window' (Donald Michie).
- Hide-and-Seek. On the belief that decision-aids must transform data into information and information into knowledge, data are actually hidden from the decision maker. The negative consequence of this antipattern is that decision makers can’t use their expertise.
- The Mind Is a Muscle. In the attempt to acknowledge human factors in the procurement process, some guidelines end up actually working against human-centering considerations: “Design efforts shall minimize or eliminate system characteristics that require excessive cognitive, physical, or sensory skills.”
1. That people predictably transfer learning from one situation to another.
2. That learners are passive receivers of wisdom - vessels into which knowledge is poured.
3. That learning is the strengthening of bonds between stimuli and correct responses.
4. That learners are blank slates on which knowledge is inscribed.
5. That skills and knowledge, to be transferable to new situations, should be acquired independent of their contexts of use.
First drafts
People are just a source of error that needs to be minimised. The alternative is to recognize that people (also) 'make safety'.
Accidents are usually the result of human error. The alternative is to see human error as an outcome (rather than a 'cause'), a sign that something is wrong with the system (Sidney Dekker).
Safe systems are usually safe. The alternative is that safe systems usually run broken.
Cycle of error (Cook and Woods). After an incident, 'things need tightening up, lessons must be learned'. Organizational reactions to failure focus on human error. The reactions to failure are: blame & train, sanctions, new regulations, rules, and technology. These interventions increase complexity and introduce new forms of failure.
Providing feedback on operational performance can be bad for morale and is best not done.
Rationality/logic/MEU is the benchmark for human decision making. The alternative is "reasoning is not about truth but about convincing others when trust alone is not enough. Doing so may seem irrational, but it is in fact social intelligence at its best." Gerd Gigerenzer, or "Man is not a rational animal, he is a rationalizing animal". Robert A Heinlein.
People are information processors, like computers. The alternative is to recognise the role of narrative, metaphore etc.
Cognitive biases are useful aids to people making decisions.
Human cognition is a higher mental function, and the lizard brain and emotions should not be involved.
People without emotional influence make better decisions.
Bull (Norman Dixon). Being clean and tidy is vital, whether it is polished brass, dress codes or tidy desks.
The important aspect of human decision making is the 'moment of choice' . Design and operational aspects should be focused on this. The alternatives include a narrative approach (Rao).
Automate what you can and leave the operator to do the rest (job design by left-overs). Supervisory control is a good model for job design. The human-centred automation alternative is to design a human-machine team to avoid cogminutia fragmentosa.
Automation reduces workload.
Automation improves performance.
Automation reduces staffing requirements.
Strong, silent automation is good (Dave Woods).
There are no UNK-UNK failure modes (Tom Sheridan), so we do not need to design or plan for them.
Regulations, rules and procedures will work as intended without reactive or cumulative effects. Technology improves safety. The alternative is to consider the reactive effects of their introduction, including risk compensation, and to remember that the people at the sharp end make continuing judgments balancing risk, profitability, workload (ETTO).
People will obey the rules in potentially high hazard systems just because they are there.
Procedures can be expected to cover all circumstances. Risk management can be comprehensive. Things will go according to the plan, so it is worth having a really detailed plan, and not investing in preparedness. The alternative is "In preparing for battle I have always found that plans are useless, but planning is indispensable" D D Eisenhower.
Providing unnecessary data 'just in case', whether it is a fourteen page checklist, a handful of alarm channels, or an overfilled tactical display. Planned information overload has adverse consequences (see operator error).
Chartjunk is a good basis for display design. The flows through a system (the 'big picture') can be presented as disjointed bullet points (Tufte).
Work can be divided by procurement or organizational boundaries, leading to stovepipe sub-systems, and the crew doing the 'integration work'.
Training can fix design problems.
Subscribe to:
Posts (Atom)










