Mario Vittone on the illusion of experience

Sobering.

That’s the only adequate word I can come up with to describe Mario Vittone’s presentation at the Museum of History and Industry on the 2012 sinking of the HMS Bounty replica off the coast of North Carolina. The title of the presentation was “The Illusion of Experience” and it is that illusion, for any thinking sailor, that is so sobering: ultimately, Vittone is talking less about the Bounty than about us, and the difficulty of seeing through the veil of what we call experience into the reality of the dangers that any day on the water may entail.

“Nobody on the crew is terribly unlike you or me,” Vittone said. The failures aboard Bounty, in his view, were failures inherent to human nature, not to intentional neglect or outright indifference. To Vittone, the mechanisms of the actual sinking had become beside the point (although he clearly had explored them in as much detail as anyone who cannot visit Bounty’s cold grave at 2400 fathoms ever can); instead, the tragedy encompassed every other problem, every other tragedy at sea that he had heard or read about in his 22 years of experience as a highly decorated Coast Guard rescue swimmer.

It’s Vittone’s assertion that all tragedies at sea (with the exception of some medical evacuations) begin with decisions made on the dock, before a line is ever let go. On the Bounty, it was the cumulative impact of a host of decisions, some made years previously, that culminated in what might have been the one last fatal one of slipping the hawsers and heading out at all with a Category 2 hurricane on the horizon.

His talk explored the roots of those decisions more than the consequences. In both his presentation and his series of articles on gcaptain covering the joint NTSB/Coast Guard hearings on the incident, he focused on the thinking behind those decisions and explored the rationalizations that the decision-makers used at each stage to convince themselves that what to all objective appearances was a dangerously rash voyage was, in fact, business as usual.

Vittone originally used the phrase “illusion of experience” as a reference to someone who knew a very little bit about hull maintenance teaching someone who knew absolutely nothing; in relative terms, that little bit of knowledge must have looked like a lot of experience to someone completely new to the business. But he has taken the concept further, suggesting that even someone who had a great depth of experience (such as Captain Robin Walbridge) but who came by it only narrowly (e.g., aboard a small handful of vessels; or primarily one, such as was the case with Walbridge) might undergo the same illusion.

This scenario should ring a loud bell for many small-craft sailors.

Vittone’s insights mesh with those of other authors who have explored this mystery in detail, including Laurence Gonzales (“Deep Survival”) and Atul Gawande (“The Checklist Manifesto”). Gawande’s characterizations of the condition that Vittone describes might be to call those in its grip “inept.” In Gawande’s world, ineptitude is a failure to apply existing knowledge to prevent catastrophe. Captain Walbridge had all the knowledge at hand to make a decision to stay in port or seek other shelter; he simply failed to apply it to the conditions he was facing.

But Vittone’s take is more insidious; he might argue that Walbridge did apply his knowledge to the situation; and, unfortunately, among those things which he thought he knew was that he had been in difficult, marginal conditions with Bounty previously and successfully sailed her through them. That knowledge may have helped inform his decision to put out in conditions, and in a vessel, that objectively were an extraordinary risk.

In this, Vittone seems to join Gonzales in suggesting that, in fact, experience can be one of the most hazardous contributors to tragedy… something that Gonzales calls “The Sandpile Effect,” in which positive experiences in marginal conditions sublimate the risks so that they appear, subjectively, acceptable, even normal. After each such experience, the margins become stretched further and further.

In fact, Vittone said, what scared him the most about the Bounty incident was that they had almost made it… if the pumps had been working, there was a good chance the ship might have made port. And, having succeeded once more at one further extension of his storm experience, Walbridge might have stretched his luck even further the next time, and more people might have died.

If this has a familiar feeling to it, it’s because it’s just an extension of what most of us are pleased to call simply “experience.” We learn we can do things successfully by having done them; we expand the horizon of the possible by measuring what we have succeeded at and extending our ambitions out a bit further. This “crawl, walk, run” model is the basis for training programs of every sort, from day-sailing instruction to master’s endorsements. The thought that it can, itself, become a dangerously subversive pattern of thought is profoundly disturbing. “Experience is being fooled by someone who’s gotten away with the same mistake longer than you have,” said Vittone.

Vittone makes it clear that none of these revelations are new, and indeed, that they are nearly universal. He spent some time explicitly relating the phenomena that Walbridge underwent with that of NASA administrators responsible for the decisions to launch Challenger and, later, Columbia in the face of objective data that suggested caution. (Anyone interested in the Challenger disaster and in the sort of rationalization and normalization of risk that Vittone is highlighting here owes it to themselves to read Richard Feynman’s appendix to the Rogers Commission Report on the accident.)

If this is in fact simply human nature at work, then none of us are, by definition, immune to it. In fact, those who believe that they are (“that could never happen to me; I would never make such bad decisions”) may be the most susceptible. If it can happen to genuine rocket scientists, what hope do the rest of us have for avoiding it?

Vittone’s suggestion is that we all stay a little bit afraid… to provide “a fair estimation of the account of peril” in our decision-making process. And he says that one of the best ways of achieving that is to entertain doubts; your own, and those of your crew. Or, as Gonzales advises more succinctly, “Be humble.”

At the end of the day, you’ll have to make a decision, and it may be right or wrong. But it is likely to be better if it is informed by not just experience, but a diversity of experience.

And this is where Gawande’s prescriptions can be useful; they provide a systematized method for objectively assessing decisions even in the face of extreme emotion or pressure… a method that can be designed and evaluated at leisure in the safety and with the resources of the experience of others easily at hand.

Again, these recommendations are not new. But they are not broadly encouraged in the sailing community today either. Our experiences have been that they are unnecessary to our successful return. But that experience may be just another illusion.

7 Replies to “Mario Vittone on the illusion of experience”

  1. Scott – you said that a lot better than I did in Seattle. My new goal is to be as smart as you made me sound in this post.

    Gonzales, and Guwande, and R.P. Feynman – they didn’t have to be sailors to understand that the last great gains to be made in safety will be about what happens between our ears. It’s about changing the way we think about going to sea.

    Thanks for the very nice piece. It was…. humbling.

  2. Thank YOU, Mario… I, and everyone I talked to who was there, thought it was an excellent presentation. And your coverage of this entire incident has sparked a much-needed conversation in both the cruising and the classic wooden boating communities.

    Those efforts definitely are changing the way we think, at least some of us, about going to sea (or, perhaps more importantly, about coming back again!).

  3. It logically follows that if one lacks expertise it becomes very difficult to do a self-assessment, failing having the quality of excellent humility.

    The work is sort of faddish right now but there’s been some fascinating study on this done by a pair of academics, Dunning and Kruger. Disregarding the popular tendency to cite their work, Dunning and Kruger’s findings pertain to the problems Mario speaks of. Quite possibly this work is specifically cited in the books mentioned above, or by Mario. If not, see more here:

    http://en.wikipedia.org/wiki/Dunning%E2%80%93Kruger_effect

    What Mario says about there being almost no “accidents” rings completely true. We constantly ignore chances to make better luck for ourselves. Morbid though it sounds, reading accident reports is an excellent way to benefit from other folks’ oversights.

  4. Good cite, Doug. I’ve heard of their work but hadn’t thought to associate it here. I don’t believe it’s in any of the works I mentioned.

    Now that you bring it up, though, I wonder if it’s not even more important for those who have expertise to exhibit that quality of “excellent humility” (I like how you put that). If you like Dunning and Kruger’s work on the incompetent, you’ll be fascinated by the work Itiel Dror and others have done on the reduction of objectivity and accuracy among experts:

    http://www.psmag.com/health/experts-mental-shortcuts-3610/

    Gonzales plumbs this a bit, too, noting that small children, the most inexpert among us, have significantly better survival rates when lost in the wilderness than fit, experienced hunters, hikers, or sailors.

    He also shares your (and my) fascination with reading accident reports. Today’s featured story is a review of “Deep Survival” by Bill Ray; read the review, then rush out and get the book if you haven’t already.

  5. Scott and Mario,

    Thank you for very good, thought provoking information. As I read this several things came to mind. Most significantly, the memory of how I was almost victim to “death by ineptness”. As a child, while my father planned a simple sail from San Pedro to Catalina Island… he decided not to equip the boat’s outboard motor with gasoline. He was very prideful in his “Mastery of Sailing” and was determined to “sail like a real sailor” and rely on wind alone. Unfortunately he picked a day to accomplish this endeavor during a freakish, completely becalmed weather condition. What should have only been a 4 or 5 hour cruise turned into over 22 hours. Second, he brought along a directional finder radio, so he could “zero in” on the K.B.I.G. station in Avalon (only if absolutely required). Unfortunately, he stowed the radio in the cabin just below the compass. As many know, radio speakers have magnets, and magnets have a funny effect on compasses. By the way, he did NOT bring a two way radio. Visibility was murky that day and the haze prohibited visual confirmation of our heading, but damn the torpedos… he was going to make it on compass alone. At approximately 19 hours out, and a blinding darkness upon us he finally retrieved the directional radio to discover we had sailed past Catalina Island. We were on our way to the middle of the Pacific. There was very little moonlight that night, and he was so confused and disoriented that he was gripped by a terrifying panic, Scary? Yes. Disastrous? Thankfully no. When we finally arrived in Avalon, he had all kinds of excuses… none of which were his own fault.

    Also this article brought to mind Race Car drivers. They live on the very edge of the “Illusion of Experience”… and push that envelope during each successive race. This makes me wonder, what kills some champion drivers, while others succeed and live to retire? Talent must enter into the discussion here. Many often tout talent and experience as the same thing, but I believe they are completely separate, yet inextricably connected issues. Of course “stupidity” is yet another factor. The ultimate act of stupidity would be to assume one has talent, without experience. I believe a perfect example of this is as Scott illustrates; “that could never happen to me; I would never make such bad decisions”. This is more than a lack of humility, I believe this demonstrates acute stupidity. In most instances, talent can only be discovered after years of experience. Unfortunately, it appears the world is also full of stupid people who will never realize it because they are killed during the process of discovery.

    Thanks again for a great article!

  6. Spooky story, Craig! Glad you survived to adulthood. I always wonder if those vessels that sail off over the horizon, never to be seen again, start off in some similar way.

    I think you’re correct in distinguishing between talent and experience. They have a certain synergy in many different fields, but they certainly aren’t the same thing.

Leave a Reply