There are unknown unknowns

From Wikipedia, the free encyclopedia
(Redirected from Unknown unknown)

Template:Short description Template:DMCA

File:Defense.gov News Photo 020221-D-9880W-080.jpg
Rumsfeld during a Pentagon news briefing in February 2002

"There are unknown unknowns" is a phrase from a response United States Secretary of Defense Donald Rumsfeld gave to a question at a U.S. Department of Defense (DoD) news briefing on February 12, 2002, about the lack of evidence linking the government of Iraq with the supply of weapons of mass destruction to terrorist groups.[1] Rumsfeld stated:

Page Template:Blockquote/styles.css has no content.

Reports that say that something hasn't happened are always interesting to me, because as we know, there are known knowns; there are things we know we know. We also know there are known unknowns; that is to say we know there are some things we do not know. But there are also unknown unknowns—the ones we don't know we don't know. And if one looks throughout the history of our country and other free countries, it is the latter category that tends to be the difficult ones.[1]

The statement became the subject of much commentary. In The Decision Book (2013), author Mikael Krogerus [de] refers to it as the "Rumsfeld matrix".[2] The statement also features in a 2013 documentary film, The Unknown Known, directed by Errol Morris.[3]

Known unknowns refers to "risks you are aware of, such as canceled flights",[4] whereas unknown unknowns are risks that come from situations that are so unexpected that they would not be considered.

Origins

Rumsfeld's statement brought attention to the concepts of known knowns, known unknowns, and unknown unknowns, but these were in common use in US defense procurement by the late 1960s. In a 1968 study sponsored by the Aerospace Industries Association, Hudson Drake from North American Rockwell argued that defence contractors had to solve both known unknowns and "unanticipated unknowns".[5] Also in 1968, Lt. Gen. William B. Bunker noted that when developing complex weapons systems "there are two kinds of technical problems: there are the known unknowns, and the unknown unknowns."[6] The usage was common enough for an industry shorthand to have developed where unknown-unknowns were referred to as "unk-unks".[7]

The term was commonly used inside NASA.[8] Rumsfeld cited NASA administrator William Graham in his memoir; he wrote that he had first heard "a variant of the phrase" from Graham when they served together on the Commission to Assess the Ballistic Missile Threat to the United States during the late 1990s.[9] Rumsfeld had previously publicly used the terms himself, stating in a 2000 speech that "There are known knowns, known unknowns and unknown unknowns. Effective intelligence work must consider them all."[10]

The terms "known unknowns" and "unknown unknowns" are often used in project management and strategic planning[11] circles.

Contemporary usage is largely consistent with the earliest known usages. For example, the term was used in evidence given to the British Columbia Royal Commission of Inquiry into Uranium Mining in 1979:

Page Template:Blockquote/styles.css has no content.

Site conditions always pose unknowns, or uncertainties, which may become known during construction or operation to the detriment of the facility and possibly lead to damage of the environment or endanger public health and safety. The risk posed by unknowns is somewhat dependent on the nature of the unknown relative to past experience. This has led me to classify unknowns into one of the following two types:

1. known unknowns (expected or foreseeable conditions), which can be reasonably anticipated but not quantified based on past experience as exemplified by case histories (in Appendix A) and

2. Unknown unknowns (unexpected or unforeseeable conditions), which pose a potentially greater risk simply because they cannot be anticipated based on past experience or investigation.

Known unknowns result from recognized but poorly understood phenomena. On the other hand, unknown unknowns are phenomena which cannot be expected because there has been no prior experience or theoretical basis for expecting the phenomena.[12]

The term also appeared in a 1982 New Yorker article on the aerospace industry, which cites the example of metal fatigue, the cause of crashes in de Havilland Comet airliners in the 1950s.[13]

Reaction

Canadian columnist Mark Steyn called it "in fact a brilliant distillation of quite a complex matter".[14] Australian economist and blogger John Quiggin wrote: "Although the language may be tortured, the basic point is both valid and important."[15]

Psychoanalytic philosopher Slavoj Žižek says that beyond these three categories there is a fourth, the unknown known, that which one intentionally refuses to acknowledge that one knows: "If Rumsfeld thinks that the main dangers in the confrontation with Iraq were the 'unknown unknowns', that is, the threats from Saddam whose nature we cannot even suspect, then the Abu Ghraib scandal shows that the main dangers lie in the 'unknown knowns'—the disavowed beliefs, suppositions and obscene practices we pretend not to know about, even though they form the background of our public values."[16]

German sociologists Christopher Daase and Oliver Kessler agreed that the cognitive frame for political practice may be determined by the relationship between "what we know, what we do not know, what we cannot know", but stated that Rumsfeld left out "what we do not like to know".[17]

The event has been used in multiple books to discuss risk assessment.[3][18]

Rumsfeld named his 2011 autobiography Known and Unknown: A Memoir. In an author's note at the start of the book, he expressly acknowledges the source of his memoir's title and mentions a few examples of his statement's prominence.[19] The Unknown Known is the title of Errol Morris's 2013 biographical documentary film about Rumsfeld.[20] In it, Rumsfeld initially defines "unknown knowns" as "the things you think you know, that it turns out you did not", and toward the end of the film he re-defines the term as "things that you know, that you don't know you know".[21]

Rumsfeld's comment earned the 2003 Foot in Mouth Award from the British Plain English Campaign.[22]

In April 2003, Slate columnist Hart Seely arranged Rumsfeld's public statements as found poetry, presenting the "unknown unknowns" passage as a poem titled "The Unknown".[23] Seely later published a full collection, Pieces of Intelligence: The Existential Poetry of Donald H. Rumsfeld (2003).[24] The poems were subsequently set to music by pianist Bryant Kong and performed by soprano Elender Wall.[25]

Historical context

As alluded to by Rumsfeld in his autobiography,[19]Template:R/superscript over two millennia ago Socrates considered known unknowns and unknown unknowns.[26][27] Much later, Thomas Aquinas in his Summa Theologica also emphasized the important difference between recognized ignorance and unconscious ignorance.[28]

Rumsfeld's statement closely parallelled a well-known proverb about knowledge:[29][30] Page Template:Blockquote/styles.css has no content.

He who knows not, and knows not that he knows not, is a fool. Shun him.
He who knows not, and knows that he knows not, is simple. Teach him.
He who knows, and knows not that he knows, is asleep. Wake him.
He who knows, and knows that he knows, is wise. Follow him.

This has been widely quoted[31] since the 19th century as (for example) an anonymous Persian,[32][33] Arabic,[34][35] African,[36] Japanese,[37] Oriental[38] or simply an old[39] proverb, or attributed to authors ranging from Confucius[40] to Bruce Lee.[41] The proverb is actually a close translation (with line order reversed) of al-Khalil ibn Ahmad al-Farahidi's medieval epigram about the "four kinds of men", as reported by Al-Ghazali (1058-1111 CE),[42][43] which was later echoed in poems by Nasir al-Din al-Tusi[44] and Ibn Yamin.[45]

"Unknown unknowns" were occasionally mentioned in the 1950s and 60s. In 1950, it was noted that sociology research was full of "unknown unknowns".[46] In a 1962 commencement address, Nobel laureate biochemist Melvin Calvin discussed how humanity "must grapple not only with the known and the 'known unknown', but also with the vastness of the 'unknown unknown'."[47]

A related 2x2 grid was created in 1955 by two American psychologists, Joseph Luft and Harrington Ingham in their development of the Johari window, a "graphic model of interpersonal behaviour"[48] that classifies knowledge about your behavior and motivations in terms of whether you or others are aware of those behaviours or motivations. For example, your motivation might be (un)known by you and (un)known by others. Another similar[49] classification scheme is the conscious competence learning model published in 1960, where a person's knowledge and skills are classified according to how (un)conscious and (in)competent they are.[50]

Analytical sciences

The term "known unknowns" has been applied to the identification of chemical substances using analytical chemistry approaches, specifically mass spectrometry. In many cases, an unknown to an investigator that is detected in an experiment is actually known in the chemical literature, a reference database, or an Internet resource. These types of compounds are termed "known unknowns". The term was originally coined by Little et al.[51] and reported a number of times in the literature since then as a general approach.[52][53][54][55]

See also

Page Template:Div col/styles.css has no content.

References

Page Template:Reflist/styles.css has no content.

  1. ^ a b Page Module:Citation/CS1/styles.css has no content."Defense.gov News Transcript: DoD News Briefing – Secretary Rumsfeld and Gen. Myers". United States Department of Defense. February 12, 2002. Archived from the original on April 6, 2016.
  2. ^ Page Module:Citation/CS1/styles.css has no content.Krogerus, Mikael (2012). The Decision Book: Fifty Models for Strategic Thinking. Roman Tschäppeler, Jenny Piening (1st American ed.). New York: W.W. Norton & Co. pp. 86–87. ISBN 978-0-393-07961-6. OCLC 738350045.
  3. ^ a b Page Module:Citation/CS1/styles.css has no content.Girard, John; Girard, JoAnn (June 1, 2009). A Leader's Guide to Knowledge Management: Drawing on the Past to Enhance Future Performance. Business Expert Press. pp. 55–. ISBN 978-1-60649-019-8. Retrieved February 10, 2014.
  4. ^ Page Module:Citation/CS1/styles.css has no content.Biafore, Bonnie (December 14, 2011). "Project Management Fundamentals". Lynda.com. Lynda.com/LinkedIN. Retrieved October 17, 2015.
  5. ^ Page Module:Citation/CS1/styles.css has no content.Poole, Walter S. (2013). "Chapter IV – Innovation: Coping with 'Unanticipated Unknowns'". History of Acquisition in the Department of Defence, Volume 2, Adapting to Flexible Response 1960-1968. p. 95.
  6. ^ Page Module:Citation/CS1/styles.css has no content.Andrews, Walter (December 7, 1968). "The 'Known Unknowns' And The 'Unknown Unknowns'". Armed Force Journal. 106 (15): 14–15.
  7. ^ Page Module:Citation/CS1/styles.css has no content.Meyers, Harald B. (August 1, 1969). "For Lockheed, Everything's Coming Up Unk-Unks". Fortune. Vol. 80, no. 2. p. 76.
  8. ^ Page Module:Citation/CS1/styles.css has no content."NASA Program Management and Procurement Procedures and Practices: Hearings Before the Subcommittee on Space Science and Applications of the Committee on Science and Technology, U.S. House of Representatives, Ninety-seventh Congress, First Session, June 24, 25, 1981". U.S. Government Printing Office. 1981.
  9. ^ Page Module:Citation/CS1/styles.css has no content.Rumsfeld, Donald (2011). Known and Unknown: A Memoir. New York: Penguin Group. p. xiv. ISBN 978-1-101-50249-5.
  10. ^ Page Module:Citation/CS1/styles.css has no content.Rumsfeld, Donald H. (February 8, 2000). Remarks of the Honorable Donald H. Rumsfeld Prepared for delivery, Community Forum Series: The New National Security Environment. Nominations Before the Senate Armed Services Committee, First Session, 107th Congress. Bryn Mawr, Pennsylvania: U.S. Government Printing Office. pp. 194–203. ISBN 978-0-16-069297-0.
  11. ^ Page Module:Citation/CS1/styles.css has no content.Courtney, Hugh; Kirkland, Jane; Viguerie, Patrick (November 1997). "Strategy Under Uncertainty". Harvard Business Review. 75 (6): 66–79. PMID 10174798.
  12. ^ Page Module:Citation/CS1/styles.css has no content."Phase V: Waste Disposal". Statement of Evidence of E. D'Appolonia, D'Appolonia Consulting Engineers, Pittsburgh, Pennsylvania. Proceedings of the British Columbia Royal Commission of Inquiry into Uranium Mining. 1979. ISBN 978-0-7718-8198-5. 0005037606.
  13. ^ Page Module:Citation/CS1/styles.css has no content.Newhouse, J. (June 14, 1982), "A reporter at large: a sporty game; 1-betting the company", New Yorker, pp. 48–105.
  14. ^ Page Module:Citation/CS1/styles.css has no content.Steyn, Mark (December 9, 2003). "Rummy speaks the truth, not gobbledygook". Daily Telegraph. Retrieved October 30, 2008.
  15. ^ Page Module:Citation/CS1/styles.css has no content.Quiggin, John (February 10, 2004). "In Defense of Rumsfeld". johnquiggin.com. Retrieved January 5, 2024.
  16. ^ Page Module:Citation/CS1/styles.css has no content.Žižek, Slavoj (May 21, 2004). "What Rumsfeld Doesn't Know That He Knows About Abu Ghraib". In These Times. Retrieved February 23, 2009 – via lacan.com.
  17. ^ Page Module:Citation/CS1/styles.css has no content.Daase, Christopher; Kessler, Oliver (December 2007). "Knowns and Unknowns in the 'War on Terror': Uncertainty and the Political Construction of Danger". Security Dialogue. 38 (4): 411–434. doi:10.1177/0967010607084994. ISSN 0967-0106. S2CID 145253344.
  18. ^ Page Module:Citation/CS1/styles.css has no content.Neve, Geert de; Luetchford, Peter (2008). Hidden Hands in the Market: Ethnographies of Fair Trade, Ethical Consumption, and Corporate Social Responsibility. Emerald Group Publishing. pp. 252–. ISBN 978-1-84855-058-2. Retrieved February 10, 2014.
  19. ^ a b Page Module:Citation/CS1/styles.css has no content.Rumsfeld, Donald (2011). Known and Unknown: A Memoir. New York: Penguin Group. p. xiii. ISBN 978-1-101-50249-5.
  20. ^ Page Module:Citation/CS1/styles.css has no content.Scott, A. O. (April 2, 2014). "Not Giving an Inch in a Battle of Wits and Words; Deciphering Donald H. Rumsfeld in 'The Unknown Known'". The New York Times. Retrieved April 4, 2014.
  21. ^ Morris, Errol (Director) (December 13, 2013). The Unknown Known (Motion picture). Los Angeles, CA: The Weinstein Company.
  22. ^ Page Module:Citation/CS1/styles.css has no content."Rum remark wins Rumsfeld an award". BBC News. December 2, 2003. Retrieved September 30, 2012.
  23. ^ Page Module:Citation/CS1/styles.css has no content.Seely, Hart (April 2, 2003). "The Poetry of D.H. Rumsfeld". Slate. Retrieved March 5, 2026.
  24. ^ Page Module:Citation/CS1/styles.css has no content.Seely, Hart (2003). Pieces of Intelligence: The Existential Poetry of Donald H. Rumsfeld. New York: Free Press. ISBN 978-0-7432-5239-3.
  25. ^ Page Module:Citation/CS1/styles.css has no content."The Poetry of Donald Rumsfeld, Set to Music". Morning Edition. NPR. March 12, 2004. Retrieved March 5, 2026.
  26. ^ Page Module:Citation/CS1/styles.css has no content.Rozell, Daniel J. (2020). Dangerous Science: Science Policy and Risk Analysis for Scientists and Engineers. Ubiquity Press. p. 48. ISBN 978-1-911529-89-7.
  27. ^ Page Module:Citation/CS1/styles.css has no content.McCarthy, Christine; Carr, David; Bailey, Richard; Barrow, Robin, eds. (March 23, 2010). The SAGE Handbook of Philosophy of Education. p. 304. ISBN 978-1-4462-0697-3.
  28. ^ Page Module:Citation/CS1/styles.css has no content.Nugent, J.B. (1967). "Ignorance". New Catholic Encyclopedia. New York: McGraw-Hill Book Company. Retrieved March 13, 2025.
  29. ^ Page Module:Citation/CS1/styles.css has no content.Pullum, Geoffrey K. (2005). "No foot in mouth". In Sumner, Tom (ed.). Untidy: The Blogs on Rumsfeld. Wilsonville, Oregon: William, James & Co. p. 28. ISBN 978-1-59028-047-8.
  30. ^ Page Module:Citation/CS1/styles.css has no content.Saravanan, R. (2021). "Chapter 13: The Rumsfeld Matrix". The Climate Demon: Past, Present, and Future of Climate Prediction. Cambridge University Press. p. 200. doi:10.1017/9781009039604. ISBN 978-1-009-03960-4.
  31. ^ Page Module:Citation/CS1/styles.css has no content.Bartlett, John (1955). Familiar Quotations: a collection of passages, phrases, and proverbs traced to their sources in ancient and modern literature (13 ed.). Boston: Little, Brown. p. 754.
  32. ^ Page Module:Citation/CS1/styles.css has no content.Felleman, Hazel, ed. (1936). The Best Loved Poems of the American People. Garden City, New York: Garden City Books. p. 623.
  33. ^ Page Module:Citation/CS1/styles.css has no content.Morgan, Joy Elmer, ed. (1951). The American Citizens Handbook. National Education Association of the United States. p. 371.
  34. ^ Page Module:Citation/CS1/styles.css has no content."A Knowsy Proverb". The Globe. Toronto. December 15, 1885. p. 6. Retrieved March 19, 2025.
  35. ^ Page Module:Citation/CS1/styles.css has no content.Burton, Isabel (1893). The Life of Sir Richard F. Burton, K.C.M.G., F.R.G.S. London: Chapman & Hall. p. 548. Retrieved March 19, 2025.
  36. ^ Page Module:Citation/CS1/styles.css has no content.Kimbro, Dennis (1993). "September 4: Sesame Street". Daily Motivations for African-American Success. New York: Random House - Fawcett Books. ISBN 978-0-449-22325-3.
  37. ^ Page Module:Citation/CS1/styles.css has no content."Japanese Proverbs". Presbyterian Standard. Vol. XLVI, no. 53. Charlotte, N.C. February 6, 1907. p. 21.
  38. ^ Page Module:Citation/CS1/styles.css has no content.Hoult, Elizabeth (2006). Learning support: a guide for mature students. Sage Publications. p. 55. ISBN 978-1-4129-0294-6.
  39. ^ Page Module:Citation/CS1/styles.css has no content.Driscoe, Margaret Sutton (December 22, 1894). "The Days We Live In". Harper's Bazaar. Vol. 27, no. 51. p. 6. Retrieved March 19, 2025.
  40. ^ Page Module:Citation/CS1/styles.css has no content.Dixon, Michael (April 16, 1993). "A case of the worst sort of ignorance". Financial Times. London. p. 22. Retrieved March 19, 2025.
  41. ^ Page Module:Citation/CS1/styles.css has no content."Bruce Lee: A Visit to the Grave". Grand Royal Magazine. No. Fall/Winter. Los Angeles. 1993. p. 50. Retrieved March 19, 2025.
  42. ^ Page Module:Citation/CS1/styles.css has no content.Al-Ghazali, Muhammad Hamid (June 25, 2013). "الباب السادس في آفات العلم وبيان علامات علماء الآخرة والعلماء السو". كتاب: إحياء علوم الدين کتاب العلم (in arabic). pp. 87–88.{{cite book}}: CS1 maint: unrecognized language (link)
  43. ^ Page Module:Citation/CS1/styles.css has no content.Al-Ghazali, Abu Hamed (2011). Revival of the Religion's Sciences. Translated by al-Sharif, Mohammad Mahdi. Beirut, Lebanon: Dar Al-Kotob Al-ilmiyah. p. 115. ISBN 978-2-7451-5945-8.
  44. ^ Page Module:Citation/CS1/styles.css has no content.Axworthy, Michael (2008). A history of Iran: empire of the mind. New York: Basic Books. ISBN 978-0-465-00888-9.
  45. ^ Page Module:Citation/CS1/styles.css has no content.Arberry, A.J. (1958). Classical Persian Literature. London: George Allen & Unwin Ltd. p. 315.
  46. ^ Page Module:Citation/CS1/styles.css has no content.Gordon, William E (July 1950). "The research project: Its educational value and its contribution to social work knowledge". Social Work Journal. 31 (3): 110–116. JSTOR 23705367.
  47. ^ Page Module:Citation/CS1/styles.css has no content."University Responding to Challenges". UCLA Summer Bruin. June 15, 1962. p. 2.
  48. ^ Page Module:Citation/CS1/styles.css has no content.Luft, Joseph (1969). Of human interaction. National Press Book. ISBN 978-0-87484-134-3.
  49. ^ Page Module:Citation/CS1/styles.css has no content.Tovstiga, Nicole; Tovstiga, George (2021). "COVID-19: a knowledge and learning perspective". Knowledge Management Research & Practice. 19 (4): 427–432. doi:10.1080/14778238.2020.1806749.
  50. ^ Page Module:Citation/CS1/styles.css has no content.DePhillips, Frank A.; Berliner, William M.; Cribbin, James J. (1960). Management of Training Programs. Homewood, Illinois: Richard C. Erwin, Inc. p. 69.
  51. ^ Page Module:Citation/CS1/styles.css has no content.Little, J.L.; Cleven, C.D.; Brown, S.D. (2011). "Identification of "Known Unknowns" utilizing accurate mass data and chemical abstracts service databases". J. Am. Soc. Mass Spectrom. 22 (2): 348–359. Bibcode:2011JASMS..22..348L. doi:10.1007/s13361-010-0034-3. PMID 21472594.
  52. ^ Page Module:Citation/CS1/styles.css has no content.Little, James L. (2011). "Identification of "known unknowns" utilizing accurate mass data and ChemSpider". Journal of the American Society for Mass Spectrometry. 23 (1): 179–185. doi:10.1007/s13361-011-0265-y. PMID 22069037.
  53. ^ Page Module:Citation/CS1/styles.css has no content.Stein, S. (2012). "Mass Spectral Reference Libraries: An Ever-Expanding Resource for Chemical Identification". Analytical Chemistry. 84 (17): 7274–7282. doi:10.1021/ac301205z. PMID 22803687.
  54. ^ Page Module:Citation/CS1/styles.css has no content.McEachran, Andrew D.; Sobus, Jon R.; Williams, Antony J. (2016). "Identifying known unknowns using the US EPA's CompTox Chemistry Dashboard". Analytical and Bioanalytical Chemistry. 409 (7): 1729–1735. doi:10.1007/s00216-016-0139-z. PMID 27987027. S2CID 31754962.
  55. ^ Page Module:Citation/CS1/styles.css has no content.Schymanski, Emma L.; Williams, Antony J. (2017). "Open Science for Identifying "Known Unknown" Chemicals". Environmental Science and Technology. 51 (10): 5357–5359. Bibcode:2017EnST...51.5357S. doi:10.1021/acs.est.7b01908. PMC 6260822. PMID 28475325.

Template:Donald Rumsfeld Lua error in package.lua at line 80: module 'Module:Navbox/configuration' not found.