Nullius in Verba
Nullius in Verba is a podcast about science—what it is and what it could be. It is hosted by Smriti Mehta from UC Berkeley and Daniël Lakens from Eindhoven University of Technology. We draw inspiration from the book Novum Organum, written in 1620 by Francis Bacon, which laid the foundations of the modern scientific method. Our logo is an homage to the title page of Novum Organum, which depicts a galleon passing between the mythical Pillars of Hercules on either side of the Strait of Gibraltar, which have been smashed by Iberian sailors to open a new world for exploration. Just as this marks the exit from the well-charted waters of the Mediterranean into the Atlantic Ocean, Bacon hoped that empirical investigation will similarly smash the old scientific ideas and lead to a greater understanding of the natural world. The title of the podcast comes from the motto of the Royal Society, set in typeface Kepler by Robert Slimbach. Our theme song is Newton’s Cradle by Grandbrothers.
Episodes

12 hours ago
12 hours ago
A reading of:
Nisbett, R. E. (1990). The anticreativity letters: Advice from a senior tempter to a junior tempter. American Psychologist, 45(9), 1078–1082. https://doi.org/10.1037/0003-066X.45.9.1078

Friday Dec 01, 2023
Episode 22: Magisterium
Friday Dec 01, 2023
Friday Dec 01, 2023
In today’s episode, we discuss the role of mentorship in academia. What are the characteristics of a good mentor-mentee relationship? What are the qualities of good mentors and good mentees? Does mentorship play a role in the development of scientific knowledge? And could mentors and mentees benefit from couples therapy?
Note: D.I.H.C is pronounced 'dick' but this is meant to be a family-friendly podcast :)
Shownotes
https://www.psychologytoday.com/us/blog/emotional-fitness/201303/10-things-your-relationship-needs-thrive
Roberts, L. R., Tinari, C. M., & Bandlow, R. (2019). An effective doctoral student mentor wears many hats and asks many questions. International Journal of Doctoral Studies, 14, 133.
Sarabipour, S., Niemi, N. M., Burgess, S. J., Smith, C. T., Filho, A. W. B., Ibrahim, A., & Clark, K. (2023). Insights from a survey of mentorship experiences by graduate and postdoctoral researchers (p. 2023.05.05.539640). bioRxiv. https://doi.org/10.1101/2023.05.05.539640

Friday Nov 17, 2023
Episode 21: Verifica Sed Confide
Friday Nov 17, 2023
Friday Nov 17, 2023
In this episode, we discuss the role of trust in science. Why should we verify but trust other scientists? What are the prerequisites for building trust within the scientific community? Who is ultimately responsible for verifying our claims and practices that bolster those claims? And should we give personality tests to everyone who enters academia?
Shownotes
Hardwig, J. (1991). The role of trust in knowledge. The Journal of Philosophy, 88(12), 693–708.
Hendriks, F., Kienhues, D., Bromme, R. (2016). Trust in Science and the Science of Trust. In: Blöbaum, B. (eds) Trust and Communication in a Digitized World. Progress in IS. Springer, Cham. https://doi.org/10.1007/978-3-319-28059-2_8
Strand, J. F. (2023). Error tight: Exercises for lab groups to prevent research mistakes. Psychological Methods, No Pagination Specified-No Pagination Specified. https://doi.org/10.1037/met0000547
Duygu Uygun-Tunç: Trust and criticism in science, Part I: Critical rationalism instead of organized skepticism: https://uyguntunc.wordpress.com/2020/10/30/trust-and-criticism-in-science-part-i-critical-rationalism-instead-of-organized-skepticism/
Vazire, S. (2017). Quality Uncertainty Erodes Trust in Science. Collabra: Psychology, 3(1), 1. https://doi.org/10.1525/collabra.74
Wicherts, J. M. (2011). Psychology must learn a lesson from fraud case. Nature, 480(7375), Article 7375. https://doi.org/10.1038/480007a
Fricker, E. (2002). Trusting others in the sciences: A priori or empirical warrant? Studies in History and Philosophy of Science Part A, 33(2), 373–383. https://doi.org/10.1016/S0039-3681(02)00006-7

Friday Nov 10, 2023
Prologus 21: Role of Trust in Knowledge (J. Hardwig)
Friday Nov 10, 2023
Friday Nov 10, 2023
In advance of our episode Verify but Trust, a reading of John Hardwig's paper The Role of Trust in Science.
Hardwig, J. (1991). The role of trust in knowledge. The Journal of Philosophy, 88(12), 693–708.

Friday Nov 03, 2023
Episode 20: Recensio Aequalium
Friday Nov 03, 2023
Friday Nov 03, 2023
In today’s episode, we discuss the peer review process---its history, its present, and its future. How does peer review work? How long has it existed in its current form? Should reviews be open and signed? Should reviewers be paid for their hard labor? Should we just abandon the peer review process, or does it have a positive role to play?
Shownotes
Peer Community in Registered Reports: https://rr.peercommunityin.org/
Suggestion to Darwin to publish a book about pigeons instead of The Origins of Species: https://www.darwinproject.ac.uk/letter/DCP-LETT-2457A.xml
Baldwin, M. (2018). Scientific Autonomy, Public Accountability, and the Rise of “Peer Review” in the Cold War United States. Isis, 109(3), 538–558. https://doi.org/10.1086/700070
Burnham, J. C. (1990). The evolution of editorial peer review. JAMA, 263(10), 1323–1329.

Friday Oct 20, 2023
Episode 19: Quantifauxcation
Friday Oct 20, 2023
Friday Oct 20, 2023
In this episode, we discuss Quantifauxcation, described by statistician Philip Stark as “situations in which a number is, in effect, made up, and then is given credence merely because it is quantitative.” We give examples of quantifauxcation in psychology, including errors of the third kind. We spend the second half of the podcast discussing how to develop quantitative measures that are meaningful and bridge the divide between qualitative and quantitative observations.
Shownotes
Statistics textbook by Philip Stark.
Stark, P. B. (2022). Pay No attention to the model behind the curtain. Pure and Applied Geophysics, 179(11), 4121–4145. https://doi.org/10.1007/s00024-022-03137-2
Burgess, E. W. (1927). Statistics and case studies as methods of sociological research, Vol 12(3), 103-120. (Thanks to Andy Grieve!)
Nick Brown's role in pointing out flaws in the positivity ratio.
Retraction notice of the positivity ratio paper.
Blog by Tania Lombrozo on nonsensical formulas in abstracts.
Kimball, A. W. (1957). Errors of the third kind in statistical consulting. Journal of the American Statistical Association, 52(278), 133–142. https://doi.org/10.1080/01621459.1957.10501374
Type III errors: Philip Stark’s post of Deborah Mayo’s blog
Brower, D. (1949). The problem of quantification in psychological science. Psychological Review, 56(6), 325–333. https://doi.org/10.1037/h0061802
Guttman scales
Wilson, M. (2023). Constructing measures: An item response modeling approach. Taylor & Francis.
Wilson, M., Bathia, S., Morell, L., Gochyyev, P., Koo, B. W., & Smith, R. (2022). Seeking a better balance between efficiency and interpretability: Comparing the likert response format with the Guttman response format. Psychological Methods. Advance online publication. https://doi.org/10.1037/met0000462
Bhatti, H.A., Mehta, S., McNeil, R., Wilson, M. (2023). A scientific approach to assessment: Rasch measurement and the four building blocks. In X. Liu & W. Boone (Eds.), Advances in Applications of Rash Measurement in Science Education. Springer Nature.

Friday Oct 13, 2023
Prologus 19: Problem-Centering vs. Mean-Centering in Science (A. H. Maslow)
Friday Oct 13, 2023
Friday Oct 13, 2023
In preparation for a discussion on Quantifauxcation, a reading of 'Problem-Centering vs. Means-Centering in Science' by Abraham H. Maslow (1946).
Maslow, A. H. (1946). Problem-Centering vs. Means-Centering in Science. Philosophy of Science, 13(4), 326–331. https://doi.org/10.1086/286907

Friday Oct 06, 2023
Episode 18: Vitia Vocationalis
Friday Oct 06, 2023
Friday Oct 06, 2023
In today’s episode, we discuss intellectual vices. How can we tell the difference between justified confidence and unjustified arrogance? How do we deal with feelings of envy or negative comparison with other scientists? What is the difference between building one’s career and careerism? And what do we do about scientists who do not care about the truth?
Shownotes
Azrin, N. H., Holz, W., Ulrich, R., & Goldiamond, I. (1961). The control of the content of conversation through reinforcement. Journal of the Experimental Analysis of Behavior, 4, 25–30. https://doi.org/10.1901/jeab.1961.4-25
Meehl, P. E. (1967). Theory-testing in psychology and physics: A methodological paradox. Philosophy of Science, 103–115. https://doi.org/10.1086/288135
Mitroff, I. I. (1974). Norms and Counter-Norms in a Select Group of the Apollo Moon Scientists: A Case Study of the Ambivalence of Scientists. American Sociological Review, 39(4), 579–595. https://doi.org/10.2307/2094423
Susan Blackmore: https://en.wikipedia.org/wiki/Susan_Blackmore

Friday Sep 22, 2023
Episode 17: Snobismus
Friday Sep 22, 2023
Friday Sep 22, 2023
In this episode, we discuss scientific snobbery and the ways in which it affects our interactions with and perceptions of other scientists. What are the reasons for hierarchies among different disciplines, institutions, and approaches to science? What are some ways in which snobbery manifests in science? And is it snobby to not want to present scientific posters? Enjoy.
Shownotes:
Ego and Math (3Blue1Brown)
M. V. Berry; Regular and irregular motion. AIP Conf. Proc. 15 September 1978; 46 (1): 16–120. https://doi.org/10.1063/1.31417

Friday Sep 08, 2023
Episode 16: Vetus Crisi Replicatio
Friday Sep 08, 2023
Friday Sep 08, 2023
In this episode, we continue our conversation on the replication crisis⏤Which methodological, theoretical, and practical concerns did psychologists raise half a century ago? What has changed, and what remains the same, during the current crisis?
Shownotes
Orne, M. T. (1962). On the social psychology of the psychological experiment: With particular reference to demand characteristics and their implications. American Psychologist, 17(11), 776–783. https://doi.org/10.1037/h0043424
Rosenthal, R. (1966). Experimenter effects in behavioral research. Appleton-Century-Crofts.
Gergen, K. J. (1973). Social psychology as history. Journal of Personality and Social Psychology, 26, 309–320. https://doi.org/10.1037/h0034436
Koole, S. L., & Lakens, D. (2012). Rewarding replications: A sure and simple way to improve psychological science. Perspectives on Psychological Science, 7(6), 608–614. https://doi.org/10.1177/1745691612462586
Greenwald, A. G. (Ed.). (1976). An editorial. Journal of Personality and Social Psychology, 33(1), 1–7. https://doi.org/10.1037/h0078635
Ring, K. (1967). Experimental social psychology: Some sober questions about some frivolous values. Journal of Experimental Social Psychology.
Ledgerwood, A., & Sherman, J. W. (2012). Short, sweet, and problematic? The rise of the short report in psychological science. Perspectives on Psychological Science, 7(1), 60–66.
Barber, T. X. (1976). Pitfalls in Human Research: Ten Pivotal Points. Pergamon Press.
Dunnette, M. D. (1966). Fads, fashions, and folderol in psychology. American Psychologist, 21(4), 343–352. https://doi.org/10.1037/h0023535
Babbage, C. (1830). Reflections on the Decline of Science in England: And on Some of Its Causes. B. Fellowes.