Nullius in Verba

Episode 16: Vetus Crisi Replicatio

In this episode, we continue our conversation on the replication crisis⏤Which methodological, theoretical, and practical concerns did psychologists raise half a century ago? What has changed, and what remains the same, during the current crisis? 
 
Shownotes
Orne, M. T. (1962). On the social psychology of the psychological experiment: With particular reference to demand characteristics and their implications. American Psychologist, 17(11), 776–783. https://doi.org/10.1037/h0043424
Rosenthal, R. (1966). Experimenter effects in behavioral research. Appleton-Century-Crofts.
Gergen, K. J. (1973). Social psychology as history. Journal of Personality and Social Psychology, 26, 309–320. https://doi.org/10.1037/h0034436
Koole, S. L., & Lakens, D. (2012). Rewarding replications: A sure and simple way to improve psychological science. Perspectives on Psychological Science, 7(6), 608–614. https://doi.org/10.1177/1745691612462586
Greenwald, A. G. (Ed.). (1976). An editorial. Journal of Personality and Social Psychology, 33(1), 1–7. https://doi.org/10.1037/h0078635
Ring, K. (1967). Experimental social psychology: Some sober questions about some frivolous values. Journal of Experimental Social Psychology.
Ledgerwood, A., & Sherman, J. W. (2012). Short, sweet, and problematic? The rise of the short report in psychological science. Perspectives on Psychological Science, 7(1), 60–66.
Barber, T. X. (1976). Pitfalls in Human Research: Ten Pivotal Points. Pergamon Press.
Dunnette, M. D. (1966). Fads, fashions, and folderol in psychology. American Psychologist, 21(4), 343–352. https://doi.org/10.1037/h0023535
Babbage, C. (1830). Reflections on the Decline of Science in England: And on Some of Its Causes. B. Fellowes.
 

Prologus 16: Investigator Data Analysis Effect (T. X. Barber)

Reading of the chapter "Investigator Data Analysis Effect" from the book:
Barber, T. X. (1976). Pitfalls in Human Research: Ten Pivotal Points. Pergamon Press.

Episode 15: Novum Crisi Replicati

In this episode, we discuss the replication crisis in psychology which has been an important topic of discussion for the last decade. We revisit some key events from the start of the replication crisis, such as the publication of Daryl Bem's studies on precognition, the paper False Positive Psychology, and the Reproducibility Project and share personal anecdotes about how it was to live through the replication crisis.
 
Shownotes: 
Bem, D. J. (2011). Feeling the future: Experimental evidence for anomalous retroactive influences on cognition and affect. Journal of Personality and Social Psychology, 100(3), 407–425. https://doi.org/10.1037/a0021524
Ritchie, S. J., Wiseman, R., & French, C. C. (2012). Failing the Future: Three Unsuccessful Attempts to Replicate Bem’s ‘Retroactive Facilitation of Recall’ Effect. PLOS ONE, 7(3), Article e33423. https://doi.org/10.1371/journal.pone.0033423
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011). False-Positive Psychology: Undisclosed Flexibility in Data Collection and Analysis Allows Presenting Anything as Significant. Psychological Science, 22(11), 1359–1366. https://doi.org/10.1177/0956797611417632
John, L. K., Loewenstein, G., & Prelec, D. (2012). Measuring the prevalence of questionable research practices with incentives for truth telling. Psychological Science, 23(5), 524–532. https://doi.org/10.1177/0956797611430953
Fiedler, K., & Schwarz, N. (2016). Questionable Research Practices Revisited. Social Psychological and Personality Science, 7(1), 45–52. https://doi.org/10.1177/1948550615612150
NOTE: Daniel says in the podcast the paper below is by Fiedler and Strack - but it is by Fiedler and Schwarz.
Ebersole, C. R., Mathur, M. B., Baranski, E., Bart-Plange, D.-J., Buttrick, N. R., Chartier, C. R., Corker, K. S., Corley, M., Hartshorne, J. K., IJzerman, H., Lazarević, L. B., Rabagliati, H., Ropovik, I., Aczel, B., Aeschbach, L. F., Andrighetto, L., Arnal, J. D., Arrow, H., Babincak, P., …
Nosek, B. A. (2020). Many Labs 5: Testing Pre-Data-Collection Peer Review as an Intervention to Increase Replicability. Advances in Methods and Practices in Psychological Science. https://doi.org/10.1177/2515245920958687
Luttrell, A., Petty, R. E., & Xu, M. (2017). Replicating and fixing failed replications: The case of need for cognition and argument quality. Journal of Experimental Social Psychology, 69, 178–183. https://doi.org/10.1016/j.jesp.2016.09.006
Simons, D. J., Shoda, Y., & Lindsay, D. S. (2017). Constraints on Generality (COG): A Proposed Addition to All Empirical Papers. Perspectives on Psychological Science, 12(6), 1123–1128. https://doi.org/10.1177/1745691617708630
Simonsohn, U. (2015). Small Telescopes Detectability and the Evaluation of Replication Results. Psychological Science, 26(5), 559–569. https://doi.org/10.1177/0956797614567341
 

Episode 14: Capax Mentis

In this episode we reflect on the role of intelligence in scientist. How much does intelligence matter in science, and which other characteristics might play a role in doing good science? Do scientist need to be extremely intelligent or can anyone do science? And what is the role of stupidity in science? 
Capax Mentis roughly translates to "capacity of mind."
Smriti stupidly messed up her audio so the quality isn't great. Apologies! 
 
Shownotes
Schwartz, M. A. (2008). The importance of stupidity in scientific research. Journal of Cell Science, 121(11), 1771. https://doi.org/10.1242/jcs.033340
Bernal, J. D. (1939). The Social Function Of Science. Routledge.
Paul Medawar: Advice to a Young Scientist 
Feynman talking about the uncomfortable feeling of confusion  
A good scientist always keeps learning – Nobel Laureate Peter Doherty 
Flatland (1884) by Edwin Abbott Abbott 
A zero-order correlation simply refers to the correlation between two variables (i.e., the independent and dependent variable) without controlling for the influence of any other variables. Essentially, this means that a zero-order correlation is the same thing as a Pearson correlation.

Prologus 14: How can I tell if I am cut out to be a scientific research worker? (P. B. Medawar)

As prologue to the next episode on how smart one needs to be to be a scientist, we present a reading of chapter 2 "How can I tell if I am cut out to be a scientific research worker?" by Peter B. Medawar from his 1979 book 'Advice to a young scientist'. Our next episode was inspired by the section "Am I brainy enough to be a scientist?"
https://www.google.nl/books/edition/Advice_To_A_Young_Scientist/3fg3DgAAQBAJ

Episode 13: Chmess

In this episode we discuss Daniel Dennett's distinction between chess, or research worth doing, and 'chmess,'  research not worth doing. We discuss ways to determine whether our research is chess or chmess, and how to avoid being sucked into lines of research we don't particularly care about. 
 
Shownotes
Dennett, D. C. (2006). Higher-order truths about chmess. Topoi, 25, 39–41.
Dunnette, M. D. (1966). Fads, fashions, and folderol in psychology. American Psychologist, 21(4), 343.
Folderol means 'a useless ornament or accessory', and is used to indicate something is 'nonsense'. 
Dweck, C. S. (2022). Mindsets: From bathtubs to hot beliefs to social change. In Kassin, S. (Ed.) Pillars of Social Psychology: Stories and Retrospectives, 213–219. Cambridge University Press. 
The Kardashian Index
 
 

Prologus 13: Chmess (D. C. Dennett)

As prologue to the next episode on Chmess, we present a reading of a paper by Daniel C. Dennett: 
Dennett, D. C. (2006). Higher-order truths about chmess. Topoi, 25, 39–41.

Episode 12: Virtutes Vocationalis

In today's episode, we discuss vocational virtues⸺scientific principles that should guide the behavior of scientists. We discuss whether we agree with values put forth by numerous scientists, including Ivan Pavlov, Peter Medawar, Santiago Ramón y Cajal, Barry Schwartz, among others, and share our own. 
 
Correction: At 56:24, Smriti mentions the book This is Biology, which is written by Ernst Mayr, not E.O. Wilson. 
 
Shownotes
Pavlov, I. (1936). Bequest of Pavlov to the Academic Youth of His Country. Science, 83(2155), 369–370. https://doi.org/10.1126/science.83.2155.369
Schwartz, B. (2022). Science, scholarship, and intellectual virtues: A guide to what higher education should be like. Journal of Moral Education, 51(1), 61-72.
Robert T. Pennock: An Instinct for Truth: Curiosity and the Moral Character of Science
Merton, R. K. (1942). A Note on Science and Democracy. Journal of Legal and Political Sociology, 1, 115–126.
Schwartz, B. (1990). The creation and destruction of value. American Psychologist, 45(1), 7.
Paul Medawar: Advice to a Young Scientist 
Ernst Mayr. This is Biology
Santiago Ramón y Cajal: Advice for a Young Investigator
Bernal, J. D. (1939). The Social Function Of Science. Routledge. 
Weber, M. (1917/1958). Science as a Vocation. Daedalus, 87(1), 111–134.
E.O. Wilson: Letters to a Young Scientist

Prologus 12: Science, Scholarship, and Intellectual Virtues (B.J. Schwartz)

As prologue to the next episode on vocational virtues, we present a reading of a paper by Barry Schwartz: 
Schwartz, B. (2022). Science, scholarship, and intellectual virtues: A guide to what higher education should be like. Journal of Moral Education, 51(1), 61-72.  https://doi.org/10.1080/03057240.2020.1772211  (Published online: 19 Jun 2020)
You can read the paper here. 
An episode from Smriti's previous podcast with Paul Connor where they discussed the paper with Barry can be found here.  
 

Episode 11: Inquisitionis Vastum

In this episode, we discuss the topic of research waste. We discuss what it is it that is being wasted and whether we waste fewer scientific resources and talent through coordination, team science, and better planning. 
 
Shownotes
Bacon, New Atlantis, 1626: https://www.gutenberg.org/files/2434/2434-h/2434-h.htm 
Dennett, D. C. (2006). Higher-order truths about chmess. Topoi, 25(1–2), 39–41. https://doi.org/10.1007/s11245-006-0005-2
Chalmers, I., & Glasziou, P. (2009). Avoidable waste in the production and reporting of research evidence. The Lancet, 374(9683), 86–89.
Mao's Hundred Flowers Campaign: https://en.wikipedia.org/wiki/Hundred_Flowers_Campaign 
Glasziou, P., & Chalmers, I. (2018). Research waste is still a scandal—An essay by Paul Glasziou and Iain Chalmers. BMJ, 363, k4645. https://doi.org/10.1136/bmj.k4645
AltmanDG. The scandal of poor medical research. BMJ 1994;308:283-4. 10.1136/bmj.308.6924.283 8124111
Bernal, J. D. (1939). The Social Function Of Science. Routledge. http://archive.org/details/in.ernet.dli.2015.188098
Duckworth, A. L., & Milkman, K. L. (2022). A guide to megastudies. PNAS Nexus, 1(5), pgac214. https://doi.org/10.1093/pnasnexus/pgac214
Almaatouq, A., Griffiths, T. L., Suchow, J., Whiting, M. E., Evans, J., & Watts, D. J. (2022). Beyond Playing 20 Questions with Nature: Integrative Experiment Design in the Social and Behavioral Sciences. PsyArXiv. https://doi.org/10.31234/osf.io/anjkm