Share
My Biggest Research Mistake
Adventures and Misadventures in Psychological Research
Edited by:
March 2019 | 256 pages | SAGE Publications, Inc
My Biggest Research Mistake helps students and professionals in the field of psychological science learn from the diverse mistakes of successful psychological scientists. Through 57 personal stories drawn from the experiences of fellows in the Association for Psychological Science (APS), editor Robert J. Sternberg presents the mistakes of experts in the field as opportunities for learning, allowing students to avoid making the same mistakes in their own work.
Preface
Acknowledgments
Robert J. Sternberg
1. Introduction: How I Learned from Mistakes
I. Failure in conceptualizing research
Nick Haslam
2. Grandiosity and Overambition
Harry P. Bahrick
3. Separating Data-Based From Non-Data-Based Evaluations
Judy S. Deloache
4. Too Clever by Half
Barbara Finlay
5. Death is Not the Answer
E. Tory Higgins
6. Thinking More Is More When Less Is More
Ying-yi Hong
7. Manipulation Checks Can Ruin Your Study
Jerome Kagan
8. Beware of Popular Premises
Saul M. Kassin
9. The Need for Blind Testing
John F. Kihlstrom
10. Finding Implicit Memory in Posthypnotic Amnesia
Joachim I. Krueger and Johannes Ullrich
11. Social Coordination in the Wild
Barbara C. Malt
12. Data Distress
David Matsumoto and Hyisung C. Hwang
13. A Big Mistake in Interpreting Cultural Differences
Richard McCarty
14. In Praise of Pilot Studies
Nora S. Newcombe
15. Start Strong, Plan Ahead
Howard C. Nusbaum
16. A Mistake in Studying the Role of Sleep in Speech
Lisa S. Onken
17. Short-Term Gains, Long-Term Impasse
Richard E. Petty
18. Be as Careful After Your Study Is Run as You Are Before
Paul Slovic
19. Lessons Learned From a Failed Experiment
Laurence Steinberg
20. Raging Hormones
Robert J. Sternberg
21. A Failure in Fidelity of Experimental Treatments
Peter Suedfeld
22. Stumbling in the Dark
Rebecca Treiman
23. Pilot, Pilot, Pilot
Ovid J. L. Tzeng
24. Failure to Recognize Surface Differences Doesn’t Necessarily Imply Underlying Processing Differences
Bernard Weiner
25. Farfel Flees From His Feast
II. Prematurely jumping to conclusions
Eva L. Baker
26. Jumping to the Wrong Conclusion: A Lesson About People and Learning
III. Following a garden path
Maya Bar-Hillel
27. Why Didn’t I See It Earlier?
Charlotte J. Patterson
28. Losing Time
IV. Using measures of dubious reliability/validity
David M. Buss
29. Virginity in Mate Selection
Robert A. Baron
30. New Fields, New Errors: Breaking Rules Every Researcher Should Know
Linda M. Bartoshuk and Derek J. Snyder
31. How Do We Compare Sensory or Hedonic Intensities Across Groups?
Larry E. Beutler and Samarea Lenore.
32. Science Marches on Its Measures
C. J. Brainerd
33. Reliability Is Not Readiness
Gary P. Latham
34. The Importance of Being There
Frank C. Worrell
35. Failure to Conduct a Pilot Study
V. Carelessness
Daniel R. Ilgen
36. Small Change—Big Mistake: Check and Check Again
Reinhold Kliegl
37. Losing My Dissertation Data
Mitchell J. Prinstein
38. Peers, Procedures, and Panic: A Careless Error That Offered a Lifetime of Benefits
Nancy L. Segal
39. Multiple Missteps: The Twin Study That Should Have Been
June Price Tangney
40. Always Late: Causes and Consequences Far and Wide
Thomas S. Wallsten, Gal Zauberman, and Dan Ariely
41. When Results Are Too Good to be True, They Are Probably Not True
VI. Overrelying on others
Mary Hegarty
42. Of Course Our Program Is Error-Free—Not!
Julie T. Fitness
43. Hiring a Woman to Do a Man’s Job: The Perils of Equal Opportunity Employment When Running (Ruining) Social Psychological Experiments
Regina F. Frey and Mark A. McDaniel
44. The Case of the Enterprising Instructor
VII. Error in statistical analysis
Donald J. Foss
45. Self-Help Can Be No Help at All: Some Unambiguous Advice
Isabel Gauthier
46. A Third-Variable Problem in Face Recognition
VIII. Generalizability of findings
J. Lawrence Aber
47. Not Establishing the Cross-cultural Validity of Measures of Key Constructs in a High-Stakes Field Experiment
Karen E. Adolph
48. Ecological Validity: Mistaking the Lab for Real life
David H. Barlow
49. A Major Error in the Evaluation of Psychological Treatments for Anxiety
IX. Failure to understand the “system”
Stephen J. Ceci
50. Mistakes Were Made (But Not by Me)
Klaus Fiedler
51. A Missed Opportunity to Improve on Credibility Analysis in Criminal law
Jack M. Fletcher
52. The Importance of Professional Discourse
Richard M. Lerner and Jun Wang
53. “Nem di Gelt?” or Can Accepting Grant Awards Be a Bad Thing?
David B. Pisoni
54. Keep Your Friends Close But Your Enemies Closer: With Whom Should You Share Your Creative Ideas?
Jonathan A. Plucker
55. Walking Ethical Tightropes in Research Collaborations
X. Societal costs outweigh societal benefits
James C. Kaufman
56. The Danger of Superficial Success
Robert J. Sternberg
57. Kinds of Research Mistakes
Index
