The Honest Hypocrite: Simulating the winner of the 2015 Superbowl

  • Subscribe to our RSS feed.
  • Twitter
  • StumbleUpon
  • Reddit
  • Facebook
  • Digg

Thursday, 8 July 2010

Psychological studies skewed by WEIRDness

Posted on 09:27 by kajal singh
At Carnegie Mellon I remember that a prerequisite for my psychology classes was to participate in a certain number of psychology experiments. We were the free subjects for the Carnegie Mellon Psychology department. Our department was not unique in this practice and Heinrich Joseph, Stephen Heine, and Ara Norenzayan from the University of British Columbia have a review paper in Behavioral and Brain Science says that the overwhelming number of psychology studies in the literature use undergraduates from the United States and Europe in their studies. The problem with that is that these undergraduates are unique in the world, typically being, Western, educated, industrialized, rich and democratic and that these WEIRDos are not representative of humanity as a whole.

The typical example of test that yields startling different results for the US and Europe vs. other countries on the world is the classic Müller-Lyer illusion where the test subject must decide which of the lines is longer, Americans and Europeans typically think that the line with the arrows pointing out is shorter, but this is not a typical answer around the world. The chart below shows the increased length of the "short" line required to make the lines seem similar. People in industrialized nations (to the right on the chart below) show the most effect.


The review paper discusses a wide range of psychology experiments designed to explore the free-rider problem and punishment from economics, through language development and family based reasoning (clumped by function - notebook-pencil) vs. rule based reasoning (notebook-magazine), to other social psychology problems.

The authors conclusions include that generalizing experimental results from WEIRD test subjects to the world population as a whole may yield very incorrect generalizations.


In the open peer commentary to the paper (found at the end of the paper at this .pdf link), other psychology researchers propose other reasons and commentary for and on the presumed outlier nature of WEIRD subjects in psychology experiments vs. the rest of the world. Some highlights are briefly listed below.

  • One group proposes that the experiments are weird, not the subjects.

  • Another suggests the variations within populations are not taken into account correctly.

  • Some argue that brain scientists are just as guilty as psychologists in using WEIRD subjects, and that generalizing results from a narrow sample of WEIRD brain subjects to the entire species is also unwise.

  • Many provide suggestions in reaching a wider sample pool. Although the one suggestion to use the Internet will then select for a worldwide population with access to the Internet - that may also be an unusual population The authors address this in their response to the commentary.

  • Others caution against generalization in animal studies and coin their own acronymical description of chimpanzees in animal experiments: Barren, Institutional, Zoo, And other Rare Rearing Environments (BIZARRE) chimpanzees. This is only one of several acronyms coined in the commentary (WRONG - When Researchers Overlook uNderlying Genotypes, ODD - Observation- and Description-Deprived psychological research)

  • Some point out that it is not just the subjects, but there are also too many WEIRD researchers.

  • One points out that the WEIRD subjects are a harbinger of what the world is becoming and wants more research on all of the variations in human experience before we become culturally homogenized. One of the more hopeful comments I thought, though it implies a trade-off between prosperity and diversity.
I suggest that you read the review and the back and forth commentary if this peaks your interest. The take home lesson appears to be that you need to be aware of the selection of your sample subjects in social, psychological and cultural experiments, using caution when reasoning from a narrow sample to the larger population (or species) and do not assume that everyone (in the world, in your culture, in the same room as you) are all the same, except when they are.

(via Science, a .pdf link of the Science review, the paper in .pdf format is at this link, )

Email ThisBlogThis!Share to XShare to Facebook
Posted in psychology | No comments
Newer Post Older Post Home

0 comments:

Post a Comment

Subscribe to: Post Comments (Atom)

Popular Posts

  • Captains of the Axiom from WALL-E
    Captain Reardon 2105-2248 143 years Captain Fee 2248-2379 131 years Captain Thompson 2380-2520 140 years Captain Brace 2521-26...
  • Recreating Laffer's unemployment benefits payout vs. unemployment rate chart but not his ridiculous conclusions
    Howard points to an excellent refutation of the ridiculous claims by Laffe r that unemployment benefits drive unemployment. The chart fro...
  • Snow yesterday was fluffy
    The picture of the creek was taken while the snow was still falling. There was 5" on the pathway at 5pm yesterday. Amounts ranged up t...
  • Employment-Population Ratio - a scarier way to look at unemployment
    The Bureau of labor Statistics compiles a stat called the Employment-Population Ratio that is the number of people working of the available...
  • Tradescantia Blooming
    Just when you think a flower has washed away in the floods, or burned away in the droughts, or withered due to benighted neglect, they come ...
  • Wesley Snipes fan in Delaware
    Could this person be such a fan of Wesley Snipes that they have a BLADE II license plate to commemorate their favorite movie? Is there a co...
  • Autographed hot dog buns at Tony Packo's Cafe in Toldeo
    Tony Packo's Cafe in Toledo is world famous for it's "Hungarian hot dogs", which are really just hot dogs with a deliciou...
  • Oscar Meyer Wienermobile in Wilmington today
    The Oscar Meyer Wienermobile was at the Acme at Rt202 and Rt 141  north of Wilmington today. They let us go inside it.  I like the custom Wi...
  • My new band and its debut album
    Reddit has a make your own band and first album with artwork generator much like the one that I have done before . It's been so long si...
  • Focus not on the Rapture but on loving others.
    A Roman Catholic priest gives the right answer when asked , "How does the Rapture figure into your faith?" ...Essentially all of t...

Categories

  • 80's TV shows
  • 9
  • A-team
  • accident
  • actors
  • aircraft
  • airplane
  • allium
  • alphabet
  • aluminum
  • animals
  • anniversary
  • Apollo 11
  • art
  • astronauts
  • astronomy
  • auction
  • Baltimore Orioles
  • baptisia
  • baptist
  • Baseball
  • bathroom
  • bathroom remodel
  • Battlestar galacta
  • bee
  • Bensi
  • bicycle
  • biden
  • biology
  • bird watching
  • blogs
  • Blue Heron
  • books
  • Boxing Day
  • brachiopod
  • broadband
  • BSG
  • Caddyshack
  • calendar
  • cancer
  • car
  • carriages
  • cars
  • cartoons
  • caterpillar
  • charts
  • chemistry
  • cherry trees
  • Chicago
  • chicken
  • children
  • Chrysler auto plant
  • cigar
  • cigar rolling
  • cinema
  • clouds
  • color
  • comics
  • commentary
  • coprology
  • creationist
  • croatian
  • cuba
  • cucumber
  • curling
  • curveball
  • daffodils
  • data presentation
  • Dealware
  • Delaware
  • deldot
  • DeLorean
  • design
  • Detroit Tigers
  • dinner
  • drilling
  • Dupont Country Club
  • Easter Island
  • eclipse
  • economics
  • el lector
  • electric
  • elements
  • Escanaba
  • evolution
  • experiment
  • explosion
  • face blindness
  • fantasy football
  • father's day
  • fayette
  • ferns
  • fireworks
  • flash mob
  • flashlight
  • flooding
  • flowers
  • flowrate
  • flu
  • fluid mechnics
  • fossil
  • fox
  • fragrance
  • frog
  • frost
  • fun
  • funeral
  • furniture
  • games
  • garden
  • gardening
  • generations
  • generator
  • genetics
  • Ghostbusters
  • gifts
  • glass tile
  • golf
  • government
  • graffiti
  • graph
  • graphing
  • great egret
  • greenville
  • groundhog
  • groundhog's day
  • Guerrilla Drive In
  • H1N1
  • hard drive
  • health care
  • histograms
  • history
  • home maintenance
  • horses
  • hubris
  • ideas
  • IHM
  • Immaculate Heart of Mary
  • Incredible Hulk
  • Independence day
  • internet
  • ipod touch
  • iris
  • IRS
  • joe-pie weed
  • juniper
  • junk
  • Key West
  • knowledge
  • labor
  • Lake Michigan
  • language
  • LCROSS
  • lego
  • license plate
  • lily of the valley
  • Lincoln Park Zoo
  • linguistics
  • lobster
  • logging
  • love
  • lunar eclipse
  • magnolia
  • manhole
  • maps
  • March Madness
  • marching band
  • marketing
  • math
  • measurement
  • memory
  • meta
  • meterology
  • military records
  • modeling
  • modelling
  • models
  • Monarch Butterfly
  • monster truck
  • monte carlo
  • moon
  • mosaic
  • mountain
  • mountain ash
  • mouse
  • movie
  • movies
  • museum
  • names
  • NASA
  • NASA Wallops space
  • National Park
  • NCAA Basketball
  • network
  • New Castle County
  • NFL
  • NOAA
  • nodes
  • Norristown
  • Northern Water Snake
  • Northern Water Snake.
  • obama
  • panorama
  • parenting
  • parking
  • pencil
  • pennsylvania
  • peonies
  • personality
  • philadelphia
  • phillies
  • philosophy
  • pi
  • picture
  • pictures
  • Pillsbury Doughboy
  • Pittsburgh
  • playoff
  • Point to Point
  • polar bear
  • politics
  • preparation
  • president
  • probability
  • progress
  • prosopagnosia
  • psychology
  • Quantum Leap
  • quiz
  • raccoon
  • rain
  • reader
  • refinery
  • religion
  • remodeling
  • restaurants
  • review
  • reviews
  • robotic groundhog
  • robots
  • rock
  • rocket launch
  • rotisserie
  • Sagarin
  • satellites
  • saw mill
  • scat
  • Science
  • Science Fiction
  • scifi
  • screaming yellow
  • sculpture
  • separated at birth
  • Septa
  • sf
  • shellpot creek
  • signs
  • Simpsons
  • simulations
  • slime mold
  • slug
  • snakes
  • snow
  • snow chairs
  • soccer
  • solar eclipse
  • space
  • speed test
  • spider
  • spring
  • Spring Beauty
  • stars
  • State fair
  • statistics
  • storage
  • strawberries
  • sun
  • survival
  • t-shirt
  • tableau
  • taxes economics statistics sussex delaware
  • technology
  • television
  • terminator
  • test
  • tetris
  • time
  • time travel
  • titles
  • toad lily
  • tomato
  • traffic cams
  • transpass
  • travel
  • trees
  • trivia
  • truck
  • tuba
  • Tufte
  • tulips
  • tunnel
  • turnpike
  • twitter
  • unemployment
  • university
  • UP State Fair
  • urinal
  • V
  • vaccination
  • Verizon FIOS
  • video
  • Virginia
  • visualization
  • vocabulary
  • WALL-E
  • Wallops
  • Walt Disney World
  • war on children
  • weather
  • website
  • white heron
  • wikipedia
  • wilmginton
  • Wilmington
  • wine
  • winter solstice
  • Winterthur
  • wood
  • zoo

Blog Archive

  • ►  2015 (2)
    • ►  January (2)
  • ►  2014 (77)
    • ►  December (1)
    • ►  November (1)
    • ►  September (4)
    • ►  August (9)
    • ►  July (20)
    • ►  June (14)
    • ►  May (3)
    • ►  April (8)
    • ►  March (5)
    • ►  February (5)
    • ►  January (7)
  • ►  2013 (30)
    • ►  December (3)
    • ►  November (5)
    • ►  September (3)
    • ►  August (3)
    • ►  June (2)
    • ►  May (4)
    • ►  April (3)
    • ►  March (2)
    • ►  February (4)
    • ►  January (1)
  • ►  2012 (41)
    • ►  November (5)
    • ►  October (4)
    • ►  September (3)
    • ►  August (1)
    • ►  July (4)
    • ►  June (9)
    • ►  May (3)
    • ►  April (3)
    • ►  March (4)
    • ►  February (1)
    • ►  January (4)
  • ►  2011 (82)
    • ►  December (3)
    • ►  November (4)
    • ►  October (1)
    • ►  September (5)
    • ►  August (7)
    • ►  July (4)
    • ►  June (5)
    • ►  May (8)
    • ►  April (15)
    • ►  March (9)
    • ►  February (6)
    • ►  January (15)
  • ▼  2010 (129)
    • ►  December (6)
    • ►  November (2)
    • ►  October (3)
    • ►  September (6)
    • ►  August (15)
    • ▼  July (20)
      • I PRAY2 license plate spotted in Delaware
      • 20th Anniversary Caddyshack quiz from Mental Floss
      • Sussex county tax scofflaws plotted and extended t...
      • Fascinating archeological finds left by the floodi...
      • Homegrown yellow pear and grape tomato and onion s...
      • Tomatoes
      • Who do you write like? Submit your writing sample.
      • Number unemployed vs. unemployment rate
      • Recreating Laffer's unemployment benefits payout v...
      • Overflowing Shellpot Creek video and photos from t...
      • Highest Shellpot Creek has ever been.
      • Phylogentic Trees and Language
      • More video of the raging Shellpot Creek
      • Video of Raging Shellpot Creek
      • Shellpot Creek is a raging torrent this morning
      • I missed a solar eclipse on Easter Island
      • Monster Truck on I95 in Delaware
      • Psychological studies skewed by WEIRDness
      • Modeling soccer (and perhaps your work team) as a ...
      • Fireworks from Greenville Country Club
    • ►  June (8)
    • ►  May (7)
    • ►  April (15)
    • ►  March (10)
    • ►  February (22)
    • ►  January (15)
  • ►  2009 (139)
    • ►  December (11)
    • ►  November (9)
    • ►  October (15)
    • ►  September (19)
    • ►  August (14)
    • ►  July (28)
    • ►  June (22)
    • ►  May (21)
Powered by Blogger.

About Me

kajal singh
View my complete profile