© U.-D. Reips [Homepage]

E-Mail reips@deusto.es  


Advanced Methods of Internet-Based Research: Logfile Analysis

Links to Information and Tools
Tool/Website URL
General Information
All you need http://iscience.deusto.es/archive/reips/upto2005site/ureips/all_you_need/index.html
Advanced Training Institute (ATI) http://ati.fullerton.edu
*Technical basis (a Flash-based Learning unit): FlashExp http://iscience.deusto.es/archive/vcs/flash/
Examples & Portal  
*Magic! http://wextor.org:8080/frog/88497/index.html?so=ati11
*Numbers http://iscience.eu/zahl/index.html?so=ati11
*The cup 1 http://wextor.org:8080/frog/cupmethneu/index.html?qu=ati11
*The cup 2 http://wextor.org:8080/frog/cup3/index.html?qu=ati11
*Personality statements http://wextor.org:8080/Sp1R3niess/PI_v11_egkx/index.html?so=ati11
*Rate expressions http://wextor.org:8080/Sp1R3niess/Project_II_v10tdsb/index.html?so=ati11
Poker http://wextor.org:8080/DeniseFrauendorfer/pokerinc/index.html?source=ati11
Shampoo http://wextor.org:8080/ambiv/exp2f/index.html?qu=ati11
Music experiment (Honing, Amsterdam) http://cf.hum.uva.nl/mmm/exp/index.html?qu=ati11
**iScience Server http://iscience.eu
i-Learn about Web Experiments
MESOSworld (Methodological Education for the Social Sciences, Virtual Campus Switzerland) http://www.mesosworld.ch
OLAT (Online Learning and Training) http://www.olat.uzh.ch/

IDEE (in German) http://wexlist.net/e-learning/start.cfm
Visualize (in German) http://wexlist.net/e-learning/browse.cfm
*Guidelines/Standards http://iscience.deusto.es/archive/reips/upto2005site/ureips/ati3/meth_take_home/index.html
Good resource for Web surveying: websm.org
SurveyWiz 4 (quick simple surveys) [3][2.2] http://psych.fullerton.edu/mbirnbaum/programs/surveyWiz4.htm
SurveyMonkey (many features for surveys, simple) http://www.surveymonkey.com/
Askito http://askito.deusto.es
FactorWiz (within-subjects factorial experiments) http://psych.fullerton.edu/mbirnbaum/programs/factorWiz.htm
**WEXTOR (between, within and quasi; step by step; visual; Internet research techniques and error avoidance built-in; download of: design, materials, data) NEW (2.5x): Flash content and soft validation
(2.3-2.5): Upload/hosting, data download in semicolon format (Excel/SPSS compatible), code plan, multiple site entry technique, skins, page timeout
(2.2): Copying and renaming of designs, seriousness and high hurdle techniques, participant pool
First Page 2000 (Free Webpage Editor) http://www.evrsoft.com/1stpage2.shtml
KompoZer (Free Webpage Editor) http://kompozer.net/download.php
ImageJ http://rsb.info.nih.gov/ij/index.html
GIMP (Photo Editing) http://gimp-win.sourceforge.net/stable.html
Paint.NET http://www.eecs.wsu.edu/paint.net/download.html
QuickTime Pro
Adobe Flash http://www.adobe.com/products/flash/
Open Source for Video Capture/Processing http://osswin.sourceforge.net/#video
Adobe Flash Player http://www.adobe.com/products/flashplayer/
Audacity (Sound Recording, editing) http://audacity.sourceforge.net/download/windows

*::web experiment list:: http://wexlist.net/
::web survey list:: http://wexlist.net/browse.cfm?action=browse&modus=survey
*Psychological Research on the Net list http://psych.hanover.edu/research/exponnet.html
*Web Experimental Psychology Lab http://wexlab.eu/WebExpPsyLab.html
Online Social Psychology Studies http://www.socialpsychology.org/expts.htm

Analysis & Scripts
**Scientific LogAnalyzer http://www.sclog.eu/
**Step-by-step manual for Scientific LogAnalyzer  
Example log file  
Ulf's Timer-Javascript The standard math.random function in JavaScript is not random!
MAMP Complete server installation
--> WEXTOR Tutorial http://wextor.org/wextor_docs/WEXTOR_tutorial.pdf
*--> Tips and Solutions http://wextor.org/wextor/en/Techniques_tricks.pdf

Examples (also see sites for Recruitment above)
Video study (in German) http://wextor.org:8080/phu/1/index.html?so=ati11
*--> Probability terms (demonstration of reordering lists by drag and drop) http://iscience.eu/probrank/index.html?so=ati11
15 Min Survey http://www.survey06.nonfx.net/index.html?so=ati11
Long Survey that can be interrupted http://wextor.org/survey/login.php?qu=ati11

Implicit Dissociation


Check out the following games/experiments: 1 = Alien Skin, 2 = Christmas Skin, 3 = Flower Skin, 4 = Nemo Skin, 6 = Alien Skin with simple rules and some additional effects
Dynamic Interviewing Program (DIP) talk to DIP at ICQ 153155077

Results (available after the workshop)
Slides Day 1 Workshop slides Day 1
Slides Day 2 Workshop slides Day 2

APA Style Converter http://cogsci.richmond.edu/APAconverter/main.html
*International Journal of Internet Science http://www.ijis.net

Useful Publications

--> Birnbaum, M. H., & Reips, U.-D. (2005). Behavioral research and data collection via the Internet. In R. W. Proctor and K.-P. L. Vu (Eds.), The handbook of human factors in Web design (pp. 471-492). Mahwah, New Jersey: Erlbaum. [Will soon appear in new edition as: Reips, U.-D., & Birnbaum, M. H. (in press). Behavioral research and data collection via the Internet. In R. W. Proctor and K.-P. L. Vu (Eds.), The handbook of human factors in Web design (2nd edition). Mahwah, New Jersey: Erlbaum.]

Buchanan, T., & Reips, U.-D. (2001). Platform-dependent biases in Online Research: Do Mac users really think different? In K. J. Jonas, P. Breuer, B. Schauenburg & M. Boos (Eds.), Perspectives on Internet Research: Concepts and Methods.

Dillman, D. A., & Bowker, D. K. (2001). The Web questionnaire challenge to survey methodologists. In U.-D. Reips & M. Bosnjak (Eds.), Dimensions of Internet Science (pp. 159-178). Lengerich: Pabst.

Dillman, D. A., Reips, U.-D., & Matzat, U. (2010). Advice in surveying the general public over the Internet. International Journal of Internet Science, 5, 1-4.

Frick, A., Bächtiger, M. T., & Reips, U.-D. (2001): Financial incentives, personal information and drop-out in online studies. In U.–D. Reips & M. Bosnjak (Eds.), Dimensions of Internet Science (pp. 209-219). Lengerich: Pabst. [PDF]

Göritz, A. S. (2006). Incentives in Web studies: Methodological issues and a review. International Journal of Internet Science, 1(1), 58-70.

Janetzko, D. (2008). Objectivity, reliability, and validity of search engine count estimates. International Journal of Internet Science, 3(1), 7-33.

Joinson, A. N., McKenna, K., Postmes, T., & Reips, U.-D. (Eds.). (2007). The Oxford Handbook of Internet Psychology. Oxford: Oxford University Press.

Joinson, A. N., & Reips, U.-D. (2007). Personalized salutation, power of sender and response rates to Web-based surveys. Computers in Human Behavior, 23(3), 1372-1383. [PDF]

Krantz, J. H. (2000). Tell me, what did you see? The stimulus on computers. Behavior Research Methods, Instruments, & Computers, 32, 221-229.

Krantz, J. H. (2001). Stimulus delivery on the web: What can be presented when calibration isn't possible. In U.-D. Reips & M. Bosnjak (Eds.), Dimensions of Internet Science (pp.113-130). Lengerich: Pabst.

Krantz, J. H., Ballard, J., Scher, J. (1997). Comparing the results of laboratory and World-Wide Web samples on the determinants of female attractiveness. Behavior Research Methods, Instruments, & Computers, 29, 264-269.

Krantz, J. H. & Dalal, R. (2000). Validity of Web-Based Psychological Research. In M. H. Birnbaum (Ed.), Psychological experiments on the internet (pp. 35-60). New York: Academic Press.

Krantz, J. H., & Altermatt, T. W. (2008). Using the Web for Student Research. Encouraging Undergraduate Research: Hanover College's Psychology Major. In S. F. Davis, M. Ware, R. Miller, & R. Rycek (Eds.), Promoting, Developing, and Sustaining the Undergraduate Research Experience in Psychology (pp. 185-188). Society for the Teaching of Psychology. Online at: http://teachpsych.org/resources/e-books/ur2008/ur2008.php

Krantz, J. H., & William, J. E. (2010). Using Media for Web-Based Research. In S. Gosling & J. A. Johnson (Eds.), Advanced Methods for Behavior Research on the Internet, Washington, DC: American Psychological Association.

Mangan, M., & Reips, U.-D. (2007). Sleep, sex, and the Web: Surveying the difficult-to-reach clinical population suffering from sexsomnia. Behavior Research Methods, 39, 233-236.

Peden, B. F. & Flashinski, D. P. (2004). Virtual Research Ethics: A Content Analysis of Surveys and Experiments Online. http://www.idea-group.com/downloads/excerpts/1591401526E.pdf, In E. Buchanan (Ed.), Readings in Virtual Research Ethics: Issues and Controversies (ch. 1). Hershey, PA: Information Science Pub. [PDF]

--> Reips, U.-D. (2002). Internet-based psychological experimenting: Five dos and five don'ts. Social Science Computer Review, 20 (3), 241-249. [PDF]

--> Reips, U.-D. (2002). Standards for Internet-based experimenting. Experimental Psychology, 49 (4) , 243-256. [PDF]

Reips, U.-D. (2006). Web-based methods. In M. Eid & E. Diener (Eds.), Handbook of multimethod measurement in psychology (pp. 73-85). Washington, DC: American Psychological Association.

--> Reips, U.-D. (2007). The methodology of Internet-based experiments. In A. Joinson, K. McKenna, T. Postmes, & U.-D. Reips (Eds.), The Oxford Handbook of Internet Psychology (pp. 373-390). Oxford University Press. [PDF]

--> Reips, U.-D., & Birnbaum, M. H. (in press). Behavioral research and data collection via the Internet. In R. W. Proctor and K.-P. L. Vu (Eds.), The handbook of human factors in Web design (2nd edition). Mahwah, New Jersey: Erlbaum.

Reips, U.-D., & Bosnjak, M. (Eds.)(2001). Dimensions of Internet Science. Lengerich: Pabst.

--> Reips, U.-D., & Funke, F. (2008). Interval level measurement with visual analogue scales in Internet-based research: VAS Generator. Behavior Research Methods, 40, 699–704. [PDF]

--> Reips, U.-D. & Krantz, J. (2010). Conducting true experiments on the Web. In S. Gosling & J. Johnson, Advanced Internet Methods in the Behavioral Sciences (pp. 193-216). Washington, DC: American Psychological Association.

Reips, U.-D., & Lengler, R. (2005). The Web Experiment List: A Web service for the recruitment of participants and archiving of Internet-based experiments. Behavior Research Methods, 37, 287-292. [PDF]

Reips, U.-D., & Neuhaus, C. (2002). WEXTOR: A Web-based tool for generating and visualizing experimental designs and procedures. Behavior Research Methods, Instruments, and Computers, 34, 234-240. [PDF]

Reips, U.-D., & Stieger, S. (2004). Scientific LogAnalyzer: A Web-based tool for analyses of server log files in psychological research. Behavior Research Methods, Instruments, & Computers, 36, 304-311. [PDF]

Sassenberg, K., Postmes, T., Boos, M., & Reips, U.-D. (2003). Studying the Internet: A challenge for modern psychology. Special issue of Swiss Journal of Psychology, 62(2).

--> Schmidt, W. C. (2007). Technical considerations when implementing online research. In A. Joinson, K. McKenna, T. Postmes, & U.-D. Reips (Eds.), The Oxford Handbook of Internet Psychology (pp. 461-472). Oxford: Oxford University Press.

Smyth, J. D., Dillman, D. A., Christian, L. M., & Stern, M. J. (2006). Effects of using visual design principles to group response options in web surveys. International Journal of Internet Science, 1, 6–16.

--> Stieger, S., Reips, U.-D., & Voracek, M. (2007). Forced-response in online surveys: Bias from reactance and an increase in sex-specific dropout. Journal of the American Society for Information Science and Technology, 58, 1653-1660. [HTML]

Welch, N. & Krantz, J. H. (1996). The World-Wide Web as a medium for psychoacoustical demonstrations and experiments: Experience and results. Behavior Research Methods, Instruments, & Computers, 28, 192-196.

Last change: 12.07.2010



Logo und Kopfzeile