Back to Journals » Psychology Research and Behavior Management » Volume 8

Quantifying biopsychosocial aspects in everyday contexts: an integrative methodological approach from the behavioral sciences

Authors Portell M, Anguera MT , Hernández-Mendo A, Jonsson G

Received 7 February 2015

Accepted for publication 17 March 2015

Published 5 June 2015 Volume 2015:8 Pages 153—160

DOI https://doi.org/10.2147/PRBM.S82417

Checked for plagiarism Yes

Review by Single anonymous peer review

Peer reviewer comments 2

Editor who approved publication: Dr Igor Elman



Mariona Portell,1 M Teresa Anguera,2 Antonio Hernández-Mendo,3 Gudberg K Jonsson4

1Department of Psychobiology and Methodology of Health Sciences, Universitat Autònoma de Barcelona, Cerdanyola del Vallès, Spain; 2Department of Methodology of Behavioral Sciences, University of Barcelona, Barcelona, Spain; 3Department Social Psychology, Social Anthropology, Social Work and Social Services, University of Málaga, Málaga, Spain; 4Human Behavior Laboratory, University of Iceland, Reykjavík, Iceland

Abstract: Contextual factors are crucial for evaluative research in psychology, as they provide insights into what works, for whom, in what circumstances, in what respects, and why. Studying behavior in context, however, poses numerous methodological challenges. Although a comprehensive framework for classifying methods seeking to quantify biopsychosocial aspects in everyday contexts was recently proposed, this framework does not contemplate contributions from observational methodology. The aim of this paper is to justify and propose a more general framework that includes observational methodology approaches. Our analysis is rooted in two general concepts: ecological validity and methodological complementarity. We performed a narrative review of the literature on research methods and techniques for studying daily life and describe their shared properties and requirements (collection of data in real time, on repeated occasions, and in natural settings) and classification criteria (eg, variables of interest and level of participant involvement in the data collection process). We provide several examples that illustrate why, despite their higher costs, studies of behavior and experience in everyday contexts offer insights that complement findings provided by other methodological approaches. We urge that observational methodology be included in classifications of research methods and techniques for studying everyday behavior and advocate a renewed commitment to prioritizing ecological validity in behavioral research seeking to quantify biopsychosocial aspects.

Keywords: experience sampling method, ecological momentary assessment, ambulatory assessment, observational methodology, naturalistic observation

Introduction

It would be difficult to justify a behavioral science in which researchers are more interested in asking participants to tick a box indicating how they have behaved over the past month than in observing how these people actually behave in their natural, everyday environment. Studying everyday behavior in context, however, poses numerous methodological challenges. It requires: 1) reconstructing the “who,” “what,” “how,” and “when” for events of interest; 2) positioning the results within the social network of the individuals studied; 3) evaluating the impact of these events on the individuals’ ecological niche; and 4) evaluating the persistence of a reality reconstructed from a selection of everyday moments.1

The explosion of information and communication technologies in recent decades has led to methodological innovations seeking to quantify biopsychosocial aspects in everyday context. While a general framework has been proposed for classifying these innovations alongside more traditional approaches,2 it does not include observational methodology, despite similarities in basic methodological requirements.310 The aim of this paper is to review these basic requirements and show why criteria for classifying research methods and techniques for studying daily life should be modified to include contributions from observational methodology. We present our analysis within the framework of ecological validity, a concept refined by two important authors: Egon Brunswik and Urie Bronfenbrenner. In the first section of this article, we describe the ecological validity framework within the context of our study, and in the remaining sections, we characterize the research methods identified in our narrative review, highlighting their shared methodological requirements and reviewing the criteria used in their classification. We show that observational methodology deserves to be considered alongside these methods and advocate the use of mixed-method and multi-method research strategies to capture biopsychosocial aspects in everyday contexts.

Representativeness and ecological validity

The criteria or standards used to regulate and assess the quality of psychosocial research are the subject of intense debate. However, the concept of generalization or applicability of results to other participants, concepts, and times can be found in classic evaluation systems used in both quantitative11 and qualitative research models.12

Egon Brunswik (1903–1955) was instrumental in developing the concepts of representativeness and applicability. Creator of the probabilistic functionalism theoretical framework and an innovative methodological approach he called “representative design,” Brunswik offered coherent arguments challenging the methodological dogma of the time.13,14 His representative design proposal15 challenged the established concept of experimental design, reflected, for example, in Robert S. Woodworth’s seminal work on experimental design popularly known as the Columbia Bible.13 Experimental design focused on isolating and controlling variables, but Brunswik considered that this destroyed the natural causal fabric that existed in the environment of an adapted organism. He maintained that for valid inferences to be made, an experiment had to take into account the representativeness of two sampling dimensions: the participants and the situations to which they were exposed. The now consolidated concept of ecological validity is closely related to the work of Brunswik and his representative design approach, which, though highly relevant, is seldom cited in methodology texts.16

We embrace the concept of ecological validity as defined by Urie Bronfenbrenner (1917–2005) in his ecological model, namely, the “extent to which the environment experienced by the subjects in a scientific investigation has the properties it is supposed or assumed to have by the experimenter.”17 This model questions the scant attention paid to natural environments in many realms of psychological research where context is treated only as a control factor. Bronfenbrenner was interested in interactions between the different systems present in a person’s environment (microsystem, mesosystem, exosystem, and macrosystem) and in their potential impact on the person and his/her psychological development.

Program evaluation studies adopting an ecological approach are methodologically more complex.18 Contextual factors are crucial for understanding the effectiveness of an intervention, and furthermore, it has been questioned whether or not an intervention can actually be separated from its external influences. This same question has been posed by proponents of the realistic evaluation model, in which evaluative research should be able to explain what works, for whom, in what circumstances, in what respects, and why.19,20 Such an approach places context in a central position in which the concept of mechanism (defined as the underlying processes operating in a given context to generate outcomes of interest) can shed light on the relationship between context and expected outcomes. In the following sections, we describe numerous ways of observing, recording, and analyzing these underlying mechanisms and seek to demonstrate the benefits of quantifying biopsychosocial aspects in everyday contexts from an integrative methodological approach.

Research methods and techniques for studying daily life

Mehl and Conner2 proposed the term “research methods for studying daily life” to describe methods used to study repeated, real-time, biopsychosocial aspects in their natural settings. The aim of these methods is to “capture life as it is lived,”21 and they are highly sensitive to the concepts of representativeness and ecological validity. Their growth has undoubtedly been favored by the spread of information and communication technologies. Hogarth et al22 demonstrated the applications of these research methods in a study of perceived risk and self-reported emotional states related to everyday activities. Over a period of 10 days, 74 participants received phone text messages at random moments during the day asking them different questions to assess their perception of risk regarding different activities. They were asked to state what they were doing at the time they received the message and to describe their current emotional state, the possible consequences of what they were doing, and their perceptions of severity, vulnerability, and risk. A random sample of 30 answers was selected from each participant based on the principles of representative design related to situational sampling. Although there were just 74 participants, the study generated approximately 17,700 information units that could be analyzed from an individual or group perspective.

Everyday behavior can also be investigated in Electronically Activated Recorder (EAR) studies.23 The EAR is a small portable audio device that records short fragments of sounds produced at different moments during a day. In one EAR study of conversational styles, 30 seconds of sound were recorded every 12.5 minutes for 4 days in 79 participants, resulting in 23,689 recordings.24 Data collected using this device can be coded using both social environment criteria (eg, location, activity, and interaction) and social interaction criteria (eg, content, style, and emotional expression). EAR-based studies have produced information that helps to link psychological effects to observable frequencies in daily life. The device, for example, has been used to study the relationship between extraversion and time spent alone, and also to estimate the number of words spoken a day.25 It can also be used to analyze common everyday behaviors that are very difficult to report retrospectively, such as laughing or sighing.26

Mehl and Conner2 compiled a set of methods and techniques that, despite their different names (see Table 1, first column), have a similar general purpose and share certain characteristics with traditional methods used in the social and health sciences, such as the diary method21 and designs rooted in observational methodology.310 We propose using the broad – and fitting – label used by Mehl and Conner, “research methods for studying daily life” (hereafter RMSDaLi), to refer to all such methods and techniques.

Table 1 An abridged list of research methods and techniques for studying daily life
Notes: *This column shows the literal terms used in our database searches; one sample study is provided for each type of method; accessed February 1, 2015. The number in parentheses refers to the year in which the first study of this type was published; §peer-reviewed journals only.

We performed a narrative review of the literature on research methods and techniques for studying daily life. We searched the PubMed and PsycINFO databases for articles using the search terms shown in the first column of Table 1 and the PsycINFO database for articles and chapters using the terms “observational methodology” and “observational method.” We additionally reviewed the reference lists of the articles retrieved to identify other relevant articles, chapters, and books. The search strategy generated more than 1,000 relevant articles and chapters, from which we selected the papers discussed below. As this is a narrative review, we are unable to discuss all relevant literature and have thus chosen publications that help to justify and illustrate the basic requirements of methods used to study everyday life and the rationale behind the classification criteria used.

Basic requirements of Research Methods for Studying Daily Life

The basic requirements of RMSDaLi are closely linked to the context and times at which the data are collected.4,27

The first requirement is that the data must be collected in a natural, real-world context. This favors ecological validity and permits the study of interrelations between experiences, everyday behaviors, and the setting in which these occur. In clinical settings, for example, experience-sampling techniques and ecological momentary assessment have provided new tools for studying the impact of social contact on the everyday lives of people with depression symptoms28 or anxiety disorders.29 Use of these methods during treatment can also increase understanding of how everyday life changes may promote or hinder clinical improvement.30 In the area of elite sport, observational methodology has provided innovative insights for linking critical behavior during a competition to physiological variations.3134

The second requirement of RMSDaLi is that events must be recorded as soon as possible after they occur. This is particularly important when self-report methods are used, as the longer the interval between the event and its registration, the greater the risk of retrospective (recall) bias. Ideally, an event or behavior should be recorded in real time.35 Several studies have shown how individuals perceive experiences differently depending on whether they evaluate them contemporaneously or retrospectively. Redelmeier and Kahneman36 showed how patients’ memories of pain during a colonoscopy or lithotripsy (retrospective evaluation) did not match their judgement of pain during the actual procedure (contemporaneous evaluation). Studies of perceived risk have also shown that this is higher during than after an event.22,37

Reis and Gable38 described a series of threats or biases that can affect people’s reconstruction or interpretation of events or experiences, namely, recency, salience, sense-making, and state of mind. According to the recency theory, end-of-day reports on mood are influenced by the most-recent events in the day, because, logically, these are the easiest to recall.39 Salience bias, on the other hand, refers to the fact that events that are particularly intense, emotional, unusual, or significant from a personal perspective are more memorable. Sense-making refers to people’s tendency to reinterpret their lives in the light of more recent events or to confirm implicit theories and beliefs. Finally, state of mind, or retrospections (particularly of affect and attitude) can reflect a person’s mood at the time of the report.37 These biases can be controlled for by having participants report in real time, but this also has limitations, such as registration errors. It is therefore recommendable to use complementary observational techniques to study behaviors such as smoking that can be observed by others (hetero-observation).40

A third requirement of RMSDaLi is that information should be recorded over a period of time, following a strategy known as “intensive repeated measures.”41 Such an approach is crucial for studying within individual processes. Intensive recording across time offers a wealth of opportunities to study microprocesses, eg, interrelationships between cognitive, affective, behavioral, and physiological variables for short intervals of time in daily life.27,4244 It has been established that behavior is made up of patterns that occur over time,45 and it would therefore seem only logical to use research designs that can help to uncover these patterns by describing observable moment-by-moment changes.4652 In the clinical setting, for example, observational recording of behavior in everyday contexts, combined with the analysis of temporal patterns, has uncovered relationships between recurrent disruptive behaviors, physiological variables, and environmental factors that are undetectable with other methodological approaches.53

A fourth aspect that influences the validity of RMSDaLi is how the data collection times are selected.22 The minimum requirement is that data should be collected systematically, taking into account: 1) the study objectives, 2) the distribution of the target behaviors over time, 3) susceptibility to retrospection bias, 4) participant burden (eg, time needed, extent to which the protocol interferes with intimacy), and 5) expected adherence to protocol (eg, activation of recording device).

A range of protocols have been proposed to select data-collection times,38,40,54,55 and these can be simplified into three broad schemas: continuous monitoring, time-based monitoring, and event-based monitoring. The first schema, continuous monitoring of the event of interest during the study period, is particularly applicable to portable technology used to record physiological variables or observable experiences (eg, heart rate, movement, or extralinguistic behavior). The second schema is time-based monitoring with fixed or variable schedules. An example of a fixed timing schedule would be a system to measure blood pressure every 4 hours over a week. In a variable timing schedule, the researchers decide on a number of samples that must be obtained over a given period (eg, three samples from a working day). In this case, the moment of sampling is selected randomly or pseudo-randomly. Well-known examples can be found in the studies compiled by Hektner et al,56 that built representative samples, at the individual level, of everyday life experiences, such as happiness. In the third schema, event-based monitoring, recording starts on detection of a clearly distinguishable event. In a study on anxiety, for example, participants would be asked to answer a short questionnaire whenever they have a panic attack. Finally, in the case of observational designs it is necessary to specify the protocols used to select both within-session and between-session recording moments.4,7,10

Classification criteria

We have adapted the taxonomy proposed by Conner and Lehman57 to classify the methodological approaches used to quantify biopsychosocial aspects in everyday contexts, with the addition of observational methodology designs. This original taxonomy is based on two dimensions: measurement variable and participant involvement. The first dimension refers to variables that are to be measured, namely experiences (eg, pain), behaviors (actions that are observable to others, such as eating), physiology (internal workings of the human body, such as blood pressure), or a combination of these. The second dimension reflects the level of participant involvement in the data collection process. Conner and Lehman distinguished between active and passive methods, where active refers to participants providing measurements through self-reporting or other voluntary actions (eg, saliva sample), and passive refers to situations in which measurements are provided via a device that does not require any action by the participants, apart from wearing or carrying the device. We have extended this definition to include intensive measurements with minimally invasive devices, such as those used in observational methodology410,58 (Table 2, second row).

Table 2 Classification of research methods and techniques for studying daily life by type of variable and level of participation
Note: *Optimal observational methodology profile shown cells [2,1] and [2,2].

Hetero-observation techniques offer several advantages over self-reporting methods: 1) they do not require participants to interrupt an activity to report something, thereby preserving spontaneity; 2) they are suitable for studying forms of everyday behavior that may go unnoticed by the participant or are prone to distortion (eg, sighing); 3) they place a lower burden on the participant; and 4) they are suitable for studying animals or people who cannot provide verbal reports (eg, infants). One limitation of these methods, however, is reactivity (ie, variations in behavior when a person knows he or she is being observed). That said, studies of the EAR, for example, have shown that carriers of this audio device become used to it within hours and that it is less intrusive than methods requiring active participation.19

The features of an ideal observational methodology profile are shown within dotted lines in Table 2. In such a case, the quantification process must be independent of the nature of what is being studied, whether this is a perceivable behavior, a text, an object, or a vocalization. The process has four key components:

  1. Choice of appropriate observational design (of which there are eight);7,10,59
  2. Use of an observation instrument (usually purpose-designed) that is perfectly adapted to the context in order to preserve the ecological validity of the data recorded;60
  3. Use of recording software,61,62 such as HOISAN,63 SOF-CODER,50 and LINCE,64 to produce coded data that are amenable to strict quality controls to demonstrate the reliability of the data;
  4. Analysis of data using appropriate methods, adapted to the design of the study.65,66

Conclusion: toward methodological complementarity for studying daily life

This paper proposes a general framework for integrating different methods and techniques for quantifying biopsychosocial aspects in everyday contexts, and it reviews their shared properties and requirements. We consider that building a bridge between methods is a prerequisite for designing tools that will facilitate the systematic analysis of the knowledge generated.

The methods reviewed in this article can provide empirical evidence to help answer questions that can only be answered by studying life while it is being lived (eg, are people who live in the present happier?).67 Ideally, RMSDaLi should be capable of capturing real-time data over time in a natural, everyday setting. Thanks to advances in information and communication technologies, these methods have gained prominence in recent years, albeit under different names. They are, however, costly to implement, and their use must be justified by the research question being addressed.21 Likewise, their omission from studies of everyday life must also be justified, and this is generally not done.

We should stress that we are not suggesting that RMSDaLi become the gold standard. A retrospective self-report design (eg, how much pain did I feel during a medical procedure) and a simultaneous self-report design (eg, how much pain am I feeling now), for example, will capture different aspects of the same experience and produce different predictors of behavior, as will an approach based on simultaneous self-reporting (how much physical activity am I doing now) versus one based on passive measurement (eg, data collected by a pedometer).68 Similarly, in a given study, it may be equally interesting to measure observable risk-taking by a worker and assess worker perceptions of risk, as both approaches can provide complementary information.69

The bridge that this paper proposes between observational methodology and innovative solutions such as EAR for studying daily life falls within the broader context of methodological complementarity. We strongly advocate the use of complementary methods to address major questions that arise in psychology.7,9,10 We are specifically referring to mixed methods (complementary use of qualitative and quantitative approaches) and multi-methods (complementary use of different methods, such as observational methodology and selective designs).70

The above examples illustrate the need for methodological complementarity and the need to adapt methodology to research questions. If we set out to quantify behavior by blindly opting for a well-established method that is a priori considered to be superior, we risk overlooking the virtues of methods whose goal is to preserve ecological validity, and this, combined with the additional cost of such methods, could lead to the start of their demise.71,72 It would be interesting for future research to explore this idea in greater depth and to determine just how much interest there is in the behavioral sciences in funding and publishing studies of behaviors in natural, everyday settings.

Acknowledgments

We gratefully acknowledge the support of 1) the Spanish government project ‘Observación de la interacción en deporte y actividad física: Avances técnicos y metodológicos en registros automatizados cualitativos-cuantitativos’ [Observation of the Interaction in Sport and Physical Activity: Technological and Methodological Advances in Qualitative-Quantitative Computerized Records] (Secretaría de Estado de Investigación, Desarrollo e Innovación del Ministerio de Economía y Competitividad) for the period 2012-2015 [Grant DEP2012-32124]; 2) the Generalitat de Catalunya Research Group ‘GRUP DE RECERCA E INNOVACIÓ EN DISSENYS (GRID). Tecnología i aplicació multimedia i digital als dissenys observacionals’ [Research and Innovation Group on Designs], Grant number 2014 SGR 971.

Disclosure

The authors report no conflicts of interest in this work.


References

1.

Craik KH. The lived day of an individual: A person-environment perspective. In: Walsh WB, Craik KH, Price RH, editors. Person-Environment Psychology: New Directions and Perspectives. Mahwah, NJ: Lawrence Erlbaum Associates, Inc.; 2000:233–266.

2.

Mehl MR, Conner TS. Handbook of Research Methods for Studying Daily Life. New York, NY: The Guilford Press; 2012.

3.

Anguera MT. Observational typology. Qual Quant. 1979;13(6):449–484.

4.

Anguera MT. Observational methods (general). In: Fernández-Ballesteros R, editor. Encyclopedia of Psychological Assessment, Vol 2. London, UK: SAGE Publications Ltd; 2003:632–637.

5.

Anguera MT. Microanalysis of T-patterns. Analysis of symmetry/asymmetry in social interaction. In: Anolli L, Duncan S, Magnusson MS, Riva G, editors. The Hidden Structure of Interaction. From Neurons to Culture Patterns. Amsterdam, The Netherlands: IOS Press; 2005:51–70.

6.

Anguera MT, Hernández-Mendo A. Metodología observacional y psicología del deporte: estado de la cuestión [Observational methodology and sports psychology: state of affairs]. Revista de Psicología del Deporte. 2014;23(1):103–109. Spanish.

7.

Anguera MT, Izquierdo C. Methodological approaches in human communication. From complexity of situation to data analysis. In: Riva G, Anguera MT, Wiederhold BK, Mantovani F, editors. From Communication to Presence. Cognition, Emotions and Culture towards the Ultimate Communicative Experience. Amsterdam, The Netherlands: IOS Press; 2006:207–226.

8.

Anguera MT, Santoyo Velasco C, Espinosa Arámburu MC. Evaluating links intensity in social networks in a school context through observational designs. In: García Mira R, Sabucedo Cameselle JM, Romay Martínez J, editors. Culture, Environmental Action and Sustainability. Göttingen, Germany: Hogrefe and Huber Publishers; 2013:286–298.

9.

Chacón S, Sanduvete S, Portell M, Anguera MT. Reporting a program evaluation: needs, program plan, intervention, and decisions. Int J Clin Health Psychol. 2013;13(1):58–66.

10.

Sánchez-Algarra P, Anguera MT. Qualitative/quantitative integration in the inductive observational study of interactive behaviour: impact of recording and coding among predominating perspectives. Qual Quant. 2013;47(2):1237–1257.

11.

Shadish WR, Cook TD, Campbell DT. Experimental and Quasi- Experimental Designs for Generalized Causal Inference. 2nd ed. Boston, MA: Houghton-Mifflin; 2002.

12.

Guba EG, Lincoln YS. Fourth Generation Evaluation. Newbury Park, CA: SAGE Publications, Inc.; 1989.

13.

Gigerenzer G. Ideas in exile: The struggles of an upright man. In: Hammond KR, Stewart TR, editors. The Essential Brunswik: Beginnings, Explications, Applications. Oxford, UK: Oxford University Press; 2001:445–452.

14.

Hogarth RM. The challenge of representative design in psychology and economics. Journal of Economic Methodology. 2005;12(2):253–263.

15.

Brunswik E. Perception and the Representative Design of Psychological Experiments. 2nd ed. Berkeley, CA: University of California Press; 1956.

16.

Dhami MK, Hertwig R, Hoffrage U. The role of representative design in an ecological approach to cognition. Psychol Bull. 2004;130(6):959–988.

17.

Bronfenbrenner U. Toward an experimental ecology of human development. Am Psychol. 1977;32(7):513–531.

18.

Torrico Linares E, Santín Vilariño C, Andrés Villas M, Menéndez Álvarez-Dardet S, López López MJ. El modelo ecológico de Bronfenbrenner como marco teórico de la psicooncología [The Bronfrenbrenner’ ecological model as theoretical framework of the psychooncology]. Anales de Psicología, 2002;18(1):45–59. Spanish.

19.

Pawson R, Greenhalgh T, Harvey G, Walshe K. Realist review – a new method of systematic review designed for complex policy interventions. J Health Serv Res Policy. 2005;10(Suppl 1):21–34.

20.

Pedersen LM, Nielsen KJ, Kines P. Realistic evaluation as a new way to design and evaluate occupational safety interventions. Saf Sci. 2012;50(1):48–54.

21.

Bolger N, Davis A, Rafaeli E. Diary methods: capturing life as it is lived. Annu Rev Psychol. 2003;54:579–616.

22.

Hogarth RM, Portell M, Cuxart A. What risks do people perceive in everyday life? A perspective gained from the experience sampling method (ESM). Risk Anal. 2007;27(6):1427–1439.

23.

Mehl MR, Pennebaker JW, Crow DM, Dabbs J, Price JH. The Electronically Activated Recorder (EAR): a device for sampling naturalistic daily activities and conversations. Behav Res Methods Instrum Comput. 2001;33(4):517–523.

24.

Mehl MR, Vazire S, Holleran SE, Clark CS. Eavesdropping on happiness: well-being is related to having less small talk and more substantive conversations. Psychol Sci. 2010;21(4):539–541.

25.

Mehl MR, Robbins ML. Naturalistic observation sampling: The Electronically Activated Recorder (EAR). In: Mehl MR, Conner TS, editors. Handbook of Research Methods for Studying Daily Life. New York, NY: The Guilford Press; 2012:176–192.

26.

Robbins ML, Mehl MR, Holleran SE, Kasle S. Naturalistically observed sighing and depression in rheumatoid arthritis patients: a preliminary study. Health Psychol. 2011;30(1):129–133.

27.

Shiffman S, Stone AA, Hufford MR. Ecological momentary assessment. Annu Rev Clin Psychol. 2008;4:1–32.

28.

Brown LH, Strauman T, Barrantes-Vidal N, Silvia, PJ, Kwapil TR. An experience-sampling study of depressive symptoms and their social context. J Nerv Ment Dis. 2011;199(6):403–409.

29.

Walz LC, Nauta MH, Aan Het Rot M. Experience sampling and ecological momentary assessment for studying the daily lives of patients with anxiety disorders: a systematic review. J Anxiety Disord. 2014;28(8):925–937.

30.

aan het Rot M, Hogenelst K, Schoevers RA. Mood disorders in everyday life: a systematic review of experience sampling and ecological momentary assessment studies. Clin Psychol Rev. 2012;32(6):510–523.

31.

Castellano J, Perea A, Alday L, Mendo AH. The measuring and observation tool in sports. Behav Res Methods. 2008;40(3):898–905.

32.

Lapresa D, Alvarez L, Arana J, Garzón B, Caballero V. Observational analysis of the offensive sequences that ended in a shot by the winning team of the 2010 UEFA Futsal Championship. J Sports Sci. 2013;31(15):1731–1739.

33.

Menescardi C, Lopez-Lopez JA, Falco C, Hernandez-Mendo A, Estevan I. Tactical aspects of a National University Taekwondo Championship in relation to round and match outcome. J Strength Cond Res. 2015;29(2):466–471.

34.

Falco C, Estevan I, Alvarez O, Morales-Sánchez V, Hernández-Mendo A. Tactical analysis of the winners’ and non-winners’ performances in a Taekwondo University Championship. Int J Sports Sci Coach. 2014;9(6):1407–1416.

35.

Schwarz N. Why researchers should think “real-time”: a cognitive rationale. In: Mehl MR, Conner TS, editors. Handbook of Research Methods for Studying Daily Life. New York, NY: The Guilford Press; 2012:22–42.

36.

Redelmeier DA, Kahneman D. Patients’ memories of painful medical treatments: real-time and retrospective evaluations of two minimally invasive procedures. Pain. 1996;66(1):3–8.

37.

Hogarth RM, Portell M, Cuxart A, Kolev GI. Emotion and reason in everyday risk perception. J Behav Decis Mak. 2011;24(2):202–222.

38.

Reis HT, Gable SL. Event-sampling and other methods for studying everyday experience. In: Reis HT, Judd CM, editors. Handbook of Research Methods in Social and Personality Psychology. New York, NY: Cambridge University Press; 2000:190–222.

39.

Stone AA, Neale JM, Shiffman S. Daily assessments of stress and coping and their association with mood. Ann Behav Med. 1993;15(1):8–16.

40.

Fahrenberg J, Myrtek M, Pawlik K, Perrez M. Ambulatory assessment – monitoring behavior in daily life settings: a behavioral-scientific challenge for psychology. Eur J Psychol Assess. 2007;23(4):206–213.

41.

Moskowitz DS, Russell JJ, Sadikaj G, Sutton R. Measuring people intensively. Canadian Psychology/Psychologie canadienne. 2009; 50(3):131–140.

42.

Casarrubea M, Jonsson GK, Faulisi F, et al. T-pattern analysis for the study of temporal structure of animal and human behavior: A comprehensive review. J Neurosci Methods. 2015;239:34–46.

43.

Cohn JF, Savette MA. Spontaneous facial expression in a small group can be automatically measured: an initial demonstration. Behav Res Methods. 2010;42(4):1079–1086.

44.

Magnusson MS. Hidden real-time patterns in intra- and inter-individual behavior: description and detection. Eur J Psychol Assess. 1996;12(2):112–123.

45.

Eibl-Eibesfeldt I. Ethology. The Biology of Behavior. New York, NY. Holt, Rinehart and Winston, Inc.; 1970.

46.

Blanchet A, Batt M, Trognon A, Masse L. Language and behavior patterns in a therapeutic interaction sequence. In: Anolli L, Duncan S, Magnusson MS, Riva G, editors. The Hidden Structure of Interaction. From Neurons to Culture Patterns. Amsterdam, The Netherlands: IOS Press; 2005:123–139.

47.

Castañer M, Torrents C, Anguera MT, Dinušová M, Jonsson GK. Identifying and analyzing motor skill responses in body movement and dance. Behav Res Methods. 2009;41(3):857–867.

48.

Fernandez J, Camerino O, Anguera MT, Jonsson GK. Identifying and analyzing the construction and effectiveness of offensive plays in basketball by using systematic observation. Behav Res Methods. 2009;41(3):719–730.

49.

Haynal-Reymond V, Jonsson GK, Magnusson MS. Non-verbal communication in doctor–suicidal patient interview. In: Anolli L, Duncan S, Magnusson MS, Riva G, editors. The Hidden Structure of Interaction. From Neurons to Culture Patterns. Amsterdam, The Netherlands: IOS Press; 2005:141–148.

50.

Jonsson GK, Anguera MT, Blanco-Villaseñor A, et al. Hidden patterns of play interaction in soccer using SOF-CODER. Behav Res Methods. 2006;38(3):372–381.

51.

Jonsson GK, Anguera MT, Sánchez-Algarra P, et al. Application of T-Pattern detection and analysis in sports research. Open Sports Sci J. 2010;3:95–104.

52.

Kerepesi A, Jonsson GK, Miklósi A, Topál J, Csányi V, Magnusson MS. Detection of temporal patterns in dog-human interaction. Behav Processes. 2005;70(1):69–79.

53.

Kemp AS, Fillmore PT, Lenjavi MR, et al. Temporal patterns of self-injurious behavior correlate with stress hormone levels in the developmentally disabled. Psychiatry Res. 2008;157(1–3):181–189.

54.

Altmann J. Observational study of behavior: sampling methods. Behaviour. 1974;49(3):227–267.

55.

Quera V. Muestreo y registro observacional [Observational sampling and recording]. In: Anguera MT, editor. Metodología Observacional en la Investigación Psicológica. Barcelona, Spain: Promociones y Publicaciones Universitarias; 1993:241–329. Spanish.

56.

Hektner JM, Schmidt JA, Csikszentmihalyi M. Experience Sampling Method: Measuring the Quality of Everyday Life. Thousand Oaks, CA: SAGE Publications, Inc.; 2007.

57.

Conner TS, Lehman BJ. Getting started: launching a study in daily life. In: Mehl MR, Conner TS, editors. Handbook of Research Methods for Studying Daily Life. New York, NY: The Guilford Press; 2012:89–107.

58.

Neumuth T, Kaschek B, Neumuth D, et al. An observation support system with an adaptive ontology-driven user interface for the modeling of complex behaviors during surgical interventions. Behav Res Methods. 2010;42(4):1049–1058.

59.

Anguera MT, Blanco-Vilaseñor A, Losada JL. Diseños observacionales, cuestión clave en el proceso de la metodología observacional [Observational designs: a key in the process of observational methodology]. Metodología de las Ciencias del Comportamiento. 2001;3(2):135–160. Spanish.

60.

Anguera MT, Magnusson MS, Jonsson GK. Instrumentos no estándar: planteamiento, desarrollo y posibilidades [Non-standard instruments: approach, development and possibilities]. Avances en Medición. 2007;5(1):63–82. Spanish.

61.

Hernández-Mendo A, Anguera MT, Rivera MA. Software for recording observational files. Behav Res Methods Instrum Comput. 2000;32(3):436–445.

62.

Hernández-Mendo A, Castellano J, Camerino O, et al. Programas informáticos de registro, control de calidad del dato, y análisis de datos [Observational software, data quality control and data analysis]. Revista de Psicología del Deporte. 2014;23(1):111–121. Spanish.

63.

Hernández-Mendo A, López-López JA, Castellano J, Morales-Sánchez V, Pastrana JL. Hoisan 1.2: Programa informático para uso en metodología observacional [Hoisan 1.2: Program for use in observacional methodology]. Cuadernos de Psicología del Deporte. 2012;12(1):55–78. Spanish.

64.

Gabín B, Camerino O, Anguera MT, Castañer M. Lince: multiplatform sport analysis software. Procedia Soc Behav Sci. 2012;46:4692–4694.

65.

Anguera MT, Hernández-Mendo A. Técnicas de análisis en estudios observacionales en ciencias del deporte [Data analysis techniques in observational studies in sport sciences]. Cuadernos de Psicología del Deporte. 2015;15(1):13–30. Spanish.

66.

Blanco-Vilaseñor A, Losada JL, Anguera MT. Data analysis techniques in observational designs applied to the environment-behaviour relation. Medio Ambient Comport Hum. 2003;4(2):111–126.

67.

Killingsworth MA, Gilbert DT. A wandering mind is an unhappy mind. Science. 2010;330(6006):932.

68.

Adamo KB, Prince SA, Tricco AC, Connor-Gorber S, Tremblay M. A comparison of indirect versus direct measures for assessing physical activity in the pediatric population: A systematic review. Int J Pediatr Obes. 2009;4(1):2–27.

69.

Takala EP, Pehkonen I, Forsman M, et al. Systematic evaluation of observational methods assessing biomechanical exposures at work. Scand J Work Environ Health. 2010;36(1):3–24.

70.

Anguera MT, Camerino O, Castañer M. Mixed methods procedures and designs for research on sport, physical education and dance. In: Camerino O, Castañer M, Anguera MT, editors. Mixed Methods Research in the Movement Sciences: Case Studies in Sport, Physical Education and Dance. Abingdon, UK: Routledge; 2012:3–27.

71.

Baumeister RF, Vohs, KD, Funder DC. Psychology as the science of self-reports and finger movements: whatever happened to actual behavior? Perspect Psychol Sci. 2007;2(4):396–403.

72.

Patterson ML. Back to social behavior: mining the mundane. Basic Appl Soc Psych. 2008;30(2):93–101.

Creative Commons License © 2015 The Author(s). This work is published and licensed by Dove Medical Press Limited. The full terms of this license are available at https://www.dovepress.com/terms.php and incorporate the Creative Commons Attribution - Non Commercial (unported, v3.0) License. By accessing the work you hereby accept the Terms. Non-commercial uses of the work are permitted without any further permission from Dove Medical Press Limited, provided the work is properly attributed. For permission for commercial use of this work, please see paragraphs 4.2 and 5 of our Terms.