Operationalization

In research design, especially in psychology, social sciences, life sciences and physics, operationalization or operationalisation is a process of defining the measurement of a phenomenon that is not directly measurable, though its existence is implied by other phenomena. Operationalization thus defines a fuzzy concept so as to make it clearly distinguishable, measurable, and understandable by empirical observation. In a broader sense, it defines the extension of a concept—describing what is and is not an instance of that concept. For example, in medicine, the phenomenon of health might be operationalized by one or more indicators like body mass index or tobacco smoking. As another example, in visual processing the presence of a certain object in the environment could be inferred by measuring specific features of the light it reflects. In these examples, the phenomena are difficult to directly observe and measure because they are general/abstract (as in the example of health) or they are latent (as in the example of the object). Operationalization helps infer the existence, and some elements of the extension, of the phenomena of interest by means of some observable and measurable effects they have.

An example of operationally defining "personal space". [1]

See also: Proxy (statistics)

Sometimes multiple or competing alternative operationalizations for the same phenomenon are available. Repeating the analysis with one operationalization after the other can determine whether the results are affected by different operationalizations. This is called checking robustness. If the results are (substantially) unchanged, the results are said to be robust against certain alternative operationalizations of the checked variables.

The concept of operationalization was first presented by the British physicist N. R. Campbell in his 'Physics: The Elements' (Cambridge, 1920). This concept spread to humanities and social sciences. It remains in use in physics.[2][3][4][5][6][7]

Theory

See also: Operational definition and Theoretical definition

History

Operationalization is the scientific practice of operational definition, where even the most basic concepts are defined through the operations by which we measure them. The practice originated with the philosophy of science book The Logic of Modern Physics (1927), by Percy Williams Bridgman, whose methodological position is called operationalism.[8]

Bridgman wrote that in the theory of relativity a concept like "duration" can split into multiple different concepts. In refining a physical theory, it may be discovered that what was thought to be one concept is actually two or more distinct concepts. Bridgman proposed that if only operationally defined concepts are used, this will never happen.

Bridgman's theory was criticized because "length" is measured in various ways (e.g. it's impossible to use a measuring rod to measure the distance to the Moon), so "length" logically isn't one concept but many, some concepts requiring knowledge of geometry. Each concept is to be defined by the measuring operation used. Another example is the radius of a sphere, obtaining different values depending on the way it is measured (say, in metres and in millimeters). Bridgman said the concept is defined on the measurement. So the criticism is that there are potentially infinite concepts, each defined by the methods that measured it, such as angle of sighting, day of the solar year, angular subtense of the moon, etc. which were gathered together, some astronomical observations taken over a period of thousands of years.

Operationalization

The practical 'operational definition' is generally understood as relating to the theoretical definitions that describe reality through the use of theory.

The importance of careful operationalization can perhaps be more clearly seen in the development of General Relativity. Einstein discovered that there were two operational definitions of "mass" being used by scientists: inertial, defined by applying a force and observing the acceleration, from Newton's Second Law of Motion; and gravitational, defined by putting the object on a scale or balance. Previously, no one had paid any attention to the different operations used because they always produced the same results,[9] but the key insight of Einstein was to posit the Principle of Equivalence that the two operations would always produce the same result because they were equivalent at a deep level, and work out the implications of that assumption, which is the General Theory of Relativity. Thus, a breakthrough in science was achieved by disregarding different operational definitions of scientific measurements and realizing that they both described a single theoretical concept. Einstein's disagreement with the operationalist approach was criticized by Bridgman[10] as follows: "Einstein did not carry over into his general relativity theory the lessons and insights he himself has taught us in his special theory." (p. 335).

In the social sciences

An operationalization diagram, used to illustrate obscure or ambiguous concepts in an academic paper. This particular example is tailored to use in the field of Political Science.

Operationalization is often used in the social sciences as part of the scientific method and psychometrics. Particular concerns about operationalization arise in cases that deal with complex concepts and complex stimuli (e.g., business research, software engineering) where unique threats to validity of operationalization are believed to exist.[11]

Anger example

For example, a researcher may wish to measure the concept "anger." Its presence, and the depth of the emotion, cannot be directly measured by an outside observer because anger is intangible. Rather, other measures are used by outside observers, such as facial expression, choice of vocabulary, loudness and tone of voice; after Damasio, Lesion studies.[12]

If a researcher wants to measure the depth of "anger" in various persons, the most direct operation would be to ask them a question, such as "are you angry", or "how angry are you?". This operation is problematic, however, because it depends upon the definition of the individual. Some people might be subjected to a mild annoyance, and become slightly angry, but describe themselves as "extremely angry," whereas others might be subjected to a severe provocation, and become very angry, but describe themselves as "slightly angry." In addition, in many circumstances it is impractical to ask subjects whether they are angry.

Since one of the measures of anger is loudness, the researcher can operationalize the concept of anger by measuring how loudly the subject speaks compared to his normal tone. However, this must assume that loudness is uniform measure. Some might respond verbally while other might respond physically.

Economics objections

One of the main critics of operationalism in social science argues that "the original goal was to eliminate the subjective mentalistic concepts that had dominated earlier psychological theory and to replace them with a more operationally meaningful account of human behavior. But, as in economics, the supporters ultimately ended up "turning operationalism inside out".[13] "Instead of replacing 'metaphysical' terms such as 'desire' and 'purpose'" they "used it to legitimize them by giving them operational definitions." Thus in psychology, as in economics, the initial, quite radical operationalist ideas eventually came to serve as little more than a "reassurance fetish"[14] for mainstream methodological practice."[15]

Tying to conceptual frameworks

See also: Conceptual framework

The above discussion links operationalization to measurement of concepts. Many scholars have worked to operationalize concepts like job satisfaction, prejudice, anger etc. Scale and index construction are forms of operationalization. There is not one perfect way to operationalize. For example, in the United States the concept distance driven would be operationalized as miles, whereas kilometers would be used in Europe.[16]

Operationalization is part of the empirical research process.[17] Take for example an empirical research question: Does job satisfaction influence job turnover? Both job satisfaction and job turnover need to be measured. The concepts and their relationship are important — operationalization occurs within a larger framework of concepts. When there is a large empirical research question or purpose the conceptual framework that organizes the response to the question must be operationalized before the data collection can begin. If a scholar constructs a questionnaire based on a conceptual framework, they have operationalized the framework. Most serious empirical research should involve operationalization that is transparent and linked to a conceptual framework.

To use an oversimplified example, the hypothesis Job satisfaction reduces job turnover is one way to connect (or frame) two concepts – job satisfaction and job turnover. The process of moving from the idea job satisfaction to the set of questionnaire items that form a job satisfaction scale is operationalization.

Operationalization uses a different logic when testing a formal (quantitative) hypothesis and testing working hypothesis (qualitative). For formal hypotheses the concepts are represented empirically (or operationalized) as numeric variables and tested using inferential statistics. Working hypotheses (particularly in the social and administrative sciences), on the other hand, are tested through evidence collection and the assessment of the evidence.[18] The evidence is generally collected within the context of a case study. The researcher asks - Is the evidence sufficient to 'support' the working hypothesis? Formal operationalization would specify the kinds of evidence needed to support the hypothesis as well as evidence which would "fail" to support it.[19] Robert Yin recommends developing a case study protocol as a way to specify the kinds of evidence needed during the data collection phases. He identifies six sources of evidence 1) documentation; 2) archival records; 3) interviews; 4) direct observations; 5) participant observation and 6) physical or cultural artifacts.[20]

In the field of public administration, Shields and Tajalli (2006) have identified five kinds of conceptual frameworks (working hypothesis, descriptive categories, practical ideal type, operations research, and formal hypothesis). They explain and illustrate how each of these conceptual frameworks can be operationalized. They also show how to make conceptualization and operationalization more concrete by demonstrating how to form conceptual framework tables that are tied to the literature and operationalization tables that lay out the specifics of how to operationalize the conceptual framework (measure the concepts).[21][22]

Notes

1. Antonio Damasio (1999) The Feeling of What Happens: Body and Emotion in the Making of Consciousness ch.2, p.55
2. Inguane, R., Gallego-Ayala, J., & Juízo, D. (2013). Decentralized water resources management in Mozambique: challenges of implementation at river basin level. Physics and Chemistry of the Earth, Parts A/B/C.
3. Wright, R. (2007). Statistical structures underlying quantum mechanics and social science. International Journal of Theoretical Physics, 46(8), 2026-2045.
4. Atmanspacher, H. (1994). Is the ontic/epistemic distinction sufficient to describe quantum systems exhaustively?. In Symposium on the Foundations of Modern Physics (pp. 15-32).
5. Svozil, K. (1990). The quantum coin toss-testing microphysical undecidability. Physics Letters A, 143(9), 433-437.
6. Downing, K. L. (1992). A qualitative teleological approach to cardiovascular physiology. Recent advances in qualitative physics, 329.
7. Martens, H., & de Muynck, W. M. (1990). The inaccuracy principle. Foundations of physics, 20(4), 357-380.
8. The operationalist thesis—which can be considered a variation on the positivist theme—was that all theoretical terms must be defined via the operations by which one measured them; see Crowther-Heyck, Hunter (2005), Herbert A. Simon: The Bounds of Reason in Modern America, JHU Press, p. 65.
9. Galileo (1638) Two New Sciences, particularly the Law of falling bodies
10. P.W. Bridgman, Einstein's Theories and the Operational Point of View, in: P.A. Schilpp, ed., Albert Einstein: Philosopher-Scientist, Open Court, La Salle, Ill., Cambridge University Press, 1982, Vol. 2, p. 335–354.
11. Lukyanenko, Roman; Evermann, Joerg; Parsons, Jeffrey (2014). "Instantiation Validity in IS Design Research". LNCS. 8463: 321–328.
12. Antonio Damasio (1999) The Feeling of What Happens: Body and Emotion in the Making of Consciousness ch.2
13. Green 2001 Operationism Again: What Did Bridgman Say? What Did Bridgman Need? in Theory and Psychology 11 (2001) p.49
14. Koch, Sigmund (1992) Psychology’s Bridgman vs. Bridgman’s Bridgman: An Essay in Reconstruction., in Theory and Psychology vol. 2 no. 3 (1992) p.275
15. Wade Hands (2004) "On operationalisms and economics" (December 2004)
16. Patricia M. Shields and Nandhini Rangarajan. 2013. A Playbook for Research Methods: Integrating Conceptual Frameworks and Project Management. Stillwater, OK: New Forums Press. For a detailed discussion of operationalization extending the example above see Shields & Rangarajan pp. 32 to 41.
17. Patricia M. Shields and Nandhini Rangarajan. 2013. A Playbook for Research Methods: Integrating Conceptual Frameworks and Project Management. Stillwater, OK: New Forums Press.
18. Patricia M. Shields and Nandhini Rangarajan (2013). A Playbook for Research Methods: Integrating Conceptual Frameworks and Project Management. Stillwater, OK: New Forums Press. pp. 109-158.
19. Patricia M. Shields and Nandhini Rangarajan (2013). A Playbook for Research Methods: Integrating Conceptual Frameworks and Project Management
20. Robert Yin. 1994. Case Study Research: Design and Methods. (2nd edition). Thousand Oaks, CA: Sage. pp. 63–80.
21. Shields, Patricia; Hassan Tajalli (2006). "Intermediate Theory: The Missing Link to successful Student Scholarship". Journal of Public Affairs Education. 12 (3): 313–334. doi:10.1080/15236803.2006.12001438.
22. Patricia M. Shields and Nandhini Rangarajan (2013). A Playbook for Research Methods: Integrating Conceptual Frameworks and Project Management. Stillwater, OK: New Forums Press.

Bibliography

• Bridgman, P.W. (1927). "The Logic of Modern Physics". Cite journal requires |journal= (help)