Showing posts with label Harrison. Show all posts
Showing posts with label Harrison. Show all posts

Saturday, 27 November 2010

What it's all about… (I hope)

I am interested in the aesthetics of interaction, specifically visualising and facilitating behavioural change in the user’s actions for the benefit of the user. My own journey into interaction design has come through my native design discipline of Visual Communication, and it’s design outcomes of graphic design and illustration. For too long Visual Communication’s contribution to the design of better interactions has (wrongly) been at the end of the design, engineering or construction process - “doing” the aesthetic bit, the artifice. Over the Twentieth century the design outcomes of graphic design and illustration have become so “deeply ingrained in the texture of daily life that (they are) taken for granted” (Crowley, 2004). The misconception that graphic designers are merely the ‘decorationists/dictators of style’ (Laurel, 2003), or just contribute ‘added value’ (Petersen et al., 2004) belies a perceived prejudice based on its commercial service to marketing and advertising. This is unfortunate as Visual Communication’s outcomes go beyond mere decoration, and beyond subservience to consumerism. It leaves out so much of the intellectual design process, and the emotional and social contexts (Kolko, 2010, p102) that the discipline draws from, I am going to suggest a way Visual Communication can be influential earlier in the process of designing interactions.

The visual is a central communication channel in humans’ ability to communicate; together with vocal, touch and smell. Neuroscience, together with anthropology, is even beginning to shed light on understanding our ancient visual communication skills, unlocking our implicit, experiential capacity for communication (Lewis-Williams, 2004). Although the original meanings and messages contained within the earliest images of Visual Communication such as cave paintings are no longer explicitly understood, the power of the visual resonates over millennia. It is clear that the images do encapsulate meaning, we have the semiotic signifiers but what is signified is culturally lost to us. It is within that semiotic framework that is still used that modern designers now use word and image effectively to communicate. As such they have developed the visual culture of 20th and 21st century life, shaping new aesthetic forms across a variety of old and new media, and changing human behaviour as a result. This is why I am interested in using Visual Communication as an influence on designing better interactions. The aesthetic is crucial in designing for use of an interaction and is linked into usability in many ways that can not be measured. Tractinsky (2004) has gone some way to measure the effects of aesthetics on interactions, but aesthetics can only be truly understood qualitatively. I will, in this paper, suggest that this understanding can be done using a pragmatist philosophical view of aesthetics, and the visualising of a phenomenological methodology to interpret experience as directly from the viewpoint of the user as possible. In both cases I will present an argument, both theoretical and practical, on how Visual Communication can help in this. I have two main themes: the connecting of Visual Communication to HCI through a phenomenological study of ‘aesthetics of use’ to understand the phenomenon; and that Visual Communication is a facilitator for behavioural change and therefore well placed to confidently contribute to both design of interactions and ‘aesthetics of use’.
The use of a phenomenological methodology draws on Heideggerian Hermeneutics (1982)(1993), and is based upon a qualitative research framework proposed by Moustakas (1994) where the ‘phenomena’ of an experience can be revealed, which is beyond the reach of quantitative measurement. Moustakas’ framework is adapted to an interpretative phenomenological model using the guidance of van Manen’s (1990) suggestions. Within Human-Computer Interaction (HCI) research Harrison (2007) has been researching into how to qualitatively understand experience. In a pragmatic philosophical way the meaning of what is experienced is “constructed on the fly, often collaboratively, by people in specific contexts and situations, and therefore that interaction itself is an essential element in meaning construction.” (p7). This meaning construction is interpretable and is “irreducibly connected to the viewpoints, interactions, histories, and local resources available to those making sense” of the experience (p7). This HCI perspective allows for synergy with the strengths of Visual Communication, and which can provide an alternative methodology within which to study the ‘aesthetics of use’.

In the first section of this paper I will expand upon my rationale behind my argument of repositioning Visual Communication as an influence upon Interaction Design. I will expand this rationale with a review of the literature strengthening the argument for facilitation for behavioural change, and the use of phenomenology to connect Visual Communication to HCI, in order to understand actual experience of behaviour. The following sections will explain the methods I am engaging to practically create a visual phenomenological methodology, and the initial results of this visual research. Finally I will end with a discussion of the directions, strengths and weaknesses of the current approach. Future work will be discussed before reaching a conclusion.

The Phenomenological Perspective

The exploration of designing interactions within a matrix of the user’s embodied and situated personal understanding is a HCI paradigm shift “to recognizing a plurality of perspectives (…) taking into account but not adjudicating the varying and perhaps conflicting perspectives of users.” (Harrison, 2007, pp7-8). The move to a phenomenological paradigm within HCI allows for a profitable linkage with Visual Communication to support Interaction Design.

Phenomenology is both a philosophical movement and a research methodology. The former provides a theoretical framework that connects Dourish’s embodied interactions, Suchman’s situated actions, McCullough’s digital ground to a pragmatic understanding (Dewey, 1980)(Shusterman, 1992) of the aesthetics of experience. In phenomenological research there are two forms, descriptive (eidetic) and interpretive (hermeneutic). Descriptive phenomenology follows the philosophy of Edward Husserl, and hermeneutic phenomenology the philosophy of Martin Heidegger (Lopez, 2004, p727). Heidegger uses the term Dasein to describe existence in respect to our own understanding of being in the world. Our “Being grows out of the average understanding of Being in which we are always involved” (1993, p49). This is ontological as to understand Being is “itself a determination of Being” (p54). This existential understanding is a “constitution-of-Being of the being that exists”(p55) in the world, and phenomenology is a concept of method through which to study the phenomena of Being, an expressed maxim of “To the things themselves!” (p72). Phenomenology investigates the Being of Beings, on studying the ‘how’ and ‘what’ meaning of a phenomena, making known the structures of Being. This investigation is hermeneutic, and it is in hermeneutic phenomenology that proposes that all understanding is interpretive (Johnson, 2000, p143). This ontological investigation of bringing out the Being of Beings helps thematise that structure.

Phenomenological reduction of these themes of Being within a specific phenomena (e.g. an aesthetic experience) begins with the apprehension of Being, to the understanding of the uncovered themes of Being, returning back through interpreting these themes of the studied experience, to the apprehension of the Being. This is a Hermeneutic Circle of interpretation, reducing the uncovered themes of the studied phenomena to “uncover commonalities and differences” (Benner, 1994, p104) seen through the eyes of the individual, to illuminate “that would have been overlooked in a purely descriptive approach” (Lopez, 2004, p734).

This hermeneutic process is contextual to a situated, cultural and historical “meaning of being in the world” (Earle, 2010, p288) (Johnson, 2000, p144) and the interpretation is conditional on the temporality of Being (Heidegger, 1982, p17) between the apprehension of Being and the understanding of the uncovered themes of Being within a studied situation. This systematic movement within a hermeneutic circle of interpretation affords the interpreter to check for “incongruities, puzzles, and unifying repeated concerns” (Benner, 1994, p113), and leads the interpreter through a cycle of “understanding, interpretation, and critique” (p120) to “uncover naturally occurring concerns and meanings” (p112) to understand the phenomena as directly as possible - as directly as experienced. Other qualitative methods attempt to examine the peripheral limitations or delimitations that surround it. In a phenomenological study the researcher enters the research open to understand the phenomena fully through the eyes of the participant. This is to understand their behaviour within that specific experience of the phenomena.

The framework for such a phenomenological research methodology is taken from two recognised academics Moustakas (1994) and van Manen (1990). Moustakas has proposed an actual staged framework for a methodology that researchers have used. This framework can be adapted for both eidetic and hermeneutic research, but to adapt it for an interpretive phenomenological study van Manen’s guidance needs to be followed. This framework, influenced primarily from nursing literature, will be discussed later in the paper and provides an established research methodology in which to explore the aesthetic experience. In doing so Visual Communication can be repositioned away from being seen as the end “artifice” and brought back to the earlier conceptualising design stages. The methodology as used to date is a written study, where each stage of writing and rewriting within a hermeneutic circle reduces the themes to a composite synthesis of meaning. van Manen advocates the writing process and offers five ways to approach writing up of the findings: thematically, analytically, exemplificatively, exegetically, or existentially (p173). He also offers a proviso to choosing the best approach that opens the methodology up beyond a purely textual outcome. Whilst he suggests the researcher can choose a combination of the above, decided by the nature of the studied phenomena, he also practically (or pragmatically) opens this up potentially beyond the textual. He calls on the researcher to be “creative in finding approaches and procedures uniquely suited” (p163) to both a particular project and the individual researcher. This is another a profitable linkage that Visual Communication can use to support Interaction Design through connecting to HCI. A purely textual representation of a phenomenological study of an experience is only partially useful for inspiring an interaction designer understand a particular experience. Visual data is a valuable source for both understanding and inspiration, and according to Benner (1994) the “use of interpretive phenomenology for interpreting visual sources of data is not yet well developed, but visual data are central to many lines of inquiry amenable to interpretive phenomenology, particularly social practices, embodied skills, and the study of lived experience.” (p120). This was sixteen years ago and through a literature search this remains under-developed. I propose within this paper how a Visual Communication Phenomenological Methodology can be developed and using a practical pilot project how it can be visually conducted.

The HCI Perspective

Without a formal externalised, repeatable process a critique of aesthetics is not possible from a functionalist HCI perspective. HCI’s theoretical root has ‘deep philosophical incompatibilities’ (Bardzell, 2009, p2357) with understanding aesthetics. The existing paradigms that HCI traditionally has worked within have raised empirical, scientific, objective knowledge as the normative (Bertelsen & Pold, 2004) (Udsen & Jurgenson, 2005). This functionalist position of examining and analysing the effect of computer systems upon human cognitive processing (Tractinsky, 2000), hasn’t been open to anything less than systematic observation. Through this scientific functionalist approach, HCI research has lead to generalisations that translate into efficient and optimised fits between computers and humans. With its focus upon functionality and usability, traditionally HCI has seen anything to do with aesthetics as ‘inversely proportional’ to usability (Ahmed et al., 2009) with warnings as to negative, detrimental affects upon efficient functionality (Tractinsky, 2004). It must be stressed that this is a traditional HCI position. As sections of the HCI research community (Harrison, 2007) are using a Phenomenological Matrix to understand experience, especially aesthetic experience, this strengthens my research perspective.
Traditional HCI, influenced by the engineering and psychology roots, has had a dismissive attitude towards aesthetics and the visual aspects of design because the emotional aspects of its influence are not revealed through the hard science of its research methods. Over the last decade, developing on Norman’s work on emotional design (2005), some HCI researchers led by Harrison, have observed the HCI paradigm developing from a position of ‘objective knowledge’ into a position from where knowledge arises from ‘situated viewpoints’ (Harrison et al., 2007). Harrison describes the three paradigms of HCI.

The first paradigm took its inspiration from HCI’s roots in industrial engineering and ergonomics, and located itself firmly within an objective and functional view of design. The second HCI paradigm focused upon a “central metaphor of mind and computer as symmetric, coupled information processors”. This intellectual position came from the influence on HCI from Cognitive Psychology. Both these first two paradigms are not mutually exclusive but overlap, and can be mapped onto Petersen’s five elements of interaction (Petersen et al., 2004). The first four interaction styles are: system, tool, dialogue and media. The system style positions the user as part of the computer system; the tool style positions the user as being in control of the system, the dialogue style positions both the user and machine as equal partners in communication, and a media style places the interactive system as a mediator between human-human communication.

The first paradigm of coupling man and machine can be seen in what Petersen defines as a System Perspective and also a Tool Perspective. Within a System Perspective the user is seen as being part of the system - as part of the machine, whereas the Tool Perspective shifted the user to an operable status, as a user of the machine. The second paradigm can be mapped to their Dialogue Partner Perspective where the user is in equal partnership with the machine, or the Media Perspective where the machine is the communication mediator between humans (Petersen et al., 2007).
Petersen’s fifth element of interaction and Harrison’s 3rd paradigm both share a phenomenological perspective that up to recently has been marginalised and subordinated under objective functionalism. In the third paradigm of HCI the focus is upon the emergent experience of humans as embodied actuators within a physical and social world.

With Harrison’s argument for the third paradigm and Petersen’s exploration of aesthetics from a Pragmatist perspective there is now an opportunity to reposition Visual Communication as an influence upon Interaction Design. This repositioning is not superficial in a desire to place the emphasis solely upon the visual design of the surface. The aesthetics of interaction, within which Visual Communication can still inform and influence, places the aesthetic not on the control of the appearance but upon an interaction that reveals itself to be aesthetic in its experience.
It is within this phenomenological space that the rhetorical voice of Visual Communication can connect and consociate with Interaction Design. It has been important to look to HCI research to locate connections with the functionalist to strengthen Visual Communication’s repositioning. To do this Petersen’s five interaction styles have been mapped to the first two paradigms of HCI, and the fifth style linking to aesthetics. Harrison’s third HCI paradigm has been crucial to this positioning, as Harrison’s phenomenological thesis is bringing HCI closer in dialogue to my position. Petersen’s work on Pragmatist Aesthetics, influenced by Dewey and Shusterman, presents a framework to form a bridge to Visual Communication via Interaction Design, using phenomenological research methodology.