This course requires students to read, reflect on a selection of authors’ ideas, and then share their findings with the class. Weekly preparation for class includes a careful reading of all the assigned texts and short reading reports of maximum 200 words for each paper. The weekly readings will collectively provide a conceptual toolkit for the design of creative interactive art works. When reading an article, students need to look for the “big picture” and important concepts that will inform their own work on the design of interactive artwork. Their task in this class is to identify and reflect on these high level concepts. They will be useful as both scholarly citations and as functional design tools for interactive works of art.
Week 1: New Media
- Lev Manovich, “The Language of New Media”, Cambridge MA, MIT Press, 2001 [Chapter 1]
- Walter Benjamin. “The Work of Art in the Age of Mechanical Reproduction” [pages. 319-333] from Photography in Print, Writings from 1816 to the Present, ed. Vicki Goldberg, Simon and Shuster, New York NY, 1991 Full Paper here!
Week 2: Embodied Interaction
- Paul Dourish, “Embodied Interaction: Exploring the Foundations of a New Approach to HCI”, draft paper in preparation for a special issue of Transactions on Computer-Human Interaction on “HCI in the New Millennium.
- David Kirsh, “Embodied Cognition and the Magical Future of Interaction Design”, ACM ToCHI 2013
Week 3: The Moving Body and Choreography
Slides Class 3: MakingStrange- class
- Loke L. and Robertson T. (2008) Inventing and Devising Movement in the Design of Movement-based Interactive Systems. In Proceedings of OZCHI 2008, pp. 81-88.
- Fdili Alaoui, B. Caramiaux, M. Serrano, F. Bevilacqua. “Movement qualities as interaction modality”, In Proceedings of ACM Conference on Designing Interactive Systems (DIS) 2012
Week 4: Interactive Musical Interfaces
Invited professor: Jules Françoise
- Zappi, Victor and McPherson, Andrew “Dimensionality and Appropriation in Digital Musical Instrument Design.” In Proc. NIME, 2014.
- Caramiaux, A. Altavilla, S. Pobiner, A. Tanaka, “Form Follows Sound: Designing Interactions from Sonic Memories”, Proceedings of the ACM Conference on Human Factors in Computing Systems, CHI’15.
- Optional : Jules Françoise, Yves Candau, Sarah Fdili Alaoui, and Thecla Schiphorst, “Designing for Kinesthetic Awareness: Revealing User Experiences Through Second-Person Inquiry,” Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems
Week 5: Creativity and Aesthetics
- Wright, J. Wallace and J. Mccarthy, J. (2008). “Aesthetics and experience centered design”. ACM Transactions on Computer-Human Interaction (TOCHI), 15(4)
- Petersen, O. Iversen, O. Krogh, and M. Ludvigsen (2004). “Aesthetic interaction: a pragmatist’s aesthetics of interactive systems”. In Proceedings of the ACM Conference on Designing Interactive Systems (DIS).
Week 6: Tangible Interactions
- Ishii and B. Ullmer, “Tangible bits: towards seamless interfaces between people, bits and atoms”, Proceeding of of the ACM Conference on Human factors in computing systems CHI’97
- Jordà, S., Geiger, G., Alonso, M., Kaltenbrunner, M. (2007). “The reacTable Exploring the Synergy between Live Music Performance and Tabletop Tangible Interfaces”. In Proceedings of the ACM 1st Tangible and Embedded Interaction conference (TEI) 2007 paper.
Week 7: Interactive Performance
- Dixon, S. (2007). “Digital performance: a history of new media in theater, dance, performance art, and installation”. MIT press. [Chapter 1]
- Salter, C. (2010). “Entangled: Technology and the Transformation of Performance”. MIT Press. [Chapter 1]
- Reeves, S., Benford, S., O’Malley, C. and Fraser, M. (2005). “Designing the spectator experience”. In Proceedings of the ACM Conference on Human Factors in Computing Systems CHI’05.
Weekly practical assignment:
Week 1 assignment:
|Portfolio Assignment: Prepare a 3 mins portfolio presentation for next week (with 3 slides/photos/texts/links/examples):
· what you have done so far:
o List all the art projects you have been part of, as well as all the tools that you have used and or developed that can be of relevance here (video, weblinks,..).
· Up to three projects idea, or direction regarding what you would ideally like to end up doing (or being part of) in the class. Only if you have no ideas, then you can pitch projects of others that you find inspiring.
- Team up!
- Start to imagine the craziest ideas for an interactive experience, what are you interested in? what would you like to offer to an audience? Have you ever had an art practice? why?
Week 2 and 3 assignment:
The goal is to have input data using one of the available sensors to capture data and to integrate the data into a program on a platform of your choice: a MaxMSP patch, or an openframeworks program for example.
- Accelerometers from Iphones/smartphones, using applications such as Touch OSC that transfers the data through an OSC connection.
- MYOs : Accelerometers + Muscle activity
- MYO for MaxMSP https://github.com/JulesFrancoise/myo-for-max/releases
- Getting started with MYO https://www.myo.com/start
- Kinect V1 and V2: capturing whole body skeleton
- Leap Motions: capturing hand motion
- Leap Motion for MaxMSP https://www.julesfrancoise.com/leapmotion/
Week 4 assignment:
Today we will use a toolkit in Max/MSP for easy and fast gesture-to-sound scenario prototyping Gesture Sound Toolkit Copyright 2015 – Baptiste Caramiaux, Alessandro Altavilla
We will explore the toolkit with accelerometer data from smartphones.
This tookit has been designed and implemented in order to investigate research questions on sonic interaction design, and led to a publication at the CHI 2015 conference. If you use the toolkit in your research or teaching, please credit the work:
- Caramiaux, Baptiste, Altavilla, Alessandro, Pobiner, Scott and Tanaka, Atau. “Form Follows Sound: Designing Interactions from Sonic Memories”. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. pp. 3943-3952. 2015 (http://dx.doi.org/10.1145/2702123.2702515)
Week 5 and 6 assignment:
During the week 5 and 6 students need to have matured the design of their interactive artifact that instantiate one or two theoretical concepts being discussed in the class. The artwork must be digital and interactive.
Material for framing the Design Process is available Here
Week 7 assignment:
Student should start to prepare the deliverable that will consist of original software and complete documentation. The documentation is a writing that describes, analyzes, and discusses the design choices embedded within the artwork, conceptually, technically, and critically, and the resulting experience for the participants. The paper needs to include their use of the design concepts of the weekly reading, analyze and describe their design decisions in the interactive artifact that they have created. Students will also be expected to orally present the artifact. The formal writing of their final project should be in the form of an interactivity paper, preferably in the CHI extended format
If appropriate, students should also prepare a video of their project, preferably with narration. The analysis of the artwork will rely on concepts drawn from the course readings. The evaluation of the participant’s experience will rely on qualitative or quantitative methodologies of the student’s choice.
The outcome of the 7 classes will be shared during an afternoon exhibition of students work.
We will be setting up the exhibition in the morning and having visitors the whole afternoon. Hereafter the posters of previous Creative Design Exhibition:
The students will be able to:
- Identify the key design principles across a range of related texts.
- Participate substantively in discussions across the range of texts included in the course readings.
- Apply these key principles in the design of their interactive artifact.
- Conduct an in-depth project about the design of an interactive artwork.
- Prepare and deliver a written paper demonstrating their application of the theoretical concepts in the design of the interactive artifact.
- Present their interactive artifact during an exhibition
Students will be graded on the quality of the work and the discussions they lead, and also on their general participation in the intellectual activity of the class. The criterion in both cases will be the effective understanding and application of the concepts of the authors in the design of their artifact.
- Reports on weekly readings — 25%
- General Participation — 15%
- Final artwork / Paper / Video and Oral Presentation — 60%
- Open Framework
- Electronics and sensors
- Arduino or micro-‐controller
- MIDI, OSC
- Video capture and editing
Tutorial on How to Write a Paper:
Writing and reflecting on the Interactive System. Guidance for writing a good HCI paper, inspired by S. Greenberg and J Galvan.
This document describes how a researcher should structure a report describing experiments in human computer interaction. The framework provided follows that of most scientific reports, where sections should: introduce the topic and problem; describe the experiment; note the key results obtained; discuss and interpret the results; and give concluding remarks. The document also indicates what archival records should be kept of the experiment.
Note: The title should be descriptive and enticing, and should be followed by the full names, contact addresses, and email address of the authors. Abstracts are typically a 100-150 word overview of experiment, results and discussion. Well-written abstracts summarize the key findings of the paper as well as introduce the problem, so the reader knows what to expect.
This section should give an overview of the general problem area, and should then focus on the particular problem you are going to investigate. Some things typically included in an introduction are:
- general problem introduction and statement
- review of experimental and commercial systems
- discussion of the relevant literature (if any)
- personal encounters with the problem
- review of previous experiments
- relevant psychological or other theories
A literature review is not an annotated bibliography in which you summarize briefly each article that you have reviewed. While a summary of the what you have read is contained within the literature review, it goes well beyond merely summarizing professional literature. It focuses on a specific topic of interest to you and includes a critical analysis of the relationship among different works, and relating this research to your work. It may be written as a stand-alone paper or to provide a theoretical framework and rationale for a research study (such as a thesis or dissertation).
- Step 2: Decide on a topic
- Step 3: Identify the literature that you will review
- Step 4: Analyze the literature
- Overview the articles: Skim the articles to get an idea of the general purpose and content of the article (focus your reading here on the abstract, introduction and first few paragraphs, the conclusion of each article. Tip: as you skim the articles, you may want to record the notes that you take on each
- Group the articles into categories (e.g. into topics and subtopics and chronologically within each subtopic).
Step 5: Summarize the literature in table or concept map format
Step 6: Synthesize the literature prior to writing your review
Using the notes that you have taken and summary tables, develop an outline of your final review. The following are the key steps as outlined by Galvan (2006: 71-79)
- Consider your purpose and voice before beginning to write.
- Consider how you reassemble your notes: plan how you will organize your findings into a unique analysis of the picture that you have captured in your notes.
- Create a topic outline that traces your argument: first explain to the reader your line or argument (or thesis); then your narrative that follows should explain and justify your line of argument.
- Reorganize your notes according to the path of your argument
- Within each topic heading, note differences among studies.
- Within each topic heading, look for obvious gaps or areas needing more research.
- Plan to describe relevant theories.
- Plan to discuss how individual studies relate to and advance theory
- Plan to summarize periodically and, again near the end of the review
- Plan to present conclusions and implications
- Plan to suggest specific directions for future research near the end of the review
- Flesh out your outline with details from your analysis
Step 7: Writing the review (Galvan, 2006: 81-90)
- Identify the broad problem area, but avoid global statements
- Early in the review, indicate why the topic being reviewed is important
- Distinguish between research finding and other sources of information
- Indicate why certain studies are important
- If you are commenting on the timeliness of a topic, be specific in describing the time frame
- If citing a classic or landmark study, identify it as such
- If a landmark study was replicated, mention that and indicate the results of the replication
- Discuss other literature reviews on your topic
- Refer the reader to other reviews on issues that you will not be discussing in details
- Justify comments such as, “no studies were found.”
- Avoid long lists of nonspecific references
- If the results of previous studies are inconsistent or widely varying, cite them separately
- Cite all relevant references in the review section of thesis, dissertation, or journal article
Step 8: Developing a coherent essay (Galvan, 2006: 91-96)
- If your review is long, provide an overview near the beginning of the review
- Near the beginning of a review, state explicitly what will and will not be covered
- Specify your point of view early in the review: this serves as the thesis statement of the review.
- Aim for a clear and cohesive essay that integrates the key details of the literature and communicates your point of view (a literature is not a series of annotated articles).
- Use subheadings, especially in long reviews
- Use transitions to help trace your argument
- If your topic teaches across disciplines, consider reviewing studies from each discipline separately
- Write a conclusion for the end of the review: Provide closure so that the path of the argument ends with a conclusion of some kind. How you end the review, however, will depend on your reason for writing it. If the review was written to stand alone, as is the case of a term paper or a review article for publication, the conclusion needs to make clear how the material in the body of the review has supported the assertion or proposition presented in the introduction. On the other hand, a review in a thesis, dissertation, or journal article presenting original research usually leads to the research questions that will be addressed.
- Check the flow of your argument for coherence.
This section should clearly describe technically the system that you have designed.
4.Evaluation (If you conducted one)
This section should clearly define the problem, describe the subjects and the materials required, indicate the methodology, and list any problems encountered. Depending upon your particular experiment, the subsections below might be best presented in a different order and you may add further subsections as needed.
4.1 Introduction and goals
Introduce your experiment, and give the reader the specific goals you expect it to address. It is common at this stage to give the reader a hint of your hypotheses (if they are not already hinted at in the Introduction).
This is a detailed description of the experiment that should allow other researchers to replicate your experiment.
Describe your participants (e.g., any relevant demographics, if/how they were divided into categories), including total number, and recruiting approach. Indicate if any incentives were used. Comment on the representativeness of your participants relative to the target population, if their representativeness isn’t immediately obvious.
If your experiment is comparing multiple different interfaces or interactive systems or techniques, describe each of them. Screen snapshots of interfaces/systems are particularly useful.
Briefly describe what participants were asked to do with the interactive system(s).
Write the formal experimental design (e.g., a 2 x 3 mixed factorial design, more specifically a 2 levels of expertise (between subjects) x 3 interfaces (within subjects) design).
Describe the sequence of activities each participant followed. This should document the experiment from a participant’s perspective.
Describe the physical setup of the experiment (e.g., where was it conducted, on what kind of equipment, etc.)
4.2.7 Independent and dependent variables
Include exactly how you intend to measure each dependent variable.
Remember to state these in terms of the independent and dependent variables. If it is not immediately clear why you would have a certain hypothesis then include a brief explanation separate from but following the hypothesis. You do not need to state the null hypothesis.
5.Results (If you conducted an experiment/evaluation)
This section is an objective report on what the numbers show. You should not try to interpret the meaning of the numbers in this section. Some of the things you may do here are:
- report means and standard deviations in neat tables
- indicate the statistics used and levels of significance
- include graphs, plots, histograms, etc that tell a story about the actual figures obtained
Only critical raw data and summary statistics should be included in the actual report. However, you must keep all your raw data in a separate archival report, should anyone (a reviewer in the case of real scientific reporting) need more detail than is provided in the paper.
Interpret the results. Although you should still try to be as objective as possible, the discussion section should illuminate your critical thinking about the results. Explain what the statistics mean, account for anomalies, and so on.
6.1 Interpretation of results (possibly)
Discuss what you believe the results really mean. For example, if you find a significant difference for some effect, what does that mean to the hypothesis? Is the different seen an important one?
6.2 Relation to other works
How do the results you’ve obtained relate to other research findings?
6.3 Impact for practitioners
As computer scientists, we are particularly concerned with the implications of our findings on practitioners. Should existing interface constructs be designed differently or used in a new context? Do you have suggestions for new designs? How can the findings be generalized?
6.4 Critical reflection
Critical reflection is one of the key foundations of science. You should criticize your work (constructively, if possible), indicate possible flaws, mitigating circumstances, the limits to generalization, conditions under which you would expect your findings to be reversed, and so on.
6.5 Research agenda
The best experiments suggest new avenues of exploration. In this section, you should reflect and refine your hypotheses, describe new hypotheses, and suggest future research, ie research that you would do if you continued along this path.
Summarize the report, and speculate on what is to come.
This list should contain only papers that have been cited in text. Citations should be in a standard form, and should include all citation information.
REF: Galvan, J. (2006). Writing literature reviews: a guide for students of the behavioral sciences (3rd ed.). Glendale, CA: Pyrczak Publishing.