tagCloud

Let’s Work Together

Extended Perception (IMA NYU, Spring 2020)

Description

Utilizing artistic, technological, and scientific ground-breaking studies, the class introduces students to the topic of Enhanced/Extended Perception. Through the analysis of selected theoretical and practical examples, students are challenged to reconsider and re-evaluate the biological sensory and perceptual apparatus by creating their own disruptive designs. The course consists of lectures (⅓), workshops (⅓), and practical sessions (⅓), and intends to provide a comprehensive and critical understanding both on the theory and philosophy related to the mind, perception, and reality, as well as on the development of functional (art and technology) prototypes that demonstrate how perception is extended, enhanced, or even hacked.

The course Extended Perception introduces students to theoretical and practical studies on technological augmentation and how they can alter, extend, and enhance biological senses, perception, and consciousness. Upon completion of this course, students will be able to:

  • Have a comprehensive understanding of how contemporary media and technologies are utilized to amplify and extend senses and perception.
  • Recognize relevant state-of-the-art artistic and scientific practices and utilize this knowledge to individual creative works.
  • Demonstrate technical skills in a range of cutting-edge software and hardware tools and resources.
  • Apply critical skills through reflection on theoretical and philosophical content, which is accomplished from class debates and related activities.

Assignments

Students are encouraged to participate in class through theoretical and practical activities, discussions, debates, and studio sessions. There are 3 main practical assignments for this course:

  • Assignment 1 – Augmented: Students are expected to develop a physical prototype that includes a sensing system with a feedback mechanism. The prototype can be in the form of a wearable, and it needs to be presented in class as fully designed and functional.
  • Assignment 2 – Connected: For the needs of Assignment 2, students need to develop and present a system that utilizes communication networks with interconnected agents in order to enhance perception and senses within a particular context based either on scientific, artistic, or philosophical research.
  • Assignment 3 – Transcended: Utilize a fully working software and/or hardware prototype that demonstrates a scenario for amplified/extrasensory cognition/sensing/perception. The project will consist of independent study that is guided and supported by the instructor.

Syllabus (in brief)

  • Lecture (1h)
    Introduction, Learning Objectives
    Main and Supplementary Senses
    Defining Sensation, Perception, Consciousness
    Short Screening: “The Brain” (BBC)
    Hacks of Perception
    Relevant Artists & Practice (James Turrell, Aristotle, Kleinberger et al. – Phox Ears, Rebecca Horn, Susanna Hertrich, Beta Tank)
    Summary & Conclusion
  • Workshop (1h) – Sensing & Reactivity (Arduino, assorted sensors)
  • Practical (1h)

  • Lecture (1h)
    Introduction, Learning Objectives
    Autopoiesis & Cognition
    Defining Umwelt (Jakob von Uexküll)
    Maturana & Varela – Cognitive Systems
    Merleau-Ponty, Heidegger, Ihde (on Perception)
    Screening: David Eagleman – New Senses for Humans (20 min)
    Relevant Artists & Practice (Francis Bacon, Hyungkoo Lee, Castellanos & Valverde, Gerson Dublon, Anthony Hall, Carsten Holler)
    Discussion: Should we challenge ourselves to extend our Unwelten?
    Summary & Conclusion
  • Workshop (1h) – Physical Computing & Node.js (Arduino, Node.js, assorted sensors)
  • Class Practical (1h)

  • Lecture (1h)
    Introduction, Learning Objectives
    Defining Augmentation
    Cyborgs, Robots, Humanoids
    Donna Haraway’s Post-Humanism
    Prosthetics
    Relevant Artists & Practice (Stelarc, Troika, Eidos, Dis-Armor Project, Ikeuchi Hiroto)
    New Bionics (Hugh Herr)
    Discussion: Debating on technological augmentation
    Summary & Conclusion
  • Workshop (1h) – Feedback Mechanisms (Arduino, assorted feedback systems)
  • Class Practical (1h)

  • Lecture (1h)
    Introduction, Learning Objectives
    Hypertext, Hypermedia, Cyberspace
    Defining Telematics
    La Plissure Du Texte & Distributed Authorship
    Collective Intelligence (Pierre Levy)
    Relevant Artists & Practice (La Plissure Du Texte 2&3, Telematic Dreaming, See you in Walhalla)
    Defining Cyberception
    Short Screenings: Matrix (immersion), True Skin (connectivity)
    The Multiple Self (Ascott)
    Summary & Conclusion 
  • Workshop (1h) – Connected Systems & Distributed Authorship (Node.js, MQTT)
  • Class Practical (1h)

Session 5: Presentations – AUGMENTED

  • Submission & Presentation of Assignment 1 (physical design, electronics, sensing + documentation)

  • Lecture (1h)
    Introduction, Learning Objectives
    Definitions: WetWare & MoistMedia
    Merging Computational & Biological Systems / Organisms / Intelligence
    Biohacking, Grinding, and Body Modification
    Brain Implantation
    Computational Processing as Brain (neural networks, genetic algorithms)
    Neuroimaging (EEG, PET, MRI, and fMRI)
    Uploading
    Consciousness & Machines – Imitation Game and the Turing Machine
    Relevant Artists & Practice (Gilberto Esparza, cellF, James Auger, Stelarc, Neil Harbisson’s Eyeborg)
    Summary & Conclusion
  • Workshop (1h) – Cognitive Computing (Node.js, Node-Red, IBM-Watson)
  • Class Practical (1h)

  • Lecture (1h)
    Introduction, Learning Objectives
    Definitions
    Chemical Activation – Neurochemistry & neurobiology
    Collective Intelligence, Biological Enhancements
    Synthetic Drugs, Cognition & Intelligence Amplification
    The Hedonistic Imperative & Doors of Perception
    Psychotropics & Virtuality – Validated, Vegetal & Virtual Realities
    Genetic Engineering & DNA Dreams – Fluorescent Bunnies, Pop Music Genome Editing 
    Summary & Conclusions
  • Workshop (1h) – Front-End Space
  • Class Practical (1h)

Session 8: Practical Session

  • Practicals, Tutorials, Studio Development – Assignment 2

Session 9: Presentations – CONNECTED

  • Submission & Presentation of Assignment 2 (telematics, electronics, physical prototypes + documentation)

Session 10: Practical Session

  • Practicals / Tutorials

Session 11: Project 3 Briefing & Practical Session

Session 12: Practicals

Session 13: Practicals

Session 14: Presentations – TRANSCENDED


Students’ Outcomes


Guest Talks

Madeline Schwartzman (Parsons School of Design) – See Yourself Sensing (guest talk: video recording available here).


Gershon Dublon (MIT Media Lab) – Extrasensory Perception (guest talk: video recording available here).

Jo Wei (Central Academy of Fine Arts, Beijing) – Human Engineering & Bio-Art (guest talk: video recording available here).

Jonas Joergensen (University of Southern Denmark) – Soft-Robot Aesthetics (guest talk: video recording available here).


Readings & Resources

Required Textbooks & Materials

Recommended Textbooks & Materials

Tutorials

Components

Physical Computing Books

Design & Making

Additional Tools