tagCloud

Let’s Work Together

Media Architecture (IMA NYU, Fall 2020)

Description

Architecture has always been considered as an immediate extension of the human civilization, and its connection with state-of-the-art technologies has always been essential. In our current highly mediated and augmented environments, architecture shifts from static, solid, and predefined, to a fluid, interactive, and ever-changing. Computational, interactive, and media technologies challenge our understanding of what architecture is, redefining our engagement with exterior and interior spaces. The course investigates the area of media architecture from a contextual and critical perspective, examining and implementing in theoretical and practical scenarios current emerging trends. Students are expected to develop a comprehensive understanding of media architecture, to thoroughly investigate its media-scape (including motivations, social implications, technological requirements), and to develop installation work that utilizes contemporary media development practices and demonstrates artistic, technological, and scientific rigor.

The course examines media and technology within the architectural space through artistic and commercial works, focusing in realizing projects that augment interior and exterior spaces with interactive media, physical installations and creative visualizations. Students are challenged to explore a wide range of taught topics and resources, such as media design (2D, 3D, VFX, film), projection mapping, creative coding, and more. Through the exploration of these multidisciplinary areas (both in theory and practice), students develop concepts that are further being realized by utilizing contemporary development methods, reiterated and refined, and finally presented to related offline and online platforms/buildings/exhibitions. 

The learning objectives for this course are to:

  • Have a comprehensive understanding of media architecture practices, and how they are utilized in developing innovative art and commercial installations, media designs, and interactive spaces.
  • Utilize a range of contemporary media design and technical skills in media design, projection mapping, and realtime interactive systems.
  • Develop theoretical and hands-on practice related to project conceptualization, research, development methods, and finalization of ground-breaking work.
  • Build strong multi-disciplinary skills, and create innovative and challenging interactive, installation, and visualization projects.

Syllabus (in brief)

PRE-PRODUCTION

Session 1: Introduction to Media Architecture

This is the first session of the course, which will introduce the topic of Media Architecture, main tools and resources used for media development, as well as provide the first assignment brief, which is due on week 4. For this first part of the course, the focus should be the understanding of the architectural site under investigation, and the methods that can be utilized in producing strong concepts for the pre-production (ideation, sketching, storyboards, research, asset discovery).

  • Course introduction: Website, mode, syllabus, resources
  • Faculty-students introduction
  • Student data collection
  • Class learning objectives
  • Lecture: Introduction to Media Architecture
    • Selected examples of Media Architecture – Descriptions, videos, documentation
    • Definitions: Media, Architecture, Media & Architecture
    • Theses: Virtuvius, Gaston Bachellard, Frank Lloyd Wright
    • A historical overview: From caves to shopping malls
    • Forms of Media Architectures (examples): Augmented, Kinetic, Immaterial
    • Summary & Conclusions
  • Assignment Brief: Explanation of Assignment 1, and introduction of the architectural site, the White Magnolia Plaza.
  • Media Design Basics: Follow this link to explore main important aspects for media design that are required to proceed for the content development of this project.
  • Homework:
    • Reading: Media Architecture Design blog
    • Reading: Check out the books Media Architecture Compendium and New Media Facades.
    • Writing/Research/Practice: Research about the White Magnolia Plaza, and write a 500 word report. Provide descriptive information about the building, and discuss on what you would like to see on the facade, and why. Add visual content (images, videos) to your template(s), and explain why these are important to be displayed for this project. Use the Photoshop and Premiere templates to show your example cases. Post your content on Notion or your NYU blog, and share with your instructor the link before the deadline. Tutorial explanation here.
      Deadline: Thursday 24/09 (by 14:00).
  • Tutorials/Resources
  • Templates

Session 2: Site Analysis, Research, and Concept Design

For the second session of Media Architecture we are going to focus on the analysis of the site, investigating properties that are needed in proceeding to the design of the concepts. Through a collective ideation session, the class will begin formulate specific directions for the creation of the pre-production material.


Session 3: Concept Production

In this session we will be focusing on reviewing the content we have developed so far, and proceed to the finalization of the concepts (due on week 4). After confirming with the instructor that a certain concept direction is desirable and manageable, students will complete the design process for the concepts – this will consist of self-made sketches, and/or assets that are available on online and offline sources.


Session 4: Presentations: Assignment 1

In session 4, the pre-production results are presented in the classroom. The participants are requested to critically reflect on the content, and refinements are suggested (if needed) for the final submission of Assignment 1. In addition, during the session we will be discussing about transitioning from pre-production to production, and we will be sharing tips on what to do and what to avoid. Finally, Assignment 2 is presented, and the class moves into the production phase: creating the content for the media facade.


PRODUCTION

Session 5: Production Design I

After the pre-production has been completed and the concepts have been finalized, it is time to beginning creating the production content. For this first session, we are going to have a look at production tools that will be used for this project, such as Unity, Blender, and After Effects. This brief introduction will help us to start identifying the best techniques that will give us the results that we envision.

  • Workshop: Blender Intro Tutorial (Video Session) – Creating basic shapes, importing and exporting 3D file formats
  • Workshop: Unity Features (Slides), Unity Intro Tutorial (PDF), Video Session
  • Workshop: After Effects Intro Tutorial (Video Recording) – Project setup, UI, file import/export, effects
  • Tasks Assignment: Identify a list of resources (such as tutorials, code examples, or open-source repositories), from one of the softwares proposed for the production design here. List these references on the online shared board, and select one or two of them to study, recreate, or tweak according to your preferences.
  • Homework: By next Thursday, demonstrate (as a blog post, with a link to slack) your practical progress that shows how you used a tool (or more) to reach to a stage of development for your concept. Document the stages of your work by taking screenshots or videos that show the techniques you have used. Ensure that you dedicate a substantial amount of time to learn the techniques and use them to your benefit. 
  • Tutorials/Resources:

Session 6: Production Design II

For the second part of the production design, we are going to focus on developing real-time particle systems that will help us visualize in multiple different ways content that is organic and dynamic. 

  • Assignments Updates / Feedback
  • Workshop: Unity Particle Systems and the Visual Effects Graph (Tutorial PDF, Video Session, Project Files: [Particle Systems], [VFX Graph])
  • Workshop: Unity Shaders (Video Session, Project Files)
  • Workshop: Blender Materials (Video Session)
  • Workshop: AE Effects (Tutorial Slides)
  • Tasks Assignments: By using the material covered in this session, produce at least one project that uses these tools and techniques, but it focuses on the concept and materials that you have already designed in the pre-production.
  • Tutorials/Resources:

Session 7: Production Design III

For the third part of the production design, we are going to focus on creating more sophisticated designs using a range of different techniques and processes, such as lighting, shaders, and animation effects. The content has to start to look more specific rather than just be similar to other tutorials and projects found online, and look unique in terms of our original ideas that were developed in the pre-production.


Session 8: Production Design IV

For the final part of the production process we need to ensure that all content is adjusted to the most appropriate level, and necessary changes are all on their way, as in week 9 the production is presented to the client. In addition, we will be discussing about presentation techniques, so that our content is effectively communicated to the other parties.

  • Assignments Updates / Feedback
  • Seminar: Professional Presentation Techniques
  • Workshop: Exporting with Unity (Animator, Recorder), and Blender / Compression with Handbrake
  • Practicals/Tutorials
  • Curation: All content is reviewed and the selected clips will be edited and demonstrated to the client during session 9. 
  • Tasks Assignments: Finalization of the content for the client presentation, and preparation of the presentation strategy for session 9.
  • Tutorials/Resources:

Session 9: Finalizing Productions

The content that has been produced so far will be presented to the client. The presentation content needs to be clear, effective, and to better illustrate the vision with sufficient details so that it makes it easier for the client to consent on the next steps for post-production and final display. Most likely, the client will provide comments and feedback, and certain adjustments and revisions need to be additionally made. This is an important part of the production process, and the team needs to consider the tasks involved and make these changes on the next iteration phase.

  • Revision Tracking: Identifying the changes that need to be made, and track the revisions for each person/team within the associated timeframes.
  • Tasks Assignments: Based on the suggested corrections, each person/team needs to proceed in the finalization of the production process and/or continue with the development of material that is most appropriate and wanted.
  • Workshops: Blender Extrusion, Unity Point Cloud (Project Files:), After Effects Transitions & Blending (Mattes)
    [Session Recording]

POST-PRODUCTION

Session 10: Post-Production I

In the post-production phase, and after the content has been shared with the client, necessary changes need to take place and ensure that the work progresses towards finalization. In post-production, all produced assets have to be finalized and refined to a high-quality standard. This usually involves processes of editing, color correction, post-processing, animation, rendering, and so on. In this first session, we are going to see how to utilize Unity and Premiere for adjusting and exporting our creations.

  • Assignments Updates / Feedback
  • Workshop: Unity Post-Processing
  • Workshop: Post Production in Premiere
  • Tasks Assignments: Working towards finalization of the projects. Apply post-processing to the works.

Session 11: Post-Production II

During session 11, all participants work for the development and finalization of the content. For the last part of the session, the best content is going to be selected for the final display on Session 13. Students need to ensure that their work is appropriately refined.

  • Assignments Updates / Feedback
  • Practicals /Tutorials: Editing / Rendering / Post-Processing
  • Curation: All content is reviewed and the selected clips will be edited and demonstrated for the final presentation in Session 13. 
  • Tasks Assignments: TBC

Session 12: Post-Production III

In this session, all content is edited, and color-corrected, to ensure consistency on the timeframe and file formats that are going to be used on the media facade. By the end of this session, all participants need to ensure that the content will be finalized before December 2, so that it can be shared with the client and their media production team and related approvals take place for the final display on the facade.

  • Assignments Updates / Feedback
  • Practicals /Tutorials: Editing / Rendering / Post-Processing
  • Tasks Assignments: TBC

Session 13: Final Presentation

The final production is presented to the client (and guests). The content is converted to a format appropriate for display. Tests will take place to ensure that the compositions play smoothly, and changes may be applied to ensure consistency and best quality playback on the facade’s media system.


DOCUMENTATION

Session 14: Project Documentation & Critical Reflection

In session 14, students are requested to document the projects that they have produced during this course. The documentation content needs to have a professional presentation that includes research content, concepts, storyboards, mood-boards, production processes, final videos, and film shooting on site. The final submission is on week 15.


Session 15: Documentation Submission

For the final submission students need to provide all related documentation of their projects. The content needs to be zipped and shared with the professor before the submission deadline.


Students’ Outputs

Booklet of final works available here.