Lecture 01: Introduction

1
Lecture 01 Introduction
IS246Multimedia Information
Prof. Marc Davis UC Berkeley SIMS Monday and
Wednesday 200 pm 330 pm Fall
2004 http//www.sims.berkeley.edu/academics/cours
es/is246/f04/
2
Todays Agenda

• Introductions
• Problem Domain
• Goals of Course
• Course Overview
• Action Items for Next Time

3
Todays Agenda

• Introductions
• Problem Domain
• Goals of Course
• Course Overview
• Action Items for Next Time

4
Who Am I?

• Assistant Professor at SIMS (School of
  Information Management and Systems)
• Background

5
Why Am I Here?

• Creating technology and applications that will
  enable daily media consumers to become daily
  media producers
• Research and teaching in the theory, design, and
  development of digital media systems for creating
  and using media metadata to automate media
  production and reuse

6
Student Introductions

• Who are you?
• Name
• Undergrad degree and current department
• Special areas of expertise and interest
• Why are you here?
• What you want to learn from the course

7
Todays Agenda

• Introductions
• Problem Domain
• Goals of Course
• Course Overview
• Action Items for Next Time

8
Global Media Network

• Digital media produced anywhere by anyone
  accessible to anyone anywhere
• Todays media users become tomorrows media
  producers
• Not 500 TV Channels 500,000,000 multimedia Web
  sources

9
What is the Problem?

• Today people cannot easily find, edit, share, and
  reuse media
• Computers dont understand media content
• Media is opaque and data rich
• We lack structured representations
• Without content representation (metadata),
  manipulating digital media will remain like
  word-processing with bitmaps

10
Types of Multimedia Data

• 1D
• Audio (speech, music, sound effects, etc.)
• MIDI
• 2D
• Photographs
• Graphics
• 3D
• Video (2D Time)
• Animation (2D Time)
• Computer graphic models
• 4D
• Computer graphic model animation (3D Time)

11
Moores Law for Cameras
2000
2002
400
Kodak DX4900
Kodak DC40
40
SiPix StyleCam Blink
Nintendo GameBoy Camera
12
2004 Nokia 7610 Phone

• Integrated megapixel (1152 x 864 pixels) camera
• Integrated video recorder with audio function and
  4x digital zoom for video clips up to 10 minutes
  long
• 65,536 color-display, 176 x 208 pixels
• Bluetooth wireless technology and USB
  connectivity
• Advanced XHTML browser
• 8 MB internal dynamic memory and 64 MB Reduced
  Size MultiMediaCard (MMC)
• Downloadable Java MIDP 2.0 applications

13
The Media Problem

• Vastly more media will be produced
• Without ways to manage it (metadata creation and
  use) we lose the advantages of digital media
• Most current approaches are insufficient and
  perhaps misguided
• Great opportunity for innovation and invention
• Need interdisciplinary approaches to the problem

14
Todays Agenda

• Introductions
• Problem Domain
• Goals of Course
• Course Overview
• Action Items for Next Time

15
Goals of the Course

• Acquire theoretical and practical foundations to
  analyze, design, and produce multimedia
  information systems
• Media theory
• Media practice
• Current and future media systems and applications
• Learn to apply media theory to media design
• Gain further experience in project-based learning
  and teamwork
• Develop an enduring framework and methodology for
  media analysis and design

16
What This Course Is

• Graduate level lecture/seminar/studio in
  multimedia information
• Highly interdisciplinary
• Information Management and Systems, Computer
  Science, Electrical Engineering
• Film Studies, Cognitive Science, Linguistics
• Film Practice, Design, HCI
• Project-based and team-oriented
• Requires stretching, commitment, and active
  participation

17
What This Course Is Not

• Topics
• Computer science or engineering course on media
  signals and systems
• Film criticism course
• Advanced media production skills course
• Media networking, protocols, compression course
• Methods
• Exams

18
Who This Course Is For

• Students from
• SIMS
• Film Studies
• EECS
• Law, Business, Journalism, Architecture
• Other departments
• Interested in
• Synergizing a variety of disciplinary approaches
  to a complex, important, and fascinating problem
  domain that will shape the future of human
  communication, technology, and culture

19
Todays Agenda

• Introductions
• Problem Domain
• Goals of Course
• Course Overview
• Action Items for Next Time

20
Course Format

• Most classes will be lecture/discussion sessions
• Lecture 50 minutes
• Discussion 30 minutes
• For each class two students will prepare
  discussion questions and help lead discussion
• Some classes will be working sessions
• Assignment 3 Overview and Ideation
• Annotated Storyboard Working Session and Crit
• Final Project Overview and Ideation
• Some classes will be student presentations
• Media Production and Theory Presentations
• Final Project Presentations

21
Course Overview

• Course phases
• Theoretical and practical foundations
• Current issues and methods
• The future of multimedia
• Course assignments
• Theory application
• Using a camcorder
• Short media production
• Final project

22
Course Sessions Part I

• Theoretical and practical foundations
• Communications theory and semiotics (Reddy, Iser,
  Barthes, Saussure)
• Formalist media theory (Bordwell, Kuleshov)
• Semiotic media theory (Metz, Eco)
• Integrating theory and practice (Eisenstein)
• Video production overview (Guest Rachel
  Strickland)
• Audio production overview (Guest Rachel
  Strickland) Theory and history of computation
  (Hillis, Winograd)
• Computational media theory (Manovich, Dorai
  Venkatesh, Bloch)

23
Course Sessions Part II

• Current issues and methods
• Metadata for media (Davenport, Davis)
• Automated media analysis (Agrain, Jain, Foote --
  Guest Jonathan Foote)
• Multimedia journalism (Guest Paul Grabowicz)
• Media asset management and reuse process
  (Christel, Dimitrova, Prelinger, Jenkins)
• Commercial editing systems (Adobe Premiere)
• Commercial media asset management systems
  (Virage)
• Research multimedia systems (FotoFile -- Guest
  Abbe Don)
• Research multimedia systems (Informedia Guest
  Michael Smith)
• Multimedia standards (MPEG-7)

24
Course Sessions Part III

• The future of multimedia
• Future of multimedia information technology
  (Bush, McLuhan, Davis, Chang)
• Active capture (Davis, Nack, Barry)
• Adaptive media (Davis, Stern, Varian)
• Mobile Media (Naaman, Sarvas, Toyama)
• Final project presentations

25
Course Assignments

• Theory application
• Using a camcorder Object lesson
• Short media production
• Annotated storyboard and goal statement
• Rough edit
• Presentation
• Final project
• Team and idea formation
• Project proposal
• Project design specifications
• Project presentation and write-up

26
Grading

• 20 Theory Application Assignment
• 20 Mini Media Production Project
• 40 Final Project
• 20 Class Participation

27
SIMS Digital Media Studio

• Hardware
• Terabyte file server
• Gigabit Ethernet
• 2 Mac G4 workstations
• 2 PC workstations
• Various audio/video input options
• 5 Sony DCR-TRV50 DV camcorders
• 5 Audio field recording packs
• Greenscreen

• Software
• Adobe Premiere
• Adobe AfterEffects
• Adobe PhotoShop
• FinalCut Pro
• Media Streams
• Collaboration tools
• Brainstorming area
• Wall whiteboards

28
Office Hours

• Marc Davis
• Thursdays 100 pm 300 pm
• And by appointment
• Ryan Shaw
• TBA

29
Todays Agenda

• Introductions
• Problem Domain
• Goals of Course
• Course Overview
• Action Items for Next Time

30
Purchase Course Materials

• Purchase Course Textbooks
• David Bordwell and Kristin Thompson. Film Art An
  Introduction. 7th Edition. McGraw Hill, New York,
  2004.
• W. Daniel Hillis. The Pattern on the Stone The
  Simple Ideas That Make Computers Work. Perseus
  Books Group, New York, 1999.

31
SIMS/CIS Computer Orientation

• See Ryan Shaw about
• Filling out SIMS/CIS Account Request Form
• Seeing Roberta Epstein on the second floor of
  South Hall to get SIMS/CIS orientation

32
Readings for Next Time

• Wednesday 09/01
• Michael Reddy The Conduit Metaphor A Case of
  Frame Conflict in Our Language about Language
  (Brooke)
• Wolfgang Iser The Reading Process A
  Phenomenological Approach (Geoff)
• Roland Barthes The Death of the Author
  (Rebecca)
• Roland Barthes From Work to Text (Sarah)

33
In Class Writing

• marc_at_sims.berkeley.edu
• ryanshaw_at_sims.berkeley.edu
• What is multimedia information?
• What are the main challenges in multimedia
  information systems?