creating the illusion mark green school of creative media

Creating the IllusionCreating the Illusion

Mark GreenMark Green

School of Creative MediaSchool of Creative Media

IntroductionIntroduction

Now that we have some idea of what new Now that we have some idea of what new media is about, how do we create a good media is about, how do we create a good illusion?illusion?

What is the process we can follow to What is the process we can follow to create a good illusion?create a good illusion?

What do we know about the design of new What do we know about the design of new media?media?

What is Good New Media?What is Good New Media?

Depends on individual taste and the type Depends on individual taste and the type of piece we are producing, but there are of piece we are producing, but there are some general ideassome general ideas

If a viewer spends a lot of time with our If a viewer spends a lot of time with our piece it is probably good:piece it is probably good: Viewer finds it entertainingViewer finds it entertaining Can accomplish his or her taskCan accomplish his or her task Is learning somethingIs learning something

What is Good New Media?What is Good New Media?

One suggested criteria is visual realismOne suggested criteria is visual realism There has been a major push over the There has been a major push over the

past few decades to produce realistic past few decades to produce realistic graphicsgraphics

Consumer video cards can now produce Consumer video cards can now produce quite realistic graphics in real-timequite realistic graphics in real-time

But how helpful is this? Or, does it just get But how helpful is this? Or, does it just get in the way?in the way?

Visual RealismVisual Realism

There are many applications where this There are many applications where this can be a major factorcan be a major factor

Flight simulators need visual realism to Flight simulators need visual realism to increase training effectivenessincrease training effectiveness

It assists in immersing the viewer in It assists in immersing the viewer in entertainment and game experiencesentertainment and game experiences

So it can be an important factor in some So it can be an important factor in some applicationsapplications


But, its not always necessaryBut, its not always necessary There are applications that visual realism There are applications that visual realism

might hurtmight hurt Observation: its easier to recognize a Observation: its easier to recognize a

person from a cartoon than from a pictureperson from a cartoon than from a picture Cartoon concentrates on the important Cartoon concentrates on the important

features for recognition, picture has too features for recognition, picture has too much detailmuch detail


All the details might not be necessary all of All the details might not be necessary all of the time, might want a higher level the time, might want a higher level representationrepresentation

Concentrate on the important points and Concentrate on the important points and ignore the detailsignore the details

Training: highlight the important points, Training: highlight the important points, have the viewer focus on them, not the have the viewer focus on them, not the details of irrelevant partsdetails of irrelevant parts


Example: I worked on a medical Example: I worked on a medical visualization, operation of a virus within a visualization, operation of a virus within a cancer cellcancer cell

The more realistic the graphics were, the The more realistic the graphics were, the harder for people to use it, in fact many harder for people to use it, in fact many got sick from looking at itgot sick from looking at it

More schematic representation worked More schematic representation worked much bettermuch better

March of TechnologyMarch of Technology

New technology is seductive, can give New technology is seductive, can give better media, but need to deal with the better media, but need to deal with the learning curvelearning curve

New graphics processors every 6 months New graphics processors every 6 months to a year, each one introduces new to a year, each one introduces new featuresfeatures

Significant advances at the consumer level Significant advances at the consumer level over the past 2 years, this will continue for over the past 2 years, this will continue for another few yearsanother few years


New ways of doing graphics that produce New ways of doing graphics that produce much better imagesmuch better images

Many designers would like to use this Many designers would like to use this technology, but the rapid evolution is a technology, but the rapid evolution is a problemproblem

The software used for these new graphics The software used for these new graphics cards is also changing rapidly, some say cards is also changing rapidly, some say too rapidly to usetoo rapidly to use


Current version of DirectX is 9 (the main Current version of DirectX is 9 (the main software for PC games), but most games software for PC games), but most games on the market use version 7on the market use version 7

Recently developed games are using Recently developed games are using versions 8 and 8.1, programmers just versions 8 and 8.1, programmers just learning how to use this softwarelearning how to use this software

Now they need to learn a new version for Now they need to learn a new version for the latest hardwarethe latest hardware


Advances in hardware are always nice, Advances in hardware are always nice, but if we can’t learn it there are problemsbut if we can’t learn it there are problems

Programmers and designers don’t have Programmers and designers don’t have time to explore the technology before the time to explore the technology before the next one comes alongnext one comes along

They don’t have time to be creative, make They don’t have time to be creative, make the best use of the technology, since they the best use of the technology, since they are always learning something neware always learning something new


Even worse, they will start to ignore itEven worse, they will start to ignore it If the technology changes too fast, people If the technology changes too fast, people

will burn out and give up on itwill burn out and give up on it They will just work with what they knowThey will just work with what they know This will eventually stop the innovation, This will eventually stop the innovation,

which isn’t good eitherwhich isn’t good either Need to pace the development of Need to pace the development of

technologytechnology

TechnologyTechnology

There is a tendency for some designers to There is a tendency for some designers to concentrate too much on the technologyconcentrate too much on the technology

This is easy to do, there is a lot of hype This is easy to do, there is a lot of hype surrounding the technology, lots of surrounding the technology, lots of marketing and companies pushing their marketing and companies pushing their technologiestechnologies

Not near as much hype about quality Not near as much hype about quality design, much harder to selldesign, much harder to sell

TechnologyTechnology

In some cases technology can make or In some cases technology can make or break a piece, but it usually isn’t the most break a piece, but it usually isn’t the most important factorimportant factor

If the content isn’t there, the technology If the content isn’t there, the technology won’t helpwon’t help

Need to think of the technology as Need to think of the technology as something that makes the content something that makes the content possible, it plays a supporting rolepossible, it plays a supporting role

InteractivityInteractivity

This is certainly part of good new mediaThis is certainly part of good new media The user needs to have some control over The user needs to have some control over

the piece, needs to feel that they are the piece, needs to feel that they are contributing to the experiencecontributing to the experience

The ability to immerse the viewer in the The ability to immerse the viewer in the experience, convince them they are part of experience, convince them they are part of the virtual world we are creatingthe virtual world we are creating

InteractivityInteractivity

Interactivity can really help a piece, but it Interactivity can really help a piece, but it isn’t the only factorisn’t the only factor

Surface interactivity can make a piece Surface interactivity can make a piece worse, it needs to be an integral part of the worse, it needs to be an integral part of the experienceexperience

Needs to fit in with the experience, not just Needs to fit in with the experience, not just something that was added on latersomething that was added on later

ContentContent

Without content you don’t have much of a Without content you don’t have much of a piece, it is one of the most important piece, it is one of the most important componentscomponents

Good content is important, and too often Good content is important, and too often not enough time is spent on developing itnot enough time is spent on developing it

There are always time pressures to start There are always time pressures to start production, to see some product being production, to see some product being developeddeveloped

ContentContent

Too often content development is viewed Too often content development is viewed as non-productive work, this is one of the as non-productive work, this is one of the most common reasons for pieces failingmost common reasons for pieces failing

There are a number of things to think There are a number of things to think about in content developmentabout in content development

First, does the content fit the medium? First, does the content fit the medium? Will it make for a good story in the medium Will it make for a good story in the medium that we are using?that we are using?

ContentContent

Many companies think they can easily re-Many companies think they can easily re-use content from other mediause content from other media

For example making games from movies, For example making games from movies, this usually doesn’t produce a very good this usually doesn’t produce a very good gamegame

Going from games to movies hasn’t been Going from games to movies hasn’t been very successful eithervery successful either

ContentContent

If content was developed for a non-If content was developed for a non-interactive media it quite often doesn’t interactive media it quite often doesn’t transfer to interactive mediatransfer to interactive media

There have been successful transfers of There have been successful transfers of board games to computer games, but both board games to computer games, but both are basically interactive mediaare basically interactive media

Often better off starting from scratchOften better off starting from scratch

ContentContent

Content can be motivated by other media, Content can be motivated by other media, the ideas could come from a book or the ideas could come from a book or movie, but it needs to be developed for movie, but it needs to be developed for interactive presentationinteractive presentation

Good content development takes time, for Good content development takes time, for larger pieces it’s a good idea to spend a larger pieces it’s a good idea to spend a considerable amount of time on content considerable amount of time on content developmentdevelopment

ContentContent

Example: if I see a two year project that is Example: if I see a two year project that is only spending a month on content only spending a month on content development I feel concerneddevelopment I feel concerned

If they plan to have follow-ups I’m even If they plan to have follow-ups I’m even more concernedmore concerned

Content development can overlap Content development can overlap production, but there should be a non-production, but there should be a non-production period at the beginningproduction period at the beginning

SummarySummary

So we need to have at least the following So we need to have at least the following things:things: good content targeted to our mediagood content targeted to our media interactivityinteractivity media (graphics, sound, etc) that immerses media (graphics, sound, etc) that immerses

the viewer in our virtual worldthe viewer in our virtual world appropriate use of technologyappropriate use of technology

this will get us a long way towards a this will get us a long way towards a successful piecesuccessful piece

The Production ProcessThe Production Process

To get a better feel for design we need to To get a better feel for design we need to look at the production processlook at the production process

only a high level view, the subject of a only a high level view, the subject of a complete course next semestercomplete course next semester

the process starts with the idea for a piece the process starts with the idea for a piece and ends with the final product, usually in and ends with the final product, usually in the form of a CDthe form of a CD


Start with the basic idea, may be as short Start with the basic idea, may be as short as a few sentencesas a few sentences

usually need a very short description so usually need a very short description so you can pitch your project whenever you you can pitch your project whenever you get a chanceget a chance

new media is becoming big business, you new media is becoming big business, you are unlikely to have the funds to do it are unlikely to have the funds to do it yourselfyourself


The early stages of a project center The early stages of a project center around raising funds so you can actually around raising funds so you can actually start productionstart production

budgets in the $5 - $10 million (US) range budgets in the $5 - $10 million (US) range are not unusual now, this is similar to are not unusual now, this is similar to producing a movie or TV seriesproducing a movie or TV series

need to have something that will convince need to have something that will convince someone to investsomeone to invest


Start with a short document, maybe 10 Start with a short document, maybe 10 pages long that outlines the project:pages long that outlines the project: the short description of the projectthe short description of the project 2 or 3 page description of the product2 or 3 page description of the product market survey, will it sellmarket survey, will it sell production scheduleproduction schedule budgetbudget your team, can you actually deliveryour team, can you actually deliver


Where do you get funding?Where do you get funding? Publisher, the company that will eventually Publisher, the company that will eventually

distribute the productdistribute the product internal funding, only if you work for a very internal funding, only if you work for a very

large company or have a small projectlarge company or have a small project customer, if developing a special purpose customer, if developing a special purpose

projectproject restaurant somewhere in Hong Kong (this is a restaurant somewhere in Hong Kong (this is a

true story)true story)


Approximately 10% of projects get fundedApproximately 10% of projects get funded once you have funding time to start once you have funding time to start

working on projectworking on project by this time you may have a 40 page or so by this time you may have a 40 page or so

long document describing the design in long document describing the design in more detail, along with sources of more detail, along with sources of motivation, background reading, etcmotivation, background reading, etc

this forms the basis of the designthis forms the basis of the design


At this point you need to consider the At this point you need to consider the following things:following things: back story and backgroundback story and background general layout of the piece, a rough sketch of general layout of the piece, a rough sketch of

the designthe design artistic style and models, general feel for artistic style and models, general feel for

appearanceappearance basic interaction with the viewerbasic interaction with the viewer


Once you have a basic design can start Once you have a basic design can start planning the production process, this is far planning the production process, this is far more important that it might seem:more important that it might seem: detailed designdetailed design identification of main assets (video, sound, identification of main assets (video, sound,

computer models, animation, etc)computer models, animation, etc) production schedule for individual production schedule for individual

componentscomponents testing strategytesting strategy


The detailed design usually overlaps part The detailed design usually overlaps part of the production processof the production process

outlines the design of each component of outlines the design of each component of the projectthe project

asset identification is one of the most asset identification is one of the most important steps, from a production point of important steps, from a production point of viewview

overlooking it could lead to disasteroverlooking it could lead to disaster


Need to identify the main objects that will be Need to identify the main objects that will be used in the piece, where most of the used in the piece, where most of the production work will be centeredproduction work will be centered

in general you will need to build most of the in general you will need to build most of the assets, but not alwaysassets, but not always

do some of the assets already exist from do some of the assets already exist from another project, or can they be purchased?another project, or can they be purchased?

What is the best way to produce them?What is the best way to produce them?


One of the main considerations is re-useOne of the main considerations is re-use can the same asset by used in more than can the same asset by used in more than

one place? If so plan to re-use itone place? If so plan to re-use it with large projects there is a tendency to with large projects there is a tendency to

redo a lot of work that could be avoided redo a lot of work that could be avoided with proper asset managementwith proper asset management

put assets in general form, catalogue them put assets in general form, catalogue them and store them properly!and store them properly!


If everything has been done right up to this If everything has been done right up to this point the main production of the piece point the main production of the piece should be easy (well sort of)should be easy (well sort of)

can easily divide process into pieces and can easily divide process into pieces and assign to individual groups, may be quite assign to individual groups, may be quite independentindependent

can even subcontract some of the work, can even subcontract some of the work, China is popular right nowChina is popular right now


Testing is the next important stepTesting is the next important step for commercial success your product has to for commercial success your product has to

be bug freebe bug free remember you are building an experience, if remember you are building an experience, if

anything happens to break that experience anything happens to break that experience the viewer will be very unhappythe viewer will be very unhappy

even simple bugs or things that aren’t quite even simple bugs or things that aren’t quite accurate can be major problemsaccurate can be major problems


Most companies have a separate testing Most companies have a separate testing department, usually called QAdepartment, usually called QA

usually start testing as soon as there is usually start testing as soon as there is something to testsomething to test

for each version produce a list of bugs, for each version produce a list of bugs, project manager responsible for checking project manager responsible for checking that each of the bugs is fixedthat each of the bugs is fixed


Near the end of the project most of the Near the end of the project most of the work is in testing and fixing bugswork is in testing and fixing bugs

producing the very final version that is to producing the very final version that is to go to the publisher is called “going gold”go to the publisher is called “going gold”

because most of the CD-R were gold in because most of the CD-R were gold in colour and that’s how it was sent to the colour and that’s how it was sent to the publisherpublisher

time for a big party!time for a big party!


There are two other departments that are There are two other departments that are involved in the production process:involved in the production process: R&D: develop special techniques and effects R&D: develop special techniques and effects

required for the project, also investigate required for the project, also investigate hardware and software that will be used in hardware and software that will be used in future projectsfuture projects

Tools: develop special purpose software tools Tools: develop special purpose software tools for use in the company, some are very project for use in the company, some are very project specificspecific

The Design ProcessThe Design Process

As you can see design occurs on many As you can see design occurs on many levels throughout the design processlevels throughout the design process

it starts at a high level in the early stages it starts at a high level in the early stages with only a few pages for the entire projectwith only a few pages for the entire project

it then works through at least 2 more it then works through at least 2 more levels with each level producing at least 10 levels with each level producing at least 10 times more informationtimes more information


Design is usually a continuous processDesign is usually a continuous process as the project progresses smaller and as the project progresses smaller and

smaller design decisions are madesmaller design decisions are made the big decisions are made early in the the big decisions are made early in the

project, they are hard to change once the project, they are hard to change once the project gets goingproject gets going

need to think carefully in the beginningneed to think carefully in the beginning


How do we do design?How do we do design? Obviously we work from high level to low Obviously we work from high level to low

level, but there is more to it than thatlevel, but there is more to it than that most good designers start by studying the most good designers start by studying the

work of others, the main source of work of others, the main source of motivationmotivation

should be aware of most art forms, film, should be aware of most art forms, film, theatre, literature, visual art, etctheatre, literature, visual art, etc


Good for motivation, also good for Good for motivation, also good for communications, most people know communications, most people know common styles, so its easy to tell peoplecommon styles, so its easy to tell people

be aware of what other people have done be aware of what other people have done in your medium and in your genrein your medium and in your genre

previous works have tackled similar design previous works have tackled similar design problems, be aware of what works and problems, be aware of what works and what doesn’t workwhat doesn’t work


Be aware of other works in your genreBe aware of other works in your genre are the standards in your genre? Will are the standards in your genre? Will

viewers expect you to stick to these viewers expect you to stick to these standards?standards?

Where must you stick to the rules of your Where must you stick to the rules of your genre and where can you depart?genre and where can you depart?

What is it that will make your piece What is it that will make your piece different from the other in your genre?different from the other in your genre?

creating the illusion mark green school of creative media

Documents

technology new technology

better slide

good new media

new version

new graphics cards

technology new ways

design of new media

visual realism example