DELCA AUDIOPREMISES AND PROBLEMS

OF AUDIO ANIMATION

TODAYS MENU

GRAND ILLUSION CON ARTIST IN TROUBLE EMOTIONALIZATION OF DELCA AUDIO PERCEPTION (3) DELCA AUDIO REALIZATION (3) SURPRISE

THE GRAND ILLUSION

1. USER 2. UNIT USED FORCOMMUNICATION

4. SERVERS & SOFTWARE

3. GHOST/DELCA 5. DATABASES

CON ARTIST IN TROUBLE

SECRET CODE: CREATING THE ILLUSION

CON ARTIST IN TROUBLE

PROBLEM 1

MISINTERPRETATION OF INTELLIGENCE

SECRET CODE: CIV, AOE, FPS

CON ARTIST IN TROUBLE

PROBLEM 2

ARTIFICIAL UNINTELLIGENCE

SECRET CODE: CREATURES, BLACK & WHITE AND SIMS ONLINE

CON ARTIST IN TROUBLE

PROBLEM 3

RANDOM INTELLIGENCE

SECRET CODE: RANDOM IS LIFE AND NOT LIFE

CON ARTIST IN TROUBLE

PROBLEM 4

THE SPOCK DILEMMA

SECRET CODE: LACK OF EMOTION, AI HCI PARADOX

CON ARTIST IN TROUBLE

PROBLEM 5

RANDOM AND/OR EMOTIONAL

SECRET CODE: HOW RANDOM ARE EMOTIONS? CAN EMOTIONS UNRANDOMIZE?

CON ARTIST IN TROUBLE

CRITICAL QUESTIONS

• HOW CAN WE ESTABLISH A LASTING CONNECTION BETWEEN USER AND DELCA?

• HOW CAN RANDOMNESS CREATE CONVINCING EXPERIENCE OF LIFE?

• HOW CAN WE EMOTIONALIZE DELCA?

• HOW CAN WE CREATE STRUCTURE AND A MEANINGFUL EXPERIENCE IN COINCIDENCE?

SECRET CODE: SOLUTION IS UP NEXT

EMOTIONALIZATION

SOLUTION 1LET THEM REJOICE

SECRET CODE: PREMISES OF AI ARE HERE TO STAY. RANDOMNESS AND EMOTION MUST GO HAND IN HAND.

EMOTIONALIZATION

SOLUTION 2AND USE VARIOUS LEVELS OF DELCA AUDIO...

PERCEPTION OF DELCA AUDIO

DELCA AUDIO

AUDIO PERCEPTION ON THREE LEVELS

• EMOTIONAL

• PHYSICAL/EMOTIONAL UNAWARE

• CULTURAL/CROSS CULTURAL

DELCA AUDIOEMOTIONAL PERCEPTION LEVEL

• TRAFFIC, CELL PHONE, WAVES, ASSOCIATED AMBIENCES

• EXAMPLES OF EMOTIONAL SPEECH:

• http://delca.itu.dk/thesis/audio_examples/example_1_emotional_speech.mp3 (german actors)

• http://delca.itu.dk/thesis/audio_examples/example_2_emotional_speech.mp3 (german actors)

• http://delca.itu.dk/thesis/audio_examples/example_3_emotional_speech.mp3 (speech synthesis

• http://delca.itu.dk/thesis/audio_examples/example_4_emotional_speech.mp3 (speech synthesis)

• EMOTIONAL STIMULATION CAN ENHANCE BONDING BETWEEN USERS AND GHOSTS

DELCA AUDIOAFFECTIVE CIRTCUMPLEX MODEL

POSITIVE

•Happy•Glad•Pleased•Cheerful

EXCITED AND POSITIVE

•Enthusiastic•Elated•Euphoric•Optimistic

CALM AND POSITIVE

•Serene•Relaxed•Content•Rest

CALM

•Quiet•Passive•Sleepy•Dull

CALM AND NEGATIVE

•Pessimistic•Bored•Tired•Drowsy

NEGATIVE

•Sad•Unhappy•Depressed•Gloomy

EXCITED AND NEGATIVE

•Distressed•Annoyed•Stressed•Nervous

EXCITED

•Aroused•Stimulated•Active•Awake

DELCA AUDIOPHYSICAL PERCEPTION LEVEL

• BRAINWAVES, NEUROLOGY, BIOLOGY, SUBTLE INFLUENCES

• EXAMPLES OF PHYSICAL AUDIO:

• http://delca.itu.dk/thesis/audio_examples/example_5_white_noise.mp3 (white noise)

• http://delca.itu.dk/thesis/audio_examples/example_6_everlasting_pitch.mp3 (cheating pitch)

• http://delca.itu.dk/thesis/audio_examples/example_7_brainwave.mp3 (brainwaves)

• MAKING INTELLIGENT SOUND CLIMATE / SOUND ECOLOGICAL SPACE

• USING SOUND TO GUIDE AND BLOCK. VENTILATION AND TOILET PROBLEM SOLVED

DELCA AUDIOCULTURAL PERCEPTION LEVEL

• CROSS CULTURAL PERCEPTION

• CLASSICAL MUSIC ”NEUTRALLY PERCEPTED”

• CLASSICAL MUSIC WIDESPREAD CULTURALLY AND IN MEDIA

• SOUNDS AND MUSIC INFLUENCE LIFESTYLE & DEVELOPMENT

• STIMULATES SOCIAL BEHAVIOR

DELCA AUDIO, FINE FINE...BUT HOW IS IT PRACTICALLY DONE?

• DELCA AUDIO ON THREE PERCEPTION LEVELS:

• 1. Verbal representation / speech synthesis and recognition

• 2. Musical representation / classical music and character themes

• 3. Ambient representation / ambient music and ambiences

SECRET CODE: DISCRETE MIXING OF ALL 3 LEVELS CREATES BEST BASIS FOR EMOTIONALIZATION

VERBAL REPRESENTATION

• Speech synthesis software

• Temporary choice on AT&T Natural Voices (ONLY UK/DE/SP/FR)

• Best sounding / Supports TSS (Text-to-speech-synthesis)

• Current vocal ghost gallery consist of 10 voices (more incoming)

http://delca.itu.dk/protoghost/ghost_gallery_teaser.mp3

VERBAL REPRESENTATION

• Voice recognition software

• Current testing tool is Dragon (160 fluent spoken words pr. Minute)

• Problem is Adv. Speech Recognition must be calibrated individually

• The need of decreasing commands

• Cognitive 5-7 (maybe excluding numbers 1-10)

MUSICAL REPRESENTATION

• CLASSICAL INSTRUMENTATION (Symphonic and solo instruments)

• Classical music is worldwide

• Classical music have a long cross cultural tradition

• Classical music is ”neutral” compared to more modern genres

• Classical music have many colours and temper

• Classical music is not just classical (mixing with ambiences, beats)

• Classical music can influence body and intelligence remarkably

• Classical music has a long story of emotionalization through media

AMBIENT REPRESENTATION

• Ambiences can project local environment (chain ghost)

• Ambiences have potential of creating sound ecology climates

• Ambiences can dull, motivate, direct users sub/conscious

• Ambiences can project certain emotions

• Ambiences can represent many levels of ghost interaction

• Mads!?

BOTTOM LINE

PROTOGHOST DEADLINE IS SEPTEMBER 2004

DECREASE COMPLEXITY – INCREASE SIMPLICITY

BUZZWORDS RANDOMNESS, STRUCTURE AND EMOTIONALIZATION

CREATE CORE TECHNOLOGY (VXML. DELCA/HTML.)

ONE PROTOGHOST

WHICH?

http://delca.itu.dk/protoghost/debating_synthesis.mp3

BUTLER

CHARLES: ”...I SUGGEST MYSELF ASTHE BUTLER VOICE! AND HERE IS WHY!

I SOUND SNOBBISH! TYPICAL BRITISH!

I GOT CHARACTER AND POTENTIAL!

DONT YOU THINK?

BUTLER

AUDREY: ”...YES MY LOVE!

HOWEVER IT IS WORTH CONSIDERATING A FEMALE BUTLER!

PLEASE NOTE THAT APROX 70% OF ITU STUDENTS ARE MALE!

BUTLER

MIKE: ”...SORRY MAY I INTERRUPT?

DONT YOU THINK IT WOULD BE COOLER TO HAVE A MORE EXPRESSIVE AND YOUTHFUL VOICE?

I AM MIKE, BY THE WAY!

BUTLER

CRYSTAL: ”...HEY WHAT ABOUT ME!?

ME MEME! YES ME!? ME! ME! ME! ME!

BUTLER

REINER: ”...UND ICH! MEIN NAME IST REINER!

UND ICH COULD BE THE SUPER BUTLER!

THAT WOULD NOT BE A PROBLEM AT ALL!?

BUTLER

KLARA: ”...UND ICH AUCH!

MEIN NAME IST KLARA!

UND MEINE ENGLISH SKILLS SIND SUPER!

BUTLER

CHARLES: ”...NOW PLEASE!

BEHAVE MY CHILDREN!

I KNOW YOU ALL WANT A PART OF THE BREAD! BUT THERE CAN ONLY BE ONE BUTLER!

GOOD BYE FOR NOW...

SURPRISE!!!

SURPRISE

Full 5.1 Digital Symphony

Opera with solo voice (Vocaloid)

350 piece Choir singing Delca Hymn

Full symphonical orchestra (US standard)

True legato instruments