“ MADO ”

Ontological Device

窓

Many people in today’s world feelit is “hard to survive”.

What can digital technologyoffer to tackle such issues and

to make humans content once more?

Sony is now commencing such trials.

Ontological Device

MADO

A device designedto let you fully feel

such comfort.

Be Together

“MADO” offers

[ Reality ]A “sense of presence” as if

it’s right in front of you.

[ Aura ]A “sensation” of being in the

same space.

Natural Communication Beyond Distance

[ Reality ]A “sense of presence” as if

it’s right in front of you.

[ Aura ]A “sensation” of being

in the same space.

With a feeling of comfort andconnectedness, you can sense thespirit and presence of family andcolleagues who are far away.

What “MADO” makes possible

Adjacency Co-creation Emergence

Engage in interactive creative workwith life-sized companions, includingphysical motions.

Create a field where you can feeleach other’s existence, with thesensation of being in the same spacetogether.

For tackling various issues, why ? MADO

One cause of finding it hard to get by for people today is “perceptive balance in disarray”

Why people today find it

hard to get by.

Educational disparity

Employment disparity

Opaque prospects(VUCA era)

Explosion of information

Reduced human

relationships

Perceptive balance

in disarray

Two senses humans are gifted with

Analyze subject by function and objective, aiming to

control it efficiently.

Cognition Perception

Perceive subject as it is, and accept movement of one’s mind

and feeling as it is.

When these two senses are functioning in balance

Soundness of body and mind, and sense of well-being is achieved.

Cognition Perception

As a result of carrying “cognition” to extremes, the fundamental well-

being of humans is in jeopardy.

Cognition

The issue we have

Perception

To tackle the issue

Cognition PerceptionWe need to redress the balance of “cognition”

and “perception”.

W h e n t w o p e r c e p t i o n s a r e f u n c t i o n i n g i n a g o o d e q u i l i b r i u m , t h e r e s u l t i s a s t a t e o f h a p p i n e s s p h y s i c a l l y , m e n t a l l y a n d s o c i e t a l l y .

I f t h e e q u i l i b r i u m o f t h e t w o p e r c e p t i o n s i s o u t o f s y n c , t h e r e s u l t i s d e t a c h m e n t f r o m p h y s i c a l , m e n t a l a n d s o c i e t a l s t a t e o f h a p p i n e s s .

“Experiencing co-existence”What is required to redress the equilibrium of “cognition” and “perception’ is

or simply put;

“Just being together”.

People have always sought the feeling of “Co-existence”.

S t a y c o n n e c t e d v i a s m a r t p h o n e c o n v e r s a t i o n s .

F e e l t h e p r e s e n c e o f t h e d e p a r t e d t h r o u g h r i t u a l o b j e c t s .

OntologyThe study of existence, being, and becoming.

provides the “co-existence” feeling that people today are subconsciously yearning for.

”Ontological Device”

Ontological Device

MADO

Technology in “MADO” and its effects.

Vertical Large ScreenReality

Environmental Equalizer

Power/Bandwidth Saving

Reality

Reality Aura

Aura

AuraDialogue with a life-sized counterpart

Stereo Echo CancellingHands-free conversation in both directions simultaneously

Low latency CommunicationNatural interactionWithout discomfort

Connection ControlComfortable sense of distance

Cuts out grating noise

Processing to maintain connection

VisualVertical 4K Large Screen allows to sense the existence and ambiance Separate background, synthesize with natural color and 3D space

Interaction

Audio

Technology in “MADO” and its effects.

[ Reality ]as if right in front of you

[ Aura ]being in the same space

4K/8K Super-resolution TechnologyHD/4K is rendered into 4K/8K super-resolution beyond band limitation

HDR TechnologyExpresses extremely vivid footage with high dynamic range as actual light

Vertical Large Screen

Connection ControlCreate a comfortable sense of distance with cognitive expressions

Lighting AdjustmentAdjust natural footage aligned to the color of the room’s lighting

Background Separation / Synthesis

Give a feeling of being in a distant surrounding space

Stereo Echo Cancelling TechnologyHQ sound to realize hands-free conversation with full duplex transmission.

Sound Localization TechnologyHear sound from speakers and sound sources of environment.

Surround Technology

Environmental EqualizerDetect grating ambient sounds and optimize environmental equalizer

P2P secure and safe transmission for privacy consideration

Low latency transmission technologyLow latency transmission for natural communication

QoS TechnologyPrioritize crucial footage and sound data to maintain quality

Secure Transmission Technology

Expression of Multi-location Slit UIConnect multi locations with simultaneous parallel slit expression

Power/Bandwidth SavingProcessing for always-on connection

Yusuke SakaiSony CorporationR&D CenterSenior UX Planner

SRE AI Partners Corp.General Manager

Since joining Sony 20 years ago, I have continued working towards the realization

of Telepresence System “MADO” that connects human to human, human to the

world through natural communication as if in the same place beyond distance.

”MADO” is the condensation of Sony’s unique, special visual / audio / interaction

technologies from an ontological perspective. By providing a reality as though the

counterpart is right in front of you and inspiring a sensation and ambiance of sharing

the same space, this device appeals to human‘s sense of “co-existence”.

I believe “MADO” provides the aimless and comfortable time in daily life, and the

“just being together” feeling of “co-existence”. And it can reawaken the nearly lost

sense of “perception” and will go on to create a genuine sensation of both physical

and mental well-being for the people who live in the coming decades.

aibo

pursues excitement and curiositybeyond objective and meaning,

WALKMAN

Delivering real voice and sound,transcending time and space

BRAVIA

Reproducing highly real footageas if you are actually in there.

Xperia

Connect person to persontranscending distance

Sense of sight, hearing and touch offers an immersive experience.

PlayStation®5

Sony has transformed lifestyles,continuing to unleash creativity together

with novel concepts and technologies.

Drawing on the spirit handed down to develop an “ontological device”

Various “Co-existence” experiencesMADOrealized by

Scene where “co-existence” is required

“Education”

Expediting a shift from a problem-solving approach thatprioritizes the quickest and most accurate response to aquestion with one specific correct answer, to a co-creationapproach conducive to creative and cooperative action in variouscircumstances by drawing on the individuality and autonomy ofeveryone. A whole new concept of education is required foracquiring a new approach.

“MADO” partnered with persons and teams in remote islandsand mountainous areas, attempting to get closer to students andto create profound and interactive learning, as a flag bearer ofsuch transformation. The team is aiming to realize a next-generation education solution that transcends distance, byresolving the lack of expert instructors due to geographicalrestrictions.

In Ama town in Shimane Prefecture, the island’s highschool students were lacking physics expert teachersrequired for attempting to get into elite scienceuniversity departments.By deploying “MADO” in the public tutoring school

“Oki Learning Center”, students can always receivespace-transcending individual tutoring with a tutor inTokyo. Feeling the space on the other side of “MADO”and the presence of the teacher that come to the schoolin the evening, students are studying assiduously.Using a white-board, the life-sized teacher can closely

monitor the students note-taking and understanding,and have a high-quality simultaneous two-way dialoguethanks to the stereo echo cancellation.

One-on-one instruction for students in remote islands

Scene where “co-existence” is required

“Education”

“Work”

Scene where “co-existence” is required

The ideal state of organizations and jobs that have typicallyemphasized productivity and efficiency to maximize “results”, isalso continuing to change.

A shift from the outdated approach of pursuing share anddominance of markets through a management deploying humanresources using an arbitrary strategy, to a new approach whereeach field person can extract and integrate information andsensations that they feel on the front line into a team that ispsychologically secure and provides high quality relationships,which allows autonomous, interactive and substantive output.

For partner companies and teams aspiring toward this new wayof working or organizing enterprises, we are connecting remotecolleagues and spaces with “MADO” and catalyzing ever-morecreative group work and team-building.

PBL (Problem/Project-Based Learning) Workshop

Scene where “co-existence” is required

“Work”

With younger generations heading to the cities and therural population dwindling, “Future Session in Kochi”was held to discuss what can be done to create anenvironment where children can imagine to workhappily in future. Connecting a base in downtown Kochiwith a learning center in the mountainous area with“MADO”, a top facilitator presided over a workshopattended by interested parties from inside and outsideof the prefecture with a variety of ages and specialties.Life-sized high school students attended by “MADO”

and their discussions about the future fomented a senseof unity within the venue, and members completing thetwo-day project were beaming with smiles as theyexchanged high-fives.

“Home”

Scene where “co-existence” is required

At the period of rapid economic growth, urbanization rapidlyadvanced as a gambit to maximize the output of the state andcorporations, which gave rise to the nuclear family lifestyle.

In a society where people have cast off the traditionalrelationships of kinship and territory in exchange for freedomand convenience, time for conversation and mingling withclose family members and neighbors is being lost due to thebusiness of everyday life and the shrinking of householdnumbers from the aging population and failing birthrate,leaving people bereft of “affiliation” without being cognizant.

“MADO” formulates a life space where people can feel eachother’s presence and ambiance and think about each otherwith ease, by “aimlessly” connecting such family members.

Living together with family that live apart“Home”

A son and his family living in the city away from home,and his mother living back at home in Nagasaki. Sinceher husband passed away, she has lived alone and losther rhythm for both diet and sleeping. However, byinstalling “MADO”, she now wakes every morning to thesound of her granddaughter’s piano practice and cansend her son and daughter off to work and school with awave. Even if nobody is there, children’s toys and booksmove around the living room through “MADO”,engendering a feeling of daily life. “It has changed mylife”, the mother said.Pursuing linkages in the domains of caregiving and

medicine, we will explore the ideal state of the family ofthe future.

Scene where “co-existence” is required

The potential of “MADO” continues to expand

PBL WorkshopsGeopark learning for regional revitalizationMusic sessions

Remote consulting

Remote living

Remote collaboration

AdjacencyLiving together with family Creating a close family atmosphere in care homes Connecting the workspace to the daycare space.

EmergenceCo-creation

Cognition Perception

Sight

Hearing

Touch

Gathering of separate energies

Revitalization of communication

Emergence of high-order energy

1-on-1 instruction for students in islands. Financial consultingRemote diagnosis

for tackling communication issues of people today, and bringing about genuine well-being

MADO

Connect people to peoplenot by roles and abilities, but by existence

“MADO” invokes “Love”in people’s hearts.

A device for invoking “Love” in heartsand actualizing human’s happiness

The Story Will Go On...