us010432731b2 ( 12 ) united states patent ( 10 ) patent no . : us...

27
US010432731B2 ( 12 ) United States Patent Shin et al . ( 10 ) Patent No .: US 10 , 432 , 731 B2 (45) Date of Patent : Oct . 1 , 2019 ( 54 ) ELECTRONIC DEVICE AND METHOD OF CONTROLLING SENSORS CONNECTED THROUGH NETWORK ( 52 ) U .S. CI . CPC ... .. . .. H04L 67 / 125 ( 2013 . 01 ); H04L 12 / 2823 ( 2013 . 01 ) ; H04L 43 / 10 ( 2013 . 01 ) ( 58 ) Field of Classification Search CPC .. . HO4L 67 / 125 ; H04L 12 / 2823 ; H04L 43 / 10 USPC .. . ... ... ... ... ... ...... 709 / 217 See application file for complete search history . ( 71 ) Applicants : SAMSUNG ELECTRONICS CO ., LTD ., Suwon - si , Gyeonggi - do ( KR ); RESEARCH & BUSINESS FOUNDATION , SUNGKYUNKWAN UNIVERSITY , Suwon - si , Gyeonggi - do ( KR ) ( 72 ) Inventors : Dong - kun Shin , Seoul ( KR ); Eun - soo Park , Yongin - si ( KR ); Si - hoon Choi , Seoul ( KR ); Gyeong - hwan Hong , Suwon - si ( KR ) ( 56 ) References Cited U .S. PATENT DOCUMENTS 2012 / 0047551 Al * 2/ 2012 Pattar . .. . . . . . . .. . . .. . . . . . . . H04W 4 / 00 726 / 1 2013 / 0086245 A1 * 4 / 2013 Lu .. . . . . . . . . . . . . . . . . . . .. HO4L 12 / 2807 709 / 223 2014 / 0184422 Al * 7/ 2014 Mensinger . . . . . . . . . . . A61B 5/ 0004 340 / 870 . 02 ( Continued ) ( 73 ) Assignees : Samsung Electronics Co . , Ltd . , Suwon -si, Gyeonggi - do ( KR ); Research & Business Foundation , Sungkyunkwan University , Suwon - si , Gyeonggi - do ( KR ) ( * ) Notice : Subject to any disclaimer , the term of this patent is extended or adjusted under 35 U .S .C . 154 (b ) by 223 days . ( 57 ) ( 21 ) Appl . No .: 15 / 401 , 295 ( 22 ) Filed : Jan . 9 , 2017 FOREIGN PATENT DOCUMENTS KR 10 - 2014 - 0074357 6 / 2014 Primary Examiner - Sm A Rahman ( 74 ) Attorney , Agent , or Firm Nixon & Vanderhye P.C . ABSTRACT Disclosed is an electronic device configured to connect with at least one sensor device through a network . The electronic device includes a communicator comprising communication circuitry configured to communicate with the at least one sensor device and a user terminal , a storage configured to store information of data acquiring methods available for the sensor device and information of settings of a current data acquiring method and a processor configured to determine whether data is acquirable based on the stored information of the data acquiring methods in response to a request for acquiring the data from the user terminal with respect to the at least one sensor device , and to control the at least one sensor based on the determination . ( 65 ) Prior Publication Data US 2017 / 0214745 A1 Jul . 27 , 2017 ( 30 ) Foreign Application Priority Data Jan . 21 , 2016 ( KR ) . . . . . . . .. . . . . . . . . . . . . .. 10 - 2016 - 0007679 ( 51 ) Int . Ci . G06F 15 / 16 H04L 29 / 08 H04L 12 / 28 H04L 12 / 26 ( 2006 . 01 ) ( 2006 . 01 ) ( 2006 . 01 ) ( 2006 . 01 ) 18 Claims , 17 Drawing Sheets 200 2001 201 301 300 300 -1 302 110 132 100 140 142 - mi SENSING DATA ACQUIRED AT APPLICATION PROGRAM FIRST USER TERMINAL FIRST APPLICATION PROGRAM 144 SECOND APPLICATION PROGRAM - 202 146 SECOND USER TERMINAL wwwwwww THIRD APPLICATION PROGRAM FIRST SENSOR DEVICE FIRST SENSING DATA FIRST PHYSICAL VIRTUAL SENSOR | ACQUIRED AT SENSOR NETWORK SENSING SECOND PROCESSOR DATABASE SECOND 200 -2 VIRTUAL SENSOR SENSOR DEVICE U ( SD ) THIRD SECOND PHYSICALI VIRTUAL SENSOR SENSOR ADDITIONAL STORAGE FOR INFORMATION ABOUT LIST OF THIRD REPORT ON DATA ACQUIRING METHODS AND AVAILABILITY TEST SENSOR DEVICE AVAILABLE SENSOR DIRECTORY THIRD PHYSICAL SENSING DATA FIRST ACQUIRING THIRD GATEWAY SENSOR METHODS SENSOR DEVICE SENSOR DEVICE DEVICE FOURTH PHYSICANE FIRST THIRD FIRST SENSOR PHYSICAL PHYSICAL VIRTUAL SETTINGS OF SENSOR SENSOR SENSOR FIFTH PHYSICAL VI DETERMINED SENSING DATA FOURTH SECOND SENSOR SECOND ACQUIRING PHYSICAL VIRTUAL III METHOD SENSOR DEVICE SENSOR SENSOR SECOND FIFTH THIRD 200 - 3 205 204 203 PHYSICAL PHYSICAL VIRTUAL SENSOR SENSOR SENSOR 300 - 2 303 - 304 305 NOTIFICATION OF SENSOR DIRECTORY FOURTH APPLICATION PROGRAM FIFTH APPLICATION PROGRAM LE SETTINGS OF SENSING DATA ACQUIRING METHOD THIRD USER TERMINAL SIXTH APPLICATION PROGRAM 134 * * * 300 - 3 306

Upload: others

Post on 15-Jul-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: US010432731B2 ( 12 ) United States Patent ( 10 ) Patent No . : US …nyx.skku.ac.kr/wp-content/uploads/2020/06/US10432731.pdf · 2020-06-19 · US010432731B2 ( 12 ) United States

US010432731B2

( 12 ) United States Patent Shin et al .

( 10 ) Patent No . : US 10 , 432 , 731 B2 ( 45 ) Date of Patent : Oct . 1 , 2019

( 54 ) ELECTRONIC DEVICE AND METHOD OF CONTROLLING SENSORS CONNECTED THROUGH NETWORK

( 52 ) U . S . CI . CPC . . . . . . . . H04L 67 / 125 ( 2013 . 01 ) ; H04L 12 / 2823

( 2013 . 01 ) ; H04L 43 / 10 ( 2013 . 01 ) ( 58 ) Field of Classification Search

CPC . . . HO4L 67 / 125 ; H04L 12 / 2823 ; H04L 43 / 10 USPC . . . . . . . . . . . . . . . . . . . . . . . . 709 / 217 See application file for complete search history .

( 71 ) Applicants : SAMSUNG ELECTRONICS CO . , LTD . , Suwon - si , Gyeonggi - do ( KR ) ; RESEARCH & BUSINESS FOUNDATION , SUNGKYUNKWAN UNIVERSITY , Suwon - si , Gyeonggi - do ( KR )

( 72 ) Inventors : Dong - kun Shin , Seoul ( KR ) ; Eun - soo Park , Yongin - si ( KR ) ; Si - hoon Choi , Seoul ( KR ) ; Gyeong - hwan Hong , Suwon - si ( KR )

( 56 ) References Cited

U . S . PATENT DOCUMENTS 2012 / 0047551 Al * 2 / 2012 Pattar . . . . . . . . . . . . . . . . . . . . . . H04W 4 / 00

726 / 1 2013 / 0086245 A1 * 4 / 2013 Lu . . . . . . . . . . . . . . . . . . . . . . HO4L 12 / 2807

709 / 223 2014 / 0184422 Al * 7 / 2014 Mensinger . . . . . . . . . . . A61B 5 / 0004

340 / 870 . 02 ( Continued )

( 73 ) Assignees : Samsung Electronics Co . , Ltd . , Suwon - si , Gyeonggi - do ( KR ) ; Research & Business Foundation , Sungkyunkwan University , Suwon - si , Gyeonggi - do ( KR )

( * ) Notice : Subject to any disclaimer , the term of this patent is extended or adjusted under 35 U . S . C . 154 ( b ) by 223 days .

( 57 ) ( 21 ) Appl . No . : 15 / 401 , 295 ( 22 ) Filed : Jan . 9 , 2017

FOREIGN PATENT DOCUMENTS KR 10 - 2014 - 0074357 6 / 2014 Primary Examiner - Sm A Rahman ( 74 ) Attorney , Agent , or Firm — Nixon & Vanderhye P . C .

ABSTRACT Disclosed is an electronic device configured to connect with at least one sensor device through a network . The electronic device includes a communicator comprising communication circuitry configured to communicate with the at least one sensor device and a user terminal , a storage configured to store information of data acquiring methods available for the sensor device and information of settings of a current data acquiring method and a processor configured to determine whether data is acquirable based on the stored information of the data acquiring methods in response to a request for acquiring the data from the user terminal with respect to the at least one sensor device , and to control the at least one sensor based on the determination .

( 65 ) Prior Publication Data US 2017 / 0214745 A1 Jul . 27 , 2017

( 30 ) Foreign Application Priority Data Jan . 21 , 2016 ( KR ) . . . . . . . . . . . . . . . . . . . . . . . 10 - 2016 - 0007679

( 51 ) Int . Ci . G06F 15 / 16 H04L 29 / 08 H04L 12 / 28 H04L 12 / 26

( 2006 . 01 ) ( 2006 . 01 ) ( 2006 . 01 ) ( 2006 . 01 ) 18 Claims , 17 Drawing Sheets

200 2001 201 301 300 300 - 1 302 110 132 100 140 142

-

mi

SENSING DATA ACQUIRED AT APPLICATION PROGRAM

FIRST USER TERMINAL

FIRST APPLICATION PROGRAM

144 SECOND APPLICATION

PROGRAM - 202

146 SECOND USER TERMINAL wwwwwww

THIRD APPLICATION PROGRAM

FIRST SENSOR DEVICE FIRST SENSING DATA FIRST PHYSICAL VIRTUAL SENSOR | ACQUIRED AT SENSOR NETWORK SENSING SECOND PROCESSOR DATABASE SECOND 200 - 2 VIRTUAL SENSOR SENSOR DEVICE U ( SD )

THIRD SECOND PHYSICALI VIRTUAL SENSOR

SENSOR

ADDITIONAL STORAGE FOR INFORMATION ABOUT LIST OF THIRD REPORT ON DATA ACQUIRING METHODS AND AVAILABILITY TEST SENSOR DEVICE AVAILABLE SENSOR DIRECTORY THIRD PHYSICAL SENSING DATA FIRST ACQUIRING THIRD GATEWAY SENSOR

METHODS SENSOR DEVICE SENSOR DEVICE DEVICE FOURTH PHYSICANE FIRST THIRD FIRST

SENSOR PHYSICAL PHYSICAL VIRTUAL SETTINGS OF SENSOR SENSOR SENSOR

FIFTH PHYSICAL VI DETERMINED SENSING DATA FOURTH SECOND SENSOR SECOND ACQUIRING PHYSICAL VIRTUAL

III METHOD SENSOR DEVICE SENSOR SENSOR

SECOND FIFTH THIRD 200 - 3 205 204 203 PHYSICAL PHYSICAL VIRTUAL

SENSOR SENSOR SENSOR

300 - 2 303 - 304 305

NOTIFICATION OF SENSOR DIRECTORY

FOURTH APPLICATION PROGRAM

FIFTH APPLICATION PROGRAM

LE SETTINGS OF SENSING DATA ACQUIRING METHOD

THIRD USER TERMINAL

SIXTH APPLICATION PROGRAM

134 * * *

300 - 3 306

Page 2: US010432731B2 ( 12 ) United States Patent ( 10 ) Patent No . : US …nyx.skku.ac.kr/wp-content/uploads/2020/06/US10432731.pdf · 2020-06-19 · US010432731B2 ( 12 ) United States

US 10 , 432 , 731 B2 Page 2

( 56 ) References Cited U . S . PATENT DOCUMENTS

2015 / 0373482 A1 * 12 / 2015 Barnard . . . . . . . . . . . . H05B 37 / 0272 370 / 338

* cited by examiner

Page 3: US010432731B2 ( 12 ) United States Patent ( 10 ) Patent No . : US …nyx.skku.ac.kr/wp-content/uploads/2020/06/US10432731.pdf · 2020-06-19 · US010432731B2 ( 12 ) United States

200

200 - 1

201

FIG . 1 132 100

301 300

300 - 1

302

110

940

942

atent

*

* *

*

*

* *

*

*

OK OR * *

OK

A cox

-

W

-

in

nnnri

- -

wwwwwwwwwwwwwwwwwwwwwwwwwwwwy

FIRST USER TERMINAL

- -

n

A

wwwwwwww

- -

W

YYYYYYYY

- -

FIRST

Y XYYYYYYYYYY - - - -

SENSING DATA ACQUIRED AT APPLICATION PROGRAM

- - -

FIRST APPLICATION PROGRAM -

ARUSHA AR

-

with the test wel ww ww ww when you

Vuu

w

-

*

-

WWWWWWWWWWWWWWWWXXYYYYYYYYYYY S

MTWT

V

* * *

- -

WWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWW

Oct . 1 , 2019

um

SECOND APPLICATION PROGRAM

- 144

- - -

MW -

* * * * *

- -

- 146

YYYYYYYYYYYY

- - IKKEEYYYYYY * * XXY XEME

- -

SECOND USER TERMINAL

KOCH

w

w

- -

w .

we went the other

- -

300 - 2 303 -

HY

- - - - - -

11111 norre wwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwww

THIRD APPLICATION PROGRAM - -

YEY

- -

w

-

FIRST SENSOR DEVICE

SENSING DATA

FIRST PHYSICAL

VIRTUAL SENSOR

ACQUIRED AT

SENSOR

NETWORK

SENSING

SECOND

PROCESSOR museo DATABASE

SECOND

arterine 200 - 2

VIRTUAL SENSOR

SENSOR DEVICE

( SD )

202

THIRD

SECOND PHYSICALI

VIRTUAL SENSOR

SENSOR

ADDITIONAL STORAGE FOR INFORMATION ABOUT LIST OF

REPORT ON I DATA ACQUIRING METHODS AND AVAILABILITY TEST

SENSOR DEVICE

AVAILABLE

SENSOR DIRECTORY

THIRD PHYSICAL

SENSING DATA

FIRST

ACQUIRING

THIRD

GATEWAY

SENSOR

METHODS

SENSOR DEVICE SENSOR DEVICE | | DEVICE

FOURTH PHYSICAMI

THIRD

FIRST

SENSOR

PHYSICAL PHYSICAL VIRTUAL

SETTINGS OF SENSOR

SENSOR

SENSOR

FIFTH PHYSICAL

DETERMINED

FOURTH

SENSING DATA

SECOND

SENSOR

SECOND

ACQUIRING

PHYSICAL VIRTUAL

puummmwwwwwwwwww

SENSOR DEVICE

SENSOR

METHOD

SENSOR

SECOND

FIFTH

THIRD

200 - 3 205 204 203

PHYSICAL PHYSICAL VIRTUAL

SENSOR

SENSOR

SENSOR

- - - - -

WWWWWWWWWWWWWwwwwwwwwwwwww

- -

FOURTH APPLICATION PROGRAM - -

Sheet 1 of 17

AAAALALALALALALALALALALALALALAL

- - REYXYXYYYYYYYXYXXXXXXWWV

- -

YYYYYYYYYYY

NOTIFICATION OF SENSOR DIRECTORY

RO .

- -

WWWWwwwwwwwwwwwwwwwwwwwwwwwwwwwww

T

E

X

*

*

*

* *

*

* * *

*

*

* *

* *

*

???????????????????? ?????????????

* *

K AKKAAKKAAK * * *

M

- - -

inn mwWWWWWW

WWWWWWWWWWWWW A

-

FIFTH APPLICATION PROGRAM -

wwwwwwwwwwwwwwwwwww

-

YYYY

in -

U

UTISET

W W

.

.

R

wwwwwwwwwwwwwww w

wwwwww

wwwwwwwwwwwww

NAHKAMAHAK A

MA WAWACARMAKHLAKKAMMALAM

- -

Y

- -

THIRD USER TERMINAL

SETTINGS OF SENSING DATA ACQUIRING METHOD

Y

- - - -

KA

wa inah

WA URA KAKA

wwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwww

- -

AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA

WWWWWWWWWWWWWWWWWWWWWWWWWWWWWWW

????????????????????????????????????????

HIRUKKUMMWWMWWYMYWW - -

SIXTH APPLICATION PROGRAM - - - - - - -

134

4 .

-

WWW

m

eewwwwwwwwww

US 10 , 432 , 731 B2

LALAR wwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwww * * * * *

300 - 3

306

w

ww

wwwwwwwwwwww w wwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwww

Page 4: US010432731B2 ( 12 ) United States Patent ( 10 ) Patent No . : US …nyx.skku.ac.kr/wp-content/uploads/2020/06/US10432731.pdf · 2020-06-19 · US010432731B2 ( 12 ) United States

atent Oct . 1 , 2019 Sheet 2 of 17 US 10 , 432 , 731 B2

FIG . 2

100 200 - 1

REQUEST FOR SENSING DATA ( GET )

FIRST SENSOR DEVICE

- - ????

SENSING DATA ( ACK ) W WW

H

KARA 1 . NA

PHYSICAL VIRTUAL SENSOR 201 AWA

PAMAMAMALAN SENSOR REQUEST FOR SENSING DATA ( GET )

SENSING DATA ( ACK ) WWUWAUAWAMUUA M . MEMEK

Page 5: US010432731B2 ( 12 ) United States Patent ( 10 ) Patent No . : US …nyx.skku.ac.kr/wp-content/uploads/2020/06/US10432731.pdf · 2020-06-19 · US010432731B2 ( 12 ) United States

atent Oct . 1 , 2019 Sheet 3 of 17 US 10 , 432 , 731 B2

FIG . 3

200 - 1

OBSERVER REGISTRATION ( OBSERVE

FIRST SENSOR DEVICE

+ + C + 0 + 0 + 0 + 0 + + + + + + + + + + + + +

SENSING DATA ( NOT HHHHH

WWWWW 142 VIRTUAL SENSOR

PHYSICAL SENSOR 201 SENSING DATA ( NOTIFY )

SENSING DATA ( NOTIFY ) , URULURUL XX

Page 6: US010432731B2 ( 12 ) United States Patent ( 10 ) Patent No . : US …nyx.skku.ac.kr/wp-content/uploads/2020/06/US10432731.pdf · 2020-06-19 · US010432731B2 ( 12 ) United States

atent Oct . 1 , 2019 Sheet 4 of 17 US 10 , 432 , 731 B2

FIG . 4

200 - 1

OBSERVER REGISTRATION ( OBSERVE ) AND

THRESHOLD SETTING WWWWWWW FIRST SENSOR

DEVICE * o o * * * * * * *

( OMISSION DUE TO LITTLE CHANGE IN SENSING DATA ) KRAKAUXERAWARAKAXXARXXXX XXX WWW KUALA LUM

142 VIRTUAL SENSOR

PHYSICAL SENSOR

201 Vwvwvwwwvvwvvwvwwwwwwwwwwwwww ( OMISSION DUE TO LITTLE CHANGE IN SENSING DATA )

XXXXXX WURARVELOCMXXXXXX

WAKATERKAWANXXXXWAARMERKERRANXXX SENSING DATA ( NOTIFY )

AAAAA S3

Page 7: US010432731B2 ( 12 ) United States Patent ( 10 ) Patent No . : US …nyx.skku.ac.kr/wp-content/uploads/2020/06/US10432731.pdf · 2020-06-19 · US010432731B2 ( 12 ) United States

atent Oct . 1 , 2019 Sheet 5 of 17 US 10 , 432 , 731 B2

FIG . 5

200 - 1

OBSERVER REGISTRATION ( OBSERVE ) AND

BATCHING SIZE SETTING FIRST SENSOR

DEVICE + 44 2048 : 90D0 BRA 4 ROOD , AAA 49 BOSQ42

A CHURCHLUWUXALAXXAUKACHCHIWUULX 142 VIRTUAL

SENSOR ACHUUMLAUAX PHYSICAL SENSOR 201

PAVALAXXXXXXXL LLLL UUUUURIALXXXV W

| _ ( NOTIFY ( 31 ) - 92 - 334 SENSING DATA

( NOTIFY $ 1 S3 *

UCHLULUKUU

Page 8: US010432731B2 ( 12 ) United States Patent ( 10 ) Patent No . : US …nyx.skku.ac.kr/wp-content/uploads/2020/06/US10432731.pdf · 2020-06-19 · US010432731B2 ( 12 ) United States

atent Oct . 1 , 2019 Sheet 6 of 17 US 10 , 432 , 731 B2

FIG . 6

START

S110 REPORT INFORMATION ABOUT DATA ACQUIRING METHOD AVAILABLE FOR AT LEAST ONE SENOR DEVICE AND INFORMATION ABOUT SETTINGS OF

CURRENT DATA ACQUIRING METHOD LELAKUXXARACA MAMMA

S120 MAKE REQUEST FOR SETTINGS OF DATA ACQUIRING METHOD TO AT LEAST ONE SENSOR DEVICE FROM USER TERMINAL AND SET DATA ACQUIRING METHOD

wwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwww

$ 130 - DATA REQUESTED BY USER TERMINAL ACQUIRABLE ?

$ 170 YES

wwwwwwwwwwwwwwwwww VU

1 * *

w CAL 2

$ 140 . UPDATE CURRENTLY SET ACQUIRING METHOD WITH REQUESTED ACQUIRING METHOD XennnOXXX NOTIFY USER TERMINAL THAT REQUESTED

ACQUIRING METHOD IS IMPOSSIBLE

TO ACQUIRE DATA YNN $ 150 TRANSMIT AND SET REQUESTED ACQUIRING METHOD

TO AT LEAST ONE SENSOR XATX

S160 NOTIFY OF SUCCESSFUL SETTING WITH REQUESTED ACQUIRING METHOD TO THE USER TERMINAL KOM ????

??????? $ 180 - RECEIVE SENSING DATA FROM AT LEAST ONE SENSOR DEVICE WEMAX

wwwww

wwww $ 190 - TRANSMIT RECEIVED SENSING DATA TO

USER TERMINAL ULUKUU Kuid

CEND

Page 9: US010432731B2 ( 12 ) United States Patent ( 10 ) Patent No . : US …nyx.skku.ac.kr/wp-content/uploads/2020/06/US10432731.pdf · 2020-06-19 · US010432731B2 ( 12 ) United States

FIG . 7

tttttttttttttttttttttttttt THIRD SENSOR DEVICE

atent

THIRD PHYSICAL SENSOR FOURTH PHYSICAL SENSOR Wwwwww

wwwww

FIFTH PHYSICAL SENSOR

WWWWWWWWWWWWW

Oct . 1 , 2019

REGISTRATION OF SENSOR DEVICE

MESSAGE OF SENSOR DEVICE REGISTRATION

LALALALALALA PILEPIT

PIYUPPIE suddetsiddddddddd dadadadadadada .

9

WWW

SENSOR DIRECTORY

APOTN9I919019119 211

SALSA

SENSOR VALUE

SENSING DATA ATTRIBUTES

AVAILABLE DATA ACQUIRING METHODS

CURRENT DATA ACQUIRING METHODS

??????????????? ????????

.

FIRST SENSOR DEVICE FIRST PHYSICAL SENSOR

" false "

FLAME DETECTION

Bus : P - - / Net : PBM

Bus : P 20 / Net : M10

Sheet 7 of 17

WY

mart wwwwwwwwwww

ANY

I / SECOND SENSOR DEVICE SECOND PHYSICAL SENSOR

420

GAS CONCENTRATION

Bus : P . - - / Net : P .

Bus : P 100 / Net : P 150

WWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWW M

Wii

I / THIRD SENSOR DEVICE THIRD PHYSICAL SENSOR

30 , 80

TEMPERATURE , HUMIDITY

Bus : P - M / Net : PBM

Bus : M 100 / Net : P 50

A KE KWA WI WA . . .

THIRD SENSOR DEVICE FOURTH PHYSICAL SENSOR

771

ATMOSPHERIC PRESSURE

* *

ARK

Bus : P - M / Net : PBM

1

N

WWW

F

ww

WWW WWW KR

THIRD SENSOR DEVICE FIFTH PHYSICAL SENSOR

92

HEART RATE

3

Bus : PBM / Net : PBM

Bus : 8 200 / Net : B 150

US 10 , 432 , 731 B2

porno

i wa KX

E 2

X

wwwww

AA KERR C 60 X A X GAK WOK 4

CHACRAMAX 6

X X

1

6

na 06 * * AX

06 0 CX AK RACE 4 CHAMAX 4XW W JACK DRAW AX X * * *

*

* * * KA +

KOKKU . W

x A

A

X

X X XXXX

. . . . .

.

. .

. .

. . .

.

. .

.

. . . . .

.

. .

. . . . . . . . . .

. .

. .

. . . . . . . . . .

. . .

. . . . . . . . . . . .

ONLYNULLIYOL t

Stuuduttuu tuu . Sulttuu . tutututu

. . . . .

. . .

. . .

. . . . .

.

.

. . .

. .

.

. .

. .

. . . . .

. . . . . . . .

.

.

Page 10: US010432731B2 ( 12 ) United States Patent ( 10 ) Patent No . : US …nyx.skku.ac.kr/wp-content/uploads/2020/06/US10432731.pdf · 2020-06-19 · US010432731B2 ( 12 ) United States

FIG . 8

atent

STORAGE OF LIST OF DATA STORAGE OF CURRENT DATA ACQUIRING METHODS ACQUIRING METHOD AVAILABLE FOR SENSOR DESIGNATED BY TERMINAL

DEVICES

DEVICE

SENSOR DIRECTORY

w

#

hot w

a

t

het hom

with all the time it withi ma

h

.

.

. . A

. .

. .

. . . .

.

.

URI

MWWWW

SENSOR VALUE

SENSING DATA ATTRIBUTES

USER LIST

AVAILABLE DATA ACQUIRING METHODS

CURRENT DATA ACQUIRING METHODS

Oct . 1 , 2019

*

MTYw wwwwwwwwwww

* 2

FIRST SENSOR DEVICE / FIRST PHYSICAL SENSOR

" false "

FLAME DETECTION

FIRST USER TERMINAL . FIRST VIRTUAL SENSOR

Bus : P . - / Net : PBM

Bus : P20 / Net : M 10

u

SECOND SENSOR DEVICE SECOND PHYSICAL SENSOR

wwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwww

VW

GAS

4201 CONCENTRATION

FIRST USER TERMINAL SECOND VIRTUAL SENSOR

MMAMMA MWWWWWWWWWWWWWWWWARTAWATUMWAMURA !

Bus : pw Net : p .

Bus : P 100 / Net : P 150

Sheet 8 of 17

m

TV

a n

TEMPERATURE ,

/ THIRD SENSOR DEVICE THIRD PHYSICAL SENSOR

30 , 80

FIRST USER TERMINAL , SECOND VIRTUAL SENSORI

Bus : P - M / Net : PBM

Bus : M 100 / Net : P50

* *

THIRD SENSOR DEVICE { FOURTH PHYSICAL SENSOR

ATMOSPHERIC PRESSURE

SECOND VIRTUAL SENSOR Namn ini

Bus : P - M / Net : PBM

Bus : M 100 / Net : M 12M

mama

mama na mamamman . mo

wwwwwwwwwwwwwwwwwwwwwwwwwwwwwwt

A

THIRD SENSOR DEVICE / FIFTH PHYSICAL SENSOR

92

HEART RATE

SECOND VIRTUAL SENSORI

Bus : PBM / Net : PBM

Bus : 8 200 / Net : B 150

US 10 , 432 , 731 B2

M

Page 11: US010432731B2 ( 12 ) United States Patent ( 10 ) Patent No . : US …nyx.skku.ac.kr/wp-content/uploads/2020/06/US10432731.pdf · 2020-06-19 · US010432731B2 ( 12 ) United States

FIG . 9

U . S . Patent

AAALAAA . .

. . . . LALA

A

AAA

FIRST SENSOR DEVICE

T

FIRST PHYSICAL SENSOR

@ SUCCESSFUL

wwwwwwwwww

WWWWWWWWWWWWWWW wwwwwwwwwwwwwwwwwwwwwwwwww

WEWERKER

3SETTINGS OF TESTED DATA ACQUIRING METHOD

MESSAGE FOR SETTING DATA ACQUIRING METHOD

DSETTINGS FOR DATA ACQUIRING METHODS

Oct . 1 , 2019

WWWWWWWWWWWWWWWWWWWWWWWWWWWW MMMMMMMWW

WWWWWWWWWWWWWW

M

SENSOR DIRECTORY

2 CHECK WHETHER DATA ACQUIRING METHOD IS AVAILABLE

* XXXX * +

SENSOR VALUE

URI

SENSING DATA ATTRIBUTES

AVAILABLE DATA ACQUIRING METHODS

CURRENT DATA ACQUIRING METHODS WH A

I

WWI LA MLA WAVE

WA

WILAH ALLAH AH

AL .

/ FIRST SENSOR DEVICE FIRST PHYSICAL SENSOR

" false "

FLAME DETECTION

Bus : P - / Net : PBM

Bus : P 100 / Net : P 50

MMMM LAWAMAMA WA MATA

Sheet 9 of 17

X MM XY * * * mm mmmmmmmmm MARWXXXKWW . . .

mm

n nnnnnnnnnnnnnnnnnnnnnnnnnnnn

SECOND SENSOR DEVICE SECOND PHYSICAL SENSOR

420

GAS CONCENTRATION

Bus : P - / Net P

Bus : P 100 / Net : P 150

wwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwww WWW WWWWWWWWWWWWWWWWWWWWWWWWWWWWW

THIRD SENSOR DEVICE THIRD PHYSICAL SENSOR

30 , 80

TEMPERATURE , HUMIDITY

Bus : P - M / Net : PBM

Bus : M 100 / Net : P 50

THIRD SENSOR DEVICE FOURTH PHYSICAL SENSOR

ATMOSPHERIC 7711

PRESSURE

Bus : P - M / Net : PBM

Bus : M 100 / Net : M 12M

Wh

Winninn

p

THIRD SENSOR DEVICE IFIFTH PHYSICAL SENSOR

921 HEART RATE

Bus : PBM / Net : PBM

Bus : B 200 / Net : B 150 AMATTA ARATATATATATATATAAAAAAAAAA

US 10 , 432 , 731 B2

Page 12: US010432731B2 ( 12 ) United States Patent ( 10 ) Patent No . : US …nyx.skku.ac.kr/wp-content/uploads/2020/06/US10432731.pdf · 2020-06-19 · US010432731B2 ( 12 ) United States

FIG . 10

U . S . Patent

FIRST SENSOR DEVICE

USER TERMINAL 1

FIRST PHYSICAL SENSOR 21222211212121

OFAILED

wwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwww MESSAGE FOR SETTING DATA ACQUIRING METHOD

DSETTINGS FOR DATA ACQUIRING METHODS

Oct . 1 , 2019

wwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwww wwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwww

W

SENSOR DIRECTORY

2 CHECK WHETHER DATA ACQUIRING METHOD IS AVAILABLE

WWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWW WWWWWWWWWWWWWWWWW

Wwwwwwwwwwwwwwwwwww

WWW

SENSOR VALUE

SENSING DATA ATTRIBUTES

AVAILABLE DATA ACQUIRING METHODS

CURRENT DATA ACQUIRING METHODS

URI

HAHRAMANMAMAHA WANAN

+

W

WW .

WWW

21 . 11 . 11

+ WWWWWWWWWW

+ +

* *

IT

+

FIRST SENSOR DEVICE / FIRST PHYSICAL SENSOR

" false "

FLAME DETECTION

+

sangurat

Bus : P . / Net : PBM

NA

Bus : P 20 / Net : M 10

+ +

W

X me

m

omkom WwwWw went the

tot 60XXXWKXXXXXXXXXXXXWA * XXXKANAKAKKUA

.

Sheet 10 of 17

.

.

. .

. .

.

.

.

.

.

. . . .

.

.

.

.

. .

.

. . .

.

. . .

.

.

.

. .

. .

.

.

.

.

. . .

.

.

.

.

.

. .

.

. .

.

.

.

.

. . .

. . . .

.

.

.

.

SECOND SENSOR DEVICE SECOND PHYSICAL SENSOR

GAS CONCENTRATION

Bus : P . Net : P .

Bus : P 100 / Net : P 150

AKUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUU

wwwww Www

WWW

wwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwww WWWWW WWWWWWWWWWWWWWWWW

TEMPERATURE ,

THIRD SENSOR DEVICE / THIRD PHYSICAL SENSOR

30 , 80

Bus : P - M / Net : PBM

Bus : M 100 / Net : P 50

771

ATMOSPHERIC PRESSURE

Bus : P - M / Net : PBM

Bus : M 100 / Net : M 12M

/ THIRD SENSOR DEVICE FOURTH PHYSICAL SENSOR / THIRD SENSOR DEVICE FIFTH PHYSICAL SENSOR

HEART RATE

Bus : PBM / Net : PBM

Bus : B 200 / Net : B 150

LARA

WA

XALANANRAAMAXXXXXX

ARANANANANANARAMANMAXXUXNXVM KRAANANANANANANANANLARLANMAMLANANLUXXXXXXX * * *

US 10 , 432 , 731 B2

Page 13: US010432731B2 ( 12 ) United States Patent ( 10 ) Patent No . : US …nyx.skku.ac.kr/wp-content/uploads/2020/06/US10432731.pdf · 2020-06-19 · US010432731B2 ( 12 ) United States

atent Oct . 1 , 2019 Sheet 11 of 17 US 10 , 432 , 731 B2

FIG . 11

wwww REQUEST FOR SENSING DATA ( 0 SECONDS )

WWW . . . W W WWW * W * * FIRST SENSOR

DEVICE SENSING DATA ACK wwwwwwwwwwwwwwwwwwwwwwwwww - KAXXXXXXXXXXXXXXXXX WRITT VZW REQUEST FOR SENSING DATA ( 5 SECONDS )

wwwwwwww WA WA MW wwwwwww

142 - PHYSICAL SENSOR

201 SENSOR SENSING DATA ACK

TWITTER

REQUEST FOR SENSING DATA ( 10 SECONDS ) MALAKARARAK ARAUKLE WMMMMM UWV ?? ?? ??? ????? ???

SENSING DATA ACK

KANNANANANMUNALNY TY YYYYYYYYYYYYYYYYYYYYYYYYYYYYYYYYYY

Page 14: US010432731B2 ( 12 ) United States Patent ( 10 ) Patent No . : US …nyx.skku.ac.kr/wp-content/uploads/2020/06/US10432731.pdf · 2020-06-19 · US010432731B2 ( 12 ) United States

atent Oct . 1 , 2019 Sheet 12 of 17 US 10 , 432 , 731 B2

FIG . 12

100 200 - 1 REQUEST FOR SENSING

DATA ( 0 SECONDS ) 66

FIRST SENSOR DEVICE

SENSING DATA ACK wwwwwwwwwwwwwwwwwwwww REQUEST FOR SENSING DATA ( 2 . 5 SECONDS )

142 VIRTUAL SENSOR

PHYSICAL SENSOR

201 SENSING DATA ACK ZEITURA

REQUEST FOR SENSING DATA ( 5 SECONDS ) wwwwwwwwwwwwwwwwwwwwwwwwwwww SENSING DATA ACK

Page 15: US010432731B2 ( 12 ) United States Patent ( 10 ) Patent No . : US …nyx.skku.ac.kr/wp-content/uploads/2020/06/US10432731.pdf · 2020-06-19 · US010432731B2 ( 12 ) United States

atent Oct . 1 , 2019 Sheet 13 of 17 US 10 , 432 , 731 B2

FIG . 13

200 - 1 OBSERVER REGISTRATION

( OBSERVE ) AND BATCHING SIZE SETTING FIRST SENSOR

DEVICE

K * XXXXXXX X EXXYYYYYYY wwwwwwwwwwwwwwwwwwwwwwwwwwwwwww wwwwwwwwwwwwwwwww wwwwwwwwwwwww 142 VIRTUAL

SENSOR come ntariamente PHYSICAL SENSOR

FOUR PIECES OF SENSING

DATA S1 WWWWWWWWWWWWWWWWWWWWW S2 S3 S4

Page 16: US010432731B2 ( 12 ) United States Patent ( 10 ) Patent No . : US …nyx.skku.ac.kr/wp-content/uploads/2020/06/US10432731.pdf · 2020-06-19 · US010432731B2 ( 12 ) United States

atent Oct . 1 , 2019 Sheet 14 of 17 US 10 , 432 , 731 B2

FIG . 14

200 - 1 OBSERVER REGISTRATION

( OBSERVE ) AND BATCHING SIZE SETTING

.

YWOWYKW Gaya FIRST SENSOR DEVICE

142 mm VIRTUAL SENSOR

PHYSICAL SENSOR 201

TWO PIECES OF SENSING DATA KAM S NISATA @ @ S2

Page 17: US010432731B2 ( 12 ) United States Patent ( 10 ) Patent No . : US …nyx.skku.ac.kr/wp-content/uploads/2020/06/US10432731.pdf · 2020-06-19 · US010432731B2 ( 12 ) United States

atent Oct . 1 , 2019 Sheet 15 of 17 US 10 , 432 , 731 B2

FIG . 15

200 - 1 OBSERVER REGISTRATION

( OBSERVE ) AND THRESHOLD ( 50 ) SETTING

mm . m mm . www . mu + + FIRST SENSOR DEVICE

( OMISSION DUE TO UTTLE CHANGE IN SENSING DATA )

142 mm VIRTUAL SENSOR

PHYSICAL SENSOR 201

( OMISSION DUE TO LITTLE CHANGE IN SENSING DATA )

SENSING DATA ( NOTIFY ) ( 30° )

W

me

Page 18: US010432731B2 ( 12 ) United States Patent ( 10 ) Patent No . : US …nyx.skku.ac.kr/wp-content/uploads/2020/06/US10432731.pdf · 2020-06-19 · US010432731B2 ( 12 ) United States

atent Oct . 1 , 2019 Sheet 16 of 17 US 10 , 432 , 731 B2

Pooooooo FIG . 16 todo

200 - 1

OBSERVER REGISTRATION ( OBSERVE ) AND

THRESHOLD ( 100 ) SETTING FIRST SENSOR

DEVICE W

SENSING DATA ( NOTIFY ) ( 20° ) C WWMWMMWMMMMMMM SuzukuHUHE

142 meter VIRTUAL SENSOR

SENSING DATA ( NOTIFY ) ( 25°C

PHYSICAL SENSOR 201

UVUGUVU VUUGUUUUU

SENSING DATA ( NOTIFY ) ( 30°C

YUXXXXXXXXXXXXXXXXXX

xxxxx WWWWW

Page 19: US010432731B2 ( 12 ) United States Patent ( 10 ) Patent No . : US …nyx.skku.ac.kr/wp-content/uploads/2020/06/US10432731.pdf · 2020-06-19 · US010432731B2 ( 12 ) United States

FIG . 17

atent

100

www

130 -

STORAGE

320

300

310

120

Oct . 1 , 2019

FIRST PROCESSOR

FIRST vers un COMMUNICATION

MODULE

THIRD COMMUNICATIONS MODULE THIRD PROCESSOR

*

* *

140 -

VIRTUAL SENSOR

Sheet 17 of 17

240 -

PHYSICAL SENSOR

200

40AA7ZNATO

210 bucana

SECOND PROCESSOR

SECOND COMMUNICATION MODULE 220

US 10 , 432 , 731 B2

?????????????????????????????????????????? .

Page 20: US010432731B2 ( 12 ) United States Patent ( 10 ) Patent No . : US …nyx.skku.ac.kr/wp-content/uploads/2020/06/US10432731.pdf · 2020-06-19 · US010432731B2 ( 12 ) United States

US 10 , 432 , 731 B2

ELECTRONIC DEVICE AND METHOD OF to be sent at the same time in case of the batching method , CONTROLLING SENSORS CONNECTED or a threshold value for sending the sensing data in case of

THROUGH NETWORK the model - driven method . In particular , the Internet of Things environment involves

CROSS - REFERENCE TO RELATED 5 more various kinds of sensor devices than the existing APPLICATION mobile environment , and thus different methods of acquiring

the sensing data are used in accordance with the kinds of This application is based on and claims priority under 35 sensor to thereby increase power efficiencies . However , the

U . S . C . $ 119 to Korean Patent Application No . 10 - 2016 method of acquiring the sensing data in the conventional 0007679 , filed on Jan . 21 , 2016 in the Korean Intellectual ellectual 10 virtual sensor technology does not increase the power effi Property Office , the disclosure of which is incorporated by ciencies since it is limited to the REST interface , e . g . , the

reference herein in its entirety . operations of GET ( polling ) and OBSERVE ( push ) . In addition , there is a method of acquiring the sensing data

BACKGROUND even in Internet of Things environments where the virtual 15 sensor is not used . However , this method merely controls a

Field polling cycle , a network transfer cycle and the like fre quency settings for acquiring the sensing data , or selects one The present disclosure relates generally to an electronic among the methods of acquiring the sensing data , i . e . the device and a method of controlling a plurality of sensors polling , push and model - driven methods . However , such a connected through a network , and for example , to an elec - 20 char and for example , to an elec - 20 change in only the method or frequency of acquiring the tronic device and a method of efficiently controlling a sensing data fails to meet a variety of Internet of Things

plurality of sensors and reducing power consumption . sensor devices and a demand of the virtual sensor . Description of Related Art A virtual sensor allows sensor devices to be widely used SUMMARY

on a network . To introduce the virtual sensor , there is a need 25 of a server for collecting and processing physical sensing Accordingly , an example aspect of the present disclosure data . For example , there have been proposed a method of provides an electronic device and a method of controlling using a smartphone or the like user terminal as a virtual sensors connected through a network , in which a sensor - data sensor server , a method of using an access point or the like acquiring method suitable for the kind of sensor device is gateway , a method of using a cloud server , etc . As compared 30 used in an Internet of Things environment where a virtual with a mobile terminal device , the gateway sufficiently sensor accesses various kinds of sensor devices , thereby receives alternating current ( AC ) power or the like power , maximizing and / or improving the power efficiency . and gives high performance even though it additionally According to an example aspect of the present disclosure , needs a networking operation between an application pro - an electronic device connecting with at least one sensor gram and the virtual sensor . Further , the gateway has a 35 device through a network is provided , the electronic device shorter communication path and a shorter communication including a communicator comprising communication cir delay than those of the cloud server . These methods have cuitry configured to communicate with the at least one something in common that they use a representational state sensor device and a user terminal ; a storage configured to transfer ( REST ) interface so that the virtual sensor can store information about data acquiring methods available for directly access all the sensor devices on the network through 40 the sensor device and information about settings of a current a uniform resource identifier ( URI ) . data acquiring method ; and a processor configured to deter

Power efficiencies of the sensor device and the user mine whether data is acquirable based on the stored infor terminal are varied depending on methods of acquiring data mation about the data acquiring methods in response to a from the sensor device . Technology about a method of request for acquiring the data from the user terminal with acquiring sensing data has been proposed even before the 45 respect to the at least one sensor device , and to control the appearance of an Internet of Things environment using the at least one sensor based on determination results . virtual sensor . The method of acquiring the sensing data In the present disclosure , the information about the data according to the characteristics of the sensor device is acquiring method may include information on at least one of broadly classified into polling and a push . The polling is a a polling method , a batching method and a model - driven method that a user periodically reads data from the sensor , 50 method . and the push is a method that the sensor sends data to a user In the present disclosure , the setting of the current data when a specific event occurs in the sensor . Further , a acquiring method may include the setting of a data acquiring push - based optimum method includes a model - driven frequency associating with at least one of the polling method and a batching method . If the sensing data is not method , the batching method and the model - driven method . frequently processed , the batching method is advantageous 55 In the present disclosure , the data acquiring frequency since the sensing data is collected and then sent . If a slight may be virtualized into numerals regardless of the kind of change in the sensing data is ignorable , the model - driven data acquiring methods . method is advantageous since the sensing data is sent only In the present disclosure , the processor may send the user when the sensing data is largely changed . However , if the terminal a result of determining whether the data is acquir sensor device does not support the batching method or the 60 able . model - driven method in light of hardware , there may be no In the present disclosure , the processor may update the choice but to use the polling . information about the settings of the current data acquiring

Further , the frequency of acquiring data is differently method in response to a data acquiring request of the user affected according to the methods of acquiring the sensing terminal if data is acquirable . data . For example , the frequency of acquiring sensing data 65 In the present disclosure , the processor may transmit the is determined based on a cycle of acquiring the sensing data information about the settings of the current data acquiring in case of the polling , the number of pieces of sensing data method to the at least one sensor device if data is acquirable .

Page 21: US010432731B2 ( 12 ) United States Patent ( 10 ) Patent No . : US …nyx.skku.ac.kr/wp-content/uploads/2020/06/US10432731.pdf · 2020-06-19 · US010432731B2 ( 12 ) United States

US 10 , 432 , 731 B2

In the present disclosure , the information about the avail FIGS . 2 , 3 , 4 and 5 are diagrams illustrating an example able data acquiring methods may be received from the at polling method , a push method , a model - driven method and least one sensor device when connecting with the at least one a batching method ; sensor device . FIG . 6 is a flowchart illustrating an example of controlling

In the present disclosure , the electronic device may fur - 5 a sensor device according to an example embodiment ; ther include at least one virtual sensor configured to acquire FIG . 7 is a diagram illustrating an example registration of and process sensing data from the at least one sensor device . available acquiring methods for a sensor device according to

In the present disclosure , the virtual sensor may transmit an example embodiment ; the processed sensing data to the user terminal . FIG . 8 is a diagram illustrating an example sensor direc

In the present disclosure , the processor may determine 10 tory according to an example embodiment ; data acquiring settings in accordance with priorities if two or FIGS . 9 and 10 are diagrams illustrating example deter more data acquiring settings of the virtual sensor and the mination of available sensor - data acquiring methods accord user terminal conflict with each other with respect to one ing to an example embodiment ; physical sensor . FIGS . 11 , 12 , 13 , 14 , 15 and 16 are diagrams illustrating

In the present disclosure , the storage may store informa - 15 examples of acquiring sensing data by making a connection tion about a method where the sensor devices acquire data between the sensor - data acquiring methods and the acquir from an internal sensor module through a bus and informa - ing frequencies ; and tion about a method where the sensor devices acquire data FIG . 17 is a block diagram illustrating an example gate through the network . way device , a sensor device and a user terminal according to

According to another example aspect of the present 20 an example embodiment . disclosure , a method of controlling at least one sensor device connected through a network is provided , the method DETAILED DESCRIPTION including storing information about data acquiring methods available for the at least one sensor device and information Below , various example embodiments will be described about settings of a current data acquiring method , receiving , 25 with reference to accompanying drawings . The following from a user terminal , a request for acquiring data with example embodiments are illustrative only , and it should be respect to the at least one sensor device and determining understood that all suitable modification , equivalents and / or whether the data is acquirable based on the stored informa alternatives fall within the scope of the disclosure . Through tion about the data acquiring methods in response to the out the drawings , like numerals refer to like elements . request for acquiring the data , and controlling the at least 30 In this description , “ have , ” “ may have , ” “ include , " " may one sensor based on results of the determining . include ” or the like expression refer to presence of the

In the present disclosure , the information about the data corresponding features ( e . g . , numerical values , functions , acquiring method may include information on at least one of operations , or elements of parts , and does not exclude a polling method , a batching method and a model - driven additional features . method . 35 In this description , “ A or B , ” “ at least one of A or / and B , ”

In the present disclosure , the setting of the current data “ one or more of A or / and B ” or the like expression may acquiring method include the setting of a data acquiring involve any possible combination of listed elements . For frequency associating with the polling method , the batching example , “ A or B , ” “ at least one of A and B , ” or “ at least one method and the model - driven method . A or B ” may refer all of ( 1 ) at least one A , ( 2 ) at least one

In the present disclosure , the data acquiring frequency 40 B , or ( 3 ) both at least one A and at least one B . may be virtualized into numerals regardless of the kind of In this description , “ a first , " " a second , ” “ the first , ” “ the data acquiring methods . second ” or the like expression may modify various elements

In the present disclosure , the method may further include regardless of order and / or importance , and does not limit the sending the user terminal a result of determining whether the elements . These expressions may be used to distinguish one data is acquirable . 45 element from another element . For example , a first user

In the present disclosure , the method may further include device and a second user device may refer to different user updating the information about the settings of the current devices regardless of order and importance . For instance , a data acquiring method if the requested data is acquirable . first element may be named a second element , and vice versa

In the present disclosure , the information about the data without departing the scope of the present disclosure . acquiring methods may be received from the at least one 50 If a certain element ( e . g . a first element ) is “ operatively or sensor device when connecting with the at least one sensor communicatively coupled with / to ” or “ connected to ” device . another element ( e . g . a second element ) , it will be under

According to another example aspect of the present stood that the certain element is connected to another disclosure , a non - volatile recording medium with a program element directly or via an additional element ( e . g . a third for implementing the aforementioned method is provided . 55 element ) . On the other hand , if a certain element ( e . g . the

first element ) is " directly coupled with / to ” or “ directly BRIEF DESCRIPTION OF THE DRAWINGS connected to ” another element ( e . g . the second element ) , it

will be understood that there are no additional element ( e . g . The above and / or other aspects , features and attendant the third element ) between the certain element and another

advantages of the present disclosure will become apparent 60 element . and more readily appreciated from the following detailed In this description , the expression of “ configured to ” may description , taken in conjunction with the accompanying be for example used interchangeably by " suitable for , " drawings , in which like reference numerals refer to like “ having the capacity to , ” “ designed to , ” “ adapted to , ” “ made elements , and wherein : to , " or " capable of ” in accordance with circumstances . The

FIG . 1 is a diagram illustrating an example process of 65 expression of " configured to ” may not necessarily refer to acquiring sensing data according to an example embodi - only “ specifically designed to ” in terms of hardware . ment ; Instead , the " device configured to ” may refer to " capable of

Page 22: US010432731B2 ( 12 ) United States Patent ( 10 ) Patent No . : US …nyx.skku.ac.kr/wp-content/uploads/2020/06/US10432731.pdf · 2020-06-19 · US010432731B2 ( 12 ) United States

US 10 , 432 , 731 B2

together with other devices or parts in a certain circum FIG . 2 is a illustrating an example , in which the gateway stance . For example , the phrase of the processor configured device 100 acquires data from a first sensor device 200 - 1 by to perform A , B , and C ” may refer , for example , to a a polling method . First , the first virtual sensor 142 of the dedicated processor ( e . g . an embedded processor ) for per gateway device 100 makes a request for sensing data to the forming the corresponding operations , or a generic - purpose 5 sensor device 200 - 1 ( GET ) . Next , the sensor device 200 - 1 processor ( e . g . a central processing unit ( CPU ) or an appli transmits data S1 sensed by the physical sensor 201 to the cation processor ) for performing the corresponding opera gateway device 100 . In addition , the first virtual sensor 142 tions by executing one or more software programs stored in of the gateway device 100 makes a request for sensing data a memory device . to the sensor device 200 - 1 ( GET ) . Next , the sensor device In this description , terms may be used for explaining a 10 % 200 - 1 transmits data S2 sensed by the physical sensor 201 to certain embodiment and not intended to limit the scope of the gateway device 100 . Like this , the polling method P other embodiments . A singular expression may involve a provides the sensing data S1 and S2 of the first physical plural expression as long as it does not clearly give different

sensor 201 whenever the virtual sensor 142 of the gateway meaning contextually . All the terms set forth herein , includ ing technical or scientific terms , have the same meanings as 15 device 100 makes the request . That is , the polling method P those generally understood by a person having an ordinary acquires the senor data as necessary whenever the request is skill in the art . Terms defined in a general - purpose dictionary made . may be construed to have the same or similar meanings as FIG . 3 is a diagram illustrating an example in which the the contextual meanings of the related art , and should not be gateway device 100 acquires data from a first sensor device interpreted as ideally or excessively formal meanings . As 20 200 - 1 by a pushing method . First , the first virtual sensor 142 necessary , the terms defined in this description should not be of the gateway device 100 performs observer registration to construed to exclude the embodiments of the present dis - the sensor device 200 - 1 ( OBSERVE ) . Then , the sensor closure . device 200 - 1 periodically transits data S1 , S2 , S3 sensed by

FIG . 1 is a diagram illustrating an example process of the physical sensor 201 to the gateway device 100 . Thus , the acquiring sensing data according to an example embodi - 25 pushing method continuously provides the sensing data Si , ment . A plurality of sensor devices , e . g . a first sensor device S2 , S3 of the first physical sensor 201 through once observer 200 - 1 , a second sensor device 200 - 2 and a sensor device registration of the virtual sensor 142 of the gateway device 200 - 3 are connected to a network , e . g . Internet of Things 100 . through a gateway device 100 . A plurality of user terminals , FIG . 4 is a diagram illustrating an example model - driven e . g . a first user terminal 300 - 1 , a second user terminal 300 - 2 30 method ( M ) as a kind of the pushing method of FIG . 3 . First , and a third user terminal 300 - 3 acquire sensing data from the the first virtual sensor 142 of the gateway device 100 plurality of sensor devices 200 - 1 , 200 - 2 and 200 - 3 through performs observer registration and threshold setting to the the gateway device 100 . sensor device 200 - 1 . Here , the threshold is a value of

The gateway device 100 may refer , for example , a func limiting a changeable size of the sensing data . The first tional unit or device that connects two or more different or 35 sensor device 200 - 1 does not transmit the sensing data S1 same kinds of communication networks and allows infor - and S2 of which the changed size is not higher than the mation to be exchanged between the communication net - threshold , but transmits only the sensing data S3 of which works . The communication network includes a local area the changed size is higher than the threshold to the gateway network ( LAN ) , public data network ( PDN ) , public device 100 . Like this , the model - driven method ( M ) is to switched telephone network ( PSTN ) , etc . Further , the gate - 40 acquire the sensing data only when the event occurs . way device 100 is a functional unit or device that converts FIG . 5 is a diagram illustrating an example batching protocols by connecting a plurality of communication net method ( B ) as a kind of the pushing method of FIG . 3 . First , works different in protocol and thus not compatible in the first virtual sensor 142 of the gateway device 100 respective layers of the open systems interconnections ( OSI ) performs an observer registration ( OBSERVE ) and batch reference model . The gateway device 100 may be for 45 ing - size setting to the sensor device 200 - 1 . Here , the batch example achieved by a router ( i . e . an access point ) , a hub , a ing - size setting is to set the size of measured sensing data to relay , etc . be transmitted at a time . That is , the first sensor device 200 - 1

Referring to FIG . 1 , the gateway device 100 includes a accumulates the sensing data S1 , S2 , S3 and transmits it to processor ( e . g . , including processing circuitry ) 110 which the gateway device 100 at a time . Like this , the batching processes various pieces of data and generally controls 50 method ( B ) is to collect and transmit the sensing data as elements or the like ; a sensing database ( SD ) 132 which much as a preset amount . stores raw data acquired from a plurality of sensor devices The data acquiring method is divisionally set for the bus 200 - 1 , 200 - 2 and 200 - 3 connected through the network ; at and the network . At the side of the bus , the data acquiring least one virtual sensor 142 , 144 and 146 which manages method refers to a method that the processor of the sensor and controls the plurality of sensor devices 200 - 1 , 200 - 2 and 55 device acquires data from an internal sensor module through 200 - 3 connected through the network ; and a sensor directory an internal bus . At the side of the network , the data acquiring 134 which records attribute information , setting informa method refers to a method that the gateway device 100 tion , etc . of the plurality of sensor devices 200 - 1 , 200 - 2 and acquires data from the sensor device through the network . 200 - 3 and the at least one virtual sensors 142 , 144 , 146 . The information about the currently set data - acquiring

The sensor directory 134 includes sensor values , sensing 60 method includes a bus data - acquiring method ( BUS ) , a data attributes , a user list , available data - acquiring methods network data - acquiring method ( NET ) , a polling method and information about a currently set data - acquiring method ( P ) , the batching method ( B ) , the model - driven method ( M ) of first to fifth physical sensors 201 ~ 205 of the sensor and an acquiring frequency given in the form of numerals . devices 200 - 1 , 200 - 2 and 200 - 3 connected through the The first to third virtual sensors 142 , 144 and 146 serve to network . The available data - acquiring methods are classified 65 widely use all the physical sensors 201 ~ 205 connected to the into a polling method ( P ) , a batching method ( B ) and a network . The first to third virtual sensors 142 , 144 and 146 model - driven method ( M ) . collect and process the data from the physical sensors

Page 23: US010432731B2 ( 12 ) United States Patent ( 10 ) Patent No . : US …nyx.skku.ac.kr/wp-content/uploads/2020/06/US10432731.pdf · 2020-06-19 · US010432731B2 ( 12 ) United States

US 10 , 432 , 731 B2

201 - 205 and then transmits it to at least one of the first to attribute , a user list , available data - acquiring methods , the third user terminals 300 - 1 - 300 - 3 . current data - acquiring methods of the plurality of first to

Each of the sensor devices 200 - 1 , 200 - 2 and 200 - 3 fifth physical sensors . Referring to FIG . 8 , the first physical includes at least one physical sensor . For example , as shown sensor 201 of the first sensor device 200 - 1 is registered with in FIG . 1 , the first sensor device 200 - 1 includes the first 5 the sensor values : " false " , the sensing data attribute : “ flame physical sensor 201 , the second sensor device 200 - 2 detection ” , a user list : " first user terminal , first virtual includes the second physical sensor 202 , and the third sensor sensor ” , available data - acquiring methods : “ BUS : P - - , NET : device 200 - 3 includes the third to fifth physical sensors PBM ” and the current data - acquiring methods : “ BUS : P 20 , 203 ~ 205 . The first to fifth physical sensors 201 ~ 205 may be NET : M 10 ” . The second physical sensor 202 of the second achieved by a three - axial acceleration sensor , a microphone , 10 sensor device 200 - 2 is registered with the sensor values : a gyroscope , a geomagnetism sensor , a gravity sensor , an “ 420 ” , the sensing data attribute : " gas concentration ” , a user optical sensor , a digital compass , a odor sensor , a proximity l ist : “ first virtual sensor , second virtual sensor ” , available sensor , etc . data - acquiring method : “ BUS : P - - , NET : P - - ” and the current

The user terminal 300 includes an application program data - acquiring methods : “ BUS : P 100 , NET : P 150 ” . The that utilizes a plurality of sensor devices 201 ~ 205 through 15 third physical sensor 203 of the third sensor device 200 - 3 is the gateway device 100 . For example , as shown in FIG . 1 , registered with the sensor values : “ 30 , 80 ” , the sensing data the first user terminal 300 - 1 includes first and second attribute : “ temperature , humidity ” , a user list : “ first virtual application programs 301 ~ 302 , the second user terminal sensor , second virtual sensor ” , available data - acquiring 300 - 2 includes third to fifth application programs 303 - 305 , methods : “ BUS : P _ M , NET : PBM ” and the current data and the third user terminal 300 - 3 includes a sixth application 20 acquiring methods : “ BUS : M 100 , NET : P 50 ” . The fourth program 306 . The first to sixth application programs physical sensor 204 of the third sensor device 200 - 3 is 301 ~ 306 of the first to third user terminals 300 - 1 , 300 - 2 and registered with the sensor values : “ 771 " , the sensing data 300 - 3 acquire sensing data from the first to fifth physical attribute : " atmospheric pressure ” , a user list : “ second virtual sensors 201 ~ 205 of the sensor devices 200 - 1 , 200 - 2 and sensor ” , available data - acquiring methods : " BUS : P M , 200 - 3 through the first and second virtual sensors 142 and 25 NET : PBM ” and the current data - acquiring methods : 144 of the gateway device 100 . To make the plurality of first “ BUS : M 100 , NET : M 120 ” . The fifth physical sensor 205 of to sixth application programs 301 ~ 306 use the plurality of the third sensor device 200 - 3 is registered with the sensor sensor devices 200 - 1 , 200 - 2 and 200 - 3 simultaneously or values : " 92 " , the sensing data attribute : “ heart rate ” , a user together , efficient management is required . The user terminal list : " second virtual sensor ” , available data - acquiring meth 300 may include a smartphone , a wearable device , a per - 30 ods : " BUS : PBM , NET : PBM ” and current data - acquiring sonal portable terminal , a notebook computer , a personal methods : " BUS : B 200 , NET : B 120 ” . computer , a desktop computer , a server , etc . The first to sixth At operation S120 , the first user terminal 300 - 1 sets the application programs 301 ~ 306 may be achieved by a secu sensor - data acquiring method to the gateway device 100 in rity program , a game program , a monitoring program , of the response to a data - acquiring request . FIG . 9 is a diagram like various programs using the sensor . 35 illustrating an example process of setting the data - acquiring

Below , a method of acquiring sensing data will be method for the first user terminal 300 - 1 . As illustrated in described with reference to FIG . 6 . FIG . 9 , the first user terminal 300 - 1 transmits a first message

At operation S110 , the plurality of first to third sensor for setting the data - acquiring method to the gateway device devices 201 ~ 203 reports the available sensor - data acquiring 100 . The first message for setting the data - acquiring method methods when it is connected to the gateway device 100 . 40 is as follows . FIG . 7 is a diagram illustrating an example that the third { method : { BUS : “ P ” , BUS Strength : 100 , NET : “ P ” , NET sensor device 200 - 3 reports on the available sensor - data Strength : 50 acquiring methods to the gateway device 100 . In FIG . 7 , the At operation S130 , the processor 110 of the gateway third sensor device 200 - 3 sends the gateway device 100 a device 100 parses the message for setting the data acquiring sensor device registration message as follows . 45 method and determines whether the acquiring methods of

{ base - URI “ / third sensor device ” , BUS : “ P ” and NET : “ P ” are suitable for the available ( URI “ / third sensor device / third physical sensor ” , value : data - acquiring methods of the sensor directory 134 . Since

{ " temperature ” : 30 , “ humidity " : 80 ) , . . . , available methods : the available data - acquiring methods are “ BUS : P - - , NET : { BUS : “ P - M ” , NET : “ PBM ” ) , default methods : { BUS : “ M ” , PBM ” in FIG . 8 , the requested acquiring methods of BUS : BUS Strength : 100 , NET : “ P ” , NET Strength : 50 } } 50 “ P ” and NET : “ P ” are acquirable .

{ URI “ / third sensor device / fourth physical sensor ” , value : At operation S140 , if the requested acquiring method of { " atmospheric pressure " : 771 } , . . . , available methods : the first user terminal 300 - 1 can acquire data , the current { BUS : “ P - M ” , NET : “ PBM ” } , default method : { BUS : “ M ” , data - acquiring method is updated as shown in the dotted BUS Strength : 100 , NET : “ M ” , NET Strength : 120 } } lines of FIG . 9 .

{ URI “ / third sensor device / fifth physical sensor ” , value : 55 At operation S150 , the gateway device 100 forwards the { " heart rate ” : 92 } , . . . , available methods : { BUS : “ P - M ” , determined requested acquiring method of the first user NET : “ PBM ” } , default method : { BUS : “ B ” , BUS Strength : terminal 300 - 1 , e . g . , " BUS : P 100 , NET : P 50 ” to the first 200 , NET : “ B ” , NET Strength : 150 } } physical sensor 201 of the first sensor device 200 - 1 . The

The gateway device 100 parses the foregoing sensor processor 210 of the first sensor device 200 - 1 sets the first device registration message from the third sensor 200 - 3 and 60 physical sensor 201 with reference to the requested acquir registers information about the third to fifth physical sensors ing method , i . e . “ BUS : P 100 , NET : P 50 ” . of the third sensor device to the sensor direction 134 as At operation S160 , the gateway device 100 sends the first shown in dotted lines of FIG . 7 . user terminal 300 - 1 a message that the requested acquiring

FIG . 8 illustrates the example sensor directory 134 in method is successfully set . which information about the plurality of first to fifth physical 65 FIG . 10 illustrates another example of a setting process of sensors connected through the network is registered . The the data acquiring method of the first user terminal 300 - 1 . At sensor directory 134 includes sensor values , sensing data operation S120 , the first user terminal 3001 may transmit a

Page 24: US010432731B2 ( 12 ) United States Patent ( 10 ) Patent No . : US …nyx.skku.ac.kr/wp-content/uploads/2020/06/US10432731.pdf · 2020-06-19 · US010432731B2 ( 12 ) United States

US 10 , 432 , 731 B2 10

message for setting the data acquiring method . The message ing to an example embodiment , the kind and frequency of for setting the data acquiring method is as follows . data acquiring methods for the first to fifth physical sensors

{ Method : { BUS : “ M ” , BUS Strength : 230 , NET : “ M ” , 201 - 205 are virtualized by the sensing data - acquiring NET Strength : 50 } method .

At operation S130 , the processor 110 of the gateway 5 In accordance with the kinds of sensing data - acquiring device 100 determines whether the acquiring methods of methods , factors for determining the ' frequency ' of acquir BUS : “ M ” and NET : “ M ” is suitable for the available data ing data are varied . In the polling method ( P ) , the frequency acquiring methods of the sensor directory 134 when receiv - is determined by a cycle of acquiring the sensing data . In the ing the message for setting the data acquiring method . batching method ( B ) , the frequency is determined by the Referring to FIG . 10 , the available data acquiring methods 10 number of pieces of sensing data to be transmitted at a time are “ BUS : P - - , NET : PBM ” , the requested acquiring method ( i . e . by a batching size ) . In the model - driven method ( M ) , BUS : “ M ” is not acquirable but only NET : “ P ” is acquirable . the frequency is determined by a threshold of determining At operation S170 , the gateway device 100 sends the user whether to transmit the sensing data . For example , the

terminal 301 a message that the requested acquiring method sensor device 200 or the gateway device 100 infrequently is not settable . 15 acquires the sensing data if the polling period becomes At operation S180 , the gateway device 100 receives the longer in the polling method ( P ) , if the threshold becomes

sensing data from the first physical sensor 201 of the first higher in the model - driven method ( M ) , and if the batching sensor device 200 - 1 by the set method BUS : P 100 . That is , size increases in the batching method ( B ) . Therefore , it is the sensing data is acquired by the polling method , at an possible to reduce power consumed in the sensor device 200 acquired frequency of 100 ( every 5 seconds ) . 20 and the gateway device 100 by changing the factors of

At operation 5190 , the gateway device 100 sends the first determining the data acquiring frequency . user terminal 301 the sensing data received from the first Like this , the ‘ kind ' and ' frequency of acquiring the physical sensor 201 of the first sensor device 200 - 1 . Here , sensing data will be collectively called the sensing data the first virtual sensor 142 may process the sensing data acquiring method . The kinds of methods can be set only received from the first physical sensor 201 of the first sensor 25 within the data acquiring methods available in the sensor device 200 - 1 and then transmit the processed data to the user device . In particular , the factors of the acquiring frequency terminal 300 . Of course , the first virtual sensor 142 may is varied depending on the types of sensor devices , and directly transmit the sensing data received from the first therefore equally represented by integer values in order to physical sensor 201 of the first sensor device 200 - 1 to the provide a consistent interface . user terminal 300 without processing the received sensing 30 FIG . 11 is a diagram illustrating an example in which the data . acquiring frequency value is 50 in the polling method ( P ) .

According to an example embodiment , the data acquiring The gateway device 100 transmits a request ( GET ) for methods and acquiring frequencies of the different kinds of sensing data to the sensor device 200 every 5 seconds , and first to third sensor devices 200 - 1 , 200 - 2 and 200 - 3 are the sensor device 200 transmits sensing data S1 , S2 and S3 applied in a lump . To this end , the settings of the data 35 in sequence to the gateway device 100 every 5 seconds in acquiring methods and acquiring frequencies of the sensor response to the sensing data request . devices are virtualized as ' data acquiring setting ' . In par - FIG . 12 is a diagram illustrating an example in which the ticular , the data acquiring frequency is varied in definition acquiring frequency value is 100 in the polling method ( P ) . and range depending on the kinds of sensor - data acquiring The gateway device 100 transmits a request ( GET ) for methods , and thus virtualized into a single integer value so 40 sensing data to the sensor device 200 every 2 . 5 seconds , and that data acquiring setting can be applied in a lump to the sensor device 200 transmits sensing data S1 , S2 and S3 various kinds of first to third sensor devices 200 - 1 , 200 - 2 in sequence to the gateway device 100 every 2 . 5 seconds in and 200 - 3 . response to the sensing data request . Like this , if the sensing

According to an example embodiment , the data acquiring data is acquired per 2 . 5 seconds shorter than 5 seconds , method of the first to third sensor devices 200 - 1 , 200 - 2 and 45 increase in the power consumption of the sensor device 200 200 - 3 is set by the gateway device 100 . The gateway device has to be taken into account for proper settings . 100 refers to a control device that is connected to all the first FIG . 11 and FIG . 12 , are examples in which the sensing to third sensor devices 200 - 1 , 200 - 2 and 200 - 3 of the local data - acquiring period becomes shorter as the acquiring network , and brings the sensing data from the first to third frequency value increases . Alternatively , the sensing data sensor devices 200 - 1 , 200 - 2 and 200 - 3 or applies the settings 50 acquiring period may become longer as the acquiring fre of the first to third sensor devices 200 - 1 , 200 - 2 and 200 - 3 . quency value increases . A conventional gateway device also includes a sensor direc FIG . 13 is a diagram illustrating an example in which the tory where data of a physical sensor and metadata informa - acquiring frequency value is 50 in the batching method ( B ) . tion are stored . According to an example embodiment , the If the gateway device 100 is set to the observer registration sensor directory is extended to manage information about 55 ( OBSERVE ) and the batching size ( at a frequency value of the sensing data - acquiring method . When the sensing data 50 ) , the sensor device 200 collects four pieces of sensing acquiring method is set in the user terminal 300 , the method data and transmits them to the gateway device 100 in a lump . setting message is transmitted to the first to third sensor FIG . 14 is a diagram illustrating an example in which the devices 200 - 1 , 200 - 2 and 200 - 3 after it is determined acquiring frequency value is 100 in the batching method ( B ) . whether the method is available with reference to the sensor 60 If the gateway device 100 is set to the observer registration directory . ( OBSERVE ) and the batching size ( at a frequency value of

The method and frequency of acquiring the available 1000 ) , the sensor device 200 collects two pieces of sensing sensing data are varied depending on the physical sensors . data S1 - S2 and transmits them to the gateway device 100 in Under the Internet of Things environment using the virtuala lump . sensors , a number of heterogeneous physical sensors need to 65 FIG . 13 and FIG . 14 , are examples in which the number be controlled in a lump with respect to the kind and of pieces of sensing data to be transmitted decreases as the frequency of acquiring the sensing data . Therefore , accord acquiring frequency value increases . Alternatively , the num

Page 25: US010432731B2 ( 12 ) United States Patent ( 10 ) Patent No . : US …nyx.skku.ac.kr/wp-content/uploads/2020/06/US10432731.pdf · 2020-06-19 · US010432731B2 ( 12 ) United States

US 10 , 432 , 731 B2 11 12

ber of pieces of sensing data to be transmitted may increase ( LTE ) , etc . ; a wireless Internet module for wireless local as the acquiring frequency value increases . area network ( WLAN ) , wireless fidelity ( Wi - Fi ) , wireless

FIG . 15 is a diagram illustrating an example in which the broadband ( Wibro ) , world interoperability for microwave acquiring frequency value is 50 in the model - driven method access ( Wimax ) , high speed downlink packet access ( HS ( M ) . If the gateway device 100 is set to the observer 5 DPA ) , etc . , a near field communication module for Blu registration ( OBSERVE ) and the batching size ( at a fre - etooth , radio frequency identification ( RFID ) , infrared data quency value of 50 ) , the sensor device 200 transmits only association ( IrDA ) , ultra - wideband ( UWB ) , ZigBee , etc . the sensing data S3 higher than 30° C . to the gateway device The first storage 130 stores data . The first storage 130 is 100 . accessed by the first processor 110 to read , record , modify ,

FIG . 16 is a diagram illustrating an example in which the 10 delete and update the data . The data stored in the first storage acquiring frequency value is 100 in the model - driven 130 may for example the sensing data transmitted from the method ( M ) . If the gateway device 100 is set to the observer first to fifth physical sensors 201 - 205 , data processed by the registration ( OBSERVE ) and the batching size ( at a fre first to third virtual sensors 142 , 144 and 146 , and the sensor quency value of 100 ) , the sensor device 200 transmits the directory 134 as shown in FIG . 8 . Of course , the first storage sensing data S1 ( 20° C . ) , the sensing data S2 ( 25º C . ) and the 15 130 may store the operating system , various applications sensing data S3 ( 30° C . ) higher than 15° C . to the gateway executable on the operating system , etc . The first storage 130 device 100 . may store a program ( or application ) for managing the

FIG . 15 and FIG . 16 , are examples in which the threshold sensor device of the virtual sensor 140 , and processing the for transmitting the sensing data at a time decreases as the sensing data . acquiring frequency value increases . Alternatively , the 20 The first storage 130 may include at least one of storage threshold for transmitting the sensing data at a time may medium such as a flash memory type , a hard disk type , a increase as the acquiring frequency value increases . multimedia card micro type , a card type memory ( e . g . an SD

As described above , the acquiring frequency value for the or XD memory , etc . ) , a random access memory ( RAM ) , a sensing data may be differently applied in accordance with static random access memory ( SRAM ) , a read - only memory the sensing data - acquiring methods . 25 ( ROM ) , an electrically erasable programmable read - only

FIG . 17 is a block diagram illustrating an example gate - memory ( EEPROM ) , a programmable read - only memory way device 100 , the sensor device 200 and the user terminal ( PROM ) a magnetic memory , a magnetic disk and an optical 300 according to an example embodiment . disk .

The gateway device 100 includes a first processor ( e . g . , The virtual sensor 140 uses software to process the including processing circuitry ) 110 , a first communication 30 sensing data acquired by managing the plurality of sensor module ( e . g . , including communication circuitry ) 120 , a first devices 200 connected through the network and provides the storage 130 , and a virtual sensor 140 . In addition to these processed sensing data to the user terminal 300 . elements , the gateway device 100 may further include other The sensor device 200 includes the second processor elements . ( e . g . , including processing circuitry ) 210 , the second com

The first processor 110 may be achieved by software , 35 munication module ( e . g . , including communication cir hardware and may include various processing circuitry , such cuitry ) 220 and the physical sensor 240 . In addition to these as , for example , and without limitation , a control board elements , the sensor device 200 may include other elements . including a dedicated processor , a central processing unit The second processor 210 generally controls the elements ( CPU ) , a micro - processing unit ( MPU ) , application specific of the sensor device 200 . The second processor 210 parses integrated circuits ( ASICs ) , digital signal processors ( DSPs ) , 40 the acquiring method setting message received from the digital signal processing devices ( DSPDs ) , programmable gateway device 100 and uses the physical sensor 240 . The logic devices ( PLDs ) , field programmable gate arrays ( FP second processor 210 transmits the sensing data sensed by GAS ) , micro - controllers , microprocessors , etc . , or combina - the physical sensor 240 using the setting method to the tion of hardware and software . The first processor 110 gateway device 100 via the second communication module generally controls the elements of the gateway device 100 , 45 220 . e . g . the first communication module 120 , the first storage The second processor 210 may be achieved by software , 130 , and the virtual sensor 140 , etc . and processes various hardware and may include various processing circuitry , such pieces of sensing data received , input or sensed from the as , for example , and without limitation , a control board plurality of first to third sensor devices 201 ~ 205 through including a dedicated processor , a central processing unit communication or a network by software or hardware . The 50 ( CPU ) , a micro - processing unit ( MPU ) , application specific first processor 110 may include an operating system ( OS ) . integrated circuits ( ASICs ) , digital signal processors Further , the first processor 110 may include an application ( DSPs ) , digital signal processing devices ( DSPDs ) , pro ( or program ) for processing various pieces of input or grammable logic devices ( PLDs ) , field programmable gate processed information . The first processor 110 parses a arrays ( FPGAs ) , micro - controllers , microprocessors , etc . , or sensing data - acquiring setting message requested by the user 55 combination of hardware and software . terminal 300 , and determines whether the data is acquirable The second communication module 220 may include with reference to the sensor directory . various communication circuitry and communicates with the

The first communication module 120 may include various gateway device 100 . The second communication module communication circuitry and communicates with at least one 220 may employ various communication circuitry , such as , sensor device 200 - 1 , 200 - 2 or 200 - 3 or the first to third user 60 for example , and without limitation , a data communication terminals 301 ~ 303 connected through the network . The first module for VDSL , Ethernet , Token - ring , high definition communicator 120 may employ various communication multimedia interface ( HDMI ) , a universal serial bus ( USB ) , circuitry , such as , for example , and without limitation , a data Component , LVDS , HEC , etc . ; a mobile communication communication module for VDSL , Ethernet , Token - ring , module for 2G , 3G , 4G , long - term evolution ( LTE ) , etc . , a high definition multimedia interface ( HDMI ) , a universal 65 wireless Internet module for wireless local area network serial bus ( USB ) , Component , LVDS , HEC , etc . ; a mobile ( WLAN ) , wireless fidelity ( Wi - Fi ) , wireless broadband ( Wi communication module for 2G , 3G , 4G , long - term evolution bro ) , world interoperability for microwave access ( Wimax ) ,

Page 26: US010432731B2 ( 12 ) United States Patent ( 10 ) Patent No . : US …nyx.skku.ac.kr/wp-content/uploads/2020/06/US10432731.pdf · 2020-06-19 · US010432731B2 ( 12 ) United States

13 US 10 , 432 , 731 B2

14 high speed downlink packet access ( HSDPA ) , etc . , a near Although a various example embodiments and drawings field communication module for Bluetooth , radio frequency have been illustrated and described , it will be appreciated by identification ( RFID ) , infrared data association ( IrDA ) , those skilled in the art that various modifications and ultra - wideband ( UWB ) , ZigBee , etc . changes may be made in these example embodiments with

The physical sensor 240 performs sensing through the 5 out departing from the principles and spirit of the disclosure . setting method . The physical sensor 240 may be achieved by The operations according to the foregoing example a three - axial acceleration sensor , a microphone , a gyroscope , embodiments may be performed by a single or a plurality of

processors . In this case , a program command for performing a geomagnetism sensor , a gravity sensor , an optical sensor , the operations to be implemented by various computers may a digital compass , an odor sensor , an proximity sensor , etc . The user terminal 300 includes a third processor ( e . g . , 10 be recorded in a computer readable medium . The computer

readable medium may contain a program command , a data including processing circuitry ) 310 and a third communica file , a data structure , etc . or combination thereof . The tion module ( e . g . , including communication circuitry ) 320 . program command may be specially designed and made for In addition to these elements , the user terminal 300 may the foregoing embodiments , or publicly known and avail include other elements . 15 able to those skilled in the art . As an example of the The third processor 310 generally controls the elements of computer readable medium , there are a magnetic medium the user terminal 300 . The third processor 310 transmits the such as a hard disk drive , a floppy disk , a magnetic tape , etc . message for setting the sensor - data acquiring method an optical medium such as a compact disc read only memory requested by the application program to the gateway device ( CD - ROM ) , a digital versatile disc ( DVD ) , a magnetic 100 through the third communication module 320 , and 20 optical medium such as a floptical disk , and a hardware receives the sensing data from the gateway device 100 device such as a read only memory ( ROM ) , a random access through the third communication module 320 . memory ( RAM ) , a flash memory , etc . specially configured to

The third processor 310 may be achieved by software , store and execute a program command . As an example of the hardware and may include various processing circuitry , such program command , there is not only a machine code made as , for example , and without limitation , a control board 25 by a compiler but also a high - level language code to be including a central processing unit ( CPU ) , a micro - process - executable by a computer through an interpreter or the like . ing unit ( MPU ) , application specific integrated circuits If a process for controlling at least one sensor device ( ASICs ) , digital signal processors ( DSPs ) , digital signal described in this example embodiment is fully or partially processing devices ( DSPDs ) , programmable logic devices achieved by a computer program , the computer readable ( PLDs ) , field programmable gate arrays ( FPGAs ) , micro - 30 medium storing the computer program also belong to the controllers , microprocessors , etc . , or combination of hard present disclosure . ware and software . Therefore , the foregoing is considered as illustrative only .

The third communication module 320 communicates with The scope of the disclosure is defined in the appended claims the gateway device 100 to transmit the message for setting and their equivalents . Accordingly , all suitable modification the sensor - data acquiring method and receive the sensing 35 and equivalents may fall within the scope of the disclosure . data . The third communication module 320 may employ various communication circuitry , such as , for example , and What is claimed is : without limitation , a data communication module for VDSL , 1 . An electronic device configured to connect with at least Ethernet , Token - ring , high definition multimedia interface one sensor device through a network , the electronic device ( HDMI ) , a universal serial bus ( USB ) , Component , LVDS , 40 comprising : HEC , etc . ; a mobile communication module for 2G , 3G , 4G , a communicator comprising communication circuitry long - term evolution ( LTE ) , etc . ; a wireless Internet module configured to communicate with the at least one sensor for wireless local area network ( WLAN ) , wireless fidelity device and a user terminal ; ( Wi - Fi ) , wireless broadband ( Wibro ) , world interoperability a storage ; and for microwave access ( Wimax ) , high speed downlink packet 45 a processor configured to : access ( HSDPA ) , etc . , a near field communication module based on the communicator being connected with the at for Bluetooth , radio frequency identification ( RFID ) , infra least one sensor device , receive information on data red data association ( IrDA ) , ultra - wideband ( UWB ) , Zig acquiring methods available for the at least one Bee , etc . sensor device therefrom ;

The electronic device according to an example embodi - 50 store the received information in the storage ; ment may be effectively used in the Internet of Things based on a request for setting a data acquiring method environment using the virtual sensor . That is , in the state that with respect to the at least one sensor device from the many kinds and number of sensors are connected through user terminal , identify whether the data acquiring the network such as the Internet of Things , and these sensors method included in the request is suitable based on are independently used in or shared in common among many 55 the stored information on the data acquiring meth applications of many user terminals , the electronic device ods , the user terminal being configured to acquire mediates the performances of the sensor devices and the sensing data from the at least one sensor device requests of the applications , thereby acquiring the data by through the electronic device , the most efficient method . based on the data acquiring method included in the

Further , the electronic device according to an example 60 request being suitable , forward the identified data embodiment reduces power consumption of the sensor acquiring method to the at least one sensor device to device by applying the sensing data acquiring method suit set the at least one sensor device with reference to the able for the requests of various kinds of Internet - of - Things forwarded data acquiring method ; and sensor devices and virtual sensors receive the sensing data from the at least one sensor

Even if the Internet - of - Things sensor device mostly uses 65 based on the forwarded data acquiring method . a small battery , it is possible to extend a battery lasting time 2 . The electronic device according to claim 1 , wherein the and increase the utility of the virtual sensor . information on the data acquiring method comprises infor

Page 27: US010432731B2 ( 12 ) United States Patent ( 10 ) Patent No . : US …nyx.skku.ac.kr/wp-content/uploads/2020/06/US10432731.pdf · 2020-06-19 · US010432731B2 ( 12 ) United States

US 10 , 432 , 731 B2 15 16

mation on one or more of : a polling method , a batching based on the data acquiring method included in the method and a model - driven method . request being suitable , the electronic device forwarding

3 . The electronic device according to claim 2 , wherein the the identified data acquiring method to the at least one processor is configured further to receive and store a data sensor device to set the at least one sensor device with acquiring frequency associated with one or more of the 5 reference to the forwarded data acquiring method ; and polling method , the batching method and the model - driven receiving the sensing data from the at least one sensor method . based on the forwarded data acquiring method . 4 . The electronic device according to claim 3 , wherein the 13 . The method according to claim 12 , wherein the data acquiring frequency is configured to be virtualized into information on the data acquiring method comprises infor numerals regardless of the data acquiring methods . mation on one or more of : a polling method , a batching 5 . The electronic device according to claim 1 , wherein the method and a model - driven method . processor is further configured to send the user terminal a 14 . The method according to claim 12 , further compris result of determining whether the data is acquirable .

6 . The electronic device according to claim 1 , wherein the 11 wherein the ing : processor is configured to update information on settings of 15 receiving and storing a data acquiring frequency associ a current data acquiring method in response to the data ated with one or more of the polling method , the acquiring request of the user terminal based on the data batching method and the model - driven method . acquiring method included in the request being suitable . 15 . The method according to claim 14 , wherein the data

7 . The electronic device according to claim 6 , wherein the acquiring frequency is virtualized into numerals regardless processor is configured to transmit the information on the 20 of the kind of data acquiring methods . settings of the current data acquiring method to the at least 16 . The method according to claim 12 , further comprising one sensor device based on the data acquiring method sending the user terminal a result of identifying whether the included in the request being suitable . data acquiring method included in the request is suitable .

8 . The electronic device according to claim 1 , further 17 . The method according to claim 12 , further comprising comprising at least one virtual sensor configured to acquire 25 updating information on the settings of a current data and process sensing data from the at least one sensor device . acquiring method based on the data acquiring method

9 . The electronic device according to claim 8 , wherein the included in the request being suitable . virtual sensor is configured to transmit the processed sensing 18 . A non - transitory computer readable recording medium data to the user terminal . having stored thereon a program for implementing a method

10 . The electronic device according to claim 9 , wherein 30 Ten 30 of an electronic device of controlling at least one sensor the processor is configured to determine data acquiring device connected thereto through a network the method settings based on priorities if two or more data acquiring comprising : settings of the virtual sensor and the user terminal conflict with each other with respect to one physical sensor . based on being connected with the at least one sensor

11 . The electronic device according to claim 1 , wherein 35 device , the electronic device receiving information on the storage is configured to store information about a method data acquiring methods available for the at least one

sensor device therefrom ; where the sensor devices acquire data from an internal sensor module through a bus and to store information about the electronic device storing the received information ; a method where the sensor devices acquire data through the based on a request for setting a data acquiring method

with respect to the at least one sensor device from a network . 40 12 . A method , of an electronic apparatus , of controlling at user terminal , the electronic device identifying whether

least one sensor device connected through a network , the the data acquiring method included in the request is method comprising : suitable based on the stored information on the data

based on being connected with the at least one sensor acquiring methods , the electronic device being config ured to send sensing data to the user terminal so that the device , the electronic device receiving information on 45

data acquiring methods available for the at least one user terminal can acquire sensing data from the at least one sensor device through the electronic device ; sensor device therefrom ;

the electronic device storing the received information ; based on the data acquiring method included in the based on a request for setting a data acquiring method request being suitable , the electronic device forwarding

the identified data acquiring method to the at least one with respect to the at least one sensor device from a 50 user terminal , the electronic device identifying whether sensor device to set the at least one sensor device with

reference to the forwarded data acquiring method ; and the data acquiring method included in the request is suitable based on the stored information on the data the electronic device receiving the sensing data from the acquiring methods , the user terminal being configured at least one sensor based on the forwarded data acquir to acquire sensing data from the at least one sensor 55 ing method . device through the electronic device ;