PROPOSAL :The Use of Voice Command in Operating Personal Computer

By :

COLLEGE OF ART & SCIENCEUNIVERSITI UTARA MALAYSIA

STIW5023ADVANCED PROGRAMMING

Lecturer : Mazen S. H. Elsayed

Group Name : VINISKAZU

Virakwan A/P Hai Kelian (800355)Anis Eliani Binti Abd. Rahman (802329)Kamal Harmoni Kamal Ariff (801584)Mohd Fazudli Bin Saad (804213)

Group Members :

:: Abstract

• This study aims to develop an application that can execute command in operating system to allow user operate the personal computer through voice.

• It will provide a proved of concept on how user will be able to operate the personal computer using voice.

• This application will receive, analyzes, searches and matches an input voice with the set of grammar which is stored in the database and returns matching results to users.

• It is another solution for users to easy work with personal computer instead of using a graphical input device.

:: Introduction

• Application that will be developing in this study is the voice input command that use to operate the personal computer.

• According to Austin. J, (__), all communication with personal computers will someday be by voice alone. This means that keyboards will be obsolete. Therefore this study will provide a proved of concept how user able to operate the personal computer using voice.

• Java platform classes and compatible with Sphinx 4.0 will design to work in Windows and Linux operating system.

• According to (Meir and Zamir, 2007), Sphinx 4.0 able to greatly improve the speech recognition capabilities and Sphinx 4.0 platform proved very to be reliable, relatively easy to use and highly portable.

:: Problem Statement

• Users facing problem to interact with personal computer due to the inability of using hands or eyes and also handicap persons.

• New users facing problem to remember the command line that used to execute the application on personal computer.

• To provide a convenient and ability to use the personal computer, application that can execute command in operating system to allow user operate the personal computer through voice is to develop.

:: Objectives

• The aim of this study is to produce three (3) commands that able to understand by Windows and Linux operating system.

• Sub objective

• To understand and how to use Sphinx 4.0.

• To develop a Java class that can be interact with Sphinx 4.0 classes.

• To make the developed class able to convert voice command into command line.

• Main objective

:: Scope

• Java classes that able to use in Windows and Linux operating system by using Sphinx 4.0.

• Classes will be use to convert voice into command line.

• Only three (3) commands will introduce into this studies.

• The three (3) command that want personal computer execute in this studies are Run Paint, Run Calculator and List File command.

:: System Specification

:: VoiceCommand Package

// OVERVIEW : This package run the voice recognition application built using Sphinx 4.0

// Uses the Sphinx 4.0 and contains of two (2) main classes that will receive,

// analyzes, searches and matches an input voice with the set of dictionary and

// grammar.

// which is stored in the database and returns matching results to users by run and

// display the application on the personal computer screen monitor.

// REQUIRES : ConvertVoiceToText class to identify, analyze voice input and convert it //into text.

// RunCommand class to execute input and display application on the screen

// monitor.

// EFFECTS : If voice input is valid, will execute the command.

// If not valid, will wait until the valid input entered.

// Else allow user to terminate the application.

:: ConvertVoiceToText Class

// OVERVIEW : This class provides a number of procedures that are

// useful for voice recognition and convert it into text.

// REQUIRES : Valid voice input, dictionary and grammar.

// Voice input that matches with the set of dictionary and grammar

// database.

// EFFECTS : If voice input is valid, will convert it into text.

// Otherwise wait until the valid input entered or allow user to

// terminate the application.

:: RunCommand Class

// OVERVIEW : This class provides procedures for execute String

// input and display application on the screen monitor according the

// types of Operating System either Windows or Linux.

// REQUIRES : String to execute the command.

// Example command : Run Paint, to run on Windows platform.

// EFFECTS : Execute command to display on the screen based on

// types of Operating System.

:: Methodology ::

User0.0

VoiceCommand

Voice Signal

Display Application

:: Context Diagram

:: Flow Diagram

:: Use Case of the System

voice command dictionary

voice command grammar

Listen Voice

convertVoiceToText class

Analyze Voice

<<include>>

<<include>>

Match voicesphinx 4.0

Message return and display application

convert to text

<<include>>

Use Run class

:: Class Diagram of the System

Feature Execution Feature Classification

Convert voice to text

sphinx

/search and match

Recording

User

voice instruction

Voice Recognizer

/send speech record

Feature

:: Sequence Diagram

User Voice Command

Record Voice Recognizer

Feature sphinx Execution

1.Listen

2.Return Instruction

3.Record Voices

4.Analyze Voices5.Process Feature

6.Match Features

7. Convert to text

8. Message return

9. Message return

10. Message return

11. Message return

12. Proceed to next stage

13. Run Application

14.Display Text

:: Group Structure

Leader Task ResponsibilitiesVirakwan A/P Hai Kelian Tasks assignment for each members

Specify system requirements

Produce system specification

Team members Task ResponsibilitiesKamal Harmoni Bin Kamal Ariff Develop Coding

-Develop VoiceCommand class

Mohd Fazudli Bin Saad Expending acoustic model

-Dictionary class

-Grammar class

Anis Eliani Binti Abd. Rahman Develop Coding

-Develop RunCommand class

:: Conclusion

• Using the Sphinx 4.0 integrate with Java platform will able to develop the application that provide function for human to interact with personal computer via voice.

• In order to implement an application that can execute at least three (3) commands on Windows or Linux operating system, we identify two (2) main classes that will develop in this study which are ConvertVoiceToText class and RunCommand class.

• These two (2) classes proposed to identify the voice input from user and finally execute the command to run the application on the screen.

:: References

Austin. J, (__). The Computer Listens Up. Atariarchives.org. Retrieved : Mac 2, 2010, from :http://www.atariarchives.org/deli/computer_listens.php

Meir, D., & Zamir, Y. (2007). Mini Project : Saya Speech Recognition. Ben-Gurion University : Department of Computer Science. 

Sphinx Technologies Inc. (2009). Sphinx. Retrieved : Mac 2, 2010,

from : http://www.sphinxsearch.com/about.html

..thank you