natural language to machine readable format by: damian tamayo presentation 1 – oct. 12, 2009 cis...
TRANSCRIPT
Natural Language to Machine Natural Language to Machine Readable FormatReadable Format
By: Damian TamayoBy: Damian Tamayo
Presentation 1 – Oct. 12, 2009Presentation 1 – Oct. 12, 2009
CIS 895 – MSE ProjectCIS 895 – MSE Project
DocumentationDocumentation
cis.ksu.edu/~dtamayocis.ksu.edu/~dtamayo What I want to do, Where I want to goWhat I want to do, Where I want to go
Vision Document – Project OverviewVision Document – Project Overview
My plan to get thereMy plan to get there Project PlanProject Plan Gantt ChartGantt Chart
Standards/Guidelines Standards/Guidelines SQA PlanSQA Plan
OverviewOverview Project OverviewProject Overview
The GoalThe Goal
Project RequirementsProject Requirements Examples – Simulated outputExamples – Simulated output
ParsingParsing Logical OutputLogical Output SemanticsSemantics PPOSPPOS
SQASQA
Cost EstimationCost Estimation
Project ScheduleProject Schedule
QuestionsQuestions
Project Overview - GoalProject Overview - Goal
Employ natural language processing to Employ natural language processing to detect structure and semantics of a detect structure and semantics of a sentence in order to output correct logic so sentence in order to output correct logic so that it can be in machine readable format that it can be in machine readable format accurately represent the inputted text accurately represent the inputted text understand the parsed structure that is understand the parsed structure that is
represented represented Ex: Two cars entered the same intersection from Ex: Two cars entered the same intersection from
different roadwaysdifferent roadways
Project RequirementsProject Requirements
Program RequirementsProgram Requirements Main focus of MSE projectMain focus of MSE project
Proprietary POS TaggerProprietary POS Tagger Ensure correct InputEnsure correct Input
Program Requirements Program Requirements
Req1 (Critical) GUIReq1 (Critical) GUI A.)POS tagger output tabA.)POS tagger output tab B.(Critical) User input (ui) tab/process -> split B.(Critical) User input (ui) tab/process -> split
sentences tabsentences tab C.) Split sentences tab -> hold process uiC.) Split sentences tab -> hold process ui D.(Critical) tab for internal representationD.(Critical) tab for internal representation E.(Critical) ontology tab for showing logicE.(Critical) ontology tab for showing logic F.(Critical)PPOS tagger – ensure inputF.(Critical)PPOS tagger – ensure input
Program Reqs (cont)Program Reqs (cont)
Req2 – error messages/servers not Req2 – error messages/servers not runningrunning
Req3 – UI free from grammatical errorsReq3 – UI free from grammatical errors
Req4 – UI not ambigousReq4 – UI not ambigous
Req5 – UI can be multiple sentencesReq5 – UI can be multiple sentences
Program Reqs (cont)Program Reqs (cont)
Req6 – Dynamic UIReq6 – Dynamic UI
Req7 – Correct punctuation Req7 – Correct punctuation
Req8 (Critical) – Internal Rep correct Req8 (Critical) – Internal Rep correct
Req9 – UI not use pronounsReq9 – UI not use pronouns
Req10 – UI not use inferenceReq10 – UI not use inference
PPOS ReqPPOS Req
PReq1 – PPOS tab -> UI manually tagPReq1 – PPOS tab -> UI manually tag A.) Supersedes other POS taggersA.) Supersedes other POS taggers B.) Return parse of sentenceB.) Return parse of sentence
PReq2 – tag options similar to other POS PReq2 – tag options similar to other POS taggerstaggers
PReq3 – Dynamic taggingPReq3 – Dynamic tagging
Expected GUIExpected GUI
Expected GUI – Split SentencesExpected GUI – Split Sentences
Expected ParseExpected Parse
Example Parse Output 2Example Parse Output 2
Expected Internal RepresentationExpected Internal Representation
Expected Logic OutputExpected Logic Output
Expected Logical RepExpected Logical Rep If you are entering a through street or highway at which there are If you are entering a through street or highway at which there are
stop signs, you must stop completely and proceed when you can do stop signs, you must stop completely and proceed when you can do so without interfering with other traffic.so without interfering with other traffic.
Expected PPOS Expected PPOS
Expected PPOS Expected PPOS
SQASQA
Supervisory CommitteeSupervisory Committee Attend presentationsAttend presentations Provide feedbackProvide feedback
Major ProfessorMajor Professor Meet with developer/weekly basisMeet with developer/weekly basis
DeveloperDeveloper Produce product in given timeframeProduce product in given timeframe Meet weekly w/ Major ProfessorMeet weekly w/ Major Professor
SQA (cont)SQA (cont)
Documentation and Coding StandardsDocumentation and Coding Standards Existing Project Existing Project
Adding ontoAdding onto Follow existing examplesFollow existing examples
MetricsMetrics COCOMO IICOCOMO II
Reviews AuditsReviews Audits Michael Marlen – chief advisor Michael Marlen – chief advisor
SQA (cont)SQA (cont)
TestingTesting Dynamic Basis Dynamic Basis
As code is integrated As code is integrated
ToolsTools MS Visual Studio 2008MS Visual Studio 2008 TortoiseSVN TortoiseSVN
Source ControlSource Control
Cost EstimationCost Estimation
COCOMO IICOCOMO II Effort – 2.45 * EAF * (KSLOC) ^ 1.09Effort – 2.45 * EAF * (KSLOC) ^ 1.09
Time = 2.5 * (Effort) ^ 0.38Time = 2.5 * (Effort) ^ 0.38
26.8 = 2.45 * 0.89 * 10^1.09 26.8 = 2.45 * 0.89 * 10^1.09 8.7 = 2.5 * 26.8 ^0.388.7 = 2.5 * 26.8 ^0.38
EAFEAF
EAF EAF
EAFEAF
Cost EstimationCost Estimation
COCOMO IICOCOMO II Effort – 2.45 * EAF * (KSLOC) ^ 1.09Effort – 2.45 * EAF * (KSLOC) ^ 1.09
Time = 2.5 * (Effort) ^ 0.38Time = 2.5 * (Effort) ^ 0.38
26.8 = 2.45 * 0.89 * 10^1.09 26.8 = 2.45 * 0.89 * 10^1.09 8.7 = 2.5 * 26.8 ^0.388.7 = 2.5 * 26.8 ^0.38
Gantt ChartGantt Chart
MilestonesMilestones
Internal RepresentationInternal Representation
Logical RepresentationLogical Representation
PPOS TaggerPPOS Tagger
Project ScheduleProject Schedule
Presentation 1 – Oct 12, 2009Presentation 1 – Oct 12, 2009 Inception Phase Inception Phase
Presentation 2 – November 5, 2009 ?Presentation 2 – November 5, 2009 ? Elaboration PhaseElaboration Phase
Presentation 3 – December 3, 2009 ?Presentation 3 – December 3, 2009 ? Production Phase – Final Product Production Phase – Final Product
Phase 2 DeliverablesPhase 2 Deliverables
Vision Plan 2.0Vision Plan 2.0 Project Plan 2.0Project Plan 2.0 Architectural Design DocumentArchitectural Design Document Software Test Plan 1.0Software Test Plan 1.0 Technical Inspection Technical Inspection Presentation 2Presentation 2
To DoTo Do
Revise DocumentsRevise Documents
Build GUIBuild GUI
Implement Internal RepresentationImplement Internal Representation
Phase 2 DocumentsPhase 2 Documents