cross cutting and advanced topics in distributed computing through service-oriented architecture and...
TRANSCRIPT
1
Cross Cutting and Advanced Topics in Distributed Computing through
Service-Oriented Architecture and Software Integration
Yinong ChenSchool of Computing, Informatics, and Decision Systems Engineering
Arizona State University, Tempe, AZ 85287-8809, U.S.A.
4th NSF/TCPP Workshop on Parallel and Distributed Computing Education (EduPar-14) In conjunction with 28th IEEE International Parallel & Distributed Processing Symposium
PHOENIX (ARIZONA) MondayMay 19, 2014
2
Three Courses Covered in Report
Course Number
Course Name First offered
Report Semester
Enrollment
CSE 101/ FSE 100
Introduction to Engineering
Fall 2006 Fall 2013 480
CSE 445/ CSE 598
Distributed Software Development
Fall 2006 Fall 2013 130
CSE 446/ CSE 598
Software Integration and Engineering
Spring 2012
Spring 2014
70
3
CSE101 / FSE100: Introduction to Engineering• Learn engineering design process through group activities• Use robot construction and programming to exercise design
and computing concept• Use service-oriented and event-driven approaches to
comprehend parallel computing principles• Started as a Computer System Engineering required course in
2006; Computer Science start to require the course in 2008; Become an required engineering first course in 2011.
• Start to be adopted overseas, universities in China and Vietnam started to offer the course in 2012
4
CSE101 / FSE100: Introduction to Engineering
DistanceMeasured < 400
TurnedRight
TurnedLeft
rightFinished
Resume180 DistanceMeasured
< rightDistance
TurningRight
TurningLeft
leftFinished
DistanceMeasured>= rightDistance
Resum180Finished
Start
RightDistance DistanceMeasured
Forward
Intel ArchitectureCornell Cup Robot
2013
Web AppsPhone Apps
Computer ScienceConcepts
Visual Programming
Robotic Experiments
http://venus.eas.asu.edu/WSRepository/eRobotic/
Algorithm and efficiency
Computer simulation
Web programming
Communication between Web robot and physical robot
Finite State Machine
http://venus.eas.asu.edu/WSRepository/eRobotic/
Intel-Based Robot as a Service (RaaS)Cornell Cup: http://venus.eas.asu.edu/WSRepository/eRobotic/video2013.wmv
6
CSE 445/598Distributed Software Development
• In service-oriented distributed systems, server applications may be invoked by multiple clients
• Multithreading with parallel computing and data synchronization using Intel’s Thread Building Blocks (TBB) is discussed
• Performance analysis and case study
Inputsize
Time measured in milliseconds
Results on Intel 32-Core MTL
7
Speedup Efficiency
8
CSE 445/598Distributed Software Development
Cross cutting and advanced topicsTopics Bloom
#Learning Outcomes
Cloud K Know that both are shared distributed resources - cloud is distinguished by on-demand, virtualized, service-oriented software and hardware resources
P2P K Server and client roles of nodes with distributed data
Security in Distri buted System
K Know that distributed systems are more vulnerable to privacy and security threats; distributed attacks modes; inherent tension between privacy and security
Web services A Be able to develop Web services and service clients to invoke services
Multithreading
C, A Resource sharing, synchronization, and performance impact
9
CSE 445/598 Distributed Software DevelopmentSample Project
AddUserInfo
Checkcredit score
Create account
Issue User ID
XML file account.xml
Approval?
Strong?Match?Yes
Yes
addPwd
Credit score Web service
Check existence
NoNo
No
Yes
User ID
PasswordRetypePassword
Subscribe
Name
SSN
Address
DoB
Create Password
You do not qualify
User ID
Password
Login
Client Provider
10
CSE446/598 Software Integration and EngineeringObjectives and Outcomes
• Distributed Application Architecture• Advanced Architecture-Driven Application
Development, workflow-based development• Enterprise Software Development and Message-
based Integration• Event-Driven Architecture and Applications• Interfacing Service-Oriented Software with
Databases and Big Data analysis• Ontology and Semantic Web• Cloud Computing and Software as a Service
CSE446/598: Infrastructure Supporting Big Data
Share nothing
DataCollection
DataAnalytics
Data & Facility
Management
Data-AppIntegrationVariety
VelocityVolume
Variability Veracity
VolatileValue
SuperComputer
Multi-processors
Shared-diskclusters
Distributed / Networked
Shared-nothingcluster
Multi-cores
SimpleComputer
Share Everything
Share cache, memory, and disk
Share memory, and disk
Share diskScale up
Scale out
Infrastructure and Facilities
11
Characteristics
12
Hadoop and Web Service Project
Mapper
Job Tracker
Name Node
Master Slave
Map
Red
uce
Laye
rH
DF
S L
ayer
Reducer Mapper Reducer
Tomcat
Web service
Data sheet
Result sheet
Final result
Data sheet
Result sheet
Final result
13
ASU REPOSITORY OF SERVICES AND APPLICATIONS
• Private Services: Many corporations, e.g., IBM and SAP, keep their repositories private for internal use only. Not be available for education purposes
• Paid Services: Many corporations, for example, Amazon Web Services, offer commercial services and subscription and payments are required.
• ASU repository offer free services for education purposes
http://venus.eas.asu.edu/WSRepository/repository.html
14
Textbook for CSE101, CSE445 and CSE446 Part I Distributed Service-Oriented Software Development and Web Data ManagementChapter 1Introduction to Distributed Service-Oriented ComputingChapter 2Distributed Computing with MultithreadingChapter 3Essentials in Service-Oriented Software DevelopmentChapter 4XML Data Representation and ProcessingChapter 5Web Application and State ManagementChapter 6Dependability of Service-Oriented SoftwarePart II Advanced Service-Oriented Computing and System IntegrationChapter 7Advanced Services and Architecture-Driven Application DevelopmentChapter 8 Enterprise Software Development and IntegrationChapter 9 Internet of Things and Robot as a ServiceChapter 10 Interfacing Service-Oriented Software with DatabasesChapter 11 Big Data and Ontology Systems Chapter 12 Service-Oriented Application ArchitectureChapter 13 A Mini Walkthrough of Service-Oriented Software DevelopmentChapter 14 Cloud Computing and Software as a ServiceAppendixService-Oriented Robotics Software Development
Service-Oriented Computing and Web Software Integration, 4th ed. in 2014