village dynamics studies knowledge bank: an overview
TRANSCRIPT
Village Dynamics Studies
Knowledge Bank:
An Overview
Presented during workshop on “An Orientation to Data Management Platforms for Agricultural Research & Extension”, 5-6 Dec, 2013
Anupama GV
Uttam Kumar Deb
Ravi Chand K
Elias Khan Patan
MCS Bantilan
• ICRISAT views small farms as a business
entity and committed to promote IMOD
• The Knowledge bank is developed using
Microsoft SQL Server and Microsoft
Business Intelligence tools
• First of its kind in the CGIAR system
• First in the world for management of rural
household survey data
• Provide easy access to panel data with
online analytical and processing (OLAP)
features
VDSA Knowledge bank
VDS Knowledge Bank:
On-line Repository of Panel Data
Village Dynamics Studies try to understand rural dynamics using Long-term Panel Data
• Household level
• Village level
• District level
and provide insights from grass roots for informed policy making
Location of 42 VDS villages:
SAT India, East India and Bangladesh
• A: Household Census Schedule
• GES: General Endowment Schedule
• D: Plot List and Cropping Pattern Module
• K: Employment Module
• L: Transaction Module
• M: Monthly Price Module
• Y: Cultivation Module
• Z: Livestock Module
• Daily Rainfall Data
Modules for VDSA Household Survey
Existing System
• Data are in Excel, ASCI, CSPro
• Data manuals are in PDF, Word
• Available through VDSA webpage
• Data extraction and analysis is time consuming
• No scope for data mining
VDSA Data Users During the last two
years (December
2011 to November
2013)
• 428 unique users
from 24 countries
of Asia, Africa,
Europe and North
America have
down loaded
newly released
data.
• These include 219 students from 95
universities in 24 countries including 103
PhD. students.
Features of the Knowledge bank
• On Line Analytical Processing (OLAP)
Facilities
• Summary reports
• User Defined Reports
• Raw data access
• Drill down features from country level to
plot level
• Supports decision making system
• Web enabled front end
• Project management tools
• User Manual
• FAQs
Features of the Knowledge bank
User-friendly data retrieval system
Features of the Knowledge bank User-friendly data retrieval system
Summary Reports / Canned Reports
Summary Reports / Canned Reports
Number of Reports: 17
• Rainfall
• Land ownership
• Cropping pattern
• Income, by sources and class
• Costs and Returns
• Wage rate for Male and Female
• Sources of Information
• Consumption and expenditure on food and
non-food items
• Asset ownership and value
Rainfall in Aurepalle: 1975 to 2013
Rainfall (mm) Summary, Aurepalle: 2012-13
Jul Sept Nov Dec Jan Feb Mar Apr May
145 107 53 0 0 67 0 24 15
155 18 0 0 0 0 3 74 20
56 133 66
14 121 43Previous Year
(2011-2012)
Jun Aug Oct
Present Year
(2012-2013)
Total rainfall in Oct to Jan 118.80
Total rainfall in Feb to May 106.00
First rainy day 9/7/2012
Total no of rainy days 51
No of rainy days in rainy season
(June to Sept)
34
Total rainfall in June ot Sept 440.60
Particulars for Year 2012 - 2013 Values
Total Annual rainfall 665.40
Average monthly rainfall 55.45
Weekly Rainfall (mm) Summary
Cropping Pattern in Kalman: 2011 Rabi Season Country
State/Region
District
Village
Season
Year
Crops Area (Ha)
Chickpea 0.10
Sorghum 6.27
Wheat 0.20
Chickpea 0.81
Sorghum 18.51
Wheat 0.51
Chickpea 0.30
Sorghum 26.41
Wheat 0.30
Chickpea 0.20
Sorghum 3.18
Wheat 0.40
Labour 5.34
83.99
10.67
Medium 4.08
93.37
2.55
Small 1.12
97.75
1.12
2011
Farm Size Percentage
Large 1.54
95.38
3.08
India
Maharashtra
Solapur
Kalman
Rabi
Citation: VDSA (2013). Village Dynamics in South Asia (VDSA) database, generated by ICRISAT/IRRI/NCAP in partnership with national institutes in India and Bangladesh. (http://vdsa.icrisat.ac.in).
Number of records skipped in above calculation:
0
User Defined
Reports
User Defined Reports
User Defined Reports
• Number of Reports: 40
• Investment
• Government development programs
• Stock inventory
• Farmer’s behaviour
• Coping mechanisms
• Profitability in crop and livestock farming
• Employment
• Prices of essential commodities and agricultural
inputs
User Defined Reports
User Defined Reports
User Defined Reports
Project Management
Tools
• ETL Success failure ratio - Pie chart for
success and failure ratio
• User Registration - Bar chart for New
user registration under each user roles
• Usage Statistics - Bar chart of top 10
reports executed by the user
• Data Upload - Table with recent 20
successful data uploads
Project Management – VDSA Data Users
Project Management – Usage Statistics
Project Management – Project Tracking
Project Implementation
• Discovery
• High Level Design
Phase 1
• Detail Design
• Development
• Unit test
• System Integration test
Phase 2 • UAT
Deployment support
• UAT
Phase 3
• Production Deployment support
• Go-live,Training
Phase 4 • Post Go-live
Stabilization support
Phase 5
Phase I - Activities
• Orienting Sonata about VDSA data
• Developing the SRS
• Data organizing
• Following protocols
• Unique id development
Phase II - Activities
• Developing integrated tables and structures
across the regions and generations.
• Data cleansing for ETL
• Development of data Dictionary
• Organizing data as per dictionary.
• Code files linking variables and codes
• Developing the business rules to generate
canned reports
Phase III - Activities
• Preparation of test cases for summary
reports
• Testing the reports against prepared test
cases
• Reporting bugs
• Re-testing after bugs fixing
Phase IV - Activities
• Learning ETL process
• Running the ETL
• Packages execution and cube processing
• Users training
• Administrator training