AI for Inclusive Development:Himachal Pradesh

Santanu ChaudhuryDirector, CSIR-CEERI Pilani

Professor, IIT Delhi (on lien)

Transformation & AI

• Using electronics and software to make everything intelligent • Intelligent Toaster• ..• ..• Intelligent Breast Scanner• Intelligent Orchard

• What should be an intelligent thing?• Self-adaptive - Ability to Learn• Ability to Decide• Ability to Explain what it does

• Status : Today Intelligent things can work in collaboration with human being• Can be a game-changer in governance

• Intelligent things can be tools for solving socio-economic problems• Pathway for new economy

Automate Processes

Challenge

• How do we develop/optimise/calibrate AI technologies which will • Minimize Gaps in services, productivity and efficiency/proficiency

• Maximize returns; and

• Yet, will not displace or cause shrinkage of job opportunities

Multi-objective multi-constraint decision Problem

Project Delivery in New Age: Cyber Physical Social System

• System built not only with intelligent things

• Regards human beings as a part of a system instead of placing them outside the system boundary.

• Such systems consist of not only cyberspace and physical space, but also human knowledge, mental capabilities, and socio-cultural elements.

• Recognition, Intelligence and Actions in Cyberspace combined with human decision making for real physical world implementation

Technology: Principle of Co-existence

• Sensors: Electronics for Observation – Intelligence at edge• Temperature, humidity, purity of water, pH, Colour, Odour, Snowfall, Wind-velocity

direction, rainfall, vibrations, rotations, pressure, etc.• Social Sensing - Enabling human beings to be digital observer

• Communication• To communicate observations and local intelligence – 3G, 4G, 5G

• Cloud• Integrated Intelligence using observations

• Decision support System • Human Intelligence to provide context and use

• Actuators to take action• Electronic operations• Human/Social Intervention

An example: Social Intervention

• Problem: Community Effort for Improved Cleanliness

• Can be addressed by the real-world social networks in communities• Social and Behavioural Interventions for positive changes

• Policy: A Scheme and Plan for Intervention

• To make Scheme and Plan more effective AI can provide strategy

• Influence Maximisation is a well known AI Technique for Cyber Social Networks

• These techniques are being explored in real communities solving real problems• Using Models of Communities• Relations in Real Communities• Taking socio-cultural ethos in context

• Case Study• Rehab of homeless Youths in USA

• Scheme and Plan can emerge through data analytics in the Cyber Space

• Action: Real world application of AI technique through social action

An Example: Remote Maintenance

• Equipment at remote locations• Micro-hydel plants, Water Treatment Units

• Sensors for Performance Data Collection• Automated or through human help

• Analysis at Cloud for fault analysis and Predictive Maintenance

• Supervisory Decision at Command Control

• Human intervention at site through mobile app based guidance

Case Study

CEERI is maintaining RO plants in different districts of Rajasthan through remote supervision

Automation and Robotics

Emerging Use Cases of Robotics• The McDonald has set-up “Create Your Taste” kiosk – an automated touch-screen

system that allows customers to create their own burgers without interacting with another human being.

• Australian company Fastbrick Robotics has developed a robot, the Hadrian X, that can lay 1,000 standard bricks in one hour – a task that would take two human bricklayers the better part of a day or longer to complete.

• In 2015, San Francisco-based startup Simbe Robotics unveiled Tally, a robot the company describes as “the world’s first fully autonomous shelf auditing and analytics solution” that roams supermarket aisles alongside human shoppers during regular business hours and ensures that goods are adequately stocked, placed and priced.

• Swedish agricultural equipment manufacturer DeLaval International recently announced that its new cow-milking robots will be deployed at a small family-owned dairy farm in Westphalia, Michigan.

Do we want such automations to happen in India?

Indian Scenario• Robotics Start-up Grey Orange builds ‘Butler’ robots that fetch and store products

and ‘Sorters’ that automatically scan and sort packages in the warehouses of e-commerce and logistics giants like Flipkart, Jabong and DTDC.

• Butler can pick up to 600 items an hour. That eclipses the 100 items a human worker can manage • invaluable efficiency in a country where supply chain costs are double those of Western

countries.

• Robots are more stable employee

• Robots are filling gaps• When workers start using collaborative robots in the mix they work better, more efficiently

and are happier with their jobs.

• Filling gaps rather than replacing people.

• India has 330,000 fewer doctors than the WHO’s minimum recommendation

• Smart machines combined with the internet could allow doctors and teachers to provide personalised services to many more people than they can today.

•

Indian Scenario• Low skill IT jobs like testing is being automated leading to job loss and opportunity shrinkage

• The plight of IT workers demonstrates that automation is already encroaching on areas without gaps to be filled.

• Automation and robotics will definitely impact lower-skilled people.• In India middle-class white collar worker will be possibly impacted the most

• Robotics and automation as per current technology trends • Enhance quality of manufacturing, • increase efficiency • Reduce cost and increase profit margin

• Current state of the art Robotics can enhance agricultural productivity

• Will this create as many new jobs ?• About 50% of the jobs lost will be compensated by the new jobs as per

estimates and projections• Job transformations

• Example: Automate routine customer services, humans to help solve customer problems, better customer experience

Reshaping: Changing the Division of Labour

• New division of labour emerging • Robots

• physical robots, intelligent software, and related autonomous and semi-autonomous mechanical and digital entities

• customers using automated self-service

• Employees

Contrasting Requirements

• Profitability in mass product or service requires automation

• Automation requires large investment

• MSME sector is unlikely to have the capital to invest

• MSME sector creates more jobs

• About 60% of jobs in the Indian economy are service oriented

• Automation is expected to improve quality of services

Emerging Workplace

• Cobots: Robots co-existing with human workers• A cobot intended to physically interact with humans in a shared workspace.• This is in contrast with other robots, designed to operate autonomously or with limited guidance• Democratisation of Robotics

• Collaborative Operation • Robots can operate in cooperation with or alongside humans in a shared workspace without safety fences or sensors.

• Safety Function • The collaborative robots stop safely in the event of contact with a human operator. • The collaborative robots can be pushed out of the way at anytime with minimal force. • There are safety standards - ISO 10218-1 for collaborative robots.

• Functionality • Force sensing and Integrated vision) are available.

• Most major Indian manufacturing/service companies are adopting this mode• Example: Bajaj Auto for pick-n-place, DTDC, Flipkart etc.• More demands• Robotics Start-up’s focus• Growth opportunity for Robotics Industry

Aggregated cobot

market more than

doubling in 2017 to

$680M. By 2025 the

industry will ship over

434K cobots per year

and equate to a ~$9.2B

market. This growth

implies a 56.5 percent

CAGR.”

Cobots with a Difference• Can we make Cobots/Automation available and tailored to labour intensive Indian MSME

sector ?• Increasing efficiency and productivity• Making workplace safe• Not changing over all manpower demand

• Designing intelligent human operated Implements • Addressing bottlenecks of specific industries• Managing unpredictable physical work

• Some sectors to look at• Jewelry

• Automation in stone shaping (precious and semi-precious) can enhance the quality of the product • Possibilities for innovation

• Leather• Textile

• Can address occupational health hazards• Silicosis problems of stone cutting workers typically in Rajasthan

• Challenge• Optimise cost• Ease of Operation• Flexibility

Areas to Explore for Cobots

• Appropriate Sensing Schemes

• Manipulator and Actuator Design

• Intelligent and flexible Control• Semi-autonomy• Learning

• HMI• Cognitive Workload Management

Specific DomainsConservation & TourismAgriculture and FoodDisaster Risk Management

AI Applications

Water90% of Himachal’s water drainage is through Indus River System. Management of water resources in HP is critical for India

An IoT approach for Context-aware Smart Water Management Using Ontology

Conceptual Model

Tourism & ConservationTourism is a major economic activity in Himachal. AI can provide a new dimension to tourism.

AI Driven Community Action in Eco-Tourism• 38% of all species on Earth are at risk.

• Key ecosystem services that humans depend on will also collapse. • Bees are responsible for pollinating 90 percent of major crops such as avocados, cherries,

and oranges

• Preventing species loss requires vast amounts of data on when and where plant, animal, and fungi species occur. • Deploying trained observers to every corner of the world is not possible.

• Eco-tourism can prompt an user to take a picture of a species on smart-phone through App• AI with computer vision models suggest the species depicted in the photo

along with specific location information via GPS

• This observation can then be confirmed by experienced naturalists. .

Ecosystem Management

• Data analytics based upon these observations provide insight to scientists and conservationists• When populations are shifting, when pest invasions occur, and how species

are reacting to the changing conditions

• Case Study• iNaturalist, an app supported by the California Academy of Sciences and

National Geographic Society, gives citizen scientists worldwide the ability to collect expert-level wildlife observations

AI and Virtual Reality for Tourism

• Presenting Ecological, Architectural and Intangible Heritage in a new way

• Experiential Tour• Richer experience to augment physical experience

• Adaptive Content Delivery

• Can be for marketing tourism

interactive story of HampiKnowledge Guided Experiencing

CASE STUDY

Space and Time Traversal

Knowledge driven Experience

A new paradigm in the domain of

experiencing heritage, which entails an

intellectual journey of an era, allowing

a person to explore a heritage site virtually

and experience the heritage in its past and

current context.

Intellectual Journey Concept

While exploring a heritage site, what if the user can :

• view the video of a dance performance depicted in a sculpture,

• read the text of a narrative portrayed in a mural painting

• compare with images of other mural paintings at other sites

• watch videos of rituals at the same site in current times

• hear recordings of different views given by various experts

Experiential Exploration Interface : A user of this system can explore a heritage site virtually, recreated usingactual site images. User can follow any of several paths :

Intelligent Story Telling: Adaptive Scripting of the Story➢ User clicks on a temple icon ➢ Click maps to a domain concept ➢ XML annotation files are searched to produce

✓ a set of images of the temple as it exists now, ✓ a text detailing its history and ✓ a video of a tour of its premises, and ✓ a 3D model of the temple as it was built originally

Experiential Exploration Interface :

Path2 : ➢ User views a weekly market or Bazaar in the temple➢ Selects a time-period (15th century) in history through the ontology.

✓ System retrieves an animation movie which recreates the Bazaar as it used to happen in the 15th century in that temple

Agriculture & FoodIncreasing agricultural crop yield with optimal input cost is needed for doubling farmer income and ensuring food security

Data Driven Agriculture• Data-driven techniques help boost agricultural productivity by increasing

yields, reducing losses and cutting down input costs. • Right input at right time in right amount

• Requires seamless data collection from various sensors, social sensing using smart-phone cameras and drones.

• Has to explicitly account for power and communication network outages

• Has to be low-cost and scalable• Return linked Business Model

• Farmers as active actors in implementation• Community driven guided action

• Combination of automated and manual intervention

• Methodology has to adapt to Indian Agricultural Practice• Not blind use of technology from developed countries

Getting Data is the challenge

To empower the farmers by providing right

information in right time through a mobile based agro-

advisory system

➢ Scope for IOT and AI based Intervention

➢ Maximum Influence model for advisory implementation

Managing Fruit Orchard

• Computer Vision based fruit detection is a critical component for infield automation in agriculture.

• With accurate knowledge of individual fruit locations in the field, it is possible to perform yield estimation and mapping• Facilitates efficient utilisation of resources and improves returns per unit area

and time.

• Precise localisation and assessment of the fruit state is also a necessary component of an automated robotic harvesting system• Cobots can improve efficiency without eliminating human workers which can

help mitigate one of the most

• Deciding to pluck using aroma and colour

Example

Food: Ensuring Quality

• Quality assurance & surveillance Essentially Recognition Problem

• Milk adulteration detection as case study

AI for Supply Chain Management of Perishable Goods

Control Room

at Dairy

Milk Collection Point

at Village # 1

Bulk Milk Cooler

(BMC) # 1

Milk Collection Point

at Village # 2

Milk Collection Point

at Village # n

Bulk Milk Cooler

(BMC) # 2

Perishability affects a large group of goods usually traded in the economy such as milk , fruits, vegetables , flowers

• IOT based Monitoring quantity and quality of supply

• Control action for quality assurance

• Demand forecasting model for intelligent storage decision

• Delivery scheduling for optimisedconsumption

Disaster ManagementFlash floods, land slides, Avalanches

Dealing with Avalanche

• Prevention of avalanche related deaths and impacts by improving avalanche forecasting.

• Trans-disciplinary platform for machine learning and data science to the field of snow science.• Making non-contact remote measurements and weather data to predict

based upon similarity with past situations• A new domain for Deep Learning

• Case Study• Open Avalanche Project – Global Community driven approach

• Similar work done at SASE

Disaster Prediction Using Satellite and Aerial Images• Can utilize artificial intelligence to constantly observe and analyze

images of the Earth’s surface and location data provided by satellites.• Fuse them with data obtained by using UAV’s

• Multi-scale data for more accurate prediction

• One Possible aim to predict the risk of landslides by observing steep slopes local geo-physical activities at micro and macro scale.

• AI-based analysis may be used to monitor aging infrastructure that could cause accidents, including roads and bridges

• Case Study: Initiatives in Japan

AI can play a major role in addressing socio-economic problems of India

Thank You

❖ Need right approach and initiatives❖ Should not lead to import of technology

increasing trade deficit

CSIR can play a key role in pilot AI based interventions in partnering with HP State Government