reactive learning agents
TRANSCRIPT
![Page 1: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/1.jpg)
Reactive Learning
AgentsJeff Smith
@jeffksmithjr
![Page 2: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/2.jpg)
Bio
![Page 3: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/3.jpg)
Bio
![Page 4: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/4.jpg)
Bio
![Page 5: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/5.jpg)
x.ai @xdotai [email protected] New York, New York
![Page 6: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/6.jpg)
Designing Agents
![Page 7: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/7.jpg)
Agents
![Page 8: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/8.jpg)
Software Agents
![Page 9: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/9.jpg)
Software Agents
Mmmm… Lunch.
![Page 10: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/10.jpg)
Software AgentsSensors
Actuators
Function
![Page 11: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/11.jpg)
Intelligent Agents
![Page 12: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/12.jpg)
Intelligent Agents
Maybe Later
![Page 13: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/13.jpg)
Intelligent Agents
Sensors
Actuators
Knowledge
Function
![Page 14: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/14.jpg)
Learning Agents
![Page 15: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/15.jpg)
Learning Agents
Not that One!
![Page 16: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/16.jpg)
Learning Agents
Sensors
Actuators
Knowledge
Learning
Function
![Page 17: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/17.jpg)
Reactive Machine Learning
![Page 18: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/18.jpg)
Reactive
![Page 19: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/19.jpg)
Reactive Systems
Responsive
Resilient Elastic
Message-Driven
![Page 20: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/20.jpg)
Reactive Strategies
Replication Containment Supervision
![Page 21: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/21.jpg)
Reactive Machine Learning
![Page 22: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/22.jpg)
Reactive Machine Learning
Uncertain DataInfinite Data
Laziness Pure Functions
Immutable Facts
Possible Worlds
![Page 23: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/23.jpg)
Reactive Learning Agents
![Page 24: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/24.jpg)
Learning Agents
Sensors
Actuators
Knowledge
Learning
Function
![Page 25: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/25.jpg)
Reactive Systems
Responsive
Resilient Elastic
Message-Driven
![Page 26: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/26.jpg)
![Page 27: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/27.jpg)
![Page 28: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/28.jpg)
![Page 29: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/29.jpg)
Reactive
![Page 30: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/30.jpg)
+ Learning AgentsReactive
![Page 31: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/31.jpg)
Source of AI Components
![Page 32: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/32.jpg)
Source of AI Components
Yours
![Page 33: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/33.jpg)
Source of AI Components
Other People’s Yours
![Page 34: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/34.jpg)
Sensors
![Page 35: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/35.jpg)
Sensors
•Messaging Platforms
•Phone cameras & sensors
•Wearables
![Page 36: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/36.jpg)
Sensors
•Messaging Platforms
•Phone cameras & sensors
•Wearables
•Your Data Collection Systems
![Page 37: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/37.jpg)
Reactive Data Collection
![Page 38: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/38.jpg)
Reactive Data Collection
![Page 39: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/39.jpg)
Reactive Data Collection
![Page 40: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/40.jpg)
Reactive Data Collection
![Page 41: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/41.jpg)
Reactive Data Collection
![Page 42: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/42.jpg)
Reactive Data Collection
![Page 43: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/43.jpg)
Reactive Data Collection
•Replication via Distributed databases
•Event-sourcing/immutable fact databases
•Uncertainty-aware data models
•AP Databases
https://skillsmatter.com/skillscasts/7038-lightning-talks-2
![Page 44: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/44.jpg)
Actuators
![Page 45: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/45.jpg)
Actuators
•Messaging platforms
•Notifications •External API Calls
![Page 46: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/46.jpg)
Actuators
•Messaging platforms
•Notifications •External API Calls
•Robots •Self-driving Cars •Internal API Calls
![Page 47: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/47.jpg)
Reactive Action
Sensors
Actuators
Knowledge
Learning
Function
![Page 48: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/48.jpg)
Reactive Action
Sensors
Actuators
Knowledge
Learning
Function
![Page 49: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/49.jpg)
Reactive Action
Sensors
Actuators
Knowledge
Learning
Function
![Page 50: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/50.jpg)
Reactive Action
Sensors
Actuators
Knowledge
Learning
Function
![Page 51: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/51.jpg)
Knowledge
![Page 52: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/52.jpg)
Knowledge
•External Datasets
•Knowledge as a Service APIs
![Page 53: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/53.jpg)
Knowledge
•External Datasets
•Knowledge as a Service APIs
•Your Training corpus •Institutional knowledge
![Page 54: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/54.jpg)
Elixir
•Functional Language •Homoiconic Syntax
•Concurrency-oriented •Runs on the bEAM (EVM)
![Page 55: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/55.jpg)
User Data
user2user1 user3
![Page 56: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/56.jpg)
Reactive Knowledge Systems
Adapted from https://github.com/mitchellhenke/circuit_breaker
![Page 57: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/57.jpg)
Reactive Knowledge Systems
![Page 58: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/58.jpg)
Reactive Knowledge Systems
![Page 59: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/59.jpg)
Reactive Knowledge Systems
![Page 60: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/60.jpg)
Reactive Knowledge Systems
![Page 61: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/61.jpg)
Reactive Knowledge Systems
![Page 62: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/62.jpg)
Learning
![Page 63: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/63.jpg)
Learning
•Machine Learning as a Service APIs
•Open Source Libraries
![Page 64: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/64.jpg)
Learning
•Machine Learning as a Service APIs
•Open Source Libraries•Your novel Algorithms
•Organizational Learning
![Page 65: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/65.jpg)
Reactive Learning
![Page 66: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/66.jpg)
Reactive Learning
![Page 67: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/67.jpg)
Reactive Learning
Raw Data Features Model
![Page 68: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/68.jpg)
Reactive Learning
Raw Data Features Model
![Page 69: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/69.jpg)
Reactive Learning
Raw Data Features Model
Raw Data Features Model
![Page 70: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/70.jpg)
Reactive Learning
Raw Data Features Model
Raw Data Features Model
![Page 71: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/71.jpg)
Reactive Learning
Raw Data Features Model
Raw Data Features Model
![Page 72: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/72.jpg)
Reactive Learning
Raw Data Features Model
![Page 74: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/74.jpg)
Agent Function
![Page 75: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/75.jpg)
Agent Function
•???
![Page 76: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/76.jpg)
Agent Function
•??? •Your Whole system
![Page 77: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/77.jpg)
Reactive Agent Functions
![Page 78: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/78.jpg)
Reactive Agent Functions
![Page 79: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/79.jpg)
Reactive Agent Functions
![Page 80: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/80.jpg)
Reactive Agent Functions
![Page 81: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/81.jpg)
Reactive Agent Functions
![Page 82: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/82.jpg)
Reactive Agent Functions
![Page 83: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/83.jpg)
Reactive Agent Functions
![Page 84: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/84.jpg)
Dialyzer in Action
ml_system.ex:3: Function predict/1 has no local returnml_system.ex:6: The call 'Elixir.MLSystem':call_model_b(feature@1::number()) will never return since it differs in the 1st argument from the success typing arguments: (binary())ml_system.ex:22: Invalid type specification for function 'Elixir.MLSystem':call_model_b/1. The success typing is (binary()) -> binary()ml_system.ex:23: Function call_model_b/1 has no local return
![Page 85: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/85.jpg)
Dialyzer in Action
ml_system.ex:24: The call 'Elixir.String':upcase(feature@1::number()) will never return since the success typing is (binary()) -> bitstring() and the contract is (t()) -> t()ml_system.ex:38: Function ensemble/1 will never be called
![Page 86: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/86.jpg)
Testing Agent Functions
Tool Tests
Dialyzer Types
QuickCheck Properties
Concuerror Interleavings
![Page 87: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/87.jpg)
Summary
![Page 88: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/88.jpg)
Learning Agents
Sensors
Actuators
Knowledge
Learning
Function
![Page 89: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/89.jpg)
Reactive Systems
Responsive
Resilient Elastic
Message-Driven
![Page 90: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/90.jpg)
Reactive Machine Learning
Uncertain DataInfinite Data
Laziness Pure Functions
Immutable Facts
Possible Worlds
![Page 91: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/91.jpg)
+ Learning AgentsReactive
![Page 92: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/92.jpg)
Reactive Machine Learning
reactivemachinelearning.com
@jeffksmithjr
Use the code gdgnycmu
for 39% off the book!
![Page 93: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/93.jpg)
x.ai @xdotai [email protected] New York, New York
![Page 95: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/95.jpg)
Thanks!
![Page 96: Reactive Learning Agents](https://reader030.vdocuments.site/reader030/viewer/2022011722/58727ba81a28abc7068b54b9/html5/thumbnails/96.jpg)
Reactive Learning
AgentsJeff Smith
@jeffksmithjr