Artificial Intelligence

1
Artificial Intelligence

• Seyed Hashem Davarpanah
• Davarpanah_at_usc.ac.ir
• University of Science and Culture

2
Text Book

• Illuminated Artificial Intelligence, Ben Coppin,
  Jones and Barlett 2004
• ??? ?????? ????? ??? ???? ????????, ????????
  ???????
• Artificial Intelligence A Modern Approach 3rd
  edition By Stuart Russel, Peter Norvig

3
Grading
Midterm Exam 25
Project or Presentation 15
Homework 10
Conference Paper (Extra) 10
Journal Paper (Extra) 15
Class Activities (Extra) 10
Final Exam 50
4
Contents
Introduction
Agents
Knowledge Representation
Problems and Search Blind Search , Heuristic Search Constraint satisfaction, Optimization Problems
Games Game Tree, Games of chance
Advanced Topics Logic, Uncertainty and Imprecision Planning, Machine Learning
5
What is intelligence?

• Intelligence of Creatures
• Intelligence of Non-Creatures
• Intelligence of Human

6
Intelligence of Creatures

• Ape can
• Use tool to get banana
• Buy coke from vending machine
• Dophin can
• Understand language communicate with human
• Dog can
• Recognize its master and his voice
• Do a few jobs
• Parrot can
• Do arithmetic

7
Intelligence of Creatures

• Ants can
• Find their way home
• Communicate with one other
• Manage their society
• Tree can
• Grow and do not collapse
• Adapt itself to the environment (cactus)
• Migrant birds can
• Identify their direction

8
Intelligence of Non-Creatures

• Blood
• Heartbeat
• Virus
• Neuron
• Rain
• Do not seem to come from thinking with knowledge
  or information consciously

9
Intelligence of Human

• Problem-Solving
• Reasoning
• Learning
• Planning
• Communicating
• Perceiving
• Acting

10
What is AI?

• Intelligence ability to learn, understand and
  think (Oxford dictionary)
• AI is the study of how to make computers make
  things which at the moment people do better.
• Examples Speech recognition, Smell, Face,
  Object, Intuition, Inferencing, Learning new
  skills, Decision making, Abstract thinking

11
Strong AI vs. Weak AI

• ??? ?????? ???
• ?????? ??? ?????? ??? ?? ??? ????????? ?? ??
  ????? ?? ?????? ????????? ?? ???? ???????? ???? ?
  ?? ????? ??? ???? ???? ??? ??????? ????????? ????
  ?? ?? ???? ??? ?????? ? ???? ???? ?? ?? ?????
  ?????? ???? ?????? ???????.
• ??? ?????? ????
• ?? ??? ??? ?????? ????? ????? ?????? ???????? ???
  ??? ? ??? ?? ????? ?????? ???? ??????? ???? ????
• ? it is not necessary to mimic human (e.g.
  arithmetic)
• ? it is not necessary to imitating birds in
  order to fly
• ???? ?? ??? ???? ?? ?????????? ????? ?????????
  ????? ???????? ?????? ??? ?? ?????? ????? ??????
  ?????

12
Definition of AI

• Weak AI
• Artificial intelligence is the study of systems
  that act in a way that to any observer would
  appear to be intelligent.
• Strong AI
• Artificial intelligence involves using methods
  based on the intelligence behavior of humans and
  other animals to solve complex problems.

13
???? ????

• ??? ???? ???? ???? ?? ?? ?????? ????? ?? ???
  ?????? ??? ???? ????.
• ?? ??? ??????? ???? ?? ?? ???? ???? ????. ?? ??
  ???????? ?? ???? ????? ???? ???? ?? ?????? ? ??
  ?????. ?? ???? ???? ????? ???? ???? ????? ?? ???
  ???? ?? ??? ????????? ???? ?? ????? ?????
  ???????? ? ?????????? ?? ???? ??????? ????? ???
  ???. ?? ??????? ?? ???? ????? ?? ???? ??? ?? ????
  ???? ???? ??????. ????? ?????? ?????? ?? ???
  ?????? ??????. ?? ????? ???? ???????????? ?? ???
  ?? ??? ???? ?? ???????? ???????? ?? ?? ??????? ??
  ????????? ??? ??????? ?? ?? ???? ???? ????????
  ????? ? ???? ?? ?? ???? ??? ?? ?????????? ?? ???.
  
• ??????? ???? ?? ??????? ???? ???. ??? ?? ?????
  ???? ????????. ???? ??????? ???? ?????????. ????
  ???? ???? ????????. ??? ????? ?? ????? ????????
  ???????? ?? ??? ???? ??? ?? ?? ???? ?????? ????
  ??? ?? ????? (?? ????? ?? ??) ???? ????????.
• ?? ????? ????? ?????????? ?? ?????? ????????? ??
  ?? ??? ?????? ????? ????? ????? ?? ????? ????
  ??????? ?? ??????? ????? ?????.
• ??? ??????? ?? ?????? ?????? ?????? ????. ??????
  ?????? ?????? ?????? ?????? ??? ?? ?????? ?????
  ?? ??? ???? ?? ???? ?? ????? ??? ??? ?? ?? ??? ??
  ????? ???.

14
Strong Method vs. Weak Method

• ??????? ???
• ??????? ??? ?????? ????? ?? ?? ???? ????? ??
  ?????? ?? ???? ? ??? ???????? ?? ?? ??? ?? ???
  ??? ??????? ?????????. ??? ?? ?????? ?? ?????
  ?????? ???? ?? ??????? ?? ??? ?????? ?????? ??
  ??????? ?? ??????? ??? ???????.
• ??????? ????
• ??????? ???? ?????? ????? ?? ?????? ?? ???? ?
  ?????????? ?? ???? ? ?????? ?? ??? ?? ???? ??
  ?????? ?????????. ???? ????????? ???? ??? ?? ???
  ???? ?? ??? ?????.

15
AI History

• Aristotle 384-322 B.C. Syllogism
• ????? ????? ???? ?? ??? ???? ?? ???? ?????
  ??????
• ???? ?? ?????? ??? ?????? ????? ??????? ????
  ????? ? ???? ????? ?????? ??? ???? ?????? ?????
  ???? ???? ???????.
• All men are mortal. Socratis is a man. ? Socrais
  is mortal
• Gottfried Leibniz, late 17th century
• Developing a formal mathematical language for
  reasoning
• George Boole, 1815-1864
• Boolean algebra
• Gottlob Frege, 1879,1884
• First-Order Predicate Calculus
• Charles Babbage, 1950s
• Analytic engine first computer

16
Turing Test

• Alan Turing, Computing Machinery Intelligence,
  1950
• An Interrogator
• Is given access to two individuals a human and
  a computer
• Can ask the two individuals any questions in text
  mode
• Is requested to distinguish the computer from
  the human
• If the interrogator cannot distinguish the
  computer from the human, then the computer may be
  assumed to be intelligent.

17
Turing Test
18
Turing Test

• Giving an objective notion of intelligence
• The behavior of a known intelligent being in
  response to a particular set of questions
• Preventing from being sidetracked by confusing
  unanswered questions
• whether the computer uses internal processes
• whether the machine is conscious of its actions
• Eliminating bias in favor of living organisms
  over machine intelligence

19
Influences of Turing Test

• No program has passed the Turing test yet
• Providing a basis for many schemes used to
  evaluate modern AI programs
• Human behaviors could be as indications of
  intelligent or good
• Examples
• Expert system
• Information retrieval
• Speech synthesis
• Spoken dialogue (wizard of Oz)

20
AI History

• Artificial Intelligence was first used by John
  McCarthy at a conference in Dartmouth College, in
  Hanover, New Hampshire.
• John McCarthy invented LISP programming language
  in 1958
• Newell and Simon (1957)invented the idea of the
  General Problem Solver (GPS)
• To solve almost any logical problem
• Means-ends analysis

21
AI History

• 19601990
• Optimism ? Realism
• No longer to create a robot as intelligent as a
  human, but rather to use algorithms, heuristics,
  and methodologies based on the ways in which the
  human brains solves problems.

22
Philosophy(???? ? ?????)

• Socratis and Plato
• ???????? ????? ?? ??? ?? ??????? ?? ?? ?????
  ???????? ??? ?? ???? ?????? ???????? ???? ????...
  ?? ???? ?? ?? ?????? ?? ?? ????? ???? ? ?? ?????
  ?? ????? ????????? ?? ?? ??????? ??? ? ?? ?????
  ?? ???? ? ??????? ?? ????? ??? ? ???? ????????
  ????? ???? ???.
• ??? ?? ??? ?? ??? ?????? ?? ????????? ?? ????????
  ???? ???? ????? ??? ?? ????? ????? ??? ?? ???? ??
  ??? ????? ?? ????? ?? ?????? ???????? ?????
  ??????? ??? ???? ??? ?? ???? ????? ??? ?????? ?
  ??? ??? ???? ???????? ?????? ?????
• An algorithm could be defined that described the
  behavior of humans determines whether a persons
  behavior was good or bad.
• Rene Descartes (17th century)
• ???? ?? ?? ???? ?????? ??? ????? ??? ??? ??? ?
  ???. ??? ?????? ?? ??? ?????? ????? ? ?? ??? ???
  ?? ???? ?? ????? ???? ???. ?? ?? ?????? ????????
  ????? ??? ?? ??? ??????? ?????? ??????? ????
  ????.

23
Linguistics(??????????)

• Noam Chomsky 1950s
• Syntactic Structure a formal theory of the
  structure of human language
• A structure of human knowledge

24
Psychology (????????? ??????)

• Cognitive psychology (????????? ??????)
• Human brain uses knowledge or information that it
  is capable of processing in order to solve
  problems, make decisions, draw conclusions, and
  carry out other intelligent acts.
• Behaviorism (??????????)
• stimuli ? behavior
• ??????????? ????? ?? ???????? ?? ?????????? ??
  ?????? ??????? ???? ????? ??????? ? ???? ????? ??
  ??? ?? ?? ???? ?? ????? ???? ???.

25
Biology(??? ????)

• Neural Network
• Learning capability
• Genetic Algorithm
• Gene, chromosome
• Evolution
• Speech Recognition
• Computer Vision

26
Four Approaches of AI
Logic
Cognitive Science
Turing test Knowledge rep. NL processing Machine
learning Automatic reasoning robotics
Rational Agent
27
AI Programming Language

• C, Java, PROLOG, LISP (List Programming)
• PROLOG (Programming in Logic)
• Facts made_from(cheese, milk).contains(milk,
  calcium).
• Rules contains(X, Y)- made_from(X, Z),
  contains(Z, Y).
• Queries
• contains(cheese, calcium). ? yes
• contains(X, calcium) ? Xmilk. Xcheese.

28
AI Application Area

• Game Playing
• Automatic Reasoning Theorem Proving
• Expert Systems
• Natural Language Understanding and Semantic
  Modeling
• Planning and Robotics
• Scheduling
• Machine Learning
• Neural Networks

29
List of AI Publications

• General AI conferences IJCAI, AAAI, ECAI
• Reasoning under uncertainty UAI
• Machine learning ICML, NIPS
• Multi-agent systems AAMAS
• Vision ICCV, CVPR
• Some journals Artificial Intelligence, Journal
  of AI Research, Machine Learning, Journal of ML
  Research, Journal of Autonomous Agents and Multi
  Agent Systems
• AI Magazine

30
Some AI videos

• Note there is a lot of AI that is not quite this
  sexy but still very valuable!
• E.g. logistics planning DARPA claims that
  savings from a single AI planning application
  during 1991 Persian Gulf crisis more than paid
  back for all of DARPAs investment in AI, ever.
  Russell and Norvig
• http//www.youtube.com/watch?v1JJsBFiXGl0feature
  related
• http//www.youtube.com/watch?vICgL1OWsn58feature
  related
• http//www.cs.utexas.edu/kdresner/aim/video/fcfs-
  insanity.mov
• http//www.youtube.com/watch?vHacG_FWWPOwfeature
  related
• http//videolectures.net/aaai07_littman_ai/
• http//www.ai.sri.com/nysmith/videos/SRI_AR-PA_AA
  AI08.avi
• http//www.youtube.com/watch?vScXX2bndGJc