Speech Recognition Robot

1
Speech Recognition Robot
Lab Book Beti Lula John
2
Speech Recognition Robot
Problem and Mission

• Civilizations Great Steps Forward
• Fire
• The Wheel
• The Printing Press
• The Steam Engine
• The Transistor
• Google
• ???

www.build-it-yourself.com
3
Speech Recognition Robot
Problem and Mission
Robots Will Rule!!! However to make this next
great leap forward, we need to make the interface
between humans and machines more natural.
www.build-it-yourself.com
4
Speech Recognition Robot
Project Plan

• Goal
• Design, build and present a speech recognition
  robot that is worthy of media attention.
• It must work.
• It must be engaging.
• Deliverables
• Power Point Lab book
• Working robot
• Presentation

www.build-it-yourself.com
5
Speech Recognition Robot
Project Plan

• Tasks
• Research
• Identify problem
• Specify solution functionality
• Build
• Test and modify
• Manage and document
• Market and present

www.build-it-yourself.com
6
Speech Recognition Robot
Teamwork

• Assign specific tasks to focused specialists
• Marketing Engineering Programming
• Market Demand - Technologies - Technologies
• Competition - Inputs / Outputs - Inputs /
  Outputs
• Sales Pitch - Specifications - Specifications
• Project Mgmt - Build - Program
• Present - Test Refine - Test Refine

www.build-it-yourself.com
7
Speech Recognition Robot
Performance
Attendance - Are you present? Professionalism -
Are you respectful of your lab and your
teammates? Teamwork - Did you help your teammates
or participate in discussions? Initiative - Did
you do something more than was expected? Results
- Did you get a result? Yes 1 No 0
www.build-it-yourself.com
8
Speech Recognition Robot
Project Management 4 Phases
1) Discovery Research applications
Research technology 2) Design Specify a
talking robot 3) Development Build a
talking robot 4) Deployment Document
project Present project
www.build-it-yourself.com
9
Speech Recognition Robot
Speech Recognition Applications
Document useful applications of speech
recognition robots. 1) Aviation 2) Healthcare 3)
Administration 4) Personal computers 5)
Production 6) ???
www.build-it-yourself.com
10
Speech Recognition Robot
Robots What are they good for?
Document what robots do better than
humans. Document what humans do better than
robots.
www.build-it-yourself.com
11
Speech Recognition Robot
Problem and Mission
Document a problem that could be solved by a
speech recognition robot. Document the mission.
(What must our speech recognition robot do to
solve the problem?)
www.build-it-yourself.com
12
Speech Recognition Robot
Problem Solving Techniques

1. Identify the problem and focus.
2. Build on the ideas of others.
3. Break the solution into simple parts.
4. Work with teammates.
5. Document.

www.build-it-yourself.com
13
Speech Recognition Robot
Measures of Success

1. Does it work 9 times out of 10?
2. Is it unique?
3. Will it attract media attention?

www.build-it-yourself.com
14
Speech Recognition Robot
Program Primitives

1. Series vs. Parallel
2. Iteration
3. Conditional
4. Variables
5. Messaging

www.build-it-yourself.com
15
Speech Recognition Robot
Strategies for recognizing speech
What are 3 attributes of speech that can be
detected and interpreted?
www.build-it-yourself.com
16
Speech Recognition Robot
Program Flow Chart to Detect Syllables
start
Start
Wait for syllable
Wait
Yes
No
2nd syllable detected ?
Display 2 syllables
Display 1 syllable
www.build-it-yourself.com
17
Speech Recognition Robot
Program Flow Chart to Detect Syllables
start
Start
No
Volume high ?
Yes
No
Volume low ?
Yes
End
www.build-it-yourself.com
18
Speech Recognition Robot
Tasks

• Marketing
• Develop an elevator pitch for your robot. 
  Research what an elevator pitch is.
• Design a one page advertisement for your robot.
• Design signs that explain how your robot works.
• Build expressive eyes, mouth, arms, and body.
• Write and record the script you want your robot
  to lead 
• (man - machine interaction) 
• Engineering
• Build the structure.
• Build a gear train that drives two shafts.
• Build a mechanism that makes eyes, mouth and
  arms move. 
• Programming
• Write a program to execute the script or man -
  machine interaction. 
• Document everything in your lab books.
•  

www.build-it-yourself.com
19
Speech Recognition Robot
Robot / Human Script
When visitor is detected, say Greetings! My
name is ... Welcome to Colegio Las Hayas. While
you are waiting, would you like to ... Please
answer, "Si" or "Huh, Huh" to my question. If
"Si" then say If "Huh, Huh" then say  
www.build-it-yourself.com
20
Speech Recognition Robot
Structure and components
Engineering This structure is good for mounting
motion modules and sensors at different
levels. The vertical shaft could make arms move
left and right.  
www.build-it-yourself.com Robot Structure Click
on Build-It-Blocks Select Presenting
Ideas Select LEGO Tall Structure Gear
Train Click on Build-It-Blocks Select Spin,
Rotate, Twirl Select Power Top Gear Train Mini 
www.build-it-yourself.com
21
Speech Recognition Robot
Structure and components
Engineering The Open n Close module can drive
many parts to move.  
www.build-it-yourself.com Robot Structure Click
on Build-It-Blocks Select Shake, Dance,
Flap Select Open n Close
www.build-it-yourself.com
22
Speech Recognition Robot
Structure and components
Engineering The arms and the mouth move.  
www.build-it-yourself.com
23
Speech Recognition Robot
Robots Made from Premium Quality Junk
www.build-it-yourself.com
24
Speech Recognition Robot
Speech Recognition Program
www.build-it-yourself.com
25
Speech Recognition Robot
Speech Recognition Program
www.build-it-yourself.com
26
Speech Recognition Robot
Speech Recognition Program
www.build-it-yourself.com
27
Speech Recognition Robot
Speech Recognition Program
Programming team  
www.build-it-yourself.com
28
Speech Recognition Robot
Robot Promo
Marketing team What can you say and show that
will make customers want to buy your robot? 1)
Write and perform a song that your robot will
sing. 2) Write and design an advertisement. 3)
Design a Web page or a Facebook page for your
robot.
www.build-it-yourself.com
29
Speech Recognition Robot
References
Example of project web site  http//www.build-it-y
ourself.com/support/support-workshops/wkshp-archiv
e/wkshp-glts-2002/index. Introduction to talking
robots at Tokyo University http//www.youtube.com/
watch?vLi4w9DPPNYINR1featurefvwp Demo of
MIT Kismet language vs expression http//www.youtu
be.com/watch?vdKZczUDGp_I Demo of how engaging
a talking robot can be. http//www.youtube.com/wat
ch?vHuqL74C6KI8featurerelated
www.build-it-yourself.com
30
Speech Recognition Robot
Project Summary

• What you should know
• The problem and mission
• 3 deliverables
• 3 measures of success
• 4 project management phases
• 3 reasons for modular construction
• 5 problem solving techniques
• 5 program primitives
• Effective use of Power Point, Google, Excel and
  collaboration tools

Reference Slides Follow
www.build-it-yourself.com
31
Speech Recognition Robot
Presentation Outline
Project Presentation 1) Introduce team members
and explain the parts of the project that were
most interesting to you. 2) State the
problem and mission (PPT Lab Book) 3) Describe
the 4 phases of project planning and who did
what. (PPT Lab Book) - Discovery -
Design - Development - Deployment 4)
Present your research (PPT Lab Book) 5) Present
your robot. 6) Grade your work on 5 measures of
performance. Questions 1) Why is modular
construction valuable? 2) Why is teamwork
important? 3) What do humans do well and what to
robots do well? 4) What are 5 computer
programming structures? 5) Describe how your
program works?
www.build-it-yourself.com
32
Speech Recognition Robot
Teamwork
The importance of teamwork in solving complex
problems. How many people are on the World of
Warcraft team? How many people to develop an
animated feature film?
www.build-it-yourself.com
33
Speech Recognition Robot
Teamwork
The importance of teamwork in solving complex
problems. How many people are on the World of
Warcraft team? 60 developers / 400 employees
when launched in 2001. 5000 employees in
2009. How many people to develop an animated
feature film? 75 artists using hand made
frames. 27 animators made Toy Story using
computer tools.
www.build-it-yourself.com
34
Speech Recognition Robot
Teamwork
The importance of teamwork in solving complex
problems. How many people worked for NASA when
we landed on the moon?
www.build-it-yourself.com
35
Speech Recognition Robot
Teamwork
The importance of teamwork in solving complex
problems. How many people worked for NASA when
we landed on the moon? 36,000 NASA employees when
man landed on the moon
www.build-it-yourself.com
36
Speech Recognition Robot
Lab Book Beti Lula John
Cant read from a distance. Image does not
relate to content
37
Speech Recognition Robot Lab Book Beti Lula John
Average, boring, not engaging
38
Speech Recognition Robot
Lab Book Beti Lula John
Direct, engaging