What is a PUMS?

1
What is a PUMS?

• Jouni Isoaho
• University of Turku, Department of Information
  Technology
• Laboratory of Communication Systems, FIN-20520
  Turku
• Tel. [phone], Fax. [phone]
• Email jouni.isoaho_at_utu.fi

2
A Meeting Place for Many Branches of Sciences

• Language technology is multidisciplinary branch
  of science covering all forms and dimensions of
  human language
• Speech technology is multidisciplinary branch of
  science covering all forms and dimensions of
  human speech
• Phonetics is study of speech production,
  acoustics and perception
• Digital signal processing covers methods and
  techniques to manipulate digital signals (e.g.
  speech, audio, image, video, )
• Communication systems covers communication
  concepts, applications and implementation
  technologies
• Computer sciences covers algorithmics, AI,
  programming techniques, information systems,
  bioinformatics, human-computer interaction
• Teaching technology (didactic IT) electric tools
  and methods for promoting learning process

3
Objectives of the Project

• Key objective is to create a new technology
  sector to Finland
• Collect together all interest groups
• Enhance co-operation to gain enough critical mass
• Do this consortium to global key player
• Education to provide competent working power
• Human-technology interaction
• Provide human pull to IT technology development
• Multidisciplinary co-operation

End-users
Technology appliers
Technology developers
4
Towards New Development Drivers
Current Driver
Technology development
Technology
Products
Applications
Users needs
Users needs / applications
???
5
Summary

• Speech and language technology will impact very
  strongly on future IT development
• Own technology programme or a part of larger real
  multidisciplinary IT programme (human
  technology)?
• Leading multidisciplinary universities should
  take much stronger role in IT technology
  development
• Current funding mechanisms and working procedures
  are not valid anymore for creating continuously
  agile, global innovation and development
  centres/areas
• Long-term research, short-term RD, education,
  mobility/globalisation and new business should be
  approached as overall
• It requires coherent programmes between Academy
  of Finland, TEKES, Ministry of Education, SITRA,
  

6
The structure of the project

• Speech recognition, production and learning
• Speech as a biometric identifier
• Speech based human interaction

7
T1 Core speech production / Olli Aaltonen

• D1.1 Highly intelligible truly artificial speech
  for Finnish (TY)
• D1.2 Highly intelligible truly artificial speech
  for English (TY)
• D1.3 Application study for speed control (TY)
• D1.4 Ubiquitous implementation for mobile
  environments (TY)
• D1.5 Multilingual text-to-phoneme implementation
  using neural networks (TTY,TY)

8
T2 Interactive learning / Tapio Salakoski

• D2.1 Reinforcement of phonemic memory models (HY,
  TY)
• D2.2 Audio-visual feedback from articulation
  vowels (TY, HY)
• D2.3 Audio-visual feedback from articulation
  consonants (TY, HY)
• D2.4 Audio-visual feedback from prosody (HY, TY,
  TTY)
• D2.5 Characterisation of core speech for improved
  learning (TY)

9
T3 Speech and speaker adaptation / Mikko Kurimo

• D3.1 Speaker adaptation for recognition (TKK)
• D3.2 Speaker adaptation for synthesis (HY)
• D3.3 Utilisation of syntactic information for
  synthesis (HY, TY)

10
Project Research Partners

• Universities and Research Institutes
• University of Turku
• Communication Systems (coordinator)
• Prof. Jouni Isoaho
• Computer Science
• Prof. Tapio Salakoski
• Phonetics
• Prof. Olli Aaltonen
• University of Helsinki
• Phonetics
• Prof. Antti Iivonen
• Language technology
• Ph.D Martti Vainio
• Translation Sciences
• Prof. Kristiina Jokinen
• Helsinki University of Technology
• Computer and Information Science
• Prof. Mikko Kurimo
• Acoustics

• Tampere University of Technology
• Signal Processing
• Prof. Jaakko Astola
• University of Joensuu
• Computer Science
• Prof. Pasi Fränti
• VTT
• Products and Production
• Ari Virtanen

11
Panel Discussion Future of Speech Technology

• Moderator Jouni Isoaho (TY)
• Panel members Olli Aaltonen (TY), Markku Turunen
  (TaY), Pasi Fränti (JoY), Johanna Lehtonen
  (Lingsoft), Aapo Puskala (Kone), Matti Sihto
  (TEKES)
• Questions
• The future of speech technology in Finland and
  abroad?
• What are the most important application and RD
  areas in future? Why?
• Which concrete actions should be done?
• - Research, education and other actions
• Impact on business and labor policy?
• - volumes, time-schedules and competence
  profiles