Synchronous Text Messaging Telepresence For Wireless Handhelds

1
Synchronous Text Messaging Telepresence For
Wireless Handhelds
Adesemowo A. Kayode
Supervise by W. D. Tucker
2
Global View
Handheld Fast-track Feedback IM

• Text Messaging
• SIMPLE
• Telepresence
• Mobile IP Data Network
• Analysis
• Summary

3
Abstract

• HFFIM rubberize plastic text-messaging for
  telepresence.
• Why? To enable text chat for online aware.
  telepresence conversation for 3G packet
  network.
• Technical Overview Fast-track Hotkeys feedback
  IM on SIMPLE platform.
• HOW? Deploy HFFIM SIMPLE network on 802.11b WLAN
  and analyse User satisfaction and Usability with
  Slaters PQ.

4
Introduction
Handheld Fast-track Feedback IM

• Text messaging evolution from asynchronous near
  extinct paging to SMS and synchronous instant
  messaging has followed the trend of being
  interactive and telepresence centric. As mobile
  devices become more data-centric, text-messaging
  telepresence requires further extension for
  better interactive discussion. The SIP extension
  for Instant Messaging and Presence Leverage
  further extends IM telepresence as well as
  specialized embedded event trigger applications.
• The paper presents a work in progress that seeks
  to overcome fundamental text chat interracial
  problems with a SIMPLE-based fast-track feedback
  approach to IM applications. The SIP client IM
  application (User Agent) running on the Handheld
  connect via mobile link to the IP based SIMPLE
  network where SIP co-ordinates clients messaging
  sessions. Slaters (UCL, UK) presence
  questionnaire for VR environment will be adapted
  for comparative analysis of user satisfaction and
  usability of the handheld fast-track feedback
  system.

5
SMS Short Messaging Services
Background
Handheld Fast-track Feedback IM
Text Messaging

• Trend of messaging either traditional (mail ?
  carrier pigeon ? telegraph ? telex ? SWIFT),
  electronic (chat, web-board, MUD, paging, SMS,
  IM, MMS) have always been pressed into instant
  interactive service.
• Text messaging took an overture in the early
  nineties from the alphanumeric paging texting to
  a more enriched SMS deployable on a common Global
  System Mobile GSM Network
• SMS had a fast inroad into the upstream vertical
  market where it is being put into specialized
  trigger applications
• Rapid adoption attributed to its fast, private,
  cost effective, low bandwidth communication yet
  lacking interactivity

6
IM Instant Messaging
Background
Handheld Fast-track Feedback IM
Text Messaging

• Instant Messsaging IM extends SMS for
  interactive talk
• Exchange of rich content between a set of
  participants in near real time coupled with
  presence and buddy lists
• Support online collaboration
• Handicapped in turn-taking conversation and
  Feedbacks
• Facial expressions in a face-to-face conversation
  are being provided in a voice chat by expressive
  gesture for approval and presence effect. This
  are lacking in text messaging
• Aim to enable text chat for online aware
  telepresence conversation for 3G packet network.

7
Handheld Text Messaging
Background
Handheld Fast-track Feedback IM
Text Messaging

• Handheld suffers from restricted input output
  entry as well as limited screen space
• IM on handheld requires facilitated text input
  for prompt gesture in an interactive talk
  session
• Build client UA IM on handheld capable of
  supporting turn-taking conversation with feedback

8
Telepresence
Background
Handheld Fast-track Feedback IM
Telepresence

• Voice chat responsive gesture reproduce
  face-to-face chat facial expressions. This
  interrupts are being presented in IM by
  fast-tracking gesture like messages as shown in
  fig 1 that denotes other party responsiveness.
• In another concept as seen in native IM presence,
  other party (buddy) online-offline status are
  presented by subscribing to a presence tracking
  server which shows availability of other clients
  rather than presentivity. This related aspect
  of presence that is an integral part of SIMPLE
  provides functionality for keeping an eye on who
  is on and who is not.

9
Fast-track Layer
Background
Handheld Fast-track Feedback IM
Telepresence

• Fig 1 Fast-track hierarchical layer

2D, 3D Emoticons 2D, 3D Emoticons User Defined HotkeyT9 Predictive Text User Defined HotkeyT9 Predictive Text On keydown typing event On keydown typing event On keydown typing event Online presence Buddy list
Fast-track feedback Fast-track feedback Fast-track feedback Fast-track feedback Fast-track feedback Fast-track feedback Presence tracking Presence tracking Presence tracking
method MESSAGE method MESSAGE method MESSAGE method MESSAGE method MESSAGE method MESSAGE method MESSAGE Package header event presence Package header event presence
INVITE ACK ACK MEDIA, messages MEDIA, messages OK OK SUBCRIBE, NOTIFY SUBCRIBE, NOTIFY
10
Presence
Background
Handheld Fast-track Feedback IM
Telepresence

• Presence as the subjective experience of being in
  one place or environment, even when one is
  physically situated in another.
• As applied to IM, presence refers to experiencing
  the facial expressive gestured environment rather
  than the plastic physical locale.
• Yet, the concept of presence in a virtual
  environment VR raises the question (debate) of
  the meaning of presence with respect to real
  world experiences.
• Rather than looking into the ontological
  questions about the nature of existence, we
  narrow down to a factor
• The possibility of the individual being able to
  navigate through and interact in the VE,
  including interaction with other actors which may
  spontaneously react to the individual

11
Slater PQ
Background
Handheld Fast-track Feedback IM
Telepresence

• Rather than looking into the ontological
  questions about the nature of existence, we
  narrow down to a factor
• The possibility of the individual being able to
  navigate through and interact in the VE,
  including interaction with other actors which may
  spontaneously react to the individual
• This factor explain our adaptation of Slaters
  reality test based Presence Questionnaire PQ.
• The PQ in hinged on three themes the sense of
  being there (in a discussion), extent to which
  the IM VE becomes the dominant reality, and the
  extent to which the IM VE is remembered as a
  place.

12
SIMPLE
Background
Handheld Fast-track Feedback IM
SIMPLE

• SIP IM Presence Leverage Extension provides a
  platform for supporting IM and presence
  applications on a SIP network.
• Messages are not treated as short pager like
  messages but as a data transfer in a session
  established pipe.
• Well look into the details of the SIP method and
  header extension later in this paper.

13
MobileIP
Background
Handheld Fast-track Feedback IM
MobileIP

• An inescapable facet of technological progress is
  the convergence of packet-switched (Internet) and
  circuit-switched telecommunication network.
• This continue to shift from cellular network
  (GSM) to packet switch mobile network 2.5G
  (GPRS) ? 3G (UMTS, CDMA2000) ? 3.5/4G (mobileIP).
• Network connectivity is also following on with
  wireless connectivity seen in 802.11b WLAN, blue
  tooth hotspot centers.

14
SIP OVERVIEW
Technical Architecture
Handheld Fast-track Feedback IM
SIMPLE

• SIP
• Signaling protocol real-time calls
• IETF RFC 2543, Colombia university SIP group
• Architecture UAs, Redirect, Proxy, Location
  and Registrar
• Textual based exposing methods for call
  properties and service information much like HTTP
• SIP message defined payloads transport media
  (text, voice) via SDP
• SIP by itself provides mechanisms that are useful
  for presence applications, and for
  session-oriented communication application but
  not IM

15
Visual Overview
Technical Architecture
Handheld Fast-track Feedback IM
16
Visual Brief
Technical Architecture
Handheld Fast-track Feedback IM

• The limited 2D emoticons expressive gesture in
  instant messaging and SMS are further extended in
  this research work for fast track telepresence
  feedback.
• Fast tracking are provide by tieing handset
  numeric keypad to user-defined gesture as done
  with speed dialing and clickable menus in event
  driven programs.
• On_click, on_keypress events provides event
  driven progress tracker allowing other party(ies)
  to know who is composing a messaging at the
  moment much like the turn-taking effect in a
  voice conversation.
• The SIP client IM application (User Agent)
  running on the Handheld connect via mobile link
  to the IP based SIMPLE network where SIP
  co-ordinates clients messaging sessions.

17
SIMPLE
Technical Architecture
Handheld Fast-track Feedback IM
SIMPLE

• Project built on SIMPLE Network (SIP IM and
  Presence Leverage Extension)
• SIMPLE extends Session Initiation Protocol, SIP
• SDP media type extended with MESSAGE method to
  allow SIP messaging stream to be established
• method MESSAGE 5060 sip sipbtucker_at_uwc5060tr
  ansporttcp
• Enabling SIP to handle continuous session as
  against make and break data chunk transfer
• MESSAGE requests differ from other sorts of SIP
  requests in that they carry media (text in our
  case), in the form of Ims, as payload.
  Conventional SIP payloads carry signaling
  information about media, but not media itself

18
INVITE message flow
Technical Architecture
Handheld Fast-track Feedback IM
SIMPLE

• IM session Contact sipuser2_at_uwcmethodMESSAG
  E

19
Telepresence
Technical Architecture
Handheld Fast-track Feedback IM

• Fast-track hierarchical layer

2D, 3D Emoticons 2D, 3D Emoticons User Defined HotkeyT9 Predictive Text User Defined HotkeyT9 Predictive Text On keydown typing event On keydown typing event On keydown typing event Online presence Buddy list
Fast-track feedback Fast-track feedback Fast-track feedback Fast-track feedback Fast-track feedback Fast-track feedback Presence tracking Presence tracking Presence tracking
method MESSAGE method MESSAGE method MESSAGE method MESSAGE method MESSAGE method MESSAGE method MESSAGE Package header event presence Package header event presence
INVITE ACK ACK MEDIA, messages MEDIA, messages OK OK SUBCRIBE, NOTIFY SUBCRIBE, NOTIFY
20
Fast-tracking
Technical Architecture
Handheld Fast-track Feedback IM

• 2D and 3D Emoticons chat-i-tude
• IM standard define shortcut keys in similitude to
  ANSI key codes
• Shortcut keys input translated into 2D and 3D
  emotion/gesture icons
• As well as slide menu selectable options
• User Defined Hotkeys
• User prefer gestures tied to handheld buttons,
  selectable menus
• T9 predictive text input system enhances
  predefined word entries
• Event Driven Online Awareness
• On click, on keydown event method interrupt
  signals

21
Fast-tracking
Technical Architecture
Handheld Fast-track Feedback IM

• Presence Indicator
• Historically on-line and off-line
• Subscriptions to and notifications of user
  presence (communication state changes)
• Event package within SIP event notification
  framework
• Extended with Event presence event package in
  Register SUBCRIBE request
• Handle by SIP SUBCRIBE and NOTIFY methods in
  logical Presence Agent Client/Server, PA/PS
• Fast-track data stream to/fro on underlining
  message SDP initiated TCP message flow

22
SUBCRIBE message flow
Technical Architecture
Handheld Fast-track Feedback IM

• SUBCRIBE message flow

TELEPRESENCE
23
Fast-track Implementation
Technical Architecture
Handheld Fast-track Feedback IM
TELEPRESENCE

• Each fast-track component get sent across with a
  pre-assigned higher priority index in the message
  flow as shown in the prioritised message
  structure.

24
Prioritised message flow
Technical Architecture
Handheld Fast-track Feedback IM

• IM session Contact sipuser2_at_uwcmethodMESSAG
  E

Header Field where proxy MESSAGE
Content-Type
CSeq c r m
From c r m
Priority R ar o
To c(1) r m
Via R amr m
25
Research Question
Methodology
Handheld Fast-track Feedback IM

• Does fast-track feedback increase text-based
  messaging presence

26
Analysis
Methodology
Handheld Fast-track Feedback IM

• We adapts Mel Slaters PQ for VR environment to
  measure presence for our real fast-track IM
  environment against standard non fast-track IM
  environment.
• We will run trials in an 802.11b WLAN environment
  as a proxy mobileIP network with a focus on
  Users Satisfaction and Usability.

27
Proposed Network
Methodology
Handheld Fast-track Feedback IM

• WLAN Wireless HotSpot
• Cisco Aironet 350 Access Point with Antennae
• Cisco Aironet 350 Series PC Card for handheld.
• Hand held type
• Compaq iPAQ Pocket PC H3870
• Compaq iPAQ PC Card Expansion Pack and WL 110
  Wireless PC Card
• Microsofts messenger SDK running on a Pocket
  2002 OS powered iPAQ

28
Conclusion
Handheld Fast-track Feedback IM

• A function fast-track IM on a WLAN is easily
  scalable to a cellular mobileIP network
• An IP-based application like the SIP based
  fast-track IM provide bridging across various
  smartphones, PDAs, handsets and other
  IP-endpoints including fixed IP phones

29
Conclusion Statement
Handheld Fast-track Feedback IM

• A fast-track feedback system could be generalised
  for other types of media (voice, video and
  virtual reality) build on a SIMPLE network.

30
Handheld Fast-track Feedback IM

• Q A