Computer Science - Virtual Keyboard - Presentation - Baharak Zali, Study notes of Network Technologies and TCP/IP

Download Computer Science - Virtual Keyboard - Presentation - Baharak Zali and more Study notes Network Technologies and TCP/IP in PDF only on Docsity!

Virtual KeyboardVirtual Keyboard

• The system can be roughly divided toThe system can be roughly divided to
  • (^) Graphics and Animation UnitGraphics and Animation Unit
  • (^) Collision Detection UnitCollision Detection Unit
  • (^) Musical unit (Virtual Keyboard)Musical unit (Virtual Keyboard)
• They are highly inter-connectedThey are highly inter-connected
• Graphics and animation taken from Omni-Graphics and animation taken from Omni- Grasp projectGrasp project
• The system uses P5 Glove as the inputThe system uses P5 Glove as the input devicedevice - (^) 3-D position of the hand3-D position of the hand - (^) Finger/joint informationFinger/joint information

Introduction Introduction

• Detect the touchDetect the touch

• Avoid penetrationAvoid penetration

• Pass the new information to thePass the new information to the

graphical unitgraphical unit

• Find the location of the collisionFind the location of the collision

• Find the right key based on the locationFind the right key based on the location

• Pass the information to the musical unitPass the information to the musical unit

Collision Detection Collision Detection

• Uses Improve LibraryUses Improve Library

• A library to help MIDI programming in C++A library to help MIDI programming in C++
• ClassesClasses
  • MidiOutputMidiOutput
  • MidiFileMidiFile
  • ......

• Plays the notesPlays the notes

• Records the played notes into a MIDI fileRecords the played notes into a MIDI file

• Replays the played notesReplays the played notes

Virtual Keyboard Virtual Keyboard

• Matching the keys with the textureMatching the keys with the texture

• Avoiding repetitive onsets caused byAvoiding repetitive onsets caused by

• Noisy input dataNoisy input data
• Glove refreshmentsGlove refreshments
• Screen RefreshmentsScreen Refreshments

Challenges Challenges

• Include the black keysInclude the black keys

• Add chord (triggered by a gesture)Add chord (triggered by a gesture)

• Change the instrument (the wayChange the instrument (the way

implemented in electronicimplemented in electronic keyboards)keyboards)

Possible Possible

Future ImprovementsFuture Improvements