ISBN: 3-540-66711-3
TITLE: Interactive Multimedia Documents
AUTHOR: Vazirgiannis, Michalis
TOC:

Preface V
Book Overview VII
Acknowledgements IX
Table of Contents XI
1. Background 1
1.1 Introduction 1
1.2 Basic Concepts 2
1.3 Temporal Aspects of IMDs 5
1.4 Spatial Aspects of an IMD 6
1.5 Multimedia Document Models 7
1.6 Multimedia Document Standards 9
1.6.1 Multimedia and Hypermedia Information Coding Experts Group (M H E G ) 10
1.6.2 H Y T I M E 22
1.6.3 Comparison of MHEG and Hytime 34
1.6.4 SMIL 35
2. Modeling Interactive Multimedia Documents 43
2.1 Interaction 44
2.1.1 Events Classification 45
2.1.2 Object-Oriented Modeling of Events 47
2.1.3 Algebraic Composition of Events 51
2.1.4 Spatiotemporal Composition of Events 52
2.2 Spatiotemporal Composition of Media Objects 53
2.2.1 Basic Concepts 53
2.2.2 Spatiotemporal Composition Model 57
2.3 Interactive Scenario Modeling 60
3. Authoring Interactive Multimedia Presentations 63
3.1 Actor Specifications and Transformations 64
3.2 Event Specification 66
3.3 Scenario Tuples Specifications 68
4. Spatiotemporal Specification & Verification for Multimedia Scenarios 73
4.1 Authoring Spatiotemporal Compositions for IMD Documents 75
4.1.1 Authoring Environment 75
4.2 Verification of IMD Documents 79
4.2.1 Temporal Layout Tool 80
4.2.2 Spatial Layout 81
4.2.3 Scenario Animation Tool 82
4.2.4 Execution Table 82
4.3 Conclusions 84
5. Transformation of Declarative Specifications to Algorithmic Representation 87
5.1 Events 88
5.1.1 User Events 89
5.1.2 Intra-objects Events 89
5.1.3 Application and System Events 90
5.1.4 Synch Events 90
5.1.5 Non-state Events 91
5.1.6 State Events 91
5.1.7 Complex Events 92
5.2 Scenario Tuples 94
5.2.1 Start Stop Event Detection Handlers 95
5.2.2 Enabling and Disabling Scenario Tuples 96
6. Rendering Interactive Multimedia Scenarios 97
6.1 A Single Threaded Approach 97
6.1.1 Overall Architecture 100
6.1.2 Auxiliary Structures 102
6.1.3 Event Detection and Evaluation 103
6.1.4 Scenario Rendering Algorithms 105
6.1.5 Presentation Engine 107
6.2 A Multithreaded Approach 108
6.2.1 The Server 110
6.2.2 Rendering Scheme Architecture - The Client 111
6.2.3 Event Handling 113
6.2.4 Starting and Interrupting Scenario Tuples 118
6.2.5 Synchronized Presentation of Media-Objects 120
7. Indexing Large Multimedia Applications: A Spatiotemporal Indexing Scheme 123
7.1 Introduction 123
7.2 A Sample Multimedia Composition 124
7.3 Indexing Schemes 127
7.3.1 A Simple Spatial and Temporal Indexing Scheme 128
7.3.2 A Unified Spatiotemporal Indexing Scheme 130
7.3.3 Retrieval of Spatiotemporal Operators Using R-trees 131
7.4 Estimation of the Retrieval Cost 134
7.4.1 Cost Analysis of R-trees 134
7.4.2 Analytical Comparison of the Indexing Schemes 136
APPENDIX A: IMD Scenario Script, a Sample Application 141
APPENDIX B: Scenario Model, the BNF Grammar 146
References 155
Subject Index 159
END
