Color-Based Video Shot Boundary Detection
Costas Cotsaces, Zuzana Cernekova, Nikos Nikolaidis, and Ioannis Pitas

23.1 Introduction ..............................................................................................................
23.2 Typology of Shot Boundary Detection Algorithms ...................................................................
       23.2.1 Features Used for Shot Boundary Detection .................................................................
       23.2.2 Feature Similarity Metrics ....................................................................................
23.3 Survey of Shot Boundary Detection Algorithms .....................................................................
       23.3.1 Classifier Trained by Dissolve Synthesizer .................................................................
       23.3.2 Temporal Splitting and Merging..............................................................................
       23.3.3 Dual Classifier ..................................................................................................
       23.3.4 Coupled Markov Chains .......................................................................................
       23.3.5 Gaussian Random Distribution Modeling ....................................................................
       23.3.6 Color Anglogram and Latent Semantic Indexing ...........................................................
       23.3.7 Gradual Shot Change Boundary Refinement ................................................................
       23.3.8 Joint Probability Image and Related Statistics .............................................................
       23.3.9 Projection into Principal Component Eigenspace ..........................................................
       23.3.10 Probabilistic Modeling of Discontinuities ..................................................................
23.4 TREC Shot Boundary Detection Task .................................................................................
       23.4.1 Description of the Evaluation Procedure ....................................................................
       23.4.2 Algorithms Participating in TRECVID ........................................................................
                 23.4.2.1 Graph Partitioning and Support Vector Machines ................................................
                 23.4.2.2 Finite State Machine ................................................................................
                 23.4.2.3 Moving Query Windows .............................................................................
                 23.4.2.4 Similarity Matrices and k-Nearest Neighbor Classifiers..........................................
                 23.4.2.5 Motion-Compensated Frame Difference and Temporal Derivatives ...........................
23.5 Performance Review ...................................................................................................
23.6 Information Theory-Based Shot Cut/Fade Detection ...............................................................
       23.6.1 Background and Definitions ...................................................................................
       23.6.2 Shot Detection Using Entropy Measures......................................................................
                 23.6.2.1 Abrupt Shot Cut Detection ..........................................................................
                 23.6.2.2 Fade Detection .......................................................................................
       23.6.3 Experimental Results and Discussion ........................................................................
23.7 Shot Transition Detection Using Singular Value Decomposition ...................................................
23.8 Feature-Level Fusion ...................................................................................................
23.9 Conclusions ..............................................................................................................
Acknowledgements ...........................................................................................................
References ....................................................................................................................