SHEN Li-li, WU Zi-yang. Study of asynchronous stereoscopic video based on event related potentials[J]. Chinese Journal of Engineering, 2018, 40(4): 508-515. DOI: 10.13374/j.issn2095-9389.2018.04.015
Citation: SHEN Li-li, WU Zi-yang. Study of asynchronous stereoscopic video based on event related potentials[J]. Chinese Journal of Engineering, 2018, 40(4): 508-515. DOI: 10.13374/j.issn2095-9389.2018.04.015

Study of asynchronous stereoscopic video based on event related potentials

More Information
  • Received Date: July 19, 2017
  • When stereoscopic videos are transmitted on the no-quality-assurance internet, frame delay occurs in the left and right views, which affect the stereoscopic sensation as well as the viewing quality. In this paper, the stimulus of motion-in-depth and motionin-lateral asynchronous stereoscopic videos were analyzed and they were compared via qualitative and quantitative assessments. In this quantitative experiments, the well-known electroencephalogram (EEG) was utilized. A total of ten subjects was recruited to participate in an experiment, in which they watched randomly presented asynchronous stereoscopic video clips. For the qualitative assessment, after viewing one clip, the subjects were asked whether they perceived any asynchronicity in the frames. The degrees of asynchronicity included no delay, one frame delay, two frame delay, and three frame delay. The electroencephalogram (EEG) signal of each subject was recorded as they viewed the clip. Next, the event-related potentials (ERPs) were extracted from the EEG signals and the behavioral data and the ERPs were analyzed to compare the different reactions to the depths and lateral extents of the asynchronous stereoscopic motion. The results reveal that the maximum allowable asynchronicity perceived for motion-in-depth stereoscopic video clips is one frame, whereas there must be no delay in the motion-in-lateral stereoscopic video clips. In addition, compared with being stimulated by the motion-in-lateral asynchronous stereoscopic video clips, a magnitude of P300 has a wider range when the subjects are stimulated by motion-in-depth asynchronous stereoscopic video clips. This indicates that the brain becomes more active in this circumstance. At the same time, the latency of P300 is longer than when stimulated by the motion-in-lateral asynchronous stereoscopic video clips, which means that when the subjects are stimulated by the same degree of asynchronicity of motion-in-depth and -in-lateral stereoscopic video clips, more time is required to process the stimulation of motion-in-depth stereoscopic video clips.
  • [1]
    Oh H, Kim J, Kim J, et al. Enhancement of visual comfort and sense of presence on stereoscopic 3D images. IEEE Trans Image Process, 2017, 26(8):3789
    [2]
    Parker A J. Binocular depth perception and the cerebral cortex. Nat Rev Neurosci, 2007, 8(5):379
    [3]
    Lin S L, Sawa Y, Fukushima N, et al. Influences of frame delay and packet loss between left and right frames in stereoscopic video communications//28th Picture Coding Symposium. Nagoya, 2010:510
    [4]
    Gao J K, Zhou J, Gu X. 3D frame synchronization detection based on classified epipolar geometry parameters//2014 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting. Beijing, 2014:1
    [5]
    Goldmann L, Lee J S, Ebrahimi T. Temporal synchronization in stereoscopic video:influence on quality of experience and automatic asynchrony detection//17th IEEE International Conference on Image Processing. Hong Kong, 2010:3241
    [6]
    Tam W J, Speranza F, Yano S, et al. Stereoscopic 3D-TV:visual comfort. IEEE Trans Broadcast, 2011, 57(2):335
    [7]
    Kim D, Choi S, Sohn K. Depth adjustment for stereoscopic images and subjective preference evaluation. J Electron Imaging, 2011, 20(3):033011
    [8]
    Hoffman D M, Girshick A R, Akeley K, et al. Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. J Vision, 2008, 8(3):33
    [9]
    Kuze J, Ukai K. Subjective evaluation of visual fatigue caused by motion images. Displays, 2008, 29(2):159
    [10]
    Scholler S, Bosse S, Treder M S, et al. Toward a direct measure of video quality perception using EEG. IEEE Trans Image Process, 2012, 21(5):2619
    [11]
    Li H C O, Seo J, Kham K, et al. Measurement of 3D visual fatigue using event-related potential (ERP):3D oddball paradigm//3D-TV Conference:the True Vision-Capture, Transmission and Display of 3D Video. Istanbul, 2008:213
    [12]
    Kaseda Y, Jiang C H, Kurokawa K, et al. Objective evaluation of fatigue by event-related potentials. J Neurolog Sci, 1998, 158(1):96
    [13]
    Luck S J. An Introduction to the Event-Related Potential Technique. The MIT Press, 2014
    [14]
    Jackson A F, Bolger D J. The neurophysiological bases of EEG and EEG measurement:a review for the rest of us. Psychophysiology, 2014, 51(11):1061
    [16]
    Mun S, Park M C, Park S, et al. SSVEP and ERP measurement of cognitive fatigue caused by stereoscopic 3D. Neurosci Lett, 2012, 525(2):89
    [17]
    Chey J, Grossberg S, Mingolla E. Neural dynamics of motion processing and speed discrimination. Vision Res, 1998, 38(18):2769
    [18]
    Chao L L, Knight R T. Prefrontal and posterior cortical activation during auditory working memory. Cogn Brain Res, 1995, 4(1):27
    [19]
    Chao L L, Knight R T. Contribution of human prefrontal cortex to delay performance. J Cogn Neurosci, 1998, 10(2):167
    [20]
    Breton F, Ritter W, Simson R, et al. The N2 component elicited by stimulus matches and multiple targets. Biol Psychol, 1988, 27(1):23
    [21]
    Folstein J R, Van Petten C. Influence of cognitive control and mismatch on the N2 component of the ERP:a review. Psychophysiology, 2008, 45(1):152
    [22]
    Hagen G F, Gatherwright J R, Lopez B A, et al. P3a from visual stimuli:task difficulty effects. Psychophysiology, 2006, 59(1):8
    [23]
    Kim K H, Kim J H, Yoon J, et al. Influence of task difficulty on the features of event-related potential during visual oddball task. Neurosci Lett, 2008, 445(2):179

Catalog

    Article Metrics

    Article views (802) PDF downloads (17) Cited by()
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return