Automatic interactive video authoring method via object recognition

Ui Nyoung Yoon; Myung Duk Hong; Geun Sik Jo

doi:10.1007/978-3-319-54472-4_55

Automatic interactive video authoring method via object recognition

Ui Nyoung Yoon, Myung Duk Hong, Geun Sik Jo

Inha University

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

1 Scopus citations

Abstract

Interactive video is a type of video which provides interactions for obtaining video related information or participating in video content. However, authors of interactive video need to spend much time to create the interactive video content. Many researchers have presented methods and features to solve the time-consuming problem. However, the methods are still too complicated to use and need to be automated. In this paper, we suggest an automatic interactive video authoring method via object recognition. Our proposed method uses deep learning based object recognition and an NLP-based keyword extraction method to annotate objects. To evaluate the method, we manually annotated the objects in the selected video clips, and we compared proposed method and manual method. The method achieved an accuracy rate of 43.16% for the whole process. This method allows authors to create interactive videos easily.

Original language	English
Title of host publication	Intelligent Information and Database Systems - 9th Asian Conference, ACIIDS 2017, Proceedings
Editors	Satoshi Tojo, Le Minh Nguyen, Ngoc Thanh Nguyen, Bogdan Trawinski
Publisher	Springer Verlag
Pages	589-598
Number of pages	10
ISBN (Print)	9783319544717
DOIs	https://doi.org/10.1007/978-3-319-54472-4_55
State	Published - 2017
Event	9th Asian Conference on Intelligent Information and Database Systems, ACIIDS 2017 - Kanazawa, Japan Duration: 3 Apr 2017 → 5 Apr 2017

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	10191 LNAI
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	9th Asian Conference on Intelligent Information and Database Systems, ACIIDS 2017
Country/Territory	Japan
City	Kanazawa
Period	3/04/17 → 5/04/17

Bibliographical note

Publisher Copyright:
© Springer International Publishing AG 2017.

Keywords

Interactive video
Keyword extraction
Object recognition

Access to Document

10.1007/978-3-319-54472-4_55

Cite this

Yoon, U. N., Hong, M. D., & Jo, G. S. (2017). Automatic interactive video authoring method via object recognition. In S. Tojo, L. M. Nguyen, N. T. Nguyen, & B. Trawinski (Eds.), Intelligent Information and Database Systems - 9th Asian Conference, ACIIDS 2017, Proceedings (pp. 589-598). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10191 LNAI). Springer Verlag. https://doi.org/10.1007/978-3-319-54472-4_55

Yoon, Ui Nyoung ; Hong, Myung Duk ; Jo, Geun Sik. / Automatic interactive video authoring method via object recognition. Intelligent Information and Database Systems - 9th Asian Conference, ACIIDS 2017, Proceedings. editor / Satoshi Tojo ; Le Minh Nguyen ; Ngoc Thanh Nguyen ; Bogdan Trawinski. Springer Verlag, 2017. pp. 589-598 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{8deea6433a0245479d2236120a8d321e,

title = "Automatic interactive video authoring method via object recognition",

abstract = "Interactive video is a type of video which provides interactions for obtaining video related information or participating in video content. However, authors of interactive video need to spend much time to create the interactive video content. Many researchers have presented methods and features to solve the time-consuming problem. However, the methods are still too complicated to use and need to be automated. In this paper, we suggest an automatic interactive video authoring method via object recognition. Our proposed method uses deep learning based object recognition and an NLP-based keyword extraction method to annotate objects. To evaluate the method, we manually annotated the objects in the selected video clips, and we compared proposed method and manual method. The method achieved an accuracy rate of 43.16% for the whole process. This method allows authors to create interactive videos easily.",

keywords = "Interactive video, Keyword extraction, Object recognition",

author = "Yoon, {Ui Nyoung} and Hong, {Myung Duk} and Jo, {Geun Sik}",

note = "Publisher Copyright: {\textcopyright} Springer International Publishing AG 2017.; 9th Asian Conference on Intelligent Information and Database Systems, ACIIDS 2017 ; Conference date: 03-04-2017 Through 05-04-2017",

year = "2017",

doi = "10.1007/978-3-319-54472-4_55",

language = "English",

isbn = "9783319544717",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Verlag",

pages = "589--598",

editor = "Satoshi Tojo and Nguyen, {Le Minh} and Nguyen, {Ngoc Thanh} and Bogdan Trawinski",

booktitle = "Intelligent Information and Database Systems - 9th Asian Conference, ACIIDS 2017, Proceedings",

address = "Germany",

}

Yoon, UN, Hong, MD & Jo, GS 2017, Automatic interactive video authoring method via object recognition. in S Tojo, LM Nguyen, NT Nguyen & B Trawinski (eds), Intelligent Information and Database Systems - 9th Asian Conference, ACIIDS 2017, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 10191 LNAI, Springer Verlag, pp. 589-598, 9th Asian Conference on Intelligent Information and Database Systems, ACIIDS 2017, Kanazawa, Japan, 3/04/17. https://doi.org/10.1007/978-3-319-54472-4_55

Automatic interactive video authoring method via object recognition. / Yoon, Ui Nyoung; Hong, Myung Duk; Jo, Geun Sik.
Intelligent Information and Database Systems - 9th Asian Conference, ACIIDS 2017, Proceedings. ed. / Satoshi Tojo; Le Minh Nguyen; Ngoc Thanh Nguyen; Bogdan Trawinski. Springer Verlag, 2017. p. 589-598 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10191 LNAI).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Automatic interactive video authoring method via object recognition

AU - Yoon, Ui Nyoung

AU - Hong, Myung Duk

AU - Jo, Geun Sik

N1 - Publisher Copyright: © Springer International Publishing AG 2017.

PY - 2017

Y1 - 2017

N2 - Interactive video is a type of video which provides interactions for obtaining video related information or participating in video content. However, authors of interactive video need to spend much time to create the interactive video content. Many researchers have presented methods and features to solve the time-consuming problem. However, the methods are still too complicated to use and need to be automated. In this paper, we suggest an automatic interactive video authoring method via object recognition. Our proposed method uses deep learning based object recognition and an NLP-based keyword extraction method to annotate objects. To evaluate the method, we manually annotated the objects in the selected video clips, and we compared proposed method and manual method. The method achieved an accuracy rate of 43.16% for the whole process. This method allows authors to create interactive videos easily.

AB - Interactive video is a type of video which provides interactions for obtaining video related information or participating in video content. However, authors of interactive video need to spend much time to create the interactive video content. Many researchers have presented methods and features to solve the time-consuming problem. However, the methods are still too complicated to use and need to be automated. In this paper, we suggest an automatic interactive video authoring method via object recognition. Our proposed method uses deep learning based object recognition and an NLP-based keyword extraction method to annotate objects. To evaluate the method, we manually annotated the objects in the selected video clips, and we compared proposed method and manual method. The method achieved an accuracy rate of 43.16% for the whole process. This method allows authors to create interactive videos easily.

KW - Interactive video

KW - Keyword extraction

KW - Object recognition

UR - http://www.scopus.com/inward/record.url?scp=85018554622&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-54472-4_55

DO - 10.1007/978-3-319-54472-4_55

M3 - Conference contribution

AN - SCOPUS:85018554622

SN - 9783319544717

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 589

EP - 598

BT - Intelligent Information and Database Systems - 9th Asian Conference, ACIIDS 2017, Proceedings

A2 - Tojo, Satoshi

A2 - Nguyen, Le Minh

A2 - Nguyen, Ngoc Thanh

A2 - Trawinski, Bogdan

PB - Springer Verlag

T2 - 9th Asian Conference on Intelligent Information and Database Systems, ACIIDS 2017

Y2 - 3 April 2017 through 5 April 2017

ER -

Yoon UN, Hong MD, Jo GS. Automatic interactive video authoring method via object recognition. In Tojo S, Nguyen LM, Nguyen NT, Trawinski B, editors, Intelligent Information and Database Systems - 9th Asian Conference, ACIIDS 2017, Proceedings. Springer Verlag. 2017. p. 589-598. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-319-54472-4_55

Automatic interactive video authoring method via object recognition

Abstract

Publication series

Conference

Bibliographical note

Keywords

Access to Document

Other files and links

Fingerprint

Cite this