Neural network for finding mathematical formulas in videos from data science conferences

Radosław Załuska


This paper presents a novel approach to the problem of finding mathematical formulas on video frames. Distinguishing equations from other text and objects on given image involves a deeper understanding of individual symbols, patterns, and their relative positions. Standard segmentation methods used for this kind of task will fail immediately because they mostly rely on noticeable differences between color and shape of different objects. By using a fully convolutional neural network and image to image transformation, we were able to achieve state of the art results in finding mathematical formulas in movie frames extracted from data science conferences videos. Current status of the work, results and further development plans are presented
Author Radosław Załuska (FEIT / ICS)
Radosław Załuska,,
- The Institute of Computer Science
Publication size in sheets0.3
Book Proceedings of the Baltic URSI Symposium supported by National Committees of the Baltic Countries, vol. CFP18N89-ART, 2018, IEEE, ISBN 978-83-949421-3-7, 300 p.
Keywords in Englishimage segmentation, fully convolutional neural network, deep learning, image processing
projectDevelopment of new algorithms in the areas of software and computer architecture, artificial intelligence and information systems and computer graphics . Project leader: Arabas Jarosław, , Phone: +48 22 234 7432, start date 01-08-2018, planned end date 31-12-2018, II/2018/DS/1, Implemented
WEiTI Działalność statutowa
Languageen angielski
08406742.pdf 322.86 KB
Score (nominal)15
ScoreMinisterial score = 15.0, BookChapterMatConf
Ministerial score (2013-2016) = 15.0, BookChapterMatConf
Citation count*
Share Share

Get link to the record

* presented citation count is obtained through Internet information analysis and it is close to the number calculated by the Publish or Perish system.