Implementing AI-powered Semantic Character Recognition in Motor Racing Sports
(Paper available in the Proceedings of the 2020 BEIT Conference)
Oftentimes, TV producers overlay visual and textual media to provide context about racers appearing on screen, such as name, position and face shot. Typically, this is accomplished by a human producer visually identifying the racers on screen, manually toggling the contextual media associated to each one and coordinating with cameramen and other TV producers to keep the racer on shot while the contextual media is on screen. This labor-intensive process is mostly suited to static overlays and makes it difficult to overlay contextual information about many racers at the same time.
This paper presents a system that largely automates these tasks and enables dynamic overlays that uses deep learning to automatically track the racers as they move on screen. This system is not merely theoretical, an implementation has already been deployed to live TV production for Formula E broadcasts. We will present the challenges found and solved in the implementation of this system, and we will discuss the implications and planned future applications of this new technological development.
This session will be rebroadcast on the BEIT Express channel on May 14, 2020 at 11:45 p.m. and May 15, 2020 at 7:45 a.m. EDT (UTC -4).