An overview of multimodal corpora, annotation tools and schemes

The aim of the present study is to provide a general overview of multimodal corpora along with their annotation tools and schemes. In the first section an introduction is given to justify the necessity of multimodal approach not only in linguistics and communication studies but also in dialog modeling. Following the justification and the definition of multimodal corpora, three relatively well-known corpora are presented and compared. The considerable differences in their platforms and schemes highlight the necessity of standardization in order to enhance the usability and interoperability of their resulting datasets. Finally, the limitations of multimodal corpus studies are briefly listed.