Annotated Video Corpus of FinSL with Kinect and Computer-Vision Data

This paper presents an annotated video corpus of Finnish Sign Language (FinSL) to which has been appended Kinect and computer-vision data. The video material consists of signed retellings of the stories Snowman and Frog, where are you?, elicited from 12 native FinSL signers in a dialogue setting. The recordings were carried out with 6 cameras directed toward the signers from different angles, and 6 signers were also recorded with one Kinect motion and depth sensing input device. All the material has been annotated in ELAN for signs, translations, grammar and prosody. To further facilitate research into FinSL prosody, computer-vision data describing the head movements and the aperture changes of the eyes and mouth of all the signers has been added to the corpus. The total duration of the material is 45 minutes and that part of it that is permitted by research consents is available for research purposes via the LAT online service of the Language Bank of Finland. The paper briefly demonstrates the linguistic use of the corpus.

[1]  Tommi Jantunen,et al.  Head movements in Finnish Sign Language on the basis of Motion Capture data: A study of the form and function of nods, nodding, head thrusts, and head pulls , 2015 .

[2]  Robert Dixon,et al.  Complement clauses and complementation strategies in typological perspective , 2006 .

[3]  Viveka Velupillai,et al.  An Introduction to Linguistic Typology , 2012 .

[4]  Johanna Mesch.  Svensk teckenspråkskorpus - dess tillkomst och uppbyggnad , 2015 .

[5]  Tommi.  Jantunen Fixed and Free : Order of the Verbal Predicate and Its Core Arguments in Declarative Transitive Clauses in Finnish Sign Language , 2009 .

[6]  Tommi Jantunen.  Ellipsis in Finnish Sign Language , 2013, Nordic Journal of Linguistics.

[7]  Tommi Jantunen,et al.  On the rhythm of head movements in Finnish and Swedish Sign Language sentences , 2016 .

[8]  J. Nichols.  Head-marking and dependent-marking grammar , 1986 .

[9]  Trevor Johnston,et al.  Auslan Corpus Annotation Guidelines , 2013 .

[10]  Jorma Laaksonen,et al.  Estimating head pose and state of facial elements for sign language video , 2014 .

[11]  Trevor Johnston,et al.  Elaborating Who's What: A Study of Constructed Action and Clause Structure in Auslan (Australian Sign Language) , 2014 .

[12]  Tommi Jantunen,et al.  Clausal coordination in Finnish Sign Language , 2016 .

[13]  Onno Crasborn,et al.  Enhanced ELAN functionality for sign language corpora , 2008, LREC 2008.

[14]  Trevor Johnston,et al.  From archive to corpus: transcription and annotation in the creation of signed language corpora , 2008, PACLIC.

[15]  Tommi Jantunen,et al.  How long is the sign? , 2014 .

[16]  Jorma Laaksonen,et al.  SLMotion - An extensible sign language oriented video analysis tool , 2014, LREC.

[17]  Lauren Gawne,et al.  Showing the story : Enactment as performance in Auslan narratives , 2014 .