This paper introduces a novel approach for large-scale unsupervised segmentation of bibliographic elements. Our problem is to segment a word token sequence representing a citation into subsequences each corresponding to a different bibliographic element, e.g. authors, paper title, journal name, publication year, etc. Obviously, each bibliographic element should be represented by contiguous word tokens. We call this constraint contiguity constraint. Therefore, we should infer a sequence of assignments of word tokens to bibliographic elements so that this constraint is satisfied. Many HMM-based methods solve this problem by prescribing fixed transition patterns among bibliographic elements. In this paper, we use generalized Mallows models (GMM) in a Bayesian multi-topic model, effectively applied to document structure learning by Chen et al. [4], and infer a permutation of latent topics each of which can be interpreted as one among the bibliographic elements. According to the inferred permutation, we arrange the order of the draws from a multinomial distribution defined over topics. In this manner, we can obtain an ordered sequence of topic assignments satisfying contiguity constraint. We do not need to prescribe any transition patterns among bibliographic elements. We only need to specify the number of bibliographic elements. However, the method proposed by Chen et al. works for our problem only after introducing modification. The main contribution of this paper is to propose strategies to make their method work also for our problem.
[1]
M. Fligner,et al.
Distance Based Ranking Models
,
1986
.
[2]
Erik Hetzner.
A simple method for citation metadata extraction using hidden markov models
,
2008,
JCDL '08.
[3]
Regina Barzilay,et al.
Bayesian Unsupervised Topic Segmentation
,
2008,
EMNLP.
[4]
Mark Steyvers,et al.
Finding scientific topics
,
2004,
Proceedings of the National Academy of Sciences of the United States of America.
[5]
Michael I. Jordan,et al.
Latent Dirichlet Allocation
,
2001,
J. Mach. Learn. Res..
[6]
David R. Karger,et al.
Global Models of Document Structure using Latent Permutations
,
2009,
NAACL.
[7]
Xiaojin Zhu,et al.
Incorporating domain knowledge into topic modeling via Dirichlet Forest priors
,
2009,
ICML '09.
[8]
Ping Yin,et al.
Metadata Extraction from Bibliographies Using Bigram HMM
,
2004,
ICADL.
[9]
T. Minka.
Estimating a Dirichlet distribution
,
2012
.
[10]
Atsuhiro Takasu,et al.
Bibliographic attribute extraction from erroneous references based on a statistical model
,
2003,
2003 Joint Conference on Digital Libraries, 2003. Proceedings..