Abstract
In the past decade research into automated patent classification has mainly focused on the higher levels of International Patent Classification (IPC) hierarchy. The patent community has expressed a need for more precise classification to better aid current pre-classification and retrieval efforts (Benzineb and Guyot, Current challenges in patent information retrieval. Springer, New York, pp 239–261, 2011). In this chapter we investigate the three main difficulties associated with automated classification on the lowest level in the IPC, i.e. subgroup level. In an effort to improve classification accuracy on this level, we (1) compare flat classification with a two-step hierarchical system which models the IPC hierarchy and (2) examine the impact of combining unigrams with PoS-filtered skipgrams on both the subclass and subgroup levels. We present experiments on English patent abstracts from the well-known WIPO-alpha benchmark data set, as well as from the more realistic CLEF-IP 2010 data set. We find that the flat and hierarchical classification approaches achieve similar performance on a small data set but that the latter is much more feasible under real-life conditions. Additionally, we find that combining unigram and skipgram features leads to similar and highly significant improvements in classification performance (over unigram-only features) on both the subclass and subgroup levels, but only if sufficient training data is available.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Benzineb K, Guyot J (2011) Automated patent classification. In: Current challenges in patent information retrieval. Springer, New York, pp 239–261
Cai L, Hofmann T (2004) Hierarchical document categorization with support vector machines. In: Proceedings of the thirteenth ACM international conference on information and knowledge management, CIKM ’04. ACM, New York, pp 78–87
Cesa-Bianchi N, Gentile C, Zaniboni L (2006) Incremental algorithms for hierarchical classification. J Mach Learn Res 7:31–54
Chen YL, Chang YC (2012) A three-phase method for patent classification. Inf Process Manag 48(6):1017–1030
Daelemans W, Zavrel J, van der Sloot K, van den Bosch A (2010) TiMBL: Tilburg memory-based learner - version 6.3 - Reference Guide
D’hondt E, Verberne S, Weber N, Koster K, Boves L (2012) Using skipgrams and pos-based feature selection for patent classification. Comput Linguist Neth J 2:52–70
D’hondt E, Verberne S, Koster K, Boves L (2013) Text representations for patent classification. Comput Linguist 39(3):755–775
D’hondt E, Verberne S, Oostdijk N, Beney J, Koster C, Boves L (2014) Dealing with temporal variation in patent categorization. Inf Retr. doi:10.1007s10791-014-9239-6
Dumais S, Chen H (2000) Hierarchical classification of web content. In: Proceedings of the 23rd annual international ACM SIGIR conference on research and development in information retrieval, SIGIR ’00. ACM, New York, pp 256–263
Eisinger D, Tsatsaronis G, Bundschus M, Wieneke U, Schroeder M (2013) Automated patent categorization and guided patent search using IPC as inspired by MeSH and PubMed. J Biomed Semant 4(1):1–23
Fall CJ, Benzineb K (2002) Literature survey: issues to be considered in the automatic classification of patents, pp 1–64
Fall CF, Benzineb K, Guyot J, Törcsvári A, Fiévet P (2003) Computer-assisted categorization of patent documents in the international patent classification. In: Proceedings of the international chemical information conference
Falquet G, Guyot J, Benzineb K (2010) myClass: a mature tool for patent classification. In: Multilingual and multimodal information access evaluation - proceedings international conference of the cross-language evaluation forum, CLEF 2010. Springer, Berlin
Guyot J, Benzineb K (2013) IPCCAT-report on a classification test. Tech. Rep., Simple Shift. srv1.olanto.org/download/myCLASS/publication/IPCCAT_Classification_at_Group_Level_20130712.pdf
King G, Zeng L (2001) Logistic regression in rare events data. Polit Anal 9(2):137–163
Koster CH, Beney J, Verberne S, Vogel M (2010) Phrase-based document categorization. Springer, New York, pp 263–286
Krier M, Zaccà F (2002) Automatic categorization applications at the European patent office. World Patent Inf 24(3):187–196
Li Y, Bontcheva K, Cunningham H (2007) Svm based learning system for f-term patent classification. In: Proceedings of the 6th NTCIR workshop meeting on evaluation of information access technologies: information retrieval, question answering and cross-lingual information access (NTCIR’07), pp 396–402
Lin HT, Lin CJ, Weng RC (2007) A note on Platt’s probabilistic outputs for support vector machines. Mach Learn 68(3):267–276
Oostdijk N, Verberne S, Koster C (2010) Constructing a broadcoverage lexicon for text mining in the patent domain. In: Proceedings of the international conference on language resources and evaluation, LREC 2010, 17–23 May 2010, Valletta, Malta
Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Blondel M, Prettenhofer P, Weiss R, Dubourg V, Vanderplas J, Passos A, Cournapeau D, Brucher M, Perrot M, Duchesnay E (2011) Scikit-learn: machine learning in Python. J Mach Learn Res 12:2825–2830
Piroi F, Lupu M, Hanbury A, Sexton AP, Magdy W, Filippov IV (2010) CLEF-IP 2010: retrieval experiments in the intellectual property domain. In: Proceedings of CLEF 2010 (notebook papers/labs/workshops)
Piroi F, Lupu M, Hanbury A, Zenz V (2011) CLEF-IP 2011: retrieval in the intellectual property domain. In: Petras V, Forner P, Clough PD (ed) Proceedings of CLEF 2011 (notebook papers/labs/workshop)
Platt J (1999) Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. In: Advances in large margin classifiers. MIT Press, Cambridge, MA, pp 61–74
Salton G, Buckley C (1988) Term-weighting approaches in automatic text retrieval. Inf Process Manag 24:513–523
Silla C, Freitas A (2011) A survey of hierarchical classification across different application domains. Data Min Knowl Disc 22(1–2):31–72
Smith H (2002) Automation of patent classification. World Patent Inf 24(4):269–271
Tikk D, Biró G, Törcsvári A (2007) A hierarchical online classifier for patent categorization. IGI Global, Information Science Reference, Hershey, pp 244–267
van Halteren H (2000) The detection of inconsistency in manually tagged text. In: Proceedings of LINC-00
Wang X, Zhao H, Lu BL (2011) Enhance top-down method with meta-classification for very large-scale hierarchical classification. In: Proceedings of the international joint conference on natural language processing, pp 1089–1097
Widodo A (2011) Clustering patent documents in the field of ICT (information and communication technology). In: Proceedings of 2011 international conference on semantic technology and information retrieval (STAIR), pp 203–208
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer-Verlag GmbH Germany
About this chapter
Cite this chapter
D’hondt, E., Verberne, S., Oostdijk, N., Boves, L. (2017). Patent Classification on Subgroup Level Using Balanced Winnow. In: Lupu, M., Mayer, K., Kando, N., Trippe, A. (eds) Current Challenges in Patent Information Retrieval. The Information Retrieval Series, vol 37. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-53817-3_11
Download citation
DOI: https://doi.org/10.1007/978-3-662-53817-3_11
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-662-53816-6
Online ISBN: 978-3-662-53817-3
eBook Packages: Computer ScienceComputer Science (R0)