Abstract
Patent documents are abundant, lengthy and are written in very technical language. Thus, reading and analyzing patent documents can be complex and time consuming. This is where the use of automatic patent segmentation can help. This work attempts to automatically segment the description part of patent texts into semantic sections. Our goal is to develop a robust and scalable segmentation tool for automatic structuring of the patent texts into pre-defined sections that will serve as a pre-processing step to patent text IR(information retrieval) and IE(information extraction) tasks. To do so, an established set of guidelines is exploited for defining the segments in the description part of the patent text. Depending on those guidelines a segmentation tool called PatSeg is developed based on a combination of text mining techniques. A rule-based algorithm is used to identify the headings inside patent text, machine learning technique is used to classify the headings into pre-defined sections, and heuristics are used to identify the sections in patent text that do not contain headings. The performance of our methods achieved up to 94% of accuracy. In addition, we proposed a big data approach based on Hadoop ecosystem modules to apply our methods on the huge amount of patent documents.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
World Intellectual Property Organization (WIPO). http://www.wipo.int
Thomson Reuter. http://thomsonreuters.com/en.html
Hearst, M.: TextTiling: segmenting text into multi-paragraph subtopic passages. Comput. Linguist. 23, 33–64 (1997)
Choi, F.Y.Y.: Advances in domain independent linear text segmentation. In: Proceedings of NAACL 2000, pp. 26–33 (2000)
Rojas, L.H., Pagola, J.E.M.: TextLec: a novel method of segmentation by topic using lower windows and lexical cohesion. In: Rueda, L., Mery, D., Kittler, J. (eds.) CIARP 2007. LNCS, vol. 4756, pp. 724–733. Springer, Heidelberg (2007). doi:10.1007/978-3-540-76725-1_75
Pérez, R.A., Medina Pagola, J.E.: Text segmentation by clustering cohesion. In: Bloch, I., Cesar, R.M. (eds.) CIARP 2010. LNCS, vol. 6419, pp. 261–268. Springer, Heidelberg (2010). doi:10.1007/978-3-642-16687-7_37
Apostolova, E., Channin, D.S., Raicu, D.: Automatic segmentation of clinical texts. In: Conference Proceedings of IEEE Engineering in Medicine and Biology Society (2009)
Tseng, Y.-H., Lin, C.J., Lin, Y.I.: Text mining techniques for patent analysis. Inf. Process. Manage. 43(5), 1216–1247 (2007)
Cortes, C., Vapnik, V.: Support vector networks. Mach. Learn. 20, 273–297 (1995)
STN International. http://www.stn-international.de
Unstructured Information Management applications. https://uima.apache.org/
Weka Toolkit. http://www.cs.waikato.ac.nz/ml/weka/
FIZ Karlsruhe - Leibniz Institute for Information Infrastructure. https://www.fiz-karlsruhe.de/
Apache Phoenix. https://phoenix.apache.org/
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Sofean, M. (2017). Automatic Segmentation of Big Data of Patent Texts. In: Bellatreche, L., Chakravarthy, S. (eds) Big Data Analytics and Knowledge Discovery. DaWaK 2017. Lecture Notes in Computer Science(), vol 10440. Springer, Cham. https://doi.org/10.1007/978-3-319-64283-3_25
Download citation
DOI: https://doi.org/10.1007/978-3-319-64283-3_25
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-64282-6
Online ISBN: 978-3-319-64283-3
eBook Packages: Computer ScienceComputer Science (R0)