Web content extraction by using decision tree learning
Küçük Resim Yok
Tarih
2012
Yazarlar
Dergi Başlığı
Dergi ISSN
Cilt Başlığı
Yayıncı
Erişim Hakkı
info:eu-repo/semantics/closedAccess
Özet
Via information extraction techniques, web pages are able to generate datasets for various studies such as natural language processing, and data mining. However, nowadays the uninformative sections like advertisement, menus, and links are in increase. The cleaning of web pages from uninformative sections, and extraction of informative content has become an important issue. In this study, we present an decision tree learning approach over DOM based features which aims to clean the uninformative sections and extract informative content in three classes: title, main content, and additional information. Through this approach, differently from previous studies, the learning model for the extraction of the main content constructed on DIV and TD tags. The proposed method achieved 95.58% accuracy in cleaning uninformative sections and extraction of the informative content. Especially for the extraction of the main block, 0.96 f-measure is obtained. © 2012 IEEE.
Açıklama
2012 20th Signal Processing and Communications Applications Conference, SIU 2012 -- 18 April 2012 through 20 April 2012 -- Fethiye, Mugla -- 90786
Anahtar Kelimeler
Data Sets; Decision Tree Learning; F-Measure; Information Extraction Techniques; Learning Models; Natural Language Processing; Web Content; Computational Linguistics; Data Mining; Decision Trees; Natural Language Processing Systems; Signal Processing; Websites; Information Retrieval Systems
Kaynak
2012 20th Signal Processing and Communications Applications Conference, SIU 2012, Proceedings
WoS Q Değeri
Scopus Q Değeri
N/A
