Hypernym Discovery over WordNet and English Corpora - using Hearst Patterns and Word Embeddings

Vallabhajosyula, Manikya Swathi
2018-07
Thumbnail Image

View/Download File

Vallabhajosyula_umn_0130M_19483.pdf (5.89 MB)

Persistent link to this item

https://hdl.handle.net/11299/200144
Statistics
View Statistics

Journal Title

Journal ISSN

Volume Title

Title

Hypernym Discovery over WordNet and English Corpora - using Hearst Patterns and Word Embeddings

Authors

Published Date

2018-07

Publisher

Type

Thesis or Dissertation

Abstract

Languages evolve over time. With new technical innovations, new terms get created and new senses are added to existing words. Dictionaries like WordNet which act as a database for English vocabulary should be updated with these new concepts. WordNet organizes these concepts in sets of synonyms and interlinks them by using semantic relations. Many Natural Language Processing applications like Machine Translation and Word Sense Disambiguation rely on WordNet for their functionality. WordNet was last updated in 2006. If WordNet is not updated with new vocabulary, the performance of applications which rely on WordNet would drop. The objective of our research is to automatically update WordNet with the new senses by using resources like online dictionaries and text corpora available over the internet. We use the ISA hierarchy structure of WordNet to insert new senses. In an ISA hierarchy, the concepts higher in a hierarchy (called hypernyms) are more abstract representations of the concepts lower in hierarchy (called hyponyms). To improve the coverage of our solution, we rely on two complementary techniques - traditional pattern matching and modern vector space models - to extract candidate hypernym from WordNet for a new sense. Our system was ranked 4 among the systems that participated in for this SemEval task SemEval 2016 Task 14 Semantic Taxonomy Enrichment. We also evaluate our system by participating in the task SemEval 2018 Task 09 Hypernym Discovery. In this task, we apply our system to the huge UMBC WebBase text corpus to extract candidate hypernyms for a given input term. Our system was ranked 3 among the systems which find hypernyms for Concepts.

Keywords

Description

University of Minnesota M.S. thesis.July 2018. Major: Computer Science. Advisor: Ted Pedersen. 1 computer file (PDF); ix, 126 pages.

Related to

Replaces

License

Collections

Master's Theses (Plan A and Professional Engineering Design Projects)

Series/Report Number

Funding information

Isbn identifier

Doi identifier

Previously Published Citation

Suggested citation

Vallabhajosyula, Manikya Swathi. (2018). Hypernym Discovery over WordNet and English Corpora - using Hearst Patterns and Word Embeddings. Retrieved from the University Digital Conservancy, https://hdl.handle.net/11299/200144.

Content distributed via the University Digital Conservancy may be subject to additional license and use restrictions applied by the depositor. By using these files, users agree to the Terms of Use. Materials in the UDC may contain content that is disturbing and/or harmful. For more information, please see our statement on harmful content in digital repositories.