Natural Language Engineering

Luke Vincent
Flashcards by Luke Vincent, updated more than 1 year ago
Luke Vincent
Created by Luke Vincent over 6 years ago
6
0

Description

University of Sussex 2014

Resource summary

Question Answer
Tokenisation converting strings to tokens
Segmentation splitting into sentences
Stemming
Lemmatisation
Part-of-speech tagging label tokens nouns/verbs/adjectives etc
phrasal chunking form phrasal units from tokens, typically refer to enitities and actions
Syntactic analysis hierarchical analyse sentences into components (subject/object/main verb)
Semantic analysis express literal meaning
Named entity recognistion identify type of entity (person/institution/place/time)
Reference resolution link difference references to the same entity
Word sense disambiguation using context to disambiguate use of a word
Relation detection identify and classify relationships between entiities
Event detection identify, classify and temporarily order events
Topic identification identify words/phrases that relate to a topic
Text similarity measure relevance of a document to a query, or of one document to another
NLP pipeline
Why is NLP hard? Many different ways of saying things Hundreds of different dialects Language is used in highly creative ways
Show full summary Hide full summary

Similar

Useful terminology to describe structure in a text
Bob Read
Generic features of texts
Claire Collins
Use of connectives when comparing two texts
Bob Read
Insert full reference here
Rhiannon Denby
Adjectives to describe people
Suveni Mukoo
Use of terminology to describe language devices in non-fiction
Bob Read
Probabilistic parsing
Doria Šarić
Terminology - analysing structure in a text
Sarah Holmes
Useful terminology to describe structure in a text
Linda Castelletti
Use of connectives when comparing two texts
Linda Castelletti
Useful terminology to describe structure in a text
Linda Castelletti