NLP
Natural Language Processing (NLP) - answer Increases availability of text
Technical: UI, information retrieval, extraction
Domain: Business-Google Advertising, Comp Sci: voice recognition
Tools and Resources for NLP - answer Like using Python NLTK
Morphology - answer Single words: made up of morphemes: stems + affixes
Example test -> tests, testing
Morpheme - answer smallest meaning bearing unit
Tokenizer - answer Recognizes words, root words Playing -> play
Sequence of words – answer N-gram, useful to build language models for word
prediction
Syntax - answercombining words according to set of rules
Basic structure of syntax - answersubject - predicate
Word classes - answerNouns, verbs
Syntatic ambiguity - answerSame sequence with different meanings like flying planes
can be dangerous
Impact of meaning on structure like I washed the shirt with soap (shirt and soap go
together)
Assigning structure to text - answerStep 1: POS Tagging : rule based, stochastic, and
transformation-based learning
Step 2: CFG - rules on how to combine chunks
Parsing - answerassigning a structure to a text that fits the rules
Semantics - answerconnecting linguistic elements to non-linguistic knowledge of the
world (meaning of words)
Pragmatics - answermeaning in context, language as a means of communication needs
three elements:
linguistic expression
what expression refers to
context
Natural Language Processing (NLP) - answer Increases availability of text
Technical: UI, information retrieval, extraction
Domain: Business-Google Advertising, Comp Sci: voice recognition
Tools and Resources for NLP - answer Like using Python NLTK
Morphology - answer Single words: made up of morphemes: stems + affixes
Example test -> tests, testing
Morpheme - answer smallest meaning bearing unit
Tokenizer - answer Recognizes words, root words Playing -> play
Sequence of words – answer N-gram, useful to build language models for word
prediction
Syntax - answercombining words according to set of rules
Basic structure of syntax - answersubject - predicate
Word classes - answerNouns, verbs
Syntatic ambiguity - answerSame sequence with different meanings like flying planes
can be dangerous
Impact of meaning on structure like I washed the shirt with soap (shirt and soap go
together)
Assigning structure to text - answerStep 1: POS Tagging : rule based, stochastic, and
transformation-based learning
Step 2: CFG - rules on how to combine chunks
Parsing - answerassigning a structure to a text that fits the rules
Semantics - answerconnecting linguistic elements to non-linguistic knowledge of the
world (meaning of words)
Pragmatics - answermeaning in context, language as a means of communication needs
three elements:
linguistic expression
what expression refers to
context
