Natural Language Processing

Natural Language Processing

1. Language - Communication, collaboration, conversation, co-creation

2. NLP - interacting between computers and human languages, computers understanding human language and communicating with us in human language

3. Formal language

   • fixed syntax, limited set of words, short and simple formations, unambiguous

4. Natural language

   • Many words, new words get added, no fixed syntax, ambiguous, complex formation

5. AI relates to NLP

   • NLP has total AI, the original turning test was solely based on NLP

6. history

   • until 1980's - complex hand written (programmed) rules
   • NLP based on machine language

7. Linguistics

   • Phonetics
   • Phonology
   • Morphonology
   • Syntax
   • semantics
   • Pragmatics
   • Discourse analysis

8. Challenges

   • Named entity recognition
   • open character recognition
   • word sense disambiguation
   • semantics
   • pragmatics

9. difficult areas in NLP

   • Paraphrase,summarize, Q and A sessions

10. Successful ares of NLP

    • Chatterbots, Spam detection, expert system