B.E. (Automation and Robotics) Natural Language Processing Syllabus - Mumbai University 2026

Theory of Computer Science, System Programming & Compiler Construction

Module 1

• Introduction to NLP: Origin & History of NLP; Language, Knowledge and Grammar in language processing; Stages in NLP; Ambiguities and its types in English and Indian Regional Languages; Challenges of NLP; Applications of NLP Self-Learning topics: Variety types of tools for regional languages pre-processing and other functionalities

Module 2: Word Level Analysis : Basic Terms: Tokenization, Stemming, Lemmatization; Survey of English Morphology, Inflectional Morphology, Derivational Morphology; Regular expression with Morphological Models: Dictionary lookup, finite state morphology; Morphological parsing with FST (Finite State Transducer);Lexicon free FST Porter Stemmer

• algorithm; Grams and its variation: Bigram, Trigram; Simple (Unsmoothed) N grams; N-gram Sensitivity to the Training Corpus; Unknown Words: Open versus closed vocabulary tasks; Evaluating N-grams: Perplexity; Smoothing: Laplace Smoothing, Good-Turing Discounting; Self-Learning topics: Noisy channel models, various edit distance, Advance Issues in Language Modelling

Module 3: Syntax analysis : Part-Of-Speech tagging(POS); Tag set for English (Upenn Treebank); Difficulties /Challenges in POS tagging; Rule-based, Stochastic and Transformation-based tagging; Generative Model: Hidden Markov Model (HMM Viterbi) for POS tagging;

• Issues in HMM POS tagging; Discriminative Model: Maximum Entropy model, Conditional random Field (CRF);Parsers: Top down and Bottom up; Modelling constituency; Bottom Up Parser: CYK, PCFG (Probabilistic Context Free Grammar), Shift Reduce Parser; Top Down Parser: Early Parser, Predictive Parser Self-Learning topics: Evaluating parsers, Parsers based language modelling, Regional languages POS tree banks

Module 4: Semantic Analysis : Introduction, meaning representation; Lexical Semantics; Corpus study; Study of Various language dictionaries like WorldNet, Babelnet; Relations among lexemes & their senses –Homonymy, Polysemy, Synonymy, Hyponymy; Semantic Ambiguity; Word Sense Disambiguation (WSD); Knowledge based approach( Lesk‘s Algorithm), Supervised (Naïve Bayes,

• Decision List),Introduction to Semi-supervised method (Yarowsky) Unsupervised (Hyperlex) Self-Learning topics: Dictionaries for regional languages, Distributional Semantics, Topic Models

Module 5: Pragmatic & Discourse Processing : Discourse: Reference Resolution, Reference Phenomena, Syntactic & Semantic constraint on coherence; Anaphora Resolution using Hobbs and Cantering Algorithm

• Self-Learning topics: Discourse segmentation, Conference resolution

Module 6: Applications of NLP : Case studies on (preferable in regional language):Machine translation; Text Summarization; Sentiment analysis; Information retrieval; Question Answering system

• Self-Learning topics: Applications based on Deep Neural Network with NLP such as LSTM network, Recurrent Neural network etc.

Text Books

• 1 Daniel Jurafsky, James H. and Martin, Speech and Language Processing, Second Edition, Prentice Hall, 2008.
• 2 Christopher D.Manning and HinrichSchutze, Foundations of Statistical Natural Language Processing, MIT Press, 1999.
• 1 Siddiqui and Tiwary U.S., Natural Language Processing and Information Retrieval, Oxford University Press, 2008.
• 2 Daniel M Bikel and ImedZitouni ― Multilingual natural language processing applications: from theory to practice, IBM Press, 2013.
• 3 Alexander Clark, Chris Fox, Shalom Lappin ― The Handbook of Computational Linguistics and Natural Language Processing, John Wiley and Sons, 2012.
• 4 Nitin Indurkhya and Fred J. Damerau, ―Handbook of Natural Language Processing, Second Edition, Chapman and Hall/CRC Press, 2010.
• 5 Niel J le Roux and SugnetLubbe, A step by step tutorial: An introduction into R application and programming.
• 6 Steven Bird, Ewan Klein and Edward Loper, Natural language processing with Python: analyzing text with the natural language toolkit, O‗Reilly Media, 2009.
• 1 http://www.cse.iitb.ac.in/~cs626-449
• 2 http://cse24-iiith.virtual-labs.ac.in/#
• 3 https://nptel.ac.in/courses/106105158 U University of Mumbai