UNIT IV WEB SEARCH – LINK ANALYSIS AND SPECIALIZED SEARCH Web size measurement - search engine optimization/spam – Web Search Architectures - crawling - meta-crawlers- Focused Crawling - web indexes –- Near-duplicate detection - Index Compression - XML retrieval. Web search overview, web structure, the user, paid placement, search engine optimization/ spam. UNIT III WEB SEARCH ENGINE – INTRODUCTION AND CRAWLING

Information Retrieval: Design features of Information Retrieval Systems-Classical, Non-classical, Alternative Models of Information Retrieval – valuation Lexical Resources: World Net-Frame Net- Stemmers-POS Tagger- Research Corpora.Introduction -History of IR- Components of IR - Issues –Open source Search engine Frameworks - The impact of the web on IR - The role of artificial intelligence (AI) in IR – IR Versus Web Search - Components of a Search engine- Characterizing the web.īoolean and vector-space retrieval models- Term weighting - TF-IDF weighting- cosine similarity – Preprocessing - Inverted indices - efficient processing with sparse vectors – Language Model based IR - Probabilistic IR –Latent Semantic Indexing - Relevance feedback and query expansion. UNIT V INFORMATION RETRIEVAL AND LEXICAL RESOURCES Machine Translation: Problems in Machine Translation- Characteristics of Indian Languages- Machine Translation Approaches-Translation involving Indian Languages. Natural Language Generation: Architecture of NLG Systems- Generation Tasks and Representations- Application of NLG. UNIT IV NATURAL LANGUAGE GENERATION AND MACHINE TRANSLATION Discourse Processing: cohesion-Reference Resolution- Discourse Coherence and Structure. Semantic Analysis: Meaning Representation-Lexical Semantics- Ambiguity-Word Sense Disambiguation. UNIT III SEMANTIC ANALYSIS AND DISCOURSE PROCESSING Syntactic Analysis: Context-free Grammar-Constituency- Parsing-Probabilistic Parsing.

Word Level Analysis: Regular Expressions-Finite-State Automata-Morphological Parsing-Spelling Error Detection and correction-Words and Word classes-Part-of Speech Tagging. UNIT II WORD LEVEL AND SYNTACTIC ANALYSIS Language Modeling: Various Grammar- based Language Models-Statistical Language Model.

Overview: Origins and challenges of NLP-Language and Grammar-Processing Indian Languages - NLP Applications-Information Retrieval. > Understand the information retrieval techniques. > Be familiar with the natural language generation. > Learn the techniques in natural language processing. CS6011 NATURAL LANGUAGE PROCESSING SYLLABUS - REGULATION - 2013

Cs6004 important questions rejinpaul