edgepedia

Natural language processing

156 articles

General

Distributional hypothesis

The distributional hypothesis is the linguistic claim, stated by Zellig Harris in 1954, that words occurring in the same contexts tend to have similar meanings, underlying word embeddings in NLP.

General

Document classification

Document classification, also known as document categorization or text categorization, is the task of automatically assigning documents such as web pages and newswire stories to predefined classes by subject, generally using machine learning algorithms.

General

Document-level relation extraction

Document-level relation extraction (DocRE) is a natural language processing method that identifies relations between entity pairs across an entire document, used to build knowledge bases from large-scale documents.

General

ELIZA

ELIZA, also known as Eliza AI, is a natural language conversation program written by Joseph Weizenbaum at MIT and published in 1966, usually considered the first chatbot.

General

Empirical Methods in Natural Language Processing

Empirical Methods in Natural Language Processing, or EMNLP, is an annual academic conference on natural language processing, first held in 1996 and one of the main NLP publication venues alongside ACL.

General

Entity linking

Entity linking is a natural language processing method that maps entity mentions in text to knowledge base entries, choosing the right entry when candidates match the same surface form.

General

Event extraction

Event extraction is the natural language processing task of identifying event mentions in text and structuring each one, with its participants, time, and location, into a machine-readable record.

General

fairseq

fairseq is an open-source sequence modeling toolkit from Facebook AI Research, first released in 2017 and rewritten in PyTorch, used for machine translation, summarization, and language modeling.

General

Fake news detection

Fake news detection is the natural language processing task of predicting whether a news article is false or misleading, covering rumor, clickbait, and veracity classification.

General

FastText

FastText is an open-source library for text classification and word embeddings developed by Facebook AI Research and released in 2016, with accuracy often on par with deep learning classifiers.

General

Findings of the Association for Computational Linguistics

Findings of the Association for Computational Linguistics, commonly Findings of ACL, is a companion proceedings series of the Association for Computational Linguistics, first published with EMNLP 2020.

General

Flair (NLP software)

Flair is an open-source Python framework for natural language processing built on PyTorch, released by Zalando Research in 2018 and known for contextual string embeddings and named entity recognition.

General

FrameNet

FrameNet is a lexical database of English organized around semantic frames, established in 1997 by Charles J. Fillmore in Berkeley and used for semantic role labeling in natural language processing.

General

Gensim

Gensim ("Generate Similar") is a free, open-source Python library for unsupervised topic modeling and document embeddings, started in 2008 and designed to stream corpora larger than RAM.

General

GLUE (benchmark)

GLUE, the General Language Understanding Evaluation benchmark, is a suite of nine NLP tasks and a leaderboard introduced in 2018 to test whether one model handles many language tasks.

General

Google Neural Machine Translation

Google Neural Machine Translation (GNMT) is the deep-learning system Google announced in 2016 to replace phrase-based translation in Google Translate, cutting errors by about 60%.

General

Google Translate

Google Translate is Google's machine translation service, launched in 2006, which translates text, documents, and websites between nearly 250 languages for more than a billion users.

General

Google Voice Search

Google Voice Search, also called Search by Voice, is a Google Search feature letting users speak queries instead of typing, first launched on iPhone in November 2008.

General

Grammar checker

A grammar checker is a program that detects and suggests corrections for grammatical, spelling, and word choice errors, embedded in word processors and used widely in education.

General

Grammar induction

Grammar induction, also called grammatical inference or grammar inference, is the process of learning a formal grammar from example data such as sentences instead of hand-written rules.

General

Grammatical error correction

Grammatical error correction (GEC) is the task of automatically detecting and correcting grammatical, orthographic, and semantic errors in text, progressing from rule-based methods to neural machine translation.

General

Grapheme-to-phoneme conversion

Grapheme-to-phoneme conversion (G2P) is the natural language processing task of predicting a word's pronunciation from its written form, a core component of text-to-speech synthesis and automatic speech recognition.

General

Hate speech detection

Hate speech detection is a natural language processing task that identifies language attacking people based on identity factors such as race or religion, used mainly for social media content moderation.

General

Head-driven phrase structure grammar

Head-driven phrase structure grammar (HPSG) is a lexicalist, unification-based theory of syntax introduced by Carl Pollard and Ivan Sag in 1987, where most grammatical information is carried by lexical entries.

General

HotpotQA

HotpotQA is a 2018 question answering dataset of 113k Wikipedia question-answer pairs, built by researchers at Carnegie Mellon, Stanford, and Université de Montréal, requiring multi-hop reasoning over multiple supporting documents.

General

Information retrieval

Information retrieval (IR) is the task of finding documents that contain answers to a user's query and ranking them by predicted relevance, the core operation behind search engines.

General

Inside–outside–beginning (tagging)

Inside–outside–beginning (IOB) tagging, or BIO tagging, is a natural language processing encoding that marks chunk boundaries with I, O, and B tags on each word.

General

Intent classification

Intent classification, also called intent detection or intent recognition, is an NLU task that assigns a user's utterance to one intent label, such as book_flight, which maps to a system action.

General

Interactive machine translation

Interactive machine translation (IMT) is a mode of computer-assisted translation in which a human translator and a machine translation system build the target text together, with the system re-predicting after each edit.

General

International Committee on Computational Linguistics

The International Committee on Computational Linguistics (ICCL) is a board of senior researchers in computational linguistics and NLP that has organized the COLING conference series since 1965.