General Architecture for Text Engineering

General Architecture for Text Engineering or GATE is a Java suite of tools originally developed at the University of Sheffield beginning in 1995 and now used worldwide by a wide community of scientists, companies, teachers and students for many natural language processing tasks, including information extraction in many languages.[1]

GATE
GATE Developer v5 main window
Developer(s)GATE research team, Dept. Computer Science, University of Sheffield
Initial release1995 (1995)
Stable release8.6 (June 10, 2019 (2019-06-10)) [±]
Preview release8.5 (August 11, 2020 (Nightly builds released every day)) [±]
Repository
Written inJava
Operating systemCross-platform
Available inEnglish
TypeText mining Information Extraction
LicenseLGPL
Websitegate.ac.uk

GATE has been compared to NLTK, R and RapidMiner.[2] As well as being widely used in its own right, it forms the basis of the KIM semantic platform.[3]

GATE community and research has been involved in several European research projects including TAO, SEKT, NeOn, Media-Campaign, Musing, Service-Finder, LIRICS and KnowledgeWeb, as well as many other projects.

As of May 28, 2011, 881 people are on the gate-users mailing list at SourceForge.net, and 111,932 downloads from SourceForge are recorded since the project moved to SourceForge in 2005.[4] The paper "GATE: A Framework and Graphical Development Environment for Robust NLP Tools and Applications"[5] has received over 800 citations in the seven years since publication (according to Google Scholar). Books covering the use of GATE, in addition to the GATE User Guide,[6] include "Building Search Applications: Lucene, LingPipe, and Gate", by Manu Konchady,[7] and "Introduction to Linguistic Annotation and Text Analytics", by Graham Wilcock.[8]

Features

GATE includes an information extraction system called ANNIE (A Nearly-New Information Extraction System) which is a set of modules comprising a tokenizer, a gazetteer, a sentence splitter, a part of speech tagger, a named entities transducer and a coreference tagger. ANNIE can be used as-is to provide basic information extraction functionality, or provide a starting point for more specific tasks.

Languages currently handled in GATE include English, Chinese, Arabic, Bulgarian, French, German, Hindi, Italian, Cebuano, Romanian, Russian, Danish.

Plugins are included for machine learning with Weka, RASP, MAXENT, SVM Light, as well as a LIBSVM integration and an in-house perceptron implementation, for managing ontologies like WordNet, for querying search engines like Google or Yahoo, for part of speech tagging with Brill or TreeTagger, and many more. Many external plugins are also available, for handling e.g. tweets.[9]

GATE accepts input in various formats, such as TXT, HTML, XML, Doc, PDF documents, and Java Serial, PostgreSQL, Lucene, Oracle Databases with help of RDBMS storage over JDBC.

JAPE transducers are used within GATE to manipulate annotations on text. Documentation is provided in the GATE User Guide.[10] A tutorial has also been written by Press Association Images.[11]

GATE Developer
GATE 5 main window.

The screenshot shows the document viewer used to display a document and its annotations. In pink are <A> hyperlink annotations from an HTML file. The right list is the annotation sets list, and the bottom table is the annotation list. In the center is the annotation editor window.

GATE Mímir

GATE generates vast quantities of information including; natural language text, semantic annotations, and ontological information. Sometimes the data itself is the end product of an application but often the information would be more useful if it could be efficiently searched. GATE Mimir provides support for indexing and searching the linguistic and semantic information generated by such applications and allows for querying the information using arbitrary combinations of text, structural information, and SPARQL.

gollark: False dichotomy.
gollark: Interesting.
gollark: The parallels to our current discussion are obvious.
gollark: Consider also the following scenario.
gollark: It's obviously named after the Ben who used to be at my school and now works at GSK.

See also
  • Unstructured Information Management Architecture (UIMA)
  • OpenNLP
  • Pheme, a major EU project managed by the GATE group on early detection of false information in social media

References
  1. Languages mentioned on http://gate.ac.uk/gate/plugins/ include Arabic, Bulgarian, Cebuano, Chinese, French, German, Hindi, Italian, Romanian and Russian.
  2. "Open Source Text Analytics by Seth Grimes - BeyeNETWORK". Retrieved 17 December 2016.
  3. Popov, Borislav; Kiryakov, Atanas; Ognyanoff, Damyan; Manov, Dimitar; Kirilov, Angel (1 September 2004). "KIM – a semantic platform for information extraction and retrieval". Natural Language Engineering. 10 (3–4): 375–392. doi:10.1017/S135132490400347X. Retrieved 17 December 2016 – via Cambridge Core.
  4. "GATE". Retrieved 17 December 2016.
  5. "GATE: A Framework and Graphical Development Environment for Robust NLP Tools and Applications", by Cunningham H., Maynard D., Bontcheva K. and Tablan V. (In proc. of the 40th Anniversary Meeting of the Association for Computational Linguistics, 2002)
  6. "GATE.ac.uk - sale/tao/split.html". Retrieved 17 December 2016.
  7. Konchady, Manu. Building Search Applications: Lucene, LingPipe, and Gate. Mustru Publishing. 2008.
  8. Wilcock, Graham (1 January 2009). Introduction to Linguistic Annotation and Text Analytics. Morgan & Claypool Publishers. ISBN 9781598297386. Retrieved 17 December 2016 – via Google Books.
  9. "GATE.ac.uk - wiki/twitie.html". Retrieved 17 December 2016.
  10. "GATE.ac.uk - sale/tao/splitch8.html". Retrieved 17 December 2016.
  11. Thakker, Dhavalkumar (17 July 2009). "Realizing Semantic Web: JAPE grammar tutorial". Retrieved 17 December 2016.
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.