Intro - Elasticsearch 权威指南中文版

返回介绍

Intro

发布于 2019-07-04 字数 1548 浏览 924 评论 0

[[identifying-words]]
== Identifying Words

A word in English is relatively simple to spot: words are separated by
whitespace or (some) punctuation.(((“languages”, “identifyig words”)))(((“words”, “identifying”))) Even in English, though, there can be
controversy: is you’re one word or two? What about o’clock,
cooperate, half-baked, or eyewitness?

Languages like German or Dutch combine individual words to create longer
compound words like Weißkopfseeadler (white-headed sea eagle), but in order
to be able to return Weißkopfseeadler as a result for the query Adler
(eagle), we need to understand how to break up compound words into their
constituent parts.

Asian languages are even more complex: some have no whitespace between words,
sentences, or even paragraphs.(((“Asian languages”, “identifying words”))) Some words can be represented by a single
character, but the same single character, when placed next to other
characters, can form just one part of a longer word with a quite different
meaning.

It should be obvious that there is no silver-bullet analyzer that will
miraculously deal with all human languages. Elasticsearch ships with dedicated
analyzers for many languages, and more language-specific analyzers are
available as plug-ins.

However, not all languages have dedicated analyzers, and sometimes you won’t
even be sure which language(s) you are dealing with. For these situations, we
need good standard tools that do a reasonable job regardless of language.

上一篇:Conclusion

下一篇:Standard analyzer

发布评论

需要 登录 才能够评论, 你可以免费 注册 一个本站的账号。

目前还没有任何评论,快来抢沙发吧!