Manticore Search Indexes and document storage

Posted on by adriannuta

Starting from v 3.2.0 Manticore Search introduced a new feature – Document Storage.

Historically Manticore Search was a text search engine which indexes texts but doesn’t keep the originals. A text is processed, transforming it from a plain string into special structures that form the full-text index, which allows fast text searching. In the result set, the user wasn’t receiving the original text, as recomposing it from the full-text index can be a complex process. In addition, indexation settings may include clauses that stop certain words from being indexed (like minimum word length or stopwords) which can make the reconstruction impossible.

[…]

SSL support: HTTPS interface

Posted on by gloriavin

In Manticore 3.1.2 was added support for data encryption between your application or another client (curl, browser etc) and Manticore Search daemon. It’s important to have it enabled if you need to protect your data (queries, responses) from interception inside your local network and especially if you connect to Manticore Search over the internet. Setting it up requires using certificates. Below is just an example of how it can be done with self-signed certificates, there may be other options like purchasing certificates signed by a real CA.

In this tutorial, we will study how to use SSL in work with Manticore Search.

In case if you want to go through an interactive course, go here.

[…]

How we’ve remade sys threads in Manticore Search

Posted on by Alexey Vinogradov

Recently we’ve remade our system threads. Since we’ve forked from Sphinx and earlier searchd had all system tasks made in an often-rise-up style. Each service worked in a dedicated thread which wakes up every 50ms and checks whether it has something to do or not. That means that even an idle daemon wakes 200 times a sec ‘just to check’ a task. Having 6 such tasks will make 1200 wakes a sec, and it became noticeable especially by clients on Amazon AWS which counts CPU usage. Those internal tasks were: […]