The index can be emptied with a TRUNCATE TABLE SQL statement or with a truncate() PHP client function.
Here is the syntax for the SQL statement:
TRUNCATE TABLE index_name [WITH RECONFIGURE]When this statement is executed, it clears the RT index completely. It disposes the in-memory data, unlinks all the index data files, and releases the associated binary logs.
An index can also be emptied with DELETE FROM index WHERE id>0, but it's not recommended as it's much slower than TRUNCATE.
- SQL
- HTTP
- PHP
- Python
- javascript
- Java
TRUNCATE TABLE products;POST /sql -d "mode=raw&query=TRUNCATE TABLE products"$params = [ 'index' => 'products' ];
$response = $client->indices()->truncate($params);utilsApi.sql('mode=raw&query=TRUNCATE TABLE products')res = await utilsApi.sql('mode=raw&query=TRUNCATE TABLE products');utilsApi.sql("mode=raw&query=TRUNCATE TABLE products");Query OK, 0 rows affected (0.02 sec){
"total":0,
"error":"",
"warning":""
}Array(
[total] => 0
[error] =>
[warning] =>
){u'error': u'', u'total': 0, u'warning': u''}{"total":0,"error":"","warning":""}{total=0, error=, warning=}One of the possible uses of this command is before attaching an index.
When RECONFIGURE option is used new tokenization, morphology, and other text processing settings specified in the config take effect after the index gets cleared. In case the schema declaration in config is different from the index schema the new schema from config got applied after index get cleared.
With this option clearing and reconfiguring an index becomes one atomic operation.
- SQL
- HTTP
- PHP
- Python
- javascript
- Java
TRUNCATE TABLE products with reconfigure;POST /sql -d "mode=raw&query=TRUNCATE TABLE products with reconfigure"$params = [ 'index' => 'products', 'with' => 'reconfigure' ];
$response = $client->indices()->truncate($params);utilsApi.sql('mode=raw&query=TRUNCATE TABLE products WITH RECONFIGURE')res = await utilsApi.sql('mode=raw&query=TRUNCATE TABLE products WITH RECONFIGURE');utilsApi.sql("mode=raw&query=TRUNCATE TABLE products WITH RECONFIGURE");Query OK, 0 rows affected (0.02 sec){
"total":0,
"error":"",
"warning":""
}Array(
[total] => 0
[error] =>
[warning] =>
){u'error': u'', u'total': 0, u'warning': u''}{"total":0,"error":"","warning":""}{total=0, error=, warning=}Manticore Search is a highly distributed system and consists of all the needed components to allow you build a highly available and scalable setup of a database for search:
- distributed index allowing sharding
- Mirroring for high availability
- Load balancing for high scalability
- Replication for data safety
Manticore Search is extremely flexible in terms of how you setup your cluster, there's no limitations and it's up to you how you design it. Just learn the tools mentioned above and use them to achieve your goal.
To add another node to a cluster just start another node of Manticore and make sure it's accessible by other nodes in your cluster. Then use a distributed index to connect one node with another and replication for data safety.
Please read distributed index. Here we will just provide an example.
Here we have split the data over 4 servers, each serving one of the shards. If one of the servers fails, our distributed index will still work, but we would miss the results from the failed shard.
- ini
index mydist {
type = distributed
agent = box1:9312:shard1
agent = box2:9312:shard2
agent = box3:9312:shard3
agent = box4:9312:shard4
}Now we added mirrors, each shard is found on 2 servers. By default, the master (the searchd instance with the distributed index) will pick randomly one of the mirrors.
The mode used for picking mirrors can be set with ha_strategy. In addition to random there's also ha_strategy = roundrobin.
More interesting strategies are the latency-weighted probabilities based ones. noerrors and nodeads not only that take out mirrors with issues, but also monitor the response times and do a balancing. If a mirror responds slower (for example due to some operations running on it), it will receive less requests. When the mirror recovers and provides better times, it will get more requests.
- ini
index mydist {
type = distributed
agent = box1:9312|box5:9312:shard1
agent = box2:9312:|box6:9312:shard2
agent = box3:9312:|box7:9312:shard3
agent = box4:9312:|box8:9312:shard4
}