How to (temporarily) stop Elasticsearch from expunging deleted documents? -


in my usecase i'm trying synchronize 2 elasticsearch indices. due versioning acutally quite simple. however, want keep writing @ time while i'm doing this.

okay, steps want perform in chronological order:

  1. clients write (index, delete, update) cluster c1
  2. create new index c2 (clients keep writing c1)
  3. copy data cluster c1 c2 (clients keep writing c1)
  4. switch clients c2
  5. synchronize changes c1 c2 (clients keep writing c2)
  6. shutdown c1

step #5 step i'm looking at. have make sure changes written c2 aren't overwritten data c1. using versioning it's rather simple writes index operations fail (versionconflictengineexception). assuming following situation:

  1. a document updated on c1 right after #3 (v2 on c1, v1 on c2)
  2. the same document deleted right after #4 (v2 on c1, deleted on c2)
  3. synchronizing try reindex v2 on c2

i know elasticsearch keeps deleted documents around while:

# index document 1:4 $ curl -xput 'http://localhost:9200/test/test/1?version=4&version_type=external' -d '{"message": "test"}' {"ok":true,"_index":"test","_type":"test","_id":"1","_version":4}  # delete document 1:6 $ curl -xdelete 'http://localhost:9200/test/test/1?version=6&version_type=external' {"ok":true,"found":true,"_index":"test","_type":"test","_id":"1","_version":6}  # index document 1:4 (error!) $ curl -xput 'http://localhost:9200/test/test/1?version=4&version_type=external' -d '{"message": "test"}' {"error":"versionconflictengineexception[[test][2] [test][1]: version conflict, current [6], provided [4]]","status":409}  # wait time  # index document 1:4 (success!) $ curl -xput 'http://localhost:9200/test/test/1?version=4&version_type=external' -d '{"message": "test"}' {"ok":true,"_index":"test","_type":"test","_id":"1","_version":4}

the problem "wait time" part. have rely on deleted documents unknown amount of time. therefore need control time disallowing expunging of deleted documents while i'm running #5. how this?

crossposted elasticsearch group (and related question)

the "wait time" part defined index.gc_deletes setting on per index basis , set "60s" default. can dynamically changed using update index settings command.


Comments

Post a Comment

Popular posts from this blog

php - get table cell data from and place a copy in another table -

two-part question: have 2 tables: 1 table items , other table selected items copied when add button clicked. after, when items wanted selected, there 'finished' button post items selected db. i started javascript didn't far @ because jquery seems better suited i'm not familiar it function addto() { var div = document.getelementbyid('fixeddiv','inside'); div.innerhtml = div.innerhtml + 'item added'; } <div id='fixeddiv'> <table align="center" id="tradee"> <th rowspan="2"> other item</th> <?php while($rowi =$item->fetch_assoc()) {?> <tr> <td> <?php echo $rowi['item_name']; ?> </td> <td><?php echo $rowi['item_description'];?></td> </tr> <?php } ?> </table> <br> <table align="center" id="tradetable"
Read more

javascript - Mootools wait with Fx.Morph start -

i trying var effect = new fx.morph(testmorph, { wait/delay 2 seconds before starting. ( fiddle here ) but when try .wait(2000) or .delay(2000) , or .wait(2000, effect) uncaught typeerror: object [object object] has no method 'delay' any ideas how working? code i'm using: var testmorph = document.id('testmorph'); var effect = new fx.morph(testmorph, { transition: 'back:out', duration: 900, link: 'chain' }).start({ 'top': 20, 'opacity': 1 }).start({ 'border-color': '#a80025', 'color': '#a80025' }); effect.delay(2000); you can use combination of chain() , delay() achieve desired effect. new fx.morph(testmorph, { transition: 'back:out', duration: 900, link: 'chain' }).start().chain(function(){ this.start.delay(2000,effect,{ //first }); }).chain(function(){ this.start({ //second }); }); the
Read more

php - Navigate throught databse rows -

i run image hosting site, , ive run problem. want make 2 buttons beside pic "next image" , "prev image". im new php/mysql , haveing troubles. check out got. use id (numbers) find correct row, have image name build next link. how make below query next , prev image names + ids? $query_next = ("select imageid, image_name images image_name = '$image_main' order imageid desc limit 1"); $query_prev = ("select imageid, image_name images image_name = '$image_main' order imageid asc limit 1"); // next $next = mysql_query($query_next); // prev $prev = mysql_query($query_prev); while ($row = mysql_fetch_assoc($next)) { $next = $row['image_name']; } while ($row = mysql_fetch_assoc($prev)) { $prev = $row['image_name']; } the html = > simple stuff. <a href="http://mysite.com/view_image/<?=$next?>">next image</a> <a href="http://mysite.com/view_image/<?=$pr
Read more