Repository navigation
Iterating in reverse Order - Empty Content #347
Description
I am trying to Iterate in Reverse Order, but every time, I set Reverse to true. It gives empty value.
Below is code -
txn := db.NewTransaction(false)
defer txn.Discard()
err = db.View(func(txn *badger.Txn) error {
DefaultIteratorOptions := badger.DefaultIteratorOptions
DefaultIteratorOptions.Reverse = true
it = txn.NewIterator(DefaultIteratorOptions)
key := strconv.Itoa(t.Year()) + "-" + strconv.Itoa(int(t.Month())) + "-" + strconv.Itoa(int(t.Day()))
prefix := []byte(key)
for it.Seek(prefix); it.ValidForPrefix(prefix); it.Next() {
item := it.Item()
k := item.Key()
v, err := item.ValueCopy([]byte(k))
if err != nil {
ctx.WriteString("Content not available")
return err
}
blogList, err := decodeBlog(v)
if err != nil {
fmt.Println("Error: decode: " + err.Error())
}
buffer.WriteString("My Content First")
}
})
Activity
janardhan1993 commentedon Dec 11, 2017
When you seek for a key in reverse iterator, we find first key which is less than or equal to the seek key.
Say you have a list of keys
when you seek for "b:" in reverse mode and iterate you will see only key "a:key1" and since you are doing validForPrefix check you won't see any data.
If you want all values for that prefix in reverse mode you should seek for
prefixKey := append([]byte("prefix"), 0xFF)
peterstace commentedon Dec 11, 2017
Just be careful of the case where you have keys of the form
"prefix", 0xff, ... some other bytes ....When seeking to the initial iterator position, it would be more correct to seek to the prefix but with the last byte incremented. So if your prefix is
"prefix", then you should seek to"prefiy". (Watch out for the case where the last byte in the prefix is 0xff... you'll have to do something a bit tricker to avoid edge cases then).peterstace commentedon Dec 11, 2017
This whole thing seems a bit tricky for users to get right. Maybe we need a
SeekAftermethod?rebootcode commentedon Dec 11, 2017
Wow, I just missed the whole context. Isn't reverse suppose to iterate the value for key
bin reverse order likeb:key4,b:key3,b:key2?I tried, prefixing
0xFFtoo like below, yet i see empty results.manishrjain commentedon Dec 11, 2017
Just right out of bat, I find this strange:
Reusing an internal byte slice from item would cause weird issues -- and the one you're seeing might be related. So, fix that, and then re-run the iterator. Also, have a look at the tests which do reverse iteration, and see how they achieve the same results.
rebootcode commentedon Dec 11, 2017
@manishrjain, Ok, the only other option I see is:-
But I read in FAQ https://github.com/dgraph-io/badger#frequently-asked-questions, where it says, If writes are getting stuck, then it's better to use
Use Item::ValueCopy instead of Item::Value when retrieving a value.Is there any other hack around available where reuse can be fixed.
Update: Even after using
item.Value()the results are empty.rebootcode commentedon Dec 11, 2017
The new
GetSequencemethod is more easy to adopt for my requirement, I am switching my option tonextSequenceapproach like an update here #346Thanks