Map with TTL option in Go
Take a look at buntdb.
tinykv
is no longer being maintained.
Just for the record, I had the same problem and wrote tinykv package which uses a map internally.
- It uses a heap of
time.Time
for timeouts, so it does not ranges over the whole map. - A max interval can be set when creating an instance. But actual intervals for checking the timeout can be any value of
time.Duration
greater than zero and less than max, based on the last item that timed out. - It provides
CAS
andTake
functionality. - A callback (optional) can be set which notifies which key and value got timed out.
- Timeouts can be explicit or sliding.
You will have to create a struct to hold your map and provide custom get/put/delete funcs to access it.
Note that 2-5k accesses per second is not really that much at all, so you don't have to worry about that.
Here's a simple implementation:
type item struct {
value string
lastAccess int64
}
type TTLMap struct {
m map[string]*item
l sync.Mutex
}
func New(ln int, maxTTL int) (m *TTLMap) {
m = &TTLMap{m: make(map[string]*item, ln)}
go func() {
for now := range time.Tick(time.Second) {
m.l.Lock()
for k, v := range m.m {
if now.Unix() - v.lastAccess > int64(maxTTL) {
delete(m.m, k)
}
}
m.l.Unlock()
}
}()
return
}
func (m *TTLMap) Len() int {
return len(m.m)
}
func (m *TTLMap) Put(k, v string) {
m.l.Lock()
it, ok := m.m[k]
if !ok {
it = &item{value: v}
m.m[k] = it
}
it.lastAccess = time.Now().Unix()
m.l.Unlock()
}
func (m *TTLMap) Get(k string) (v string) {
m.l.Lock()
if it, ok := m.m[k]; ok {
v = it.value
it.lastAccess = time.Now().Unix()
}
m.l.Unlock()
return
}
playground
note(2020-09-23): for some reason the time resolution on the current version of the playground is way off, this works fine, however to try on the playground you have to change the sleep to 3-5 seconds.
I suggest to use Map of golang's built-in package sync
, it's very easy to use and already handles concurrency https://golang.org/pkg/sync/#Map