New KVs should be written to the top layer and trigger eviction from a tier if sufficient space doesn't exist.
Originally posted by @wvaske in #214 (comment)
It looks like the current implementation when writing KV chunks will not send to memory then evict if memory is full but allocate directly to storage.
This should probably issue a write to the top layer and a set of evictions to move data down the stack to make room in the top of the hierarchy.