Configuring the dtool cache directoryΒΆ
When fetching a dataset item from a dataset stored in object storage the file get stored in a cache directory. The default cache directory is:
~/.cache/dtool
You may want to configure this cache to be in a different location. This can be achieved using the dtool config cache
command:
$ mkdir /tmp/dtool
$ dtool config cache /tmp/dtool
It is also possible to override both the default and the configured cache
directory by exporting the environment variable DTOOL_CACHE_DIRECTORY
.
This can be useful when using local SSD on a compute cluster:
$ mkdir /local/ssd/dtool
$ export DTOOL_CACHE_DIRECTORY=/local/ssd/dtool
Warning
There is no automatic mechanism built into dtool to clear up the cache. It can therefore grow very large if you are working with lots of datasets in object storage.