Good morning,
When running a library (sparkling water) for a very large dataset, I've noticed that during an export procedure the /var/lib/lxc storage is being used. Since the storage seems to be at a static 130GB of memory, this is a problem because the storage is running out of space and causing the cluster to fail. I'm not currently sure the exact area of code that is causing this area of storage to be used, so until I figure that out could someone please tell me if there is a way to increase the size of /var/lib/lxc in the meantime? I believe /var/lib/lxc is part of the node's container, so if someone with more knowledge could tell me what types of write operations tend to use this storage, that would also be helpful.
Thanks