Modifying size of /var/lib/lxc

somedeveloper — Fri, 22 Nov 2024 16:30:27 GMT

Good morning,

When running a library (sparkling water) for a very large dataset, I've noticed that during an export procedure the /var/lib/lxc storage is being used. Since the storage seems to be at a static 130GB of memory, this is a problem because the storage is running out of space and causing the cluster to fail. I'm not currently sure the exact area of code that is causing this area of storage to be used, so until I figure that out could someone please tell me if there is a way to increase the size of /var/lib/lxc in the meantime? I believe /var/lib/lxc is part of the node's container, so if someone with more knowledge could tell me what types of write operations tend to use this storage, that would also be helpful.

Thanks

Re: Modifying size of /var/lib/lxc

Walter_C — Fri, 22 Nov 2024 19:32:32 GMT

Unfortunately this is a setting that cannot be increased on customer side

Re: Modifying size of /var/lib/lxc

Antonio1 — Tue, 04 Nov 2025 14:03:42 GMT

Can it be decreased though? In all my workflows the /var/lib/lxc is bigger than local_disk0, so I feel forced to pay to a big disk that I don't even can use.

topic Re: Modifying size of /var/lib/lxc in Data Engineering

Modifying size of /var/lib/lxc

Re: Modifying size of /var/lib/lxc

Re: Modifying size of /var/lib/lxc