Disk usage increase on download server / mirrors

[Baptiste Jonglez]

On 21-07-19, Jo-Philipp Wich wrote:
> Hi Baptiste,
> 
> I agree that we should start purging the oldest kmod archives. I'd
> propose dropping a kmod archive directory whenever it exceeds the age of
> 6 months.

This looks like a good idea.

To expand one my previous email, here are some numbers for snapshots:

- current total space (targets + packages): 208.0 GiB
- cleaning up kmods from > 6 months ago: 144.1 GiB
- cleaning up kmods from > 3 months ago: 120.0 GiB
- cleaning up kmods from > 1 month  ago: 95.7 GiB

So, snapshot kmods are responsible for about +10 GB of storage each month.

And for releases (18.06-SNAPSHOT and 19.07-SNAPSHOT):

- current total space (targets + packages): 682.9 GiB
- cleaning up kmods from > 6 months ago: 610.3 GiB
- cleaning up kmods from > 1 months ago: 597.4 GiB

If we clean up [snapshot kmods > 6 months] and [stable snapshots kmods > 1 months],
we gain 150 GB.

Here is what I used on a mirror to test:

  $ find snapshots/targets/ -type d -wholename '*/kmods/*' -ctime +180 -exec rm -r '{}' \;
  $ find releases/*SNAPSHOT -type d -wholename '*/kmods/*' -ctime +30 -exec rm -r '{}' \;

Thanks,
Baptiste
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 833 bytes
Desc: not available
URL: <http://lists.openwrt.org/pipermail/openwrt-adm/attachments/20201125/34cd0a70/attachment.sig>