[RFC] Refactoring OpenWrt's build infra

[Baptiste Jonglez]

On 16-10-22, Christian Marangi wrote:
> On Sun, Oct 16, 2022 at 02:07:05PM +0200, Baptiste Jonglez wrote:
> > - either buildbot can run latent workers with a different Docker image
> >   depending on the build
> 
> IMHO, this would be the safest and better solution to the problem. But
> this means that we will have to support 2 thing instead of having one
> centrilized container.

I'm not even sure Buildbot is able to do that :)

But if it is, and the only change between worker images is the version of
the base image (e.g. Debian), then that sounds manageable.

> Would be ideal to have one centrilized dl/ dir where each runner can go
> and take the file. We already support that in openwrt (to have a
> different dl dir) and there isn't any problem with having different
> release tar for the same package.

I had tried to share dl/ across several worker containers on the same
physical machine.  But there are race conditions that make it not so easy
to do.  I fixed one issue [1] but there was another that I couldn't track down.

We could use object storage, for instance from DigitalOcean [2].  It would
allow all workers to read/write to the same shared storage for download
files, and get (hopefully) good download performance.  With that in place,
we could also prune dl/ very aggressively to save disk space.

Baptiste

[1] https://git.openwrt.org/d4c957f24b2f76986378c6d9
[2] https://www.digitalocean.com/products/spaces
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 833 bytes
Desc: not available
URL: <http://lists.openwrt.org/pipermail/openwrt-devel/attachments/20221016/e55a3e7e/attachment.sig>