Buildbot stuck? No new packages builds since Tuesday 22nd

[Hannu Nyman]

Hi,
Looks like the workers have got stuck again. All fsf-dock workers. Only 
the two different workers that were just started are still alive.

The same seems to concern also the 21.02 packages buildbot. All fsf-dock 
workers seem stuck.

Hannu

Ps. the 21.02 buildbot looks severely under-resourced compared to the 
half-dormant 19.07 branch. I would think that the current RC release 
should already have the priority for build resources.




On 2021-06-26 13:59, Hauke Mehrtens wrote:
> On 6/26/21 10:15 AM, Hannu Nyman wrote:
>> Looks like the packages buildbot is somehow stuck. No new builds has 
>> been uploaded since Tuesday 22nd.
>> https://downloads.openwrt.org/snapshots/packages/
>> 
>> Buildbot status shows only janitor activity for the last four days.
>> https://buildbot.openwrt.org/master/packages/#/waterfall
> 
> Hi Hannu,
> 
> Thanks for reporting this problem, Baptiste fixed it by restarting the
> build bots.
> 
> Hauke
> 
> 
> zorun | there are connection failures in the log on 22/06, and then
>         regulary since then: [Broker (TLSMemoryBIOProtocol),client]
>         Master replied to keepalive, everything's fine
> zorun | so the workers are connected to the master and are waiting for 
> a
>         job, but the master doesn't send anything
> zorun | it looks like a synchronisation bug in buildbot :/
> zorun | ynezz: if you want to have a look, I have left fsf-dock-24 in
>         this "stuck" state
> zorun | I have restarted all other workers and they are now building