[FS#3537] ramips-mt7621: rcu_sched self-detected stall on CPU

OpenWrt Bugs openwrt-bugs at lists.openwrt.org
Thu Feb 25 14:16:47 EST 2021


THIS IS AN AUTOMATED MESSAGE, DO NOT REPLY.

The following task has a new comment added:

FS#3537 - ramips-mt7621: rcu_sched self-detected stall on CPU
User who did this - P (pijetja)

----------
Same problem on:Model
Xiaomi Mi Router 3G
MediaTek MT7621 ver:1 eco:3
OpenWrt 19.07-SNAPSHOT r11312-e9c0c5021c / LuCI openwrt-19.07 branch git-21.050.37945-c33df8f
Kernel:
4.14.221
I have to disable hw_nat
Tue Feb  9 15:22:25 2021 kern.err kernel: [207215.882941] INFO: rcu_sched self-detected stall on CPU
Tue Feb  9 15:22:25 2021 kern.err kernel: [207215.888318]     3-...: (1 GPs behind) idle=266/140000000000001/0 softirq=11508153/11508154 fqs=3000
Tue Feb  9 15:22:25 2021 kern.err kernel: [207215.897284]      (t=6001 jiffies g=5024083 c=5024082 q=1517)
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207215.902861] NMI backtrace for cpu 3
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207215.906463] CPU: 3 PID: 26575 Comm: kworker/3:0 Not tainted 4.14.216 #0
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207215.913189] Workqueue: events_power_efficient 0x8e700cac [nf_flow_table at 8e700000+0x3370]
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207215.921331] Stack : 00000000 00000000 804d8568 8fc0fd24 00000000 00000000 00000000 00000000
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207215.929767]         00000000 00000000 00000000 00000000 00000000 00000001 8fc0fce0 1cc28238
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207215.938201]         8fc0fd78 00000000 00000000 000085a0 00000038 8049e238 00000008 00000000
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207215.946635]         00000000 80550000 000def25 61745f77 8fc0fcc0 00000000 00000000 00000003
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207215.955070]         80554500 8054c0cc 000000e0 80550000 00000000 802ae5d0 0000000c 806b000c
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207215.963505]         ...
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207215.966031] Call Trace:
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207215.966128] [] 0x8049e238
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207215.972220] [] 0x802ae5d0
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207215.975796] [] 0x8000c1a0
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207215.979358] [] 0x8000c1a8
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207215.982919] [] 0x80487074
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207215.986480] [] 0x80072ce4
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207215.990041] [] 0x8048e094
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207215.993602] [] 0x80008f30
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207215.997165] [] 0x80008f30
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.000725] [] 0x8048e180
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.004288] [] 0x80086678
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.007866] [] 0x80085ac8
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.011473] [] 0x8e700000 [nf_flow_table at 8e700000+0x3370]
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.017798] [] 0x80089238
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.021360] [] 0x8009a288
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.024922] [] 0x8025c330
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.028484] [] 0x80332b94
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.032045] [] 0x80077f64
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.035606] [] 0x800793b8
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.039167] [] 0x80078360
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.042730] [] 0x80073670
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.046292] [] 0x8025c118
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.049852] [] 0x8025bfc4
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.053416] [] 0x8025c184
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.056978] [] 0x80073670
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.060540] [] 0x804a4efc
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.064100] [] 0x8025b840
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.067675] [] 0x80007488
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.071233]
Tue Feb  9 15:22:25 2021 kern.err kernel: [207216.072816] INFO: rcu_sched detected stalls on CPUs/tasks:
Tue Feb  9 15:22:25 2021 kern.err kernel: [207216.078465]     3-...: (1 GPs behind) idle=266/140000000000000/0 softirq=11508153/11508154 fqs=3001
Tue Feb  9 15:22:25 2021 kern.err kernel: [207216.087434]     (detected by 2, t=6020 jiffies, g=5024083, c=5024082, q=1518)
Tue Feb  9 15:22:25 2021 kern.info kernel: [207216.094500] Sending NMI from CPU 2 to CPUs 3:
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.098978] NMI backtrace for cpu 3
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.102544] CPU: 3 PID: 26575 Comm: kworker/3:0 Not tainted 4.14.216 #0
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.109238] Workqueue: events_power_efficient 0x8e700cac [nf_flow_table at 8e700000+0x3370]
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.117383] task: 8fe69320 task.stack: 8d0f2000
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.121976] $ 0   : 00000000 00000001 00000000 00000000
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.127283] $ 4   : 00000006 00100000 013baeda 013baeda
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.132590] $ 8   : 0000ffff ffff0000 00000002 fffffffe
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.137896] $12   : 80553530 00000040 ffffffff 0000a5ce
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.143203] $16   : 8e6eb27c 81241320 8054c1e8 00100000
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.148511] $20   : 805ab344 8e6eb2fc 80550000 8056dba0
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.153818] $24   : 3b9aca00 00000000
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.159125] $28   : 8d0f2000 8d0f3dc8 8e700000 8006bf20
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.164433] Hi    : 00000133
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.167384] Lo    : 33333380
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.170338] epc   : 8006bfbc 0x8006bfbc
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.174244] ra    : 8006bf20 0x8006bf20
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.178146] Status: 11007c03    KERNEL EXL IE
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.182413] Cause : 50800400 (ExcCode 00)
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.186491] PrId  : 0001992f (MIPS 1004Kc)
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.190659] CPU: 3 PID: 26575 Comm: kworker/3:0 Not tainted 4.14.216 #0
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.197340] Workqueue: events_power_efficient 0x8e700cac [nf_flow_table at 8e700000+0x3370]
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.205481] Stack : 00000000 00000000 804d8568 8fc0fd64 00000000 00000000 00000000 00000000
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.213916]         00000000 00000000 00000000 00000000 00000000 00000001 8fc0fd20 1cc28238
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.222350]         8fc0fdb8 00000000 00000000 00009270 00000038 8049e238 00000008 00000000
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.230785]         00000000 80550000 000302dc 61745f77 8fc0fd00 00000000 00000000 00000003
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.239220]         804dfe64 8053f5a0 804dda54 80550000 00000000 802ae5d0 0000000c 806b000c
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.247655]         ...
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.250181] Call Trace:
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.250246] [] 0x8049e238
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.256338] [] 0x802ae5d0
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.259913] [] 0x8000c1a0
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.263474] [] 0x8000c1a8
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.267034] [] 0x80487074
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.270608] [] 0x8000c264
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.274169] [] 0x8048e074
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.277731] [] 0x80009044
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.281290] [] 0x80009054
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.284864] [] 0x80059f5c
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.288423] [] 0x800a1860
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.291983] [] 0x80085f80
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.295559] [] 0x80011860
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.299146] [] 0x8e700000 [nf_flow_table at 8e700000+0x3370]
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.305471] [] 0x80074210
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.309072] [] 0x8e700000 [nf_flow_table at 8e700000+0x3370]
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.315397] [] 0x80074344
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.318959] [] 0x800743e8
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.322518] [] 0x80332b94
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.326078] [] 0x80077f64
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.329638] [] 0x800785a0
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.333198] [] 0x80078360
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.336771] [] 0x80073670
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.340331] [] 0x80073670
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.343892] [] 0x8025c118
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.347451] [] 0x8025bfc4
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.351013] [] 0x8025c184
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.354574] [] 0x80073670
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.358135] [] 0x804a4efc
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.361696] [] 0x8025b840
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.365271] [] 0x80007488
Tue Feb  9 15:22:25 2021 kern.warn kernel: [207216.368828]
Tue Feb  9 15:25:38 2021 kern.err kernel: [207395.931367] INFO: rcu_sched self-detected stall on CPU
Tue Feb  9 15:25:38 2021 kern.err kernel: [207395.936732]     3-...: (1 GPs behind) idle=266/140000000000001/0 softirq=11508153/11508154 fqs=10519
Tue Feb  9 15:25:38 2021 kern.err kernel: [207395.945785]      (t=24006 jiffies g=5024083 c=5024082 q=6524)
Tue Feb  9 15:25:38 2021 kern.err kernel: [207395.951353] INFO: rcu_sched detected stalls on CPUs/tasks:
Tue Feb  9 15:25:38 2021 kern.err kernel: [207395.951428] rcu_sched kthread starved for 2925 jiffies! g5024083 c5024082 f0x0 RCU_GP_WAIT_FQS(3) ->state=0x402 ->cpu=1
Tue Feb  9 15:25:38 2021 kern.err kernel: [207395.951453]     3-...: (1 GPs behind) idle=266/140000000000001/0 softirq=11508153/11508154 fqs=10519
Tue Feb  9 15:25:38 2021 kern.info kernel: [207395.956980] rcu_sched       I
Tue Feb  9 15:25:38 2021 kern.err kernel: [207395.967788]
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207395.976789]     0     8      2 0x00100000
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207395.979823] (detected by 2, t=24009 jiffies, g=5024083, c=5024082, q=6524)
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207395.981464] Stack :
Tue Feb  9 15:25:38 2021 kern.info kernel: [207395.985542] Sending NMI from CPU 2 to CPUs 3:
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207395.992455]  8fc57e38 8fc3aca0 8fc57e38 8fc57e38 8fc57e38 80550000 81223380 00000000
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207396.006855]         81240da0 80052c28 013bf60b 81223380 8fc57e38 80550000 81223380 00000000
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207396.015291]         00000003 8054c1e8 80554610 804a05b8 8fc57e38 80550000 80550000 00000000
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207396.023728]         00000003 804a3dd0 80550000 00000000 8fc57ebc 800682b8 00000000 00000001
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207396.032164]         00000000 81223408 013bf60b 800887c0 8fc3aca0 03000001 80554500 00000000
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207396.040601]         ...
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207396.043128] Call Trace:
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207396.043252] [] 0x80052c28
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207396.049341] [] 0x804a05b8
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207396.052915] [] 0x804a3dd0
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207396.056488] [] 0x800682b8
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207396.060051] [] 0x800887c0
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207396.063626] [] 0x80084ce4
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207396.067214] [] 0x80080000
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207396.070775] [] 0x80081d2c
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207396.074403] [] 0x80084784
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207396.077963] [] 0x8004c108
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207396.081523] [] 0x8004bfd8
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207396.085108] [] 0x8004bfd8
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207396.088694] [] 0x8004bfd8
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207396.092255] [] 0x80006f78
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207396.095828]
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207399.542994] NMI backtrace for cpu 3
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207399.546644] CPU: 3 PID: 26575 Comm: kworker/3:0 Not tainted 4.14.216 #0
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207399.553461] Workqueue: events_power_efficient 0x8e700cac [nf_flow_table at 8e700000+0x3370]
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207399.561676] Stack : 00000000 00000000 804d8568 8fc0fd24 00000000 00000000 00000000 00000000
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207399.570319]         00000000 00000000 00000000 00000000 00000000 00000001 8fc0fce0 1cc28238
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207399.578961]         8fc0fd78 00000000 00000000 0000a208 00000038 8049e238 00000008 00000000
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207399.587605]         00000000 80550000 000871f5 61745f77 8fc0fcc0 00000000 00000000 00000003
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207399.596251]         80554500 8054c0cc 000000e0 80550000 00000000 802ae5d0 0000000c 806b000c
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207399.604900]         ...
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207399.607499] Call Trace:
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207399.607761] [] 0x8049e238
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207399.614019] [] 0x802ae5d0
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207399.617715] [] 0x8000c1a0
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207399.621351] [] 0x8000c1a8
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207399.624982] [] 0x80487074
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207399.628611] [] 0x80072ce4
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207399.632250] [] 0x8048e094
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207399.635880] [] 0x80008f30
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207399.639577] [] 0x80008f30
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207399.643204] [] 0x8048e180
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207399.646832] [] 0x804a4b34
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207399.650471] [] 0x80086678
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207399.654100] [] 0x8008658c
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207399.657746] [] 0x80085ac8
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207399.661467] [] 0x8e700000 [nf_flow_table at 8e700000+0x3370]
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207399.668064] [] 0x8e700000 [nf_flow_table at 8e700000+0x3370]
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207399.674462] [] 0x80089238
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207399.678101] [] 0x8009a288
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207399.681737] [] 0x8025c330
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207399.685372] [] 0x80332b94
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207399.689001] [] 0x80077f64
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207399.692633] [] 0x800793b8
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207399.696261] [] 0x80078360
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207399.699904] [] 0x80073670
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207399.703536] [] 0x8025c118
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207399.707164] [] 0x8025bfc4
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207399.710807] [] 0x8025c184
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207399.714443] [] 0x80073670
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207399.718079] [] 0x804a4efc
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207399.721714] [] 0x8025b840
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207399.725413] [] 0x80007488
Tue Feb  9 15:25:38 2021 kern.warn kernel: [207399.729023]
Tue Feb  9 15:25:39 2021 kern.info kernel: [207400.640099] mtk_soc_eth 1e100000.ethernet eth0: port 3 link down
Tue Feb  9 15:25:47 2021 kern.info kernel: [207408.858280] mtk_soc_eth 1e100000.ethernet eth0: port 3 link up
Tue Feb  9 15:26:21 2021 daemon.notice hostapd: wlan1: AP-STA-DISCONNECTED bc:17:b8:34:93:ec

----------

More information can be found at the following URL:
https://bugs.openwrt.org/index.php?do=details&task_id=3537#comment9411

You are receiving this message because you have requested it from the Flyspray bugtracking system.  If you did not expect this message or don't want to receive mails in future, you can change your notification settings at the URL shown above.



More information about the openwrt-bugs mailing list