State of OpenWrt wiki and alternatives

[Jonas Gorski]

Hi,

On Tue, Feb 18, 2025 at 9:52 PM Paul D <newtwen at gmail.com> wrote:
>
> On 2025-02-17 06:37, Paul Spooren wrote:
> > Hi all,
> >
> > I’m writing here since the topic is not only administratively but concerns developers, too.
> >
> > Historically openwrt.org was managed by two kind administrators which (to my knowledge) moved on to other things. The website is based on DokuWiki and is now in a semi ideal state, a bunch of AI scraper bots slowing it down further. Some new admins stepped up and help to maintain things (i.e. blocking bots), however things are not great.
> >
> > Again historically, the wiki kept track of packages[1] and devices[2] with the help of rather complex shell scripts, now outdated but a feast for scrapping bots. At some point in the past, Jo and me converted the table of hardware (aka supported devices) into a JavaScript generated overview, massively lowering the load on the website. Nonetheless, if you look hard enough[3], there are still many linked pages using the legacy system and thereby overloading the server. While writing this email, I realize that all “package” views[4] are legacy and again, very heavy on the server.
> >
> > I’m suggesting the following immediate changes which will take some time/effort but hopefully result in something with low maintenance in the future:
> >
> > * Remove all “packages” form the Wiki, this results in endless amounts of outdated pages, last pages are for 21.02 which is EOL
> > * Spin up some scripts which parses the “newly” introduced index.json file[5] and render a static page every 24 hours, adopt what Alpine does[6], something I tested last year[7] or offer a format supported by Repology[12] and let them do the rendering
> > * Drop all “table of hardware” views, deploy and link the much better overview from @soif[8]
> >
> > These steps should remove the endless clobber of pages likely no human actually uses due to endless loading times. If there are no voices against these steps, I’d setup toh.openwrt.org and change.
> >
> > If we feel fancy, we could move on to a more modern appearance overall. We could render devices pages like LineageOS does, I did some adoption loooong time ago[9]. Combined with the work of @soif this could become quite handy. Feeling even fancies, we could move to a more modern wiki software[10] or have technical documentation rendered[11] based on a Git repository.
> >
> > Looking forward to your thoughts.
> >
> Good initiative. Q: is a CAPTCHA a workable solution for the bots? Would rather have performant wiki and occasional CAPTCHA than molasses.

LLMs are quite good at solving CAPTCHAs (sometimes even better than
actual humans), and from an accessibility standpoint CAPTCHAs can be
quite exclusionary. I know that we have users that would be affected
by this. So this might hurt us more than them.

Best Regards,
Jonas