ustream-ssl build error (mbedtls)

Koen Vandeputte koen.vandeputte at citymesh.com
Wed Sep 10 04:25:50 PDT 2025 

HI All,

After encoutering following issue a lot of times in the past year, I
was finally able to get a log of it.
It only happens in 2% of all builds when using a massive amount of
cores on a full openwrt build (>=32 cores)

Simply doing a clean and full rebuild fixes/avoids the issue in 95% of
the tries.

Does anyone have any idea how to properly fix this one?

Thanks!


make[2]: Entering directory
'/home/koen/firmware/builds/generic_dr40x9/scripts/config'
make[2]: 'conf' is up to date.
make[2]: Leaving directory
'/home/koen/firmware/builds/generic_dr40x9/scripts/config'
make[1]: Entering directory '/home/koen/firmware/builds/generic_dr40x9'
make[2]: Entering directory
'/home/koen/firmware/builds/generic_dr40x9/package/libs/ustream-ssl'
rm -rf /home/koen/firmware/builds/generic_dr40x9/build_dir/target-arm_cortex-a7+neon-vfpv4_musl_eabi/ustream-ssl-mbedtls/ustream-ssl-2024.07.28~99bd3d2b
rm -f /home/koen/firmware/builds/generic_dr40x9/staging_dir/target-arm_cortex-a7+neon-vfpv4_musl_eabi/stamp/.ustream-ssl.mbedtls_installed
rm -f /home/koen/firmware/builds/generic_dr40x9/staging_dir/target-arm_cortex-a7+neon-vfpv4_musl_eabi/packages/ustream-ssl.mbedtls.list
make[2]: Leaving directory
'/home/koen/firmware/builds/generic_dr40x9/package/libs/ustream-ssl'
time: package/libs/ustream-ssl/mbedtls/clean#0.06#0.02#0.08
make[1]: Leaving directory '/home/koen/firmware/builds/generic_dr40x9'
make[2]: Entering directory
'/home/koen/firmware/builds/generic_dr40x9/scripts/config'
make[2]: 'conf' is up to date.
make[2]: Leaving directory
'/home/koen/firmware/builds/generic_dr40x9/scripts/config'
make[1]: Entering directory '/home/koen/firmware/builds/generic_dr40x9'
mkdir -p /home/koen/firmware/builds/generic_dr40x9/build_dir/target-arm_cortex-a7+neon-vfpv4_musl_eabi/stamp
touch /home/koen/firmware/builds/generic_dr40x9/staging_dir/target-arm_cortex-a7+neon-vfpv4_musl_eabi/.prepared
make[2]: Entering directory
'/home/koen/firmware/builds/generic_dr40x9/package/libs/toolchain'
echo "libc" >> /home/koen/firmware/builds/generic_dr40x9/staging_dir/target-arm_cortex-a7+neon-vfpv4_musl_eabi/pkginfo/toolchain.default.install
echo "libgcc" >>
/home/koen/firmware/builds/generic_dr40x9/staging_dir/target-arm_cortex-a7+neon-vfpv4_musl_eabi/pkginfo/toolchain.default.install
echo "libatomic" >>
/home/koen/firmware/builds/generic_dr40x9/staging_dir/target-arm_cortex-a7+neon-vfpv4_musl_eabi/pkginfo/toolchain.default.install
echo "libstdcpp" >>
/home/koen/firmware/builds/generic_dr40x9/staging_dir/target-arm_cortex-a7+neon-vfpv4_musl_eabi/pkginfo/toolchain.default.install
echo "libpthread" >>
/home/koen/firmware/builds/generic_dr40x9/staging_dir/target-arm_cortex-a7+neon-vfpv4_musl_eabi/pkginfo/toolchain.default.install
echo "librt" >>
/home/koen/firmware/builds/generic_dr40x9/staging_dir/target-arm_cortex-a7+neon-vfpv4_musl_eabi/pkginfo/toolchain.default.install
make[2]: Leaving directory
'/home/koen/firmware/builds/generic_dr40x9/package/libs/toolchain'
time: package/libs/toolchain/compile#0.05#0.02#0.07
make[2]: Entering directory
'/home/koen/firmware/builds/generic_dr40x9/package/libs/libjson-c'
echo "libjson-c" >>
/home/koen/firmware/builds/generic_dr40x9/staging_dir/target-arm_cortex-a7+neon-vfpv4_musl_eabi/pkginfo/libjson-c.default.install
make[2]: Leaving directory
'/home/koen/firmware/builds/generic_dr40x9/package/libs/libjson-c'
time: package/libs/libjson-c/compile#0.08#0.03#0.10
make[2]: Entering directory
'/home/koen/firmware/builds/generic_dr40x9/package/utils/lua'
make[2]: Leaving directory
'/home/koen/firmware/builds/generic_dr40x9/package/utils/lua'
time: package/utils/lua/compile#0.09#0.03#0.12
make[2]: Entering directory
'/home/koen/firmware/builds/generic_dr40x9/package/libs/libubox'
echo "libubox" >>
/home/koen/firmware/builds/generic_dr40x9/staging_dir/target-arm_cortex-a7+neon-vfpv4_musl_eabi/pkginfo/libubox.default.install
echo "libblobmsg-json" >>
/home/koen/firmware/builds/generic_dr40x9/staging_dir/target-arm_cortex-a7+neon-vfpv4_musl_eabi/pkginfo/libubox.default.install
echo "jshn" >> /home/koen/firmware/builds/generic_dr40x9/staging_dir/target-arm_cortex-a7+neon-vfpv4_musl_eabi/pkginfo/libubox.default.install
echo "libjson-script" >>
/home/koen/firmware/builds/generic_dr40x9/staging_dir/target-arm_cortex-a7+neon-vfpv4_musl_eabi/pkginfo/libubox.default.install
make[2]: Leaving directory
'/home/koen/firmware/builds/generic_dr40x9/package/libs/libubox'
time: package/libs/libubox/compile#0.07#0.02#0.09
make[2]: Entering directory
'/home/koen/firmware/builds/generic_dr40x9/package/libs/ustream-ssl'
touch /home/koen/firmware/builds/generic_dr40x9/build_dir/target-arm_cortex-a7+neon-vfpv4_musl_eabi/ustream-ssl-mbedtls/ustream-ssl-2024.07.28~99bd3d2b/.prepared_3297593354519463e216066bfe5a845b_6664517399ebbbc92a37c5bb081b5c53_check
. /home/koen/firmware/builds/generic_dr40x9/include/shell.sh; zstdcat
/home/koen/firmware/builds/generic_dr40x9/dl/ustream-ssl-2024.07.28~99bd3d2b.tar.zst
| tar -C /home/koen/firmware/builds/generic_dr40x9/build_dir/target-arm_cortex-a7+neon-vfpv4_musl_eabi/ustream-ssl-mbedtls/ustream-ssl-2024.07.28~99bd3d2b/..
-xf -
[ ! -d ./src/ ] || cp -fpR ./src/.
/home/koen/firmware/builds/generic_dr40x9/build_dir/target-arm_cortex-a7+neon-vfpv4_musl_eabi/ustream-ssl-mbedtls/ustream-ssl-2024.07.28~99bd3d2b
touch /home/koen/firmware/builds/generic_dr40x9/build_dir/target-arm_cortex-a7+neon-vfpv4_musl_eabi/ustream-ssl-mbedtls/ustream-ssl-2024.07.28~99bd3d2b/.prepared_3297593354519463e216066bfe5a845b_6664517399ebbbc92a37c5bb081b5c53
rm -f /home/koen/firmware/builds/generic_dr40x9/build_dir/target-arm_cortex-a7+neon-vfpv4_musl_eabi/ustream-ssl-mbedtls/ustream-ssl-2024.07.28~99bd3d2b/.configured_*
rm -f /home/koen/firmware/builds/generic_dr40x9/staging_dir/target-arm_cortex-a7+neon-vfpv4_musl_eabi/stamp/.ustream-ssl.mbedtls_installed
mkdir -p /home/koen/firmware/builds/generic_dr40x9/build_dir/target-arm_cortex-a7+neon-vfpv4_musl_eabi/ustream-ssl-mbedtls/ustream-ssl-2024.07.28~99bd3d2b
(cd /home/koen/firmware/builds/generic_dr40x9/build_dir/target-arm_cortex-a7+neon-vfpv4_musl_eabi/ustream-ssl-mbedtls/ustream-ssl-2024.07.28~99bd3d2b;
CFLAGS="-O2 -pipe -fno-caller-saves -fno-plt -fhonour-copts
-mfloat-abi=hard
-fmacro-prefix-map=/home/koen/firmware/builds/generic_dr40x9/build_dir/target-arm_cortex-a7+neon-vfpv4_musl_eabi/ustream-ssl-mbedtls/ustream-ssl-2024.07.28~99bd3d2b=ustream-ssl-2024.07.28~99bd3d2b
-ffunction-sections -fdata-sections -Wformat -Werror=format-security
-fstack-protector -D_FORTIFY_SOURCE=1 -Wl,-z,now -Wl,-z,relro "
CXXFLAGS="-O2 -pipe -fno-caller-saves -fno-plt -fhonour-copts
-mfloat-abi=hard
-fmacro-prefix-map=/home/koen/firmware/builds/generic_dr40x9/build_dir/target-arm_cortex-a7+neon-vfpv4_musl_eabi/ustream-ssl-mbedtls/ustream-ssl-2024.07.28~99bd3d2b=ustream-ssl-2024.07.28~99bd3d2b
-ffunction-sections -fdata-sections -Wformat -Werror=format-security
-fstack-protector -D_FORTIFY_SOURCE=1 -Wl,-z,now -Wl,-z,relro
-ffunction-sections -fdata-sections "
LDFLAGS="-L/home/koen/firmware/builds/generic_dr40x9/staging_dir/toolchain-arm_cortex-a7+neon-vfpv4_gcc-14.3.0_musl_eabi/usr/lib
-L/home/koen/firmware/builds/generic_dr40x9/staging_dir/toolchain-arm_cortex-a7+neon-vfpv4_gcc-14.3.0_musl_eabi/lib
-fuse-ld=bfd -Wl,--gc-sections -znow -zrelro " cmake
--no-warn-unused-cli -DCMAKE_SYSTEM_NAME=Linux
-DCMAKE_SYSTEM_VERSION=1 -DCMAKE_SYSTEM_PROCESSOR=arm
-DCMAKE_BUILD_TYPE=Release -DCMAKE_C_FLAGS_RELEASE="-DNDEBUG"
-DCMAKE_CXX_FLAGS_RELEASE="-DNDEBUG"
-DCMAKE_C_COMPILER_LAUNCHER="/home/koen/firmware/builds/generic_dr40x9/staging_dir/host/bin/ccache"
-DCMAKE_C_COMPILER="arm-openwrt-linux-muslgnueabi-gcc"
-DCMAKE_CXX_COMPILER_LAUNCHER="/home/koen/firmware/builds/generic_dr40x9/staging_dir/host/bin/ccache"
-DCMAKE_CXX_COMPILER="arm-openwrt-linux-muslgnueabi-g++"
-DCMAKE_ASM_COMPILER_LAUNCHER="/home/koen/firmware/builds/generic_dr40x9/staging_dir/host/bin/ccache"
-DCMAKE_ASM_COMPILER="arm-openwrt-linux-muslgnueabi-gcc"
-DCMAKE_EXE_LINKER_FLAGS:STRING="-L/home/koen/firmware/builds/generic_dr40x9/staging_dir/toolchain-arm_cortex-a7+neon-vfpv4_gcc-14.3.0_musl_eabi/usr/lib
-L/home/koen/firmware/builds/generic_dr40x9/staging_dir/toolchain-arm_cortex-a7+neon-vfpv4_gcc-14.3.0_musl_eabi/lib
-fuse-ld=bfd -Wl,--gc-sections -znow -zrelro"
-DCMAKE_MODULE_LINKER_FLAGS:STRING="-L/home/koen/firmware/builds/generic_dr40x9/staging_dir/toolchain-arm_cortex-a7+neon-vfpv4_gcc-14.3.0_musl_eabi/usr/lib
-L/home/koen/firmware/builds/generic_dr40x9/staging_dir/toolchain-arm_cortex-a7+neon-vfpv4_gcc-14.3.0_musl_eabi/lib
-fuse-ld=bfd -Wl,--gc-sections -znow -zrelro -Wl,-Bsymbolic-functions"
-DCMAKE_SHARED_LINKER_FLAGS:STRING="-L/home/koen/firmware/builds/generic_dr40x9/staging_dir/toolchain-arm_cortex-a7+neon-vfpv4_gcc-14.3.0_musl_eabi/usr/lib
-L/home/koen/firmware/builds/generic_dr40x9/staging_dir/toolchain-arm_cortex-a7+neon-vfpv4_gcc-14.3.0_musl_eabi/lib
-fuse-ld=bfd -Wl,--gc-sections -znow -zrelro -Wl,-Bsymbolic-functions"
-DCMAKE_AR="/home/koen/firmware/builds/generic_dr40x9/staging_dir/toolchain-arm_cortex-a7+neon-vfpv4_gcc-14.3.0_musl_eabi/bin/arm-openwrt-linux-muslgnueabi-gcc-ar"
-DCMAKE_NM="/home/koen/firmware/builds/generic_dr40x9/staging_dir/toolchain-arm_cortex-a7+neon-vfpv4_gcc-14.3.0_musl_eabi/bin/arm-openwrt-linux-muslgnueabi-gcc-nm"
-DCMAKE_RANLIB="/home/koen/firmware/builds/generic_dr40x9/staging_dir/toolchain-arm_cortex-a7+neon-vfpv4_gcc-14.3.0_musl_eabi/bin/arm-openwrt-linux-muslgnueabi-gcc-ranlib"
-DCMAKE_FIND_ROOT_PATH="/home/koen/firmware/builds/generic_dr40x9/staging_dir/target-arm_cortex-a7+neon-vfpv4_musl_eabi/usr;/home/koen/firmware/builds/generic_dr40x9/staging_dir/toolchain-arm_cortex-a7+neon-vfpv4_gcc-14.3.0_musl_eabi"
-DCMAKE_FIND_ROOT_PATH_MODE_PROGRAM=BOTH
-DCMAKE_FIND_ROOT_PATH_MODE_LIBRARY=ONLY
-DCMAKE_FIND_ROOT_PATH_MODE_INCLUDE=ONLY -DCMAKE_STRIP=:
-DCMAKE_INSTALL_PREFIX=/usr
-DDL_LIBRARY=/home/koen/firmware/builds/generic_dr40x9/staging_dir/target-arm_cortex-a7+neon-vfpv4_musl_eabi
-DCMAKE_PREFIX_PATH=/home/koen/firmware/builds/generic_dr40x9/staging_dir/target-arm_cortex-a7+neon-vfpv4_musl_eabi
-DCMAKE_SKIP_RPATH=TRUE -DCMAKE_EXPORT_PACKAGE_REGISTRY=FALSE
-DCMAKE_EXPORT_NO_PACKAGE_REGISTRY=TRUE
-DCMAKE_FIND_USE_PACKAGE_REGISTRY=FALSE
-DCMAKE_FIND_PACKAGE_NO_PACKAGE_REGISTRY=TRUE
-DCMAKE_FIND_USE_SYSTEM_PACKAGE_REGISTRY=FALSE
-DCMAKE_FIND_PACKAGE_NO_SYSTEM_PACKAGE_REGISTRY=TRUE
-DCMAKE_GENERATOR="Ninja" -DMBEDTLS=on
/home/koen/firmware/builds/generic_dr40x9/build_dir/target-arm_cortex-a7+neon-vfpv4_musl_eabi/ustream-ssl-mbedtls/ustream-ssl-2024.07.28~99bd3d2b
)
CMake Deprecation Warning at CMakeLists.txt:1 (cmake_minimum_required):
  Compatibility with CMake < 3.10 will be removed from a future version of
  CMake.

  Update the VERSION argument <min> value.  Or, use the <min>...<max> syntax
  to tell CMake that the project requires at least <min> but has been updated
  to work with policies introduced by <max> or earlier.

Not searching for unused variables given on the command line.

-- The C compiler identification is GNU 14.3.0
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working C compiler:
/home/koen/firmware/builds/generic_dr40x9/staging_dir/toolchain-arm_cortex-a7+neon-vfpv4_gcc-14.3.0_musl_eabi/bin/arm-openwrt-linux-muslgnueabi-gcc
- skipped
-- Detecting C compile features
-- Detecting C compile features - done
-- Configuring done (0.1s)
CMake Error: The following variables are used in this project, but
they are set to NOTFOUND.
Please set them or make sure they are set and tested correctly in the
CMake files:
mbedcrypto_library
    linked by target "ustream-ssl" in directory
/home/koen/firmware/builds/generic_dr40x9/build_dir/target-arm_cortex-a7+neon-vfpv4_musl_eabi/ustream-ssl-mbedtls/ustream-ssl-2024.07.28~99bd3d2b
mbedtls_library
    linked by target "ustream-ssl" in directory
/home/koen/firmware/builds/generic_dr40x9/build_dir/target-arm_cortex-a7+neon-vfpv4_musl_eabi/ustream-ssl-mbedtls/ustream-ssl-2024.07.28~99bd3d2b
mbedx509_library
    linked by target "ustream-ssl" in directory
/home/koen/firmware/builds/generic_dr40x9/build_dir/target-arm_cortex-a7+neon-vfpv4_musl_eabi/ustream-ssl-mbedtls/ustream-ssl-2024.07.28~99bd3d2b

-- Generating done (0.0s)
CMake Generate step failed.  Build files cannot be regenerated correctly.
make[2]: *** [Makefile:75:
/home/koen/firmware/builds/generic_dr40x9/build_dir/target-arm_cortex-a7+neon-vfpv4_musl_eabi/ustream-ssl-mbedtls/ustream-ssl-2024.07.28~99bd3d2b/.configured_68b329da9893e34099c7d8ad5cb9c940]
Error 1
make[2]: Leaving directory
'/home/koen/firmware/builds/generic_dr40x9/package/libs/ustream-ssl'
time: package/libs/ustream-ssl/mbedtls/compile#0.11#0.04#0.14
    ERROR: package/libs/ustream-ssl failed to build (build variant: mbedtls).
make[1]: Leaving directory '/home/koen/firmware/builds/generic_dr40x9'

More information about the openwrt-devel mailing list