HomeDefectsLIN1023-3435
Fixed

LIN1023-3435 : Fetch problems for grpc in LTS23

Created: Jan 22, 2024    Updated: Nov 24, 2024
Resolved Date: Mar 17, 2024
Found In Version: 10.23.30.4
Fix Version: 10.23.30.8
Severity: Standard
Applicable for: Wind River Linux LTS 23
Component/s: Build & Config, Userspace

Description

Clone for LTS 23 as usual, then run setup and try to build:


$ ./wrlinux-x/setup.sh --machine qemux86-64 --distro wrlinux --dl-layers
$ . environment-setup-x86_64-wrlinuxsdk-linux
$ . oe-init-build-env


Add the following to the end of local.conf:


BB_NO_NETWORK = '0'
BB_ALLOWED_NETWORKS = "*.windriver.com"



$ bitbake nativesdk-grpc


You will get an error from the fetch stage:


WARNING: nativesdk-grpc-1.50.1-r0 do_fetch: Failed to fetch URL gitsm://github.com/protocolbuffers/protobuf.git;protocol=https;name=third_party/protobuf;subpath=third_party/protobuf;nobranch=1;bareclone=1;nobranch=1, attempting MIRRORS if available
ERROR: nativesdk-grpc-1.50.1-r0 do_fetch: The URL: 'gitsm://github.com/protocolbuffers/protobuf.git;protocol=https;name=third_party/protobuf;subpath=third_party/protobuf;nobranch=1;bareclone=1;nobranch=1' is not trusted and cannot be used
ERROR: nativesdk-grpc-1.50.1-r0 do_fetch: gitsm: submodule download failed: FetchError Fetcher failure for URL: 'gitsm://github.com/protocolbuffers/protobuf.git;protocol=https;name=third_party/protobuf;subpath=third_party/protobuf;nobranch=1;bareclone=1;nobranch=1'. Unable to fetch URL from any source.
WARNING: nativesdk-grpc-1.50.1-r0 do_fetch: Failed to fetch URL gitsm://github.com/google/bloaty.git;protocol=https;name=third_party/bloaty;subpath=third_party/bloaty;nobranch=1;bareclone=1;nobranch=1, attempting MIRRORS if available
ERROR: nativesdk-grpc-1.50.1-r0 do_fetch: The URL: 'gitsm://github.com/google/bloaty.git;protocol=https;name=third_party/bloaty;subpath=third_party/bloaty;nobranch=1;bareclone=1;nobranch=1' is not trusted and cannot be used
ERROR: nativesdk-grpc-1.50.1-r0 do_fetch: gitsm: submodule download failed: FetchError Fetcher failure for URL: 'gitsm://github.com/google/bloaty.git;protocol=https;name=third_party/bloaty;subpath=third_party/bloaty;nobranch=1;bareclone=1;nobranch=1'. Unable to fetch URL from any source.
WARNING: nativesdk-grpc-1.50.1-r0 do_fetch: Failed to fetch URL gitsm://github.com/grpc/grpc.git;protocol=https;name=grpc;branch=v1.50.x, attempting MIRRORS if available
ERROR: nativesdk-grpc-1.50.1-r0 do_fetch: The URL: 'gitsm://github.com/grpc/grpc.git;protocol=https;name=grpc;branch=v1.50.x' is not trusted and cannot be used
ERROR: nativesdk-grpc-1.50.1-r0 do_fetch: Bitbake Fetcher Error: FetchError('Unable to fetch URL from any source.', 'gitsm://github.com/grpc/grpc.git;protocol=https;name=grpc;branch=v1.50.x')
ERROR: Logfile of failure stored in: /work//netdl-test/build/tmp-glibc/work/x86_64-nativesdk-wrlinuxsdk-linux/nativesdk-grpc/1.50.1-r0/temp/log.do_fetch.1479328
ERROR: Task (virtual:nativesdk:/work/netdl-test/layers/meta-openembedded/meta-oe/recipes-devtools/grpc/grpc_1.50.1.bb:do_fetch) failed with exit code '1'
NOTE: Tasks Summary: Attempted 495 tasks of which 0 didn't need to be rerun and 1 failed.

Summary: 1 task failed:
  virtual:nativesdk:/work/netdl-test/layers/meta-openembedded/meta-oe/recipes-devtools/grpc/grpc_1.50.1.bb:do_fetch
Summary: There were 3 WARNING messages.
Summary: There were 6 ERROR messages, returning a non-zero exit code.



It seems that the package native-grpc is not possible to build when BB_ALLOWED_NETWORKS is enabled and used.
The gitsm in the SRC_URI in grpc seem to make it troublesome for the fetcher in this case.

BB_NO_NETWORK has to be disabled for BB_ALLOWED_NETWORKS to take effect.


Workaround

Add in local.conf the following lines:
BB_NO_NETWORK:pn-nativesdk-grpc = "1"
BB_NO_NETWORK:pn-grpc-native = "1"
BB_NO_NETWORK:pn-grpc = "1"

Steps to Reproduce

Clone for LTS 23 as usual, then run setup and try to build:


$ ./wrlinux-x/setup.sh --machine qemux86-64 --distro wrlinux --dl-layers
$ . environment-setup-x86_64-wrlinuxsdk-linux
$ . oe-init-build-env


Add the following to the end of local.conf:


BB_NO_NETWORK = '0'
BB_ALLOWED_NETWORKS = "*.windriver.com"



$ bitbake nativesdk-grpc


You will get an error from the fetch stage:


WARNING: nativesdk-grpc-1.50.1-r0 do_fetch: Failed to fetch URL gitsm://github.com/protocolbuffers/protobuf.git;protocol=https;name=third_party/protobuf;subpath=third_party/protobuf;nobranch=1;bareclone=1;nobranch=1, attempting MIRRORS if available
ERROR: nativesdk-grpc-1.50.1-r0 do_fetch: The URL: 'gitsm://github.com/protocolbuffers/protobuf.git;protocol=https;name=third_party/protobuf;subpath=third_party/protobuf;nobranch=1;bareclone=1;nobranch=1' is not trusted and cannot be used
ERROR: nativesdk-grpc-1.50.1-r0 do_fetch: gitsm: submodule download failed: FetchError Fetcher failure for URL: 'gitsm://github.com/protocolbuffers/protobuf.git;protocol=https;name=third_party/protobuf;subpath=third_party/protobuf;nobranch=1;bareclone=1;nobranch=1'. Unable to fetch URL from any source.
WARNING: nativesdk-grpc-1.50.1-r0 do_fetch: Failed to fetch URL gitsm://github.com/google/bloaty.git;protocol=https;name=third_party/bloaty;subpath=third_party/bloaty;nobranch=1;bareclone=1;nobranch=1, attempting MIRRORS if available
ERROR: nativesdk-grpc-1.50.1-r0 do_fetch: The URL: 'gitsm://github.com/google/bloaty.git;protocol=https;name=third_party/bloaty;subpath=third_party/bloaty;nobranch=1;bareclone=1;nobranch=1' is not trusted and cannot be used
ERROR: nativesdk-grpc-1.50.1-r0 do_fetch: gitsm: submodule download failed: FetchError Fetcher failure for URL: 'gitsm://github.com/google/bloaty.git;protocol=https;name=third_party/bloaty;subpath=third_party/bloaty;nobranch=1;bareclone=1;nobranch=1'. Unable to fetch URL from any source.
WARNING: nativesdk-grpc-1.50.1-r0 do_fetch: Failed to fetch URL gitsm://github.com/grpc/grpc.git;protocol=https;name=grpc;branch=v1.50.x, attempting MIRRORS if available
ERROR: nativesdk-grpc-1.50.1-r0 do_fetch: The URL: 'gitsm://github.com/grpc/grpc.git;protocol=https;name=grpc;branch=v1.50.x' is not trusted and cannot be used
ERROR: nativesdk-grpc-1.50.1-r0 do_fetch: Bitbake Fetcher Error: FetchError('Unable to fetch URL from any source.', 'gitsm://github.com/grpc/grpc.git;protocol=https;name=grpc;branch=v1.50.x')
ERROR: Logfile of failure stored in: /work//netdl-test/build/tmp-glibc/work/x86_64-nativesdk-wrlinuxsdk-linux/nativesdk-grpc/1.50.1-r0/temp/log.do_fetch.1479328
ERROR: Task (virtual:nativesdk:/work/netdl-test/layers/meta-openembedded/meta-oe/recipes-devtools/grpc/grpc_1.50.1.bb:do_fetch) failed with exit code '1'
NOTE: Tasks Summary: Attempted 495 tasks of which 0 didn't need to be rerun and 1 failed.

Summary: 1 task failed:
  virtual:nativesdk:/work/netdl-test/layers/meta-openembedded/meta-oe/recipes-devtools/grpc/grpc_1.50.1.bb:do_fetch
Summary: There were 3 WARNING messages.
Summary: There were 6 ERROR messages, returning a non-zero exit code.