2024-08-22T20:28:02.2455557Z Current runner version: '2.319.1' 2024-08-22T20:28:02.2461718Z Runner name: 'i-043a091e27bd81c57' 2024-08-22T20:28:02.2462528Z Runner group name: 'Default' 2024-08-22T20:28:02.2463445Z Machine name: 'ip-10-0-56-93' 2024-08-22T20:28:02.2480013Z Testing runner upgrade compatibility 2024-08-22T20:28:02.3783633Z ##[group]GITHUB_TOKEN Permissions 2024-08-22T20:28:02.3785532Z Contents: read 2024-08-22T20:28:02.3786157Z Metadata: read 2024-08-22T20:28:02.3786698Z Packages: read 2024-08-22T20:28:02.3787167Z ##[endgroup] 2024-08-22T20:28:02.3790265Z Secret source: Actions 2024-08-22T20:28:02.3791117Z Prepare workflow directory 2024-08-22T20:28:02.9152002Z Prepare all required actions 2024-08-22T20:28:02.9327857Z Getting action download info 2024-08-22T20:28:03.0843508Z Download action repository 'actions/checkout@v3' (SHA:f43a0e5ff2bd294095638e18286ca9a3d1956744) 2024-08-22T20:28:03.3285922Z Download action repository 'actions/download-artifact@v3' (SHA:9bc31d5ccc31df68ecc42ccf4149144866c47d8a) 2024-08-22T20:28:03.4553308Z Download action repository 'pmeier/pytest-results-action@v0.3.0' (SHA:a2c1430e2bddadbad9f49a6f9b879f062c6b19b1) 2024-08-22T20:28:03.5728897Z Download action repository 'actions/upload-artifact@v3' (SHA:a8a3f3ad30e3422c9c7b888a15615d19a852ae32) 2024-08-22T20:28:03.7046049Z Download action repository 'seemethere/upload-artifact-s3@v5' (SHA:baba72d0712b404f646cebe0730933554ebce96a) 2024-08-22T20:28:03.9745868Z Uses: pytorch/test-infra/.github/workflows/linux_job.yml@refs/heads/main (6dab351bed7d1c647665a8b8e883ec5b1c973feb) 2024-08-22T20:28:03.9747982Z ##[group] Inputs 2024-08-22T20:28:03.9750305Z script: echo "::group::Print machine info" uname -a echo "::endgroup::" echo "::group::Install newer objcopy that supports --set-section-alignment" yum install -y devtoolset-10-binutils export PATH=/opt/rh/devtoolset-10/root/usr/bin/:$PATH echo "::endgroup::" TORCHCHAT_DEVICE=cpu .ci/scripts/run-docs evaluation echo "::group::Completion" echo "tests complete" echo "*******************************************" echo "::endgroup::" 2024-08-22T20:28:03.9753076Z timeout: 60 2024-08-22T20:28:03.9753481Z runner: linux.g5.4xlarge.nvidia.gpu 2024-08-22T20:28:03.9753996Z upload-artifact: 2024-08-22T20:28:03.9754500Z download-artifact: 2024-08-22T20:28:03.9754887Z repository: 2024-08-22T20:28:03.9755294Z fetch-depth: 1 2024-08-22T20:28:03.9755764Z submodules: 2024-08-22T20:28:03.9756101Z ref: 2024-08-22T20:28:03.9756583Z test-infra-repository: pytorch/test-infra 2024-08-22T20:28:03.9757185Z test-infra-ref: 2024-08-22T20:28:03.9757585Z docker-image: pytorch/conda-builder 2024-08-22T20:28:03.9758189Z docker-build-dir: .ci/docker 2024-08-22T20:28:03.9758701Z gpu-arch-type: cuda 2024-08-22T20:28:03.9759093Z gpu-arch-version: 12.1 2024-08-22T20:28:03.9759549Z job-name: linux-job 2024-08-22T20:28:03.9760361Z continue-on-error: false 2024-08-22T20:28:03.9760780Z binary-matrix: 2024-08-22T20:28:03.9761209Z run-with-docker: true 2024-08-22T20:28:03.9761713Z secrets-env: 2024-08-22T20:28:03.9762076Z no-sudo: false 2024-08-22T20:28:03.9762538Z ##[endgroup] 2024-08-22T20:28:03.9763263Z Complete job name: test-evaluation-cpu / linux-job 2024-08-22T20:28:04.0427191Z A job started hook has been configured by the self-hosted runner administrator 2024-08-22T20:28:04.0578478Z ##[group]Run '/home/ec2-user/runner-scripts/before_job.sh' 2024-08-22T20:28:04.0590680Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-22T20:28:04.0591287Z ##[endgroup] 2024-08-22T20:28:05.8562211Z Runner Type: linux.g5.4xlarge.nvidia.gpu 2024-08-22T20:28:05.8562767Z Instance Type: g5.4xlarge 2024-08-22T20:28:05.8563456Z AMI Name: al2023-ami-2023.5.20240701.0-kernel-6.1-x86_64 2024-08-22T20:28:05.8564000Z AMI ID: ami-06c68f701d8090592 2024-08-22T20:28:11.7966996Z ##[group]Run set -euxo pipefail 2024-08-22T20:28:11.7967511Z set -euxo pipefail 2024-08-22T20:28:11.7967950Z if [[ "${NO_SUDO}" == "false" ]]; then 2024-08-22T20:28:11.7968493Z  echo "::group::Cleanup with-sudo debug output" 2024-08-22T20:28:11.7969246Z  sudo rm -rfv "${GITHUB_WORKSPACE}" 2024-08-22T20:28:11.7969720Z else 2024-08-22T20:28:11.7970107Z  echo "::group::Cleanup no-sudo debug output" 2024-08-22T20:28:11.7970623Z  rm -rfv "${GITHUB_WORKSPACE}" 2024-08-22T20:28:11.7971041Z fi 2024-08-22T20:28:11.7971324Z  2024-08-22T20:28:11.7971635Z mkdir -p "${GITHUB_WORKSPACE}" 2024-08-22T20:28:11.7972066Z echo "::endgroup::" 2024-08-22T20:28:11.7982846Z shell: /usr/bin/bash -e {0} 2024-08-22T20:28:11.7983202Z env: 2024-08-22T20:28:11.7983531Z DOCKER_IMAGE: pytorch/conda-builder:cuda12.1 2024-08-22T20:28:11.7983994Z REPOSITORY: pytorch/torchchat 2024-08-22T20:28:11.7984391Z PR_NUMBER: 1044 2024-08-22T20:28:11.7986764Z SCRIPT: echo "::group::Print machine info" uname -a echo "::endgroup::" echo "::group::Install newer objcopy that supports --set-section-alignment" yum install -y devtoolset-10-binutils export PATH=/opt/rh/devtoolset-10/root/usr/bin/:$PATH echo "::endgroup::" TORCHCHAT_DEVICE=cpu .ci/scripts/run-docs evaluation echo "::group::Completion" echo "tests complete" echo "*******************************************" echo "::endgroup::" 2024-08-22T20:28:11.7989273Z NO_SUDO: false 2024-08-22T20:28:11.7989612Z ##[endgroup] 2024-08-22T20:28:11.8022278Z + [[ false == \f\a\l\s\e ]] 2024-08-22T20:28:11.8043067Z ##[group]Cleanup with-sudo debug output 2024-08-22T20:28:11.8052241Z + echo '::group::Cleanup with-sudo debug output' 2024-08-22T20:28:11.8052957Z + sudo rm -rfv /home/ec2-user/actions-runner/_work/torchchat/torchchat 2024-08-22T20:28:11.9399109Z removed directory '/home/ec2-user/actions-runner/_work/torchchat/torchchat' 2024-08-22T20:28:11.9421690Z + mkdir -p /home/ec2-user/actions-runner/_work/torchchat/torchchat 2024-08-22T20:28:11.9438999Z + echo ::endgroup:: 2024-08-22T20:28:11.9439816Z ##[endgroup] 2024-08-22T20:28:11.9552898Z ##[group]Run actions/checkout@v3 2024-08-22T20:28:11.9553308Z with: 2024-08-22T20:28:11.9553623Z repository: pytorch/test-infra 2024-08-22T20:28:11.9554009Z path: test-infra 2024-08-22T20:28:11.9554329Z submodules: recursive 2024-08-22T20:28:11.9554796Z token: *** 2024-08-22T20:28:11.9555106Z ssh-strict: true 2024-08-22T20:28:11.9555435Z persist-credentials: true 2024-08-22T20:28:11.9555781Z clean: true 2024-08-22T20:28:11.9556178Z sparse-checkout-cone-mode: true 2024-08-22T20:28:11.9556572Z fetch-depth: 1 2024-08-22T20:28:11.9556864Z fetch-tags: false 2024-08-22T20:28:11.9557168Z lfs: false 2024-08-22T20:28:11.9557467Z set-safe-directory: true 2024-08-22T20:28:11.9557795Z env: 2024-08-22T20:28:11.9558120Z DOCKER_IMAGE: pytorch/conda-builder:cuda12.1 2024-08-22T20:28:11.9558575Z REPOSITORY: pytorch/torchchat 2024-08-22T20:28:11.9558940Z PR_NUMBER: 1044 2024-08-22T20:28:11.9561065Z SCRIPT: echo "::group::Print machine info" uname -a echo "::endgroup::" echo "::group::Install newer objcopy that supports --set-section-alignment" yum install -y devtoolset-10-binutils export PATH=/opt/rh/devtoolset-10/root/usr/bin/:$PATH echo "::endgroup::" TORCHCHAT_DEVICE=cpu .ci/scripts/run-docs evaluation echo "::group::Completion" echo "tests complete" echo "*******************************************" echo "::endgroup::" 2024-08-22T20:28:11.9563237Z ##[endgroup] 2024-08-22T20:28:12.0611941Z Syncing repository: pytorch/test-infra 2024-08-22T20:28:12.0612805Z ##[group]Getting Git version info 2024-08-22T20:28:12.0613851Z Working directory is '/home/ec2-user/actions-runner/_work/torchchat/torchchat/test-infra' 2024-08-22T20:28:12.0615017Z [command]/usr/bin/git version 2024-08-22T20:28:12.0615492Z git version 2.40.1 2024-08-22T20:28:12.0617034Z ##[endgroup] 2024-08-22T20:28:12.0629855Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/6846967a-8d27-47b9-b0f4-4c90b03b2eb1' before making global git config changes 2024-08-22T20:28:12.0631281Z Adding repository directory to the temporary git global config as a safe directory 2024-08-22T20:28:12.0635134Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/torchchat/torchchat/test-infra 2024-08-22T20:28:12.0682051Z ##[group]Initializing the repository 2024-08-22T20:28:12.0685024Z [command]/usr/bin/git init /home/ec2-user/actions-runner/_work/torchchat/torchchat/test-infra 2024-08-22T20:28:12.0730010Z hint: Using 'master' as the name for the initial branch. This default branch name 2024-08-22T20:28:12.0731065Z hint: is subject to change. To configure the initial branch name to use in all 2024-08-22T20:28:12.0731865Z hint: of your new repositories, which will suppress this warning, call: 2024-08-22T20:28:12.0732425Z hint: 2024-08-22T20:28:12.0732901Z hint: git config --global init.defaultBranch 2024-08-22T20:28:12.0733371Z hint: 2024-08-22T20:28:12.0733890Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-08-22T20:28:12.0735139Z hint: 'development'. The just-created branch can be renamed via this command: 2024-08-22T20:28:12.0735726Z hint: 2024-08-22T20:28:12.0736179Z hint: git branch -m 2024-08-22T20:28:12.0737268Z Initialized empty Git repository in /home/ec2-user/actions-runner/_work/torchchat/torchchat/test-infra/.git/ 2024-08-22T20:28:12.0744337Z [command]/usr/bin/git remote add origin https://github.com/pytorch/test-infra 2024-08-22T20:28:12.0807501Z ##[endgroup] 2024-08-22T20:28:12.0808153Z ##[group]Disabling automatic garbage collection 2024-08-22T20:28:12.0810125Z [command]/usr/bin/git config --local gc.auto 0 2024-08-22T20:28:12.0852256Z ##[endgroup] 2024-08-22T20:28:12.0852854Z ##[group]Setting up auth 2024-08-22T20:28:12.0857674Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2024-08-22T20:28:12.0900327Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2024-08-22T20:28:12.1256353Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2024-08-22T20:28:12.1298420Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2024-08-22T20:28:12.1651437Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic *** 2024-08-22T20:28:12.1709165Z ##[endgroup] 2024-08-22T20:28:12.1709854Z ##[group]Determining the default branch 2024-08-22T20:28:12.1712195Z Retrieving the default branch name 2024-08-22T20:28:12.3467996Z Default branch 'main' 2024-08-22T20:28:12.3468712Z ##[endgroup] 2024-08-22T20:28:12.3469249Z ##[group]Fetching the repository 2024-08-22T20:28:12.3473769Z [command]/usr/bin/git -c protocol.version=2 fetch --no-tags --prune --progress --no-recurse-submodules --depth=1 origin +refs/heads/main:refs/remotes/origin/main 2024-08-22T20:28:12.5383870Z remote: Enumerating objects: 1649, done. 2024-08-22T20:28:12.5384997Z remote: Counting objects: 0% (1/1649) 2024-08-22T20:28:12.5385992Z remote: Counting objects: 1% (17/1649) 2024-08-22T20:28:12.5386965Z remote: Counting objects: 2% (33/1649) 2024-08-22T20:28:12.5387923Z remote: Counting objects: 3% (50/1649) 2024-08-22T20:28:12.5389088Z remote: Counting objects: 4% (66/1649) 2024-08-22T20:28:12.5390172Z remote: Counting objects: 5% (83/1649) 2024-08-22T20:28:12.5390691Z remote: Counting objects: 6% (99/1649) 2024-08-22T20:28:12.5391183Z remote: Counting objects: 7% (116/1649) 2024-08-22T20:28:12.5391859Z remote: Counting objects: 8% (132/1649) 2024-08-22T20:28:12.5392370Z remote: Counting objects: 9% (149/1649) 2024-08-22T20:28:12.5393006Z remote: Counting objects: 10% (165/1649) 2024-08-22T20:28:12.5393677Z remote: Counting objects: 11% (182/1649) 2024-08-22T20:28:12.5394307Z remote: Counting objects: 12% (198/1649) 2024-08-22T20:28:12.5395228Z remote: Counting objects: 13% (215/1649) 2024-08-22T20:28:12.5395855Z remote: Counting objects: 14% (231/1649) 2024-08-22T20:28:12.5396615Z remote: Counting objects: 15% (248/1649) 2024-08-22T20:28:12.5397239Z remote: Counting objects: 16% (264/1649) 2024-08-22T20:28:12.5397869Z remote: Counting objects: 17% (281/1649) 2024-08-22T20:28:12.5398360Z remote: Counting objects: 18% (297/1649) 2024-08-22T20:28:12.5398836Z remote: Counting objects: 19% (314/1649) 2024-08-22T20:28:12.5399394Z remote: Counting objects: 20% (330/1649) 2024-08-22T20:28:12.5399881Z remote: Counting objects: 21% (347/1649) 2024-08-22T20:28:12.5400371Z remote: Counting objects: 22% (363/1649) 2024-08-22T20:28:12.5400854Z remote: Counting objects: 23% (380/1649) 2024-08-22T20:28:12.5401333Z remote: Counting objects: 24% (396/1649) 2024-08-22T20:28:12.5401858Z remote: Counting objects: 25% (413/1649) 2024-08-22T20:28:12.5402388Z remote: Counting objects: 26% (429/1649) 2024-08-22T20:28:12.5402903Z remote: Counting objects: 27% (446/1649) 2024-08-22T20:28:12.5403427Z remote: Counting objects: 28% (462/1649) 2024-08-22T20:28:12.5403947Z remote: Counting objects: 29% (479/1649) 2024-08-22T20:28:12.5404462Z remote: Counting objects: 30% (495/1649) 2024-08-22T20:28:12.5404986Z remote: Counting objects: 31% (512/1649) 2024-08-22T20:28:12.5405510Z remote: Counting objects: 32% (528/1649) 2024-08-22T20:28:12.5406023Z remote: Counting objects: 33% (545/1649) 2024-08-22T20:28:12.5406545Z remote: Counting objects: 34% (561/1649) 2024-08-22T20:28:12.5407069Z remote: Counting objects: 35% (578/1649) 2024-08-22T20:28:12.5407580Z remote: Counting objects: 36% (594/1649) 2024-08-22T20:28:12.5408297Z remote: Counting objects: 37% (611/1649) 2024-08-22T20:28:12.5408785Z remote: Counting objects: 38% (627/1649) 2024-08-22T20:28:12.5409263Z remote: Counting objects: 39% (644/1649) 2024-08-22T20:28:12.5409744Z remote: Counting objects: 40% (660/1649) 2024-08-22T20:28:12.5410228Z remote: Counting objects: 41% (677/1649) 2024-08-22T20:28:12.5410701Z remote: Counting objects: 42% (693/1649) 2024-08-22T20:28:12.5411183Z remote: Counting objects: 43% (710/1649) 2024-08-22T20:28:12.5411668Z remote: Counting objects: 44% (726/1649) 2024-08-22T20:28:12.5412149Z remote: Counting objects: 45% (743/1649) 2024-08-22T20:28:12.5412626Z remote: Counting objects: 46% (759/1649) 2024-08-22T20:28:12.5413107Z remote: Counting objects: 47% (776/1649) 2024-08-22T20:28:12.5413588Z remote: Counting objects: 48% (792/1649) 2024-08-22T20:28:12.5414061Z remote: Counting objects: 49% (809/1649) 2024-08-22T20:28:12.5414550Z remote: Counting objects: 50% (825/1649) 2024-08-22T20:28:12.5415036Z remote: Counting objects: 51% (841/1649) 2024-08-22T20:28:12.5415525Z remote: Counting objects: 52% (858/1649) 2024-08-22T20:28:12.5416014Z remote: Counting objects: 53% (874/1649) 2024-08-22T20:28:12.5416496Z remote: Counting objects: 54% (891/1649) 2024-08-22T20:28:12.5416973Z remote: Counting objects: 55% (907/1649) 2024-08-22T20:28:12.5417491Z remote: Counting objects: 56% (924/1649) 2024-08-22T20:28:12.5418144Z remote: Counting objects: 57% (940/1649) 2024-08-22T20:28:12.5418772Z remote: Counting objects: 58% (957/1649) 2024-08-22T20:28:12.5419277Z remote: Counting objects: 59% (973/1649) 2024-08-22T20:28:12.5419759Z remote: Counting objects: 60% (990/1649) 2024-08-22T20:28:12.5420241Z remote: Counting objects: 61% (1006/1649) 2024-08-22T20:28:12.5420857Z remote: Counting objects: 62% (1023/1649) 2024-08-22T20:28:12.5421538Z remote: Counting objects: 63% (1039/1649) 2024-08-22T20:28:12.5422110Z remote: Counting objects: 64% (1056/1649) 2024-08-22T20:28:12.5422813Z remote: Counting objects: 65% (1072/1649) 2024-08-22T20:28:12.5423330Z remote: Counting objects: 66% (1089/1649) 2024-08-22T20:28:12.5423837Z remote: Counting objects: 67% (1105/1649) 2024-08-22T20:28:12.5424336Z remote: Counting objects: 68% (1122/1649) 2024-08-22T20:28:12.5424829Z remote: Counting objects: 69% (1138/1649) 2024-08-22T20:28:12.5425333Z remote: Counting objects: 70% (1155/1649) 2024-08-22T20:28:12.5425831Z remote: Counting objects: 71% (1171/1649) 2024-08-22T20:28:12.5426323Z remote: Counting objects: 72% (1188/1649) 2024-08-22T20:28:12.5426821Z remote: Counting objects: 73% (1204/1649) 2024-08-22T20:28:12.5427316Z remote: Counting objects: 74% (1221/1649) 2024-08-22T20:28:12.5427807Z remote: Counting objects: 75% (1237/1649) 2024-08-22T20:28:12.5428309Z remote: Counting objects: 76% (1254/1649) 2024-08-22T20:28:12.5428808Z remote: Counting objects: 77% (1270/1649) 2024-08-22T20:28:12.5429307Z remote: Counting objects: 78% (1287/1649) 2024-08-22T20:28:12.5429811Z remote: Counting objects: 79% (1303/1649) 2024-08-22T20:28:12.5430306Z remote: Counting objects: 80% (1320/1649) 2024-08-22T20:28:12.5430795Z remote: Counting objects: 81% (1336/1649) 2024-08-22T20:28:12.5431294Z remote: Counting objects: 82% (1353/1649) 2024-08-22T20:28:12.5431791Z remote: Counting objects: 83% (1369/1649) 2024-08-22T20:28:12.5432277Z remote: Counting objects: 84% (1386/1649) 2024-08-22T20:28:12.5432784Z remote: Counting objects: 85% (1402/1649) 2024-08-22T20:28:12.5433321Z remote: Counting objects: 86% (1419/1649) 2024-08-22T20:28:12.5433819Z remote: Counting objects: 87% (1435/1649) 2024-08-22T20:28:12.5434604Z remote: Counting objects: 88% (1452/1649) 2024-08-22T20:28:12.5435248Z remote: Counting objects: 89% (1468/1649) 2024-08-22T20:28:12.5435754Z remote: Counting objects: 90% (1485/1649) 2024-08-22T20:28:12.5436323Z remote: Counting objects: 91% (1501/1649) 2024-08-22T20:28:12.5436822Z remote: Counting objects: 92% (1518/1649) 2024-08-22T20:28:12.5437319Z remote: Counting objects: 93% (1534/1649) 2024-08-22T20:28:12.5437807Z remote: Counting objects: 94% (1551/1649) 2024-08-22T20:28:12.5438303Z remote: Counting objects: 95% (1567/1649) 2024-08-22T20:28:12.5438799Z remote: Counting objects: 96% (1584/1649) 2024-08-22T20:28:12.5439290Z remote: Counting objects: 97% (1600/1649) 2024-08-22T20:28:12.5439783Z remote: Counting objects: 98% (1617/1649) 2024-08-22T20:28:12.5440282Z remote: Counting objects: 99% (1633/1649) 2024-08-22T20:28:12.5440773Z remote: Counting objects: 100% (1649/1649) 2024-08-22T20:28:12.5441306Z remote: Counting objects: 100% (1649/1649), done. 2024-08-22T20:28:12.5441864Z remote: Compressing objects: 0% (1/1260) 2024-08-22T20:28:12.5442384Z remote: Compressing objects: 1% (13/1260) 2024-08-22T20:28:12.5442916Z remote: Compressing objects: 2% (26/1260) 2024-08-22T20:28:12.5443437Z remote: Compressing objects: 3% (38/1260) 2024-08-22T20:28:12.5443959Z remote: Compressing objects: 4% (51/1260) 2024-08-22T20:28:12.5444468Z remote: Compressing objects: 5% (63/1260) 2024-08-22T20:28:12.5444982Z remote: Compressing objects: 6% (76/1260) 2024-08-22T20:28:12.5445501Z remote: Compressing objects: 7% (89/1260) 2024-08-22T20:28:12.5446017Z remote: Compressing objects: 8% (101/1260) 2024-08-22T20:28:12.5446546Z remote: Compressing objects: 9% (114/1260) 2024-08-22T20:28:12.5447078Z remote: Compressing objects: 10% (126/1260) 2024-08-22T20:28:12.5447596Z remote: Compressing objects: 11% (139/1260) 2024-08-22T20:28:12.5448127Z remote: Compressing objects: 12% (152/1260) 2024-08-22T20:28:12.5448650Z remote: Compressing objects: 13% (164/1260) 2024-08-22T20:28:12.5449301Z remote: Compressing objects: 14% (177/1260) 2024-08-22T20:28:12.5449826Z remote: Compressing objects: 15% (189/1260) 2024-08-22T20:28:12.5450348Z remote: Compressing objects: 16% (202/1260) 2024-08-22T20:28:12.5450861Z remote: Compressing objects: 17% (215/1260) 2024-08-22T20:28:12.5451378Z remote: Compressing objects: 18% (227/1260) 2024-08-22T20:28:12.5451903Z remote: Compressing objects: 19% (240/1260) 2024-08-22T20:28:12.5452414Z remote: Compressing objects: 20% (252/1260) 2024-08-22T20:28:12.5452937Z remote: Compressing objects: 21% (265/1260) 2024-08-22T20:28:12.5453467Z remote: Compressing objects: 22% (278/1260) 2024-08-22T20:28:12.5453983Z remote: Compressing objects: 23% (290/1260) 2024-08-22T20:28:12.5454497Z remote: Compressing objects: 24% (303/1260) 2024-08-22T20:28:12.5455120Z remote: Compressing objects: 25% (315/1260) 2024-08-22T20:28:12.5455667Z remote: Compressing objects: 26% (328/1260) 2024-08-22T20:28:12.5456218Z remote: Compressing objects: 27% (341/1260) 2024-08-22T20:28:12.5456737Z remote: Compressing objects: 28% (353/1260) 2024-08-22T20:28:12.5457284Z remote: Compressing objects: 29% (366/1260) 2024-08-22T20:28:12.5457826Z remote: Compressing objects: 30% (378/1260) 2024-08-22T20:28:12.5458344Z remote: Compressing objects: 31% (391/1260) 2024-08-22T20:28:12.5458861Z remote: Compressing objects: 32% (404/1260) 2024-08-22T20:28:12.5459371Z remote: Compressing objects: 33% (416/1260) 2024-08-22T20:28:12.5459941Z remote: Compressing objects: 34% (429/1260) 2024-08-22T20:28:12.5460485Z remote: Compressing objects: 35% (441/1260) 2024-08-22T20:28:12.5461023Z remote: Compressing objects: 36% (454/1260) 2024-08-22T20:28:12.5461645Z remote: Compressing objects: 37% (467/1260) 2024-08-22T20:28:12.5462164Z remote: Compressing objects: 38% (479/1260) 2024-08-22T20:28:12.5462680Z remote: Compressing objects: 39% (492/1260) 2024-08-22T20:28:12.5463195Z remote: Compressing objects: 40% (504/1260) 2024-08-22T20:28:12.5463717Z remote: Compressing objects: 41% (517/1260) 2024-08-22T20:28:12.5464226Z remote: Compressing objects: 42% (530/1260) 2024-08-22T20:28:12.5464745Z remote: Compressing objects: 43% (542/1260) 2024-08-22T20:28:12.5465265Z remote: Compressing objects: 44% (555/1260) 2024-08-22T20:28:12.5465781Z remote: Compressing objects: 45% (567/1260) 2024-08-22T20:28:12.5466287Z remote: Compressing objects: 46% (580/1260) 2024-08-22T20:28:12.5466800Z remote: Compressing objects: 47% (593/1260) 2024-08-22T20:28:12.5467320Z remote: Compressing objects: 48% (605/1260) 2024-08-22T20:28:12.5467827Z remote: Compressing objects: 49% (618/1260) 2024-08-22T20:28:12.5468348Z remote: Compressing objects: 50% (630/1260) 2024-08-22T20:28:12.5468867Z remote: Compressing objects: 51% (643/1260) 2024-08-22T20:28:12.5469388Z remote: Compressing objects: 52% (656/1260) 2024-08-22T20:28:12.5469904Z remote: Compressing objects: 53% (668/1260) 2024-08-22T20:28:12.5470472Z remote: Compressing objects: 54% (681/1260) 2024-08-22T20:28:12.5470986Z remote: Compressing objects: 55% (693/1260) 2024-08-22T20:28:12.5471511Z remote: Compressing objects: 56% (706/1260) 2024-08-22T20:28:12.5472030Z remote: Compressing objects: 57% (719/1260) 2024-08-22T20:28:12.5472543Z remote: Compressing objects: 58% (731/1260) 2024-08-22T20:28:12.5473058Z remote: Compressing objects: 59% (744/1260) 2024-08-22T20:28:12.5473579Z remote: Compressing objects: 60% (756/1260) 2024-08-22T20:28:12.5474087Z remote: Compressing objects: 61% (769/1260) 2024-08-22T20:28:12.5474619Z remote: Compressing objects: 62% (782/1260) 2024-08-22T20:28:12.5475137Z remote: Compressing objects: 63% (794/1260) 2024-08-22T20:28:12.5475760Z remote: Compressing objects: 64% (807/1260) 2024-08-22T20:28:12.5476321Z remote: Compressing objects: 65% (819/1260) 2024-08-22T20:28:12.5476836Z remote: Compressing objects: 66% (832/1260) 2024-08-22T20:28:12.5477355Z remote: Compressing objects: 67% (845/1260) 2024-08-22T20:28:12.5477870Z remote: Compressing objects: 68% (857/1260) 2024-08-22T20:28:12.5478388Z remote: Compressing objects: 69% (870/1260) 2024-08-22T20:28:12.5478910Z remote: Compressing objects: 70% (882/1260) 2024-08-22T20:28:12.5479436Z remote: Compressing objects: 71% (895/1260) 2024-08-22T20:28:12.5479994Z remote: Compressing objects: 72% (908/1260) 2024-08-22T20:28:12.5480511Z remote: Compressing objects: 73% (920/1260) 2024-08-22T20:28:12.5481021Z remote: Compressing objects: 74% (933/1260) 2024-08-22T20:28:12.5481543Z remote: Compressing objects: 75% (945/1260) 2024-08-22T20:28:12.5482061Z remote: Compressing objects: 76% (958/1260) 2024-08-22T20:28:12.5482576Z remote: Compressing objects: 77% (971/1260) 2024-08-22T20:28:12.5483099Z remote: Compressing objects: 78% (983/1260) 2024-08-22T20:28:12.5483613Z remote: Compressing objects: 79% (996/1260) 2024-08-22T20:28:12.5484133Z remote: Compressing objects: 80% (1008/1260) 2024-08-22T20:28:12.5484677Z remote: Compressing objects: 81% (1021/1260) 2024-08-22T20:28:12.5485208Z remote: Compressing objects: 82% (1034/1260) 2024-08-22T20:28:12.5485750Z remote: Compressing objects: 83% (1046/1260) 2024-08-22T20:28:12.5486279Z remote: Compressing objects: 84% (1059/1260) 2024-08-22T20:28:12.5486803Z remote: Compressing objects: 85% (1071/1260) 2024-08-22T20:28:12.5487346Z remote: Compressing objects: 86% (1084/1260) 2024-08-22T20:28:12.5487967Z remote: Compressing objects: 87% (1097/1260) 2024-08-22T20:28:12.5488504Z remote: Compressing objects: 88% (1109/1260) 2024-08-22T20:28:12.5489042Z remote: Compressing objects: 89% (1122/1260) 2024-08-22T20:28:12.5489580Z remote: Compressing objects: 90% (1134/1260) 2024-08-22T20:28:12.5490171Z remote: Compressing objects: 91% (1147/1260) 2024-08-22T20:28:12.5490687Z remote: Compressing objects: 92% (1160/1260) 2024-08-22T20:28:12.5491211Z remote: Compressing objects: 93% (1172/1260) 2024-08-22T20:28:12.5491745Z remote: Compressing objects: 94% (1185/1260) 2024-08-22T20:28:12.5492258Z remote: Compressing objects: 95% (1197/1260) 2024-08-22T20:28:12.5492782Z remote: Compressing objects: 96% (1210/1260) 2024-08-22T20:28:12.5493314Z remote: Compressing objects: 97% (1223/1260) 2024-08-22T20:28:12.5493831Z remote: Compressing objects: 98% (1235/1260) 2024-08-22T20:28:12.5494358Z remote: Compressing objects: 99% (1248/1260) 2024-08-22T20:28:12.5494882Z remote: Compressing objects: 100% (1260/1260) 2024-08-22T20:28:12.5495571Z remote: Compressing objects: 100% (1260/1260), done. 2024-08-22T20:28:12.5496265Z Receiving objects: 0% (1/1649) 2024-08-22T20:28:12.5496776Z Receiving objects: 1% (17/1649) 2024-08-22T20:28:12.5497213Z Receiving objects: 2% (33/1649) 2024-08-22T20:28:12.5500637Z Receiving objects: 3% (50/1649) 2024-08-22T20:28:12.5511399Z Receiving objects: 4% (66/1649) 2024-08-22T20:28:12.5517232Z Receiving objects: 5% (83/1649) 2024-08-22T20:28:12.5522942Z Receiving objects: 6% (99/1649) 2024-08-22T20:28:12.5526178Z Receiving objects: 7% (116/1649) 2024-08-22T20:28:12.5528166Z Receiving objects: 8% (132/1649) 2024-08-22T20:28:12.5532994Z Receiving objects: 9% (149/1649) 2024-08-22T20:28:12.5538526Z Receiving objects: 10% (165/1649) 2024-08-22T20:28:12.5541051Z Receiving objects: 11% (182/1649) 2024-08-22T20:28:12.5545503Z Receiving objects: 12% (198/1649) 2024-08-22T20:28:12.5789737Z Receiving objects: 13% (215/1649) 2024-08-22T20:28:12.5867074Z Receiving objects: 14% (231/1649) 2024-08-22T20:28:12.5870695Z Receiving objects: 15% (248/1649) 2024-08-22T20:28:12.5874470Z Receiving objects: 16% (264/1649) 2024-08-22T20:28:12.5879217Z Receiving objects: 17% (281/1649) 2024-08-22T20:28:12.5915984Z Receiving objects: 18% (297/1649) 2024-08-22T20:28:12.5927863Z Receiving objects: 19% (314/1649) 2024-08-22T20:28:12.5929250Z Receiving objects: 20% (330/1649) 2024-08-22T20:28:12.5933885Z Receiving objects: 21% (347/1649) 2024-08-22T20:28:12.5938451Z Receiving objects: 22% (363/1649) 2024-08-22T20:28:12.5942068Z Receiving objects: 23% (380/1649) 2024-08-22T20:28:12.5952310Z Receiving objects: 24% (396/1649) 2024-08-22T20:28:12.5969010Z Receiving objects: 25% (413/1649) 2024-08-22T20:28:12.5971844Z Receiving objects: 26% (429/1649) 2024-08-22T20:28:12.5973519Z Receiving objects: 27% (446/1649) 2024-08-22T20:28:12.5980465Z Receiving objects: 28% (462/1649) 2024-08-22T20:28:12.5983372Z Receiving objects: 29% (479/1649) 2024-08-22T20:28:12.5992698Z Receiving objects: 30% (495/1649) 2024-08-22T20:28:12.5999912Z Receiving objects: 31% (512/1649) 2024-08-22T20:28:12.6006013Z Receiving objects: 32% (528/1649) 2024-08-22T20:28:12.6014496Z Receiving objects: 33% (545/1649) 2024-08-22T20:28:12.6015330Z Receiving objects: 34% (561/1649) 2024-08-22T20:28:12.6017915Z Receiving objects: 35% (578/1649) 2024-08-22T20:28:12.6023719Z Receiving objects: 36% (594/1649) 2024-08-22T20:28:12.6030380Z Receiving objects: 37% (611/1649) 2024-08-22T20:28:12.6033145Z Receiving objects: 38% (627/1649) 2024-08-22T20:28:12.6038542Z Receiving objects: 39% (644/1649) 2024-08-22T20:28:12.6043631Z Receiving objects: 40% (660/1649) 2024-08-22T20:28:12.6048340Z Receiving objects: 41% (677/1649) 2024-08-22T20:28:12.6052979Z Receiving objects: 42% (693/1649) 2024-08-22T20:28:12.6056384Z Receiving objects: 43% (710/1649) 2024-08-22T20:28:12.6059199Z Receiving objects: 44% (726/1649) 2024-08-22T20:28:12.6063206Z Receiving objects: 45% (743/1649) 2024-08-22T20:28:12.6067560Z Receiving objects: 46% (759/1649) 2024-08-22T20:28:12.6070297Z Receiving objects: 47% (776/1649) 2024-08-22T20:28:12.6073767Z Receiving objects: 48% (792/1649) 2024-08-22T20:28:12.6077068Z Receiving objects: 49% (809/1649) 2024-08-22T20:28:12.6081784Z Receiving objects: 50% (825/1649) 2024-08-22T20:28:12.6084788Z Receiving objects: 51% (841/1649) 2024-08-22T20:28:12.6087366Z Receiving objects: 52% (858/1649) 2024-08-22T20:28:12.6092510Z Receiving objects: 53% (874/1649) 2024-08-22T20:28:12.6096182Z Receiving objects: 54% (891/1649) 2024-08-22T20:28:12.6097955Z Receiving objects: 55% (907/1649) 2024-08-22T20:28:12.6100731Z Receiving objects: 56% (924/1649) 2024-08-22T20:28:12.6104386Z Receiving objects: 57% (940/1649) 2024-08-22T20:28:12.6110057Z Receiving objects: 58% (957/1649) 2024-08-22T20:28:12.6118293Z Receiving objects: 59% (973/1649) 2024-08-22T20:28:12.6121928Z Receiving objects: 60% (990/1649) 2024-08-22T20:28:12.6125690Z Receiving objects: 61% (1006/1649) 2024-08-22T20:28:12.6129199Z Receiving objects: 62% (1023/1649) 2024-08-22T20:28:12.6135081Z Receiving objects: 63% (1039/1649) 2024-08-22T20:28:12.6141185Z Receiving objects: 64% (1056/1649) 2024-08-22T20:28:12.6145609Z Receiving objects: 65% (1072/1649) 2024-08-22T20:28:12.6147768Z Receiving objects: 66% (1089/1649) 2024-08-22T20:28:12.6152049Z Receiving objects: 67% (1105/1649) 2024-08-22T20:28:12.6156512Z Receiving objects: 68% (1122/1649) 2024-08-22T20:28:12.6163067Z Receiving objects: 69% (1138/1649) 2024-08-22T20:28:12.6168367Z Receiving objects: 70% (1155/1649) 2024-08-22T20:28:12.6176210Z Receiving objects: 71% (1171/1649) 2024-08-22T20:28:12.6183823Z Receiving objects: 72% (1188/1649) 2024-08-22T20:28:12.6221394Z Receiving objects: 73% (1204/1649) 2024-08-22T20:28:12.6227129Z Receiving objects: 74% (1221/1649) 2024-08-22T20:28:12.6309423Z Receiving objects: 75% (1237/1649) 2024-08-22T20:28:12.6310872Z Receiving objects: 76% (1254/1649) 2024-08-22T20:28:12.6316769Z Receiving objects: 77% (1270/1649) 2024-08-22T20:28:12.6318352Z Receiving objects: 78% (1287/1649) 2024-08-22T20:28:12.6320845Z Receiving objects: 79% (1303/1649) 2024-08-22T20:28:12.6326645Z Receiving objects: 80% (1320/1649) 2024-08-22T20:28:12.6335988Z Receiving objects: 81% (1336/1649) 2024-08-22T20:28:12.6377675Z Receiving objects: 82% (1353/1649) 2024-08-22T20:28:12.6379817Z Receiving objects: 83% (1369/1649) 2024-08-22T20:28:12.6382931Z Receiving objects: 84% (1386/1649) 2024-08-22T20:28:12.6385583Z Receiving objects: 85% (1402/1649) 2024-08-22T20:28:12.6386169Z Receiving objects: 86% (1419/1649) 2024-08-22T20:28:12.6386620Z Receiving objects: 87% (1435/1649) 2024-08-22T20:28:12.6388265Z Receiving objects: 88% (1452/1649) 2024-08-22T20:28:12.6391109Z Receiving objects: 89% (1468/1649) 2024-08-22T20:28:12.6393625Z Receiving objects: 90% (1485/1649) 2024-08-22T20:28:12.6394739Z Receiving objects: 91% (1501/1649) 2024-08-22T20:28:12.6395157Z Receiving objects: 92% (1518/1649) 2024-08-22T20:28:12.6396812Z Receiving objects: 93% (1534/1649) 2024-08-22T20:28:12.6399797Z Receiving objects: 94% (1551/1649) 2024-08-22T20:28:12.6400591Z Receiving objects: 95% (1567/1649) 2024-08-22T20:28:12.6407273Z Receiving objects: 96% (1584/1649) 2024-08-22T20:28:12.6419260Z Receiving objects: 97% (1600/1649) 2024-08-22T20:28:12.6429921Z Receiving objects: 98% (1617/1649) 2024-08-22T20:28:12.6449883Z Receiving objects: 99% (1633/1649) 2024-08-22T20:28:12.6450740Z remote: Total 1649 (delta 371), reused 1069 (delta 267), pack-reused 0 (from 0) 2024-08-22T20:28:12.6466194Z Receiving objects: 100% (1649/1649) 2024-08-22T20:28:12.6466737Z Receiving objects: 100% (1649/1649), 2.83 MiB | 27.10 MiB/s, done. 2024-08-22T20:28:12.6474205Z Resolving deltas: 0% (0/371) 2024-08-22T20:28:12.6475224Z Resolving deltas: 1% (5/371) 2024-08-22T20:28:12.6476599Z Resolving deltas: 2% (8/371) 2024-08-22T20:28:12.6477051Z Resolving deltas: 3% (12/371) 2024-08-22T20:28:12.6478576Z Resolving deltas: 4% (15/371) 2024-08-22T20:28:12.6479217Z Resolving deltas: 5% (20/371) 2024-08-22T20:28:12.6479687Z Resolving deltas: 6% (23/371) 2024-08-22T20:28:12.6480768Z Resolving deltas: 7% (26/371) 2024-08-22T20:28:12.6481293Z Resolving deltas: 8% (30/371) 2024-08-22T20:28:12.6483294Z Resolving deltas: 9% (34/371) 2024-08-22T20:28:12.6483769Z Resolving deltas: 10% (40/371) 2024-08-22T20:28:12.6484401Z Resolving deltas: 11% (41/371) 2024-08-22T20:28:12.6488318Z Resolving deltas: 12% (45/371) 2024-08-22T20:28:12.6488777Z Resolving deltas: 13% (49/371) 2024-08-22T20:28:12.6489166Z Resolving deltas: 14% (52/371) 2024-08-22T20:28:12.6492117Z Resolving deltas: 15% (57/371) 2024-08-22T20:28:12.6504614Z Resolving deltas: 16% (60/371) 2024-08-22T20:28:12.6505168Z Resolving deltas: 17% (65/371) 2024-08-22T20:28:12.6507263Z Resolving deltas: 18% (67/371) 2024-08-22T20:28:12.6507875Z Resolving deltas: 19% (72/371) 2024-08-22T20:28:12.6508468Z Resolving deltas: 20% (75/371) 2024-08-22T20:28:12.6509077Z Resolving deltas: 21% (78/371) 2024-08-22T20:28:12.6509693Z Resolving deltas: 22% (83/371) 2024-08-22T20:28:12.6510715Z Resolving deltas: 23% (86/371) 2024-08-22T20:28:12.6511317Z Resolving deltas: 24% (92/371) 2024-08-22T20:28:12.6512242Z Resolving deltas: 25% (93/371) 2024-08-22T20:28:12.6514391Z Resolving deltas: 26% (97/371) 2024-08-22T20:28:12.6515239Z Resolving deltas: 27% (101/371) 2024-08-22T20:28:12.6520570Z Resolving deltas: 28% (106/371) 2024-08-22T20:28:12.6520983Z Resolving deltas: 29% (110/371) 2024-08-22T20:28:12.6522150Z Resolving deltas: 30% (113/371) 2024-08-22T20:28:12.6522788Z Resolving deltas: 31% (117/371) 2024-08-22T20:28:12.6524551Z Resolving deltas: 32% (120/371) 2024-08-22T20:28:12.6525906Z Resolving deltas: 33% (123/371) 2024-08-22T20:28:12.6526933Z Resolving deltas: 34% (128/371) 2024-08-22T20:28:12.6529033Z Resolving deltas: 35% (131/371) 2024-08-22T20:28:12.6529974Z Resolving deltas: 36% (134/371) 2024-08-22T20:28:12.6530385Z Resolving deltas: 37% (140/371) 2024-08-22T20:28:12.6532667Z Resolving deltas: 38% (141/371) 2024-08-22T20:28:12.6533314Z Resolving deltas: 39% (146/371) 2024-08-22T20:28:12.6535797Z Resolving deltas: 40% (149/371) 2024-08-22T20:28:12.6536257Z Resolving deltas: 41% (153/371) 2024-08-22T20:28:12.6536662Z Resolving deltas: 42% (156/371) 2024-08-22T20:28:12.6537955Z Resolving deltas: 43% (160/371) 2024-08-22T20:28:12.6539543Z Resolving deltas: 44% (164/371) 2024-08-22T20:28:12.6540674Z Resolving deltas: 45% (167/371) 2024-08-22T20:28:12.6541806Z Resolving deltas: 46% (171/371) 2024-08-22T20:28:12.6542369Z Resolving deltas: 47% (175/371) 2024-08-22T20:28:12.6542931Z Resolving deltas: 48% (179/371) 2024-08-22T20:28:12.6543666Z Resolving deltas: 49% (183/371) 2024-08-22T20:28:12.6545311Z Resolving deltas: 50% (187/371) 2024-08-22T20:28:12.6545876Z Resolving deltas: 51% (191/371) 2024-08-22T20:28:12.6546443Z Resolving deltas: 52% (193/371) 2024-08-22T20:28:12.6547184Z Resolving deltas: 53% (197/371) 2024-08-22T20:28:12.6548388Z Resolving deltas: 54% (202/371) 2024-08-22T20:28:12.6549354Z Resolving deltas: 55% (205/371) 2024-08-22T20:28:12.6550513Z Resolving deltas: 56% (210/371) 2024-08-22T20:28:12.6552424Z Resolving deltas: 57% (212/371) 2024-08-22T20:28:12.6553019Z Resolving deltas: 58% (216/371) 2024-08-22T20:28:12.6553740Z Resolving deltas: 59% (219/371) 2024-08-22T20:28:12.6554396Z Resolving deltas: 60% (223/371) 2024-08-22T20:28:12.6556337Z Resolving deltas: 61% (227/371) 2024-08-22T20:28:12.6557166Z Resolving deltas: 62% (231/371) 2024-08-22T20:28:12.6559997Z Resolving deltas: 63% (234/371) 2024-08-22T20:28:12.6560662Z Resolving deltas: 64% (238/371) 2024-08-22T20:28:12.6563700Z Resolving deltas: 65% (242/371) 2024-08-22T20:28:12.6564304Z Resolving deltas: 66% (245/371) 2024-08-22T20:28:12.6564895Z Resolving deltas: 67% (250/371) 2024-08-22T20:28:12.6565422Z Resolving deltas: 68% (253/371) 2024-08-22T20:28:12.6565927Z Resolving deltas: 69% (256/371) 2024-08-22T20:28:12.6566660Z Resolving deltas: 70% (260/371) 2024-08-22T20:28:12.6567102Z Resolving deltas: 71% (264/371) 2024-08-22T20:28:12.6567488Z Resolving deltas: 72% (268/371) 2024-08-22T20:28:12.6568005Z Resolving deltas: 73% (272/371) 2024-08-22T20:28:12.6568560Z Resolving deltas: 74% (275/371) 2024-08-22T20:28:12.6569086Z Resolving deltas: 75% (279/371) 2024-08-22T20:28:12.6569608Z Resolving deltas: 76% (282/371) 2024-08-22T20:28:12.6570106Z Resolving deltas: 77% (286/371) 2024-08-22T20:28:12.6570488Z Resolving deltas: 78% (290/371) 2024-08-22T20:28:12.6570877Z Resolving deltas: 79% (294/371) 2024-08-22T20:28:12.6571263Z Resolving deltas: 80% (300/371) 2024-08-22T20:28:12.6571703Z Resolving deltas: 81% (301/371) 2024-08-22T20:28:12.6572106Z Resolving deltas: 82% (305/371) 2024-08-22T20:28:12.6572616Z Resolving deltas: 83% (308/371) 2024-08-22T20:28:12.6573039Z Resolving deltas: 84% (312/371) 2024-08-22T20:28:12.6573493Z Resolving deltas: 85% (319/371) 2024-08-22T20:28:12.6573921Z Resolving deltas: 86% (320/371) 2024-08-22T20:28:12.6574429Z Resolving deltas: 87% (323/371) 2024-08-22T20:28:12.6574876Z Resolving deltas: 88% (329/371) 2024-08-22T20:28:12.6575273Z Resolving deltas: 89% (332/371) 2024-08-22T20:28:12.6575650Z Resolving deltas: 90% (334/371) 2024-08-22T20:28:12.6576079Z Resolving deltas: 91% (340/371) 2024-08-22T20:28:12.6576864Z Resolving deltas: 92% (342/371) 2024-08-22T20:28:12.6577418Z Resolving deltas: 93% (346/371) 2024-08-22T20:28:12.6581200Z Resolving deltas: 94% (349/371) 2024-08-22T20:28:12.6584420Z Resolving deltas: 95% (354/371) 2024-08-22T20:28:12.6585403Z Resolving deltas: 97% (360/371) 2024-08-22T20:28:12.6587259Z Resolving deltas: 98% (364/371) 2024-08-22T20:28:12.6590383Z Resolving deltas: 99% (368/371) 2024-08-22T20:28:12.6591297Z Resolving deltas: 100% (371/371) 2024-08-22T20:28:12.6591699Z Resolving deltas: 100% (371/371), done. 2024-08-22T20:28:12.7561320Z From https://github.com/pytorch/test-infra 2024-08-22T20:28:12.7561887Z * [new branch] main -> origin/main 2024-08-22T20:28:12.7586397Z ##[endgroup] 2024-08-22T20:28:12.7586932Z ##[group]Determining the checkout info 2024-08-22T20:28:12.7589028Z ##[endgroup] 2024-08-22T20:28:12.7589547Z ##[group]Checking out the ref 2024-08-22T20:28:12.7592783Z [command]/usr/bin/git checkout --progress --force -B main refs/remotes/origin/main 2024-08-22T20:28:12.8802494Z Switched to a new branch 'main' 2024-08-22T20:28:12.8803093Z branch 'main' set up to track 'origin/main'. 2024-08-22T20:28:12.8813540Z ##[endgroup] 2024-08-22T20:28:12.8814103Z ##[group]Setting up auth for fetching submodules 2024-08-22T20:28:12.8818362Z [command]/usr/bin/git config --global http.https://github.com/.extraheader AUTHORIZATION: basic *** 2024-08-22T20:28:12.8882800Z [command]/usr/bin/git config --global --unset-all url.https://github.com/.insteadOf 2024-08-22T20:28:12.8927718Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf git@github.com: 2024-08-22T20:28:12.8974038Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf org-21003710@github.com: 2024-08-22T20:28:12.9016568Z ##[endgroup] 2024-08-22T20:28:12.9017094Z ##[group]Fetching submodules 2024-08-22T20:28:12.9019222Z [command]/usr/bin/git submodule sync --recursive 2024-08-22T20:28:12.9383702Z [command]/usr/bin/git -c protocol.version=2 submodule update --init --force --depth=1 --recursive 2024-08-22T20:28:12.9742676Z [command]/usr/bin/git submodule foreach --recursive git config --local gc.auto 0 2024-08-22T20:28:13.0095475Z ##[endgroup] 2024-08-22T20:28:13.0096064Z ##[group]Persisting credentials for submodules 2024-08-22T20:28:13.0100698Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'url\.https\:\/\/github\.com\/\.insteadOf' && git config --local --unset-all 'url.https://github.com/.insteadOf' || :" 2024-08-22T20:28:13.0457306Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local 'http.https://github.com/.extraheader' 'AUTHORIZATION: basic ***' && git config --local --show-origin --name-only --get-regexp remote.origin.url" 2024-08-22T20:28:13.0807033Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'git@github.com:' 2024-08-22T20:28:13.1159382Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'org-21003710@github.com:' 2024-08-22T20:28:13.1513803Z ##[endgroup] 2024-08-22T20:28:13.1565640Z [command]/usr/bin/git log -1 --format='%H' 2024-08-22T20:28:13.1606361Z '6dab351bed7d1c647665a8b8e883ec5b1c973feb' 2024-08-22T20:28:13.1905889Z Prepare all required actions 2024-08-22T20:28:13.1906385Z Getting action download info 2024-08-22T20:28:13.2723648Z Download action repository 'pytorch/test-infra@main' (SHA:6dab351bed7d1c647665a8b8e883ec5b1c973feb) 2024-08-22T20:28:13.7629558Z Getting action download info 2024-08-22T20:28:13.8807605Z Download action repository 'nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482' (SHA:3e91a01664abd3c5cd539100d10d33b9c5b68482) 2024-08-22T20:28:14.1159472Z ##[group]Run ./test-infra/.github/actions/setup-linux 2024-08-22T20:28:14.1159952Z env: 2024-08-22T20:28:14.1160289Z DOCKER_IMAGE: pytorch/conda-builder:cuda12.1 2024-08-22T20:28:14.1160738Z REPOSITORY: pytorch/torchchat 2024-08-22T20:28:14.1161112Z PR_NUMBER: 1044 2024-08-22T20:28:14.1163233Z SCRIPT: echo "::group::Print machine info" uname -a echo "::endgroup::" echo "::group::Install newer objcopy that supports --set-section-alignment" yum install -y devtoolset-10-binutils export PATH=/opt/rh/devtoolset-10/root/usr/bin/:$PATH echo "::endgroup::" TORCHCHAT_DEVICE=cpu .ci/scripts/run-docs evaluation echo "::group::Completion" echo "tests complete" echo "*******************************************" echo "::endgroup::" 2024-08-22T20:28:14.1165384Z ##[endgroup] 2024-08-22T20:28:14.1357058Z ##[group]Run set -euo pipefail 2024-08-22T20:28:14.1357469Z set -euo pipefail 2024-08-22T20:28:14.1357852Z function get_ec2_metadata() { 2024-08-22T20:28:14.1358364Z  # Pulled from instance metadata endpoint for EC2 2024-08-22T20:28:14.1359259Z  # see https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/instancedata-data-retrieval.html 2024-08-22T20:28:14.1360201Z  category=$1 2024-08-22T20:28:14.1360719Z  curl -fsSL "http://169.254.169.254/latest/meta-data/${category}" 2024-08-22T20:28:14.1361283Z } 2024-08-22T20:28:14.1361629Z echo "ami-id: $(get_ec2_metadata ami-id)" 2024-08-22T20:28:14.1362212Z echo "instance-id: $(get_ec2_metadata instance-id)" 2024-08-22T20:28:14.1362854Z echo "instance-type: $(get_ec2_metadata instance-type)" 2024-08-22T20:28:14.1363410Z echo "system info $(uname -a)" 2024-08-22T20:28:14.1372446Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-22T20:28:14.1372967Z env: 2024-08-22T20:28:14.1373345Z DOCKER_IMAGE: pytorch/conda-builder:cuda12.1 2024-08-22T20:28:14.1373818Z REPOSITORY: pytorch/torchchat 2024-08-22T20:28:14.1374197Z PR_NUMBER: 1044 2024-08-22T20:28:14.1376283Z SCRIPT: echo "::group::Print machine info" uname -a echo "::endgroup::" echo "::group::Install newer objcopy that supports --set-section-alignment" yum install -y devtoolset-10-binutils export PATH=/opt/rh/devtoolset-10/root/usr/bin/:$PATH echo "::endgroup::" TORCHCHAT_DEVICE=cpu .ci/scripts/run-docs evaluation echo "::group::Completion" echo "tests complete" echo "*******************************************" echo "::endgroup::" 2024-08-22T20:28:14.1378513Z ##[endgroup] 2024-08-22T20:28:14.1468758Z ami-id: ami-06c68f701d8090592 2024-08-22T20:28:14.1527627Z instance-id: i-043a091e27bd81c57 2024-08-22T20:28:14.1583683Z instance-type: g5.4xlarge 2024-08-22T20:28:14.1596978Z system info Linux ip-10-0-56-93.ec2.internal 6.1.94-99.176.amzn2023.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Jun 18 14:57:56 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux 2024-08-22T20:28:14.1629539Z ##[group]Run if systemctl is-active --quiet docker; then 2024-08-22T20:28:14.1630135Z if systemctl is-active --quiet docker; then 2024-08-22T20:28:14.1630689Z  echo "Docker daemon is running..."; 2024-08-22T20:28:14.1631182Z else 2024-08-22T20:28:14.1631667Z  echo "Starting docker deamon..." && sudo systemctl start docker; 2024-08-22T20:28:14.1632238Z fi 2024-08-22T20:28:14.1641737Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-22T20:28:14.1642232Z env: 2024-08-22T20:28:14.1642560Z DOCKER_IMAGE: pytorch/conda-builder:cuda12.1 2024-08-22T20:28:14.1643213Z REPOSITORY: pytorch/torchchat 2024-08-22T20:28:14.1643591Z PR_NUMBER: 1044 2024-08-22T20:28:14.1645696Z SCRIPT: echo "::group::Print machine info" uname -a echo "::endgroup::" echo "::group::Install newer objcopy that supports --set-section-alignment" yum install -y devtoolset-10-binutils export PATH=/opt/rh/devtoolset-10/root/usr/bin/:$PATH echo "::endgroup::" TORCHCHAT_DEVICE=cpu .ci/scripts/run-docs evaluation echo "::group::Completion" echo "tests complete" echo "*******************************************" echo "::endgroup::" 2024-08-22T20:28:14.1647856Z ##[endgroup] 2024-08-22T20:28:14.1737214Z Docker daemon is running... 2024-08-22T20:28:14.1763700Z ##[group]Run AWS_ACCOUNT_ID=$(aws sts get-caller-identity|grep Account|cut -f4 -d\") 2024-08-22T20:28:14.1764564Z AWS_ACCOUNT_ID=$(aws sts get-caller-identity|grep Account|cut -f4 -d\") 2024-08-22T20:28:14.1765280Z retry () { "$@" || (sleep 1 && "$@") || (sleep 2 && "$@") } 2024-08-22T20:28:14.1766152Z retry aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \ 2024-08-22T20:28:14.1767137Z  --password-stdin "$AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com" 2024-08-22T20:28:14.1776046Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-22T20:28:14.1776549Z env: 2024-08-22T20:28:14.1776880Z DOCKER_IMAGE: pytorch/conda-builder:cuda12.1 2024-08-22T20:28:14.1777344Z REPOSITORY: pytorch/torchchat 2024-08-22T20:28:14.1777740Z PR_NUMBER: 1044 2024-08-22T20:28:14.1779842Z SCRIPT: echo "::group::Print machine info" uname -a echo "::endgroup::" echo "::group::Install newer objcopy that supports --set-section-alignment" yum install -y devtoolset-10-binutils export PATH=/opt/rh/devtoolset-10/root/usr/bin/:$PATH echo "::endgroup::" TORCHCHAT_DEVICE=cpu .ci/scripts/run-docs evaluation echo "::group::Completion" echo "tests complete" echo "*******************************************" echo "::endgroup::" 2024-08-22T20:28:14.1782264Z AWS_RETRY_MODE: standard 2024-08-22T20:28:14.1782625Z AWS_MAX_ATTEMPTS: 5 2024-08-22T20:28:14.1782958Z AWS_DEFAULT_REGION: us-east-1 2024-08-22T20:28:14.1783335Z ##[endgroup] 2024-08-22T20:28:15.3020960Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-08-22T20:28:15.3021752Z Configure a credential helper to remove this warning. See 2024-08-22T20:28:15.3022630Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-08-22T20:28:15.3023275Z 2024-08-22T20:28:15.3023452Z Login Succeeded 2024-08-22T20:28:15.3073484Z ##[group]Run env | grep '^GITHUB' >> "${RUNNER_TEMP}/github_env_${GITHUB_RUN_ID}" 2024-08-22T20:28:15.3074268Z env | grep '^GITHUB' >> "${RUNNER_TEMP}/github_env_${GITHUB_RUN_ID}" 2024-08-22T20:28:15.3074974Z env | grep '^CI' >> "${RUNNER_TEMP}/github_env_${GITHUB_RUN_ID}" 2024-08-22T20:28:15.3084231Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-22T20:28:15.3084724Z env: 2024-08-22T20:28:15.3085060Z DOCKER_IMAGE: pytorch/conda-builder:cuda12.1 2024-08-22T20:28:15.3085516Z REPOSITORY: pytorch/torchchat 2024-08-22T20:28:15.3085881Z PR_NUMBER: 1044 2024-08-22T20:28:15.3087971Z SCRIPT: echo "::group::Print machine info" uname -a echo "::endgroup::" echo "::group::Install newer objcopy that supports --set-section-alignment" yum install -y devtoolset-10-binutils export PATH=/opt/rh/devtoolset-10/root/usr/bin/:$PATH echo "::endgroup::" TORCHCHAT_DEVICE=cpu .ci/scripts/run-docs evaluation echo "::group::Completion" echo "tests complete" echo "*******************************************" echo "::endgroup::" 2024-08-22T20:28:15.3090135Z ##[endgroup] 2024-08-22T20:28:15.3187360Z ##[group]Run RUNNER_ARTIFACT_DIR="${RUNNER_TEMP}/artifacts" 2024-08-22T20:28:15.3187962Z RUNNER_ARTIFACT_DIR="${RUNNER_TEMP}/artifacts" 2024-08-22T20:28:15.3188493Z sudo rm -rf "${RUNNER_ARTIFACT_DIR}" 2024-08-22T20:28:15.3188971Z mkdir -p "${RUNNER_ARTIFACT_DIR}" 2024-08-22T20:28:15.3189762Z echo "RUNNER_ARTIFACT_DIR=${RUNNER_ARTIFACT_DIR}" >> "${GITHUB_ENV}" 2024-08-22T20:28:15.3190321Z  2024-08-22T20:28:15.3190772Z RUNNER_TEST_RESULTS_DIR="${RUNNER_TEMP}/test-results" 2024-08-22T20:28:15.3191345Z sudo rm -rf "${RUNNER_TEST_RESULTS_DIR}" 2024-08-22T20:28:15.3191839Z mkdir -p "${RUNNER_TEST_RESULTS_DIR}" 2024-08-22T20:28:15.3192478Z echo "RUNNER_TEST_RESULTS_DIR=${RUNNER_TEST_RESULTS_DIR}" >> "${GITHUB_ENV}" 2024-08-22T20:28:15.3193071Z  2024-08-22T20:28:15.3193392Z RUNNER_DOCS_DIR="${RUNNER_TEMP}/docs" 2024-08-22T20:28:15.3193874Z sudo rm -rf "${RUNNER_DOCS_DIR}" 2024-08-22T20:28:15.3194320Z mkdir -p "${RUNNER_DOCS_DIR}" 2024-08-22T20:28:15.3194861Z echo "RUNNER_DOCS_DIR=${RUNNER_DOCS_DIR}" >> "${GITHUB_ENV}" 2024-08-22T20:28:15.3203349Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-22T20:28:15.3203849Z env: 2024-08-22T20:28:15.3204182Z DOCKER_IMAGE: pytorch/conda-builder:cuda12.1 2024-08-22T20:28:15.3204638Z REPOSITORY: pytorch/torchchat 2024-08-22T20:28:15.3205016Z PR_NUMBER: 1044 2024-08-22T20:28:15.3207101Z SCRIPT: echo "::group::Print machine info" uname -a echo "::endgroup::" echo "::group::Install newer objcopy that supports --set-section-alignment" yum install -y devtoolset-10-binutils export PATH=/opt/rh/devtoolset-10/root/usr/bin/:$PATH echo "::endgroup::" TORCHCHAT_DEVICE=cpu .ci/scripts/run-docs evaluation echo "::group::Completion" echo "tests complete" echo "*******************************************" echo "::endgroup::" 2024-08-22T20:28:15.3209443Z ##[endgroup] 2024-08-22T20:28:15.5390868Z ##[group]Run needs=0 2024-08-22T20:28:15.5391190Z needs=0 2024-08-22T20:28:15.5391707Z if lspci -v | grep -e 'controller.*NVIDIA' >/dev/null 2>/dev/null; then 2024-08-22T20:28:15.5392302Z  needs=1 2024-08-22T20:28:15.5392593Z fi 2024-08-22T20:28:15.5392940Z echo "does=${needs}" >> $GITHUB_OUTPUT 2024-08-22T20:28:15.5402121Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-22T20:28:15.5402613Z env: 2024-08-22T20:28:15.5402939Z DOCKER_IMAGE: pytorch/conda-builder:cuda12.1 2024-08-22T20:28:15.5403397Z REPOSITORY: pytorch/torchchat 2024-08-22T20:28:15.5403768Z PR_NUMBER: 1044 2024-08-22T20:28:15.5405853Z SCRIPT: echo "::group::Print machine info" uname -a echo "::endgroup::" echo "::group::Install newer objcopy that supports --set-section-alignment" yum install -y devtoolset-10-binutils export PATH=/opt/rh/devtoolset-10/root/usr/bin/:$PATH echo "::endgroup::" TORCHCHAT_DEVICE=cpu .ci/scripts/run-docs evaluation echo "::group::Completion" echo "tests complete" echo "*******************************************" echo "::endgroup::" 2024-08-22T20:28:15.5408198Z RUNNER_ARTIFACT_DIR: /home/ec2-user/actions-runner/_work/_temp/artifacts 2024-08-22T20:28:15.5408972Z RUNNER_TEST_RESULTS_DIR: /home/ec2-user/actions-runner/_work/_temp/test-results 2024-08-22T20:28:15.5409703Z RUNNER_DOCS_DIR: /home/ec2-user/actions-runner/_work/_temp/docs 2024-08-22T20:28:15.5410197Z ##[endgroup] 2024-08-22T20:28:15.5721269Z ##[group]Run pytorch/test-infra/.github/actions/setup-nvidia@main 2024-08-22T20:28:15.5721794Z with: 2024-08-22T20:28:15.5722073Z driver-version: 550.54.15 2024-08-22T20:28:15.5722411Z env: 2024-08-22T20:28:15.5722722Z DOCKER_IMAGE: pytorch/conda-builder:cuda12.1 2024-08-22T20:28:15.5723176Z REPOSITORY: pytorch/torchchat 2024-08-22T20:28:15.5723554Z PR_NUMBER: 1044 2024-08-22T20:28:15.5725647Z SCRIPT: echo "::group::Print machine info" uname -a echo "::endgroup::" echo "::group::Install newer objcopy that supports --set-section-alignment" yum install -y devtoolset-10-binutils export PATH=/opt/rh/devtoolset-10/root/usr/bin/:$PATH echo "::endgroup::" TORCHCHAT_DEVICE=cpu .ci/scripts/run-docs evaluation echo "::group::Completion" echo "tests complete" echo "*******************************************" echo "::endgroup::" 2024-08-22T20:28:15.5728189Z RUNNER_ARTIFACT_DIR: /home/ec2-user/actions-runner/_work/_temp/artifacts 2024-08-22T20:28:15.5728953Z RUNNER_TEST_RESULTS_DIR: /home/ec2-user/actions-runner/_work/_temp/test-results 2024-08-22T20:28:15.5729679Z RUNNER_DOCS_DIR: /home/ec2-user/actions-runner/_work/_temp/docs 2024-08-22T20:28:15.5730194Z ##[endgroup] 2024-08-22T20:28:15.5774170Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2024-08-22T20:28:15.5774722Z with: 2024-08-22T20:28:15.5774989Z timeout_minutes: 10 2024-08-22T20:28:15.5775317Z max_attempts: 3 2024-08-22T20:28:15.5807974Z command: # Is it disgusting to have a full shell script here in this github action? Sure # But is it the best way to make it so that this action relies on nothing else? Absolutely set -eou pipefail DISTRIBUTION=$(. /etc/os-release;echo $ID$VERSION_ID) DRIVER_FN="NVIDIA-Linux-x86_64-${DRIVER_VERSION}.run" install_nvidia_docker2_amzn2() { ( set -x # Needed for yum-config-manager sudo yum install -y yum-utils if [[ "${DISTRIBUTION}" == "amzn2023" ]] ; then YUM_REPO_URL="https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo" else # Amazon Linux 2 YUM_REPO_URL="https://nvidia.github.io/nvidia-docker/${DISTRIBUTION}/nvidia-docker.repo" fi sudo yum-config-manager --add-repo "${YUM_REPO_URL}" sudo yum install -y nvidia-docker2 sudo systemctl restart docker ) } install_nvidia_docker2_ubuntu20() { ( set -x # Install nvidia-driver package if not installed status="$(dpkg-query -W --showformat='${db:Status-Status}' nvidia-docker2 2>&1)" if [ ! $? = 0 ] || [ ! "$status" = installed ]; then sudo apt-get install -y nvidia-docker2 sudo systemctl restart docker fi ) } pre_install_nvidia_driver_amzn2() { ( # Purge any nvidia driver installed from RHEL repo sudo yum remove -y nvidia-driver-latest-dkms ) } install_nvidia_driver_common() { ( # Try to gather more information about the runner and its existing NVIDIA driver if any echo "Before installing NVIDIA driver" lspci lsmod modinfo nvidia || true HAS_NVIDIA_DRIVER=0 # Check if NVIDIA driver has already been installed if [ -x "$(command -v nvidia-smi)" ]; then set +e # The driver exists, check its version next. Also check only the first GPU if there are more than one of them # so that the same driver version is not print over multiple lines INSTALLED_DRIVER_VERSION=$(nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0) NVIDIA_SMI_STATUS=$? if [ "$NVIDIA_SMI_STATUS" -ne 0 ] && [ "$NVIDIA_SMI_STATUS" -ne 14 ]; then echo "Failed to get NVIDIA driver version ($INSTALLED_DRIVER_VERSION). Continuing" elif [ "$INSTALLED_DRIVER_VERSION" != "$DRIVER_VERSION" ]; then echo "NVIDIA driver ($INSTALLED_DRIVER_VERSION) has been installed, but we expect to have $DRIVER_VERSION instead. Continuing" else HAS_NVIDIA_DRIVER=1 echo "NVIDIA driver ($INSTALLED_DRIVER_VERSION) has already been installed. Skipping NVIDIA driver installation" fi set -e fi if [ "$HAS_NVIDIA_DRIVER" -eq 0 ]; then # CAUTION: this may need to be updated in future if [ "${DISTRIBUTION}" != ubuntu20.04 ]; then sudo yum groupinstall -y "Development Tools" # ensure our kernel install is the same as our underlying kernel, # groupinstall "Development Tools" has a habit of mismatching kernel headers sudo yum install -y "kernel-devel-uname-r == $(uname -r)" sudo modprobe backlight fi sudo curl -fsL -o /tmp/nvidia_driver "https://s3.amazonaws.com/ossci-linux/nvidia_driver/$DRIVER_FN" set +e sudo /bin/bash /tmp/nvidia_driver -s --no-drm NVIDIA_INSTALLATION_STATUS=$? RESET_GPU=0 if [ "$NVIDIA_INSTALLATION_STATUS" -ne 0 ]; then sudo cat /var/log/nvidia-installer.log # Fail to install NVIDIA driver, try to reset the GPU RESET_GPU=1 elif [ -x "$(command -v nvidia-smi)" ]; then # Check again if nvidia-smi works even if the driver installation completes successfully INSTALLED_DRIVER_VERSION=$(nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0) NVIDIA_SMI_STATUS=$? if [ "$NVIDIA_SMI_STATUS" -ne 0 ] && [ "$NVIDIA_SMI_STATUS" -ne 14 ]; then RESET_GPU=1 fi fi if [ "$RESET_GPU" -eq 1 ]; then NVIDIA_DEVICES=$(lspci -D | grep -i NVIDIA | cut -d' ' -f1) # The GPU can get stuck in a failure state if somehow the test crashs the GPU microcode. When this # happens, we'll try to reset all NVIDIA devices https://github.com/pytorch/pytorch/issues/88388 for PCI_ID in $NVIDIA_DEVICES; do DEVICE_ENABLED=$(cat /sys/bus/pci/devices/$PCI_ID/enable) echo "Reseting $PCI_ID (enabled state: $DEVICE_ENABLED)" # This requires sudo permission of course echo "1" | sudo tee /sys/bus/pci/devices/$PCI_ID/reset sleep 1 done fi sudo rm -fv /tmp/nvidia_driver set -e fi ) } post_install_nvidia_driver_common() { ( sudo modprobe nvidia || true echo "After installing NVIDIA driver" lspci lsmod modinfo nvidia || true ( set +e nvidia-smi # NB: Annoyingly, nvidia-smi command returns successfully with return code 0 even in # the case where the driver has already crashed as it still can get the driver version # and some basic information like the bus ID. However, the rest of the information # would be missing (ERR!), for example: # # +-----------------------------------------------------------------------------+ # | NVIDIA-SMI 525.89.02 Driver Version: 525.89.02 CUDA Version: 12.0 | # |-------------------------------+----------------------+----------------------+ # | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | # | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | # | | | MIG M. | # |===============================+======================+======================| # | 0 ERR! Off | 00000000:00:1E.0 Off | ERR! | # |ERR! ERR! ERR! ERR! / ERR! | 4184MiB / 23028MiB | ERR! Default | # | | | ERR! | # +-------------------------------+----------------------+----------------------+ # # +-----------------------------------------------------------------------------+ # | Processes: | # | GPU GI CI PID Type Process name GPU Memory | # | ID ID Usage | # |=============================================================================| # +-----------------------------------------------------------------------------+ # # This should be reported as a failure instead as it will guarantee to fail when # Docker tries to run with --gpus all # # So, the correct check here is to query one of the missing piece of info like # GPU name, so that the command can fail accordingly nvidia-smi --query-gpu=gpu_name --format=csv,noheader --id=0 NVIDIA_SMI_STATUS=$? # Allowable exit statuses for nvidia-smi, see: https://github.com/NVIDIA/gpu-operator/issues/285 if [ "$NVIDIA_SMI_STATUS" -eq 0 ] || [ "$NVIDIA_SMI_STATUS" -eq 14 ]; then echo "INFO: Ignoring allowed status ${NVIDIA_SMI_STATUS}" else echo "ERROR: nvidia-smi exited with unresolved status ${NVIDIA_SMI_STATUS}" exit ${NVIDIA_SMI_STATUS} fi set -e ) ) } install_nvidia_driver_amzn2() { ( set -x pre_install_nvidia_driver_amzn2 install_nvidia_driver_common post_install_nvidia_driver_common ) } install_nvidia_driver_ubuntu20() { ( set -x install_nvidia_driver_common post_install_nvidia_driver_common ) } echo "== Installing nvidia driver ${DRIVER_FN} ==" case "${DISTRIBUTION}" in amzn*) install_nvidia_driver_amzn2 ;; ubuntu20.04) install_nvidia_driver_ubuntu20 ;; *) echo "ERROR: Unknown distribution ${DISTRIBUTION}" exit 1 ;; esac # Install container toolkit based on distribution echo "== Installing nvidia container toolkit for ${DISTRIBUTION} ==" case "${DISTRIBUTION}" in amzn*) install_nvidia_docker2_amzn2 ;; ubuntu20.04) install_nvidia_docker2_ubuntu20 ;; *) echo "ERROR: Unknown distribution ${DISTRIBUTION}" exit 1 ;; esac echo "GPU_FLAG=--gpus all -e NVIDIA_DRIVER_CAPABILITIES=all" >> "${GITHUB_ENV}" # Fix https://github.com/NVIDIA/nvidia-docker/issues/1648 on runners with # more than one GPUs. This just needs to be run once. The command fails # on subsequent runs and complains that the mode is already on, but that's # ok sudo nvidia-persistenced || true # This should show persistence mode ON nvidia-smi 2024-08-22T20:28:15.5842251Z retry_wait_seconds: 10 2024-08-22T20:28:15.5842616Z polling_interval_seconds: 1 2024-08-22T20:28:15.5842982Z warning_on_retry: true 2024-08-22T20:28:15.5843328Z continue_on_error: false 2024-08-22T20:28:15.5843662Z env: 2024-08-22T20:28:15.5843966Z DOCKER_IMAGE: pytorch/conda-builder:cuda12.1 2024-08-22T20:28:15.5844421Z REPOSITORY: pytorch/torchchat 2024-08-22T20:28:15.5844798Z PR_NUMBER: 1044 2024-08-22T20:28:15.5846876Z SCRIPT: echo "::group::Print machine info" uname -a echo "::endgroup::" echo "::group::Install newer objcopy that supports --set-section-alignment" yum install -y devtoolset-10-binutils export PATH=/opt/rh/devtoolset-10/root/usr/bin/:$PATH echo "::endgroup::" TORCHCHAT_DEVICE=cpu .ci/scripts/run-docs evaluation echo "::group::Completion" echo "tests complete" echo "*******************************************" echo "::endgroup::" 2024-08-22T20:28:15.5849227Z RUNNER_ARTIFACT_DIR: /home/ec2-user/actions-runner/_work/_temp/artifacts 2024-08-22T20:28:15.5849994Z RUNNER_TEST_RESULTS_DIR: /home/ec2-user/actions-runner/_work/_temp/test-results 2024-08-22T20:28:15.5850772Z RUNNER_DOCS_DIR: /home/ec2-user/actions-runner/_work/_temp/docs 2024-08-22T20:28:15.5851288Z DRIVER_VERSION: 550.54.15 2024-08-22T20:28:15.5851634Z ##[endgroup] 2024-08-22T20:28:15.6675343Z == Installing nvidia driver NVIDIA-Linux-x86_64-550.54.15.run == 2024-08-22T20:28:15.6676226Z + pre_install_nvidia_driver_amzn2 2024-08-22T20:28:15.6678885Z + sudo yum remove -y nvidia-driver-latest-dkms 2024-08-22T20:28:16.0603240Z No match for argument: nvidia-driver-latest-dkms 2024-08-22T20:28:16.0603762Z No packages marked for removal. 2024-08-22T20:28:16.0683655Z Dependencies resolved. 2024-08-22T20:28:16.0693480Z Nothing to do. 2024-08-22T20:28:16.0693778Z Complete! 2024-08-22T20:28:16.1162999Z + install_nvidia_driver_common 2024-08-22T20:28:16.1165909Z + echo 'Before installing NVIDIA driver' 2024-08-22T20:28:16.1166543Z Before installing NVIDIA driver 2024-08-22T20:28:16.1167258Z + lspci 2024-08-22T20:28:16.1275333Z 00:00.0 Host bridge: Intel Corporation 440FX - 82441FX PMC [Natoma] 2024-08-22T20:28:16.1276159Z 00:01.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II] 2024-08-22T20:28:16.1277091Z 00:01.3 Non-VGA unclassified device: Intel Corporation 82371AB/EB/MB PIIX4 ACPI (rev 08) 2024-08-22T20:28:16.1277885Z 00:03.0 VGA compatible controller: Amazon.com, Inc. Device 1111 2024-08-22T20:28:16.1278677Z 00:04.0 Non-Volatile memory controller: Amazon.com, Inc. NVMe EBS Controller 2024-08-22T20:28:16.1279459Z 00:05.0 Ethernet controller: Amazon.com, Inc. Elastic Network Adapter (ENA) 2024-08-22T20:28:16.1280194Z 00:1e.0 3D controller: NVIDIA Corporation GA102GL [A10G] (rev a1) 2024-08-22T20:28:16.1281043Z 00:1f.0 Non-Volatile memory controller: Amazon.com, Inc. NVMe SSD Controller 2024-08-22T20:28:16.1281631Z + lsmod 2024-08-22T20:28:16.1348164Z Module Size Used by 2024-08-22T20:28:16.1348581Z veth 36864 0 2024-08-22T20:28:16.1348952Z nvidia_modeset 1351680 0 2024-08-22T20:28:16.1349379Z video 65536 1 nvidia_modeset 2024-08-22T20:28:16.1349816Z wmi 36864 1 video 2024-08-22T20:28:16.1350208Z nvidia_uvm 4706304 0 2024-08-22T20:28:16.1350674Z nvidia 54071296 7 nvidia_uvm,nvidia_modeset 2024-08-22T20:28:16.1351173Z drm 602112 1 nvidia 2024-08-22T20:28:16.1351608Z drm_panel_orientation_quirks 28672 1 drm 2024-08-22T20:28:16.1352135Z backlight 24576 3 video,drm,nvidia_modeset 2024-08-22T20:28:16.1352631Z i2c_core 106496 2 nvidia,drm 2024-08-22T20:28:16.1353271Z xt_conntrack 16384 1 2024-08-22T20:28:16.1353645Z nft_chain_nat 16384 3 2024-08-22T20:28:16.1354011Z xt_MASQUERADE 20480 1 2024-08-22T20:28:16.1354455Z nf_nat 57344 2 nft_chain_nat,xt_MASQUERADE 2024-08-22T20:28:16.1354937Z nf_conntrack_netlink 57344 0 2024-08-22T20:28:16.1355510Z nf_conntrack 184320 4 xt_conntrack,nf_nat,nf_conntrack_netlink,xt_MASQUERADE 2024-08-22T20:28:16.1356224Z nf_defrag_ipv6 24576 1 nf_conntrack 2024-08-22T20:28:16.1356693Z nf_defrag_ipv4 16384 1 nf_conntrack 2024-08-22T20:28:16.1357117Z xfrm_user 57344 1 2024-08-22T20:28:16.1357512Z xfrm_algo 16384 1 xfrm_user 2024-08-22T20:28:16.1357929Z xt_addrtype 16384 2 2024-08-22T20:28:16.1358329Z nft_compat 20480 4 2024-08-22T20:28:16.1358784Z nf_tables 307200 57 nft_compat,nft_chain_nat 2024-08-22T20:28:16.1359395Z nfnetlink 20480 4 nft_compat,nf_conntrack_netlink,nf_tables 2024-08-22T20:28:16.1359940Z br_netfilter 36864 0 2024-08-22T20:28:16.1360346Z bridge 307200 1 br_netfilter 2024-08-22T20:28:16.1360790Z stp 16384 1 bridge 2024-08-22T20:28:16.1361212Z llc 16384 2 bridge,stp 2024-08-22T20:28:16.1361621Z overlay 167936 0 2024-08-22T20:28:16.1361996Z tls 114688 0 2024-08-22T20:28:16.1362380Z nls_ascii 16384 1 2024-08-22T20:28:16.1362753Z nls_cp437 20480 1 2024-08-22T20:28:16.1363114Z vfat 24576 1 2024-08-22T20:28:16.1363481Z fat 86016 1 vfat 2024-08-22T20:28:16.1363864Z sunrpc 692224 1 2024-08-22T20:28:16.1364230Z ena 167936 0 2024-08-22T20:28:16.1364603Z ghash_clmulni_intel 16384 0 2024-08-22T20:28:16.1364977Z ptp 36864 1 ena 2024-08-22T20:28:16.1365379Z pps_core 24576 1 ptp 2024-08-22T20:28:16.1365778Z aesni_intel 393216 0 2024-08-22T20:28:16.1366142Z i8042 45056 0 2024-08-22T20:28:16.1366514Z serio 28672 3 i8042 2024-08-22T20:28:16.1366938Z crypto_simd 16384 1 aesni_intel 2024-08-22T20:28:16.1367459Z cryptd 28672 2 crypto_simd,ghash_clmulni_intel 2024-08-22T20:28:16.1367961Z button 24576 0 2024-08-22T20:28:16.1368326Z sch_fq_codel 20480 17 2024-08-22T20:28:16.1368907Z dm_mod 188416 0 2024-08-22T20:28:16.1369418Z fuse 163840 1 2024-08-22T20:28:16.1369810Z configfs 57344 1 2024-08-22T20:28:16.1370190Z dax 45056 1 dm_mod 2024-08-22T20:28:16.1370613Z loop 36864 0 2024-08-22T20:28:16.1371021Z dmi_sysfs 20480 0 2024-08-22T20:28:16.1371501Z crc32_pclmul 16384 0 2024-08-22T20:28:16.1371879Z crc32c_intel 24576 0 2024-08-22T20:28:16.1372236Z efivarfs 24576 1 2024-08-22T20:28:16.1372602Z + modinfo nvidia 2024-08-22T20:28:16.1373303Z filename: /lib/modules/6.1.94-99.176.amzn2023.x86_64/kernel/drivers/video/nvidia.ko 2024-08-22T20:28:16.1374002Z alias: char-major-195-* 2024-08-22T20:28:16.1374388Z version: 550.54.15 2024-08-22T20:28:16.1374730Z supported: external 2024-08-22T20:28:16.1375060Z license: NVIDIA 2024-08-22T20:28:16.1375431Z firmware: nvidia/550.54.15/gsp_tu10x.bin 2024-08-22T20:28:16.1375921Z firmware: nvidia/550.54.15/gsp_ga10x.bin 2024-08-22T20:28:16.1376367Z srcversion: 833721318DA517F0C2FEC97 2024-08-22T20:28:16.1376830Z alias: pci:v000010DEd*sv*sd*bc06sc80i00* 2024-08-22T20:28:16.1377326Z alias: pci:v000010DEd*sv*sd*bc03sc02i00* 2024-08-22T20:28:16.1377802Z alias: pci:v000010DEd*sv*sd*bc03sc00i00* 2024-08-22T20:28:16.1378292Z depends: i2c-core,drm 2024-08-22T20:28:16.1378647Z retpoline: Y 2024-08-22T20:28:16.1378948Z name: nvidia 2024-08-22T20:28:16.1379554Z vermagic: 6.1.94-99.176.amzn2023.x86_64 SMP preempt mod_unload modversions 2024-08-22T20:28:16.1380364Z parm: NvSwitchRegDwords:NvSwitch regkey (charp) 2024-08-22T20:28:16.1381001Z parm: NvSwitchBlacklist:NvSwitchBlacklist=uuid[,uuid...] (charp) 2024-08-22T20:28:16.1381586Z parm: NVreg_ResmanDebugLevel:int 2024-08-22T20:28:16.1382025Z parm: NVreg_RmLogonRC:int 2024-08-22T20:28:16.1382456Z parm: NVreg_ModifyDeviceFiles:int 2024-08-22T20:28:16.1382908Z parm: NVreg_DeviceFileUID:int 2024-08-22T20:28:16.1383332Z parm: NVreg_DeviceFileGID:int 2024-08-22T20:28:16.1383765Z parm: NVreg_DeviceFileMode:int 2024-08-22T20:28:16.1384287Z parm: NVreg_InitializeSystemMemoryAllocations:int 2024-08-22T20:28:16.1384836Z parm: NVreg_UsePageAttributeTable:int 2024-08-22T20:28:16.1385311Z parm: NVreg_EnablePCIeGen3:int 2024-08-22T20:28:16.1385738Z parm: NVreg_EnableMSI:int 2024-08-22T20:28:16.1386140Z parm: NVreg_TCEBypassMode:int 2024-08-22T20:28:16.1386604Z parm: NVreg_EnableStreamMemOPs:int 2024-08-22T20:28:16.1387128Z parm: NVreg_RestrictProfilingToAdminUsers:int 2024-08-22T20:28:16.1387695Z parm: NVreg_PreserveVideoMemoryAllocations:int 2024-08-22T20:28:16.1388250Z parm: NVreg_EnableS0ixPowerManagement:int 2024-08-22T20:28:16.1388853Z parm: NVreg_S0ixPowerManagementVideoMemoryThreshold:int 2024-08-22T20:28:16.1389446Z parm: NVreg_DynamicPowerManagement:int 2024-08-22T20:28:16.1390054Z parm: NVreg_DynamicPowerManagementVideoMemoryThreshold:int 2024-08-22T20:28:16.1390640Z parm: NVreg_EnableGpuFirmware:int 2024-08-22T20:28:16.1391123Z parm: NVreg_EnableGpuFirmwareLogs:int 2024-08-22T20:28:16.1391649Z parm: NVreg_OpenRmEnableUnsupportedGpus:int 2024-08-22T20:28:16.1392188Z parm: NVreg_EnableUserNUMAManagement:int 2024-08-22T20:28:16.1392673Z parm: NVreg_MemoryPoolSize:int 2024-08-22T20:28:16.1393135Z parm: NVreg_KMallocHeapMaxSize:int 2024-08-22T20:28:16.1393615Z parm: NVreg_VMallocHeapMaxSize:int 2024-08-22T20:28:16.1394077Z parm: NVreg_IgnoreMMIOCheck:int 2024-08-22T20:28:16.1394520Z parm: NVreg_NvLinkDisable:int 2024-08-22T20:28:16.1395015Z parm: NVreg_EnablePCIERelaxedOrderingMode:int 2024-08-22T20:28:16.1395522Z parm: NVreg_RegisterPCIDriver:int 2024-08-22T20:28:16.1396177Z parm: NVreg_EnableResizableBar:int 2024-08-22T20:28:16.1396674Z parm: NVreg_EnableDbgBreakpoint:int 2024-08-22T20:28:16.1397159Z parm: NVreg_EnableNonblockingOpen:int 2024-08-22T20:28:16.1397635Z parm: NVreg_RegistryDwords:charp 2024-08-22T20:28:16.1398127Z parm: NVreg_RegistryDwordsPerDevice:charp 2024-08-22T20:28:16.1398601Z parm: NVreg_RmMsg:charp 2024-08-22T20:28:16.1398998Z parm: NVreg_GpuBlacklist:charp 2024-08-22T20:28:16.1399456Z parm: NVreg_TemporaryFilePath:charp 2024-08-22T20:28:16.1399923Z parm: NVreg_ExcludedGpus:charp 2024-08-22T20:28:16.1400368Z parm: NVreg_DmaRemapPeerMmio:int 2024-08-22T20:28:16.1400840Z parm: NVreg_RmNvlinkBandwidth:charp 2024-08-22T20:28:16.1401307Z parm: NVreg_ImexChannelCount:int 2024-08-22T20:28:16.1401742Z parm: rm_firmware_active:charp 2024-08-22T20:28:16.1402149Z + HAS_NVIDIA_DRIVER=0 2024-08-22T20:28:16.1402543Z ++ command -v nvidia-smi 2024-08-22T20:28:16.1402933Z + '[' -x /usr/bin/nvidia-smi ']' 2024-08-22T20:28:16.1403296Z + set +e 2024-08-22T20:28:16.1403796Z ++ nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0 2024-08-22T20:28:16.1681932Z + INSTALLED_DRIVER_VERSION=550.54.15 2024-08-22T20:28:16.1682346Z + NVIDIA_SMI_STATUS=0 2024-08-22T20:28:16.1682744Z + '[' 0 -ne 0 ']' 2024-08-22T20:28:16.1683106Z + '[' 550.54.15 '!=' 550.54.15 ']' 2024-08-22T20:28:16.1683569Z + HAS_NVIDIA_DRIVER=1 2024-08-22T20:28:16.1684528Z + echo 'NVIDIA driver (550.54.15) has already been installed. Skipping NVIDIA driver installation' 2024-08-22T20:28:16.1685659Z + set -e 2024-08-22T20:28:16.1686060Z + '[' 1 -eq 0 ']' 2024-08-22T20:28:16.1686792Z NVIDIA driver (550.54.15) has already been installed. Skipping NVIDIA driver installation 2024-08-22T20:28:16.1687473Z + post_install_nvidia_driver_common 2024-08-22T20:28:16.1689826Z + sudo modprobe nvidia 2024-08-22T20:28:16.2637673Z + echo 'After installing NVIDIA driver' 2024-08-22T20:28:16.2638311Z + lspci 2024-08-22T20:28:16.2638692Z After installing NVIDIA driver 2024-08-22T20:28:16.2744967Z 00:00.0 Host bridge: Intel Corporation 440FX - 82441FX PMC [Natoma] 2024-08-22T20:28:16.2745902Z 00:01.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II] 2024-08-22T20:28:16.2746831Z 00:01.3 Non-VGA unclassified device: Intel Corporation 82371AB/EB/MB PIIX4 ACPI (rev 08) 2024-08-22T20:28:16.2747616Z 00:03.0 VGA compatible controller: Amazon.com, Inc. Device 1111 2024-08-22T20:28:16.2748409Z 00:04.0 Non-Volatile memory controller: Amazon.com, Inc. NVMe EBS Controller 2024-08-22T20:28:16.2749190Z 00:05.0 Ethernet controller: Amazon.com, Inc. Elastic Network Adapter (ENA) 2024-08-22T20:28:16.2749911Z 00:1e.0 3D controller: NVIDIA Corporation GA102GL [A10G] (rev a1) 2024-08-22T20:28:16.2750703Z 00:1f.0 Non-Volatile memory controller: Amazon.com, Inc. NVMe SSD Controller 2024-08-22T20:28:16.2751281Z + lsmod 2024-08-22T20:28:16.2778388Z Module Size Used by 2024-08-22T20:28:16.2778810Z veth 36864 0 2024-08-22T20:28:16.2779197Z nvidia_modeset 1351680 0 2024-08-22T20:28:16.2779711Z video 65536 1 nvidia_modeset 2024-08-22T20:28:16.2780164Z wmi 36864 1 video 2024-08-22T20:28:16.2780548Z nvidia_uvm 4706304 0 2024-08-22T20:28:16.2780976Z nvidia 54071296 7 nvidia_uvm,nvidia_modeset 2024-08-22T20:28:16.2781449Z drm 602112 1 nvidia 2024-08-22T20:28:16.2781890Z drm_panel_orientation_quirks 28672 1 drm 2024-08-22T20:28:16.2782399Z backlight 24576 3 video,drm,nvidia_modeset 2024-08-22T20:28:16.2782903Z i2c_core 106496 2 nvidia,drm 2024-08-22T20:28:16.2783319Z xt_conntrack 16384 1 2024-08-22T20:28:16.2783682Z nft_chain_nat 16384 3 2024-08-22T20:28:16.2784048Z xt_MASQUERADE 20480 1 2024-08-22T20:28:16.2784487Z nf_nat 57344 2 nft_chain_nat,xt_MASQUERADE 2024-08-22T20:28:16.2784955Z nf_conntrack_netlink 57344 0 2024-08-22T20:28:16.2785754Z nf_conntrack 184320 4 xt_conntrack,nf_nat,nf_conntrack_netlink,xt_MASQUERADE 2024-08-22T20:28:16.2786388Z nf_defrag_ipv6 24576 1 nf_conntrack 2024-08-22T20:28:16.2786839Z nf_defrag_ipv4 16384 1 nf_conntrack 2024-08-22T20:28:16.2787254Z xfrm_user 57344 1 2024-08-22T20:28:16.2787634Z xfrm_algo 16384 1 xfrm_user 2024-08-22T20:28:16.2788043Z xt_addrtype 16384 2 2024-08-22T20:28:16.2788400Z nft_compat 20480 4 2024-08-22T20:28:16.2788839Z nf_tables 307200 57 nft_compat,nft_chain_nat 2024-08-22T20:28:16.2789434Z nfnetlink 20480 4 nft_compat,nf_conntrack_netlink,nf_tables 2024-08-22T20:28:16.2789953Z br_netfilter 36864 0 2024-08-22T20:28:16.2790355Z bridge 307200 1 br_netfilter 2024-08-22T20:28:16.2790787Z stp 16384 1 bridge 2024-08-22T20:28:16.2791189Z llc 16384 2 bridge,stp 2024-08-22T20:28:16.2791602Z overlay 167936 0 2024-08-22T20:28:16.2791959Z tls 114688 0 2024-08-22T20:28:16.2792311Z nls_ascii 16384 1 2024-08-22T20:28:16.2792667Z nls_cp437 20480 1 2024-08-22T20:28:16.2793021Z vfat 24576 1 2024-08-22T20:28:16.2793388Z fat 86016 1 vfat 2024-08-22T20:28:16.2793772Z sunrpc 692224 1 2024-08-22T20:28:16.2794129Z ena 167936 0 2024-08-22T20:28:16.2794482Z ghash_clmulni_intel 16384 0 2024-08-22T20:28:16.2794856Z ptp 36864 1 ena 2024-08-22T20:28:16.2795383Z pps_core 24576 1 ptp 2024-08-22T20:28:16.2795757Z aesni_intel 393216 0 2024-08-22T20:28:16.2796205Z i8042 45056 0 2024-08-22T20:28:16.2796565Z serio 28672 3 i8042 2024-08-22T20:28:16.2796965Z crypto_simd 16384 1 aesni_intel 2024-08-22T20:28:16.2797466Z cryptd 28672 2 crypto_simd,ghash_clmulni_intel 2024-08-22T20:28:16.2797959Z button 24576 0 2024-08-22T20:28:16.2798321Z sch_fq_codel 20480 17 2024-08-22T20:28:16.2798788Z dm_mod 188416 0 2024-08-22T20:28:16.2799268Z fuse 163840 1 2024-08-22T20:28:16.2799716Z configfs 57344 1 2024-08-22T20:28:16.2800195Z dax 45056 1 dm_mod 2024-08-22T20:28:16.2800616Z loop 36864 0 2024-08-22T20:28:16.2800971Z dmi_sysfs 20480 0 2024-08-22T20:28:16.2801335Z crc32_pclmul 16384 0 2024-08-22T20:28:16.2801697Z crc32c_intel 24576 0 2024-08-22T20:28:16.2802054Z efivarfs 24576 1 2024-08-22T20:28:16.2802411Z + modinfo nvidia 2024-08-22T20:28:16.2803093Z filename: /lib/modules/6.1.94-99.176.amzn2023.x86_64/kernel/drivers/video/nvidia.ko 2024-08-22T20:28:16.2803786Z alias: char-major-195-* 2024-08-22T20:28:16.2804152Z version: 550.54.15 2024-08-22T20:28:16.2804492Z supported: external 2024-08-22T20:28:16.2804825Z license: NVIDIA 2024-08-22T20:28:16.2805183Z firmware: nvidia/550.54.15/gsp_tu10x.bin 2024-08-22T20:28:16.2805653Z firmware: nvidia/550.54.15/gsp_ga10x.bin 2024-08-22T20:28:16.2806095Z srcversion: 833721318DA517F0C2FEC97 2024-08-22T20:28:16.2806544Z alias: pci:v000010DEd*sv*sd*bc06sc80i00* 2024-08-22T20:28:16.2807031Z alias: pci:v000010DEd*sv*sd*bc03sc02i00* 2024-08-22T20:28:16.2807500Z alias: pci:v000010DEd*sv*sd*bc03sc00i00* 2024-08-22T20:28:16.2807973Z depends: i2c-core,drm 2024-08-22T20:28:16.2808321Z retpoline: Y 2024-08-22T20:28:16.2808626Z name: nvidia 2024-08-22T20:28:16.2809220Z vermagic: 6.1.94-99.176.amzn2023.x86_64 SMP preempt mod_unload modversions 2024-08-22T20:28:16.2809905Z parm: NvSwitchRegDwords:NvSwitch regkey (charp) 2024-08-22T20:28:16.2810537Z parm: NvSwitchBlacklist:NvSwitchBlacklist=uuid[,uuid...] (charp) 2024-08-22T20:28:16.2811161Z parm: NVreg_ResmanDebugLevel:int 2024-08-22T20:28:16.2811708Z parm: NVreg_RmLogonRC:int 2024-08-22T20:28:16.2812134Z parm: NVreg_ModifyDeviceFiles:int 2024-08-22T20:28:16.2812571Z parm: NVreg_DeviceFileUID:int 2024-08-22T20:28:16.2812996Z parm: NVreg_DeviceFileGID:int 2024-08-22T20:28:16.2813418Z parm: NVreg_DeviceFileMode:int 2024-08-22T20:28:16.2813922Z parm: NVreg_InitializeSystemMemoryAllocations:int 2024-08-22T20:28:16.2814470Z parm: NVreg_UsePageAttributeTable:int 2024-08-22T20:28:16.2814937Z parm: NVreg_EnablePCIeGen3:int 2024-08-22T20:28:16.2815355Z parm: NVreg_EnableMSI:int 2024-08-22T20:28:16.2815759Z parm: NVreg_TCEBypassMode:int 2024-08-22T20:28:16.2816199Z parm: NVreg_EnableStreamMemOPs:int 2024-08-22T20:28:16.2816709Z parm: NVreg_RestrictProfilingToAdminUsers:int 2024-08-22T20:28:16.2817273Z parm: NVreg_PreserveVideoMemoryAllocations:int 2024-08-22T20:28:16.2817823Z parm: NVreg_EnableS0ixPowerManagement:int 2024-08-22T20:28:16.2818413Z parm: NVreg_S0ixPowerManagementVideoMemoryThreshold:int 2024-08-22T20:28:16.2818993Z parm: NVreg_DynamicPowerManagement:int 2024-08-22T20:28:16.2819589Z parm: NVreg_DynamicPowerManagementVideoMemoryThreshold:int 2024-08-22T20:28:16.2820170Z parm: NVreg_EnableGpuFirmware:int 2024-08-22T20:28:16.2820637Z parm: NVreg_EnableGpuFirmwareLogs:int 2024-08-22T20:28:16.2821204Z parm: NVreg_OpenRmEnableUnsupportedGpus:int 2024-08-22T20:28:16.2821732Z parm: NVreg_EnableUserNUMAManagement:int 2024-08-22T20:28:16.2822296Z parm: NVreg_MemoryPoolSize:int 2024-08-22T20:28:16.2822748Z parm: NVreg_KMallocHeapMaxSize:int 2024-08-22T20:28:16.2823217Z parm: NVreg_VMallocHeapMaxSize:int 2024-08-22T20:28:16.2823676Z parm: NVreg_IgnoreMMIOCheck:int 2024-08-22T20:28:16.2824151Z parm: NVreg_NvLinkDisable:int 2024-08-22T20:28:16.2824645Z parm: NVreg_EnablePCIERelaxedOrderingMode:int 2024-08-22T20:28:16.2825162Z parm: NVreg_RegisterPCIDriver:int 2024-08-22T20:28:16.2825620Z parm: NVreg_EnableResizableBar:int 2024-08-22T20:28:16.2826101Z parm: NVreg_EnableDbgBreakpoint:int 2024-08-22T20:28:16.2826591Z parm: NVreg_EnableNonblockingOpen:int 2024-08-22T20:28:16.2827056Z parm: NVreg_RegistryDwords:charp 2024-08-22T20:28:16.2827542Z parm: NVreg_RegistryDwordsPerDevice:charp 2024-08-22T20:28:16.2828010Z parm: NVreg_RmMsg:charp 2024-08-22T20:28:16.2828405Z parm: NVreg_GpuBlacklist:charp 2024-08-22T20:28:16.2828867Z parm: NVreg_TemporaryFilePath:charp 2024-08-22T20:28:16.2829324Z parm: NVreg_ExcludedGpus:charp 2024-08-22T20:28:16.2829762Z parm: NVreg_DmaRemapPeerMmio:int 2024-08-22T20:28:16.2830233Z parm: NVreg_RmNvlinkBandwidth:charp 2024-08-22T20:28:16.2830704Z parm: NVreg_ImexChannelCount:int 2024-08-22T20:28:16.2831136Z parm: rm_firmware_active:charp 2024-08-22T20:28:16.2831542Z + set +e 2024-08-22T20:28:16.2831844Z + nvidia-smi 2024-08-22T20:28:16.3016267Z Thu Aug 22 20:28:16 2024 2024-08-22T20:28:16.3016872Z +-----------------------------------------------------------------------------------------+ 2024-08-22T20:28:16.3017895Z | NVIDIA-SMI 550.54.15 Driver Version: 550.54.15 CUDA Version: 12.4 | 2024-08-22T20:28:16.3018867Z |-----------------------------------------+------------------------+----------------------+ 2024-08-22T20:28:16.3019647Z | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | 2024-08-22T20:28:16.3020536Z | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | 2024-08-22T20:28:16.3021218Z | | | MIG M. | 2024-08-22T20:28:16.3021745Z |=========================================+========================+======================| 2024-08-22T20:28:16.3244389Z | 0 NVIDIA A10G On | 00000000:00:1E.0 Off | 0 | 2024-08-22T20:28:16.3245216Z | 0% 31C P8 17W / 300W | 0MiB / 23028MiB | 0% Default | 2024-08-22T20:28:16.3245849Z | | | N/A | 2024-08-22T20:28:16.3246526Z +-----------------------------------------+------------------------+----------------------+ 2024-08-22T20:28:16.3249430Z 2024-08-22T20:28:16.3250214Z +-----------------------------------------------------------------------------------------+ 2024-08-22T20:28:16.3250840Z | Processes: | 2024-08-22T20:28:16.3251531Z | GPU GI CI PID Type Process name GPU Memory | 2024-08-22T20:28:16.3252227Z | ID ID Usage | 2024-08-22T20:28:16.3252783Z |=========================================================================================| 2024-08-22T20:28:16.3256384Z | No running processes found | 2024-08-22T20:28:16.3257153Z +-----------------------------------------------------------------------------------------+ 2024-08-22T20:28:16.6263153Z + nvidia-smi --query-gpu=gpu_name --format=csv,noheader --id=0 2024-08-22T20:28:16.6453771Z NVIDIA A10G 2024-08-22T20:28:16.6516216Z + NVIDIA_SMI_STATUS=0 2024-08-22T20:28:16.6516811Z + '[' 0 -eq 0 ']' 2024-08-22T20:28:16.6517198Z + echo 'INFO: Ignoring allowed status 0' 2024-08-22T20:28:16.6517621Z + set -e 2024-08-22T20:28:16.6517909Z INFO: Ignoring allowed status 0 2024-08-22T20:28:16.6526327Z == Installing nvidia container toolkit for amzn2023 == 2024-08-22T20:28:16.6530340Z + sudo yum install -y yum-utils 2024-08-22T20:28:17.0638244Z Last metadata expiration check: 1:51:17 ago on Thu Aug 22 18:37:00 2024. 2024-08-22T20:28:17.0860923Z Package dnf-utils-4.3.0-13.amzn2023.0.4.noarch is already installed. 2024-08-22T20:28:17.1165897Z Dependencies resolved. 2024-08-22T20:28:17.1291862Z Nothing to do. 2024-08-22T20:28:17.1292228Z Complete! 2024-08-22T20:28:17.1671410Z + [[ amzn2023 == \a\m\z\n\2\0\2\3 ]] 2024-08-22T20:28:17.1672448Z + YUM_REPO_URL=https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo 2024-08-22T20:28:17.1673949Z + sudo yum-config-manager --add-repo https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo 2024-08-22T20:28:17.5009026Z Adding repo from: https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo 2024-08-22T20:28:17.5662121Z + sudo yum install -y nvidia-docker2 2024-08-22T20:28:18.0380994Z nvidia-container-toolkit 10 kB/s | 833 B 00:00 2024-08-22T20:28:18.0601130Z Package nvidia-docker2-2.14.0-1.noarch is already installed. 2024-08-22T20:28:18.0894761Z Dependencies resolved. 2024-08-22T20:28:18.1019423Z Nothing to do. 2024-08-22T20:28:18.1019770Z Complete! 2024-08-22T20:28:18.1419051Z + sudo systemctl restart docker 2024-08-22T20:28:20.3907083Z nvidia-persistenced failed to initialize. Check syslog for more details. 2024-08-22T20:28:20.4148728Z Thu Aug 22 20:28:20 2024 2024-08-22T20:28:20.4149740Z +-----------------------------------------------------------------------------------------+ 2024-08-22T20:28:20.4150663Z | NVIDIA-SMI 550.54.15 Driver Version: 550.54.15 CUDA Version: 12.4 | 2024-08-22T20:28:20.4151493Z |-----------------------------------------+------------------------+----------------------+ 2024-08-22T20:28:20.4152293Z | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | 2024-08-22T20:28:20.4153194Z | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | 2024-08-22T20:28:20.4154250Z | | | MIG M. | 2024-08-22T20:28:20.4154800Z |=========================================+========================+======================| 2024-08-22T20:28:20.4361925Z | 0 NVIDIA A10G On | 00000000:00:1E.0 Off | 0 | 2024-08-22T20:28:20.4362877Z | 0% 31C P8 17W / 300W | 0MiB / 23028MiB | 0% Default | 2024-08-22T20:28:20.4363565Z | | | N/A | 2024-08-22T20:28:20.4364274Z +-----------------------------------------+------------------------+----------------------+ 2024-08-22T20:28:20.4366904Z 2024-08-22T20:28:20.4367789Z +-----------------------------------------------------------------------------------------+ 2024-08-22T20:28:20.4368461Z | Processes: | 2024-08-22T20:28:20.4369166Z | GPU GI CI PID Type Process name GPU Memory | 2024-08-22T20:28:20.4369838Z | ID ID Usage | 2024-08-22T20:28:20.4370391Z |=========================================================================================| 2024-08-22T20:28:20.4372543Z | No running processes found | 2024-08-22T20:28:20.4373510Z +-----------------------------------------------------------------------------------------+ 2024-08-22T20:28:21.6476618Z Command completed after 1 attempt(s). 2024-08-22T20:28:21.6560628Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2024-08-22T20:28:21.6561392Z # ignore expansion of "docker ps -q" since it could be empty 2024-08-22T20:28:21.6561975Z # shellcheck disable=SC2046 2024-08-22T20:28:21.6562423Z docker stop $(docker ps -q) || true 2024-08-22T20:28:21.6562893Z # Prune all of the docker images 2024-08-22T20:28:21.6563330Z docker system prune -af 2024-08-22T20:28:21.6575546Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-22T20:28:21.6576026Z env: 2024-08-22T20:28:21.6576355Z DOCKER_IMAGE: pytorch/conda-builder:cuda12.1 2024-08-22T20:28:21.6576805Z REPOSITORY: pytorch/torchchat 2024-08-22T20:28:21.6577172Z PR_NUMBER: 1044 2024-08-22T20:28:21.6579250Z SCRIPT: echo "::group::Print machine info" uname -a echo "::endgroup::" echo "::group::Install newer objcopy that supports --set-section-alignment" yum install -y devtoolset-10-binutils export PATH=/opt/rh/devtoolset-10/root/usr/bin/:$PATH echo "::endgroup::" TORCHCHAT_DEVICE=cpu .ci/scripts/run-docs evaluation echo "::group::Completion" echo "tests complete" echo "*******************************************" echo "::endgroup::" 2024-08-22T20:28:21.6581587Z RUNNER_ARTIFACT_DIR: /home/ec2-user/actions-runner/_work/_temp/artifacts 2024-08-22T20:28:21.6582401Z RUNNER_TEST_RESULTS_DIR: /home/ec2-user/actions-runner/_work/_temp/test-results 2024-08-22T20:28:21.6583102Z RUNNER_DOCS_DIR: /home/ec2-user/actions-runner/_work/_temp/docs 2024-08-22T20:28:21.6583704Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-22T20:28:21.6584173Z ##[endgroup] 2024-08-22T20:28:21.6910308Z "docker stop" requires at least 1 argument. 2024-08-22T20:28:21.6911312Z See 'docker stop --help'. 2024-08-22T20:28:21.6911620Z 2024-08-22T20:28:21.6911872Z Usage: docker stop [OPTIONS] CONTAINER [CONTAINER...] 2024-08-22T20:28:21.6912272Z 2024-08-22T20:28:21.6912539Z Stop one or more running containers 2024-08-22T20:28:21.7102246Z Total reclaimed space: 0B 2024-08-22T20:28:21.7181271Z ##[group]Run ./test-infra/.github/actions/setup-ssh 2024-08-22T20:28:21.7181827Z with: 2024-08-22T20:28:21.7182421Z github-secret: *** 2024-08-22T20:28:21.7183497Z instructions: All testing is done inside the container, to start an interactive session run: docker exec -it $(docker container ps --format '{{.ID}}') bash 2024-08-22T20:28:21.7184565Z activate-with-label: false 2024-08-22T20:28:21.7185023Z label: with-ssh 2024-08-22T20:28:21.7185519Z remove-existing-keys: true 2024-08-22T20:28:21.7185940Z fail-silently: true 2024-08-22T20:28:21.7186338Z env: 2024-08-22T20:28:21.7186835Z DOCKER_IMAGE: pytorch/conda-builder:cuda12.1 2024-08-22T20:28:21.7187353Z REPOSITORY: pytorch/torchchat 2024-08-22T20:28:21.7187816Z PR_NUMBER: 1044 2024-08-22T20:28:21.7190173Z SCRIPT: echo "::group::Print machine info" uname -a echo "::endgroup::" echo "::group::Install newer objcopy that supports --set-section-alignment" yum install -y devtoolset-10-binutils export PATH=/opt/rh/devtoolset-10/root/usr/bin/:$PATH echo "::endgroup::" TORCHCHAT_DEVICE=cpu .ci/scripts/run-docs evaluation echo "::group::Completion" echo "tests complete" echo "*******************************************" echo "::endgroup::" 2024-08-22T20:28:21.7192624Z RUNNER_ARTIFACT_DIR: /home/ec2-user/actions-runner/_work/_temp/artifacts 2024-08-22T20:28:21.7193522Z RUNNER_TEST_RESULTS_DIR: /home/ec2-user/actions-runner/_work/_temp/test-results 2024-08-22T20:28:21.7194340Z RUNNER_DOCS_DIR: /home/ec2-user/actions-runner/_work/_temp/docs 2024-08-22T20:28:21.7195056Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-22T20:28:21.7195674Z ##[endgroup] 2024-08-22T20:28:21.8019378Z Please see https://github.com/pytorch/pytorch/wiki/Debugging-using-with-ssh-for-Github-Actions for more info. 2024-08-22T20:28:22.1329182Z Grabbing public ssh keys from https://github.com/kwen2501.keys 2024-08-22T20:28:22.2126415Z ~/.ssh/authorized_keys file found on node, removing ~/.ssh and starting fresh 2024-08-22T20:28:22.2140674Z Public keys pulled and installed to /home/ec2-user/.ssh/authorized_keys 2024-08-22T20:28:22.2165631Z Login using: ssh ec2-user@ec2-52-207-145-139.compute-1.amazonaws.com 2024-08-22T20:28:22.2166674Z All testing is done inside the container, to start an interactive session run: 2024-08-22T20:28:22.2167614Z docker exec -it $(docker container ps --format '{{.ID}}') bash 2024-08-22T20:28:22.2302716Z ##[group]Run actions/checkout@v3 2024-08-22T20:28:22.2303162Z with: 2024-08-22T20:28:22.2303614Z repository: pytorch/torchchat 2024-08-22T20:28:22.2304111Z ref: refs/pull/1044/merge 2024-08-22T20:28:22.2304547Z path: pytorch/torchchat 2024-08-22T20:28:22.2305062Z fetch-depth: 1 2024-08-22T20:28:22.2305572Z token: *** 2024-08-22T20:28:22.2305959Z ssh-strict: true 2024-08-22T20:28:22.2306429Z persist-credentials: true 2024-08-22T20:28:22.2306867Z clean: true 2024-08-22T20:28:22.2307269Z sparse-checkout-cone-mode: true 2024-08-22T20:28:22.2307812Z fetch-tags: false 2024-08-22T20:28:22.2308209Z lfs: false 2024-08-22T20:28:22.2308841Z set-safe-directory: true 2024-08-22T20:28:22.2309360Z env: 2024-08-22T20:28:22.2309774Z DOCKER_IMAGE: pytorch/conda-builder:cuda12.1 2024-08-22T20:28:22.2310310Z REPOSITORY: pytorch/torchchat 2024-08-22T20:28:22.2310852Z PR_NUMBER: 1044 2024-08-22T20:28:22.2313160Z SCRIPT: echo "::group::Print machine info" uname -a echo "::endgroup::" echo "::group::Install newer objcopy that supports --set-section-alignment" yum install -y devtoolset-10-binutils export PATH=/opt/rh/devtoolset-10/root/usr/bin/:$PATH echo "::endgroup::" TORCHCHAT_DEVICE=cpu .ci/scripts/run-docs evaluation echo "::group::Completion" echo "tests complete" echo "*******************************************" echo "::endgroup::" 2024-08-22T20:28:22.2315633Z RUNNER_ARTIFACT_DIR: /home/ec2-user/actions-runner/_work/_temp/artifacts 2024-08-22T20:28:22.2316528Z RUNNER_TEST_RESULTS_DIR: /home/ec2-user/actions-runner/_work/_temp/test-results 2024-08-22T20:28:22.2317358Z RUNNER_DOCS_DIR: /home/ec2-user/actions-runner/_work/_temp/docs 2024-08-22T20:28:22.2318107Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-22T20:28:22.2318632Z ##[endgroup] 2024-08-22T20:28:22.3200841Z Syncing repository: pytorch/torchchat 2024-08-22T20:28:22.3209968Z ##[group]Getting Git version info 2024-08-22T20:28:22.3210932Z Working directory is '/home/ec2-user/actions-runner/_work/torchchat/torchchat/pytorch/torchchat' 2024-08-22T20:28:22.3231236Z [command]/usr/bin/git version 2024-08-22T20:28:22.3284107Z git version 2.40.1 2024-08-22T20:28:22.3305054Z ##[endgroup] 2024-08-22T20:28:22.3318169Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/d9f60160-5062-48fe-b264-2bfe16c286c9' before making global git config changes 2024-08-22T20:28:22.3319508Z Adding repository directory to the temporary git global config as a safe directory 2024-08-22T20:28:22.3322301Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/torchchat/torchchat/pytorch/torchchat 2024-08-22T20:28:22.3367054Z ##[group]Initializing the repository 2024-08-22T20:28:22.3370037Z [command]/usr/bin/git init /home/ec2-user/actions-runner/_work/torchchat/torchchat/pytorch/torchchat 2024-08-22T20:28:22.3415148Z hint: Using 'master' as the name for the initial branch. This default branch name 2024-08-22T20:28:22.3416460Z hint: is subject to change. To configure the initial branch name to use in all 2024-08-22T20:28:22.3417430Z hint: of your new repositories, which will suppress this warning, call: 2024-08-22T20:28:22.3418211Z hint: 2024-08-22T20:28:22.3418768Z hint: git config --global init.defaultBranch 2024-08-22T20:28:22.3419288Z hint: 2024-08-22T20:28:22.3419960Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-08-22T20:28:22.3420913Z hint: 'development'. The just-created branch can be renamed via this command: 2024-08-22T20:28:22.3421546Z hint: 2024-08-22T20:28:22.3422393Z hint: git branch -m 2024-08-22T20:28:22.3423367Z Initialized empty Git repository in /home/ec2-user/actions-runner/_work/torchchat/torchchat/pytorch/torchchat/.git/ 2024-08-22T20:28:22.3428916Z [command]/usr/bin/git remote add origin https://github.com/pytorch/torchchat 2024-08-22T20:28:22.3476147Z ##[endgroup] 2024-08-22T20:28:22.3476844Z ##[group]Disabling automatic garbage collection 2024-08-22T20:28:22.3479444Z [command]/usr/bin/git config --local gc.auto 0 2024-08-22T20:28:22.3520973Z ##[endgroup] 2024-08-22T20:28:22.3522011Z ##[group]Setting up auth 2024-08-22T20:28:22.3527672Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2024-08-22T20:28:22.3571645Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2024-08-22T20:28:22.3931666Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2024-08-22T20:28:22.3977746Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2024-08-22T20:28:22.4338904Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic *** 2024-08-22T20:28:22.4401850Z ##[endgroup] 2024-08-22T20:28:22.4403047Z ##[group]Fetching the repository 2024-08-22T20:28:22.4410170Z [command]/usr/bin/git -c protocol.version=2 fetch --no-tags --prune --progress --no-recurse-submodules --depth=1 origin +refs/pull/1044/merge:refs/remotes/pull/1044/merge 2024-08-22T20:28:22.6333720Z remote: Enumerating objects: 237, done. 2024-08-22T20:28:22.6334857Z remote: Counting objects: 0% (1/237) 2024-08-22T20:28:22.6335777Z remote: Counting objects: 1% (3/237) 2024-08-22T20:28:22.6336447Z remote: Counting objects: 2% (5/237) 2024-08-22T20:28:22.6337114Z remote: Counting objects: 3% (8/237) 2024-08-22T20:28:22.6337713Z remote: Counting objects: 4% (10/237) 2024-08-22T20:28:22.6338320Z remote: Counting objects: 5% (12/237) 2024-08-22T20:28:22.6338991Z remote: Counting objects: 6% (15/237) 2024-08-22T20:28:22.6340000Z remote: Counting objects: 7% (17/237) 2024-08-22T20:28:22.6340865Z remote: Counting objects: 8% (19/237) 2024-08-22T20:28:22.6341692Z remote: Counting objects: 9% (22/237) 2024-08-22T20:28:22.6342527Z remote: Counting objects: 10% (24/237) 2024-08-22T20:28:22.6343460Z remote: Counting objects: 11% (27/237) 2024-08-22T20:28:22.6344237Z remote: Counting objects: 12% (29/237) 2024-08-22T20:28:22.6345099Z remote: Counting objects: 13% (31/237) 2024-08-22T20:28:22.6345934Z remote: Counting objects: 14% (34/237) 2024-08-22T20:28:22.6346724Z remote: Counting objects: 15% (36/237) 2024-08-22T20:28:22.6347509Z remote: Counting objects: 16% (38/237) 2024-08-22T20:28:22.6348181Z remote: Counting objects: 17% (41/237) 2024-08-22T20:28:22.6348775Z remote: Counting objects: 18% (43/237) 2024-08-22T20:28:22.6349315Z remote: Counting objects: 19% (46/237) 2024-08-22T20:28:22.6350040Z remote: Counting objects: 20% (48/237) 2024-08-22T20:28:22.6350778Z remote: Counting objects: 21% (50/237) 2024-08-22T20:28:22.6351321Z remote: Counting objects: 22% (53/237) 2024-08-22T20:28:22.6351963Z remote: Counting objects: 23% (55/237) 2024-08-22T20:28:22.6352631Z remote: Counting objects: 24% (57/237) 2024-08-22T20:28:22.6353265Z remote: Counting objects: 25% (60/237) 2024-08-22T20:28:22.6353819Z remote: Counting objects: 26% (62/237) 2024-08-22T20:28:22.6354397Z remote: Counting objects: 27% (64/237) 2024-08-22T20:28:22.6355026Z remote: Counting objects: 28% (67/237) 2024-08-22T20:28:22.6355583Z remote: Counting objects: 29% (69/237) 2024-08-22T20:28:22.6356575Z remote: Counting objects: 30% (72/237) 2024-08-22T20:28:22.6357370Z remote: Counting objects: 31% (74/237) 2024-08-22T20:28:22.6357906Z remote: Counting objects: 32% (76/237) 2024-08-22T20:28:22.6358479Z remote: Counting objects: 33% (79/237) 2024-08-22T20:28:22.6359126Z remote: Counting objects: 34% (81/237) 2024-08-22T20:28:22.6359850Z remote: Counting objects: 35% (83/237) 2024-08-22T20:28:22.6360583Z remote: Counting objects: 36% (86/237) 2024-08-22T20:28:22.6361330Z remote: Counting objects: 37% (88/237) 2024-08-22T20:28:22.6361864Z remote: Counting objects: 38% (91/237) 2024-08-22T20:28:22.6362431Z remote: Counting objects: 39% (93/237) 2024-08-22T20:28:22.6363072Z remote: Counting objects: 40% (95/237) 2024-08-22T20:28:22.6363599Z remote: Counting objects: 41% (98/237) 2024-08-22T20:28:22.6364198Z remote: Counting objects: 42% (100/237) 2024-08-22T20:28:22.6365004Z remote: Counting objects: 43% (102/237) 2024-08-22T20:28:22.6365639Z remote: Counting objects: 44% (105/237) 2024-08-22T20:28:22.6366204Z remote: Counting objects: 45% (107/237) 2024-08-22T20:28:22.6366847Z remote: Counting objects: 46% (110/237) 2024-08-22T20:28:22.6367425Z remote: Counting objects: 47% (112/237) 2024-08-22T20:28:22.6368016Z remote: Counting objects: 48% (114/237) 2024-08-22T20:28:22.6368841Z remote: Counting objects: 49% (117/237) 2024-08-22T20:28:22.6369424Z remote: Counting objects: 50% (119/237) 2024-08-22T20:28:22.6369990Z remote: Counting objects: 51% (121/237) 2024-08-22T20:28:22.6370627Z remote: Counting objects: 52% (124/237) 2024-08-22T20:28:22.6371223Z remote: Counting objects: 53% (126/237) 2024-08-22T20:28:22.6371773Z remote: Counting objects: 54% (128/237) 2024-08-22T20:28:22.6372452Z remote: Counting objects: 55% (131/237) 2024-08-22T20:28:22.6373244Z remote: Counting objects: 56% (133/237) 2024-08-22T20:28:22.6373791Z remote: Counting objects: 57% (136/237) 2024-08-22T20:28:22.6374434Z remote: Counting objects: 58% (138/237) 2024-08-22T20:28:22.6375029Z remote: Counting objects: 59% (140/237) 2024-08-22T20:28:22.6375566Z remote: Counting objects: 60% (143/237) 2024-08-22T20:28:22.6376405Z remote: Counting objects: 61% (145/237) 2024-08-22T20:28:22.6377017Z remote: Counting objects: 62% (147/237) 2024-08-22T20:28:22.6377555Z remote: Counting objects: 63% (150/237) 2024-08-22T20:28:22.6378190Z remote: Counting objects: 64% (152/237) 2024-08-22T20:28:22.6378788Z remote: Counting objects: 65% (155/237) 2024-08-22T20:28:22.6379368Z remote: Counting objects: 66% (157/237) 2024-08-22T20:28:22.6380197Z remote: Counting objects: 67% (159/237) 2024-08-22T20:28:22.6380794Z remote: Counting objects: 68% (162/237) 2024-08-22T20:28:22.6381374Z remote: Counting objects: 69% (164/237) 2024-08-22T20:28:22.6382149Z remote: Counting objects: 70% (166/237) 2024-08-22T20:28:22.6382745Z remote: Counting objects: 71% (169/237) 2024-08-22T20:28:22.6383317Z remote: Counting objects: 72% (171/237) 2024-08-22T20:28:22.6383932Z remote: Counting objects: 73% (174/237) 2024-08-22T20:28:22.6384505Z remote: Counting objects: 74% (176/237) 2024-08-22T20:28:22.6385177Z remote: Counting objects: 75% (178/237) 2024-08-22T20:28:22.6385912Z remote: Counting objects: 76% (181/237) 2024-08-22T20:28:22.6386489Z remote: Counting objects: 77% (183/237) 2024-08-22T20:28:22.6387061Z remote: Counting objects: 78% (185/237) 2024-08-22T20:28:22.6387687Z remote: Counting objects: 79% (188/237) 2024-08-22T20:28:22.6388260Z remote: Counting objects: 80% (190/237) 2024-08-22T20:28:22.6388858Z remote: Counting objects: 81% (192/237) 2024-08-22T20:28:22.6389609Z remote: Counting objects: 82% (195/237) 2024-08-22T20:28:22.6390357Z remote: Counting objects: 83% (197/237) 2024-08-22T20:28:22.6390967Z remote: Counting objects: 84% (200/237) 2024-08-22T20:28:22.6391573Z remote: Counting objects: 85% (202/237) 2024-08-22T20:28:22.6392146Z remote: Counting objects: 86% (204/237) 2024-08-22T20:28:22.6392739Z remote: Counting objects: 87% (207/237) 2024-08-22T20:28:22.6393446Z remote: Counting objects: 88% (209/237) 2024-08-22T20:28:22.6394053Z remote: Counting objects: 89% (211/237) 2024-08-22T20:28:22.6394621Z remote: Counting objects: 90% (214/237) 2024-08-22T20:28:22.6395216Z remote: Counting objects: 91% (216/237) 2024-08-22T20:28:22.6395808Z remote: Counting objects: 92% (219/237) 2024-08-22T20:28:22.6396491Z remote: Counting objects: 93% (221/237) 2024-08-22T20:28:22.6397138Z remote: Counting objects: 94% (223/237) 2024-08-22T20:28:22.6397695Z remote: Counting objects: 95% (226/237) 2024-08-22T20:28:22.6398273Z remote: Counting objects: 96% (228/237) 2024-08-22T20:28:22.6398921Z remote: Counting objects: 97% (230/237) 2024-08-22T20:28:22.6399575Z remote: Counting objects: 98% (233/237) 2024-08-22T20:28:22.6400257Z remote: Counting objects: 99% (235/237) 2024-08-22T20:28:22.6400938Z remote: Counting objects: 100% (237/237) 2024-08-22T20:28:22.6401526Z remote: Counting objects: 100% (237/237), done. 2024-08-22T20:28:22.6402169Z remote: Compressing objects: 0% (1/193) 2024-08-22T20:28:22.6402885Z remote: Compressing objects: 1% (2/193) 2024-08-22T20:28:22.6403444Z remote: Compressing objects: 2% (4/193) 2024-08-22T20:28:22.6404037Z remote: Compressing objects: 3% (6/193) 2024-08-22T20:28:22.6404711Z remote: Compressing objects: 4% (8/193) 2024-08-22T20:28:22.6405277Z remote: Compressing objects: 5% (10/193) 2024-08-22T20:28:22.6405890Z remote: Compressing objects: 6% (12/193) 2024-08-22T20:28:22.6406590Z remote: Compressing objects: 7% (14/193) 2024-08-22T20:28:22.6407194Z remote: Compressing objects: 8% (16/193) 2024-08-22T20:28:22.6407763Z remote: Compressing objects: 9% (18/193) 2024-08-22T20:28:22.6408462Z remote: Compressing objects: 10% (20/193) 2024-08-22T20:28:22.6409066Z remote: Compressing objects: 11% (22/193) 2024-08-22T20:28:22.6409657Z remote: Compressing objects: 12% (24/193) 2024-08-22T20:28:22.6410332Z remote: Compressing objects: 13% (26/193) 2024-08-22T20:28:22.6410933Z remote: Compressing objects: 14% (28/193) 2024-08-22T20:28:22.6411513Z remote: Compressing objects: 15% (29/193) 2024-08-22T20:28:22.6412169Z remote: Compressing objects: 16% (31/193) 2024-08-22T20:28:22.6415779Z remote: Compressing objects: 17% (33/193) 2024-08-22T20:28:22.6430899Z remote: Compressing objects: 18% (35/193) 2024-08-22T20:28:22.6435900Z remote: Compressing objects: 19% (37/193) 2024-08-22T20:28:22.6436836Z remote: Compressing objects: 20% (39/193) 2024-08-22T20:28:22.6442263Z remote: Compressing objects: 21% (41/193) 2024-08-22T20:28:22.6444836Z remote: Compressing objects: 22% (43/193) 2024-08-22T20:28:22.6445539Z remote: Compressing objects: 23% (45/193) 2024-08-22T20:28:22.6447036Z remote: Compressing objects: 24% (47/193) 2024-08-22T20:28:22.6447634Z remote: Compressing objects: 25% (49/193) 2024-08-22T20:28:22.6449219Z remote: Compressing objects: 26% (51/193) 2024-08-22T20:28:22.6449910Z remote: Compressing objects: 27% (53/193) 2024-08-22T20:28:22.6450516Z remote: Compressing objects: 28% (55/193) 2024-08-22T20:28:22.6454981Z remote: Compressing objects: 29% (56/193) 2024-08-22T20:28:22.6457639Z remote: Compressing objects: 30% (58/193) 2024-08-22T20:28:22.6458283Z remote: Compressing objects: 31% (60/193) 2024-08-22T20:28:22.6459217Z remote: Compressing objects: 32% (62/193) 2024-08-22T20:28:22.6460066Z remote: Compressing objects: 33% (64/193) 2024-08-22T20:28:22.6460752Z remote: Compressing objects: 34% (66/193) 2024-08-22T20:28:22.6461524Z remote: Compressing objects: 35% (68/193) 2024-08-22T20:28:22.6462179Z remote: Compressing objects: 36% (70/193) 2024-08-22T20:28:22.6462821Z remote: Compressing objects: 37% (72/193) 2024-08-22T20:28:22.6463584Z remote: Compressing objects: 38% (74/193) 2024-08-22T20:28:22.6464253Z remote: Compressing objects: 39% (76/193) 2024-08-22T20:28:22.6464865Z remote: Compressing objects: 40% (78/193) 2024-08-22T20:28:22.6465467Z remote: Compressing objects: 41% (80/193) 2024-08-22T20:28:22.6466291Z remote: Compressing objects: 42% (82/193) 2024-08-22T20:28:22.6466933Z remote: Compressing objects: 43% (83/193) 2024-08-22T20:28:22.6467543Z remote: Compressing objects: 44% (85/193) 2024-08-22T20:28:22.6469674Z remote: Compressing objects: 45% (87/193) 2024-08-22T20:28:22.6472884Z remote: Compressing objects: 46% (89/193) 2024-08-22T20:28:22.6474102Z remote: Compressing objects: 47% (91/193) 2024-08-22T20:28:22.6474948Z remote: Compressing objects: 48% (93/193) 2024-08-22T20:28:22.6475626Z remote: Compressing objects: 49% (95/193) 2024-08-22T20:28:22.6476510Z remote: Compressing objects: 50% (97/193) 2024-08-22T20:28:22.6477347Z remote: Compressing objects: 51% (99/193) 2024-08-22T20:28:22.6477952Z remote: Compressing objects: 52% (101/193) 2024-08-22T20:28:22.6478791Z remote: Compressing objects: 53% (103/193) 2024-08-22T20:28:22.6479503Z remote: Compressing objects: 54% (105/193) 2024-08-22T20:28:22.6480341Z remote: Compressing objects: 55% (107/193) 2024-08-22T20:28:22.6480969Z remote: Compressing objects: 56% (109/193) 2024-08-22T20:28:22.6481856Z remote: Compressing objects: 57% (111/193) 2024-08-22T20:28:22.6482518Z remote: Compressing objects: 58% (112/193) 2024-08-22T20:28:22.6483236Z remote: Compressing objects: 59% (114/193) 2024-08-22T20:28:22.6483945Z remote: Compressing objects: 60% (116/193) 2024-08-22T20:28:22.6484571Z remote: Compressing objects: 61% (118/193) 2024-08-22T20:28:22.6485141Z remote: Compressing objects: 62% (120/193) 2024-08-22T20:28:22.6486599Z remote: Compressing objects: 63% (122/193) 2024-08-22T20:28:22.6490515Z remote: Compressing objects: 64% (124/193) 2024-08-22T20:28:22.6491652Z remote: Compressing objects: 65% (126/193) 2024-08-22T20:28:22.6492689Z remote: Compressing objects: 66% (128/193) 2024-08-22T20:28:22.6494023Z remote: Compressing objects: 67% (130/193) 2024-08-22T20:28:22.6496424Z remote: Compressing objects: 68% (132/193) 2024-08-22T20:28:22.6497365Z remote: Compressing objects: 69% (134/193) 2024-08-22T20:28:22.6501431Z remote: Compressing objects: 70% (136/193) 2024-08-22T20:28:22.6503536Z remote: Compressing objects: 71% (138/193) 2024-08-22T20:28:22.6504578Z remote: Compressing objects: 72% (139/193) 2024-08-22T20:28:22.6505165Z remote: Compressing objects: 73% (141/193) 2024-08-22T20:28:22.6509266Z remote: Compressing objects: 74% (143/193) 2024-08-22T20:28:22.6511344Z remote: Compressing objects: 75% (145/193) 2024-08-22T20:28:22.6512190Z remote: Compressing objects: 76% (147/193) 2024-08-22T20:28:22.6512909Z remote: Compressing objects: 77% (149/193) 2024-08-22T20:28:22.6519378Z remote: Compressing objects: 78% (151/193) 2024-08-22T20:28:22.6521592Z remote: Compressing objects: 79% (153/193) 2024-08-22T20:28:22.6522692Z remote: Compressing objects: 80% (155/193) 2024-08-22T20:28:22.6523749Z remote: Compressing objects: 81% (157/193) 2024-08-22T20:28:22.6524555Z remote: Compressing objects: 82% (159/193) 2024-08-22T20:28:22.6525515Z remote: Compressing objects: 83% (161/193) 2024-08-22T20:28:22.6526187Z remote: Compressing objects: 84% (163/193) 2024-08-22T20:28:22.6527002Z remote: Compressing objects: 85% (165/193) 2024-08-22T20:28:22.6527740Z remote: Compressing objects: 86% (166/193) 2024-08-22T20:28:22.6528320Z remote: Compressing objects: 87% (168/193) 2024-08-22T20:28:22.6529071Z remote: Compressing objects: 88% (170/193) 2024-08-22T20:28:22.6529810Z remote: Compressing objects: 89% (172/193) 2024-08-22T20:28:22.6530374Z remote: Compressing objects: 90% (174/193) 2024-08-22T20:28:22.6530994Z remote: Compressing objects: 91% (176/193) 2024-08-22T20:28:22.6531652Z remote: Compressing objects: 92% (178/193) 2024-08-22T20:28:22.6532244Z remote: Compressing objects: 93% (180/193) 2024-08-22T20:28:22.6532891Z remote: Compressing objects: 94% (182/193) 2024-08-22T20:28:22.6533545Z remote: Compressing objects: 95% (184/193) 2024-08-22T20:28:22.6534469Z remote: Compressing objects: 96% (186/193) 2024-08-22T20:28:22.6535241Z remote: Compressing objects: 97% (188/193) 2024-08-22T20:28:22.6535932Z remote: Compressing objects: 98% (190/193) 2024-08-22T20:28:22.6536509Z remote: Compressing objects: 99% (192/193) 2024-08-22T20:28:22.6537136Z remote: Compressing objects: 100% (193/193) 2024-08-22T20:28:22.6537937Z remote: Compressing objects: 100% (193/193), done. 2024-08-22T20:28:22.6561313Z Receiving objects: 0% (1/237) 2024-08-22T20:28:22.6561777Z Receiving objects: 1% (3/237) 2024-08-22T20:28:22.6562522Z Receiving objects: 2% (5/237) 2024-08-22T20:28:22.6563936Z Receiving objects: 3% (8/237) 2024-08-22T20:28:22.6566074Z Receiving objects: 4% (10/237) 2024-08-22T20:28:22.6567541Z Receiving objects: 5% (12/237) 2024-08-22T20:28:22.6568164Z Receiving objects: 6% (15/237) 2024-08-22T20:28:22.6568609Z Receiving objects: 7% (17/237) 2024-08-22T20:28:22.6569206Z Receiving objects: 8% (19/237) 2024-08-22T20:28:22.6572220Z Receiving objects: 9% (22/237) 2024-08-22T20:28:22.6573133Z Receiving objects: 10% (24/237) 2024-08-22T20:28:22.6573678Z Receiving objects: 11% (27/237) 2024-08-22T20:28:22.6574151Z Receiving objects: 12% (29/237) 2024-08-22T20:28:22.6574784Z Receiving objects: 13% (31/237) 2024-08-22T20:28:22.6575564Z Receiving objects: 14% (34/237) 2024-08-22T20:28:22.6576187Z Receiving objects: 15% (36/237) 2024-08-22T20:28:22.6580151Z Receiving objects: 16% (38/237) 2024-08-22T20:28:22.6580754Z Receiving objects: 17% (41/237) 2024-08-22T20:28:22.6581264Z Receiving objects: 18% (43/237) 2024-08-22T20:28:22.6581799Z Receiving objects: 19% (46/237) 2024-08-22T20:28:22.6582392Z Receiving objects: 20% (48/237) 2024-08-22T20:28:22.6582964Z Receiving objects: 21% (50/237) 2024-08-22T20:28:22.6583543Z Receiving objects: 22% (53/237) 2024-08-22T20:28:22.6584019Z Receiving objects: 23% (55/237) 2024-08-22T20:28:22.6584502Z Receiving objects: 24% (57/237) 2024-08-22T20:28:22.6585017Z Receiving objects: 25% (60/237) 2024-08-22T20:28:22.6585496Z Receiving objects: 26% (62/237) 2024-08-22T20:28:22.6585991Z Receiving objects: 27% (64/237) 2024-08-22T20:28:22.6586750Z Receiving objects: 28% (67/237) 2024-08-22T20:28:22.6587301Z Receiving objects: 29% (69/237) 2024-08-22T20:28:22.6587795Z Receiving objects: 30% (72/237) 2024-08-22T20:28:22.6588295Z Receiving objects: 31% (74/237) 2024-08-22T20:28:22.6588782Z Receiving objects: 32% (76/237) 2024-08-22T20:28:22.6589271Z Receiving objects: 33% (79/237) 2024-08-22T20:28:22.6589759Z Receiving objects: 34% (81/237) 2024-08-22T20:28:22.6590232Z Receiving objects: 35% (83/237) 2024-08-22T20:28:22.6590902Z Receiving objects: 36% (86/237) 2024-08-22T20:28:22.6592531Z Receiving objects: 37% (88/237) 2024-08-22T20:28:22.6593004Z Receiving objects: 38% (91/237) 2024-08-22T20:28:22.6594078Z Receiving objects: 39% (93/237) 2024-08-22T20:28:22.6594701Z Receiving objects: 40% (95/237) 2024-08-22T20:28:22.6595464Z Receiving objects: 41% (98/237) 2024-08-22T20:28:22.6595957Z Receiving objects: 42% (100/237) 2024-08-22T20:28:22.6596599Z Receiving objects: 43% (102/237) 2024-08-22T20:28:22.6597140Z Receiving objects: 44% (105/237) 2024-08-22T20:28:22.6597632Z Receiving objects: 45% (107/237) 2024-08-22T20:28:22.6598197Z Receiving objects: 46% (110/237) 2024-08-22T20:28:22.6598639Z Receiving objects: 47% (112/237) 2024-08-22T20:28:22.6599276Z Receiving objects: 48% (114/237) 2024-08-22T20:28:22.6599838Z Receiving objects: 49% (117/237) 2024-08-22T20:28:22.6604125Z Receiving objects: 50% (119/237) 2024-08-22T20:28:22.6605723Z Receiving objects: 51% (121/237) 2024-08-22T20:28:22.6607276Z Receiving objects: 52% (124/237) 2024-08-22T20:28:22.6650848Z Receiving objects: 53% (126/237) 2024-08-22T20:28:22.6651433Z Receiving objects: 54% (128/237) 2024-08-22T20:28:22.6653484Z Receiving objects: 55% (131/237) 2024-08-22T20:28:22.6655862Z Receiving objects: 56% (133/237) 2024-08-22T20:28:22.6656382Z Receiving objects: 57% (136/237) 2024-08-22T20:28:22.6657041Z Receiving objects: 58% (138/237) 2024-08-22T20:28:22.6657532Z Receiving objects: 59% (140/237) 2024-08-22T20:28:22.6657995Z Receiving objects: 60% (143/237) 2024-08-22T20:28:22.6658546Z Receiving objects: 61% (145/237) 2024-08-22T20:28:22.6659024Z Receiving objects: 62% (147/237) 2024-08-22T20:28:22.6659585Z Receiving objects: 63% (150/237) 2024-08-22T20:28:22.6660785Z Receiving objects: 64% (152/237) 2024-08-22T20:28:22.6662879Z Receiving objects: 65% (155/237) 2024-08-22T20:28:22.6663490Z Receiving objects: 66% (157/237) 2024-08-22T20:28:22.6663941Z Receiving objects: 67% (159/237) 2024-08-22T20:28:22.6664570Z Receiving objects: 68% (162/237) 2024-08-22T20:28:22.6665111Z Receiving objects: 69% (164/237) 2024-08-22T20:28:22.6665800Z Receiving objects: 70% (166/237) 2024-08-22T20:28:22.6667639Z Receiving objects: 71% (169/237) 2024-08-22T20:28:22.6668199Z Receiving objects: 72% (171/237) 2024-08-22T20:28:22.6668918Z Receiving objects: 73% (174/237) 2024-08-22T20:28:22.6669682Z Receiving objects: 74% (176/237) 2024-08-22T20:28:22.6672773Z Receiving objects: 75% (178/237) 2024-08-22T20:28:22.6673770Z Receiving objects: 76% (181/237) 2024-08-22T20:28:22.6674241Z Receiving objects: 77% (183/237) 2024-08-22T20:28:22.6675314Z Receiving objects: 78% (185/237) 2024-08-22T20:28:22.6677210Z Receiving objects: 79% (188/237) 2024-08-22T20:28:22.6679210Z Receiving objects: 80% (190/237) 2024-08-22T20:28:22.6679767Z Receiving objects: 81% (192/237) 2024-08-22T20:28:22.6680831Z remote: Total 237 (delta 16), reused 151 (delta 7), pack-reused 0 (from 0) 2024-08-22T20:28:22.6682130Z Receiving objects: 82% (195/237) 2024-08-22T20:28:22.6686332Z Receiving objects: 83% (197/237) 2024-08-22T20:28:22.6688024Z Receiving objects: 84% (200/237) 2024-08-22T20:28:22.6690021Z Receiving objects: 85% (202/237) 2024-08-22T20:28:22.6690843Z Receiving objects: 86% (204/237) 2024-08-22T20:28:22.6691757Z Receiving objects: 87% (207/237) 2024-08-22T20:28:22.6692988Z Receiving objects: 88% (209/237) 2024-08-22T20:28:22.6696022Z Receiving objects: 89% (211/237) 2024-08-22T20:28:22.6696539Z Receiving objects: 90% (214/237) 2024-08-22T20:28:22.6698167Z Receiving objects: 91% (216/237) 2024-08-22T20:28:22.6698634Z Receiving objects: 92% (219/237) 2024-08-22T20:28:22.6699802Z Receiving objects: 93% (221/237) 2024-08-22T20:28:22.6700954Z Receiving objects: 94% (223/237) 2024-08-22T20:28:22.6701478Z Receiving objects: 95% (226/237) 2024-08-22T20:28:22.6704038Z Receiving objects: 96% (228/237) 2024-08-22T20:28:22.6704754Z Receiving objects: 97% (230/237) 2024-08-22T20:28:22.6705575Z Receiving objects: 98% (233/237) 2024-08-22T20:28:22.6706319Z Receiving objects: 99% (235/237) 2024-08-22T20:28:22.6706953Z Receiving objects: 100% (237/237) 2024-08-22T20:28:22.6707938Z Receiving objects: 100% (237/237), 488.09 KiB | 32.54 MiB/s, done. 2024-08-22T20:28:22.6710696Z Resolving deltas: 0% (0/16) 2024-08-22T20:28:22.6711443Z Resolving deltas: 6% (1/16) 2024-08-22T20:28:22.6712469Z Resolving deltas: 12% (2/16) 2024-08-22T20:28:22.6713147Z Resolving deltas: 18% (3/16) 2024-08-22T20:28:22.6713878Z Resolving deltas: 25% (4/16) 2024-08-22T20:28:22.6714752Z Resolving deltas: 37% (6/16) 2024-08-22T20:28:22.6715352Z Resolving deltas: 43% (7/16) 2024-08-22T20:28:22.6716010Z Resolving deltas: 50% (8/16) 2024-08-22T20:28:22.6716773Z Resolving deltas: 56% (9/16) 2024-08-22T20:28:22.6717515Z Resolving deltas: 62% (10/16) 2024-08-22T20:28:22.6718143Z Resolving deltas: 68% (11/16) 2024-08-22T20:28:22.6718741Z Resolving deltas: 75% (12/16) 2024-08-22T20:28:22.6719170Z Resolving deltas: 81% (13/16) 2024-08-22T20:28:22.6719682Z Resolving deltas: 87% (14/16) 2024-08-22T20:28:22.6720308Z Resolving deltas: 93% (15/16) 2024-08-22T20:28:22.6720805Z Resolving deltas: 100% (16/16) 2024-08-22T20:28:22.6721357Z Resolving deltas: 100% (16/16), done. 2024-08-22T20:28:22.6852409Z From https://github.com/pytorch/torchchat 2024-08-22T20:28:22.6853506Z * [new ref] refs/pull/1044/merge -> pull/1044/merge 2024-08-22T20:28:22.6879142Z ##[endgroup] 2024-08-22T20:28:22.6879906Z ##[group]Determining the checkout info 2024-08-22T20:28:22.6881184Z ##[endgroup] 2024-08-22T20:28:22.6881897Z ##[group]Checking out the ref 2024-08-22T20:28:22.6885238Z [command]/usr/bin/git checkout --progress --force refs/remotes/pull/1044/merge 2024-08-22T20:28:22.7065433Z Note: switching to 'refs/remotes/pull/1044/merge'. 2024-08-22T20:28:22.7066115Z 2024-08-22T20:28:22.7066712Z You are in 'detached HEAD' state. You can look around, make experimental 2024-08-22T20:28:22.7067828Z changes and commit them, and you can discard any commits you make in this 2024-08-22T20:28:22.7068636Z state without impacting any branches by switching back to a branch. 2024-08-22T20:28:22.7069212Z 2024-08-22T20:28:22.7069630Z If you want to create a new branch to retain commits you create, you may 2024-08-22T20:28:22.7070555Z do so (now or later) by using -c with the switch command. Example: 2024-08-22T20:28:22.7071020Z 2024-08-22T20:28:22.7071244Z git switch -c 2024-08-22T20:28:22.7071755Z 2024-08-22T20:28:22.7071995Z Or undo this operation with: 2024-08-22T20:28:22.7072431Z 2024-08-22T20:28:22.7072623Z git switch - 2024-08-22T20:28:22.7072898Z 2024-08-22T20:28:22.7073361Z Turn off this advice by setting config variable advice.detachedHead to false 2024-08-22T20:28:22.7073963Z 2024-08-22T20:28:22.7074512Z HEAD is now at 0e4d4b1 Merge c8dc18a48d66f51855d89294f3ca800692cd5dad into d5bb3c6659c8978a95c5141eb31e6e58f94af20a 2024-08-22T20:28:22.7076334Z ##[endgroup] 2024-08-22T20:28:22.7121696Z [command]/usr/bin/git log -1 --format='%H' 2024-08-22T20:28:22.7159369Z '0e4d4b184770ee5c0943c8ad43f2a1be7a2dd2c9' 2024-08-22T20:28:22.7368703Z Prepare all required actions 2024-08-22T20:28:22.7501933Z ##[group]Run ./test-infra/.github/actions/calculate-docker-image 2024-08-22T20:28:22.7502632Z with: 2024-08-22T20:28:22.7503079Z docker-image-name: pytorch/conda-builder:cuda12.1 2024-08-22T20:28:22.7503714Z docker-build-dir: .ci/docker 2024-08-22T20:28:22.7504281Z working-directory: pytorch/torchchat 2024-08-22T20:28:22.7504911Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-22T20:28:22.7505488Z force-push: false 2024-08-22T20:28:22.7505961Z env: 2024-08-22T20:28:22.7506374Z DOCKER_IMAGE: pytorch/conda-builder:cuda12.1 2024-08-22T20:28:22.7506906Z REPOSITORY: pytorch/torchchat 2024-08-22T20:28:22.7507433Z PR_NUMBER: 1044 2024-08-22T20:28:22.7509753Z SCRIPT: echo "::group::Print machine info" uname -a echo "::endgroup::" echo "::group::Install newer objcopy that supports --set-section-alignment" yum install -y devtoolset-10-binutils export PATH=/opt/rh/devtoolset-10/root/usr/bin/:$PATH echo "::endgroup::" TORCHCHAT_DEVICE=cpu .ci/scripts/run-docs evaluation echo "::group::Completion" echo "tests complete" echo "*******************************************" echo "::endgroup::" 2024-08-22T20:28:22.7512253Z RUNNER_ARTIFACT_DIR: /home/ec2-user/actions-runner/_work/_temp/artifacts 2024-08-22T20:28:22.7513246Z RUNNER_TEST_RESULTS_DIR: /home/ec2-user/actions-runner/_work/_temp/test-results 2024-08-22T20:28:22.7514159Z RUNNER_DOCS_DIR: /home/ec2-user/actions-runner/_work/_temp/docs 2024-08-22T20:28:22.7514914Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-22T20:28:22.7515438Z ##[endgroup] 2024-08-22T20:28:22.7542648Z ##[group]Run set -ex 2024-08-22T20:28:22.7543096Z set -ex 2024-08-22T20:28:22.7543496Z  2024-08-22T20:28:22.7544148Z # If the docker build directory or the build script doesn't exist, the action will 2024-08-22T20:28:22.7545165Z # gracefully return the docker image name as it is. Pulling docker image in Linux 2024-08-22T20:28:22.7546082Z # job could then download the pre-built image as usual 2024-08-22T20:28:22.7546937Z if [[ ! -d "${DOCKER_BUILD_DIR}" ]] || [[ ! -f "${DOCKER_BUILD_DIR}/build.sh" ]]; then 2024-08-22T20:28:22.7547695Z  echo "skip=true" >> "${GITHUB_OUTPUT}" 2024-08-22T20:28:22.7548447Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2024-08-22T20:28:22.7549165Z  2024-08-22T20:28:22.7549827Z  echo "There is no Docker build script in ${REPO_NAME} repo, skipping..." 2024-08-22T20:28:22.7550530Z  exit 0 2024-08-22T20:28:22.7550964Z else 2024-08-22T20:28:22.7551396Z  echo "skip=false" >> "${GITHUB_OUTPUT}" 2024-08-22T20:28:22.7551931Z fi 2024-08-22T20:28:22.7552351Z  2024-08-22T20:28:22.7552892Z if [[ "${DOCKER_IMAGE_NAME}" == *"${DOCKER_REGISTRY}/${REPO_NAME}"* ]]; then 2024-08-22T20:28:22.7553818Z  # The docker image name already includes the ECR prefix and tag, so we can just 2024-08-22T20:28:22.7554725Z  # use it as it is, but first let's extract the tag 2024-08-22T20:28:22.7555491Z  DOCKER_TAG=$(echo "${DOCKER_IMAGE_NAME}" | awk -F '[:,]' '{print $2}') 2024-08-22T20:28:22.7556372Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-08-22T20:28:22.7557238Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2024-08-22T20:28:22.7557959Z else 2024-08-22T20:28:22.7558450Z  DOCKER_TAG=$(git rev-parse HEAD:"${DOCKER_BUILD_DIR}") 2024-08-22T20:28:22.7559280Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-08-22T20:28:22.7560255Z  echo "docker-image=${DOCKER_REGISTRY}/${REPO_NAME}/${DOCKER_IMAGE_NAME}:${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-08-22T20:28:22.7561056Z fi 2024-08-22T20:28:22.7571073Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-22T20:28:22.7571675Z env: 2024-08-22T20:28:22.7572295Z DOCKER_IMAGE: pytorch/conda-builder:cuda12.1 2024-08-22T20:28:22.7572884Z REPOSITORY: pytorch/torchchat 2024-08-22T20:28:22.7573428Z PR_NUMBER: 1044 2024-08-22T20:28:22.7575666Z SCRIPT: echo "::group::Print machine info" uname -a echo "::endgroup::" echo "::group::Install newer objcopy that supports --set-section-alignment" yum install -y devtoolset-10-binutils export PATH=/opt/rh/devtoolset-10/root/usr/bin/:$PATH echo "::endgroup::" TORCHCHAT_DEVICE=cpu .ci/scripts/run-docs evaluation echo "::group::Completion" echo "tests complete" echo "*******************************************" echo "::endgroup::" 2024-08-22T20:28:22.7578081Z RUNNER_ARTIFACT_DIR: /home/ec2-user/actions-runner/_work/_temp/artifacts 2024-08-22T20:28:22.7578934Z RUNNER_TEST_RESULTS_DIR: /home/ec2-user/actions-runner/_work/_temp/test-results 2024-08-22T20:28:22.7579791Z RUNNER_DOCS_DIR: /home/ec2-user/actions-runner/_work/_temp/docs 2024-08-22T20:28:22.7580507Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-22T20:28:22.7581054Z REPO_NAME: torchchat 2024-08-22T20:28:22.7581616Z DOCKER_IMAGE_NAME: pytorch/conda-builder:cuda12.1 2024-08-22T20:28:22.7582177Z DOCKER_BUILD_DIR: .ci/docker 2024-08-22T20:28:22.7582765Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-22T20:28:22.7583591Z ##[endgroup] 2024-08-22T20:28:22.7615992Z + [[ ! -d .ci/docker ]] 2024-08-22T20:28:22.7616448Z + echo skip=true 2024-08-22T20:28:22.7616976Z + echo docker-image=pytorch/conda-builder:cuda12.1 2024-08-22T20:28:22.7617876Z + echo 'There is no Docker build script in torchchat repo, skipping...' 2024-08-22T20:28:22.7618851Z + exit 0 2024-08-22T20:28:22.7619509Z There is no Docker build script in torchchat repo, skipping... 2024-08-22T20:28:22.7742800Z Prepare all required actions 2024-08-22T20:28:22.7787150Z ##[group]Run ./test-infra/.github/actions/pull-docker-image 2024-08-22T20:28:22.7787746Z with: 2024-08-22T20:28:22.7788223Z docker-image: pytorch/conda-builder:cuda12.1 2024-08-22T20:28:22.7788926Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-22T20:28:22.7789542Z env: 2024-08-22T20:28:22.7789995Z DOCKER_IMAGE: pytorch/conda-builder:cuda12.1 2024-08-22T20:28:22.7790502Z REPOSITORY: pytorch/torchchat 2024-08-22T20:28:22.7790984Z PR_NUMBER: 1044 2024-08-22T20:28:22.7793311Z SCRIPT: echo "::group::Print machine info" uname -a echo "::endgroup::" echo "::group::Install newer objcopy that supports --set-section-alignment" yum install -y devtoolset-10-binutils export PATH=/opt/rh/devtoolset-10/root/usr/bin/:$PATH echo "::endgroup::" TORCHCHAT_DEVICE=cpu .ci/scripts/run-docs evaluation echo "::group::Completion" echo "tests complete" echo "*******************************************" echo "::endgroup::" 2024-08-22T20:28:22.7795782Z RUNNER_ARTIFACT_DIR: /home/ec2-user/actions-runner/_work/_temp/artifacts 2024-08-22T20:28:22.7796780Z RUNNER_TEST_RESULTS_DIR: /home/ec2-user/actions-runner/_work/_temp/test-results 2024-08-22T20:28:22.7797608Z RUNNER_DOCS_DIR: /home/ec2-user/actions-runner/_work/_temp/docs 2024-08-22T20:28:22.7798301Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-22T20:28:22.7798955Z ##[endgroup] 2024-08-22T20:28:22.7865981Z ##[group]Run set -x 2024-08-22T20:28:22.7866334Z set -x 2024-08-22T20:28:22.7866640Z set +e 2024-08-22T20:28:22.7866920Z  2024-08-22T20:28:22.7867188Z login() { 2024-08-22T20:28:22.7867837Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2024-08-22T20:28:22.7868546Z } 2024-08-22T20:28:22.7868812Z  2024-08-22T20:28:22.7869089Z retry () { 2024-08-22T20:28:22.7869476Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2024-08-22T20:28:22.7869905Z } 2024-08-22T20:28:22.7870176Z  2024-08-22T20:28:22.7870485Z retry login "${DOCKER_REGISTRY}" 2024-08-22T20:28:22.7870889Z  2024-08-22T20:28:22.7871156Z set -e 2024-08-22T20:28:22.7871617Z # ignore output since only exit code is used for conditional 2024-08-22T20:28:22.7872318Z # only pull docker image if it's not available locally 2024-08-22T20:28:22.7873065Z if ! docker inspect --type=image "${DOCKER_IMAGE}" >/dev/null 2>/dev/null; then 2024-08-22T20:28:22.7873751Z  retry docker pull "${DOCKER_IMAGE}" 2024-08-22T20:28:22.7874186Z fi 2024-08-22T20:28:22.7883015Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-22T20:28:22.7883504Z env: 2024-08-22T20:28:22.7883831Z DOCKER_IMAGE: pytorch/conda-builder:cuda12.1 2024-08-22T20:28:22.7884281Z REPOSITORY: pytorch/torchchat 2024-08-22T20:28:22.7884653Z PR_NUMBER: 1044 2024-08-22T20:28:22.7886753Z SCRIPT: echo "::group::Print machine info" uname -a echo "::endgroup::" echo "::group::Install newer objcopy that supports --set-section-alignment" yum install -y devtoolset-10-binutils export PATH=/opt/rh/devtoolset-10/root/usr/bin/:$PATH echo "::endgroup::" TORCHCHAT_DEVICE=cpu .ci/scripts/run-docs evaluation echo "::group::Completion" echo "tests complete" echo "*******************************************" echo "::endgroup::" 2024-08-22T20:28:22.7889102Z RUNNER_ARTIFACT_DIR: /home/ec2-user/actions-runner/_work/_temp/artifacts 2024-08-22T20:28:22.7890023Z RUNNER_TEST_RESULTS_DIR: /home/ec2-user/actions-runner/_work/_temp/test-results 2024-08-22T20:28:22.7890739Z RUNNER_DOCS_DIR: /home/ec2-user/actions-runner/_work/_temp/docs 2024-08-22T20:28:22.7891355Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-22T20:28:22.7891951Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-22T20:28:22.7892450Z ##[endgroup] 2024-08-22T20:28:22.7919766Z + set +e 2024-08-22T20:28:22.7920595Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-22T20:28:22.7921231Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-22T20:28:22.7923380Z + aws ecr get-login-password --region us-east-1 2024-08-22T20:28:22.7925718Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-22T20:28:23.3724115Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-08-22T20:28:23.3725071Z Configure a credential helper to remove this warning. See 2024-08-22T20:28:23.3726060Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-08-22T20:28:23.3726574Z 2024-08-22T20:28:23.3726696Z Login Succeeded 2024-08-22T20:28:23.3747142Z + set -e 2024-08-22T20:28:23.3747627Z + docker inspect --type=image pytorch/conda-builder:cuda12.1 2024-08-22T20:28:23.3907590Z + retry docker pull pytorch/conda-builder:cuda12.1 2024-08-22T20:28:23.3908170Z + docker pull pytorch/conda-builder:cuda12.1 2024-08-22T20:28:23.5491180Z cuda12.1: Pulling from pytorch/conda-builder 2024-08-22T20:28:23.5492103Z 2d473b07cdd5: Pulling fs layer 2024-08-22T20:28:23.5492635Z 1feefa38b24d: Pulling fs layer 2024-08-22T20:28:23.5493137Z f3b743645691: Pulling fs layer 2024-08-22T20:28:23.5493655Z 09ec69653086: Pulling fs layer 2024-08-22T20:28:23.5494149Z 07dcdf002e0e: Pulling fs layer 2024-08-22T20:28:23.5494623Z 6d463d3f66d5: Pulling fs layer 2024-08-22T20:28:23.5495027Z af5c0f3f240b: Pulling fs layer 2024-08-22T20:28:23.5495398Z 1c60ace79a8a: Pulling fs layer 2024-08-22T20:28:23.5495776Z 0cb4bb0dd002: Pulling fs layer 2024-08-22T20:28:23.5496128Z 6a40c884dc1c: Pulling fs layer 2024-08-22T20:28:23.5496490Z 21c4fd2610fc: Pulling fs layer 2024-08-22T20:28:23.5496850Z 90d96273fa23: Pulling fs layer 2024-08-22T20:28:23.5497201Z 625bfd303d2d: Pulling fs layer 2024-08-22T20:28:23.5497564Z e8f5e731f8e4: Pulling fs layer 2024-08-22T20:28:23.5497927Z 43ef26b4d3a4: Pulling fs layer 2024-08-22T20:28:23.5498285Z 7027d2bdfdb1: Pulling fs layer 2024-08-22T20:28:23.5498635Z af5c0f3f240b: Waiting 2024-08-22T20:28:23.5498972Z db6f5f4c0334: Pulling fs layer 2024-08-22T20:28:23.5499310Z 09ec69653086: Waiting 2024-08-22T20:28:23.5499624Z 1c60ace79a8a: Waiting 2024-08-22T20:28:23.5499947Z 784019980816: Pulling fs layer 2024-08-22T20:28:23.5500305Z a7beba6b9d19: Pulling fs layer 2024-08-22T20:28:23.5500671Z 417dce1e59af: Pulling fs layer 2024-08-22T20:28:23.5501019Z 0cb4bb0dd002: Waiting 2024-08-22T20:28:23.5501327Z 6d463d3f66d5: Waiting 2024-08-22T20:28:23.5501649Z 2b99a72dd557: Pulling fs layer 2024-08-22T20:28:23.5502024Z f49fb64d359c: Pulling fs layer 2024-08-22T20:28:23.5502371Z 07dcdf002e0e: Waiting 2024-08-22T20:28:23.5502699Z bfb071e5ae48: Pulling fs layer 2024-08-22T20:28:23.5503055Z 21c4fd2610fc: Waiting 2024-08-22T20:28:23.5503376Z b2ba091c4c7d: Pulling fs layer 2024-08-22T20:28:23.5503747Z 8cfb81a5220c: Pulling fs layer 2024-08-22T20:28:23.5504123Z c5058f81a371: Pulling fs layer 2024-08-22T20:28:23.5504476Z ca3686f68fee: Pulling fs layer 2024-08-22T20:28:23.5504836Z e8f5e731f8e4: Waiting 2024-08-22T20:28:23.5505164Z fdb9230cd483: Pulling fs layer 2024-08-22T20:28:23.5505522Z dc18f68db4d4: Pulling fs layer 2024-08-22T20:28:23.5505880Z 6a40c884dc1c: Waiting 2024-08-22T20:28:23.5506201Z e7fc196062f1: Pulling fs layer 2024-08-22T20:28:23.5506543Z a7beba6b9d19: Waiting 2024-08-22T20:28:23.5506853Z bfb071e5ae48: Waiting 2024-08-22T20:28:23.5507161Z db6f5f4c0334: Waiting 2024-08-22T20:28:23.5507467Z b2ba091c4c7d: Waiting 2024-08-22T20:28:23.5507779Z 417dce1e59af: Waiting 2024-08-22T20:28:23.5508101Z fdb9230cd483: Waiting 2024-08-22T20:28:23.5508658Z dc18f68db4d4: Waiting 2024-08-22T20:28:23.5508967Z 8cfb81a5220c: Waiting 2024-08-22T20:28:23.5509281Z e7fc196062f1: Waiting 2024-08-22T20:28:23.5509580Z 784019980816: Waiting 2024-08-22T20:28:23.5509880Z 90d96273fa23: Waiting 2024-08-22T20:28:23.5510185Z 625bfd303d2d: Waiting 2024-08-22T20:28:23.5510486Z 7027d2bdfdb1: Waiting 2024-08-22T20:28:23.5510798Z f49fb64d359c: Waiting 2024-08-22T20:28:23.5511282Z ca3686f68fee: Waiting 2024-08-22T20:28:23.5511585Z c5058f81a371: Waiting 2024-08-22T20:28:23.5511891Z 2b99a72dd557: Waiting 2024-08-22T20:28:23.6031840Z f3b743645691: Verifying Checksum 2024-08-22T20:28:23.6117941Z 1feefa38b24d: Verifying Checksum 2024-08-22T20:28:23.6118462Z 1feefa38b24d: Download complete 2024-08-22T20:28:23.6478563Z 09ec69653086: Verifying Checksum 2024-08-22T20:28:23.6479510Z 09ec69653086: Download complete 2024-08-22T20:28:24.4320794Z 6d463d3f66d5: Download complete 2024-08-22T20:28:24.4609222Z 2d473b07cdd5: Download complete 2024-08-22T20:28:24.4752785Z af5c0f3f240b: Verifying Checksum 2024-08-22T20:28:24.4753268Z af5c0f3f240b: Download complete 2024-08-22T20:28:24.5662781Z 0cb4bb0dd002: Verifying Checksum 2024-08-22T20:28:24.5663243Z 0cb4bb0dd002: Download complete 2024-08-22T20:28:24.6062577Z 6a40c884dc1c: Verifying Checksum 2024-08-22T20:28:24.6063190Z 6a40c884dc1c: Download complete 2024-08-22T20:28:24.6571669Z 21c4fd2610fc: Download complete 2024-08-22T20:28:24.6966033Z 90d96273fa23: Verifying Checksum 2024-08-22T20:28:24.6966489Z 90d96273fa23: Download complete 2024-08-22T20:28:25.0493177Z 1c60ace79a8a: Verifying Checksum 2024-08-22T20:28:25.0581665Z 1c60ace79a8a: Download complete 2024-08-22T20:28:25.0582178Z 07dcdf002e0e: Verifying Checksum 2024-08-22T20:28:25.0582617Z 07dcdf002e0e: Download complete 2024-08-22T20:28:25.6895481Z e8f5e731f8e4: Verifying Checksum 2024-08-22T20:28:25.6896097Z e8f5e731f8e4: Download complete 2024-08-22T20:28:26.1330087Z 625bfd303d2d: Verifying Checksum 2024-08-22T20:28:26.1330642Z 625bfd303d2d: Download complete 2024-08-22T20:28:26.1754451Z db6f5f4c0334: Verifying Checksum 2024-08-22T20:28:26.1755014Z db6f5f4c0334: Download complete 2024-08-22T20:28:26.1796639Z 43ef26b4d3a4: Verifying Checksum 2024-08-22T20:28:26.1797194Z 43ef26b4d3a4: Download complete 2024-08-22T20:28:26.2165978Z a7beba6b9d19: Download complete 2024-08-22T20:28:26.2193647Z 784019980816: Download complete 2024-08-22T20:28:26.3484873Z 2b99a72dd557: Verifying Checksum 2024-08-22T20:28:26.3485429Z 2b99a72dd557: Download complete 2024-08-22T20:28:26.4301734Z f49fb64d359c: Download complete 2024-08-22T20:28:26.4507226Z 7027d2bdfdb1: Verifying Checksum 2024-08-22T20:28:26.4507784Z 7027d2bdfdb1: Download complete 2024-08-22T20:28:26.5312868Z b2ba091c4c7d: Download complete 2024-08-22T20:28:26.5759021Z 8cfb81a5220c: Download complete 2024-08-22T20:28:26.6254270Z c5058f81a371: Verifying Checksum 2024-08-22T20:28:26.6254836Z c5058f81a371: Download complete 2024-08-22T20:28:26.8727540Z ca3686f68fee: Verifying Checksum 2024-08-22T20:28:26.8728053Z ca3686f68fee: Download complete 2024-08-22T20:28:26.9057330Z fdb9230cd483: Verifying Checksum 2024-08-22T20:28:26.9057912Z fdb9230cd483: Download complete 2024-08-22T20:28:26.9510324Z dc18f68db4d4: Download complete 2024-08-22T20:28:28.0374332Z 2d473b07cdd5: Pull complete 2024-08-22T20:28:28.0658119Z 1feefa38b24d: Pull complete 2024-08-22T20:28:28.0867485Z f3b743645691: Pull complete 2024-08-22T20:28:28.1141976Z 09ec69653086: Pull complete 2024-08-22T20:28:30.5733950Z bfb071e5ae48: Verifying Checksum 2024-08-22T20:28:30.5734787Z bfb071e5ae48: Download complete 2024-08-22T20:28:32.2872603Z 07dcdf002e0e: Pull complete 2024-08-22T20:28:32.4956926Z e7fc196062f1: Verifying Checksum 2024-08-22T20:28:32.4957383Z e7fc196062f1: Download complete 2024-08-22T20:28:34.6585964Z 6d463d3f66d5: Pull complete 2024-08-22T20:28:34.6836817Z af5c0f3f240b: Pull complete 2024-08-22T20:28:36.0027186Z 1c60ace79a8a: Pull complete 2024-08-22T20:28:36.1650749Z 0cb4bb0dd002: Pull complete 2024-08-22T20:28:36.1891749Z 6a40c884dc1c: Pull complete 2024-08-22T20:28:36.2114601Z 21c4fd2610fc: Pull complete 2024-08-22T20:28:36.2322764Z 90d96273fa23: Pull complete 2024-08-22T20:28:39.5644991Z 625bfd303d2d: Pull complete 2024-08-22T20:28:41.0255104Z e8f5e731f8e4: Pull complete 2024-08-22T20:28:44.9593489Z 43ef26b4d3a4: Pull complete 2024-08-22T20:28:46.7176024Z 7027d2bdfdb1: Pull complete 2024-08-22T20:28:46.7419735Z db6f5f4c0334: Pull complete 2024-08-22T20:28:46.7645235Z 784019980816: Pull complete 2024-08-22T20:28:46.7831754Z a7beba6b9d19: Pull complete 2024-08-22T20:29:16.0470025Z 417dce1e59af: Verifying Checksum 2024-08-22T20:29:16.0470492Z 417dce1e59af: Download complete 2024-08-22T20:30:07.6215203Z 417dce1e59af: Pull complete 2024-08-22T20:30:08.0800654Z 2b99a72dd557: Pull complete 2024-08-22T20:30:08.3287182Z f49fb64d359c: Pull complete 2024-08-22T20:30:23.9250527Z bfb071e5ae48: Pull complete 2024-08-22T20:30:24.1488962Z b2ba091c4c7d: Pull complete 2024-08-22T20:30:24.3601926Z 8cfb81a5220c: Pull complete 2024-08-22T20:30:24.5907193Z c5058f81a371: Pull complete 2024-08-22T20:30:25.1289558Z ca3686f68fee: Pull complete 2024-08-22T20:30:25.3522805Z fdb9230cd483: Pull complete 2024-08-22T20:30:25.5771427Z dc18f68db4d4: Pull complete 2024-08-22T20:30:44.4637650Z e7fc196062f1: Pull complete 2024-08-22T20:30:44.5954961Z Digest: sha256:9f128b503c8de2d2267228e5a5ddfd791872f8fe7e4630afeec3efb07d810e8b 2024-08-22T20:30:44.6378822Z Status: Downloaded newer image for pytorch/conda-builder:cuda12.1 2024-08-22T20:30:44.6575740Z docker.io/pytorch/conda-builder:cuda12.1 2024-08-22T20:30:44.6705124Z ##[group]Run set -ex 2024-08-22T20:30:44.6705477Z set -ex 2024-08-22T20:30:44.6705764Z { 2024-08-22T20:30:44.6706073Z  echo "#!/usr/bin/env bash"; 2024-08-22T20:30:44.6706492Z  echo "set -eou pipefail"; 2024-08-22T20:30:44.6706921Z  # shellcheck disable=SC2016 2024-08-22T20:30:44.6707393Z  echo 'eval "$(conda shell.bash hook)"'; 2024-08-22T20:30:44.6707845Z  echo "set -x"; 2024-08-22T20:30:44.6708197Z  echo "${SCRIPT}"; 2024-08-22T20:30:44.6708598Z } > "${RUNNER_TEMP}/exec_script" 2024-08-22T20:30:44.6709057Z chmod +x "${RUNNER_TEMP}/exec_script" 2024-08-22T20:30:44.6709975Z python3 "/home/ec2-user/actions-runner/_work/torchchat/torchchat/test-infra/.github/scripts/run_with_env_secrets.py" "" 2024-08-22T20:30:44.6721389Z shell: /usr/bin/bash -e {0} 2024-08-22T20:30:44.6721724Z env: 2024-08-22T20:30:44.6722077Z DOCKER_IMAGE: pytorch/conda-builder:cuda12.1 2024-08-22T20:30:44.6722530Z REPOSITORY: pytorch/torchchat 2024-08-22T20:30:44.6722902Z PR_NUMBER: 1044 2024-08-22T20:30:44.6724988Z SCRIPT: echo "::group::Print machine info" uname -a echo "::endgroup::" echo "::group::Install newer objcopy that supports --set-section-alignment" yum install -y devtoolset-10-binutils export PATH=/opt/rh/devtoolset-10/root/usr/bin/:$PATH echo "::endgroup::" TORCHCHAT_DEVICE=cpu .ci/scripts/run-docs evaluation echo "::group::Completion" echo "tests complete" echo "*******************************************" echo "::endgroup::" 2024-08-22T20:30:44.6727313Z RUNNER_ARTIFACT_DIR: /home/ec2-user/actions-runner/_work/_temp/artifacts 2024-08-22T20:30:44.6728075Z RUNNER_TEST_RESULTS_DIR: /home/ec2-user/actions-runner/_work/_temp/test-results 2024-08-22T20:30:44.6728790Z RUNNER_DOCS_DIR: /home/ec2-user/actions-runner/_work/_temp/docs 2024-08-22T20:30:44.6729396Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-22T20:30:44.6730260Z ALL_SECRETS: { "github_token": "***" } 2024-08-22T20:30:44.6730678Z ##[endgroup] 2024-08-22T20:30:44.6764633Z + echo '#!/usr/bin/env bash' 2024-08-22T20:30:44.6765196Z + echo 'set -eou pipefail' 2024-08-22T20:30:44.6765688Z + echo 'eval "$(conda shell.bash hook)"' 2024-08-22T20:30:44.6766124Z + echo 'set -x' 2024-08-22T20:30:44.6766562Z + echo 'echo "::group::Print machine info" 2024-08-22T20:30:44.6766983Z uname -a 2024-08-22T20:30:44.6769925Z echo "::endgroup::" 2024-08-22T20:30:44.6770197Z 2024-08-22T20:30:44.6770788Z echo "::group::Install newer objcopy that supports --set-section-alignment" 2024-08-22T20:30:44.6771759Z yum install -y devtoolset-10-binutils 2024-08-22T20:30:44.6772328Z export PATH=/opt/rh/devtoolset-10/root/usr/bin/:$PATH 2024-08-22T20:30:44.6772811Z echo "::endgroup::" 2024-08-22T20:30:44.6773003Z 2024-08-22T20:30:44.6773259Z TORCHCHAT_DEVICE=cpu .ci/scripts/run-docs evaluation 2024-08-22T20:30:44.6773614Z 2024-08-22T20:30:44.6775656Z echo "::group::Completion" 2024-08-22T20:30:44.6776160Z echo "tests complete" 2024-08-22T20:30:44.6776625Z echo "*******************************************" 2024-08-22T20:30:44.6777057Z echo "::endgroup::"' 2024-08-22T20:30:44.6777653Z + chmod +x /home/ec2-user/actions-runner/_work/_temp/exec_script 2024-08-22T20:30:44.6781871Z + python3 /home/ec2-user/actions-runner/_work/torchchat/torchchat/test-infra/.github/scripts/run_with_env_secrets.py '' 2024-08-22T20:31:22.9297389Z Running command: 2024-08-22T20:31:22.9308592Z docker run -e PR_NUMBER -e RUNNER_ARTIFACT_DIR=/artifacts -e RUNNER_DOCS_DIR=/docs -e RUNNER_TEST_RESULTS_DIR=/test-results --env-file="/home/ec2-user/actions-runner/_work/_temp/github_env_10515112207" `# It is unknown why the container sees a different value for this.` -e GITHUB_STEP_SUMMARY -e SECRET_GITHUB_TOKEN --cap-add=SYS_PTRACE --detach --ipc=host --security-opt seccomp=unconfined --shm-size=2g --tty --ulimit stack=10485760:83886080 --ulimit core=0 --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all -v "/home/ec2-user/actions-runner/_work/torchchat/torchchat/pytorch/torchchat:/pytorch/torchchat" -v "/home/ec2-user/actions-runner/_work/torchchat/torchchat/test-infra:/test-infra" -v "/home/ec2-user/actions-runner/_work/_temp/artifacts:/artifacts" -v "/home/ec2-user/actions-runner/_work/_temp/docs:/docs" -v "/home/ec2-user/actions-runner/_work/_temp/test-results:/test-results" -v "/home/ec2-user/actions-runner/_work/_temp/exec_script:/exec" -v "/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_1685da1c-9605-4bbe-9d3a-6db93f1577c8":"/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_1685da1c-9605-4bbe-9d3a-6db93f1577c8" -w /pytorch/torchchat "pytorch/conda-builder:cuda12.1" 2024-08-22T20:31:22.9316415Z 2024-08-22T20:31:22.9316976Z 3aad161c05e101a32c2b6ad1544aec0e550d24f3fc6b6dae82ae3c6193b8664c 2024-08-22T20:31:22.9318333Z Running command: docker exec -t 3aad161c05e101a32c2b6ad1544aec0e550d24f3fc6b6dae82ae3c6193b8664c /exec 2024-08-22T20:31:22.9319225Z + echo '::group::Print machine info' 2024-08-22T20:31:22.9319945Z ##[group]Print machine info 2024-08-22T20:31:22.9320300Z + uname -a 2024-08-22T20:31:22.9321159Z Linux 3aad161c05e1 6.1.94-99.176.amzn2023.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Jun 18 14:57:56 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux 2024-08-22T20:31:22.9322002Z + echo ::endgroup:: 2024-08-22T20:31:22.9322524Z ##[endgroup] 2024-08-22T20:31:22.9323099Z + echo '::group::Install newer objcopy that supports --set-section-alignment' 2024-08-22T20:31:22.9324093Z ##[group]Install newer objcopy that supports --set-section-alignment 2024-08-22T20:31:22.9324731Z + yum install -y devtoolset-10-binutils 2024-08-22T20:31:22.9325175Z Loaded plugins: fastestmirror, ovl 2024-08-22T20:31:22.9325604Z Loading mirror speeds from cached hostfile 2024-08-22T20:31:22.9325925Z 2024-08-22T20:31:22.9326198Z epel/x86_64/metalink | 5.1 kB 00:00 2024-08-22T20:31:22.9326772Z * epel: d2lzkl7pfhq30w.cloudfront.net 2024-08-22T20:31:22.9327063Z 2024-08-22T20:31:22.9327277Z base | 3.6 kB 00:00 2024-08-22T20:31:22.9327643Z 2024-08-22T20:31:22.9327969Z centos-sclo-rh | 3.0 kB 00:00 2024-08-22T20:31:22.9328607Z 2024-08-22T20:31:22.9328946Z centos-sclo-sclo | 3.0 kB 00:00 2024-08-22T20:31:22.9329362Z 2024-08-22T20:31:22.9329584Z extras | 2.9 kB 00:00 2024-08-22T20:31:22.9329954Z 2024-08-22T20:31:22.9330178Z updates | 2.9 kB 00:00 2024-08-22T20:31:22.9330668Z Resolving Dependencies 2024-08-22T20:31:22.9331061Z --> Running transaction check 2024-08-22T20:31:22.9331686Z ---> Package devtoolset-10-binutils.x86_64 0:2.35-5.el7.4 will be installed 2024-08-22T20:31:22.9332695Z --> Processing Dependency: devtoolset-10-runtime for package: devtoolset-10-binutils-2.35-5.el7.4.x86_64 2024-08-22T20:31:22.9333493Z --> Running transaction check 2024-08-22T20:31:22.9334424Z ---> Package devtoolset-10-runtime.x86_64 0:10.1-0.el7 will be installed 2024-08-22T20:31:22.9335062Z --> Finished Dependency Resolution 2024-08-22T20:31:22.9335347Z 2024-08-22T20:31:22.9335467Z Dependencies Resolved 2024-08-22T20:31:22.9335674Z 2024-08-22T20:31:22.9335852Z ================================================================================ 2024-08-22T20:31:22.9336426Z Package Arch Version Repository Size 2024-08-22T20:31:22.9336996Z ================================================================================ 2024-08-22T20:31:22.9337435Z Installing: 2024-08-22T20:31:22.9338171Z devtoolset-10-binutils x86_64 2.35-5.el7.4 centos-sclo-rh 6.3 M 2024-08-22T20:31:22.9338770Z Installing for dependencies: 2024-08-22T20:31:22.9339400Z devtoolset-10-runtime x86_64 10.1-0.el7 centos-sclo-rh 19 k 2024-08-22T20:31:22.9339860Z 2024-08-22T20:31:22.9339981Z Transaction Summary 2024-08-22T20:31:22.9340336Z ================================================================================ 2024-08-22T20:31:22.9340876Z Install 1 Package (+1 Dependent package) 2024-08-22T20:31:22.9341180Z 2024-08-22T20:31:22.9341313Z Total download size: 6.3 M 2024-08-22T20:31:22.9341646Z Installed size: 25 M 2024-08-22T20:31:22.9341962Z Downloading packages: 2024-08-22T20:31:22.9342164Z 2024-08-22T20:31:22.9342597Z (1/2): devtoolset-10-binutils-2.35-5.el7.4.x86_64.rpm | 6.3 MB 00:00 2024-08-22T20:31:22.9343092Z 2024-08-22T20:31:22.9343503Z (2/2): devtoolset-10-runtime-10.1-0.el7.x86_64.rpm | 19 kB 00:00 2024-08-22T20:31:22.9344262Z -------------------------------------------------------------------------------- 2024-08-22T20:31:22.9344834Z Total 26 MB/s | 6.3 MB 00:00 2024-08-22T20:31:22.9345325Z Running transaction check 2024-08-22T20:31:22.9345665Z Running transaction test 2024-08-22T20:31:22.9346005Z Transaction test succeeded 2024-08-22T20:31:22.9346343Z Running transaction 2024-08-22T20:31:22.9346535Z 2024-08-22T20:31:22.9346920Z Installing : devtoolset-10-runtime-10.1-0 [ ] 1/2 2024-08-22T20:31:22.9347765Z Installing : devtoolset-10-runtime-10.1-0 [# ] 1/2 2024-08-22T20:31:22.9348595Z Installing : devtoolset-10-runtime-10.1-0 [## ] 1/2 2024-08-22T20:31:22.9349411Z Installing : devtoolset-10-runtime-10.1-0 [### ] 1/2 2024-08-22T20:31:22.9350238Z Installing : devtoolset-10-runtime-10.1-0 [#### ] 1/2 2024-08-22T20:31:22.9351128Z Installing : devtoolset-10-runtime-10.1-0 [##### ] 1/2 2024-08-22T20:31:22.9351949Z Installing : devtoolset-10-runtime-10.1-0 [###### ] 1/2 2024-08-22T20:31:22.9352775Z Installing : devtoolset-10-runtime-10.1-0 [####### ] 1/2 2024-08-22T20:31:22.9353601Z Installing : devtoolset-10-runtime-10.1-0 [######## ] 1/2 2024-08-22T20:31:22.9354420Z Installing : devtoolset-10-runtime-10.1-0 [######### ] 1/2 2024-08-22T20:31:22.9355233Z Installing : devtoolset-10-runtime-10.1-0 [########## ] 1/2 2024-08-22T20:31:22.9356202Z Installing : devtoolset-10-runtime-10.1-0 [########### ] 1/2 2024-08-22T20:31:22.9357131Z Installing : devtoolset-10-runtime-10.1-0 [############ ] 1/2 2024-08-22T20:31:22.9357950Z Installing : devtoolset-10-runtime-10.1-0 [############# ] 1/2 2024-08-22T20:31:22.9358776Z Installing : devtoolset-10-runtime-10.1-0 [############## ] 1/2 2024-08-22T20:31:22.9359607Z Installing : devtoolset-10-runtime-10.1-0 [############### ] 1/2 2024-08-22T20:31:22.9360418Z Installing : devtoolset-10-runtime-10.1-0 [################ ] 1/2 2024-08-22T20:31:22.9361243Z Installing : devtoolset-10-runtime-10.1-0 [################# ] 1/2 2024-08-22T20:31:22.9362074Z Installing : devtoolset-10-runtime-10.1-0 [################## ] 1/2 2024-08-22T20:31:22.9362903Z Installing : devtoolset-10-runtime-10.1-0 [################### ] 1/2 2024-08-22T20:31:22.9363731Z Installing : devtoolset-10-runtime-10.1-0 [##################### ] 1/2 2024-08-22T20:31:22.9364554Z Installing : devtoolset-10-runtime-10.1-0 [###################### ] 1/2 2024-08-22T20:31:22.9365373Z Installing : devtoolset-10-runtime-10.1-0 [####################### ] 1/2 2024-08-22T20:31:22.9366185Z Installing : devtoolset-10-runtime-10.1-0 [######################## ] 1/2 2024-08-22T20:31:22.9367108Z Installing : devtoolset-10-runtime-10.1-0 [######################### ] 1/2 2024-08-22T20:31:22.9367948Z Installing : devtoolset-10-runtime-10.1-0 [########################## ] 1/2 2024-08-22T20:31:22.9368767Z Installing : devtoolset-10-runtime-10.1-0 [########################### ] 1/2 2024-08-22T20:31:22.9369592Z Installing : devtoolset-10-runtime-10.1-0 [############################ ] 1/2 2024-08-22T20:31:22.9370439Z Installing : devtoolset-10-runtime-10.1-0.el7.x86_64 1/2 2024-08-22T20:31:22.9371207Z ValueError: SELinux policy is not managed or store cannot be accessed. 2024-08-22T20:31:22.9371647Z 2024-08-22T20:31:22.9372026Z Installing : devtoolset-10-binutils-2.35- [ ] 2/2 2024-08-22T20:31:22.9372848Z Installing : devtoolset-10-binutils-2.35- [# ] 2/2 2024-08-22T20:31:22.9373670Z Installing : devtoolset-10-binutils-2.35- [## ] 2/2 2024-08-22T20:31:22.9374488Z Installing : devtoolset-10-binutils-2.35- [### ] 2/2 2024-08-22T20:31:22.9375310Z Installing : devtoolset-10-binutils-2.35- [#### ] 2/2 2024-08-22T20:31:22.9376133Z Installing : devtoolset-10-binutils-2.35- [##### ] 2/2 2024-08-22T20:31:22.9376948Z Installing : devtoolset-10-binutils-2.35- [###### ] 2/2 2024-08-22T20:31:22.9377773Z Installing : devtoolset-10-binutils-2.35- [####### ] 2/2 2024-08-22T20:31:22.9378592Z Installing : devtoolset-10-binutils-2.35- [######## ] 2/2 2024-08-22T20:31:22.9379420Z Installing : devtoolset-10-binutils-2.35- [######### ] 2/2 2024-08-22T20:31:22.9380279Z Installing : devtoolset-10-binutils-2.35- [########## ] 2/2 2024-08-22T20:31:22.9381111Z Installing : devtoolset-10-binutils-2.35- [########### ] 2/2 2024-08-22T20:31:22.9381929Z Installing : devtoolset-10-binutils-2.35- [############ ] 2/2 2024-08-22T20:31:22.9382751Z Installing : devtoolset-10-binutils-2.35- [############# ] 2/2 2024-08-22T20:31:22.9383571Z Installing : devtoolset-10-binutils-2.35- [############## ] 2/2 2024-08-22T20:31:22.9384391Z Installing : devtoolset-10-binutils-2.35- [############### ] 2/2 2024-08-22T20:31:22.9385202Z Installing : devtoolset-10-binutils-2.35- [################ ] 2/2 2024-08-22T20:31:22.9386021Z Installing : devtoolset-10-binutils-2.35- [################# ] 2/2 2024-08-22T20:31:22.9386936Z Installing : devtoolset-10-binutils-2.35- [################## ] 2/2 2024-08-22T20:31:23.2588308Z Installing : devtoolset-10-binutils-2.35- [################### ] 2/2 2024-08-22T20:31:23.2589513Z Installing : devtoolset-10-binutils-2.35- [#################### ] 2/2 2024-08-22T20:31:23.2590650Z Installing : devtoolset-10-binutils-2.35- [##################### ] 2/2 2024-08-22T20:31:23.2591746Z Installing : devtoolset-10-binutils-2.35- [###################### ] 2/2 2024-08-22T20:31:23.2592817Z Installing : devtoolset-10-binutils-2.35- [####################### ] 2/2 2024-08-22T20:31:23.2593924Z Installing : devtoolset-10-binutils-2.35- [######################## ] 2/2 2024-08-22T20:31:23.2595021Z Installing : devtoolset-10-binutils-2.35- [######################### ] 2/2 2024-08-22T20:31:23.2596137Z Installing : devtoolset-10-binutils-2.35- [########################## ] 2/2 2024-08-22T20:31:23.2597365Z Installing : devtoolset-10-binutils-2.35- [########################### ] 2/2 2024-08-22T20:31:23.2598449Z Installing : devtoolset-10-binutils-2.35- [############################ ] 2/2 2024-08-22T20:31:23.2599605Z Installing : devtoolset-10-binutils-2.35-5.el7.4.x86_64 2/2 2024-08-22T20:31:23.2600767Z install-info: No such file or directory for /opt/rh/devtoolset-10/root/usr/share/info/as.info.gz 2024-08-22T20:31:23.2602196Z install-info: No such file or directory for /opt/rh/devtoolset-10/root/usr/share/info/binutils.info.gz 2024-08-22T20:31:23.2603882Z install-info: No such file or directory for /opt/rh/devtoolset-10/root/usr/share/info/gprof.info.gz 2024-08-22T20:31:23.2605290Z install-info: No such file or directory for /opt/rh/devtoolset-10/root/usr/share/info/ld.info.gz 2024-08-22T20:31:23.2606670Z install-info: No such file or directory for /opt/rh/devtoolset-10/root/usr/share/info/standards.info.gz 2024-08-22T20:31:23.2607356Z 2024-08-22T20:31:23.2607773Z Verifying : devtoolset-10-runtime-10.1-0.el7.x86_64 1/2 2024-08-22T20:31:23.2608263Z 2024-08-22T20:31:23.2608665Z Verifying : devtoolset-10-binutils-2.35-5.el7.4.x86_64 2/2 2024-08-22T20:31:23.2609155Z 2024-08-22T20:31:23.2609266Z Installed: 2024-08-22T20:31:23.2609836Z devtoolset-10-binutils.x86_64 0:2.35-5.el7.4 2024-08-22T20:31:23.2610340Z 2024-08-22T20:31:23.2610473Z Dependency Installed: 2024-08-22T20:31:23.2611084Z devtoolset-10-runtime.x86_64 0:10.1-0.el7 2024-08-22T20:31:23.2611551Z 2024-08-22T20:31:23.2611666Z Complete! 2024-08-22T20:31:23.2613077Z + export PATH=/opt/rh/devtoolset-10/root/usr/bin/:/opt/conda/bin:/opt/conda/condabin:/opt/conda/bin:/usr/local/cuda-12.1/bin:/opt/rh/devtoolset-9/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-08-22T20:31:23.2615516Z + PATH=/opt/rh/devtoolset-10/root/usr/bin/:/opt/conda/bin:/opt/conda/condabin:/opt/conda/bin:/usr/local/cuda-12.1/bin:/opt/rh/devtoolset-9/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-08-22T20:31:23.2616844Z + echo ::endgroup:: 2024-08-22T20:31:23.2617692Z ##[endgroup] 2024-08-22T20:31:23.2617985Z + TORCHCHAT_DEVICE=cpu 2024-08-22T20:31:23.2618399Z + .ci/scripts/run-docs evaluation 2024-08-22T20:31:23.2618784Z + echo ::group::Completion 2024-08-22T20:31:23.2619342Z ##[group]Completion 2024-08-22T20:31:23.2619692Z + echo 'tests complete' 2024-08-22T20:31:23.2620016Z tests complete 2024-08-22T20:31:23.2620441Z + echo '*******************************************' 2024-08-22T20:31:23.2620909Z ******************************************* 2024-08-22T20:31:23.2621301Z + echo ::endgroup:: 2024-08-22T20:31:23.2621848Z ##[endgroup] 2024-08-22T20:31:23.2691172Z ##[group]Run pmeier/pytest-results-action@v0.3.0 2024-08-22T20:31:23.2691638Z with: 2024-08-22T20:31:23.2692033Z path: /home/ec2-user/actions-runner/_work/_temp/test-results 2024-08-22T20:31:23.2692546Z fail-on-empty: false 2024-08-22T20:31:23.2693013Z env: 2024-08-22T20:31:23.2693329Z DOCKER_IMAGE: pytorch/conda-builder:cuda12.1 2024-08-22T20:31:23.2693781Z REPOSITORY: pytorch/torchchat 2024-08-22T20:31:23.2694143Z PR_NUMBER: 1044 2024-08-22T20:31:23.2696238Z SCRIPT: echo "::group::Print machine info" uname -a echo "::endgroup::" echo "::group::Install newer objcopy that supports --set-section-alignment" yum install -y devtoolset-10-binutils export PATH=/opt/rh/devtoolset-10/root/usr/bin/:$PATH echo "::endgroup::" TORCHCHAT_DEVICE=cpu .ci/scripts/run-docs evaluation echo "::group::Completion" echo "tests complete" echo "*******************************************" echo "::endgroup::" 2024-08-22T20:31:23.2698596Z RUNNER_ARTIFACT_DIR: /home/ec2-user/actions-runner/_work/_temp/artifacts 2024-08-22T20:31:23.2699342Z RUNNER_TEST_RESULTS_DIR: /home/ec2-user/actions-runner/_work/_temp/test-results 2024-08-22T20:31:23.2700067Z RUNNER_DOCS_DIR: /home/ec2-user/actions-runner/_work/_temp/docs 2024-08-22T20:31:23.2700671Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-22T20:31:23.2701158Z ##[endgroup] 2024-08-22T20:31:23.3389925Z Prepare all required actions 2024-08-22T20:31:23.3427651Z ##[group]Run ./test-infra/.github/actions/chown-directory 2024-08-22T20:31:23.3428127Z with: 2024-08-22T20:31:23.3428552Z directory: /home/ec2-user/actions-runner/_work/torchchat/torchchat/ 2024-08-22T20:31:23.3429269Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2024-08-22T20:31:23.3429821Z env: 2024-08-22T20:31:23.3430139Z DOCKER_IMAGE: pytorch/conda-builder:cuda12.1 2024-08-22T20:31:23.3430588Z REPOSITORY: pytorch/torchchat 2024-08-22T20:31:23.3430963Z PR_NUMBER: 1044 2024-08-22T20:31:23.3433083Z SCRIPT: echo "::group::Print machine info" uname -a echo "::endgroup::" echo "::group::Install newer objcopy that supports --set-section-alignment" yum install -y devtoolset-10-binutils export PATH=/opt/rh/devtoolset-10/root/usr/bin/:$PATH echo "::endgroup::" TORCHCHAT_DEVICE=cpu .ci/scripts/run-docs evaluation echo "::group::Completion" echo "tests complete" echo "*******************************************" echo "::endgroup::" 2024-08-22T20:31:23.3435906Z RUNNER_ARTIFACT_DIR: /home/ec2-user/actions-runner/_work/_temp/artifacts 2024-08-22T20:31:23.3436713Z RUNNER_TEST_RESULTS_DIR: /home/ec2-user/actions-runner/_work/_temp/test-results 2024-08-22T20:31:23.3437427Z RUNNER_DOCS_DIR: /home/ec2-user/actions-runner/_work/_temp/docs 2024-08-22T20:31:23.3438040Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-22T20:31:23.3438506Z ##[endgroup] 2024-08-22T20:31:23.3457640Z ##[group]Run docker run --rm -v "${DIRECTORY}":/v -w /v "${ALPINE_IMAGE}" chown -R "$(id -u):$(id -g)" . 2024-08-22T20:31:23.3458594Z docker run --rm -v "${DIRECTORY}":/v -w /v "${ALPINE_IMAGE}" chown -R "$(id -u):$(id -g)" . 2024-08-22T20:31:23.3470235Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-22T20:31:23.3470723Z env: 2024-08-22T20:31:23.3471042Z DOCKER_IMAGE: pytorch/conda-builder:cuda12.1 2024-08-22T20:31:23.3471495Z REPOSITORY: pytorch/torchchat 2024-08-22T20:31:23.3471872Z PR_NUMBER: 1044 2024-08-22T20:31:23.3473955Z SCRIPT: echo "::group::Print machine info" uname -a echo "::endgroup::" echo "::group::Install newer objcopy that supports --set-section-alignment" yum install -y devtoolset-10-binutils export PATH=/opt/rh/devtoolset-10/root/usr/bin/:$PATH echo "::endgroup::" TORCHCHAT_DEVICE=cpu .ci/scripts/run-docs evaluation echo "::group::Completion" echo "tests complete" echo "*******************************************" echo "::endgroup::" 2024-08-22T20:31:23.3476295Z RUNNER_ARTIFACT_DIR: /home/ec2-user/actions-runner/_work/_temp/artifacts 2024-08-22T20:31:23.3477119Z RUNNER_TEST_RESULTS_DIR: /home/ec2-user/actions-runner/_work/_temp/test-results 2024-08-22T20:31:23.3477822Z RUNNER_DOCS_DIR: /home/ec2-user/actions-runner/_work/_temp/docs 2024-08-22T20:31:23.3478423Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-22T20:31:23.3479062Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2024-08-22T20:31:23.3479951Z DIRECTORY: /home/ec2-user/actions-runner/_work/torchchat/torchchat/ 2024-08-22T20:31:23.3480489Z ##[endgroup] 2024-08-22T20:31:23.3694042Z Unable to find image '308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine:latest' locally 2024-08-22T20:31:23.5827294Z latest: Pulling from tool/alpine 2024-08-22T20:31:23.5827780Z 540db60ca938: Pulling fs layer 2024-08-22T20:31:23.6567117Z 540db60ca938: Download complete 2024-08-22T20:31:23.7728873Z 540db60ca938: Pull complete 2024-08-22T20:31:23.7824556Z Digest: sha256:def822f9851ca422481ec6fee59a9966f12b351c62ccb9aca841526ffaa9f748 2024-08-22T20:31:23.7855843Z Status: Downloaded newer image for 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine:latest 2024-08-22T20:31:24.8899055Z Prepare all required actions 2024-08-22T20:31:24.8934267Z ##[group]Run ./test-infra/.github/actions/chown-directory 2024-08-22T20:31:24.8934834Z with: 2024-08-22T20:31:24.8935182Z directory: /home/ec2-user/actions-runner/_work/_temp 2024-08-22T20:31:24.8935844Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2024-08-22T20:31:24.8936388Z env: 2024-08-22T20:31:24.8936697Z DOCKER_IMAGE: pytorch/conda-builder:cuda12.1 2024-08-22T20:31:24.8937154Z REPOSITORY: pytorch/torchchat 2024-08-22T20:31:24.8937522Z PR_NUMBER: 1044 2024-08-22T20:31:24.8939634Z SCRIPT: echo "::group::Print machine info" uname -a echo "::endgroup::" echo "::group::Install newer objcopy that supports --set-section-alignment" yum install -y devtoolset-10-binutils export PATH=/opt/rh/devtoolset-10/root/usr/bin/:$PATH echo "::endgroup::" TORCHCHAT_DEVICE=cpu .ci/scripts/run-docs evaluation echo "::group::Completion" echo "tests complete" echo "*******************************************" echo "::endgroup::" 2024-08-22T20:31:24.8941976Z RUNNER_ARTIFACT_DIR: /home/ec2-user/actions-runner/_work/_temp/artifacts 2024-08-22T20:31:24.8942733Z RUNNER_TEST_RESULTS_DIR: /home/ec2-user/actions-runner/_work/_temp/test-results 2024-08-22T20:31:24.8943452Z RUNNER_DOCS_DIR: /home/ec2-user/actions-runner/_work/_temp/docs 2024-08-22T20:31:24.8944058Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-22T20:31:24.8944520Z ##[endgroup] 2024-08-22T20:31:24.8963984Z ##[group]Run docker run --rm -v "${DIRECTORY}":/v -w /v "${ALPINE_IMAGE}" chown -R "$(id -u):$(id -g)" . 2024-08-22T20:31:24.8964933Z docker run --rm -v "${DIRECTORY}":/v -w /v "${ALPINE_IMAGE}" chown -R "$(id -u):$(id -g)" . 2024-08-22T20:31:24.8975347Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-22T20:31:24.8975833Z env: 2024-08-22T20:31:24.8976149Z DOCKER_IMAGE: pytorch/conda-builder:cuda12.1 2024-08-22T20:31:24.8976595Z REPOSITORY: pytorch/torchchat 2024-08-22T20:31:24.8976969Z PR_NUMBER: 1044 2024-08-22T20:31:24.8979050Z SCRIPT: echo "::group::Print machine info" uname -a echo "::endgroup::" echo "::group::Install newer objcopy that supports --set-section-alignment" yum install -y devtoolset-10-binutils export PATH=/opt/rh/devtoolset-10/root/usr/bin/:$PATH echo "::endgroup::" TORCHCHAT_DEVICE=cpu .ci/scripts/run-docs evaluation echo "::group::Completion" echo "tests complete" echo "*******************************************" echo "::endgroup::" 2024-08-22T20:31:24.8981440Z RUNNER_ARTIFACT_DIR: /home/ec2-user/actions-runner/_work/_temp/artifacts 2024-08-22T20:31:24.8982195Z RUNNER_TEST_RESULTS_DIR: /home/ec2-user/actions-runner/_work/_temp/test-results 2024-08-22T20:31:24.8982898Z RUNNER_DOCS_DIR: /home/ec2-user/actions-runner/_work/_temp/docs 2024-08-22T20:31:24.8983499Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-22T20:31:24.8984142Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2024-08-22T20:31:24.8984781Z DIRECTORY: /home/ec2-user/actions-runner/_work/_temp 2024-08-22T20:31:24.8985238Z ##[endgroup] 2024-08-22T20:31:25.8499284Z ##[group]Run # Only do these steps if we actually want to upload an artifact 2024-08-22T20:31:25.8500277Z # Only do these steps if we actually want to upload an artifact 2024-08-22T20:31:25.8500919Z if [[ -n "${UPLOAD_ARTIFACT_NAME}" ]]; then 2024-08-22T20:31:25.8501685Z  # If the default execution path is followed then we should get a wheel in the dist/ folder 2024-08-22T20:31:25.8502559Z  # attempt to just grab whatever is in there and scoop it all up 2024-08-22T20:31:25.8503274Z  if find "dist/" -name "*.whl" >/dev/null 2>/dev/null; then 2024-08-22T20:31:25.8503888Z  mv -v dist/*.whl "${RUNNER_ARTIFACT_DIR}/" 2024-08-22T20:31:25.8504345Z  fi 2024-08-22T20:31:25.8504732Z  if [[ -d "artifacts-to-be-uploaded" ]]; then 2024-08-22T20:31:25.8505380Z  mv -v artifacts-to-be-uploaded/* "${RUNNER_ARTIFACT_DIR}/" 2024-08-22T20:31:25.8505928Z  fi 2024-08-22T20:31:25.8506543Z  # Set to fail upload step if there are no files for upload and expected files for upload 2024-08-22T20:31:25.8507370Z  echo 'if-no-files-found=error' >> "${GITHUB_OUTPUT}" 2024-08-22T20:31:25.8507888Z fi 2024-08-22T20:31:25.8508164Z  2024-08-22T20:31:25.8508440Z upload_docs=0 2024-08-22T20:31:25.8509019Z # Check if there are files in the documentation folder to upload, note that 2024-08-22T20:31:25.8509673Z # empty folders do not count 2024-08-22T20:31:25.8510290Z if find "${RUNNER_DOCS_DIR}" -mindepth 1 -maxdepth 1 -type f | read -r; then 2024-08-22T20:31:25.8511198Z  # TODO: Add a check here to test if on ec2 because if we're not on ec2 then this 2024-08-22T20:31:25.8511934Z  # upload will probably not work correctly 2024-08-22T20:31:25.8512412Z  upload_docs=1 2024-08-22T20:31:25.8512738Z fi 2024-08-22T20:31:25.8513162Z echo "upload-docs=${upload_docs}" >> "${GITHUB_OUTPUT}" 2024-08-22T20:31:25.8522457Z shell: /usr/bin/bash -e {0} 2024-08-22T20:31:25.8522792Z env: 2024-08-22T20:31:25.8523127Z DOCKER_IMAGE: pytorch/conda-builder:cuda12.1 2024-08-22T20:31:25.8523590Z REPOSITORY: pytorch/torchchat 2024-08-22T20:31:25.8523957Z PR_NUMBER: 1044 2024-08-22T20:31:25.8526055Z SCRIPT: echo "::group::Print machine info" uname -a echo "::endgroup::" echo "::group::Install newer objcopy that supports --set-section-alignment" yum install -y devtoolset-10-binutils export PATH=/opt/rh/devtoolset-10/root/usr/bin/:$PATH echo "::endgroup::" TORCHCHAT_DEVICE=cpu .ci/scripts/run-docs evaluation echo "::group::Completion" echo "tests complete" echo "*******************************************" echo "::endgroup::" 2024-08-22T20:31:25.8528408Z RUNNER_ARTIFACT_DIR: /home/ec2-user/actions-runner/_work/_temp/artifacts 2024-08-22T20:31:25.8529177Z RUNNER_TEST_RESULTS_DIR: /home/ec2-user/actions-runner/_work/_temp/test-results 2024-08-22T20:31:25.8529900Z RUNNER_DOCS_DIR: /home/ec2-user/actions-runner/_work/_temp/docs 2024-08-22T20:31:25.8530507Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-22T20:31:25.8531015Z UPLOAD_ARTIFACT_NAME: 2024-08-22T20:31:25.8531346Z ##[endgroup] 2024-08-22T20:31:25.8628886Z Prepare all required actions 2024-08-22T20:31:25.8667919Z ##[group]Run ./test-infra/.github/actions/teardown-linux 2024-08-22T20:31:25.8668388Z with: 2024-08-22T20:31:25.8668639Z env: 2024-08-22T20:31:25.8668961Z DOCKER_IMAGE: pytorch/conda-builder:cuda12.1 2024-08-22T20:31:25.8669406Z REPOSITORY: pytorch/torchchat 2024-08-22T20:31:25.8669774Z PR_NUMBER: 1044 2024-08-22T20:31:25.8671861Z SCRIPT: echo "::group::Print machine info" uname -a echo "::endgroup::" echo "::group::Install newer objcopy that supports --set-section-alignment" yum install -y devtoolset-10-binutils export PATH=/opt/rh/devtoolset-10/root/usr/bin/:$PATH echo "::endgroup::" TORCHCHAT_DEVICE=cpu .ci/scripts/run-docs evaluation echo "::group::Completion" echo "tests complete" echo "*******************************************" echo "::endgroup::" 2024-08-22T20:31:25.8674208Z RUNNER_ARTIFACT_DIR: /home/ec2-user/actions-runner/_work/_temp/artifacts 2024-08-22T20:31:25.8675160Z RUNNER_TEST_RESULTS_DIR: /home/ec2-user/actions-runner/_work/_temp/test-results 2024-08-22T20:31:25.8675865Z RUNNER_DOCS_DIR: /home/ec2-user/actions-runner/_work/_temp/docs 2024-08-22T20:31:25.8676548Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-22T20:31:25.8677018Z ##[endgroup] 2024-08-22T20:31:25.8697597Z ##[group]Run set -eou pipefail 2024-08-22T20:31:25.8697991Z set -eou pipefail 2024-08-22T20:31:25.8698327Z  2024-08-22T20:31:25.8698824Z echo "Holding runner for 2 hours until all ssh sessions have logged out" 2024-08-22T20:31:25.8699436Z for _ in $(seq 1440); do 2024-08-22T20:31:25.8699898Z  # Break if no ssh session exists anymore 2024-08-22T20:31:25.8700388Z  if [ "$(who)" = "" ]; then 2024-08-22T20:31:25.8700782Z  break 2024-08-22T20:31:25.8701101Z  fi 2024-08-22T20:31:25.8701394Z  echo "." 2024-08-22T20:31:25.8701723Z  sleep 5 2024-08-22T20:31:25.8702033Z done 2024-08-22T20:31:25.8711729Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-22T20:31:25.8712228Z env: 2024-08-22T20:31:25.8712545Z DOCKER_IMAGE: pytorch/conda-builder:cuda12.1 2024-08-22T20:31:25.8712990Z REPOSITORY: pytorch/torchchat 2024-08-22T20:31:25.8713366Z PR_NUMBER: 1044 2024-08-22T20:31:25.8715458Z SCRIPT: echo "::group::Print machine info" uname -a echo "::endgroup::" echo "::group::Install newer objcopy that supports --set-section-alignment" yum install -y devtoolset-10-binutils export PATH=/opt/rh/devtoolset-10/root/usr/bin/:$PATH echo "::endgroup::" TORCHCHAT_DEVICE=cpu .ci/scripts/run-docs evaluation echo "::group::Completion" echo "tests complete" echo "*******************************************" echo "::endgroup::" 2024-08-22T20:31:25.8717877Z RUNNER_ARTIFACT_DIR: /home/ec2-user/actions-runner/_work/_temp/artifacts 2024-08-22T20:31:25.8718632Z RUNNER_TEST_RESULTS_DIR: /home/ec2-user/actions-runner/_work/_temp/test-results 2024-08-22T20:31:25.8719351Z RUNNER_DOCS_DIR: /home/ec2-user/actions-runner/_work/_temp/docs 2024-08-22T20:31:25.8719951Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-22T20:31:25.8720425Z ##[endgroup] 2024-08-22T20:31:25.8749111Z Holding runner for 2 hours until all ssh sessions have logged out 2024-08-22T20:31:25.8810118Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2024-08-22T20:31:25.8810875Z # ignore expansion of "docker ps -q" since it could be empty 2024-08-22T20:31:25.8811509Z # shellcheck disable=SC2046 2024-08-22T20:31:25.8811962Z docker stop $(docker ps -q) || true 2024-08-22T20:31:25.8812423Z # Prune all of the docker images 2024-08-22T20:31:25.8812861Z docker system prune -af 2024-08-22T20:31:25.8821270Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-22T20:31:25.8821781Z env: 2024-08-22T20:31:25.8822110Z DOCKER_IMAGE: pytorch/conda-builder:cuda12.1 2024-08-22T20:31:25.8822583Z REPOSITORY: pytorch/torchchat 2024-08-22T20:31:25.8823156Z PR_NUMBER: 1044 2024-08-22T20:31:25.8825255Z SCRIPT: echo "::group::Print machine info" uname -a echo "::endgroup::" echo "::group::Install newer objcopy that supports --set-section-alignment" yum install -y devtoolset-10-binutils export PATH=/opt/rh/devtoolset-10/root/usr/bin/:$PATH echo "::endgroup::" TORCHCHAT_DEVICE=cpu .ci/scripts/run-docs evaluation echo "::group::Completion" echo "tests complete" echo "*******************************************" echo "::endgroup::" 2024-08-22T20:31:25.8827579Z RUNNER_ARTIFACT_DIR: /home/ec2-user/actions-runner/_work/_temp/artifacts 2024-08-22T20:31:25.8828337Z RUNNER_TEST_RESULTS_DIR: /home/ec2-user/actions-runner/_work/_temp/test-results 2024-08-22T20:31:25.8829051Z RUNNER_DOCS_DIR: /home/ec2-user/actions-runner/_work/_temp/docs 2024-08-22T20:31:25.8829660Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-22T20:31:25.8830277Z ##[endgroup] 2024-08-22T20:31:36.3628590Z 3aad161c05e1 2024-08-22T20:31:36.4105792Z Deleted Containers: 2024-08-22T20:31:36.4106517Z 3aad161c05e101a32c2b6ad1544aec0e550d24f3fc6b6dae82ae3c6193b8664c 2024-08-22T20:31:36.4107073Z 2024-08-22T20:31:41.7804102Z Deleted Images: 2024-08-22T20:31:41.7804798Z untagged: pytorch/conda-builder:cuda12.1 2024-08-22T20:31:41.7805734Z untagged: pytorch/conda-builder@sha256:9f128b503c8de2d2267228e5a5ddfd791872f8fe7e4630afeec3efb07d810e8b 2024-08-22T20:31:41.7806693Z deleted: sha256:ca6cb5e15adf1287624fd5ee41e98e3482f9ba8e8eb49b94e1c89149740d589e 2024-08-22T20:31:41.7807525Z deleted: sha256:7ea5160e27b147a9b8579d1ecaa57d793582bf5bc915c7f8cdbfb0e9d6cb07a7 2024-08-22T20:31:41.7808345Z deleted: sha256:b62ea2cf6a5771e822ce3339bbcc153c9d1d567d410908f8c8bb6364538d5ce4 2024-08-22T20:31:41.7809194Z deleted: sha256:e2aa7aeae6883178dc9137b7198de0dd0e488fe2f3c2350041d78a21c5268174 2024-08-22T20:31:41.7810025Z deleted: sha256:7d64cbcd3947a1e0aa1abd5a9d734cd961aea4c0ec4635ea3294e37e96f69830 2024-08-22T20:31:41.7810886Z deleted: sha256:3eb08d55a9f629f97e2e1c0cf20ff802536c0d341d9ba38f949500fdc3329dc9 2024-08-22T20:31:41.7811700Z deleted: sha256:617916537dafd2cb5f4e62e43d1fffecd492f1dbdd557b93a8d4a3d8516f182a 2024-08-22T20:31:41.7812499Z deleted: sha256:e39e75923171030569887b5cbf74f952383a76c593d9abf08059f9d6c0eba9b6 2024-08-22T20:31:41.7813289Z deleted: sha256:d1a0a10f342c13f93556fdd4df93a12497190394e4198dcd5618cbac69506c9b 2024-08-22T20:31:41.7814076Z deleted: sha256:e9a939e626efc5c03f7b5206aa11981d73de39345c575dcc35552c4b1f4fe935 2024-08-22T20:31:41.7814893Z deleted: sha256:12bf6c0ce8bb61ca65095e25018efabe18faabbf4ba318874150aa3ce13a8008 2024-08-22T20:31:41.7815752Z deleted: sha256:d4899a6466695bcab7f74253d4e13a31e2861aa3346ae5e87cfaec75bfa2a5a1 2024-08-22T20:31:41.7816555Z deleted: sha256:57f423db078477fd48a3b21e0e960108e17ad45def0728927e3607b867c011be 2024-08-22T20:31:41.7817344Z deleted: sha256:4d9e8db683cb433346e5a329c9a1223693b21cbe1ef03ad9669ea169d2531568 2024-08-22T20:31:41.7818148Z deleted: sha256:636b11b88d0d4f380e06ce31e183eb66b39baf66d25b46d671a6d07156272626 2024-08-22T20:31:41.7818954Z deleted: sha256:5fb38e0fdae552967ea7e31c6dbf71dd662194ce4c3e34a73275d955c7516ac9 2024-08-22T20:31:41.7819755Z deleted: sha256:e945d944e062cb5b4b5bce5ca9255339c385aa7e76352cba574e7b9adcbfaf81 2024-08-22T20:31:41.7820616Z deleted: sha256:629a87d40778fa59aae239569d2e4022eb9c73c24d5a8a80b631578c6a0d95de 2024-08-22T20:31:41.7821430Z deleted: sha256:28b222b3a9320157c8d332c568c93debef3da5ea2a633329870ce36a79787ec0 2024-08-22T20:31:41.7822367Z deleted: sha256:77654d0fdc0b2b63fe1b22c1e69a2e39d9c51f0935f861e7828d36f4f736ad79 2024-08-22T20:31:41.7823178Z deleted: sha256:bf65b0450ea54ac3431526e360b0f7c3e7c4ac66000529df84d01fa39061535c 2024-08-22T20:31:41.7823975Z deleted: sha256:2e78abff6cee136276a6b6ac50167c9b9761c7005e02c832947580165140577f 2024-08-22T20:31:41.7824765Z deleted: sha256:779151bb607dc93e1099434061314ed422972abb54587e96a0400de4fdc718c0 2024-08-22T20:31:41.7825587Z deleted: sha256:8b116155e6592b810a5108f4e36aed3bd14b162dc4636a3b9052a885006508a4 2024-08-22T20:31:41.7826738Z deleted: sha256:16eb6de95902da3aa8f26838aa5e0876e791b9d338a43d4ddf7864bccfcb3e25 2024-08-22T20:31:41.7827579Z deleted: sha256:f1cc8ad9df374e9b9b2cfbdcd52ce63a53a3ee8b4f82edcebde8156aeec389ad 2024-08-22T20:31:41.7828408Z deleted: sha256:29937eb76d3be5ed458043982e587e3ae1c44991b86fef436ac51e69b3526331 2024-08-22T20:31:41.7829223Z deleted: sha256:fa0dd9cde456c1e5de9010f19af898bbeaa2c089cc1ae9f6e56166a558d448a8 2024-08-22T20:31:41.7830050Z deleted: sha256:74a8a6ee05c38b7d2b93ff2b2cfc3502c47cc6dc1043ecda998808f02c36076e 2024-08-22T20:31:41.7830838Z deleted: sha256:c734a1acf015e761506178e29744373917426c75b2191f3e74173bd615af5108 2024-08-22T20:31:41.7831611Z deleted: sha256:174f5685490326fc0a1c0f5570b8663732189b327007e47ff13d2ca59673db02 2024-08-22T20:31:41.7832472Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine:latest 2024-08-22T20:31:41.7833714Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine@sha256:def822f9851ca422481ec6fee59a9966f12b351c62ccb9aca841526ffaa9f748 2024-08-22T20:31:41.7835633Z deleted: sha256:6dbb9cc54074106d46d4ccb330f2a40a682d49dda5f4844962b7dce9fe44aaec 2024-08-22T20:31:41.7836733Z deleted: sha256:b2d5eeeaba3a22b9b8aa97261957974a6bd65274ebd43e1d81d0a7b8b752b116 2024-08-22T20:31:41.7837336Z 2024-08-22T20:31:41.7837518Z Total reclaimed space: 13.9GB 2024-08-22T20:31:41.7887562Z ##[group]Run set +e 2024-08-22T20:31:41.7887897Z set +e 2024-08-22T20:31:41.7888240Z if [[ "${NO_SUDO}" == "false" ]]; then 2024-08-22T20:31:41.7888799Z  sudo rm -rf "${GITHUB_WORKSPACE:?}/${REPOSITORY:?}" 2024-08-22T20:31:41.7889296Z else 2024-08-22T20:31:41.7889680Z  rm -rf "${GITHUB_WORKSPACE:?}/${REPOSITORY:?}" 2024-08-22T20:31:41.7890145Z fi 2024-08-22T20:31:41.7890424Z set -e 2024-08-22T20:31:41.7899776Z shell: /usr/bin/bash -e {0} 2024-08-22T20:31:41.7900117Z env: 2024-08-22T20:31:41.7900436Z DOCKER_IMAGE: pytorch/conda-builder:cuda12.1 2024-08-22T20:31:41.7900896Z REPOSITORY: pytorch/torchchat 2024-08-22T20:31:41.7901272Z PR_NUMBER: 1044 2024-08-22T20:31:41.7903434Z SCRIPT: echo "::group::Print machine info" uname -a echo "::endgroup::" echo "::group::Install newer objcopy that supports --set-section-alignment" yum install -y devtoolset-10-binutils export PATH=/opt/rh/devtoolset-10/root/usr/bin/:$PATH echo "::endgroup::" TORCHCHAT_DEVICE=cpu .ci/scripts/run-docs evaluation echo "::group::Completion" echo "tests complete" echo "*******************************************" echo "::endgroup::" 2024-08-22T20:31:41.7905829Z RUNNER_ARTIFACT_DIR: /home/ec2-user/actions-runner/_work/_temp/artifacts 2024-08-22T20:31:41.7906582Z RUNNER_TEST_RESULTS_DIR: /home/ec2-user/actions-runner/_work/_temp/test-results 2024-08-22T20:31:41.7907300Z RUNNER_DOCS_DIR: /home/ec2-user/actions-runner/_work/_temp/docs 2024-08-22T20:31:41.7907905Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-22T20:31:41.7908375Z NO_SUDO: false 2024-08-22T20:31:41.7908673Z ##[endgroup] 2024-08-22T20:31:41.9389968Z Post job cleanup. 2024-08-22T20:31:42.0348504Z Post job cleanup. 2024-08-22T20:31:42.1220163Z [command]/usr/bin/git version 2024-08-22T20:31:42.1273068Z git version 2.40.1 2024-08-22T20:31:42.1309821Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/25f0c400-aa32-4e94-80c4-0eb14ae23c59' before making global git config changes 2024-08-22T20:31:42.1311036Z Adding repository directory to the temporary git global config as a safe directory 2024-08-22T20:31:42.1314916Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/torchchat/torchchat/test-infra 2024-08-22T20:31:42.1361484Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2024-08-22T20:31:42.1404979Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2024-08-22T20:31:42.1770487Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2024-08-22T20:31:42.1806105Z http.https://github.com/.extraheader 2024-08-22T20:31:42.1815760Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader 2024-08-22T20:31:42.1861158Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2024-08-22T20:31:42.2298463Z A job completed hook has been configured by the self-hosted runner administrator 2024-08-22T20:31:42.2321577Z ##[group]Run '/home/ec2-user/runner-scripts/after_job.sh' 2024-08-22T20:31:42.2330385Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-22T20:31:42.2330890Z ##[endgroup] 2024-08-22T20:31:49.1596078Z Cleaning up orphan processes