2025-03-14T06:06:50.1597592Z Current runner version: '2.322.0' 2025-03-14T06:06:50.1607732Z Runner name: 'i-0aed66dea5c7934ab' 2025-03-14T06:06:50.1609092Z Runner group name: 'Default' 2025-03-14T06:06:50.1610627Z Machine name: 'ip-10-0-9-173' 2025-03-14T06:06:50.1615447Z ##[group]GITHUB_TOKEN Permissions 2025-03-14T06:06:50.1618823Z Contents: read 2025-03-14T06:06:50.1619773Z Metadata: read 2025-03-14T06:06:50.1620761Z Packages: read 2025-03-14T06:06:50.1621665Z ##[endgroup] 2025-03-14T06:06:50.1626541Z Secret source: Actions 2025-03-14T06:06:50.1627924Z Prepare workflow directory 2025-03-14T06:06:50.6125397Z Prepare all required actions 2025-03-14T06:06:50.6179663Z Getting action download info 2025-03-14T06:06:50.7957965Z Download action repository 'pytorch/test-infra@main' (SHA:de00dac6adc071cb2f9861380a0ed3947b93e5cc) 2025-03-14T06:06:52.1449213Z Download action repository 'pytorch/pytorch@main' (SHA:d4496346b901e9a4c3993bf6b2054014c7c0b731) 2025-03-14T06:07:04.1038662Z Download action repository 'actions/checkout@v4' (SHA:11bd71901bbe5b1630ceea73d27597364c9af683) 2025-03-14T06:07:04.3175594Z Download action repository 'actions/download-artifact@v4.1.7' (SHA:65a9edc5881444af0b9093a5e628f2fe47ea3b2e) 2025-03-14T06:07:04.7217060Z Getting action download info 2025-03-14T06:07:04.8979684Z Getting action download info 2025-03-14T06:07:05.0040220Z Download action repository 'nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482' (SHA:3e91a01664abd3c5cd539100d10d33b9c5b68482) 2025-03-14T06:07:05.1940431Z Uses: pytorch/pytorch/.github/workflows/_binary-test-linux.yml@refs/heads/main (aed0b7a742a2d7b7901790622829cbd2135049a4) 2025-03-14T06:07:05.1943134Z ##[group] Inputs 2025-03-14T06:07:05.1943575Z build_name: manywheel-py3_9-cuda12_6 2025-03-14T06:07:05.1944051Z build_environment: linux-binary-manywheel 2025-03-14T06:07:05.1944628Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2025-03-14T06:07:05.1945217Z PYTORCH_ROOT: /pytorch 2025-03-14T06:07:05.1945622Z PACKAGE_TYPE: manywheel 2025-03-14T06:07:05.1946015Z DESIRED_CUDA: cu126 2025-03-14T06:07:05.1946400Z GPU_ARCH_VERSION: 12.6 2025-03-14T06:07:05.1946761Z GPU_ARCH_TYPE: cuda 2025-03-14T06:07:05.1947229Z DOCKER_IMAGE: pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:07:05.1947732Z LIBTORCH_CONFIG: 2025-03-14T06:07:05.1948066Z LIBTORCH_VARIANT: 2025-03-14T06:07:05.1948426Z DESIRED_DEVTOOLSET: cxx11-abi 2025-03-14T06:07:05.1948799Z DESIRED_PYTHON: 3.9 2025-03-14T06:07:05.1949145Z runner_prefix: lf. 2025-03-14T06:07:05.1949522Z runs_on: linux.4xlarge.nvidia.gpu 2025-03-14T06:07:05.1950541Z use_split_build: false 2025-03-14T06:07:05.1950936Z ##[endgroup] 2025-03-14T06:07:05.1951328Z Complete job name: manywheel-py3_9-cuda12_6-test / test 2025-03-14T06:07:05.2555694Z A job started hook has been configured by the self-hosted runner administrator 2025-03-14T06:07:05.2697982Z ##[group]Run '/home/ec2-user/runner-scripts/before_job.sh' 2025-03-14T06:07:05.2709308Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T06:07:05.2710403Z ##[endgroup] 2025-03-14T06:07:07.1102814Z Runner Type: lf.linux.4xlarge.nvidia.gpu 2025-03-14T06:07:07.1103505Z Instance Type: g3.4xlarge 2025-03-14T06:07:07.1103889Z AMI Name: unknown 2025-03-14T06:07:07.1133405Z AMI ID: ami-05b10e08d247fb927 2025-03-14T06:07:13.9449643Z ##[group]Run { 2025-03-14T06:07:13.9450125Z { 2025-03-14T06:07:13.9450485Z  echo "PYTORCH_ROOT=/pytorch" 2025-03-14T06:07:13.9450951Z  echo "PACKAGE_TYPE=manywheel" 2025-03-14T06:07:13.9451379Z  2025-03-14T06:07:13.9451692Z  echo "DESIRED_CUDA=cu126" 2025-03-14T06:07:13.9452124Z  echo "GPU_ARCH_VERSION=12.6" 2025-03-14T06:07:13.9452568Z  echo "GPU_ARCH_TYPE=cuda" 2025-03-14T06:07:13.9453130Z  echo "DOCKER_IMAGE=pytorch/manylinux2_28-builder:cuda12.6-main" 2025-03-14T06:07:13.9453704Z  echo "SKIP_ALL_TESTS=1" 2025-03-14T06:07:13.9454117Z  echo "LIBTORCH_CONFIG=" 2025-03-14T06:07:13.9454533Z  echo "LIBTORCH_VARIANT=" 2025-03-14T06:07:13.9455301Z  echo "DESIRED_DEVTOOLSET=cxx11-abi" 2025-03-14T06:07:13.9455754Z  echo "DESIRED_PYTHON=3.9" 2025-03-14T06:07:13.9456144Z  2025-03-14T06:07:13.9456726Z  echo "ALPINE_IMAGE=308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine" 2025-03-14T06:07:13.9457423Z  echo "AWS_DEFAULT_REGION=us-east-1" 2025-03-14T06:07:13.9457880Z  echo "BINARY_ENV_FILE=/tmp/env" 2025-03-14T06:07:13.9458389Z  echo "BUILD_ENVIRONMENT=linux-binary-manywheel" 2025-03-14T06:07:13.9458895Z  echo "PR_NUMBER=" 2025-03-14T06:07:13.9459339Z  echo "PYTORCH_FINAL_PACKAGE_DIR=/artifacts" 2025-03-14T06:07:13.9459913Z  echo "SHA1=aed0b7a742a2d7b7901790622829cbd2135049a4" 2025-03-14T06:07:13.9460423Z  echo "USE_SPLIT_BUILD=false" 2025-03-14T06:07:13.9460834Z } >> "${GITHUB_ENV} }}" 2025-03-14T06:07:13.9468328Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T06:07:13.9468875Z env: 2025-03-14T06:07:13.9469231Z PYTORCH_ROOT: /pytorch 2025-03-14T06:07:13.9469606Z PACKAGE_TYPE: manywheel 2025-03-14T06:07:13.9469963Z DESIRED_CUDA: cu126 2025-03-14T06:07:13.9470311Z GPU_ARCH_VERSION: 12.6 2025-03-14T06:07:13.9470708Z GPU_ARCH_TYPE: cuda 2025-03-14T06:07:13.9471155Z DOCKER_IMAGE: pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:07:13.9471653Z SKIP_ALL_TESTS: 1 2025-03-14T06:07:13.9472156Z LIBTORCH_CONFIG: 2025-03-14T06:07:13.9472503Z LIBTORCH_VARIANT: 2025-03-14T06:07:13.9472864Z DESIRED_DEVTOOLSET: cxx11-abi 2025-03-14T06:07:13.9473257Z DESIRED_PYTHON: 3.9 2025-03-14T06:07:13.9473755Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2025-03-14T06:07:13.9474328Z AWS_DEFAULT_REGION: us-east-1 2025-03-14T06:07:13.9474702Z BINARY_ENV_FILE: /tmp/env 2025-03-14T06:07:13.9475113Z BUILD_ENVIRONMENT: linux-binary-manywheel 2025-03-14T06:07:13.9476009Z GITHUB_TOKEN: *** 2025-03-14T06:07:13.9476384Z PR_NUMBER: 2025-03-14T06:07:13.9476728Z PYTORCH_FINAL_PACKAGE_DIR: /artifacts 2025-03-14T06:07:13.9477189Z SHA1: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:07:13.9477616Z USE_SPLIT_BUILD: false 2025-03-14T06:07:13.9477970Z ##[endgroup] 2025-03-14T06:07:13.9617972Z ##[group]Run pytorch/test-infra/.github/actions/setup-ssh@main 2025-03-14T06:07:13.9618581Z with: 2025-03-14T06:07:13.9619150Z github-secret: *** 2025-03-14T06:07:13.9619542Z activate-with-label: false 2025-03-14T06:07:13.9619908Z label: with-ssh 2025-03-14T06:07:13.9620255Z remove-existing-keys: true 2025-03-14T06:07:13.9620639Z fail-silently: true 2025-03-14T06:07:13.9620976Z env: 2025-03-14T06:07:13.9621268Z PYTORCH_ROOT: /pytorch 2025-03-14T06:07:13.9621641Z PACKAGE_TYPE: manywheel 2025-03-14T06:07:13.9622006Z DESIRED_CUDA: cu126 2025-03-14T06:07:13.9622357Z GPU_ARCH_VERSION: 12.6 2025-03-14T06:07:13.9622708Z GPU_ARCH_TYPE: cuda 2025-03-14T06:07:13.9623123Z DOCKER_IMAGE: pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:07:13.9623639Z SKIP_ALL_TESTS: 1 2025-03-14T06:07:13.9623967Z LIBTORCH_CONFIG: 2025-03-14T06:07:13.9624297Z LIBTORCH_VARIANT: 2025-03-14T06:07:13.9624649Z DESIRED_DEVTOOLSET: cxx11-abi 2025-03-14T06:07:13.9625098Z DESIRED_PYTHON: 3.9 2025-03-14T06:07:13.9625605Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2025-03-14T06:07:13.9626437Z AWS_DEFAULT_REGION: us-east-1 2025-03-14T06:07:13.9626861Z BINARY_ENV_FILE: /tmp/env 2025-03-14T06:07:13.9627269Z BUILD_ENVIRONMENT: linux-binary-manywheel 2025-03-14T06:07:13.9627849Z GITHUB_TOKEN: *** 2025-03-14T06:07:13.9628182Z PR_NUMBER: 2025-03-14T06:07:13.9628527Z PYTORCH_FINAL_PACKAGE_DIR: /artifacts 2025-03-14T06:07:13.9628968Z SHA1: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:07:13.9629414Z USE_SPLIT_BUILD: false 2025-03-14T06:07:13.9629766Z ##[endgroup] 2025-03-14T06:07:14.1185237Z Please see https://github.com/pytorch/pytorch/wiki/Debugging-using-with-ssh-for-Github-Actions for more info. 2025-03-14T06:07:14.1187893Z Not on pull request and ciflow reference could not be extracted, skipping adding ssh keys 2025-03-14T06:07:14.1389860Z ##[group]Run pytorch/pytorch/.github/actions/checkout-pytorch@main 2025-03-14T06:07:14.1390484Z with: 2025-03-14T06:07:14.1390800Z no-sudo: false 2025-03-14T06:07:14.1391141Z submodules: recursive 2025-03-14T06:07:14.1391485Z fetch-depth: 0 2025-03-14T06:07:14.1391808Z env: 2025-03-14T06:07:14.1392118Z PYTORCH_ROOT: /pytorch 2025-03-14T06:07:14.1392492Z PACKAGE_TYPE: manywheel 2025-03-14T06:07:14.1392856Z DESIRED_CUDA: cu126 2025-03-14T06:07:14.1393194Z GPU_ARCH_VERSION: 12.6 2025-03-14T06:07:14.1393551Z GPU_ARCH_TYPE: cuda 2025-03-14T06:07:14.1393988Z DOCKER_IMAGE: pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:07:14.1394484Z SKIP_ALL_TESTS: 1 2025-03-14T06:07:14.1394814Z LIBTORCH_CONFIG: 2025-03-14T06:07:14.1395131Z LIBTORCH_VARIANT: 2025-03-14T06:07:14.1395489Z DESIRED_DEVTOOLSET: cxx11-abi 2025-03-14T06:07:14.1395895Z DESIRED_PYTHON: 3.9 2025-03-14T06:07:14.1396465Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2025-03-14T06:07:14.1397040Z AWS_DEFAULT_REGION: us-east-1 2025-03-14T06:07:14.1397431Z BINARY_ENV_FILE: /tmp/env 2025-03-14T06:07:14.1397839Z BUILD_ENVIRONMENT: linux-binary-manywheel 2025-03-14T06:07:14.1398483Z GITHUB_TOKEN: *** 2025-03-14T06:07:14.1398822Z PR_NUMBER: 2025-03-14T06:07:14.1399149Z PYTORCH_FINAL_PACKAGE_DIR: /artifacts 2025-03-14T06:07:14.1399618Z SHA1: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:07:14.1400066Z USE_SPLIT_BUILD: false 2025-03-14T06:07:14.1400417Z ##[endgroup] 2025-03-14T06:07:14.1535557Z ##[group]Run echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2025-03-14T06:07:14.1536691Z echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2025-03-14T06:07:14.1544065Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T06:07:14.1544562Z env: 2025-03-14T06:07:14.1544887Z PYTORCH_ROOT: /pytorch 2025-03-14T06:07:14.1545247Z PACKAGE_TYPE: manywheel 2025-03-14T06:07:14.1545613Z DESIRED_CUDA: cu126 2025-03-14T06:07:14.1545969Z GPU_ARCH_VERSION: 12.6 2025-03-14T06:07:14.1546333Z GPU_ARCH_TYPE: cuda 2025-03-14T06:07:14.1546771Z DOCKER_IMAGE: pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:07:14.1547246Z SKIP_ALL_TESTS: 1 2025-03-14T06:07:14.1547578Z LIBTORCH_CONFIG: 2025-03-14T06:07:14.1547907Z LIBTORCH_VARIANT: 2025-03-14T06:07:14.1548267Z DESIRED_DEVTOOLSET: cxx11-abi 2025-03-14T06:07:14.1548656Z DESIRED_PYTHON: 3.9 2025-03-14T06:07:14.1549140Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2025-03-14T06:07:14.1549717Z AWS_DEFAULT_REGION: us-east-1 2025-03-14T06:07:14.1550108Z BINARY_ENV_FILE: /tmp/env 2025-03-14T06:07:14.1550521Z BUILD_ENVIRONMENT: linux-binary-manywheel 2025-03-14T06:07:14.1551157Z GITHUB_TOKEN: *** 2025-03-14T06:07:14.1551496Z PR_NUMBER: 2025-03-14T06:07:14.1551829Z PYTORCH_FINAL_PACKAGE_DIR: /artifacts 2025-03-14T06:07:14.1552291Z SHA1: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:07:14.1552742Z USE_SPLIT_BUILD: false 2025-03-14T06:07:14.1553094Z ##[endgroup] 2025-03-14T06:07:14.1652002Z ##[group]Run # Use all available CPUs for fetching 2025-03-14T06:07:14.1652558Z # Use all available CPUs for fetching 2025-03-14T06:07:14.1653023Z cd "${GITHUB_WORKSPACE}" 2025-03-14T06:07:14.1653479Z git config --global fetch.parallel 0 2025-03-14T06:07:14.1653971Z git config --global submodule.fetchJobs 0 2025-03-14T06:07:14.1654448Z  2025-03-14T06:07:14.1654938Z # Clean workspace. The default checkout action should also do this, but 2025-03-14T06:07:14.1655546Z # do it here as well just in case 2025-03-14T06:07:14.1655978Z if [[ -d .git ]]; then 2025-03-14T06:07:14.1656363Z  if [ -z "${NO_SUDO}" ]; then 2025-03-14T06:07:14.1657003Z  sudo git clean -ffdx 2025-03-14T06:07:14.1657594Z  else 2025-03-14T06:07:14.1657955Z  git clean -ffdx 2025-03-14T06:07:14.1658321Z  fi 2025-03-14T06:07:14.1658630Z fi 2025-03-14T06:07:14.1664950Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T06:07:14.1665429Z env: 2025-03-14T06:07:14.1665742Z PYTORCH_ROOT: /pytorch 2025-03-14T06:07:14.1666119Z PACKAGE_TYPE: manywheel 2025-03-14T06:07:14.1666481Z DESIRED_CUDA: cu126 2025-03-14T06:07:14.1666829Z GPU_ARCH_VERSION: 12.6 2025-03-14T06:07:14.1667168Z GPU_ARCH_TYPE: cuda 2025-03-14T06:07:14.1667603Z DOCKER_IMAGE: pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:07:14.1668102Z SKIP_ALL_TESTS: 1 2025-03-14T06:07:14.1668432Z LIBTORCH_CONFIG: 2025-03-14T06:07:14.1668761Z LIBTORCH_VARIANT: 2025-03-14T06:07:14.1669097Z DESIRED_DEVTOOLSET: cxx11-abi 2025-03-14T06:07:14.1669479Z DESIRED_PYTHON: 3.9 2025-03-14T06:07:14.1669992Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2025-03-14T06:07:14.1670576Z AWS_DEFAULT_REGION: us-east-1 2025-03-14T06:07:14.1670967Z BINARY_ENV_FILE: /tmp/env 2025-03-14T06:07:14.1671351Z BUILD_ENVIRONMENT: linux-binary-manywheel 2025-03-14T06:07:14.1671997Z GITHUB_TOKEN: *** 2025-03-14T06:07:14.1672335Z PR_NUMBER: 2025-03-14T06:07:14.1672678Z PYTORCH_FINAL_PACKAGE_DIR: /artifacts 2025-03-14T06:07:14.1673140Z SHA1: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:07:14.1673585Z USE_SPLIT_BUILD: false 2025-03-14T06:07:14.1673920Z NO_SUDO: false 2025-03-14T06:07:14.1674237Z ##[endgroup] 2025-03-14T06:07:14.3355781Z Removing .additional_ci_files/ 2025-03-14T06:07:14.3356659Z Removing .pytest_cache/ 2025-03-14T06:07:14.3357480Z Removing build/ 2025-03-14T06:07:14.3357815Z Removing dist/ 2025-03-14T06:07:14.3358462Z Removing logs-test-default-3-5-lf.linux.4xlarge.nvidia.gpu_38756619319.zip 2025-03-14T06:07:14.3359306Z Removing test-jsons-test-default-3-5-lf.linux.4xlarge.nvidia.gpu_38756619319.zip 2025-03-14T06:07:14.3360236Z Removing test-reports-test-default-3-5-lf.linux.4xlarge.nvidia.gpu_38756619319.zip 2025-03-14T06:07:14.3360942Z Removing test/.pytorch-disabled-tests.json 2025-03-14T06:07:14.3361689Z Removing test/__pycache__/ 2025-03-14T06:07:14.3362074Z Removing test/dynamo/__pycache__/ 2025-03-14T06:07:14.3362492Z Removing test/inductor/__pycache__/ 2025-03-14T06:07:14.3362916Z Removing test/test-reports/ 2025-03-14T06:07:14.3363314Z Removing test/torch_compile_debug/ 2025-03-14T06:07:14.3363708Z Removing tools/__pycache__/ 2025-03-14T06:07:14.3364102Z Removing tools/stats/__pycache__/ 2025-03-14T06:07:14.3364659Z Removing tools/stats/upload_utilization_stats/__pycache__/ 2025-03-14T06:07:14.3365187Z Removing tools/testing/__pycache__/ 2025-03-14T06:07:14.3365694Z Removing tools/testing/target_determination/__pycache__/ 2025-03-14T06:07:14.3366339Z Removing tools/testing/target_determination/heuristics/__pycache__/ 2025-03-14T06:07:14.3366900Z Removing usage_log.txt 2025-03-14T06:07:14.3466618Z ##[group]Run actions/checkout@v4 2025-03-14T06:07:14.3467028Z with: 2025-03-14T06:07:14.3467381Z ref: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:07:14.3467825Z fetch-depth: 0 2025-03-14T06:07:14.3468167Z submodules: recursive 2025-03-14T06:07:14.3468512Z show-progress: false 2025-03-14T06:07:14.3468884Z repository: pytorch/pytorch 2025-03-14T06:07:14.3469411Z token: *** 2025-03-14T06:07:14.3469737Z ssh-strict: true 2025-03-14T06:07:14.3470062Z ssh-user: git 2025-03-14T06:07:14.3470400Z persist-credentials: true 2025-03-14T06:07:14.3470750Z clean: true 2025-03-14T06:07:14.3471090Z sparse-checkout-cone-mode: true 2025-03-14T06:07:14.3471493Z fetch-tags: false 2025-03-14T06:07:14.3471815Z lfs: false 2025-03-14T06:07:14.3472144Z set-safe-directory: true 2025-03-14T06:07:14.3472491Z env: 2025-03-14T06:07:14.3472795Z PYTORCH_ROOT: /pytorch 2025-03-14T06:07:14.3473165Z PACKAGE_TYPE: manywheel 2025-03-14T06:07:14.3473758Z DESIRED_CUDA: cu126 2025-03-14T06:07:14.3474085Z GPU_ARCH_VERSION: 12.6 2025-03-14T06:07:14.3474598Z GPU_ARCH_TYPE: cuda 2025-03-14T06:07:14.3475054Z DOCKER_IMAGE: pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:07:14.3475550Z SKIP_ALL_TESTS: 1 2025-03-14T06:07:14.3475875Z LIBTORCH_CONFIG: 2025-03-14T06:07:14.3476187Z LIBTORCH_VARIANT: 2025-03-14T06:07:14.3476547Z DESIRED_DEVTOOLSET: cxx11-abi 2025-03-14T06:07:14.3476936Z DESIRED_PYTHON: 3.9 2025-03-14T06:07:14.3477428Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2025-03-14T06:07:14.3478002Z AWS_DEFAULT_REGION: us-east-1 2025-03-14T06:07:14.3478390Z BINARY_ENV_FILE: /tmp/env 2025-03-14T06:07:14.3478779Z BUILD_ENVIRONMENT: linux-binary-manywheel 2025-03-14T06:07:14.3479349Z GITHUB_TOKEN: *** 2025-03-14T06:07:14.3479680Z PR_NUMBER: 2025-03-14T06:07:14.3480020Z PYTORCH_FINAL_PACKAGE_DIR: /artifacts 2025-03-14T06:07:14.3480473Z SHA1: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:07:14.3480907Z USE_SPLIT_BUILD: false 2025-03-14T06:07:14.3481258Z ##[endgroup] 2025-03-14T06:07:14.4964616Z Syncing repository: pytorch/pytorch 2025-03-14T06:07:14.4967224Z ##[group]Getting Git version info 2025-03-14T06:07:14.4967864Z Working directory is '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2025-03-14T06:07:14.4968746Z [command]/usr/bin/git version 2025-03-14T06:07:14.4969181Z git version 2.47.1 2025-03-14T06:07:14.5005140Z ##[endgroup] 2025-03-14T06:07:14.5019449Z Copying '/home/ec2-user/.gitconfig' to '/home/ec2-user/actions-runner/_work/_temp/d418ace0-b0d5-40e3-b9c6-ff9520dc2f58/.gitconfig' 2025-03-14T06:07:14.5041936Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/d418ace0-b0d5-40e3-b9c6-ff9520dc2f58' before making global git config changes 2025-03-14T06:07:14.5043149Z Adding repository directory to the temporary git global config as a safe directory 2025-03-14T06:07:14.5048076Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2025-03-14T06:07:14.5108160Z [command]/usr/bin/git config --local --get remote.origin.url 2025-03-14T06:07:14.5129452Z https://github.com/pytorch/pytorch 2025-03-14T06:07:14.5151373Z ##[group]Removing previously created refs, to avoid conflicts 2025-03-14T06:07:14.5156145Z [command]/usr/bin/git rev-parse --symbolic-full-name --verify --quiet HEAD 2025-03-14T06:07:14.5178497Z HEAD 2025-03-14T06:07:14.5222893Z ##[endgroup] 2025-03-14T06:07:14.5228411Z [command]/usr/bin/git submodule status 2025-03-14T06:07:14.5607176Z 7e1e1fe3858c63c251c637ae41a20de425dde96f android/libs/fbjni (v0.1.0-12-g7e1e1fe) 2025-03-14T06:07:14.5694617Z 4dfe081cf6bcd15db339cf2680b9281b8451eeb3 third_party/FP16 (4dfe081) 2025-03-14T06:07:14.5783973Z b408327ac2a15ec3e43352421954f5b1967701d1 third_party/FXdiv (b408327) 2025-03-14T06:07:14.5892696Z c07e3a0400713d546e0dea2d5466dd22ea389c73 third_party/NNPACK (c07e3a0) 2025-03-14T06:07:14.5921097Z e170594ac7cf1dac584da473d4ca9301087090c1 third_party/NVTX (v3.1.0) 2025-03-14T06:07:14.6011261Z a6bfc237255a6bac1513f7c1ebde6d8aed6b5191 third_party/VulkanMemoryAllocator (v2.1.0-705-ga6bfc23) 2025-03-14T06:07:14.6638348Z 51a0103656eff6fc9bfd39a4597923c4b542c883 third_party/XNNPACK (remotes/origin/ds/ndk-1243-g51a010365) 2025-03-14T06:07:14.6666482Z 0d98dba29d66e93259db7daa53a9327df767a415 third_party/benchmark (v1.6.1) 2025-03-14T06:07:14.6701652Z 8086bbe3a78d931eb96fe12fdc014082e18d18d3 third_party/composable_kernel (mock-tag-test-6-g8086bbe3a) 2025-03-14T06:07:14.6867308Z 3b6597bba913d51161383657829b7e644e59c006 third_party/cpp-httplib (v0.15.3-20-g3b6597b) 2025-03-14T06:07:14.7004826Z 1e83a2fdd3102f65c6f1fb602c1b320486218a99 third_party/cpuinfo (1e83a2f) 2025-03-14T06:07:14.7048269Z 91b7532f3386768bba4f444ee7672b497f34da8a third_party/cudnn_frontend (v0.5-44-g91b7532) 2025-03-14T06:07:14.7161186Z afa1772203677c5118fcd82537a9c8fefbcc7008 third_party/cutlass (v3.8.0) 2025-03-14T06:07:14.7958661Z 3147391d946bb4b6c68edd901f2add6ac1f31f8c third_party/eigen (3.4.0) 2025-03-14T06:07:14.8397464Z dbc3157bf256f1339b3fa1fef2be89ac4078be0e third_party/fbgemm (v0.4.1-446-gdbc3157b) 2025-03-14T06:07:14.8504251Z 979702c87a8713a8e0a5e9fee122b90d2ef13be5 third_party/flash-attention (v2.7.4) 2025-03-14T06:07:14.8533480Z 01834de25e4bf3975a9a00e816292b1ad0fe184b third_party/flatbuffers (v23.3.3) 2025-03-14T06:07:14.9061685Z 123913715afeb8a437e6388b4473fcc4753e1c9a third_party/fmt (11.1.4) 2025-03-14T06:07:14.9190433Z 3fb5c176c17c765a3492cd2f0321b0dab712f350 third_party/gemmlowp/gemmlowp (remotes/origin/revert-87-master-135-g3fb5c17) 2025-03-14T06:07:14.9325716Z 5354032ea08eadd7fc4456477f7f7c6308818509 third_party/gloo (5354032) 2025-03-14T06:07:14.9626666Z b514bdc898e2951020cbdca1304b75f5950d1f59 third_party/googletest (release-1.8.0-3484-gb514bdc8) 2025-03-14T06:07:14.9727272Z 719d8e6cd7f7a0e01b155657526d693acf97c2b3 third_party/ideep (pytorch-rls-v3.7.1) 2025-03-14T06:07:14.9798888Z 5b8a7d7422611c3a0d799fb5fc5dd4abfae35b42 third_party/ittapi (v3.23.0-14-g5b8a7d7) 2025-03-14T06:07:15.0110815Z 2859721fd9e73d3ca1c56f827dbc64e6d68f78a2 third_party/kineto (remotes/origin/sraikund/test-53-g2859721) 2025-03-14T06:07:15.0140862Z ef685a13cfbe8d418aa2ed34350e21e4938358b6 third_party/kleidiai (v1.3.0) 2025-03-14T06:07:15.0169668Z b66e3214d8a104669c2ec05ae91ebc26a8f5ab78 third_party/mimalloc (v1.8.2) 2025-03-14T06:07:15.0761343Z 87cda1d6646592ac5866dc703c8e1839046a6806 third_party/nlohmann (v3.10.1-113-g87cda1d6) 2025-03-14T06:07:15.1122548Z b8baa8446686496da4cc8fda09f2b6fe65c2a02c third_party/onnx (v1.17.0) 2025-03-14T06:07:15.1152008Z a799f4aed9c94b765dcdaabaeab7d5e7e2310878 third_party/opentelemetry-cpp (v1.14.2) 2025-03-14T06:07:15.1181586Z 9d3ab05a7fffbc71a492bc6a17be034e83e8f0fe third_party/pocketfft (release_for_eigen-11-g9d3ab05) 2025-03-14T06:07:15.1686073Z d1eca4e4b421cd2997495c4b4e65cea6be4e9b8a third_party/protobuf (v3.7.0-rc.2-1279-gd1eca4e4b) 2025-03-14T06:07:15.1771819Z 072586a71b55b7f8c584153d223e95687148a900 third_party/psimd (heads/master) 2025-03-14T06:07:15.1839191Z 4fe0e1e183925bf8cfa6aae24237e724a96479b8 third_party/pthreadpool (0.1-144-g4fe0e1e) 2025-03-14T06:07:15.1900726Z a2e59f0e7065404b44dfe92a28aca47ba1378dc4 third_party/pybind11 (v2.11.0-182-ga2e59f0e) 2025-03-14T06:07:15.1986005Z f45429b087dd7d5bc78bb40dc7cf06425c252d67 third_party/python-peachpy (remotes/origin/pre-generated) 2025-03-14T06:07:15.2121882Z 56e1f79cb140fb9326d612d0be06b5250565cade third_party/sleef (3.7-33-g56e1f79) 2025-03-14T06:07:15.2201467Z 52791a2fd214b2a9dc5759d36725909c1daa7f2e third_party/tensorpipe (remotes/origin/master) 2025-03-14T06:07:15.2215209Z ##[group]Cleaning the repository 2025-03-14T06:07:15.2220926Z [command]/usr/bin/git clean -ffdx 2025-03-14T06:07:15.2452942Z [command]/usr/bin/git reset --hard HEAD 2025-03-14T06:07:16.3193703Z Updating files: 66% (10964/16540) 2025-03-14T06:07:16.3388192Z Updating files: 67% (11082/16540) 2025-03-14T06:07:16.3452418Z Updating files: 68% (11248/16540) 2025-03-14T06:07:16.3534746Z Updating files: 69% (11413/16540) 2025-03-14T06:07:16.3735765Z Updating files: 70% (11578/16540) 2025-03-14T06:07:16.4058605Z Updating files: 71% (11744/16540) 2025-03-14T06:07:16.4386496Z Updating files: 72% (11909/16540) 2025-03-14T06:07:16.4800986Z Updating files: 73% (12075/16540) 2025-03-14T06:07:16.4975550Z Updating files: 74% (12240/16540) 2025-03-14T06:07:16.5132162Z Updating files: 75% (12405/16540) 2025-03-14T06:07:16.5414328Z Updating files: 76% (12571/16540) 2025-03-14T06:07:16.5700213Z Updating files: 77% (12736/16540) 2025-03-14T06:07:16.6034888Z Updating files: 78% (12902/16540) 2025-03-14T06:07:16.6310818Z Updating files: 79% (13067/16540) 2025-03-14T06:07:16.6582389Z Updating files: 80% (13232/16540) 2025-03-14T06:07:16.6748765Z Updating files: 81% (13398/16540) 2025-03-14T06:07:16.6921172Z Updating files: 82% (13563/16540) 2025-03-14T06:07:16.7114642Z Updating files: 83% (13729/16540) 2025-03-14T06:07:16.7303883Z Updating files: 84% (13894/16540) 2025-03-14T06:07:16.7466727Z Updating files: 85% (14059/16540) 2025-03-14T06:07:16.7645366Z Updating files: 86% (14225/16540) 2025-03-14T06:07:16.7798649Z Updating files: 87% (14390/16540) 2025-03-14T06:07:16.7990867Z Updating files: 88% (14556/16540) 2025-03-14T06:07:16.8225761Z Updating files: 89% (14721/16540) 2025-03-14T06:07:16.8383300Z Updating files: 90% (14886/16540) 2025-03-14T06:07:16.8552836Z Updating files: 91% (15052/16540) 2025-03-14T06:07:16.8757245Z Updating files: 92% (15217/16540) 2025-03-14T06:07:16.9001566Z Updating files: 93% (15383/16540) 2025-03-14T06:07:16.9252425Z Updating files: 94% (15548/16540) 2025-03-14T06:07:16.9460049Z Updating files: 95% (15713/16540) 2025-03-14T06:07:16.9646745Z Updating files: 96% (15879/16540) 2025-03-14T06:07:17.0001294Z Updating files: 97% (16044/16540) 2025-03-14T06:07:17.0211786Z Updating files: 98% (16210/16540) 2025-03-14T06:07:17.0414030Z Updating files: 99% (16375/16540) 2025-03-14T06:07:17.0414444Z Updating files: 100% (16540/16540) 2025-03-14T06:07:17.0414867Z Updating files: 100% (16540/16540), done. 2025-03-14T06:07:17.0630025Z HEAD is now at f14f6bfd7b6 [Inductor][Optimus] Extend capability of current split cat aten pass (#149027) 2025-03-14T06:07:17.0698594Z ##[endgroup] 2025-03-14T06:07:17.0701248Z ##[group]Disabling automatic garbage collection 2025-03-14T06:07:17.0708898Z [command]/usr/bin/git config --local gc.auto 0 2025-03-14T06:07:17.0743318Z ##[endgroup] 2025-03-14T06:07:17.0744263Z ##[group]Setting up auth 2025-03-14T06:07:17.0753182Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2025-03-14T06:07:17.0787729Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2025-03-14T06:07:17.1143267Z Entering 'android/libs/fbjni' 2025-03-14T06:07:17.1206467Z Entering 'third_party/FP16' 2025-03-14T06:07:17.1270690Z Entering 'third_party/FXdiv' 2025-03-14T06:07:17.1335163Z Entering 'third_party/NNPACK' 2025-03-14T06:07:17.1398456Z Entering 'third_party/NVTX' 2025-03-14T06:07:17.1462864Z Entering 'third_party/VulkanMemoryAllocator' 2025-03-14T06:07:17.1527838Z Entering 'third_party/XNNPACK' 2025-03-14T06:07:17.1607793Z Entering 'third_party/benchmark' 2025-03-14T06:07:17.1672979Z Entering 'third_party/composable_kernel' 2025-03-14T06:07:17.1745577Z Entering 'third_party/cpp-httplib' 2025-03-14T06:07:17.1809173Z Entering 'third_party/cpuinfo' 2025-03-14T06:07:17.1873659Z Entering 'third_party/cudnn_frontend' 2025-03-14T06:07:17.1938233Z Entering 'third_party/cutlass' 2025-03-14T06:07:17.2009230Z Entering 'third_party/eigen' 2025-03-14T06:07:17.2076440Z Entering 'third_party/fbgemm' 2025-03-14T06:07:17.2140511Z Entering 'third_party/fbgemm/third_party/asmjit' 2025-03-14T06:07:17.2202925Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2025-03-14T06:07:17.2268040Z Entering 'third_party/fbgemm/third_party/cutlass' 2025-03-14T06:07:17.2339234Z Entering 'third_party/fbgemm/third_party/googletest' 2025-03-14T06:07:17.2401187Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2025-03-14T06:07:17.2466190Z Entering 'third_party/flash-attention' 2025-03-14T06:07:17.2531528Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-03-14T06:07:17.2601414Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-03-14T06:07:17.2676661Z Entering 'third_party/flatbuffers' 2025-03-14T06:07:17.2743532Z Entering 'third_party/fmt' 2025-03-14T06:07:17.2806973Z Entering 'third_party/gemmlowp/gemmlowp' 2025-03-14T06:07:17.2872669Z Entering 'third_party/gloo' 2025-03-14T06:07:17.2937002Z Entering 'third_party/googletest' 2025-03-14T06:07:17.3000000Z Entering 'third_party/ideep' 2025-03-14T06:07:17.3063656Z Entering 'third_party/ideep/mkl-dnn' 2025-03-14T06:07:17.3135081Z Entering 'third_party/ittapi' 2025-03-14T06:07:17.3198600Z Entering 'third_party/kineto' 2025-03-14T06:07:17.3262722Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-03-14T06:07:17.3325007Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-03-14T06:07:17.3392812Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-03-14T06:07:17.3458739Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-03-14T06:07:17.3521518Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-03-14T06:07:17.3584271Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-03-14T06:07:17.3651099Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-03-14T06:07:17.3714616Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-03-14T06:07:17.3778865Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-03-14T06:07:17.3844307Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-03-14T06:07:17.3908714Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-03-14T06:07:17.3972039Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-03-14T06:07:17.4038113Z Entering 'third_party/kleidiai' 2025-03-14T06:07:17.4101265Z Entering 'third_party/mimalloc' 2025-03-14T06:07:17.4166454Z Entering 'third_party/nlohmann' 2025-03-14T06:07:17.4231997Z Entering 'third_party/onnx' 2025-03-14T06:07:17.4313769Z Entering 'third_party/onnx/third_party/pybind11' 2025-03-14T06:07:17.4380159Z Entering 'third_party/opentelemetry-cpp' 2025-03-14T06:07:17.4445753Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-03-14T06:07:17.4507881Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-03-14T06:07:17.4571950Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-03-14T06:07:17.4636461Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-03-14T06:07:17.4699664Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-03-14T06:07:17.4762538Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-03-14T06:07:17.4825708Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-03-14T06:07:17.4887133Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-03-14T06:07:17.4953788Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-03-14T06:07:17.5018528Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-03-14T06:07:17.5105653Z Entering 'third_party/pocketfft' 2025-03-14T06:07:17.5171214Z Entering 'third_party/protobuf' 2025-03-14T06:07:17.5238563Z Entering 'third_party/protobuf/third_party/benchmark' 2025-03-14T06:07:17.5300441Z Entering 'third_party/protobuf/third_party/googletest' 2025-03-14T06:07:17.5366510Z Entering 'third_party/psimd' 2025-03-14T06:07:17.5430823Z Entering 'third_party/pthreadpool' 2025-03-14T06:07:17.5493586Z Entering 'third_party/pybind11' 2025-03-14T06:07:17.5558103Z Entering 'third_party/python-peachpy' 2025-03-14T06:07:17.5621861Z Entering 'third_party/sleef' 2025-03-14T06:07:17.5687998Z Entering 'third_party/tensorpipe' 2025-03-14T06:07:17.5751449Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-03-14T06:07:17.5814148Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-03-14T06:07:17.5877166Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-03-14T06:07:17.5940443Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-03-14T06:07:17.6001409Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-03-14T06:07:17.6087423Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2025-03-14T06:07:17.6118854Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2025-03-14T06:07:17.6456857Z Entering 'android/libs/fbjni' 2025-03-14T06:07:17.6519666Z Entering 'third_party/FP16' 2025-03-14T06:07:17.6583688Z Entering 'third_party/FXdiv' 2025-03-14T06:07:17.6647346Z Entering 'third_party/NNPACK' 2025-03-14T06:07:17.6711010Z Entering 'third_party/NVTX' 2025-03-14T06:07:17.6775387Z Entering 'third_party/VulkanMemoryAllocator' 2025-03-14T06:07:17.6839412Z Entering 'third_party/XNNPACK' 2025-03-14T06:07:17.6919751Z Entering 'third_party/benchmark' 2025-03-14T06:07:17.6983627Z Entering 'third_party/composable_kernel' 2025-03-14T06:07:17.7056574Z Entering 'third_party/cpp-httplib' 2025-03-14T06:07:17.7119793Z Entering 'third_party/cpuinfo' 2025-03-14T06:07:17.7184594Z Entering 'third_party/cudnn_frontend' 2025-03-14T06:07:17.7247962Z Entering 'third_party/cutlass' 2025-03-14T06:07:17.7322905Z Entering 'third_party/eigen' 2025-03-14T06:07:17.7389101Z Entering 'third_party/fbgemm' 2025-03-14T06:07:17.7453123Z Entering 'third_party/fbgemm/third_party/asmjit' 2025-03-14T06:07:17.7515665Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2025-03-14T06:07:17.7578342Z Entering 'third_party/fbgemm/third_party/cutlass' 2025-03-14T06:07:17.7648277Z Entering 'third_party/fbgemm/third_party/googletest' 2025-03-14T06:07:17.7710221Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2025-03-14T06:07:17.7775455Z Entering 'third_party/flash-attention' 2025-03-14T06:07:17.7839762Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-03-14T06:07:17.7909792Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-03-14T06:07:17.7983399Z Entering 'third_party/flatbuffers' 2025-03-14T06:07:17.8050506Z Entering 'third_party/fmt' 2025-03-14T06:07:17.8114512Z Entering 'third_party/gemmlowp/gemmlowp' 2025-03-14T06:07:17.8179370Z Entering 'third_party/gloo' 2025-03-14T06:07:17.8243603Z Entering 'third_party/googletest' 2025-03-14T06:07:17.8306985Z Entering 'third_party/ideep' 2025-03-14T06:07:17.8370187Z Entering 'third_party/ideep/mkl-dnn' 2025-03-14T06:07:17.8443237Z Entering 'third_party/ittapi' 2025-03-14T06:07:17.8506222Z Entering 'third_party/kineto' 2025-03-14T06:07:17.8570759Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-03-14T06:07:17.8634576Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-03-14T06:07:17.8699480Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-03-14T06:07:17.8764716Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-03-14T06:07:17.8829456Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-03-14T06:07:17.8892140Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-03-14T06:07:17.8960982Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-03-14T06:07:17.9024868Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-03-14T06:07:17.9089727Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-03-14T06:07:17.9154448Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-03-14T06:07:17.9218910Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-03-14T06:07:17.9282107Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-03-14T06:07:17.9346325Z Entering 'third_party/kleidiai' 2025-03-14T06:07:17.9409919Z Entering 'third_party/mimalloc' 2025-03-14T06:07:17.9473995Z Entering 'third_party/nlohmann' 2025-03-14T06:07:17.9538810Z Entering 'third_party/onnx' 2025-03-14T06:07:17.9619352Z Entering 'third_party/onnx/third_party/pybind11' 2025-03-14T06:07:17.9685198Z Entering 'third_party/opentelemetry-cpp' 2025-03-14T06:07:17.9749966Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-03-14T06:07:17.9813271Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-03-14T06:07:17.9876342Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-03-14T06:07:17.9938822Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-03-14T06:07:18.0002584Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-03-14T06:07:18.0065855Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-03-14T06:07:18.0129367Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-03-14T06:07:18.0191652Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-03-14T06:07:18.0257366Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-03-14T06:07:18.0321776Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-03-14T06:07:18.0410148Z Entering 'third_party/pocketfft' 2025-03-14T06:07:18.0472964Z Entering 'third_party/protobuf' 2025-03-14T06:07:18.0540288Z Entering 'third_party/protobuf/third_party/benchmark' 2025-03-14T06:07:18.0603189Z Entering 'third_party/protobuf/third_party/googletest' 2025-03-14T06:07:18.0668696Z Entering 'third_party/psimd' 2025-03-14T06:07:18.0733066Z Entering 'third_party/pthreadpool' 2025-03-14T06:07:18.0795362Z Entering 'third_party/pybind11' 2025-03-14T06:07:18.0859781Z Entering 'third_party/python-peachpy' 2025-03-14T06:07:18.0922805Z Entering 'third_party/sleef' 2025-03-14T06:07:18.0986547Z Entering 'third_party/tensorpipe' 2025-03-14T06:07:18.1049824Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-03-14T06:07:18.1111681Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-03-14T06:07:18.1174652Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-03-14T06:07:18.1238327Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-03-14T06:07:18.1299787Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-03-14T06:07:18.1390985Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic *** 2025-03-14T06:07:18.1447341Z ##[endgroup] 2025-03-14T06:07:18.1447911Z ##[group]Fetching the repository 2025-03-14T06:07:18.1458775Z [command]/usr/bin/git -c protocol.version=2 fetch --prune --no-recurse-submodules origin +refs/heads/*:refs/remotes/origin/* +refs/tags/*:refs/tags/* 2025-03-14T06:07:18.4378276Z From https://github.com/pytorch/pytorch 2025-03-14T06:07:18.4379013Z - [deleted] (none) -> ciflow/trunk/149171 2025-03-14T06:07:19.6232668Z * [new branch] gh/malfet/228/base -> origin/gh/malfet/228/base 2025-03-14T06:07:19.6233790Z * [new branch] gh/malfet/228/head -> origin/gh/malfet/228/head 2025-03-14T06:07:19.6235973Z * [new branch] gh/malfet/228/orig -> origin/gh/malfet/228/orig 2025-03-14T06:07:19.6254129Z db6d72213b8..d4496346b90 main -> origin/main 2025-03-14T06:07:19.6261738Z + c4b8be3d09f...e4044d0e7ea update_submodule_FBGEMM -> origin/update_submodule_FBGEMM (forced update) 2025-03-14T06:07:19.6263219Z 15cd6921a56..e8d36019d42 viable/strict -> origin/viable/strict 2025-03-14T06:07:19.6271543Z * [new tag] ciflow/inductor/149179 -> ciflow/inductor/149179 2025-03-14T06:07:19.6273738Z * [new tag] ciflow/inductor/149180 -> ciflow/inductor/149180 2025-03-14T06:07:19.6276096Z * [new tag] ciflow/mps/149179 -> ciflow/mps/149179 2025-03-14T06:07:19.6276839Z * [new tag] ciflow/mps/149180 -> ciflow/mps/149180 2025-03-14T06:07:19.6279497Z * [new tag] ciflow/rocm-mi300/149088 -> ciflow/rocm-mi300/149088 2025-03-14T06:07:19.6921516Z [command]/usr/bin/git rev-parse --verify --quiet aed0b7a742a2d7b7901790622829cbd2135049a4^{object} 2025-03-14T06:07:19.6948174Z aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:07:19.6954898Z ##[endgroup] 2025-03-14T06:07:19.6955976Z ##[group]Determining the checkout info 2025-03-14T06:07:19.6957238Z ##[endgroup] 2025-03-14T06:07:19.6964668Z [command]/usr/bin/git sparse-checkout disable 2025-03-14T06:07:19.7300578Z [command]/usr/bin/git config --local --unset-all extensions.worktreeConfig 2025-03-14T06:07:19.7331954Z ##[group]Checking out the ref 2025-03-14T06:07:19.7337875Z [command]/usr/bin/git checkout --progress --force aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:07:19.8800138Z Previous HEAD position was f14f6bfd7b6 [Inductor][Optimus] Extend capability of current split cat aten pass (#149027) 2025-03-14T06:07:19.8810076Z HEAD is now at aed0b7a742a [c10d] Add param recording for uniqueID broadcasting and allgather (#149166) 2025-03-14T06:07:19.8834560Z ##[endgroup] 2025-03-14T06:07:19.8835637Z ##[group]Setting up auth for fetching submodules 2025-03-14T06:07:19.8844904Z [command]/usr/bin/git config --global http.https://github.com/.extraheader AUTHORIZATION: basic *** 2025-03-14T06:07:19.8896665Z [command]/usr/bin/git config --global --unset-all url.https://github.com/.insteadOf 2025-03-14T06:07:19.8931770Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf git@github.com: 2025-03-14T06:07:19.8966307Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf org-21003710@github.com: 2025-03-14T06:07:19.8995118Z ##[endgroup] 2025-03-14T06:07:19.8996172Z ##[group]Fetching submodules 2025-03-14T06:07:19.9001513Z [command]/usr/bin/git submodule sync --recursive 2025-03-14T06:07:19.9352480Z Synchronizing submodule url for 'android/libs/fbjni' 2025-03-14T06:07:19.9378713Z Synchronizing submodule url for 'third_party/FP16' 2025-03-14T06:07:19.9404941Z Synchronizing submodule url for 'third_party/FXdiv' 2025-03-14T06:07:19.9431753Z Synchronizing submodule url for 'third_party/NNPACK' 2025-03-14T06:07:19.9459169Z Synchronizing submodule url for 'third_party/NVTX' 2025-03-14T06:07:19.9485210Z Synchronizing submodule url for 'third_party/VulkanMemoryAllocator' 2025-03-14T06:07:19.9511236Z Synchronizing submodule url for 'third_party/XNNPACK' 2025-03-14T06:07:19.9555143Z Synchronizing submodule url for 'third_party/benchmark' 2025-03-14T06:07:19.9580732Z Synchronizing submodule url for 'third_party/composable_kernel' 2025-03-14T06:07:19.9613485Z Synchronizing submodule url for 'third_party/cpp-httplib' 2025-03-14T06:07:19.9640139Z Synchronizing submodule url for 'third_party/cpuinfo' 2025-03-14T06:07:19.9666351Z Synchronizing submodule url for 'third_party/cudnn_frontend' 2025-03-14T06:07:19.9692532Z Synchronizing submodule url for 'third_party/cutlass' 2025-03-14T06:07:19.9727402Z Synchronizing submodule url for 'third_party/eigen' 2025-03-14T06:07:19.9758395Z Synchronizing submodule url for 'third_party/fbgemm' 2025-03-14T06:07:19.9782565Z Synchronizing submodule url for 'third_party/fbgemm/third_party/asmjit' 2025-03-14T06:07:19.9806913Z Synchronizing submodule url for 'third_party/fbgemm/third_party/cpuinfo' 2025-03-14T06:07:19.9832070Z Synchronizing submodule url for 'third_party/fbgemm/third_party/cutlass' 2025-03-14T06:07:19.9863666Z Synchronizing submodule url for 'third_party/fbgemm/third_party/googletest' 2025-03-14T06:07:19.9888283Z Synchronizing submodule url for 'third_party/fbgemm/third_party/hipify_torch' 2025-03-14T06:07:19.9915821Z Synchronizing submodule url for 'third_party/flash-attention' 2025-03-14T06:07:19.9941000Z Synchronizing submodule url for 'third_party/flash-attention/csrc/composable_kernel' 2025-03-14T06:07:19.9971323Z Synchronizing submodule url for 'third_party/flash-attention/csrc/cutlass' 2025-03-14T06:07:20.0009627Z Synchronizing submodule url for 'third_party/flatbuffers' 2025-03-14T06:07:20.0039793Z Synchronizing submodule url for 'third_party/fmt' 2025-03-14T06:07:20.0065837Z Synchronizing submodule url for 'third_party/gemmlowp/gemmlowp' 2025-03-14T06:07:20.0091566Z Synchronizing submodule url for 'third_party/gloo' 2025-03-14T06:07:20.0117918Z Synchronizing submodule url for 'third_party/googletest' 2025-03-14T06:07:20.0145615Z Synchronizing submodule url for 'third_party/ideep' 2025-03-14T06:07:20.0167717Z Synchronizing submodule url for 'third_party/ideep/mkl-dnn' 2025-03-14T06:07:20.0201056Z Synchronizing submodule url for 'third_party/ittapi' 2025-03-14T06:07:20.0228474Z Synchronizing submodule url for 'third_party/kineto' 2025-03-14T06:07:20.0253330Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog' 2025-03-14T06:07:20.0277429Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-03-14T06:07:20.0305270Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-03-14T06:07:20.0331890Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-03-14T06:07:20.0357631Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-03-14T06:07:20.0382308Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-03-14T06:07:20.0410280Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-03-14T06:07:20.0437523Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-03-14T06:07:20.0462705Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-03-14T06:07:20.0489610Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-03-14T06:07:20.0516513Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/fmt' 2025-03-14T06:07:20.0541845Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/googletest' 2025-03-14T06:07:20.0569373Z Synchronizing submodule url for 'third_party/kleidiai' 2025-03-14T06:07:20.0595210Z Synchronizing submodule url for 'third_party/mimalloc' 2025-03-14T06:07:20.0621835Z Synchronizing submodule url for 'third_party/nlohmann' 2025-03-14T06:07:20.0650854Z Synchronizing submodule url for 'third_party/onnx' 2025-03-14T06:07:20.0691066Z Synchronizing submodule url for 'third_party/onnx/third_party/pybind11' 2025-03-14T06:07:20.0720930Z Synchronizing submodule url for 'third_party/opentelemetry-cpp' 2025-03-14T06:07:20.0747714Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-03-14T06:07:20.0771848Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/googletest' 2025-03-14T06:07:20.0796478Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-03-14T06:07:20.0821130Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-03-14T06:07:20.0848384Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-03-14T06:07:20.0872473Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-03-14T06:07:20.0897624Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-03-14T06:07:20.0921404Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-03-14T06:07:20.0949782Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-03-14T06:07:20.0975910Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-03-14T06:07:20.1025448Z Synchronizing submodule url for 'third_party/pocketfft' 2025-03-14T06:07:20.1052186Z Synchronizing submodule url for 'third_party/protobuf' 2025-03-14T06:07:20.1082416Z Synchronizing submodule url for 'third_party/protobuf/third_party/benchmark' 2025-03-14T06:07:20.1107063Z Synchronizing submodule url for 'third_party/protobuf/third_party/googletest' 2025-03-14T06:07:20.1136085Z Synchronizing submodule url for 'third_party/psimd' 2025-03-14T06:07:20.1162353Z Synchronizing submodule url for 'third_party/pthreadpool' 2025-03-14T06:07:20.1187600Z Synchronizing submodule url for 'third_party/pybind11' 2025-03-14T06:07:20.1213855Z Synchronizing submodule url for 'third_party/python-peachpy' 2025-03-14T06:07:20.1241619Z Synchronizing submodule url for 'third_party/sleef' 2025-03-14T06:07:20.1268472Z Synchronizing submodule url for 'third_party/tensorpipe' 2025-03-14T06:07:20.1292212Z Synchronizing submodule url for 'third_party/tensorpipe/third_party/googletest' 2025-03-14T06:07:20.1316393Z Synchronizing submodule url for 'third_party/tensorpipe/third_party/libnop' 2025-03-14T06:07:20.1341187Z Synchronizing submodule url for 'third_party/tensorpipe/third_party/libuv' 2025-03-14T06:07:20.1366546Z Synchronizing submodule url for 'third_party/tensorpipe/third_party/pybind11' 2025-03-14T06:07:20.1389485Z Synchronizing submodule url for 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-03-14T06:07:20.1429738Z [command]/usr/bin/git -c protocol.version=2 submodule update --init --force --recursive 2025-03-14T06:07:20.2000346Z Submodule path 'android/libs/fbjni': checked out '7e1e1fe3858c63c251c637ae41a20de425dde96f' 2025-03-14T06:07:20.2152884Z Submodule path 'third_party/FP16': checked out '4dfe081cf6bcd15db339cf2680b9281b8451eeb3' 2025-03-14T06:07:20.2266214Z Submodule path 'third_party/FXdiv': checked out 'b408327ac2a15ec3e43352421954f5b1967701d1' 2025-03-14T06:07:20.2641590Z Submodule path 'third_party/NNPACK': checked out 'c07e3a0400713d546e0dea2d5466dd22ea389c73' 2025-03-14T06:07:20.3202029Z Submodule path 'third_party/NVTX': checked out 'e170594ac7cf1dac584da473d4ca9301087090c1' 2025-03-14T06:07:20.3755776Z Submodule path 'third_party/VulkanMemoryAllocator': checked out 'a6bfc237255a6bac1513f7c1ebde6d8aed6b5191' 2025-03-14T06:07:21.6281768Z Submodule path 'third_party/XNNPACK': checked out '51a0103656eff6fc9bfd39a4597923c4b542c883' 2025-03-14T06:07:21.6621181Z Submodule path 'third_party/benchmark': checked out '0d98dba29d66e93259db7daa53a9327df767a415' 2025-03-14T06:07:22.0884034Z Submodule path 'third_party/composable_kernel': checked out '8086bbe3a78d931eb96fe12fdc014082e18d18d3' 2025-03-14T06:07:22.1482480Z Submodule path 'third_party/cpp-httplib': checked out '3b6597bba913d51161383657829b7e644e59c006' 2025-03-14T06:07:22.2892744Z Submodule path 'third_party/cpuinfo': checked out '1e83a2fdd3102f65c6f1fb602c1b320486218a99' 2025-03-14T06:07:22.3395240Z Submodule path 'third_party/cudnn_frontend': checked out '91b7532f3386768bba4f444ee7672b497f34da8a' 2025-03-14T06:07:23.3136114Z Submodule path 'third_party/cutlass': checked out 'afa1772203677c5118fcd82537a9c8fefbcc7008' 2025-03-14T06:07:23.6848579Z Submodule path 'third_party/eigen': checked out '3147391d946bb4b6c68edd901f2add6ac1f31f8c' 2025-03-14T06:07:23.7835035Z Submodule path 'third_party/fbgemm': checked out 'dbc3157bf256f1339b3fa1fef2be89ac4078be0e' 2025-03-14T06:07:23.8437361Z Submodule path 'third_party/fbgemm/third_party/asmjit': checked out 'd3fbf7c9bc7c1d1365a94a45614b91c5a3706b81' 2025-03-14T06:07:23.9774336Z Submodule path 'third_party/fbgemm/third_party/cpuinfo': checked out 'ed8b86a253800bafdb7b25c5c399f91bff9cb1f3' 2025-03-14T06:07:24.6697574Z Submodule path 'third_party/fbgemm/third_party/cutlass': checked out 'fc9ebc645b63f3a6bc80aaefde5c063fb72110d6' 2025-03-14T06:07:24.7346264Z Submodule path 'third_party/fbgemm/third_party/googletest': checked out 'cbf019de22c8dd37b2108da35b2748fd702d1796' 2025-03-14T06:07:24.7503003Z Submodule path 'third_party/fbgemm/third_party/hipify_torch': checked out '23f53b025b466d8ec3c45d52290d3442f7fbe6b1' 2025-03-14T06:07:24.8663455Z Submodule path 'third_party/flash-attention': checked out '979702c87a8713a8e0a5e9fee122b90d2ef13be5' 2025-03-14T06:07:25.2739866Z Submodule path 'third_party/flash-attention/csrc/composable_kernel': checked out '888317e698e9803c62bd38568abc9e05d7709f33' 2025-03-14T06:07:26.1890867Z Submodule path 'third_party/flash-attention/csrc/cutlass': checked out 'c506e16788cb08416a4a57e11a9067beeee29420' 2025-03-14T06:07:26.4072865Z Submodule path 'third_party/flatbuffers': checked out '01834de25e4bf3975a9a00e816292b1ad0fe184b' 2025-03-14T06:07:26.4513406Z Submodule path 'third_party/fmt': checked out '123913715afeb8a437e6388b4473fcc4753e1c9a' 2025-03-14T06:07:26.5050796Z Submodule path 'third_party/gemmlowp/gemmlowp': checked out '3fb5c176c17c765a3492cd2f0321b0dab712f350' 2025-03-14T06:07:26.5445301Z Submodule path 'third_party/gloo': checked out '5354032ea08eadd7fc4456477f7f7c6308818509' 2025-03-14T06:07:26.6056509Z Submodule path 'third_party/googletest': checked out 'b514bdc898e2951020cbdca1304b75f5950d1f59' 2025-03-14T06:07:26.6228024Z Submodule path 'third_party/ideep': checked out '719d8e6cd7f7a0e01b155657526d693acf97c2b3' 2025-03-14T06:07:27.4710584Z Submodule path 'third_party/ideep/mkl-dnn': checked out '8d263e693366ef8db40acc569cc7d8edf644556d' 2025-03-14T06:07:27.4932129Z Submodule path 'third_party/ittapi': checked out '5b8a7d7422611c3a0d799fb5fc5dd4abfae35b42' 2025-03-14T06:07:27.6133608Z Submodule path 'third_party/kineto': checked out '2859721fd9e73d3ca1c56f827dbc64e6d68f78a2' 2025-03-14T06:07:27.7313561Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog': checked out '7d04a0053a845370ae06ce317a22a48e9edcc74e' 2025-03-14T06:07:27.9919085Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM': checked out 'ffde4e54bc7249a6039a5e6b45b395141e1217f9' 2025-03-14T06:07:28.0193812Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr': checked out '871ed52d350214a034f6ef8a3b8f51c5ce1bd400' 2025-03-14T06:07:28.0704316Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt': checked out 'cd4af11efc9c622896a3e4cb599fa28668ca3d05' 2025-03-14T06:07:28.0895641Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags': checked out 'e171aa2d15ed9eb17054558e0b3a6a413bb01067' 2025-03-14T06:07:28.1011198Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc': checked out '8411df715cf522606e3b1aca386ddfc0b63d34b4' 2025-03-14T06:07:28.1269353Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog': checked out 'b33e3bad4c46c8a6345525fd822af355e5ef9446' 2025-03-14T06:07:28.1854240Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest': checked out '58d77fa8070e8cec2dc1ed015d66b454c8d78850' 2025-03-14T06:07:28.3384400Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json': checked out '4f8fba14066156b73f1189a2b8bd568bde5284c5' 2025-03-14T06:07:28.3625443Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs': checked out 'f68a2fa8ea36c783bdd760371411fcb495aa3150' 2025-03-14T06:07:28.4138437Z Submodule path 'third_party/kineto/libkineto/third_party/fmt': checked out '0041a40c1350ba702d475b9c4ad62da77caea164' 2025-03-14T06:07:28.4770724Z Submodule path 'third_party/kineto/libkineto/third_party/googletest': checked out '7aca84427f224eeed3144123d5230d5871e93347' 2025-03-14T06:07:28.5313629Z Submodule path 'third_party/kleidiai': checked out 'ef685a13cfbe8d418aa2ed34350e21e4938358b6' 2025-03-14T06:07:28.5858567Z Submodule path 'third_party/mimalloc': checked out 'b66e3214d8a104669c2ec05ae91ebc26a8f5ab78' 2025-03-14T06:07:28.7488767Z Submodule path 'third_party/nlohmann': checked out '87cda1d6646592ac5866dc703c8e1839046a6806' 2025-03-14T06:07:29.3719096Z Submodule path 'third_party/onnx': checked out 'b8baa8446686496da4cc8fda09f2b6fe65c2a02c' 2025-03-14T06:07:29.4269079Z Submodule path 'third_party/onnx/third_party/pybind11': checked out '3e9dfa2866941655c56877882565e7577de6fc7b' 2025-03-14T06:07:29.5496989Z Submodule path 'third_party/opentelemetry-cpp': checked out 'a799f4aed9c94b765dcdaabaeab7d5e7e2310878' 2025-03-14T06:07:29.5808125Z Submodule path 'third_party/opentelemetry-cpp/third_party/benchmark': checked out 'd572f4777349d43653b21d6c2fc63020ab326db2' 2025-03-14T06:07:29.6377453Z Submodule path 'third_party/opentelemetry-cpp/third_party/googletest': checked out 'b796f7d44681514f58a683a3a71ff17c94edb0c1' 2025-03-14T06:07:29.6550583Z Submodule path 'third_party/opentelemetry-cpp/third_party/ms-gsl': checked out '6f4529395c5b7c2d661812257cd6780c67e54afa' 2025-03-14T06:07:29.8157558Z Submodule path 'third_party/opentelemetry-cpp/third_party/nlohmann-json': checked out 'bc889afb4c5bf1c0d8ee29ef35eaaf4c8bef8a5d' 2025-03-14T06:07:29.8326950Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto': checked out '4ca4f0335c63cda7ab31ea7ed70d6553aee14dce' 2025-03-14T06:07:29.8542847Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp': checked out '06b57f48ded1fa3bdd3d4346f6ef29e40e08eaf5' 2025-03-14T06:07:29.8791608Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp': checked out 'c9ffcdda9086ffd9e1283ea7a0276d831f3c8a8d' 2025-03-14T06:07:30.2351248Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb': checked out 'eefb26f82b233268fc98577d265352720d477ba4' 2025-03-14T06:07:30.2996957Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2025-03-14T06:07:31.1694101Z Submodule path 'third_party/opentelemetry-cpp/tools/vcpkg': checked out '8eb57355a4ffb410a2e94c07b4dca2dffbee8e50' 2025-03-14T06:07:31.1839221Z Submodule path 'third_party/pocketfft': checked out '9d3ab05a7fffbc71a492bc6a17be034e83e8f0fe' 2025-03-14T06:07:31.6008354Z Submodule path 'third_party/protobuf': checked out 'd1eca4e4b421cd2997495c4b4e65cea6be4e9b8a' 2025-03-14T06:07:31.6228825Z Submodule path 'third_party/protobuf/third_party/benchmark': checked out '5b7683f49e1e9223cf9927b24f6fd3d6bd82e3f8' 2025-03-14T06:07:31.6948324Z Submodule path 'third_party/protobuf/third_party/googletest': checked out '5ec7f0c4a113e2f18ac2c6cc7df51ad6afc24081' 2025-03-14T06:07:31.7060089Z Submodule path 'third_party/psimd': checked out '072586a71b55b7f8c584153d223e95687148a900' 2025-03-14T06:07:31.7215837Z Submodule path 'third_party/pthreadpool': checked out '4fe0e1e183925bf8cfa6aae24237e724a96479b8' 2025-03-14T06:07:31.7759199Z Submodule path 'third_party/pybind11': checked out 'a2e59f0e7065404b44dfe92a28aca47ba1378dc4' 2025-03-14T06:07:31.8152533Z Submodule path 'third_party/python-peachpy': checked out 'f45429b087dd7d5bc78bb40dc7cf06425c252d67' 2025-03-14T06:07:31.8752395Z Submodule path 'third_party/sleef': checked out '56e1f79cb140fb9326d612d0be06b5250565cade' 2025-03-14T06:07:31.9181956Z Submodule path 'third_party/tensorpipe': checked out '52791a2fd214b2a9dc5759d36725909c1daa7f2e' 2025-03-14T06:07:31.9808577Z Submodule path 'third_party/tensorpipe/third_party/googletest': checked out 'aee0f9d9b5b87796ee8a0ab26b7587ec30e8858e' 2025-03-14T06:07:32.0038299Z Submodule path 'third_party/tensorpipe/third_party/libnop': checked out '910b55815be16109f04f4180e9adee14fb4ce281' 2025-03-14T06:07:32.0921532Z Submodule path 'third_party/tensorpipe/third_party/libuv': checked out '1dff88e5161cba5c59276d2070d2e304e4dcb242' 2025-03-14T06:07:32.1334893Z Submodule path 'third_party/tensorpipe/third_party/pybind11': checked out 'a23996fce38ff6ccfbcdc09f1e63f2c4be5ea2ef' 2025-03-14T06:07:32.1447565Z Submodule path 'third_party/tensorpipe/third_party/pybind11/tools/clang': checked out '6a00cbc4a9b8e68b71caf7f774b3f9c753ae84d5' 2025-03-14T06:07:32.1494339Z [command]/usr/bin/git submodule foreach --recursive git config --local gc.auto 0 2025-03-14T06:07:32.1842226Z Entering 'android/libs/fbjni' 2025-03-14T06:07:32.1890719Z Entering 'third_party/FP16' 2025-03-14T06:07:32.1941168Z Entering 'third_party/FXdiv' 2025-03-14T06:07:32.1990135Z Entering 'third_party/NNPACK' 2025-03-14T06:07:32.2039950Z Entering 'third_party/NVTX' 2025-03-14T06:07:32.2088609Z Entering 'third_party/VulkanMemoryAllocator' 2025-03-14T06:07:32.2138477Z Entering 'third_party/XNNPACK' 2025-03-14T06:07:32.2204318Z Entering 'third_party/benchmark' 2025-03-14T06:07:32.2255254Z Entering 'third_party/composable_kernel' 2025-03-14T06:07:32.2311770Z Entering 'third_party/cpp-httplib' 2025-03-14T06:07:32.2360742Z Entering 'third_party/cpuinfo' 2025-03-14T06:07:32.2410155Z Entering 'third_party/cudnn_frontend' 2025-03-14T06:07:32.2459924Z Entering 'third_party/cutlass' 2025-03-14T06:07:32.2517146Z Entering 'third_party/eigen' 2025-03-14T06:07:32.2569308Z Entering 'third_party/fbgemm' 2025-03-14T06:07:32.2617861Z Entering 'third_party/fbgemm/third_party/asmjit' 2025-03-14T06:07:32.2666046Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2025-03-14T06:07:32.2713655Z Entering 'third_party/fbgemm/third_party/cutlass' 2025-03-14T06:07:32.2769023Z Entering 'third_party/fbgemm/third_party/googletest' 2025-03-14T06:07:32.2817564Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2025-03-14T06:07:32.2867314Z Entering 'third_party/flash-attention' 2025-03-14T06:07:32.2916668Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-03-14T06:07:32.2972283Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-03-14T06:07:32.3031721Z Entering 'third_party/flatbuffers' 2025-03-14T06:07:32.3084033Z Entering 'third_party/fmt' 2025-03-14T06:07:32.3133652Z Entering 'third_party/gemmlowp/gemmlowp' 2025-03-14T06:07:32.3182557Z Entering 'third_party/gloo' 2025-03-14T06:07:32.3232682Z Entering 'third_party/googletest' 2025-03-14T06:07:32.3281133Z Entering 'third_party/ideep' 2025-03-14T06:07:32.3330523Z Entering 'third_party/ideep/mkl-dnn' 2025-03-14T06:07:32.3386597Z Entering 'third_party/ittapi' 2025-03-14T06:07:32.3435688Z Entering 'third_party/kineto' 2025-03-14T06:07:32.3485499Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-03-14T06:07:32.3534983Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-03-14T06:07:32.3586209Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-03-14T06:07:32.3636401Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-03-14T06:07:32.3686048Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-03-14T06:07:32.3735717Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-03-14T06:07:32.3785722Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-03-14T06:07:32.3835585Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-03-14T06:07:32.3883913Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-03-14T06:07:32.3934412Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-03-14T06:07:32.3983912Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-03-14T06:07:32.4032636Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-03-14T06:07:32.4081687Z Entering 'third_party/kleidiai' 2025-03-14T06:07:32.4131644Z Entering 'third_party/mimalloc' 2025-03-14T06:07:32.4180747Z Entering 'third_party/nlohmann' 2025-03-14T06:07:32.4232347Z Entering 'third_party/onnx' 2025-03-14T06:07:32.4300232Z Entering 'third_party/onnx/third_party/pybind11' 2025-03-14T06:07:32.4352074Z Entering 'third_party/opentelemetry-cpp' 2025-03-14T06:07:32.4404567Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-03-14T06:07:32.4453307Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-03-14T06:07:32.4501334Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-03-14T06:07:32.4549912Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-03-14T06:07:32.4598757Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-03-14T06:07:32.4647924Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-03-14T06:07:32.4695107Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-03-14T06:07:32.4742992Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-03-14T06:07:32.4792888Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-03-14T06:07:32.4843059Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-03-14T06:07:32.4914845Z Entering 'third_party/pocketfft' 2025-03-14T06:07:32.4963729Z Entering 'third_party/protobuf' 2025-03-14T06:07:32.5015350Z Entering 'third_party/protobuf/third_party/benchmark' 2025-03-14T06:07:32.5065033Z Entering 'third_party/protobuf/third_party/googletest' 2025-03-14T06:07:32.5114671Z Entering 'third_party/psimd' 2025-03-14T06:07:32.5163848Z Entering 'third_party/pthreadpool' 2025-03-14T06:07:32.5212040Z Entering 'third_party/pybind11' 2025-03-14T06:07:32.5262122Z Entering 'third_party/python-peachpy' 2025-03-14T06:07:32.5310055Z Entering 'third_party/sleef' 2025-03-14T06:07:32.5359685Z Entering 'third_party/tensorpipe' 2025-03-14T06:07:32.5408560Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-03-14T06:07:32.5457477Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-03-14T06:07:32.5504481Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-03-14T06:07:32.5554596Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-03-14T06:07:32.5601393Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-03-14T06:07:32.5664021Z ##[endgroup] 2025-03-14T06:07:32.5664600Z ##[group]Persisting credentials for submodules 2025-03-14T06:07:32.5672783Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'url\.https\:\/\/github\.com\/\.insteadOf' && git config --local --unset-all 'url.https://github.com/.insteadOf' || :" 2025-03-14T06:07:32.6010723Z Entering 'android/libs/fbjni' 2025-03-14T06:07:32.6053977Z url.https://github.com/.insteadof 2025-03-14T06:07:32.6054431Z url.https://github.com/.insteadof 2025-03-14T06:07:32.6092211Z Entering 'third_party/FP16' 2025-03-14T06:07:32.6136291Z url.https://github.com/.insteadof 2025-03-14T06:07:32.6136759Z url.https://github.com/.insteadof 2025-03-14T06:07:32.6176092Z Entering 'third_party/FXdiv' 2025-03-14T06:07:32.6218884Z url.https://github.com/.insteadof 2025-03-14T06:07:32.6220058Z url.https://github.com/.insteadof 2025-03-14T06:07:32.6258312Z Entering 'third_party/NNPACK' 2025-03-14T06:07:32.6301729Z url.https://github.com/.insteadof 2025-03-14T06:07:32.6302205Z url.https://github.com/.insteadof 2025-03-14T06:07:32.6340760Z Entering 'third_party/NVTX' 2025-03-14T06:07:32.6385076Z url.https://github.com/.insteadof 2025-03-14T06:07:32.6385526Z url.https://github.com/.insteadof 2025-03-14T06:07:32.6423785Z Entering 'third_party/VulkanMemoryAllocator' 2025-03-14T06:07:32.6467845Z url.https://github.com/.insteadof 2025-03-14T06:07:32.6468276Z url.https://github.com/.insteadof 2025-03-14T06:07:32.6506140Z Entering 'third_party/XNNPACK' 2025-03-14T06:07:32.6551201Z url.https://github.com/.insteadof 2025-03-14T06:07:32.6551677Z url.https://github.com/.insteadof 2025-03-14T06:07:32.6606871Z Entering 'third_party/benchmark' 2025-03-14T06:07:32.6651305Z url.https://github.com/.insteadof 2025-03-14T06:07:32.6651728Z url.https://github.com/.insteadof 2025-03-14T06:07:32.6689701Z Entering 'third_party/composable_kernel' 2025-03-14T06:07:32.6733362Z url.https://github.com/.insteadof 2025-03-14T06:07:32.6733806Z url.https://github.com/.insteadof 2025-03-14T06:07:32.6778742Z Entering 'third_party/cpp-httplib' 2025-03-14T06:07:32.6822033Z url.https://github.com/.insteadof 2025-03-14T06:07:32.6822454Z url.https://github.com/.insteadof 2025-03-14T06:07:32.6860271Z Entering 'third_party/cpuinfo' 2025-03-14T06:07:32.6902860Z url.https://github.com/.insteadof 2025-03-14T06:07:32.6903301Z url.https://github.com/.insteadof 2025-03-14T06:07:32.6941697Z Entering 'third_party/cudnn_frontend' 2025-03-14T06:07:32.6984218Z url.https://github.com/.insteadof 2025-03-14T06:07:32.6984656Z url.https://github.com/.insteadof 2025-03-14T06:07:32.7023719Z Entering 'third_party/cutlass' 2025-03-14T06:07:32.7067713Z url.https://github.com/.insteadof 2025-03-14T06:07:32.7068175Z url.https://github.com/.insteadof 2025-03-14T06:07:32.7115302Z Entering 'third_party/eigen' 2025-03-14T06:07:32.7159076Z url.https://github.com/.insteadof 2025-03-14T06:07:32.7159509Z url.https://github.com/.insteadof 2025-03-14T06:07:32.7200667Z Entering 'third_party/fbgemm' 2025-03-14T06:07:32.7245400Z url.https://github.com/.insteadof 2025-03-14T06:07:32.7245842Z url.https://github.com/.insteadof 2025-03-14T06:07:32.7284219Z Entering 'third_party/fbgemm/third_party/asmjit' 2025-03-14T06:07:32.7327948Z url.https://github.com/.insteadof 2025-03-14T06:07:32.7328383Z url.https://github.com/.insteadof 2025-03-14T06:07:32.7365843Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2025-03-14T06:07:32.7408813Z url.https://github.com/.insteadof 2025-03-14T06:07:32.7409260Z url.https://github.com/.insteadof 2025-03-14T06:07:32.7448005Z Entering 'third_party/fbgemm/third_party/cutlass' 2025-03-14T06:07:32.7490368Z url.https://github.com/.insteadof 2025-03-14T06:07:32.7490964Z url.https://github.com/.insteadof 2025-03-14T06:07:32.7538262Z Entering 'third_party/fbgemm/third_party/googletest' 2025-03-14T06:07:32.7579984Z url.https://github.com/.insteadof 2025-03-14T06:07:32.7580436Z url.https://github.com/.insteadof 2025-03-14T06:07:32.7618073Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2025-03-14T06:07:32.7661117Z url.https://github.com/.insteadof 2025-03-14T06:07:32.7661562Z url.https://github.com/.insteadof 2025-03-14T06:07:32.7701686Z Entering 'third_party/flash-attention' 2025-03-14T06:07:32.7744925Z url.https://github.com/.insteadof 2025-03-14T06:07:32.7745372Z url.https://github.com/.insteadof 2025-03-14T06:07:32.7784180Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-03-14T06:07:32.7827815Z url.https://github.com/.insteadof 2025-03-14T06:07:32.7828263Z url.https://github.com/.insteadof 2025-03-14T06:07:32.7874930Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-03-14T06:07:32.7918806Z url.https://github.com/.insteadof 2025-03-14T06:07:32.7919261Z url.https://github.com/.insteadof 2025-03-14T06:07:32.7968533Z Entering 'third_party/flatbuffers' 2025-03-14T06:07:32.8010859Z url.https://github.com/.insteadof 2025-03-14T06:07:32.8011309Z url.https://github.com/.insteadof 2025-03-14T06:07:32.8052377Z Entering 'third_party/fmt' 2025-03-14T06:07:32.8094892Z url.https://github.com/.insteadof 2025-03-14T06:07:32.8095334Z url.https://github.com/.insteadof 2025-03-14T06:07:32.8136040Z Entering 'third_party/gemmlowp/gemmlowp' 2025-03-14T06:07:32.8178574Z url.https://github.com/.insteadof 2025-03-14T06:07:32.8179012Z url.https://github.com/.insteadof 2025-03-14T06:07:32.8216677Z Entering 'third_party/gloo' 2025-03-14T06:07:32.8260704Z url.https://github.com/.insteadof 2025-03-14T06:07:32.8261148Z url.https://github.com/.insteadof 2025-03-14T06:07:32.8298939Z Entering 'third_party/googletest' 2025-03-14T06:07:32.8344029Z url.https://github.com/.insteadof 2025-03-14T06:07:32.8344481Z url.https://github.com/.insteadof 2025-03-14T06:07:32.8382767Z Entering 'third_party/ideep' 2025-03-14T06:07:32.8425712Z url.https://github.com/.insteadof 2025-03-14T06:07:32.8426157Z url.https://github.com/.insteadof 2025-03-14T06:07:32.8465014Z Entering 'third_party/ideep/mkl-dnn' 2025-03-14T06:07:32.8507563Z url.https://github.com/.insteadof 2025-03-14T06:07:32.8508078Z url.https://github.com/.insteadof 2025-03-14T06:07:32.8554814Z Entering 'third_party/ittapi' 2025-03-14T06:07:32.8598075Z url.https://github.com/.insteadof 2025-03-14T06:07:32.8598578Z url.https://github.com/.insteadof 2025-03-14T06:07:32.8637182Z Entering 'third_party/kineto' 2025-03-14T06:07:32.8680178Z url.https://github.com/.insteadof 2025-03-14T06:07:32.8680637Z url.https://github.com/.insteadof 2025-03-14T06:07:32.8718522Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-03-14T06:07:32.8761780Z url.https://github.com/.insteadof 2025-03-14T06:07:32.8762241Z url.https://github.com/.insteadof 2025-03-14T06:07:32.8800432Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-03-14T06:07:32.8845057Z url.https://github.com/.insteadof 2025-03-14T06:07:32.8845519Z url.https://github.com/.insteadof 2025-03-14T06:07:32.8886046Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-03-14T06:07:32.8929256Z url.https://github.com/.insteadof 2025-03-14T06:07:32.8929768Z url.https://github.com/.insteadof 2025-03-14T06:07:32.8968363Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-03-14T06:07:32.9011305Z url.https://github.com/.insteadof 2025-03-14T06:07:32.9011769Z url.https://github.com/.insteadof 2025-03-14T06:07:32.9051857Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-03-14T06:07:32.9094467Z url.https://github.com/.insteadof 2025-03-14T06:07:32.9094925Z url.https://github.com/.insteadof 2025-03-14T06:07:32.9133888Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-03-14T06:07:32.9176761Z url.https://github.com/.insteadof 2025-03-14T06:07:32.9177371Z url.https://github.com/.insteadof 2025-03-14T06:07:32.9218887Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-03-14T06:07:32.9261944Z url.https://github.com/.insteadof 2025-03-14T06:07:32.9262396Z url.https://github.com/.insteadof 2025-03-14T06:07:32.9302154Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-03-14T06:07:32.9345378Z url.https://github.com/.insteadof 2025-03-14T06:07:32.9345822Z url.https://github.com/.insteadof 2025-03-14T06:07:32.9384536Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-03-14T06:07:32.9427954Z url.https://github.com/.insteadof 2025-03-14T06:07:32.9428404Z url.https://github.com/.insteadof 2025-03-14T06:07:32.9468592Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-03-14T06:07:32.9511181Z url.https://github.com/.insteadof 2025-03-14T06:07:32.9511643Z url.https://github.com/.insteadof 2025-03-14T06:07:32.9553147Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-03-14T06:07:32.9595712Z url.https://github.com/.insteadof 2025-03-14T06:07:32.9596135Z url.https://github.com/.insteadof 2025-03-14T06:07:32.9634790Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-03-14T06:07:32.9676899Z url.https://github.com/.insteadof 2025-03-14T06:07:32.9677345Z url.https://github.com/.insteadof 2025-03-14T06:07:32.9716907Z Entering 'third_party/kleidiai' 2025-03-14T06:07:32.9760563Z url.https://github.com/.insteadof 2025-03-14T06:07:32.9760987Z url.https://github.com/.insteadof 2025-03-14T06:07:32.9799204Z Entering 'third_party/mimalloc' 2025-03-14T06:07:32.9842872Z url.https://github.com/.insteadof 2025-03-14T06:07:32.9843308Z url.https://github.com/.insteadof 2025-03-14T06:07:32.9881095Z Entering 'third_party/nlohmann' 2025-03-14T06:07:32.9923781Z url.https://github.com/.insteadof 2025-03-14T06:07:32.9924197Z url.https://github.com/.insteadof 2025-03-14T06:07:32.9963326Z Entering 'third_party/onnx' 2025-03-14T06:07:33.0006048Z url.https://github.com/.insteadof 2025-03-14T06:07:33.0006489Z url.https://github.com/.insteadof 2025-03-14T06:07:33.0062916Z Entering 'third_party/onnx/third_party/pybind11' 2025-03-14T06:07:33.0105641Z url.https://github.com/.insteadof 2025-03-14T06:07:33.0106058Z url.https://github.com/.insteadof 2025-03-14T06:07:33.0146822Z Entering 'third_party/opentelemetry-cpp' 2025-03-14T06:07:33.0189900Z url.https://github.com/.insteadof 2025-03-14T06:07:33.0190332Z url.https://github.com/.insteadof 2025-03-14T06:07:33.0231563Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-03-14T06:07:33.0273933Z url.https://github.com/.insteadof 2025-03-14T06:07:33.0274354Z url.https://github.com/.insteadof 2025-03-14T06:07:33.0311592Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-03-14T06:07:33.0354649Z url.https://github.com/.insteadof 2025-03-14T06:07:33.0355095Z url.https://github.com/.insteadof 2025-03-14T06:07:33.0393594Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-03-14T06:07:33.0436641Z url.https://github.com/.insteadof 2025-03-14T06:07:33.0437088Z url.https://github.com/.insteadof 2025-03-14T06:07:33.0474037Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-03-14T06:07:33.0517036Z url.https://github.com/.insteadof 2025-03-14T06:07:33.0517477Z url.https://github.com/.insteadof 2025-03-14T06:07:33.0557782Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-03-14T06:07:33.0599322Z url.https://github.com/.insteadof 2025-03-14T06:07:33.0599765Z url.https://github.com/.insteadof 2025-03-14T06:07:33.0637807Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-03-14T06:07:33.0679560Z url.https://github.com/.insteadof 2025-03-14T06:07:33.0680013Z url.https://github.com/.insteadof 2025-03-14T06:07:33.0717338Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-03-14T06:07:33.0760848Z url.https://github.com/.insteadof 2025-03-14T06:07:33.0761475Z url.https://github.com/.insteadof 2025-03-14T06:07:33.0798571Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-03-14T06:07:33.0842023Z url.https://github.com/.insteadof 2025-03-14T06:07:33.0842595Z url.https://github.com/.insteadof 2025-03-14T06:07:33.0882608Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-03-14T06:07:33.0925201Z url.https://github.com/.insteadof 2025-03-14T06:07:33.0925817Z url.https://github.com/.insteadof 2025-03-14T06:07:33.0965919Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-03-14T06:07:33.1008737Z url.https://github.com/.insteadof 2025-03-14T06:07:33.1009368Z url.https://github.com/.insteadof 2025-03-14T06:07:33.1071886Z Entering 'third_party/pocketfft' 2025-03-14T06:07:33.1115880Z url.https://github.com/.insteadof 2025-03-14T06:07:33.1116519Z url.https://github.com/.insteadof 2025-03-14T06:07:33.1154631Z Entering 'third_party/protobuf' 2025-03-14T06:07:33.1197347Z url.https://github.com/.insteadof 2025-03-14T06:07:33.1197935Z url.https://github.com/.insteadof 2025-03-14T06:07:33.1241949Z Entering 'third_party/protobuf/third_party/benchmark' 2025-03-14T06:07:33.1284633Z url.https://github.com/.insteadof 2025-03-14T06:07:33.1285186Z url.https://github.com/.insteadof 2025-03-14T06:07:33.1322932Z Entering 'third_party/protobuf/third_party/googletest' 2025-03-14T06:07:33.1366991Z url.https://github.com/.insteadof 2025-03-14T06:07:33.1367583Z url.https://github.com/.insteadof 2025-03-14T06:07:33.1407311Z Entering 'third_party/psimd' 2025-03-14T06:07:33.1452038Z url.https://github.com/.insteadof 2025-03-14T06:07:33.1452574Z url.https://github.com/.insteadof 2025-03-14T06:07:33.1489726Z Entering 'third_party/pthreadpool' 2025-03-14T06:07:33.1534999Z url.https://github.com/.insteadof 2025-03-14T06:07:33.1535657Z url.https://github.com/.insteadof 2025-03-14T06:07:33.1573157Z Entering 'third_party/pybind11' 2025-03-14T06:07:33.1617165Z url.https://github.com/.insteadof 2025-03-14T06:07:33.1618019Z url.https://github.com/.insteadof 2025-03-14T06:07:33.1658817Z Entering 'third_party/python-peachpy' 2025-03-14T06:07:33.1701615Z url.https://github.com/.insteadof 2025-03-14T06:07:33.1702569Z url.https://github.com/.insteadof 2025-03-14T06:07:33.1740298Z Entering 'third_party/sleef' 2025-03-14T06:07:33.1782454Z url.https://github.com/.insteadof 2025-03-14T06:07:33.1783397Z url.https://github.com/.insteadof 2025-03-14T06:07:33.1820963Z Entering 'third_party/tensorpipe' 2025-03-14T06:07:33.1864312Z url.https://github.com/.insteadof 2025-03-14T06:07:33.1865257Z url.https://github.com/.insteadof 2025-03-14T06:07:33.1902844Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-03-14T06:07:33.1946271Z url.https://github.com/.insteadof 2025-03-14T06:07:33.1947188Z url.https://github.com/.insteadof 2025-03-14T06:07:33.1984282Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-03-14T06:07:33.2026906Z url.https://github.com/.insteadof 2025-03-14T06:07:33.2027871Z url.https://github.com/.insteadof 2025-03-14T06:07:33.2065164Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-03-14T06:07:33.2107595Z url.https://github.com/.insteadof 2025-03-14T06:07:33.2108532Z url.https://github.com/.insteadof 2025-03-14T06:07:33.2146984Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-03-14T06:07:33.2189044Z url.https://github.com/.insteadof 2025-03-14T06:07:33.2189991Z url.https://github.com/.insteadof 2025-03-14T06:07:33.2227462Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-03-14T06:07:33.2269952Z url.https://github.com/.insteadof 2025-03-14T06:07:33.2270899Z url.https://github.com/.insteadof 2025-03-14T06:07:33.2330980Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local 'http.https://github.com/.extraheader' 'AUTHORIZATION: basic ***' && git config --local --show-origin --name-only --get-regexp remote.origin.url" 2025-03-14T06:07:33.2668255Z Entering 'android/libs/fbjni' 2025-03-14T06:07:33.2728909Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/android/libs/fbjni/config remote.origin.url 2025-03-14T06:07:33.2747284Z Entering 'third_party/FP16' 2025-03-14T06:07:33.2807399Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FP16/config remote.origin.url 2025-03-14T06:07:33.2825526Z Entering 'third_party/FXdiv' 2025-03-14T06:07:33.2885418Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FXdiv/config remote.origin.url 2025-03-14T06:07:33.2903447Z Entering 'third_party/NNPACK' 2025-03-14T06:07:33.2965057Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK/config remote.origin.url 2025-03-14T06:07:33.2983564Z Entering 'third_party/NVTX' 2025-03-14T06:07:33.3044123Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NVTX/config remote.origin.url 2025-03-14T06:07:33.3062909Z Entering 'third_party/VulkanMemoryAllocator' 2025-03-14T06:07:33.3124322Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/VulkanMemoryAllocator/config remote.origin.url 2025-03-14T06:07:33.3143741Z Entering 'third_party/XNNPACK' 2025-03-14T06:07:33.3202472Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/XNNPACK/config remote.origin.url 2025-03-14T06:07:33.3238923Z Entering 'third_party/benchmark' 2025-03-14T06:07:33.3297746Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/benchmark/config remote.origin.url 2025-03-14T06:07:33.3316723Z Entering 'third_party/composable_kernel' 2025-03-14T06:07:33.3377846Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/composable_kernel/config remote.origin.url 2025-03-14T06:07:33.3402599Z Entering 'third_party/cpp-httplib' 2025-03-14T06:07:33.3465463Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpp-httplib/config remote.origin.url 2025-03-14T06:07:33.3483669Z Entering 'third_party/cpuinfo' 2025-03-14T06:07:33.3544532Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpuinfo/config remote.origin.url 2025-03-14T06:07:33.3563433Z Entering 'third_party/cudnn_frontend' 2025-03-14T06:07:33.3624111Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cudnn_frontend/config remote.origin.url 2025-03-14T06:07:33.3643852Z Entering 'third_party/cutlass' 2025-03-14T06:07:33.3702800Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cutlass/config remote.origin.url 2025-03-14T06:07:33.3732368Z Entering 'third_party/eigen' 2025-03-14T06:07:33.3791637Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/eigen/config remote.origin.url 2025-03-14T06:07:33.3812439Z Entering 'third_party/fbgemm' 2025-03-14T06:07:33.3873255Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/config remote.origin.url 2025-03-14T06:07:33.3891638Z Entering 'third_party/fbgemm/third_party/asmjit' 2025-03-14T06:07:33.3951809Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/asmjit/config remote.origin.url 2025-03-14T06:07:33.3969868Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2025-03-14T06:07:33.4030076Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cpuinfo/config remote.origin.url 2025-03-14T06:07:33.4048392Z Entering 'third_party/fbgemm/third_party/cutlass' 2025-03-14T06:07:33.4108447Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cutlass/config remote.origin.url 2025-03-14T06:07:33.4135916Z Entering 'third_party/fbgemm/third_party/googletest' 2025-03-14T06:07:33.4195302Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/googletest/config remote.origin.url 2025-03-14T06:07:33.4213295Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2025-03-14T06:07:33.4275816Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/hipify_torch/config remote.origin.url 2025-03-14T06:07:33.4295082Z Entering 'third_party/flash-attention' 2025-03-14T06:07:33.4363939Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/config remote.origin.url 2025-03-14T06:07:33.4383256Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-03-14T06:07:33.4443142Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/modules/csrc/composable_kernel/config remote.origin.url 2025-03-14T06:07:33.4467258Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-03-14T06:07:33.4528036Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/modules/csrc/cutlass/config remote.origin.url 2025-03-14T06:07:33.4557839Z Entering 'third_party/flatbuffers' 2025-03-14T06:07:33.4618287Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/flatbuffers/config remote.origin.url 2025-03-14T06:07:33.4641631Z Entering 'third_party/fmt' 2025-03-14T06:07:33.4700998Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fmt/config remote.origin.url 2025-03-14T06:07:33.4719464Z Entering 'third_party/gemmlowp/gemmlowp' 2025-03-14T06:07:33.4780520Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gemmlowp/gemmlowp/config remote.origin.url 2025-03-14T06:07:33.4798865Z Entering 'third_party/gloo' 2025-03-14T06:07:33.4859442Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gloo/config remote.origin.url 2025-03-14T06:07:33.4878066Z Entering 'third_party/googletest' 2025-03-14T06:07:33.4939375Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/googletest/config remote.origin.url 2025-03-14T06:07:33.4957887Z Entering 'third_party/ideep' 2025-03-14T06:07:33.5017872Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/config remote.origin.url 2025-03-14T06:07:33.5036131Z Entering 'third_party/ideep/mkl-dnn' 2025-03-14T06:07:33.5094300Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/modules/mkl-dnn/config remote.origin.url 2025-03-14T06:07:33.5120818Z Entering 'third_party/ittapi' 2025-03-14T06:07:33.5180695Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ittapi/config remote.origin.url 2025-03-14T06:07:33.5198778Z Entering 'third_party/kineto' 2025-03-14T06:07:33.5259580Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/config remote.origin.url 2025-03-14T06:07:33.5277570Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-03-14T06:07:33.5339136Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/config remote.origin.url 2025-03-14T06:07:33.5356639Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-03-14T06:07:33.5416856Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/DCGM/config remote.origin.url 2025-03-14T06:07:33.5438708Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-03-14T06:07:33.5498065Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/cpr/config remote.origin.url 2025-03-14T06:07:33.5517059Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-03-14T06:07:33.5578965Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/fmt/config remote.origin.url 2025-03-14T06:07:33.5597350Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-03-14T06:07:33.5660260Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/config remote.origin.url 2025-03-14T06:07:33.5677481Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-03-14T06:07:33.5739063Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/modules/doc/config remote.origin.url 2025-03-14T06:07:33.5758993Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-03-14T06:07:33.5820863Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/glog/config remote.origin.url 2025-03-14T06:07:33.5840141Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-03-14T06:07:33.5899758Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/googletest/config remote.origin.url 2025-03-14T06:07:33.5918660Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-03-14T06:07:33.5981285Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/json/config remote.origin.url 2025-03-14T06:07:33.6000947Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-03-14T06:07:33.6062384Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/pfs/config remote.origin.url 2025-03-14T06:07:33.6082873Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-03-14T06:07:33.6143095Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/fmt/config remote.origin.url 2025-03-14T06:07:33.6161113Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-03-14T06:07:33.6220704Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/googletest/config remote.origin.url 2025-03-14T06:07:33.6241713Z Entering 'third_party/kleidiai' 2025-03-14T06:07:33.6301614Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kleidiai/config remote.origin.url 2025-03-14T06:07:33.6320368Z Entering 'third_party/mimalloc' 2025-03-14T06:07:33.6382474Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/mimalloc/config remote.origin.url 2025-03-14T06:07:33.6401673Z Entering 'third_party/nlohmann' 2025-03-14T06:07:33.6463035Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nlohmann/config remote.origin.url 2025-03-14T06:07:33.6482973Z Entering 'third_party/onnx' 2025-03-14T06:07:33.6544274Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/config remote.origin.url 2025-03-14T06:07:33.6580852Z Entering 'third_party/onnx/third_party/pybind11' 2025-03-14T06:07:33.6641257Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/pybind11/config remote.origin.url 2025-03-14T06:07:33.6661655Z Entering 'third_party/opentelemetry-cpp' 2025-03-14T06:07:33.6723232Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/config remote.origin.url 2025-03-14T06:07:33.6743486Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-03-14T06:07:33.6802304Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/benchmark/config remote.origin.url 2025-03-14T06:07:33.6820374Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-03-14T06:07:33.6881727Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/googletest/config remote.origin.url 2025-03-14T06:07:33.6899822Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-03-14T06:07:33.6959870Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/ms-gsl/config remote.origin.url 2025-03-14T06:07:33.6977635Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-03-14T06:07:33.7038496Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/nlohmann-json/config remote.origin.url 2025-03-14T06:07:33.7057991Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-03-14T06:07:33.7117837Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentelemetry-proto/config remote.origin.url 2025-03-14T06:07:33.7136582Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-03-14T06:07:33.7195384Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentracing-cpp/config remote.origin.url 2025-03-14T06:07:33.7213804Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-03-14T06:07:33.7274504Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/config remote.origin.url 2025-03-14T06:07:33.7291459Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-03-14T06:07:33.7352601Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/civetweb/config remote.origin.url 2025-03-14T06:07:33.7372838Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-03-14T06:07:33.7433263Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/googletest/config remote.origin.url 2025-03-14T06:07:33.7452805Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-03-14T06:07:33.7512838Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/tools/vcpkg/config remote.origin.url 2025-03-14T06:07:33.7556335Z Entering 'third_party/pocketfft' 2025-03-14T06:07:33.7616008Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pocketfft/config remote.origin.url 2025-03-14T06:07:33.7636608Z Entering 'third_party/protobuf' 2025-03-14T06:07:33.7696786Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/config remote.origin.url 2025-03-14T06:07:33.7719578Z Entering 'third_party/protobuf/third_party/benchmark' 2025-03-14T06:07:33.7780802Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/benchmark/config remote.origin.url 2025-03-14T06:07:33.7798556Z Entering 'third_party/protobuf/third_party/googletest' 2025-03-14T06:07:33.7858311Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/googletest/config remote.origin.url 2025-03-14T06:07:33.7878535Z Entering 'third_party/psimd' 2025-03-14T06:07:33.7939554Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/psimd/config remote.origin.url 2025-03-14T06:07:33.7958038Z Entering 'third_party/pthreadpool' 2025-03-14T06:07:33.8018143Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/pthreadpool/config remote.origin.url 2025-03-14T06:07:33.8037542Z Entering 'third_party/pybind11' 2025-03-14T06:07:33.8097938Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pybind11/config remote.origin.url 2025-03-14T06:07:33.8116800Z Entering 'third_party/python-peachpy' 2025-03-14T06:07:33.8178113Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/python-peachpy/config remote.origin.url 2025-03-14T06:07:33.8196066Z Entering 'third_party/sleef' 2025-03-14T06:07:33.8257568Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/sleef/config remote.origin.url 2025-03-14T06:07:33.8276233Z Entering 'third_party/tensorpipe' 2025-03-14T06:07:33.8337349Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/config remote.origin.url 2025-03-14T06:07:33.8355296Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-03-14T06:07:33.8415018Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/googletest/config remote.origin.url 2025-03-14T06:07:33.8433941Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-03-14T06:07:33.8492827Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libnop/config remote.origin.url 2025-03-14T06:07:33.8510544Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-03-14T06:07:33.8571468Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libuv/config remote.origin.url 2025-03-14T06:07:33.8589983Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-03-14T06:07:33.8651772Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/config remote.origin.url 2025-03-14T06:07:33.8668610Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-03-14T06:07:33.8730081Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/modules/tools/clang/config remote.origin.url 2025-03-14T06:07:33.9762654Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'git@github.com:' 2025-03-14T06:07:34.0103219Z Entering 'android/libs/fbjni' 2025-03-14T06:07:34.0154142Z Entering 'third_party/FP16' 2025-03-14T06:07:34.0202894Z Entering 'third_party/FXdiv' 2025-03-14T06:07:34.0251851Z Entering 'third_party/NNPACK' 2025-03-14T06:07:34.0300364Z Entering 'third_party/NVTX' 2025-03-14T06:07:34.0350487Z Entering 'third_party/VulkanMemoryAllocator' 2025-03-14T06:07:34.0399516Z Entering 'third_party/XNNPACK' 2025-03-14T06:07:34.0466289Z Entering 'third_party/benchmark' 2025-03-14T06:07:34.0514635Z Entering 'third_party/composable_kernel' 2025-03-14T06:07:34.0570081Z Entering 'third_party/cpp-httplib' 2025-03-14T06:07:34.0618568Z Entering 'third_party/cpuinfo' 2025-03-14T06:07:34.0668520Z Entering 'third_party/cudnn_frontend' 2025-03-14T06:07:34.0717167Z Entering 'third_party/cutlass' 2025-03-14T06:07:34.0774989Z Entering 'third_party/eigen' 2025-03-14T06:07:34.0825772Z Entering 'third_party/fbgemm' 2025-03-14T06:07:34.0875731Z Entering 'third_party/fbgemm/third_party/asmjit' 2025-03-14T06:07:34.0922818Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2025-03-14T06:07:34.0972436Z Entering 'third_party/fbgemm/third_party/cutlass' 2025-03-14T06:07:34.1028650Z Entering 'third_party/fbgemm/third_party/googletest' 2025-03-14T06:07:34.1075920Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2025-03-14T06:07:34.1124869Z Entering 'third_party/flash-attention' 2025-03-14T06:07:34.1174976Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-03-14T06:07:34.1230734Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-03-14T06:07:34.1289891Z Entering 'third_party/flatbuffers' 2025-03-14T06:07:34.1343606Z Entering 'third_party/fmt' 2025-03-14T06:07:34.1392503Z Entering 'third_party/gemmlowp/gemmlowp' 2025-03-14T06:07:34.1441948Z Entering 'third_party/gloo' 2025-03-14T06:07:34.1490270Z Entering 'third_party/googletest' 2025-03-14T06:07:34.1539947Z Entering 'third_party/ideep' 2025-03-14T06:07:34.1587460Z Entering 'third_party/ideep/mkl-dnn' 2025-03-14T06:07:34.1643992Z Entering 'third_party/ittapi' 2025-03-14T06:07:34.1692123Z Entering 'third_party/kineto' 2025-03-14T06:07:34.1742392Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-03-14T06:07:34.1790341Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-03-14T06:07:34.1840856Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-03-14T06:07:34.1888621Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-03-14T06:07:34.1939271Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-03-14T06:07:34.1986618Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-03-14T06:07:34.2039851Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-03-14T06:07:34.2087737Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-03-14T06:07:34.2137565Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-03-14T06:07:34.2186626Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-03-14T06:07:34.2237136Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-03-14T06:07:34.2284804Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-03-14T06:07:34.2335457Z Entering 'third_party/kleidiai' 2025-03-14T06:07:34.2384398Z Entering 'third_party/mimalloc' 2025-03-14T06:07:34.2433805Z Entering 'third_party/nlohmann' 2025-03-14T06:07:34.2483087Z Entering 'third_party/onnx' 2025-03-14T06:07:34.2552099Z Entering 'third_party/onnx/third_party/pybind11' 2025-03-14T06:07:34.2603065Z Entering 'third_party/opentelemetry-cpp' 2025-03-14T06:07:34.2655184Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-03-14T06:07:34.2702317Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-03-14T06:07:34.2751207Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-03-14T06:07:34.2798289Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-03-14T06:07:34.2847825Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-03-14T06:07:34.2895105Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-03-14T06:07:34.2944179Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-03-14T06:07:34.2991215Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-03-14T06:07:34.3042526Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-03-14T06:07:34.3091659Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-03-14T06:07:34.3164288Z Entering 'third_party/pocketfft' 2025-03-14T06:07:34.3212231Z Entering 'third_party/protobuf' 2025-03-14T06:07:34.3264988Z Entering 'third_party/protobuf/third_party/benchmark' 2025-03-14T06:07:34.3312138Z Entering 'third_party/protobuf/third_party/googletest' 2025-03-14T06:07:34.3363320Z Entering 'third_party/psimd' 2025-03-14T06:07:34.3412267Z Entering 'third_party/pthreadpool' 2025-03-14T06:07:34.3461841Z Entering 'third_party/pybind11' 2025-03-14T06:07:34.3510480Z Entering 'third_party/python-peachpy' 2025-03-14T06:07:34.3559401Z Entering 'third_party/sleef' 2025-03-14T06:07:34.3608173Z Entering 'third_party/tensorpipe' 2025-03-14T06:07:34.3659937Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-03-14T06:07:34.3707455Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-03-14T06:07:34.3756168Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-03-14T06:07:34.3804475Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-03-14T06:07:34.3852401Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-03-14T06:07:34.3919036Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'org-21003710@github.com:' 2025-03-14T06:07:34.4255423Z Entering 'android/libs/fbjni' 2025-03-14T06:07:34.4304144Z Entering 'third_party/FP16' 2025-03-14T06:07:34.4354824Z Entering 'third_party/FXdiv' 2025-03-14T06:07:34.4403813Z Entering 'third_party/NNPACK' 2025-03-14T06:07:34.4454771Z Entering 'third_party/NVTX' 2025-03-14T06:07:34.4503691Z Entering 'third_party/VulkanMemoryAllocator' 2025-03-14T06:07:34.4553783Z Entering 'third_party/XNNPACK' 2025-03-14T06:07:34.4618766Z Entering 'third_party/benchmark' 2025-03-14T06:07:34.4668484Z Entering 'third_party/composable_kernel' 2025-03-14T06:07:34.4724117Z Entering 'third_party/cpp-httplib' 2025-03-14T06:07:34.4773357Z Entering 'third_party/cpuinfo' 2025-03-14T06:07:34.4822592Z Entering 'third_party/cudnn_frontend' 2025-03-14T06:07:34.4874237Z Entering 'third_party/cutlass' 2025-03-14T06:07:34.4933538Z Entering 'third_party/eigen' 2025-03-14T06:07:34.4984597Z Entering 'third_party/fbgemm' 2025-03-14T06:07:34.5035416Z Entering 'third_party/fbgemm/third_party/asmjit' 2025-03-14T06:07:34.5082214Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2025-03-14T06:07:34.5130988Z Entering 'third_party/fbgemm/third_party/cutlass' 2025-03-14T06:07:34.5185188Z Entering 'third_party/fbgemm/third_party/googletest' 2025-03-14T06:07:34.5233815Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2025-03-14T06:07:34.5282737Z Entering 'third_party/flash-attention' 2025-03-14T06:07:34.5333515Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-03-14T06:07:34.5388850Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-03-14T06:07:34.5448344Z Entering 'third_party/flatbuffers' 2025-03-14T06:07:34.5500631Z Entering 'third_party/fmt' 2025-03-14T06:07:34.5551097Z Entering 'third_party/gemmlowp/gemmlowp' 2025-03-14T06:07:34.5600280Z Entering 'third_party/gloo' 2025-03-14T06:07:34.5650469Z Entering 'third_party/googletest' 2025-03-14T06:07:34.5699386Z Entering 'third_party/ideep' 2025-03-14T06:07:34.5748113Z Entering 'third_party/ideep/mkl-dnn' 2025-03-14T06:07:34.5803956Z Entering 'third_party/ittapi' 2025-03-14T06:07:34.5854258Z Entering 'third_party/kineto' 2025-03-14T06:07:34.5903569Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-03-14T06:07:34.5953420Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-03-14T06:07:34.6003317Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-03-14T06:07:34.6053896Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-03-14T06:07:34.6102950Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-03-14T06:07:34.6152614Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-03-14T06:07:34.6202449Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-03-14T06:07:34.6252054Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-03-14T06:07:34.6300343Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-03-14T06:07:34.6351701Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-03-14T06:07:34.6401736Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-03-14T06:07:34.6450314Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-03-14T06:07:34.6499665Z Entering 'third_party/kleidiai' 2025-03-14T06:07:34.6549958Z Entering 'third_party/mimalloc' 2025-03-14T06:07:34.6599988Z Entering 'third_party/nlohmann' 2025-03-14T06:07:34.6649899Z Entering 'third_party/onnx' 2025-03-14T06:07:34.6715606Z Entering 'third_party/onnx/third_party/pybind11' 2025-03-14T06:07:34.6767063Z Entering 'third_party/opentelemetry-cpp' 2025-03-14T06:07:34.6817908Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-03-14T06:07:34.6867779Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-03-14T06:07:34.6914927Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-03-14T06:07:34.6963584Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-03-14T06:07:34.7012631Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-03-14T06:07:34.7061586Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-03-14T06:07:34.7108869Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-03-14T06:07:34.7156937Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-03-14T06:07:34.7206713Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-03-14T06:07:34.7257962Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-03-14T06:07:34.7329229Z Entering 'third_party/pocketfft' 2025-03-14T06:07:34.7377778Z Entering 'third_party/protobuf' 2025-03-14T06:07:34.7431366Z Entering 'third_party/protobuf/third_party/benchmark' 2025-03-14T06:07:34.7480270Z Entering 'third_party/protobuf/third_party/googletest' 2025-03-14T06:07:34.7530340Z Entering 'third_party/psimd' 2025-03-14T06:07:34.7579141Z Entering 'third_party/pthreadpool' 2025-03-14T06:07:34.7628168Z Entering 'third_party/pybind11' 2025-03-14T06:07:34.7677044Z Entering 'third_party/python-peachpy' 2025-03-14T06:07:34.7725457Z Entering 'third_party/sleef' 2025-03-14T06:07:34.7776073Z Entering 'third_party/tensorpipe' 2025-03-14T06:07:34.7825343Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-03-14T06:07:34.7873687Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-03-14T06:07:34.7920925Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-03-14T06:07:34.7969359Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-03-14T06:07:34.8016571Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-03-14T06:07:34.8079852Z ##[endgroup] 2025-03-14T06:07:34.8126871Z [command]/usr/bin/git log -1 --format=%H 2025-03-14T06:07:34.8152242Z aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:07:34.8360266Z Prepare all required actions 2025-03-14T06:07:34.8360972Z Getting action download info 2025-03-14T06:07:34.9378666Z Download action repository 'nick-fields/retry@v3.0.0' (SHA:7152eba30c6575329ac0576536151aca5a72780e) 2025-03-14T06:07:35.0954497Z ##[group]Run ./.github/actions/setup-linux 2025-03-14T06:07:35.0954962Z env: 2025-03-14T06:07:35.0955279Z PYTORCH_ROOT: /pytorch 2025-03-14T06:07:35.0955633Z PACKAGE_TYPE: manywheel 2025-03-14T06:07:35.0956001Z DESIRED_CUDA: cu126 2025-03-14T06:07:35.0956349Z GPU_ARCH_VERSION: 12.6 2025-03-14T06:07:35.0956722Z GPU_ARCH_TYPE: cuda 2025-03-14T06:07:35.0957163Z DOCKER_IMAGE: pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:07:35.0957644Z SKIP_ALL_TESTS: 1 2025-03-14T06:07:35.0957977Z LIBTORCH_CONFIG: 2025-03-14T06:07:35.0958307Z LIBTORCH_VARIANT: 2025-03-14T06:07:35.0958864Z DESIRED_DEVTOOLSET: cxx11-abi 2025-03-14T06:07:35.0959552Z DESIRED_PYTHON: 3.9 2025-03-14T06:07:35.0960491Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2025-03-14T06:07:35.0961089Z AWS_DEFAULT_REGION: us-east-1 2025-03-14T06:07:35.0961461Z BINARY_ENV_FILE: /tmp/env 2025-03-14T06:07:35.0961870Z BUILD_ENVIRONMENT: linux-binary-manywheel 2025-03-14T06:07:35.0962499Z GITHUB_TOKEN: *** 2025-03-14T06:07:35.0962840Z PR_NUMBER: 2025-03-14T06:07:35.0963187Z PYTORCH_FINAL_PACKAGE_DIR: /artifacts 2025-03-14T06:07:35.0963641Z SHA1: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:07:35.0964071Z USE_SPLIT_BUILD: false 2025-03-14T06:07:35.0964432Z ##[endgroup] 2025-03-14T06:07:35.1020286Z ##[group]Run set -euo pipefail 2025-03-14T06:07:35.1020750Z set -euo pipefail 2025-03-14T06:07:35.1021132Z function get_ec2_metadata() { 2025-03-14T06:07:35.1021629Z  # Pulled from instance metadata endpoint for EC2 2025-03-14T06:07:35.1022413Z  # see https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/instancedata-data-retrieval.html 2025-03-14T06:07:35.1023124Z  category=$1 2025-03-14T06:07:35.1023606Z  # If it is GCP runner (runner name contains gcp), do not run this 2025-03-14T06:07:35.1024170Z  runner_name_str=i-0aed66dea5c7934ab 2025-03-14T06:07:35.1024605Z  if [[ -f /.inarc ]]; then 2025-03-14T06:07:35.1025065Z  echo "ARC Runner, no info on ec2 metadata" 2025-03-14T06:07:35.1025768Z  elif [[ $runner_name_str == *"gcp"* ]]; then 2025-03-14T06:07:35.1026709Z  echo "Runner is from Google Cloud Platform, No info on ec2 metadata" 2025-03-14T06:07:35.1027271Z  else 2025-03-14T06:07:35.1028307Z  curl -H "X-aws-ec2-metadata-token: $(curl -s -X PUT "http://169.254.169.254/latest/api/token" -H "X-aws-ec2-metadata-token-ttl-seconds: 30")" -fsSL "http://169.254.169.254/latest/meta-data/${category}" 2025-03-14T06:07:35.1029396Z  fi 2025-03-14T06:07:35.1029688Z } 2025-03-14T06:07:35.1030054Z echo "ami-id: $(get_ec2_metadata ami-id)" 2025-03-14T06:07:35.1030615Z echo "instance-id: $(get_ec2_metadata instance-id)" 2025-03-14T06:07:35.1031229Z echo "instance-type: $(get_ec2_metadata instance-type)" 2025-03-14T06:07:35.1031768Z echo "system info $(uname -a)" 2025-03-14T06:07:35.1038729Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T06:07:35.1039238Z env: 2025-03-14T06:07:35.1039550Z PYTORCH_ROOT: /pytorch 2025-03-14T06:07:35.1039919Z PACKAGE_TYPE: manywheel 2025-03-14T06:07:35.1040283Z DESIRED_CUDA: cu126 2025-03-14T06:07:35.1040714Z GPU_ARCH_VERSION: 12.6 2025-03-14T06:07:35.1041336Z GPU_ARCH_TYPE: cuda 2025-03-14T06:07:35.1041923Z DOCKER_IMAGE: pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:07:35.1042510Z SKIP_ALL_TESTS: 1 2025-03-14T06:07:35.1042945Z LIBTORCH_CONFIG: 2025-03-14T06:07:35.1043396Z LIBTORCH_VARIANT: 2025-03-14T06:07:35.1043847Z DESIRED_DEVTOOLSET: cxx11-abi 2025-03-14T06:07:35.1044405Z DESIRED_PYTHON: 3.9 2025-03-14T06:07:35.1045201Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2025-03-14T06:07:35.1045881Z AWS_DEFAULT_REGION: us-east-1 2025-03-14T06:07:35.1046441Z BINARY_ENV_FILE: /tmp/env 2025-03-14T06:07:35.1067937Z BUILD_ENVIRONMENT: linux-binary-manywheel 2025-03-14T06:07:35.1068661Z GITHUB_TOKEN: *** 2025-03-14T06:07:35.1069023Z PR_NUMBER: 2025-03-14T06:07:35.1069369Z PYTORCH_FINAL_PACKAGE_DIR: /artifacts 2025-03-14T06:07:35.1069837Z SHA1: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:07:35.1070288Z USE_SPLIT_BUILD: false 2025-03-14T06:07:35.1070624Z ##[endgroup] 2025-03-14T06:07:35.1234300Z ami-id: ami-05b10e08d247fb927 2025-03-14T06:07:35.1352409Z instance-id: i-0aed66dea5c7934ab 2025-03-14T06:07:35.1466795Z instance-type: g3.4xlarge 2025-03-14T06:07:35.1479493Z system info Linux ip-10-0-9-173.ec2.internal 6.1.128-136.201.amzn2023.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Feb 10 16:18:01 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux 2025-03-14T06:07:35.1528313Z ##[group]Run echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2025-03-14T06:07:35.1529437Z echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2025-03-14T06:07:35.1536597Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T06:07:35.1537092Z env: 2025-03-14T06:07:35.1537399Z PYTORCH_ROOT: /pytorch 2025-03-14T06:07:35.1537757Z PACKAGE_TYPE: manywheel 2025-03-14T06:07:35.1538117Z DESIRED_CUDA: cu126 2025-03-14T06:07:35.1538459Z GPU_ARCH_VERSION: 12.6 2025-03-14T06:07:35.1538812Z GPU_ARCH_TYPE: cuda 2025-03-14T06:07:35.1539252Z DOCKER_IMAGE: pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:07:35.1539722Z SKIP_ALL_TESTS: 1 2025-03-14T06:07:35.1540047Z LIBTORCH_CONFIG: 2025-03-14T06:07:35.1540377Z LIBTORCH_VARIANT: 2025-03-14T06:07:35.1540728Z DESIRED_DEVTOOLSET: cxx11-abi 2025-03-14T06:07:35.1541109Z DESIRED_PYTHON: 3.9 2025-03-14T06:07:35.1541602Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2025-03-14T06:07:35.1542178Z AWS_DEFAULT_REGION: us-east-1 2025-03-14T06:07:35.1542566Z BINARY_ENV_FILE: /tmp/env 2025-03-14T06:07:35.1542974Z BUILD_ENVIRONMENT: linux-binary-manywheel 2025-03-14T06:07:35.1543850Z GITHUB_TOKEN: *** 2025-03-14T06:07:35.1544184Z PR_NUMBER: 2025-03-14T06:07:35.1544507Z PYTORCH_FINAL_PACKAGE_DIR: /artifacts 2025-03-14T06:07:35.1544966Z SHA1: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:07:35.1545409Z USE_SPLIT_BUILD: false 2025-03-14T06:07:35.1545760Z ##[endgroup] 2025-03-14T06:07:35.1612715Z ##[group]Run if systemctl is-active --quiet docker; then 2025-03-14T06:07:35.1613286Z if systemctl is-active --quiet docker; then 2025-03-14T06:07:35.1613793Z  echo "Docker daemon is running..."; 2025-03-14T06:07:35.1614210Z else 2025-03-14T06:07:35.1614681Z  echo "Starting docker deamon..." && sudo systemctl start docker; 2025-03-14T06:07:35.1615237Z fi 2025-03-14T06:07:35.1621613Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T06:07:35.1622115Z env: 2025-03-14T06:07:35.1622426Z PYTORCH_ROOT: /pytorch 2025-03-14T06:07:35.1622802Z PACKAGE_TYPE: manywheel 2025-03-14T06:07:35.1623169Z DESIRED_CUDA: cu126 2025-03-14T06:07:35.1623515Z GPU_ARCH_VERSION: 12.6 2025-03-14T06:07:35.1623878Z GPU_ARCH_TYPE: cuda 2025-03-14T06:07:35.1624319Z DOCKER_IMAGE: pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:07:35.1624814Z SKIP_ALL_TESTS: 1 2025-03-14T06:07:35.1625148Z LIBTORCH_CONFIG: 2025-03-14T06:07:35.1625490Z LIBTORCH_VARIANT: 2025-03-14T06:07:35.1625855Z DESIRED_DEVTOOLSET: cxx11-abi 2025-03-14T06:07:35.1626652Z DESIRED_PYTHON: 3.9 2025-03-14T06:07:35.1627206Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2025-03-14T06:07:35.1627785Z AWS_DEFAULT_REGION: us-east-1 2025-03-14T06:07:35.1628178Z BINARY_ENV_FILE: /tmp/env 2025-03-14T06:07:35.1628796Z BUILD_ENVIRONMENT: linux-binary-manywheel 2025-03-14T06:07:35.1629489Z GITHUB_TOKEN: *** 2025-03-14T06:07:35.1629825Z PR_NUMBER: 2025-03-14T06:07:35.1630152Z PYTORCH_FINAL_PACKAGE_DIR: /artifacts 2025-03-14T06:07:35.1630616Z SHA1: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:07:35.1631074Z USE_SPLIT_BUILD: false 2025-03-14T06:07:35.1631436Z ##[endgroup] 2025-03-14T06:07:35.1712026Z Docker daemon is running... 2025-03-14T06:07:35.1777234Z ##[group]Run nick-fields/retry@v3.0.0 2025-03-14T06:07:35.1777638Z with: 2025-03-14T06:07:35.1777939Z shell: bash 2025-03-14T06:07:35.1778258Z timeout_minutes: 5 2025-03-14T06:07:35.1778653Z max_attempts: 3 2025-03-14T06:07:35.1778988Z retry_wait_seconds: 30 2025-03-14T06:07:35.1781674Z command: AWS_ACCOUNT_ID=$(aws sts get-caller-identity|grep Account|cut -f4 -d\") aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \ --password-stdin "$AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com" # For LF Runners we need to make sure we also login to Meta's ECR docker registry too. META_AWS_ACCOUNT_ID=308535385114 if [ "$AWS_ACCOUNT_ID" != "$META_AWS_ACCOUNT_ID" ] ; then aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \ --password-stdin "$META_AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com" fi 2025-03-14T06:07:35.1784354Z polling_interval_seconds: 1 2025-03-14T06:07:35.1784753Z warning_on_retry: true 2025-03-14T06:07:35.1785117Z continue_on_error: false 2025-03-14T06:07:35.1785471Z env: 2025-03-14T06:07:35.1785776Z PYTORCH_ROOT: /pytorch 2025-03-14T06:07:35.1786128Z PACKAGE_TYPE: manywheel 2025-03-14T06:07:35.1786492Z DESIRED_CUDA: cu126 2025-03-14T06:07:35.1786833Z GPU_ARCH_VERSION: 12.6 2025-03-14T06:07:35.1787190Z GPU_ARCH_TYPE: cuda 2025-03-14T06:07:35.1787633Z DOCKER_IMAGE: pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:07:35.1788114Z SKIP_ALL_TESTS: 1 2025-03-14T06:07:35.1788444Z LIBTORCH_CONFIG: 2025-03-14T06:07:35.1788783Z LIBTORCH_VARIANT: 2025-03-14T06:07:35.1789143Z DESIRED_DEVTOOLSET: cxx11-abi 2025-03-14T06:07:35.1789528Z DESIRED_PYTHON: 3.9 2025-03-14T06:07:35.1790009Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2025-03-14T06:07:35.1790579Z AWS_DEFAULT_REGION: us-east-1 2025-03-14T06:07:35.1791147Z BINARY_ENV_FILE: /tmp/env 2025-03-14T06:07:35.1791554Z BUILD_ENVIRONMENT: linux-binary-manywheel 2025-03-14T06:07:35.1792161Z GITHUB_TOKEN: *** 2025-03-14T06:07:35.1792493Z PR_NUMBER: 2025-03-14T06:07:35.1792816Z PYTORCH_FINAL_PACKAGE_DIR: /artifacts 2025-03-14T06:07:35.1793281Z SHA1: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:07:35.1793725Z USE_SPLIT_BUILD: false 2025-03-14T06:07:35.1794090Z AWS_RETRY_MODE: standard 2025-03-14T06:07:35.1794455Z AWS_MAX_ATTEMPTS: 5 2025-03-14T06:07:35.1794777Z ##[endgroup] 2025-03-14T06:07:36.6103415Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2025-03-14T06:07:36.6104239Z Configure a credential helper to remove this warning. See 2025-03-14T06:07:36.6104963Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2025-03-14T06:07:36.6105667Z 2025-03-14T06:07:36.6105828Z Login Succeeded 2025-03-14T06:07:37.2730828Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2025-03-14T06:07:37.2731644Z Configure a credential helper to remove this warning. See 2025-03-14T06:07:37.2732405Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2025-03-14T06:07:37.2733059Z 2025-03-14T06:07:37.2733221Z Login Succeeded 2025-03-14T06:07:37.3114223Z Command completed after 1 attempt(s). 2025-03-14T06:07:37.3182067Z ##[group]Run env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2025-03-14T06:07:37.3182743Z env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2025-03-14T06:07:37.3183336Z env | grep '^CI' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2025-03-14T06:07:37.3191371Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T06:07:37.3191893Z env: 2025-03-14T06:07:37.3192203Z PYTORCH_ROOT: /pytorch 2025-03-14T06:07:37.3192580Z PACKAGE_TYPE: manywheel 2025-03-14T06:07:37.3192945Z DESIRED_CUDA: cu126 2025-03-14T06:07:37.3193290Z GPU_ARCH_VERSION: 12.6 2025-03-14T06:07:37.3193645Z GPU_ARCH_TYPE: cuda 2025-03-14T06:07:37.3194083Z DOCKER_IMAGE: pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:07:37.3194575Z SKIP_ALL_TESTS: 1 2025-03-14T06:07:37.3194905Z LIBTORCH_CONFIG: 2025-03-14T06:07:37.3195231Z LIBTORCH_VARIANT: 2025-03-14T06:07:37.3195575Z DESIRED_DEVTOOLSET: cxx11-abi 2025-03-14T06:07:37.3195965Z DESIRED_PYTHON: 3.9 2025-03-14T06:07:37.3196464Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2025-03-14T06:07:37.3197039Z AWS_DEFAULT_REGION: us-east-1 2025-03-14T06:07:37.3197427Z BINARY_ENV_FILE: /tmp/env 2025-03-14T06:07:37.3197823Z BUILD_ENVIRONMENT: linux-binary-manywheel 2025-03-14T06:07:37.3198491Z GITHUB_TOKEN: *** 2025-03-14T06:07:37.3198831Z PR_NUMBER: 2025-03-14T06:07:37.3199176Z PYTORCH_FINAL_PACKAGE_DIR: /artifacts 2025-03-14T06:07:37.3199641Z SHA1: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:07:37.3200089Z USE_SPLIT_BUILD: false 2025-03-14T06:07:37.3200432Z ##[endgroup] 2025-03-14T06:07:37.3313695Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2025-03-14T06:07:37.3315175Z # ignore expansion of "docker ps -q" since it could be empty 2025-03-14T06:07:37.3316321Z # shellcheck disable=SC2046 2025-03-14T06:07:37.3317235Z docker stop $(docker ps -q) || true 2025-03-14T06:07:37.3318190Z # Prune all of the docker images 2025-03-14T06:07:37.3319043Z docker system prune -af 2025-03-14T06:07:37.3329970Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T06:07:37.3330475Z env: 2025-03-14T06:07:37.3330796Z PYTORCH_ROOT: /pytorch 2025-03-14T06:07:37.3331178Z PACKAGE_TYPE: manywheel 2025-03-14T06:07:37.3331554Z DESIRED_CUDA: cu126 2025-03-14T06:07:37.3331904Z GPU_ARCH_VERSION: 12.6 2025-03-14T06:07:37.3332264Z GPU_ARCH_TYPE: cuda 2025-03-14T06:07:37.3332704Z DOCKER_IMAGE: pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:07:37.3333182Z SKIP_ALL_TESTS: 1 2025-03-14T06:07:37.3333717Z LIBTORCH_CONFIG: 2025-03-14T06:07:37.3334049Z LIBTORCH_VARIANT: 2025-03-14T06:07:37.3334405Z DESIRED_DEVTOOLSET: cxx11-abi 2025-03-14T06:07:37.3334792Z DESIRED_PYTHON: 3.9 2025-03-14T06:07:37.3335271Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2025-03-14T06:07:37.3335845Z AWS_DEFAULT_REGION: us-east-1 2025-03-14T06:07:37.3336234Z BINARY_ENV_FILE: /tmp/env 2025-03-14T06:07:37.3336643Z BUILD_ENVIRONMENT: linux-binary-manywheel 2025-03-14T06:07:37.3337272Z GITHUB_TOKEN: *** 2025-03-14T06:07:37.3337607Z PR_NUMBER: 2025-03-14T06:07:37.3337930Z PYTORCH_FINAL_PACKAGE_DIR: /artifacts 2025-03-14T06:07:37.3338399Z SHA1: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:07:37.3338847Z USE_SPLIT_BUILD: false 2025-03-14T06:07:37.3339199Z ##[endgroup] 2025-03-14T06:07:37.3639997Z "docker stop" requires at least 1 argument. 2025-03-14T06:07:37.3640515Z See 'docker stop --help'. 2025-03-14T06:07:37.3640768Z 2025-03-14T06:07:37.3640991Z Usage: docker stop [OPTIONS] CONTAINER [CONTAINER...] 2025-03-14T06:07:37.3641375Z 2025-03-14T06:07:37.3641545Z Stop one or more running containers 2025-03-14T06:07:37.3814591Z Total reclaimed space: 0B 2025-03-14T06:07:37.3857599Z ##[group]Run set +e 2025-03-14T06:07:37.3858001Z set +e 2025-03-14T06:07:37.3858308Z set -x 2025-03-14T06:07:37.3858627Z  2025-03-14T06:07:37.3858971Z PT_DOMAIN=download.pytorch.org 2025-03-14T06:07:37.3859705Z # TODO: Flaky access to download.pytorch.org https://github.com/pytorch/pytorch/issues/100400, 2025-03-14T06:07:37.3860818Z # cleaning this up once the issue is fixed. There are more than one resolved IP here, the last 2025-03-14T06:07:37.3861510Z # one is returned at random 2025-03-14T06:07:37.3862015Z RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" | tail -n1) 2025-03-14T06:07:37.3862508Z  2025-03-14T06:07:37.3862838Z if [ -z "${RESOLVED_IP}" ]; then 2025-03-14T06:07:37.3863407Z  echo "Couldn't resolve ${PT_DOMAIN}, retrying with Google DNS..." 2025-03-14T06:07:37.3864080Z  RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" @8.8.8.8 | tail -n1) 2025-03-14T06:07:37.3864588Z  2025-03-14T06:07:37.3864905Z  if [ -z "${RESOLVED_IP}" ]; then 2025-03-14T06:07:37.3865416Z  echo "Couldn't resolve ${PT_DOMAIN}, exiting..." 2025-03-14T06:07:37.3865890Z  exit 1 2025-03-14T06:07:37.3866219Z  fi 2025-03-14T06:07:37.3866524Z fi 2025-03-14T06:07:37.3866803Z  2025-03-14T06:07:37.3867161Z if grep -r "${PT_DOMAIN}" /etc/hosts; then 2025-03-14T06:07:37.3867649Z  # Clean up any old records first 2025-03-14T06:07:37.3868126Z  sudo sed -i "/${PT_DOMAIN}/d" /etc/hosts 2025-03-14T06:07:37.3868558Z fi 2025-03-14T06:07:37.3868837Z  2025-03-14T06:07:37.3869259Z echo "${RESOLVED_IP} ${PT_DOMAIN}" | sudo tee -a /etc/hosts 2025-03-14T06:07:37.3869783Z cat /etc/hosts 2025-03-14T06:07:37.3876345Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T06:07:37.3876844Z env: 2025-03-14T06:07:37.3877148Z PYTORCH_ROOT: /pytorch 2025-03-14T06:07:37.3877518Z PACKAGE_TYPE: manywheel 2025-03-14T06:07:37.3877880Z DESIRED_CUDA: cu126 2025-03-14T06:07:37.3878208Z GPU_ARCH_VERSION: 12.6 2025-03-14T06:07:37.3878566Z GPU_ARCH_TYPE: cuda 2025-03-14T06:07:37.3879004Z DOCKER_IMAGE: pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:07:37.3879499Z SKIP_ALL_TESTS: 1 2025-03-14T06:07:37.3879832Z LIBTORCH_CONFIG: 2025-03-14T06:07:37.3880146Z LIBTORCH_VARIANT: 2025-03-14T06:07:37.3880515Z DESIRED_DEVTOOLSET: cxx11-abi 2025-03-14T06:07:37.3880911Z DESIRED_PYTHON: 3.9 2025-03-14T06:07:37.3881419Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2025-03-14T06:07:37.3881993Z AWS_DEFAULT_REGION: us-east-1 2025-03-14T06:07:37.3882366Z BINARY_ENV_FILE: /tmp/env 2025-03-14T06:07:37.3882960Z BUILD_ENVIRONMENT: linux-binary-manywheel 2025-03-14T06:07:37.3883595Z GITHUB_TOKEN: *** 2025-03-14T06:07:37.3883933Z PR_NUMBER: 2025-03-14T06:07:37.3884274Z PYTORCH_FINAL_PACKAGE_DIR: /artifacts 2025-03-14T06:07:37.3884736Z SHA1: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:07:37.3885169Z USE_SPLIT_BUILD: false 2025-03-14T06:07:37.3885524Z ##[endgroup] 2025-03-14T06:07:37.3914449Z + PT_DOMAIN=download.pytorch.org 2025-03-14T06:07:37.3920283Z ++ dig -4 +short download.pytorch.org 2025-03-14T06:07:37.3921265Z ++ tail -n1 2025-03-14T06:07:37.4048101Z + RESOLVED_IP=18.160.10.28 2025-03-14T06:07:37.4048500Z + '[' -z 18.160.10.28 ']' 2025-03-14T06:07:37.4048898Z + grep -r download.pytorch.org /etc/hosts 2025-03-14T06:07:37.4061182Z 18.160.10.28 download.pytorch.org 2025-03-14T06:07:37.4063099Z + sudo sed -i /download.pytorch.org/d /etc/hosts 2025-03-14T06:07:37.5631318Z + echo '18.160.10.28 download.pytorch.org' 2025-03-14T06:07:37.5632325Z + sudo tee -a /etc/hosts 2025-03-14T06:07:37.7194167Z 18.160.10.28 download.pytorch.org 2025-03-14T06:07:37.7213513Z + cat /etc/hosts 2025-03-14T06:07:37.7223670Z 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 2025-03-14T06:07:37.7230950Z ::1 localhost6 localhost6.localdomain6 2025-03-14T06:07:37.7231454Z 18.160.10.28 download.pytorch.org 2025-03-14T06:07:37.7272919Z Prepare all required actions 2025-03-14T06:07:37.7301960Z ##[group]Run ./.github/actions/chown-workspace 2025-03-14T06:07:37.7302395Z with: 2025-03-14T06:07:37.7302834Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2025-03-14T06:07:37.7303372Z env: 2025-03-14T06:07:37.7303675Z PYTORCH_ROOT: /pytorch 2025-03-14T06:07:37.7304041Z PACKAGE_TYPE: manywheel 2025-03-14T06:07:37.7304399Z DESIRED_CUDA: cu126 2025-03-14T06:07:37.7304729Z GPU_ARCH_VERSION: 12.6 2025-03-14T06:07:37.7305083Z GPU_ARCH_TYPE: cuda 2025-03-14T06:07:37.7305516Z DOCKER_IMAGE: pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:07:37.7306002Z SKIP_ALL_TESTS: 1 2025-03-14T06:07:37.7306342Z LIBTORCH_CONFIG: 2025-03-14T06:07:37.7306648Z LIBTORCH_VARIANT: 2025-03-14T06:07:37.7307001Z DESIRED_DEVTOOLSET: cxx11-abi 2025-03-14T06:07:37.7307377Z DESIRED_PYTHON: 3.9 2025-03-14T06:07:37.7307865Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2025-03-14T06:07:37.7308474Z AWS_DEFAULT_REGION: us-east-1 2025-03-14T06:07:37.7308864Z BINARY_ENV_FILE: /tmp/env 2025-03-14T06:07:37.7309265Z BUILD_ENVIRONMENT: linux-binary-manywheel 2025-03-14T06:07:37.7309908Z GITHUB_TOKEN: *** 2025-03-14T06:07:37.7310241Z PR_NUMBER: 2025-03-14T06:07:37.7310576Z PYTORCH_FINAL_PACKAGE_DIR: /artifacts 2025-03-14T06:07:37.7311012Z SHA1: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:07:37.7311451Z USE_SPLIT_BUILD: false 2025-03-14T06:07:37.7311799Z ##[endgroup] 2025-03-14T06:07:37.7336479Z ##[group]Run docker run --rm -v "$(pwd)":/v -w /v "${ALPINE_IMAGE}" chown -R "$(id -u):$(id -g)" . 2025-03-14T06:07:37.7337287Z docker run --rm -v "$(pwd)":/v -w /v "${ALPINE_IMAGE}" chown -R "$(id -u):$(id -g)" . 2025-03-14T06:07:37.7344854Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T06:07:37.7345348Z env: 2025-03-14T06:07:37.7345638Z PYTORCH_ROOT: /pytorch 2025-03-14T06:07:37.7346008Z PACKAGE_TYPE: manywheel 2025-03-14T06:07:37.7346378Z DESIRED_CUDA: cu126 2025-03-14T06:07:37.7346726Z GPU_ARCH_VERSION: 12.6 2025-03-14T06:07:37.7347065Z GPU_ARCH_TYPE: cuda 2025-03-14T06:07:37.7347500Z DOCKER_IMAGE: pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:07:37.7347997Z SKIP_ALL_TESTS: 1 2025-03-14T06:07:37.7348323Z LIBTORCH_CONFIG: 2025-03-14T06:07:37.7348654Z LIBTORCH_VARIANT: 2025-03-14T06:07:37.7348994Z DESIRED_DEVTOOLSET: cxx11-abi 2025-03-14T06:07:37.7349376Z DESIRED_PYTHON: 3.9 2025-03-14T06:07:37.7349873Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2025-03-14T06:07:37.7350445Z AWS_DEFAULT_REGION: us-east-1 2025-03-14T06:07:37.7350836Z BINARY_ENV_FILE: /tmp/env 2025-03-14T06:07:37.7351431Z BUILD_ENVIRONMENT: linux-binary-manywheel 2025-03-14T06:07:37.7352044Z GITHUB_TOKEN: *** 2025-03-14T06:07:37.7352383Z PR_NUMBER: 2025-03-14T06:07:37.7352719Z PYTORCH_FINAL_PACKAGE_DIR: /artifacts 2025-03-14T06:07:37.7353175Z SHA1: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:07:37.7353621Z USE_SPLIT_BUILD: false 2025-03-14T06:07:37.7353957Z ##[endgroup] 2025-03-14T06:07:37.7566112Z Unable to find image '308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine:latest' locally 2025-03-14T06:07:37.9750528Z latest: Pulling from tool/alpine 2025-03-14T06:07:37.9751225Z 540db60ca938: Pulling fs layer 2025-03-14T06:07:38.0922133Z 540db60ca938: Verifying Checksum 2025-03-14T06:07:38.0922582Z 540db60ca938: Download complete 2025-03-14T06:07:38.2100778Z 540db60ca938: Pull complete 2025-03-14T06:07:38.2195588Z Digest: sha256:def822f9851ca422481ec6fee59a9966f12b351c62ccb9aca841526ffaa9f748 2025-03-14T06:07:38.2233339Z Status: Downloaded newer image for 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine:latest 2025-03-14T06:07:51.3245426Z ##[group]Run rm -rf "${GITHUB_WORKSPACE}" 2025-03-14T06:07:51.3246137Z rm -rf "${GITHUB_WORKSPACE}" 2025-03-14T06:07:51.3246576Z mkdir "${GITHUB_WORKSPACE}" 2025-03-14T06:07:51.3256470Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T06:07:51.3256973Z env: 2025-03-14T06:07:51.3257285Z PYTORCH_ROOT: /pytorch 2025-03-14T06:07:51.3257657Z PACKAGE_TYPE: manywheel 2025-03-14T06:07:51.3258010Z DESIRED_CUDA: cu126 2025-03-14T06:07:51.3258362Z GPU_ARCH_VERSION: 12.6 2025-03-14T06:07:51.3258718Z GPU_ARCH_TYPE: cuda 2025-03-14T06:07:51.3259153Z DOCKER_IMAGE: pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:07:51.3259648Z SKIP_ALL_TESTS: 1 2025-03-14T06:07:51.3259960Z LIBTORCH_CONFIG: 2025-03-14T06:07:51.3260285Z LIBTORCH_VARIANT: 2025-03-14T06:07:51.3260642Z DESIRED_DEVTOOLSET: cxx11-abi 2025-03-14T06:07:51.3261036Z DESIRED_PYTHON: 3.9 2025-03-14T06:07:51.3261612Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2025-03-14T06:07:51.3262194Z AWS_DEFAULT_REGION: us-east-1 2025-03-14T06:07:51.3262584Z BINARY_ENV_FILE: /tmp/env 2025-03-14T06:07:51.3262975Z BUILD_ENVIRONMENT: linux-binary-manywheel 2025-03-14T06:07:51.3263646Z GITHUB_TOKEN: *** 2025-03-14T06:07:51.3263986Z PR_NUMBER: 2025-03-14T06:07:51.3264326Z PYTORCH_FINAL_PACKAGE_DIR: /artifacts 2025-03-14T06:07:51.3264785Z SHA1: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:07:51.3265211Z USE_SPLIT_BUILD: false 2025-03-14T06:07:51.3265567Z ##[endgroup] 2025-03-14T06:07:54.4725668Z ##[group]Run actions/checkout@v4 2025-03-14T06:07:54.4726119Z with: 2025-03-14T06:07:54.4727026Z ref: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:07:54.4727489Z submodules: recursive 2025-03-14T06:07:54.4727853Z show-progress: false 2025-03-14T06:07:54.4728204Z path: pytorch 2025-03-14T06:07:54.4728530Z repository: pytorch/pytorch 2025-03-14T06:07:54.4729077Z token: *** 2025-03-14T06:07:54.4729400Z ssh-strict: true 2025-03-14T06:07:54.4729725Z ssh-user: git 2025-03-14T06:07:54.4730066Z persist-credentials: true 2025-03-14T06:07:54.4730433Z clean: true 2025-03-14T06:07:54.4730758Z sparse-checkout-cone-mode: true 2025-03-14T06:07:54.4731161Z fetch-depth: 1 2025-03-14T06:07:54.4731487Z fetch-tags: false 2025-03-14T06:07:54.4731812Z lfs: false 2025-03-14T06:07:54.4732116Z set-safe-directory: true 2025-03-14T06:07:54.4732475Z env: 2025-03-14T06:07:54.4732779Z PYTORCH_ROOT: /pytorch 2025-03-14T06:07:54.4733139Z PACKAGE_TYPE: manywheel 2025-03-14T06:07:54.4733540Z DESIRED_CUDA: cu126 2025-03-14T06:07:54.4733885Z GPU_ARCH_VERSION: 12.6 2025-03-14T06:07:54.4734234Z GPU_ARCH_TYPE: cuda 2025-03-14T06:07:54.4734660Z DOCKER_IMAGE: pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:07:54.4735142Z SKIP_ALL_TESTS: 1 2025-03-14T06:07:54.4735449Z LIBTORCH_CONFIG: 2025-03-14T06:07:54.4735773Z LIBTORCH_VARIANT: 2025-03-14T06:07:54.4736380Z DESIRED_DEVTOOLSET: cxx11-abi 2025-03-14T06:07:54.4736762Z DESIRED_PYTHON: 3.9 2025-03-14T06:07:54.4737253Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2025-03-14T06:07:54.4737803Z AWS_DEFAULT_REGION: us-east-1 2025-03-14T06:07:54.4738187Z BINARY_ENV_FILE: /tmp/env 2025-03-14T06:07:54.4738589Z BUILD_ENVIRONMENT: linux-binary-manywheel 2025-03-14T06:07:54.4739170Z GITHUB_TOKEN: *** 2025-03-14T06:07:54.4739494Z PR_NUMBER: 2025-03-14T06:07:54.4739828Z PYTORCH_FINAL_PACKAGE_DIR: /artifacts 2025-03-14T06:07:54.4740272Z SHA1: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:07:54.4740708Z USE_SPLIT_BUILD: false 2025-03-14T06:07:54.4741054Z ##[endgroup] 2025-03-14T06:07:54.6062385Z Syncing repository: pytorch/pytorch 2025-03-14T06:07:54.6072205Z ##[group]Getting Git version info 2025-03-14T06:07:54.6073512Z Working directory is '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch' 2025-03-14T06:07:54.6118381Z [command]/usr/bin/git version 2025-03-14T06:07:54.6166659Z git version 2.47.1 2025-03-14T06:07:54.6205931Z ##[endgroup] 2025-03-14T06:07:54.6218712Z Copying '/home/ec2-user/.gitconfig' to '/home/ec2-user/actions-runner/_work/_temp/d7ca7e48-f0a6-4328-9df2-653f0b968191/.gitconfig' 2025-03-14T06:07:54.6233643Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/d7ca7e48-f0a6-4328-9df2-653f0b968191' before making global git config changes 2025-03-14T06:07:54.6234809Z Adding repository directory to the temporary git global config as a safe directory 2025-03-14T06:07:54.6241008Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch 2025-03-14T06:07:54.6278952Z ##[group]Initializing the repository 2025-03-14T06:07:54.6283911Z [command]/usr/bin/git init /home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch 2025-03-14T06:07:54.6321626Z hint: Using 'master' as the name for the initial branch. This default branch name 2025-03-14T06:07:54.6322818Z hint: is subject to change. To configure the initial branch name to use in all 2025-03-14T06:07:54.6323546Z hint: of your new repositories, which will suppress this warning, call: 2025-03-14T06:07:54.6324078Z hint: 2025-03-14T06:07:54.6324463Z hint: git config --global init.defaultBranch 2025-03-14T06:07:54.6324929Z hint: 2025-03-14T06:07:54.6325662Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2025-03-14T06:07:54.6327282Z hint: 'development'. The just-created branch can be renamed via this command: 2025-03-14T06:07:54.6327845Z hint: 2025-03-14T06:07:54.6328144Z hint: git branch -m 2025-03-14T06:07:54.6329075Z Initialized empty Git repository in /home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/ 2025-03-14T06:07:54.6337377Z [command]/usr/bin/git remote add origin https://github.com/pytorch/pytorch 2025-03-14T06:07:54.6367474Z ##[endgroup] 2025-03-14T06:07:54.6368059Z ##[group]Disabling automatic garbage collection 2025-03-14T06:07:54.6372664Z [command]/usr/bin/git config --local gc.auto 0 2025-03-14T06:07:54.6403208Z ##[endgroup] 2025-03-14T06:07:54.6403751Z ##[group]Setting up auth 2025-03-14T06:07:54.6411834Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2025-03-14T06:07:54.6445239Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2025-03-14T06:07:54.6767813Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2025-03-14T06:07:54.6798771Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2025-03-14T06:07:54.7117727Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic *** 2025-03-14T06:07:54.7167283Z ##[endgroup] 2025-03-14T06:07:54.7168371Z ##[group]Fetching the repository 2025-03-14T06:07:54.7180407Z [command]/usr/bin/git -c protocol.version=2 fetch --no-tags --prune --no-recurse-submodules --depth=1 origin aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:07:58.2223700Z From https://github.com/pytorch/pytorch 2025-03-14T06:07:58.2224847Z * branch aed0b7a742a2d7b7901790622829cbd2135049a4 -> FETCH_HEAD 2025-03-14T06:07:58.2249025Z ##[endgroup] 2025-03-14T06:07:58.2250094Z ##[group]Determining the checkout info 2025-03-14T06:07:58.2254521Z ##[endgroup] 2025-03-14T06:07:58.2261282Z [command]/usr/bin/git sparse-checkout disable 2025-03-14T06:07:58.2301282Z [command]/usr/bin/git config --local --unset-all extensions.worktreeConfig 2025-03-14T06:07:58.2332445Z ##[group]Checking out the ref 2025-03-14T06:07:58.2338357Z [command]/usr/bin/git checkout --progress --force aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:07:59.2548494Z Updating files: 77% (12916/16577) 2025-03-14T06:07:59.2795038Z Updating files: 78% (12931/16577) 2025-03-14T06:07:59.3017628Z Updating files: 79% (13096/16577) 2025-03-14T06:07:59.3252791Z Updating files: 80% (13262/16577) 2025-03-14T06:07:59.3380822Z Updating files: 81% (13428/16577) 2025-03-14T06:07:59.3515539Z Updating files: 82% (13594/16577) 2025-03-14T06:07:59.3651758Z Updating files: 83% (13759/16577) 2025-03-14T06:07:59.3815278Z Updating files: 84% (13925/16577) 2025-03-14T06:07:59.3940089Z Updating files: 85% (14091/16577) 2025-03-14T06:07:59.4082109Z Updating files: 86% (14257/16577) 2025-03-14T06:07:59.4196265Z Updating files: 87% (14422/16577) 2025-03-14T06:07:59.4349516Z Updating files: 88% (14588/16577) 2025-03-14T06:07:59.4539278Z Updating files: 89% (14754/16577) 2025-03-14T06:07:59.4660518Z Updating files: 90% (14920/16577) 2025-03-14T06:07:59.4789340Z Updating files: 91% (15086/16577) 2025-03-14T06:07:59.4948105Z Updating files: 92% (15251/16577) 2025-03-14T06:07:59.5131691Z Updating files: 93% (15417/16577) 2025-03-14T06:07:59.5324798Z Updating files: 94% (15583/16577) 2025-03-14T06:07:59.5493875Z Updating files: 95% (15749/16577) 2025-03-14T06:07:59.5637104Z Updating files: 96% (15914/16577) 2025-03-14T06:07:59.5925237Z Updating files: 97% (16080/16577) 2025-03-14T06:07:59.6089149Z Updating files: 98% (16246/16577) 2025-03-14T06:07:59.6250923Z Updating files: 99% (16412/16577) 2025-03-14T06:07:59.6251352Z Updating files: 100% (16577/16577) 2025-03-14T06:07:59.6251765Z Updating files: 100% (16577/16577), done. 2025-03-14T06:07:59.6486227Z Note: switching to 'aed0b7a742a2d7b7901790622829cbd2135049a4'. 2025-03-14T06:07:59.6486658Z 2025-03-14T06:07:59.6487256Z You are in 'detached HEAD' state. You can look around, make experimental 2025-03-14T06:07:59.6487988Z changes and commit them, and you can discard any commits you make in this 2025-03-14T06:07:59.6488687Z state without impacting any branches by switching back to a branch. 2025-03-14T06:07:59.6489088Z 2025-03-14T06:07:59.6489379Z If you want to create a new branch to retain commits you create, you may 2025-03-14T06:07:59.6490038Z do so (now or later) by using -c with the switch command. Example: 2025-03-14T06:07:59.6490403Z 2025-03-14T06:07:59.6490573Z git switch -c 2025-03-14T06:07:59.6490857Z 2025-03-14T06:07:59.6491019Z Or undo this operation with: 2025-03-14T06:07:59.6491280Z 2025-03-14T06:07:59.6491419Z git switch - 2025-03-14T06:07:59.6491626Z 2025-03-14T06:07:59.6491940Z Turn off this advice by setting config variable advice.detachedHead to false 2025-03-14T06:07:59.6492374Z 2025-03-14T06:07:59.6492790Z HEAD is now at aed0b7a [c10d] Add param recording for uniqueID broadcasting and allgather (#149166) 2025-03-14T06:07:59.6528877Z ##[endgroup] 2025-03-14T06:07:59.6529909Z ##[group]Setting up auth for fetching submodules 2025-03-14T06:07:59.6537541Z [command]/usr/bin/git config --global http.https://github.com/.extraheader AUTHORIZATION: basic *** 2025-03-14T06:07:59.6588262Z [command]/usr/bin/git config --global --unset-all url.https://github.com/.insteadOf 2025-03-14T06:07:59.6624826Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf git@github.com: 2025-03-14T06:07:59.6659482Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf org-21003710@github.com: 2025-03-14T06:07:59.6686799Z ##[endgroup] 2025-03-14T06:07:59.6687817Z ##[group]Fetching submodules 2025-03-14T06:07:59.6693098Z [command]/usr/bin/git submodule sync --recursive 2025-03-14T06:07:59.7042363Z [command]/usr/bin/git -c protocol.version=2 submodule update --init --force --depth=1 --recursive 2025-03-14T06:07:59.7377349Z Submodule 'android/libs/fbjni' (https://github.com/facebookincubator/fbjni.git) registered for path 'android/libs/fbjni' 2025-03-14T06:07:59.7381322Z Submodule 'third_party/NNPACK_deps/FP16' (https://github.com/Maratyszcza/FP16.git) registered for path 'third_party/FP16' 2025-03-14T06:07:59.7384648Z Submodule 'third_party/NNPACK_deps/FXdiv' (https://github.com/Maratyszcza/FXdiv.git) registered for path 'third_party/FXdiv' 2025-03-14T06:07:59.7388300Z Submodule 'third_party/NNPACK' (https://github.com/Maratyszcza/NNPACK.git) registered for path 'third_party/NNPACK' 2025-03-14T06:07:59.7392137Z Submodule 'third_party/NVTX' (https://github.com/NVIDIA/NVTX.git) registered for path 'third_party/NVTX' 2025-03-14T06:07:59.7396632Z Submodule 'third_party/VulkanMemoryAllocator' (https://github.com/GPUOpen-LibrariesAndSDKs/VulkanMemoryAllocator.git) registered for path 'third_party/VulkanMemoryAllocator' 2025-03-14T06:07:59.7400504Z Submodule 'third_party/XNNPACK' (https://github.com/google/XNNPACK.git) registered for path 'third_party/XNNPACK' 2025-03-14T06:07:59.7404998Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/benchmark' 2025-03-14T06:07:59.7409608Z Submodule 'third_party/composable_kernel' (https://github.com/ROCm/composable_kernel.git) registered for path 'third_party/composable_kernel' 2025-03-14T06:07:59.7414153Z Submodule 'third_party/cpp-httplib' (https://github.com/yhirose/cpp-httplib.git) registered for path 'third_party/cpp-httplib' 2025-03-14T06:07:59.7418798Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo.git) registered for path 'third_party/cpuinfo' 2025-03-14T06:07:59.7423797Z Submodule 'third_party/cudnn_frontend' (https://github.com/NVIDIA/cudnn-frontend.git) registered for path 'third_party/cudnn_frontend' 2025-03-14T06:07:59.7429320Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/cutlass' 2025-03-14T06:07:59.7434839Z Submodule 'third_party/eigen' (https://gitlab.com/libeigen/eigen.git) registered for path 'third_party/eigen' 2025-03-14T06:07:59.7439914Z Submodule 'third_party/fbgemm' (https://github.com/pytorch/fbgemm) registered for path 'third_party/fbgemm' 2025-03-14T06:07:59.7446413Z Submodule 'third_party/flash-attention' (https://github.com/Dao-AILab/flash-attention.git) registered for path 'third_party/flash-attention' 2025-03-14T06:07:59.7453895Z Submodule 'third_party/flatbuffers' (https://github.com/google/flatbuffers.git) registered for path 'third_party/flatbuffers' 2025-03-14T06:07:59.7459424Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/fmt' 2025-03-14T06:07:59.7465193Z Submodule 'third_party/gemmlowp/gemmlowp' (https://github.com/google/gemmlowp.git) registered for path 'third_party/gemmlowp/gemmlowp' 2025-03-14T06:07:59.7470807Z Submodule 'third_party/gloo' (https://github.com/facebookincubator/gloo) registered for path 'third_party/gloo' 2025-03-14T06:07:59.7476675Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/googletest' 2025-03-14T06:07:59.7482555Z Submodule 'third_party/ideep' (https://github.com/intel/ideep) registered for path 'third_party/ideep' 2025-03-14T06:07:59.7488812Z Submodule 'third_party/ittapi' (https://github.com/intel/ittapi.git) registered for path 'third_party/ittapi' 2025-03-14T06:07:59.7494928Z Submodule 'third_party/kineto' (https://github.com/pytorch/kineto) registered for path 'third_party/kineto' 2025-03-14T06:07:59.7501485Z Submodule 'third_party/kleidiai' (https://github.com/ARM-software/kleidiai.git) registered for path 'third_party/kleidiai' 2025-03-14T06:07:59.7507937Z Submodule 'third_party/mimalloc' (https://github.com/microsoft/mimalloc.git) registered for path 'third_party/mimalloc' 2025-03-14T06:07:59.7514600Z Submodule 'third_party/nlohmann' (https://github.com/nlohmann/json.git) registered for path 'third_party/nlohmann' 2025-03-14T06:07:59.7521260Z Submodule 'third_party/onnx' (https://github.com/onnx/onnx.git) registered for path 'third_party/onnx' 2025-03-14T06:07:59.7528928Z Submodule 'third_party/opentelemetry-cpp' (https://github.com/open-telemetry/opentelemetry-cpp.git) registered for path 'third_party/opentelemetry-cpp' 2025-03-14T06:07:59.7535754Z Submodule 'third_party/pocketfft' (https://github.com/mreineck/pocketfft) registered for path 'third_party/pocketfft' 2025-03-14T06:07:59.7542813Z Submodule 'third_party/protobuf' (https://github.com/protocolbuffers/protobuf.git) registered for path 'third_party/protobuf' 2025-03-14T06:07:59.7549987Z Submodule 'third_party/NNPACK_deps/psimd' (https://github.com/Maratyszcza/psimd.git) registered for path 'third_party/psimd' 2025-03-14T06:07:59.7557167Z Submodule 'third_party/NNPACK_deps/pthreadpool' (https://github.com/Maratyszcza/pthreadpool.git) registered for path 'third_party/pthreadpool' 2025-03-14T06:07:59.7566588Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/pybind11' 2025-03-14T06:07:59.7574063Z Submodule 'third_party/python-peachpy' (https://github.com/malfet/PeachPy.git) registered for path 'third_party/python-peachpy' 2025-03-14T06:07:59.7581612Z Submodule 'third_party/sleef' (https://github.com/shibatch/sleef) registered for path 'third_party/sleef' 2025-03-14T06:07:59.7589476Z Submodule 'third_party/tensorpipe' (https://github.com/pytorch/tensorpipe.git) registered for path 'third_party/tensorpipe' 2025-03-14T06:07:59.7622429Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/android/libs/fbjni'... 2025-03-14T06:08:00.0917636Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/FXdiv'... 2025-03-14T06:08:00.0919737Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/NNPACK'... 2025-03-14T06:08:00.0921756Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/FP16'... 2025-03-14T06:08:00.0950704Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/gemmlowp/gemmlowp'... 2025-03-14T06:08:00.6626516Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/VulkanMemoryAllocator'... 2025-03-14T06:08:00.6627953Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/benchmark'... 2025-03-14T06:08:00.6629441Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/cpp-httplib'... 2025-03-14T06:08:00.6630920Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/NVTX'... 2025-03-14T06:08:00.6632155Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/cpuinfo'... 2025-03-14T06:08:00.6633360Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/cudnn_frontend'... 2025-03-14T06:08:00.6634779Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/flash-attention'... 2025-03-14T06:08:00.6636207Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/fmt'... 2025-03-14T06:08:00.6637440Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/gloo'... 2025-03-14T06:08:00.6638595Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/ittapi'... 2025-03-14T06:08:00.6639771Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/ideep'... 2025-03-14T06:08:00.6640900Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/googletest'... 2025-03-14T06:08:00.6642285Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/flatbuffers'... 2025-03-14T06:08:00.6643563Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/kleidiai'... 2025-03-14T06:08:00.6644866Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/eigen'... 2025-03-14T06:08:00.6645895Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/mimalloc'... 2025-03-14T06:08:00.6647212Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/pocketfft'... 2025-03-14T06:08:00.6648257Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/fbgemm'... 2025-03-14T06:08:00.7272962Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/pthreadpool'... 2025-03-14T06:08:00.7282955Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/psimd'... 2025-03-14T06:08:00.7611153Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/onnx'... 2025-03-14T06:08:01.3627583Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/kineto'... 2025-03-14T06:08:01.3628595Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/XNNPACK'... 2025-03-14T06:08:01.3629553Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/nlohmann'... 2025-03-14T06:08:01.3630579Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/python-peachpy'... 2025-03-14T06:08:01.3631619Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/pybind11'... 2025-03-14T06:08:01.3632569Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/tensorpipe'... 2025-03-14T06:08:01.3633606Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/opentelemetry-cpp'... 2025-03-14T06:08:01.3634593Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/sleef'... 2025-03-14T06:08:01.3635535Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/cutlass'... 2025-03-14T06:08:01.3636525Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/composable_kernel'... 2025-03-14T06:08:01.4628807Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/protobuf'... 2025-03-14T06:08:02.3449726Z From https://github.com/facebookincubator/fbjni 2025-03-14T06:08:02.3450393Z * branch 7e1e1fe3858c63c251c637ae41a20de425dde96f -> FETCH_HEAD 2025-03-14T06:08:02.3617066Z Submodule path 'android/libs/fbjni': checked out '7e1e1fe3858c63c251c637ae41a20de425dde96f' 2025-03-14T06:08:02.8881004Z From https://github.com/Maratyszcza/FP16 2025-03-14T06:08:02.8881639Z * branch 4dfe081cf6bcd15db339cf2680b9281b8451eeb3 -> FETCH_HEAD 2025-03-14T06:08:02.8991870Z Submodule path 'third_party/FP16': checked out '4dfe081cf6bcd15db339cf2680b9281b8451eeb3' 2025-03-14T06:08:03.2795000Z From https://github.com/Maratyszcza/FXdiv 2025-03-14T06:08:03.2795624Z * branch b408327ac2a15ec3e43352421954f5b1967701d1 -> FETCH_HEAD 2025-03-14T06:08:03.2864872Z Submodule path 'third_party/FXdiv': checked out 'b408327ac2a15ec3e43352421954f5b1967701d1' 2025-03-14T06:08:03.6934383Z From https://github.com/Maratyszcza/NNPACK 2025-03-14T06:08:03.6935039Z * branch c07e3a0400713d546e0dea2d5466dd22ea389c73 -> FETCH_HEAD 2025-03-14T06:08:03.7183773Z Submodule path 'third_party/NNPACK': checked out 'c07e3a0400713d546e0dea2d5466dd22ea389c73' 2025-03-14T06:08:04.3146573Z From https://github.com/NVIDIA/NVTX 2025-03-14T06:08:04.3147179Z * branch e170594ac7cf1dac584da473d4ca9301087090c1 -> FETCH_HEAD 2025-03-14T06:08:04.3564416Z Submodule path 'third_party/NVTX': checked out 'e170594ac7cf1dac584da473d4ca9301087090c1' 2025-03-14T06:08:04.9939110Z From https://github.com/GPUOpen-LibrariesAndSDKs/VulkanMemoryAllocator 2025-03-14T06:08:04.9939862Z * branch a6bfc237255a6bac1513f7c1ebde6d8aed6b5191 -> FETCH_HEAD 2025-03-14T06:08:05.0352016Z Submodule path 'third_party/VulkanMemoryAllocator': checked out 'a6bfc237255a6bac1513f7c1ebde6d8aed6b5191' 2025-03-14T06:08:08.3468871Z From https://github.com/google/XNNPACK 2025-03-14T06:08:09.2007340Z * branch 51a0103656eff6fc9bfd39a4597923c4b542c883 -> FETCH_HEAD 2025-03-14T06:08:09.2008224Z Submodule path 'third_party/XNNPACK': checked out '51a0103656eff6fc9bfd39a4597923c4b542c883' 2025-03-14T06:08:09.8672137Z From https://github.com/google/benchmark 2025-03-14T06:08:09.8672786Z * branch 0d98dba29d66e93259db7daa53a9327df767a415 -> FETCH_HEAD 2025-03-14T06:08:09.8874953Z Submodule path 'third_party/benchmark': checked out '0d98dba29d66e93259db7daa53a9327df767a415' 2025-03-14T06:08:10.6788108Z From https://github.com/ROCm/composable_kernel 2025-03-14T06:08:10.6788747Z * branch 8086bbe3a78d931eb96fe12fdc014082e18d18d3 -> FETCH_HEAD 2025-03-14T06:08:11.0013951Z Submodule path 'third_party/composable_kernel': checked out '8086bbe3a78d931eb96fe12fdc014082e18d18d3' 2025-03-14T06:08:11.5038613Z From https://github.com/yhirose/cpp-httplib 2025-03-14T06:08:11.5039228Z * branch 3b6597bba913d51161383657829b7e644e59c006 -> FETCH_HEAD 2025-03-14T06:08:11.5458851Z Submodule path 'third_party/cpp-httplib': checked out '3b6597bba913d51161383657829b7e644e59c006' 2025-03-14T06:08:12.0820103Z From https://github.com/pytorch/cpuinfo 2025-03-14T06:08:12.0820738Z * branch 1e83a2fdd3102f65c6f1fb602c1b320486218a99 -> FETCH_HEAD 2025-03-14T06:08:12.1920832Z Submodule path 'third_party/cpuinfo': checked out '1e83a2fdd3102f65c6f1fb602c1b320486218a99' 2025-03-14T06:08:12.6495785Z From https://github.com/NVIDIA/cudnn-frontend 2025-03-14T06:08:12.6496423Z * branch 91b7532f3386768bba4f444ee7672b497f34da8a -> FETCH_HEAD 2025-03-14T06:08:12.6847349Z Submodule path 'third_party/cudnn_frontend': checked out '91b7532f3386768bba4f444ee7672b497f34da8a' 2025-03-14T06:08:13.2425176Z From https://github.com/NVIDIA/cutlass 2025-03-14T06:08:13.2425824Z * branch afa1772203677c5118fcd82537a9c8fefbcc7008 -> FETCH_HEAD 2025-03-14T06:08:14.0025221Z Submodule path 'third_party/cutlass': checked out 'afa1772203677c5118fcd82537a9c8fefbcc7008' 2025-03-14T06:08:15.6913386Z From https://gitlab.com/libeigen/eigen 2025-03-14T06:08:15.6914362Z * branch 3147391d946bb4b6c68edd901f2add6ac1f31f8c -> FETCH_HEAD 2025-03-14T06:08:15.8931555Z Submodule path 'third_party/eigen': checked out '3147391d946bb4b6c68edd901f2add6ac1f31f8c' 2025-03-14T06:08:16.6762965Z From https://github.com/pytorch/fbgemm 2025-03-14T06:08:16.6763611Z * branch dbc3157bf256f1339b3fa1fef2be89ac4078be0e -> FETCH_HEAD 2025-03-14T06:08:16.7401165Z Submodule path 'third_party/fbgemm': checked out 'dbc3157bf256f1339b3fa1fef2be89ac4078be0e' 2025-03-14T06:08:16.7423141Z Submodule 'third_party/asmjit' (https://github.com/asmjit/asmjit.git) registered for path 'third_party/fbgemm/third_party/asmjit' 2025-03-14T06:08:16.7427525Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo) registered for path 'third_party/fbgemm/third_party/cpuinfo' 2025-03-14T06:08:16.7431499Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/fbgemm/third_party/cutlass' 2025-03-14T06:08:16.7435461Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/fbgemm/third_party/googletest' 2025-03-14T06:08:16.7439671Z Submodule 'third_party/hipify_torch' (https://github.com/ROCmSoftwarePlatform/hipify_torch.git) registered for path 'third_party/fbgemm/third_party/hipify_torch' 2025-03-14T06:08:16.7471263Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/fbgemm/third_party/asmjit'... 2025-03-14T06:08:17.0242641Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/fbgemm/third_party/hipify_torch'... 2025-03-14T06:08:17.0243898Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/fbgemm/third_party/googletest'... 2025-03-14T06:08:17.1130320Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/fbgemm/third_party/cpuinfo'... 2025-03-14T06:08:17.2131239Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/fbgemm/third_party/cutlass'... 2025-03-14T06:08:18.8336184Z From https://github.com/asmjit/asmjit 2025-03-14T06:08:18.8336823Z * branch d3fbf7c9bc7c1d1365a94a45614b91c5a3706b81 -> FETCH_HEAD 2025-03-14T06:08:18.8852164Z Submodule path 'third_party/fbgemm/third_party/asmjit': checked out 'd3fbf7c9bc7c1d1365a94a45614b91c5a3706b81' 2025-03-14T06:08:19.7618746Z From https://github.com/pytorch/cpuinfo 2025-03-14T06:08:19.7619399Z * branch ed8b86a253800bafdb7b25c5c399f91bff9cb1f3 -> FETCH_HEAD 2025-03-14T06:08:19.8803788Z Submodule path 'third_party/fbgemm/third_party/cpuinfo': checked out 'ed8b86a253800bafdb7b25c5c399f91bff9cb1f3' 2025-03-14T06:08:21.1179785Z From https://github.com/NVIDIA/cutlass 2025-03-14T06:08:21.1180625Z * branch fc9ebc645b63f3a6bc80aaefde5c063fb72110d6 -> FETCH_HEAD 2025-03-14T06:08:21.6668398Z Submodule path 'third_party/fbgemm/third_party/cutlass': checked out 'fc9ebc645b63f3a6bc80aaefde5c063fb72110d6' 2025-03-14T06:08:22.4763593Z From https://github.com/google/googletest 2025-03-14T06:08:22.4764511Z * branch cbf019de22c8dd37b2108da35b2748fd702d1796 -> FETCH_HEAD 2025-03-14T06:08:22.5222185Z Submodule path 'third_party/fbgemm/third_party/googletest': checked out 'cbf019de22c8dd37b2108da35b2748fd702d1796' 2025-03-14T06:08:23.0530416Z From https://github.com/ROCmSoftwarePlatform/hipify_torch 2025-03-14T06:08:23.0531486Z * branch 23f53b025b466d8ec3c45d52290d3442f7fbe6b1 -> FETCH_HEAD 2025-03-14T06:08:23.0609865Z Submodule path 'third_party/fbgemm/third_party/hipify_torch': checked out '23f53b025b466d8ec3c45d52290d3442f7fbe6b1' 2025-03-14T06:08:23.5956870Z From https://github.com/Dao-AILab/flash-attention 2025-03-14T06:08:23.5957524Z * branch 979702c87a8713a8e0a5e9fee122b90d2ef13be5 -> FETCH_HEAD 2025-03-14T06:08:23.6797190Z Submodule path 'third_party/flash-attention': checked out '979702c87a8713a8e0a5e9fee122b90d2ef13be5' 2025-03-14T06:08:23.6820524Z Submodule 'csrc/composable_kernel' (https://github.com/ROCm/composable_kernel.git) registered for path 'third_party/flash-attention/csrc/composable_kernel' 2025-03-14T06:08:23.6824734Z Submodule 'csrc/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/flash-attention/csrc/cutlass' 2025-03-14T06:08:23.6856752Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/flash-attention/csrc/composable_kernel'... 2025-03-14T06:08:25.1387915Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/flash-attention/csrc/cutlass'... 2025-03-14T06:08:26.0689003Z From https://github.com/ROCm/composable_kernel 2025-03-14T06:08:26.0689653Z * branch 888317e698e9803c62bd38568abc9e05d7709f33 -> FETCH_HEAD 2025-03-14T06:08:26.3756176Z Submodule path 'third_party/flash-attention/csrc/composable_kernel': checked out '888317e698e9803c62bd38568abc9e05d7709f33' 2025-03-14T06:08:27.9945850Z From https://github.com/NVIDIA/cutlass 2025-03-14T06:08:27.9946490Z * branch c506e16788cb08416a4a57e11a9067beeee29420 -> FETCH_HEAD 2025-03-14T06:08:28.7436309Z Submodule path 'third_party/flash-attention/csrc/cutlass': checked out 'c506e16788cb08416a4a57e11a9067beeee29420' 2025-03-14T06:08:29.6509099Z From https://github.com/google/flatbuffers 2025-03-14T06:08:29.6509734Z * branch 01834de25e4bf3975a9a00e816292b1ad0fe184b -> FETCH_HEAD 2025-03-14T06:08:29.8008025Z Submodule path 'third_party/flatbuffers': checked out '01834de25e4bf3975a9a00e816292b1ad0fe184b' 2025-03-14T06:08:30.3796653Z From https://github.com/fmtlib/fmt 2025-03-14T06:08:30.3797272Z * branch 123913715afeb8a437e6388b4473fcc4753e1c9a -> FETCH_HEAD 2025-03-14T06:08:30.4084702Z Submodule path 'third_party/fmt': checked out '123913715afeb8a437e6388b4473fcc4753e1c9a' 2025-03-14T06:08:30.9332833Z From https://github.com/google/gemmlowp 2025-03-14T06:08:30.9333963Z * branch 3fb5c176c17c765a3492cd2f0321b0dab712f350 -> FETCH_HEAD 2025-03-14T06:08:30.9696146Z Submodule path 'third_party/gemmlowp/gemmlowp': checked out '3fb5c176c17c765a3492cd2f0321b0dab712f350' 2025-03-14T06:08:31.5530251Z From https://github.com/facebookincubator/gloo 2025-03-14T06:08:31.5530885Z * branch 5354032ea08eadd7fc4456477f7f7c6308818509 -> FETCH_HEAD 2025-03-14T06:08:31.5792322Z Submodule path 'third_party/gloo': checked out '5354032ea08eadd7fc4456477f7f7c6308818509' 2025-03-14T06:08:32.1493728Z From https://github.com/google/googletest 2025-03-14T06:08:32.1494379Z * branch b514bdc898e2951020cbdca1304b75f5950d1f59 -> FETCH_HEAD 2025-03-14T06:08:32.1943617Z Submodule path 'third_party/googletest': checked out 'b514bdc898e2951020cbdca1304b75f5950d1f59' 2025-03-14T06:08:32.6676656Z From https://github.com/intel/ideep 2025-03-14T06:08:32.6677262Z * branch 719d8e6cd7f7a0e01b155657526d693acf97c2b3 -> FETCH_HEAD 2025-03-14T06:08:32.6790669Z Submodule path 'third_party/ideep': checked out '719d8e6cd7f7a0e01b155657526d693acf97c2b3' 2025-03-14T06:08:32.6810590Z Submodule 'mkl-dnn' (https://github.com/intel/mkl-dnn.git) registered for path 'third_party/ideep/mkl-dnn' 2025-03-14T06:08:32.6840051Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/ideep/mkl-dnn'... 2025-03-14T06:08:38.2184576Z From https://github.com/intel/mkl-dnn 2025-03-14T06:08:38.2185222Z * branch 8d263e693366ef8db40acc569cc7d8edf644556d -> FETCH_HEAD 2025-03-14T06:08:38.8168360Z Submodule path 'third_party/ideep/mkl-dnn': checked out '8d263e693366ef8db40acc569cc7d8edf644556d' 2025-03-14T06:08:39.3011361Z From https://github.com/intel/ittapi 2025-03-14T06:08:39.3011952Z * branch 5b8a7d7422611c3a0d799fb5fc5dd4abfae35b42 -> FETCH_HEAD 2025-03-14T06:08:39.3171932Z Submodule path 'third_party/ittapi': checked out '5b8a7d7422611c3a0d799fb5fc5dd4abfae35b42' 2025-03-14T06:08:39.7380098Z From https://github.com/pytorch/kineto 2025-03-14T06:08:39.7380951Z * branch 2859721fd9e73d3ca1c56f827dbc64e6d68f78a2 -> FETCH_HEAD 2025-03-14T06:08:39.8362073Z Submodule path 'third_party/kineto': checked out '2859721fd9e73d3ca1c56f827dbc64e6d68f78a2' 2025-03-14T06:08:39.8384141Z Submodule 'libkineto/third_party/dynolog' (https://github.com/facebookincubator/dynolog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog' 2025-03-14T06:08:39.8387456Z Submodule 'libkineto/third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/fmt' 2025-03-14T06:08:39.8391342Z Submodule 'libkineto/third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/googletest' 2025-03-14T06:08:39.8423100Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog'... 2025-03-14T06:08:40.3194921Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/kineto/libkineto/third_party/fmt'... 2025-03-14T06:08:40.3196215Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/kineto/libkineto/third_party/googletest'... 2025-03-14T06:08:41.0785610Z From https://github.com/facebookincubator/dynolog 2025-03-14T06:08:41.0786298Z * branch 7d04a0053a845370ae06ce317a22a48e9edcc74e -> FETCH_HEAD 2025-03-14T06:08:41.1718120Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog': checked out '7d04a0053a845370ae06ce317a22a48e9edcc74e' 2025-03-14T06:08:41.1739825Z Submodule 'third_party/DCGM' (https://github.com/NVIDIA/DCGM.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-03-14T06:08:41.1743665Z Submodule 'third_party/cpr' (https://github.com/libcpr/cpr.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-03-14T06:08:41.1747426Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-03-14T06:08:41.1751552Z Submodule 'third_party/gflags' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-03-14T06:08:41.1755837Z Submodule 'third_party/glog' (https://github.com/google/glog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-03-14T06:08:41.1760304Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-03-14T06:08:41.1764471Z Submodule 'third_party/json' (https://github.com/nlohmann/json.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-03-14T06:08:41.1768990Z Submodule 'third_party/pfs' (https://github.com/dtrugman/pfs.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-03-14T06:08:41.1803672Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'... 2025-03-14T06:08:42.8203792Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'... 2025-03-14T06:08:42.8205298Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'... 2025-03-14T06:08:42.8206710Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'... 2025-03-14T06:08:42.8208361Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'... 2025-03-14T06:08:42.8209944Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/glog'... 2025-03-14T06:08:42.8211365Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'... 2025-03-14T06:08:42.8213036Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/json'... 2025-03-14T06:08:44.6284701Z From https://github.com/NVIDIA/DCGM 2025-03-14T06:08:44.6285382Z * branch ffde4e54bc7249a6039a5e6b45b395141e1217f9 -> FETCH_HEAD 2025-03-14T06:08:44.8495990Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM': checked out 'ffde4e54bc7249a6039a5e6b45b395141e1217f9' 2025-03-14T06:08:45.3562498Z From https://github.com/libcpr/cpr 2025-03-14T06:08:45.3563087Z * branch 871ed52d350214a034f6ef8a3b8f51c5ce1bd400 -> FETCH_HEAD 2025-03-14T06:08:45.3735022Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr': checked out '871ed52d350214a034f6ef8a3b8f51c5ce1bd400' 2025-03-14T06:08:45.9805174Z From https://github.com/fmtlib/fmt 2025-03-14T06:08:45.9805939Z * branch cd4af11efc9c622896a3e4cb599fa28668ca3d05 -> FETCH_HEAD 2025-03-14T06:08:46.0122083Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt': checked out 'cd4af11efc9c622896a3e4cb599fa28668ca3d05' 2025-03-14T06:08:46.4554975Z From https://github.com/gflags/gflags 2025-03-14T06:08:46.4555621Z * branch e171aa2d15ed9eb17054558e0b3a6a413bb01067 -> FETCH_HEAD 2025-03-14T06:08:46.4672158Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags': checked out 'e171aa2d15ed9eb17054558e0b3a6a413bb01067' 2025-03-14T06:08:46.4692703Z Submodule 'doc' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-03-14T06:08:46.4723951Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'... 2025-03-14T06:08:47.1249923Z From https://github.com/gflags/gflags 2025-03-14T06:08:47.1250538Z * branch 8411df715cf522606e3b1aca386ddfc0b63d34b4 -> FETCH_HEAD 2025-03-14T06:08:47.1313014Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc': checked out '8411df715cf522606e3b1aca386ddfc0b63d34b4' 2025-03-14T06:08:47.6848370Z From https://github.com/google/glog 2025-03-14T06:08:47.6849017Z * branch b33e3bad4c46c8a6345525fd822af355e5ef9446 -> FETCH_HEAD 2025-03-14T06:08:47.7036176Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog': checked out 'b33e3bad4c46c8a6345525fd822af355e5ef9446' 2025-03-14T06:08:48.4336464Z From https://github.com/google/googletest 2025-03-14T06:08:48.4337170Z * branch 58d77fa8070e8cec2dc1ed015d66b454c8d78850 -> FETCH_HEAD 2025-03-14T06:08:48.4776973Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest': checked out '58d77fa8070e8cec2dc1ed015d66b454c8d78850' 2025-03-14T06:08:49.1234335Z From https://github.com/nlohmann/json 2025-03-14T06:08:49.1234984Z * branch 4f8fba14066156b73f1189a2b8bd568bde5284c5 -> FETCH_HEAD 2025-03-14T06:08:49.2269385Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json': checked out '4f8fba14066156b73f1189a2b8bd568bde5284c5' 2025-03-14T06:08:49.6853183Z From https://github.com/dtrugman/pfs 2025-03-14T06:08:49.6854350Z * branch f68a2fa8ea36c783bdd760371411fcb495aa3150 -> FETCH_HEAD 2025-03-14T06:08:49.7029572Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs': checked out 'f68a2fa8ea36c783bdd760371411fcb495aa3150' 2025-03-14T06:08:50.3328081Z From https://github.com/fmtlib/fmt 2025-03-14T06:08:50.3328701Z * branch 0041a40c1350ba702d475b9c4ad62da77caea164 -> FETCH_HEAD 2025-03-14T06:08:50.3630272Z Submodule path 'third_party/kineto/libkineto/third_party/fmt': checked out '0041a40c1350ba702d475b9c4ad62da77caea164' 2025-03-14T06:08:51.2045755Z From https://github.com/google/googletest 2025-03-14T06:08:51.2046404Z * branch 7aca84427f224eeed3144123d5230d5871e93347 -> FETCH_HEAD 2025-03-14T06:08:51.2496241Z Submodule path 'third_party/kineto/libkineto/third_party/googletest': checked out '7aca84427f224eeed3144123d5230d5871e93347' 2025-03-14T06:08:51.7075091Z From https://github.com/ARM-software/kleidiai 2025-03-14T06:08:51.7075701Z * branch ef685a13cfbe8d418aa2ed34350e21e4938358b6 -> FETCH_HEAD 2025-03-14T06:08:51.7501322Z Submodule path 'third_party/kleidiai': checked out 'ef685a13cfbe8d418aa2ed34350e21e4938358b6' 2025-03-14T06:08:52.3497295Z From https://github.com/microsoft/mimalloc 2025-03-14T06:08:52.3497959Z * branch b66e3214d8a104669c2ec05ae91ebc26a8f5ab78 -> FETCH_HEAD 2025-03-14T06:08:52.3904352Z Submodule path 'third_party/mimalloc': checked out 'b66e3214d8a104669c2ec05ae91ebc26a8f5ab78' 2025-03-14T06:08:53.2025553Z From https://github.com/nlohmann/json 2025-03-14T06:08:53.2026482Z * branch 87cda1d6646592ac5866dc703c8e1839046a6806 -> FETCH_HEAD 2025-03-14T06:08:53.3214224Z Submodule path 'third_party/nlohmann': checked out '87cda1d6646592ac5866dc703c8e1839046a6806' 2025-03-14T06:08:54.2829948Z From https://github.com/onnx/onnx 2025-03-14T06:08:54.2830579Z * branch b8baa8446686496da4cc8fda09f2b6fe65c2a02c -> FETCH_HEAD 2025-03-14T06:08:54.7752527Z Submodule path 'third_party/onnx': checked out 'b8baa8446686496da4cc8fda09f2b6fe65c2a02c' 2025-03-14T06:08:54.7795091Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/onnx/third_party/pybind11' 2025-03-14T06:08:54.7826624Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/onnx/third_party/pybind11'... 2025-03-14T06:08:55.7054564Z From https://github.com/pybind/pybind11 2025-03-14T06:08:55.7055201Z * branch 3e9dfa2866941655c56877882565e7577de6fc7b -> FETCH_HEAD 2025-03-14T06:08:55.7417853Z Submodule path 'third_party/onnx/third_party/pybind11': checked out '3e9dfa2866941655c56877882565e7577de6fc7b' 2025-03-14T06:08:56.4774544Z From https://github.com/open-telemetry/opentelemetry-cpp 2025-03-14T06:08:56.4775271Z * branch a799f4aed9c94b765dcdaabaeab7d5e7e2310878 -> FETCH_HEAD 2025-03-14T06:08:56.5647777Z Submodule path 'third_party/opentelemetry-cpp': checked out 'a799f4aed9c94b765dcdaabaeab7d5e7e2310878' 2025-03-14T06:08:56.5670587Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark) registered for path 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-03-14T06:08:56.5674431Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/opentelemetry-cpp/third_party/googletest' 2025-03-14T06:08:56.5678191Z Submodule 'third_party/ms-gsl' (https://github.com/microsoft/GSL) registered for path 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-03-14T06:08:56.5682192Z Submodule 'third_party/nlohmann-json' (https://github.com/nlohmann/json) registered for path 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-03-14T06:08:56.5686419Z Submodule 'third_party/opentelemetry-proto' (https://github.com/open-telemetry/opentelemetry-proto) registered for path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-03-14T06:08:56.5690563Z Submodule 'third_party/opentracing-cpp' (https://github.com/opentracing/opentracing-cpp.git) registered for path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-03-14T06:08:56.5694822Z Submodule 'third_party/prometheus-cpp' (https://github.com/jupp0r/prometheus-cpp) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-03-14T06:08:56.5699006Z Submodule 'tools/vcpkg' (https://github.com/Microsoft/vcpkg) registered for path 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-03-14T06:08:56.5731868Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/benchmark'... 2025-03-14T06:08:56.7814967Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp'... 2025-03-14T06:08:56.8097049Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentracing-cpp'... 2025-03-14T06:08:56.8098468Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/googletest'... 2025-03-14T06:08:56.8436925Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/ms-gsl'... 2025-03-14T06:08:56.8438332Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentelemetry-proto'... 2025-03-14T06:08:56.9438295Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/nlohmann-json'... 2025-03-14T06:08:57.0821829Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/opentelemetry-cpp/tools/vcpkg'... 2025-03-14T06:08:57.7166978Z From https://github.com/google/benchmark 2025-03-14T06:08:57.7167834Z * branch d572f4777349d43653b21d6c2fc63020ab326db2 -> FETCH_HEAD 2025-03-14T06:08:57.7373466Z Submodule path 'third_party/opentelemetry-cpp/third_party/benchmark': checked out 'd572f4777349d43653b21d6c2fc63020ab326db2' 2025-03-14T06:08:58.4689088Z From https://github.com/google/googletest 2025-03-14T06:08:58.4690066Z * branch b796f7d44681514f58a683a3a71ff17c94edb0c1 -> FETCH_HEAD 2025-03-14T06:08:58.5127363Z Submodule path 'third_party/opentelemetry-cpp/third_party/googletest': checked out 'b796f7d44681514f58a683a3a71ff17c94edb0c1' 2025-03-14T06:08:58.9940724Z From https://github.com/microsoft/GSL 2025-03-14T06:08:58.9941797Z * branch 6f4529395c5b7c2d661812257cd6780c67e54afa -> FETCH_HEAD 2025-03-14T06:08:59.0057373Z Submodule path 'third_party/opentelemetry-cpp/third_party/ms-gsl': checked out '6f4529395c5b7c2d661812257cd6780c67e54afa' 2025-03-14T06:08:59.8656299Z From https://github.com/nlohmann/json 2025-03-14T06:08:59.8657103Z * branch bc889afb4c5bf1c0d8ee29ef35eaaf4c8bef8a5d -> FETCH_HEAD 2025-03-14T06:08:59.9909517Z Submodule path 'third_party/opentelemetry-cpp/third_party/nlohmann-json': checked out 'bc889afb4c5bf1c0d8ee29ef35eaaf4c8bef8a5d' 2025-03-14T06:09:00.4403814Z From https://github.com/open-telemetry/opentelemetry-proto 2025-03-14T06:09:00.4404528Z * branch 4ca4f0335c63cda7ab31ea7ed70d6553aee14dce -> FETCH_HEAD 2025-03-14T06:09:00.4521297Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto': checked out '4ca4f0335c63cda7ab31ea7ed70d6553aee14dce' 2025-03-14T06:09:00.8403118Z From https://github.com/opentracing/opentracing-cpp 2025-03-14T06:09:00.8403785Z * branch 06b57f48ded1fa3bdd3d4346f6ef29e40e08eaf5 -> FETCH_HEAD 2025-03-14T06:09:00.8542773Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp': checked out '06b57f48ded1fa3bdd3d4346f6ef29e40e08eaf5' 2025-03-14T06:09:01.3628189Z From https://github.com/jupp0r/prometheus-cpp 2025-03-14T06:09:01.3628831Z * branch c9ffcdda9086ffd9e1283ea7a0276d831f3c8a8d -> FETCH_HEAD 2025-03-14T06:09:01.3804420Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp': checked out 'c9ffcdda9086ffd9e1283ea7a0276d831f3c8a8d' 2025-03-14T06:09:01.3824037Z Submodule 'civetweb' (https://github.com/civetweb/civetweb.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-03-14T06:09:01.3828473Z Submodule 'googletest' (https://github.com/google/googletest.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-03-14T06:09:01.3859002Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'... 2025-03-14T06:09:02.3172119Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'... 2025-03-14T06:09:02.8852929Z From https://github.com/civetweb/civetweb 2025-03-14T06:09:02.8853811Z * branch eefb26f82b233268fc98577d265352720d477ba4 -> FETCH_HEAD 2025-03-14T06:09:03.1604280Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb': checked out 'eefb26f82b233268fc98577d265352720d477ba4' 2025-03-14T06:09:03.7982340Z From https://github.com/google/googletest 2025-03-14T06:09:03.7982980Z * branch e2239ee6043f73722e7aa812a459f54a28552929 -> FETCH_HEAD 2025-03-14T06:09:03.8451350Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2025-03-14T06:09:05.6169919Z From https://github.com/Microsoft/vcpkg 2025-03-14T06:09:05.6170580Z * branch 8eb57355a4ffb410a2e94c07b4dca2dffbee8e50 -> FETCH_HEAD 2025-03-14T06:09:06.2819515Z Submodule path 'third_party/opentelemetry-cpp/tools/vcpkg': checked out '8eb57355a4ffb410a2e94c07b4dca2dffbee8e50' 2025-03-14T06:09:06.6691915Z From https://github.com/mreineck/pocketfft 2025-03-14T06:09:06.6692589Z * branch 9d3ab05a7fffbc71a492bc6a17be034e83e8f0fe -> FETCH_HEAD 2025-03-14T06:09:06.6758003Z Submodule path 'third_party/pocketfft': checked out '9d3ab05a7fffbc71a492bc6a17be034e83e8f0fe' 2025-03-14T06:09:09.3759102Z From https://github.com/protocolbuffers/protobuf 2025-03-14T06:09:09.3759791Z * branch d1eca4e4b421cd2997495c4b4e65cea6be4e9b8a -> FETCH_HEAD 2025-03-14T06:09:09.6891133Z Submodule path 'third_party/protobuf': checked out 'd1eca4e4b421cd2997495c4b4e65cea6be4e9b8a' 2025-03-14T06:09:09.6918377Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/protobuf/third_party/benchmark' 2025-03-14T06:09:09.6923065Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/protobuf/third_party/googletest' 2025-03-14T06:09:09.6955667Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/protobuf/third_party/benchmark'... 2025-03-14T06:09:09.9843330Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/protobuf/third_party/googletest'... 2025-03-14T06:09:10.5502421Z From https://github.com/google/benchmark 2025-03-14T06:09:10.5503012Z * branch 5b7683f49e1e9223cf9927b24f6fd3d6bd82e3f8 -> FETCH_HEAD 2025-03-14T06:09:10.5658262Z Submodule path 'third_party/protobuf/third_party/benchmark': checked out '5b7683f49e1e9223cf9927b24f6fd3d6bd82e3f8' 2025-03-14T06:09:11.3403782Z From https://github.com/google/googletest 2025-03-14T06:09:11.3404438Z * branch 5ec7f0c4a113e2f18ac2c6cc7df51ad6afc24081 -> FETCH_HEAD 2025-03-14T06:09:11.3934699Z Submodule path 'third_party/protobuf/third_party/googletest': checked out '5ec7f0c4a113e2f18ac2c6cc7df51ad6afc24081' 2025-03-14T06:09:11.4048566Z Submodule path 'third_party/psimd': checked out '072586a71b55b7f8c584153d223e95687148a900' 2025-03-14T06:09:11.8275008Z From https://github.com/Maratyszcza/pthreadpool 2025-03-14T06:09:11.8275969Z * branch 4fe0e1e183925bf8cfa6aae24237e724a96479b8 -> FETCH_HEAD 2025-03-14T06:09:11.8382666Z Submodule path 'third_party/pthreadpool': checked out '4fe0e1e183925bf8cfa6aae24237e724a96479b8' 2025-03-14T06:09:12.4270162Z From https://github.com/pybind/pybind11 2025-03-14T06:09:12.4270787Z * branch a2e59f0e7065404b44dfe92a28aca47ba1378dc4 -> FETCH_HEAD 2025-03-14T06:09:12.4644659Z Submodule path 'third_party/pybind11': checked out 'a2e59f0e7065404b44dfe92a28aca47ba1378dc4' 2025-03-14T06:09:12.9324290Z From https://github.com/malfet/PeachPy 2025-03-14T06:09:12.9324888Z * branch f45429b087dd7d5bc78bb40dc7cf06425c252d67 -> FETCH_HEAD 2025-03-14T06:09:12.9604916Z Submodule path 'third_party/python-peachpy': checked out 'f45429b087dd7d5bc78bb40dc7cf06425c252d67' 2025-03-14T06:09:13.6058653Z From https://github.com/shibatch/sleef 2025-03-14T06:09:13.6059281Z * branch 56e1f79cb140fb9326d612d0be06b5250565cade -> FETCH_HEAD 2025-03-14T06:09:13.6544036Z Submodule path 'third_party/sleef': checked out '56e1f79cb140fb9326d612d0be06b5250565cade' 2025-03-14T06:09:14.0951514Z From https://github.com/pytorch/tensorpipe 2025-03-14T06:09:14.0952150Z * branch 52791a2fd214b2a9dc5759d36725909c1daa7f2e -> FETCH_HEAD 2025-03-14T06:09:14.1218448Z Submodule path 'third_party/tensorpipe': checked out '52791a2fd214b2a9dc5759d36725909c1daa7f2e' 2025-03-14T06:09:14.1239484Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/tensorpipe/third_party/googletest' 2025-03-14T06:09:14.1243179Z Submodule 'third_party/libnop' (https://github.com/google/libnop.git) registered for path 'third_party/tensorpipe/third_party/libnop' 2025-03-14T06:09:14.1247207Z Submodule 'third_party/libuv' (https://github.com/libuv/libuv.git) registered for path 'third_party/tensorpipe/third_party/libuv' 2025-03-14T06:09:14.1251275Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/tensorpipe/third_party/pybind11' 2025-03-14T06:09:14.1284107Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/tensorpipe/third_party/googletest'... 2025-03-14T06:09:14.3889307Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/tensorpipe/third_party/libnop'... 2025-03-14T06:09:14.4124153Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/tensorpipe/third_party/libuv'... 2025-03-14T06:09:14.6114537Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11'... 2025-03-14T06:09:15.3352511Z From https://github.com/google/googletest 2025-03-14T06:09:15.3353146Z * branch aee0f9d9b5b87796ee8a0ab26b7587ec30e8858e -> FETCH_HEAD 2025-03-14T06:09:15.3805497Z Submodule path 'third_party/tensorpipe/third_party/googletest': checked out 'aee0f9d9b5b87796ee8a0ab26b7587ec30e8858e' 2025-03-14T06:09:15.8084573Z From https://github.com/google/libnop 2025-03-14T06:09:15.8085245Z * branch 910b55815be16109f04f4180e9adee14fb4ce281 -> FETCH_HEAD 2025-03-14T06:09:15.8235644Z Submodule path 'third_party/tensorpipe/third_party/libnop': checked out '910b55815be16109f04f4180e9adee14fb4ce281' 2025-03-14T06:09:16.5465252Z From https://github.com/libuv/libuv 2025-03-14T06:09:16.5465899Z * branch 1dff88e5161cba5c59276d2070d2e304e4dcb242 -> FETCH_HEAD 2025-03-14T06:09:16.6039243Z Submodule path 'third_party/tensorpipe/third_party/libuv': checked out '1dff88e5161cba5c59276d2070d2e304e4dcb242' 2025-03-14T06:09:17.2241360Z From https://github.com/pybind/pybind11 2025-03-14T06:09:17.2242368Z * branch a23996fce38ff6ccfbcdc09f1e63f2c4be5ea2ef -> FETCH_HEAD 2025-03-14T06:09:17.2560385Z Submodule path 'third_party/tensorpipe/third_party/pybind11': checked out 'a23996fce38ff6ccfbcdc09f1e63f2c4be5ea2ef' 2025-03-14T06:09:17.2580831Z Submodule 'tools/clang' (https://github.com/wjakob/clang-cindex-python3) registered for path 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-03-14T06:09:17.2611509Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11/tools/clang'... 2025-03-14T06:09:17.8932734Z From https://github.com/wjakob/clang-cindex-python3 2025-03-14T06:09:17.8933819Z * branch 6a00cbc4a9b8e68b71caf7f774b3f9c753ae84d5 -> FETCH_HEAD 2025-03-14T06:09:17.9001906Z Submodule path 'third_party/tensorpipe/third_party/pybind11/tools/clang': checked out '6a00cbc4a9b8e68b71caf7f774b3f9c753ae84d5' 2025-03-14T06:09:17.9047331Z [command]/usr/bin/git submodule foreach --recursive git config --local gc.auto 0 2025-03-14T06:09:17.9388897Z Entering 'android/libs/fbjni' 2025-03-14T06:09:17.9438635Z Entering 'third_party/FP16' 2025-03-14T06:09:17.9487566Z Entering 'third_party/FXdiv' 2025-03-14T06:09:17.9537492Z Entering 'third_party/NNPACK' 2025-03-14T06:09:17.9586162Z Entering 'third_party/NVTX' 2025-03-14T06:09:17.9636962Z Entering 'third_party/VulkanMemoryAllocator' 2025-03-14T06:09:17.9685769Z Entering 'third_party/XNNPACK' 2025-03-14T06:09:17.9753716Z Entering 'third_party/benchmark' 2025-03-14T06:09:17.9801784Z Entering 'third_party/composable_kernel' 2025-03-14T06:09:17.9859988Z Entering 'third_party/cpp-httplib' 2025-03-14T06:09:17.9909591Z Entering 'third_party/cpuinfo' 2025-03-14T06:09:17.9960648Z Entering 'third_party/cudnn_frontend' 2025-03-14T06:09:18.0009431Z Entering 'third_party/cutlass' 2025-03-14T06:09:18.0068362Z Entering 'third_party/eigen' 2025-03-14T06:09:18.0120102Z Entering 'third_party/fbgemm' 2025-03-14T06:09:18.0170012Z Entering 'third_party/fbgemm/third_party/asmjit' 2025-03-14T06:09:18.0217837Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2025-03-14T06:09:18.0267481Z Entering 'third_party/fbgemm/third_party/cutlass' 2025-03-14T06:09:18.0323445Z Entering 'third_party/fbgemm/third_party/googletest' 2025-03-14T06:09:18.0372148Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2025-03-14T06:09:18.0420994Z Entering 'third_party/flash-attention' 2025-03-14T06:09:18.0472409Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-03-14T06:09:18.0528412Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-03-14T06:09:18.0586091Z Entering 'third_party/flatbuffers' 2025-03-14T06:09:18.0638604Z Entering 'third_party/fmt' 2025-03-14T06:09:18.0686952Z Entering 'third_party/gemmlowp/gemmlowp' 2025-03-14T06:09:18.0736848Z Entering 'third_party/gloo' 2025-03-14T06:09:18.0785645Z Entering 'third_party/googletest' 2025-03-14T06:09:18.0835563Z Entering 'third_party/ideep' 2025-03-14T06:09:18.0882565Z Entering 'third_party/ideep/mkl-dnn' 2025-03-14T06:09:18.0938941Z Entering 'third_party/ittapi' 2025-03-14T06:09:18.0987218Z Entering 'third_party/kineto' 2025-03-14T06:09:18.1039496Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-03-14T06:09:18.1088684Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-03-14T06:09:18.1139844Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-03-14T06:09:18.1187715Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-03-14T06:09:18.1238413Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-03-14T06:09:18.1285298Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-03-14T06:09:18.1336876Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-03-14T06:09:18.1385502Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-03-14T06:09:18.1436355Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-03-14T06:09:18.1485371Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-03-14T06:09:18.1536110Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-03-14T06:09:18.1583849Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-03-14T06:09:18.1635057Z Entering 'third_party/kleidiai' 2025-03-14T06:09:18.1683470Z Entering 'third_party/mimalloc' 2025-03-14T06:09:18.1734349Z Entering 'third_party/nlohmann' 2025-03-14T06:09:18.1784595Z Entering 'third_party/onnx' 2025-03-14T06:09:18.1850887Z Entering 'third_party/onnx/third_party/pybind11' 2025-03-14T06:09:18.1902414Z Entering 'third_party/opentelemetry-cpp' 2025-03-14T06:09:18.1954441Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-03-14T06:09:18.2001626Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-03-14T06:09:18.2049906Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-03-14T06:09:18.2097101Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-03-14T06:09:18.2146525Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-03-14T06:09:18.2193726Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-03-14T06:09:18.2242774Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-03-14T06:09:18.2289371Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-03-14T06:09:18.2341326Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-03-14T06:09:18.2390451Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-03-14T06:09:18.2462258Z Entering 'third_party/pocketfft' 2025-03-14T06:09:18.2510337Z Entering 'third_party/protobuf' 2025-03-14T06:09:18.2564967Z Entering 'third_party/protobuf/third_party/benchmark' 2025-03-14T06:09:18.2612630Z Entering 'third_party/protobuf/third_party/googletest' 2025-03-14T06:09:18.2663196Z Entering 'third_party/psimd' 2025-03-14T06:09:18.2711762Z Entering 'third_party/pthreadpool' 2025-03-14T06:09:18.2760599Z Entering 'third_party/pybind11' 2025-03-14T06:09:18.2808978Z Entering 'third_party/python-peachpy' 2025-03-14T06:09:18.2858269Z Entering 'third_party/sleef' 2025-03-14T06:09:18.2906543Z Entering 'third_party/tensorpipe' 2025-03-14T06:09:18.2955805Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-03-14T06:09:18.3002938Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-03-14T06:09:18.3051340Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-03-14T06:09:18.3099084Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-03-14T06:09:18.3146833Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-03-14T06:09:18.3212610Z ##[endgroup] 2025-03-14T06:09:18.3213226Z ##[group]Persisting credentials for submodules 2025-03-14T06:09:18.3219260Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'url\.https\:\/\/github\.com\/\.insteadOf' && git config --local --unset-all 'url.https://github.com/.insteadOf' || :" 2025-03-14T06:09:18.3560079Z Entering 'android/libs/fbjni' 2025-03-14T06:09:18.3622979Z Entering 'third_party/FP16' 2025-03-14T06:09:18.3687219Z Entering 'third_party/FXdiv' 2025-03-14T06:09:18.3751545Z Entering 'third_party/NNPACK' 2025-03-14T06:09:18.3815075Z Entering 'third_party/NVTX' 2025-03-14T06:09:18.3879626Z Entering 'third_party/VulkanMemoryAllocator' 2025-03-14T06:09:18.3944292Z Entering 'third_party/XNNPACK' 2025-03-14T06:09:18.4023920Z Entering 'third_party/benchmark' 2025-03-14T06:09:18.4087765Z Entering 'third_party/composable_kernel' 2025-03-14T06:09:18.4159171Z Entering 'third_party/cpp-httplib' 2025-03-14T06:09:18.4222665Z Entering 'third_party/cpuinfo' 2025-03-14T06:09:18.4287809Z Entering 'third_party/cudnn_frontend' 2025-03-14T06:09:18.4352509Z Entering 'third_party/cutlass' 2025-03-14T06:09:18.4427172Z Entering 'third_party/eigen' 2025-03-14T06:09:18.4492620Z Entering 'third_party/fbgemm' 2025-03-14T06:09:18.4556883Z Entering 'third_party/fbgemm/third_party/asmjit' 2025-03-14T06:09:18.4618834Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2025-03-14T06:09:18.4682838Z Entering 'third_party/fbgemm/third_party/cutlass' 2025-03-14T06:09:18.4753980Z Entering 'third_party/fbgemm/third_party/googletest' 2025-03-14T06:09:18.4816483Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2025-03-14T06:09:18.4881824Z Entering 'third_party/flash-attention' 2025-03-14T06:09:18.4946106Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-03-14T06:09:18.5014450Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-03-14T06:09:18.5087860Z Entering 'third_party/flatbuffers' 2025-03-14T06:09:18.5154917Z Entering 'third_party/fmt' 2025-03-14T06:09:18.5218384Z Entering 'third_party/gemmlowp/gemmlowp' 2025-03-14T06:09:18.5282686Z Entering 'third_party/gloo' 2025-03-14T06:09:18.5346506Z Entering 'third_party/googletest' 2025-03-14T06:09:18.5409981Z Entering 'third_party/ideep' 2025-03-14T06:09:18.5472648Z Entering 'third_party/ideep/mkl-dnn' 2025-03-14T06:09:18.5545707Z Entering 'third_party/ittapi' 2025-03-14T06:09:18.5608731Z Entering 'third_party/kineto' 2025-03-14T06:09:18.5671695Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-03-14T06:09:18.5735280Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-03-14T06:09:18.5800110Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-03-14T06:09:18.5864759Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-03-14T06:09:18.5930008Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-03-14T06:09:18.5992519Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-03-14T06:09:18.6059925Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-03-14T06:09:18.6124099Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-03-14T06:09:18.6188728Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-03-14T06:09:18.6254171Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-03-14T06:09:18.6320186Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-03-14T06:09:18.6383735Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-03-14T06:09:18.6450321Z Entering 'third_party/kleidiai' 2025-03-14T06:09:18.6516251Z Entering 'third_party/mimalloc' 2025-03-14T06:09:18.6580359Z Entering 'third_party/nlohmann' 2025-03-14T06:09:18.6645249Z Entering 'third_party/onnx' 2025-03-14T06:09:18.6724619Z Entering 'third_party/onnx/third_party/pybind11' 2025-03-14T06:09:18.6791248Z Entering 'third_party/opentelemetry-cpp' 2025-03-14T06:09:18.6857417Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-03-14T06:09:18.6919801Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-03-14T06:09:18.6983015Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-03-14T06:09:18.7045737Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-03-14T06:09:18.7109692Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-03-14T06:09:18.7172773Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-03-14T06:09:18.7235950Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-03-14T06:09:18.7297536Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-03-14T06:09:18.7363803Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-03-14T06:09:18.7429171Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-03-14T06:09:18.7516634Z Entering 'third_party/pocketfft' 2025-03-14T06:09:18.7580451Z Entering 'third_party/protobuf' 2025-03-14T06:09:18.7647810Z Entering 'third_party/protobuf/third_party/benchmark' 2025-03-14T06:09:18.7710883Z Entering 'third_party/protobuf/third_party/googletest' 2025-03-14T06:09:18.7777259Z Entering 'third_party/psimd' 2025-03-14T06:09:18.7844175Z Entering 'third_party/pthreadpool' 2025-03-14T06:09:18.7907318Z Entering 'third_party/pybind11' 2025-03-14T06:09:18.7971317Z Entering 'third_party/python-peachpy' 2025-03-14T06:09:18.8035222Z Entering 'third_party/sleef' 2025-03-14T06:09:18.8098843Z Entering 'third_party/tensorpipe' 2025-03-14T06:09:18.8163285Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-03-14T06:09:18.8225855Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-03-14T06:09:18.8288388Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-03-14T06:09:18.8351837Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-03-14T06:09:18.8413925Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-03-14T06:09:18.8499129Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local 'http.https://github.com/.extraheader' 'AUTHORIZATION: basic ***' && git config --local --show-origin --name-only --get-regexp remote.origin.url" 2025-03-14T06:09:18.8835493Z Entering 'android/libs/fbjni' 2025-03-14T06:09:18.8894677Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/android/libs/fbjni/config remote.origin.url 2025-03-14T06:09:18.8913464Z Entering 'third_party/FP16' 2025-03-14T06:09:18.8975784Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FP16/config remote.origin.url 2025-03-14T06:09:18.8994948Z Entering 'third_party/FXdiv' 2025-03-14T06:09:18.9055472Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FXdiv/config remote.origin.url 2025-03-14T06:09:18.9073975Z Entering 'third_party/NNPACK' 2025-03-14T06:09:18.9134052Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/NNPACK/config remote.origin.url 2025-03-14T06:09:18.9153111Z Entering 'third_party/NVTX' 2025-03-14T06:09:18.9212259Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/NVTX/config remote.origin.url 2025-03-14T06:09:18.9232611Z Entering 'third_party/VulkanMemoryAllocator' 2025-03-14T06:09:18.9292695Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/VulkanMemoryAllocator/config remote.origin.url 2025-03-14T06:09:18.9311679Z Entering 'third_party/XNNPACK' 2025-03-14T06:09:18.9373151Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/XNNPACK/config remote.origin.url 2025-03-14T06:09:18.9408323Z Entering 'third_party/benchmark' 2025-03-14T06:09:18.9468801Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/benchmark/config remote.origin.url 2025-03-14T06:09:18.9487964Z Entering 'third_party/composable_kernel' 2025-03-14T06:09:18.9551298Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/composable_kernel/config remote.origin.url 2025-03-14T06:09:18.9576791Z Entering 'third_party/cpp-httplib' 2025-03-14T06:09:18.9637450Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/cpp-httplib/config remote.origin.url 2025-03-14T06:09:18.9656087Z Entering 'third_party/cpuinfo' 2025-03-14T06:09:18.9716279Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/cpuinfo/config remote.origin.url 2025-03-14T06:09:18.9737474Z Entering 'third_party/cudnn_frontend' 2025-03-14T06:09:18.9798818Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/cudnn_frontend/config remote.origin.url 2025-03-14T06:09:18.9817810Z Entering 'third_party/cutlass' 2025-03-14T06:09:18.9878326Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/cutlass/config remote.origin.url 2025-03-14T06:09:18.9907262Z Entering 'third_party/eigen' 2025-03-14T06:09:18.9968340Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/eigen/config remote.origin.url 2025-03-14T06:09:18.9989940Z Entering 'third_party/fbgemm' 2025-03-14T06:09:19.0054417Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/fbgemm/config remote.origin.url 2025-03-14T06:09:19.0069679Z Entering 'third_party/fbgemm/third_party/asmjit' 2025-03-14T06:09:19.0131419Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/asmjit/config remote.origin.url 2025-03-14T06:09:19.0149615Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2025-03-14T06:09:19.0208544Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cpuinfo/config remote.origin.url 2025-03-14T06:09:19.0227892Z Entering 'third_party/fbgemm/third_party/cutlass' 2025-03-14T06:09:19.0287846Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cutlass/config remote.origin.url 2025-03-14T06:09:19.0313331Z Entering 'third_party/fbgemm/third_party/googletest' 2025-03-14T06:09:19.0373497Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/googletest/config remote.origin.url 2025-03-14T06:09:19.0392364Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2025-03-14T06:09:19.0453262Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/hipify_torch/config remote.origin.url 2025-03-14T06:09:19.0473187Z Entering 'third_party/flash-attention' 2025-03-14T06:09:19.0532519Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/flash-attention/config remote.origin.url 2025-03-14T06:09:19.0552168Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-03-14T06:09:19.0611200Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/flash-attention/modules/csrc/composable_kernel/config remote.origin.url 2025-03-14T06:09:19.0637466Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-03-14T06:09:19.0695952Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/flash-attention/modules/csrc/cutlass/config remote.origin.url 2025-03-14T06:09:19.0725370Z Entering 'third_party/flatbuffers' 2025-03-14T06:09:19.0785823Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/flatbuffers/config remote.origin.url 2025-03-14T06:09:19.0807348Z Entering 'third_party/fmt' 2025-03-14T06:09:19.0866962Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/fmt/config remote.origin.url 2025-03-14T06:09:19.0885875Z Entering 'third_party/gemmlowp/gemmlowp' 2025-03-14T06:09:19.0945579Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/gemmlowp/gemmlowp/config remote.origin.url 2025-03-14T06:09:19.0964477Z Entering 'third_party/gloo' 2025-03-14T06:09:19.1024535Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/gloo/config remote.origin.url 2025-03-14T06:09:19.1043868Z Entering 'third_party/googletest' 2025-03-14T06:09:19.1103833Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/googletest/config remote.origin.url 2025-03-14T06:09:19.1122856Z Entering 'third_party/ideep' 2025-03-14T06:09:19.1182358Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/ideep/config remote.origin.url 2025-03-14T06:09:19.1199649Z Entering 'third_party/ideep/mkl-dnn' 2025-03-14T06:09:19.1259177Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/ideep/modules/mkl-dnn/config remote.origin.url 2025-03-14T06:09:19.1286132Z Entering 'third_party/ittapi' 2025-03-14T06:09:19.1348403Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/ittapi/config remote.origin.url 2025-03-14T06:09:19.1367079Z Entering 'third_party/kineto' 2025-03-14T06:09:19.1427047Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/kineto/config remote.origin.url 2025-03-14T06:09:19.1445538Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-03-14T06:09:19.1506538Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/config remote.origin.url 2025-03-14T06:09:19.1524812Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-03-14T06:09:19.1586454Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/DCGM/config remote.origin.url 2025-03-14T06:09:19.1606377Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-03-14T06:09:19.1669364Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/cpr/config remote.origin.url 2025-03-14T06:09:19.1688003Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-03-14T06:09:19.1749886Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/fmt/config remote.origin.url 2025-03-14T06:09:19.1769760Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-03-14T06:09:19.1832555Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/config remote.origin.url 2025-03-14T06:09:19.1849389Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-03-14T06:09:19.1909645Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/modules/doc/config remote.origin.url 2025-03-14T06:09:19.1930913Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-03-14T06:09:19.1991324Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/glog/config remote.origin.url 2025-03-14T06:09:19.2010099Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-03-14T06:09:19.2071373Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/googletest/config remote.origin.url 2025-03-14T06:09:19.2089997Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-03-14T06:09:19.2150745Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/json/config remote.origin.url 2025-03-14T06:09:19.2170381Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-03-14T06:09:19.2231260Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/pfs/config remote.origin.url 2025-03-14T06:09:19.2251626Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-03-14T06:09:19.2310681Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/fmt/config remote.origin.url 2025-03-14T06:09:19.2330712Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-03-14T06:09:19.2389783Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/googletest/config remote.origin.url 2025-03-14T06:09:19.2409924Z Entering 'third_party/kleidiai' 2025-03-14T06:09:19.2470951Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/kleidiai/config remote.origin.url 2025-03-14T06:09:19.2490028Z Entering 'third_party/mimalloc' 2025-03-14T06:09:19.2549993Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/mimalloc/config remote.origin.url 2025-03-14T06:09:19.2569123Z Entering 'third_party/nlohmann' 2025-03-14T06:09:19.2628773Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/nlohmann/config remote.origin.url 2025-03-14T06:09:19.2649212Z Entering 'third_party/onnx' 2025-03-14T06:09:19.2708710Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/onnx/config remote.origin.url 2025-03-14T06:09:19.2745374Z Entering 'third_party/onnx/third_party/pybind11' 2025-03-14T06:09:19.2805647Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/pybind11/config remote.origin.url 2025-03-14T06:09:19.2827173Z Entering 'third_party/opentelemetry-cpp' 2025-03-14T06:09:19.2887586Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/config remote.origin.url 2025-03-14T06:09:19.2907482Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-03-14T06:09:19.2967357Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/benchmark/config remote.origin.url 2025-03-14T06:09:19.2985813Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-03-14T06:09:19.3046418Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/googletest/config remote.origin.url 2025-03-14T06:09:19.3064602Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-03-14T06:09:19.3124093Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/ms-gsl/config remote.origin.url 2025-03-14T06:09:19.3143028Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-03-14T06:09:19.3202234Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/nlohmann-json/config remote.origin.url 2025-03-14T06:09:19.3222072Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-03-14T06:09:19.3282927Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentelemetry-proto/config remote.origin.url 2025-03-14T06:09:19.3301299Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-03-14T06:09:19.3361158Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentracing-cpp/config remote.origin.url 2025-03-14T06:09:19.3379865Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-03-14T06:09:19.3441098Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/config remote.origin.url 2025-03-14T06:09:19.3458648Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-03-14T06:09:19.3519520Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/civetweb/config remote.origin.url 2025-03-14T06:09:19.3540924Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-03-14T06:09:19.3600881Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/googletest/config remote.origin.url 2025-03-14T06:09:19.3620924Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-03-14T06:09:19.3681502Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/tools/vcpkg/config remote.origin.url 2025-03-14T06:09:19.3723061Z Entering 'third_party/pocketfft' 2025-03-14T06:09:19.3783085Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/pocketfft/config remote.origin.url 2025-03-14T06:09:19.3801567Z Entering 'third_party/protobuf' 2025-03-14T06:09:19.3863056Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/protobuf/config remote.origin.url 2025-03-14T06:09:19.3884926Z Entering 'third_party/protobuf/third_party/benchmark' 2025-03-14T06:09:19.3945110Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/benchmark/config remote.origin.url 2025-03-14T06:09:19.3963283Z Entering 'third_party/protobuf/third_party/googletest' 2025-03-14T06:09:19.4023694Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/googletest/config remote.origin.url 2025-03-14T06:09:19.4044870Z Entering 'third_party/psimd' 2025-03-14T06:09:19.4104426Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/psimd/config remote.origin.url 2025-03-14T06:09:19.4123311Z Entering 'third_party/pthreadpool' 2025-03-14T06:09:19.4183523Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/pthreadpool/config remote.origin.url 2025-03-14T06:09:19.4202241Z Entering 'third_party/pybind11' 2025-03-14T06:09:19.4262746Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/pybind11/config remote.origin.url 2025-03-14T06:09:19.4281776Z Entering 'third_party/python-peachpy' 2025-03-14T06:09:19.4341846Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/python-peachpy/config remote.origin.url 2025-03-14T06:09:19.4360535Z Entering 'third_party/sleef' 2025-03-14T06:09:19.4420349Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/sleef/config remote.origin.url 2025-03-14T06:09:19.4440129Z Entering 'third_party/tensorpipe' 2025-03-14T06:09:19.4499264Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/tensorpipe/config remote.origin.url 2025-03-14T06:09:19.4517448Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-03-14T06:09:19.4577577Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/googletest/config remote.origin.url 2025-03-14T06:09:19.4596155Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-03-14T06:09:19.4657318Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libnop/config remote.origin.url 2025-03-14T06:09:19.4674828Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-03-14T06:09:19.4735116Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libuv/config remote.origin.url 2025-03-14T06:09:19.4753721Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-03-14T06:09:19.4812946Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/config remote.origin.url 2025-03-14T06:09:19.4831617Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-03-14T06:09:19.4891609Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/modules/tools/clang/config remote.origin.url 2025-03-14T06:09:19.6102462Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'git@github.com:' 2025-03-14T06:09:19.6438740Z Entering 'android/libs/fbjni' 2025-03-14T06:09:19.6488022Z Entering 'third_party/FP16' 2025-03-14T06:09:19.6537173Z Entering 'third_party/FXdiv' 2025-03-14T06:09:19.6585743Z Entering 'third_party/NNPACK' 2025-03-14T06:09:19.6635510Z Entering 'third_party/NVTX' 2025-03-14T06:09:19.6684938Z Entering 'third_party/VulkanMemoryAllocator' 2025-03-14T06:09:19.6734728Z Entering 'third_party/XNNPACK' 2025-03-14T06:09:19.6799304Z Entering 'third_party/benchmark' 2025-03-14T06:09:19.6849112Z Entering 'third_party/composable_kernel' 2025-03-14T06:09:19.6904960Z Entering 'third_party/cpp-httplib' 2025-03-14T06:09:19.6955918Z Entering 'third_party/cpuinfo' 2025-03-14T06:09:19.7005287Z Entering 'third_party/cudnn_frontend' 2025-03-14T06:09:19.7056370Z Entering 'third_party/cutlass' 2025-03-14T06:09:19.7113322Z Entering 'third_party/eigen' 2025-03-14T06:09:19.7165522Z Entering 'third_party/fbgemm' 2025-03-14T06:09:19.7214702Z Entering 'third_party/fbgemm/third_party/asmjit' 2025-03-14T06:09:19.7262934Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2025-03-14T06:09:19.7311208Z Entering 'third_party/fbgemm/third_party/cutlass' 2025-03-14T06:09:19.7367321Z Entering 'third_party/fbgemm/third_party/googletest' 2025-03-14T06:09:19.7415512Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2025-03-14T06:09:19.7465140Z Entering 'third_party/flash-attention' 2025-03-14T06:09:19.7514763Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-03-14T06:09:19.7569387Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-03-14T06:09:19.7630054Z Entering 'third_party/flatbuffers' 2025-03-14T06:09:19.7681955Z Entering 'third_party/fmt' 2025-03-14T06:09:19.7731837Z Entering 'third_party/gemmlowp/gemmlowp' 2025-03-14T06:09:19.7781606Z Entering 'third_party/gloo' 2025-03-14T06:09:19.7832886Z Entering 'third_party/googletest' 2025-03-14T06:09:19.7881478Z Entering 'third_party/ideep' 2025-03-14T06:09:19.7929847Z Entering 'third_party/ideep/mkl-dnn' 2025-03-14T06:09:19.7987809Z Entering 'third_party/ittapi' 2025-03-14T06:09:19.8038405Z Entering 'third_party/kineto' 2025-03-14T06:09:19.8086297Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-03-14T06:09:19.8135286Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-03-14T06:09:19.8186306Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-03-14T06:09:19.8236325Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-03-14T06:09:19.8284809Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-03-14T06:09:19.8333953Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-03-14T06:09:19.8385247Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-03-14T06:09:19.8435553Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-03-14T06:09:19.8483891Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-03-14T06:09:19.8536229Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-03-14T06:09:19.8586918Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-03-14T06:09:19.8635731Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-03-14T06:09:19.8684795Z Entering 'third_party/kleidiai' 2025-03-14T06:09:19.8736814Z Entering 'third_party/mimalloc' 2025-03-14T06:09:19.8785311Z Entering 'third_party/nlohmann' 2025-03-14T06:09:19.8837370Z Entering 'third_party/onnx' 2025-03-14T06:09:19.8905078Z Entering 'third_party/onnx/third_party/pybind11' 2025-03-14T06:09:19.8957388Z Entering 'third_party/opentelemetry-cpp' 2025-03-14T06:09:19.9008271Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-03-14T06:09:19.9058252Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-03-14T06:09:19.9106182Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-03-14T06:09:19.9155213Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-03-14T06:09:19.9205168Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-03-14T06:09:19.9254414Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-03-14T06:09:19.9302263Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-03-14T06:09:19.9351165Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-03-14T06:09:19.9401143Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-03-14T06:09:19.9451859Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-03-14T06:09:19.9523295Z Entering 'third_party/pocketfft' 2025-03-14T06:09:19.9572453Z Entering 'third_party/protobuf' 2025-03-14T06:09:19.9623575Z Entering 'third_party/protobuf/third_party/benchmark' 2025-03-14T06:09:19.9672738Z Entering 'third_party/protobuf/third_party/googletest' 2025-03-14T06:09:19.9722209Z Entering 'third_party/psimd' 2025-03-14T06:09:19.9773166Z Entering 'third_party/pthreadpool' 2025-03-14T06:09:19.9822768Z Entering 'third_party/pybind11' 2025-03-14T06:09:19.9872757Z Entering 'third_party/python-peachpy' 2025-03-14T06:09:19.9921148Z Entering 'third_party/sleef' 2025-03-14T06:09:19.9971011Z Entering 'third_party/tensorpipe' 2025-03-14T06:09:20.0019314Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-03-14T06:09:20.0067658Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-03-14T06:09:20.0115266Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-03-14T06:09:20.0164128Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-03-14T06:09:20.0210520Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-03-14T06:09:20.0278735Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'org-21003710@github.com:' 2025-03-14T06:09:20.0619817Z Entering 'android/libs/fbjni' 2025-03-14T06:09:20.0670518Z Entering 'third_party/FP16' 2025-03-14T06:09:20.0719556Z Entering 'third_party/FXdiv' 2025-03-14T06:09:20.0769600Z Entering 'third_party/NNPACK' 2025-03-14T06:09:20.0819010Z Entering 'third_party/NVTX' 2025-03-14T06:09:20.0869919Z Entering 'third_party/VulkanMemoryAllocator' 2025-03-14T06:09:20.0918857Z Entering 'third_party/XNNPACK' 2025-03-14T06:09:20.0985162Z Entering 'third_party/benchmark' 2025-03-14T06:09:20.1036665Z Entering 'third_party/composable_kernel' 2025-03-14T06:09:20.1093419Z Entering 'third_party/cpp-httplib' 2025-03-14T06:09:20.1143049Z Entering 'third_party/cpuinfo' 2025-03-14T06:09:20.1194194Z Entering 'third_party/cudnn_frontend' 2025-03-14T06:09:20.1244172Z Entering 'third_party/cutlass' 2025-03-14T06:09:20.1301495Z Entering 'third_party/eigen' 2025-03-14T06:09:20.1353932Z Entering 'third_party/fbgemm' 2025-03-14T06:09:20.1403698Z Entering 'third_party/fbgemm/third_party/asmjit' 2025-03-14T06:09:20.1453017Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2025-03-14T06:09:20.1501549Z Entering 'third_party/fbgemm/third_party/cutlass' 2025-03-14T06:09:20.1557994Z Entering 'third_party/fbgemm/third_party/googletest' 2025-03-14T06:09:20.1606142Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2025-03-14T06:09:20.1656384Z Entering 'third_party/flash-attention' 2025-03-14T06:09:20.1705799Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-03-14T06:09:20.1761065Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-03-14T06:09:20.1821436Z Entering 'third_party/flatbuffers' 2025-03-14T06:09:20.1875801Z Entering 'third_party/fmt' 2025-03-14T06:09:20.1925378Z Entering 'third_party/gemmlowp/gemmlowp' 2025-03-14T06:09:20.1976242Z Entering 'third_party/gloo' 2025-03-14T06:09:20.2025211Z Entering 'third_party/googletest' 2025-03-14T06:09:20.2076150Z Entering 'third_party/ideep' 2025-03-14T06:09:20.2123970Z Entering 'third_party/ideep/mkl-dnn' 2025-03-14T06:09:20.2180838Z Entering 'third_party/ittapi' 2025-03-14T06:09:20.2231055Z Entering 'third_party/kineto' 2025-03-14T06:09:20.2279677Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-03-14T06:09:20.2328311Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-03-14T06:09:20.2378812Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-03-14T06:09:20.2427517Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-03-14T06:09:20.2476193Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-03-14T06:09:20.2524031Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-03-14T06:09:20.2576212Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-03-14T06:09:20.2624857Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-03-14T06:09:20.2675572Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-03-14T06:09:20.2726843Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-03-14T06:09:20.2777861Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-03-14T06:09:20.2825484Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-03-14T06:09:20.2876369Z Entering 'third_party/kleidiai' 2025-03-14T06:09:20.2925328Z Entering 'third_party/mimalloc' 2025-03-14T06:09:20.2975510Z Entering 'third_party/nlohmann' 2025-03-14T06:09:20.3025752Z Entering 'third_party/onnx' 2025-03-14T06:09:20.3092084Z Entering 'third_party/onnx/third_party/pybind11' 2025-03-14T06:09:20.3143610Z Entering 'third_party/opentelemetry-cpp' 2025-03-14T06:09:20.3194439Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-03-14T06:09:20.3243091Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-03-14T06:09:20.3290702Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-03-14T06:09:20.3339481Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-03-14T06:09:20.3388069Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-03-14T06:09:20.3436968Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-03-14T06:09:20.3484704Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-03-14T06:09:20.3532534Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-03-14T06:09:20.3583567Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-03-14T06:09:20.3634464Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-03-14T06:09:20.3705774Z Entering 'third_party/pocketfft' 2025-03-14T06:09:20.3755610Z Entering 'third_party/protobuf' 2025-03-14T06:09:20.3809746Z Entering 'third_party/protobuf/third_party/benchmark' 2025-03-14T06:09:20.3859353Z Entering 'third_party/protobuf/third_party/googletest' 2025-03-14T06:09:20.3909895Z Entering 'third_party/psimd' 2025-03-14T06:09:20.3961419Z Entering 'third_party/pthreadpool' 2025-03-14T06:09:20.4011041Z Entering 'third_party/pybind11' 2025-03-14T06:09:20.4061810Z Entering 'third_party/python-peachpy' 2025-03-14T06:09:20.4111403Z Entering 'third_party/sleef' 2025-03-14T06:09:20.4164215Z Entering 'third_party/tensorpipe' 2025-03-14T06:09:20.4213495Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-03-14T06:09:20.4263745Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-03-14T06:09:20.4311199Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-03-14T06:09:20.4360223Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-03-14T06:09:20.4406745Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-03-14T06:09:20.4470243Z ##[endgroup] 2025-03-14T06:09:20.4511119Z [command]/usr/bin/git log -1 --format=%H 2025-03-14T06:09:20.4535708Z aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:09:20.4645995Z ##[group]Run # Remove any artifacts from the previous checkouts 2025-03-14T06:09:20.4646679Z # Remove any artifacts from the previous checkouts 2025-03-14T06:09:20.4647178Z git clean -fxd 2025-03-14T06:09:20.4654810Z shell: /usr/bin/bash -e {0} 2025-03-14T06:09:20.4655175Z env: 2025-03-14T06:09:20.4655491Z PYTORCH_ROOT: /pytorch 2025-03-14T06:09:20.4655870Z PACKAGE_TYPE: manywheel 2025-03-14T06:09:20.4656236Z DESIRED_CUDA: cu126 2025-03-14T06:09:20.4656586Z GPU_ARCH_VERSION: 12.6 2025-03-14T06:09:20.4656942Z GPU_ARCH_TYPE: cuda 2025-03-14T06:09:20.4657378Z DOCKER_IMAGE: pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:09:20.4657874Z SKIP_ALL_TESTS: 1 2025-03-14T06:09:20.4658205Z LIBTORCH_CONFIG: 2025-03-14T06:09:20.4658531Z LIBTORCH_VARIANT: 2025-03-14T06:09:20.4658868Z DESIRED_DEVTOOLSET: cxx11-abi 2025-03-14T06:09:20.4659250Z DESIRED_PYTHON: 3.9 2025-03-14T06:09:20.4659817Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2025-03-14T06:09:20.4660392Z AWS_DEFAULT_REGION: us-east-1 2025-03-14T06:09:20.4660762Z BINARY_ENV_FILE: /tmp/env 2025-03-14T06:09:20.4661167Z BUILD_ENVIRONMENT: linux-binary-manywheel 2025-03-14T06:09:20.4661782Z GITHUB_TOKEN: *** 2025-03-14T06:09:20.4662114Z PR_NUMBER: 2025-03-14T06:09:20.4662453Z PYTORCH_FINAL_PACKAGE_DIR: /artifacts 2025-03-14T06:09:20.4662907Z SHA1: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:09:20.4663345Z USE_SPLIT_BUILD: false 2025-03-14T06:09:20.4663694Z ##[endgroup] 2025-03-14T06:09:20.5026075Z Prepare all required actions 2025-03-14T06:09:20.5027221Z Getting action download info 2025-03-14T06:09:20.6413586Z ##[group]Run ./pytorch/.github/actions/filter-test-configs 2025-03-14T06:09:20.6414055Z with: 2025-03-14T06:09:20.6414523Z github-token: *** 2025-03-14T06:09:20.6414928Z test-matrix: { include: [ { config: "default" }, ]} 2025-03-14T06:09:20.6415382Z env: 2025-03-14T06:09:20.6415685Z PYTORCH_ROOT: /pytorch 2025-03-14T06:09:20.6416049Z PACKAGE_TYPE: manywheel 2025-03-14T06:09:20.6416392Z DESIRED_CUDA: cu126 2025-03-14T06:09:20.6416733Z GPU_ARCH_VERSION: 12.6 2025-03-14T06:09:20.6417091Z GPU_ARCH_TYPE: cuda 2025-03-14T06:09:20.6417525Z DOCKER_IMAGE: pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:09:20.6418015Z SKIP_ALL_TESTS: 1 2025-03-14T06:09:20.6418322Z LIBTORCH_CONFIG: 2025-03-14T06:09:20.6418649Z LIBTORCH_VARIANT: 2025-03-14T06:09:20.6419004Z DESIRED_DEVTOOLSET: cxx11-abi 2025-03-14T06:09:20.6419388Z DESIRED_PYTHON: 3.9 2025-03-14T06:09:20.6419951Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2025-03-14T06:09:20.6420537Z AWS_DEFAULT_REGION: us-east-1 2025-03-14T06:09:20.6420928Z BINARY_ENV_FILE: /tmp/env 2025-03-14T06:09:20.6421320Z BUILD_ENVIRONMENT: linux-binary-manywheel 2025-03-14T06:09:20.6421898Z GITHUB_TOKEN: *** 2025-03-14T06:09:20.6422225Z PR_NUMBER: 2025-03-14T06:09:20.6422570Z PYTORCH_FINAL_PACKAGE_DIR: /artifacts 2025-03-14T06:09:20.6423086Z SHA1: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:09:20.6423510Z USE_SPLIT_BUILD: false 2025-03-14T06:09:20.6423869Z ##[endgroup] 2025-03-14T06:09:20.6476686Z ##[group]Run nick-fields/retry@v3.0.0 2025-03-14T06:09:20.6477075Z with: 2025-03-14T06:09:20.6477368Z shell: bash 2025-03-14T06:09:20.6477682Z timeout_minutes: 10 2025-03-14T06:09:20.6478018Z max_attempts: 5 2025-03-14T06:09:20.6478351Z retry_wait_seconds: 30 2025-03-14T06:09:20.6479320Z command: set -eux # PyYAML 6.0 doesn't work with MacOS x86 anymore # This must run on Python-3.7 (AmazonLinux2) so can't use request=3.32.2 python3 -m pip install requests==2.27.1 pyyaml==6.0.1 2025-03-14T06:09:20.6480530Z polling_interval_seconds: 1 2025-03-14T06:09:20.6480915Z warning_on_retry: true 2025-03-14T06:09:20.6481278Z continue_on_error: false 2025-03-14T06:09:20.6481636Z env: 2025-03-14T06:09:20.6481938Z PYTORCH_ROOT: /pytorch 2025-03-14T06:09:20.6482287Z PACKAGE_TYPE: manywheel 2025-03-14T06:09:20.6482649Z DESIRED_CUDA: cu126 2025-03-14T06:09:20.6482997Z GPU_ARCH_VERSION: 12.6 2025-03-14T06:09:20.6483348Z GPU_ARCH_TYPE: cuda 2025-03-14T06:09:20.6483781Z DOCKER_IMAGE: pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:09:20.6484354Z SKIP_ALL_TESTS: 1 2025-03-14T06:09:20.6484690Z LIBTORCH_CONFIG: 2025-03-14T06:09:20.6485025Z LIBTORCH_VARIANT: 2025-03-14T06:09:20.6485384Z DESIRED_DEVTOOLSET: cxx11-abi 2025-03-14T06:09:20.6485827Z DESIRED_PYTHON: 3.9 2025-03-14T06:09:20.6486418Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2025-03-14T06:09:20.6487002Z AWS_DEFAULT_REGION: us-east-1 2025-03-14T06:09:20.6487394Z BINARY_ENV_FILE: /tmp/env 2025-03-14T06:09:20.6487809Z BUILD_ENVIRONMENT: linux-binary-manywheel 2025-03-14T06:09:20.6488443Z GITHUB_TOKEN: *** 2025-03-14T06:09:20.6488784Z PR_NUMBER: 2025-03-14T06:09:20.6489107Z PYTORCH_FINAL_PACKAGE_DIR: /artifacts 2025-03-14T06:09:20.6489561Z SHA1: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:09:20.6490054Z USE_SPLIT_BUILD: false 2025-03-14T06:09:20.6490409Z ##[endgroup] 2025-03-14T06:09:20.7734388Z + python3 -m pip install requests==2.27.1 pyyaml==6.0.1 2025-03-14T06:09:21.0900639Z Defaulting to user installation because normal site-packages is not writeable 2025-03-14T06:09:21.1099375Z Requirement already satisfied: requests==2.27.1 in /home/ec2-user/.local/lib/python3.9/site-packages (2.27.1) 2025-03-14T06:09:21.1106454Z Requirement already satisfied: pyyaml==6.0.1 in /home/ec2-user/.local/lib/python3.9/site-packages (6.0.1) 2025-03-14T06:09:21.1256218Z Requirement already satisfied: urllib3<1.27,>=1.21.1 in /usr/lib/python3.9/site-packages (from requests==2.27.1) (1.25.10) 2025-03-14T06:09:21.1269673Z Requirement already satisfied: idna<4,>=2.5 in /usr/lib/python3.9/site-packages (from requests==2.27.1) (2.10) 2025-03-14T06:09:21.1275369Z Requirement already satisfied: certifi>=2017.4.17 in /home/ec2-user/.local/lib/python3.9/site-packages (from requests==2.27.1) (2025.1.31) 2025-03-14T06:09:21.1289672Z Requirement already satisfied: charset-normalizer~=2.0.0 in /home/ec2-user/.local/lib/python3.9/site-packages (from requests==2.27.1) (2.0.12) 2025-03-14T06:09:21.7530546Z Command completed after 1 attempt(s). 2025-03-14T06:09:21.7603344Z ##[group]Run set -x 2025-03-14T06:09:21.7603714Z set -x 2025-03-14T06:09:21.7604035Z  2025-03-14T06:09:21.7604521Z # Use relative path here as this could be checked out anywhere, not necessarily 2025-03-14T06:09:21.7605147Z # in runner workspace 2025-03-14T06:09:21.7605689Z python3 "${GITHUB_ACTION_PATH}/../../scripts/parse_ref.py" 2025-03-14T06:09:21.7613501Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T06:09:21.7613999Z env: 2025-03-14T06:09:21.7614316Z PYTORCH_ROOT: /pytorch 2025-03-14T06:09:21.7614675Z PACKAGE_TYPE: manywheel 2025-03-14T06:09:21.7615044Z DESIRED_CUDA: cu126 2025-03-14T06:09:21.7615391Z GPU_ARCH_VERSION: 12.6 2025-03-14T06:09:21.7615806Z GPU_ARCH_TYPE: cuda 2025-03-14T06:09:21.7616239Z DOCKER_IMAGE: pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:09:21.7616712Z SKIP_ALL_TESTS: 1 2025-03-14T06:09:21.7617044Z LIBTORCH_CONFIG: 2025-03-14T06:09:21.7617375Z LIBTORCH_VARIANT: 2025-03-14T06:09:21.7617733Z DESIRED_DEVTOOLSET: cxx11-abi 2025-03-14T06:09:21.7618111Z DESIRED_PYTHON: 3.9 2025-03-14T06:09:21.7618590Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2025-03-14T06:09:21.7619161Z AWS_DEFAULT_REGION: us-east-1 2025-03-14T06:09:21.7619557Z BINARY_ENV_FILE: /tmp/env 2025-03-14T06:09:21.7620168Z BUILD_ENVIRONMENT: linux-binary-manywheel 2025-03-14T06:09:21.7620799Z GITHUB_TOKEN: *** 2025-03-14T06:09:21.7621111Z PR_NUMBER: 2025-03-14T06:09:21.7621454Z PYTORCH_FINAL_PACKAGE_DIR: /artifacts 2025-03-14T06:09:21.7621913Z SHA1: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:09:21.7622356Z USE_SPLIT_BUILD: false 2025-03-14T06:09:21.7622709Z ##[endgroup] 2025-03-14T06:09:21.7653715Z + python3 /home/ec2-user/actions-runner/_work/pytorch/pytorch/./pytorch/.github/actions/filter-test-configs/../../scripts/parse_ref.py 2025-03-14T06:09:21.7964711Z ##[group]Run set -x 2025-03-14T06:09:21.7965103Z set -x 2025-03-14T06:09:21.7965403Z  2025-03-14T06:09:21.7965894Z # TODO: This is a very hacky way to get the job name. GitHub runner has the info 2025-03-14T06:09:21.7966651Z # but doesn't expose it in anyway. The job name is part of the job message the 2025-03-14T06:09:21.7967415Z # runner receives, so it's there and printed out to the diag log. Below is the 2025-03-14T06:09:21.7968208Z # code responsible for printing it. Need to check with GitHub to see if they can 2025-03-14T06:09:21.7968893Z # expose this variable as part of GitHub context. 2025-03-14T06:09:21.7969628Z # https://github.com/actions/runner/blob/main/src/Runner.Worker/JobExtension.cs#L345 2025-03-14T06:09:21.7970443Z pushd "/home/ec2-user/actions-runner/_work/pytorch/../../_diag" 2025-03-14T06:09:21.7970998Z pwd 2025-03-14T06:09:21.7971304Z  2025-03-14T06:09:21.7971820Z LOG_FILE=$(grep -l -r "aed0b7a742a2d7b7901790622829cbd2135049a4" *.log | tail -n 1) 2025-03-14T06:09:21.7972442Z if [ -n "${LOG_FILE}" ]; then 2025-03-14T06:09:21.7973034Z  # For some reasons, awk {print $2} on Linux and Windows (bash) work correctly while it 2025-03-14T06:09:21.7973684Z  # needs to be awk {print $3} on MacOS 2025-03-14T06:09:21.7974344Z  case ${RUNNER_OS} in 2025-03-14T06:09:21.7974763Z  macOS) 2025-03-14T06:09:21.7975343Z  JOB_NAME=$(grep -r "\"jobDisplayName\"" "${LOG_FILE}" | awk -F '[:]' '{print $3}' | sed 's/"//g' | xargs) 2025-03-14T06:09:21.7975977Z  ;; 2025-03-14T06:09:21.7976274Z  *) 2025-03-14T06:09:21.7976822Z  JOB_NAME=$(grep -r "\"jobDisplayName\"" "${LOG_FILE}" | awk -F '[:]' '{print $2}' | sed 's/"//g' | xargs) 2025-03-14T06:09:21.7977442Z  ;; 2025-03-14T06:09:21.7977750Z  esac 2025-03-14T06:09:21.7978148Z  echo "job-name=${JOB_NAME}" >> "${GITHUB_OUTPUT}" 2025-03-14T06:09:21.7978592Z fi 2025-03-14T06:09:21.7978886Z  2025-03-14T06:09:21.7979176Z popd 2025-03-14T06:09:21.7985680Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T06:09:21.7986171Z env: 2025-03-14T06:09:21.7986459Z PYTORCH_ROOT: /pytorch 2025-03-14T06:09:21.7986826Z PACKAGE_TYPE: manywheel 2025-03-14T06:09:21.7987202Z DESIRED_CUDA: cu126 2025-03-14T06:09:21.7987545Z GPU_ARCH_VERSION: 12.6 2025-03-14T06:09:21.7987895Z GPU_ARCH_TYPE: cuda 2025-03-14T06:09:21.7988315Z DOCKER_IMAGE: pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:09:21.7988811Z SKIP_ALL_TESTS: 1 2025-03-14T06:09:21.7989138Z LIBTORCH_CONFIG: 2025-03-14T06:09:21.7989467Z LIBTORCH_VARIANT: 2025-03-14T06:09:21.7989817Z DESIRED_DEVTOOLSET: cxx11-abi 2025-03-14T06:09:21.7990183Z DESIRED_PYTHON: 3.9 2025-03-14T06:09:21.7990678Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2025-03-14T06:09:21.7991252Z AWS_DEFAULT_REGION: us-east-1 2025-03-14T06:09:21.7991639Z BINARY_ENV_FILE: /tmp/env 2025-03-14T06:09:21.7992046Z BUILD_ENVIRONMENT: linux-binary-manywheel 2025-03-14T06:09:21.7992636Z GITHUB_TOKEN: *** 2025-03-14T06:09:21.7992951Z PR_NUMBER: 2025-03-14T06:09:21.7993293Z PYTORCH_FINAL_PACKAGE_DIR: /artifacts 2025-03-14T06:09:21.7993759Z SHA1: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:09:21.7994389Z USE_SPLIT_BUILD: false 2025-03-14T06:09:21.7994746Z ##[endgroup] 2025-03-14T06:09:21.8021416Z + pushd /home/ec2-user/actions-runner/_work/pytorch/../../_diag 2025-03-14T06:09:21.8022069Z ~/actions-runner/_diag ~/actions-runner/_work/pytorch/pytorch 2025-03-14T06:09:21.8022601Z /home/ec2-user/actions-runner/_diag 2025-03-14T06:09:21.8023040Z + pwd 2025-03-14T06:09:21.8028885Z ++ grep -l -r aed0b7a742a2d7b7901790622829cbd2135049a4 Runner_20250314-045713-utc.log Runner_20250314-045925-utc.log Worker_20250314-051758-utc.log Worker_20250314-060648-utc.log 2025-03-14T06:09:21.8029887Z ++ tail -n 1 2025-03-14T06:09:21.8049682Z + LOG_FILE=Worker_20250314-060648-utc.log 2025-03-14T06:09:21.8050334Z + '[' -n Worker_20250314-060648-utc.log ']' 2025-03-14T06:09:21.8050798Z + case ${RUNNER_OS} in 2025-03-14T06:09:21.8056672Z ++ grep -r '"jobDisplayName"' Worker_20250314-060648-utc.log 2025-03-14T06:09:21.8057745Z ++ awk -F '[:]' '{print $2}' 2025-03-14T06:09:21.8058663Z ++ sed 's/"//g' 2025-03-14T06:09:21.8059910Z ++ xargs 2025-03-14T06:09:21.8093531Z + JOB_NAME='manywheel-py3_9-cuda12_6-test / test,' 2025-03-14T06:09:21.8094727Z + echo 'job-name=manywheel-py3_9-cuda12_6-test / test,' 2025-03-14T06:09:21.8095546Z + popd 2025-03-14T06:09:21.8095890Z ~/actions-runner/_work/pytorch/pytorch 2025-03-14T06:09:21.8156744Z ##[group]Run echo "Workflow: ${GITHUB_WORKFLOW}" 2025-03-14T06:09:21.8157376Z echo "Workflow: ${GITHUB_WORKFLOW}" 2025-03-14T06:09:21.8157815Z echo "Job name: ${JOB_NAME}" 2025-03-14T06:09:21.8158216Z  2025-03-14T06:09:21.8158716Z # Use relative path here as this could be checked out anywhere, not necessarily 2025-03-14T06:09:21.8159326Z # in runner workspace 2025-03-14T06:09:21.8159885Z python3 "${GITHUB_ACTION_PATH}/../../scripts/filter_test_configs.py" \ 2025-03-14T06:09:21.8160482Z  --workflow "${GITHUB_WORKFLOW}" \ 2025-03-14T06:09:21.8160931Z  --job-name "${JOB_NAME}" \ 2025-03-14T06:09:21.8161510Z  --test-matrix "{ include: [ 2025-03-14T06:09:21.8161956Z  { config: "default" }, 2025-03-14T06:09:21.8162340Z ]} 2025-03-14T06:09:21.8162642Z " \ 2025-03-14T06:09:21.8162974Z  --selected-test-configs "" \ 2025-03-14T06:09:21.8163423Z  --pr-number "${PR_NUMBER}" \ 2025-03-14T06:09:21.8163852Z  --tag "${TAG}" \ 2025-03-14T06:09:21.8164252Z  --event-name "${EVENT_NAME}" \ 2025-03-14T06:09:21.8164692Z  --schedule "${SCHEDULE}" \ 2025-03-14T06:09:21.8165102Z  --branch "${HEAD_BRANCH}" 2025-03-14T06:09:21.8171540Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T06:09:21.8172040Z env: 2025-03-14T06:09:21.8172353Z PYTORCH_ROOT: /pytorch 2025-03-14T06:09:21.8172731Z PACKAGE_TYPE: manywheel 2025-03-14T06:09:21.8173087Z DESIRED_CUDA: cu126 2025-03-14T06:09:21.8173437Z GPU_ARCH_VERSION: 12.6 2025-03-14T06:09:21.8173801Z GPU_ARCH_TYPE: cuda 2025-03-14T06:09:21.8174257Z DOCKER_IMAGE: pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:09:21.8174757Z SKIP_ALL_TESTS: 1 2025-03-14T06:09:21.8175081Z LIBTORCH_CONFIG: 2025-03-14T06:09:21.8175412Z LIBTORCH_VARIANT: 2025-03-14T06:09:21.8175769Z DESIRED_DEVTOOLSET: cxx11-abi 2025-03-14T06:09:21.8176161Z DESIRED_PYTHON: 3.9 2025-03-14T06:09:21.8176667Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2025-03-14T06:09:21.8177221Z AWS_DEFAULT_REGION: us-east-1 2025-03-14T06:09:21.8177612Z BINARY_ENV_FILE: /tmp/env 2025-03-14T06:09:21.8178026Z BUILD_ENVIRONMENT: linux-binary-manywheel 2025-03-14T06:09:21.8178623Z GITHUB_TOKEN: *** 2025-03-14T06:09:21.8178956Z PR_NUMBER: 2025-03-14T06:09:21.8179293Z PYTORCH_FINAL_PACKAGE_DIR: /artifacts 2025-03-14T06:09:21.8179736Z SHA1: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:09:21.8180181Z USE_SPLIT_BUILD: false 2025-03-14T06:09:21.8180587Z JOB_NAME: manywheel-py3_9-cuda12_6-test / test, 2025-03-14T06:09:21.8181198Z TAG: 2025-03-14T06:09:21.8181494Z EVENT_NAME: push 2025-03-14T06:09:21.8181800Z SCHEDULE: 2025-03-14T06:09:21.8182105Z HEAD_BRANCH: 2025-03-14T06:09:21.8182420Z ##[endgroup] 2025-03-14T06:09:21.8209141Z Workflow: linux-binary-manywheel 2025-03-14T06:09:21.8209615Z Job name: manywheel-py3_9-cuda12_6-test / test, 2025-03-14T06:09:22.0341452Z fatal: not a git repository (or any of the parent directories): .git 2025-03-14T06:09:22.0348289Z /home/ec2-user/actions-runner/_work/pytorch/pytorch/./pytorch/.github/actions/filter-test-configs/../../scripts/filter_test_configs.py:487: UserWarning: failed to get commit messages: Command '['git', 'cherry', '-v', 'origin/main']' returned non-zero exit status 128. 2025-03-14T06:09:22.0349800Z warnings.warn(f"failed to get commit messages: {e}") 2025-03-14T06:09:22.0498555Z ##[group]Run echo "Filtered matrix:" 2025-03-14T06:09:22.0499062Z echo "Filtered matrix:" 2025-03-14T06:09:22.0499501Z echo "{"include": [{"config": "default"}]}" 2025-03-14T06:09:22.0499983Z  2025-03-14T06:09:22.0500278Z echo 2025-03-14T06:09:22.0500650Z echo "Is the current job unstable? False" 2025-03-14T06:09:22.0501089Z  2025-03-14T06:09:22.0501364Z echo 2025-03-14T06:09:22.0501727Z echo "Is keep-going label set? False" 2025-03-14T06:09:22.0502151Z  2025-03-14T06:09:22.0502444Z echo 2025-03-14T06:09:22.0502773Z echo "Renabled issues? " 2025-03-14T06:09:22.0509298Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T06:09:22.0509792Z env: 2025-03-14T06:09:22.0510096Z PYTORCH_ROOT: /pytorch 2025-03-14T06:09:22.0510463Z PACKAGE_TYPE: manywheel 2025-03-14T06:09:22.0510904Z DESIRED_CUDA: cu126 2025-03-14T06:09:22.0511233Z GPU_ARCH_VERSION: 12.6 2025-03-14T06:09:22.0511592Z GPU_ARCH_TYPE: cuda 2025-03-14T06:09:22.0512040Z DOCKER_IMAGE: pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:09:22.0512532Z SKIP_ALL_TESTS: 1 2025-03-14T06:09:22.0513041Z LIBTORCH_CONFIG: 2025-03-14T06:09:22.0513396Z LIBTORCH_VARIANT: 2025-03-14T06:09:22.0513754Z DESIRED_DEVTOOLSET: cxx11-abi 2025-03-14T06:09:22.0514137Z DESIRED_PYTHON: 3.9 2025-03-14T06:09:22.0514631Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2025-03-14T06:09:22.0515188Z AWS_DEFAULT_REGION: us-east-1 2025-03-14T06:09:22.0515576Z BINARY_ENV_FILE: /tmp/env 2025-03-14T06:09:22.0515982Z BUILD_ENVIRONMENT: linux-binary-manywheel 2025-03-14T06:09:22.0516578Z GITHUB_TOKEN: *** 2025-03-14T06:09:22.0516905Z PR_NUMBER: 2025-03-14T06:09:22.0517244Z PYTORCH_FINAL_PACKAGE_DIR: /artifacts 2025-03-14T06:09:22.0517686Z SHA1: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:09:22.0518129Z USE_SPLIT_BUILD: false 2025-03-14T06:09:22.0518480Z ##[endgroup] 2025-03-14T06:09:22.0545620Z Filtered matrix: 2025-03-14T06:09:22.0546368Z {include: [{config: default}]} 2025-03-14T06:09:22.0547070Z 2025-03-14T06:09:22.0547265Z Is the current job unstable? False 2025-03-14T06:09:22.0547567Z 2025-03-14T06:09:22.0547729Z Is keep-going label set? False 2025-03-14T06:09:22.0547992Z 2025-03-14T06:09:22.0548130Z Renabled issues? 2025-03-14T06:09:22.0630498Z ##[group]Run actions/download-artifact@v4.1.7 2025-03-14T06:09:22.0630983Z with: 2025-03-14T06:09:22.0631314Z name: manywheel-py3_9-cuda12_6 2025-03-14T06:09:22.0631805Z path: /home/ec2-user/actions-runner/_work/_temp/artifacts/ 2025-03-14T06:09:22.0632309Z merge-multiple: false 2025-03-14T06:09:22.0632684Z repository: pytorch/pytorch 2025-03-14T06:09:22.0633041Z run-id: 13849515243 2025-03-14T06:09:22.0633365Z env: 2025-03-14T06:09:22.0633676Z PYTORCH_ROOT: /pytorch 2025-03-14T06:09:22.0634040Z PACKAGE_TYPE: manywheel 2025-03-14T06:09:22.0634398Z DESIRED_CUDA: cu126 2025-03-14T06:09:22.0634728Z GPU_ARCH_VERSION: 12.6 2025-03-14T06:09:22.0635082Z GPU_ARCH_TYPE: cuda 2025-03-14T06:09:22.0635515Z DOCKER_IMAGE: pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:09:22.0636003Z SKIP_ALL_TESTS: 1 2025-03-14T06:09:22.0636526Z LIBTORCH_CONFIG: 2025-03-14T06:09:22.0636843Z LIBTORCH_VARIANT: 2025-03-14T06:09:22.0637203Z DESIRED_DEVTOOLSET: cxx11-abi 2025-03-14T06:09:22.0637643Z DESIRED_PYTHON: 3.9 2025-03-14T06:09:22.0638144Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2025-03-14T06:09:22.0638706Z AWS_DEFAULT_REGION: us-east-1 2025-03-14T06:09:22.0639089Z BINARY_ENV_FILE: /tmp/env 2025-03-14T06:09:22.0639498Z BUILD_ENVIRONMENT: linux-binary-manywheel 2025-03-14T06:09:22.0640085Z GITHUB_TOKEN: *** 2025-03-14T06:09:22.0640413Z PR_NUMBER: 2025-03-14T06:09:22.0640750Z PYTORCH_FINAL_PACKAGE_DIR: /artifacts 2025-03-14T06:09:22.0641190Z SHA1: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:09:22.0641632Z USE_SPLIT_BUILD: false 2025-03-14T06:09:22.0641981Z ##[endgroup] 2025-03-14T06:09:22.3673674Z Downloading single artifact 2025-03-14T06:09:22.4723342Z Preparing to download the following artifacts: 2025-03-14T06:09:22.4723916Z - manywheel-py3_9-cuda12_6 (ID: 2750743564, Size: 852822756) 2025-03-14T06:09:22.5222448Z Redirecting to blob download url: https://productionresultssa15.blob.core.windows.net/actions-results/35d6eda5-c7ee-4425-987b-09bf93083985/workflow-job-run-f5a5a4f2-ff17-5c8d-3dfd-b2949333372a/artifacts/bfbaba16621466d21f7cdb40be1a35fb9464bc6e1c980050513f705a014cad99.zip 2025-03-14T06:09:22.5224355Z Starting download of artifact to: /home/ec2-user/actions-runner/_work/_temp/artifacts 2025-03-14T06:09:22.7008273Z (node:106462) [DEP0005] DeprecationWarning: Buffer() is deprecated due to security and usability issues. Please use the Buffer.alloc(), Buffer.allocUnsafe(), or Buffer.from() methods instead. 2025-03-14T06:09:22.7009530Z (Use `node --trace-deprecation ...` to show where the warning was created) 2025-03-14T06:09:38.0799800Z Artifact download completed successfully. 2025-03-14T06:09:38.0800324Z Total of 1 artifact(s) downloaded 2025-03-14T06:09:38.0808771Z Download artifact has finished successfully 2025-03-14T06:09:38.1142570Z ##[group]Run pytorch/test-infra/.github/actions/setup-nvidia@main 2025-03-14T06:09:38.1143178Z with: 2025-03-14T06:09:38.1143500Z driver-version: 550.54.15 2025-03-14T06:09:38.1143843Z env: 2025-03-14T06:09:38.1144152Z PYTORCH_ROOT: /pytorch 2025-03-14T06:09:38.1144522Z PACKAGE_TYPE: manywheel 2025-03-14T06:09:38.1144887Z DESIRED_CUDA: cu126 2025-03-14T06:09:38.1145233Z GPU_ARCH_VERSION: 12.6 2025-03-14T06:09:38.1145572Z GPU_ARCH_TYPE: cuda 2025-03-14T06:09:38.1146004Z DOCKER_IMAGE: pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:09:38.1146498Z SKIP_ALL_TESTS: 1 2025-03-14T06:09:38.1146831Z LIBTORCH_CONFIG: 2025-03-14T06:09:38.1147158Z LIBTORCH_VARIANT: 2025-03-14T06:09:38.1147500Z DESIRED_DEVTOOLSET: cxx11-abi 2025-03-14T06:09:38.1147887Z DESIRED_PYTHON: 3.9 2025-03-14T06:09:38.1148394Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2025-03-14T06:09:38.1148964Z AWS_DEFAULT_REGION: us-east-1 2025-03-14T06:09:38.1149403Z BINARY_ENV_FILE: /tmp/env 2025-03-14T06:09:38.1149827Z BUILD_ENVIRONMENT: linux-binary-manywheel 2025-03-14T06:09:38.1150445Z GITHUB_TOKEN: *** 2025-03-14T06:09:38.1150764Z PR_NUMBER: 2025-03-14T06:09:38.1151106Z PYTORCH_FINAL_PACKAGE_DIR: /artifacts 2025-03-14T06:09:38.1151561Z SHA1: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:09:38.1152007Z USE_SPLIT_BUILD: false 2025-03-14T06:09:38.1152362Z ##[endgroup] 2025-03-14T06:09:38.1201825Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2025-03-14T06:09:38.1202369Z with: 2025-03-14T06:09:38.1202682Z timeout_minutes: 10 2025-03-14T06:09:38.1203009Z max_attempts: 3 2025-03-14T06:09:38.1233252Z command: # Is it disgusting to have a full shell script here in this github action? Sure # But is it the best way to make it so that this action relies on nothing else? Absolutely set -eou pipefail DISTRIBUTION=$(. /etc/os-release;echo $ID$VERSION_ID) DRIVER_FN="NVIDIA-Linux-x86_64-${DRIVER_VERSION}.run" install_nvidia_docker2_amzn2() { ( set -x # Needed for yum-config-manager sudo yum install -y yum-utils if [[ "${DISTRIBUTION}" == "amzn2023" ]] ; then YUM_REPO_URL="https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo" else # Amazon Linux 2 YUM_REPO_URL="https://nvidia.github.io/nvidia-docker/${DISTRIBUTION}/nvidia-docker.repo" fi sudo yum-config-manager --add-repo "${YUM_REPO_URL}" sudo yum install -y nvidia-docker2 nvidia-container-toolkit-1.16.2 sudo systemctl restart docker ) } install_nvidia_docker2_ubuntu20() { ( set -x # Install nvidia-driver package if not installed status="$(dpkg-query -W --showformat='${db:Status-Status}' nvidia-docker2 2>&1)" if [ ! $? = 0 ] || [ ! "$status" = installed ]; then sudo apt-get install -y nvidia-docker2 nvidia-container-toolkit-1.16.2 sudo systemctl restart docker fi ) } pre_install_nvidia_driver_amzn2() { ( # Purge any nvidia driver installed from RHEL repo sudo yum remove -y nvidia-driver-latest-dkms ) } install_nvidia_driver_common() { ( # Try to gather more information about the runner and its existing NVIDIA driver if any echo "Before installing NVIDIA driver" lspci lsmod modinfo nvidia || true HAS_NVIDIA_DRIVER=0 # Check if NVIDIA driver has already been installed if [ -x "$(command -v nvidia-smi)" ]; then set +e # The driver exists, check its version next. Also check only the first GPU if there are more than one of them # so that the same driver version is not print over multiple lines INSTALLED_DRIVER_VERSION=$(nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0) NVIDIA_SMI_STATUS=$? if [ "$NVIDIA_SMI_STATUS" -ne 0 ] && [ "$NVIDIA_SMI_STATUS" -ne 14 ]; then echo "Failed to get NVIDIA driver version ($INSTALLED_DRIVER_VERSION). Continuing" elif [ "$INSTALLED_DRIVER_VERSION" != "$DRIVER_VERSION" ]; then echo "NVIDIA driver ($INSTALLED_DRIVER_VERSION) has been installed, but we expect to have $DRIVER_VERSION instead. Continuing" else HAS_NVIDIA_DRIVER=1 echo "NVIDIA driver ($INSTALLED_DRIVER_VERSION) has already been installed. Skipping NVIDIA driver installation" fi set -e fi if [ "$HAS_NVIDIA_DRIVER" -eq 0 ]; then # CAUTION: this may need to be updated in future if [ "${DISTRIBUTION}" != ubuntu20.04 ]; then sudo yum groupinstall -y "Development Tools" # ensure our kernel install is the same as our underlying kernel, # groupinstall "Development Tools" has a habit of mismatching kernel headers sudo yum install -y "kernel-devel-uname-r == $(uname -r)" sudo modprobe backlight fi sudo curl -fsL -o /tmp/nvidia_driver "https://s3.amazonaws.com/ossci-linux/nvidia_driver/$DRIVER_FN" set +e sudo /bin/bash /tmp/nvidia_driver -s --no-drm NVIDIA_INSTALLATION_STATUS=$? RESET_GPU=0 if [ "$NVIDIA_INSTALLATION_STATUS" -ne 0 ]; then sudo cat /var/log/nvidia-installer.log # Fail to install NVIDIA driver, try to reset the GPU RESET_GPU=1 elif [ -x "$(command -v nvidia-smi)" ]; then # Check again if nvidia-smi works even if the driver installation completes successfully INSTALLED_DRIVER_VERSION=$(nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0) NVIDIA_SMI_STATUS=$? if [ "$NVIDIA_SMI_STATUS" -ne 0 ] && [ "$NVIDIA_SMI_STATUS" -ne 14 ]; then RESET_GPU=1 fi fi if [ "$RESET_GPU" -eq 1 ]; then NVIDIA_DEVICES=$(lspci -D | grep -i NVIDIA | cut -d' ' -f1) # The GPU can get stuck in a failure state if somehow the test crashs the GPU microcode. When this # happens, we'll try to reset all NVIDIA devices https://github.com/pytorch/pytorch/issues/88388 for PCI_ID in $NVIDIA_DEVICES; do DEVICE_ENABLED=$(cat /sys/bus/pci/devices/$PCI_ID/enable) echo "Reseting $PCI_ID (enabled state: $DEVICE_ENABLED)" # This requires sudo permission of course echo "1" | sudo tee /sys/bus/pci/devices/$PCI_ID/reset sleep 1 done fi sudo rm -fv /tmp/nvidia_driver set -e fi ) } post_install_nvidia_driver_common() { ( sudo modprobe nvidia || true echo "After installing NVIDIA driver" lspci lsmod modinfo nvidia || true ( set +e nvidia-smi # NB: Annoyingly, nvidia-smi command returns successfully with return code 0 even in # the case where the driver has already crashed as it still can get the driver version # and some basic information like the bus ID. However, the rest of the information # would be missing (ERR!), for example: # # +-----------------------------------------------------------------------------+ # | NVIDIA-SMI 525.89.02 Driver Version: 525.89.02 CUDA Version: 12.0 | # |-------------------------------+----------------------+----------------------+ # | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | # | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | # | | | MIG M. | # |===============================+======================+======================| # | 0 ERR! Off | 00000000:00:1E.0 Off | ERR! | # |ERR! ERR! ERR! ERR! / ERR! | 4184MiB / 23028MiB | ERR! Default | # | | | ERR! | # +-------------------------------+----------------------+----------------------+ # # +-----------------------------------------------------------------------------+ # | Processes: | # | GPU GI CI PID Type Process name GPU Memory | # | ID ID Usage | # |=============================================================================| # +-----------------------------------------------------------------------------+ # # This should be reported as a failure instead as it will guarantee to fail when # Docker tries to run with --gpus all # # So, the correct check here is to query one of the missing piece of info like # GPU name, so that the command can fail accordingly nvidia-smi --query-gpu=gpu_name --format=csv,noheader --id=0 NVIDIA_SMI_STATUS=$? # Allowable exit statuses for nvidia-smi, see: https://github.com/NVIDIA/gpu-operator/issues/285 if [ "$NVIDIA_SMI_STATUS" -eq 0 ] || [ "$NVIDIA_SMI_STATUS" -eq 14 ]; then echo "INFO: Ignoring allowed status ${NVIDIA_SMI_STATUS}" else echo "ERROR: nvidia-smi exited with unresolved status ${NVIDIA_SMI_STATUS}" exit ${NVIDIA_SMI_STATUS} fi set -e ) ) } install_nvidia_driver_amzn2() { ( set -x pre_install_nvidia_driver_amzn2 install_nvidia_driver_common post_install_nvidia_driver_common ) } install_nvidia_driver_ubuntu20() { ( set -x install_nvidia_driver_common post_install_nvidia_driver_common ) } echo "== Installing nvidia driver ${DRIVER_FN} ==" case "${DISTRIBUTION}" in amzn*) install_nvidia_driver_amzn2 ;; ubuntu20.04) install_nvidia_driver_ubuntu20 ;; *) echo "ERROR: Unknown distribution ${DISTRIBUTION}" exit 1 ;; esac # Install container toolkit based on distribution echo "== Installing nvidia container toolkit for ${DISTRIBUTION} ==" case "${DISTRIBUTION}" in amzn*) install_nvidia_docker2_amzn2 ;; ubuntu20.04) install_nvidia_docker2_ubuntu20 ;; *) echo "ERROR: Unknown distribution ${DISTRIBUTION}" exit 1 ;; esac echo "GPU_FLAG=--gpus all -e NVIDIA_DRIVER_CAPABILITIES=all" >> "${GITHUB_ENV}" # Fix https://github.com/NVIDIA/nvidia-docker/issues/1648 on runners with # more than one GPUs. This just needs to be run once. The command fails # on subsequent runs and complains that the mode is already on, but that's # ok sudo nvidia-persistenced || true # This should show persistence mode ON nvidia-smi 2025-03-14T06:09:38.1262905Z retry_wait_seconds: 10 2025-03-14T06:09:38.1263292Z polling_interval_seconds: 1 2025-03-14T06:09:38.1263709Z warning_on_retry: true 2025-03-14T06:09:38.1264082Z continue_on_error: false 2025-03-14T06:09:38.1264428Z env: 2025-03-14T06:09:38.1264736Z PYTORCH_ROOT: /pytorch 2025-03-14T06:09:38.1265109Z PACKAGE_TYPE: manywheel 2025-03-14T06:09:38.1265476Z DESIRED_CUDA: cu126 2025-03-14T06:09:38.1265808Z GPU_ARCH_VERSION: 12.6 2025-03-14T06:09:38.1266166Z GPU_ARCH_TYPE: cuda 2025-03-14T06:09:38.1266599Z DOCKER_IMAGE: pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:09:38.1267094Z SKIP_ALL_TESTS: 1 2025-03-14T06:09:38.1267427Z LIBTORCH_CONFIG: 2025-03-14T06:09:38.1267747Z LIBTORCH_VARIANT: 2025-03-14T06:09:38.1268109Z DESIRED_DEVTOOLSET: cxx11-abi 2025-03-14T06:09:38.1268603Z DESIRED_PYTHON: 3.9 2025-03-14T06:09:38.1269125Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2025-03-14T06:09:38.1269696Z AWS_DEFAULT_REGION: us-east-1 2025-03-14T06:09:38.1270067Z BINARY_ENV_FILE: /tmp/env 2025-03-14T06:09:38.1270478Z BUILD_ENVIRONMENT: linux-binary-manywheel 2025-03-14T06:09:38.1271066Z GITHUB_TOKEN: *** 2025-03-14T06:09:38.1271401Z PR_NUMBER: 2025-03-14T06:09:38.1271743Z PYTORCH_FINAL_PACKAGE_DIR: /artifacts 2025-03-14T06:09:38.1272201Z SHA1: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:09:38.1272629Z USE_SPLIT_BUILD: false 2025-03-14T06:09:38.1273000Z DRIVER_VERSION: 550.54.15 2025-03-14T06:09:38.1273363Z ##[endgroup] 2025-03-14T06:09:38.2112156Z == Installing nvidia driver NVIDIA-Linux-x86_64-550.54.15.run == 2025-03-14T06:09:38.2114115Z + pre_install_nvidia_driver_amzn2 2025-03-14T06:09:38.2114936Z + sudo yum remove -y nvidia-driver-latest-dkms 2025-03-14T06:09:38.6175005Z No match for argument: nvidia-driver-latest-dkms 2025-03-14T06:09:38.6176156Z No packages marked for removal. 2025-03-14T06:09:38.6256483Z Dependencies resolved. 2025-03-14T06:09:38.6270701Z Nothing to do. 2025-03-14T06:09:38.6271361Z Complete! 2025-03-14T06:09:38.6616964Z + install_nvidia_driver_common 2025-03-14T06:09:38.6621182Z + echo 'Before installing NVIDIA driver' 2025-03-14T06:09:38.6622900Z Before installing NVIDIA driver 2025-03-14T06:09:38.6625505Z + lspci 2025-03-14T06:09:38.6837432Z 00:00.0 Host bridge: Intel Corporation 440FX - 82441FX PMC [Natoma] (rev 02) 2025-03-14T06:09:38.6838205Z 00:01.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II] 2025-03-14T06:09:38.6838884Z 00:01.1 IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II] 2025-03-14T06:09:38.6839555Z 00:01.3 Bridge: Intel Corporation 82371AB/EB/MB PIIX4 ACPI (rev 01) 2025-03-14T06:09:38.6840133Z 00:02.0 VGA compatible controller: Cirrus Logic GD 5446 2025-03-14T06:09:38.6840754Z 00:03.0 Ethernet controller: Amazon.com, Inc. Elastic Network Adapter (ENA) 2025-03-14T06:09:38.6841520Z 00:1e.0 VGA compatible controller: NVIDIA Corporation GM204GL [Tesla M60] (rev a1) 2025-03-14T06:09:38.6842568Z 00:1f.0 Unassigned class [ff80]: XenSource, Inc. Xen Platform Device (rev 01) 2025-03-14T06:09:38.6843097Z + lsmod 2025-03-14T06:09:38.6880440Z Module Size Used by 2025-03-14T06:09:38.6881122Z veth 36864 0 2025-03-14T06:09:38.6881913Z nvidia_modeset 1351680 0 2025-03-14T06:09:38.6882404Z video 65536 1 nvidia_modeset 2025-03-14T06:09:38.6882826Z wmi 36864 1 video 2025-03-14T06:09:38.6883198Z nvidia_uvm 4706304 0 2025-03-14T06:09:38.6883627Z nvidia 54071296 7 nvidia_uvm,nvidia_modeset 2025-03-14T06:09:38.6884093Z drm 602112 1 nvidia 2025-03-14T06:09:38.6884524Z drm_panel_orientation_quirks 32768 1 drm 2025-03-14T06:09:38.6885027Z backlight 24576 3 video,drm,nvidia_modeset 2025-03-14T06:09:38.6885506Z i2c_core 110592 2 nvidia,drm 2025-03-14T06:09:38.6885932Z xt_conntrack 16384 1 2025-03-14T06:09:38.6886308Z nft_chain_nat 16384 3 2025-03-14T06:09:38.6886682Z xt_MASQUERADE 20480 1 2025-03-14T06:09:38.6887107Z nf_nat 57344 2 nft_chain_nat,xt_MASQUERADE 2025-03-14T06:09:38.6887555Z nf_conntrack_netlink 57344 0 2025-03-14T06:09:38.6888100Z nf_conntrack 184320 4 xt_conntrack,nf_nat,nf_conntrack_netlink,xt_MASQUERADE 2025-03-14T06:09:38.6888697Z nf_defrag_ipv6 24576 1 nf_conntrack 2025-03-14T06:09:38.6889149Z nf_defrag_ipv4 16384 1 nf_conntrack 2025-03-14T06:09:38.6889571Z xfrm_user 57344 1 2025-03-14T06:09:38.6889952Z xfrm_algo 16384 1 xfrm_user 2025-03-14T06:09:38.6890345Z xt_addrtype 16384 2 2025-03-14T06:09:38.6890720Z nft_compat 20480 4 2025-03-14T06:09:38.6891154Z nf_tables 311296 57 nft_compat,nft_chain_nat 2025-03-14T06:09:38.6891913Z nfnetlink 20480 4 nft_compat,nf_conntrack_netlink,nf_tables 2025-03-14T06:09:38.6892474Z br_netfilter 36864 0 2025-03-14T06:09:38.6892853Z bridge 323584 1 br_netfilter 2025-03-14T06:09:38.6893273Z stp 16384 1 bridge 2025-03-14T06:09:38.6893681Z llc 16384 2 bridge,stp 2025-03-14T06:09:38.6894091Z overlay 167936 0 2025-03-14T06:09:38.6894457Z tls 135168 0 2025-03-14T06:09:38.6894810Z nls_ascii 16384 1 2025-03-14T06:09:38.6895178Z ata_piix 45056 0 2025-03-14T06:09:38.6895546Z nls_cp437 20480 1 2025-03-14T06:09:38.6895932Z libata 405504 1 ata_piix 2025-03-14T06:09:38.6896340Z vfat 24576 1 2025-03-14T06:09:38.6896695Z sunrpc 696320 1 2025-03-14T06:09:38.6897070Z fat 86016 1 vfat 2025-03-14T06:09:38.6897465Z scsi_mod 290816 1 libata 2025-03-14T06:09:38.6897901Z scsi_common 16384 2 scsi_mod,libata 2025-03-14T06:09:38.6898346Z ena 180224 0 2025-03-14T06:09:38.6898699Z i8042 45056 0 2025-03-14T06:09:38.6899073Z serio 28672 3 i8042 2025-03-14T06:09:38.6899472Z ghash_clmulni_intel 16384 0 2025-03-14T06:09:38.6899856Z button 24576 0 2025-03-14T06:09:38.6900224Z sch_fq_codel 20480 9 2025-03-14T06:09:38.6900598Z dm_mod 188416 0 2025-03-14T06:09:38.6900971Z fuse 163840 1 2025-03-14T06:09:38.6901339Z configfs 57344 1 2025-03-14T06:09:38.6901714Z loop 36864 0 2025-03-14T06:09:38.6902085Z dax 45056 1 dm_mod 2025-03-14T06:09:38.6902469Z dmi_sysfs 20480 0 2025-03-14T06:09:38.6902871Z crc32_pclmul 16384 0 2025-03-14T06:09:38.6903250Z crc32c_intel 24576 0 2025-03-14T06:09:38.6903617Z + modinfo nvidia 2025-03-14T06:09:38.6904159Z filename: /lib/modules/6.1.128-136.201.amzn2023.x86_64/kernel/drivers/video/nvidia.ko 2025-03-14T06:09:38.6904784Z alias: char-major-195-* 2025-03-14T06:09:38.6905255Z version: 550.54.15 2025-03-14T06:09:38.6905617Z supported: external 2025-03-14T06:09:38.6905972Z license: NVIDIA 2025-03-14T06:09:38.6906357Z firmware: nvidia/550.54.15/gsp_tu10x.bin 2025-03-14T06:09:38.6906840Z firmware: nvidia/550.54.15/gsp_ga10x.bin 2025-03-14T06:09:38.6907276Z srcversion: 833721318DA517F0C2FEC97 2025-03-14T06:09:38.6907726Z alias: pci:v000010DEd*sv*sd*bc06sc80i00* 2025-03-14T06:09:38.6908206Z alias: pci:v000010DEd*sv*sd*bc03sc02i00* 2025-03-14T06:09:38.6908692Z alias: pci:v000010DEd*sv*sd*bc03sc00i00* 2025-03-14T06:09:38.6909130Z depends: i2c-core,drm 2025-03-14T06:09:38.6909486Z retpoline: Y 2025-03-14T06:09:38.6909814Z name: nvidia 2025-03-14T06:09:38.6910313Z vermagic: 6.1.128-136.201.amzn2023.x86_64 SMP preempt mod_unload modversions 2025-03-14T06:09:38.6910954Z parm: NvSwitchRegDwords:NvSwitch regkey (charp) 2025-03-14T06:09:38.6911569Z parm: NvSwitchBlacklist:NvSwitchBlacklist=uuid[,uuid...] (charp) 2025-03-14T06:09:38.6912130Z parm: NVreg_ResmanDebugLevel:int 2025-03-14T06:09:38.6912567Z parm: NVreg_RmLogonRC:int 2025-03-14T06:09:38.6912991Z parm: NVreg_ModifyDeviceFiles:int 2025-03-14T06:09:38.6913434Z parm: NVreg_DeviceFileUID:int 2025-03-14T06:09:38.6913861Z parm: NVreg_DeviceFileGID:int 2025-03-14T06:09:38.6914273Z parm: NVreg_DeviceFileMode:int 2025-03-14T06:09:38.6914772Z parm: NVreg_InitializeSystemMemoryAllocations:int 2025-03-14T06:09:38.6915307Z parm: NVreg_UsePageAttributeTable:int 2025-03-14T06:09:38.6915771Z parm: NVreg_EnablePCIeGen3:int 2025-03-14T06:09:38.6916200Z parm: NVreg_EnableMSI:int 2025-03-14T06:09:38.6916615Z parm: NVreg_TCEBypassMode:int 2025-03-14T06:09:38.6917048Z parm: NVreg_EnableStreamMemOPs:int 2025-03-14T06:09:38.6917635Z parm: NVreg_RestrictProfilingToAdminUsers:int 2025-03-14T06:09:38.6918206Z parm: NVreg_PreserveVideoMemoryAllocations:int 2025-03-14T06:09:38.6918730Z parm: NVreg_EnableS0ixPowerManagement:int 2025-03-14T06:09:38.6919295Z parm: NVreg_S0ixPowerManagementVideoMemoryThreshold:int 2025-03-14T06:09:38.6919841Z parm: NVreg_DynamicPowerManagement:int 2025-03-14T06:09:38.6920417Z parm: NVreg_DynamicPowerManagementVideoMemoryThreshold:int 2025-03-14T06:09:38.6920981Z parm: NVreg_EnableGpuFirmware:int 2025-03-14T06:09:38.6921458Z parm: NVreg_EnableGpuFirmwareLogs:int 2025-03-14T06:09:38.6921970Z parm: NVreg_OpenRmEnableUnsupportedGpus:int 2025-03-14T06:09:38.6922472Z parm: NVreg_EnableUserNUMAManagement:int 2025-03-14T06:09:38.6922953Z parm: NVreg_MemoryPoolSize:int 2025-03-14T06:09:38.6923409Z parm: NVreg_KMallocHeapMaxSize:int 2025-03-14T06:09:38.6923926Z parm: NVreg_VMallocHeapMaxSize:int 2025-03-14T06:09:38.6924398Z parm: NVreg_IgnoreMMIOCheck:int 2025-03-14T06:09:38.6924835Z parm: NVreg_NvLinkDisable:int 2025-03-14T06:09:38.6925327Z parm: NVreg_EnablePCIERelaxedOrderingMode:int 2025-03-14T06:09:38.6925829Z parm: NVreg_RegisterPCIDriver:int 2025-03-14T06:09:38.6926727Z parm: NVreg_EnableResizableBar:int 2025-03-14T06:09:38.6927220Z parm: NVreg_EnableDbgBreakpoint:int 2025-03-14T06:09:38.6927686Z parm: NVreg_EnableNonblockingOpen:int 2025-03-14T06:09:38.6928165Z parm: NVreg_RegistryDwords:charp 2025-03-14T06:09:38.6928642Z parm: NVreg_RegistryDwordsPerDevice:charp 2025-03-14T06:09:38.6929107Z parm: NVreg_RmMsg:charp 2025-03-14T06:09:38.6929520Z parm: NVreg_GpuBlacklist:charp 2025-03-14T06:09:38.6929960Z parm: NVreg_TemporaryFilePath:charp 2025-03-14T06:09:38.6930427Z parm: NVreg_ExcludedGpus:charp 2025-03-14T06:09:38.6930878Z parm: NVreg_DmaRemapPeerMmio:int 2025-03-14T06:09:38.6931352Z parm: NVreg_RmNvlinkBandwidth:charp 2025-03-14T06:09:38.6931977Z parm: NVreg_ImexChannelCount:int 2025-03-14T06:09:38.6932425Z parm: rm_firmware_active:charp 2025-03-14T06:09:38.6932821Z + HAS_NVIDIA_DRIVER=0 2025-03-14T06:09:38.6933174Z ++ command -v nvidia-smi 2025-03-14T06:09:38.6933559Z + '[' -x /usr/bin/nvidia-smi ']' 2025-03-14T06:09:38.6933932Z + set +e 2025-03-14T06:09:38.6934352Z ++ nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0 2025-03-14T06:09:38.7158308Z + INSTALLED_DRIVER_VERSION=550.54.15 2025-03-14T06:09:38.7159279Z + NVIDIA_SMI_STATUS=0 2025-03-14T06:09:38.7159938Z + '[' 0 -ne 0 ']' 2025-03-14T06:09:38.7160529Z + '[' 550.54.15 '!=' 550.54.15 ']' 2025-03-14T06:09:38.7161278Z + HAS_NVIDIA_DRIVER=1 2025-03-14T06:09:38.7162363Z + echo 'NVIDIA driver (550.54.15) has already been installed. Skipping NVIDIA driver installation' 2025-03-14T06:09:38.7163538Z + set -e 2025-03-14T06:09:38.7163840Z + '[' 1 -eq 0 ']' 2025-03-14T06:09:38.7164401Z NVIDIA driver (550.54.15) has already been installed. Skipping NVIDIA driver installation 2025-03-14T06:09:38.7165040Z + post_install_nvidia_driver_common 2025-03-14T06:09:38.7165719Z + sudo modprobe nvidia 2025-03-14T06:09:38.8924935Z + echo 'After installing NVIDIA driver' 2025-03-14T06:09:38.8925640Z + lspci 2025-03-14T06:09:38.8925970Z After installing NVIDIA driver 2025-03-14T06:09:38.9137848Z 00:00.0 Host bridge: Intel Corporation 440FX - 82441FX PMC [Natoma] (rev 02) 2025-03-14T06:09:38.9138604Z 00:01.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II] 2025-03-14T06:09:38.9139490Z 00:01.1 IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II] 2025-03-14T06:09:38.9140151Z 00:01.3 Bridge: Intel Corporation 82371AB/EB/MB PIIX4 ACPI (rev 01) 2025-03-14T06:09:38.9140727Z 00:02.0 VGA compatible controller: Cirrus Logic GD 5446 2025-03-14T06:09:38.9141344Z 00:03.0 Ethernet controller: Amazon.com, Inc. Elastic Network Adapter (ENA) 2025-03-14T06:09:38.9142330Z 00:1e.0 VGA compatible controller: NVIDIA Corporation GM204GL [Tesla M60] (rev a1) 2025-03-14T06:09:38.9143102Z 00:1f.0 Unassigned class [ff80]: XenSource, Inc. Xen Platform Device (rev 01) 2025-03-14T06:09:38.9143651Z + lsmod 2025-03-14T06:09:38.9167821Z Module Size Used by 2025-03-14T06:09:38.9168277Z veth 36864 0 2025-03-14T06:09:38.9168667Z nvidia_modeset 1351680 0 2025-03-14T06:09:38.9169075Z video 65536 1 nvidia_modeset 2025-03-14T06:09:38.9169489Z wmi 36864 1 video 2025-03-14T06:09:38.9169879Z nvidia_uvm 4706304 0 2025-03-14T06:09:38.9170303Z nvidia 54071296 7 nvidia_uvm,nvidia_modeset 2025-03-14T06:09:38.9170762Z drm 602112 1 nvidia 2025-03-14T06:09:38.9171197Z drm_panel_orientation_quirks 32768 1 drm 2025-03-14T06:09:38.9171726Z backlight 24576 3 video,drm,nvidia_modeset 2025-03-14T06:09:38.9172231Z i2c_core 110592 2 nvidia,drm 2025-03-14T06:09:38.9172690Z xt_conntrack 16384 1 2025-03-14T06:09:38.9173089Z nft_chain_nat 16384 3 2025-03-14T06:09:38.9173467Z xt_MASQUERADE 20480 1 2025-03-14T06:09:38.9173876Z nf_nat 57344 2 nft_chain_nat,xt_MASQUERADE 2025-03-14T06:09:38.9174346Z nf_conntrack_netlink 57344 0 2025-03-14T06:09:38.9174899Z nf_conntrack 184320 4 xt_conntrack,nf_nat,nf_conntrack_netlink,xt_MASQUERADE 2025-03-14T06:09:38.9175502Z nf_defrag_ipv6 24576 1 nf_conntrack 2025-03-14T06:09:38.9175953Z nf_defrag_ipv4 16384 1 nf_conntrack 2025-03-14T06:09:38.9176375Z xfrm_user 57344 1 2025-03-14T06:09:38.9176748Z xfrm_algo 16384 1 xfrm_user 2025-03-14T06:09:38.9177164Z xt_addrtype 16384 2 2025-03-14T06:09:38.9177540Z nft_compat 20480 4 2025-03-14T06:09:38.9177973Z nf_tables 311296 57 nft_compat,nft_chain_nat 2025-03-14T06:09:38.9178543Z nfnetlink 20480 4 nft_compat,nf_conntrack_netlink,nf_tables 2025-03-14T06:09:38.9179055Z br_netfilter 36864 0 2025-03-14T06:09:38.9179692Z bridge 323584 1 br_netfilter 2025-03-14T06:09:38.9180118Z stp 16384 1 bridge 2025-03-14T06:09:38.9180526Z llc 16384 2 bridge,stp 2025-03-14T06:09:38.9180935Z overlay 167936 0 2025-03-14T06:09:38.9181284Z tls 135168 0 2025-03-14T06:09:38.9181645Z nls_ascii 16384 1 2025-03-14T06:09:38.9182029Z ata_piix 45056 0 2025-03-14T06:09:38.9182396Z nls_cp437 20480 1 2025-03-14T06:09:38.9182771Z libata 405504 1 ata_piix 2025-03-14T06:09:38.9183152Z vfat 24576 1 2025-03-14T06:09:38.9183516Z sunrpc 696320 1 2025-03-14T06:09:38.9183883Z fat 86016 1 vfat 2025-03-14T06:09:38.9184271Z scsi_mod 290816 1 libata 2025-03-14T06:09:38.9184699Z scsi_common 16384 2 scsi_mod,libata 2025-03-14T06:09:38.9185118Z ena 180224 0 2025-03-14T06:09:38.9185480Z i8042 45056 0 2025-03-14T06:09:38.9185853Z serio 28672 3 i8042 2025-03-14T06:09:38.9186250Z ghash_clmulni_intel 16384 0 2025-03-14T06:09:38.9186631Z button 24576 0 2025-03-14T06:09:38.9186980Z sch_fq_codel 20480 9 2025-03-14T06:09:38.9187345Z dm_mod 188416 0 2025-03-14T06:09:38.9187707Z fuse 163840 1 2025-03-14T06:09:38.9188077Z configfs 57344 1 2025-03-14T06:09:38.9188441Z loop 36864 0 2025-03-14T06:09:38.9188790Z dax 45056 1 dm_mod 2025-03-14T06:09:38.9189185Z dmi_sysfs 20480 0 2025-03-14T06:09:38.9189551Z crc32_pclmul 16384 0 2025-03-14T06:09:38.9189923Z crc32c_intel 24576 0 2025-03-14T06:09:38.9190288Z + modinfo nvidia 2025-03-14T06:09:38.9190848Z filename: /lib/modules/6.1.128-136.201.amzn2023.x86_64/kernel/drivers/video/nvidia.ko 2025-03-14T06:09:38.9191570Z alias: char-major-195-* 2025-03-14T06:09:38.9191981Z version: 550.54.15 2025-03-14T06:09:38.9192344Z supported: external 2025-03-14T06:09:38.9192698Z license: NVIDIA 2025-03-14T06:09:38.9193083Z firmware: nvidia/550.54.15/gsp_tu10x.bin 2025-03-14T06:09:38.9193542Z firmware: nvidia/550.54.15/gsp_ga10x.bin 2025-03-14T06:09:38.9194010Z srcversion: 833721318DA517F0C2FEC97 2025-03-14T06:09:38.9194463Z alias: pci:v000010DEd*sv*sd*bc06sc80i00* 2025-03-14T06:09:38.9194941Z alias: pci:v000010DEd*sv*sd*bc03sc02i00* 2025-03-14T06:09:38.9195412Z alias: pci:v000010DEd*sv*sd*bc03sc00i00* 2025-03-14T06:09:38.9195839Z depends: i2c-core,drm 2025-03-14T06:09:38.9196214Z retpoline: Y 2025-03-14T06:09:38.9196539Z name: nvidia 2025-03-14T06:09:38.9197042Z vermagic: 6.1.128-136.201.amzn2023.x86_64 SMP preempt mod_unload modversions 2025-03-14T06:09:38.9197691Z parm: NvSwitchRegDwords:NvSwitch regkey (charp) 2025-03-14T06:09:38.9198287Z parm: NvSwitchBlacklist:NvSwitchBlacklist=uuid[,uuid...] (charp) 2025-03-14T06:09:38.9198869Z parm: NVreg_ResmanDebugLevel:int 2025-03-14T06:09:38.9199310Z parm: NVreg_RmLogonRC:int 2025-03-14T06:09:38.9199765Z parm: NVreg_ModifyDeviceFiles:int 2025-03-14T06:09:38.9200196Z parm: NVreg_DeviceFileUID:int 2025-03-14T06:09:38.9200631Z parm: NVreg_DeviceFileGID:int 2025-03-14T06:09:38.9201065Z parm: NVreg_DeviceFileMode:int 2025-03-14T06:09:38.9201567Z parm: NVreg_InitializeSystemMemoryAllocations:int 2025-03-14T06:09:38.9202099Z parm: NVreg_UsePageAttributeTable:int 2025-03-14T06:09:38.9202551Z parm: NVreg_EnablePCIeGen3:int 2025-03-14T06:09:38.9202978Z parm: NVreg_EnableMSI:int 2025-03-14T06:09:38.9203400Z parm: NVreg_TCEBypassMode:int 2025-03-14T06:09:38.9203849Z parm: NVreg_EnableStreamMemOPs:int 2025-03-14T06:09:38.9204358Z parm: NVreg_RestrictProfilingToAdminUsers:int 2025-03-14T06:09:38.9204898Z parm: NVreg_PreserveVideoMemoryAllocations:int 2025-03-14T06:09:38.9205531Z parm: NVreg_EnableS0ixPowerManagement:int 2025-03-14T06:09:38.9206097Z parm: NVreg_S0ixPowerManagementVideoMemoryThreshold:int 2025-03-14T06:09:38.9206656Z parm: NVreg_DynamicPowerManagement:int 2025-03-14T06:09:38.9207229Z parm: NVreg_DynamicPowerManagementVideoMemoryThreshold:int 2025-03-14T06:09:38.9207775Z parm: NVreg_EnableGpuFirmware:int 2025-03-14T06:09:38.9208251Z parm: NVreg_EnableGpuFirmwareLogs:int 2025-03-14T06:09:38.9208766Z parm: NVreg_OpenRmEnableUnsupportedGpus:int 2025-03-14T06:09:38.9209283Z parm: NVreg_EnableUserNUMAManagement:int 2025-03-14T06:09:38.9209761Z parm: NVreg_MemoryPoolSize:int 2025-03-14T06:09:38.9210221Z parm: NVreg_KMallocHeapMaxSize:int 2025-03-14T06:09:38.9210674Z parm: NVreg_VMallocHeapMaxSize:int 2025-03-14T06:09:38.9211139Z parm: NVreg_IgnoreMMIOCheck:int 2025-03-14T06:09:38.9211587Z parm: NVreg_NvLinkDisable:int 2025-03-14T06:09:38.9212068Z parm: NVreg_EnablePCIERelaxedOrderingMode:int 2025-03-14T06:09:38.9212564Z parm: NVreg_RegisterPCIDriver:int 2025-03-14T06:09:38.9213008Z parm: NVreg_EnableResizableBar:int 2025-03-14T06:09:38.9213476Z parm: NVreg_EnableDbgBreakpoint:int 2025-03-14T06:09:38.9213959Z parm: NVreg_EnableNonblockingOpen:int 2025-03-14T06:09:38.9214429Z parm: NVreg_RegistryDwords:charp 2025-03-14T06:09:38.9214902Z parm: NVreg_RegistryDwordsPerDevice:charp 2025-03-14T06:09:38.9215345Z parm: NVreg_RmMsg:charp 2025-03-14T06:09:38.9215753Z parm: NVreg_GpuBlacklist:charp 2025-03-14T06:09:38.9216206Z parm: NVreg_TemporaryFilePath:charp 2025-03-14T06:09:38.9216663Z parm: NVreg_ExcludedGpus:charp 2025-03-14T06:09:38.9217106Z parm: NVreg_DmaRemapPeerMmio:int 2025-03-14T06:09:38.9217642Z parm: NVreg_RmNvlinkBandwidth:charp 2025-03-14T06:09:38.9218129Z parm: NVreg_ImexChannelCount:int 2025-03-14T06:09:38.9218569Z parm: rm_firmware_active:charp 2025-03-14T06:09:38.9218971Z + set +e 2025-03-14T06:09:38.9219262Z + nvidia-smi 2025-03-14T06:09:38.9389194Z Fri Mar 14 06:09:38 2025 2025-03-14T06:09:38.9389706Z +-----------------------------------------------------------------------------------------+ 2025-03-14T06:09:38.9390382Z | NVIDIA-SMI 550.54.15 Driver Version: 550.54.15 CUDA Version: 12.4 | 2025-03-14T06:09:38.9391045Z |-----------------------------------------+------------------------+----------------------+ 2025-03-14T06:09:38.9391740Z | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | 2025-03-14T06:09:38.9392460Z | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | 2025-03-14T06:09:38.9393046Z | | | MIG M. | 2025-03-14T06:09:38.9393532Z |=========================================+========================+======================| 2025-03-14T06:09:38.9476051Z | 0 Tesla M60 On | 00000000:00:1E.0 Off | 0 | 2025-03-14T06:09:38.9476671Z | N/A 22C P8 14W / 150W | 0MiB / 7680MiB | 0% Default | 2025-03-14T06:09:38.9477213Z | | | N/A | 2025-03-14T06:09:38.9477767Z +-----------------------------------------+------------------------+----------------------+ 2025-03-14T06:09:38.9478310Z 2025-03-14T06:09:38.9478837Z +-----------------------------------------------------------------------------------------+ 2025-03-14T06:09:38.9479435Z | Processes: | 2025-03-14T06:09:38.9480063Z | GPU GI CI PID Type Process name GPU Memory | 2025-03-14T06:09:38.9480853Z | ID ID Usage | 2025-03-14T06:09:38.9481337Z |=========================================================================================| 2025-03-14T06:09:38.9481934Z | No running processes found | 2025-03-14T06:09:38.9482556Z +-----------------------------------------------------------------------------------------+ 2025-03-14T06:09:39.0064380Z + nvidia-smi --query-gpu=gpu_name --format=csv,noheader --id=0 2025-03-14T06:09:39.0252857Z Tesla M60 2025-03-14T06:09:39.0314361Z + NVIDIA_SMI_STATUS=0 2025-03-14T06:09:39.0314720Z + '[' 0 -eq 0 ']' 2025-03-14T06:09:39.0315078Z + echo 'INFO: Ignoring allowed status 0' 2025-03-14T06:09:39.0315475Z + set -e 2025-03-14T06:09:39.0315799Z INFO: Ignoring allowed status 0 2025-03-14T06:09:39.0322394Z == Installing nvidia container toolkit for amzn2023 == 2025-03-14T06:09:39.0326971Z + sudo yum install -y yum-utils 2025-03-14T06:09:39.6292848Z Last metadata expiration check: 0:42:35 ago on Fri Mar 14 05:27:04 2025. 2025-03-14T06:09:39.6592117Z Package dnf-utils-4.3.0-13.amzn2023.0.5.noarch is already installed. 2025-03-14T06:09:39.7131280Z Dependencies resolved. 2025-03-14T06:09:39.7405719Z Nothing to do. 2025-03-14T06:09:39.7406376Z Complete! 2025-03-14T06:09:39.7819655Z + [[ amzn2023 == \a\m\z\n\2\0\2\3 ]] 2025-03-14T06:09:39.7820425Z + YUM_REPO_URL=https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo 2025-03-14T06:09:39.7821551Z + sudo yum-config-manager --add-repo https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo 2025-03-14T06:09:40.2021668Z Adding repo from: https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo 2025-03-14T06:09:40.2620309Z + sudo yum install -y nvidia-docker2 nvidia-container-toolkit-1.16.2 2025-03-14T06:09:40.8988849Z nvidia-container-toolkit 13 kB/s | 833 B 00:00 2025-03-14T06:09:40.9295600Z Package nvidia-docker2-2.14.0-1.noarch is already installed. 2025-03-14T06:09:40.9303929Z Package nvidia-container-toolkit-1.16.2-1.x86_64 is already installed. 2025-03-14T06:09:40.9841524Z Dependencies resolved. 2025-03-14T06:09:41.0115525Z Nothing to do. 2025-03-14T06:09:41.0116262Z Complete! 2025-03-14T06:09:41.0550489Z + sudo systemctl restart docker 2025-03-14T06:09:49.7903079Z nvidia-persistenced failed to initialize. Check syslog for more details. 2025-03-14T06:09:49.8130722Z Fri Mar 14 06:09:49 2025 2025-03-14T06:09:49.8131269Z +-----------------------------------------------------------------------------------------+ 2025-03-14T06:09:49.8131978Z | NVIDIA-SMI 550.54.15 Driver Version: 550.54.15 CUDA Version: 12.4 | 2025-03-14T06:09:49.8132628Z |-----------------------------------------+------------------------+----------------------+ 2025-03-14T06:09:49.8133344Z | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | 2025-03-14T06:09:49.8134081Z | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | 2025-03-14T06:09:49.8134674Z | | | MIG M. | 2025-03-14T06:09:49.8135148Z |=========================================+========================+======================| 2025-03-14T06:09:49.8214489Z | 0 Tesla M60 On | 00000000:00:1E.0 Off | 0 | 2025-03-14T06:09:49.8215115Z | N/A 22C P8 14W / 150W | 0MiB / 7680MiB | 0% Default | 2025-03-14T06:09:49.8215634Z | | | N/A | 2025-03-14T06:09:49.8216182Z +-----------------------------------------+------------------------+----------------------+ 2025-03-14T06:09:49.8216731Z 2025-03-14T06:09:49.8217628Z +-----------------------------------------------------------------------------------------+ 2025-03-14T06:09:49.8218221Z | Processes: | 2025-03-14T06:09:49.8218833Z | GPU GI CI PID Type Process name GPU Memory | 2025-03-14T06:09:49.8219413Z | ID ID Usage | 2025-03-14T06:09:49.8219905Z |=========================================================================================| 2025-03-14T06:09:49.8220489Z | No running processes found | 2025-03-14T06:09:49.8221136Z +-----------------------------------------------------------------------------------------+ 2025-03-14T06:09:50.1984643Z Command completed after 1 attempt(s). 2025-03-14T06:09:50.2106710Z ##[group]Run pytorch/test-infra/.github/actions/pull-docker-image@main 2025-03-14T06:09:50.2107345Z with: 2025-03-14T06:09:50.2107757Z docker-image: pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:09:50.2108373Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-03-14T06:09:50.2108866Z env: 2025-03-14T06:09:50.2109179Z PYTORCH_ROOT: /pytorch 2025-03-14T06:09:50.2109558Z PACKAGE_TYPE: manywheel 2025-03-14T06:09:50.2109927Z DESIRED_CUDA: cu126 2025-03-14T06:09:50.2110263Z GPU_ARCH_VERSION: 12.6 2025-03-14T06:09:50.2110620Z GPU_ARCH_TYPE: cuda 2025-03-14T06:09:50.2111056Z DOCKER_IMAGE: pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:09:50.2111545Z SKIP_ALL_TESTS: 1 2025-03-14T06:09:50.2111885Z LIBTORCH_CONFIG: 2025-03-14T06:09:50.2112200Z LIBTORCH_VARIANT: 2025-03-14T06:09:50.2112748Z DESIRED_DEVTOOLSET: cxx11-abi 2025-03-14T06:09:50.2113139Z DESIRED_PYTHON: 3.9 2025-03-14T06:09:50.2113725Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2025-03-14T06:09:50.2114288Z AWS_DEFAULT_REGION: us-east-1 2025-03-14T06:09:50.2114690Z BINARY_ENV_FILE: /tmp/env 2025-03-14T06:09:50.2115099Z BUILD_ENVIRONMENT: linux-binary-manywheel 2025-03-14T06:09:50.2115717Z GITHUB_TOKEN: *** 2025-03-14T06:09:50.2116058Z PR_NUMBER: 2025-03-14T06:09:50.2116405Z PYTORCH_FINAL_PACKAGE_DIR: /artifacts 2025-03-14T06:09:50.2116849Z SHA1: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:09:50.2117299Z USE_SPLIT_BUILD: false 2025-03-14T06:09:50.2117738Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2025-03-14T06:09:50.2118210Z ##[endgroup] 2025-03-14T06:09:50.2143611Z ##[group]Run set -x 2025-03-14T06:09:50.2144004Z set -x 2025-03-14T06:09:50.2144326Z set +e 2025-03-14T06:09:50.2144641Z  2025-03-14T06:09:50.2144926Z login() { 2025-03-14T06:09:50.2145537Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2025-03-14T06:09:50.2146200Z } 2025-03-14T06:09:50.2146506Z  2025-03-14T06:09:50.2146809Z retry () { 2025-03-14T06:09:50.2147182Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2025-03-14T06:09:50.2147602Z } 2025-03-14T06:09:50.2147904Z  2025-03-14T06:09:50.2148238Z retry login "${DOCKER_REGISTRY}" 2025-03-14T06:09:50.2148660Z  2025-03-14T06:09:50.2148943Z set -e 2025-03-14T06:09:50.2149396Z # ignore output since only exit code is used for conditional 2025-03-14T06:09:50.2150022Z # only pull docker image if it's not available locally 2025-03-14T06:09:50.2150711Z if ! docker inspect --type=image "${DOCKER_IMAGE}" >/dev/null 2>/dev/null; then 2025-03-14T06:09:50.2151347Z  retry docker pull "${DOCKER_IMAGE}" 2025-03-14T06:09:50.2151784Z fi 2025-03-14T06:09:50.2162461Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T06:09:50.2162960Z env: 2025-03-14T06:09:50.2163287Z PYTORCH_ROOT: /pytorch 2025-03-14T06:09:50.2163670Z PACKAGE_TYPE: manywheel 2025-03-14T06:09:50.2164238Z DESIRED_CUDA: cu126 2025-03-14T06:09:50.2164573Z GPU_ARCH_VERSION: 12.6 2025-03-14T06:09:50.2164961Z GPU_ARCH_TYPE: cuda 2025-03-14T06:09:50.2165419Z DOCKER_IMAGE: pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:09:50.2165914Z SKIP_ALL_TESTS: 1 2025-03-14T06:09:50.2166250Z LIBTORCH_CONFIG: 2025-03-14T06:09:50.2166565Z LIBTORCH_VARIANT: 2025-03-14T06:09:50.2166923Z DESIRED_DEVTOOLSET: cxx11-abi 2025-03-14T06:09:50.2167324Z DESIRED_PYTHON: 3.9 2025-03-14T06:09:50.2167835Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2025-03-14T06:09:50.2168408Z AWS_DEFAULT_REGION: us-east-1 2025-03-14T06:09:50.2168782Z BINARY_ENV_FILE: /tmp/env 2025-03-14T06:09:50.2169198Z BUILD_ENVIRONMENT: linux-binary-manywheel 2025-03-14T06:09:50.2169795Z GITHUB_TOKEN: *** 2025-03-14T06:09:50.2170133Z PR_NUMBER: 2025-03-14T06:09:50.2170646Z PYTORCH_FINAL_PACKAGE_DIR: /artifacts 2025-03-14T06:09:50.2171116Z SHA1: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:09:50.2171575Z USE_SPLIT_BUILD: false 2025-03-14T06:09:50.2172022Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2025-03-14T06:09:50.2172608Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-03-14T06:09:50.2173116Z ##[endgroup] 2025-03-14T06:09:50.2205243Z + set +e 2025-03-14T06:09:50.2205671Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-03-14T06:09:50.2206228Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-03-14T06:09:50.2210230Z + aws ecr get-login-password --region us-east-1 2025-03-14T06:09:50.2211343Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-03-14T06:09:50.8927623Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2025-03-14T06:09:50.8928425Z Configure a credential helper to remove this warning. See 2025-03-14T06:09:50.8929170Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2025-03-14T06:09:50.8930043Z 2025-03-14T06:09:50.8930394Z Login Succeeded 2025-03-14T06:09:50.8942233Z + set -e 2025-03-14T06:09:50.8943247Z + docker inspect --type=image pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:09:50.9099903Z + retry docker pull pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:09:50.9100934Z + docker pull pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:09:51.0898079Z cuda12.6-main: Pulling from pytorch/manylinux2_28-builder 2025-03-14T06:09:51.0898643Z 99567ad9a0f9: Pulling fs layer 2025-03-14T06:09:51.0899072Z 63f310f401f4: Pulling fs layer 2025-03-14T06:09:51.0899446Z 92102170d109: Pulling fs layer 2025-03-14T06:09:51.0899841Z b2fa7e89de18: Pulling fs layer 2025-03-14T06:09:51.0900232Z b610f6a41227: Pulling fs layer 2025-03-14T06:09:51.0900619Z 94151d582c9b: Pulling fs layer 2025-03-14T06:09:51.0900996Z 49869b255566: Pulling fs layer 2025-03-14T06:09:51.0901390Z 0a2e762fe64b: Pulling fs layer 2025-03-14T06:09:51.0901787Z 2b3d34fc39dc: Pulling fs layer 2025-03-14T06:09:51.0902161Z b610f6a41227: Waiting 2025-03-14T06:09:51.0902533Z da7c2d135a50: Pulling fs layer 2025-03-14T06:09:51.0902924Z b406340fbdb6: Pulling fs layer 2025-03-14T06:09:51.0903277Z 94151d582c9b: Waiting 2025-03-14T06:09:51.0903633Z 7fd3c7b19eba: Pulling fs layer 2025-03-14T06:09:51.0904005Z 0a2e762fe64b: Waiting 2025-03-14T06:09:51.0904333Z 49869b255566: Waiting 2025-03-14T06:09:51.0904664Z b2fa7e89de18: Waiting 2025-03-14T06:09:51.0904985Z 2b3d34fc39dc: Waiting 2025-03-14T06:09:51.0905344Z 4c5fdd30967d: Pulling fs layer 2025-03-14T06:09:51.0905724Z da7c2d135a50: Waiting 2025-03-14T06:09:51.0906078Z a80cc186070a: Pulling fs layer 2025-03-14T06:09:51.0906446Z b406340fbdb6: Waiting 2025-03-14T06:09:51.0906764Z 4c5fdd30967d: Waiting 2025-03-14T06:09:51.0907117Z 2c61e91cbf31: Pulling fs layer 2025-03-14T06:09:51.0907503Z 2d5c7ca16baa: Pulling fs layer 2025-03-14T06:09:51.0907895Z 8dfcf3ede1c8: Pulling fs layer 2025-03-14T06:09:51.0908272Z 3301b24fe9e9: Pulling fs layer 2025-03-14T06:09:51.0908657Z de6ca66b52a7: Pulling fs layer 2025-03-14T06:09:51.0909315Z e3cc71ccda70: Pulling fs layer 2025-03-14T06:09:51.0909709Z 68d45afb2045: Pulling fs layer 2025-03-14T06:09:51.0910084Z 8dfcf3ede1c8: Waiting 2025-03-14T06:09:51.0910439Z fd8520966e42: Pulling fs layer 2025-03-14T06:09:51.0910808Z 5ab883f52cae: Pulling fs layer 2025-03-14T06:09:51.0911191Z f3495299ffbd: Pulling fs layer 2025-03-14T06:09:51.0911572Z 4f4fb700ef54: Pulling fs layer 2025-03-14T06:09:51.0911958Z f174b99501da: Pulling fs layer 2025-03-14T06:09:51.0912351Z bd19a663a32b: Pulling fs layer 2025-03-14T06:09:51.0912724Z f8c8e7d5c8fe: Pulling fs layer 2025-03-14T06:09:51.0913099Z 3301b24fe9e9: Waiting 2025-03-14T06:09:51.0913435Z e3cc71ccda70: Waiting 2025-03-14T06:09:51.0913770Z fd8520966e42: Waiting 2025-03-14T06:09:51.0914086Z bd19a663a32b: Waiting 2025-03-14T06:09:51.0914419Z 68d45afb2045: Waiting 2025-03-14T06:09:51.0914749Z 4f4fb700ef54: Waiting 2025-03-14T06:09:51.0915249Z de6ca66b52a7: Waiting 2025-03-14T06:09:51.0915613Z 5ab883f52cae: Waiting 2025-03-14T06:09:51.0915927Z f3495299ffbd: Waiting 2025-03-14T06:09:51.7841113Z 92102170d109: Verifying Checksum 2025-03-14T06:09:51.7841591Z 92102170d109: Download complete 2025-03-14T06:09:51.8449074Z 99567ad9a0f9: Verifying Checksum 2025-03-14T06:09:51.8449742Z 99567ad9a0f9: Download complete 2025-03-14T06:09:52.0356117Z 63f310f401f4: Verifying Checksum 2025-03-14T06:09:52.0356815Z 63f310f401f4: Download complete 2025-03-14T06:09:52.0918020Z b610f6a41227: Verifying Checksum 2025-03-14T06:09:52.0919321Z b610f6a41227: Download complete 2025-03-14T06:09:52.1296938Z 49869b255566: Verifying Checksum 2025-03-14T06:09:52.1298375Z 49869b255566: Download complete 2025-03-14T06:09:52.3486042Z 0a2e762fe64b: Verifying Checksum 2025-03-14T06:09:52.3486806Z 0a2e762fe64b: Download complete 2025-03-14T06:09:52.4111244Z 2b3d34fc39dc: Verifying Checksum 2025-03-14T06:09:52.4111706Z 2b3d34fc39dc: Download complete 2025-03-14T06:09:53.0362391Z 94151d582c9b: Verifying Checksum 2025-03-14T06:09:53.0362904Z 94151d582c9b: Download complete 2025-03-14T06:09:53.0856272Z b406340fbdb6: Verifying Checksum 2025-03-14T06:09:53.0856791Z b406340fbdb6: Download complete 2025-03-14T06:09:54.4725735Z b2fa7e89de18: Download complete 2025-03-14T06:09:54.5944618Z 4c5fdd30967d: Download complete 2025-03-14T06:09:54.6733928Z a80cc186070a: Verifying Checksum 2025-03-14T06:09:54.6734653Z a80cc186070a: Download complete 2025-03-14T06:09:54.7291105Z 2c61e91cbf31: Verifying Checksum 2025-03-14T06:09:54.7291667Z 2c61e91cbf31: Download complete 2025-03-14T06:09:54.7846568Z 2d5c7ca16baa: Download complete 2025-03-14T06:09:54.8451834Z 8dfcf3ede1c8: Verifying Checksum 2025-03-14T06:09:54.8452497Z 8dfcf3ede1c8: Download complete 2025-03-14T06:09:55.1657758Z 99567ad9a0f9: Pull complete 2025-03-14T06:09:55.1851930Z 3301b24fe9e9: Verifying Checksum 2025-03-14T06:09:55.1852711Z 3301b24fe9e9: Download complete 2025-03-14T06:09:55.2317419Z de6ca66b52a7: Verifying Checksum 2025-03-14T06:09:55.3259904Z e3cc71ccda70: Download complete 2025-03-14T06:09:55.3270958Z da7c2d135a50: Verifying Checksum 2025-03-14T06:09:55.3271822Z da7c2d135a50: Download complete 2025-03-14T06:09:55.3915263Z 68d45afb2045: Verifying Checksum 2025-03-14T06:09:55.3915716Z 68d45afb2045: Download complete 2025-03-14T06:09:55.5032770Z 7fd3c7b19eba: Verifying Checksum 2025-03-14T06:09:55.5033255Z 7fd3c7b19eba: Download complete 2025-03-14T06:09:55.7090236Z 5ab883f52cae: Verifying Checksum 2025-03-14T06:09:55.7091055Z 5ab883f52cae: Download complete 2025-03-14T06:09:55.7431378Z 4f4fb700ef54: Download complete 2025-03-14T06:09:55.8712457Z 63f310f401f4: Pull complete 2025-03-14T06:09:56.3014469Z f3495299ffbd: Verifying Checksum 2025-03-14T06:09:56.3015531Z f3495299ffbd: Download complete 2025-03-14T06:09:57.0280933Z 92102170d109: Pull complete 2025-03-14T06:09:58.7218903Z bd19a663a32b: Verifying Checksum 2025-03-14T06:09:58.7219410Z bd19a663a32b: Download complete 2025-03-14T06:09:58.7576744Z f8c8e7d5c8fe: Verifying Checksum 2025-03-14T06:09:58.7577228Z f8c8e7d5c8fe: Download complete 2025-03-14T06:10:03.5346434Z fd8520966e42: Verifying Checksum 2025-03-14T06:10:03.5347256Z fd8520966e42: Download complete 2025-03-14T06:10:04.5423465Z b2fa7e89de18: Pull complete 2025-03-14T06:10:05.1387994Z b610f6a41227: Pull complete 2025-03-14T06:10:06.0161245Z 94151d582c9b: Pull complete 2025-03-14T06:10:06.0428868Z 49869b255566: Pull complete 2025-03-14T06:10:06.2978840Z 0a2e762fe64b: Pull complete 2025-03-14T06:10:06.3216020Z 2b3d34fc39dc: Pull complete 2025-03-14T06:10:19.7492482Z da7c2d135a50: Pull complete 2025-03-14T06:10:19.7705377Z b406340fbdb6: Pull complete 2025-03-14T06:10:25.3194351Z 7fd3c7b19eba: Pull complete 2025-03-14T06:10:25.3449186Z 4c5fdd30967d: Pull complete 2025-03-14T06:10:25.3647408Z a80cc186070a: Pull complete 2025-03-14T06:10:25.3849570Z 2c61e91cbf31: Pull complete 2025-03-14T06:10:25.4043563Z 2d5c7ca16baa: Pull complete 2025-03-14T06:10:25.4240729Z 8dfcf3ede1c8: Pull complete 2025-03-14T06:10:25.4988591Z 3301b24fe9e9: Pull complete 2025-03-14T06:10:25.5201602Z de6ca66b52a7: Pull complete 2025-03-14T06:10:25.5390423Z e3cc71ccda70: Pull complete 2025-03-14T06:10:25.5582666Z 68d45afb2045: Pull complete 2025-03-14T06:10:44.8118388Z fd8520966e42: Pull complete 2025-03-14T06:10:46.8215532Z 5ab883f52cae: Pull complete 2025-03-14T06:10:49.0806222Z f3495299ffbd: Pull complete 2025-03-14T06:10:49.5074944Z 4f4fb700ef54: Pull complete 2025-03-14T06:11:04.1032407Z f174b99501da: Verifying Checksum 2025-03-14T06:11:04.1032875Z f174b99501da: Download complete 2025-03-14T06:11:56.9554238Z f174b99501da: Pull complete 2025-03-14T06:11:59.1645757Z bd19a663a32b: Pull complete 2025-03-14T06:11:59.6182945Z f8c8e7d5c8fe: Pull complete 2025-03-14T06:11:59.8658228Z Digest: sha256:a134eadfac474e38a584e947aebf13114539e6d147bbf6afcd140720820fb6d2 2025-03-14T06:11:59.9599327Z Status: Downloaded newer image for pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:12:00.0146427Z docker.io/pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:12:00.0215729Z Prepare all required actions 2025-03-14T06:12:00.0260440Z ##[group]Run ./pytorch/.github/actions/test-pytorch-binary 2025-03-14T06:12:00.0260962Z env: 2025-03-14T06:12:00.0261274Z PYTORCH_ROOT: /pytorch 2025-03-14T06:12:00.0261632Z PACKAGE_TYPE: manywheel 2025-03-14T06:12:00.0261998Z DESIRED_CUDA: cu126 2025-03-14T06:12:00.0262353Z GPU_ARCH_VERSION: 12.6 2025-03-14T06:12:00.0262711Z GPU_ARCH_TYPE: cuda 2025-03-14T06:12:00.0263150Z DOCKER_IMAGE: pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:12:00.0263640Z SKIP_ALL_TESTS: 1 2025-03-14T06:12:00.0263978Z LIBTORCH_CONFIG: 2025-03-14T06:12:00.0264307Z LIBTORCH_VARIANT: 2025-03-14T06:12:00.0264672Z DESIRED_DEVTOOLSET: cxx11-abi 2025-03-14T06:12:00.0265040Z DESIRED_PYTHON: 3.9 2025-03-14T06:12:00.0265549Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2025-03-14T06:12:00.0266158Z AWS_DEFAULT_REGION: us-east-1 2025-03-14T06:12:00.0266884Z BINARY_ENV_FILE: /tmp/env 2025-03-14T06:12:00.0267451Z BUILD_ENVIRONMENT: linux-binary-manywheel 2025-03-14T06:12:00.0268080Z GITHUB_TOKEN: *** 2025-03-14T06:12:00.0268432Z PR_NUMBER: 2025-03-14T06:12:00.0268829Z PYTORCH_FINAL_PACKAGE_DIR: /artifacts 2025-03-14T06:12:00.0269315Z SHA1: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:12:00.0269790Z USE_SPLIT_BUILD: false 2025-03-14T06:12:00.0270237Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2025-03-14T06:12:00.0270717Z ##[endgroup] 2025-03-14T06:12:00.0524852Z ##[group]Run set -x 2025-03-14T06:12:00.0525248Z set -x 2025-03-14T06:12:00.0525596Z # shellcheck disable=SC2086,SC2090 2025-03-14T06:12:00.0526058Z container_name=$(docker run \ 2025-03-14T06:12:00.0526867Z  ${GPU_FLAG:-} \ 2025-03-14T06:12:00.0527250Z  -e BINARY_ENV_FILE \ 2025-03-14T06:12:00.0527652Z  -e BUILD_ENVIRONMENT \ 2025-03-14T06:12:00.0528036Z  -e DESIRED_CUDA \ 2025-03-14T06:12:00.0528436Z  -e DESIRED_DEVTOOLSET \ 2025-03-14T06:12:00.0528845Z  -e DESIRED_PYTHON \ 2025-03-14T06:12:00.0529235Z  -e GITHUB_ACTIONS \ 2025-03-14T06:12:00.0529902Z  -e GPU_ARCH_TYPE \ 2025-03-14T06:12:00.0530274Z  -e GPU_ARCH_VERSION \ 2025-03-14T06:12:00.0530675Z  -e LIBTORCH_VARIANT \ 2025-03-14T06:12:00.0531068Z  -e PACKAGE_TYPE \ 2025-03-14T06:12:00.0531471Z  -e PYTORCH_FINAL_PACKAGE_DIR \ 2025-03-14T06:12:00.0531898Z  -e PYTORCH_ROOT \ 2025-03-14T06:12:00.0532296Z  -e SKIP_ALL_TESTS \ 2025-03-14T06:12:00.0532687Z  -e USE_SPLIT_BUILD \ 2025-03-14T06:12:00.0533068Z  --tty \ 2025-03-14T06:12:00.0533398Z  --detach \ 2025-03-14T06:12:00.0533802Z  -v "${GITHUB_WORKSPACE}/pytorch:/pytorch" \ 2025-03-14T06:12:00.0534298Z  -v "${RUNNER_TEMP}/artifacts:/final_pkgs" \ 2025-03-14T06:12:00.0534744Z  -w / \ 2025-03-14T06:12:00.0535078Z  "${DOCKER_IMAGE}" 2025-03-14T06:12:00.0535436Z ) 2025-03-14T06:12:00.0535731Z  2025-03-14T06:12:00.0536125Z echo "CONTAINER_NAME=${container_name}" >> "$GITHUB_ENV" 2025-03-14T06:12:00.0537255Z if [[ "${GPU_ARCH_TYPE}" != "rocm" && "${BUILD_ENVIRONMENT}" != "linux-aarch64-binary-manywheel" && "${BUILD_ENVIRONMENT}" != "linux-s390x-binary-manywheel" && "${GPU_ARCH_TYPE}" != "xpu" ]]; then 2025-03-14T06:12:00.0538542Z  # Propagate download.pytorch.org IP to container. This is only needed on Linux non aarch64 runner 2025-03-14T06:12:00.0539530Z  grep download.pytorch.org /etc/hosts | docker exec -i "${container_name}" bash -c "/bin/cat >> /etc/hosts" 2025-03-14T06:12:00.0540224Z fi 2025-03-14T06:12:00.0540524Z  2025-03-14T06:12:00.0541137Z docker exec -t -w "${PYTORCH_ROOT}" "${container_name}" bash -c "bash .circleci/scripts/binary_populate_env.sh" 2025-03-14T06:12:00.0541835Z # Generate test script 2025-03-14T06:12:00.0542787Z docker exec -t -w "${PYTORCH_ROOT}" -e OUTPUT_SCRIPT="/run.sh" "${container_name}" bash -c "bash .circleci/scripts/binary_linux_test.sh" 2025-03-14T06:12:00.0543831Z docker exec -t "${container_name}" bash -c "source ${BINARY_ENV_FILE} && bash -x /run.sh" 2025-03-14T06:12:00.0551851Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T06:12:00.0552351Z env: 2025-03-14T06:12:00.0552658Z PYTORCH_ROOT: /pytorch 2025-03-14T06:12:00.0553038Z PACKAGE_TYPE: manywheel 2025-03-14T06:12:00.0553400Z DESIRED_CUDA: cu126 2025-03-14T06:12:00.0553731Z GPU_ARCH_VERSION: 12.6 2025-03-14T06:12:00.0554089Z GPU_ARCH_TYPE: cuda 2025-03-14T06:12:00.0554521Z DOCKER_IMAGE: pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:12:00.0555012Z SKIP_ALL_TESTS: 1 2025-03-14T06:12:00.0555346Z LIBTORCH_CONFIG: 2025-03-14T06:12:00.0555656Z LIBTORCH_VARIANT: 2025-03-14T06:12:00.0556007Z DESIRED_DEVTOOLSET: cxx11-abi 2025-03-14T06:12:00.0556402Z DESIRED_PYTHON: 3.9 2025-03-14T06:12:00.0556901Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2025-03-14T06:12:00.0557471Z AWS_DEFAULT_REGION: us-east-1 2025-03-14T06:12:00.0557856Z BINARY_ENV_FILE: /tmp/env 2025-03-14T06:12:00.0558255Z BUILD_ENVIRONMENT: linux-binary-manywheel 2025-03-14T06:12:00.0558848Z GITHUB_TOKEN: *** 2025-03-14T06:12:00.0559177Z PR_NUMBER: 2025-03-14T06:12:00.0559508Z PYTORCH_FINAL_PACKAGE_DIR: /artifacts 2025-03-14T06:12:00.0559961Z SHA1: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:12:00.0560383Z USE_SPLIT_BUILD: false 2025-03-14T06:12:00.0560812Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2025-03-14T06:12:00.0561280Z ##[endgroup] 2025-03-14T06:12:00.0600457Z ++ docker run --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all -e BINARY_ENV_FILE -e BUILD_ENVIRONMENT -e DESIRED_CUDA -e DESIRED_DEVTOOLSET -e DESIRED_PYTHON -e GITHUB_ACTIONS -e GPU_ARCH_TYPE -e GPU_ARCH_VERSION -e LIBTORCH_VARIANT -e PACKAGE_TYPE -e PYTORCH_FINAL_PACKAGE_DIR -e PYTORCH_ROOT -e SKIP_ALL_TESTS -e USE_SPLIT_BUILD --tty --detach -v /home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch:/pytorch -v /home/ec2-user/actions-runner/_work/_temp/artifacts:/final_pkgs -w / pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:12:38.9570502Z + container_name=cd74cffec1e3b460f4ae001d11df352321480394e396aaf3d7a17cd5a80cfa8b 2025-03-14T06:12:38.9573534Z + echo CONTAINER_NAME=cd74cffec1e3b460f4ae001d11df352321480394e396aaf3d7a17cd5a80cfa8b 2025-03-14T06:12:38.9574417Z + [[ cuda != \r\o\c\m ]] 2025-03-14T06:12:38.9574975Z + [[ linux-binary-manywheel != \l\i\n\u\x\-\a\a\r\c\h\6\4\-\b\i\n\a\r\y\-\m\a\n\y\w\h\e\e\l ]] 2025-03-14T06:12:38.9575732Z + [[ linux-binary-manywheel != \l\i\n\u\x\-\s\3\9\0\x\-\b\i\n\a\r\y\-\m\a\n\y\w\h\e\e\l ]] 2025-03-14T06:12:38.9576305Z + [[ cuda != \x\p\u ]] 2025-03-14T06:12:38.9576692Z + grep download.pytorch.org /etc/hosts 2025-03-14T06:12:38.9577526Z + docker exec -i cd74cffec1e3b460f4ae001d11df352321480394e396aaf3d7a17cd5a80cfa8b bash -c '/bin/cat >> /etc/hosts' 2025-03-14T06:12:39.0857072Z + docker exec -t -w /pytorch cd74cffec1e3b460f4ae001d11df352321480394e396aaf3d7a17cd5a80cfa8b bash -c 'bash .circleci/scripts/binary_populate_env.sh' 2025-03-14T06:12:39.1479697Z + export TZ=UTC 2025-03-14T06:12:39.1480065Z + TZ=UTC 2025-03-14T06:12:39.1480789Z + envfile=/tmp/env 2025-03-14T06:12:39.1481126Z + [[ -n /pytorch ]] 2025-03-14T06:12:39.1484804Z ++ dirname /pytorch 2025-03-14T06:12:39.1508321Z + workdir=/ 2025-03-14T06:12:39.1508870Z + [[ manywheel == \l\i\b\t\o\r\c\h ]] 2025-03-14T06:12:39.1509490Z + export DOCKER_IMAGE= 2025-03-14T06:12:39.1509831Z + DOCKER_IMAGE= 2025-03-14T06:12:39.1510195Z + [[ -z '' ]] 2025-03-14T06:12:39.1510742Z + [[ cu126 == cpu ]] 2025-03-14T06:12:39.1511278Z + export DOCKER_IMAGE=pytorch/manylinux2_28-builder:126 2025-03-14T06:12:39.1511808Z + DOCKER_IMAGE=pytorch/manylinux2_28-builder:126 2025-03-14T06:12:39.1512245Z + USE_GOLD_LINKER=OFF 2025-03-14T06:12:39.1512602Z + [[ cu126 == \c\p\u ]] 2025-03-14T06:12:39.1513485Z + PIP_UPLOAD_FOLDER=nightly/ 2025-03-14T06:12:39.1515653Z ++ date -u +%Y%m%d 2025-03-14T06:12:39.1538638Z + export DATE=20250314 2025-03-14T06:12:39.1539009Z + DATE=20250314 2025-03-14T06:12:39.1544935Z ++ cat /pytorch/version.txt 2025-03-14T06:12:39.1546868Z ++ cut -da -f1 2025-03-14T06:12:39.1571983Z + BASE_BUILD_VERSION=2.8.0.dev20250314 2025-03-14T06:12:39.1572493Z + tagged_version 2025-03-14T06:12:39.1573010Z + GIT_DIR=//pytorch/.git 2025-03-14T06:12:39.1573768Z + GIT_DESCRIBE='git --git-dir //pytorch/.git describe --tags --match v[0-9]*.[0-9]*.[0-9]*' 2025-03-14T06:12:39.1574627Z + [[ ! -d //pytorch/.git ]] 2025-03-14T06:12:39.1575186Z + git --git-dir //pytorch/.git describe --tags --match 'v[0-9]*.[0-9]*.[0-9]*' --exact 2025-03-14T06:12:39.1597113Z fatal: No names found, cannot describe anything. 2025-03-14T06:12:39.1598423Z + return 1 2025-03-14T06:12:39.1602252Z ++ uname 2025-03-14T06:12:39.1624682Z + [[ Linux == \D\a\r\w\i\n ]] 2025-03-14T06:12:39.1625214Z + export PYTORCH_BUILD_VERSION=2.8.0.dev20250314+cu126 2025-03-14T06:12:39.1625729Z + PYTORCH_BUILD_VERSION=2.8.0.dev20250314+cu126 2025-03-14T06:12:39.1626784Z + export PYTORCH_BUILD_NUMBER=1 2025-03-14T06:12:39.1627280Z + PYTORCH_BUILD_NUMBER=1 2025-03-14T06:12:39.1629934Z ++ cat /pytorch/.ci/docker/triton_version.txt 2025-03-14T06:12:39.1651961Z + TRITON_VERSION=3.3.0 2025-03-14T06:12:39.1652614Z + TRITON_CONSTRAINT='platform_system == '\''Linux'\'' and platform_machine == '\''x86_64'\''' 2025-03-14T06:12:39.1653459Z + [[ manywheel =~ .*wheel.* ]] 2025-03-14T06:12:39.1653977Z + [[ -n '' ]] 2025-03-14T06:12:39.1655261Z + [[ manywheel =~ .*wheel.* ]] 2025-03-14T06:12:39.1655820Z + [[ -n 2.8.0.dev20250314+cu126 ]] 2025-03-14T06:12:39.1656248Z + [[ 2.8.0.dev20250314+cu126 =~ .*rocm.* ]] 2025-03-14T06:12:39.1656660Z + [[ manywheel =~ .*wheel.* ]] 2025-03-14T06:12:39.1657050Z + [[ -n 2.8.0.dev20250314+cu126 ]] 2025-03-14T06:12:39.1657455Z + [[ 2.8.0.dev20250314+cu126 =~ .*xpu.* ]] 2025-03-14T06:12:39.1657878Z + USE_GLOO_WITH_OPENSSL=ON 2025-03-14T06:12:39.1658264Z + [[ cuda =~ .*aarch64.* ]] 2025-03-14T06:12:39.1658606Z + cat 2025-03-14T06:12:39.1666041Z ++ uname -a 2025-03-14T06:12:39.1690857Z ++ date 2025-03-14T06:12:39.1740659Z ++ uname 2025-03-14T06:12:39.1762402Z + [[ Linux != Darwin ]] 2025-03-14T06:12:39.1762776Z + MEMORY_LIMIT_MAX_JOBS=12 2025-03-14T06:12:39.1766197Z ++ nproc 2025-03-14T06:12:39.1790137Z + NUM_CPUS=14 2025-03-14T06:12:39.1790498Z + export MAX_JOBS=12 2025-03-14T06:12:39.1790848Z + MAX_JOBS=12 2025-03-14T06:12:39.1791155Z + cat 2025-03-14T06:12:39.1816617Z + echo 'retry () {' 2025-03-14T06:12:39.1817297Z + echo ' $* || (sleep 1 && $*) || (sleep 2 && $*) || (sleep 4 && $*) || (sleep 8 && $*)' 2025-03-14T06:12:39.1817819Z + echo '}' 2025-03-14T06:12:39.1818258Z + echo 'export -f retry' 2025-03-14T06:12:39.1818703Z + cat /tmp/env 2025-03-14T06:12:39.1841393Z # =================== The following code will be executed inside Docker container =================== 2025-03-14T06:12:39.1842027Z export TZ=UTC 2025-03-14T06:12:39.1842898Z echo "Running on Linux cd74cffec1e3 6.1.128-136.201.amzn2023.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Feb 10 16:18:01 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux at Fri Mar 14 06:12:39 UTC 2025" 2025-03-14T06:12:39.1843941Z 2025-03-14T06:12:39.1844168Z export PACKAGE_TYPE="manywheel" 2025-03-14T06:12:39.1844588Z export DESIRED_PYTHON="3.9" 2025-03-14T06:12:39.1845254Z export DESIRED_CUDA="cu126" 2025-03-14T06:12:39.1845832Z export LIBTORCH_VARIANT="" 2025-03-14T06:12:39.1846353Z export BUILD_PYTHONLESS="" 2025-03-14T06:12:39.1846891Z export USE_SPLIT_BUILD="false" 2025-03-14T06:12:39.1847303Z if [[ "linux-gnu" == "msys" ]]; then 2025-03-14T06:12:39.1847901Z export LIBTORCH_CONFIG="" 2025-03-14T06:12:39.1848333Z if [[ "" == 'debug' ]]; then 2025-03-14T06:12:39.1848689Z export DEBUG=1 2025-03-14T06:12:39.1849145Z fi 2025-03-14T06:12:39.1849550Z export DESIRED_DEVTOOLSET="" 2025-03-14T06:12:39.1850092Z else 2025-03-14T06:12:39.1850595Z export DESIRED_DEVTOOLSET="cxx11-abi" 2025-03-14T06:12:39.1851087Z fi 2025-03-14T06:12:39.1853909Z 2025-03-14T06:12:39.1854120Z export DATE="20250314" 2025-03-14T06:12:39.1854513Z export NIGHTLIES_DATE_PREAMBLE=1.14.0.dev 2025-03-14T06:12:39.1855028Z export PYTORCH_BUILD_VERSION="2.8.0.dev20250314+cu126" 2025-03-14T06:12:39.1855727Z export PYTORCH_BUILD_NUMBER="1" 2025-03-14T06:12:39.1856201Z export OVERRIDE_PACKAGE_VERSION="2.8.0.dev20250314+cu126" 2025-03-14T06:12:39.1856942Z export PYTORCH_EXTRA_INSTALL_REQUIREMENTS="" 2025-03-14T06:12:39.1857310Z 2025-03-14T06:12:39.1857474Z # TODO: We don't need this anymore IIUC 2025-03-14T06:12:39.1857963Z export TORCH_PACKAGE_NAME='torch' 2025-03-14T06:12:39.1858431Z 2025-03-14T06:12:39.1858601Z export USE_FBGEMM=1 2025-03-14T06:12:39.1858947Z export PIP_UPLOAD_FOLDER="nightly/" 2025-03-14T06:12:39.1859639Z export DOCKER_IMAGE="pytorch/manylinux2_28-builder:126" 2025-03-14T06:12:39.1860024Z 2025-03-14T06:12:39.1860041Z 2025-03-14T06:12:39.1860199Z export USE_GOLD_LINKER="OFF" 2025-03-14T06:12:39.1860596Z export USE_GLOO_WITH_OPENSSL="ON" 2025-03-14T06:12:39.1861163Z # =================== The above code will be executed inside Docker container =================== 2025-03-14T06:12:39.1861742Z export MAX_JOBS="12" 2025-03-14T06:12:39.1862068Z retry () { 2025-03-14T06:12:39.1862477Z $* || (sleep 1 && $*) || (sleep 2 && $*) || (sleep 4 && $*) || (sleep 8 && $*) 2025-03-14T06:12:39.1863349Z } 2025-03-14T06:12:39.1863841Z export -f retry 2025-03-14T06:12:39.1866381Z + docker exec -t -w /pytorch -e OUTPUT_SCRIPT=/run.sh cd74cffec1e3b460f4ae001d11df352321480394e396aaf3d7a17cd5a80cfa8b bash -c 'bash .circleci/scripts/binary_linux_test.sh' 2025-03-14T06:12:39.3688274Z ls: cannot access '/final_pkgs/torch_no_python*': No such file or directory 2025-03-14T06:12:39.3750695Z 2025-03-14T06:12:39.3750715Z 2025-03-14T06:12:39.3751002Z The script that will run in the next step is: 2025-03-14T06:12:39.3772746Z # =================== The following code will be executed inside Docker container =================== 2025-03-14T06:12:39.3773431Z set -eux -o pipefail 2025-03-14T06:12:39.3773654Z 2025-03-14T06:12:39.3773805Z retry () { 2025-03-14T06:12:39.3774124Z "$@" || (sleep 1 && "$@") || (sleep 2 && "$@") 2025-03-14T06:12:39.3774804Z } 2025-03-14T06:12:39.3774981Z 2025-03-14T06:12:39.3775144Z # Source binary env file here if exists 2025-03-14T06:12:39.3775579Z if [[ -e "/tmp/env" ]]; then 2025-03-14T06:12:39.3775953Z source "/tmp/env" 2025-03-14T06:12:39.3776260Z fi 2025-03-14T06:12:39.3776435Z 2025-03-14T06:12:39.3776598Z python_nodot="$(echo 3.9 | tr -d m.u)" 2025-03-14T06:12:39.3776895Z 2025-03-14T06:12:39.3777032Z # Set up Python 2025-03-14T06:12:39.3777385Z if [[ "manywheel" != libtorch ]]; then 2025-03-14T06:12:39.3777904Z python_path="/opt/python/cp$python_nodot-cp${python_nodot}" 2025-03-14T06:12:39.3778427Z if [[ "$python_nodot" = *t ]]; then 2025-03-14T06:12:39.3778865Z python_digits="$(echo 3.9 | tr -cd [:digit:])" 2025-03-14T06:12:39.3779722Z python_path="/opt/python/cp$python_digits-cp${python_digits}t" 2025-03-14T06:12:39.3780718Z fi 2025-03-14T06:12:39.3781137Z export PATH="${python_path}/bin:$PATH" 2025-03-14T06:12:39.3781553Z fi 2025-03-14T06:12:39.3781713Z 2025-03-14T06:12:39.3781862Z EXTRA_CONDA_FLAGS="" 2025-03-14T06:12:39.3782398Z NUMPY_PIN="" 2025-03-14T06:12:39.3782788Z PROTOBUF_PACKAGE="defaults::protobuf" 2025-03-14T06:12:39.3783076Z 2025-03-14T06:12:39.3783251Z if [[ "$python_nodot" = *310* ]]; then 2025-03-14T06:12:39.3784334Z # There's an issue with conda channel priority where it'll randomly pick 1.19 over 1.20 2025-03-14T06:12:39.3785136Z # we set a lower boundary here just to be safe 2025-03-14T06:12:39.3785926Z NUMPY_PIN=">=1.21.2" 2025-03-14T06:12:39.3786571Z PROTOBUF_PACKAGE="protobuf>=3.19.0" 2025-03-14T06:12:39.3787295Z fi 2025-03-14T06:12:39.3787581Z 2025-03-14T06:12:39.3787876Z if [[ "$python_nodot" = *39* ]]; then 2025-03-14T06:12:39.3789039Z # There's an issue with conda channel priority where it'll randomly pick 1.19 over 1.20 2025-03-14T06:12:39.3790652Z # we set a lower boundary here just to be safe 2025-03-14T06:12:39.3791461Z NUMPY_PIN=">=1.20" 2025-03-14T06:12:39.3792046Z fi 2025-03-14T06:12:39.3792332Z 2025-03-14T06:12:39.3792873Z # Move debug wheels out of the package dir so they don't get installed 2025-03-14T06:12:39.3793905Z mkdir -p /tmp/debug_final_pkgs 2025-03-14T06:12:39.3795000Z mv /final_pkgs/debug-*.zip /tmp/debug_final_pkgs || echo "no debug packages to move" 2025-03-14T06:12:39.3795995Z 2025-03-14T06:12:39.3796258Z # Install the package 2025-03-14T06:12:39.3797284Z # These network calls should not have 'retry's because they are installing 2025-03-14T06:12:39.3798531Z # locally and aren't actually network calls 2025-03-14T06:12:39.3799708Z # Pick only one package of multiple available (which happens as result of workflow re-runs) 2025-03-14T06:12:39.3800426Z pkg="/final_pkgs/$(ls -1 /final_pkgs|sort|tail -1)" 2025-03-14T06:12:39.3800932Z if [[ "$PYTORCH_BUILD_VERSION" == *dev* ]]; then 2025-03-14T06:12:39.3801359Z CHANNEL="nightly" 2025-03-14T06:12:39.3801706Z else 2025-03-14T06:12:39.3802005Z CHANNEL="test" 2025-03-14T06:12:39.3802331Z fi 2025-03-14T06:12:39.3802489Z 2025-03-14T06:12:39.3802651Z if [[ "manywheel" != libtorch ]]; then 2025-03-14T06:12:39.3803107Z if [[ "$BUILD_ENVIRONMENT" != *s390x* ]]; then 2025-03-14T06:12:39.3803558Z if [[ "false" == "true" ]]; then 2025-03-14T06:12:39.3803956Z pkg_no_python="" 2025-03-14T06:12:39.3804536Z pkg_torch="/final_pkgs/torch-2.8.0.dev20250314+cu126-cp39-cp39-manylinux_2_28_x86_64.whl" 2025-03-14T06:12:39.3805287Z # todo: after folder is populated use the pypi_pkg channel instead 2025-03-14T06:12:39.3806139Z pip install "$pkg_no_python" "$pkg_torch" --index-url "https://download.pytorch.org/whl/${CHANNEL}/cu126_pypi_pkg" 2025-03-14T06:12:39.3806955Z retry pip install -q numpy protobuf typing-extensions 2025-03-14T06:12:39.3807457Z else 2025-03-14T06:12:39.3807960Z pip install "$pkg" --index-url "https://download.pytorch.org/whl/${CHANNEL}/cu126" 2025-03-14T06:12:39.3808658Z retry pip install -q numpy protobuf typing-extensions 2025-03-14T06:12:39.3809117Z fi 2025-03-14T06:12:39.3809410Z else 2025-03-14T06:12:39.3809879Z pip install "$pkg" 2025-03-14T06:12:39.3810325Z retry pip install -q numpy protobuf typing-extensions 2025-03-14T06:12:39.3810800Z fi 2025-03-14T06:12:39.3811066Z fi 2025-03-14T06:12:39.3811379Z if [[ "manywheel" == libtorch ]]; then 2025-03-14T06:12:39.3811837Z pkg="$(ls /final_pkgs/*-latest.zip)" 2025-03-14T06:12:39.3812257Z unzip "$pkg" -d /tmp 2025-03-14T06:12:39.3812607Z cd /tmp/libtorch 2025-03-14T06:12:39.3812903Z fi 2025-03-14T06:12:39.3813075Z 2025-03-14T06:12:39.3813211Z # Test the package 2025-03-14T06:12:39.3813562Z /pytorch/.ci/pytorch/check_binary.sh 2025-03-14T06:12:39.3813839Z 2025-03-14T06:12:39.3814253Z if [[ "$GPU_ARCH_TYPE" != *s390x* && "$GPU_ARCH_TYPE" != *xpu* && "$GPU_ARCH_TYPE" != *rocm* && "manywheel" != libtorch ]]; then 2025-03-14T06:12:39.3815035Z # Exclude s390, xpu, rocm and libtorch builds from smoke testing 2025-03-14T06:12:39.3815872Z python /pytorch/.ci/pytorch/smoke_test/smoke_test.py --package=torchonly --torch-compile-check disabled 2025-03-14T06:12:39.3816575Z fi 2025-03-14T06:12:39.3816749Z 2025-03-14T06:12:39.3816885Z # Clean temp files 2025-03-14T06:12:39.3817255Z cd /pytorch/.ci/pytorch/ && git clean -ffdx 2025-03-14T06:12:39.3817549Z 2025-03-14T06:12:39.3817867Z # =================== The above code will be executed inside Docker container =================== 2025-03-14T06:12:39.3818880Z + docker exec -t cd74cffec1e3b460f4ae001d11df352321480394e396aaf3d7a17cd5a80cfa8b bash -c 'source /tmp/env && bash -x /run.sh' 2025-03-14T06:12:39.4423753Z Running on Linux cd74cffec1e3 6.1.128-136.201.amzn2023.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Feb 10 16:18:01 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux at Fri Mar 14 06:12:39 UTC 2025 2025-03-14T06:12:39.4445000Z + set -eux -o pipefail 2025-03-14T06:12:39.4445389Z + [[ -e /tmp/env ]] 2025-03-14T06:12:39.4445825Z + source /tmp/env 2025-03-14T06:12:39.4446761Z ++ export TZ=UTC 2025-03-14T06:12:39.4447331Z ++ TZ=UTC 2025-03-14T06:12:39.4448891Z ++ echo 'Running on Linux cd74cffec1e3 6.1.128-136.201.amzn2023.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Feb 10 16:18:01 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux at Fri Mar 14 06:12:39 UTC 2025' 2025-03-14T06:12:39.4451391Z Running on Linux cd74cffec1e3 6.1.128-136.201.amzn2023.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Feb 10 16:18:01 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux at Fri Mar 14 06:12:39 UTC 2025 2025-03-14T06:12:39.4452690Z ++ export PACKAGE_TYPE=manywheel 2025-03-14T06:12:39.4453110Z ++ PACKAGE_TYPE=manywheel 2025-03-14T06:12:39.4453662Z ++ export DESIRED_PYTHON=3.9 2025-03-14T06:12:39.4454027Z ++ DESIRED_PYTHON=3.9 2025-03-14T06:12:39.4454384Z ++ export DESIRED_CUDA=cu126 2025-03-14T06:12:39.4454758Z ++ DESIRED_CUDA=cu126 2025-03-14T06:12:39.4455109Z ++ export LIBTORCH_VARIANT= 2025-03-14T06:12:39.4455463Z ++ LIBTORCH_VARIANT= 2025-03-14T06:12:39.4455817Z ++ export BUILD_PYTHONLESS= 2025-03-14T06:12:39.4456202Z ++ BUILD_PYTHONLESS= 2025-03-14T06:12:39.4456558Z ++ export USE_SPLIT_BUILD=false 2025-03-14T06:12:39.4456943Z ++ USE_SPLIT_BUILD=false 2025-03-14T06:12:39.4457300Z ++ [[ linux-gnu == \m\s\y\s ]] 2025-03-14T06:12:39.4457708Z ++ export DESIRED_DEVTOOLSET=cxx11-abi 2025-03-14T06:12:39.4458146Z ++ DESIRED_DEVTOOLSET=cxx11-abi 2025-03-14T06:12:39.4458532Z ++ export DATE=20250314 2025-03-14T06:12:39.4458871Z ++ DATE=20250314 2025-03-14T06:12:39.4459214Z ++ export NIGHTLIES_DATE_PREAMBLE=1.14.0.dev 2025-03-14T06:12:39.4459675Z ++ NIGHTLIES_DATE_PREAMBLE=1.14.0.dev 2025-03-14T06:12:39.4460160Z ++ export PYTORCH_BUILD_VERSION=2.8.0.dev20250314+cu126 2025-03-14T06:12:39.4460964Z ++ PYTORCH_BUILD_VERSION=2.8.0.dev20250314+cu126 2025-03-14T06:12:39.4461491Z ++ export PYTORCH_BUILD_NUMBER=1 2025-03-14T06:12:39.4461873Z ++ PYTORCH_BUILD_NUMBER=1 2025-03-14T06:12:39.4462555Z ++ export OVERRIDE_PACKAGE_VERSION=2.8.0.dev20250314+cu126 2025-03-14T06:12:39.4463269Z ++ OVERRIDE_PACKAGE_VERSION=2.8.0.dev20250314+cu126 2025-03-14T06:12:39.4463821Z ++ export PYTORCH_EXTRA_INSTALL_REQUIREMENTS= 2025-03-14T06:12:39.4464462Z ++ PYTORCH_EXTRA_INSTALL_REQUIREMENTS= 2025-03-14T06:12:39.4465093Z ++ export TORCH_PACKAGE_NAME=torch 2025-03-14T06:12:39.4465517Z ++ TORCH_PACKAGE_NAME=torch 2025-03-14T06:12:39.4465888Z ++ export USE_FBGEMM=1 2025-03-14T06:12:39.4466233Z ++ USE_FBGEMM=1 2025-03-14T06:12:39.4466577Z ++ export PIP_UPLOAD_FOLDER=nightly/ 2025-03-14T06:12:39.4466980Z ++ PIP_UPLOAD_FOLDER=nightly/ 2025-03-14T06:12:39.4467445Z ++ export DOCKER_IMAGE=pytorch/manylinux2_28-builder:126 2025-03-14T06:12:39.4467977Z ++ DOCKER_IMAGE=pytorch/manylinux2_28-builder:126 2025-03-14T06:12:39.4468439Z ++ export USE_GOLD_LINKER=OFF 2025-03-14T06:12:39.4468814Z ++ USE_GOLD_LINKER=OFF 2025-03-14T06:12:39.4469158Z ++ export USE_GLOO_WITH_OPENSSL=ON 2025-03-14T06:12:39.4469562Z ++ USE_GLOO_WITH_OPENSSL=ON 2025-03-14T06:12:39.4469928Z ++ export MAX_JOBS=12 2025-03-14T06:12:39.4470259Z ++ MAX_JOBS=12 2025-03-14T06:12:39.4470579Z ++ export -f retry 2025-03-14T06:12:39.4470889Z ++ echo 3.9 2025-03-14T06:12:39.4471191Z ++ tr -d m.u 2025-03-14T06:12:39.4488861Z + python_nodot=39 2025-03-14T06:12:39.4489239Z + [[ manywheel != libtorch ]] 2025-03-14T06:12:39.4489823Z + python_path=/opt/python/cp39-cp39 2025-03-14T06:12:39.4490208Z + [[ 39 = *t ]] 2025-03-14T06:12:39.4491164Z + export PATH=/opt/python/cp39-cp39/bin:/usr/local/cuda/bin:/opt/rh/gcc-toolset-11/root/usr/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2025-03-14T06:12:39.4492713Z + PATH=/opt/python/cp39-cp39/bin:/usr/local/cuda/bin:/opt/rh/gcc-toolset-11/root/usr/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2025-03-14T06:12:39.4493669Z + EXTRA_CONDA_FLAGS= 2025-03-14T06:12:39.4494009Z + NUMPY_PIN= 2025-03-14T06:12:39.4494383Z + PROTOBUF_PACKAGE=defaults::protobuf 2025-03-14T06:12:39.4494779Z + [[ 39 = *310* ]] 2025-03-14T06:12:39.4495092Z + [[ 39 = *39* ]] 2025-03-14T06:12:39.4495412Z + NUMPY_PIN='>=1.20' 2025-03-14T06:12:39.4495924Z + mkdir -p /tmp/debug_final_pkgs 2025-03-14T06:12:39.4518751Z + mv '/final_pkgs/debug-*.zip' /tmp/debug_final_pkgs 2025-03-14T06:12:39.4543326Z mv: cannot stat '/final_pkgs/debug-*.zip': No such file or directory 2025-03-14T06:12:39.4545496Z + echo 'no debug packages to move' 2025-03-14T06:12:39.4545923Z no debug packages to move 2025-03-14T06:12:39.4553152Z ++ ls -1 /final_pkgs 2025-03-14T06:12:39.4554766Z ++ sort 2025-03-14T06:12:39.4557298Z ++ tail -1 2025-03-14T06:12:39.4583558Z + pkg=/final_pkgs/torch-2.8.0.dev20250314+cu126-cp39-cp39-manylinux_2_28_x86_64.whl 2025-03-14T06:12:39.4584208Z + [[ 2.8.0.dev20250314+cu126 == *dev* ]] 2025-03-14T06:12:39.4584611Z + CHANNEL=nightly 2025-03-14T06:12:39.4584946Z + [[ manywheel != libtorch ]] 2025-03-14T06:12:39.4585349Z + [[ linux-binary-manywheel != *s390x* ]] 2025-03-14T06:12:39.4585758Z + [[ false == \t\r\u\e ]] 2025-03-14T06:12:39.4586658Z + pip install /final_pkgs/torch-2.8.0.dev20250314+cu126-cp39-cp39-manylinux_2_28_x86_64.whl --index-url https://download.pytorch.org/whl/nightly/cu126 2025-03-14T06:12:41.1137498Z Looking in indexes: https://download.pytorch.org/whl/nightly/cu126 2025-03-14T06:12:41.1199115Z Processing /final_pkgs/torch-2.8.0.dev20250314+cu126-cp39-cp39-manylinux_2_28_x86_64.whl 2025-03-14T06:12:44.0318474Z Collecting filelock (from torch==2.8.0.dev20250314+cu126) 2025-03-14T06:12:44.0359705Z Downloading https://download.pytorch.org/whl/nightly/filelock-3.16.1-py3-none-any.whl (16 kB) 2025-03-14T06:12:44.0812633Z Collecting typing-extensions>=4.10.0 (from torch==2.8.0.dev20250314+cu126) 2025-03-14T06:12:44.0861253Z Downloading https://download.pytorch.org/whl/nightly/typing_extensions-4.12.2-py3-none-any.whl (37 kB) 2025-03-14T06:12:44.1270670Z Collecting sympy>=1.13.3 (from torch==2.8.0.dev20250314+cu126) 2025-03-14T06:12:44.1313915Z Downloading https://download.pytorch.org/whl/nightly/sympy-1.13.3-py3-none-any.whl (6.2 MB) 2025-03-14T06:12:44.1738628Z [?25l ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 0.0/6.2 MB ? eta -:--:-- 2025-03-14T06:12:44.1739641Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6.2/6.2 MB 166.9 MB/s eta 0:00:00 2025-03-14T06:12:44.2447023Z [?25hCollecting networkx (from torch==2.8.0.dev20250314+cu126) 2025-03-14T06:12:44.2491956Z Downloading https://download.pytorch.org/whl/nightly/networkx-3.4.2-py3-none-any.whl (1.7 MB) 2025-03-14T06:12:44.2662834Z [?25l ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 0.0/1.7 MB ? eta -:--:-- 2025-03-14T06:12:44.2663740Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.7/1.7 MB 118.3 MB/s eta 0:00:00 2025-03-14T06:12:44.3532531Z [?25hCollecting jinja2 (from torch==2.8.0.dev20250314+cu126) 2025-03-14T06:12:44.3572133Z Downloading https://download.pytorch.org/whl/nightly/jinja2-3.1.4-py3-none-any.whl (133 kB) 2025-03-14T06:12:44.3888423Z Collecting fsspec (from torch==2.8.0.dev20250314+cu126) 2025-03-14T06:12:44.3928335Z Downloading https://download.pytorch.org/whl/nightly/fsspec-2024.10.0-py3-none-any.whl (179 kB) 2025-03-14T06:12:44.4865804Z Collecting nvidia-cuda-nvrtc-cu12==12.6.77 (from torch==2.8.0.dev20250314+cu126) 2025-03-14T06:12:44.4906106Z Downloading https://download.pytorch.org/whl/nightly/cu126/nvidia_cuda_nvrtc_cu12-12.6.77-py3-none-manylinux2014_x86_64.whl (23.7 MB) 2025-03-14T06:12:44.6120886Z [?25l ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 0.0/23.7 MB ? eta -:--:-- 2025-03-14T06:12:44.6121973Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 23.7/23.7 MB 202.0 MB/s eta 0:00:00 2025-03-14T06:12:44.7219617Z [?25hCollecting nvidia-cuda-runtime-cu12==12.6.77 (from torch==2.8.0.dev20250314+cu126) 2025-03-14T06:12:44.7264960Z Downloading https://download.pytorch.org/whl/nightly/cu126/nvidia_cuda_runtime_cu12-12.6.77-py3-none-manylinux2014_x86_64.whl (897 kB) 2025-03-14T06:12:44.7400102Z [?25l ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 0.0/897.7 kB ? eta -:--:-- 2025-03-14T06:12:44.7401056Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 897.7/897.7 kB 76.1 MB/s eta 0:00:00 2025-03-14T06:12:44.7722793Z [?25hCollecting nvidia-cuda-cupti-cu12==12.6.80 (from torch==2.8.0.dev20250314+cu126) 2025-03-14T06:12:44.7768305Z Downloading https://download.pytorch.org/whl/nightly/cu126/nvidia_cuda_cupti_cu12-12.6.80-py3-none-manylinux2014_x86_64.whl (8.9 MB) 2025-03-14T06:12:44.8317430Z [?25l ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 0.0/8.9 MB ? eta -:--:-- 2025-03-14T06:12:44.8318348Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 8.9/8.9 MB 177.1 MB/s eta 0:00:00 2025-03-14T06:12:44.8917358Z [?25hCollecting nvidia-cudnn-cu12==9.5.1.17 (from torch==2.8.0.dev20250314+cu126) 2025-03-14T06:12:44.8963794Z Downloading https://download.pytorch.org/whl/nightly/cu126/nvidia_cudnn_cu12-9.5.1.17-py3-none-manylinux_2_28_x86_64.whl (571.0 MB) 2025-03-14T06:12:45.1014826Z [?25l ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 0.0/571.0 MB ? eta -:--:-- 2025-03-14T06:12:45.3040941Z  ━━╸━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 41.7/571.0 MB 208.8 MB/s eta 0:00:03 2025-03-14T06:12:45.5067224Z  ━━━━━━━━╺━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 125.6/571.0 MB 311.9 MB/s eta 0:00:02 2025-03-14T06:12:45.7094680Z  ━━━━━━━━━━━━━╸━━━━━━━━━━━━━━━━━━━━━━━ 211.6/571.0 MB 349.5 MB/s eta 0:00:02 2025-03-14T06:12:45.9120647Z  ━━━━━━━━━━━━━━━━━━━╺━━━━━━━━━━━━━━━━━ 298.1/571.0 MB 408.5 MB/s eta 0:00:01 2025-03-14T06:12:46.1147442Z  ━━━━━━━━━━━━━━━━━━━━━━━━╸━━━━━━━━━━━━ 384.3/571.0 MB 425.6 MB/s eta 0:00:01 2025-03-14T06:12:46.3174045Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╺━━━━━━ 470.3/571.0 MB 426.0 MB/s eta 0:00:01 2025-03-14T06:12:46.5200157Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╺ 557.3/571.0 MB 426.5 MB/s eta 0:00:01 2025-03-14T06:12:46.7227142Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 570.9/571.0 MB 427.0 MB/s eta 0:00:01 2025-03-14T06:12:46.9250705Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 570.9/571.0 MB 427.0 MB/s eta 0:00:01 2025-03-14T06:12:47.1275514Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 570.9/571.0 MB 427.0 MB/s eta 0:00:01 2025-03-14T06:12:47.3301533Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 570.9/571.0 MB 427.0 MB/s eta 0:00:01 2025-03-14T06:12:47.5324202Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 570.9/571.0 MB 427.0 MB/s eta 0:00:01 2025-03-14T06:12:47.7348951Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 570.9/571.0 MB 427.0 MB/s eta 0:00:01 2025-03-14T06:12:47.9372153Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 570.9/571.0 MB 427.0 MB/s eta 0:00:01 2025-03-14T06:12:48.1395719Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 570.9/571.0 MB 427.0 MB/s eta 0:00:01 2025-03-14T06:12:48.3418416Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 570.9/571.0 MB 427.0 MB/s eta 0:00:01 2025-03-14T06:12:48.5441572Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 570.9/571.0 MB 427.0 MB/s eta 0:00:01 2025-03-14T06:12:48.7463423Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 570.9/571.0 MB 427.0 MB/s eta 0:00:01 2025-03-14T06:12:48.9485951Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 570.9/571.0 MB 427.0 MB/s eta 0:00:01 2025-03-14T06:12:49.1507375Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 570.9/571.0 MB 427.0 MB/s eta 0:00:01 2025-03-14T06:12:49.3530958Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 570.9/571.0 MB 427.0 MB/s eta 0:00:01 2025-03-14T06:12:49.5553837Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 570.9/571.0 MB 427.0 MB/s eta 0:00:01 2025-03-14T06:12:49.7575273Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 570.9/571.0 MB 427.0 MB/s eta 0:00:01 2025-03-14T06:12:49.9598003Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 570.9/571.0 MB 427.0 MB/s eta 0:00:01 2025-03-14T06:12:49.9794064Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 570.9/571.0 MB 427.0 MB/s eta 0:00:01 2025-03-14T06:12:49.9795032Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 571.0/571.0 MB 61.7 MB/s eta 0:00:00 2025-03-14T06:12:51.7511050Z [?25hCollecting nvidia-cublas-cu12==12.6.4.1 (from torch==2.8.0.dev20250314+cu126) 2025-03-14T06:12:51.7552722Z Downloading https://download.pytorch.org/whl/nightly/cu126/nvidia_cublas_cu12-12.6.4.1-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (393.1 MB) 2025-03-14T06:12:51.9601005Z [?25l ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 0.0/393.1 MB ? eta -:--:-- 2025-03-14T06:12:52.1629154Z  ━━━━━━━━╺━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 84.9/393.1 MB 425.3 MB/s eta 0:00:01 2025-03-14T06:12:52.3655529Z  ━━━━━━━━━━━━━━━━╺━━━━━━━━━━━━━━━━━━━━ 171.4/393.1 MB 425.9 MB/s eta 0:00:01 2025-03-14T06:12:52.5681642Z  ━━━━━━━━━━━━━━━━━━━━━━━━╺━━━━━━━━━━━━ 257.7/393.1 MB 425.9 MB/s eta 0:00:01 2025-03-14T06:12:52.7707440Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╺━━━━ 343.9/393.1 MB 426.2 MB/s eta 0:00:01 2025-03-14T06:12:52.9731614Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 393.0/393.1 MB 426.6 MB/s eta 0:00:01 2025-03-14T06:12:53.1757876Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 393.0/393.1 MB 426.6 MB/s eta 0:00:01 2025-03-14T06:12:53.3779588Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 393.0/393.1 MB 426.6 MB/s eta 0:00:01 2025-03-14T06:12:53.5801231Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 393.0/393.1 MB 426.6 MB/s eta 0:00:01 2025-03-14T06:12:53.7825509Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 393.0/393.1 MB 426.6 MB/s eta 0:00:01 2025-03-14T06:12:53.9850068Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 393.0/393.1 MB 426.6 MB/s eta 0:00:01 2025-03-14T06:12:54.1872441Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 393.0/393.1 MB 426.6 MB/s eta 0:00:01 2025-03-14T06:12:54.3895624Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 393.0/393.1 MB 426.6 MB/s eta 0:00:01 2025-03-14T06:12:54.5917475Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 393.0/393.1 MB 426.6 MB/s eta 0:00:01 2025-03-14T06:12:54.7941342Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 393.0/393.1 MB 426.6 MB/s eta 0:00:01 2025-03-14T06:12:54.8577225Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 393.0/393.1 MB 426.6 MB/s eta 0:00:01 2025-03-14T06:12:54.8578225Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 393.1/393.1 MB 93.9 MB/s eta 0:00:00 2025-03-14T06:12:56.0870420Z [?25hCollecting nvidia-cufft-cu12==11.3.0.4 (from torch==2.8.0.dev20250314+cu126) 2025-03-14T06:12:56.0910933Z Downloading https://download.pytorch.org/whl/nightly/cu126/nvidia_cufft_cu12-11.3.0.4-py3-none-manylinux2014_x86_64.whl (200.2 MB) 2025-03-14T06:12:56.2963731Z [?25l ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 0.0/200.2 MB ? eta -:--:-- 2025-03-14T06:12:56.4988757Z  ━━━━━━━━━━━━━━━╸━━━━━━━━━━━━━━━━━━━━━━ 83.9/200.2 MB 420.7 MB/s eta 0:00:01 2025-03-14T06:12:56.7019897Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╺━━━━━ 169.1/200.2 MB 420.3 MB/s eta 0:00:01 2025-03-14T06:12:56.9048958Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 200.0/200.2 MB 419.6 MB/s eta 0:00:01 2025-03-14T06:12:57.1071149Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 200.0/200.2 MB 419.6 MB/s eta 0:00:01 2025-03-14T06:12:57.1961311Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 200.0/200.2 MB 419.6 MB/s eta 0:00:01 2025-03-14T06:12:57.1962288Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 200.2/200.2 MB 181.9 MB/s eta 0:00:00 2025-03-14T06:12:57.8430186Z [?25hCollecting nvidia-curand-cu12==10.3.7.77 (from torch==2.8.0.dev20250314+cu126) 2025-03-14T06:12:57.8472322Z Downloading https://download.pytorch.org/whl/nightly/cu126/nvidia_curand_cu12-10.3.7.77-py3-none-manylinux2014_x86_64.whl (56.3 MB) 2025-03-14T06:12:58.0523246Z [?25l ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 0.0/56.3 MB ? eta -:--:-- 2025-03-14T06:12:58.1520888Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 56.1/56.3 MB 329.6 MB/s eta 0:00:01 2025-03-14T06:12:58.1521842Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56.3/56.3 MB 187.1 MB/s eta 0:00:00 2025-03-14T06:12:58.3536595Z [?25hCollecting nvidia-cusolver-cu12==11.7.1.2 (from torch==2.8.0.dev20250314+cu126) 2025-03-14T06:12:58.3581396Z Downloading https://download.pytorch.org/whl/nightly/cu126/nvidia_cusolver_cu12-11.7.1.2-py3-none-manylinux2014_x86_64.whl (158.2 MB) 2025-03-14T06:12:58.5629907Z [?25l ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 0.0/158.2 MB ? eta -:--:-- 2025-03-14T06:12:58.7654867Z  ━━━━━━━━━━━━━━━━━━━━╺━━━━━━━━━━━━━━━━━ 83.4/158.2 MB 417.4 MB/s eta 0:00:01 2025-03-14T06:12:58.9679015Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 158.1/158.2 MB 417.5 MB/s eta 0:00:01 2025-03-14T06:12:59.0929392Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 158.1/158.2 MB 417.5 MB/s eta 0:00:01 2025-03-14T06:12:59.0930417Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 158.2/158.2 MB 216.6 MB/s eta 0:00:00 2025-03-14T06:12:59.6063894Z [?25hCollecting nvidia-cusparse-cu12==12.5.4.2 (from torch==2.8.0.dev20250314+cu126) 2025-03-14T06:12:59.6114959Z Downloading https://download.pytorch.org/whl/nightly/cu126/nvidia_cusparse_cu12-12.5.4.2-py3-none-manylinux2014_x86_64.whl (216.6 MB) 2025-03-14T06:12:59.8165367Z [?25l ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 0.0/216.6 MB ? eta -:--:-- 2025-03-14T06:13:00.0193248Z  ━━━━━━━━━━━━━━╸━━━━━━━━━━━━━━━━━━━━━━━ 84.7/216.6 MB 424.0 MB/s eta 0:00:01 2025-03-14T06:13:00.2219686Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╺━━━━━━━ 170.9/216.6 MB 424.9 MB/s eta 0:00:01 2025-03-14T06:13:00.4243782Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 216.5/216.6 MB 424.4 MB/s eta 0:00:01 2025-03-14T06:13:00.6274363Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 216.5/216.6 MB 424.4 MB/s eta 0:00:01 2025-03-14T06:13:00.8297928Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 216.5/216.6 MB 424.4 MB/s eta 0:00:01 2025-03-14T06:13:00.8805793Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 216.5/216.6 MB 424.4 MB/s eta 0:00:01 2025-03-14T06:13:00.8806785Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 216.6/216.6 MB 171.2 MB/s eta 0:00:00 2025-03-14T06:13:01.5680330Z [?25hCollecting nvidia-cusparselt-cu12==0.6.3 (from torch==2.8.0.dev20250314+cu126) 2025-03-14T06:13:01.5723378Z Downloading https://download.pytorch.org/whl/nightly/cu126/nvidia_cusparselt_cu12-0.6.3-py3-none-manylinux2014_x86_64.whl (156.8 MB) 2025-03-14T06:13:01.7775264Z [?25l ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 0.0/156.8 MB ? eta -:--:-- 2025-03-14T06:13:01.9802429Z  ━━━━━━━━━━╺━━━━━━━━━━━━━━━━━━━━━━━━━━━ 43.3/156.8 MB 216.6 MB/s eta 0:00:01 2025-03-14T06:13:02.1827328Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╺━━━━━━ 128.5/156.8 MB 319.3 MB/s eta 0:00:01 2025-03-14T06:13:02.3851482Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 156.8/156.8 MB 333.7 MB/s eta 0:00:01 2025-03-14T06:13:02.4153236Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 156.8/156.8 MB 333.7 MB/s eta 0:00:01 2025-03-14T06:13:02.4154210Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 156.8/156.8 MB 186.9 MB/s eta 0:00:00 2025-03-14T06:13:02.9254286Z [?25hCollecting nvidia-nccl-cu12==2.25.1 (from torch==2.8.0.dev20250314+cu126) 2025-03-14T06:13:02.9295783Z Downloading https://download.pytorch.org/whl/nightly/cu126/nvidia_nccl_cu12-2.25.1-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (1.8 kB) 2025-03-14T06:13:02.9626845Z Collecting nvidia-nvtx-cu12==12.6.77 (from torch==2.8.0.dev20250314+cu126) 2025-03-14T06:13:02.9670371Z Downloading https://download.pytorch.org/whl/nightly/cu126/nvidia_nvtx_cu12-12.6.77-py3-none-manylinux2014_x86_64.whl (89 kB) 2025-03-14T06:13:03.0118419Z Collecting nvidia-nvjitlink-cu12==12.6.85 (from torch==2.8.0.dev20250314+cu126) 2025-03-14T06:13:03.0164658Z Downloading https://download.pytorch.org/whl/nightly/cu126/nvidia_nvjitlink_cu12-12.6.85-py3-none-manylinux2010_x86_64.manylinux_2_12_x86_64.whl (19.7 MB) 2025-03-14T06:13:03.1286070Z [?25l ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 0.0/19.7 MB ? eta -:--:-- 2025-03-14T06:13:03.1287028Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 19.7/19.7 MB 183.4 MB/s eta 0:00:00 2025-03-14T06:13:03.2285187Z [?25hCollecting nvidia-cufile-cu12==1.11.1.6 (from torch==2.8.0.dev20250314+cu126) 2025-03-14T06:13:03.2325359Z Downloading https://download.pytorch.org/whl/nightly/cu126/nvidia_cufile_cu12-1.11.1.6-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (1.5 kB) 2025-03-14T06:13:03.3000184Z Collecting pytorch-triton==3.3.0+git96316ce5 (from torch==2.8.0.dev20250314+cu126) 2025-03-14T06:13:03.3056943Z Downloading https://download.pytorch.org/whl/nightly/pytorch_triton-3.3.0%2Bgit96316ce5-cp39-cp39-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl.metadata (1.4 kB) 2025-03-14T06:13:03.3304562Z Requirement already satisfied: setuptools>=40.8.0 in /opt/_internal/cpython-3.9.21/lib/python3.9/site-packages (from pytorch-triton==3.3.0+git96316ce5->torch==2.8.0.dev20250314+cu126) (75.8.2) 2025-03-14T06:13:03.3788071Z Collecting mpmath<1.4,>=1.1.0 (from sympy>=1.13.3->torch==2.8.0.dev20250314+cu126) 2025-03-14T06:13:03.3835163Z Downloading https://download.pytorch.org/whl/nightly/mpmath-1.3.0-py3-none-any.whl (536 kB) 2025-03-14T06:13:03.3965955Z [?25l ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 0.0/536.2 kB ? eta -:--:-- 2025-03-14T06:13:03.3966889Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 536.2/536.2 kB 34.4 MB/s eta 0:00:00 2025-03-14T06:13:03.4441396Z [?25hCollecting MarkupSafe>=2.0 (from jinja2->torch==2.8.0.dev20250314+cu126) 2025-03-14T06:13:03.4482670Z Downloading https://download.pytorch.org/whl/nightly/MarkupSafe-2.1.5-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB) 2025-03-14T06:13:03.4572477Z INFO: pip is looking at multiple versions of networkx to determine which version is compatible with other requirements. This could take a while. 2025-03-14T06:13:03.4579279Z Collecting networkx (from torch==2.8.0.dev20250314+cu126) 2025-03-14T06:13:03.4628553Z Downloading https://download.pytorch.org/whl/nightly/networkx-3.3-py3-none-any.whl (1.7 MB) 2025-03-14T06:13:03.4824783Z [?25l ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 0.0/1.7 MB ? eta -:--:-- 2025-03-14T06:13:03.4825701Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.7/1.7 MB 100.9 MB/s eta 0:00:00 2025-03-14T06:13:03.5068293Z [?25h Downloading https://download.pytorch.org/whl/nightly/networkx-3.2.1-py3-none-any.whl (1.6 MB) 2025-03-14T06:13:03.5273500Z [?25l ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 0.0/1.6 MB ? eta -:--:-- 2025-03-14T06:13:03.5274412Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.6/1.6 MB 91.2 MB/s eta 0:00:00 2025-03-14T06:13:03.5754842Z [?25hDownloading https://download.pytorch.org/whl/nightly/cu126/nvidia_cufile_cu12-1.11.1.6-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (1.1 MB) 2025-03-14T06:13:03.5892620Z [?25l ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 0.0/1.1 MB ? eta -:--:-- 2025-03-14T06:13:03.5893542Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.1/1.1 MB 101.9 MB/s eta 0:00:00 2025-03-14T06:13:03.5943266Z [?25hDownloading https://download.pytorch.org/whl/nightly/cu126/nvidia_nccl_cu12-2.25.1-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (201.4 MB) 2025-03-14T06:13:03.7995877Z [?25l ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 0.0/201.4 MB ? eta -:--:-- 2025-03-14T06:13:04.0022382Z  ━━━━━━━━━━━━╸━━━━━━━━━━━━━━━━━━━━━━━━━━━ 64.2/201.4 MB 322.4 MB/s eta 0:00:01 2025-03-14T06:13:04.2048109Z  ━━━━━━━━━━━━━━━━━━━━━━━━━╺━━━━━━━━━━━━━ 130.5/201.4 MB 324.8 MB/s eta 0:00:01 2025-03-14T06:13:04.4075755Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╺ 196.9/201.4 MB 325.5 MB/s eta 0:00:01 2025-03-14T06:13:04.6102335Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 201.3/201.4 MB 325.9 MB/s eta 0:00:01 2025-03-14T06:13:04.8125054Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 201.3/201.4 MB 325.9 MB/s eta 0:00:01 2025-03-14T06:13:04.8471080Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 201.3/201.4 MB 325.9 MB/s eta 0:00:01 2025-03-14T06:13:04.8472035Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 201.4/201.4 MB 161.3 MB/s eta 0:00:00 2025-03-14T06:13:04.8538116Z [?25hDownloading https://download.pytorch.org/whl/nightly/pytorch_triton-3.3.0%2Bgit96316ce5-cp39-cp39-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (153.4 MB) 2025-03-14T06:13:05.0587149Z [?25l ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 0.0/153.4 MB ? eta -:--:-- 2025-03-14T06:13:05.2613073Z  ━━━━━━━━━━━━━━━╺━━━━━━━━━━━━━━━━━━━━━━━━ 58.2/153.4 MB 291.7 MB/s eta 0:00:01 2025-03-14T06:13:05.4639061Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸━━━━━━━━━ 116.9/153.4 MB 290.7 MB/s eta 0:00:01 2025-03-14T06:13:05.6662592Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 153.4/153.4 MB 292.8 MB/s eta 0:00:01 2025-03-14T06:13:05.8682594Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 153.4/153.4 MB 292.8 MB/s eta 0:00:01 2025-03-14T06:13:05.9863642Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸ 153.4/153.4 MB 292.8 MB/s eta 0:00:01 2025-03-14T06:13:05.9864604Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 153.4/153.4 MB 135.9 MB/s eta 0:00:00 2025-03-14T06:13:07.3602701Z [?25hInstalling collected packages: nvidia-cusparselt-cu12, mpmath, typing-extensions, sympy, pytorch-triton, nvidia-nvtx-cu12, nvidia-nvjitlink-cu12, nvidia-nccl-cu12, nvidia-curand-cu12, nvidia-cufile-cu12, nvidia-cuda-runtime-cu12, nvidia-cuda-nvrtc-cu12, nvidia-cuda-cupti-cu12, nvidia-cublas-cu12, networkx, MarkupSafe, fsspec, filelock, nvidia-cusparse-cu12, nvidia-cufft-cu12, nvidia-cudnn-cu12, jinja2, nvidia-cusolver-cu12, torch 2025-03-14T06:14:05.5661145Z Successfully installed MarkupSafe-2.1.5 filelock-3.16.1 fsspec-2024.10.0 jinja2-3.1.4 mpmath-1.3.0 networkx-3.2.1 nvidia-cublas-cu12-12.6.4.1 nvidia-cuda-cupti-cu12-12.6.80 nvidia-cuda-nvrtc-cu12-12.6.77 nvidia-cuda-runtime-cu12-12.6.77 nvidia-cudnn-cu12-9.5.1.17 nvidia-cufft-cu12-11.3.0.4 nvidia-cufile-cu12-1.11.1.6 nvidia-curand-cu12-10.3.7.77 nvidia-cusolver-cu12-11.7.1.2 nvidia-cusparse-cu12-12.5.4.2 nvidia-cusparselt-cu12-0.6.3 nvidia-nccl-cu12-2.25.1 nvidia-nvjitlink-cu12-12.6.85 nvidia-nvtx-cu12-12.6.77 pytorch-triton-3.3.0+git96316ce5 sympy-1.13.3 torch-2.8.0.dev20250314+cu126 typing-extensions-4.12.2 2025-03-14T06:14:05.5666151Z WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning. 2025-03-14T06:14:05.8279078Z + retry pip install -q numpy protobuf typing-extensions 2025-03-14T06:14:05.8279691Z + pip install -q numpy protobuf typing-extensions 2025-03-14T06:14:10.9463088Z WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning. 2025-03-14T06:14:11.1546926Z + [[ manywheel == libtorch ]] 2025-03-14T06:14:11.1547429Z + /pytorch/.ci/pytorch/check_binary.sh 2025-03-14T06:14:11.1568090Z + [[ -z 3.9 ]] 2025-03-14T06:14:11.1568440Z + [[ -z cu126 ]] 2025-03-14T06:14:11.1568774Z + [[ -z cxx11-abi ]] 2025-03-14T06:14:11.1569116Z + [[ -z manywheel ]] 2025-03-14T06:14:11.1569455Z + [[ manywheel == libtorch ]] 2025-03-14T06:14:11.1569834Z + [[ 3.9 =~ ([0-9].[0-9]+)t ]] 2025-03-14T06:14:11.1570203Z + [[ 3.9 =~ ([0-9].[0-9]+) ]] 2025-03-14T06:14:11.1570561Z + py_dot=3.9 2025-03-14T06:14:11.1578062Z +++ which python 2025-03-14T06:14:11.1592470Z ++ dirname /opt/python/cp39-cp39/bin/python 2025-03-14T06:14:11.1616565Z + export install_root=/opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/ 2025-03-14T06:14:11.1617553Z + install_root=/opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/ 2025-03-14T06:14:11.1618173Z + [[ cu126 == \x\p\u ]] 2025-03-14T06:14:11.1618589Z + echo 'Checking that the gcc ABI is what we expect' 2025-03-14T06:14:11.1620375Z Checking that the gcc ABI is what we expect 2025-03-14T06:14:11.1623530Z ++ uname 2025-03-14T06:14:11.1647118Z + [[ Linux != \D\a\r\w\i\n ]] 2025-03-14T06:14:11.1647912Z + torch_config=/opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch//share/cmake/Torch/TorchConfig.cmake 2025-03-14T06:14:11.1648961Z + [[ ! -f /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch//share/cmake/Torch/TorchConfig.cmake ]] 2025-03-14T06:14:11.1649708Z + echo 'Checking the TorchConfig.cmake' 2025-03-14T06:14:11.1650181Z Checking the TorchConfig.cmake 2025-03-14T06:14:11.1650938Z + cat /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch//share/cmake/Torch/TorchConfig.cmake 2025-03-14T06:14:11.1671407Z # FindTorch 2025-03-14T06:14:11.1671904Z # ------- 2025-03-14T06:14:11.1672422Z # 2025-03-14T06:14:11.1672738Z # Finds the Torch library 2025-03-14T06:14:11.1673091Z # 2025-03-14T06:14:11.1673418Z # This will define the following variables: 2025-03-14T06:14:11.1673835Z # 2025-03-14T06:14:11.1674219Z # TORCH_FOUND -- True if the system has the Torch library 2025-03-14T06:14:11.1674829Z # TORCH_INCLUDE_DIRS -- The include directories for torch 2025-03-14T06:14:11.1675391Z # TORCH_LIBRARIES -- Libraries to link against 2025-03-14T06:14:11.1675941Z # TORCH_CXX_FLAGS -- Additional (required) compiler flags 2025-03-14T06:14:11.1676420Z # 2025-03-14T06:14:11.1676722Z # and the following imported targets: 2025-03-14T06:14:11.1677125Z # 2025-03-14T06:14:11.1677411Z # torch 2025-03-14T06:14:11.1677767Z macro(append_torchlib_if_found) 2025-03-14T06:14:11.1678383Z foreach (_arg ${ARGN}) 2025-03-14T06:14:11.1679057Z find_library(${_arg}_LIBRARY ${_arg} PATHS "${TORCH_INSTALL_PREFIX}/lib") 2025-03-14T06:14:11.1679798Z if(${_arg}_LIBRARY) 2025-03-14T06:14:11.1680204Z list(APPEND TORCH_LIBRARIES ${${_arg}_LIBRARY}) 2025-03-14T06:14:11.1680633Z else() 2025-03-14T06:14:11.1681057Z message(WARNING "static library ${${_arg}_LIBRARY} not found.") 2025-03-14T06:14:11.1681560Z endif() 2025-03-14T06:14:11.1681874Z endforeach() 2025-03-14T06:14:11.1682192Z endmacro() 2025-03-14T06:14:11.1682367Z 2025-03-14T06:14:11.1682539Z macro(append_wholearchive_lib_if_found) 2025-03-14T06:14:11.1683207Z foreach (_arg ${ARGN}) 2025-03-14T06:14:11.1683709Z find_library(${_arg}_LIBRARY ${_arg} PATHS "${TORCH_INSTALL_PREFIX}/lib") 2025-03-14T06:14:11.1684254Z if(${_arg}_LIBRARY) 2025-03-14T06:14:11.1684589Z if(APPLE) 2025-03-14T06:14:11.1685026Z list(APPEND TORCH_LIBRARIES "-Wl,-force_load,${${_arg}_LIBRARY}") 2025-03-14T06:14:11.1685547Z elseif(MSVC) 2025-03-14T06:14:11.1685994Z list(APPEND TORCH_LIBRARIES "-WHOLEARCHIVE:${${_arg}_LIBRARY}") 2025-03-14T06:14:11.1686500Z else() 2025-03-14T06:14:11.1686796Z # Linux 2025-03-14T06:14:11.1687338Z list(APPEND TORCH_LIBRARIES "-Wl,--whole-archive ${${_arg}_LIBRARY} -Wl,--no-whole-archive") 2025-03-14T06:14:11.1688034Z endif() 2025-03-14T06:14:11.1688340Z else() 2025-03-14T06:14:11.1688772Z message(WARNING "static library ${${_arg}_LIBRARY} not found.") 2025-03-14T06:14:11.1689272Z endif() 2025-03-14T06:14:11.1689553Z endforeach() 2025-03-14T06:14:11.1689869Z endmacro() 2025-03-14T06:14:11.1690055Z 2025-03-14T06:14:11.1690236Z include(FindPackageHandleStandardArgs) 2025-03-14T06:14:11.1690530Z 2025-03-14T06:14:11.1690706Z if(DEFINED ENV{TORCH_INSTALL_PREFIX}) 2025-03-14T06:14:11.1691188Z set(TORCH_INSTALL_PREFIX $ENV{TORCH_INSTALL_PREFIX}) 2025-03-14T06:14:11.1691620Z else() 2025-03-14T06:14:11.1692058Z # Assume we are in /share/cmake/Torch/TorchConfig.cmake 2025-03-14T06:14:11.1692797Z get_filename_component(CMAKE_CURRENT_LIST_DIR "${CMAKE_CURRENT_LIST_FILE}" PATH) 2025-03-14T06:14:11.1693605Z get_filename_component(TORCH_INSTALL_PREFIX "${CMAKE_CURRENT_LIST_DIR}/../../../" ABSOLUTE) 2025-03-14T06:14:11.1694212Z endif() 2025-03-14T06:14:11.1694374Z 2025-03-14T06:14:11.1694532Z # Include directories. 2025-03-14T06:14:11.1695034Z if(EXISTS "${TORCH_INSTALL_PREFIX}/include") 2025-03-14T06:14:11.1695492Z set(TORCH_INCLUDE_DIRS 2025-03-14T06:14:11.1695905Z ${TORCH_INSTALL_PREFIX}/include 2025-03-14T06:14:11.1696390Z ${TORCH_INSTALL_PREFIX}/include/torch/csrc/api/include) 2025-03-14T06:14:11.1696850Z else() 2025-03-14T06:14:11.1697152Z set(TORCH_INCLUDE_DIRS 2025-03-14T06:14:11.1697502Z ${TORCH_INSTALL_PREFIX}/include 2025-03-14T06:14:11.1697971Z ${TORCH_INSTALL_PREFIX}/include/torch/csrc/api/include) 2025-03-14T06:14:11.1698432Z endif() 2025-03-14T06:14:11.1698592Z 2025-03-14T06:14:11.1698753Z # Library dependencies. 2025-03-14T06:14:11.1699088Z if(ON) 2025-03-14T06:14:11.1699517Z find_package(Caffe2 REQUIRED PATHS ${CMAKE_CURRENT_LIST_DIR}/../Caffe2) 2025-03-14T06:14:11.1700111Z set(TORCH_LIBRARIES torch ${Caffe2_MAIN_LIBS}) 2025-03-14T06:14:11.1700568Z append_torchlib_if_found(c10) 2025-03-14T06:14:11.1700937Z else() 2025-03-14T06:14:11.1701386Z add_library(torch STATIC IMPORTED) # set imported_location at the bottom 2025-03-14T06:14:11.1701939Z #library need whole archive 2025-03-14T06:14:11.1702379Z append_wholearchive_lib_if_found(torch torch_cpu) 2025-03-14T06:14:11.1702825Z if(ON) 2025-03-14T06:14:11.1703219Z append_wholearchive_lib_if_found(torch_cuda c10_cuda) 2025-03-14T06:14:11.1703684Z endif() 2025-03-14T06:14:11.1703961Z if(OFF) 2025-03-14T06:14:11.1704335Z append_wholearchive_lib_if_found(torch_xpu c10_xpu) 2025-03-14T06:14:11.1705007Z endif() 2025-03-14T06:14:11.1705181Z 2025-03-14T06:14:11.1705504Z # We need manually add dependent libraries when they are not linked into the 2025-03-14T06:14:11.1706355Z # shared library. 2025-03-14T06:14:11.1706884Z # TODO: this list might be incomplete. 2025-03-14T06:14:11.1707326Z append_torchlib_if_found(c10) 2025-03-14T06:14:11.1707590Z 2025-03-14T06:14:11.1707716Z if(ON) 2025-03-14T06:14:11.1708037Z append_torchlib_if_found(nnpack) 2025-03-14T06:14:11.1708548Z endif() 2025-03-14T06:14:11.1708848Z 2025-03-14T06:14:11.1709063Z if(ON) 2025-03-14T06:14:11.1709406Z append_torchlib_if_found(pytorch_qnnpack) 2025-03-14T06:14:11.1710102Z endif() 2025-03-14T06:14:11.1710291Z 2025-03-14T06:14:11.1710530Z if(ON) 2025-03-14T06:14:11.1710853Z append_torchlib_if_found(XNNPACK) 2025-03-14T06:14:11.1711612Z append_torchlib_if_found(microkernels-prod) 2025-03-14T06:14:11.1712079Z endif() 2025-03-14T06:14:11.1712360Z 2025-03-14T06:14:11.1712588Z if(OFF) 2025-03-14T06:14:11.1712973Z append_torchlib_if_found(kleidiai) 2025-03-14T06:14:11.1713372Z endif() 2025-03-14T06:14:11.1713537Z 2025-03-14T06:14:11.1713851Z append_torchlib_if_found(caffe2_protos protobuf-lite protobuf protoc) 2025-03-14T06:14:11.1714426Z append_torchlib_if_found(onnx onnx_proto) 2025-03-14T06:14:11.1714737Z 2025-03-14T06:14:11.1714892Z append_torchlib_if_found(fmt) 2025-03-14T06:14:11.1715322Z append_torchlib_if_found(cpuinfo clog) 2025-03-14T06:14:11.1715780Z 2025-03-14T06:14:11.1715965Z append_torchlib_if_found(eigen_blas) 2025-03-14T06:14:11.1716419Z append_torchlib_if_found(pthreadpool) 2025-03-14T06:14:11.1716910Z 2025-03-14T06:14:11.1717050Z if(ON) 2025-03-14T06:14:11.1717366Z append_torchlib_if_found(fbgemm) 2025-03-14T06:14:11.1717765Z endif() 2025-03-14T06:14:11.1717929Z 2025-03-14T06:14:11.1718065Z if(ON) 2025-03-14T06:14:11.1718384Z append_torchlib_if_found(dnnl mkldnn) 2025-03-14T06:14:11.1718788Z endif() 2025-03-14T06:14:11.1718971Z 2025-03-14T06:14:11.1719131Z append_torchlib_if_found(sleef asmjit) 2025-03-14T06:14:11.1719535Z endif() 2025-03-14T06:14:11.1719697Z 2025-03-14T06:14:11.1719837Z if(1) 2025-03-14T06:14:11.1720151Z append_torchlib_if_found(kineto) 2025-03-14T06:14:11.1720514Z endif() 2025-03-14T06:14:11.1720691Z 2025-03-14T06:14:11.1720812Z if(ON) 2025-03-14T06:14:11.1721093Z if(MSVC) 2025-03-14T06:14:11.1721601Z find_library(CAFFE2_NVRTC_LIBRARY caffe2_nvrtc PATHS "${TORCH_INSTALL_PREFIX}/lib") 2025-03-14T06:14:11.1722303Z list(APPEND TORCH_CUDA_LIBRARIES ${CAFFE2_NVRTC_LIBRARY}) 2025-03-14T06:14:11.1722898Z else() 2025-03-14T06:14:11.1723254Z set(TORCH_CUDA_LIBRARIES ${CUDA_NVRTC_LIB}) 2025-03-14T06:14:11.1723672Z endif() 2025-03-14T06:14:11.1724032Z if(TARGET torch::nvtoolsext) 2025-03-14T06:14:11.1724487Z list(APPEND TORCH_CUDA_LIBRARIES torch::nvtoolsext) 2025-03-14T06:14:11.1724918Z endif() 2025-03-14T06:14:11.1725103Z 2025-03-14T06:14:11.1725225Z if(ON) 2025-03-14T06:14:11.1725682Z find_library(C10_CUDA_LIBRARY c10_cuda PATHS "${TORCH_INSTALL_PREFIX}/lib") 2025-03-14T06:14:11.1726992Z list(APPEND TORCH_CUDA_LIBRARIES ${C10_CUDA_LIBRARY} ${Caffe2_PUBLIC_CUDA_DEPENDENCY_LIBS}) 2025-03-14T06:14:11.1727630Z endif() 2025-03-14T06:14:11.1728011Z list(APPEND TORCH_LIBRARIES ${TORCH_CUDA_LIBRARIES}) 2025-03-14T06:14:11.1728451Z endif() 2025-03-14T06:14:11.1728630Z 2025-03-14T06:14:11.1728761Z if(OFF AND ON) 2025-03-14T06:14:11.1729122Z append_torchlib_if_found(c10_xpu torch_xpu) 2025-03-14T06:14:11.1729550Z endif() 2025-03-14T06:14:11.1729712Z 2025-03-14T06:14:11.1730058Z # When we build libtorch with the old libstdc++ ABI, dependent libraries must too. 2025-03-14T06:14:11.1730646Z if(CMAKE_SYSTEM_NAME STREQUAL "Linux") 2025-03-14T06:14:11.1731127Z set(TORCH_CXX_FLAGS "-D_GLIBCXX_USE_CXX11_ABI=1") 2025-03-14T06:14:11.1731568Z endif() 2025-03-14T06:14:11.1731730Z 2025-03-14T06:14:11.1732026Z find_library(TORCH_LIBRARY torch PATHS "${TORCH_INSTALL_PREFIX}/lib") 2025-03-14T06:14:11.1732630Z # the statements below changes target properties on 2025-03-14T06:14:11.1733365Z # - the imported target from Caffe2Targets.cmake in shared library mode (see the find_package above) 2025-03-14T06:14:11.1734194Z # - this is untested whether it is the correct (or desired) methodology in CMake 2025-03-14T06:14:11.1734887Z # - the imported target created in this file in static library mode 2025-03-14T06:14:11.1735396Z if(NOT ON) 2025-03-14T06:14:11.1735942Z # do not set this property on the shared library target, as it will cause confusion in some builds 2025-03-14T06:14:11.1736778Z # as the configuration specific property is set in the Caffe2Targets.cmake file 2025-03-14T06:14:11.1737383Z set_target_properties(torch PROPERTIES 2025-03-14T06:14:11.1738001Z IMPORTED_LOCATION "${TORCH_LIBRARY}" 2025-03-14T06:14:11.1738410Z ) 2025-03-14T06:14:11.1738691Z endif() 2025-03-14T06:14:11.1739021Z set_target_properties(torch PROPERTIES 2025-03-14T06:14:11.1739877Z INTERFACE_INCLUDE_DIRECTORIES "${TORCH_INCLUDE_DIRS}" 2025-03-14T06:14:11.1740431Z CXX_STANDARD 17 2025-03-14T06:14:11.1740982Z ) 2025-03-14T06:14:11.1741334Z if(TORCH_CXX_FLAGS) 2025-03-14T06:14:11.1741871Z set_property(TARGET torch PROPERTY INTERFACE_COMPILE_OPTIONS "${TORCH_CXX_FLAGS}") 2025-03-14T06:14:11.1742442Z endif() 2025-03-14T06:14:11.1742618Z 2025-03-14T06:14:11.1742960Z find_package_handle_standard_args(Torch DEFAULT_MSG TORCH_LIBRARY TORCH_INCLUDE_DIRS) 2025-03-14T06:14:11.1743627Z ++ sed -ne 's/.*D_GLIBCXX_USE_CXX11_ABI=\(.\)".*/\1/p' 2025-03-14T06:14:11.1744094Z + actual_gcc_abi=1 2025-03-14T06:14:11.1744431Z ++ is_expected 1 2025-03-14T06:14:11.1744730Z ++ [[ 1 -gt 0 ]] 2025-03-14T06:14:11.1745038Z ++ echo 1 2025-03-14T06:14:11.1745326Z + [[ 1 != 1 ]] 2025-03-14T06:14:11.1745779Z + echo 'Checking that symbols in libtorch.so have the right gcc abi' 2025-03-14T06:14:11.1746408Z Checking that symbols in libtorch.so have the right gcc abi 2025-03-14T06:14:11.1746938Z ++ dirname /pytorch/.ci/pytorch/check_binary.sh 2025-03-14T06:14:11.1747502Z + python3 /pytorch/.ci/pytorch/smoke_test/check_binary_symbols.py 2025-03-14T06:14:11.5350336Z lib: /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch_cpu.so 2025-03-14T06:14:29.2584787Z num_cxx11_symbols: 2104 2025-03-14T06:14:29.2585242Z num_pre_cxx11_symbols: 0 2025-03-14T06:14:29.5272415Z + echo 'cxx11 symbols seem to be in order' 2025-03-14T06:14:29.5272937Z cxx11 symbols seem to be in order 2025-03-14T06:14:29.5276581Z ++ uname 2025-03-14T06:14:29.5306147Z + [[ Linux == \D\a\r\w\i\n ]] 2025-03-14T06:14:29.5306992Z + all_libs=($(find "$install_root" -name '*.so')) 2025-03-14T06:14:29.5310894Z ++ find /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/ -name '*.so' 2025-03-14T06:14:29.5589216Z + for lib in "${all_libs[@]}" 2025-03-14T06:14:29.5593075Z ++ ldd /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/_C.cpython-39-x86_64-linux-gnu.so 2025-03-14T06:14:29.5740834Z ++ objdump -p /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/_C.cpython-39-x86_64-linux-gnu.so 2025-03-14T06:14:29.5741634Z ++ grep RUNPATH 2025-03-14T06:14:29.5772592Z + echo 'All dependencies of /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/_C.cpython-39-x86_64-linux-gnu.so are linux-vdso.so.1 (0x00007ffd2f1de000) 2025-03-14T06:14:29.5774032Z libtorch_python.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch_python.so (0x00007f6343dfa000) 2025-03-14T06:14:29.5775177Z libpthread.so.0 => /usr/lib64/libpthread.so.0 (0x00007f6343bda000) 2025-03-14T06:14:29.5775792Z libc.so.6 => /usr/lib64/libc.so.6 (0x00007f6343804000) 2025-03-14T06:14:29.5776601Z libtorch.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch.so (0x00007f6345292000) 2025-03-14T06:14:29.5777642Z libshm.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libshm.so (0x00007f6345284000) 2025-03-14T06:14:29.5778702Z libtorch_cpu.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch_cpu.so (0x00007f632f539000) 2025-03-14T06:14:29.5779815Z libtorch_cuda.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch_cuda.so (0x00007f62f1b4c000) 2025-03-14T06:14:29.5780927Z libc10_cuda.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libc10_cuda.so (0x00007f63451d3000) 2025-03-14T06:14:29.5782160Z libcudart.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cuda_runtime/lib/libcudart.so.12 (0x00007f62f189b000) 2025-03-14T06:14:29.5783353Z libc10.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libc10.so (0x00007f62f1779000) 2025-03-14T06:14:29.5784125Z libdl.so.2 => /usr/lib64/libdl.so.2 (0x00007f62f1575000) 2025-03-14T06:14:29.5785283Z libcudnn.so.9 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cudnn/lib/libcudnn.so.9 (0x00007f62f1356000) 2025-03-14T06:14:29.5786605Z libcusparseLt.so.0 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../cusparselt/lib/libcusparseLt.so.0 (0x00007f62e2d02000) 2025-03-14T06:14:29.5787927Z libcufile.so.0 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cufile/lib/libcufile.so.0 (0x00007f62e2a2a000) 2025-03-14T06:14:29.5788877Z libstdc++.so.6 => /usr/lib64/libstdc++.so.6 (0x00007f62e2695000) 2025-03-14T06:14:29.5789462Z libgcc_s.so.1 => /usr/lib64/libgcc_s.so.1 (0x00007f62e247d000) 2025-03-14T06:14:29.5790005Z /lib64/ld-linux-x86-64.so.2 (0x00007f63450a5000) 2025-03-14T06:14:29.5790524Z librt.so.1 => /usr/lib64/librt.so.1 (0x00007f62e2275000) 2025-03-14T06:14:29.5791047Z libm.so.6 => /usr/lib64/libm.so.6 (0x00007f62e1ef3000) 2025-03-14T06:14:29.5791922Z libgomp-c9fef706.so.1 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libgomp-c9fef706.so.1 (0x00007f62e1cb6000) 2025-03-14T06:14:29.5793227Z libcupti.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cuda_cupti/lib/libcupti.so.12 (0x00007f62e14c2000) 2025-03-14T06:14:29.5794588Z libcusparse.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cusparse/lib/libcusparse.so.12 (0x00007f62cfabd000) 2025-03-14T06:14:29.5795930Z libcufft.so.11 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cufft/lib/libcufft.so.11 (0x00007f62beabc000) 2025-03-14T06:14:29.5797232Z libcurand.so.10 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/curand/lib/libcurand.so.10 (0x00007f62b8683000) 2025-03-14T06:14:29.5798677Z libcublas.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cublas/lib/libcublas.so.12 (0x00007f62b1d3c000) 2025-03-14T06:14:29.5800048Z libcublasLt.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cublas/lib/libcublasLt.so.12 (0x00007f6290510000) 2025-03-14T06:14:29.5801356Z libnccl.so.2 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/nccl/lib/libnccl.so.2 (0x00007f6280d11000) 2025-03-14T06:14:29.5802255Z libutil.so.1 => /usr/lib64/libutil.so.1 (0x00007f6280b0d000) 2025-03-14T06:14:29.5803421Z libnvJitLink.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cusparse/lib/../../nvjitlink/lib/libnvJitLink.so.12 (0x00007f627d884000) with runpath ' 2025-03-14T06:14:29.5805038Z All dependencies of /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/_C.cpython-39-x86_64-linux-gnu.so are linux-vdso.so.1 (0x00007ffd2f1de000) 2025-03-14T06:14:29.5806383Z libtorch_python.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch_python.so (0x00007f6343dfa000) 2025-03-14T06:14:29.5807299Z libpthread.so.0 => /usr/lib64/libpthread.so.0 (0x00007f6343bda000) 2025-03-14T06:14:29.5807884Z libc.so.6 => /usr/lib64/libc.so.6 (0x00007f6343804000) 2025-03-14T06:14:29.5808664Z libtorch.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch.so (0x00007f6345292000) 2025-03-14T06:14:29.5809676Z libshm.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libshm.so (0x00007f6345284000) 2025-03-14T06:14:29.5810741Z libtorch_cpu.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch_cpu.so (0x00007f632f539000) 2025-03-14T06:14:29.5811875Z libtorch_cuda.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch_cuda.so (0x00007f62f1b4c000) 2025-03-14T06:14:29.5812997Z libc10_cuda.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libc10_cuda.so (0x00007f63451d3000) 2025-03-14T06:14:29.5814231Z libcudart.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cuda_runtime/lib/libcudart.so.12 (0x00007f62f189b000) 2025-03-14T06:14:29.5815523Z libc10.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libc10.so (0x00007f62f1779000) 2025-03-14T06:14:29.5816315Z libdl.so.2 => /usr/lib64/libdl.so.2 (0x00007f62f1575000) 2025-03-14T06:14:29.5817206Z libcudnn.so.9 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cudnn/lib/libcudnn.so.9 (0x00007f62f1356000) 2025-03-14T06:14:29.5818532Z libcusparseLt.so.0 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../cusparselt/lib/libcusparseLt.so.0 (0x00007f62e2d02000) 2025-03-14T06:14:29.5819868Z libcufile.so.0 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cufile/lib/libcufile.so.0 (0x00007f62e2a2a000) 2025-03-14T06:14:29.5820827Z libstdc++.so.6 => /usr/lib64/libstdc++.so.6 (0x00007f62e2695000) 2025-03-14T06:14:29.5821418Z libgcc_s.so.1 => /usr/lib64/libgcc_s.so.1 (0x00007f62e247d000) 2025-03-14T06:14:29.5821952Z /lib64/ld-linux-x86-64.so.2 (0x00007f63450a5000) 2025-03-14T06:14:29.5822459Z librt.so.1 => /usr/lib64/librt.so.1 (0x00007f62e2275000) 2025-03-14T06:14:29.5822978Z libm.so.6 => /usr/lib64/libm.so.6 (0x00007f62e1ef3000) 2025-03-14T06:14:29.5823866Z libgomp-c9fef706.so.1 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libgomp-c9fef706.so.1 (0x00007f62e1cb6000) 2025-03-14T06:14:29.5825172Z libcupti.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cuda_cupti/lib/libcupti.so.12 (0x00007f62e14c2000) 2025-03-14T06:14:29.5827087Z libcusparse.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cusparse/lib/libcusparse.so.12 (0x00007f62cfabd000) 2025-03-14T06:14:29.5828563Z libcufft.so.11 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cufft/lib/libcufft.so.11 (0x00007f62beabc000) 2025-03-14T06:14:29.5829889Z libcurand.so.10 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/curand/lib/libcurand.so.10 (0x00007f62b8683000) 2025-03-14T06:14:29.5831219Z libcublas.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cublas/lib/libcublas.so.12 (0x00007f62b1d3c000) 2025-03-14T06:14:29.5832540Z libcublasLt.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cublas/lib/libcublasLt.so.12 (0x00007f6290510000) 2025-03-14T06:14:29.5833839Z libnccl.so.2 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/nccl/lib/libnccl.so.2 (0x00007f6280d11000) 2025-03-14T06:14:29.5834747Z libutil.so.1 => /usr/lib64/libutil.so.1 (0x00007f6280b0d000) 2025-03-14T06:14:29.5835904Z libnvJitLink.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cusparse/lib/../../nvjitlink/lib/libnvJitLink.so.12 (0x00007f627d884000) with runpath 2025-03-14T06:14:29.5837003Z + for lib in "${all_libs[@]}" 2025-03-14T06:14:29.5837583Z ++ ldd /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libc10.so 2025-03-14T06:14:29.5866620Z ++ objdump -p /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libc10.so 2025-03-14T06:14:29.5867241Z ++ grep RUNPATH 2025-03-14T06:14:29.5895738Z + echo 'All dependencies of /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libc10.so are linux-vdso.so.1 (0x00007ffeb9dcb000) 2025-03-14T06:14:29.5896726Z libdl.so.2 => /usr/lib64/libdl.so.2 (0x00007faa8a5eb000) 2025-03-14T06:14:29.5897479Z libstdc++.so.6 => /usr/lib64/libstdc++.so.6 (0x00007faa8a256000) 2025-03-14T06:14:29.5898050Z libm.so.6 => /usr/lib64/libm.so.6 (0x00007faa89ed4000) 2025-03-14T06:14:29.5898597Z libgcc_s.so.1 => /usr/lib64/libgcc_s.so.1 (0x00007faa89cbc000) 2025-03-14T06:14:29.5899214Z libpthread.so.0 => /usr/lib64/libpthread.so.0 (0x00007faa89a9c000) 2025-03-14T06:14:29.5899807Z libc.so.6 => /usr/lib64/libc.so.6 (0x00007faa896c6000) 2025-03-14T06:14:29.5900380Z /lib64/ld-linux-x86-64.so.2 (0x00007faa8a7ef000) with runpath ' 2025-03-14T06:14:29.5901554Z All dependencies of /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libc10.so are linux-vdso.so.1 (0x00007ffeb9dcb000) 2025-03-14T06:14:29.5902492Z libdl.so.2 => /usr/lib64/libdl.so.2 (0x00007faa8a5eb000) 2025-03-14T06:14:29.5903061Z libstdc++.so.6 => /usr/lib64/libstdc++.so.6 (0x00007faa8a256000) 2025-03-14T06:14:29.5903620Z libm.so.6 => /usr/lib64/libm.so.6 (0x00007faa89ed4000) 2025-03-14T06:14:29.5904170Z libgcc_s.so.1 => /usr/lib64/libgcc_s.so.1 (0x00007faa89cbc000) 2025-03-14T06:14:29.5904776Z libpthread.so.0 => /usr/lib64/libpthread.so.0 (0x00007faa89a9c000) 2025-03-14T06:14:29.5905338Z libc.so.6 => /usr/lib64/libc.so.6 (0x00007faa896c6000) 2025-03-14T06:14:29.5905901Z /lib64/ld-linux-x86-64.so.2 (0x00007faa8a7ef000) with runpath 2025-03-14T06:14:29.5906419Z + for lib in "${all_libs[@]}" 2025-03-14T06:14:29.5907021Z ++ ldd /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libc10_cuda.so 2025-03-14T06:14:29.5991743Z ++ objdump -p /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libc10_cuda.so 2025-03-14T06:14:29.5992441Z ++ grep RUNPATH 2025-03-14T06:14:29.6020370Z + echo 'All dependencies of /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libc10_cuda.so are linux-vdso.so.1 (0x00007ffc4df26000) 2025-03-14T06:14:29.6021628Z libc10.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libc10.so (0x00007f2e481ec000) 2025-03-14T06:14:29.6022415Z libdl.so.2 => /usr/lib64/libdl.so.2 (0x00007f2e47f8e000) 2025-03-14T06:14:29.6023665Z libcudart.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cuda_runtime/lib/libcudart.so.12 (0x00007f2e47cdd000) 2025-03-14T06:14:29.6024770Z libstdc++.so.6 => /usr/lib64/libstdc++.so.6 (0x00007f2e47948000) 2025-03-14T06:14:29.6025536Z libm.so.6 => /usr/lib64/libm.so.6 (0x00007f2e475c6000) 2025-03-14T06:14:29.6026114Z libgcc_s.so.1 => /usr/lib64/libgcc_s.so.1 (0x00007f2e473ae000) 2025-03-14T06:14:29.6027351Z libc.so.6 => /usr/lib64/libc.so.6 (0x00007f2e46fd8000) 2025-03-14T06:14:29.6027862Z /lib64/ld-linux-x86-64.so.2 (0x00007f2e48192000) 2025-03-14T06:14:29.6028428Z libpthread.so.0 => /usr/lib64/libpthread.so.0 (0x00007f2e46db8000) 2025-03-14T06:14:29.6029073Z librt.so.1 => /usr/lib64/librt.so.1 (0x00007f2e46bb0000) with runpath ' 2025-03-14T06:14:29.6030090Z All dependencies of /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libc10_cuda.so are linux-vdso.so.1 (0x00007ffc4df26000) 2025-03-14T06:14:29.6031273Z libc10.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libc10.so (0x00007f2e481ec000) 2025-03-14T06:14:29.6032049Z libdl.so.2 => /usr/lib64/libdl.so.2 (0x00007f2e47f8e000) 2025-03-14T06:14:29.6033013Z libcudart.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cuda_runtime/lib/libcudart.so.12 (0x00007f2e47cdd000) 2025-03-14T06:14:29.6034001Z libstdc++.so.6 => /usr/lib64/libstdc++.so.6 (0x00007f2e47948000) 2025-03-14T06:14:29.6034562Z libm.so.6 => /usr/lib64/libm.so.6 (0x00007f2e475c6000) 2025-03-14T06:14:29.6035107Z libgcc_s.so.1 => /usr/lib64/libgcc_s.so.1 (0x00007f2e473ae000) 2025-03-14T06:14:29.6035650Z libc.so.6 => /usr/lib64/libc.so.6 (0x00007f2e46fd8000) 2025-03-14T06:14:29.6036141Z /lib64/ld-linux-x86-64.so.2 (0x00007f2e48192000) 2025-03-14T06:14:29.6036704Z libpthread.so.0 => /usr/lib64/libpthread.so.0 (0x00007f2e46db8000) 2025-03-14T06:14:29.6037341Z librt.so.1 => /usr/lib64/librt.so.1 (0x00007f2e46bb0000) with runpath 2025-03-14T06:14:29.6037872Z + for lib in "${all_libs[@]}" 2025-03-14T06:14:29.6038487Z ++ ldd /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libcaffe2_nvrtc.so 2025-03-14T06:14:29.6114085Z ++ objdump -p /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libcaffe2_nvrtc.so 2025-03-14T06:14:29.6114813Z ++ grep RUNPATH 2025-03-14T06:14:29.6142458Z + echo 'All dependencies of /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libcaffe2_nvrtc.so are linux-vdso.so.1 (0x00007ffd83090000) 2025-03-14T06:14:29.6144107Z libnvrtc.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cuda_nvrtc/lib/libnvrtc.so.12 (0x00007f21becce000) 2025-03-14T06:14:29.6145497Z libcuda.so.1 => /usr/lib64/libcuda.so.1 (0x00007f21bd000000) 2025-03-14T06:14:29.6146095Z libstdc++.so.6 => /usr/lib64/libstdc++.so.6 (0x00007f21bcc6b000) 2025-03-14T06:14:29.6146653Z libm.so.6 => /usr/lib64/libm.so.6 (0x00007f21bc8e9000) 2025-03-14T06:14:29.6147199Z libgcc_s.so.1 => /usr/lib64/libgcc_s.so.1 (0x00007f21bc6d1000) 2025-03-14T06:14:29.6147726Z libc.so.6 => /usr/lib64/libc.so.6 (0x00007f21bc2fb000) 2025-03-14T06:14:29.6148299Z libpthread.so.0 => /usr/lib64/libpthread.so.0 (0x00007f21bc0db000) 2025-03-14T06:14:29.6148888Z librt.so.1 => /usr/lib64/librt.so.1 (0x00007f21bbed3000) 2025-03-14T06:14:29.6149428Z libdl.so.2 => /usr/lib64/libdl.so.2 (0x00007f21bbccf000) 2025-03-14T06:14:29.6150092Z /lib64/ld-linux-x86-64.so.2 (0x00007f21c2ad0000) with runpath ' 2025-03-14T06:14:29.6151566Z All dependencies of /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libcaffe2_nvrtc.so are linux-vdso.so.1 (0x00007ffd83090000) 2025-03-14T06:14:29.6152948Z libnvrtc.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cuda_nvrtc/lib/libnvrtc.so.12 (0x00007f21becce000) 2025-03-14T06:14:29.6153908Z libcuda.so.1 => /usr/lib64/libcuda.so.1 (0x00007f21bd000000) 2025-03-14T06:14:29.6154492Z libstdc++.so.6 => /usr/lib64/libstdc++.so.6 (0x00007f21bcc6b000) 2025-03-14T06:14:29.6155056Z libm.so.6 => /usr/lib64/libm.so.6 (0x00007f21bc8e9000) 2025-03-14T06:14:29.6155602Z libgcc_s.so.1 => /usr/lib64/libgcc_s.so.1 (0x00007f21bc6d1000) 2025-03-14T06:14:29.6156130Z libc.so.6 => /usr/lib64/libc.so.6 (0x00007f21bc2fb000) 2025-03-14T06:14:29.6156841Z libpthread.so.0 => /usr/lib64/libpthread.so.0 (0x00007f21bc0db000) 2025-03-14T06:14:29.6157458Z librt.so.1 => /usr/lib64/librt.so.1 (0x00007f21bbed3000) 2025-03-14T06:14:29.6158000Z libdl.so.2 => /usr/lib64/libdl.so.2 (0x00007f21bbccf000) 2025-03-14T06:14:29.6158566Z /lib64/ld-linux-x86-64.so.2 (0x00007f21c2ad0000) with runpath 2025-03-14T06:14:29.6159096Z + for lib in "${all_libs[@]}" 2025-03-14T06:14:29.6159651Z ++ ldd /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libshm.so 2025-03-14T06:14:29.6241566Z ++ objdump -p /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libshm.so 2025-03-14T06:14:29.6242209Z ++ grep RUNPATH 2025-03-14T06:14:29.6270459Z + echo 'All dependencies of /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libshm.so are linux-vdso.so.1 (0x00007ffd5d5ee000) 2025-03-14T06:14:29.6271890Z libtorch_cpu.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch_cpu.so (0x00007f481e5af000) 2025-03-14T06:14:29.6272741Z librt.so.1 => /usr/lib64/librt.so.1 (0x00007f481e3a7000) 2025-03-14T06:14:29.6273764Z libc10.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libc10.so (0x00007f4832973000) 2025-03-14T06:14:29.6274716Z libpthread.so.0 => /usr/lib64/libpthread.so.0 (0x00007f481e187000) 2025-03-14T06:14:29.6275306Z libdl.so.2 => /usr/lib64/libdl.so.2 (0x00007f481df83000) 2025-03-14T06:14:29.6275870Z libstdc++.so.6 => /usr/lib64/libstdc++.so.6 (0x00007f481dbee000) 2025-03-14T06:14:29.6276428Z libm.so.6 => /usr/lib64/libm.so.6 (0x00007f481d86c000) 2025-03-14T06:14:29.6277311Z libgomp-c9fef706.so.1 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libgomp-c9fef706.so.1 (0x00007f481d62f000) 2025-03-14T06:14:29.6278226Z libgcc_s.so.1 => /usr/lib64/libgcc_s.so.1 (0x00007f481d417000) 2025-03-14T06:14:29.6278750Z libc.so.6 => /usr/lib64/libc.so.6 (0x00007f481d041000) 2025-03-14T06:14:29.6279681Z libcupti.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cuda_cupti/lib/libcupti.so.12 (0x00007f481c84d000) 2025-03-14T06:14:29.6281033Z libcudart.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cuda_runtime/lib/libcudart.so.12 (0x00007f481c59c000) 2025-03-14T06:14:29.6282165Z /lib64/ld-linux-x86-64.so.2 (0x00007f483287a000) 2025-03-14T06:14:29.6282762Z libutil.so.1 => /usr/lib64/libutil.so.1 (0x00007f481c398000) with runpath ' 2025-03-14T06:14:29.6283771Z All dependencies of /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libshm.so are linux-vdso.so.1 (0x00007ffd5d5ee000) 2025-03-14T06:14:29.6284993Z libtorch_cpu.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch_cpu.so (0x00007f481e5af000) 2025-03-14T06:14:29.6285816Z librt.so.1 => /usr/lib64/librt.so.1 (0x00007f481e3a7000) 2025-03-14T06:14:29.6287098Z libc10.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libc10.so (0x00007f4832973000) 2025-03-14T06:14:29.6287954Z libpthread.so.0 => /usr/lib64/libpthread.so.0 (0x00007f481e187000) 2025-03-14T06:14:29.6288546Z libdl.so.2 => /usr/lib64/libdl.so.2 (0x00007f481df83000) 2025-03-14T06:14:29.6289122Z libstdc++.so.6 => /usr/lib64/libstdc++.so.6 (0x00007f481dbee000) 2025-03-14T06:14:29.6289677Z libm.so.6 => /usr/lib64/libm.so.6 (0x00007f481d86c000) 2025-03-14T06:14:29.6290547Z libgomp-c9fef706.so.1 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libgomp-c9fef706.so.1 (0x00007f481d62f000) 2025-03-14T06:14:29.6291466Z libgcc_s.so.1 => /usr/lib64/libgcc_s.so.1 (0x00007f481d417000) 2025-03-14T06:14:29.6292010Z libc.so.6 => /usr/lib64/libc.so.6 (0x00007f481d041000) 2025-03-14T06:14:29.6292933Z libcupti.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cuda_cupti/lib/libcupti.so.12 (0x00007f481c84d000) 2025-03-14T06:14:29.6294306Z libcudart.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cuda_runtime/lib/libcudart.so.12 (0x00007f481c59c000) 2025-03-14T06:14:29.6295362Z /lib64/ld-linux-x86-64.so.2 (0x00007f483287a000) 2025-03-14T06:14:29.6295964Z libutil.so.1 => /usr/lib64/libutil.so.1 (0x00007f481c398000) with runpath 2025-03-14T06:14:29.6296529Z + for lib in "${all_libs[@]}" 2025-03-14T06:14:29.6297117Z ++ ldd /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch.so 2025-03-14T06:14:29.6390022Z ++ objdump -p /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch.so 2025-03-14T06:14:29.6390693Z ++ grep RUNPATH 2025-03-14T06:14:29.6417879Z + echo 'All dependencies of /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch.so are linux-vdso.so.1 (0x00007ffef988b000) 2025-03-14T06:14:29.6419208Z libtorch_cpu.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch_cpu.so (0x00007fc345038000) 2025-03-14T06:14:29.6420350Z libtorch_cuda.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch_cuda.so (0x00007fc30764b000) 2025-03-14T06:14:29.6421212Z libgcc_s.so.1 => /usr/lib64/libgcc_s.so.1 (0x00007fc307433000) 2025-03-14T06:14:29.6422220Z libpthread.so.0 => /usr/lib64/libpthread.so.0 (0x00007fc307213000) 2025-03-14T06:14:29.6422950Z libc.so.6 => /usr/lib64/libc.so.6 (0x00007fc306e3d000) 2025-03-14T06:14:29.6424049Z libc10.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libc10.so (0x00007fc3593d4000) 2025-03-14T06:14:29.6424828Z librt.so.1 => /usr/lib64/librt.so.1 (0x00007fc306c35000) 2025-03-14T06:14:29.6425377Z libdl.so.2 => /usr/lib64/libdl.so.2 (0x00007fc306a31000) 2025-03-14T06:14:29.6425887Z libm.so.6 => /usr/lib64/libm.so.6 (0x00007fc3066af000) 2025-03-14T06:14:29.6427198Z libgomp-c9fef706.so.1 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libgomp-c9fef706.so.1 (0x00007fc306472000) 2025-03-14T06:14:29.6428504Z libcupti.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cuda_cupti/lib/libcupti.so.12 (0x00007fc305c7e000) 2025-03-14T06:14:29.6429868Z libcudart.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cuda_runtime/lib/libcudart.so.12 (0x00007fc3059cd000) 2025-03-14T06:14:29.6431180Z libstdc++.so.6 => /usr/lib64/libstdc++.so.6 (0x00007fc305638000) 2025-03-14T06:14:29.6431768Z /lib64/ld-linux-x86-64.so.2 (0x00007fc359303000) 2025-03-14T06:14:29.6432629Z libc10_cuda.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libc10_cuda.so (0x00007fc305587000) 2025-03-14T06:14:29.6434018Z libcusparse.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cusparse/lib/libcusparse.so.12 (0x00007fc2f3b82000) 2025-03-14T06:14:29.6435511Z libcufft.so.11 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cufft/lib/libcufft.so.11 (0x00007fc2e2b81000) 2025-03-14T06:14:29.6436951Z libcufile.so.0 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cufile/lib/libcufile.so.0 (0x00007fc2e28a9000) 2025-03-14T06:14:29.6438457Z libcusparseLt.so.0 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../cusparselt/lib/libcusparseLt.so.0 (0x00007fc2d4255000) 2025-03-14T06:14:29.6439961Z libcurand.so.10 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/curand/lib/libcurand.so.10 (0x00007fc2cde1c000) 2025-03-14T06:14:29.6441480Z libcublas.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cublas/lib/libcublas.so.12 (0x00007fc2c74d5000) 2025-03-14T06:14:29.6442849Z libcublasLt.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cublas/lib/libcublasLt.so.12 (0x00007fc2a5ca9000) 2025-03-14T06:14:29.6444151Z libcudnn.so.9 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cudnn/lib/libcudnn.so.9 (0x00007fc2a5a8a000) 2025-03-14T06:14:29.6446187Z libnccl.so.2 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/nccl/lib/libnccl.so.2 (0x00007fc29628b000) 2025-03-14T06:14:29.6447129Z libutil.so.1 => /usr/lib64/libutil.so.1 (0x00007fc296087000) 2025-03-14T06:14:29.6448288Z libnvJitLink.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cusparse/lib/../../nvjitlink/lib/libnvJitLink.so.12 (0x00007fc292dfe000) with runpath ' 2025-03-14T06:14:29.6449843Z All dependencies of /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch.so are linux-vdso.so.1 (0x00007ffef988b000) 2025-03-14T06:14:29.6451092Z libtorch_cpu.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch_cpu.so (0x00007fc345038000) 2025-03-14T06:14:29.6452228Z libtorch_cuda.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch_cuda.so (0x00007fc30764b000) 2025-03-14T06:14:29.6453089Z libgcc_s.so.1 => /usr/lib64/libgcc_s.so.1 (0x00007fc307433000) 2025-03-14T06:14:29.6453676Z libpthread.so.0 => /usr/lib64/libpthread.so.0 (0x00007fc307213000) 2025-03-14T06:14:29.6454255Z libc.so.6 => /usr/lib64/libc.so.6 (0x00007fc306e3d000) 2025-03-14T06:14:29.6455014Z libc10.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libc10.so (0x00007fc3593d4000) 2025-03-14T06:14:29.6455790Z librt.so.1 => /usr/lib64/librt.so.1 (0x00007fc306c35000) 2025-03-14T06:14:29.6456323Z libdl.so.2 => /usr/lib64/libdl.so.2 (0x00007fc306a31000) 2025-03-14T06:14:29.6456829Z libm.so.6 => /usr/lib64/libm.so.6 (0x00007fc3066af000) 2025-03-14T06:14:29.6457714Z libgomp-c9fef706.so.1 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libgomp-c9fef706.so.1 (0x00007fc306472000) 2025-03-14T06:14:29.6459010Z libcupti.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cuda_cupti/lib/libcupti.so.12 (0x00007fc305c7e000) 2025-03-14T06:14:29.6460365Z libcudart.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cuda_runtime/lib/libcudart.so.12 (0x00007fc3059cd000) 2025-03-14T06:14:29.6461421Z libstdc++.so.6 => /usr/lib64/libstdc++.so.6 (0x00007fc305638000) 2025-03-14T06:14:29.6462451Z /lib64/ld-linux-x86-64.so.2 (0x00007fc359303000) 2025-03-14T06:14:29.6463385Z libc10_cuda.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libc10_cuda.so (0x00007fc305587000) 2025-03-14T06:14:29.6464630Z libcusparse.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cusparse/lib/libcusparse.so.12 (0x00007fc2f3b82000) 2025-03-14T06:14:29.6465976Z libcufft.so.11 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cufft/lib/libcufft.so.11 (0x00007fc2e2b81000) 2025-03-14T06:14:29.6467275Z libcufile.so.0 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cufile/lib/libcufile.so.0 (0x00007fc2e28a9000) 2025-03-14T06:14:29.6468610Z libcusparseLt.so.0 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../cusparselt/lib/libcusparseLt.so.0 (0x00007fc2d4255000) 2025-03-14T06:14:29.6469968Z libcurand.so.10 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/curand/lib/libcurand.so.10 (0x00007fc2cde1c000) 2025-03-14T06:14:29.6471294Z libcublas.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cublas/lib/libcublas.so.12 (0x00007fc2c74d5000) 2025-03-14T06:14:29.6472634Z libcublasLt.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cublas/lib/libcublasLt.so.12 (0x00007fc2a5ca9000) 2025-03-14T06:14:29.6473980Z libcudnn.so.9 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cudnn/lib/libcudnn.so.9 (0x00007fc2a5a8a000) 2025-03-14T06:14:29.6475215Z libnccl.so.2 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/nccl/lib/libnccl.so.2 (0x00007fc29628b000) 2025-03-14T06:14:29.6476123Z libutil.so.1 => /usr/lib64/libutil.so.1 (0x00007fc296087000) 2025-03-14T06:14:29.6477355Z libnvJitLink.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cusparse/lib/../../nvjitlink/lib/libnvJitLink.so.12 (0x00007fc292dfe000) with runpath 2025-03-14T06:14:29.6478463Z + for lib in "${all_libs[@]}" 2025-03-14T06:14:29.6479063Z ++ ldd /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch_cpu.so 2025-03-14T06:14:29.6518157Z ++ objdump -p /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch_cpu.so 2025-03-14T06:14:29.6519540Z ++ grep RUNPATH 2025-03-14T06:14:29.6575644Z + echo 'All dependencies of /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch_cpu.so are linux-vdso.so.1 (0x00007ffceb2e1000) 2025-03-14T06:14:29.6576916Z libc10.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libc10.so (0x00007f95903c7000) 2025-03-14T06:14:29.6577699Z librt.so.1 => /usr/lib64/librt.so.1 (0x00007f957bde9000) 2025-03-14T06:14:29.6578673Z libgcc_s.so.1 => /usr/lib64/libgcc_s.so.1 (0x00007f957bbd1000) 2025-03-14T06:14:29.6579267Z libdl.so.2 => /usr/lib64/libdl.so.2 (0x00007f957b9cd000) 2025-03-14T06:14:29.6579851Z libpthread.so.0 => /usr/lib64/libpthread.so.0 (0x00007f957b7ad000) 2025-03-14T06:14:29.6580438Z libm.so.6 => /usr/lib64/libm.so.6 (0x00007f957b42b000) 2025-03-14T06:14:29.6581328Z libgomp-c9fef706.so.1 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libgomp-c9fef706.so.1 (0x00007f957b1ee000) 2025-03-14T06:14:29.6582624Z libcupti.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cuda_cupti/lib/libcupti.so.12 (0x00007f957a9fa000) 2025-03-14T06:14:29.6583975Z libcudart.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cuda_runtime/lib/libcudart.so.12 (0x00007f957a749000) 2025-03-14T06:14:29.6584963Z libstdc++.so.6 => /usr/lib64/libstdc++.so.6 (0x00007f957a3b4000) 2025-03-14T06:14:29.6585522Z libc.so.6 => /usr/lib64/libc.so.6 (0x00007f9579fde000) 2025-03-14T06:14:29.6586017Z /lib64/ld-linux-x86-64.so.2 (0x00007f95902bc000) 2025-03-14T06:14:29.6586599Z libutil.so.1 => /usr/lib64/libutil.so.1 (0x00007f9579dda000) with runpath ' 2025-03-14T06:14:29.6587644Z All dependencies of /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch_cpu.so are linux-vdso.so.1 (0x00007ffceb2e1000) 2025-03-14T06:14:29.6589062Z libc10.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libc10.so (0x00007f95903c7000) 2025-03-14T06:14:29.6589833Z librt.so.1 => /usr/lib64/librt.so.1 (0x00007f957bde9000) 2025-03-14T06:14:29.6590387Z libgcc_s.so.1 => /usr/lib64/libgcc_s.so.1 (0x00007f957bbd1000) 2025-03-14T06:14:29.6590954Z libdl.so.2 => /usr/lib64/libdl.so.2 (0x00007f957b9cd000) 2025-03-14T06:14:29.6591593Z libpthread.so.0 => /usr/lib64/libpthread.so.0 (0x00007f957b7ad000) 2025-03-14T06:14:29.6592153Z libm.so.6 => /usr/lib64/libm.so.6 (0x00007f957b42b000) 2025-03-14T06:14:29.6593042Z libgomp-c9fef706.so.1 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libgomp-c9fef706.so.1 (0x00007f957b1ee000) 2025-03-14T06:14:29.6594345Z libcupti.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cuda_cupti/lib/libcupti.so.12 (0x00007f957a9fa000) 2025-03-14T06:14:29.6595706Z libcudart.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cuda_runtime/lib/libcudart.so.12 (0x00007f957a749000) 2025-03-14T06:14:29.6596686Z libstdc++.so.6 => /usr/lib64/libstdc++.so.6 (0x00007f957a3b4000) 2025-03-14T06:14:29.6597240Z libc.so.6 => /usr/lib64/libc.so.6 (0x00007f9579fde000) 2025-03-14T06:14:29.6597721Z /lib64/ld-linux-x86-64.so.2 (0x00007f95902bc000) 2025-03-14T06:14:29.6598302Z libutil.so.1 => /usr/lib64/libutil.so.1 (0x00007f9579dda000) with runpath 2025-03-14T06:14:29.6598862Z + for lib in "${all_libs[@]}" 2025-03-14T06:14:29.6599464Z ++ ldd /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch_cuda.so 2025-03-14T06:14:29.6691221Z ++ objdump -p /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch_cuda.so 2025-03-14T06:14:29.6693211Z ++ grep RUNPATH 2025-03-14T06:14:29.6791725Z + echo 'All dependencies of /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch_cuda.so are linux-vdso.so.1 (0x00007ffdc6143000) 2025-03-14T06:14:29.6793090Z libc10_cuda.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libc10_cuda.so (0x00007f45bb4fb000) 2025-03-14T06:14:29.6794317Z libcudart.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cuda_runtime/lib/libcudart.so.12 (0x00007f457d6e1000) 2025-03-14T06:14:29.6796271Z libcusparse.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cusparse/lib/libcusparse.so.12 (0x00007f456bcdc000) 2025-03-14T06:14:29.6797609Z libcufft.so.11 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cufft/lib/libcufft.so.11 (0x00007f455acdb000) 2025-03-14T06:14:29.6798918Z libcufile.so.0 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cufile/lib/libcufile.so.0 (0x00007f455aa03000) 2025-03-14T06:14:29.6800251Z libcusparseLt.so.0 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../cusparselt/lib/libcusparseLt.so.0 (0x00007f454c3af000) 2025-03-14T06:14:29.6801602Z libcurand.so.10 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/curand/lib/libcurand.so.10 (0x00007f4545f76000) 2025-03-14T06:14:29.6802914Z libcublas.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cublas/lib/libcublas.so.12 (0x00007f453f62f000) 2025-03-14T06:14:29.6804261Z libcublasLt.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cublas/lib/libcublasLt.so.12 (0x00007f451de03000) 2025-03-14T06:14:29.6805557Z libcudnn.so.9 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cudnn/lib/libcudnn.so.9 (0x00007f451dbe4000) 2025-03-14T06:14:29.6806813Z libnccl.so.2 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/nccl/lib/libnccl.so.2 (0x00007f450e3e5000) 2025-03-14T06:14:29.6807754Z libpthread.so.0 => /usr/lib64/libpthread.so.0 (0x00007f450e1c5000) 2025-03-14T06:14:29.6808578Z libdl.so.2 => /usr/lib64/libdl.so.2 (0x00007f450dfc1000) 2025-03-14T06:14:29.6809135Z librt.so.1 => /usr/lib64/librt.so.1 (0x00007f450ddb9000) 2025-03-14T06:14:29.6809980Z libc10.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libc10.so (0x00007f45bb3cf000) 2025-03-14T06:14:29.6811150Z libtorch_cpu.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch_cpu.so (0x00007f44f9aee000) 2025-03-14T06:14:29.6812105Z libstdc++.so.6 => /usr/lib64/libstdc++.so.6 (0x00007f44f9759000) 2025-03-14T06:14:29.6812709Z libm.so.6 => /usr/lib64/libm.so.6 (0x00007f44f93d7000) 2025-03-14T06:14:29.6813307Z libgcc_s.so.1 => /usr/lib64/libgcc_s.so.1 (0x00007f44f91bf000) 2025-03-14T06:14:29.6813903Z libc.so.6 => /usr/lib64/libc.so.6 (0x00007f44f8de9000) 2025-03-14T06:14:29.6814447Z /lib64/ld-linux-x86-64.so.2 (0x00007f45bb37f000) 2025-03-14T06:14:29.6815577Z libnvJitLink.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cusparse/lib/../../nvjitlink/lib/libnvJitLink.so.12 (0x00007f44f5b60000) 2025-03-14T06:14:29.6817702Z libgomp-c9fef706.so.1 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libgomp-c9fef706.so.1 (0x00007f44f5923000) 2025-03-14T06:14:29.6819018Z libcupti.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cuda_cupti/lib/libcupti.so.12 (0x00007f44f512f000) 2025-03-14T06:14:29.6820041Z libutil.so.1 => /usr/lib64/libutil.so.1 (0x00007f44f4f2b000) with runpath ' 2025-03-14T06:14:29.6821089Z All dependencies of /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch_cuda.so are linux-vdso.so.1 (0x00007ffdc6143000) 2025-03-14T06:14:29.6822470Z libc10_cuda.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libc10_cuda.so (0x00007f45bb4fb000) 2025-03-14T06:14:29.6823730Z libcudart.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cuda_runtime/lib/libcudart.so.12 (0x00007f457d6e1000) 2025-03-14T06:14:29.6825121Z libcusparse.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cusparse/lib/libcusparse.so.12 (0x00007f456bcdc000) 2025-03-14T06:14:29.6826968Z libcufft.so.11 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cufft/lib/libcufft.so.11 (0x00007f455acdb000) 2025-03-14T06:14:29.6828303Z libcufile.so.0 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cufile/lib/libcufile.so.0 (0x00007f455aa03000) 2025-03-14T06:14:29.6829638Z libcusparseLt.so.0 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../cusparselt/lib/libcusparseLt.so.0 (0x00007f454c3af000) 2025-03-14T06:14:29.6830996Z libcurand.so.10 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/curand/lib/libcurand.so.10 (0x00007f4545f76000) 2025-03-14T06:14:29.6832315Z libcublas.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cublas/lib/libcublas.so.12 (0x00007f453f62f000) 2025-03-14T06:14:29.6833661Z libcublasLt.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cublas/lib/libcublasLt.so.12 (0x00007f451de03000) 2025-03-14T06:14:29.6835529Z libcudnn.so.9 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cudnn/lib/libcudnn.so.9 (0x00007f451dbe4000) 2025-03-14T06:14:29.6836788Z libnccl.so.2 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/nccl/lib/libnccl.so.2 (0x00007f450e3e5000) 2025-03-14T06:14:29.6837712Z libpthread.so.0 => /usr/lib64/libpthread.so.0 (0x00007f450e1c5000) 2025-03-14T06:14:29.6838301Z libdl.so.2 => /usr/lib64/libdl.so.2 (0x00007f450dfc1000) 2025-03-14T06:14:29.6838845Z librt.so.1 => /usr/lib64/librt.so.1 (0x00007f450ddb9000) 2025-03-14T06:14:29.6839614Z libc10.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libc10.so (0x00007f45bb3cf000) 2025-03-14T06:14:29.6840855Z libtorch_cpu.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch_cpu.so (0x00007f44f9aee000) 2025-03-14T06:14:29.6841760Z libstdc++.so.6 => /usr/lib64/libstdc++.so.6 (0x00007f44f9759000) 2025-03-14T06:14:29.6842299Z libm.so.6 => /usr/lib64/libm.so.6 (0x00007f44f93d7000) 2025-03-14T06:14:29.6842863Z libgcc_s.so.1 => /usr/lib64/libgcc_s.so.1 (0x00007f44f91bf000) 2025-03-14T06:14:29.6843404Z libc.so.6 => /usr/lib64/libc.so.6 (0x00007f44f8de9000) 2025-03-14T06:14:29.6843906Z /lib64/ld-linux-x86-64.so.2 (0x00007f45bb37f000) 2025-03-14T06:14:29.6844956Z libnvJitLink.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cusparse/lib/../../nvjitlink/lib/libnvJitLink.so.12 (0x00007f44f5b60000) 2025-03-14T06:14:29.6846401Z libgomp-c9fef706.so.1 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libgomp-c9fef706.so.1 (0x00007f44f5923000) 2025-03-14T06:14:29.6847743Z libcupti.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cuda_cupti/lib/libcupti.so.12 (0x00007f44f512f000) 2025-03-14T06:14:29.6848872Z libutil.so.1 => /usr/lib64/libutil.so.1 (0x00007f44f4f2b000) with runpath 2025-03-14T06:14:29.6849471Z + for lib in "${all_libs[@]}" 2025-03-14T06:14:29.6850172Z ++ ldd /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch_cuda_linalg.so 2025-03-14T06:14:29.6915094Z ++ objdump -p /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch_cuda_linalg.so 2025-03-14T06:14:29.6916083Z ++ grep RUNPATH 2025-03-14T06:14:29.6947210Z + echo 'All dependencies of /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch_cuda_linalg.so are linux-vdso.so.1 (0x00007ffdba1c3000) 2025-03-14T06:14:29.6948812Z libtorch_cpu.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch_cpu.so (0x00007f2f4aebe000) 2025-03-14T06:14:29.6949994Z libtorch_cuda.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch_cuda.so (0x00007f2f0d4d1000) 2025-03-14T06:14:29.6951486Z libcusolver.so.11 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cusolver/lib/libcusolver.so.11 (0x00007f2f040c8000) 2025-03-14T06:14:29.6953006Z libc10_cuda.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libc10_cuda.so (0x00007f2f64758000) 2025-03-14T06:14:29.6954243Z libcudart.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cuda_runtime/lib/libcudart.so.12 (0x00007f2f03e17000) 2025-03-14T06:14:29.6955439Z libc10.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libc10.so (0x00007f2f64636000) 2025-03-14T06:14:29.6956251Z libpthread.so.0 => /usr/lib64/libpthread.so.0 (0x00007f2f03bf7000) 2025-03-14T06:14:29.6956858Z libdl.so.2 => /usr/lib64/libdl.so.2 (0x00007f2f039f3000) 2025-03-14T06:14:29.6957822Z libcublas.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cublas/lib/libcublas.so.12 (0x00007f2efd0ac000) 2025-03-14T06:14:29.6959217Z libcusparse.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cusparse/lib/libcusparse.so.12 (0x00007f2eeb6a7000) 2025-03-14T06:14:29.6960222Z libstdc++.so.6 => /usr/lib64/libstdc++.so.6 (0x00007f2eeb312000) 2025-03-14T06:14:29.6960790Z libm.so.6 => /usr/lib64/libm.so.6 (0x00007f2eeaf90000) 2025-03-14T06:14:29.6961329Z libgcc_s.so.1 => /usr/lib64/libgcc_s.so.1 (0x00007f2eead78000) 2025-03-14T06:14:29.6961873Z libc.so.6 => /usr/lib64/libc.so.6 (0x00007f2eea9a2000) 2025-03-14T06:14:29.6962379Z /lib64/ld-linux-x86-64.so.2 (0x00007f2f645de000) 2025-03-14T06:14:29.6962904Z librt.so.1 => /usr/lib64/librt.so.1 (0x00007f2eea79a000) 2025-03-14T06:14:29.6963820Z libgomp-c9fef706.so.1 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libgomp-c9fef706.so.1 (0x00007f2eea55d000) 2025-03-14T06:14:29.6965119Z libcupti.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cuda_cupti/lib/libcupti.so.12 (0x00007f2ee9d69000) 2025-03-14T06:14:29.6966573Z libcufft.so.11 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cufft/lib/libcufft.so.11 (0x00007f2ed8d68000) 2025-03-14T06:14:29.6967889Z libcufile.so.0 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cufile/lib/libcufile.so.0 (0x00007f2ed8a90000) 2025-03-14T06:14:29.6969237Z libcusparseLt.so.0 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../cusparselt/lib/libcusparseLt.so.0 (0x00007f2eca43c000) 2025-03-14T06:14:29.6970594Z libcurand.so.10 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/curand/lib/libcurand.so.10 (0x00007f2ec4003000) 2025-03-14T06:14:29.6971950Z libcublasLt.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cublas/lib/libcublasLt.so.12 (0x00007f2ea27d7000) 2025-03-14T06:14:29.6973279Z libcudnn.so.9 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cudnn/lib/libcudnn.so.9 (0x00007f2ea25b8000) 2025-03-14T06:14:29.6974535Z libnccl.so.2 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/nccl/lib/libnccl.so.2 (0x00007f2e92db9000) 2025-03-14T06:14:29.6975945Z libnvJitLink.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cusolver/lib/../../nvjitlink/lib/libnvJitLink.so.12 (0x00007f2e8fb30000) 2025-03-14T06:14:29.6977075Z libutil.so.1 => /usr/lib64/libutil.so.1 (0x00007f2e8f92c000) with runpath ' 2025-03-14T06:14:29.6978158Z All dependencies of /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch_cuda_linalg.so are linux-vdso.so.1 (0x00007ffdba1c3000) 2025-03-14T06:14:29.6979537Z libtorch_cpu.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch_cpu.so (0x00007f2f4aebe000) 2025-03-14T06:14:29.6980694Z libtorch_cuda.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch_cuda.so (0x00007f2f0d4d1000) 2025-03-14T06:14:29.6981969Z libcusolver.so.11 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cusolver/lib/libcusolver.so.11 (0x00007f2f040c8000) 2025-03-14T06:14:29.6983208Z libc10_cuda.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libc10_cuda.so (0x00007f2f64758000) 2025-03-14T06:14:29.6984452Z libcudart.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cuda_runtime/lib/libcudart.so.12 (0x00007f2f03e17000) 2025-03-14T06:14:29.6985642Z libc10.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libc10.so (0x00007f2f64636000) 2025-03-14T06:14:29.6986451Z libpthread.so.0 => /usr/lib64/libpthread.so.0 (0x00007f2f03bf7000) 2025-03-14T06:14:29.6987043Z libdl.so.2 => /usr/lib64/libdl.so.2 (0x00007f2f039f3000) 2025-03-14T06:14:29.6987979Z libcublas.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cublas/lib/libcublas.so.12 (0x00007f2efd0ac000) 2025-03-14T06:14:29.6989351Z libcusparse.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cusparse/lib/libcusparse.so.12 (0x00007f2eeb6a7000) 2025-03-14T06:14:29.6990352Z libstdc++.so.6 => /usr/lib64/libstdc++.so.6 (0x00007f2eeb312000) 2025-03-14T06:14:29.6990912Z libm.so.6 => /usr/lib64/libm.so.6 (0x00007f2eeaf90000) 2025-03-14T06:14:29.6991439Z libgcc_s.so.1 => /usr/lib64/libgcc_s.so.1 (0x00007f2eead78000) 2025-03-14T06:14:29.6991984Z libc.so.6 => /usr/lib64/libc.so.6 (0x00007f2eea9a2000) 2025-03-14T06:14:29.6992485Z /lib64/ld-linux-x86-64.so.2 (0x00007f2f645de000) 2025-03-14T06:14:29.6993004Z librt.so.1 => /usr/lib64/librt.so.1 (0x00007f2eea79a000) 2025-03-14T06:14:29.6993906Z libgomp-c9fef706.so.1 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libgomp-c9fef706.so.1 (0x00007f2eea55d000) 2025-03-14T06:14:29.6995205Z libcupti.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cuda_cupti/lib/libcupti.so.12 (0x00007f2ee9d69000) 2025-03-14T06:14:29.6996579Z libcufft.so.11 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cufft/lib/libcufft.so.11 (0x00007f2ed8d68000) 2025-03-14T06:14:29.6997877Z libcufile.so.0 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cufile/lib/libcufile.so.0 (0x00007f2ed8a90000) 2025-03-14T06:14:29.6999219Z libcusparseLt.so.0 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../cusparselt/lib/libcusparseLt.so.0 (0x00007f2eca43c000) 2025-03-14T06:14:29.7000567Z libcurand.so.10 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/curand/lib/libcurand.so.10 (0x00007f2ec4003000) 2025-03-14T06:14:29.7001918Z libcublasLt.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cublas/lib/libcublasLt.so.12 (0x00007f2ea27d7000) 2025-03-14T06:14:29.7003249Z libcudnn.so.9 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cudnn/lib/libcudnn.so.9 (0x00007f2ea25b8000) 2025-03-14T06:14:29.7004505Z libnccl.so.2 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/nccl/lib/libnccl.so.2 (0x00007f2e92db9000) 2025-03-14T06:14:29.7005916Z libnvJitLink.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cusolver/lib/../../nvjitlink/lib/libnvJitLink.so.12 (0x00007f2e8fb30000) 2025-03-14T06:14:29.7007038Z libutil.so.1 => /usr/lib64/libutil.so.1 (0x00007f2e8f92c000) with runpath 2025-03-14T06:14:29.7007598Z + for lib in "${all_libs[@]}" 2025-03-14T06:14:29.7008238Z ++ ldd /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch_global_deps.so 2025-03-14T06:14:29.7039344Z ++ objdump -p /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch_global_deps.so 2025-03-14T06:14:29.7040076Z ++ grep RUNPATH 2025-03-14T06:14:29.7066739Z + echo 'All dependencies of /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch_global_deps.so are linux-vdso.so.1 (0x00007ffee61ca000) 2025-03-14T06:14:29.7067855Z libpthread.so.0 => /usr/lib64/libpthread.so.0 (0x00007f5b8806b000) 2025-03-14T06:14:29.7068443Z libm.so.6 => /usr/lib64/libm.so.6 (0x00007f5b87ce9000) 2025-03-14T06:14:29.7069065Z libdl.so.2 => /usr/lib64/libdl.so.2 (0x00007f5b87ae5000) 2025-03-14T06:14:29.7070303Z libcudart.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cuda_runtime/lib/libcudart.so.12 (0x00007f5b87834000) 2025-03-14T06:14:29.7071749Z libgomp-c9fef706.so.1 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libgomp-c9fef706.so.1 (0x00007f5b875f7000) 2025-03-14T06:14:29.7072639Z libc.so.6 => /usr/lib64/libc.so.6 (0x00007f5b87221000) 2025-03-14T06:14:29.7073160Z /lib64/ld-linux-x86-64.so.2 (0x00007f5b8828b000) 2025-03-14T06:14:29.7073736Z librt.so.1 => /usr/lib64/librt.so.1 (0x00007f5b87019000) with runpath ' 2025-03-14T06:14:29.7074787Z All dependencies of /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch_global_deps.so are linux-vdso.so.1 (0x00007ffee61ca000) 2025-03-14T06:14:29.7075839Z libpthread.so.0 => /usr/lib64/libpthread.so.0 (0x00007f5b8806b000) 2025-03-14T06:14:29.7076415Z libm.so.6 => /usr/lib64/libm.so.6 (0x00007f5b87ce9000) 2025-03-14T06:14:29.7076939Z libdl.so.2 => /usr/lib64/libdl.so.2 (0x00007f5b87ae5000) 2025-03-14T06:14:29.7077922Z libcudart.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cuda_runtime/lib/libcudart.so.12 (0x00007f5b87834000) 2025-03-14T06:14:29.7079236Z libgomp-c9fef706.so.1 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libgomp-c9fef706.so.1 (0x00007f5b875f7000) 2025-03-14T06:14:29.7080108Z libc.so.6 => /usr/lib64/libc.so.6 (0x00007f5b87221000) 2025-03-14T06:14:29.7080609Z /lib64/ld-linux-x86-64.so.2 (0x00007f5b8828b000) 2025-03-14T06:14:29.7081176Z librt.so.1 => /usr/lib64/librt.so.1 (0x00007f5b87019000) with runpath 2025-03-14T06:14:29.7081881Z + for lib in "${all_libs[@]}" 2025-03-14T06:14:29.7082494Z ++ ldd /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch_python.so 2025-03-14T06:14:29.7189494Z ++ objdump -p /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch_python.so 2025-03-14T06:14:29.7190268Z ++ grep RUNPATH 2025-03-14T06:14:29.7221588Z + echo 'All dependencies of /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch_python.so are linux-vdso.so.1 (0x00007ffdf55c9000) 2025-03-14T06:14:29.7222900Z libtorch.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch.so (0x00007f2ddc910000) 2025-03-14T06:14:29.7223944Z libshm.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libshm.so (0x00007f2ddc904000) 2025-03-14T06:14:29.7225011Z libtorch_cpu.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch_cpu.so (0x00007f2dc71a1000) 2025-03-14T06:14:29.7226597Z libtorch_cuda.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch_cuda.so (0x00007f2d897b4000) 2025-03-14T06:14:29.7227753Z libc10_cuda.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libc10_cuda.so (0x00007f2ddc851000) 2025-03-14T06:14:29.7228994Z libcudart.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cuda_runtime/lib/libcudart.so.12 (0x00007f2d89503000) 2025-03-14T06:14:29.7230414Z libc10.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libc10.so (0x00007f2d893e1000) 2025-03-14T06:14:29.7231471Z libpthread.so.0 => /usr/lib64/libpthread.so.0 (0x00007f2d891c1000) 2025-03-14T06:14:29.7232068Z libdl.so.2 => /usr/lib64/libdl.so.2 (0x00007f2d88fbd000) 2025-03-14T06:14:29.7233160Z libcudnn.so.9 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cudnn/lib/libcudnn.so.9 (0x00007f2d88d9e000) 2025-03-14T06:14:29.7234528Z libcusparseLt.so.0 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../cusparselt/lib/libcusparseLt.so.0 (0x00007f2d7a74a000) 2025-03-14T06:14:29.7235866Z libcufile.so.0 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cufile/lib/libcufile.so.0 (0x00007f2d7a472000) 2025-03-14T06:14:29.7236819Z libstdc++.so.6 => /usr/lib64/libstdc++.so.6 (0x00007f2d7a0dd000) 2025-03-14T06:14:29.7237391Z libgcc_s.so.1 => /usr/lib64/libgcc_s.so.1 (0x00007f2d79ec5000) 2025-03-14T06:14:29.7237939Z libc.so.6 => /usr/lib64/libc.so.6 (0x00007f2d79aef000) 2025-03-14T06:14:29.7238442Z /lib64/ld-linux-x86-64.so.2 (0x00007f2ddc717000) 2025-03-14T06:14:29.7238959Z librt.so.1 => /usr/lib64/librt.so.1 (0x00007f2d798e7000) 2025-03-14T06:14:29.7239482Z libm.so.6 => /usr/lib64/libm.so.6 (0x00007f2d79565000) 2025-03-14T06:14:29.7240376Z libgomp-c9fef706.so.1 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libgomp-c9fef706.so.1 (0x00007f2d79328000) 2025-03-14T06:14:29.7241729Z libcupti.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cuda_cupti/lib/libcupti.so.12 (0x00007f2d78b34000) 2025-03-14T06:14:29.7243093Z libcusparse.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cusparse/lib/libcusparse.so.12 (0x00007f2d6712f000) 2025-03-14T06:14:29.7244434Z libcufft.so.11 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cufft/lib/libcufft.so.11 (0x00007f2d5612e000) 2025-03-14T06:14:29.7245739Z libcurand.so.10 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/curand/lib/libcurand.so.10 (0x00007f2d4fcf5000) 2025-03-14T06:14:29.7247084Z libcublas.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cublas/lib/libcublas.so.12 (0x00007f2d493ae000) 2025-03-14T06:14:29.7248436Z libcublasLt.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cublas/lib/libcublasLt.so.12 (0x00007f2d27b82000) 2025-03-14T06:14:29.7249883Z libnccl.so.2 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/nccl/lib/libnccl.so.2 (0x00007f2d18383000) 2025-03-14T06:14:29.7250793Z libutil.so.1 => /usr/lib64/libutil.so.1 (0x00007f2d1817f000) 2025-03-14T06:14:29.7251941Z libnvJitLink.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cusparse/lib/../../nvjitlink/lib/libnvJitLink.so.12 (0x00007f2d14ef6000) with runpath ' 2025-03-14T06:14:29.7253521Z All dependencies of /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch_python.so are linux-vdso.so.1 (0x00007ffdf55c9000) 2025-03-14T06:14:29.7254755Z libtorch.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch.so (0x00007f2ddc910000) 2025-03-14T06:14:29.7255806Z libshm.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libshm.so (0x00007f2ddc904000) 2025-03-14T06:14:29.7256878Z libtorch_cpu.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch_cpu.so (0x00007f2dc71a1000) 2025-03-14T06:14:29.7258257Z libtorch_cuda.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libtorch_cuda.so (0x00007f2d897b4000) 2025-03-14T06:14:29.7259620Z libc10_cuda.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libc10_cuda.so (0x00007f2ddc851000) 2025-03-14T06:14:29.7260865Z libcudart.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cuda_runtime/lib/libcudart.so.12 (0x00007f2d89503000) 2025-03-14T06:14:29.7262040Z libc10.so => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libc10.so (0x00007f2d893e1000) 2025-03-14T06:14:29.7262866Z libpthread.so.0 => /usr/lib64/libpthread.so.0 (0x00007f2d891c1000) 2025-03-14T06:14:29.7263544Z libdl.so.2 => /usr/lib64/libdl.so.2 (0x00007f2d88fbd000) 2025-03-14T06:14:29.7264572Z libcudnn.so.9 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cudnn/lib/libcudnn.so.9 (0x00007f2d88d9e000) 2025-03-14T06:14:29.7266049Z libcusparseLt.so.0 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../cusparselt/lib/libcusparseLt.so.0 (0x00007f2d7a74a000) 2025-03-14T06:14:29.7267542Z libcufile.so.0 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cufile/lib/libcufile.so.0 (0x00007f2d7a472000) 2025-03-14T06:14:29.7268580Z libstdc++.so.6 => /usr/lib64/libstdc++.so.6 (0x00007f2d7a0dd000) 2025-03-14T06:14:29.7269222Z libgcc_s.so.1 => /usr/lib64/libgcc_s.so.1 (0x00007f2d79ec5000) 2025-03-14T06:14:29.7269817Z libc.so.6 => /usr/lib64/libc.so.6 (0x00007f2d79aef000) 2025-03-14T06:14:29.7270369Z /lib64/ld-linux-x86-64.so.2 (0x00007f2ddc717000) 2025-03-14T06:14:29.7270928Z librt.so.1 => /usr/lib64/librt.so.1 (0x00007f2d798e7000) 2025-03-14T06:14:29.7271501Z libm.so.6 => /usr/lib64/libm.so.6 (0x00007f2d79565000) 2025-03-14T06:14:29.7272458Z libgomp-c9fef706.so.1 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/libgomp-c9fef706.so.1 (0x00007f2d79328000) 2025-03-14T06:14:29.7273905Z libcupti.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cuda_cupti/lib/libcupti.so.12 (0x00007f2d78b34000) 2025-03-14T06:14:29.7275428Z libcusparse.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cusparse/lib/libcusparse.so.12 (0x00007f2d6712f000) 2025-03-14T06:14:29.7276924Z libcufft.so.11 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cufft/lib/libcufft.so.11 (0x00007f2d5612e000) 2025-03-14T06:14:29.7278385Z libcurand.so.10 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/curand/lib/libcurand.so.10 (0x00007f2d4fcf5000) 2025-03-14T06:14:29.7280017Z libcublas.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cublas/lib/libcublas.so.12 (0x00007f2d493ae000) 2025-03-14T06:14:29.7281696Z libcublasLt.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cublas/lib/libcublasLt.so.12 (0x00007f2d27b82000) 2025-03-14T06:14:29.7283318Z libnccl.so.2 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/nccl/lib/libnccl.so.2 (0x00007f2d18383000) 2025-03-14T06:14:29.7284455Z libutil.so.1 => /usr/lib64/libutil.so.1 (0x00007f2d1817f000) 2025-03-14T06:14:29.7285622Z libnvJitLink.so.12 => /opt/python/cp39-cp39/bin/../lib/python3.9/site-packages/torch/lib/../../nvidia/cusparse/lib/../../nvjitlink/lib/libnvJitLink.so.12 (0x00007f2d14ef6000) with runpath 2025-03-14T06:14:29.7286756Z +++ realpath /pytorch/.ci/pytorch/check_binary.sh 2025-03-14T06:14:29.7287259Z ++ dirname /pytorch/.ci/pytorch/check_binary.sh 2025-03-14T06:14:29.7287769Z + TEST_CODE_DIR=/pytorch/.ci/pytorch/test_example_code 2025-03-14T06:14:29.7288259Z + [[ manywheel == \l\i\b\t\o\r\c\h ]] 2025-03-14T06:14:29.7288639Z + pushd /tmp 2025-03-14T06:14:29.7288942Z /tmp / 2025-03-14T06:14:29.7289268Z + python -c 'import torch' 2025-03-14T06:14:32.0490572Z + popd 2025-03-14T06:14:32.0490921Z / 2025-03-14T06:14:32.0491238Z + [[ manywheel != \l\i\b\t\o\r\c\h ]] 2025-03-14T06:14:32.0491668Z + pushd /tmp 2025-03-14T06:14:32.0491977Z /tmp / 2025-03-14T06:14:32.0492449Z + python -c 'import torch; assert torch.version.git_version != "Unknown"' 2025-03-14T06:14:34.1518217Z + python -c 'import torch; assert torch.version.git_version != None' 2025-03-14T06:14:36.3013561Z + popd 2025-03-14T06:14:36.3013928Z / 2025-03-14T06:14:36.3014226Z + [[ manywheel == \l\i\b\t\o\r\c\h ]] 2025-03-14T06:14:36.3017840Z ++ uname -m 2025-03-14T06:14:36.3043735Z + [[ x86_64 != \a\r\m\6\4 ]] 2025-03-14T06:14:36.3047897Z ++ uname -m 2025-03-14T06:14:36.3075283Z + [[ x86_64 != \s\3\9\0\x ]] 2025-03-14T06:14:36.3078894Z ++ uname 2025-03-14T06:14:36.3101151Z + [[ Linux != \D\a\r\w\i\n ]] 2025-03-14T06:14:36.3105355Z ++ uname -m 2025-03-14T06:14:36.3128403Z + [[ x86_64 == \a\a\r\c\h\6\4 ]] 2025-03-14T06:14:36.3128821Z + echo 'Checking that MKL is available' 2025-03-14T06:14:36.3129293Z Checking that MKL is available 2025-03-14T06:14:36.3129677Z + pushd /tmp 2025-03-14T06:14:36.3129960Z /tmp / 2025-03-14T06:14:36.3130438Z + python -c 'import torch; exit(0 if torch.backends.mkl.is_available() else 1)' 2025-03-14T06:14:38.4210949Z + popd 2025-03-14T06:14:38.4211282Z / 2025-03-14T06:14:38.4211608Z + [[ manywheel == \l\i\b\t\o\r\c\h ]] 2025-03-14T06:14:38.4215300Z ++ uname 2025-03-14T06:14:38.4240965Z + [[ Linux != \D\a\r\w\i\n ]] 2025-03-14T06:14:38.4244549Z ++ uname -m 2025-03-14T06:14:38.4267081Z + [[ x86_64 != \s\3\9\0\x ]] 2025-03-14T06:14:38.4267490Z + echo 'Checking that XNNPACK is available' 2025-03-14T06:14:38.4267960Z Checking that XNNPACK is available 2025-03-14T06:14:38.4268359Z + pushd /tmp 2025-03-14T06:14:38.4268666Z /tmp / 2025-03-14T06:14:38.4269267Z + python -c 'import torch.backends.xnnpack; exit(0 if torch.backends.xnnpack.enabled else 1)' 2025-03-14T06:14:40.5229199Z + popd 2025-03-14T06:14:40.5229750Z / 2025-03-14T06:14:40.5230618Z + [[ linux-gnu == \m\s\y\s ]] 2025-03-14T06:14:40.5231124Z + [[ cu126 != \c\p\u ]] 2025-03-14T06:14:40.5231458Z + [[ cu126 != \x\p\u ]] 2025-03-14T06:14:40.5232077Z + [[ cu126 != \c\p\u\-\c\x\x\1\1\-\a\b\i ]] 2025-03-14T06:14:40.5235582Z + [[ cu126 != *\r\o\c\m* ]] 2025-03-14T06:14:40.5236159Z ++ uname -m 2025-03-14T06:14:40.5260911Z + [[ x86_64 != \s\3\9\0\x ]] 2025-03-14T06:14:40.5261316Z + [[ manywheel == \l\i\b\t\o\r\c\h ]] 2025-03-14T06:14:40.5261723Z + pushd /tmp 2025-03-14T06:14:40.5262036Z /tmp / 2025-03-14T06:14:40.5262415Z + echo 'Checking that CUDA archs are setup correctly' 2025-03-14T06:14:40.5262930Z Checking that CUDA archs are setup correctly 2025-03-14T06:14:40.5263461Z + timeout 20 python -c 'import torch; torch.randn([3,5]).cuda()' 2025-03-14T06:14:42.8291889Z + echo 'Checking that magma is available' 2025-03-14T06:14:42.8292436Z Checking that magma is available 2025-03-14T06:14:42.8293026Z + python -c 'import torch; torch.rand(1).cuda(); exit(0 if torch.cuda.has_magma else 1)' 2025-03-14T06:14:45.1116947Z + echo 'Checking that CuDNN is available' 2025-03-14T06:14:45.1117481Z Checking that CuDNN is available 2025-03-14T06:14:45.1118076Z + python -c 'import torch; exit(0 if torch.backends.cudnn.is_available() else 1)' 2025-03-14T06:14:47.2084379Z + echo 'Checking that exception handling works' 2025-03-14T06:14:47.2084927Z Checking that exception handling works 2025-03-14T06:14:47.2085817Z + python -c 'import torch; from unittest import TestCase;TestCase().assertRaises(RuntimeError, lambda:torch.eye(7, 7, device='\''cuda:7'\''))' 2025-03-14T06:14:49.3677448Z + echo 'Checking that basic RNN works' 2025-03-14T06:14:49.3677951Z Checking that basic RNN works 2025-03-14T06:14:49.3678435Z + python /pytorch/.ci/pytorch/test_example_code/rnn_smoke.py 2025-03-14T06:14:51.7589230Z + echo 'Checking that basic CNN works' 2025-03-14T06:14:51.7589776Z Checking that basic CNN works 2025-03-14T06:14:51.7590274Z + python /pytorch/.ci/pytorch/test_example_code/cnn_smoke.py 2025-03-14T06:14:53.9721812Z tensor([0.], device='cuda:0', grad_fn=) 2025-03-14T06:14:55.8175265Z + echo 'Test that linalg works' 2025-03-14T06:14:55.8175739Z Test that linalg works 2025-03-14T06:14:55.8176393Z + python -c 'import torch;x=torch.rand(3,3,device='\''cuda'\'');print(torch.linalg.svd(torch.mm(x.t(), x)))' 2025-03-14T06:14:58.0162550Z torch.return_types.linalg_svd( 2025-03-14T06:14:58.0163032Z U=tensor([[ 0.4557, 0.8299, 0.3217], 2025-03-14T06:14:58.0163465Z [ 0.5390, -0.5449, 0.6423], 2025-03-14T06:14:58.0163877Z [ 0.7084, -0.1193, -0.6957]], device='cuda:0'), 2025-03-14T06:14:58.0164371Z S=tensor([2.8713, 0.4177, 0.0419], device='cuda:0'), 2025-03-14T06:14:58.0164835Z Vh=tensor([[ 0.4557, 0.5390, 0.7084], 2025-03-14T06:14:58.0165241Z [ 0.8299, -0.5449, -0.1193], 2025-03-14T06:14:58.0166192Z [ 0.3217, 0.6423, -0.6957]], device='cuda:0')) 2025-03-14T06:14:58.3100098Z + popd 2025-03-14T06:14:58.3100550Z / 2025-03-14T06:14:58.3100880Z + [[ manywheel != \l\i\b\t\o\r\c\h ]] 2025-03-14T06:14:58.3105394Z ++ dirname /pytorch/.ci/pytorch/check_binary.sh 2025-03-14T06:14:58.3131010Z + pushd /pytorch/.ci/pytorch/smoke_test 2025-03-14T06:14:58.3131469Z /pytorch/.ci/pytorch/smoke_test / 2025-03-14T06:14:58.3132069Z + python -c 'from smoke_test import test_linalg; test_linalg()' 2025-03-14T06:15:01.4647631Z Testing smoke_test_linalg on cpu 2025-03-14T06:15:01.8550865Z + [[ cu126 == *cuda* ]] 2025-03-14T06:15:01.8552086Z + popd 2025-03-14T06:15:01.8572721Z / 2025-03-14T06:15:01.8573182Z ++ uname 2025-03-14T06:15:01.8580525Z + [[ Linux == \L\i\n\u\x ]] 2025-03-14T06:15:01.8581190Z + [[ manywheel != \l\i\b\t\o\r\c\h ]] 2025-03-14T06:15:01.8581662Z + GLOO_CHECK='import torch.distributed as dist 2025-03-14T06:15:01.8582100Z try: 2025-03-14T06:15:01.8582476Z dist.init_process_group('\''gloo'\'', rank=0, world_size=1) 2025-03-14T06:15:01.8583025Z except RuntimeError as e: 2025-03-14T06:15:01.8583585Z print(e) 2025-03-14T06:15:01.8583923Z ' 2025-03-14T06:15:01.8584424Z ++ GLOO_DEVICE_TRANSPORT=TCP_TLS 2025-03-14T06:15:01.8584829Z ++ MASTER_ADDR=localhost 2025-03-14T06:15:01.8585281Z ++ MASTER_PORT=63945 2025-03-14T06:15:01.8585818Z ++ python -c 'import torch.distributed as dist 2025-03-14T06:15:01.8586258Z try: 2025-03-14T06:15:01.8586663Z dist.init_process_group('\''gloo'\'', rank=0, world_size=1) 2025-03-14T06:15:01.8587154Z except RuntimeError as e: 2025-03-14T06:15:01.8587511Z print(e) 2025-03-14T06:15:01.8587809Z ' 2025-03-14T06:15:03.9922403Z + RESULT='[enforce fail at /pytorch/third_party/gloo/gloo/transport/tcp/tls/context.cc:50] pkey != nullptr && cert != nullptr. Private key and certificate location must be specified' 2025-03-14T06:15:03.9923617Z + GLOO_TRANSPORT_IS_NOT_SUPPORTED='gloo transport is not supported' 2025-03-14T06:15:03.9924946Z + [[ [enforce fail at /pytorch/third_party/gloo/gloo/transport/tcp/tls/context.cc:50] pkey != nullptr && cert != nullptr. Private key and certificate location must be specified =~ gloo transport is not supported ]] 2025-03-14T06:15:03.9927240Z ++ uname 2025-03-14T06:15:03.9952804Z + [[ Linux == \L\i\n\u\x ]] 2025-03-14T06:15:03.9953281Z + [[ manywheel == \m\a\n\y\w\h\e\e\l ]] 2025-03-14T06:15:03.9953674Z + pushd /tmp 2025-03-14T06:15:03.9953980Z /tmp / 2025-03-14T06:15:03.9954687Z + python -c 'import torch; exit(0 if torch.compiled_with_cxx11_abi() else (0 if torch._C._PYBIND11_BUILD_ABI == '\''_cxxabi1011'\'' else 1))' 2025-03-14T06:15:06.0953221Z + popd 2025-03-14T06:15:06.0953777Z / 2025-03-14T06:15:06.0955598Z + [[ cuda != *s390x* ]] 2025-03-14T06:15:06.0955986Z + [[ cuda != *xpu* ]] 2025-03-14T06:15:06.0956334Z + [[ cuda != *rocm* ]] 2025-03-14T06:15:06.0956675Z + [[ manywheel != libtorch ]] 2025-03-14T06:15:06.0957386Z + python /pytorch/.ci/pytorch/smoke_test/smoke_test.py --package=torchonly --torch-compile-check disabled 2025-03-14T06:15:09.2538672Z torch: 2.8.0.dev20250314+cu126 2025-03-14T06:15:09.2539194Z ATen/Parallel: 2025-03-14T06:15:09.2539581Z at::get_num_threads() : 8 2025-03-14T06:15:09.2539988Z at::get_num_interop_threads() : 8 2025-03-14T06:15:09.2540417Z OpenMP 201511 (a.k.a. OpenMP 4.5) 2025-03-14T06:15:09.2540827Z omp_get_max_threads() : 8 2025-03-14T06:15:09.2541536Z Intel(R) oneAPI Math Kernel Library Version 2024.2-Product Build 20240605 for Intel(R) 64 architecture applications 2025-03-14T06:15:09.2542283Z mkl_get_max_threads() : 8 2025-03-14T06:15:09.2542796Z Intel(R) MKL-DNN v3.7.1 (Git Hash 8d263e693366ef8db40acc569cc7d8edf644556d) 2025-03-14T06:15:09.2543362Z std::thread::hardware_concurrency() : 16 2025-03-14T06:15:09.2543846Z Environment variables: 2025-03-14T06:15:09.2544211Z OMP_NUM_THREADS : [not set] 2025-03-14T06:15:09.2544594Z MKL_NUM_THREADS : [not set] 2025-03-14T06:15:09.2544984Z ATen parallel backend: OpenMP 2025-03-14T06:15:09.2545236Z 2025-03-14T06:15:09.2545481Z Skip version check for channel None as stable version is None 2025-03-14T06:15:09.2546303Z Testing smoke_test_conv2d 2025-03-14T06:15:09.2793601Z Testing smoke_test_linalg on cpu 2025-03-14T06:15:09.2944321Z torch cuda: 12.6 2025-03-14T06:15:09.2955518Z torch cudnn: 90501 2025-03-14T06:15:09.2956259Z cuDNN enabled? True 2025-03-14T06:15:09.3122290Z CUDA initialized successfully 2025-03-14T06:15:09.3123134Z Number of CUDA devices: 1 2025-03-14T06:15:09.3123812Z Device 0: Tesla M60 2025-03-14T06:15:09.3124162Z torch nccl version: (2, 25, 1) 2025-03-14T06:15:09.3124584Z Testing test_cuda_runtime_errors_captured 2025-03-14T06:15:09.4624879Z /pytorch/aten/src/ATen/native/cuda/TensorCompare.cu:112: _assert_async_cuda_kernel: block: [0,0,0], thread: [0,0,0] Assertion `` failed. 2025-03-14T06:15:09.4629174Z Caught CUDA exception with success: CUDA error: device-side assert triggered 2025-03-14T06:15:09.4630565Z CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. 2025-03-14T06:15:09.4631431Z For debugging consider passing CUDA_LAUNCH_BLOCKING=1 2025-03-14T06:15:09.4632030Z Compile with `TORCH_USE_CUDA_DSA` to enable device-side assertions. 2025-03-14T06:15:09.4632440Z 2025-03-14T06:15:09.8622264Z + cd /pytorch/.ci/pytorch/ 2025-03-14T06:15:09.8623068Z + git clean -ffdx 2025-03-14T06:15:09.8696583Z Removing smoke_test/__pycache__/ 2025-03-14T06:15:09.8803292Z ##[group]Run pytorch/test-infra/.github/actions/teardown-linux@main 2025-03-14T06:15:09.8803894Z with: 2025-03-14T06:15:09.8804196Z env: 2025-03-14T06:15:09.8804508Z PYTORCH_ROOT: /pytorch 2025-03-14T06:15:09.8804866Z PACKAGE_TYPE: manywheel 2025-03-14T06:15:09.8805231Z DESIRED_CUDA: cu126 2025-03-14T06:15:09.8805584Z GPU_ARCH_VERSION: 12.6 2025-03-14T06:15:09.8805942Z GPU_ARCH_TYPE: cuda 2025-03-14T06:15:09.8806379Z DOCKER_IMAGE: pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:15:09.8806860Z SKIP_ALL_TESTS: 1 2025-03-14T06:15:09.8807186Z LIBTORCH_CONFIG: 2025-03-14T06:15:09.8807520Z LIBTORCH_VARIANT: 2025-03-14T06:15:09.8807880Z DESIRED_DEVTOOLSET: cxx11-abi 2025-03-14T06:15:09.8808266Z DESIRED_PYTHON: 3.9 2025-03-14T06:15:09.8808750Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2025-03-14T06:15:09.8809539Z AWS_DEFAULT_REGION: us-east-1 2025-03-14T06:15:09.8809926Z BINARY_ENV_FILE: /tmp/env 2025-03-14T06:15:09.8810384Z BUILD_ENVIRONMENT: linux-binary-manywheel 2025-03-14T06:15:09.8810981Z GITHUB_TOKEN: *** 2025-03-14T06:15:09.8811316Z PR_NUMBER: 2025-03-14T06:15:09.8811655Z PYTORCH_FINAL_PACKAGE_DIR: /artifacts 2025-03-14T06:15:09.8812111Z SHA1: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:15:09.8812550Z USE_SPLIT_BUILD: false 2025-03-14T06:15:09.8812995Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2025-03-14T06:15:09.8813664Z CONTAINER_NAME: cd74cffec1e3b460f4ae001d11df352321480394e396aaf3d7a17cd5a80cfa8b 2025-03-14T06:15:09.8814273Z ##[endgroup] 2025-03-14T06:15:09.8844306Z ##[group]Run set -eou pipefail 2025-03-14T06:15:09.8844736Z set -eou pipefail 2025-03-14T06:15:09.8845102Z  2025-03-14T06:15:09.8845586Z echo "Holding runner for 2 hours until all ssh sessions have logged out" 2025-03-14T06:15:09.8846261Z for _ in $(seq 1440); do 2025-03-14T06:15:09.8846700Z  # Break if no ssh session exists anymore 2025-03-14T06:15:09.8847173Z  if [ "$(who)" = "" ]; then 2025-03-14T06:15:09.8847574Z  break 2025-03-14T06:15:09.8847899Z  fi 2025-03-14T06:15:09.8848199Z  echo "." 2025-03-14T06:15:09.8848538Z  sleep 5 2025-03-14T06:15:09.8848864Z done 2025-03-14T06:15:09.8858907Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T06:15:09.8859402Z env: 2025-03-14T06:15:09.8859695Z PYTORCH_ROOT: /pytorch 2025-03-14T06:15:09.8860066Z PACKAGE_TYPE: manywheel 2025-03-14T06:15:09.8860432Z DESIRED_CUDA: cu126 2025-03-14T06:15:09.8860775Z GPU_ARCH_VERSION: 12.6 2025-03-14T06:15:09.8861134Z GPU_ARCH_TYPE: cuda 2025-03-14T06:15:09.8861559Z DOCKER_IMAGE: pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:15:09.8862052Z SKIP_ALL_TESTS: 1 2025-03-14T06:15:09.8862383Z LIBTORCH_CONFIG: 2025-03-14T06:15:09.8862730Z LIBTORCH_VARIANT: 2025-03-14T06:15:09.8863091Z DESIRED_DEVTOOLSET: cxx11-abi 2025-03-14T06:15:09.8863467Z DESIRED_PYTHON: 3.9 2025-03-14T06:15:09.8863972Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2025-03-14T06:15:09.8864543Z AWS_DEFAULT_REGION: us-east-1 2025-03-14T06:15:09.8864935Z BINARY_ENV_FILE: /tmp/env 2025-03-14T06:15:09.8865348Z BUILD_ENVIRONMENT: linux-binary-manywheel 2025-03-14T06:15:09.8865936Z GITHUB_TOKEN: *** 2025-03-14T06:15:09.8866255Z PR_NUMBER: 2025-03-14T06:15:09.8866603Z PYTORCH_FINAL_PACKAGE_DIR: /artifacts 2025-03-14T06:15:09.8867060Z SHA1: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:15:09.8867514Z USE_SPLIT_BUILD: false 2025-03-14T06:15:09.8867947Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2025-03-14T06:15:09.8868618Z CONTAINER_NAME: cd74cffec1e3b460f4ae001d11df352321480394e396aaf3d7a17cd5a80cfa8b 2025-03-14T06:15:09.8869237Z ##[endgroup] 2025-03-14T06:15:09.8900853Z Holding runner for 2 hours until all ssh sessions have logged out 2025-03-14T06:15:09.8963972Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2025-03-14T06:15:09.8964685Z # ignore expansion of "docker ps -q" since it could be empty 2025-03-14T06:15:09.8965236Z # shellcheck disable=SC2046 2025-03-14T06:15:09.8965681Z docker stop $(docker ps -q) || true 2025-03-14T06:15:09.8966139Z # Prune all of the docker images 2025-03-14T06:15:09.8966577Z docker system prune -af 2025-03-14T06:15:09.8972996Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T06:15:09.8973473Z env: 2025-03-14T06:15:09.8973784Z PYTORCH_ROOT: /pytorch 2025-03-14T06:15:09.8974160Z PACKAGE_TYPE: manywheel 2025-03-14T06:15:09.8974524Z DESIRED_CUDA: cu126 2025-03-14T06:15:09.8974869Z GPU_ARCH_VERSION: 12.6 2025-03-14T06:15:09.8975210Z GPU_ARCH_TYPE: cuda 2025-03-14T06:15:09.8975643Z DOCKER_IMAGE: pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:15:09.8976340Z SKIP_ALL_TESTS: 1 2025-03-14T06:15:09.8976683Z LIBTORCH_CONFIG: 2025-03-14T06:15:09.8977016Z LIBTORCH_VARIANT: 2025-03-14T06:15:09.8977381Z DESIRED_DEVTOOLSET: cxx11-abi 2025-03-14T06:15:09.8977768Z DESIRED_PYTHON: 3.9 2025-03-14T06:15:09.8978264Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2025-03-14T06:15:09.8978817Z AWS_DEFAULT_REGION: us-east-1 2025-03-14T06:15:09.8979206Z BINARY_ENV_FILE: /tmp/env 2025-03-14T06:15:09.8979619Z BUILD_ENVIRONMENT: linux-binary-manywheel 2025-03-14T06:15:09.8980212Z GITHUB_TOKEN: *** 2025-03-14T06:15:09.8980543Z PR_NUMBER: 2025-03-14T06:15:09.8980869Z PYTORCH_FINAL_PACKAGE_DIR: /artifacts 2025-03-14T06:15:09.8981330Z SHA1: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:15:09.8981779Z USE_SPLIT_BUILD: false 2025-03-14T06:15:09.8982215Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2025-03-14T06:15:09.8982908Z CONTAINER_NAME: cd74cffec1e3b460f4ae001d11df352321480394e396aaf3d7a17cd5a80cfa8b 2025-03-14T06:15:09.8983534Z ##[endgroup] 2025-03-14T06:15:10.6229272Z cd74cffec1e3 2025-03-14T06:15:11.8099350Z Deleted Containers: 2025-03-14T06:15:11.8100264Z cd74cffec1e3b460f4ae001d11df352321480394e396aaf3d7a17cd5a80cfa8b 2025-03-14T06:15:11.8100699Z 2025-03-14T06:15:14.9375052Z Deleted Images: 2025-03-14T06:15:14.9375684Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine:latest 2025-03-14T06:15:14.9376821Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine@sha256:def822f9851ca422481ec6fee59a9966f12b351c62ccb9aca841526ffaa9f748 2025-03-14T06:15:14.9378399Z deleted: sha256:6dbb9cc54074106d46d4ccb330f2a40a682d49dda5f4844962b7dce9fe44aaec 2025-03-14T06:15:14.9379187Z deleted: sha256:b2d5eeeaba3a22b9b8aa97261957974a6bd65274ebd43e1d81d0a7b8b752b116 2025-03-14T06:15:14.9379876Z untagged: pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:15:14.9380719Z untagged: pytorch/manylinux2_28-builder@sha256:a134eadfac474e38a584e947aebf13114539e6d147bbf6afcd140720820fb6d2 2025-03-14T06:15:14.9381710Z deleted: sha256:270beaf65d47c84567992c0cde754423115c8162d1991fbeab609d0b66f8eb06 2025-03-14T06:15:14.9382506Z deleted: sha256:1e439e9661831850500b849d1d59d4edba9e861b6e0befc0d6f4744a5bd8822e 2025-03-14T06:15:14.9383297Z deleted: sha256:447add1b8e134c8f93a3a70827c7bfb5fa2ff59c7790c00b2f4e4a49a6dcd33b 2025-03-14T06:15:14.9384102Z deleted: sha256:8abf6df7c37c5cffc73ce12d49fff200159d6c81ada51aed7ae87dd89284de5c 2025-03-14T06:15:14.9384910Z deleted: sha256:0ef2cbc93ee451a250324125155a7febf6384a018f2746c9ca777d74c6036767 2025-03-14T06:15:14.9385699Z deleted: sha256:e018fc2b2f7062b16e9cf9dc665ca07d5785abb6654cda74fde7f4593143c276 2025-03-14T06:15:14.9386492Z deleted: sha256:ff46ce499e6640d74165ad746f4aa86577bbefcce7f7f4576caf31f0cc7f145d 2025-03-14T06:15:14.9387282Z deleted: sha256:d390e424d05871b114bdf6290c2ddc5f17882cb17565ae5d4be7556937ce72e9 2025-03-14T06:15:14.9388070Z deleted: sha256:e8ff7ebc09ebea73be63a23920a4ba0cb721049821e641ae809ab88391d9baee 2025-03-14T06:15:14.9388857Z deleted: sha256:ac64dc009e3357d67669eaac88859798b4b88b8ad9cf2fa465c33c2412c324ab 2025-03-14T06:15:14.9389964Z deleted: sha256:746937e759f8b630e1a802977aab12f6af5033440fe79c3027c2e442374c9109 2025-03-14T06:15:14.9390797Z deleted: sha256:fb38567143f1a926b9f02710a8acc499145f79e9c91a2edd746a049c91950e87 2025-03-14T06:15:14.9391585Z deleted: sha256:684d84a554583f3816c3fc2cabdfc4740e14ae428edd8adeb8cde69bd5540dad 2025-03-14T06:15:14.9392393Z deleted: sha256:1aa6e6867bd391ced66bbccfc2b50c997b5e9396561e10b3a6ec49053f0d3c7f 2025-03-14T06:15:14.9393192Z deleted: sha256:47581d4f5390576d5d09c71a51ffe8f5641b9dd360ec3f98ceaa8a4fb6ae48d9 2025-03-14T06:15:14.9393954Z deleted: sha256:8637b8127f574c569f87a6feda17d3b015e8c961feb479c8106b0ceff258023d 2025-03-14T06:15:14.9394739Z deleted: sha256:dfb120b695653c4679c7b30e7c9dd0827033b3f75c28512fe3c06de1b70c8304 2025-03-14T06:15:14.9395553Z deleted: sha256:518267d2b7dff5c85f4b8c36bfe17d694380b22e8c8a3d5ecbb7219ca9f9d596 2025-03-14T06:15:14.9396364Z deleted: sha256:cbdde099e2de73e34ad9af7fde9ae214f6a961cf54a484cf91e2cf3a24bdfa38 2025-03-14T06:15:14.9397364Z deleted: sha256:ed1754340e13ab45e2e6834fc6100b920084fbc528adde2956db3a2be5725a05 2025-03-14T06:15:14.9398157Z deleted: sha256:60435e31a512140eaf15ebdd4080fadf86baf6801b8d3ccadd5104350fd51f15 2025-03-14T06:15:14.9398934Z deleted: sha256:b677f9b5efd13e812c23d1fa9157fef8f83ee20e08a97ece84813832849ef159 2025-03-14T06:15:14.9399736Z deleted: sha256:6a025c24fc8c4ea2c8a8b3c1ea353a3a92abd3460f3db1fc2bd25217a0c0bea2 2025-03-14T06:15:14.9400530Z deleted: sha256:26a9335d111f1f13f447a6742e39e086c8cd9ee730f15307cd32e8e888b36996 2025-03-14T06:15:14.9401301Z deleted: sha256:824945696e32b4b156ee75e1b4336c0a7308f8b1c8843245a50f43e9681cd0b8 2025-03-14T06:15:14.9402086Z deleted: sha256:aebb14f5e43c42c9b143334c64ee263b3b8ee8d65e756df07f03c3b1689880ae 2025-03-14T06:15:14.9402889Z deleted: sha256:d921c9e1df15ca1a1d37cc506dcd7e75e5f6d8c7464c35c4df6a05cc036150f3 2025-03-14T06:15:14.9403682Z deleted: sha256:e6fe909005e5a0dd901a940465407ffd2c6bbfe6fecced655b5dcd6133daa4a4 2025-03-14T06:15:14.9404488Z deleted: sha256:75d2f730541644ed380f2f7ec9afb377c1f4863003fafce00ebf93b9c7342210 2025-03-14T06:15:14.9404975Z 2025-03-14T06:15:14.9405140Z Total reclaimed space: 19.25GB 2025-03-14T06:15:14.9443162Z Prepare all required actions 2025-03-14T06:15:14.9472347Z ##[group]Run ./pytorch/.github/actions/chown-workspace 2025-03-14T06:15:14.9472849Z with: 2025-03-14T06:15:14.9473342Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2025-03-14T06:15:14.9473905Z env: 2025-03-14T06:15:14.9474222Z PYTORCH_ROOT: /pytorch 2025-03-14T06:15:14.9474623Z PACKAGE_TYPE: manywheel 2025-03-14T06:15:14.9475011Z DESIRED_CUDA: cu126 2025-03-14T06:15:14.9475363Z GPU_ARCH_VERSION: 12.6 2025-03-14T06:15:14.9475748Z GPU_ARCH_TYPE: cuda 2025-03-14T06:15:14.9476221Z DOCKER_IMAGE: pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:15:14.9476746Z SKIP_ALL_TESTS: 1 2025-03-14T06:15:14.9477095Z LIBTORCH_CONFIG: 2025-03-14T06:15:14.9477429Z LIBTORCH_VARIANT: 2025-03-14T06:15:14.9477821Z DESIRED_DEVTOOLSET: cxx11-abi 2025-03-14T06:15:14.9478233Z DESIRED_PYTHON: 3.9 2025-03-14T06:15:14.9478812Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2025-03-14T06:15:14.9479416Z AWS_DEFAULT_REGION: us-east-1 2025-03-14T06:15:14.9479831Z BINARY_ENV_FILE: /tmp/env 2025-03-14T06:15:14.9480265Z BUILD_ENVIRONMENT: linux-binary-manywheel 2025-03-14T06:15:14.9480913Z GITHUB_TOKEN: *** 2025-03-14T06:15:14.9481258Z PR_NUMBER: 2025-03-14T06:15:14.9481624Z PYTORCH_FINAL_PACKAGE_DIR: /artifacts 2025-03-14T06:15:14.9482100Z SHA1: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:15:14.9482578Z USE_SPLIT_BUILD: false 2025-03-14T06:15:14.9483051Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2025-03-14T06:15:14.9483803Z CONTAINER_NAME: cd74cffec1e3b460f4ae001d11df352321480394e396aaf3d7a17cd5a80cfa8b 2025-03-14T06:15:14.9484459Z ##[endgroup] 2025-03-14T06:15:14.9510094Z ##[group]Run docker run --rm -v "$(pwd)":/v -w /v "${ALPINE_IMAGE}" chown -R "$(id -u):$(id -g)" . 2025-03-14T06:15:14.9510891Z docker run --rm -v "$(pwd)":/v -w /v "${ALPINE_IMAGE}" chown -R "$(id -u):$(id -g)" . 2025-03-14T06:15:14.9518750Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T06:15:14.9519250Z env: 2025-03-14T06:15:14.9519566Z PYTORCH_ROOT: /pytorch 2025-03-14T06:15:14.9519945Z PACKAGE_TYPE: manywheel 2025-03-14T06:15:14.9520314Z DESIRED_CUDA: cu126 2025-03-14T06:15:14.9520646Z GPU_ARCH_VERSION: 12.6 2025-03-14T06:15:14.9521007Z GPU_ARCH_TYPE: cuda 2025-03-14T06:15:14.9521445Z DOCKER_IMAGE: pytorch/manylinux2_28-builder:cuda12.6-main 2025-03-14T06:15:14.9521936Z SKIP_ALL_TESTS: 1 2025-03-14T06:15:14.9522269Z LIBTORCH_CONFIG: 2025-03-14T06:15:14.9522583Z LIBTORCH_VARIANT: 2025-03-14T06:15:14.9522939Z DESIRED_DEVTOOLSET: cxx11-abi 2025-03-14T06:15:14.9523332Z DESIRED_PYTHON: 3.9 2025-03-14T06:15:14.9523831Z ALPINE_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine 2025-03-14T06:15:14.9524604Z AWS_DEFAULT_REGION: us-east-1 2025-03-14T06:15:14.9524980Z BINARY_ENV_FILE: /tmp/env 2025-03-14T06:15:14.9525389Z BUILD_ENVIRONMENT: linux-binary-manywheel 2025-03-14T06:15:14.9525989Z GITHUB_TOKEN: *** 2025-03-14T06:15:14.9526848Z PR_NUMBER: 2025-03-14T06:15:14.9527198Z PYTORCH_FINAL_PACKAGE_DIR: /artifacts 2025-03-14T06:15:14.9527659Z SHA1: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:15:14.9528086Z USE_SPLIT_BUILD: false 2025-03-14T06:15:14.9528523Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2025-03-14T06:15:14.9529213Z CONTAINER_NAME: cd74cffec1e3b460f4ae001d11df352321480394e396aaf3d7a17cd5a80cfa8b 2025-03-14T06:15:14.9529827Z ##[endgroup] 2025-03-14T06:15:14.9745869Z Unable to find image '308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine:latest' locally 2025-03-14T06:15:15.3332861Z latest: Pulling from tool/alpine 2025-03-14T06:15:15.3333714Z 540db60ca938: Pulling fs layer 2025-03-14T06:15:15.4487009Z 540db60ca938: Verifying Checksum 2025-03-14T06:15:15.4487486Z 540db60ca938: Download complete 2025-03-14T06:15:15.5663742Z 540db60ca938: Pull complete 2025-03-14T06:15:15.5765368Z Digest: sha256:def822f9851ca422481ec6fee59a9966f12b351c62ccb9aca841526ffaa9f748 2025-03-14T06:15:15.5814536Z Status: Downloaded newer image for 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine:latest 2025-03-14T06:15:17.6618111Z Post job cleanup. 2025-03-14T06:15:17.7932434Z [command]/usr/bin/git version 2025-03-14T06:15:17.7983966Z git version 2.47.1 2025-03-14T06:15:17.8040895Z Copying '/home/ec2-user/.gitconfig' to '/home/ec2-user/actions-runner/_work/_temp/7dcfbb53-da82-467b-824e-b8b31f7783cb/.gitconfig' 2025-03-14T06:15:17.8054344Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/7dcfbb53-da82-467b-824e-b8b31f7783cb' before making global git config changes 2025-03-14T06:15:17.8055500Z Adding repository directory to the temporary git global config as a safe directory 2025-03-14T06:15:17.8061940Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch 2025-03-14T06:15:17.8108990Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2025-03-14T06:15:17.8155390Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2025-03-14T06:15:17.8502823Z Entering 'android/libs/fbjni' 2025-03-14T06:15:17.8568298Z Entering 'third_party/FP16' 2025-03-14T06:15:17.8634618Z Entering 'third_party/FXdiv' 2025-03-14T06:15:17.8698114Z Entering 'third_party/NNPACK' 2025-03-14T06:15:17.8763337Z Entering 'third_party/NVTX' 2025-03-14T06:15:17.8828461Z Entering 'third_party/VulkanMemoryAllocator' 2025-03-14T06:15:17.8892024Z Entering 'third_party/XNNPACK' 2025-03-14T06:15:17.8975022Z Entering 'third_party/benchmark' 2025-03-14T06:15:17.9039739Z Entering 'third_party/composable_kernel' 2025-03-14T06:15:17.9110914Z Entering 'third_party/cpp-httplib' 2025-03-14T06:15:17.9175738Z Entering 'third_party/cpuinfo' 2025-03-14T06:15:17.9240032Z Entering 'third_party/cudnn_frontend' 2025-03-14T06:15:17.9304042Z Entering 'third_party/cutlass' 2025-03-14T06:15:17.9377147Z Entering 'third_party/eigen' 2025-03-14T06:15:17.9444497Z Entering 'third_party/fbgemm' 2025-03-14T06:15:17.9507590Z Entering 'third_party/fbgemm/third_party/asmjit' 2025-03-14T06:15:17.9571674Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2025-03-14T06:15:17.9637100Z Entering 'third_party/fbgemm/third_party/cutlass' 2025-03-14T06:15:17.9707435Z Entering 'third_party/fbgemm/third_party/googletest' 2025-03-14T06:15:17.9771392Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2025-03-14T06:15:17.9837103Z Entering 'third_party/flash-attention' 2025-03-14T06:15:17.9900619Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-03-14T06:15:17.9971193Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-03-14T06:15:18.0045866Z Entering 'third_party/flatbuffers' 2025-03-14T06:15:18.0112261Z Entering 'third_party/fmt' 2025-03-14T06:15:18.0176341Z Entering 'third_party/gemmlowp/gemmlowp' 2025-03-14T06:15:18.0240676Z Entering 'third_party/gloo' 2025-03-14T06:15:18.0303962Z Entering 'third_party/googletest' 2025-03-14T06:15:18.0368613Z Entering 'third_party/ideep' 2025-03-14T06:15:18.0431846Z Entering 'third_party/ideep/mkl-dnn' 2025-03-14T06:15:18.0502360Z Entering 'third_party/ittapi' 2025-03-14T06:15:18.0566238Z Entering 'third_party/kineto' 2025-03-14T06:15:18.0631519Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-03-14T06:15:18.0693658Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-03-14T06:15:18.0759992Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-03-14T06:15:18.0823722Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-03-14T06:15:18.0888152Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-03-14T06:15:18.0951185Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-03-14T06:15:18.1016167Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-03-14T06:15:18.1080031Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-03-14T06:15:18.1144710Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-03-14T06:15:18.1208365Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-03-14T06:15:18.1274878Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-03-14T06:15:18.1338516Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-03-14T06:15:18.1403688Z Entering 'third_party/kleidiai' 2025-03-14T06:15:18.1468592Z Entering 'third_party/mimalloc' 2025-03-14T06:15:18.1532957Z Entering 'third_party/nlohmann' 2025-03-14T06:15:18.1598215Z Entering 'third_party/onnx' 2025-03-14T06:15:18.1681694Z Entering 'third_party/onnx/third_party/pybind11' 2025-03-14T06:15:18.1748333Z Entering 'third_party/opentelemetry-cpp' 2025-03-14T06:15:18.1813604Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-03-14T06:15:18.1938498Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-03-14T06:15:18.1942483Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-03-14T06:15:18.2006645Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-03-14T06:15:18.2072253Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-03-14T06:15:18.2136670Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-03-14T06:15:18.2200281Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-03-14T06:15:18.2263762Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-03-14T06:15:18.2330404Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-03-14T06:15:18.2395481Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-03-14T06:15:18.2481183Z Entering 'third_party/pocketfft' 2025-03-14T06:15:18.2545215Z Entering 'third_party/protobuf' 2025-03-14T06:15:18.2612717Z Entering 'third_party/protobuf/third_party/benchmark' 2025-03-14T06:15:18.2677097Z Entering 'third_party/protobuf/third_party/googletest' 2025-03-14T06:15:18.2743127Z Entering 'third_party/psimd' 2025-03-14T06:15:18.2806615Z Entering 'third_party/pthreadpool' 2025-03-14T06:15:18.2871512Z Entering 'third_party/pybind11' 2025-03-14T06:15:18.2936649Z Entering 'third_party/python-peachpy' 2025-03-14T06:15:18.3000157Z Entering 'third_party/sleef' 2025-03-14T06:15:18.3065926Z Entering 'third_party/tensorpipe' 2025-03-14T06:15:18.3130221Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-03-14T06:15:18.3192886Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-03-14T06:15:18.3256645Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-03-14T06:15:18.3319180Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-03-14T06:15:18.3381729Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-03-14T06:15:18.3469384Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2025-03-14T06:15:18.3491881Z http.https://github.com/.extraheader 2025-03-14T06:15:18.3505198Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader 2025-03-14T06:15:18.3541153Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2025-03-14T06:15:18.3878557Z Entering 'android/libs/fbjni' 2025-03-14T06:15:18.3922057Z http.https://github.com/.extraheader 2025-03-14T06:15:18.3961999Z Entering 'third_party/FP16' 2025-03-14T06:15:18.4005929Z http.https://github.com/.extraheader 2025-03-14T06:15:18.4045231Z Entering 'third_party/FXdiv' 2025-03-14T06:15:18.4088496Z http.https://github.com/.extraheader 2025-03-14T06:15:18.4127092Z Entering 'third_party/NNPACK' 2025-03-14T06:15:18.4170435Z http.https://github.com/.extraheader 2025-03-14T06:15:18.4208907Z Entering 'third_party/NVTX' 2025-03-14T06:15:18.4253327Z http.https://github.com/.extraheader 2025-03-14T06:15:18.4293047Z Entering 'third_party/VulkanMemoryAllocator' 2025-03-14T06:15:18.4337397Z http.https://github.com/.extraheader 2025-03-14T06:15:18.4375503Z Entering 'third_party/XNNPACK' 2025-03-14T06:15:18.4419788Z http.https://github.com/.extraheader 2025-03-14T06:15:18.4476610Z Entering 'third_party/benchmark' 2025-03-14T06:15:18.4519514Z http.https://github.com/.extraheader 2025-03-14T06:15:18.4559248Z Entering 'third_party/composable_kernel' 2025-03-14T06:15:18.4603081Z http.https://github.com/.extraheader 2025-03-14T06:15:18.4649857Z Entering 'third_party/cpp-httplib' 2025-03-14T06:15:18.4693183Z http.https://github.com/.extraheader 2025-03-14T06:15:18.4732900Z Entering 'third_party/cpuinfo' 2025-03-14T06:15:18.4775768Z http.https://github.com/.extraheader 2025-03-14T06:15:18.4815757Z Entering 'third_party/cudnn_frontend' 2025-03-14T06:15:18.4860062Z http.https://github.com/.extraheader 2025-03-14T06:15:18.4899490Z Entering 'third_party/cutlass' 2025-03-14T06:15:18.4944029Z http.https://github.com/.extraheader 2025-03-14T06:15:18.4990880Z Entering 'third_party/eigen' 2025-03-14T06:15:18.5035837Z http.https://github.com/.extraheader 2025-03-14T06:15:18.5077778Z Entering 'third_party/fbgemm' 2025-03-14T06:15:18.5120475Z http.https://github.com/.extraheader 2025-03-14T06:15:18.5160360Z Entering 'third_party/fbgemm/third_party/asmjit' 2025-03-14T06:15:18.5202600Z http.https://github.com/.extraheader 2025-03-14T06:15:18.5241490Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2025-03-14T06:15:18.5283683Z http.https://github.com/.extraheader 2025-03-14T06:15:18.5322381Z Entering 'third_party/fbgemm/third_party/cutlass' 2025-03-14T06:15:18.5366132Z http.https://github.com/.extraheader 2025-03-14T06:15:18.5412412Z Entering 'third_party/fbgemm/third_party/googletest' 2025-03-14T06:15:18.5455519Z http.https://github.com/.extraheader 2025-03-14T06:15:18.5493949Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2025-03-14T06:15:18.5537549Z http.https://github.com/.extraheader 2025-03-14T06:15:18.5578650Z Entering 'third_party/flash-attention' 2025-03-14T06:15:18.5621693Z http.https://github.com/.extraheader 2025-03-14T06:15:18.5661128Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-03-14T06:15:18.5703170Z http.https://github.com/.extraheader 2025-03-14T06:15:18.5749076Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-03-14T06:15:18.5791158Z http.https://github.com/.extraheader 2025-03-14T06:15:18.5841587Z Entering 'third_party/flatbuffers' 2025-03-14T06:15:18.5884766Z http.https://github.com/.extraheader 2025-03-14T06:15:18.5927459Z Entering 'third_party/fmt' 2025-03-14T06:15:18.5971583Z http.https://github.com/.extraheader 2025-03-14T06:15:18.6010460Z Entering 'third_party/gemmlowp/gemmlowp' 2025-03-14T06:15:18.6055891Z http.https://github.com/.extraheader 2025-03-14T06:15:18.6094806Z Entering 'third_party/gloo' 2025-03-14T06:15:18.6138659Z http.https://github.com/.extraheader 2025-03-14T06:15:18.6177468Z Entering 'third_party/googletest' 2025-03-14T06:15:18.6220938Z http.https://github.com/.extraheader 2025-03-14T06:15:18.6260176Z Entering 'third_party/ideep' 2025-03-14T06:15:18.6303133Z http.https://github.com/.extraheader 2025-03-14T06:15:18.6341221Z Entering 'third_party/ideep/mkl-dnn' 2025-03-14T06:15:18.6383587Z http.https://github.com/.extraheader 2025-03-14T06:15:18.6432770Z Entering 'third_party/ittapi' 2025-03-14T06:15:18.6475993Z http.https://github.com/.extraheader 2025-03-14T06:15:18.6514491Z Entering 'third_party/kineto' 2025-03-14T06:15:18.6558256Z http.https://github.com/.extraheader 2025-03-14T06:15:18.6597377Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-03-14T06:15:18.6640638Z http.https://github.com/.extraheader 2025-03-14T06:15:18.6679288Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-03-14T06:15:18.6722332Z http.https://github.com/.extraheader 2025-03-14T06:15:18.6764727Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-03-14T06:15:18.6807237Z http.https://github.com/.extraheader 2025-03-14T06:15:18.6847143Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-03-14T06:15:18.6890617Z http.https://github.com/.extraheader 2025-03-14T06:15:18.6930909Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-03-14T06:15:18.6973397Z http.https://github.com/.extraheader 2025-03-14T06:15:18.7011244Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-03-14T06:15:18.7055177Z http.https://github.com/.extraheader 2025-03-14T06:15:18.7096774Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-03-14T06:15:18.7140562Z http.https://github.com/.extraheader 2025-03-14T06:15:18.7181026Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-03-14T06:15:18.7223653Z http.https://github.com/.extraheader 2025-03-14T06:15:18.7264526Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-03-14T06:15:18.7307299Z http.https://github.com/.extraheader 2025-03-14T06:15:18.7348142Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-03-14T06:15:18.7390981Z http.https://github.com/.extraheader 2025-03-14T06:15:18.7433188Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-03-14T06:15:18.7475779Z http.https://github.com/.extraheader 2025-03-14T06:15:18.7514256Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-03-14T06:15:18.7557447Z http.https://github.com/.extraheader 2025-03-14T06:15:18.7597826Z Entering 'third_party/kleidiai' 2025-03-14T06:15:18.7642326Z http.https://github.com/.extraheader 2025-03-14T06:15:18.7680748Z Entering 'third_party/mimalloc' 2025-03-14T06:15:18.7724078Z http.https://github.com/.extraheader 2025-03-14T06:15:18.7763139Z Entering 'third_party/nlohmann' 2025-03-14T06:15:18.7806023Z http.https://github.com/.extraheader 2025-03-14T06:15:18.7845919Z Entering 'third_party/onnx' 2025-03-14T06:15:18.7888782Z http.https://github.com/.extraheader 2025-03-14T06:15:18.7946782Z Entering 'third_party/onnx/third_party/pybind11' 2025-03-14T06:15:18.7989629Z http.https://github.com/.extraheader 2025-03-14T06:15:18.8031287Z Entering 'third_party/opentelemetry-cpp' 2025-03-14T06:15:18.8074091Z http.https://github.com/.extraheader 2025-03-14T06:15:18.8114141Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-03-14T06:15:18.8156790Z http.https://github.com/.extraheader 2025-03-14T06:15:18.8195511Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-03-14T06:15:18.8238871Z http.https://github.com/.extraheader 2025-03-14T06:15:18.8276903Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-03-14T06:15:18.8319560Z http.https://github.com/.extraheader 2025-03-14T06:15:18.8359842Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-03-14T06:15:18.8403476Z http.https://github.com/.extraheader 2025-03-14T06:15:18.8445829Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-03-14T06:15:18.8489293Z http.https://github.com/.extraheader 2025-03-14T06:15:18.8529618Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-03-14T06:15:18.8573148Z http.https://github.com/.extraheader 2025-03-14T06:15:18.8612891Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-03-14T06:15:18.8657544Z http.https://github.com/.extraheader 2025-03-14T06:15:18.8695520Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-03-14T06:15:18.8741281Z http.https://github.com/.extraheader 2025-03-14T06:15:18.8783985Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-03-14T06:15:18.8829674Z http.https://github.com/.extraheader 2025-03-14T06:15:18.8871590Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-03-14T06:15:18.8917044Z http.https://github.com/.extraheader 2025-03-14T06:15:18.8980887Z Entering 'third_party/pocketfft' 2025-03-14T06:15:18.9025653Z http.https://github.com/.extraheader 2025-03-14T06:15:18.9065353Z Entering 'third_party/protobuf' 2025-03-14T06:15:18.9109596Z http.https://github.com/.extraheader 2025-03-14T06:15:18.9153896Z Entering 'third_party/protobuf/third_party/benchmark' 2025-03-14T06:15:18.9196950Z http.https://github.com/.extraheader 2025-03-14T06:15:18.9237541Z Entering 'third_party/protobuf/third_party/googletest' 2025-03-14T06:15:18.9280875Z http.https://github.com/.extraheader 2025-03-14T06:15:18.9322837Z Entering 'third_party/psimd' 2025-03-14T06:15:18.9367832Z http.https://github.com/.extraheader 2025-03-14T06:15:18.9407913Z Entering 'third_party/pthreadpool' 2025-03-14T06:15:18.9453168Z http.https://github.com/.extraheader 2025-03-14T06:15:18.9492610Z Entering 'third_party/pybind11' 2025-03-14T06:15:18.9537662Z http.https://github.com/.extraheader 2025-03-14T06:15:18.9577218Z Entering 'third_party/python-peachpy' 2025-03-14T06:15:18.9621847Z http.https://github.com/.extraheader 2025-03-14T06:15:18.9661674Z Entering 'third_party/sleef' 2025-03-14T06:15:18.9705012Z http.https://github.com/.extraheader 2025-03-14T06:15:18.9744421Z Entering 'third_party/tensorpipe' 2025-03-14T06:15:18.9787457Z http.https://github.com/.extraheader 2025-03-14T06:15:18.9825480Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-03-14T06:15:18.9870169Z http.https://github.com/.extraheader 2025-03-14T06:15:18.9908858Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-03-14T06:15:18.9955037Z http.https://github.com/.extraheader 2025-03-14T06:15:18.9993275Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-03-14T06:15:19.0038262Z http.https://github.com/.extraheader 2025-03-14T06:15:19.0077385Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-03-14T06:15:19.0120813Z http.https://github.com/.extraheader 2025-03-14T06:15:19.0160752Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-03-14T06:15:19.0204367Z http.https://github.com/.extraheader 2025-03-14T06:15:19.0448298Z Post job cleanup. 2025-03-14T06:15:19.0541536Z Post job cleanup. 2025-03-14T06:15:19.1856278Z A job completed hook has been configured by the self-hosted runner administrator 2025-03-14T06:15:19.1888258Z ##[group]Run '/home/ec2-user/runner-scripts/after_job.sh' 2025-03-14T06:15:19.1894346Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T06:15:19.1894860Z ##[endgroup] 2025-03-14T06:15:19.1993846Z [!ALERT!] Swap in detected! [!ALERT!] 2025-03-14T06:15:32.6699640Z [!ALERT!] Swap out detected [!ALERT!] 2025-03-14T06:15:53.8479213Z Cleaning up orphan processes