2024-06-26T07:00:23.8713242Z Current runner version: '2.317.0' 2024-06-26T07:00:23.8719312Z Runner name: 'i-0d0929ec639f8ba06' 2024-06-26T07:00:23.8720205Z Runner group name: 'Default' 2024-06-26T07:00:23.8721192Z Machine name: 'ip-10-0-21-147' 2024-06-26T07:00:23.8726294Z ##[group]GITHUB_TOKEN Permissions 2024-06-26T07:00:23.8728349Z Actions: read 2024-06-26T07:00:23.8728901Z Attestations: read 2024-06-26T07:00:23.8729508Z Checks: read 2024-06-26T07:00:23.8730041Z Contents: read 2024-06-26T07:00:23.8730577Z Deployments: read 2024-06-26T07:00:23.8731174Z Discussions: read 2024-06-26T07:00:23.8731774Z Issues: read 2024-06-26T07:00:23.8732324Z Metadata: read 2024-06-26T07:00:23.8732847Z Packages: read 2024-06-26T07:00:23.8733397Z Pages: read 2024-06-26T07:00:23.8733955Z PullRequests: read 2024-06-26T07:00:23.8734538Z RepositoryProjects: read 2024-06-26T07:00:23.8735229Z SecurityEvents: read 2024-06-26T07:00:23.8735840Z Statuses: read 2024-06-26T07:00:23.8736385Z ##[endgroup] 2024-06-26T07:00:23.8739553Z Secret source: Actions 2024-06-26T07:00:23.8740446Z Prepare workflow directory 2024-06-26T07:00:24.2256848Z Prepare all required actions 2024-06-26T07:00:24.2431098Z Getting action download info 2024-06-26T07:00:24.4230837Z Download action repository 'pytorch/test-infra@main' (SHA:43a2ce341cc31288e9a38b65ce600a7f43021bd5) 2024-06-26T07:00:24.7743450Z Download action repository 'pytorch/pytorch@main' (SHA:c422a9549d2b320b47a9391f6cbcf592b2876c88) 2024-06-26T07:00:27.4080241Z Download action repository 'aws-actions/configure-aws-credentials@v3' (SHA:50ac8dd1e1b10d09dac7b8727528b91bed831ac0) 2024-06-26T07:00:27.5324525Z Download action repository 'seemethere/upload-artifact-s3@v5' (SHA:baba72d0712b404f646cebe0730933554ebce96a) 2024-06-26T07:00:27.7858806Z Getting action download info 2024-06-26T07:00:27.8854532Z Download action repository 'malfet/checkout@silent-checkout' (SHA:e07af140b3ccefc05679e3755b9db68f4ee4589c) 2024-06-26T07:00:28.1483602Z Getting action download info 2024-06-26T07:00:28.2365834Z Download action repository 'nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482' (SHA:3e91a01664abd3c5cd539100d10d33b9c5b68482) 2024-06-26T07:00:28.3939576Z Uses: pytorch/pytorch/.github/workflows/_linux-test.yml@refs/tags/ciflow/inductor/129470 (b8c4c54d347aa776934c60784e35936878ef18dc) 2024-06-26T07:00:28.3941670Z ##[group] Inputs 2024-06-26T07:00:28.3942151Z build-environment: linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-06-26T07:00:28.3950788Z test-matrix: {"include": [{"config": "inductor", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_distributed", "shard": 1, "num_shards": 1, "runner": "linux.g5.12xlarge.nvidia.gpu"}, {"config": "inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_cpp_wrapper_abi_compatible", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}]} 2024-06-26T07:00:28.3959939Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:00:28.3961145Z sync-tag: 2024-06-26T07:00:28.3961966Z timeout-minutes: 240 2024-06-26T07:00:28.3962304Z use-gha: 2024-06-26T07:00:28.3962584Z dashboard-tag: 2024-06-26T07:00:28.3962912Z s3-bucket: gha-artifacts 2024-06-26T07:00:28.3963271Z aws-role-to-assume: 2024-06-26T07:00:28.3963607Z ##[endgroup] 2024-06-26T07:00:28.3964441Z Complete job name: cuda12.1-py3.10-gcc9-sm86 / test (aot_inductor_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-06-26T07:00:28.4521440Z A job started hook has been configured by the self-hosted runner administrator 2024-06-26T07:00:28.4658814Z ##[group]Run '/home/ec2-user/runner-scripts/cleanup.sh' 2024-06-26T07:00:28.4669590Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:00:28.4670112Z ##[endgroup] 2024-06-26T07:00:29.3212677Z ##[group]Run pytorch/test-infra/.github/actions/setup-ssh@main 2024-06-26T07:00:29.3213274Z with: 2024-06-26T07:00:29.3213896Z github-secret: *** 2024-06-26T07:00:29.3214814Z instructions: All testing is done inside the container, to start an interactive session run: docker exec -it $(docker container ps --format '{{.ID}}') bash 2024-06-26T07:00:29.3215796Z activate-with-label: false 2024-06-26T07:00:29.3216159Z label: with-ssh 2024-06-26T07:00:29.3216499Z remove-existing-keys: true 2024-06-26T07:00:29.3216895Z fail-silently: true 2024-06-26T07:00:29.3217211Z env: 2024-06-26T07:00:29.3217503Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:00:29.3217850Z ##[endgroup] 2024-06-26T07:00:29.4084018Z Please see https://github.com/pytorch/pytorch/wiki/Debugging-using-with-ssh-for-Github-Actions for more info. 2024-06-26T07:00:29.4085230Z ciflow reference detected, attempting to extract PR number 2024-06-26T07:00:29.6937434Z Grabbing public ssh keys from https://github.com/pytorch-bot[bot].keys 2024-06-26T07:00:29.7557763Z No SSH keys found for user pytorch-bot[bot] 2024-06-26T07:00:29.7558511Z Grabbing public ssh keys from https://github.com/leslie-fang-intel.keys 2024-06-26T07:00:29.8223184Z No SSH keys found for user leslie-fang-intel 2024-06-26T07:00:29.8332050Z ##[group]Run pytorch/pytorch/.github/actions/checkout-pytorch@main 2024-06-26T07:00:29.8332715Z with: 2024-06-26T07:00:29.8333055Z submodules: recursive 2024-06-26T07:00:29.8333426Z fetch-depth: 0 2024-06-26T07:00:29.8333801Z env: 2024-06-26T07:00:29.8334126Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:00:29.8334496Z ##[endgroup] 2024-06-26T07:00:29.8530891Z ##[group]Run retry () { 2024-06-26T07:00:29.8558572Z retry () { 2024-06-26T07:00:29.8559108Z  $* || (sleep 1 && $*) || (sleep 2 && $*) || (sleep 4 && $*) || (sleep 8 && $*) 2024-06-26T07:00:29.8559673Z } 2024-06-26T07:00:29.8559986Z echo "${GITHUB_WORKSPACE}" 2024-06-26T07:00:29.8560420Z if [ -z "${NO_SUDO}" ]; then 2024-06-26T07:00:29.8560906Z  retry sudo rm -rf "${GITHUB_WORKSPACE}" 2024-06-26T07:00:29.8561369Z else 2024-06-26T07:00:29.8561719Z  retry rm -rf "${GITHUB_WORKSPACE}" 2024-06-26T07:00:29.8562152Z fi 2024-06-26T07:00:29.8562500Z mkdir "${GITHUB_WORKSPACE}" 2024-06-26T07:00:29.8570587Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:00:29.8571095Z env: 2024-06-26T07:00:29.8571378Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:00:29.8571734Z NO_SUDO: 2024-06-26T07:00:29.8572007Z ##[endgroup] 2024-06-26T07:00:29.8595686Z /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-06-26T07:00:32.0923707Z ##[group]Run malfet/checkout@silent-checkout 2024-06-26T07:00:32.0924182Z with: 2024-06-26T07:00:32.0924509Z ref: b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:00:32.0925058Z fetch-depth: 0 2024-06-26T07:00:32.0925378Z submodules: recursive 2024-06-26T07:00:32.0925729Z quiet-checkout: true 2024-06-26T07:00:32.0926077Z repository: pytorch/pytorch 2024-06-26T07:00:32.0926566Z token: *** 2024-06-26T07:00:32.0926865Z ssh-strict: true 2024-06-26T07:00:32.0927198Z persist-credentials: true 2024-06-26T07:00:32.0927552Z clean: true 2024-06-26T07:00:32.0927891Z sparse-checkout-cone-mode: true 2024-06-26T07:00:32.0928284Z lfs: false 2024-06-26T07:00:32.0928585Z set-safe-directory: true 2024-06-26T07:00:32.0928928Z env: 2024-06-26T07:00:32.0929210Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:00:32.0929557Z ##[endgroup] 2024-06-26T07:00:32.1845075Z Syncing repository: pytorch/pytorch 2024-06-26T07:00:32.1846613Z ##[group]Getting Git version info 2024-06-26T07:00:32.1847358Z Working directory is '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2024-06-26T07:00:32.1848221Z [command]/usr/bin/git version 2024-06-26T07:00:32.1848586Z git version 2.40.1 2024-06-26T07:00:32.1849919Z ##[endgroup] 2024-06-26T07:00:32.1860853Z Copying '/home/ec2-user/.gitconfig' to '/home/ec2-user/actions-runner/_work/_temp/99b86e13-7320-4de9-a137-5635e1d31c2c/.gitconfig' 2024-06-26T07:00:32.1868498Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/99b86e13-7320-4de9-a137-5635e1d31c2c' before making global git config changes 2024-06-26T07:00:32.1869777Z Adding repository directory to the temporary git global config as a safe directory 2024-06-26T07:00:32.1873086Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-06-26T07:00:32.1907480Z Deleting the contents of '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2024-06-26T07:00:32.1911679Z ##[group]Initializing the repository 2024-06-26T07:00:32.1914726Z [command]/usr/bin/git init /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-06-26T07:00:32.1933807Z hint: Using 'master' as the name for the initial branch. This default branch name 2024-06-26T07:00:32.1934666Z hint: is subject to change. To configure the initial branch name to use in all 2024-06-26T07:00:32.1935459Z hint: of your new repositories, which will suppress this warning, call: 2024-06-26T07:00:32.1936013Z hint: 2024-06-26T07:00:32.1936465Z hint: git config --global init.defaultBranch 2024-06-26T07:00:32.1936939Z hint: 2024-06-26T07:00:32.1937620Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-06-26T07:00:32.1938459Z hint: 'development'. The just-created branch can be renamed via this command: 2024-06-26T07:00:32.1939041Z hint: 2024-06-26T07:00:32.1939363Z hint: git branch -m 2024-06-26T07:00:32.1940097Z Initialized empty Git repository in /home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/ 2024-06-26T07:00:32.1942602Z [command]/usr/bin/git remote add origin https://github.com/pytorch/pytorch 2024-06-26T07:00:32.1962004Z ##[endgroup] 2024-06-26T07:00:32.1962590Z ##[group]Disabling automatic garbage collection 2024-06-26T07:00:32.1964984Z [command]/usr/bin/git config --local gc.auto 0 2024-06-26T07:00:32.1983399Z ##[endgroup] 2024-06-26T07:00:32.1983916Z ##[group]Setting up auth 2024-06-26T07:00:32.1989315Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2024-06-26T07:00:32.2009823Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2024-06-26T07:00:32.2202417Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2024-06-26T07:00:32.2223390Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2024-06-26T07:00:32.2418642Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic *** 2024-06-26T07:00:32.2461788Z ##[endgroup] 2024-06-26T07:00:32.2462352Z ##[group]Fetching the repository 2024-06-26T07:00:32.2468128Z [command]/usr/bin/git -c protocol.version=2 fetch --prune --progress --no-recurse-submodules --quiet origin +refs/heads/*:refs/remotes/origin/* +refs/tags/*:refs/tags/* 2024-06-26T07:00:34.4091092Z remote: Enumerating objects: 987612 2024-06-26T07:00:34.4091652Z remote: Enumerating objects: 990209, done. 2024-06-26T07:00:34.4095673Z remote: Counting objects: 0% (1/2597) 2024-06-26T07:00:34.4096429Z remote: Counting objects: 1% (26/2597) 2024-06-26T07:00:34.4097202Z remote: Counting objects: 2% (52/2597) 2024-06-26T07:00:34.4097945Z remote: Counting objects: 3% (78/2597) 2024-06-26T07:00:34.4105064Z remote: Counting objects: 4% (104/2597) 2024-06-26T07:00:34.4105699Z remote: Counting objects: 5% (130/2597) 2024-06-26T07:00:34.4106324Z remote: Counting objects: 6% (156/2597) 2024-06-26T07:00:34.4106832Z remote: Counting objects: 7% (182/2597) 2024-06-26T07:00:34.4107612Z remote: Counting objects: 8% (208/2597) 2024-06-26T07:00:34.4108199Z remote: Counting objects: 9% (234/2597) 2024-06-26T07:00:34.4108703Z remote: Counting objects: 10% (260/2597) 2024-06-26T07:00:34.4109208Z remote: Counting objects: 11% (286/2597) 2024-06-26T07:00:34.4109719Z remote: Counting objects: 12% (312/2597) 2024-06-26T07:00:34.4110221Z remote: Counting objects: 13% (338/2597) 2024-06-26T07:00:34.4110793Z remote: Counting objects: 14% (364/2597) 2024-06-26T07:00:34.4111463Z remote: Counting objects: 15% (390/2597) 2024-06-26T07:00:34.4112043Z remote: Counting objects: 16% (416/2597) 2024-06-26T07:00:34.4112563Z remote: Counting objects: 17% (442/2597) 2024-06-26T07:00:34.4113115Z remote: Counting objects: 18% (468/2597) 2024-06-26T07:00:34.4113794Z remote: Counting objects: 19% (494/2597) 2024-06-26T07:00:34.4114472Z remote: Counting objects: 20% (520/2597) 2024-06-26T07:00:34.4115125Z remote: Counting objects: 21% (546/2597) 2024-06-26T07:00:34.4115646Z remote: Counting objects: 22% (572/2597) 2024-06-26T07:00:34.4116310Z remote: Counting objects: 23% (598/2597) 2024-06-26T07:00:34.4116984Z remote: Counting objects: 24% (624/2597) 2024-06-26T07:00:34.4117540Z remote: Counting objects: 25% (650/2597) 2024-06-26T07:00:34.4118332Z remote: Counting objects: 26% (676/2597) 2024-06-26T07:00:34.4119026Z remote: Counting objects: 27% (702/2597) 2024-06-26T07:00:34.4119565Z remote: Counting objects: 28% (728/2597) 2024-06-26T07:00:34.4120062Z remote: Counting objects: 29% (754/2597) 2024-06-26T07:00:34.4120549Z remote: Counting objects: 30% (780/2597) 2024-06-26T07:00:34.4121179Z remote: Counting objects: 31% (806/2597) 2024-06-26T07:00:34.4121777Z remote: Counting objects: 32% (832/2597) 2024-06-26T07:00:34.4122272Z remote: Counting objects: 33% (858/2597) 2024-06-26T07:00:34.4122776Z remote: Counting objects: 34% (883/2597) 2024-06-26T07:00:34.4123319Z remote: Counting objects: 35% (909/2597) 2024-06-26T07:00:34.4124006Z remote: Counting objects: 36% (935/2597) 2024-06-26T07:00:34.4124562Z remote: Counting objects: 37% (961/2597) 2024-06-26T07:00:34.4125130Z remote: Counting objects: 38% (987/2597) 2024-06-26T07:00:34.4125658Z remote: Counting objects: 39% (1013/2597) 2024-06-26T07:00:34.4126221Z remote: Counting objects: 40% (1039/2597) 2024-06-26T07:00:34.4126912Z remote: Counting objects: 41% (1065/2597) 2024-06-26T07:00:34.4127485Z remote: Counting objects: 42% (1091/2597) 2024-06-26T07:00:34.4128002Z remote: Counting objects: 43% (1117/2597) 2024-06-26T07:00:34.4128771Z remote: Counting objects: 44% (1143/2597) 2024-06-26T07:00:34.4129451Z remote: Counting objects: 45% (1169/2597) 2024-06-26T07:00:34.4130118Z remote: Counting objects: 46% (1195/2597) 2024-06-26T07:00:34.4130802Z remote: Counting objects: 47% (1221/2597) 2024-06-26T07:00:34.4131492Z remote: Counting objects: 48% (1247/2597) 2024-06-26T07:00:34.4132094Z remote: Counting objects: 49% (1273/2597) 2024-06-26T07:00:34.4132834Z remote: Counting objects: 50% (1299/2597) 2024-06-26T07:00:34.4133521Z remote: Counting objects: 51% (1325/2597) 2024-06-26T07:00:34.4134050Z remote: Counting objects: 52% (1351/2597) 2024-06-26T07:00:34.4134564Z remote: Counting objects: 53% (1377/2597) 2024-06-26T07:00:34.4135072Z remote: Counting objects: 54% (1403/2597) 2024-06-26T07:00:34.4135590Z remote: Counting objects: 55% (1429/2597) 2024-06-26T07:00:34.4136108Z remote: Counting objects: 56% (1455/2597) 2024-06-26T07:00:34.4136628Z remote: Counting objects: 57% (1481/2597) 2024-06-26T07:00:34.4137136Z remote: Counting objects: 58% (1507/2597) 2024-06-26T07:00:34.4137646Z remote: Counting objects: 59% (1533/2597) 2024-06-26T07:00:34.4138160Z remote: Counting objects: 60% (1559/2597) 2024-06-26T07:00:34.4138669Z remote: Counting objects: 61% (1585/2597) 2024-06-26T07:00:34.4139184Z remote: Counting objects: 62% (1611/2597) 2024-06-26T07:00:34.4139727Z remote: Counting objects: 63% (1637/2597) 2024-06-26T07:00:34.4140250Z remote: Counting objects: 64% (1663/2597) 2024-06-26T07:00:34.4140761Z remote: Counting objects: 65% (1689/2597) 2024-06-26T07:00:34.4141276Z remote: Counting objects: 66% (1715/2597) 2024-06-26T07:00:34.4141783Z remote: Counting objects: 67% (1740/2597) 2024-06-26T07:00:34.4142347Z remote: Counting objects: 68% (1766/2597) 2024-06-26T07:00:34.4142866Z remote: Counting objects: 69% (1792/2597) 2024-06-26T07:00:34.4143379Z remote: Counting objects: 70% (1818/2597) 2024-06-26T07:00:34.4143888Z remote: Counting objects: 71% (1844/2597) 2024-06-26T07:00:34.4144407Z remote: Counting objects: 72% (1870/2597) 2024-06-26T07:00:34.4144919Z remote: Counting objects: 73% (1896/2597) 2024-06-26T07:00:34.4145436Z remote: Counting objects: 74% (1922/2597) 2024-06-26T07:00:34.4145942Z remote: Counting objects: 75% (1948/2597) 2024-06-26T07:00:34.4146452Z remote: Counting objects: 76% (1974/2597) 2024-06-26T07:00:34.4147048Z remote: Counting objects: 77% (2000/2597) 2024-06-26T07:00:34.4147713Z remote: Counting objects: 78% (2026/2597) 2024-06-26T07:00:34.4148220Z remote: Counting objects: 79% (2052/2597) 2024-06-26T07:00:34.4148738Z remote: Counting objects: 80% (2078/2597) 2024-06-26T07:00:34.4149248Z remote: Counting objects: 81% (2104/2597) 2024-06-26T07:00:34.4149767Z remote: Counting objects: 82% (2130/2597) 2024-06-26T07:00:34.4150272Z remote: Counting objects: 83% (2156/2597) 2024-06-26T07:00:34.4150783Z remote: Counting objects: 84% (2182/2597) 2024-06-26T07:00:34.4151297Z remote: Counting objects: 85% (2208/2597) 2024-06-26T07:00:34.4151808Z remote: Counting objects: 86% (2234/2597) 2024-06-26T07:00:34.4152312Z remote: Counting objects: 87% (2260/2597) 2024-06-26T07:00:34.4152823Z remote: Counting objects: 88% (2286/2597) 2024-06-26T07:00:34.4153335Z remote: Counting objects: 89% (2312/2597) 2024-06-26T07:00:34.4153857Z remote: Counting objects: 90% (2338/2597) 2024-06-26T07:00:34.4154360Z remote: Counting objects: 91% (2364/2597) 2024-06-26T07:00:34.4154872Z remote: Counting objects: 92% (2390/2597) 2024-06-26T07:00:34.4155387Z remote: Counting objects: 93% (2416/2597) 2024-06-26T07:00:34.4155898Z remote: Counting objects: 94% (2442/2597) 2024-06-26T07:00:34.4156493Z remote: Counting objects: 95% (2468/2597) 2024-06-26T07:00:34.4157008Z remote: Counting objects: 96% (2494/2597) 2024-06-26T07:00:34.4157521Z remote: Counting objects: 97% (2520/2597) 2024-06-26T07:00:34.4158035Z remote: Counting objects: 98% (2546/2597) 2024-06-26T07:00:34.4158541Z remote: Counting objects: 99% (2572/2597) 2024-06-26T07:00:34.4159054Z remote: Counting objects: 100% (2597/2597) 2024-06-26T07:00:34.4159605Z remote: Counting objects: 100% (2597/2597), done. 2024-06-26T07:00:34.4252753Z remote: Compressing objects: 0% (1/1074) 2024-06-26T07:00:34.4632931Z remote: Compressing objects: 1% (11/1074) 2024-06-26T07:00:34.5016931Z remote: Compressing objects: 2% (22/1074) 2024-06-26T07:00:34.5359078Z remote: Compressing objects: 3% (33/1074) 2024-06-26T07:00:34.5552588Z remote: Compressing objects: 4% (43/1074) 2024-06-26T07:00:34.5828643Z remote: Compressing objects: 5% (54/1074) 2024-06-26T07:00:34.6101118Z remote: Compressing objects: 6% (65/1074) 2024-06-26T07:00:34.6491124Z remote: Compressing objects: 7% (76/1074) 2024-06-26T07:00:34.7391499Z remote: Compressing objects: 8% (86/1074) 2024-06-26T07:00:34.8471220Z remote: Compressing objects: 9% (97/1074) 2024-06-26T07:00:34.8471825Z remote: Compressing objects: 10% (108/1074) 2024-06-26T07:00:34.8492983Z remote: Compressing objects: 11% (119/1074) 2024-06-26T07:00:34.8599837Z remote: Compressing objects: 12% (129/1074) 2024-06-26T07:00:34.8682587Z remote: Compressing objects: 13% (140/1074) 2024-06-26T07:00:34.8722956Z remote: Compressing objects: 14% (151/1074) 2024-06-26T07:00:34.8723560Z remote: Compressing objects: 15% (162/1074) 2024-06-26T07:00:34.8781749Z remote: Compressing objects: 16% (172/1074) 2024-06-26T07:00:34.8782356Z remote: Compressing objects: 17% (183/1074) 2024-06-26T07:00:34.8782944Z remote: Compressing objects: 18% (194/1074) 2024-06-26T07:00:34.8802160Z remote: Compressing objects: 19% (205/1074) 2024-06-26T07:00:34.8825155Z remote: Compressing objects: 20% (215/1074) 2024-06-26T07:00:34.8839201Z remote: Compressing objects: 21% (226/1074) 2024-06-26T07:00:34.8850790Z remote: Compressing objects: 22% (237/1074) 2024-06-26T07:00:34.8876608Z remote: Compressing objects: 23% (248/1074) 2024-06-26T07:00:34.8887470Z remote: Compressing objects: 24% (258/1074) 2024-06-26T07:00:34.8896970Z remote: Compressing objects: 25% (269/1074) 2024-06-26T07:00:34.8906651Z remote: Compressing objects: 26% (280/1074) 2024-06-26T07:00:34.8912453Z remote: Compressing objects: 27% (290/1074) 2024-06-26T07:00:34.8920162Z remote: Compressing objects: 28% (301/1074) 2024-06-26T07:00:34.8932602Z remote: Compressing objects: 29% (312/1074) 2024-06-26T07:00:34.8942095Z remote: Compressing objects: 30% (323/1074) 2024-06-26T07:00:34.8949919Z remote: Compressing objects: 31% (333/1074) 2024-06-26T07:00:34.8950467Z remote: Compressing objects: 32% (344/1074) 2024-06-26T07:00:34.8961733Z remote: Compressing objects: 33% (355/1074) 2024-06-26T07:00:34.8976240Z remote: Compressing objects: 34% (366/1074) 2024-06-26T07:00:34.8991183Z remote: Compressing objects: 35% (376/1074) 2024-06-26T07:00:34.9012055Z remote: Compressing objects: 36% (387/1074) 2024-06-26T07:00:34.9027662Z remote: Compressing objects: 37% (398/1074) 2024-06-26T07:00:34.9043073Z remote: Compressing objects: 38% (409/1074) 2024-06-26T07:00:34.9061181Z remote: Compressing objects: 39% (419/1074) 2024-06-26T07:00:34.9075107Z remote: Compressing objects: 40% (430/1074) 2024-06-26T07:00:34.9101403Z remote: Compressing objects: 41% (441/1074) 2024-06-26T07:00:34.9120102Z remote: Compressing objects: 42% (452/1074) 2024-06-26T07:00:34.9123572Z remote: Compressing objects: 43% (462/1074) 2024-06-26T07:00:34.9131287Z remote: Compressing objects: 44% (473/1074) 2024-06-26T07:00:34.9134200Z remote: Compressing objects: 45% (484/1074) 2024-06-26T07:00:34.9148004Z remote: Compressing objects: 46% (495/1074) 2024-06-26T07:00:34.9161219Z remote: Compressing objects: 47% (505/1074) 2024-06-26T07:00:34.9185679Z remote: Compressing objects: 48% (516/1074) 2024-06-26T07:00:34.9190679Z remote: Compressing objects: 49% (527/1074) 2024-06-26T07:00:34.9195556Z remote: Compressing objects: 50% (537/1074) 2024-06-26T07:00:34.9202194Z remote: Compressing objects: 51% (548/1074) 2024-06-26T07:00:34.9216133Z remote: Compressing objects: 52% (559/1074) 2024-06-26T07:00:34.9229689Z remote: Compressing objects: 53% (570/1074) 2024-06-26T07:00:34.9247655Z remote: Compressing objects: 54% (580/1074) 2024-06-26T07:00:34.9260944Z remote: Compressing objects: 55% (591/1074) 2024-06-26T07:00:34.9268008Z remote: Compressing objects: 56% (602/1074) 2024-06-26T07:00:34.9282946Z remote: Compressing objects: 57% (613/1074) 2024-06-26T07:00:34.9288952Z remote: Compressing objects: 58% (623/1074) 2024-06-26T07:00:34.9298128Z remote: Compressing objects: 59% (634/1074) 2024-06-26T07:00:34.9314773Z remote: Compressing objects: 60% (645/1074) 2024-06-26T07:00:34.9320353Z remote: Compressing objects: 61% (656/1074) 2024-06-26T07:00:34.9324158Z remote: Compressing objects: 62% (666/1074) 2024-06-26T07:00:34.9331607Z remote: Compressing objects: 63% (677/1074) 2024-06-26T07:00:34.9349539Z remote: Compressing objects: 64% (688/1074) 2024-06-26T07:00:34.9352739Z remote: Compressing objects: 65% (699/1074) 2024-06-26T07:00:34.9353619Z remote: Compressing objects: 66% (709/1074) 2024-06-26T07:00:34.9362576Z remote: Compressing objects: 67% (720/1074) 2024-06-26T07:00:34.9368223Z remote: Compressing objects: 68% (731/1074) 2024-06-26T07:00:34.9373585Z remote: Compressing objects: 69% (742/1074) 2024-06-26T07:00:34.9376587Z remote: Compressing objects: 70% (752/1074) 2024-06-26T07:00:34.9380988Z remote: Compressing objects: 71% (763/1074) 2024-06-26T07:00:34.9383616Z remote: Compressing objects: 72% (774/1074) 2024-06-26T07:00:34.9389150Z remote: Compressing objects: 73% (785/1074) 2024-06-26T07:00:34.9389832Z remote: Compressing objects: 74% (795/1074) 2024-06-26T07:00:34.9390559Z remote: Compressing objects: 75% (806/1074) 2024-06-26T07:00:34.9391103Z remote: Compressing objects: 76% (817/1074) 2024-06-26T07:00:34.9391634Z remote: Compressing objects: 77% (827/1074) 2024-06-26T07:00:34.9392160Z remote: Compressing objects: 78% (838/1074) 2024-06-26T07:00:34.9395009Z remote: Compressing objects: 79% (849/1074) 2024-06-26T07:00:34.9395546Z remote: Compressing objects: 80% (860/1074) 2024-06-26T07:00:34.9396089Z remote: Compressing objects: 81% (870/1074) 2024-06-26T07:00:34.9399067Z remote: Compressing objects: 82% (881/1074) 2024-06-26T07:00:34.9399602Z remote: Compressing objects: 83% (892/1074) 2024-06-26T07:00:34.9400142Z remote: Compressing objects: 84% (903/1074) 2024-06-26T07:00:34.9407406Z remote: Compressing objects: 85% (913/1074) 2024-06-26T07:00:34.9407948Z remote: Compressing objects: 86% (924/1074) 2024-06-26T07:00:34.9408478Z remote: Compressing objects: 87% (935/1074) 2024-06-26T07:00:34.9414182Z remote: Compressing objects: 88% (946/1074) 2024-06-26T07:00:34.9414718Z remote: Compressing objects: 89% (956/1074) 2024-06-26T07:00:34.9415248Z remote: Compressing objects: 90% (967/1074) 2024-06-26T07:00:34.9415776Z remote: Compressing objects: 91% (978/1074) 2024-06-26T07:00:34.9420351Z remote: Compressing objects: 92% (989/1074) 2024-06-26T07:00:34.9421005Z remote: Compressing objects: 93% (999/1074) 2024-06-26T07:00:34.9421542Z remote: Compressing objects: 94% (1010/1074) 2024-06-26T07:00:34.9431405Z remote: Compressing objects: 95% (1021/1074) 2024-06-26T07:00:34.9432198Z remote: Compressing objects: 96% (1032/1074) 2024-06-26T07:00:34.9432888Z remote: Compressing objects: 97% (1042/1074) 2024-06-26T07:00:34.9433431Z remote: Compressing objects: 98% (1053/1074) 2024-06-26T07:00:34.9433973Z remote: Compressing objects: 99% (1064/1074) 2024-06-26T07:00:34.9434681Z remote: Compressing objects: 100% (1074/1074) 2024-06-26T07:00:34.9435533Z remote: Compressing objects: 100% (1074/1074), done. 2024-06-26T07:00:55.3741721Z remote: Total 990209 (delta 2062), reused 1863 (delta 1522), pack-reused 987612 2024-06-26T07:01:14.9828550Z [command]/usr/bin/git rev-parse --verify --quiet b8c4c54d347aa776934c60784e35936878ef18dc^{object} 2024-06-26T07:01:14.9846893Z b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:01:14.9851103Z ##[endgroup] 2024-06-26T07:01:14.9851925Z ##[group]Determining the checkout info 2024-06-26T07:01:14.9854353Z ##[endgroup] 2024-06-26T07:01:14.9855172Z ##[group]Checking out the ref 2024-06-26T07:01:14.9856520Z [command]/usr/bin/git checkout --quiet --force b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:01:16.2098267Z ##[endgroup] 2024-06-26T07:01:16.2101110Z ##[group]Setting up auth for fetching submodules 2024-06-26T07:01:16.2103246Z [command]/usr/bin/git config --global http.https://github.com/.extraheader AUTHORIZATION: basic *** 2024-06-26T07:01:16.2143812Z [command]/usr/bin/git config --global --unset-all url.https://github.com/.insteadOf 2024-06-26T07:01:16.2169230Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf git@github.com: 2024-06-26T07:01:16.2189261Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf org-21003710@github.com: 2024-06-26T07:01:16.2205780Z ##[endgroup] 2024-06-26T07:01:16.2206324Z ##[group]Fetching submodules 2024-06-26T07:01:16.2209471Z [command]/usr/bin/git submodule sync --recursive 2024-06-26T07:01:16.2416957Z [command]/usr/bin/git -c protocol.version=2 submodule update --init --force --recursive 2024-06-26T07:01:16.2620815Z Submodule 'android/libs/fbjni' (https://github.com/facebookincubator/fbjni.git) registered for path 'android/libs/fbjni' 2024-06-26T07:01:16.2622223Z Submodule 'third_party/NNPACK_deps/FP16' (https://github.com/Maratyszcza/FP16.git) registered for path 'third_party/FP16' 2024-06-26T07:01:16.2623817Z Submodule 'third_party/NNPACK_deps/FXdiv' (https://github.com/Maratyszcza/FXdiv.git) registered for path 'third_party/FXdiv' 2024-06-26T07:01:16.2625171Z Submodule 'third_party/NNPACK' (https://github.com/Maratyszcza/NNPACK.git) registered for path 'third_party/NNPACK' 2024-06-26T07:01:16.2627861Z Submodule 'third_party/VulkanMemoryAllocator' (https://github.com/GPUOpen-LibrariesAndSDKs/VulkanMemoryAllocator.git) registered for path 'third_party/VulkanMemoryAllocator' 2024-06-26T07:01:16.2629686Z Submodule 'third_party/XNNPACK' (https://github.com/google/XNNPACK.git) registered for path 'third_party/XNNPACK' 2024-06-26T07:01:16.2631248Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/benchmark' 2024-06-26T07:01:16.2633459Z Submodule 'third_party/cpp-httplib' (https://github.com/yhirose/cpp-httplib.git) registered for path 'third_party/cpp-httplib' 2024-06-26T07:01:16.2635523Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo.git) registered for path 'third_party/cpuinfo' 2024-06-26T07:01:16.2637910Z Submodule 'third_party/cudnn_frontend' (https://github.com/NVIDIA/cudnn-frontend.git) registered for path 'third_party/cudnn_frontend' 2024-06-26T07:01:16.2640078Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/cutlass' 2024-06-26T07:01:16.2642460Z Submodule 'third_party/eigen' (https://gitlab.com/libeigen/eigen.git) registered for path 'third_party/eigen' 2024-06-26T07:01:16.2645060Z Submodule 'third_party/fbgemm' (https://github.com/pytorch/fbgemm) registered for path 'third_party/fbgemm' 2024-06-26T07:01:16.2647720Z Submodule 'third_party/flatbuffers' (https://github.com/google/flatbuffers.git) registered for path 'third_party/flatbuffers' 2024-06-26T07:01:16.2650085Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/fmt' 2024-06-26T07:01:16.2652765Z Submodule 'third_party/foxi' (https://github.com/houseroad/foxi.git) registered for path 'third_party/foxi' 2024-06-26T07:01:16.2655653Z Submodule 'third_party/gemmlowp/gemmlowp' (https://github.com/google/gemmlowp.git) registered for path 'third_party/gemmlowp/gemmlowp' 2024-06-26T07:01:16.2658275Z Submodule 'third_party/gloo' (https://github.com/facebookincubator/gloo) registered for path 'third_party/gloo' 2024-06-26T07:01:16.2661104Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/googletest' 2024-06-26T07:01:16.2663903Z Submodule 'third_party/ideep' (https://github.com/intel/ideep) registered for path 'third_party/ideep' 2024-06-26T07:01:16.2666986Z Submodule 'third_party/ittapi' (https://github.com/intel/ittapi.git) registered for path 'third_party/ittapi' 2024-06-26T07:01:16.2670458Z Submodule 'third_party/kineto' (https://github.com/pytorch/kineto) registered for path 'third_party/kineto' 2024-06-26T07:01:16.2673663Z Submodule 'third_party/mimalloc' (https://github.com/microsoft/mimalloc.git) registered for path 'third_party/mimalloc' 2024-06-26T07:01:16.2676693Z Submodule 'third_party/nccl/nccl' (https://github.com/NVIDIA/nccl) registered for path 'third_party/nccl/nccl' 2024-06-26T07:01:16.2680016Z Submodule 'third_party/nlohmann' (https://github.com/nlohmann/json.git) registered for path 'third_party/nlohmann' 2024-06-26T07:01:16.2683234Z Submodule 'third_party/onnx' (https://github.com/onnx/onnx.git) registered for path 'third_party/onnx' 2024-06-26T07:01:16.2687043Z Submodule 'third_party/opentelemetry-cpp' (https://github.com/open-telemetry/opentelemetry-cpp.git) registered for path 'third_party/opentelemetry-cpp' 2024-06-26T07:01:16.2690212Z Submodule 'third_party/pocketfft' (https://github.com/mreineck/pocketfft) registered for path 'third_party/pocketfft' 2024-06-26T07:01:16.2693697Z Submodule 'third_party/protobuf' (https://github.com/protocolbuffers/protobuf.git) registered for path 'third_party/protobuf' 2024-06-26T07:01:16.2697316Z Submodule 'third_party/NNPACK_deps/psimd' (https://github.com/Maratyszcza/psimd.git) registered for path 'third_party/psimd' 2024-06-26T07:01:16.2701179Z Submodule 'third_party/NNPACK_deps/pthreadpool' (https://github.com/Maratyszcza/pthreadpool.git) registered for path 'third_party/pthreadpool' 2024-06-26T07:01:16.2704669Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/pybind11' 2024-06-26T07:01:16.2708767Z Submodule 'third_party/python-peachpy' (https://github.com/malfet/PeachPy.git) registered for path 'third_party/python-peachpy' 2024-06-26T07:01:16.2712414Z Submodule 'third_party/sleef' (https://github.com/shibatch/sleef) registered for path 'third_party/sleef' 2024-06-26T07:01:16.2716399Z Submodule 'third_party/tensorpipe' (https://github.com/pytorch/tensorpipe.git) registered for path 'third_party/tensorpipe' 2024-06-26T07:01:16.2736012Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/android/libs/fbjni'... 2024-06-26T07:01:16.5305962Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FP16'... 2024-06-26T07:01:16.7003336Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FXdiv'... 2024-06-26T07:01:16.8861310Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/NNPACK'... 2024-06-26T07:01:17.1193415Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/VulkanMemoryAllocator'... 2024-06-26T07:01:19.1607993Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/XNNPACK'... 2024-06-26T07:01:29.0475088Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/benchmark'... 2024-06-26T07:01:29.4234436Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpp-httplib'... 2024-06-26T07:01:29.9209947Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpuinfo'... 2024-06-26T07:01:30.4891832Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cudnn_frontend'... 2024-06-26T07:01:31.6423176Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cutlass'... 2024-06-26T07:01:33.3968159Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/eigen'... 2024-06-26T07:01:39.2873760Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm'... 2024-06-26T07:01:40.6031175Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/flatbuffers'... 2024-06-26T07:01:42.2382735Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fmt'... 2024-06-26T07:01:43.4393355Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/foxi'... 2024-06-26T07:01:43.5842855Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gemmlowp/gemmlowp'... 2024-06-26T07:01:44.0310778Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gloo'... 2024-06-26T07:01:44.3446130Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/googletest'... 2024-06-26T07:01:45.3108548Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep'... 2024-06-26T07:01:45.6332807Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ittapi'... 2024-06-26T07:01:45.8791931Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto'... 2024-06-26T07:01:47.3363152Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/mimalloc'... 2024-06-26T07:01:48.0543146Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nccl/nccl'... 2024-06-26T07:01:48.7508075Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nlohmann'... 2024-06-26T07:01:54.3702491Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx'... 2024-06-26T07:01:56.6439781Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp'... 2024-06-26T07:02:02.2477506Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pocketfft'... 2024-06-26T07:02:02.4591742Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf'... 2024-06-26T07:02:10.7450397Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/psimd'... 2024-06-26T07:02:10.9019795Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pthreadpool'... 2024-06-26T07:02:11.0729072Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pybind11'... 2024-06-26T07:02:12.1235483Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/python-peachpy'... 2024-06-26T07:02:12.4068306Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/sleef'... 2024-06-26T07:02:13.0308568Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe'... 2024-06-26T07:02:13.4511623Z Submodule path 'android/libs/fbjni': checked out '7e1e1fe3858c63c251c637ae41a20de425dde96f' 2024-06-26T07:02:13.4592969Z Submodule path 'third_party/FP16': checked out '4dfe081cf6bcd15db339cf2680b9281b8451eeb3' 2024-06-26T07:02:13.4655290Z Submodule path 'third_party/FXdiv': checked out 'b408327ac2a15ec3e43352421954f5b1967701d1' 2024-06-26T07:02:13.4834586Z Submodule path 'third_party/NNPACK': checked out 'c07e3a0400713d546e0dea2d5466dd22ea389c73' 2024-06-26T07:02:13.5121527Z Submodule path 'third_party/VulkanMemoryAllocator': checked out 'a6bfc237255a6bac1513f7c1ebde6d8aed6b5191' 2024-06-26T07:02:14.2861508Z Submodule path 'third_party/XNNPACK': checked out 'fcbf55af6cf28a4627bcd1f703ab7ad843f0f3a2' 2024-06-26T07:02:14.3034612Z Submodule path 'third_party/benchmark': checked out '0d98dba29d66e93259db7daa53a9327df767a415' 2024-06-26T07:02:14.3391218Z Submodule path 'third_party/cpp-httplib': checked out '3b6597bba913d51161383657829b7e644e59c006' 2024-06-26T07:02:14.4233443Z Submodule path 'third_party/cpuinfo': checked out '3c8b1533ac03dd6531ab6e7b9245d488f13a82a5' 2024-06-26T07:02:14.4498921Z Submodule path 'third_party/cudnn_frontend': checked out 'aa3abd4bc689d6412979c7f55f9cd132848c9c6a' 2024-06-26T07:02:14.8757031Z Submodule path 'third_party/cutlass': checked out 'bbe579a9e3beb6ea6626d9227ec32d0dae119a49' 2024-06-26T07:02:15.0874428Z Submodule path 'third_party/eigen': checked out '3147391d946bb4b6c68edd901f2add6ac1f31f8c' 2024-06-26T07:02:15.1500731Z Submodule path 'third_party/fbgemm': checked out 'dbc3157bf256f1339b3fa1fef2be89ac4078be0e' 2024-06-26T07:02:15.1512555Z Submodule 'third_party/asmjit' (https://github.com/asmjit/asmjit.git) registered for path 'third_party/fbgemm/third_party/asmjit' 2024-06-26T07:02:15.1515492Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo) registered for path 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T07:02:15.1516972Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/fbgemm/third_party/cutlass' 2024-06-26T07:02:15.1518483Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/fbgemm/third_party/googletest' 2024-06-26T07:02:15.1520345Z Submodule 'third_party/hipify_torch' (https://github.com/ROCmSoftwarePlatform/hipify_torch.git) registered for path 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T07:02:15.1536381Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/asmjit'... 2024-06-26T07:02:16.1551204Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cpuinfo'... 2024-06-26T07:02:16.7170732Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cutlass'... 2024-06-26T07:02:18.4496857Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/googletest'... 2024-06-26T07:02:19.4500914Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/hipify_torch'... 2024-06-26T07:02:19.7863196Z Submodule path 'third_party/fbgemm/third_party/asmjit': checked out 'd3fbf7c9bc7c1d1365a94a45614b91c5a3706b81' 2024-06-26T07:02:19.8705174Z Submodule path 'third_party/fbgemm/third_party/cpuinfo': checked out 'ed8b86a253800bafdb7b25c5c399f91bff9cb1f3' 2024-06-26T07:02:20.2126380Z Submodule path 'third_party/fbgemm/third_party/cutlass': checked out 'fc9ebc645b63f3a6bc80aaefde5c063fb72110d6' 2024-06-26T07:02:20.2673953Z Submodule path 'third_party/fbgemm/third_party/googletest': checked out 'cbf019de22c8dd37b2108da35b2748fd702d1796' 2024-06-26T07:02:20.2760891Z Submodule path 'third_party/fbgemm/third_party/hipify_torch': checked out '23f53b025b466d8ec3c45d52290d3442f7fbe6b1' 2024-06-26T07:02:20.3688407Z Submodule path 'third_party/flatbuffers': checked out '01834de25e4bf3975a9a00e816292b1ad0fe184b' 2024-06-26T07:02:20.3974485Z Submodule path 'third_party/fmt': checked out 'e69e5f977d458f2650bb346dadf2ad30c5320281' 2024-06-26T07:02:20.4036683Z Submodule path 'third_party/foxi': checked out 'c278588e34e535f0bb8f00df3880d26928038cad' 2024-06-26T07:02:20.4344235Z Submodule path 'third_party/gemmlowp/gemmlowp': checked out '3fb5c176c17c765a3492cd2f0321b0dab712f350' 2024-06-26T07:02:20.4538146Z Submodule path 'third_party/gloo': checked out '5354032ea08eadd7fc4456477f7f7c6308818509' 2024-06-26T07:02:20.4904062Z Submodule path 'third_party/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2024-06-26T07:02:20.4996435Z Submodule path 'third_party/ideep': checked out '55ca0191687aaf19aca5cdb7881c791e3bea442b' 2024-06-26T07:02:20.5006050Z Submodule 'mkl-dnn' (https://github.com/intel/mkl-dnn.git) registered for path 'third_party/ideep/mkl-dnn' 2024-06-26T07:02:20.5021596Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep/mkl-dnn'... 2024-06-26T07:02:32.8388647Z Submodule path 'third_party/ideep/mkl-dnn': checked out '1137e04ec0b5251ca2b4400a4fd3c667ce843d67' 2024-06-26T07:02:32.8521548Z Submodule path 'third_party/ittapi': checked out '5b8a7d7422611c3a0d799fb5fc5dd4abfae35b42' 2024-06-26T07:02:32.9299030Z Submodule path 'third_party/kineto': checked out '8681ff11e1fa54da39023076c5c43eddd87b7a8a' 2024-06-26T07:02:32.9311875Z Submodule 'libkineto/third_party/dynolog' (https://github.com/facebookincubator/dynolog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T07:02:32.9313610Z Submodule 'libkineto/third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T07:02:32.9315463Z Submodule 'libkineto/third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T07:02:32.9333438Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog'... 2024-06-26T07:02:33.4466436Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/fmt'... 2024-06-26T07:02:34.7081478Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/googletest'... 2024-06-26T07:02:35.7787038Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog': checked out '7d04a0053a845370ae06ce317a22a48e9edcc74e' 2024-06-26T07:02:35.7797724Z Submodule 'third_party/DCGM' (https://github.com/NVIDIA/DCGM.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T07:02:35.7799734Z Submodule 'third_party/cpr' (https://github.com/libcpr/cpr.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T07:02:35.7801554Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T07:02:35.7831192Z Submodule 'third_party/gflags' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T07:02:35.7833683Z Submodule 'third_party/glog' (https://github.com/google/glog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T07:02:35.7835975Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T07:02:35.7838048Z Submodule 'third_party/json' (https://github.com/nlohmann/json.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T07:02:35.7839732Z Submodule 'third_party/pfs' (https://github.com/dtrugman/pfs.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T07:02:35.7841332Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'... 2024-06-26T07:02:36.8039541Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'... 2024-06-26T07:02:37.1627875Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'... 2024-06-26T07:02:38.3852700Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'... 2024-06-26T07:02:38.6472194Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/glog'... 2024-06-26T07:02:39.1363459Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'... 2024-06-26T07:02:40.1002196Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/json'... 2024-06-26T07:02:45.8221448Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'... 2024-06-26T07:02:46.1657619Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM': checked out 'ffde4e54bc7249a6039a5e6b45b395141e1217f9' 2024-06-26T07:02:46.1792134Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr': checked out '871ed52d350214a034f6ef8a3b8f51c5ce1bd400' 2024-06-26T07:02:46.2086971Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt': checked out 'cd4af11efc9c622896a3e4cb599fa28668ca3d05' 2024-06-26T07:02:46.2182139Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags': checked out 'e171aa2d15ed9eb17054558e0b3a6a413bb01067' 2024-06-26T07:02:46.2192419Z Submodule 'doc' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T07:02:46.2209135Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'... 2024-06-26T07:02:46.5007808Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc': checked out '8411df715cf522606e3b1aca386ddfc0b63d34b4' 2024-06-26T07:02:46.5150134Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog': checked out 'b33e3bad4c46c8a6345525fd822af355e5ef9446' 2024-06-26T07:02:46.5486293Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest': checked out '58d77fa8070e8cec2dc1ed015d66b454c8d78850' 2024-06-26T07:02:46.6308715Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json': checked out '4f8fba14066156b73f1189a2b8bd568bde5284c5' 2024-06-26T07:02:46.6431537Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs': checked out 'f68a2fa8ea36c783bdd760371411fcb495aa3150' 2024-06-26T07:02:46.6724063Z Submodule path 'third_party/kineto/libkineto/third_party/fmt': checked out 'a33701196adfad74917046096bf5a2aa0ab0bb50' 2024-06-26T07:02:46.7212109Z Submodule path 'third_party/kineto/libkineto/third_party/googletest': checked out '7aca84427f224eeed3144123d5230d5871e93347' 2024-06-26T07:02:46.7518260Z Submodule path 'third_party/mimalloc': checked out 'b66e3214d8a104669c2ec05ae91ebc26a8f5ab78' 2024-06-26T07:02:46.7713821Z Submodule path 'third_party/nccl/nccl': checked out '48bb7fec7953112ff37499a272317f6663f8f600' 2024-06-26T07:02:46.8568193Z Submodule path 'third_party/nlohmann': checked out '87cda1d6646592ac5866dc703c8e1839046a6806' 2024-06-26T07:02:47.1357483Z Submodule path 'third_party/onnx': checked out '990217f043af7222348ca8f0301e17fa7b841781' 2024-06-26T07:02:47.1382367Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/onnx/third_party/benchmark' 2024-06-26T07:02:47.1384164Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/onnx/third_party/pybind11' 2024-06-26T07:02:47.1400192Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx/third_party/benchmark'... 2024-06-26T07:02:47.5340707Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx/third_party/pybind11'... 2024-06-26T07:02:48.5299388Z Submodule path 'third_party/onnx/third_party/benchmark': checked out '2dd015dfef425c866d9a43f2c67d8b52d709acb6' 2024-06-26T07:02:48.5584451Z Submodule path 'third_party/onnx/third_party/pybind11': checked out '5b0a6fc2017fcc176545afe3e09c9f9885283242' 2024-06-26T07:02:48.6110090Z Submodule path 'third_party/opentelemetry-cpp': checked out 'a799f4aed9c94b765dcdaabaeab7d5e7e2310878' 2024-06-26T07:02:48.6121512Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark) registered for path 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T07:02:48.6123545Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T07:02:48.6125472Z Submodule 'third_party/ms-gsl' (https://github.com/microsoft/GSL) registered for path 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T07:02:48.6127359Z Submodule 'third_party/nlohmann-json' (https://github.com/nlohmann/json) registered for path 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T07:02:48.6129493Z Submodule 'third_party/opentelemetry-proto' (https://github.com/open-telemetry/opentelemetry-proto) registered for path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T07:02:48.6131811Z Submodule 'third_party/opentracing-cpp' (https://github.com/opentracing/opentracing-cpp.git) registered for path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T07:02:48.6133875Z Submodule 'third_party/prometheus-cpp' (https://github.com/jupp0r/prometheus-cpp) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T07:02:48.6135753Z Submodule 'tools/vcpkg' (https://github.com/Microsoft/vcpkg) registered for path 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T07:02:48.6151692Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/benchmark'... 2024-06-26T07:02:48.9993121Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/googletest'... 2024-06-26T07:02:50.1855908Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/ms-gsl'... 2024-06-26T07:02:50.5921742Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/nlohmann-json'... 2024-06-26T07:02:56.1943376Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentelemetry-proto'... 2024-06-26T07:02:56.4804314Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentracing-cpp'... 2024-06-26T07:02:56.6641146Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp'... 2024-06-26T07:02:56.9568943Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/tools/vcpkg'... 2024-06-26T07:03:04.4050053Z Submodule path 'third_party/opentelemetry-cpp/third_party/benchmark': checked out 'd572f4777349d43653b21d6c2fc63020ab326db2' 2024-06-26T07:03:04.4381501Z Submodule path 'third_party/opentelemetry-cpp/third_party/googletest': checked out 'b796f7d44681514f58a683a3a71ff17c94edb0c1' 2024-06-26T07:03:04.4503879Z Submodule path 'third_party/opentelemetry-cpp/third_party/ms-gsl': checked out '6f4529395c5b7c2d661812257cd6780c67e54afa' 2024-06-26T07:03:04.5344282Z Submodule path 'third_party/opentelemetry-cpp/third_party/nlohmann-json': checked out 'bc889afb4c5bf1c0d8ee29ef35eaaf4c8bef8a5d' 2024-06-26T07:03:04.5439447Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto': checked out '4ca4f0335c63cda7ab31ea7ed70d6553aee14dce' 2024-06-26T07:03:04.5545210Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp': checked out '06b57f48ded1fa3bdd3d4346f6ef29e40e08eaf5' 2024-06-26T07:03:04.5659063Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp': checked out 'c9ffcdda9086ffd9e1283ea7a0276d831f3c8a8d' 2024-06-26T07:03:04.5669040Z Submodule 'civetweb' (https://github.com/civetweb/civetweb.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T07:03:04.5671329Z Submodule 'googletest' (https://github.com/google/googletest.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T07:03:04.5687520Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'... 2024-06-26T07:03:06.3522093Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'... 2024-06-26T07:03:07.5258602Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb': checked out 'eefb26f82b233268fc98577d265352720d477ba4' 2024-06-26T07:03:07.5624993Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2024-06-26T07:03:07.9229323Z Submodule path 'third_party/opentelemetry-cpp/tools/vcpkg': checked out '8eb57355a4ffb410a2e94c07b4dca2dffbee8e50' 2024-06-26T07:03:07.9308548Z Submodule path 'third_party/pocketfft': checked out '9d3ab05a7fffbc71a492bc6a17be034e83e8f0fe' 2024-06-26T07:03:08.1463468Z Submodule path 'third_party/protobuf': checked out 'd1eca4e4b421cd2997495c4b4e65cea6be4e9b8a' 2024-06-26T07:03:08.1479960Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/protobuf/third_party/benchmark' 2024-06-26T07:03:08.1481833Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/protobuf/third_party/googletest' 2024-06-26T07:03:08.1498638Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/benchmark'... 2024-06-26T07:03:08.5780653Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/googletest'... 2024-06-26T07:03:09.5449744Z Submodule path 'third_party/protobuf/third_party/benchmark': checked out '5b7683f49e1e9223cf9927b24f6fd3d6bd82e3f8' 2024-06-26T07:03:09.6070758Z Submodule path 'third_party/protobuf/third_party/googletest': checked out '5ec7f0c4a113e2f18ac2c6cc7df51ad6afc24081' 2024-06-26T07:03:09.6134531Z Submodule path 'third_party/psimd': checked out '072586a71b55b7f8c584153d223e95687148a900' 2024-06-26T07:03:09.6225357Z Submodule path 'third_party/pthreadpool': checked out '4fe0e1e183925bf8cfa6aae24237e724a96479b8' 2024-06-26T07:03:09.6508235Z Submodule path 'third_party/pybind11': checked out '3e9dfa2866941655c56877882565e7577de6fc7b' 2024-06-26T07:03:09.6732731Z Submodule path 'third_party/python-peachpy': checked out 'f45429b087dd7d5bc78bb40dc7cf06425c252d67' 2024-06-26T07:03:09.7067534Z Submodule path 'third_party/sleef': checked out '60e76d2bce17d278b439d9da17177c8f957a9e9b' 2024-06-26T07:03:09.7270653Z Submodule path 'third_party/tensorpipe': checked out '52791a2fd214b2a9dc5759d36725909c1daa7f2e' 2024-06-26T07:03:09.7281963Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/tensorpipe/third_party/googletest' 2024-06-26T07:03:09.7284629Z Submodule 'third_party/libnop' (https://github.com/google/libnop.git) registered for path 'third_party/tensorpipe/third_party/libnop' 2024-06-26T07:03:09.7286138Z Submodule 'third_party/libuv' (https://github.com/libuv/libuv.git) registered for path 'third_party/tensorpipe/third_party/libuv' 2024-06-26T07:03:09.7287615Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T07:03:09.7302999Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/googletest'... 2024-06-26T07:03:10.7038569Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libnop'... 2024-06-26T07:03:10.9633929Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libuv'... 2024-06-26T07:03:11.9693076Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11'... 2024-06-26T07:03:13.0464727Z Submodule path 'third_party/tensorpipe/third_party/googletest': checked out 'aee0f9d9b5b87796ee8a0ab26b7587ec30e8858e' 2024-06-26T07:03:13.0577796Z Submodule path 'third_party/tensorpipe/third_party/libnop': checked out '910b55815be16109f04f4180e9adee14fb4ce281' 2024-06-26T07:03:13.1140992Z Submodule path 'third_party/tensorpipe/third_party/libuv': checked out '1dff88e5161cba5c59276d2070d2e304e4dcb242' 2024-06-26T07:03:13.1369689Z Submodule path 'third_party/tensorpipe/third_party/pybind11': checked out 'a23996fce38ff6ccfbcdc09f1e63f2c4be5ea2ef' 2024-06-26T07:03:13.1380942Z Submodule 'tools/clang' (https://github.com/wjakob/clang-cindex-python3) registered for path 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T07:03:13.1398406Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11/tools/clang'... 2024-06-26T07:03:13.3146916Z Submodule path 'third_party/tensorpipe/third_party/pybind11/tools/clang': checked out '6a00cbc4a9b8e68b71caf7f774b3f9c753ae84d5' 2024-06-26T07:03:13.3169452Z [command]/usr/bin/git submodule foreach --recursive git config --local gc.auto 0 2024-06-26T07:03:13.3377987Z Entering 'android/libs/fbjni' 2024-06-26T07:03:13.3405710Z Entering 'third_party/FP16' 2024-06-26T07:03:13.3431266Z Entering 'third_party/FXdiv' 2024-06-26T07:03:13.3458984Z Entering 'third_party/NNPACK' 2024-06-26T07:03:13.3488486Z Entering 'third_party/VulkanMemoryAllocator' 2024-06-26T07:03:13.3515923Z Entering 'third_party/XNNPACK' 2024-06-26T07:03:13.3555852Z Entering 'third_party/benchmark' 2024-06-26T07:03:13.3582981Z Entering 'third_party/cpp-httplib' 2024-06-26T07:03:13.3613209Z Entering 'third_party/cpuinfo' 2024-06-26T07:03:13.3641205Z Entering 'third_party/cudnn_frontend' 2024-06-26T07:03:13.3668077Z Entering 'third_party/cutlass' 2024-06-26T07:03:13.3701818Z Entering 'third_party/eigen' 2024-06-26T07:03:13.3729613Z Entering 'third_party/fbgemm' 2024-06-26T07:03:13.3756433Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-06-26T07:03:13.3784365Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T07:03:13.3811415Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-06-26T07:03:13.3842175Z Entering 'third_party/fbgemm/third_party/googletest' 2024-06-26T07:03:13.3869427Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T07:03:13.3898056Z Entering 'third_party/flatbuffers' 2024-06-26T07:03:13.3927957Z Entering 'third_party/fmt' 2024-06-26T07:03:13.3955190Z Entering 'third_party/foxi' 2024-06-26T07:03:13.3985268Z Entering 'third_party/gemmlowp/gemmlowp' 2024-06-26T07:03:13.4014640Z Entering 'third_party/gloo' 2024-06-26T07:03:13.4041249Z Entering 'third_party/googletest' 2024-06-26T07:03:13.4068031Z Entering 'third_party/ideep' 2024-06-26T07:03:13.4096183Z Entering 'third_party/ideep/mkl-dnn' 2024-06-26T07:03:13.4127316Z Entering 'third_party/ittapi' 2024-06-26T07:03:13.4153260Z Entering 'third_party/kineto' 2024-06-26T07:03:13.4180850Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T07:03:13.4209298Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T07:03:13.4236207Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T07:03:13.4262654Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T07:03:13.4289118Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T07:03:13.4316054Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T07:03:13.4345007Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T07:03:13.4373384Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T07:03:13.4399621Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T07:03:13.4426949Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T07:03:13.4456450Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T07:03:13.4482704Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T07:03:13.4510753Z Entering 'third_party/mimalloc' 2024-06-26T07:03:13.4540908Z Entering 'third_party/nccl/nccl' 2024-06-26T07:03:13.4567952Z Entering 'third_party/nlohmann' 2024-06-26T07:03:13.4597172Z Entering 'third_party/onnx' 2024-06-26T07:03:13.4637656Z Entering 'third_party/onnx/third_party/benchmark' 2024-06-26T07:03:13.4666802Z Entering 'third_party/onnx/third_party/pybind11' 2024-06-26T07:03:13.4698869Z Entering 'third_party/opentelemetry-cpp' 2024-06-26T07:03:13.4729228Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T07:03:13.4757060Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T07:03:13.4783818Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T07:03:13.4812508Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T07:03:13.4838545Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T07:03:13.4866188Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T07:03:13.4892395Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T07:03:13.4919669Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T07:03:13.4949179Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T07:03:13.4976105Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T07:03:13.5018905Z Entering 'third_party/pocketfft' 2024-06-26T07:03:13.5046186Z Entering 'third_party/protobuf' 2024-06-26T07:03:13.5076507Z Entering 'third_party/protobuf/third_party/benchmark' 2024-06-26T07:03:13.5104885Z Entering 'third_party/protobuf/third_party/googletest' 2024-06-26T07:03:13.5134975Z Entering 'third_party/psimd' 2024-06-26T07:03:13.5162245Z Entering 'third_party/pthreadpool' 2024-06-26T07:03:13.5189838Z Entering 'third_party/pybind11' 2024-06-26T07:03:13.5218622Z Entering 'third_party/python-peachpy' 2024-06-26T07:03:13.5246738Z Entering 'third_party/sleef' 2024-06-26T07:03:13.5274948Z Entering 'third_party/tensorpipe' 2024-06-26T07:03:13.5301790Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-06-26T07:03:13.5330627Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-06-26T07:03:13.5356866Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-06-26T07:03:13.5384709Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T07:03:13.5412141Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T07:03:13.5454475Z ##[endgroup] 2024-06-26T07:03:13.5456322Z ##[group]Persisting credentials for submodules 2024-06-26T07:03:13.5460227Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'url\.https\:\/\/github\.com\/\.insteadOf' && git config --local --unset-all 'url.https://github.com/.insteadOf' || :" 2024-06-26T07:03:13.5672176Z Entering 'android/libs/fbjni' 2024-06-26T07:03:13.5706860Z Entering 'third_party/FP16' 2024-06-26T07:03:13.5742559Z Entering 'third_party/FXdiv' 2024-06-26T07:03:13.5777206Z Entering 'third_party/NNPACK' 2024-06-26T07:03:13.5812171Z Entering 'third_party/VulkanMemoryAllocator' 2024-06-26T07:03:13.5848355Z Entering 'third_party/XNNPACK' 2024-06-26T07:03:13.5891511Z Entering 'third_party/benchmark' 2024-06-26T07:03:13.5928136Z Entering 'third_party/cpp-httplib' 2024-06-26T07:03:13.5962254Z Entering 'third_party/cpuinfo' 2024-06-26T07:03:13.5994537Z Entering 'third_party/cudnn_frontend' 2024-06-26T07:03:13.6028599Z Entering 'third_party/cutlass' 2024-06-26T07:03:13.6070710Z Entering 'third_party/eigen' 2024-06-26T07:03:13.6108703Z Entering 'third_party/fbgemm' 2024-06-26T07:03:13.6144180Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-06-26T07:03:13.6178682Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T07:03:13.6213564Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-06-26T07:03:13.6252648Z Entering 'third_party/fbgemm/third_party/googletest' 2024-06-26T07:03:13.6287631Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T07:03:13.6323160Z Entering 'third_party/flatbuffers' 2024-06-26T07:03:13.6357844Z Entering 'third_party/fmt' 2024-06-26T07:03:13.6393753Z Entering 'third_party/foxi' 2024-06-26T07:03:13.6426358Z Entering 'third_party/gemmlowp/gemmlowp' 2024-06-26T07:03:13.6462145Z Entering 'third_party/gloo' 2024-06-26T07:03:13.6496821Z Entering 'third_party/googletest' 2024-06-26T07:03:13.6533899Z Entering 'third_party/ideep' 2024-06-26T07:03:13.6569780Z Entering 'third_party/ideep/mkl-dnn' 2024-06-26T07:03:13.6607726Z Entering 'third_party/ittapi' 2024-06-26T07:03:13.6642936Z Entering 'third_party/kineto' 2024-06-26T07:03:13.6677435Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T07:03:13.6712325Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T07:03:13.6747871Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T07:03:13.6781776Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T07:03:13.6816943Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T07:03:13.6851602Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T07:03:13.6887874Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T07:03:13.6922414Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T07:03:13.6955669Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T07:03:13.6991818Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T07:03:13.7026368Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T07:03:13.7061753Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T07:03:13.7096634Z Entering 'third_party/mimalloc' 2024-06-26T07:03:13.7134114Z Entering 'third_party/nccl/nccl' 2024-06-26T07:03:13.7168320Z Entering 'third_party/nlohmann' 2024-06-26T07:03:13.7204026Z Entering 'third_party/onnx' 2024-06-26T07:03:13.7248102Z Entering 'third_party/onnx/third_party/benchmark' 2024-06-26T07:03:13.7283704Z Entering 'third_party/onnx/third_party/pybind11' 2024-06-26T07:03:13.7318554Z Entering 'third_party/opentelemetry-cpp' 2024-06-26T07:03:13.7355215Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T07:03:13.7389578Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T07:03:13.7423100Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T07:03:13.7456408Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T07:03:13.7491193Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T07:03:13.7523308Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T07:03:13.7558192Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T07:03:13.7590019Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T07:03:13.7625253Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T07:03:13.7661447Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T07:03:13.7712231Z Entering 'third_party/pocketfft' 2024-06-26T07:03:13.7747095Z Entering 'third_party/protobuf' 2024-06-26T07:03:13.7785532Z Entering 'third_party/protobuf/third_party/benchmark' 2024-06-26T07:03:13.7819501Z Entering 'third_party/protobuf/third_party/googletest' 2024-06-26T07:03:13.7856151Z Entering 'third_party/psimd' 2024-06-26T07:03:13.7891152Z Entering 'third_party/pthreadpool' 2024-06-26T07:03:13.7926568Z Entering 'third_party/pybind11' 2024-06-26T07:03:13.7961750Z Entering 'third_party/python-peachpy' 2024-06-26T07:03:13.7998435Z Entering 'third_party/sleef' 2024-06-26T07:03:13.8035589Z Entering 'third_party/tensorpipe' 2024-06-26T07:03:13.8069869Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-06-26T07:03:13.8102732Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-06-26T07:03:13.8137297Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-06-26T07:03:13.8171925Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T07:03:13.8206758Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T07:03:13.8253822Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local 'http.https://github.com/.extraheader' 'AUTHORIZATION: basic ***' && git config --local --show-origin --name-only --get-regexp remote.origin.url" 2024-06-26T07:03:13.8461083Z Entering 'android/libs/fbjni' 2024-06-26T07:03:13.8492848Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/android/libs/fbjni/config remote.origin.url 2024-06-26T07:03:13.8506095Z Entering 'third_party/FP16' 2024-06-26T07:03:13.8537983Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FP16/config remote.origin.url 2024-06-26T07:03:13.8552032Z Entering 'third_party/FXdiv' 2024-06-26T07:03:13.8583577Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FXdiv/config remote.origin.url 2024-06-26T07:03:13.8597554Z Entering 'third_party/NNPACK' 2024-06-26T07:03:13.8628851Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK/config remote.origin.url 2024-06-26T07:03:13.8641811Z Entering 'third_party/VulkanMemoryAllocator' 2024-06-26T07:03:13.8673471Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/VulkanMemoryAllocator/config remote.origin.url 2024-06-26T07:03:13.8685661Z Entering 'third_party/XNNPACK' 2024-06-26T07:03:13.8716237Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/XNNPACK/config remote.origin.url 2024-06-26T07:03:13.8741331Z Entering 'third_party/benchmark' 2024-06-26T07:03:13.8771922Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/benchmark/config remote.origin.url 2024-06-26T07:03:13.8785890Z Entering 'third_party/cpp-httplib' 2024-06-26T07:03:13.8817089Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpp-httplib/config remote.origin.url 2024-06-26T07:03:13.8829372Z Entering 'third_party/cpuinfo' 2024-06-26T07:03:13.8860555Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpuinfo/config remote.origin.url 2024-06-26T07:03:13.8875336Z Entering 'third_party/cudnn_frontend' 2024-06-26T07:03:13.8906897Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cudnn_frontend/config remote.origin.url 2024-06-26T07:03:13.8920701Z Entering 'third_party/cutlass' 2024-06-26T07:03:13.8950850Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cutlass/config remote.origin.url 2024-06-26T07:03:13.8970256Z Entering 'third_party/eigen' 2024-06-26T07:03:13.9002450Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/eigen/config remote.origin.url 2024-06-26T07:03:13.9017458Z Entering 'third_party/fbgemm' 2024-06-26T07:03:13.9049502Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/config remote.origin.url 2024-06-26T07:03:13.9061804Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-06-26T07:03:13.9093726Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/asmjit/config remote.origin.url 2024-06-26T07:03:13.9106216Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T07:03:13.9138015Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cpuinfo/config remote.origin.url 2024-06-26T07:03:13.9150963Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-06-26T07:03:13.9181835Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cutlass/config remote.origin.url 2024-06-26T07:03:13.9199330Z Entering 'third_party/fbgemm/third_party/googletest' 2024-06-26T07:03:13.9230693Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/googletest/config remote.origin.url 2024-06-26T07:03:13.9243259Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T07:03:13.9272926Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/hipify_torch/config remote.origin.url 2024-06-26T07:03:13.9286058Z Entering 'third_party/flatbuffers' 2024-06-26T07:03:13.9315623Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/flatbuffers/config remote.origin.url 2024-06-26T07:03:13.9330075Z Entering 'third_party/fmt' 2024-06-26T07:03:13.9361046Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fmt/config remote.origin.url 2024-06-26T07:03:13.9373676Z Entering 'third_party/foxi' 2024-06-26T07:03:13.9405291Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/foxi/config remote.origin.url 2024-06-26T07:03:13.9419273Z Entering 'third_party/gemmlowp/gemmlowp' 2024-06-26T07:03:13.9450272Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gemmlowp/gemmlowp/config remote.origin.url 2024-06-26T07:03:13.9464348Z Entering 'third_party/gloo' 2024-06-26T07:03:13.9496619Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gloo/config remote.origin.url 2024-06-26T07:03:13.9509847Z Entering 'third_party/googletest' 2024-06-26T07:03:13.9540890Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/googletest/config remote.origin.url 2024-06-26T07:03:13.9554659Z Entering 'third_party/ideep' 2024-06-26T07:03:13.9586230Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/config remote.origin.url 2024-06-26T07:03:13.9598261Z Entering 'third_party/ideep/mkl-dnn' 2024-06-26T07:03:13.9629718Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/modules/mkl-dnn/config remote.origin.url 2024-06-26T07:03:13.9648374Z Entering 'third_party/ittapi' 2024-06-26T07:03:13.9679457Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ittapi/config remote.origin.url 2024-06-26T07:03:13.9693181Z Entering 'third_party/kineto' 2024-06-26T07:03:13.9725555Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/config remote.origin.url 2024-06-26T07:03:13.9738943Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T07:03:13.9772058Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/config remote.origin.url 2024-06-26T07:03:13.9783401Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T07:03:13.9814322Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/DCGM/config remote.origin.url 2024-06-26T07:03:13.9827658Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T07:03:13.9860508Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/cpr/config remote.origin.url 2024-06-26T07:03:13.9873155Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T07:03:13.9904071Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/fmt/config remote.origin.url 2024-06-26T07:03:13.9915954Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T07:03:13.9948210Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/config remote.origin.url 2024-06-26T07:03:13.9960163Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T07:03:13.9991905Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/modules/doc/config remote.origin.url 2024-06-26T07:03:14.0005601Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T07:03:14.0038628Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/glog/config remote.origin.url 2024-06-26T07:03:14.0051306Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T07:03:14.0085026Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/googletest/config remote.origin.url 2024-06-26T07:03:14.0097783Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T07:03:14.0129729Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/json/config remote.origin.url 2024-06-26T07:03:14.0143405Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T07:03:14.0175805Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/pfs/config remote.origin.url 2024-06-26T07:03:14.0189797Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T07:03:14.0221234Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/fmt/config remote.origin.url 2024-06-26T07:03:14.0233891Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T07:03:14.0266020Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/googletest/config remote.origin.url 2024-06-26T07:03:14.0279120Z Entering 'third_party/mimalloc' 2024-06-26T07:03:14.0311760Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/mimalloc/config remote.origin.url 2024-06-26T07:03:14.0324879Z Entering 'third_party/nccl/nccl' 2024-06-26T07:03:14.0355436Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nccl/nccl/config remote.origin.url 2024-06-26T07:03:14.0368213Z Entering 'third_party/nlohmann' 2024-06-26T07:03:14.0398183Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nlohmann/config remote.origin.url 2024-06-26T07:03:14.0412669Z Entering 'third_party/onnx' 2024-06-26T07:03:14.0443119Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/config remote.origin.url 2024-06-26T07:03:14.0469629Z Entering 'third_party/onnx/third_party/benchmark' 2024-06-26T07:03:14.0501361Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/benchmark/config remote.origin.url 2024-06-26T07:03:14.0513767Z Entering 'third_party/onnx/third_party/pybind11' 2024-06-26T07:03:14.0544559Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/pybind11/config remote.origin.url 2024-06-26T07:03:14.0561182Z Entering 'third_party/opentelemetry-cpp' 2024-06-26T07:03:14.0594049Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/config remote.origin.url 2024-06-26T07:03:14.0608324Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T07:03:14.0641146Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/benchmark/config remote.origin.url 2024-06-26T07:03:14.0653787Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T07:03:14.0684953Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/googletest/config remote.origin.url 2024-06-26T07:03:14.0697496Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T07:03:14.0729459Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/ms-gsl/config remote.origin.url 2024-06-26T07:03:14.0740919Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T07:03:14.0772279Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/nlohmann-json/config remote.origin.url 2024-06-26T07:03:14.0785886Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T07:03:14.0818334Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentelemetry-proto/config remote.origin.url 2024-06-26T07:03:14.0830686Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T07:03:14.0860905Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentracing-cpp/config remote.origin.url 2024-06-26T07:03:14.0874188Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T07:03:14.0907856Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/config remote.origin.url 2024-06-26T07:03:14.0920302Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T07:03:14.0951938Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/civetweb/config remote.origin.url 2024-06-26T07:03:14.0965255Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T07:03:14.0996136Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/googletest/config remote.origin.url 2024-06-26T07:03:14.1009016Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T07:03:14.1039587Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/tools/vcpkg/config remote.origin.url 2024-06-26T07:03:14.1068402Z Entering 'third_party/pocketfft' 2024-06-26T07:03:14.1100300Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pocketfft/config remote.origin.url 2024-06-26T07:03:14.1113069Z Entering 'third_party/protobuf' 2024-06-26T07:03:14.1146035Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/config remote.origin.url 2024-06-26T07:03:14.1161450Z Entering 'third_party/protobuf/third_party/benchmark' 2024-06-26T07:03:14.1193215Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/benchmark/config remote.origin.url 2024-06-26T07:03:14.1204621Z Entering 'third_party/protobuf/third_party/googletest' 2024-06-26T07:03:14.1235765Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/googletest/config remote.origin.url 2024-06-26T07:03:14.1250908Z Entering 'third_party/psimd' 2024-06-26T07:03:14.1284667Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/psimd/config remote.origin.url 2024-06-26T07:03:14.1296939Z Entering 'third_party/pthreadpool' 2024-06-26T07:03:14.1328808Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/pthreadpool/config remote.origin.url 2024-06-26T07:03:14.1340815Z Entering 'third_party/pybind11' 2024-06-26T07:03:14.1371899Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pybind11/config remote.origin.url 2024-06-26T07:03:14.1385197Z Entering 'third_party/python-peachpy' 2024-06-26T07:03:14.1417820Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/python-peachpy/config remote.origin.url 2024-06-26T07:03:14.1432322Z Entering 'third_party/sleef' 2024-06-26T07:03:14.1463637Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/sleef/config remote.origin.url 2024-06-26T07:03:14.1477844Z Entering 'third_party/tensorpipe' 2024-06-26T07:03:14.1512603Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/config remote.origin.url 2024-06-26T07:03:14.1525168Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-06-26T07:03:14.1556319Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/googletest/config remote.origin.url 2024-06-26T07:03:14.1567970Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-06-26T07:03:14.1600959Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libnop/config remote.origin.url 2024-06-26T07:03:14.1613449Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-06-26T07:03:14.1644667Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libuv/config remote.origin.url 2024-06-26T07:03:14.1657252Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T07:03:14.1689551Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/config remote.origin.url 2024-06-26T07:03:14.1701453Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T07:03:14.1734719Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/modules/tools/clang/config remote.origin.url 2024-06-26T07:03:14.2564607Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'git@github.com:' 2024-06-26T07:03:14.2771266Z Entering 'android/libs/fbjni' 2024-06-26T07:03:14.2797879Z Entering 'third_party/FP16' 2024-06-26T07:03:14.2825480Z Entering 'third_party/FXdiv' 2024-06-26T07:03:14.2853980Z Entering 'third_party/NNPACK' 2024-06-26T07:03:14.2881437Z Entering 'third_party/VulkanMemoryAllocator' 2024-06-26T07:03:14.2908854Z Entering 'third_party/XNNPACK' 2024-06-26T07:03:14.2946981Z Entering 'third_party/benchmark' 2024-06-26T07:03:14.2976600Z Entering 'third_party/cpp-httplib' 2024-06-26T07:03:14.3003925Z Entering 'third_party/cpuinfo' 2024-06-26T07:03:14.3035670Z Entering 'third_party/cudnn_frontend' 2024-06-26T07:03:14.3064037Z Entering 'third_party/cutlass' 2024-06-26T07:03:14.3095891Z Entering 'third_party/eigen' 2024-06-26T07:03:14.3124841Z Entering 'third_party/fbgemm' 2024-06-26T07:03:14.3153450Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-06-26T07:03:14.3180273Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T07:03:14.3209547Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-06-26T07:03:14.3241464Z Entering 'third_party/fbgemm/third_party/googletest' 2024-06-26T07:03:14.3269247Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T07:03:14.3297235Z Entering 'third_party/flatbuffers' 2024-06-26T07:03:14.3326953Z Entering 'third_party/fmt' 2024-06-26T07:03:14.3353513Z Entering 'third_party/foxi' 2024-06-26T07:03:14.3381601Z Entering 'third_party/gemmlowp/gemmlowp' 2024-06-26T07:03:14.3410756Z Entering 'third_party/gloo' 2024-06-26T07:03:14.3438299Z Entering 'third_party/googletest' 2024-06-26T07:03:14.3468769Z Entering 'third_party/ideep' 2024-06-26T07:03:14.3496870Z Entering 'third_party/ideep/mkl-dnn' 2024-06-26T07:03:14.3529919Z Entering 'third_party/ittapi' 2024-06-26T07:03:14.3556358Z Entering 'third_party/kineto' 2024-06-26T07:03:14.3585134Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T07:03:14.3612491Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T07:03:14.3642419Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T07:03:14.3667989Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T07:03:14.3695933Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T07:03:14.3721973Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T07:03:14.3750815Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T07:03:14.3778879Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T07:03:14.3806605Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T07:03:14.3833513Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T07:03:14.3861051Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T07:03:14.3890072Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T07:03:14.3917530Z Entering 'third_party/mimalloc' 2024-06-26T07:03:14.3946807Z Entering 'third_party/nccl/nccl' 2024-06-26T07:03:14.3976396Z Entering 'third_party/nlohmann' 2024-06-26T07:03:14.4006284Z Entering 'third_party/onnx' 2024-06-26T07:03:14.4046305Z Entering 'third_party/onnx/third_party/benchmark' 2024-06-26T07:03:14.4074806Z Entering 'third_party/onnx/third_party/pybind11' 2024-06-26T07:03:14.4106079Z Entering 'third_party/opentelemetry-cpp' 2024-06-26T07:03:14.4133914Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T07:03:14.4161917Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T07:03:14.4187799Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T07:03:14.4214512Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T07:03:14.4243430Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T07:03:14.4271752Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T07:03:14.4299011Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T07:03:14.4327549Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T07:03:14.4357115Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T07:03:14.4386185Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T07:03:14.4430448Z Entering 'third_party/pocketfft' 2024-06-26T07:03:14.4457936Z Entering 'third_party/protobuf' 2024-06-26T07:03:14.4486372Z Entering 'third_party/protobuf/third_party/benchmark' 2024-06-26T07:03:14.4514705Z Entering 'third_party/protobuf/third_party/googletest' 2024-06-26T07:03:14.4542718Z Entering 'third_party/psimd' 2024-06-26T07:03:14.4572566Z Entering 'third_party/pthreadpool' 2024-06-26T07:03:14.4599753Z Entering 'third_party/pybind11' 2024-06-26T07:03:14.4628436Z Entering 'third_party/python-peachpy' 2024-06-26T07:03:14.4655705Z Entering 'third_party/sleef' 2024-06-26T07:03:14.4681902Z Entering 'third_party/tensorpipe' 2024-06-26T07:03:14.4711099Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-06-26T07:03:14.4739905Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-06-26T07:03:14.4765387Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-06-26T07:03:14.4792900Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T07:03:14.4820058Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T07:03:14.4860722Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'org-21003710@github.com:' 2024-06-26T07:03:14.5072709Z Entering 'android/libs/fbjni' 2024-06-26T07:03:14.5098027Z Entering 'third_party/FP16' 2024-06-26T07:03:14.5125372Z Entering 'third_party/FXdiv' 2024-06-26T07:03:14.5152179Z Entering 'third_party/NNPACK' 2024-06-26T07:03:14.5179403Z Entering 'third_party/VulkanMemoryAllocator' 2024-06-26T07:03:14.5207542Z Entering 'third_party/XNNPACK' 2024-06-26T07:03:14.5248106Z Entering 'third_party/benchmark' 2024-06-26T07:03:14.5276397Z Entering 'third_party/cpp-httplib' 2024-06-26T07:03:14.5302717Z Entering 'third_party/cpuinfo' 2024-06-26T07:03:14.5333092Z Entering 'third_party/cudnn_frontend' 2024-06-26T07:03:14.5360637Z Entering 'third_party/cutlass' 2024-06-26T07:03:14.5394674Z Entering 'third_party/eigen' 2024-06-26T07:03:14.5423204Z Entering 'third_party/fbgemm' 2024-06-26T07:03:14.5452333Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-06-26T07:03:14.5478458Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T07:03:14.5505574Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-06-26T07:03:14.5537380Z Entering 'third_party/fbgemm/third_party/googletest' 2024-06-26T07:03:14.5563656Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T07:03:14.5592324Z Entering 'third_party/flatbuffers' 2024-06-26T07:03:14.5621716Z Entering 'third_party/fmt' 2024-06-26T07:03:14.5650753Z Entering 'third_party/foxi' 2024-06-26T07:03:14.5678174Z Entering 'third_party/gemmlowp/gemmlowp' 2024-06-26T07:03:14.5707079Z Entering 'third_party/gloo' 2024-06-26T07:03:14.5736438Z Entering 'third_party/googletest' 2024-06-26T07:03:14.5764243Z Entering 'third_party/ideep' 2024-06-26T07:03:14.5791102Z Entering 'third_party/ideep/mkl-dnn' 2024-06-26T07:03:14.5824073Z Entering 'third_party/ittapi' 2024-06-26T07:03:14.5853479Z Entering 'third_party/kineto' 2024-06-26T07:03:14.5881904Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T07:03:14.5910483Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T07:03:14.5938344Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T07:03:14.5967761Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T07:03:14.5995832Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T07:03:14.6023126Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T07:03:14.6050271Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T07:03:14.6075827Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T07:03:14.6103599Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T07:03:14.6130670Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T07:03:14.6158661Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T07:03:14.6186207Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T07:03:14.6213625Z Entering 'third_party/mimalloc' 2024-06-26T07:03:14.6243420Z Entering 'third_party/nccl/nccl' 2024-06-26T07:03:14.6271851Z Entering 'third_party/nlohmann' 2024-06-26T07:03:14.6299613Z Entering 'third_party/onnx' 2024-06-26T07:03:14.6338474Z Entering 'third_party/onnx/third_party/benchmark' 2024-06-26T07:03:14.6367527Z Entering 'third_party/onnx/third_party/pybind11' 2024-06-26T07:03:14.6397275Z Entering 'third_party/opentelemetry-cpp' 2024-06-26T07:03:14.6428292Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T07:03:14.6456340Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T07:03:14.6485065Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T07:03:14.6512316Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T07:03:14.6540254Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T07:03:14.6565040Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T07:03:14.6590553Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T07:03:14.6618485Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T07:03:14.6648630Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T07:03:14.6677444Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T07:03:14.6720692Z Entering 'third_party/pocketfft' 2024-06-26T07:03:14.6748801Z Entering 'third_party/protobuf' 2024-06-26T07:03:14.6780100Z Entering 'third_party/protobuf/third_party/benchmark' 2024-06-26T07:03:14.6807405Z Entering 'third_party/protobuf/third_party/googletest' 2024-06-26T07:03:14.6837128Z Entering 'third_party/psimd' 2024-06-26T07:03:14.6865433Z Entering 'third_party/pthreadpool' 2024-06-26T07:03:14.6894982Z Entering 'third_party/pybind11' 2024-06-26T07:03:14.6922077Z Entering 'third_party/python-peachpy' 2024-06-26T07:03:14.6952410Z Entering 'third_party/sleef' 2024-06-26T07:03:14.6978834Z Entering 'third_party/tensorpipe' 2024-06-26T07:03:14.7005437Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-06-26T07:03:14.7033038Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-06-26T07:03:14.7059136Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-06-26T07:03:14.7085088Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T07:03:14.7112031Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T07:03:14.7149288Z ##[endgroup] 2024-06-26T07:03:14.7181434Z [command]/usr/bin/git log -1 --format='%H' 2024-06-26T07:03:14.7203786Z 'b8c4c54d347aa776934c60784e35936878ef18dc' 2024-06-26T07:03:14.7384624Z Prepare all required actions 2024-06-26T07:03:14.7385146Z Getting action download info 2024-06-26T07:03:14.8781277Z ##[group]Run ./.github/actions/setup-linux 2024-06-26T07:03:14.8781982Z env: 2024-06-26T07:03:14.8782333Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:03:14.8782750Z ##[endgroup] 2024-06-26T07:03:14.8843502Z ##[group]Run set -euo pipefail 2024-06-26T07:03:14.8844006Z set -euo pipefail 2024-06-26T07:03:14.8844547Z function get_ec2_metadata() { 2024-06-26T07:03:14.8845470Z  # Pulled from instance metadata endpoint for EC2 2024-06-26T07:03:14.8846429Z  # see https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/instancedata-data-retrieval.html 2024-06-26T07:03:14.8847277Z  category=$1 2024-06-26T07:03:14.8847881Z  # If it is GCP runner (runner name contains gcp), do not run this 2024-06-26T07:03:14.8848593Z  runner_name_str=i-0d0929ec639f8ba06 2024-06-26T07:03:14.8849161Z  if [[ -f /.inarc ]]; then 2024-06-26T07:03:14.8849735Z  echo "ARC Runner, no info on ec2 metadata" 2024-06-26T07:03:14.8850382Z  elif [[ $runner_name_str == *"gcp"* ]]; then 2024-06-26T07:03:14.8851145Z  echo "Runner is from Google Cloud Platform, No info on ec2 metadata" 2024-06-26T07:03:14.8851870Z  else 2024-06-26T07:03:14.8852441Z  curl -fsSL "http://169.254.169.254/latest/meta-data/${category}" 2024-06-26T07:03:14.8853090Z  fi 2024-06-26T07:03:14.8853457Z } 2024-06-26T07:03:14.8853890Z echo "ami-id: $(get_ec2_metadata ami-id)" 2024-06-26T07:03:14.8854741Z echo "instance-id: $(get_ec2_metadata instance-id)" 2024-06-26T07:03:14.8855518Z echo "instance-type: $(get_ec2_metadata instance-type)" 2024-06-26T07:03:14.8856217Z echo "system info $(uname -a)" 2024-06-26T07:03:14.8864189Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:03:14.8864769Z env: 2024-06-26T07:03:14.8865137Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:03:14.8865573Z ##[endgroup] 2024-06-26T07:03:14.8934540Z ami-id: ami-0ce0c36d7a00b20e2 2024-06-26T07:03:14.8973759Z instance-id: i-0d0929ec639f8ba06 2024-06-26T07:03:14.9013111Z instance-type: g5.4xlarge 2024-06-26T07:03:14.9018998Z system info Linux ip-10-0-21-147.ec2.internal 4.14.336-257.562.amzn2.x86_64 #1 SMP Sat Feb 24 09:50:35 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux 2024-06-26T07:03:14.9040727Z ##[group]Run echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> $GITHUB_OUTPUT 2024-06-26T07:03:14.9041759Z echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> $GITHUB_OUTPUT 2024-06-26T07:03:14.9050071Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:03:14.9050636Z env: 2024-06-26T07:03:14.9050988Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:03:14.9051407Z ##[endgroup] 2024-06-26T07:03:14.9114146Z ##[group]Run if systemctl is-active --quiet docker; then 2024-06-26T07:03:14.9114769Z if systemctl is-active --quiet docker; then 2024-06-26T07:03:14.9115315Z  echo "Docker daemon is running..."; 2024-06-26T07:03:14.9115780Z else 2024-06-26T07:03:14.9116278Z  echo "Starting docker deamon..." && sudo systemctl start docker; 2024-06-26T07:03:14.9116868Z fi 2024-06-26T07:03:14.9124408Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:03:14.9125026Z env: 2024-06-26T07:03:14.9125318Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:03:14.9125684Z ##[endgroup] 2024-06-26T07:03:14.9160559Z Docker daemon is running... 2024-06-26T07:03:14.9207326Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2024-06-26T07:03:14.9207949Z with: 2024-06-26T07:03:14.9208296Z shell: bash 2024-06-26T07:03:14.9208657Z timeout_minutes: 5 2024-06-26T07:03:14.9209050Z max_attempts: 3 2024-06-26T07:03:14.9209433Z retry_wait_seconds: 30 2024-06-26T07:03:14.9210997Z command: AWS_ACCOUNT_ID=$(aws sts get-caller-identity|grep Account|cut -f4 -d\") aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \ --password-stdin "$AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com" 2024-06-26T07:03:14.9212487Z polling_interval_seconds: 1 2024-06-26T07:03:14.9212943Z warning_on_retry: true 2024-06-26T07:03:14.9213373Z continue_on_error: false 2024-06-26T07:03:14.9213782Z env: 2024-06-26T07:03:14.9214121Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:03:14.9214552Z AWS_RETRY_MODE: standard 2024-06-26T07:03:14.9214980Z AWS_MAX_ATTEMPTS: 5 2024-06-26T07:03:14.9215400Z AWS_DEFAULT_REGION: us-east-1 2024-06-26T07:03:14.9215862Z ##[endgroup] 2024-06-26T07:03:15.7853879Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-06-26T07:03:15.7854718Z Configure a credential helper to remove this warning. See 2024-06-26T07:03:15.7855573Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-06-26T07:03:15.7856092Z 2024-06-26T07:03:15.7856250Z Login Succeeded 2024-06-26T07:03:15.9708776Z Command completed after 1 attempt(s). 2024-06-26T07:03:15.9751144Z ##[group]Run env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-06-26T07:03:15.9751856Z env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-06-26T07:03:15.9752507Z env | grep '^CI' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-06-26T07:03:15.9760187Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:03:15.9760679Z env: 2024-06-26T07:03:15.9760968Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:03:15.9761316Z ##[endgroup] 2024-06-26T07:03:15.9821321Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2024-06-26T07:03:15.9822094Z # ignore expansion of "docker ps -q" since it could be empty 2024-06-26T07:03:15.9822691Z # shellcheck disable=SC2046 2024-06-26T07:03:15.9823157Z docker stop $(docker ps -q) || true 2024-06-26T07:03:15.9823644Z # Prune all of the docker images 2024-06-26T07:03:15.9824102Z docker system prune -af 2024-06-26T07:03:15.9832232Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:03:15.9832731Z env: 2024-06-26T07:03:15.9832998Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:03:15.9833340Z ##[endgroup] 2024-06-26T07:03:16.0074297Z "docker stop" requires at least 1 argument. 2024-06-26T07:03:16.0074931Z See 'docker stop --help'. 2024-06-26T07:03:16.0075170Z 2024-06-26T07:03:16.0075399Z Usage: docker stop [OPTIONS] CONTAINER [CONTAINER...] 2024-06-26T07:03:16.0075777Z 2024-06-26T07:03:16.0075931Z Stop one or more running containers 2024-06-26T07:03:16.0223627Z Total reclaimed space: 0B 2024-06-26T07:03:16.0252587Z ##[group]Run set +e 2024-06-26T07:03:16.0252950Z set +e 2024-06-26T07:03:16.0253256Z set -x 2024-06-26T07:03:16.0253552Z  2024-06-26T07:03:16.0253874Z PT_DOMAIN=download.pytorch.org 2024-06-26T07:03:16.0254675Z # TODO: Flaky access to download.pytorch.org https://github.com/pytorch/pytorch/issues/100400, 2024-06-26T07:03:16.0255745Z # cleaning this up once the issue is fixed. There are more than one resolved IP here, the last 2024-06-26T07:03:16.0256490Z # one is returned at random 2024-06-26T07:03:16.0257036Z RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" | tail -n1) 2024-06-26T07:03:16.0257541Z  2024-06-26T07:03:16.0257863Z if [ -z "${RESOLVED_IP}" ]; then 2024-06-26T07:03:16.0258479Z  echo "Couldn't resolve ${PT_DOMAIN}, retrying with Google DNS..." 2024-06-26T07:03:16.0259237Z  RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" @8.8.8.8 | tail -n1) 2024-06-26T07:03:16.0259799Z  2024-06-26T07:03:16.0260130Z  if [ -z "${RESOLVED_IP}" ]; then 2024-06-26T07:03:16.0260684Z  echo "Couldn't resolve ${PT_DOMAIN}, exiting..." 2024-06-26T07:03:16.0261190Z  exit 1 2024-06-26T07:03:16.0261499Z  fi 2024-06-26T07:03:16.0261817Z fi 2024-06-26T07:03:16.0262241Z  2024-06-26T07:03:16.0262611Z if grep -r "${PT_DOMAIN}" /etc/hosts; then 2024-06-26T07:03:16.0263124Z  # Clean up any old records first 2024-06-26T07:03:16.0263632Z  sudo sed -i "/${PT_DOMAIN}/d" /etc/hosts 2024-06-26T07:03:16.0264084Z fi 2024-06-26T07:03:16.0264358Z  2024-06-26T07:03:16.0264788Z echo "${RESOLVED_IP} ${PT_DOMAIN}" | sudo tee -a /etc/hosts 2024-06-26T07:03:16.0265333Z cat /etc/hosts 2024-06-26T07:03:16.0273605Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:03:16.0274105Z env: 2024-06-26T07:03:16.0274387Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:03:16.0274741Z ##[endgroup] 2024-06-26T07:03:16.0294986Z + PT_DOMAIN=download.pytorch.org 2024-06-26T07:03:16.0298594Z ++ dig -4 +short download.pytorch.org 2024-06-26T07:03:16.0299042Z ++ tail -n1 2024-06-26T07:03:16.0400450Z + RESOLVED_IP=18.160.10.28 2024-06-26T07:03:16.0400889Z + '[' -z 18.160.10.28 ']' 2024-06-26T07:03:16.0401347Z + grep -r download.pytorch.org /etc/hosts 2024-06-26T07:03:16.0406425Z 18.160.18.56 download.pytorch.org 2024-06-26T07:03:16.0407061Z + sudo sed -i /download.pytorch.org/d /etc/hosts 2024-06-26T07:03:16.0501289Z + echo '18.160.10.28 download.pytorch.org' 2024-06-26T07:03:16.0501819Z + sudo tee -a /etc/hosts 2024-06-26T07:03:16.0780962Z 18.160.10.28 download.pytorch.org 2024-06-26T07:03:16.0793572Z + cat /etc/hosts 2024-06-26T07:03:16.0797682Z 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 2024-06-26T07:03:16.0810735Z ::1 localhost6 localhost6.localdomain6 2024-06-26T07:03:16.0811276Z 18.160.10.28 download.pytorch.org 2024-06-26T07:03:16.1017570Z ##[group]Run pytorch/test-infra/.github/actions/calculate-docker-image@main 2024-06-26T07:03:16.1018159Z with: 2024-06-26T07:03:16.1019225Z docker-image-name: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:03:16.1020418Z docker-build-dir: .ci/docker 2024-06-26T07:03:16.1020802Z working-directory: . 2024-06-26T07:03:16.1021266Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:03:16.1021786Z force-push: false 2024-06-26T07:03:16.1022078Z env: 2024-06-26T07:03:16.1022342Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:03:16.1022682Z ##[endgroup] 2024-06-26T07:03:16.1039754Z ##[group]Run set -ex 2024-06-26T07:03:16.1040210Z set -ex 2024-06-26T07:03:16.1040505Z  2024-06-26T07:03:16.1041063Z # If the docker build directory or the build script doesn't exist, the action will 2024-06-26T07:03:16.1042208Z # gracefully return the docker image name as it is. Pulling docker image in Linux 2024-06-26T07:03:16.1043002Z # job could then download the pre-built image as usual 2024-06-26T07:03:16.1043752Z if [[ ! -d "${DOCKER_BUILD_DIR}" ]] || [[ ! -f "${DOCKER_BUILD_DIR}/build.sh" ]]; then 2024-06-26T07:03:16.1044421Z  echo "skip=true" >> "${GITHUB_OUTPUT}" 2024-06-26T07:03:16.1045137Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2024-06-26T07:03:16.1045694Z  2024-06-26T07:03:16.1046203Z  echo "There is no Docker build script in ${REPO_NAME} repo, skipping..." 2024-06-26T07:03:16.1046825Z  exit 0 2024-06-26T07:03:16.1047134Z else 2024-06-26T07:03:16.1047507Z  echo "skip=false" >> "${GITHUB_OUTPUT}" 2024-06-26T07:03:16.1047953Z fi 2024-06-26T07:03:16.1048236Z  2024-06-26T07:03:16.1048707Z if [[ "${DOCKER_IMAGE_NAME}" == *"${DOCKER_REGISTRY}/${REPO_NAME}"* ]]; then 2024-06-26T07:03:16.1049563Z  # The docker image name already includes the ECR prefix and tag, so we can just 2024-06-26T07:03:16.1050326Z  # use it as it is, but first let's extract the tag 2024-06-26T07:03:16.1051030Z  DOCKER_TAG=$(echo "${DOCKER_IMAGE_NAME}" | awk -F '[:,]' '{print $2}') 2024-06-26T07:03:16.1051749Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-06-26T07:03:16.1052445Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2024-06-26T07:03:16.1052997Z else 2024-06-26T07:03:16.1053437Z  DOCKER_TAG=$(git rev-parse HEAD:"${DOCKER_BUILD_DIR}") 2024-06-26T07:03:16.1054099Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-06-26T07:03:16.1054979Z  echo "docker-image=${DOCKER_REGISTRY}/${REPO_NAME}/${DOCKER_IMAGE_NAME}:${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-06-26T07:03:16.1055712Z fi 2024-06-26T07:03:16.1063310Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:03:16.1063807Z env: 2024-06-26T07:03:16.1064090Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:03:16.1064439Z REPO_NAME: pytorch 2024-06-26T07:03:16.1065556Z DOCKER_IMAGE_NAME: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:03:16.1066735Z DOCKER_BUILD_DIR: .ci/docker 2024-06-26T07:03:16.1067414Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:03:16.1068074Z ##[endgroup] 2024-06-26T07:03:16.1088234Z + [[ ! -d .ci/docker ]] 2024-06-26T07:03:16.1088772Z + [[ ! -f .ci/docker/build.sh ]] 2024-06-26T07:03:16.1089191Z + echo skip=false 2024-06-26T07:03:16.1091193Z + [[ 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 == *\3\0\8\5\3\5\3\8\5\1\1\4\.\d\k\r\.\e\c\r\.\u\s\-\e\a\s\t\-\1\.\a\m\a\z\o\n\a\w\s\.\c\o\m\/\p\y\t\o\r\c\h* ]] 2024-06-26T07:03:16.1094372Z ++ echo 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:03:16.1095550Z ++ awk -F '[:,]' '{print $2}' 2024-06-26T07:03:16.1101535Z + DOCKER_TAG=91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:03:16.1102279Z + echo docker-tag=91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:03:16.1104159Z + echo docker-image=308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:03:16.1130659Z ##[group]Run set +e 2024-06-26T07:03:16.1131033Z set +e 2024-06-26T07:03:16.1131345Z set -x 2024-06-26T07:03:16.1131638Z  2024-06-26T07:03:16.1131927Z login() { 2024-06-26T07:03:16.1132597Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2024-06-26T07:03:16.1133424Z } 2024-06-26T07:03:16.1133699Z  2024-06-26T07:03:16.1133986Z retry () { 2024-06-26T07:03:16.1134385Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2024-06-26T07:03:16.1134842Z } 2024-06-26T07:03:16.1135117Z  2024-06-26T07:03:16.1135444Z retry login "${DOCKER_REGISTRY}" 2024-06-26T07:03:16.1135866Z  2024-06-26T07:03:16.1136337Z # Check if image already exists, if it does then skip building it 2024-06-26T07:03:16.1137043Z if docker manifest inspect "${DOCKER_IMAGE}"; then 2024-06-26T07:03:16.1137555Z  exit 0 2024-06-26T07:03:16.1137864Z fi 2024-06-26T07:03:16.1138144Z  2024-06-26T07:03:16.1138646Z # NB: This part requires a full checkout. Otherwise, the merge base will 2024-06-26T07:03:16.1139468Z # be empty. The default action would be to continue rebuild the image 2024-06-26T07:03:16.1140215Z if [[ "$BASE_REVISION" = "$(git rev-parse HEAD)" ]]; then 2024-06-26T07:03:16.1140884Z  # if we're on the base branch then use the parent commit 2024-06-26T07:03:16.1141479Z  MERGE_BASE=$(git rev-parse HEAD~) 2024-06-26T07:03:16.1141918Z else 2024-06-26T07:03:16.1142394Z  # otherwise we're on a PR, so use the most recent base commit 2024-06-26T07:03:16.1143075Z  MERGE_BASE=$(git merge-base HEAD "$BASE_REVISION") 2024-06-26T07:03:16.1143586Z fi 2024-06-26T07:03:16.1143877Z  2024-06-26T07:03:16.1144205Z if [[ -z "${MERGE_BASE}" ]]; then 2024-06-26T07:03:16.1144706Z  echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2024-06-26T07:03:16.1145166Z  2024-06-26T07:03:16.1145821Z  echo "Finding merge base only works with full checkout, please set fetch-depth to 0, continuing ..." 2024-06-26T07:03:16.1146576Z  exit 0 2024-06-26T07:03:16.1146881Z fi 2024-06-26T07:03:16.1147168Z  2024-06-26T07:03:16.1147769Z if ! git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}"; then 2024-06-26T07:03:16.1148734Z  echo "Directory '${DOCKER_BUILD_DIR}' not found in commit $MERGE_BASE, you should rebase onto a more recent commit" 2024-06-26T07:03:16.1149518Z  exit 1 2024-06-26T07:03:16.1149830Z fi 2024-06-26T07:03:16.1150116Z  2024-06-26T07:03:16.1150606Z PREVIOUS_DOCKER_TAG=$(git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}") 2024-06-26T07:03:16.1151537Z # If no image exists but the hash is the same as the previous hash then we should error out here 2024-06-26T07:03:16.1152417Z if [[ "${PREVIOUS_DOCKER_TAG}" == "${DOCKER_TAG}" ]]; then 2024-06-26T07:03:16.1153399Z  echo "WARNING: Something has gone wrong and the previous image isn't available for the merge-base of your branch" 2024-06-26T07:03:16.1154480Z  echo " Will re-build docker image to store in local cache, TTS may be longer" 2024-06-26T07:03:16.1155259Z fi 2024-06-26T07:03:16.1155545Z  2024-06-26T07:03:16.1155918Z echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2024-06-26T07:03:16.1163587Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:03:16.1164088Z env: 2024-06-26T07:03:16.1164367Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:03:16.1164818Z DOCKER_BUILD_DIR: .ci/docker 2024-06-26T07:03:16.1165287Z BASE_REVISION: b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:03:16.1166543Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:03:16.1167761Z DOCKER_TAG: 91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:03:16.1168365Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:03:16.1168884Z ##[endgroup] 2024-06-26T07:03:16.1188359Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:03:16.1189183Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:03:16.1190048Z + aws ecr get-login-password --region us-east-1 2024-06-26T07:03:16.1190811Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:03:16.5237855Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-06-26T07:03:16.5238720Z Configure a credential helper to remove this warning. See 2024-06-26T07:03:16.5239605Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-06-26T07:03:16.5240300Z 2024-06-26T07:03:16.5240476Z Login Succeeded 2024-06-26T07:03:16.5251431Z + docker manifest inspect 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:03:16.7387405Z { 2024-06-26T07:03:16.7388150Z "schemaVersion": 2, 2024-06-26T07:03:16.7389357Z "mediaType": "application/vnd.docker.distribution.manifest.v2+json", 2024-06-26T07:03:16.7390051Z "config": { 2024-06-26T07:03:16.7390509Z "mediaType": "application/vnd.docker.container.image.v1+json", 2024-06-26T07:03:16.7391058Z "size": 48681, 2024-06-26T07:03:16.7391607Z "digest": "sha256:0058b15e517a024817bccd921dc9af264c964f500b3cb9b3f4649a8ac22cc2dd" 2024-06-26T07:03:16.7392424Z }, 2024-06-26T07:03:16.7392688Z "layers": [ 2024-06-26T07:03:16.7392965Z { 2024-06-26T07:03:16.7393406Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7393957Z "size": 28580681, 2024-06-26T07:03:16.7394507Z "digest": "sha256:7a2c559011895d255fce249c00396abff5ae7e0c0a92931d0ed493e71de78e3a" 2024-06-26T07:03:16.7395162Z }, 2024-06-26T07:03:16.7395405Z { 2024-06-26T07:03:16.7395841Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7398042Z "size": 7943451, 2024-06-26T07:03:16.7398813Z "digest": "sha256:224fe954d7252f10539d243d6c9688806f7d13ad775ed02e7f7c79077844510d" 2024-06-26T07:03:16.7399717Z }, 2024-06-26T07:03:16.7400056Z { 2024-06-26T07:03:16.7400654Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7401434Z "size": 55728572, 2024-06-26T07:03:16.7402166Z "digest": "sha256:75722010b82e31715876aeeed0b2cee414296f0124fdfa061ab845ba2a158450" 2024-06-26T07:03:16.7402983Z }, 2024-06-26T07:03:16.7403327Z { 2024-06-26T07:03:16.7403901Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7404783Z "size": 186, 2024-06-26T07:03:16.7405458Z "digest": "sha256:d527cbbb87e3016fd72a18a9b468c945ad0ca27c5770b39debd6ed704db3a195" 2024-06-26T07:03:16.7406193Z }, 2024-06-26T07:03:16.7406579Z + exit 0 2024-06-26T07:03:16.7406933Z { 2024-06-26T07:03:16.7407527Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7408232Z "size": 6886, 2024-06-26T07:03:16.7408961Z "digest": "sha256:b57676e46aee1a8c82e528d78e5a13e31142524eea31c8b213d69ddcb6f1fe80" 2024-06-26T07:03:16.7410016Z }, 2024-06-26T07:03:16.7410370Z { 2024-06-26T07:03:16.7410957Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7411618Z "size": 1329001756, 2024-06-26T07:03:16.7412200Z "digest": "sha256:a8c1e85b5e14cec7af70bf304cb4d4cee6a1d25eb8215b2cf4fdc33e5af5e108" 2024-06-26T07:03:16.7412923Z }, 2024-06-26T07:03:16.7413270Z { 2024-06-26T07:03:16.7413826Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7414545Z "size": 62501, 2024-06-26T07:03:16.7415239Z "digest": "sha256:a41a8d1c11c8d80fe4e82b0d05478f8d51176ff20b8350905fc1b25c93a51198" 2024-06-26T07:03:16.7416033Z }, 2024-06-26T07:03:16.7416362Z { 2024-06-26T07:03:16.7416901Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7417459Z "size": 1684, 2024-06-26T07:03:16.7418001Z "digest": "sha256:0c12278907551c2962927d27c115f6f7bf0df894318b8aea6ece3ef01ccd0a8a" 2024-06-26T07:03:16.7418730Z }, 2024-06-26T07:03:16.7418997Z { 2024-06-26T07:03:16.7419437Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7419990Z "size": 1523, 2024-06-26T07:03:16.7420549Z "digest": "sha256:d8d1234baab3ec9ccb8bb710fc6b8ff6c10896ba2e8d27a347583eca770f9ff1" 2024-06-26T07:03:16.7421176Z }, 2024-06-26T07:03:16.7421431Z { 2024-06-26T07:03:16.7421865Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7422424Z "size": 2528295403, 2024-06-26T07:03:16.7422990Z "digest": "sha256:7ed32bc8e4696fcdb2feef850781160597b2275ad756819c4add88236b0577d5" 2024-06-26T07:03:16.7423602Z }, 2024-06-26T07:03:16.7423850Z { 2024-06-26T07:03:16.7424417Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7424978Z "size": 86016, 2024-06-26T07:03:16.7425533Z "digest": "sha256:ec1e7978c1fe161ced1d98092a51e7c5953ca5fda5577f54df9dbda4afff1b2b" 2024-06-26T07:03:16.7426138Z }, 2024-06-26T07:03:16.7426399Z { 2024-06-26T07:03:16.7426838Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7427693Z "size": 1823, 2024-06-26T07:03:16.7428228Z "digest": "sha256:309b872da805fcdf74137a887464876fa0615dc8b24199307119eb65fc2bfb49" 2024-06-26T07:03:16.7428841Z }, 2024-06-26T07:03:16.7429096Z { 2024-06-26T07:03:16.7429527Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7430070Z "size": 246737542, 2024-06-26T07:03:16.7430628Z "digest": "sha256:e82932cb002c06a782077b8e5965f8733eb8563406a23cab260d9d8c4a994f7d" 2024-06-26T07:03:16.7431231Z }, 2024-06-26T07:03:16.7431479Z { 2024-06-26T07:03:16.7431910Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7432454Z "size": 545, 2024-06-26T07:03:16.7433004Z "digest": "sha256:ca9dd73e3e9378225ebdcfd12199ef44649e34fe55003cfbc8afe2e8a4527c5b" 2024-06-26T07:03:16.7433617Z }, 2024-06-26T07:03:16.7433874Z { 2024-06-26T07:03:16.7434313Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7434858Z "size": 1283, 2024-06-26T07:03:16.7435383Z "digest": "sha256:16d76a79d5d6616e228537785ec83a869f68a402520bbc6e826201621ca6cb98" 2024-06-26T07:03:16.7435985Z }, 2024-06-26T07:03:16.7436241Z { 2024-06-26T07:03:16.7436665Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7437212Z "size": 485, 2024-06-26T07:03:16.7437758Z "digest": "sha256:4bdf41c9ecbe1651e0986ccbea4663a0556af27b7145a679cfa45c35dc96b891" 2024-06-26T07:03:16.7438372Z }, 2024-06-26T07:03:16.7438620Z { 2024-06-26T07:03:16.7439051Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7439605Z "size": 91710937, 2024-06-26T07:03:16.7440177Z "digest": "sha256:f4863801e30cdbcd1d4e6cb1cbbcde7dbcaf6ae317ca80429295741ce60ac31d" 2024-06-26T07:03:16.7440800Z }, 2024-06-26T07:03:16.7441051Z { 2024-06-26T07:03:16.7441487Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7442142Z "size": 3233, 2024-06-26T07:03:16.7442690Z "digest": "sha256:d37dd9ed8948a0d02e1198bbedadbca36477a0980dd553196385aab0c025581d" 2024-06-26T07:03:16.7443304Z }, 2024-06-26T07:03:16.7443560Z { 2024-06-26T07:03:16.7443984Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7444606Z "size": 1905, 2024-06-26T07:03:16.7445157Z "digest": "sha256:cf2f34f225dbed17c1a9a8b9ea4ad030aba797774a716dc0a82fe212324aa751" 2024-06-26T07:03:16.7445773Z }, 2024-06-26T07:03:16.7446019Z { 2024-06-26T07:03:16.7446447Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7446991Z "size": 702, 2024-06-26T07:03:16.7447532Z "digest": "sha256:df546d7b3e34396a6f2b51d8c88be976eca017bc99168d838c2c7bacabab9ec4" 2024-06-26T07:03:16.7448133Z }, 2024-06-26T07:03:16.7448386Z { 2024-06-26T07:03:16.7448825Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7449448Z "size": 2784789002, 2024-06-26T07:03:16.7450016Z "digest": "sha256:3d914950f8addfc4d657a2365c76e1143eb80b710cd3f6e9ae05640217fc6347" 2024-06-26T07:03:16.7450626Z }, 2024-06-26T07:03:16.7450878Z { 2024-06-26T07:03:16.7451301Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7451847Z "size": 381, 2024-06-26T07:03:16.7452382Z "digest": "sha256:96d0e2032184c57e62a652aaffcf0241f0d0c7a23e894ca0ad192c4a64a36583" 2024-06-26T07:03:16.7452988Z }, 2024-06-26T07:03:16.7453238Z { 2024-06-26T07:03:16.7453666Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7454207Z "size": 11879, 2024-06-26T07:03:16.7454744Z "digest": "sha256:06e12ce59790cb8b091e5d619c2a62a28329008ee184a8b9a562e3db12471f30" 2024-06-26T07:03:16.7455335Z }, 2024-06-26T07:03:16.7455588Z { 2024-06-26T07:03:16.7456018Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7456550Z "size": 803, 2024-06-26T07:03:16.7457104Z "digest": "sha256:ed712f63cde7070bdec2a6179c4c35e752c6991ddbc69fe9f2724a9903250ceb" 2024-06-26T07:03:16.7457719Z }, 2024-06-26T07:03:16.7457970Z { 2024-06-26T07:03:16.7458390Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7458935Z "size": 106, 2024-06-26T07:03:16.7459461Z "digest": "sha256:a97a71ef8a4e66234dfc2098834f8395ac5630240e60164d1a251fdb0115ba85" 2024-06-26T07:03:16.7460056Z }, 2024-06-26T07:03:16.7460301Z { 2024-06-26T07:03:16.7460727Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7461275Z "size": 503, 2024-06-26T07:03:16.7461810Z "digest": "sha256:25cd0c482ad612f936b35b4f220c580e16be982226aac8801a6a849a6bfdc221" 2024-06-26T07:03:16.7462416Z }, 2024-06-26T07:03:16.7462668Z { 2024-06-26T07:03:16.7463099Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7463641Z "size": 121477177, 2024-06-26T07:03:16.7464208Z "digest": "sha256:9bf94bc456584365fda21d0ed83b7cc690b08a71727b71c4c1e667e15028a386" 2024-06-26T07:03:16.7464808Z }, 2024-06-26T07:03:16.7465058Z { 2024-06-26T07:03:16.7465482Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7466023Z "size": 109, 2024-06-26T07:03:16.7466554Z "digest": "sha256:de45a14c9b227e4b0c9d45d42223b50a71c03522ddd9e2ca0d9517835206c823" 2024-06-26T07:03:16.7467161Z }, 2024-06-26T07:03:16.7467614Z { 2024-06-26T07:03:16.7468051Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7468598Z "size": 491, 2024-06-26T07:03:16.7469123Z "digest": "sha256:e99241e77209b0b35a0fb59a61c0821fc161190178af7e4af45e6eeaa043375e" 2024-06-26T07:03:16.7469724Z }, 2024-06-26T07:03:16.7469975Z { 2024-06-26T07:03:16.7470403Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7470942Z "size": 291, 2024-06-26T07:03:16.7471488Z "digest": "sha256:35e8f4e2a42f9df0c969dedd2199cf71719cf5ecfa676dfa014bbdeb4fdb295f" 2024-06-26T07:03:16.7472224Z }, 2024-06-26T07:03:16.7472481Z { 2024-06-26T07:03:16.7472905Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7473447Z "size": 101, 2024-06-26T07:03:16.7473984Z "digest": "sha256:a823ffa4c541394b52953391dc0a6867e26c37fe4a71fa022a2cc3f07f0ba70d" 2024-06-26T07:03:16.7474587Z }, 2024-06-26T07:03:16.7474832Z { 2024-06-26T07:03:16.7475263Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7475806Z "size": 1473, 2024-06-26T07:03:16.7476328Z "digest": "sha256:44ba272eae2064603605a6238b3f35cc6578859d660068e702a047a9cd8ab2fd" 2024-06-26T07:03:16.7476925Z }, 2024-06-26T07:03:16.7477179Z { 2024-06-26T07:03:16.7477608Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7478145Z "size": 446710781, 2024-06-26T07:03:16.7478701Z "digest": "sha256:da02d278e5240c285bc855ce4e42cd6121d5b903787f5c14f03e575ad1268650" 2024-06-26T07:03:16.7479379Z }, 2024-06-26T07:03:16.7479637Z { 2024-06-26T07:03:16.7480060Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7480603Z "size": 161, 2024-06-26T07:03:16.7481124Z "digest": "sha256:73a0ce681c295135456e190578733273276b38b4dd5babbb39298f384d43b1c6" 2024-06-26T07:03:16.7481711Z }, 2024-06-26T07:03:16.7481984Z { 2024-06-26T07:03:16.7482445Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7482989Z "size": 564, 2024-06-26T07:03:16.7483523Z "digest": "sha256:49737bd5ae709dbf7956e21fc8b05ba009e9e6c9b130b0126a73bd3d3f5efc78" 2024-06-26T07:03:16.7484131Z }, 2024-06-26T07:03:16.7484385Z { 2024-06-26T07:03:16.7484899Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7485436Z "size": 35874600, 2024-06-26T07:03:16.7485989Z "digest": "sha256:9cd4c745f8e4f9d5c9bb8050923575afad21f5b7852975a4a1981bc9eff282c5" 2024-06-26T07:03:16.7486597Z }, 2024-06-26T07:03:16.7486857Z { 2024-06-26T07:03:16.7487285Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7487828Z "size": 104, 2024-06-26T07:03:16.7488352Z "digest": "sha256:b2950a0365345d4c17a48627c905fd8930b3b3154c727f0526eb9ca547102bb7" 2024-06-26T07:03:16.7488941Z }, 2024-06-26T07:03:16.7489197Z { 2024-06-26T07:03:16.7489626Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7490168Z "size": 425, 2024-06-26T07:03:16.7490688Z "digest": "sha256:25e19d81d9fc081962ff4cbc09e098f4035419822712c19a410f5282300dfb9e" 2024-06-26T07:03:16.7491282Z }, 2024-06-26T07:03:16.7491543Z { 2024-06-26T07:03:16.7491976Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7492513Z "size": 20262084, 2024-06-26T07:03:16.7493074Z "digest": "sha256:60156b40fcbec2c25f0170b0a82fa8cd9303e0daae8bb1811fd0fc6562e88e8e" 2024-06-26T07:03:16.7493687Z }, 2024-06-26T07:03:16.7493931Z { 2024-06-26T07:03:16.7494374Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7494915Z "size": 439, 2024-06-26T07:03:16.7495438Z "digest": "sha256:7a868239227fd19b30a19927bbc8f058d247403fe5b343c55f4b4b8987918911" 2024-06-26T07:03:16.7496031Z }, 2024-06-26T07:03:16.7496295Z { 2024-06-26T07:03:16.7496728Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7497268Z "size": 702, 2024-06-26T07:03:16.7497798Z "digest": "sha256:df546d7b3e34396a6f2b51d8c88be976eca017bc99168d838c2c7bacabab9ec4" 2024-06-26T07:03:16.7498409Z }, 2024-06-26T07:03:16.7498661Z { 2024-06-26T07:03:16.7499085Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7499630Z "size": 143, 2024-06-26T07:03:16.7500155Z "digest": "sha256:83911d7c7ecf11b5932bb7449975c52e7f737a5b867691935e1ccb85ceb25b52" 2024-06-26T07:03:16.7500753Z }, 2024-06-26T07:03:16.7500999Z { 2024-06-26T07:03:16.7501432Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7502048Z "size": 135, 2024-06-26T07:03:16.7502593Z "digest": "sha256:b3c5d66c679f58c71febdd502889bd8cd3d36e5001754cdf1e30eabe21135cce" 2024-06-26T07:03:16.7503201Z }, 2024-06-26T07:03:16.7503456Z { 2024-06-26T07:03:16.7503880Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7504438Z "size": 4911495247, 2024-06-26T07:03:16.7504987Z "digest": "sha256:84b2c7a899820f6acdb22148c5e8346d8b26c33269fd01842c9573515251e1e1" 2024-06-26T07:03:16.7505587Z }, 2024-06-26T07:03:16.7505839Z { 2024-06-26T07:03:16.7506263Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7506806Z "size": 190, 2024-06-26T07:03:16.7507613Z "digest": "sha256:c1068d03a811d8dead5da9e82fdc8869205fc4ee9cb92d4f7a4acfbb5ba83950" 2024-06-26T07:03:16.7508244Z }, 2024-06-26T07:03:16.7508490Z { 2024-06-26T07:03:16.7508919Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7509549Z "size": 565, 2024-06-26T07:03:16.7510085Z "digest": "sha256:671b4a301d81074fca17d36851f81801552c4ecb2f90ff3412aa9ab6a1a91371" 2024-06-26T07:03:16.7510682Z }, 2024-06-26T07:03:16.7510936Z { 2024-06-26T07:03:16.7511366Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7511917Z "size": 43163095, 2024-06-26T07:03:16.7512471Z "digest": "sha256:67760cf5ec46ab58d3ca98637fd9b26cb47a67446bfd0db176fe5e023606aa0d" 2024-06-26T07:03:16.7513082Z }, 2024-06-26T07:03:16.7513340Z { 2024-06-26T07:03:16.7513767Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7514313Z "size": 106, 2024-06-26T07:03:16.7514852Z "digest": "sha256:ddc9740bcea2b301e99b50525059aea8d9c7121a1c8eab566561a8968438a8c2" 2024-06-26T07:03:16.7515464Z }, 2024-06-26T07:03:16.7515709Z { 2024-06-26T07:03:16.7516139Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7516683Z "size": 1213, 2024-06-26T07:03:16.7517229Z "digest": "sha256:fb2e977685609fcc01de170ba7f50a573e73e6520e47253717e92a28952c5ee8" 2024-06-26T07:03:16.7517821Z }, 2024-06-26T07:03:16.7518074Z { 2024-06-26T07:03:16.7518504Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7519058Z "size": 702, 2024-06-26T07:03:16.7519602Z "digest": "sha256:df546d7b3e34396a6f2b51d8c88be976eca017bc99168d838c2c7bacabab9ec4" 2024-06-26T07:03:16.7520213Z }, 2024-06-26T07:03:16.7520466Z { 2024-06-26T07:03:16.7520889Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7521431Z "size": 138, 2024-06-26T07:03:16.7521977Z "digest": "sha256:b599c5a8c7cb461cbd7b3c98b99960b8eb04506e05e79db1cc0cfadb14a47e91" 2024-06-26T07:03:16.7522588Z }, 2024-06-26T07:03:16.7522833Z { 2024-06-26T07:03:16.7523263Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7523808Z "size": 120, 2024-06-26T07:03:16.7524359Z "digest": "sha256:e08e88c1366827455ee7ddbf92b6ae615ceb3cbd3fb11cd03ddd31bd3fa94a9c" 2024-06-26T07:03:16.7525058Z }, 2024-06-26T07:03:16.7525311Z { 2024-06-26T07:03:16.7525745Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7526284Z "size": 1904157495, 2024-06-26T07:03:16.7526854Z "digest": "sha256:12ba7431ff38de8cf6af3052a2a52e79f4e712b8c99f5bafde3c20e63b1f570f" 2024-06-26T07:03:16.7527465Z }, 2024-06-26T07:03:16.7527717Z { 2024-06-26T07:03:16.7528148Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7528699Z "size": 172, 2024-06-26T07:03:16.7529238Z "digest": "sha256:cf7c2cb896cba6a594028cc0fd246e127a2f4481d48905a3aa12c5f5872332d4" 2024-06-26T07:03:16.7529853Z }, 2024-06-26T07:03:16.7530097Z { 2024-06-26T07:03:16.7530525Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7531071Z "size": 908, 2024-06-26T07:03:16.7531622Z "digest": "sha256:3a778ddfac2af5b3a11f49ddf2f3f1ad1731f74ba691f434ab69966d1e2a189f" 2024-06-26T07:03:16.7532320Z }, 2024-06-26T07:03:16.7532577Z { 2024-06-26T07:03:16.7533014Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7533555Z "size": 702, 2024-06-26T07:03:16.7534100Z "digest": "sha256:df546d7b3e34396a6f2b51d8c88be976eca017bc99168d838c2c7bacabab9ec4" 2024-06-26T07:03:16.7534712Z }, 2024-06-26T07:03:16.7534965Z { 2024-06-26T07:03:16.7535386Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7535928Z "size": 134, 2024-06-26T07:03:16.7536459Z "digest": "sha256:236c8f0245f4b40616a4322eaf1e1b3e178d5990db1fcaba39622ea4e79c06a1" 2024-06-26T07:03:16.7537062Z }, 2024-06-26T07:03:16.7537308Z { 2024-06-26T07:03:16.7537736Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7538283Z "size": 32, 2024-06-26T07:03:16.7538816Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-06-26T07:03:16.7539491Z }, 2024-06-26T07:03:16.7539752Z { 2024-06-26T07:03:16.7540182Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7540718Z "size": 156, 2024-06-26T07:03:16.7541265Z "digest": "sha256:dda1ce302b9a9df0c8f1145d2e3eaa03c96909bb45a792451f1fcb555b06738d" 2024-06-26T07:03:16.7541886Z }, 2024-06-26T07:03:16.7542137Z { 2024-06-26T07:03:16.7542561Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7543108Z "size": 1841, 2024-06-26T07:03:16.7543650Z "digest": "sha256:e797fe86caef19319e03f8dca92cf96838ab3bb3644f4447c6dfc04230118afa" 2024-06-26T07:03:16.7544261Z }, 2024-06-26T07:03:16.7544506Z { 2024-06-26T07:03:16.7544944Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7545495Z "size": 7529784, 2024-06-26T07:03:16.7546041Z "digest": "sha256:967190076fc0ab2bb2fc0d74e58edd3d662a537d702ff3f8b6e876230154a16f" 2024-06-26T07:03:16.7546650Z }, 2024-06-26T07:03:16.7546915Z { 2024-06-26T07:03:16.7547532Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7548077Z "size": 165, 2024-06-26T07:03:16.7548612Z "digest": "sha256:4fb0a83f06855534ef82b80dcf7c685303edb2bcbd446196066dc2ad2dd71281" 2024-06-26T07:03:16.7549212Z }, 2024-06-26T07:03:16.7549465Z { 2024-06-26T07:03:16.7549886Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7550433Z "size": 7944, 2024-06-26T07:03:16.7550973Z "digest": "sha256:68af2ec4e30a33f26947ece9f3a31b7d3b04c2bca5865d4b48618457832a1da2" 2024-06-26T07:03:16.7551574Z }, 2024-06-26T07:03:16.7551829Z { 2024-06-26T07:03:16.7552254Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7552801Z "size": 8070, 2024-06-26T07:03:16.7553329Z "digest": "sha256:cc91933e985a044c6df53caa15488d2285896f5e991f38ec068c253ceec53f14" 2024-06-26T07:03:16.7553932Z }, 2024-06-26T07:03:16.7554183Z { 2024-06-26T07:03:16.7554622Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7555157Z "size": 303, 2024-06-26T07:03:16.7555693Z "digest": "sha256:9f3187916e7dcad33cc572f8f0e949d2f507b887f99cfd6acefd14826b44960d" 2024-06-26T07:03:16.7556303Z }, 2024-06-26T07:03:16.7556546Z { 2024-06-26T07:03:16.7556974Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7557518Z "size": 7629071, 2024-06-26T07:03:16.7558043Z "digest": "sha256:52608399485738d10d779254946c9e1d536010dd45593c69bf1eb9f62f85dc24" 2024-06-26T07:03:16.7558616Z }, 2024-06-26T07:03:16.7558867Z { 2024-06-26T07:03:16.7559292Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7559834Z "size": 108, 2024-06-26T07:03:16.7560365Z "digest": "sha256:05a6f6dcc1c00bac6660923a22adc7d7c34416718f8c89daf9b3351d9365f694" 2024-06-26T07:03:16.7560974Z }, 2024-06-26T07:03:16.7561224Z { 2024-06-26T07:03:16.7561650Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7562284Z "size": 54145775, 2024-06-26T07:03:16.7562849Z "digest": "sha256:6bc9dc8315b09b27c976bfba9700767ba412d72fd0528b18bbe8f8e62005ec22" 2024-06-26T07:03:16.7563458Z }, 2024-06-26T07:03:16.7563700Z { 2024-06-26T07:03:16.7564130Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7564737Z "size": 474, 2024-06-26T07:03:16.7565273Z "digest": "sha256:1b0e27c35f07b3fbf0aeb548d1949bf1d60a420136da21789d94d196c891d981" 2024-06-26T07:03:16.7565874Z }, 2024-06-26T07:03:16.7566129Z { 2024-06-26T07:03:16.7566557Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7567109Z "size": 1374858747, 2024-06-26T07:03:16.7567651Z "digest": "sha256:95237e7311a1c5ce6937db7196c866632f44e8788514a5c0eb4a3f04da4017e6" 2024-06-26T07:03:16.7568245Z }, 2024-06-26T07:03:16.7568495Z { 2024-06-26T07:03:16.7568914Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7569546Z "size": 106, 2024-06-26T07:03:16.7570096Z "digest": "sha256:789eff6c51aada70bf75eb1acafed63c0d839b768638001500616ff6e53b854a" 2024-06-26T07:03:16.7570711Z }, 2024-06-26T07:03:16.7570955Z { 2024-06-26T07:03:16.7571381Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7571923Z "size": 558, 2024-06-26T07:03:16.7572467Z "digest": "sha256:de0f8a8c45c6077b3c5ba3b84d7f07de98353fd618dad9a1e2f368ffe00493c7" 2024-06-26T07:03:16.7573075Z }, 2024-06-26T07:03:16.7573323Z { 2024-06-26T07:03:16.7573747Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7574288Z "size": 46248513, 2024-06-26T07:03:16.7574826Z "digest": "sha256:2060028f74888d218bebdd10d723f66c33ee1c708935c4ffd4654d34912ac4dc" 2024-06-26T07:03:16.7575426Z }, 2024-06-26T07:03:16.7575677Z { 2024-06-26T07:03:16.7576095Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7576648Z "size": 111, 2024-06-26T07:03:16.7577197Z "digest": "sha256:e412c7f3b2ded440992955bd92512345cbece8a8894cd3592f714ebc758ad1a0" 2024-06-26T07:03:16.7577797Z }, 2024-06-26T07:03:16.7578041Z { 2024-06-26T07:03:16.7578466Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7579004Z "size": 32, 2024-06-26T07:03:16.7579538Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-06-26T07:03:16.7580139Z }, 2024-06-26T07:03:16.7580387Z { 2024-06-26T07:03:16.7580811Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7581352Z "size": 32, 2024-06-26T07:03:16.7581879Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-06-26T07:03:16.7582490Z }, 2024-06-26T07:03:16.7582739Z { 2024-06-26T07:03:16.7583162Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7583705Z "size": 32, 2024-06-26T07:03:16.7584242Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-06-26T07:03:16.7584859Z }, 2024-06-26T07:03:16.7585101Z { 2024-06-26T07:03:16.7585526Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:16.7586068Z "size": 32, 2024-06-26T07:03:16.7586599Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-06-26T07:03:16.7587202Z } 2024-06-26T07:03:16.7587613Z ] 2024-06-26T07:03:16.7587855Z } 2024-06-26T07:03:16.7701431Z ##[group]Run tag=${ECR_DOCKER_IMAGE##*/} 2024-06-26T07:03:16.7701925Z tag=${ECR_DOCKER_IMAGE##*/} 2024-06-26T07:03:16.7702510Z echo "docker pull ghcr.io/pytorch/ci-image:${tag/:/-}" 2024-06-26T07:03:16.7710681Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:03:16.7711178Z env: 2024-06-26T07:03:16.7711456Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:03:16.7712589Z ECR_DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:03:16.7713744Z ##[endgroup] 2024-06-26T07:03:16.7735906Z docker pull ghcr.io/pytorch/ci-image:pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks-91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:03:16.7782318Z ##[group]Run pytorch/test-infra/.github/actions/pull-docker-image@main 2024-06-26T07:03:16.7782888Z with: 2024-06-26T07:03:16.7783946Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:03:16.7785227Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:03:16.7785740Z env: 2024-06-26T07:03:16.7786015Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:03:16.7786359Z ##[endgroup] 2024-06-26T07:03:16.7801903Z ##[group]Run set -x 2024-06-26T07:03:16.7802243Z set -x 2024-06-26T07:03:16.7802544Z set +e 2024-06-26T07:03:16.7802935Z  2024-06-26T07:03:16.7803207Z login() { 2024-06-26T07:03:16.7803863Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2024-06-26T07:03:16.7804630Z } 2024-06-26T07:03:16.7804908Z  2024-06-26T07:03:16.7805207Z retry () { 2024-06-26T07:03:16.7805602Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2024-06-26T07:03:16.7806048Z } 2024-06-26T07:03:16.7806327Z  2024-06-26T07:03:16.7806646Z retry login "${DOCKER_REGISTRY}" 2024-06-26T07:03:16.7807058Z  2024-06-26T07:03:16.7807331Z set -e 2024-06-26T07:03:16.7807802Z # ignore output since only exit code is used for conditional 2024-06-26T07:03:16.7808503Z # only pull docker image if it's not available locally 2024-06-26T07:03:16.7809256Z if ! docker inspect --type=image "${DOCKER_IMAGE}" >/dev/null 2>/dev/null; then 2024-06-26T07:03:16.7809946Z  retry docker pull "${DOCKER_IMAGE}" 2024-06-26T07:03:16.7810395Z fi 2024-06-26T07:03:16.7817062Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:03:16.7817550Z env: 2024-06-26T07:03:16.7817836Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:03:16.7818971Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:03:16.7820248Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:03:16.7820761Z ##[endgroup] 2024-06-26T07:03:16.7840387Z + set +e 2024-06-26T07:03:16.7841015Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:03:16.7841654Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:03:16.7842527Z + aws ecr get-login-password --region us-east-1 2024-06-26T07:03:16.7843290Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:03:17.1900016Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-06-26T07:03:17.1900834Z Configure a credential helper to remove this warning. See 2024-06-26T07:03:17.1901656Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-06-26T07:03:17.1902182Z 2024-06-26T07:03:17.1902316Z Login Succeeded 2024-06-26T07:03:17.1910909Z + set -e 2024-06-26T07:03:17.1912206Z + docker inspect --type=image 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:03:17.2037053Z + retry docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:03:17.2039163Z + docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:03:17.4053088Z 91382da70d5719cd7007b6b80b71d2f48398f6b7: Pulling from pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks 2024-06-26T07:03:17.4054018Z 7a2c55901189: Pulling fs layer 2024-06-26T07:03:17.4054396Z 224fe954d725: Pulling fs layer 2024-06-26T07:03:17.4054964Z 75722010b82e: Pulling fs layer 2024-06-26T07:03:17.4055355Z d527cbbb87e3: Pulling fs layer 2024-06-26T07:03:17.4055886Z b57676e46aee: Pulling fs layer 2024-06-26T07:03:17.4056400Z a8c1e85b5e14: Pulling fs layer 2024-06-26T07:03:17.4056784Z a41a8d1c11c8: Pulling fs layer 2024-06-26T07:03:17.4057157Z 0c1227890755: Pulling fs layer 2024-06-26T07:03:17.4057530Z d8d1234baab3: Pulling fs layer 2024-06-26T07:03:17.4057926Z 7ed32bc8e469: Pulling fs layer 2024-06-26T07:03:17.4058304Z ec1e7978c1fe: Pulling fs layer 2024-06-26T07:03:17.4058679Z 309b872da805: Pulling fs layer 2024-06-26T07:03:17.4059041Z e82932cb002c: Pulling fs layer 2024-06-26T07:03:17.4059421Z ca9dd73e3e93: Pulling fs layer 2024-06-26T07:03:17.4059935Z 16d76a79d5d6: Pulling fs layer 2024-06-26T07:03:17.4060308Z 4bdf41c9ecbe: Pulling fs layer 2024-06-26T07:03:17.4060684Z f4863801e30c: Pulling fs layer 2024-06-26T07:03:17.4061058Z d37dd9ed8948: Pulling fs layer 2024-06-26T07:03:17.4061434Z cf2f34f225db: Pulling fs layer 2024-06-26T07:03:17.4061811Z df546d7b3e34: Pulling fs layer 2024-06-26T07:03:17.4062214Z 3d914950f8ad: Pulling fs layer 2024-06-26T07:03:17.4062609Z 96d0e2032184: Pulling fs layer 2024-06-26T07:03:17.4062979Z 06e12ce59790: Pulling fs layer 2024-06-26T07:03:17.4063346Z ed712f63cde7: Pulling fs layer 2024-06-26T07:03:17.4063727Z a97a71ef8a4e: Pulling fs layer 2024-06-26T07:03:17.4064156Z 25cd0c482ad6: Pulling fs layer 2024-06-26T07:03:17.4064532Z 9bf94bc45658: Pulling fs layer 2024-06-26T07:03:17.4064898Z de45a14c9b22: Pulling fs layer 2024-06-26T07:03:17.4065261Z d527cbbb87e3: Waiting 2024-06-26T07:03:17.4065603Z e99241e77209: Pulling fs layer 2024-06-26T07:03:17.4065960Z d8d1234baab3: Waiting 2024-06-26T07:03:17.4066291Z 35e8f4e2a42f: Pulling fs layer 2024-06-26T07:03:17.4066658Z a41a8d1c11c8: Waiting 2024-06-26T07:03:17.4066996Z a823ffa4c541: Pulling fs layer 2024-06-26T07:03:17.4067512Z 7ed32bc8e469: Waiting 2024-06-26T07:03:17.4067837Z b57676e46aee: Waiting 2024-06-26T07:03:17.4068173Z 44ba272eae20: Pulling fs layer 2024-06-26T07:03:17.4068609Z da02d278e524: Pulling fs layer 2024-06-26T07:03:17.4068963Z 0c1227890755: Waiting 2024-06-26T07:03:17.4069357Z ec1e7978c1fe: Waiting 2024-06-26T07:03:17.4069753Z 73a0ce681c29: Pulling fs layer 2024-06-26T07:03:17.4070184Z 49737bd5ae70: Pulling fs layer 2024-06-26T07:03:17.4070552Z 9cd4c745f8e4: Pulling fs layer 2024-06-26T07:03:17.4070960Z 309b872da805: Waiting 2024-06-26T07:03:17.4071281Z a8c1e85b5e14: Waiting 2024-06-26T07:03:17.4071604Z b2950a036534: Pulling fs layer 2024-06-26T07:03:17.4071975Z 25e19d81d9fc: Pulling fs layer 2024-06-26T07:03:17.4072412Z 60156b40fcbe: Pulling fs layer 2024-06-26T07:03:17.4072801Z e82932cb002c: Waiting 2024-06-26T07:03:17.4073123Z 7a868239227f: Pulling fs layer 2024-06-26T07:03:17.4073497Z 83911d7c7ecf: Pulling fs layer 2024-06-26T07:03:17.4073857Z ca9dd73e3e93: Waiting 2024-06-26T07:03:17.4074174Z a823ffa4c541: Waiting 2024-06-26T07:03:17.4074497Z b3c5d66c679f: Pulling fs layer 2024-06-26T07:03:17.4074874Z 84b2c7a89982: Pulling fs layer 2024-06-26T07:03:17.4075238Z 44ba272eae20: Waiting 2024-06-26T07:03:17.4075560Z c1068d03a811: Pulling fs layer 2024-06-26T07:03:17.4075919Z 16d76a79d5d6: Waiting 2024-06-26T07:03:17.4076246Z 671b4a301d81: Pulling fs layer 2024-06-26T07:03:17.4076614Z 67760cf5ec46: Pulling fs layer 2024-06-26T07:03:17.4076960Z 49737bd5ae70: Waiting 2024-06-26T07:03:17.4077295Z ddc9740bcea2: Pulling fs layer 2024-06-26T07:03:17.4077661Z 4bdf41c9ecbe: Waiting 2024-06-26T07:03:17.4077989Z fb2e97768560: Pulling fs layer 2024-06-26T07:03:17.4078346Z da02d278e524: Waiting 2024-06-26T07:03:17.4078681Z b599c5a8c7cb: Pulling fs layer 2024-06-26T07:03:17.4079054Z e08e88c13668: Pulling fs layer 2024-06-26T07:03:17.4079400Z f4863801e30c: Waiting 2024-06-26T07:03:17.4079732Z 12ba7431ff38: Pulling fs layer 2024-06-26T07:03:17.4080158Z 9cd4c745f8e4: Waiting 2024-06-26T07:03:17.4080474Z 73a0ce681c29: Waiting 2024-06-26T07:03:17.4080842Z cf7c2cb896cb: Pulling fs layer 2024-06-26T07:03:17.4081201Z b2950a036534: Waiting 2024-06-26T07:03:17.4081682Z 3a778ddfac2a: Pulling fs layer 2024-06-26T07:03:17.4082044Z d37dd9ed8948: Waiting 2024-06-26T07:03:17.4082464Z cf2f34f225db: Waiting 2024-06-26T07:03:17.4082838Z 236c8f0245f4: Pulling fs layer 2024-06-26T07:03:17.4083259Z 96d0e2032184: Waiting 2024-06-26T07:03:17.4083605Z df546d7b3e34: Waiting 2024-06-26T07:03:17.4083923Z 25cd0c482ad6: Waiting 2024-06-26T07:03:17.4084237Z 3d914950f8ad: Waiting 2024-06-26T07:03:17.4084625Z ed712f63cde7: Waiting 2024-06-26T07:03:17.4084936Z 9bf94bc45658: Waiting 2024-06-26T07:03:17.4085250Z de45a14c9b22: Waiting 2024-06-26T07:03:17.4085565Z 25e19d81d9fc: Waiting 2024-06-26T07:03:17.4085878Z b3c5d66c679f: Waiting 2024-06-26T07:03:17.4086189Z 60156b40fcbe: Waiting 2024-06-26T07:03:17.4086500Z 7a868239227f: Waiting 2024-06-26T07:03:17.4086913Z a97a71ef8a4e: Waiting 2024-06-26T07:03:17.4087238Z 4f4fb700ef54: Pulling fs layer 2024-06-26T07:03:17.4087596Z e99241e77209: Waiting 2024-06-26T07:03:17.4087911Z 35e8f4e2a42f: Waiting 2024-06-26T07:03:17.4088241Z dda1ce302b9a: Pulling fs layer 2024-06-26T07:03:17.4088605Z ddc9740bcea2: Waiting 2024-06-26T07:03:17.4088939Z e797fe86caef: Pulling fs layer 2024-06-26T07:03:17.4089300Z 12ba7431ff38: Waiting 2024-06-26T07:03:17.4089605Z fb2e97768560: Waiting 2024-06-26T07:03:17.4089926Z cf7c2cb896cb: Waiting 2024-06-26T07:03:17.4090243Z 83911d7c7ecf: Waiting 2024-06-26T07:03:17.4090555Z e08e88c13668: Waiting 2024-06-26T07:03:17.4090860Z b599c5a8c7cb: Waiting 2024-06-26T07:03:17.4091175Z 671b4a301d81: Waiting 2024-06-26T07:03:17.4091491Z 67760cf5ec46: Waiting 2024-06-26T07:03:17.4091804Z 3a778ddfac2a: Waiting 2024-06-26T07:03:17.4092127Z 967190076fc0: Pulling fs layer 2024-06-26T07:03:17.4092497Z 4fb0a83f0685: Pulling fs layer 2024-06-26T07:03:17.4092871Z 68af2ec4e30a: Pulling fs layer 2024-06-26T07:03:17.4093247Z cc91933e985a: Pulling fs layer 2024-06-26T07:03:17.4093681Z 9f3187916e7d: Pulling fs layer 2024-06-26T07:03:17.4094048Z 526083994857: Pulling fs layer 2024-06-26T07:03:17.4094416Z 05a6f6dcc1c0: Pulling fs layer 2024-06-26T07:03:17.4094775Z 84b2c7a89982: Waiting 2024-06-26T07:03:17.4095105Z 6bc9dc8315b0: Pulling fs layer 2024-06-26T07:03:17.4095534Z 1b0e27c35f07: Pulling fs layer 2024-06-26T07:03:17.4095910Z 95237e7311a1: Pulling fs layer 2024-06-26T07:03:17.4096271Z 789eff6c51aa: Pulling fs layer 2024-06-26T07:03:17.4096649Z de0f8a8c45c6: Pulling fs layer 2024-06-26T07:03:17.4097023Z 2060028f7488: Pulling fs layer 2024-06-26T07:03:17.4097384Z e412c7f3b2de: Pulling fs layer 2024-06-26T07:03:17.4097743Z 9f3187916e7d: Waiting 2024-06-26T07:03:17.4098055Z 526083994857: Waiting 2024-06-26T07:03:17.4098365Z 05a6f6dcc1c0: Waiting 2024-06-26T07:03:17.4098673Z 6bc9dc8315b0: Waiting 2024-06-26T07:03:17.4098988Z 1b0e27c35f07: Waiting 2024-06-26T07:03:17.4099307Z dda1ce302b9a: Waiting 2024-06-26T07:03:17.4099622Z e797fe86caef: Waiting 2024-06-26T07:03:17.4099935Z 236c8f0245f4: Waiting 2024-06-26T07:03:17.4100242Z 95237e7311a1: Waiting 2024-06-26T07:03:17.4100550Z 967190076fc0: Waiting 2024-06-26T07:03:17.4100858Z 68af2ec4e30a: Waiting 2024-06-26T07:03:17.4101174Z 2060028f7488: Waiting 2024-06-26T07:03:17.4101484Z de0f8a8c45c6: Waiting 2024-06-26T07:03:17.4101801Z cc91933e985a: Waiting 2024-06-26T07:03:17.4102107Z 789eff6c51aa: Waiting 2024-06-26T07:03:17.4102422Z 4fb0a83f0685: Waiting 2024-06-26T07:03:17.5292233Z 224fe954d725: Verifying Checksum 2024-06-26T07:03:17.5292706Z 224fe954d725: Download complete 2024-06-26T07:03:17.5979570Z d527cbbb87e3: Verifying Checksum 2024-06-26T07:03:17.5980223Z d527cbbb87e3: Download complete 2024-06-26T07:03:17.6754598Z b57676e46aee: Verifying Checksum 2024-06-26T07:03:17.6755040Z b57676e46aee: Download complete 2024-06-26T07:03:17.7470803Z 7a2c55901189: Verifying Checksum 2024-06-26T07:03:17.7471244Z 7a2c55901189: Download complete 2024-06-26T07:03:17.8202738Z a41a8d1c11c8: Verifying Checksum 2024-06-26T07:03:17.8203310Z a41a8d1c11c8: Download complete 2024-06-26T07:03:17.8909819Z 0c1227890755: Verifying Checksum 2024-06-26T07:03:17.8910478Z 0c1227890755: Download complete 2024-06-26T07:03:17.9748151Z d8d1234baab3: Verifying Checksum 2024-06-26T07:03:17.9749113Z d8d1234baab3: Download complete 2024-06-26T07:03:18.0323038Z 75722010b82e: Verifying Checksum 2024-06-26T07:03:18.0323542Z 75722010b82e: Download complete 2024-06-26T07:03:18.1412105Z ec1e7978c1fe: Download complete 2024-06-26T07:03:18.2014200Z 309b872da805: Verifying Checksum 2024-06-26T07:03:18.2014672Z 309b872da805: Download complete 2024-06-26T07:03:18.7945337Z 7a2c55901189: Pull complete 2024-06-26T07:03:19.1244125Z 224fe954d725: Pull complete 2024-06-26T07:03:20.1059691Z 75722010b82e: Pull complete 2024-06-26T07:03:20.1613681Z d527cbbb87e3: Pull complete 2024-06-26T07:03:20.2215498Z b57676e46aee: Pull complete 2024-06-26T07:03:20.7256152Z e82932cb002c: Verifying Checksum 2024-06-26T07:03:20.7257045Z e82932cb002c: Download complete 2024-06-26T07:03:20.7994557Z ca9dd73e3e93: Verifying Checksum 2024-06-26T07:03:20.7995156Z ca9dd73e3e93: Download complete 2024-06-26T07:03:20.8795858Z 16d76a79d5d6: Verifying Checksum 2024-06-26T07:03:20.8796322Z 16d76a79d5d6: Download complete 2024-06-26T07:03:20.9419012Z 4bdf41c9ecbe: Download complete 2024-06-26T07:03:21.9708670Z f4863801e30c: Verifying Checksum 2024-06-26T07:03:21.9709186Z f4863801e30c: Download complete 2024-06-26T07:03:22.0532622Z d37dd9ed8948: Download complete 2024-06-26T07:03:22.1325924Z cf2f34f225db: Download complete 2024-06-26T07:03:22.2099852Z df546d7b3e34: Verifying Checksum 2024-06-26T07:03:22.2100434Z df546d7b3e34: Download complete 2024-06-26T07:03:31.0161712Z a8c1e85b5e14: Download complete 2024-06-26T07:03:31.0901286Z 96d0e2032184: Download complete 2024-06-26T07:03:31.1615101Z 06e12ce59790: Verifying Checksum 2024-06-26T07:03:31.1615755Z 06e12ce59790: Download complete 2024-06-26T07:03:31.2325498Z ed712f63cde7: Verifying Checksum 2024-06-26T07:03:31.2326010Z ed712f63cde7: Download complete 2024-06-26T07:03:31.3061292Z a97a71ef8a4e: Verifying Checksum 2024-06-26T07:03:31.3061881Z a97a71ef8a4e: Download complete 2024-06-26T07:03:31.4003267Z 25cd0c482ad6: Verifying Checksum 2024-06-26T07:03:31.4003855Z 25cd0c482ad6: Download complete 2024-06-26T07:03:32.6676214Z 9bf94bc45658: Verifying Checksum 2024-06-26T07:03:32.6676718Z 9bf94bc45658: Download complete 2024-06-26T07:03:32.7404771Z de45a14c9b22: Verifying Checksum 2024-06-26T07:03:32.7405238Z de45a14c9b22: Download complete 2024-06-26T07:03:32.8125078Z e99241e77209: Verifying Checksum 2024-06-26T07:03:32.8125640Z e99241e77209: Download complete 2024-06-26T07:03:32.8923092Z 35e8f4e2a42f: Verifying Checksum 2024-06-26T07:03:32.8923567Z 35e8f4e2a42f: Download complete 2024-06-26T07:03:32.9767899Z a823ffa4c541: Verifying Checksum 2024-06-26T07:03:32.9768477Z a823ffa4c541: Download complete 2024-06-26T07:03:33.0583323Z 44ba272eae20: Download complete 2024-06-26T07:03:37.5748221Z da02d278e524: Download complete 2024-06-26T07:03:37.6508322Z 73a0ce681c29: Download complete 2024-06-26T07:03:37.7214656Z 49737bd5ae70: Verifying Checksum 2024-06-26T07:03:37.7215304Z 49737bd5ae70: Download complete 2024-06-26T07:03:38.1412889Z 9cd4c745f8e4: Download complete 2024-06-26T07:03:38.2465849Z b2950a036534: Verifying Checksum 2024-06-26T07:03:38.3186549Z 25e19d81d9fc: Download complete 2024-06-26T07:03:38.5832089Z 60156b40fcbe: Verifying Checksum 2024-06-26T07:03:38.5832616Z 60156b40fcbe: Download complete 2024-06-26T07:03:38.6560034Z 7a868239227f: Download complete 2024-06-26T07:03:38.7797266Z 83911d7c7ecf: Download complete 2024-06-26T07:03:38.8538270Z b3c5d66c679f: Verifying Checksum 2024-06-26T07:03:38.8538766Z b3c5d66c679f: Download complete 2024-06-26T07:03:43.3126169Z 7ed32bc8e469: Verifying Checksum 2024-06-26T07:03:43.3126637Z 7ed32bc8e469: Download complete 2024-06-26T07:03:43.4030117Z c1068d03a811: Download complete 2024-06-26T07:03:43.4724203Z 671b4a301d81: Download complete 2024-06-26T07:03:43.9557768Z a8c1e85b5e14: Pull complete 2024-06-26T07:03:44.0025988Z 67760cf5ec46: Verifying Checksum 2024-06-26T07:03:44.0026656Z 67760cf5ec46: Download complete 2024-06-26T07:03:44.0696550Z ddc9740bcea2: Download complete 2024-06-26T07:03:44.1486897Z fb2e97768560: Download complete 2024-06-26T07:03:44.1866003Z a41a8d1c11c8: Pull complete 2024-06-26T07:03:44.2223493Z b599c5a8c7cb: Verifying Checksum 2024-06-26T07:03:44.2223954Z b599c5a8c7cb: Download complete 2024-06-26T07:03:44.2981276Z e08e88c13668: Verifying Checksum 2024-06-26T07:03:44.2982033Z e08e88c13668: Download complete 2024-06-26T07:03:44.4332070Z 0c1227890755: Pull complete 2024-06-26T07:03:44.6796726Z d8d1234baab3: Pull complete 2024-06-26T07:03:50.1144249Z 3d914950f8ad: Verifying Checksum 2024-06-26T07:03:50.1806829Z 3d914950f8ad: Download complete 2024-06-26T07:03:50.1807281Z cf7c2cb896cb: Verifying Checksum 2024-06-26T07:03:50.1807842Z cf7c2cb896cb: Download complete 2024-06-26T07:03:50.2664228Z 3a778ddfac2a: Verifying Checksum 2024-06-26T07:03:50.2665056Z 3a778ddfac2a: Download complete 2024-06-26T07:03:50.3701841Z 236c8f0245f4: Verifying Checksum 2024-06-26T07:03:50.3702315Z 236c8f0245f4: Download complete 2024-06-26T07:03:50.3772709Z 4f4fb700ef54: Verifying Checksum 2024-06-26T07:03:50.3773208Z 4f4fb700ef54: Download complete 2024-06-26T07:03:50.4497610Z dda1ce302b9a: Download complete 2024-06-26T07:03:50.5330333Z e797fe86caef: Verifying Checksum 2024-06-26T07:03:50.5330925Z e797fe86caef: Download complete 2024-06-26T07:03:50.6692856Z 967190076fc0: Verifying Checksum 2024-06-26T07:03:50.6693558Z 967190076fc0: Download complete 2024-06-26T07:03:50.7552570Z 4fb0a83f0685: Download complete 2024-06-26T07:03:50.8520562Z 68af2ec4e30a: Download complete 2024-06-26T07:03:50.9332047Z cc91933e985a: Verifying Checksum 2024-06-26T07:03:50.9332512Z cc91933e985a: Download complete 2024-06-26T07:03:51.0075983Z 9f3187916e7d: Verifying Checksum 2024-06-26T07:03:51.0076665Z 9f3187916e7d: Download complete 2024-06-26T07:03:51.1325014Z 526083994857: Verifying Checksum 2024-06-26T07:03:51.1325697Z 526083994857: Download complete 2024-06-26T07:03:51.2134864Z 05a6f6dcc1c0: Verifying Checksum 2024-06-26T07:03:51.2135325Z 05a6f6dcc1c0: Download complete 2024-06-26T07:03:51.8183641Z 6bc9dc8315b0: Verifying Checksum 2024-06-26T07:03:51.9083075Z 6bc9dc8315b0: Download complete 2024-06-26T07:03:51.9083681Z 1b0e27c35f07: Verifying Checksum 2024-06-26T07:03:51.9084838Z 1b0e27c35f07: Download complete 2024-06-26T07:04:13.4869921Z 12ba7431ff38: Verifying Checksum 2024-06-26T07:04:13.4871381Z 12ba7431ff38: Download complete 2024-06-26T07:04:13.5607178Z 789eff6c51aa: Download complete 2024-06-26T07:04:13.6304641Z de0f8a8c45c6: Verifying Checksum 2024-06-26T07:04:13.6308408Z de0f8a8c45c6: Download complete 2024-06-26T07:04:15.4607862Z 2060028f7488: Verifying Checksum 2024-06-26T07:04:15.4608504Z 2060028f7488: Download complete 2024-06-26T07:04:15.5446664Z e412c7f3b2de: Verifying Checksum 2024-06-26T07:04:15.5447251Z e412c7f3b2de: Download complete 2024-06-26T07:04:22.1092900Z 95237e7311a1: Verifying Checksum 2024-06-26T07:04:22.1093405Z 95237e7311a1: Download complete 2024-06-26T07:04:49.3542758Z 84b2c7a89982: Verifying Checksum 2024-06-26T07:04:49.3543316Z 84b2c7a89982: Download complete 2024-06-26T07:05:00.6790298Z 7ed32bc8e469: Pull complete 2024-06-26T07:05:00.9595566Z ec1e7978c1fe: Pull complete 2024-06-26T07:05:01.1756957Z 309b872da805: Pull complete 2024-06-26T07:05:08.4765034Z e82932cb002c: Pull complete 2024-06-26T07:05:08.6878472Z ca9dd73e3e93: Pull complete 2024-06-26T07:05:08.9024008Z 16d76a79d5d6: Pull complete 2024-06-26T07:05:09.1226364Z 4bdf41c9ecbe: Pull complete 2024-06-26T07:05:11.4992862Z f4863801e30c: Pull complete 2024-06-26T07:05:11.7158212Z d37dd9ed8948: Pull complete 2024-06-26T07:05:11.9426612Z cf2f34f225db: Pull complete 2024-06-26T07:05:12.1539594Z df546d7b3e34: Pull complete 2024-06-26T07:06:01.4734101Z 3d914950f8ad: Pull complete 2024-06-26T07:06:01.6161922Z 96d0e2032184: Pull complete 2024-06-26T07:06:01.6965029Z 06e12ce59790: Pull complete 2024-06-26T07:06:01.7913282Z ed712f63cde7: Pull complete 2024-06-26T07:06:01.9186791Z a97a71ef8a4e: Pull complete 2024-06-26T07:06:02.0249362Z 25cd0c482ad6: Pull complete 2024-06-26T07:06:05.4981195Z 9bf94bc45658: Pull complete 2024-06-26T07:06:05.7253805Z de45a14c9b22: Pull complete 2024-06-26T07:06:05.9698968Z e99241e77209: Pull complete 2024-06-26T07:06:06.1857414Z 35e8f4e2a42f: Pull complete 2024-06-26T07:06:06.4138067Z a823ffa4c541: Pull complete 2024-06-26T07:06:06.6277776Z 44ba272eae20: Pull complete 2024-06-26T07:06:14.7804053Z da02d278e524: Pull complete 2024-06-26T07:06:14.8949716Z 73a0ce681c29: Pull complete 2024-06-26T07:06:15.1048634Z 49737bd5ae70: Pull complete 2024-06-26T07:06:16.0634221Z 9cd4c745f8e4: Pull complete 2024-06-26T07:06:16.1583543Z b2950a036534: Pull complete 2024-06-26T07:06:16.2898738Z 25e19d81d9fc: Pull complete 2024-06-26T07:06:16.7725594Z 60156b40fcbe: Pull complete 2024-06-26T07:06:16.9875395Z 7a868239227f: Pull complete 2024-06-26T07:06:17.3835251Z 83911d7c7ecf: Pull complete 2024-06-26T07:06:17.5595467Z b3c5d66c679f: Pull complete 2024-06-26T07:06:56.7032051Z 84b2c7a89982: Pull complete 2024-06-26T07:06:56.9235333Z c1068d03a811: Pull complete 2024-06-26T07:06:57.1550274Z 671b4a301d81: Pull complete 2024-06-26T07:06:59.1873357Z 67760cf5ec46: Pull complete 2024-06-26T07:06:59.2278697Z ddc9740bcea2: Pull complete 2024-06-26T07:06:59.2842644Z fb2e97768560: Pull complete 2024-06-26T07:06:59.4035737Z b599c5a8c7cb: Pull complete 2024-06-26T07:06:59.4537459Z e08e88c13668: Pull complete 2024-06-26T07:07:33.7211894Z 12ba7431ff38: Pull complete 2024-06-26T07:07:33.8955762Z cf7c2cb896cb: Pull complete 2024-06-26T07:07:34.1127156Z 3a778ddfac2a: Pull complete 2024-06-26T07:07:34.5929453Z 236c8f0245f4: Pull complete 2024-06-26T07:07:34.8094501Z 4f4fb700ef54: Pull complete 2024-06-26T07:07:35.0337045Z dda1ce302b9a: Pull complete 2024-06-26T07:07:35.2581658Z e797fe86caef: Pull complete 2024-06-26T07:07:35.6341921Z 967190076fc0: Pull complete 2024-06-26T07:07:35.8615369Z 4fb0a83f0685: Pull complete 2024-06-26T07:07:36.0752394Z 68af2ec4e30a: Pull complete 2024-06-26T07:07:36.2643179Z cc91933e985a: Pull complete 2024-06-26T07:07:36.4776027Z 9f3187916e7d: Pull complete 2024-06-26T07:07:37.5760491Z 526083994857: Pull complete 2024-06-26T07:07:37.7955418Z 05a6f6dcc1c0: Pull complete 2024-06-26T07:07:39.8670310Z 6bc9dc8315b0: Pull complete 2024-06-26T07:07:40.0857931Z 1b0e27c35f07: Pull complete 2024-06-26T07:07:53.5570520Z 95237e7311a1: Pull complete 2024-06-26T07:07:53.6253529Z 789eff6c51aa: Pull complete 2024-06-26T07:07:53.6722894Z de0f8a8c45c6: Pull complete 2024-06-26T07:07:54.3657595Z 2060028f7488: Pull complete 2024-06-26T07:07:54.4091464Z e412c7f3b2de: Pull complete 2024-06-26T07:07:54.7019791Z Digest: sha256:216c88a4f79ebfa71a5dcf4d9a946548184354a3ea1f677f4b1065d28705debb 2024-06-26T07:07:54.7052869Z Status: Downloaded newer image for 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:07:54.7082129Z 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:07:54.7121030Z ##[group]Run echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> "$GITHUB_OUTPUT" 2024-06-26T07:07:54.7121943Z echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> "$GITHUB_OUTPUT" 2024-06-26T07:07:54.7130045Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:07:54.7130532Z env: 2024-06-26T07:07:54.7130812Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:07:54.7131159Z ##[endgroup] 2024-06-26T07:07:54.7283705Z ##[group]Run pytorch/test-infra/.github/actions/setup-nvidia@main 2024-06-26T07:07:54.7284246Z with: 2024-06-26T07:07:54.7284537Z driver-version: 550.54.15 2024-06-26T07:07:54.7284940Z env: 2024-06-26T07:07:54.7285221Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:07:54.7285560Z ##[endgroup] 2024-06-26T07:07:54.7324175Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2024-06-26T07:07:54.7324740Z with: 2024-06-26T07:07:54.7325086Z timeout_minutes: 10 2024-06-26T07:07:54.7325407Z max_attempts: 3 2024-06-26T07:07:54.7355924Z command: # Is it disgusting to have a full shell script here in this github action? Sure # But is it the best way to make it so that this action relies on nothing else? Absolutely set -eou pipefail DISTRIBUTION=$(. /etc/os-release;echo $ID$VERSION_ID) DRIVER_FN="NVIDIA-Linux-x86_64-${DRIVER_VERSION}.run" install_nvidia_docker2_amzn2() { ( set -x # Needed for yum-config-manager sudo yum install -y yum-utils if [[ "${DISTRIBUTION}" == "amzn2023" ]] ; then YUM_REPO_URL="https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo" else # Amazon Linux 2 YUM_REPO_URL="https://nvidia.github.io/nvidia-docker/${DISTRIBUTION}/nvidia-docker.repo" fi sudo yum-config-manager --add-repo "${YUM_REPO_URL}" sudo yum install -y nvidia-docker2 sudo systemctl restart docker ) } install_nvidia_docker2_ubuntu20() { ( set -x # Install nvidia-driver package if not installed status="$(dpkg-query -W --showformat='${db:Status-Status}' nvidia-docker2 2>&1)" if [ ! $? = 0 ] || [ ! "$status" = installed ]; then sudo apt-get install -y nvidia-docker2 sudo systemctl restart docker fi ) } pre_install_nvidia_driver_amzn2() { ( # Purge any nvidia driver installed from RHEL repo sudo yum remove -y nvidia-driver-latest-dkms ) } install_nvidia_driver_common() { ( # Try to gather more information about the runner and its existing NVIDIA driver if any echo "Before installing NVIDIA driver" lspci lsmod modinfo nvidia || true HAS_NVIDIA_DRIVER=0 # Check if NVIDIA driver has already been installed if [ -x "$(command -v nvidia-smi)" ]; then set +e # The driver exists, check its version next. Also check only the first GPU if there are more than one of them # so that the same driver version is not print over multiple lines INSTALLED_DRIVER_VERSION=$(nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0) NVIDIA_SMI_STATUS=$? if [ "$NVIDIA_SMI_STATUS" -ne 0 ] && [ "$NVIDIA_SMI_STATUS" -ne 14 ]; then echo "Failed to get NVIDIA driver version ($INSTALLED_DRIVER_VERSION). Continuing" elif [ "$INSTALLED_DRIVER_VERSION" != "$DRIVER_VERSION" ]; then echo "NVIDIA driver ($INSTALLED_DRIVER_VERSION) has been installed, but we expect to have $DRIVER_VERSION instead. Continuing" else HAS_NVIDIA_DRIVER=1 echo "NVIDIA driver ($INSTALLED_DRIVER_VERSION) has already been installed. Skipping NVIDIA driver installation" fi set -e fi if [ "$HAS_NVIDIA_DRIVER" -eq 0 ]; then # CAUTION: this may need to be updated in future if [ "${DISTRIBUTION}" != ubuntu20.04 ]; then sudo yum groupinstall -y "Development Tools" # ensure our kernel install is the same as our underlying kernel, # groupinstall "Development Tools" has a habit of mismatching kernel headers sudo yum install -y "kernel-devel-uname-r == $(uname -r)" sudo modprobe backlight fi sudo curl -fsL -o /tmp/nvidia_driver "https://s3.amazonaws.com/ossci-linux/nvidia_driver/$DRIVER_FN" set +e sudo /bin/bash /tmp/nvidia_driver -s --no-drm NVIDIA_INSTALLATION_STATUS=$? RESET_GPU=0 if [ "$NVIDIA_INSTALLATION_STATUS" -ne 0 ]; then sudo cat /var/log/nvidia-installer.log # Fail to install NVIDIA driver, try to reset the GPU RESET_GPU=1 elif [ -x "$(command -v nvidia-smi)" ]; then # Check again if nvidia-smi works even if the driver installation completes successfully INSTALLED_DRIVER_VERSION=$(nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0) NVIDIA_SMI_STATUS=$? if [ "$NVIDIA_SMI_STATUS" -ne 0 ] && [ "$NVIDIA_SMI_STATUS" -ne 14 ]; then RESET_GPU=1 fi fi if [ "$RESET_GPU" -eq 1 ]; then NVIDIA_DEVICES=$(lspci -D | grep -i NVIDIA | cut -d' ' -f1) # The GPU can get stuck in a failure state if somehow the test crashs the GPU microcode. When this # happens, we'll try to reset all NVIDIA devices https://github.com/pytorch/pytorch/issues/88388 for PCI_ID in $NVIDIA_DEVICES; do DEVICE_ENABLED=$(cat /sys/bus/pci/devices/$PCI_ID/enable) echo "Reseting $PCI_ID (enabled state: $DEVICE_ENABLED)" # This requires sudo permission of course echo "1" | sudo tee /sys/bus/pci/devices/$PCI_ID/reset sleep 1 done fi sudo rm -fv /tmp/nvidia_driver set -e fi ) } post_install_nvidia_driver_common() { ( sudo modprobe nvidia || true echo "After installing NVIDIA driver" lspci lsmod modinfo nvidia || true ( set +e nvidia-smi # NB: Annoyingly, nvidia-smi command returns successfully with return code 0 even in # the case where the driver has already crashed as it still can get the driver version # and some basic information like the bus ID. However, the rest of the information # would be missing (ERR!), for example: # # +-----------------------------------------------------------------------------+ # | NVIDIA-SMI 525.89.02 Driver Version: 525.89.02 CUDA Version: 12.0 | # |-------------------------------+----------------------+----------------------+ # | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | # | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | # | | | MIG M. | # |===============================+======================+======================| # | 0 ERR! Off | 00000000:00:1E.0 Off | ERR! | # |ERR! ERR! ERR! ERR! / ERR! | 4184MiB / 23028MiB | ERR! Default | # | | | ERR! | # +-------------------------------+----------------------+----------------------+ # # +-----------------------------------------------------------------------------+ # | Processes: | # | GPU GI CI PID Type Process name GPU Memory | # | ID ID Usage | # |=============================================================================| # +-----------------------------------------------------------------------------+ # # This should be reported as a failure instead as it will guarantee to fail when # Docker tries to run with --gpus all # # So, the correct check here is to query one of the missing piece of info like # GPU name, so that the command can fail accordingly nvidia-smi --query-gpu=gpu_name --format=csv,noheader --id=0 NVIDIA_SMI_STATUS=$? # Allowable exit statuses for nvidia-smi, see: https://github.com/NVIDIA/gpu-operator/issues/285 if [ "$NVIDIA_SMI_STATUS" -eq 0 ] || [ "$NVIDIA_SMI_STATUS" -eq 14 ]; then echo "INFO: Ignoring allowed status ${NVIDIA_SMI_STATUS}" else echo "ERROR: nvidia-smi exited with unresolved status ${NVIDIA_SMI_STATUS}" exit ${NVIDIA_SMI_STATUS} fi set -e ) ) } install_nvidia_driver_amzn2() { ( set -x pre_install_nvidia_driver_amzn2 install_nvidia_driver_common post_install_nvidia_driver_common ) } install_nvidia_driver_ubuntu20() { ( set -x install_nvidia_driver_common post_install_nvidia_driver_common ) } echo "== Installing nvidia driver ${DRIVER_FN} ==" case "${DISTRIBUTION}" in amzn*) install_nvidia_driver_amzn2 ;; ubuntu20.04) install_nvidia_driver_ubuntu20 ;; *) echo "ERROR: Unknown distribution ${DISTRIBUTION}" exit 1 ;; esac # Install container toolkit based on distribution echo "== Installing nvidia container toolkit for ${DISTRIBUTION} ==" case "${DISTRIBUTION}" in amzn*) install_nvidia_docker2_amzn2 ;; ubuntu20.04) install_nvidia_docker2_ubuntu20 ;; *) echo "ERROR: Unknown distribution ${DISTRIBUTION}" exit 1 ;; esac echo "GPU_FLAG=--gpus all -e NVIDIA_DRIVER_CAPABILITIES=all" >> "${GITHUB_ENV}" 2024-06-26T07:07:54.7386764Z retry_wait_seconds: 10 2024-06-26T07:07:54.7387134Z polling_interval_seconds: 1 2024-06-26T07:07:54.7387601Z warning_on_retry: true 2024-06-26T07:07:54.7387960Z continue_on_error: false 2024-06-26T07:07:54.7388303Z env: 2024-06-26T07:07:54.7388577Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:07:54.7388933Z DRIVER_VERSION: 550.54.15 2024-06-26T07:07:54.7389287Z ##[endgroup] 2024-06-26T07:07:54.7920615Z == Installing nvidia driver NVIDIA-Linux-x86_64-550.54.15.run == 2024-06-26T07:07:54.7921450Z + pre_install_nvidia_driver_amzn2 2024-06-26T07:07:54.7921994Z + sudo yum remove -y nvidia-driver-latest-dkms 2024-06-26T07:07:55.1057223Z Loaded plugins: extras_suggestions, langpacks, priorities, update-motd 2024-06-26T07:07:55.1442380Z No Match for argument: nvidia-driver-latest-dkms 2024-06-26T07:07:55.1681830Z No Packages marked for removal 2024-06-26T07:07:55.1797169Z + install_nvidia_driver_common 2024-06-26T07:07:55.1800101Z + echo 'Before installing NVIDIA driver' 2024-06-26T07:07:55.1800987Z Before installing NVIDIA driver 2024-06-26T07:07:55.1802675Z + lspci 2024-06-26T07:07:55.1916408Z 00:00.0 Host bridge: Intel Corporation 440FX - 82441FX PMC [Natoma] 2024-06-26T07:07:55.1917309Z 00:01.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II] 2024-06-26T07:07:55.1918513Z 00:01.3 Non-VGA unclassified device: Intel Corporation 82371AB/EB/MB PIIX4 ACPI (rev 08) 2024-06-26T07:07:55.1919660Z 00:03.0 VGA compatible controller: Amazon.com, Inc. Device 1111 2024-06-26T07:07:55.1920811Z 00:04.0 Non-Volatile memory controller: Amazon.com, Inc. Device 8061 2024-06-26T07:07:55.1921967Z 00:05.0 Ethernet controller: Amazon.com, Inc. Elastic Network Adapter (ENA) 2024-06-26T07:07:55.1923021Z 00:1e.0 3D controller: NVIDIA Corporation Device 2237 (rev a1) 2024-06-26T07:07:55.1924181Z 00:1f.0 Non-Volatile memory controller: Amazon.com, Inc. NVMe SSD Controller 2024-06-26T07:07:55.1925138Z + lsmod 2024-06-26T07:07:55.1933294Z Module Size Used by 2024-06-26T07:07:55.1933882Z xt_nat 16384 0 2024-06-26T07:07:55.1934369Z ib_core 266240 0 2024-06-26T07:07:55.1934747Z nvidia_modeset 1339392 0 2024-06-26T07:07:55.1935128Z veth 16384 0 2024-06-26T07:07:55.1935633Z nvidia_uvm 4599808 0 2024-06-26T07:07:55.1936536Z nvidia 53989376 2 nvidia_uvm,nvidia_modeset 2024-06-26T07:07:55.1937050Z drm 421888 1 nvidia 2024-06-26T07:07:55.1937541Z i2c_core 77824 2 nvidia,drm 2024-06-26T07:07:55.1938123Z backlight 16384 1 nvidia_modeset 2024-06-26T07:07:55.1938736Z xt_conntrack 16384 1 2024-06-26T07:07:55.1939243Z ipt_MASQUERADE 16384 1 2024-06-26T07:07:55.1939852Z nf_nat_masquerade_ipv4 16384 1 ipt_MASQUERADE 2024-06-26T07:07:55.1940438Z nf_conntrack_netlink 49152 0 2024-06-26T07:07:55.1941030Z nfnetlink 16384 2 nf_conntrack_netlink 2024-06-26T07:07:55.1941664Z xfrm_user 45056 1 2024-06-26T07:07:55.1942210Z xfrm_algo 16384 1 xfrm_user 2024-06-26T07:07:55.1942802Z iptable_nat 16384 1 2024-06-26T07:07:55.1943312Z nf_conntrack_ipv4 16384 3 2024-06-26T07:07:55.1943821Z nf_defrag_ipv4 16384 1 nf_conntrack_ipv4 2024-06-26T07:07:55.1944302Z nf_nat_ipv4 16384 1 iptable_nat 2024-06-26T07:07:55.1944858Z nf_nat 32768 3 nf_nat_masquerade_ipv4,nf_nat_ipv4,xt_nat 2024-06-26T07:07:55.1945951Z nf_conntrack 155648 8 xt_conntrack,nf_nat_masquerade_ipv4,nf_conntrack_ipv4,nf_nat,ipt_MASQUERADE,nf_nat_ipv4,xt_nat,nf_conntrack_netlink 2024-06-26T07:07:55.1946866Z xt_addrtype 16384 2 2024-06-26T07:07:55.1947674Z iptable_filter 16384 1 2024-06-26T07:07:55.1948235Z br_netfilter 24576 0 2024-06-26T07:07:55.1948652Z bridge 172032 1 br_netfilter 2024-06-26T07:07:55.1949092Z stp 16384 1 bridge 2024-06-26T07:07:55.1949520Z llc 16384 2 bridge,stp 2024-06-26T07:07:55.1949941Z overlay 86016 0 2024-06-26T07:07:55.1950315Z sunrpc 393216 1 2024-06-26T07:07:55.1950683Z dm_mirror 28672 0 2024-06-26T07:07:55.1951094Z dm_region_hash 20480 1 dm_mirror 2024-06-26T07:07:55.1951585Z dm_log 20480 2 dm_region_hash,dm_mirror 2024-06-26T07:07:55.1952101Z dm_mod 143360 2 dm_log,dm_mirror 2024-06-26T07:07:55.1952641Z dax 69632 1 dm_mod 2024-06-26T07:07:55.1953047Z crc32_pclmul 16384 0 2024-06-26T07:07:55.1953489Z ghash_clmulni_intel 16384 0 2024-06-26T07:07:55.1953874Z pcbc 16384 0 2024-06-26T07:07:55.1954252Z aesni_intel 188416 0 2024-06-26T07:07:55.1954659Z aes_x86_64 20480 1 aesni_intel 2024-06-26T07:07:55.1955118Z crypto_simd 16384 1 aesni_intel 2024-06-26T07:07:55.1955571Z glue_helper 16384 1 aesni_intel 2024-06-26T07:07:55.1956132Z cryptd 28672 3 crypto_simd,ghash_clmulni_intel,aesni_intel 2024-06-26T07:07:55.1956683Z mousedev 24576 0 2024-06-26T07:07:55.1957062Z evdev 20480 3 2024-06-26T07:07:55.1957430Z psmouse 32768 0 2024-06-26T07:07:55.1957807Z button 16384 0 2024-06-26T07:07:55.1958181Z ena 139264 0 2024-06-26T07:07:55.1958572Z ptp 20480 1 ena 2024-06-26T07:07:55.1958972Z pps_core 20480 1 ptp 2024-06-26T07:07:55.1959377Z crc32c_intel 24576 0 2024-06-26T07:07:55.1959759Z autofs4 49152 2 2024-06-26T07:07:55.1960119Z + modinfo nvidia 2024-06-26T07:07:55.1960863Z filename: /lib/modules/4.14.336-257.562.amzn2.x86_64/kernel/drivers/video/nvidia.ko 2024-06-26T07:07:55.1961576Z alias: char-major-195-* 2024-06-26T07:07:55.1961968Z version: 550.54.15 2024-06-26T07:07:55.1962312Z supported: external 2024-06-26T07:07:55.1962660Z license: NVIDIA 2024-06-26T07:07:55.1963046Z firmware: nvidia/550.54.15/gsp_tu10x.bin 2024-06-26T07:07:55.1963532Z firmware: nvidia/550.54.15/gsp_ga10x.bin 2024-06-26T07:07:55.1963991Z srcversion: 833721318DA517F0C2FEC97 2024-06-26T07:07:55.1964463Z alias: pci:v000010DEd*sv*sd*bc06sc80i00* 2024-06-26T07:07:55.1965098Z alias: pci:v000010DEd*sv*sd*bc03sc02i00* 2024-06-26T07:07:55.1965704Z alias: pci:v000010DEd*sv*sd*bc03sc00i00* 2024-06-26T07:07:55.1966199Z depends: i2c-core,drm 2024-06-26T07:07:55.1966566Z retpoline: Y 2024-06-26T07:07:55.1966880Z name: nvidia 2024-06-26T07:07:55.1967426Z vermagic: 4.14.336-257.562.amzn2.x86_64 SMP mod_unload modversions 2024-06-26T07:07:55.1968084Z parm: NvSwitchRegDwords:NvSwitch regkey (charp) 2024-06-26T07:07:55.1968738Z parm: NvSwitchBlacklist:NvSwitchBlacklist=uuid[,uuid...] (charp) 2024-06-26T07:07:55.1969334Z parm: NVreg_ResmanDebugLevel:int 2024-06-26T07:07:55.1969783Z parm: NVreg_RmLogonRC:int 2024-06-26T07:07:55.1970225Z parm: NVreg_ModifyDeviceFiles:int 2024-06-26T07:07:55.1970687Z parm: NVreg_DeviceFileUID:int 2024-06-26T07:07:55.1971126Z parm: NVreg_DeviceFileGID:int 2024-06-26T07:07:55.1971565Z parm: NVreg_DeviceFileMode:int 2024-06-26T07:07:55.1972139Z parm: NVreg_InitializeSystemMemoryAllocations:int 2024-06-26T07:07:55.1972723Z parm: NVreg_UsePageAttributeTable:int 2024-06-26T07:07:55.1973208Z parm: NVreg_EnablePCIeGen3:int 2024-06-26T07:07:55.1973642Z parm: NVreg_EnableMSI:int 2024-06-26T07:07:55.1974064Z parm: NVreg_TCEBypassMode:int 2024-06-26T07:07:55.1974522Z parm: NVreg_EnableStreamMemOPs:int 2024-06-26T07:07:55.1975057Z parm: NVreg_RestrictProfilingToAdminUsers:int 2024-06-26T07:07:55.1975713Z parm: NVreg_PreserveVideoMemoryAllocations:int 2024-06-26T07:07:55.1976277Z parm: NVreg_EnableS0ixPowerManagement:int 2024-06-26T07:07:55.1976887Z parm: NVreg_S0ixPowerManagementVideoMemoryThreshold:int 2024-06-26T07:07:55.1977480Z parm: NVreg_DynamicPowerManagement:int 2024-06-26T07:07:55.1978096Z parm: NVreg_DynamicPowerManagementVideoMemoryThreshold:int 2024-06-26T07:07:55.1978690Z parm: NVreg_EnableGpuFirmware:int 2024-06-26T07:07:55.1979189Z parm: NVreg_EnableGpuFirmwareLogs:int 2024-06-26T07:07:55.1979721Z parm: NVreg_OpenRmEnableUnsupportedGpus:int 2024-06-26T07:07:55.1980272Z parm: NVreg_EnableUserNUMAManagement:int 2024-06-26T07:07:55.1980772Z parm: NVreg_MemoryPoolSize:int 2024-06-26T07:07:55.1981241Z parm: NVreg_KMallocHeapMaxSize:int 2024-06-26T07:07:55.1981726Z parm: NVreg_VMallocHeapMaxSize:int 2024-06-26T07:07:55.1982211Z parm: NVreg_IgnoreMMIOCheck:int 2024-06-26T07:07:55.1982667Z parm: NVreg_NvLinkDisable:int 2024-06-26T07:07:55.1983181Z parm: NVreg_EnablePCIERelaxedOrderingMode:int 2024-06-26T07:07:55.1983707Z parm: NVreg_RegisterPCIDriver:int 2024-06-26T07:07:55.1984187Z parm: NVreg_EnableResizableBar:int 2024-06-26T07:07:55.1984679Z parm: NVreg_EnableDbgBreakpoint:int 2024-06-26T07:07:55.1985181Z parm: NVreg_EnableNonblockingOpen:int 2024-06-26T07:07:55.1985663Z parm: NVreg_RegistryDwords:charp 2024-06-26T07:07:55.1986170Z parm: NVreg_RegistryDwordsPerDevice:charp 2024-06-26T07:07:55.1986649Z parm: NVreg_RmMsg:charp 2024-06-26T07:07:55.1987068Z parm: NVreg_GpuBlacklist:charp 2024-06-26T07:07:55.1987753Z parm: NVreg_TemporaryFilePath:charp 2024-06-26T07:07:55.1988224Z parm: NVreg_ExcludedGpus:charp 2024-06-26T07:07:55.1988688Z parm: NVreg_DmaRemapPeerMmio:int 2024-06-26T07:07:55.1989170Z parm: NVreg_RmNvlinkBandwidth:charp 2024-06-26T07:07:55.1989658Z parm: NVreg_ImexChannelCount:int 2024-06-26T07:07:55.1990119Z parm: rm_firmware_active:charp 2024-06-26T07:07:55.1990535Z + HAS_NVIDIA_DRIVER=0 2024-06-26T07:07:55.1990919Z ++ command -v nvidia-smi 2024-06-26T07:07:55.1991326Z + '[' -x /usr/bin/nvidia-smi ']' 2024-06-26T07:07:55.1991697Z + set +e 2024-06-26T07:07:55.1992201Z ++ nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0 2024-06-26T07:07:57.1792447Z + INSTALLED_DRIVER_VERSION=550.54.15 2024-06-26T07:07:57.1793133Z + NVIDIA_SMI_STATUS=0 2024-06-26T07:07:57.1794094Z + '[' 0 -ne 0 ']' 2024-06-26T07:07:57.1794498Z + '[' 550.54.15 '!=' 550.54.15 ']' 2024-06-26T07:07:57.1794907Z + HAS_NVIDIA_DRIVER=1 2024-06-26T07:07:57.1795688Z + echo 'NVIDIA driver (550.54.15) has already been installed. Skipping NVIDIA driver installation' 2024-06-26T07:07:57.1796463Z + set -e 2024-06-26T07:07:57.1796776Z + '[' 1 -eq 0 ']' 2024-06-26T07:07:57.1797403Z NVIDIA driver (550.54.15) has already been installed. Skipping NVIDIA driver installation 2024-06-26T07:07:57.1798087Z + post_install_nvidia_driver_common 2024-06-26T07:07:57.1798500Z + sudo modprobe nvidia 2024-06-26T07:07:57.1894269Z + echo 'After installing NVIDIA driver' 2024-06-26T07:07:57.1894854Z + lspci 2024-06-26T07:07:57.1895151Z After installing NVIDIA driver 2024-06-26T07:07:57.1974489Z 00:00.0 Host bridge: Intel Corporation 440FX - 82441FX PMC [Natoma] 2024-06-26T07:07:57.1975504Z 00:01.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II] 2024-06-26T07:07:57.1976527Z 00:01.3 Non-VGA unclassified device: Intel Corporation 82371AB/EB/MB PIIX4 ACPI (rev 08) 2024-06-26T07:07:57.1977315Z 00:03.0 VGA compatible controller: Amazon.com, Inc. Device 1111 2024-06-26T07:07:57.1978065Z 00:04.0 Non-Volatile memory controller: Amazon.com, Inc. Device 8061 2024-06-26T07:07:57.1978821Z 00:05.0 Ethernet controller: Amazon.com, Inc. Elastic Network Adapter (ENA) 2024-06-26T07:07:57.1979536Z 00:1e.0 3D controller: NVIDIA Corporation Device 2237 (rev a1) 2024-06-26T07:07:57.1980492Z 00:1f.0 Non-Volatile memory controller: Amazon.com, Inc. NVMe SSD Controller 2024-06-26T07:07:57.1981073Z + lsmod 2024-06-26T07:07:57.1988683Z Module Size Used by 2024-06-26T07:07:57.1989169Z xt_nat 16384 0 2024-06-26T07:07:57.1989646Z ib_core 266240 0 2024-06-26T07:07:57.1990128Z nvidia_modeset 1339392 0 2024-06-26T07:07:57.1990653Z veth 16384 0 2024-06-26T07:07:57.1991145Z nvidia_uvm 4599808 0 2024-06-26T07:07:57.1991667Z nvidia 53989376 2 nvidia_uvm,nvidia_modeset 2024-06-26T07:07:57.1992156Z drm 421888 1 nvidia 2024-06-26T07:07:57.1992588Z i2c_core 77824 2 nvidia,drm 2024-06-26T07:07:57.1993094Z backlight 16384 1 nvidia_modeset 2024-06-26T07:07:57.1993531Z xt_conntrack 16384 1 2024-06-26T07:07:57.1993912Z ipt_MASQUERADE 16384 1 2024-06-26T07:07:57.1994362Z nf_nat_masquerade_ipv4 16384 1 ipt_MASQUERADE 2024-06-26T07:07:57.1994832Z nf_conntrack_netlink 49152 0 2024-06-26T07:07:57.1995271Z nfnetlink 16384 2 nf_conntrack_netlink 2024-06-26T07:07:57.1995862Z xfrm_user 45056 1 2024-06-26T07:07:57.1996383Z xfrm_algo 16384 1 xfrm_user 2024-06-26T07:07:57.1996938Z iptable_nat 16384 1 2024-06-26T07:07:57.1997366Z nf_conntrack_ipv4 16384 3 2024-06-26T07:07:57.1997798Z nf_defrag_ipv4 16384 1 nf_conntrack_ipv4 2024-06-26T07:07:57.1998279Z nf_nat_ipv4 16384 1 iptable_nat 2024-06-26T07:07:57.1998826Z nf_nat 32768 3 nf_nat_masquerade_ipv4,nf_nat_ipv4,xt_nat 2024-06-26T07:07:57.1999811Z nf_conntrack 155648 8 xt_conntrack,nf_nat_masquerade_ipv4,nf_conntrack_ipv4,nf_nat,ipt_MASQUERADE,nf_nat_ipv4,xt_nat,nf_conntrack_netlink 2024-06-26T07:07:57.2000673Z xt_addrtype 16384 2 2024-06-26T07:07:57.2001056Z iptable_filter 16384 1 2024-06-26T07:07:57.2001441Z br_netfilter 24576 0 2024-06-26T07:07:57.2001856Z bridge 172032 1 br_netfilter 2024-06-26T07:07:57.2002305Z stp 16384 1 bridge 2024-06-26T07:07:57.2002730Z llc 16384 2 bridge,stp 2024-06-26T07:07:57.2003188Z overlay 86016 0 2024-06-26T07:07:57.2003567Z sunrpc 393216 1 2024-06-26T07:07:57.2004039Z dm_mirror 28672 0 2024-06-26T07:07:57.2004443Z dm_region_hash 20480 1 dm_mirror 2024-06-26T07:07:57.2005028Z dm_log 20480 2 dm_region_hash,dm_mirror 2024-06-26T07:07:57.2005686Z dm_mod 143360 2 dm_log,dm_mirror 2024-06-26T07:07:57.2006148Z dax 69632 1 dm_mod 2024-06-26T07:07:57.2006570Z crc32_pclmul 16384 0 2024-06-26T07:07:57.2006945Z ghash_clmulni_intel 16384 0 2024-06-26T07:07:57.2007325Z pcbc 16384 0 2024-06-26T07:07:57.2007694Z aesni_intel 188416 0 2024-06-26T07:07:57.2008081Z aes_x86_64 20480 1 aesni_intel 2024-06-26T07:07:57.2008546Z crypto_simd 16384 1 aesni_intel 2024-06-26T07:07:57.2008995Z glue_helper 16384 1 aesni_intel 2024-06-26T07:07:57.2009552Z cryptd 28672 3 crypto_simd,ghash_clmulni_intel,aesni_intel 2024-06-26T07:07:57.2010081Z mousedev 24576 0 2024-06-26T07:07:57.2010454Z evdev 20480 3 2024-06-26T07:07:57.2010852Z psmouse 32768 0 2024-06-26T07:07:57.2011221Z button 16384 0 2024-06-26T07:07:57.2011591Z ena 139264 0 2024-06-26T07:07:57.2011958Z ptp 20480 1 ena 2024-06-26T07:07:57.2012361Z pps_core 20480 1 ptp 2024-06-26T07:07:57.2012789Z crc32c_intel 24576 0 2024-06-26T07:07:57.2013173Z autofs4 49152 2 2024-06-26T07:07:57.2013526Z + modinfo nvidia 2024-06-26T07:07:57.2014219Z filename: /lib/modules/4.14.336-257.562.amzn2.x86_64/kernel/drivers/video/nvidia.ko 2024-06-26T07:07:57.2015057Z alias: char-major-195-* 2024-06-26T07:07:57.2015439Z version: 550.54.15 2024-06-26T07:07:57.2015777Z supported: external 2024-06-26T07:07:57.2016117Z license: NVIDIA 2024-06-26T07:07:57.2016503Z firmware: nvidia/550.54.15/gsp_tu10x.bin 2024-06-26T07:07:57.2016979Z firmware: nvidia/550.54.15/gsp_ga10x.bin 2024-06-26T07:07:57.2017438Z srcversion: 833721318DA517F0C2FEC97 2024-06-26T07:07:57.2017903Z alias: pci:v000010DEd*sv*sd*bc06sc80i00* 2024-06-26T07:07:57.2018397Z alias: pci:v000010DEd*sv*sd*bc03sc02i00* 2024-06-26T07:07:57.2018883Z alias: pci:v000010DEd*sv*sd*bc03sc00i00* 2024-06-26T07:07:57.2019377Z depends: i2c-core,drm 2024-06-26T07:07:57.2019749Z retpoline: Y 2024-06-26T07:07:57.2020056Z name: nvidia 2024-06-26T07:07:57.2020598Z vermagic: 4.14.336-257.562.amzn2.x86_64 SMP mod_unload modversions 2024-06-26T07:07:57.2021254Z parm: NvSwitchRegDwords:NvSwitch regkey (charp) 2024-06-26T07:07:57.2021907Z parm: NvSwitchBlacklist:NvSwitchBlacklist=uuid[,uuid...] (charp) 2024-06-26T07:07:57.2022499Z parm: NVreg_ResmanDebugLevel:int 2024-06-26T07:07:57.2022933Z parm: NVreg_RmLogonRC:int 2024-06-26T07:07:57.2023369Z parm: NVreg_ModifyDeviceFiles:int 2024-06-26T07:07:57.2023827Z parm: NVreg_DeviceFileUID:int 2024-06-26T07:07:57.2024257Z parm: NVreg_DeviceFileGID:int 2024-06-26T07:07:57.2024696Z parm: NVreg_DeviceFileMode:int 2024-06-26T07:07:57.2025226Z parm: NVreg_InitializeSystemMemoryAllocations:int 2024-06-26T07:07:57.2025797Z parm: NVreg_UsePageAttributeTable:int 2024-06-26T07:07:57.2026271Z parm: NVreg_EnablePCIeGen3:int 2024-06-26T07:07:57.2026703Z parm: NVreg_EnableMSI:int 2024-06-26T07:07:57.2027123Z parm: NVreg_TCEBypassMode:int 2024-06-26T07:07:57.2027878Z parm: NVreg_EnableStreamMemOPs:int 2024-06-26T07:07:57.2028403Z parm: NVreg_RestrictProfilingToAdminUsers:int 2024-06-26T07:07:57.2028991Z parm: NVreg_PreserveVideoMemoryAllocations:int 2024-06-26T07:07:57.2029553Z parm: NVreg_EnableS0ixPowerManagement:int 2024-06-26T07:07:57.2030159Z parm: NVreg_S0ixPowerManagementVideoMemoryThreshold:int 2024-06-26T07:07:57.2030749Z parm: NVreg_DynamicPowerManagement:int 2024-06-26T07:07:57.2031355Z parm: NVreg_DynamicPowerManagementVideoMemoryThreshold:int 2024-06-26T07:07:57.2031949Z parm: NVreg_EnableGpuFirmware:int 2024-06-26T07:07:57.2032441Z parm: NVreg_EnableGpuFirmwareLogs:int 2024-06-26T07:07:57.2033121Z parm: NVreg_OpenRmEnableUnsupportedGpus:int 2024-06-26T07:07:57.2033682Z parm: NVreg_EnableUserNUMAManagement:int 2024-06-26T07:07:57.2034177Z parm: NVreg_MemoryPoolSize:int 2024-06-26T07:07:57.2034644Z parm: NVreg_KMallocHeapMaxSize:int 2024-06-26T07:07:57.2035125Z parm: NVreg_VMallocHeapMaxSize:int 2024-06-26T07:07:57.2035597Z parm: NVreg_IgnoreMMIOCheck:int 2024-06-26T07:07:57.2036050Z parm: NVreg_NvLinkDisable:int 2024-06-26T07:07:57.2036552Z parm: NVreg_EnablePCIERelaxedOrderingMode:int 2024-06-26T07:07:57.2037068Z parm: NVreg_RegisterPCIDriver:int 2024-06-26T07:07:57.2037546Z parm: NVreg_EnableResizableBar:int 2024-06-26T07:07:57.2038034Z parm: NVreg_EnableDbgBreakpoint:int 2024-06-26T07:07:57.2038535Z parm: NVreg_EnableNonblockingOpen:int 2024-06-26T07:07:57.2039019Z parm: NVreg_RegistryDwords:charp 2024-06-26T07:07:57.2039525Z parm: NVreg_RegistryDwordsPerDevice:charp 2024-06-26T07:07:57.2040001Z parm: NVreg_RmMsg:charp 2024-06-26T07:07:57.2040407Z parm: NVreg_GpuBlacklist:charp 2024-06-26T07:07:57.2040873Z parm: NVreg_TemporaryFilePath:charp 2024-06-26T07:07:57.2041349Z parm: NVreg_ExcludedGpus:charp 2024-06-26T07:07:57.2041805Z parm: NVreg_DmaRemapPeerMmio:int 2024-06-26T07:07:57.2042278Z parm: NVreg_RmNvlinkBandwidth:charp 2024-06-26T07:07:57.2042840Z parm: NVreg_ImexChannelCount:int 2024-06-26T07:07:57.2043292Z parm: rm_firmware_active:charp 2024-06-26T07:07:57.2043690Z + set +e 2024-06-26T07:07:57.2043986Z + nvidia-smi 2024-06-26T07:07:58.7724440Z Wed Jun 26 07:07:58 2024 2024-06-26T07:07:58.7725497Z +-----------------------------------------------------------------------------------------+ 2024-06-26T07:07:58.7726559Z | NVIDIA-SMI 550.54.15 Driver Version: 550.54.15 CUDA Version: 12.4 | 2024-06-26T07:07:58.7743684Z |-----------------------------------------+------------------------+----------------------+ 2024-06-26T07:07:58.7744817Z | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | 2024-06-26T07:07:58.7745959Z | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | 2024-06-26T07:07:58.7746880Z | | | MIG M. | 2024-06-26T07:07:58.7747922Z |=========================================+========================+======================| 2024-06-26T07:07:58.7824341Z | 0 NVIDIA A10G Off | 00000000:00:1E.0 Off | 0 | 2024-06-26T07:07:58.7825332Z | 0% 33C P0 63W / 300W | 0MiB / 23028MiB | 0% Default | 2024-06-26T07:07:58.7826143Z | | | N/A | 2024-06-26T07:07:58.7827081Z +-----------------------------------------+------------------------+----------------------+ 2024-06-26T07:07:58.7828152Z 2024-06-26T07:07:58.7829038Z +-----------------------------------------------------------------------------------------+ 2024-06-26T07:07:58.7829841Z | Processes: | 2024-06-26T07:07:58.7830789Z | GPU GI CI PID Type Process name GPU Memory | 2024-06-26T07:07:58.7831692Z | ID ID Usage | 2024-06-26T07:07:58.7832415Z |=========================================================================================| 2024-06-26T07:07:58.7833242Z | No running processes found | 2024-06-26T07:07:58.7834225Z +-----------------------------------------------------------------------------------------+ 2024-06-26T07:07:59.4059912Z + nvidia-smi --query-gpu=gpu_name --format=csv,noheader --id=0 2024-06-26T07:08:00.9895294Z NVIDIA A10G 2024-06-26T07:08:01.4384104Z + NVIDIA_SMI_STATUS=0 2024-06-26T07:08:01.4384762Z + '[' 0 -eq 0 ']' 2024-06-26T07:08:01.4385176Z + echo 'INFO: Ignoring allowed status 0' 2024-06-26T07:08:01.4385610Z + set -e 2024-06-26T07:08:01.4385919Z INFO: Ignoring allowed status 0 2024-06-26T07:08:01.4390265Z == Installing nvidia container toolkit for amzn2 == 2024-06-26T07:08:01.4392207Z + sudo yum install -y yum-utils 2024-06-26T07:08:01.7398544Z Loaded plugins: extras_suggestions, langpacks, priorities, update-motd 2024-06-26T07:08:03.2243829Z Package yum-utils-1.1.31-46.amzn2.0.1.noarch already installed and latest version 2024-06-26T07:08:03.2244910Z Nothing to do 2024-06-26T07:08:03.3715918Z + [[ amzn2 == \a\m\z\n\2\0\2\3 ]] 2024-06-26T07:08:03.3716997Z + YUM_REPO_URL=https://nvidia.github.io/nvidia-docker/amzn2/nvidia-docker.repo 2024-06-26T07:08:03.3718193Z + sudo yum-config-manager --add-repo https://nvidia.github.io/nvidia-docker/amzn2/nvidia-docker.repo 2024-06-26T07:08:03.7026010Z Loaded plugins: extras_suggestions, langpacks, priorities, update-motd 2024-06-26T07:08:03.7290297Z adding repo from: https://nvidia.github.io/nvidia-docker/amzn2/nvidia-docker.repo 2024-06-26T07:08:03.7291612Z grabbing file https://nvidia.github.io/nvidia-docker/amzn2/nvidia-docker.repo to /etc/yum.repos.d/nvidia-docker.repo 2024-06-26T07:08:03.7292705Z repo saved to /etc/yum.repos.d/nvidia-docker.repo 2024-06-26T07:08:03.7408936Z + sudo yum install -y nvidia-docker2 2024-06-26T07:08:04.0486366Z Loaded plugins: extras_suggestions, langpacks, priorities, update-motd 2024-06-26T07:08:05.5302088Z Package nvidia-docker2-2.13.0-1.noarch already installed and latest version 2024-06-26T07:08:05.5302825Z Nothing to do 2024-06-26T07:08:05.6805211Z + sudo systemctl restart docker 2024-06-26T07:08:44.8381677Z Command completed after 1 attempt(s). 2024-06-26T07:08:44.8438911Z ##[group]Run python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84 2024-06-26T07:08:44.8439678Z python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84 2024-06-26T07:08:44.8440367Z python3 -m tools.stats.monitor > usage_log.txt 2>&1 & 2024-06-26T07:08:44.8441021Z echo "monitor-script-pid=${!}" >> "${GITHUB_OUTPUT}" 2024-06-26T07:08:44.8448839Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:08:44.8449360Z env: 2024-06-26T07:08:44.8449652Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:08:44.8450099Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:08:44.8450570Z ##[endgroup] 2024-06-26T07:08:45.0660282Z Defaulting to user installation because normal site-packages is not writeable 2024-06-26T07:08:45.0818228Z Requirement already satisfied: psutil==5.9.1 in /home/ec2-user/.local/lib/python3.7/site-packages (5.9.1) 2024-06-26T07:08:45.0917204Z Requirement already satisfied: nvidia-ml-py==11.525.84 in /home/ec2-user/.local/lib/python3.7/site-packages (11.525.84) 2024-06-26T07:08:45.2001813Z Prepare all required actions 2024-06-26T07:08:45.2002314Z Getting action download info 2024-06-26T07:08:45.3198871Z Download action repository 'seemethere/download-artifact-s3@v4' (SHA:1da556a7aa0a088e3153970611f6c432d58e80e6) 2024-06-26T07:08:45.6067056Z Download action repository 'actions/download-artifact@v3' (SHA:9bc31d5ccc31df68ecc42ccf4149144866c47d8a) 2024-06-26T07:08:45.7970202Z ##[group]Run ./.github/actions/download-build-artifacts 2024-06-26T07:08:45.7970695Z with: 2024-06-26T07:08:45.7971039Z name: linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-06-26T07:08:45.7971506Z s3-bucket: gha-artifacts 2024-06-26T07:08:45.7971846Z env: 2024-06-26T07:08:45.7972116Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:08:45.7972567Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:08:45.7973050Z ##[endgroup] 2024-06-26T07:08:45.8004560Z ##[group]Run seemethere/download-artifact-s3@v4 2024-06-26T07:08:45.8005082Z with: 2024-06-26T07:08:45.8005459Z name: linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-06-26T07:08:45.8005927Z s3-bucket: gha-artifacts 2024-06-26T07:08:45.8006272Z region: us-east-1 2024-06-26T07:08:45.8006574Z env: 2024-06-26T07:08:45.8006857Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:08:45.8007304Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:08:45.8007787Z ##[endgroup] 2024-06-26T07:08:46.2167631Z (node:11354) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2024-06-26T07:08:46.2168347Z 2024-06-26T07:08:46.2168606Z Please migrate your code to use AWS SDK for JavaScript (v3). 2024-06-26T07:08:46.2169325Z For more information, check the migration guide at https://a.co/7PzMCcy 2024-06-26T07:08:46.2170298Z (Use `node --trace-warnings ...` to show where the warning was created) 2024-06-26T07:08:46.2860371Z Found 1 objects with prefix pytorch/pytorch/9673646808/linux-focal-cuda12.1-py3.10-gcc9-sm86/ 2024-06-26T07:08:46.2861459Z Starting download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2024-06-26T07:08:53.7735971Z Finished download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2024-06-26T07:08:53.7742126Z Artifact download has finished successfully 2024-06-26T07:08:53.7901948Z ##[group]Run unzip -o artifacts.zip 2024-06-26T07:08:53.7902392Z unzip -o artifacts.zip 2024-06-26T07:08:53.7910545Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:08:53.7911169Z env: 2024-06-26T07:08:53.7911459Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:08:53.7911949Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:08:53.7912428Z ##[endgroup] 2024-06-26T07:08:53.7938660Z Archive: artifacts.zip 2024-06-26T07:08:53.7940395Z creating: dist/ 2024-06-26T07:08:55.7685484Z inflating: dist/torch-2.5.0a0+gitb8c4c54-cp310-cp310-linux_x86_64.whl 2024-06-26T07:08:55.7686263Z creating: build/custom_test_artifacts/ 2024-06-26T07:08:55.7686858Z creating: build/custom_test_artifacts/custom-op-build/ 2024-06-26T07:08:55.7687580Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/ 2024-06-26T07:08:55.7688408Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/pkgRedirects/ 2024-06-26T07:08:55.7692532Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeConfigureLog.yaml 2024-06-26T07:08:55.7693463Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/ 2024-06-26T07:08:55.7694415Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-06-26T07:08:55.7695387Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-06-26T07:08:55.7696345Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-06-26T07:08:55.7697432Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-06-26T07:08:55.7698717Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-06-26T07:08:55.7699701Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-06-26T07:08:55.7700878Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-06-26T07:08:55.7702018Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-06-26T07:08:55.7703156Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-06-26T07:08:55.7704288Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-06-26T07:08:55.7705397Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-06-26T07:08:55.7706543Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-06-26T07:08:55.7707943Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-06-26T07:08:55.7708966Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/ 2024-06-26T07:08:55.7709957Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/ 2024-06-26T07:08:55.7745841Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2024-06-26T07:08:55.7784585Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2024-06-26T07:08:55.7791297Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2024-06-26T07:08:55.7828764Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2024-06-26T07:08:55.7830155Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2024-06-26T07:08:55.7831577Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2024-06-26T07:08:55.7833083Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2024-06-26T07:08:55.7834499Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2024-06-26T07:08:55.7836040Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2024-06-26T07:08:55.7837411Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2024-06-26T07:08:55.7838775Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2024-06-26T07:08:55.7840109Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2024-06-26T07:08:55.7841381Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2024-06-26T07:08:55.7842604Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c 2024-06-26T07:08:55.7843805Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin 2024-06-26T07:08:55.7845026Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2024-06-26T07:08:55.7846279Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o 2024-06-26T07:08:55.7847474Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu 2024-06-26T07:08:55.7897121Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out 2024-06-26T07:08:55.7954543Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin 2024-06-26T07:08:55.7955714Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake 2024-06-26T07:08:55.7956687Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeScratch/ 2024-06-26T07:08:55.7957545Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeTmp/ 2024-06-26T07:08:55.7958444Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/cmake.check_cache 2024-06-26T07:08:55.7959359Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/ 2024-06-26T07:08:55.7960361Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.ts 2024-06-26T07:08:55.7961494Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.make 2024-06-26T07:08:55.7962763Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/depend.make 2024-06-26T07:08:55.7963791Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/link.txt 2024-06-26T07:08:55.7964851Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/cmake_clean.cmake 2024-06-26T07:08:55.7965981Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/build.make 2024-06-26T07:08:55.7967052Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/DependInfo.cmake 2024-06-26T07:08:55.7968108Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/flags.make 2024-06-26T07:08:55.7969147Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/progress.make 2024-06-26T07:08:55.7981314Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o.d 2024-06-26T07:08:55.8108834Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o 2024-06-26T07:08:55.8109924Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/ 2024-06-26T07:08:55.8111005Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.ts 2024-06-26T07:08:55.8112291Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.make 2024-06-26T07:08:55.8113690Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/depend.make 2024-06-26T07:08:55.8114770Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/link.txt 2024-06-26T07:08:55.8115889Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/cmake_clean.cmake 2024-06-26T07:08:55.8117016Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/build.make 2024-06-26T07:08:55.8118144Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/DependInfo.cmake 2024-06-26T07:08:55.8119254Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/flags.make 2024-06-26T07:08:55.8120349Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/progress.make 2024-06-26T07:08:55.8133292Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o.d 2024-06-26T07:08:55.8212652Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o 2024-06-26T07:08:55.8214087Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-06-26T07:08:55.8215574Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/TargetDirectories.txt 2024-06-26T07:08:55.8216668Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/progress.marks 2024-06-26T07:08:55.8217616Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile2 2024-06-26T07:08:55.8218850Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile.cmake 2024-06-26T07:08:55.8219903Z inflating: build/custom_test_artifacts/custom-op-build/detect_cuda_version.cc 2024-06-26T07:08:55.8220738Z inflating: build/custom_test_artifacts/custom-op-build/CMakeCache.txt 2024-06-26T07:08:55.8221515Z inflating: build/custom_test_artifacts/custom-op-build/Makefile 2024-06-26T07:08:55.8222318Z inflating: build/custom_test_artifacts/custom-op-build/cmake_install.cmake 2024-06-26T07:08:55.8327180Z inflating: build/custom_test_artifacts/custom-op-build/libcustom_ops.so 2024-06-26T07:08:55.8387613Z inflating: build/custom_test_artifacts/custom-op-build/test_custom_ops 2024-06-26T07:08:55.8388466Z creating: build/custom_test_artifacts/jit-hook-build/ 2024-06-26T07:08:55.8389165Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/ 2024-06-26T07:08:55.8389970Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/pkgRedirects/ 2024-06-26T07:08:55.8394858Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeConfigureLog.yaml 2024-06-26T07:08:55.8395873Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/ 2024-06-26T07:08:55.8396794Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-06-26T07:08:55.8397765Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-06-26T07:08:55.8398707Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-06-26T07:08:55.8399784Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-06-26T07:08:55.8400860Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-06-26T07:08:55.8401848Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-06-26T07:08:55.8402878Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-06-26T07:08:55.8404008Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-06-26T07:08:55.8405222Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-06-26T07:08:55.8406463Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-06-26T07:08:55.8407573Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-06-26T07:08:55.8408702Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-06-26T07:08:55.8409840Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-06-26T07:08:55.8410844Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/ 2024-06-26T07:08:55.8411825Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/ 2024-06-26T07:08:55.8446269Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2024-06-26T07:08:55.8484665Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2024-06-26T07:08:55.8487594Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2024-06-26T07:08:55.8527885Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2024-06-26T07:08:55.8529258Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2024-06-26T07:08:55.8530765Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2024-06-26T07:08:55.8532264Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2024-06-26T07:08:55.8533674Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2024-06-26T07:08:55.8535050Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2024-06-26T07:08:55.8536415Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2024-06-26T07:08:55.8537775Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2024-06-26T07:08:55.8539109Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2024-06-26T07:08:55.8540380Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2024-06-26T07:08:55.8541602Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c 2024-06-26T07:08:55.8542841Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin 2024-06-26T07:08:55.8544049Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2024-06-26T07:08:55.8545219Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o 2024-06-26T07:08:55.8546406Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu 2024-06-26T07:08:55.8596502Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out 2024-06-26T07:08:55.8654282Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin 2024-06-26T07:08:55.8655440Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake 2024-06-26T07:08:55.8656409Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeScratch/ 2024-06-26T07:08:55.8675140Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeTmp/ 2024-06-26T07:08:55.8676197Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/cmake.check_cache 2024-06-26T07:08:55.8677137Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/ 2024-06-26T07:08:55.8678180Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.ts 2024-06-26T07:08:55.8679349Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.make 2024-06-26T07:08:55.8680473Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/depend.make 2024-06-26T07:08:55.8681532Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/link.txt 2024-06-26T07:08:55.8682621Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/cmake_clean.cmake 2024-06-26T07:08:55.8683705Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/build.make 2024-06-26T07:08:55.8684804Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/DependInfo.cmake 2024-06-26T07:08:55.8685971Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/flags.make 2024-06-26T07:08:55.8687052Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/progress.make 2024-06-26T07:08:55.8688210Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o.d 2024-06-26T07:08:55.8741972Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o 2024-06-26T07:08:55.8743234Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-06-26T07:08:55.8744291Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/TargetDirectories.txt 2024-06-26T07:08:55.8745242Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/progress.marks 2024-06-26T07:08:55.8746139Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile2 2024-06-26T07:08:55.8747005Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile.cmake 2024-06-26T07:08:55.8748053Z inflating: build/custom_test_artifacts/jit-hook-build/detect_cuda_version.cc 2024-06-26T07:08:55.8748880Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeCache.txt 2024-06-26T07:08:55.8749641Z inflating: build/custom_test_artifacts/jit-hook-build/Makefile 2024-06-26T07:08:55.8750424Z inflating: build/custom_test_artifacts/jit-hook-build/cmake_install.cmake 2024-06-26T07:08:55.8795967Z inflating: build/custom_test_artifacts/jit-hook-build/test_jit_hooks 2024-06-26T07:08:55.8796707Z creating: build/custom_test_artifacts/custom-backend-build/ 2024-06-26T07:08:55.8797454Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/ 2024-06-26T07:08:55.8798309Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/pkgRedirects/ 2024-06-26T07:08:55.8803606Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeConfigureLog.yaml 2024-06-26T07:08:55.8804649Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/ 2024-06-26T07:08:55.8805689Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-06-26T07:08:55.8806721Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-06-26T07:08:55.8807727Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-06-26T07:08:55.8808943Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-06-26T07:08:55.8810084Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-06-26T07:08:55.8811121Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-06-26T07:08:55.8812268Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-06-26T07:08:55.8813452Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-06-26T07:08:55.8814646Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-06-26T07:08:55.8815828Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-06-26T07:08:55.8817082Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-06-26T07:08:55.8818282Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-06-26T07:08:55.8819472Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-06-26T07:08:55.8820546Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/ 2024-06-26T07:08:55.8821597Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/ 2024-06-26T07:08:55.8855007Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2024-06-26T07:08:55.8892880Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2024-06-26T07:08:55.8894510Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2024-06-26T07:08:55.8937403Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2024-06-26T07:08:55.8939047Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2024-06-26T07:08:55.8940956Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2024-06-26T07:08:55.8942995Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2024-06-26T07:08:55.8944728Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2024-06-26T07:08:55.8946340Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2024-06-26T07:08:55.8947996Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2024-06-26T07:08:55.8949415Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2024-06-26T07:08:55.8950811Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2024-06-26T07:08:55.8952135Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2024-06-26T07:08:55.8953403Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c 2024-06-26T07:08:55.8954650Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin 2024-06-26T07:08:55.8955905Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2024-06-26T07:08:55.8957125Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o 2024-06-26T07:08:55.8958367Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu 2024-06-26T07:08:55.9003343Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out 2024-06-26T07:08:55.9061075Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin 2024-06-26T07:08:55.9062736Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake 2024-06-26T07:08:55.9064057Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeScratch/ 2024-06-26T07:08:55.9065296Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeTmp/ 2024-06-26T07:08:55.9066401Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/cmake.check_cache 2024-06-26T07:08:55.9067688Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/ 2024-06-26T07:08:55.9068809Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.ts 2024-06-26T07:08:55.9070197Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.make 2024-06-26T07:08:55.9071482Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/depend.make 2024-06-26T07:08:55.9072608Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/link.txt 2024-06-26T07:08:55.9073761Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/cmake_clean.cmake 2024-06-26T07:08:55.9075046Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/build.make 2024-06-26T07:08:55.9076218Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/DependInfo.cmake 2024-06-26T07:08:55.9077370Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/flags.make 2024-06-26T07:08:55.9078523Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/progress.make 2024-06-26T07:08:55.9079747Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o.d 2024-06-26T07:08:55.9191253Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o 2024-06-26T07:08:55.9192852Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/ 2024-06-26T07:08:55.9194384Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.ts 2024-06-26T07:08:55.9195716Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.make 2024-06-26T07:08:55.9196960Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/depend.make 2024-06-26T07:08:55.9198140Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/link.txt 2024-06-26T07:08:55.9199357Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/cmake_clean.cmake 2024-06-26T07:08:55.9200589Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/build.make 2024-06-26T07:08:55.9201821Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/DependInfo.cmake 2024-06-26T07:08:55.9203044Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/flags.make 2024-06-26T07:08:55.9204263Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/progress.make 2024-06-26T07:08:55.9214918Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o.d 2024-06-26T07:08:55.9269289Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o 2024-06-26T07:08:55.9271834Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-06-26T07:08:55.9273141Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/TargetDirectories.txt 2024-06-26T07:08:55.9274161Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/progress.marks 2024-06-26T07:08:55.9275108Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile2 2024-06-26T07:08:55.9276047Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile.cmake 2024-06-26T07:08:55.9276992Z inflating: build/custom_test_artifacts/custom-backend-build/detect_cuda_version.cc 2024-06-26T07:08:55.9277884Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeCache.txt 2024-06-26T07:08:55.9278704Z inflating: build/custom_test_artifacts/custom-backend-build/Makefile 2024-06-26T07:08:55.9279544Z inflating: build/custom_test_artifacts/custom-backend-build/cmake_install.cmake 2024-06-26T07:08:55.9373546Z inflating: build/custom_test_artifacts/custom-backend-build/libcustom_backend.so 2024-06-26T07:08:55.9414390Z inflating: build/custom_test_artifacts/custom-backend-build/test_custom_backend 2024-06-26T07:08:55.9415019Z creating: build/lib/ 2024-06-26T07:08:55.9499731Z inflating: build/lib/libprotobuf-lite.a 2024-06-26T07:08:55.9938329Z inflating: build/lib/libprotobuf.a 2024-06-26T07:08:55.9947703Z inflating: build/lib/libpthreadpool.a 2024-06-26T07:08:55.9955543Z inflating: build/lib/libcpuinfo.a 2024-06-26T07:08:55.9963165Z inflating: build/lib/libcpuinfo_internals.a 2024-06-26T07:08:55.9963766Z inflating: build/lib/libclog.a 2024-06-26T07:08:55.9981185Z inflating: build/lib/libnnpack.a 2024-06-26T07:08:55.9983279Z inflating: build/lib/libnnpack_reference_layers.a 2024-06-26T07:08:56.0045570Z inflating: build/lib/libgtest.a 2024-06-26T07:08:56.0117219Z inflating: build/lib/libbenchmark.a 2024-06-26T07:08:56.0178609Z inflating: build/lib/libasmjit.a 2024-06-26T07:08:56.0185686Z inflating: build/lib/libittnotify.a 2024-06-26T07:08:56.0212502Z inflating: build/lib/libtensorpipe_uv.a 2024-06-26T07:08:56.0335291Z inflating: build/lib/libgloo.a 2024-06-26T07:08:56.0355977Z inflating: build/lib/libfmt.a 2024-06-26T07:08:56.0444805Z inflating: build/lib/libc10.so 2024-06-26T07:08:56.0446026Z inflating: build/lib/libcaffe2_nvrtc.so 2024-06-26T07:08:56.0446743Z inflating: build/lib/libfoxi_loader.a 2024-06-26T07:08:56.0448140Z inflating: build/lib/libtorch_global_deps.so 2024-06-26T07:08:56.0466645Z inflating: build/lib/libpytorch_qnnpack.a 2024-06-26T07:08:56.0484075Z inflating: build/lib/libgmock.a 2024-06-26T07:08:56.0484571Z inflating: build/lib/libgtest_main.a 2024-06-26T07:08:56.0485114Z inflating: build/lib/libbenchmark_main.a 2024-06-26T07:08:56.0970673Z inflating: build/lib/libprotoc.a 2024-06-26T07:08:56.1340576Z inflating: build/lib/libgloo_cuda.a 2024-06-26T07:08:57.1069455Z inflating: build/lib/libdnnl.a 2024-06-26T07:08:57.1618185Z inflating: build/lib/libtensorpipe.a 2024-06-26T07:08:57.1671867Z inflating: build/lib/libc10_cuda.so 2024-06-26T07:08:57.1672571Z inflating: build/lib/libgmock_main.a 2024-06-26T07:08:57.2872189Z inflating: build/lib/libfbgemm.a 2024-06-26T07:08:57.3117378Z inflating: build/lib/libtensorpipe_cuda.a 2024-06-26T07:08:57.3613725Z inflating: build/lib/libkineto.a 2024-06-26T07:08:57.3792250Z inflating: build/lib/libXNNPACK.a 2024-06-26T07:08:57.3833986Z inflating: build/lib/libonnx_proto.a 2024-06-26T07:08:57.4497783Z inflating: build/lib/libonnx.a 2024-06-26T07:08:59.7763152Z inflating: build/lib/libtorch_cpu.so 2024-06-26T07:08:59.7767575Z inflating: build/lib/libunbox_lib.a 2024-06-26T07:08:59.7771583Z inflating: build/lib/libshm.so 2024-06-26T07:09:01.7636327Z inflating: build/lib/libtorch_cuda.so 2024-06-26T07:09:01.7636844Z inflating: build/lib/libtorch.so 2024-06-26T07:09:01.7639081Z inflating: build/lib/libc10d_cuda_test.so 2024-06-26T07:09:02.5580793Z inflating: build/lib/libtorch_cuda_linalg.so 2024-06-26T07:09:02.7472068Z inflating: build/lib/libtorch_python.so 2024-06-26T07:09:02.7538799Z inflating: build/lib/libtorchbind_test.so 2024-06-26T07:09:02.7558855Z inflating: build/lib/libjitbackend_test.so 2024-06-26T07:09:02.7583467Z inflating: build/lib/libbackend_with_compiler.so 2024-06-26T07:09:02.7617053Z inflating: build/lib/libnnapi_backend.so 2024-06-26T07:09:02.7617536Z creating: build/bin/ 2024-06-26T07:09:02.7666168Z inflating: build/bin/c10_CompileTimeFunctionPointer_test 2024-06-26T07:09:02.7716256Z inflating: build/bin/c10_DeviceGuard_test 2024-06-26T07:09:02.7765085Z inflating: build/bin/c10_Device_test 2024-06-26T07:09:02.7822760Z inflating: build/bin/c10_DispatchKeySet_test 2024-06-26T07:09:02.7874851Z inflating: build/bin/c10_Scalar_test 2024-06-26T07:09:02.7922563Z inflating: build/bin/c10_StreamGuard_test 2024-06-26T07:09:02.7972320Z inflating: build/bin/c10_SymInt_test 2024-06-26T07:09:02.8025665Z inflating: build/bin/c10_InlineDeviceGuard_test 2024-06-26T07:09:02.8079359Z inflating: build/bin/c10_InlineStreamGuard_test 2024-06-26T07:09:02.8134278Z inflating: build/bin/c10_SizesAndStrides_test 2024-06-26T07:09:02.8202624Z inflating: build/bin/c10_cow_test 2024-06-26T07:09:02.8254438Z inflating: build/bin/c10_Bitset_test 2024-06-26T07:09:02.8302258Z inflating: build/bin/c10_ConstexprCrc_test 2024-06-26T07:09:02.8351752Z inflating: build/bin/c10_DeadlockDetection_test 2024-06-26T07:09:02.8400264Z inflating: build/bin/c10_Half_test 2024-06-26T07:09:02.8454759Z inflating: build/bin/c10_LeftRight_test 2024-06-26T07:09:02.8507996Z inflating: build/bin/c10_Metaprogramming_test 2024-06-26T07:09:02.8556449Z inflating: build/bin/c10_Synchronized_test 2024-06-26T07:09:02.8610375Z inflating: build/bin/c10_ThreadLocal_test 2024-06-26T07:09:02.8660113Z inflating: build/bin/c10_TypeIndex_test 2024-06-26T07:09:02.8709753Z inflating: build/bin/c10_TypeList_test 2024-06-26T07:09:02.8757009Z inflating: build/bin/c10_TypeTraits_test 2024-06-26T07:09:02.8807299Z inflating: build/bin/c10_accumulate_test 2024-06-26T07:09:02.8860979Z inflating: build/bin/c10_bfloat16_test 2024-06-26T07:09:02.8909751Z inflating: build/bin/c10_bit_cast_test 2024-06-26T07:09:02.8964941Z inflating: build/bin/c10_complex_math_test 2024-06-26T07:09:02.9018747Z inflating: build/bin/c10_complex_test 2024-06-26T07:09:02.9070055Z inflating: build/bin/c10_exception_test 2024-06-26T07:09:02.9118270Z inflating: build/bin/c10_flags_test 2024-06-26T07:09:02.9166621Z inflating: build/bin/c10_generic_math_test 2024-06-26T07:09:02.9326691Z inflating: build/bin/c10_intrusive_ptr_test 2024-06-26T07:09:02.9375804Z inflating: build/bin/c10_irange_test 2024-06-26T07:09:02.9427686Z inflating: build/bin/c10_lazy_test 2024-06-26T07:09:02.9482604Z inflating: build/bin/c10_logging_test 2024-06-26T07:09:02.9554973Z inflating: build/bin/c10_optional_test 2024-06-26T07:09:02.9615307Z inflating: build/bin/c10_ordered_preserving_dict_test 2024-06-26T07:09:02.9668273Z inflating: build/bin/c10_registry_test 2024-06-26T07:09:02.9813652Z inflating: build/bin/c10_small_vector_test 2024-06-26T07:09:02.9863456Z inflating: build/bin/c10_ssize_test 2024-06-26T07:09:02.9913819Z inflating: build/bin/c10_string_util_test 2024-06-26T07:09:02.9971596Z inflating: build/bin/c10_string_view_test 2024-06-26T07:09:03.0020020Z inflating: build/bin/c10_tempfile_test 2024-06-26T07:09:03.0067373Z inflating: build/bin/c10_intrusive_ptr_benchmark 2024-06-26T07:09:03.0121797Z inflating: build/bin/c10_typeid_test 2024-06-26T07:09:03.0555795Z inflating: build/bin/protoc-3.13.0.0 2024-06-26T07:09:03.0988753Z inflating: build/bin/protoc 2024-06-26T07:09:03.1039830Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_1_var_test 2024-06-26T07:09:03.1091832Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_catches_stream 2024-06-26T07:09:03.1143723Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_catches_thread_and_block_and_device 2024-06-26T07:09:03.1194772Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_from_2_processes 2024-06-26T07:09:03.1246548Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_blocks_and_threads 2024-06-26T07:09:03.1298723Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_multiple_blocks 2024-06-26T07:09:03.1346596Z inflating: build/bin/c10_cuda_CUDATest 2024-06-26T07:09:03.1398625Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_same_block 2024-06-26T07:09:03.1717630Z inflating: build/bin/vec_test_all_types_DEFAULT 2024-06-26T07:09:03.2050645Z inflating: build/bin/vec_test_all_types_AVX512 2024-06-26T07:09:03.2396742Z inflating: build/bin/vec_test_all_types_AVX2 2024-06-26T07:09:03.2448635Z inflating: build/bin/FileStoreTest 2024-06-26T07:09:03.2502896Z inflating: build/bin/TCPStoreTest 2024-06-26T07:09:03.2554984Z inflating: build/bin/HashStoreTest 2024-06-26T07:09:03.2568384Z inflating: build/bin/ProcessGroupMPITest 2024-06-26T07:09:03.2621059Z inflating: build/bin/test_edge_op_registration 2024-06-26T07:09:03.2625384Z inflating: build/bin/torch_shm_manager 2024-06-26T07:09:03.2628675Z inflating: build/bin/example_allreduce 2024-06-26T07:09:03.2682740Z inflating: build/bin/test_dist_autograd 2024-06-26T07:09:03.2750444Z inflating: build/bin/test_cpp_rpc 2024-06-26T07:09:03.2752969Z inflating: build/bin/parallel_benchmark 2024-06-26T07:09:03.2818202Z inflating: build/bin/test_mobile_nnc 2024-06-26T07:09:03.2827190Z inflating: build/bin/aot_model_compiler_test 2024-06-26T07:09:03.3164098Z inflating: build/bin/test_lazy 2024-06-26T07:09:03.4307766Z inflating: build/bin/test_api 2024-06-26T07:09:03.4379139Z inflating: build/bin/Dict_test 2024-06-26T07:09:03.4430202Z inflating: build/bin/Dimname_test 2024-06-26T07:09:03.4493050Z inflating: build/bin/MaybeOwned_test 2024-06-26T07:09:03.4549140Z inflating: build/bin/NamedTensor_test 2024-06-26T07:09:03.4607096Z inflating: build/bin/apply_utils_test 2024-06-26T07:09:03.4664733Z inflating: build/bin/atest 2024-06-26T07:09:03.4726935Z inflating: build/bin/basic 2024-06-26T07:09:03.4780680Z inflating: build/bin/broadcast_test 2024-06-26T07:09:03.4830330Z inflating: build/bin/cpu_allocator_test 2024-06-26T07:09:03.4887161Z inflating: build/bin/cpu_generator_test 2024-06-26T07:09:03.4939004Z inflating: build/bin/cpu_profiling_allocator_test 2024-06-26T07:09:03.5029987Z inflating: build/bin/cpu_rng_test 2024-06-26T07:09:03.5078849Z inflating: build/bin/dispatch_key_set_test 2024-06-26T07:09:03.5128180Z inflating: build/bin/dlconvertor_test 2024-06-26T07:09:03.5185671Z inflating: build/bin/extension_backend_test 2024-06-26T07:09:03.5239514Z inflating: build/bin/half_test 2024-06-26T07:09:03.5332645Z inflating: build/bin/ivalue_test 2024-06-26T07:09:03.5381039Z inflating: build/bin/lazy_tensor_test 2024-06-26T07:09:03.5434144Z inflating: build/bin/math_kernel_test 2024-06-26T07:09:03.5487302Z inflating: build/bin/memory_format_test 2024-06-26T07:09:03.5539002Z inflating: build/bin/memory_overlapping_test 2024-06-26T07:09:03.5590744Z inflating: build/bin/mobile_memory_cleanup 2024-06-26T07:09:03.5645442Z inflating: build/bin/native_test 2024-06-26T07:09:03.5694788Z inflating: build/bin/operator_name_test 2024-06-26T07:09:03.5744977Z inflating: build/bin/operators_test 2024-06-26T07:09:03.5795672Z inflating: build/bin/packedtensoraccessor_test 2024-06-26T07:09:03.5861218Z inflating: build/bin/pow_test 2024-06-26T07:09:03.5917186Z inflating: build/bin/quantized_test 2024-06-26T07:09:03.5966048Z inflating: build/bin/reduce_ops_test 2024-06-26T07:09:03.6016086Z inflating: build/bin/reportMemoryUsage_test 2024-06-26T07:09:03.6071687Z inflating: build/bin/scalar_tensor_test 2024-06-26T07:09:03.6128777Z inflating: build/bin/scalar_test 2024-06-26T07:09:03.6179281Z inflating: build/bin/StorageUtils_test 2024-06-26T07:09:03.6230633Z inflating: build/bin/stride_properties_test 2024-06-26T07:09:03.6307780Z inflating: build/bin/tensor_iterator_test 2024-06-26T07:09:03.6360248Z inflating: build/bin/test_parallel 2024-06-26T07:09:03.6363397Z inflating: build/bin/thread_init_test 2024-06-26T07:09:03.6418020Z inflating: build/bin/type_ptr_test 2024-06-26T07:09:03.6476557Z inflating: build/bin/type_test 2024-06-26T07:09:03.6527664Z inflating: build/bin/undefined_tensor_test 2024-06-26T07:09:03.6529069Z inflating: build/bin/verify_api_visibility 2024-06-26T07:09:03.6596971Z inflating: build/bin/legacy_vmap_test 2024-06-26T07:09:03.6647764Z inflating: build/bin/weakref_test 2024-06-26T07:09:03.6697964Z inflating: build/bin/wrapdim_test 2024-06-26T07:09:03.6748717Z inflating: build/bin/xla_tensor_test 2024-06-26T07:09:03.6808268Z inflating: build/bin/IListRef_test 2024-06-26T07:09:03.6912151Z inflating: build/bin/List_test 2024-06-26T07:09:03.6976663Z inflating: build/bin/KernelFunction_test 2024-06-26T07:09:03.7095009Z inflating: build/bin/kernel_function_legacy_test 2024-06-26T07:09:03.7188704Z inflating: build/bin/kernel_function_test 2024-06-26T07:09:03.7313168Z inflating: build/bin/kernel_lambda_legacy_test 2024-06-26T07:09:03.7413964Z inflating: build/bin/kernel_lambda_test 2024-06-26T07:09:03.7473380Z inflating: build/bin/kernel_stackbased_test 2024-06-26T07:09:03.7566910Z inflating: build/bin/make_boxed_from_unboxed_functor_test 2024-06-26T07:09:03.7616605Z inflating: build/bin/CppSignature_test 2024-06-26T07:09:03.7671264Z inflating: build/bin/backend_fallback_test 2024-06-26T07:09:03.7719080Z inflating: build/bin/op_allowlist_test 2024-06-26T07:09:03.7782430Z inflating: build/bin/inline_container_test 2024-06-26T07:09:03.8074445Z inflating: build/bin/op_registration_test 2024-06-26T07:09:03.8125961Z inflating: build/bin/cuda_apply_test 2024-06-26T07:09:03.8175626Z inflating: build/bin/cuda_allocator_test 2024-06-26T07:09:03.8233210Z inflating: build/bin/cuda_atomic_ops_test 2024-06-26T07:09:03.8286579Z inflating: build/bin/cuda_caching_host_allocator_test 2024-06-26T07:09:03.8354586Z inflating: build/bin/cuda_complex_math_test 2024-06-26T07:09:03.8412296Z inflating: build/bin/cuda_complex_test 2024-06-26T07:09:03.8461183Z inflating: build/bin/cuda_device_test 2024-06-26T07:09:03.8517265Z inflating: build/bin/cuda_cub_test 2024-06-26T07:09:03.8566862Z inflating: build/bin/cuda_dlconvertor_test 2024-06-26T07:09:03.8630305Z inflating: build/bin/cuda_distributions_test 2024-06-26T07:09:03.8685924Z inflating: build/bin/cuda_generator_test 2024-06-26T07:09:03.8734876Z inflating: build/bin/cuda_half_test 2024-06-26T07:09:03.8784752Z inflating: build/bin/cuda_integer_divider_test 2024-06-26T07:09:03.8833088Z inflating: build/bin/cuda_optional_test 2024-06-26T07:09:03.8883489Z inflating: build/bin/cuda_packedtensoraccessor_test 2024-06-26T07:09:03.8935174Z inflating: build/bin/cuda_reportMemoryUsage_test 2024-06-26T07:09:03.8984199Z inflating: build/bin/cuda_allocatorTraceTracker_test 2024-06-26T07:09:03.9043466Z inflating: build/bin/cuda_stream_test 2024-06-26T07:09:03.9091791Z inflating: build/bin/cuda_cudnn_test 2024-06-26T07:09:03.9142630Z inflating: build/bin/cuda_vectorized_test 2024-06-26T07:09:03.9157570Z inflating: build/bin/tutorial_tensorexpr 2024-06-26T07:09:03.9222434Z inflating: build/bin/ProcessGroupGlooTest 2024-06-26T07:09:03.9278655Z inflating: build/bin/ProcessGroupGlooAsyncTest 2024-06-26T07:09:03.9340292Z inflating: build/bin/ProcessGroupNCCLTest 2024-06-26T07:09:03.9400850Z inflating: build/bin/ProcessGroupNCCLErrorsTest 2024-06-26T07:09:04.0207542Z inflating: build/bin/test_tensorexpr 2024-06-26T07:09:04.0768607Z inflating: build/bin/test_jit 2024-06-26T07:09:04.0769236Z creating: .additional_ci_files/ 2024-06-26T07:09:04.0822488Z inflating: .additional_ci_files/test-times.json 2024-06-26T07:09:04.1034290Z inflating: .additional_ci_files/test-class-times.json 2024-06-26T07:09:04.1059300Z ##[group]Run rm artifacts.zip 2024-06-26T07:09:04.1059682Z rm artifacts.zip 2024-06-26T07:09:04.1069098Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:09:04.1069596Z env: 2024-06-26T07:09:04.1069889Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:09:04.1070332Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:09:04.1070812Z ##[endgroup] 2024-06-26T07:09:04.1766546Z ##[group]Run df -H 2024-06-26T07:09:04.1766881Z df -H 2024-06-26T07:09:04.1774513Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:09:04.1775049Z env: 2024-06-26T07:09:04.1775336Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:09:04.1775794Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:09:04.1776290Z ##[endgroup] 2024-06-26T07:09:04.1802104Z Filesystem Size Used Avail Use% Mounted on 2024-06-26T07:09:04.1802632Z devtmpfs 34G 0 34G 0% /dev 2024-06-26T07:09:04.1803116Z tmpfs 34G 0 34G 0% /dev/shm 2024-06-26T07:09:04.1803817Z tmpfs 34G 455k 34G 1% /run 2024-06-26T07:09:04.1804306Z tmpfs 34G 0 34G 0% /sys/fs/cgroup 2024-06-26T07:09:04.1804862Z /dev/nvme0n1p1 162G 67G 96G 41% / 2024-06-26T07:09:04.1841426Z Prepare all required actions 2024-06-26T07:09:04.1841863Z Getting action download info 2024-06-26T07:09:04.3155910Z ##[group]Run ./.github/actions/download-td-artifacts 2024-06-26T07:09:04.3156373Z with: 2024-06-26T07:09:04.3156634Z env: 2024-06-26T07:09:04.3156906Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:09:04.3157359Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:09:04.3157842Z ##[endgroup] 2024-06-26T07:09:04.3188957Z ##[group]Run seemethere/download-artifact-s3@v4 2024-06-26T07:09:04.3189400Z with: 2024-06-26T07:09:04.3189666Z name: td_results 2024-06-26T07:09:04.3189986Z s3-bucket: gha-artifacts 2024-06-26T07:09:04.3190338Z region: us-east-1 2024-06-26T07:09:04.3190641Z env: 2024-06-26T07:09:04.3190912Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:09:04.3191365Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:09:04.3191848Z ##[endgroup] 2024-06-26T07:09:04.7266434Z (node:11397) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2024-06-26T07:09:04.7267173Z 2024-06-26T07:09:04.7267767Z Please migrate your code to use AWS SDK for JavaScript (v3). 2024-06-26T07:09:04.7268502Z For more information, check the migration guide at https://a.co/7PzMCcy 2024-06-26T07:09:04.7269335Z (Use `node --trace-warnings ...` to show where the warning was created) 2024-06-26T07:09:04.7985781Z Found 0 objects with prefix pytorch/pytorch/9673646808/td_results/ 2024-06-26T07:09:04.7992677Z Artifact download has finished successfully 2024-06-26T07:09:04.8137664Z ##[group]Run mkdir -p .additional_ci_files 2024-06-26T07:09:04.8138154Z mkdir -p .additional_ci_files 2024-06-26T07:09:04.8138717Z mv td_results.json .additional_ci_files/td_results.json 2024-06-26T07:09:04.8146626Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:09:04.8147131Z env: 2024-06-26T07:09:04.8147663Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:09:04.8148133Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:09:04.8148614Z ##[endgroup] 2024-06-26T07:09:04.8182612Z mv: cannot stat 'td_results.json': No such file or directory 2024-06-26T07:09:04.8195514Z ##[error]Process completed with exit code 1. 2024-06-26T07:09:04.8225986Z ##[group]Run .github/scripts/parse_ref.py 2024-06-26T07:09:04.8226454Z .github/scripts/parse_ref.py 2024-06-26T07:09:04.8233418Z shell: /usr/bin/bash -e {0} 2024-06-26T07:09:04.8233760Z env: 2024-06-26T07:09:04.8234166Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:09:04.8234622Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:09:04.8235104Z ##[endgroup] 2024-06-26T07:09:04.8460820Z Prepare all required actions 2024-06-26T07:09:04.8497555Z ##[group]Run ./.github/actions/get-workflow-job-id 2024-06-26T07:09:04.8498016Z with: 2024-06-26T07:09:04.8498561Z github-token: *** 2024-06-26T07:09:04.8498866Z env: 2024-06-26T07:09:04.8499138Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:09:04.8499593Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:09:04.8500074Z ##[endgroup] 2024-06-26T07:09:04.8515258Z ##[group]Run set -eux 2024-06-26T07:09:04.8515613Z set -eux 2024-06-26T07:09:04.8516302Z python3 .github/scripts/get_workflow_job_id.py "${GITHUB_RUN_ID}" "${RUNNER_NAME}" 2024-06-26T07:09:04.8524129Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:09:04.8524723Z env: 2024-06-26T07:09:04.8525043Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:09:04.8525538Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:09:04.8526185Z GITHUB_TOKEN: *** 2024-06-26T07:09:04.8526496Z ##[endgroup] 2024-06-26T07:09:04.8545437Z + python3 .github/scripts/get_workflow_job_id.py 9673646808 i-0d0929ec639f8ba06 2024-06-26T07:09:06.1554902Z setting job-id=26688912508 2024-06-26T07:09:06.1555956Z setting job-name=cuda12.1-py3.10-gcc9-sm86 / test (aot_inductor_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-06-26T07:09:06.1749266Z Prepare all required actions 2024-06-26T07:09:06.1749711Z Getting action download info 2024-06-26T07:09:06.2743975Z ##[group]Run ./.github/actions/filter-test-configs 2024-06-26T07:09:06.2744433Z with: 2024-06-26T07:09:06.2744890Z github-token: *** 2024-06-26T07:09:06.2753611Z test-matrix: {"include": [{"config": "inductor", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_distributed", "shard": 1, "num_shards": 1, "runner": "linux.g5.12xlarge.nvidia.gpu"}, {"config": "inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_cpp_wrapper_abi_compatible", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}]} 2024-06-26T07:09:06.2762182Z job-name: cuda12.1-py3.10-gcc9-sm86 / test (aot_inductor_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-06-26T07:09:06.2762883Z env: 2024-06-26T07:09:06.2763165Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:09:06.2763617Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:09:06.2764234Z ##[endgroup] 2024-06-26T07:09:06.2804075Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2024-06-26T07:09:06.2804696Z with: 2024-06-26T07:09:06.2804966Z shell: bash 2024-06-26T07:09:06.2805269Z timeout_minutes: 10 2024-06-26T07:09:06.2805597Z max_attempts: 5 2024-06-26T07:09:06.2805907Z retry_wait_seconds: 30 2024-06-26T07:09:06.2807029Z command: set -eux # PyYAML 6.0 doesn't work with MacOS x86 anymore # This must run on Python-3.7 (AmazonLinux2) so can't use request=3.32.2 python3 -m pip install requests==2.27.1 pyyaml==6.0.1 2024-06-26T07:09:06.2808183Z polling_interval_seconds: 1 2024-06-26T07:09:06.2808558Z warning_on_retry: true 2024-06-26T07:09:06.2808903Z continue_on_error: false 2024-06-26T07:09:06.2809243Z env: 2024-06-26T07:09:06.2809520Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:09:06.2809969Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:09:06.2810611Z GITHUB_TOKEN: *** 2024-06-26T07:09:06.2810941Z ##[endgroup] 2024-06-26T07:09:06.3301729Z + python3 -m pip install requests==2.27.1 pyyaml==6.0.1 2024-06-26T07:09:06.5476663Z Defaulting to user installation because normal site-packages is not writeable 2024-06-26T07:09:06.5631262Z Requirement already satisfied: requests==2.27.1 in /home/ec2-user/.local/lib/python3.7/site-packages (2.27.1) 2024-06-26T07:09:06.5773909Z Requirement already satisfied: pyyaml==6.0.1 in /home/ec2-user/.local/lib/python3.7/site-packages (6.0.1) 2024-06-26T07:09:06.5782466Z Requirement already satisfied: certifi>=2017.4.17 in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.27.1) (2024.6.2) 2024-06-26T07:09:06.5791914Z Requirement already satisfied: charset-normalizer~=2.0.0; python_version >= "3" in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.27.1) (2.0.12) 2024-06-26T07:09:06.5813401Z Requirement already satisfied: urllib3<1.27,>=1.21.1 in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.27.1) (1.26.19) 2024-06-26T07:09:06.6012997Z Requirement already satisfied: idna<4,>=2.5; python_version >= "3" in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.27.1) (3.7) 2024-06-26T07:09:07.3301033Z Command completed after 1 attempt(s). 2024-06-26T07:09:07.3344076Z ##[group]Run set -x 2024-06-26T07:09:07.3344427Z set -x 2024-06-26T07:09:07.3344727Z  2024-06-26T07:09:07.3345285Z # Use relative path here as this could be checked out anywhere, not necessarily 2024-06-26T07:09:07.3345993Z # in runner workspace 2024-06-26T07:09:07.3346543Z python3 "${GITHUB_ACTION_PATH}/../../scripts/parse_ref.py" 2024-06-26T07:09:07.3354775Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:09:07.3355275Z env: 2024-06-26T07:09:07.3355558Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:09:07.3356010Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:09:07.3356488Z ##[endgroup] 2024-06-26T07:09:07.3379662Z + python3 /home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/filter-test-configs/../../scripts/parse_ref.py 2024-06-26T07:09:07.3599143Z ##[group]Run echo "Workflow: ${GITHUB_WORKFLOW}" 2024-06-26T07:09:07.3599693Z echo "Workflow: ${GITHUB_WORKFLOW}" 2024-06-26T07:09:07.3600166Z echo "Job name: ${JOB_NAME}" 2024-06-26T07:09:07.3600569Z  2024-06-26T07:09:07.3601115Z # Use relative path here as this could be checked out anywhere, not necessarily 2024-06-26T07:09:07.3601789Z # in runner workspace 2024-06-26T07:09:07.3602367Z python3 "${GITHUB_ACTION_PATH}/../../scripts/filter_test_configs.py" \ 2024-06-26T07:09:07.3603008Z  --workflow "${GITHUB_WORKFLOW}" \ 2024-06-26T07:09:07.3603461Z  --job-name "${JOB_NAME}" \ 2024-06-26T07:09:07.3611734Z  --test-matrix "{"include": [{"config": "inductor", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_distributed", "shard": 1, "num_shards": 1, "runner": "linux.g5.12xlarge.nvidia.gpu"}, {"config": "inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_cpp_wrapper_abi_compatible", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}]}" \ 2024-06-26T07:09:07.3620183Z  --selected-test-configs "" \ 2024-06-26T07:09:07.3620641Z  --pr-number "${PR_NUMBER}" \ 2024-06-26T07:09:07.3621072Z  --tag "${TAG}" \ 2024-06-26T07:09:07.3621466Z  --event-name "${EVENT_NAME}" \ 2024-06-26T07:09:07.3621909Z  --schedule "${SCHEDULE}" \ 2024-06-26T07:09:07.3622337Z  --branch "${HEAD_BRANCH}" 2024-06-26T07:09:07.3630079Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:09:07.3630576Z env: 2024-06-26T07:09:07.3630862Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:09:07.3631318Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:09:07.3631995Z GITHUB_TOKEN: *** 2024-06-26T07:09:07.3632632Z JOB_NAME: cuda12.1-py3.10-gcc9-sm86 / test (aot_inductor_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-06-26T07:09:07.3633336Z PR_NUMBER: 2024-06-26T07:09:07.3633647Z TAG: ciflow/inductor/129470 2024-06-26T07:09:07.3634006Z EVENT_NAME: push 2024-06-26T07:09:07.3634318Z SCHEDULE: 2024-06-26T07:09:07.3634604Z HEAD_BRANCH: 2024-06-26T07:09:07.3634894Z ##[endgroup] 2024-06-26T07:09:07.3654773Z Workflow: inductor 2024-06-26T07:09:07.3656156Z Job name: cuda12.1-py3.10-gcc9-sm86 / test (aot_inductor_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-06-26T07:09:07.5951979Z INFO:root:Found no test-config label on the PR, so all test configs are included 2024-06-26T07:09:07.7738158Z ##[group]Run echo "Filtered matrix:" 2024-06-26T07:09:07.7738628Z echo "Filtered matrix:" 2024-06-26T07:09:07.7746700Z echo "{"include": [{"config": "inductor", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_distributed", "shard": 1, "num_shards": 1, "runner": "linux.g5.12xlarge.nvidia.gpu"}, {"config": "inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_cpp_wrapper_abi_compatible", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}]}" 2024-06-26T07:09:07.7755549Z  2024-06-26T07:09:07.7755938Z echo 2024-06-26T07:09:07.7756317Z echo "Is the current job unstable? False" 2024-06-26T07:09:07.7756789Z  2024-06-26T07:09:07.7757074Z echo 2024-06-26T07:09:07.7757447Z echo "Is keep-going label set? False" 2024-06-26T07:09:07.7757886Z  2024-06-26T07:09:07.7758166Z echo 2024-06-26T07:09:07.7758493Z echo "Renabled issues? " 2024-06-26T07:09:07.7766256Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:09:07.7766758Z env: 2024-06-26T07:09:07.7767054Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:09:07.7767517Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:09:07.7767996Z ##[endgroup] 2024-06-26T07:09:07.7787379Z Filtered matrix: 2024-06-26T07:09:07.7797591Z {include: [{config: inductor, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: inductor, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: inductor_distributed, shard: 1, num_shards: 1, runner: linux.g5.12xlarge.nvidia.gpu}, {config: inductor_huggingface, shard: 1, num_shards: 1, runner: linux.g5.4xlarge.nvidia.gpu}, {config: inductor_timm, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: inductor_timm, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: inductor_torchbench, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: inductor_torchbench, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_inductor_huggingface, shard: 1, num_shards: 1, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_inductor_timm, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_inductor_timm, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_inductor_torchbench, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_inductor_torchbench, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: aot_inductor_huggingface, shard: 1, num_shards: 1, runner: linux.g5.4xlarge.nvidia.gpu}, {config: aot_inductor_timm, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: aot_inductor_timm, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: aot_inductor_torchbench, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: aot_inductor_torchbench, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: inductor_cpp_wrapper_abi_compatible, shard: 1, num_shards: 1, runner: linux.g5.4xlarge.nvidia.gpu}]} 2024-06-26T07:09:07.7805860Z 2024-06-26T07:09:07.7806011Z Is the current job unstable? False 2024-06-26T07:09:07.7806295Z 2024-06-26T07:09:07.7806567Z Is keep-going label set? False 2024-06-26T07:09:07.7806828Z 2024-06-26T07:09:07.7806954Z Renabled issues? 2024-06-26T07:09:07.7846512Z ##[group]Run echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2024-06-26T07:09:07.7847212Z echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2024-06-26T07:09:07.7854667Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:09:07.7855161Z env: 2024-06-26T07:09:07.7855444Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:09:07.7855905Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:09:07.7856443Z JOB_TIMEOUT: 240 2024-06-26T07:09:07.7856750Z ##[endgroup] 2024-06-26T07:09:07.7926425Z ##[group]Run set -x 2024-06-26T07:09:07.7926825Z set -x 2024-06-26T07:09:07.7927129Z  2024-06-26T07:09:07.7927489Z if [[ $TEST_CONFIG == 'multigpu' ]]; then 2024-06-26T07:09:07.7928085Z  TEST_COMMAND=.ci/pytorch/multigpu-test.sh 2024-06-26T07:09:07.7928692Z elif [[ $BUILD_ENVIRONMENT == *onnx* ]]; then 2024-06-26T07:09:07.7929251Z  TEST_COMMAND=.ci/onnx/test.sh 2024-06-26T07:09:07.7929693Z else 2024-06-26T07:09:07.7930050Z  TEST_COMMAND=.ci/pytorch/test.sh 2024-06-26T07:09:07.7930503Z fi 2024-06-26T07:09:07.7930793Z  2024-06-26T07:09:07.7931273Z # detached container should get cleaned up by teardown_ec2_linux 2024-06-26T07:09:07.7932023Z # TODO: Stop building test binaries as part of the build phase 2024-06-26T07:09:07.7932698Z # Used for GPU_FLAG since that doesn't play nice 2024-06-26T07:09:07.7933290Z # shellcheck disable=SC2086,SC2090 2024-06-26T07:09:07.7933750Z container_name=$(docker run \ 2024-06-26T07:09:07.7934172Z  ${GPU_FLAG:-} \ 2024-06-26T07:09:07.7934550Z  -e BUILD_ENVIRONMENT \ 2024-06-26T07:09:07.7934961Z  -e PR_NUMBER \ 2024-06-26T07:09:07.7935323Z  -e GITHUB_ACTIONS \ 2024-06-26T07:09:07.7935719Z  -e GITHUB_REPOSITORY \ 2024-06-26T07:09:07.7936132Z  -e GITHUB_WORKFLOW \ 2024-06-26T07:09:07.7936520Z  -e GITHUB_JOB \ 2024-06-26T07:09:07.7936880Z  -e GITHUB_RUN_ID \ 2024-06-26T07:09:07.7937268Z  -e GITHUB_RUN_NUMBER \ 2024-06-26T07:09:07.7937680Z  -e GITHUB_RUN_ATTEMPT \ 2024-06-26T07:09:07.7938075Z  -e JOB_ID \ 2024-06-26T07:09:07.7938419Z  -e JOB_NAME \ 2024-06-26T07:09:07.7938773Z  -e BASE_SHA \ 2024-06-26T07:09:07.7939121Z  -e BRANCH \ 2024-06-26T07:09:07.7939452Z  -e SHA1 \ 2024-06-26T07:09:07.7939804Z  -e AWS_DEFAULT_REGION \ 2024-06-26T07:09:07.7940211Z  -e IN_WHEEL_TEST \ 2024-06-26T07:09:07.7940595Z  -e SHARD_NUMBER \ 2024-06-26T07:09:07.7940962Z  -e TEST_CONFIG \ 2024-06-26T07:09:07.7941341Z  -e NUM_TEST_SHARDS \ 2024-06-26T07:09:07.7941738Z  -e REENABLED_ISSUES \ 2024-06-26T07:09:07.7942157Z  -e CONTINUE_THROUGH_ERROR \ 2024-06-26T07:09:07.7942582Z  -e VERBOSE_TEST_LOGS \ 2024-06-26T07:09:07.7942989Z  -e NO_TEST_TIMEOUT \ 2024-06-26T07:09:07.7943373Z  -e NO_TD \ 2024-06-26T07:09:07.7943713Z  -e TD_DISTRIBUTED \ 2024-06-26T07:09:07.7944096Z  -e PR_LABELS \ 2024-06-26T07:09:07.7944508Z  -e MAX_JOBS="$(nproc --ignore=2)" \ 2024-06-26T07:09:07.7944970Z  -e SCCACHE_BUCKET \ 2024-06-26T07:09:07.7945361Z  -e SCCACHE_S3_KEY_PREFIX \ 2024-06-26T07:09:07.7945773Z  -e XLA_CUDA \ 2024-06-26T07:09:07.7946209Z  -e XLA_CLANG_CACHE_S3_BUCKET_NAME \ 2024-06-26T07:09:07.7946748Z  -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK \ 2024-06-26T07:09:07.7947397Z  -e PYTORCH_TEST_RERUN_DISABLED_TESTS \ 2024-06-26T07:09:07.7947922Z  -e SKIP_SCCACHE_INITIALIZATION=1 \ 2024-06-26T07:09:07.7948511Z  -e HUGGING_FACE_HUB_TOKEN \ 2024-06-26T07:09:07.7948937Z  -e DASHBOARD_TAG \ 2024-06-26T07:09:07.7949411Z  --env-file="/tmp/github_env_${GITHUB_RUN_ID}" \ 2024-06-26T07:09:07.7949973Z  --security-opt seccomp=unconfined \ 2024-06-26T07:09:07.7950439Z  --cap-add=SYS_PTRACE \ 2024-06-26T07:09:07.7950834Z  --ipc=host \ 2024-06-26T07:09:07.7951190Z  --shm-size="${SHM_SIZE}" \ 2024-06-26T07:09:07.7951593Z  --tty \ 2024-06-26T07:09:07.7951912Z  --detach \ 2024-06-26T07:09:07.7952276Z  --name="${container_name}" \ 2024-06-26T07:09:07.7952695Z  --user jenkins \ 2024-06-26T07:09:07.7953265Z  -v "${GITHUB_WORKSPACE}:/var/lib/jenkins/workspace" \ 2024-06-26T07:09:07.7953837Z  -w /var/lib/jenkins/workspace \ 2024-06-26T07:09:07.7954276Z  "${DOCKER_IMAGE}" 2024-06-26T07:09:07.7954623Z ) 2024-06-26T07:09:07.7955042Z # Propagate download.pytorch.org IP to container 2024-06-26T07:09:07.7955954Z grep download.pytorch.org /etc/hosts | docker exec -i "${container_name}" sudo bash -c "/bin/cat >> /etc/hosts" 2024-06-26T07:09:07.7956961Z echo "DOCKER_CONTAINER_ID=${container_name}" >> "${GITHUB_ENV}" 2024-06-26T07:09:07.7957854Z docker exec -t "${container_name}" sh -c "pip install $(echo dist/*.whl)[opt-einsum] && ${TEST_COMMAND}" 2024-06-26T07:09:07.7965229Z shell: /usr/bin/bash -e {0} 2024-06-26T07:09:07.7965584Z env: 2024-06-26T07:09:07.7965872Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:09:07.7966370Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:09:07.7966984Z BUILD_ENVIRONMENT: linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-06-26T07:09:07.7967491Z PR_NUMBER: 2024-06-26T07:09:07.7967818Z GITHUB_REPOSITORY: pytorch/pytorch 2024-06-26T07:09:07.7968226Z GITHUB_WORKFLOW: inductor 2024-06-26T07:09:07.7968584Z GITHUB_JOB: test 2024-06-26T07:09:07.7968912Z GITHUB_RUN_ID: 9673646808 2024-06-26T07:09:07.7969274Z GITHUB_RUN_NUMBER: 76977 2024-06-26T07:09:07.7969625Z GITHUB_RUN_ATTEMPT: 1 2024-06-26T07:09:07.7969964Z JOB_ID: 26688912508 2024-06-26T07:09:07.7970601Z JOB_NAME: cuda12.1-py3.10-gcc9-sm86 / test (aot_inductor_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-06-26T07:09:07.7971290Z BRANCH: 2024-06-26T07:09:07.7971622Z SHA1: b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:09:07.7972129Z BASE_SHA: b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:09:07.7972608Z TEST_CONFIG: aot_inductor_timm 2024-06-26T07:09:07.7972988Z SHARD_NUMBER: 2 2024-06-26T07:09:07.7973293Z NUM_TEST_SHARDS: 2 2024-06-26T07:09:07.7973618Z REENABLED_ISSUES: 2024-06-26T07:09:07.7973962Z CONTINUE_THROUGH_ERROR: False 2024-06-26T07:09:07.7974343Z VERBOSE_TEST_LOGS: False 2024-06-26T07:09:07.7974699Z NO_TEST_TIMEOUT: False 2024-06-26T07:09:07.7975038Z NO_TD: False 2024-06-26T07:09:07.7975342Z TD_DISTRIBUTED: False 2024-06-26T07:09:07.7975760Z SCCACHE_BUCKET: ossci-compiler-cache-circleci-v2 2024-06-26T07:09:07.7976251Z SCCACHE_S3_KEY_PREFIX: inductor 2024-06-26T07:09:07.7976637Z SHM_SIZE: 2g 2024-06-26T07:09:07.7977706Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:09:07.7978846Z XLA_CUDA: 2024-06-26T07:09:07.7979333Z XLA_CLANG_CACHE_S3_BUCKET_NAME: ossci-compiler-clang-cache-circleci-xla 2024-06-26T07:09:07.7979937Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK: 0 2024-06-26T07:09:07.7980374Z PYTORCH_TEST_RERUN_DISABLED_TESTS: 0 2024-06-26T07:09:07.7980778Z DASHBOARD_TAG: 2024-06-26T07:09:07.7981291Z HUGGING_FACE_HUB_TOKEN: *** 2024-06-26T07:09:07.7981660Z ##[endgroup] 2024-06-26T07:09:07.8002032Z + [[ aot_inductor_timm == \m\u\l\t\i\g\p\u ]] 2024-06-26T07:09:07.8002855Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *onnx* ]] 2024-06-26T07:09:07.8003487Z + TEST_COMMAND=.ci/pytorch/test.sh 2024-06-26T07:09:07.8009543Z +++ nproc --ignore=2 2024-06-26T07:09:07.8021532Z ++ docker run --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all -e BUILD_ENVIRONMENT -e PR_NUMBER -e GITHUB_ACTIONS -e GITHUB_REPOSITORY -e GITHUB_WORKFLOW -e GITHUB_JOB -e GITHUB_RUN_ID -e GITHUB_RUN_NUMBER -e GITHUB_RUN_ATTEMPT -e JOB_ID -e JOB_NAME -e BASE_SHA -e BRANCH -e SHA1 -e AWS_DEFAULT_REGION -e IN_WHEEL_TEST -e SHARD_NUMBER -e TEST_CONFIG -e NUM_TEST_SHARDS -e REENABLED_ISSUES -e CONTINUE_THROUGH_ERROR -e VERBOSE_TEST_LOGS -e NO_TEST_TIMEOUT -e NO_TD -e TD_DISTRIBUTED -e PR_LABELS -e MAX_JOBS=14 -e SCCACHE_BUCKET -e SCCACHE_S3_KEY_PREFIX -e XLA_CUDA -e XLA_CLANG_CACHE_S3_BUCKET_NAME -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK -e PYTORCH_TEST_RERUN_DISABLED_TESTS -e SKIP_SCCACHE_INITIALIZATION=1 -e HUGGING_FACE_HUB_TOKEN -e DASHBOARD_TAG --env-file=/tmp/github_env_9673646808 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --ipc=host --shm-size=2g --tty --detach --name= --user jenkins -v /home/ec2-user/actions-runner/_work/pytorch/pytorch:/var/lib/jenkins/workspace -w /var/lib/jenkins/workspace 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:09:19.0413601Z + container_name=9e7838844bf9b3c79df6186681211b7b1cbf1257424f1c3a3791890da01a84d4 2024-06-26T07:09:19.0414369Z + grep download.pytorch.org /etc/hosts 2024-06-26T07:09:19.0421386Z + docker exec -i 9e7838844bf9b3c79df6186681211b7b1cbf1257424f1c3a3791890da01a84d4 sudo bash -c '/bin/cat >> /etc/hosts' 2024-06-26T07:09:19.1028850Z + echo DOCKER_CONTAINER_ID=9e7838844bf9b3c79df6186681211b7b1cbf1257424f1c3a3791890da01a84d4 2024-06-26T07:09:19.1030829Z ++ echo dist/torch-2.5.0a0+gitb8c4c54-cp310-cp310-linux_x86_64.whl 2024-06-26T07:09:19.1032559Z + docker exec -t 9e7838844bf9b3c79df6186681211b7b1cbf1257424f1c3a3791890da01a84d4 sh -c 'pip install dist/torch-2.5.0a0+gitb8c4c54-cp310-cp310-linux_x86_64.whl[opt-einsum] && .ci/pytorch/test.sh' 2024-06-26T07:09:19.4890136Z Processing ./dist/torch-2.5.0a0+gitb8c4c54-cp310-cp310-linux_x86_64.whl (from torch==2.5.0a0+gitb8c4c54) 2024-06-26T07:09:19.8001973Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (3.13.1) 2024-06-26T07:09:19.8008100Z Requirement already satisfied: typing-extensions>=4.8.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (4.12.2) 2024-06-26T07:09:19.8010543Z Requirement already satisfied: sympy in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (1.12.1) 2024-06-26T07:09:19.8012746Z Requirement already satisfied: networkx in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (2.8.8) 2024-06-26T07:09:19.8014729Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (3.1.4) 2024-06-26T07:09:19.8017375Z Requirement already satisfied: fsspec in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (2024.2.0) 2024-06-26T07:09:19.8043533Z Requirement already satisfied: opt-einsum>=3.3 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (3.3.0) 2024-06-26T07:09:19.8101297Z Requirement already satisfied: numpy>=1.7 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from opt-einsum>=3.3->torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (1.21.2) 2024-06-26T07:09:19.8534866Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from jinja2->torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (2.1.5) 2024-06-26T07:09:19.8693824Z Requirement already satisfied: mpmath<1.4.0,>=1.1.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from sympy->torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (1.3.0) 2024-06-26T07:09:21.1775558Z Installing collected packages: torch 2024-06-26T07:09:29.8501227Z ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 2024-06-26T07:09:29.8502550Z timm 0.9.7 requires torchvision, which is not installed. 2024-06-26T07:09:29.8504785Z Successfully installed torch-2.5.0a0+gitb8c4c54 2024-06-26T07:09:29.9277122Z ++ dirname .ci/pytorch/test.sh 2024-06-26T07:09:29.9282283Z + source .ci/pytorch/common.sh 2024-06-26T07:09:29.9285131Z +++ dirname .ci/pytorch/common.sh 2024-06-26T07:09:29.9290881Z ++ source .ci/pytorch/common_utils.sh 2024-06-26T07:09:29.9292150Z +++ declare -f -t trap_add 2024-06-26T07:09:29.9299381Z ++ set -ex 2024-06-26T07:09:29.9300056Z ++ [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *rocm* ]] 2024-06-26T07:09:29.9300651Z ++ BUILD_TEST_LIBTORCH=0 2024-06-26T07:09:29.9301230Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *rocm* ]] 2024-06-26T07:09:29.9301818Z ++ stat -c %u /var/lib/jenkins/workspace 2024-06-26T07:09:29.9310510Z + WORKSPACE_ORIGINAL_OWNER_ID=1000 2024-06-26T07:09:29.9311102Z + trap_add cleanup_workspace EXIT 2024-06-26T07:09:29.9311526Z + trap_add_cmd=cleanup_workspace 2024-06-26T07:09:29.9311903Z + shift 2024-06-26T07:09:29.9312467Z + for trap_add_name in "$@" 2024-06-26T07:09:29.9316222Z +++ trap -p EXIT 2024-06-26T07:09:29.9317157Z ++ eval 'extract_trap_cmd ' 2024-06-26T07:09:29.9317691Z +++ extract_trap_cmd 2024-06-26T07:09:29.9318151Z +++ printf '%s\n' '' 2024-06-26T07:09:29.9318548Z ++ printf '%s\n' cleanup_workspace 2024-06-26T07:09:29.9319415Z + trap -- ' 2024-06-26T07:09:29.9319877Z cleanup_workspace' EXIT 2024-06-26T07:09:29.9320416Z + sudo chown -R jenkins /var/lib/jenkins/workspace 2024-06-26T07:09:30.4269071Z + git config --global --add safe.directory /var/lib/jenkins/workspace 2024-06-26T07:09:30.4283273Z + echo 'Environment variables:' 2024-06-26T07:09:30.4283862Z Environment variables: 2024-06-26T07:09:30.4284240Z + env 2024-06-26T07:09:30.4289583Z INSTALLED_DB=yes 2024-06-26T07:09:30.4290138Z NV_LIBCUBLAS_VERSION=12.1.3.1-1 2024-06-26T07:09:30.4290658Z NVIDIA_VISIBLE_DEVICES=all 2024-06-26T07:09:30.4291180Z NV_NVML_DEV_VERSION=12.1.105-1 2024-06-26T07:09:30.4291782Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-06-26T07:09:30.4292507Z CONTINUE_THROUGH_ERROR=False 2024-06-26T07:09:30.4293152Z NV_LIBNCCL_DEV_PACKAGE=libnccl-dev=2.17.1-1+cuda12.1 2024-06-26T07:09:30.4295190Z NV_LIBNCCL_DEV_PACKAGE_VERSION=2.17.1-1 2024-06-26T07:09:30.4295924Z BUILD_ENVIRONMENT=linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-06-26T07:09:30.4296431Z HOSTNAME=9e7838844bf9 2024-06-26T07:09:30.4297273Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_f388aebd-0de1-41e7-875f-eca2474afb0b 2024-06-26T07:09:30.4298267Z GITHUB_ACTION=__self 2024-06-26T07:09:30.4298764Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2024-06-26T07:09:30.4302565Z NVIDIA_REQUIRE_CUDA=cuda>=12.1 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 brand=tesla,driver>=525,driver<526 brand=unknown,driver>=525,driver<526 brand=nvidia,driver>=525,driver<526 brand=nvidiartx,driver>=525,driver<526 brand=geforce,driver>=525,driver<526 brand=geforcertx,driver>=525,driver<526 brand=quadro,driver>=525,driver<526 brand=quadrortx,driver>=525,driver<526 brand=titan,driver>=525,driver<526 brand=titanrtx,driver>=525,driver<526 2024-06-26T07:09:30.4306844Z NV_LIBCUBLAS_DEV_PACKAGE=libcublas-dev-12-1=12.1.3.1-1 2024-06-26T07:09:30.4307636Z NV_NVTX_VERSION=12.1.105-1 2024-06-26T07:09:30.4308085Z GITHUB_RUN_NUMBER=76977 2024-06-26T07:09:30.4308650Z TEST_CONFIG=aot_inductor_timm 2024-06-26T07:09:30.4309077Z GITHUB_REPOSITORY_OWNER_ID=21003710 2024-06-26T07:09:30.4309550Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2024-06-26T07:09:30.4310015Z NV_CUDA_CUDART_DEV_VERSION=12.1.105-1 2024-06-26T07:09:30.4310461Z NV_LIBCUSPARSE_VERSION=12.1.0.106-1 2024-06-26T07:09:30.4310874Z NV_LIBNPP_VERSION=12.1.0.40-1 2024-06-26T07:09:30.4311324Z GITHUB_TRIGGERING_ACTOR=pytorch-bot[bot] 2024-06-26T07:09:30.4311895Z CMAKE_CUDA_COMPILER_LAUNCHER=/opt/cache/bin/sccache 2024-06-26T07:09:30.4312355Z GITHUB_REF_TYPE=tag 2024-06-26T07:09:30.4312690Z TORCH_CUDA_ARCH_LIST=Maxwell 2024-06-26T07:09:30.4313073Z NCCL_VERSION=2.17.1-1 2024-06-26T07:09:30.4313467Z BASE_SHA=b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:09:30.4313899Z XLA_CUDA= 2024-06-26T07:09:30.4314517Z HUGGING_FACE_HUB_TOKEN=*** 2024-06-26T07:09:30.4317734Z *** 2024-06-26T07:09:30.4318031Z CARGO_NET_GIT_FETCH_WITH_CLI=true 2024-06-26T07:09:30.4318426Z GITHUB_REPOSITORY_ID=65600975 2024-06-26T07:09:30.4318800Z GITHUB_ACTIONS=true 2024-06-26T07:09:30.4319138Z NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:09:30.4319648Z NV_NVPROF_DEV_PACKAGE=cuda-nvprof-12-1=12.1.105-1 2024-06-26T07:09:30.4320171Z NV_LIBNPP_PACKAGE=libnpp-12-1=12.1.0.40-1 2024-06-26T07:09:30.4320645Z SHA1=b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:09:30.4321219Z NV_LIBNCCL_DEV_PACKAGE_NAME=libnccl-dev 2024-06-26T07:09:30.4321700Z GITHUB_SHA=b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:09:30.4322474Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/inductor.yml@refs/tags/ciflow/inductor/129470 2024-06-26T07:09:30.4323182Z UCC_HOME=/usr 2024-06-26T07:09:30.4323520Z NV_LIBCUBLAS_DEV_VERSION=12.1.3.1-1 2024-06-26T07:09:30.4323918Z VERBOSE_TEST_LOGS=False 2024-06-26T07:09:30.4324262Z NVIDIA_PRODUCT_NAME=CUDA 2024-06-26T07:09:30.4324827Z NV_LIBCUBLAS_DEV_PACKAGE_NAME=libcublas-dev-12-1 2024-06-26T07:09:30.4325326Z GITHUB_REF=refs/tags/ciflow/inductor/129470 2024-06-26T07:09:30.4325782Z NV_CUDA_CUDART_VERSION=12.1.105-1 2024-06-26T07:09:30.4326167Z SHARD_NUMBER=2 2024-06-26T07:09:30.4326485Z GITHUB_REF_PROTECTED=false 2024-06-26T07:09:30.4326836Z HOME=/var/lib/jenkins 2024-06-26T07:09:30.4327194Z GITHUB_API_URL=https://api.github.com 2024-06-26T07:09:30.4327634Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2024-06-26T07:09:30.4328229Z UCX_COMMIT=7bb2722ff2187a0cad557ae4a6afa090569f83fb 2024-06-26T07:09:30.4328891Z SCCACHE_S3_KEY_PREFIX=inductor 2024-06-26T07:09:30.4329386Z CUDA_VERSION=12.1.1 2024-06-26T07:09:30.4329955Z NV_LIBCUBLAS_PACKAGE=libcublas-12-1=12.1.3.1-1 2024-06-26T07:09:30.4330570Z NUM_TEST_SHARDS=2 2024-06-26T07:09:30.4330969Z UCX_HOME=/usr 2024-06-26T07:09:30.4331512Z NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE=cuda-nsight-compute-12-1=12.1.1-1 2024-06-26T07:09:30.4332577Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_f388aebd-0de1-41e7-875f-eca2474afb0b 2024-06-26T07:09:30.4333807Z JOB_NAME=cuda12.1-py3.10-gcc9-sm86 / test (aot_inductor_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-06-26T07:09:30.4334991Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_f388aebd-0de1-41e7-875f-eca2474afb0b 2024-06-26T07:09:30.4336082Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2024-06-26T07:09:30.4336733Z GITHUB_EVENT_NAME=push 2024-06-26T07:09:30.4337066Z DASHBOARD_TAG= 2024-06-26T07:09:30.4337370Z GITHUB_RUN_ID=9673646808 2024-06-26T07:09:30.4337812Z NV_LIBNPP_DEV_PACKAGE=libnpp-dev-12-1=12.1.0.40-1 2024-06-26T07:09:30.4338346Z NV_LIBCUBLAS_PACKAGE_NAME=libcublas-12-1 2024-06-26T07:09:30.4339387Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_f388aebd-0de1-41e7-875f-eca2474afb0b 2024-06-26T07:09:30.4340592Z GITHUB_ACTOR=pytorch-bot[bot] 2024-06-26T07:09:30.4341002Z NV_LIBNPP_DEV_VERSION=12.1.0.40-1 2024-06-26T07:09:30.4341436Z PR_NUMBER= 2024-06-26T07:09:30.4341828Z GITHUB_RUN_ATTEMPT=1 2024-06-26T07:09:30.4342162Z ANACONDA_PYTHON_VERSION=3.10 2024-06-26T07:09:30.4342717Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2024-06-26T07:09:30.4343239Z TERM=xterm 2024-06-26T07:09:30.4343706Z NV_LIBCUSPARSE_DEV_VERSION=12.1.0.106-1 2024-06-26T07:09:30.4344238Z INSTALLED_VISION=yes 2024-06-26T07:09:30.4344552Z BRANCH= 2024-06-26T07:09:30.4344893Z OPENSSL_ROOT_DIR=/opt/openssl 2024-06-26T07:09:30.4345403Z LIBRARY_PATH=/usr/local/cuda/lib64/stubs 2024-06-26T07:09:30.4345828Z CUDA_PATH=/usr/local/cuda 2024-06-26T07:09:30.4346848Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2024-06-26T07:09:30.4347913Z GITHUB_SERVER_URL=https://github.com 2024-06-26T07:09:30.4348432Z UCC_COMMIT=20eae37090a4ce1b32bcce6144ccad0b49943e0b 2024-06-26T07:09:30.4348934Z REENABLED_ISSUES= 2024-06-26T07:09:30.4349243Z SHLVL=1 2024-06-26T07:09:30.4349656Z MAX_JOBS=14 2024-06-26T07:09:30.4349979Z NV_CUDA_LIB_VERSION=12.1.1-1 2024-06-26T07:09:30.4350334Z NVARCH=x86_64 2024-06-26T07:09:30.4350632Z GITHUB_ACTOR_ID=54816060 2024-06-26T07:09:30.4351077Z GITHUB_WORKFLOW_SHA=b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:09:30.4351612Z GITHUB_REF_NAME=ciflow/inductor/129470 2024-06-26T07:09:30.4352091Z NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-1 2024-06-26T07:09:30.4352745Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2024-06-26T07:09:30.4353305Z GITHUB_JOB=test 2024-06-26T07:09:30.4353700Z NV_LIBNCCL_PACKAGE=libnccl2=2.17.1-1+cuda12.1 2024-06-26T07:09:30.4354248Z LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64 2024-06-26T07:09:30.4354761Z NO_TEST_TIMEOUT=False 2024-06-26T07:09:30.4355080Z TD_DISTRIBUTED=False 2024-06-26T07:09:30.4355450Z NV_CUDA_NSIGHT_COMPUTE_VERSION=12.1.1-1 2024-06-26T07:09:30.4355885Z GITHUB_REPOSITORY=pytorch/pytorch 2024-06-26T07:09:30.4356301Z NV_NVPROF_VERSION=12.1.105-1 2024-06-26T07:09:30.4356664Z GITHUB_RETENTION_DAYS=90 2024-06-26T07:09:30.4357011Z OPENSSL_DIR=/opt/openssl 2024-06-26T07:09:30.4357363Z GITHUB_ACTION_REPOSITORY= 2024-06-26T07:09:30.4358374Z PATH=/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-06-26T07:09:30.4359427Z GITHUB_BASE_REF= 2024-06-26T07:09:30.4359753Z NV_LIBNCCL_PACKAGE_NAME=libnccl2 2024-06-26T07:09:30.4360118Z CI=true 2024-06-26T07:09:30.4360423Z NV_LIBNCCL_PACKAGE_VERSION=2.17.1-1 2024-06-26T07:09:30.4360835Z GITHUB_REPOSITORY_OWNER=pytorch 2024-06-26T07:09:30.4361208Z JOB_ID=26688912508 2024-06-26T07:09:30.4361520Z INSTALLED_PROTOBUF=yes 2024-06-26T07:09:30.4361846Z GITHUB_HEAD_REF= 2024-06-26T07:09:30.4362151Z GITHUB_ACTION_REF= 2024-06-26T07:09:30.4362577Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2024-06-26T07:09:30.4363040Z GITHUB_WORKFLOW=inductor 2024-06-26T07:09:30.4363394Z DEBIAN_FRONTEND=noninteractive 2024-06-26T07:09:30.4364336Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_f388aebd-0de1-41e7-875f-eca2474afb0b 2024-06-26T07:09:30.4365223Z NO_TD=False 2024-06-26T07:09:30.4365521Z SKIP_SCCACHE_INITIALIZATION=1 2024-06-26T07:09:30.4365888Z _=/usr/bin/env 2024-06-26T07:09:30.4366359Z ++ python -c 'import site; print(site.getsitepackages()[0])' 2024-06-26T07:09:30.4434600Z + TORCH_INSTALL_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch 2024-06-26T07:09:30.4435797Z + TORCH_BIN_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/bin 2024-06-26T07:09:30.4437019Z + TORCH_LIB_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/lib 2024-06-26T07:09:30.4437984Z + TORCH_TEST_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/test 2024-06-26T07:09:30.4438588Z + BUILD_DIR=build 2024-06-26T07:09:30.4438916Z + BUILD_RENAMED_DIR=build_renamed 2024-06-26T07:09:30.4439295Z + BUILD_BIN_DIR=build/bin 2024-06-26T07:09:30.4439738Z + SHARD_NUMBER=2 2024-06-26T07:09:30.4440170Z + NUM_TEST_SHARDS=2 2024-06-26T07:09:30.4440533Z + export VALGRIND=ON 2024-06-26T07:09:30.4440853Z + VALGRIND=ON 2024-06-26T07:09:30.4441321Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *clang9* ]] 2024-06-26T07:09:30.4441959Z + [[ 0 == \1 ]] 2024-06-26T07:09:30.4442252Z + [[ False == \1 ]] 2024-06-26T07:09:30.4442723Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *bazel* ]] 2024-06-26T07:09:30.4443246Z ++ realpath build/custom_test_artifacts 2024-06-26T07:09:30.4446813Z + CUSTOM_TEST_ARTIFACT_BUILD_DIR=/var/lib/jenkins/workspace/build/custom_test_artifacts 2024-06-26T07:09:30.4447672Z + [[ -n '' ]] 2024-06-26T07:09:30.4448027Z + echo 'Environment variables' 2024-06-26T07:09:30.4448405Z Environment variables 2024-06-26T07:09:30.4448722Z + env 2024-06-26T07:09:30.4452042Z INSTALLED_DB=yes 2024-06-26T07:09:30.4452541Z NV_LIBCUBLAS_VERSION=12.1.3.1-1 2024-06-26T07:09:30.4453078Z NVIDIA_VISIBLE_DEVICES=all 2024-06-26T07:09:30.4453623Z NV_NVML_DEV_VERSION=12.1.105-1 2024-06-26T07:09:30.4454544Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-06-26T07:09:30.4455295Z CONTINUE_THROUGH_ERROR=False 2024-06-26T07:09:30.4455902Z NV_LIBNCCL_DEV_PACKAGE=libnccl-dev=2.17.1-1+cuda12.1 2024-06-26T07:09:30.4456505Z NV_LIBNCCL_DEV_PACKAGE_VERSION=2.17.1-1 2024-06-26T07:09:30.4457196Z BUILD_ENVIRONMENT=linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-06-26T07:09:30.4457732Z HOSTNAME=9e7838844bf9 2024-06-26T07:09:30.4458710Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_f388aebd-0de1-41e7-875f-eca2474afb0b 2024-06-26T07:09:30.4459563Z GITHUB_ACTION=__self 2024-06-26T07:09:30.4459949Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2024-06-26T07:09:30.4463690Z NVIDIA_REQUIRE_CUDA=cuda>=12.1 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 brand=tesla,driver>=525,driver<526 brand=unknown,driver>=525,driver<526 brand=nvidia,driver>=525,driver<526 brand=nvidiartx,driver>=525,driver<526 brand=geforce,driver>=525,driver<526 brand=geforcertx,driver>=525,driver<526 brand=quadro,driver>=525,driver<526 brand=quadrortx,driver>=525,driver<526 brand=titan,driver>=525,driver<526 brand=titanrtx,driver>=525,driver<526 2024-06-26T07:09:30.4467773Z NV_LIBCUBLAS_DEV_PACKAGE=libcublas-dev-12-1=12.1.3.1-1 2024-06-26T07:09:30.4468273Z NV_NVTX_VERSION=12.1.105-1 2024-06-26T07:09:30.4468624Z GITHUB_RUN_NUMBER=76977 2024-06-26T07:09:30.4468975Z TEST_CONFIG=aot_inductor_timm 2024-06-26T07:09:30.4469354Z GITHUB_REPOSITORY_OWNER_ID=21003710 2024-06-26T07:09:30.4469817Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2024-06-26T07:09:30.4470275Z NV_CUDA_CUDART_DEV_VERSION=12.1.105-1 2024-06-26T07:09:30.4470711Z NV_LIBCUSPARSE_VERSION=12.1.0.106-1 2024-06-26T07:09:30.4471129Z NV_LIBNPP_VERSION=12.1.0.40-1 2024-06-26T07:09:30.4471567Z GITHUB_TRIGGERING_ACTOR=pytorch-bot[bot] 2024-06-26T07:09:30.4472061Z CMAKE_CUDA_COMPILER_LAUNCHER=/opt/cache/bin/sccache 2024-06-26T07:09:30.4472531Z GITHUB_REF_TYPE=tag 2024-06-26T07:09:30.4472865Z TORCH_CUDA_ARCH_LIST=Maxwell 2024-06-26T07:09:30.4473241Z NCCL_VERSION=2.17.1-1 2024-06-26T07:09:30.4473632Z BASE_SHA=b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:09:30.4474065Z XLA_CUDA= 2024-06-26T07:09:30.4474521Z HUGGING_FACE_HUB_TOKEN=*** 2024-06-26T07:09:30.4474911Z *** 2024-06-26T07:09:30.4475198Z CARGO_NET_GIT_FETCH_WITH_CLI=true 2024-06-26T07:09:30.4475594Z GITHUB_REPOSITORY_ID=65600975 2024-06-26T07:09:30.4475954Z GITHUB_ACTIONS=true 2024-06-26T07:09:30.4476290Z NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:09:30.4476777Z NV_NVPROF_DEV_PACKAGE=cuda-nvprof-12-1=12.1.105-1 2024-06-26T07:09:30.4477306Z NV_LIBNPP_PACKAGE=libnpp-12-1=12.1.0.40-1 2024-06-26T07:09:30.4477767Z SHA1=b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:09:30.4478271Z NV_LIBNCCL_DEV_PACKAGE_NAME=libnccl-dev 2024-06-26T07:09:30.4478750Z GITHUB_SHA=b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:09:30.4479523Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/inductor.yml@refs/tags/ciflow/inductor/129470 2024-06-26T07:09:30.4480358Z UCC_HOME=/usr 2024-06-26T07:09:30.4480703Z NV_LIBCUBLAS_DEV_VERSION=12.1.3.1-1 2024-06-26T07:09:30.4494340Z VERBOSE_TEST_LOGS=False 2024-06-26T07:09:30.4494709Z NVIDIA_PRODUCT_NAME=CUDA 2024-06-26T07:09:30.4495175Z NV_LIBCUBLAS_DEV_PACKAGE_NAME=libcublas-dev-12-1 2024-06-26T07:09:30.4495666Z GITHUB_REF=refs/tags/ciflow/inductor/129470 2024-06-26T07:09:30.4496128Z NV_CUDA_CUDART_VERSION=12.1.105-1 2024-06-26T07:09:30.4496501Z SHARD_NUMBER=2 2024-06-26T07:09:30.4496798Z GITHUB_REF_PROTECTED=false 2024-06-26T07:09:30.4497146Z HOME=/var/lib/jenkins 2024-06-26T07:09:30.4497511Z GITHUB_API_URL=https://api.github.com 2024-06-26T07:09:30.4497943Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2024-06-26T07:09:30.4498416Z UCX_COMMIT=7bb2722ff2187a0cad557ae4a6afa090569f83fb 2024-06-26T07:09:30.4499027Z SCCACHE_S3_KEY_PREFIX=inductor 2024-06-26T07:09:30.4499403Z CUDA_VERSION=12.1.1 2024-06-26T07:09:30.4499814Z NV_LIBCUBLAS_PACKAGE=libcublas-12-1=12.1.3.1-1 2024-06-26T07:09:30.4500266Z NUM_TEST_SHARDS=2 2024-06-26T07:09:30.4500567Z UCX_HOME=/usr 2024-06-26T07:09:30.4501071Z NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE=cuda-nsight-compute-12-1=12.1.1-1 2024-06-26T07:09:30.4502124Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_f388aebd-0de1-41e7-875f-eca2474afb0b 2024-06-26T07:09:30.4503307Z JOB_NAME=cuda12.1-py3.10-gcc9-sm86 / test (aot_inductor_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-06-26T07:09:30.4504477Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_f388aebd-0de1-41e7-875f-eca2474afb0b 2024-06-26T07:09:30.4505566Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2024-06-26T07:09:30.4506203Z GITHUB_EVENT_NAME=push 2024-06-26T07:09:30.4506531Z DASHBOARD_TAG= 2024-06-26T07:09:30.4506842Z GITHUB_RUN_ID=9673646808 2024-06-26T07:09:30.4507522Z NV_LIBNPP_DEV_PACKAGE=libnpp-dev-12-1=12.1.0.40-1 2024-06-26T07:09:30.4508073Z NV_LIBCUBLAS_PACKAGE_NAME=libcublas-12-1 2024-06-26T07:09:30.4509050Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_f388aebd-0de1-41e7-875f-eca2474afb0b 2024-06-26T07:09:30.4509937Z GITHUB_ACTOR=pytorch-bot[bot] 2024-06-26T07:09:30.4510340Z NV_LIBNPP_DEV_VERSION=12.1.0.40-1 2024-06-26T07:09:30.4510709Z PR_NUMBER= 2024-06-26T07:09:30.4510998Z GITHUB_RUN_ATTEMPT=1 2024-06-26T07:09:30.4511315Z VALGRIND=ON 2024-06-26T07:09:30.4511602Z ANACONDA_PYTHON_VERSION=3.10 2024-06-26T07:09:30.4512040Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2024-06-26T07:09:30.4512492Z TERM=xterm 2024-06-26T07:09:30.4512823Z NV_LIBCUSPARSE_DEV_VERSION=12.1.0.106-1 2024-06-26T07:09:30.4513227Z INSTALLED_VISION=yes 2024-06-26T07:09:30.4513535Z BRANCH= 2024-06-26T07:09:30.4513818Z OPENSSL_ROOT_DIR=/opt/openssl 2024-06-26T07:09:30.4514224Z LIBRARY_PATH=/usr/local/cuda/lib64/stubs 2024-06-26T07:09:30.4514634Z CUDA_PATH=/usr/local/cuda 2024-06-26T07:09:30.4515371Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2024-06-26T07:09:30.4516119Z GITHUB_SERVER_URL=https://github.com 2024-06-26T07:09:30.4516602Z UCC_COMMIT=20eae37090a4ce1b32bcce6144ccad0b49943e0b 2024-06-26T07:09:30.4517061Z REENABLED_ISSUES= 2024-06-26T07:09:30.4517362Z SHLVL=1 2024-06-26T07:09:30.4517620Z MAX_JOBS=14 2024-06-26T07:09:30.4517922Z NV_CUDA_LIB_VERSION=12.1.1-1 2024-06-26T07:09:30.4518275Z NVARCH=x86_64 2024-06-26T07:09:30.4518573Z GITHUB_ACTOR_ID=54816060 2024-06-26T07:09:30.4519025Z GITHUB_WORKFLOW_SHA=b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:09:30.4519543Z GITHUB_REF_NAME=ciflow/inductor/129470 2024-06-26T07:09:30.4520024Z NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-1 2024-06-26T07:09:30.4520673Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2024-06-26T07:09:30.4521240Z GITHUB_JOB=test 2024-06-26T07:09:30.4521627Z NV_LIBNCCL_PACKAGE=libnccl2=2.17.1-1+cuda12.1 2024-06-26T07:09:30.4522175Z LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64 2024-06-26T07:09:30.4522683Z NO_TEST_TIMEOUT=False 2024-06-26T07:09:30.4523121Z TD_DISTRIBUTED=False 2024-06-26T07:09:30.4523506Z NV_CUDA_NSIGHT_COMPUTE_VERSION=12.1.1-1 2024-06-26T07:09:30.4523951Z GITHUB_REPOSITORY=pytorch/pytorch 2024-06-26T07:09:30.4524405Z NV_NVPROF_VERSION=12.1.105-1 2024-06-26T07:09:30.4524839Z GITHUB_RETENTION_DAYS=90 2024-06-26T07:09:30.4525186Z OPENSSL_DIR=/opt/openssl 2024-06-26T07:09:30.4525535Z GITHUB_ACTION_REPOSITORY= 2024-06-26T07:09:30.4526558Z PATH=/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-06-26T07:09:30.4527597Z GITHUB_BASE_REF= 2024-06-26T07:09:30.4527917Z NV_LIBNCCL_PACKAGE_NAME=libnccl2 2024-06-26T07:09:30.4528281Z CI=true 2024-06-26T07:09:30.4528729Z NV_LIBNCCL_PACKAGE_VERSION=2.17.1-1 2024-06-26T07:09:30.4529141Z GITHUB_REPOSITORY_OWNER=pytorch 2024-06-26T07:09:30.4529518Z JOB_ID=26688912508 2024-06-26T07:09:30.4529831Z INSTALLED_PROTOBUF=yes 2024-06-26T07:09:30.4530154Z GITHUB_HEAD_REF= 2024-06-26T07:09:30.4530469Z GITHUB_ACTION_REF= 2024-06-26T07:09:30.4530899Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2024-06-26T07:09:30.4531364Z GITHUB_WORKFLOW=inductor 2024-06-26T07:09:30.4531714Z DEBIAN_FRONTEND=noninteractive 2024-06-26T07:09:30.4532607Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_f388aebd-0de1-41e7-875f-eca2474afb0b 2024-06-26T07:09:30.4533411Z NO_TD=False 2024-06-26T07:09:30.4533710Z SKIP_SCCACHE_INITIALIZATION=1 2024-06-26T07:09:30.4534065Z _=/usr/bin/env 2024-06-26T07:09:30.4534399Z + echo 'Testing pytorch' 2024-06-26T07:09:30.4534740Z Testing pytorch 2024-06-26T07:09:30.4535059Z + export LANG=C.UTF-8 2024-06-26T07:09:30.4535392Z + LANG=C.UTF-8 2024-06-26T07:09:30.4535686Z + PR_NUMBER= 2024-06-26T07:09:30.4536023Z + [[ aot_inductor_timm == \d\e\f\a\u\l\t ]] 2024-06-26T07:09:30.4536504Z + [[ aot_inductor_timm == \d\i\s\t\r\i\b\u\t\e\d ]] 2024-06-26T07:09:30.4536980Z + [[ aot_inductor_timm == \s\l\o\w ]] 2024-06-26T07:09:30.4537589Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *slow-gradcheck* ]] 2024-06-26T07:09:30.4538272Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *cuda* ]] 2024-06-26T07:09:30.4538808Z + export PYTORCH_TESTING_DEVICE_ONLY_FOR=cuda 2024-06-26T07:09:30.4539282Z + PYTORCH_TESTING_DEVICE_ONLY_FOR=cuda 2024-06-26T07:09:30.4539733Z + [[ aot_inductor_timm == *crossref* ]] 2024-06-26T07:09:30.4540288Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *rocm* ]] 2024-06-26T07:09:30.4540905Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *xpu* ]] 2024-06-26T07:09:30.4541545Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *-bazel-* ]] 2024-06-26T07:09:30.4542094Z + pip_install --user ninja==1.10.2 2024-06-26T07:09:30.4542614Z + pip install --progress-bar off --user ninja==1.10.2 2024-06-26T07:09:30.8049476Z Collecting ninja==1.10.2 2024-06-26T07:09:30.8212357Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl.metadata (5.0 kB) 2024-06-26T07:09:30.8351120Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl (108 kB) 2024-06-26T07:09:32.1446328Z Installing collected packages: ninja 2024-06-26T07:09:32.1514053Z  WARNING: The script ninja is installed in '/var/lib/jenkins/.local/bin' which is not on PATH. 2024-06-26T07:09:32.1515378Z Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. 2024-06-26T07:09:32.1558129Z Successfully installed ninja-1.10.2 2024-06-26T07:09:32.2426106Z + export PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-06-26T07:09:32.2430517Z + PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-06-26T07:09:32.2433279Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *aarch64* ]] 2024-06-26T07:09:32.2434551Z + install_tlparse 2024-06-26T07:09:32.2434989Z + pip_install --user tlparse==0.3.7 2024-06-26T07:09:32.2435529Z + pip install --progress-bar off --user tlparse==0.3.7 2024-06-26T07:09:32.5953006Z Collecting tlparse==0.3.7 2024-06-26T07:09:32.6133046Z Downloading tlparse-0.3.7-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (346 bytes) 2024-06-26T07:09:32.6261167Z Downloading tlparse-0.3.7-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.2 MB) 2024-06-26T07:09:33.9480484Z Installing collected packages: tlparse 2024-06-26T07:09:33.9842288Z Successfully installed tlparse-0.3.7 2024-06-26T07:09:34.0669426Z ++ python -m site --user-base 2024-06-26T07:09:34.0825712Z + PATH=/var/lib/jenkins/.local/bin:/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-06-26T07:09:34.0827877Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *asan* ]] 2024-06-26T07:09:34.0828554Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *-debug* ]] 2024-06-26T07:09:34.0829291Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *-bazel-* ]] 2024-06-26T07:09:34.0830295Z + echo 'We are not in debug mode: linux-focal-cuda12.1-py3.10-gcc9-sm86. Expect the assertion to pass' 2024-06-26T07:09:34.0831410Z We are not in debug mode: linux-focal-cuda12.1-py3.10-gcc9-sm86. Expect the assertion to pass 2024-06-26T07:09:34.0832098Z + cd test 2024-06-26T07:09:34.0832610Z + python -c 'import torch; torch._C._crash_if_debug_asserts_fail(424242)' 2024-06-26T07:09:35.5544367Z + [[ aot_inductor_timm == \n\o\g\p\u\_\N\O\_\A\V\X\2 ]] 2024-06-26T07:09:35.5544984Z + [[ aot_inductor_timm == \n\o\g\p\u\_\A\V\X\5\1\2 ]] 2024-06-26T07:09:35.5545779Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *-bazel-* ]] 2024-06-26T07:09:35.5546278Z + pushd test 2024-06-26T07:09:35.5546614Z ~/workspace/test ~/workspace 2024-06-26T07:09:35.5547144Z ++ python -c 'import torch; print(torch.version.cuda)' 2024-06-26T07:09:37.0296520Z + CUDA_VERSION=12.1 2024-06-26T07:09:37.0297197Z + '[' 12.1 == 12.4 ']' 2024-06-26T07:09:37.0297567Z + ISCUDA124= 2024-06-26T07:09:37.0297863Z + popd 2024-06-26T07:09:37.0298132Z ~/workspace 2024-06-26T07:09:37.0301422Z + DYNAMO_BENCHMARK_FLAGS=() 2024-06-26T07:09:37.0302047Z + [[ aot_inductor_timm == *dynamo_eager* ]] 2024-06-26T07:09:37.0302749Z + [[ aot_inductor_timm == *aot_eager* ]] 2024-06-26T07:09:37.0303437Z + [[ aot_inductor_timm == *aot_inductor* ]] 2024-06-26T07:09:37.0304289Z + DYNAMO_BENCHMARK_FLAGS+=(--export-aot-inductor) 2024-06-26T07:09:37.0305042Z + [[ aot_inductor_timm == *dynamic* ]] 2024-06-26T07:09:37.0305712Z + [[ aot_inductor_timm == *cpu_inductor* ]] 2024-06-26T07:09:37.0306477Z + DYNAMO_BENCHMARK_FLAGS+=(--device cuda) 2024-06-26T07:09:37.0332138Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *libtorch* ]] 2024-06-26T07:09:37.0332990Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *-bazel-* ]] 2024-06-26T07:09:37.0334991Z + cd test 2024-06-26T07:09:37.0335550Z + python -c 'import torch; print(torch.__config__.show())' 2024-06-26T07:09:38.3939820Z PyTorch built with: 2024-06-26T07:09:38.3940400Z - GCC 9.4 2024-06-26T07:09:38.3940799Z - C++ Version: 201703 2024-06-26T07:09:38.3941773Z - Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications 2024-06-26T07:09:38.3942915Z - Intel(R) MKL-DNN v3.4.2 (Git Hash 1137e04ec0b5251ca2b4400a4fd3c667ce843d67) 2024-06-26T07:09:38.3943641Z - OpenMP 201511 (a.k.a. OpenMP 4.5) 2024-06-26T07:09:38.3944184Z - LAPACK is enabled (usually provided by MKL) 2024-06-26T07:09:38.3944715Z - NNPACK is enabled 2024-06-26T07:09:38.3945170Z - CPU capability usage: AVX2 2024-06-26T07:09:38.3945583Z - CUDA Runtime 12.1 2024-06-26T07:09:38.3946208Z - NVCC architecture flags: -gencode;arch=compute_86,code=sm_86 2024-06-26T07:09:38.3946878Z - CuDNN 90.1 (built against CUDA 12.4) 2024-06-26T07:09:38.3947608Z - Magma 2.6.1 2024-06-26T07:09:38.3955328Z - Build settings: BLAS_INFO=mkl, BUILD_TYPE=Release, CUDA_VERSION=12.1, CUDNN_VERSION=9.1.0, CXX_COMPILER=/opt/cache/bin/c++, CXX_FLAGS= -D_GLIBCXX_USE_CXX11_ABI=1 -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOROCTRACER -DUSE_FBGEMM -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -O2 -fPIC -Wall -Wextra -Werror=return-type -Werror=non-virtual-dtor -Werror=bool-operation -Wnarrowing -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-unused-parameter -Wno-unused-function -Wno-unused-result -Wno-strict-overflow -Wno-strict-aliasing -Wno-stringop-overflow -Wsuggest-override -Wno-psabi -Wno-error=pedantic -Wno-error=old-style-cast -Wno-missing-braces -fdiagnostics-color=always -faligned-new -Werror -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Wno-stringop-overflow, FORCE_FALLBACK_CUDA_MPI=1, LAPACK_INFO=mkl, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, PERF_WITH_AVX512=1, TORCH_VERSION=2.5.0, USE_CUDA=ON, USE_CUDNN=ON, USE_CUSPARSELT=ON, USE_EXCEPTION_PTR=1, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_GLOO=ON, USE_MKL=ON, USE_MKLDNN=ON, USE_MPI=ON, USE_NCCL=ON, USE_NNPACK=ON, USE_OPENMP=ON, USE_ROCM=OFF, USE_ROCM_KERNEL_ASSERT=OFF, 2024-06-26T07:09:38.3962378Z 2024-06-26T07:09:38.6723491Z + cd test 2024-06-26T07:09:38.6724165Z + python -c 'import torch; print(torch.__config__.parallel_info())' 2024-06-26T07:09:39.8891607Z ATen/Parallel: 2024-06-26T07:09:39.8892198Z at::get_num_threads() : 8 2024-06-26T07:09:39.8892713Z at::get_num_interop_threads() : 16 2024-06-26T07:09:39.8893231Z OpenMP 201511 (a.k.a. OpenMP 4.5) 2024-06-26T07:09:39.8893636Z omp_get_max_threads() : 8 2024-06-26T07:09:39.8894623Z Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications 2024-06-26T07:09:39.8895415Z mkl_get_max_threads() : 8 2024-06-26T07:09:39.8896039Z Intel(R) MKL-DNN v3.4.2 (Git Hash 1137e04ec0b5251ca2b4400a4fd3c667ce843d67) 2024-06-26T07:09:39.8896696Z std::thread::hardware_concurrency() : 16 2024-06-26T07:09:39.8897129Z Environment variables: 2024-06-26T07:09:39.8897477Z OMP_NUM_THREADS : [not set] 2024-06-26T07:09:39.8897859Z MKL_NUM_THREADS : [not set] 2024-06-26T07:09:39.8898245Z ATen parallel backend: OpenMP 2024-06-26T07:09:39.8898498Z 2024-06-26T07:09:40.1305939Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *aarch64* ]] 2024-06-26T07:09:40.1306750Z + [[ aot_inductor_timm == *backward* ]] 2024-06-26T07:09:40.1308950Z + [[ aot_inductor_timm == *xla* ]] 2024-06-26T07:09:40.1309384Z + [[ aot_inductor_timm == *executorch* ]] 2024-06-26T07:09:40.1309866Z + [[ aot_inductor_timm == \j\i\t\_\l\e\g\a\c\y ]] 2024-06-26T07:09:40.1310506Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *libtorch* ]] 2024-06-26T07:09:40.1311070Z + [[ aot_inductor_timm == distributed ]] 2024-06-26T07:09:40.1311563Z + [[ aot_inductor_timm == *inductor_distributed* ]] 2024-06-26T07:09:40.1312116Z + [[ aot_inductor_timm == *inductor-halide* ]] 2024-06-26T07:09:40.1312679Z + [[ aot_inductor_timm == *inductor-micro-benchmark* ]] 2024-06-26T07:09:40.1313206Z + [[ aot_inductor_timm == *huggingface* ]] 2024-06-26T07:09:40.1313649Z + [[ aot_inductor_timm == *timm* ]] 2024-06-26T07:09:40.1314056Z + install_torchvision 2024-06-26T07:09:40.1314381Z + local orig_preload 2024-06-26T07:09:40.1314699Z + local commit 2024-06-26T07:09:40.1315004Z ++ get_pinned_commit vision 2024-06-26T07:09:40.1315386Z ++ cat .github/ci_commit_pins/vision.txt 2024-06-26T07:09:40.1319918Z + commit=d23a6e1664d20707c11781299611436e1f0c104f 2024-06-26T07:09:40.1320507Z + orig_preload= 2024-06-26T07:09:40.1320926Z + '[' -n '' ']' 2024-06-26T07:09:40.1321745Z + pip_install --no-use-pep517 --user git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2024-06-26T07:09:40.1323145Z + pip install --progress-bar off --no-use-pep517 --user git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2024-06-26T07:09:40.4404209Z Collecting git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2024-06-26T07:09:40.4410278Z Cloning https://github.com/pytorch/vision.git (to revision d23a6e1664d20707c11781299611436e1f0c104f) to /tmp/pip-req-build-dllr11ym 2024-06-26T07:09:40.4428132Z Running command git clone --filter=blob:none --quiet https://github.com/pytorch/vision.git /tmp/pip-req-build-dllr11ym 2024-06-26T07:09:41.8133783Z Running command git rev-parse -q --verify 'sha^d23a6e1664d20707c11781299611436e1f0c104f' 2024-06-26T07:09:41.8152123Z Running command git fetch -q https://github.com/pytorch/vision.git d23a6e1664d20707c11781299611436e1f0c104f 2024-06-26T07:09:43.0310076Z Running command git checkout -q d23a6e1664d20707c11781299611436e1f0c104f 2024-06-26T07:09:43.2546879Z Resolved https://github.com/pytorch/vision.git to commit d23a6e1664d20707c11781299611436e1f0c104f 2024-06-26T07:09:45.5802739Z Preparing metadata (setup.py) ... [?25l- \ done 2024-06-26T07:09:45.5851608Z [?25hRequirement already satisfied: numpy in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (1.21.2) 2024-06-26T07:09:45.5854525Z Requirement already satisfied: torch in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (2.5.0a0+gitb8c4c54) 2024-06-26T07:09:45.5859795Z Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (10.3.0) 2024-06-26T07:09:45.6064332Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (3.13.1) 2024-06-26T07:09:45.6070953Z Requirement already satisfied: typing-extensions>=4.8.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (4.12.2) 2024-06-26T07:09:45.6073297Z Requirement already satisfied: sympy in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (1.12.1) 2024-06-26T07:09:45.6076421Z Requirement already satisfied: networkx in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (2.8.8) 2024-06-26T07:09:45.6079067Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (3.1.4) 2024-06-26T07:09:45.6081863Z Requirement already satisfied: fsspec in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (2024.2.0) 2024-06-26T07:09:45.6500912Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from jinja2->torch->torchvision==0.19.0a0+d23a6e1) (2.1.5) 2024-06-26T07:09:45.6657435Z Requirement already satisfied: mpmath<1.4.0,>=1.1.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from sympy->torch->torchvision==0.19.0a0+d23a6e1) (1.3.0) 2024-06-26T07:09:45.6734198Z Building wheels for collected packages: torchvision 2024-06-26T07:10:58.0577086Z Building wheel for torchvision (setup.py) ... [?25l- \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ done 2024-06-26T07:10:58.0604501Z [?25h Created wheel for torchvision: filename=torchvision-0.19.0a0+d23a6e1-cp310-cp310-linux_x86_64.whl size=2112790 sha256=ed36a9a04012ca3fdde3235de2a315d065f13136fdc2d1eaa0f4829e3111cbeb 2024-06-26T07:10:58.0606266Z Stored in directory: /var/lib/jenkins/.cache/pip/wheels/0e/56/35/02931e71eb23fd2b85591c7ec05b733ca7c8b328a2fd151f96 2024-06-26T07:10:58.0641037Z Successfully built torchvision 2024-06-26T07:10:59.2610238Z Installing collected packages: torchvision 2024-06-26T07:10:59.6449447Z Successfully installed torchvision-0.19.0a0+d23a6e1 2024-06-26T07:10:59.7531994Z + '[' -n '' ']' 2024-06-26T07:10:59.7532336Z + id=1 2024-06-26T07:10:59.7533421Z + test_dynamo_benchmark timm_models 1 2024-06-26T07:10:59.7534377Z ++ pwd 2024-06-26T07:10:59.7536443Z + TEST_REPORTS_DIR=/var/lib/jenkins/workspace/test/test-reports 2024-06-26T07:10:59.7537202Z + local suite=timm_models 2024-06-26T07:10:59.7537589Z + shift 2024-06-26T07:10:59.7537892Z + local shard_id=1 2024-06-26T07:10:59.7538270Z + shift 2024-06-26T07:10:59.7538708Z + [[ aot_inductor_timm == *perf_compare* ]] 2024-06-26T07:10:59.7539214Z + [[ aot_inductor_timm == *perf* ]] 2024-06-26T07:10:59.7539725Z + [[ aot_inductor_timm == *cpu_inductor* ]] 2024-06-26T07:10:59.7540208Z + [[ aot_inductor_timm == *aot_inductor* ]] 2024-06-26T07:10:59.7540975Z + test_single_dynamo_benchmark inference timm_models 1 --inference --bfloat16 2024-06-26T07:10:59.7541758Z ++ pwd 2024-06-26T07:10:59.7542338Z + TEST_REPORTS_DIR=/var/lib/jenkins/workspace/test/test-reports 2024-06-26T07:10:59.7548386Z + mkdir -p /var/lib/jenkins/workspace/test/test-reports 2024-06-26T07:10:59.7553422Z + local name=inference 2024-06-26T07:10:59.7553846Z + shift 2024-06-26T07:10:59.7554246Z + local suite=timm_models 2024-06-26T07:10:59.7554725Z + shift 2024-06-26T07:10:59.7555102Z + local shard_id=1 2024-06-26T07:10:59.7555530Z + shift 2024-06-26T07:10:59.7555922Z + partition_flags=() 2024-06-26T07:10:59.7556385Z + local partition_flags 2024-06-26T07:10:59.7556894Z + [[ -n 2 ]] 2024-06-26T07:10:59.7557343Z + [[ -n 1 ]] 2024-06-26T07:10:59.7558175Z + partition_flags=(--total-partitions "$NUM_TEST_SHARDS" --partition-id "$shard_id") 2024-06-26T07:10:59.7559124Z + [[ aot_inductor_timm == *perf_compare* ]] 2024-06-26T07:10:59.7559764Z + [[ aot_inductor_timm == *perf* ]] 2024-06-26T07:10:59.7560401Z + [[ aot_inductor_timm == *aot_inductor* ]] 2024-06-26T07:10:59.7561056Z + export TORCHINDUCTOR_ABI_COMPATIBLE=1 2024-06-26T07:10:59.7561672Z + TORCHINDUCTOR_ABI_COMPATIBLE=1 2024-06-26T07:10:59.7564032Z + python benchmarks/dynamo/timm_models.py --ci --accuracy --timing --explain --export-aot-inductor --device cuda --inference --bfloat16 --total-partitions 2 --partition-id 1 --output /var/lib/jenkins/workspace/test/test-reports/inference_timm_models.csv 2024-06-26T07:11:05.5694687Z 2024-06-26T07:11:05.7334417Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:11:05.7334756Z 2024-06-26T07:11:05.7914684Z model.safetensors: 0% 0.00/29.6M [00:00 /dev/null 2>&1; then 2024-06-26T07:36:02.4000187Z  zip -r "logs-${FILE_SUFFIX}.zip" test -i '*.log' 2024-06-26T07:36:02.4000674Z fi 2024-06-26T07:36:02.4008132Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:36:02.4008618Z env: 2024-06-26T07:36:02.4009014Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:36:02.4009475Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:36:02.4010199Z DOCKER_CONTAINER_ID: 9e7838844bf9b3c79df6186681211b7b1cbf1257424f1c3a3791890da01a84d4 2024-06-26T07:36:02.4011051Z FILE_SUFFIX: test-aot_inductor_timm-2-2-linux.g5.4xlarge.nvidia.gpu_26688912508 2024-06-26T07:36:02.4011654Z ##[endgroup] 2024-06-26T07:36:02.4056536Z adding: usage_log.txt (deflated 92%) 2024-06-26T07:36:02.4121596Z ##[group]Run # Remove any previous debugging artifacts if they exist 2024-06-26T07:36:02.4122296Z # Remove any previous debugging artifacts if they exist 2024-06-26T07:36:02.4122842Z rm -f debug-*.zip 2024-06-26T07:36:02.4123234Z if [ -d 'test/debug' ]; then 2024-06-26T07:36:02.4123739Z  zip -r "debug-${FILE_SUFFIX}.zip" test/debug 2024-06-26T07:36:02.4124205Z fi 2024-06-26T07:36:02.4130871Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:36:02.4131377Z env: 2024-06-26T07:36:02.4131655Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:36:02.4132099Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:36:02.4132816Z DOCKER_CONTAINER_ID: 9e7838844bf9b3c79df6186681211b7b1cbf1257424f1c3a3791890da01a84d4 2024-06-26T07:36:02.4133667Z FILE_SUFFIX: test-aot_inductor_timm-2-2-linux.g5.4xlarge.nvidia.gpu_26688912508 2024-06-26T07:36:02.4134280Z ##[endgroup] 2024-06-26T07:36:02.4210655Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-06-26T07:36:02.4211104Z with: 2024-06-26T07:36:02.4211402Z s3-bucket: gha-artifacts 2024-06-26T07:36:02.4211848Z s3-prefix: pytorch/pytorch/9673646808/1/artifact 2024-06-26T07:36:02.4212332Z retention-days: 14 2024-06-26T07:36:02.4212832Z if-no-files-found: warn 2024-06-26T07:36:02.4213204Z path: test-jsons-*.zip 2024-06-26T07:36:02.4213560Z name: artifact 2024-06-26T07:36:02.4213884Z region: us-east-1 2024-06-26T07:36:02.4214198Z env: 2024-06-26T07:36:02.4214498Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:36:02.4214957Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:36:02.4215684Z DOCKER_CONTAINER_ID: 9e7838844bf9b3c79df6186681211b7b1cbf1257424f1c3a3791890da01a84d4 2024-06-26T07:36:02.4216320Z ##[endgroup] 2024-06-26T07:36:02.7317744Z NOTE: s3-prefix specified, ignoring name parameter 2024-06-26T07:36:02.7318559Z With the provided path, there will be 1 file uploaded 2024-06-26T07:36:02.7319197Z Uploading to s3 prefix: pytorch/pytorch/9673646808/1/artifact 2024-06-26T07:36:02.7346649Z Starting upload of test-jsons-test-aot_inductor_timm-2-2-linux.g5.4xlarge.nvidia.gpu_26688912508.zip 2024-06-26T07:36:02.8669066Z Finished upload of test-jsons-test-aot_inductor_timm-2-2-linux.g5.4xlarge.nvidia.gpu_26688912508.zip 2024-06-26T07:36:02.8801207Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-06-26T07:36:02.8801649Z with: 2024-06-26T07:36:02.8801940Z s3-bucket: gha-artifacts 2024-06-26T07:36:02.8802371Z s3-prefix: pytorch/pytorch/9673646808/1/artifact 2024-06-26T07:36:02.8802856Z retention-days: 14 2024-06-26T07:36:02.8803193Z if-no-files-found: error 2024-06-26T07:36:02.8803563Z path: test-reports-*.zip 2024-06-26T07:36:02.8803926Z name: artifact 2024-06-26T07:36:02.8804234Z region: us-east-1 2024-06-26T07:36:02.8804540Z env: 2024-06-26T07:36:02.8804890Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:36:02.8805346Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:36:02.8806061Z DOCKER_CONTAINER_ID: 9e7838844bf9b3c79df6186681211b7b1cbf1257424f1c3a3791890da01a84d4 2024-06-26T07:36:02.8806693Z ##[endgroup] 2024-06-26T07:36:03.1880976Z NOTE: s3-prefix specified, ignoring name parameter 2024-06-26T07:36:03.1881847Z With the provided path, there will be 1 file uploaded 2024-06-26T07:36:03.1882718Z Uploading to s3 prefix: pytorch/pytorch/9673646808/1/artifact 2024-06-26T07:36:03.1910069Z Starting upload of test-reports-test-aot_inductor_timm-2-2-linux.g5.4xlarge.nvidia.gpu_26688912508.zip 2024-06-26T07:36:03.3226442Z Finished upload of test-reports-test-aot_inductor_timm-2-2-linux.g5.4xlarge.nvidia.gpu_26688912508.zip 2024-06-26T07:36:03.3359520Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-06-26T07:36:03.3359963Z with: 2024-06-26T07:36:03.3360251Z s3-bucket: gha-artifacts 2024-06-26T07:36:03.3360687Z s3-prefix: pytorch/pytorch/9673646808/1/artifact 2024-06-26T07:36:03.3361155Z retention-days: 14 2024-06-26T07:36:03.3361494Z if-no-files-found: ignore 2024-06-26T07:36:03.3361856Z path: logs-*.zip 2024-06-26T07:36:03.3362167Z name: artifact 2024-06-26T07:36:03.3362467Z region: us-east-1 2024-06-26T07:36:03.3362768Z env: 2024-06-26T07:36:03.3363044Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:36:03.3363498Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:36:03.3364229Z DOCKER_CONTAINER_ID: 9e7838844bf9b3c79df6186681211b7b1cbf1257424f1c3a3791890da01a84d4 2024-06-26T07:36:03.3364936Z ##[endgroup] 2024-06-26T07:36:03.6473238Z NOTE: s3-prefix specified, ignoring name parameter 2024-06-26T07:36:03.6473931Z With the provided path, there will be 1 file uploaded 2024-06-26T07:36:03.6474604Z Uploading to s3 prefix: pytorch/pytorch/9673646808/1/artifact 2024-06-26T07:36:03.6500404Z Starting upload of logs-test-aot_inductor_timm-2-2-linux.g5.4xlarge.nvidia.gpu_26688912508.zip 2024-06-26T07:36:03.8053147Z Finished upload of logs-test-aot_inductor_timm-2-2-linux.g5.4xlarge.nvidia.gpu_26688912508.zip 2024-06-26T07:36:03.8184814Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-06-26T07:36:03.8185259Z with: 2024-06-26T07:36:03.8185551Z s3-bucket: gha-artifacts 2024-06-26T07:36:03.8185988Z s3-prefix: pytorch/pytorch/9673646808/1/artifact 2024-06-26T07:36:03.8186462Z retention-days: 14 2024-06-26T07:36:03.8186802Z if-no-files-found: ignore 2024-06-26T07:36:03.8187482Z path: debug-*.zip 2024-06-26T07:36:03.8187806Z name: artifact 2024-06-26T07:36:03.8188114Z region: us-east-1 2024-06-26T07:36:03.8188417Z env: 2024-06-26T07:36:03.8188701Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:36:03.8189169Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:36:03.8189887Z DOCKER_CONTAINER_ID: 9e7838844bf9b3c79df6186681211b7b1cbf1257424f1c3a3791890da01a84d4 2024-06-26T07:36:03.8190515Z ##[endgroup] 2024-06-26T07:36:04.1212767Z No files were found with the provided path: debug-*.zip. No artifacts will be uploaded. 2024-06-26T07:36:04.1343852Z ##[group]Run # shellcheck disable=SC2156 2024-06-26T07:36:04.1344339Z # shellcheck disable=SC2156 2024-06-26T07:36:04.1345135Z find . -iname "core.[1-9]*" -exec docker exec "${DOCKER_CONTAINER_ID}" sh -c "gdb python {} -ex 'bt' -ex 'q'" \; 2024-06-26T07:36:04.1353250Z shell: /usr/bin/bash -e {0} 2024-06-26T07:36:04.1353605Z env: 2024-06-26T07:36:04.1353897Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:36:04.1354352Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:36:04.1355066Z DOCKER_CONTAINER_ID: 9e7838844bf9b3c79df6186681211b7b1cbf1257424f1c3a3791890da01a84d4 2024-06-26T07:36:04.1355694Z ##[endgroup] 2024-06-26T07:36:04.2976448Z ##[group]Run pytorch/test-infra/.github/actions/teardown-linux@main 2024-06-26T07:36:04.2977006Z with: 2024-06-26T07:36:04.2977269Z env: 2024-06-26T07:36:04.2977537Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:36:04.2978031Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:36:04.2978774Z DOCKER_CONTAINER_ID: 9e7838844bf9b3c79df6186681211b7b1cbf1257424f1c3a3791890da01a84d4 2024-06-26T07:36:04.2979404Z ##[endgroup] 2024-06-26T07:36:04.2996906Z ##[group]Run set -eou pipefail 2024-06-26T07:36:04.2997323Z set -eou pipefail 2024-06-26T07:36:04.2997684Z  2024-06-26T07:36:04.2998200Z echo "Holding runner for 2 hours until all ssh sessions have logged out" 2024-06-26T07:36:04.2998856Z for _ in $(seq 1440); do 2024-06-26T07:36:04.2999332Z  # Break if no ssh session exists anymore 2024-06-26T07:36:04.2999842Z  if [ "$(who)" = "" ]; then 2024-06-26T07:36:04.3000255Z  break 2024-06-26T07:36:04.3000600Z  fi 2024-06-26T07:36:04.3000904Z  echo "." 2024-06-26T07:36:04.3001236Z  sleep 5 2024-06-26T07:36:04.3001559Z done 2024-06-26T07:36:04.3008941Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:36:04.3009436Z env: 2024-06-26T07:36:04.3009717Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:36:04.3010173Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:36:04.3010900Z DOCKER_CONTAINER_ID: 9e7838844bf9b3c79df6186681211b7b1cbf1257424f1c3a3791890da01a84d4 2024-06-26T07:36:04.3011520Z ##[endgroup] 2024-06-26T07:36:04.3031382Z Holding runner for 2 hours until all ssh sessions have logged out 2024-06-26T07:36:04.3063626Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2024-06-26T07:36:04.3064396Z # ignore expansion of "docker ps -q" since it could be empty 2024-06-26T07:36:04.3064986Z # shellcheck disable=SC2046 2024-06-26T07:36:04.3065462Z docker stop $(docker ps -q) || true 2024-06-26T07:36:04.3065941Z # Prune all of the docker images 2024-06-26T07:36:04.3066392Z docker system prune -af 2024-06-26T07:36:04.3073468Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:36:04.3073960Z env: 2024-06-26T07:36:04.3074230Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:36:04.3074681Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:36:04.3075398Z DOCKER_CONTAINER_ID: 9e7838844bf9b3c79df6186681211b7b1cbf1257424f1c3a3791890da01a84d4 2024-06-26T07:36:04.3076018Z ##[endgroup] 2024-06-26T07:36:04.6089701Z 9e7838844bf9 2024-06-26T07:36:05.3586301Z Deleted Containers: 2024-06-26T07:36:05.3586904Z 9e7838844bf9b3c79df6186681211b7b1cbf1257424f1c3a3791890da01a84d4 2024-06-26T07:36:05.3587676Z 2024-06-26T07:36:10.3759628Z Deleted Images: 2024-06-26T07:36:10.3761492Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:36:10.3763829Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks@sha256:216c88a4f79ebfa71a5dcf4d9a946548184354a3ea1f677f4b1065d28705debb 2024-06-26T07:36:10.3765865Z deleted: sha256:0058b15e517a024817bccd921dc9af264c964f500b3cb9b3f4649a8ac22cc2dd 2024-06-26T07:36:10.3766947Z deleted: sha256:754ead7012f0b7691885a9660f02e80be6cee8c5665486fb995c1fb06adb6e92 2024-06-26T07:36:10.3768061Z deleted: sha256:fbe4496d8830e11be86d8f222522e7956f32f85bfc06b05ea53961f34a58af74 2024-06-26T07:36:10.3768895Z deleted: sha256:1c83814aa1a1a7e0cc998e3479bdab8e8766b975560cbf00690acf39ed899a80 2024-06-26T07:36:10.3769769Z deleted: sha256:e9ea8e61942c7f8ae4aab97b8d102b01d6bb4b6cf2a605808cd34130a17d8a0f 2024-06-26T07:36:10.3770824Z deleted: sha256:acc5fc32588cd95e082a6ce35e48d0f303ae8f96e3ab65c4e375b85e1f3c4a92 2024-06-26T07:36:10.3771715Z deleted: sha256:a93e53400904d29e4185d3be942ea34f19572ea438962788ae4e9b3d9bf4c498 2024-06-26T07:36:10.3772736Z deleted: sha256:c97092b88b5e4c77c68bbc4b51afab64e38719af1ff58013ec49a696cdd40a6e 2024-06-26T07:36:10.3773569Z deleted: sha256:b132889c90d67ffa53655846603e3fcc2372c23f04dbdbc54690a39d304eb89b 2024-06-26T07:36:10.3774378Z deleted: sha256:915d54081ed607710624abe3f2490114c745858831f4fc13396bd3b4b9a121bc 2024-06-26T07:36:10.3775186Z deleted: sha256:bfa8d446c498c87f535aef102695564de1b22c755e6c63944ae2f5073a2b31ec 2024-06-26T07:36:10.3776006Z deleted: sha256:e71460fb363c29e70bbe357d680aaa7ae694f094ef2f2713609158ad90611744 2024-06-26T07:36:10.3776812Z deleted: sha256:84079bb1b4ee1d0119ae3d3e701de460a1324912297c675425c9a36d30fcdb0f 2024-06-26T07:36:10.3777635Z deleted: sha256:d86ac3ca148d4758cb03b493fdd49109d8f1a2c7c85c4b755493c3c4529553e5 2024-06-26T07:36:10.3778475Z deleted: sha256:532b3ab97c44a673a0d5f62ee46fa6a83248a84de8877754a612355be56ed0a3 2024-06-26T07:36:10.3779350Z deleted: sha256:617e2a35f25ae24500c88c0c9b8475f0687fbcbed3d200013b4c99c6d8941aff 2024-06-26T07:36:10.3780177Z deleted: sha256:b88120bcd5a26a660c09c5df13176e0ef098fb2c8cdb57d74ab0796a3d1194d6 2024-06-26T07:36:10.3781052Z deleted: sha256:c016b2e7764735243205fb76fa9a273bb3dd4bf05532288e3a613ce022131ac3 2024-06-26T07:36:10.3781888Z deleted: sha256:bcaca462c390deddd2995de2d245a7495e7d2e1e94f0edad30a573c83d0588fd 2024-06-26T07:36:10.3782726Z deleted: sha256:9e260eba003d5c25d7b410e5c4c3093845d9e46611896840901c689d7fbf8ee6 2024-06-26T07:36:10.3783535Z deleted: sha256:3e62b86f8b911a9b59c62d55f063e71683ae6a01c22418db5d27930712adaad6 2024-06-26T07:36:10.3784347Z deleted: sha256:905920ccb1d88449b8dde686c34a4b2a8b6f59e78ac44916b189ea3593b9fbbb 2024-06-26T07:36:10.3785159Z deleted: sha256:961201237e03acd5061406238dd7a3c1343ac888d7583212cd0ab5ae1b4f0540 2024-06-26T07:36:10.3785986Z deleted: sha256:70047a2aac62159fa28fb4dbd4567ec2ffbab68fe046967e09acb0eb3e5cb9cb 2024-06-26T07:36:10.3786817Z deleted: sha256:1ec680ad781436ae65fa987f5fa1ed032ecd5c82a6e35eea6707de501f62c0f4 2024-06-26T07:36:10.3787986Z deleted: sha256:ef859623a50e85abf6e6c1dbd6188aa765a66cc7b2bd618a1cbe4825b7b2bd91 2024-06-26T07:36:10.3788828Z deleted: sha256:404ade5cacff59773b93ab438bfa64cd3a171d07f6f168bdc4a5d4bfa0b43526 2024-06-26T07:36:10.3789919Z deleted: sha256:5b27de6ee3d9f2f18217bf18dec725f7b4954c0e48c85d35752634c22d62209b 2024-06-26T07:36:10.3790768Z deleted: sha256:498e39c575b3fa069acaac7e46b91b4e54ae3a05f2ada5c4347091f346f25d4c 2024-06-26T07:36:10.3791562Z deleted: sha256:1405919d2694d65669b1f4c842282021afe89208ce86570e96464903733da2d0 2024-06-26T07:36:10.3792359Z deleted: sha256:d5b41e5d70896c0472fc3e6da0516a17d89cd6635dc75010ecddc31ce9690fad 2024-06-26T07:36:10.3793178Z deleted: sha256:18e9379b62b9d0bb40293d28a652eafaee66a499f66f0776bf14e37a513101b7 2024-06-26T07:36:10.3794007Z deleted: sha256:a781f80ed00ff2926a699fd01a309bb0b4fb7d5655eb652c205bb9c7f811035f 2024-06-26T07:36:10.3794969Z deleted: sha256:c0430973b7cf759075330ee29c79bfd1312c91e6033d9dd883b4b1c29743a171 2024-06-26T07:36:10.3795786Z deleted: sha256:e733b3d66efb9342e5a283376c0e1ddffa47a42fecc26e61ecaf0a3472885d97 2024-06-26T07:36:10.3796610Z deleted: sha256:8929c0b2047f74b84c82c39eff9077a92ae1a828cde00c9ab78fb3e0ed5e0283 2024-06-26T07:36:10.3797421Z deleted: sha256:f5b56155fb58a0a60fe6391d3581cf91610ed69d4f0a321257c19944da296a52 2024-06-26T07:36:10.3798227Z deleted: sha256:b54d2cb355238d1aa91e58df93064447b80f53706d1ca62823acc834f5ac54fe 2024-06-26T07:36:10.3799030Z deleted: sha256:e7311285af9eeddb51aa5629aa98386e89f1456ff32843b6aee6443247edf66c 2024-06-26T07:36:10.3799845Z deleted: sha256:67657ceec347da8dc8085d5731633efeac115ba677fa4b7c5966c4260f7abab0 2024-06-26T07:36:10.3800669Z deleted: sha256:b496e50409dbf414930fc9b4437aa0aa4ce27bc7840e050ae459aaffcf9aca86 2024-06-26T07:36:10.3801481Z deleted: sha256:8f5276170cc4a60d36ad7b964a502306b29546254cedcbcb101ea9123497d2c0 2024-06-26T07:36:10.3802282Z deleted: sha256:53d524d1564745e96a7e515462171b73184d9f1ff5454b32fcfbbca39d361467 2024-06-26T07:36:10.3803099Z deleted: sha256:2acbadb00d69b6aca575f04baba4ea26ae2b5c2d85f09945004ad93a78a8eb75 2024-06-26T07:36:10.3804038Z deleted: sha256:02665efeff878aeb603c1edb2e21cb700c171c025d64f5aae1b2b20b12f3964a 2024-06-26T07:36:10.3804942Z deleted: sha256:19bd23e9a51dfe883a8b8d2ff6d66ff1b3476b8912856406bb79b81762aa6d4b 2024-06-26T07:36:10.3805760Z deleted: sha256:73aa8637bf9299d6298dabd858480c274a62117388f2ca1d5e9eb15c6d1e4155 2024-06-26T07:36:10.3806567Z deleted: sha256:5f8968406305f348b1caebc0e035187d6e9965ace7b9d5f2f21114d37c9fe2e1 2024-06-26T07:36:10.3807379Z deleted: sha256:d827104914db0c503cf5c81f13e2456bf4efce42d4cf1f8d5d70838207278bee 2024-06-26T07:36:10.3808199Z deleted: sha256:867b219724f2f1aaf56f42e3e9f03a5d64bdca8a6a72407efd10328aeea5d510 2024-06-26T07:36:10.3809020Z deleted: sha256:b9ff2a7cceb9237b26bcb17728edf8a558eec5a76f63626e84f80541dfc0f1d4 2024-06-26T07:36:10.3809854Z deleted: sha256:be73f509106819007ce2b0f5a1301ac56ae583cb6c1fb69bee93efa0840368f1 2024-06-26T07:36:10.3810672Z deleted: sha256:2a11c07c915c3fdbb4e73096dea73ea950c970d50fe1a5764060bd62b7b7cf2c 2024-06-26T07:36:10.3811492Z deleted: sha256:5e9989622e2abc1c72f8184343507b45d75e4ff971edb68b96cbcd75ae484ff5 2024-06-26T07:36:10.3812314Z deleted: sha256:05ce642bd9cf5a9205bff107df28b1d6cef7d5f6ab3ea944d28c032ec61270df 2024-06-26T07:36:10.3813120Z deleted: sha256:017702617f6c07b73f2088678f4710b794cfe897a213a5cf122a0e2519eae0ac 2024-06-26T07:36:10.3813924Z deleted: sha256:44b3b37bb1ca39dc5cf356de41a23a5c12f605a1992813e408087fb2b0ad6d1c 2024-06-26T07:36:10.3814740Z deleted: sha256:8c387982e9f27db357a1d149dc149cabc0bd04668ad6956387a5072682dada67 2024-06-26T07:36:10.3815555Z deleted: sha256:10d415dca4e3fbb88a747b40317f3c6333c041ba8f73855f67fb9fe981fae5ee 2024-06-26T07:36:10.3816365Z deleted: sha256:6c65469bf0f53dcd625faefe363b8f3136c08388a6cf64d9158e8576e4ee89b1 2024-06-26T07:36:10.3817200Z deleted: sha256:027db5d8b76deeefbd8c34b485ab7ff14ed2a3e6800425c1ce0d77c2e9fdd4ab 2024-06-26T07:36:10.3818026Z deleted: sha256:24941234ad28cf5c8174d7cf18326c10b4e17f2c2137672ea0322df461597dd7 2024-06-26T07:36:10.3818844Z deleted: sha256:240ea2eebfa8519d6c2d88f4c99e66ce4e038d000f93ce8d03726c01d81180ef 2024-06-26T07:36:10.3819656Z deleted: sha256:09e823cb391a69f6a195e3ca8a41624b5f8b34eee14c6eb36277de814a91966e 2024-06-26T07:36:10.3820505Z deleted: sha256:730479d695169a6593bf0ac16b377491dce65175a6d158e012422367d04577fd 2024-06-26T07:36:10.3821318Z deleted: sha256:b0a30f9f7bd5459ff662453b9346a7ba8ea8db1191528345c1953eab4aa2f54e 2024-06-26T07:36:10.3822147Z deleted: sha256:75cefa87effaa3ad361c74642839923101f0f9982f814f3c9e2ed4ad52f2a008 2024-06-26T07:36:10.3822949Z deleted: sha256:6f97db87ba9512e615e871c6982000602982e1e5a5be334a56e7292251e84e00 2024-06-26T07:36:10.3823760Z deleted: sha256:35a033279d5c9bd6b862bfa9331d8fcbf98bbaf778a778fabc882384db9204f8 2024-06-26T07:36:10.3824582Z deleted: sha256:ab9b00c496073d62e69e032178858d3d6d4c4bab9e87065d3785c6da57351d00 2024-06-26T07:36:10.3825463Z deleted: sha256:7ed947299e109c2459de6e240d86f049c30f93f2380659ce441d8737b8cd065f 2024-06-26T07:36:10.3826274Z deleted: sha256:410d5a7f7a9a1cb4551c106b9cc728a9dcff598f9be231a351ce6a0a33f81e64 2024-06-26T07:36:10.3827099Z deleted: sha256:5f0021bb56efa14bb93978c01513e2a1187ba30e69bdb0546d0ef39b30873f88 2024-06-26T07:36:10.3828115Z deleted: sha256:c1601aa97eb84151c14da3aeea351201bd99144d36d66b397f6555d80245d86d 2024-06-26T07:36:10.3828950Z deleted: sha256:72af05a89be22accdc1ca5d66dcbbb33993a9ef5997f849df1d4ba4c48049f25 2024-06-26T07:36:10.3829781Z deleted: sha256:38b90c9663dcaa2bc57a4dd3008298e7ea93e9535fa42312b4dc4246e7491af9 2024-06-26T07:36:10.3830661Z deleted: sha256:bda61b6cefb3ec8eeb74fef1ca1c7f9a5845fe5e8f07b8123323e897425d5c29 2024-06-26T07:36:10.3831492Z deleted: sha256:5a18e1aa877074529a84cbddf19f8d5403787823378ceae6b72fb62f78d43037 2024-06-26T07:36:10.3832308Z deleted: sha256:6c3e7df31590f02f10cb71fc4eb27653e9b428df2e6e5421a455b062bd2e39f9 2024-06-26T07:36:10.3832800Z 2024-06-26T07:36:10.3832959Z Total reclaimed space: 36.29GB 2024-06-26T07:36:10.3894657Z Post job cleanup. 2024-06-26T07:36:10.3941990Z Post job cleanup. 2024-06-26T07:36:10.4761478Z [command]/usr/bin/git version 2024-06-26T07:36:10.4803562Z git version 2.40.1 2024-06-26T07:36:10.4836020Z Copying '/home/ec2-user/.gitconfig' to '/home/ec2-user/actions-runner/_work/_temp/74858855-3ab0-425d-99b8-8cfc9b6aa63c/.gitconfig' 2024-06-26T07:36:10.4847986Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/74858855-3ab0-425d-99b8-8cfc9b6aa63c' before making global git config changes 2024-06-26T07:36:10.4849216Z Adding repository directory to the temporary git global config as a safe directory 2024-06-26T07:36:10.4852786Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-06-26T07:36:10.4882560Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2024-06-26T07:36:10.4906139Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2024-06-26T07:36:10.5127081Z Entering 'android/libs/fbjni' 2024-06-26T07:36:10.5163501Z Entering 'third_party/FP16' 2024-06-26T07:36:10.5201125Z Entering 'third_party/FXdiv' 2024-06-26T07:36:10.5237795Z Entering 'third_party/NNPACK' 2024-06-26T07:36:10.5269623Z Entering 'third_party/VulkanMemoryAllocator' 2024-06-26T07:36:10.5305565Z Entering 'third_party/XNNPACK' 2024-06-26T07:36:10.5349438Z Entering 'third_party/benchmark' 2024-06-26T07:36:10.5385497Z Entering 'third_party/cpp-httplib' 2024-06-26T07:36:10.5420809Z Entering 'third_party/cpuinfo' 2024-06-26T07:36:10.5457968Z Entering 'third_party/cudnn_frontend' 2024-06-26T07:36:10.5493793Z Entering 'third_party/cutlass' 2024-06-26T07:36:10.5538126Z Entering 'third_party/eigen' 2024-06-26T07:36:10.5574327Z Entering 'third_party/fbgemm' 2024-06-26T07:36:10.5613327Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-06-26T07:36:10.5648744Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T07:36:10.5683688Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-06-26T07:36:10.5722123Z Entering 'third_party/fbgemm/third_party/googletest' 2024-06-26T07:36:10.5757512Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T07:36:10.5794905Z Entering 'third_party/flatbuffers' 2024-06-26T07:36:10.5828951Z Entering 'third_party/fmt' 2024-06-26T07:36:10.5861695Z Entering 'third_party/foxi' 2024-06-26T07:36:10.5898541Z Entering 'third_party/gemmlowp/gemmlowp' 2024-06-26T07:36:10.5935919Z Entering 'third_party/gloo' 2024-06-26T07:36:10.5972212Z Entering 'third_party/googletest' 2024-06-26T07:36:10.6006979Z Entering 'third_party/ideep' 2024-06-26T07:36:10.6042331Z Entering 'third_party/ideep/mkl-dnn' 2024-06-26T07:36:10.6082344Z Entering 'third_party/ittapi' 2024-06-26T07:36:10.6116339Z Entering 'third_party/kineto' 2024-06-26T07:36:10.6152017Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T07:36:10.6187915Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T07:36:10.6223287Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T07:36:10.6258958Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T07:36:10.6294460Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T07:36:10.6328900Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T07:36:10.6362790Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T07:36:10.6397483Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T07:36:10.6431151Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T07:36:10.6463625Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T07:36:10.6498532Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T07:36:10.6531272Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T07:36:10.6563513Z Entering 'third_party/mimalloc' 2024-06-26T07:36:10.6603374Z Entering 'third_party/nccl/nccl' 2024-06-26T07:36:10.6642137Z Entering 'third_party/nlohmann' 2024-06-26T07:36:10.6677002Z Entering 'third_party/onnx' 2024-06-26T07:36:10.6722206Z Entering 'third_party/onnx/third_party/benchmark' 2024-06-26T07:36:10.6755251Z Entering 'third_party/onnx/third_party/pybind11' 2024-06-26T07:36:10.6790187Z Entering 'third_party/opentelemetry-cpp' 2024-06-26T07:36:10.6824110Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T07:36:10.6856135Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T07:36:10.6887783Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T07:36:10.6918771Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T07:36:10.6951415Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T07:36:10.6981761Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T07:36:10.7015526Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T07:36:10.7047476Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T07:36:10.7079609Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T07:36:10.7118380Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T07:36:10.7165948Z Entering 'third_party/pocketfft' 2024-06-26T07:36:10.7197514Z Entering 'third_party/protobuf' 2024-06-26T07:36:10.7235955Z Entering 'third_party/protobuf/third_party/benchmark' 2024-06-26T07:36:10.7269396Z Entering 'third_party/protobuf/third_party/googletest' 2024-06-26T07:36:10.7306999Z Entering 'third_party/psimd' 2024-06-26T07:36:10.7339372Z Entering 'third_party/pthreadpool' 2024-06-26T07:36:10.7372042Z Entering 'third_party/pybind11' 2024-06-26T07:36:10.7402836Z Entering 'third_party/python-peachpy' 2024-06-26T07:36:10.7433819Z Entering 'third_party/sleef' 2024-06-26T07:36:10.7468985Z Entering 'third_party/tensorpipe' 2024-06-26T07:36:10.7501408Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-06-26T07:36:10.7536746Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-06-26T07:36:10.7570321Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-06-26T07:36:10.7603734Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T07:36:10.7636503Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T07:36:10.7687815Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2024-06-26T07:36:10.7705273Z http.https://github.com/.extraheader 2024-06-26T07:36:10.7713540Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader 2024-06-26T07:36:10.7736410Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2024-06-26T07:36:10.7946431Z Entering 'android/libs/fbjni' 2024-06-26T07:36:10.7969155Z http.https://github.com/.extraheader 2024-06-26T07:36:10.7993408Z Entering 'third_party/FP16' 2024-06-26T07:36:10.8014373Z http.https://github.com/.extraheader 2024-06-26T07:36:10.8036927Z Entering 'third_party/FXdiv' 2024-06-26T07:36:10.8058068Z http.https://github.com/.extraheader 2024-06-26T07:36:10.8081577Z Entering 'third_party/NNPACK' 2024-06-26T07:36:10.8102258Z http.https://github.com/.extraheader 2024-06-26T07:36:10.8126953Z Entering 'third_party/VulkanMemoryAllocator' 2024-06-26T07:36:10.8148735Z http.https://github.com/.extraheader 2024-06-26T07:36:10.8171118Z Entering 'third_party/XNNPACK' 2024-06-26T07:36:10.8192675Z http.https://github.com/.extraheader 2024-06-26T07:36:10.8225678Z Entering 'third_party/benchmark' 2024-06-26T07:36:10.8248128Z http.https://github.com/.extraheader 2024-06-26T07:36:10.8272306Z Entering 'third_party/cpp-httplib' 2024-06-26T07:36:10.8294047Z http.https://github.com/.extraheader 2024-06-26T07:36:10.8318194Z Entering 'third_party/cpuinfo' 2024-06-26T07:36:10.8339602Z http.https://github.com/.extraheader 2024-06-26T07:36:10.8364114Z Entering 'third_party/cudnn_frontend' 2024-06-26T07:36:10.8385425Z http.https://github.com/.extraheader 2024-06-26T07:36:10.8410896Z Entering 'third_party/cutlass' 2024-06-26T07:36:10.8433621Z http.https://github.com/.extraheader 2024-06-26T07:36:10.8462595Z Entering 'third_party/eigen' 2024-06-26T07:36:10.8485240Z http.https://github.com/.extraheader 2024-06-26T07:36:10.8510724Z Entering 'third_party/fbgemm' 2024-06-26T07:36:10.8531540Z http.https://github.com/.extraheader 2024-06-26T07:36:10.8552950Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-06-26T07:36:10.8574997Z http.https://github.com/.extraheader 2024-06-26T07:36:10.8598870Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T07:36:10.8620316Z http.https://github.com/.extraheader 2024-06-26T07:36:10.8642758Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-06-26T07:36:10.8663991Z http.https://github.com/.extraheader 2024-06-26T07:36:10.8691904Z Entering 'third_party/fbgemm/third_party/googletest' 2024-06-26T07:36:10.8713357Z http.https://github.com/.extraheader 2024-06-26T07:36:10.8735553Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T07:36:10.8757278Z http.https://github.com/.extraheader 2024-06-26T07:36:10.8781585Z Entering 'third_party/flatbuffers' 2024-06-26T07:36:10.8804058Z http.https://github.com/.extraheader 2024-06-26T07:36:10.8828859Z Entering 'third_party/fmt' 2024-06-26T07:36:10.8850648Z http.https://github.com/.extraheader 2024-06-26T07:36:10.8873026Z Entering 'third_party/foxi' 2024-06-26T07:36:10.8892875Z http.https://github.com/.extraheader 2024-06-26T07:36:10.8918020Z Entering 'third_party/gemmlowp/gemmlowp' 2024-06-26T07:36:10.8939649Z http.https://github.com/.extraheader 2024-06-26T07:36:10.8962492Z Entering 'third_party/gloo' 2024-06-26T07:36:10.8983197Z http.https://github.com/.extraheader 2024-06-26T07:36:10.9006117Z Entering 'third_party/googletest' 2024-06-26T07:36:10.9026314Z http.https://github.com/.extraheader 2024-06-26T07:36:10.9049615Z Entering 'third_party/ideep' 2024-06-26T07:36:10.9070946Z http.https://github.com/.extraheader 2024-06-26T07:36:10.9093424Z Entering 'third_party/ideep/mkl-dnn' 2024-06-26T07:36:10.9114213Z http.https://github.com/.extraheader 2024-06-26T07:36:10.9143755Z Entering 'third_party/ittapi' 2024-06-26T07:36:10.9166499Z http.https://github.com/.extraheader 2024-06-26T07:36:10.9188742Z Entering 'third_party/kineto' 2024-06-26T07:36:10.9209570Z http.https://github.com/.extraheader 2024-06-26T07:36:10.9231869Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T07:36:10.9253821Z http.https://github.com/.extraheader 2024-06-26T07:36:10.9278720Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T07:36:10.9299584Z http.https://github.com/.extraheader 2024-06-26T07:36:10.9324546Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T07:36:10.9344907Z http.https://github.com/.extraheader 2024-06-26T07:36:10.9369740Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T07:36:10.9390384Z http.https://github.com/.extraheader 2024-06-26T07:36:10.9418668Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T07:36:10.9439483Z http.https://github.com/.extraheader 2024-06-26T07:36:10.9463079Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T07:36:10.9485294Z http.https://github.com/.extraheader 2024-06-26T07:36:10.9511936Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T07:36:10.9534505Z http.https://github.com/.extraheader 2024-06-26T07:36:10.9557249Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T07:36:10.9577889Z http.https://github.com/.extraheader 2024-06-26T07:36:10.9601402Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T07:36:10.9622586Z http.https://github.com/.extraheader 2024-06-26T07:36:10.9646098Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T07:36:10.9667040Z http.https://github.com/.extraheader 2024-06-26T07:36:10.9692260Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T07:36:10.9713826Z http.https://github.com/.extraheader 2024-06-26T07:36:10.9735581Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T07:36:10.9757616Z http.https://github.com/.extraheader 2024-06-26T07:36:10.9780441Z Entering 'third_party/mimalloc' 2024-06-26T07:36:10.9802521Z http.https://github.com/.extraheader 2024-06-26T07:36:10.9824620Z Entering 'third_party/nccl/nccl' 2024-06-26T07:36:10.9847707Z http.https://github.com/.extraheader 2024-06-26T07:36:10.9872664Z Entering 'third_party/nlohmann' 2024-06-26T07:36:10.9893972Z http.https://github.com/.extraheader 2024-06-26T07:36:10.9918768Z Entering 'third_party/onnx' 2024-06-26T07:36:10.9940991Z http.https://github.com/.extraheader 2024-06-26T07:36:10.9978210Z Entering 'third_party/onnx/third_party/benchmark' 2024-06-26T07:36:10.9999336Z http.https://github.com/.extraheader 2024-06-26T07:36:11.0023163Z Entering 'third_party/onnx/third_party/pybind11' 2024-06-26T07:36:11.0045866Z http.https://github.com/.extraheader 2024-06-26T07:36:11.0071418Z Entering 'third_party/opentelemetry-cpp' 2024-06-26T07:36:11.0093987Z http.https://github.com/.extraheader 2024-06-26T07:36:11.0119099Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T07:36:11.0138676Z http.https://github.com/.extraheader 2024-06-26T07:36:11.0163635Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T07:36:11.0184314Z http.https://github.com/.extraheader 2024-06-26T07:36:11.0206993Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T07:36:11.0227919Z http.https://github.com/.extraheader 2024-06-26T07:36:11.0251077Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T07:36:11.0272163Z http.https://github.com/.extraheader 2024-06-26T07:36:11.0296302Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T07:36:11.0317599Z http.https://github.com/.extraheader 2024-06-26T07:36:11.0340363Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T07:36:11.0361446Z http.https://github.com/.extraheader 2024-06-26T07:36:11.0385219Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T07:36:11.0407269Z http.https://github.com/.extraheader 2024-06-26T07:36:11.0430347Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T07:36:11.0451224Z http.https://github.com/.extraheader 2024-06-26T07:36:11.0476306Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T07:36:11.0496728Z http.https://github.com/.extraheader 2024-06-26T07:36:11.0522007Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T07:36:11.0543319Z http.https://github.com/.extraheader 2024-06-26T07:36:11.0581051Z Entering 'third_party/pocketfft' 2024-06-26T07:36:11.0602861Z http.https://github.com/.extraheader 2024-06-26T07:36:11.0625223Z Entering 'third_party/protobuf' 2024-06-26T07:36:11.0647493Z http.https://github.com/.extraheader 2024-06-26T07:36:11.0674418Z Entering 'third_party/protobuf/third_party/benchmark' 2024-06-26T07:36:11.0693878Z http.https://github.com/.extraheader 2024-06-26T07:36:11.0715320Z Entering 'third_party/protobuf/third_party/googletest' 2024-06-26T07:36:11.0736798Z http.https://github.com/.extraheader 2024-06-26T07:36:11.0762434Z Entering 'third_party/psimd' 2024-06-26T07:36:11.0784606Z http.https://github.com/.extraheader 2024-06-26T07:36:11.0809644Z Entering 'third_party/pthreadpool' 2024-06-26T07:36:11.0831616Z http.https://github.com/.extraheader 2024-06-26T07:36:11.0853738Z Entering 'third_party/pybind11' 2024-06-26T07:36:11.0875879Z http.https://github.com/.extraheader 2024-06-26T07:36:11.0898962Z Entering 'third_party/python-peachpy' 2024-06-26T07:36:11.0920451Z http.https://github.com/.extraheader 2024-06-26T07:36:11.0942933Z Entering 'third_party/sleef' 2024-06-26T07:36:11.0965268Z http.https://github.com/.extraheader 2024-06-26T07:36:11.0989063Z Entering 'third_party/tensorpipe' 2024-06-26T07:36:11.1010559Z http.https://github.com/.extraheader 2024-06-26T07:36:11.1032478Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-06-26T07:36:11.1053391Z http.https://github.com/.extraheader 2024-06-26T07:36:11.1075963Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-06-26T07:36:11.1097115Z http.https://github.com/.extraheader 2024-06-26T07:36:11.1132662Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-06-26T07:36:11.1140962Z http.https://github.com/.extraheader 2024-06-26T07:36:11.1165054Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T07:36:11.1187415Z http.https://github.com/.extraheader 2024-06-26T07:36:11.1210391Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T07:36:11.1231614Z http.https://github.com/.extraheader 2024-06-26T07:36:11.1333499Z A job completed hook has been configured by the self-hosted runner administrator 2024-06-26T07:36:11.1351113Z ##[group]Run '/home/ec2-user/runner-scripts/cleanup.sh' 2024-06-26T07:36:11.1357777Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:36:11.1358301Z ##[endgroup] 2024-06-26T07:36:12.0788950Z Cleaning up orphan processes