2024-06-26T07:02:06.2434394Z Current runner version: '2.317.0' 2024-06-26T07:02:06.2440666Z Runner name: 'i-0ca3df5e506f33f09' 2024-06-26T07:02:06.2441589Z Runner group name: 'Default' 2024-06-26T07:02:06.2442544Z Machine name: 'ip-10-0-24-29' 2024-06-26T07:02:06.2447640Z ##[group]GITHUB_TOKEN Permissions 2024-06-26T07:02:06.2449667Z Actions: read 2024-06-26T07:02:06.2450290Z Attestations: read 2024-06-26T07:02:06.2450858Z Checks: read 2024-06-26T07:02:06.2451428Z Contents: read 2024-06-26T07:02:06.2451967Z Deployments: read 2024-06-26T07:02:06.2452546Z Discussions: read 2024-06-26T07:02:06.2453406Z Issues: read 2024-06-26T07:02:06.2453991Z Metadata: read 2024-06-26T07:02:06.2454522Z Packages: read 2024-06-26T07:02:06.2455109Z Pages: read 2024-06-26T07:02:06.2455659Z PullRequests: read 2024-06-26T07:02:06.2456241Z RepositoryProjects: read 2024-06-26T07:02:06.2456950Z SecurityEvents: read 2024-06-26T07:02:06.2457588Z Statuses: read 2024-06-26T07:02:06.2458152Z ##[endgroup] 2024-06-26T07:02:06.2461437Z Secret source: Actions 2024-06-26T07:02:06.2462321Z Prepare workflow directory 2024-06-26T07:02:06.6248492Z Prepare all required actions 2024-06-26T07:02:06.6429164Z Getting action download info 2024-06-26T07:02:06.8284746Z Download action repository 'pytorch/test-infra@main' (SHA:43a2ce341cc31288e9a38b65ce600a7f43021bd5) 2024-06-26T07:02:07.1614739Z Download action repository 'pytorch/pytorch@main' (SHA:c422a9549d2b320b47a9391f6cbcf592b2876c88) 2024-06-26T07:02:10.0342798Z Download action repository 'aws-actions/configure-aws-credentials@v3' (SHA:50ac8dd1e1b10d09dac7b8727528b91bed831ac0) 2024-06-26T07:02:10.1942580Z Download action repository 'seemethere/upload-artifact-s3@v5' (SHA:baba72d0712b404f646cebe0730933554ebce96a) 2024-06-26T07:02:10.5411845Z Getting action download info 2024-06-26T07:02:10.6909095Z Download action repository 'malfet/checkout@silent-checkout' (SHA:e07af140b3ccefc05679e3755b9db68f4ee4589c) 2024-06-26T07:02:10.8672521Z Getting action download info 2024-06-26T07:02:10.9795613Z Download action repository 'nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482' (SHA:3e91a01664abd3c5cd539100d10d33b9c5b68482) 2024-06-26T07:02:11.1282903Z Uses: pytorch/pytorch/.github/workflows/_linux-test.yml@refs/tags/ciflow/inductor/129470 (b8c4c54d347aa776934c60784e35936878ef18dc) 2024-06-26T07:02:11.1285255Z ##[group] Inputs 2024-06-26T07:02:11.1285843Z build-environment: linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-06-26T07:02:11.1293015Z test-matrix: {"include": [{"config": "dynamo_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}]} 2024-06-26T07:02:11.1301157Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:02:11.1302362Z sync-tag: 2024-06-26T07:02:11.1303238Z timeout-minutes: 240 2024-06-26T07:02:11.1303576Z use-gha: 2024-06-26T07:02:11.1303867Z dashboard-tag: 2024-06-26T07:02:11.1304191Z s3-bucket: gha-artifacts 2024-06-26T07:02:11.1304543Z aws-role-to-assume: 2024-06-26T07:02:11.1304887Z ##[endgroup] 2024-06-26T07:02:11.1305940Z Complete job name: cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (dynamic_aot_eager_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-06-26T07:02:11.1866373Z A job started hook has been configured by the self-hosted runner administrator 2024-06-26T07:02:11.2007945Z ##[group]Run '/home/ec2-user/runner-scripts/cleanup.sh' 2024-06-26T07:02:11.2018930Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:02:11.2019488Z ##[endgroup] 2024-06-26T07:02:11.8905295Z ##[group]Run pytorch/test-infra/.github/actions/setup-ssh@main 2024-06-26T07:02:11.8905849Z with: 2024-06-26T07:02:11.8906534Z github-secret: *** 2024-06-26T07:02:11.8907480Z instructions: All testing is done inside the container, to start an interactive session run: docker exec -it $(docker container ps --format '{{.ID}}') bash 2024-06-26T07:02:11.8908474Z activate-with-label: false 2024-06-26T07:02:11.8908836Z label: with-ssh 2024-06-26T07:02:11.8909166Z remove-existing-keys: true 2024-06-26T07:02:11.8909524Z fail-silently: true 2024-06-26T07:02:11.8909839Z env: 2024-06-26T07:02:11.8910111Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:02:11.8910455Z ##[endgroup] 2024-06-26T07:02:11.9768949Z Please see https://github.com/pytorch/pytorch/wiki/Debugging-using-with-ssh-for-Github-Actions for more info. 2024-06-26T07:02:11.9769981Z ciflow reference detected, attempting to extract PR number 2024-06-26T07:02:12.3475453Z Grabbing public ssh keys from https://github.com/pytorch-bot[bot].keys 2024-06-26T07:02:12.4130941Z No SSH keys found for user pytorch-bot[bot] 2024-06-26T07:02:12.4131785Z Grabbing public ssh keys from https://github.com/leslie-fang-intel.keys 2024-06-26T07:02:12.5394556Z No SSH keys found for user leslie-fang-intel 2024-06-26T07:02:12.5555851Z ##[group]Run pytorch/pytorch/.github/actions/checkout-pytorch@main 2024-06-26T07:02:12.5556446Z with: 2024-06-26T07:02:12.5556730Z submodules: recursive 2024-06-26T07:02:12.5557059Z fetch-depth: 0 2024-06-26T07:02:12.5557344Z env: 2024-06-26T07:02:12.5557614Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:02:12.5557946Z ##[endgroup] 2024-06-26T07:02:12.5752639Z ##[group]Run retry () { 2024-06-26T07:02:12.5753067Z retry () { 2024-06-26T07:02:12.5753630Z  $* || (sleep 1 && $*) || (sleep 2 && $*) || (sleep 4 && $*) || (sleep 8 && $*) 2024-06-26T07:02:12.5754236Z } 2024-06-26T07:02:12.5754628Z echo "${GITHUB_WORKSPACE}" 2024-06-26T07:02:12.5755107Z if [ -z "${NO_SUDO}" ]; then 2024-06-26T07:02:12.5755617Z  retry sudo rm -rf "${GITHUB_WORKSPACE}" 2024-06-26T07:02:12.5756125Z else 2024-06-26T07:02:12.5756532Z  retry rm -rf "${GITHUB_WORKSPACE}" 2024-06-26T07:02:12.5756984Z fi 2024-06-26T07:02:12.5757461Z mkdir "${GITHUB_WORKSPACE}" 2024-06-26T07:02:12.5765529Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:02:12.5766103Z env: 2024-06-26T07:02:12.5766466Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:02:12.5766861Z NO_SUDO: 2024-06-26T07:02:12.5767206Z ##[endgroup] 2024-06-26T07:02:12.5819434Z /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-06-26T07:02:14.6960857Z ##[group]Run malfet/checkout@silent-checkout 2024-06-26T07:02:14.6961294Z with: 2024-06-26T07:02:14.6961615Z ref: b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:02:14.6962056Z fetch-depth: 0 2024-06-26T07:02:14.6962369Z submodules: recursive 2024-06-26T07:02:14.6962714Z quiet-checkout: true 2024-06-26T07:02:14.6963172Z repository: pytorch/pytorch 2024-06-26T07:02:14.6963650Z token: *** 2024-06-26T07:02:14.6963939Z ssh-strict: true 2024-06-26T07:02:14.6964266Z persist-credentials: true 2024-06-26T07:02:14.6964614Z clean: true 2024-06-26T07:02:14.6964949Z sparse-checkout-cone-mode: true 2024-06-26T07:02:14.6965419Z lfs: false 2024-06-26T07:02:14.6965715Z set-safe-directory: true 2024-06-26T07:02:14.6966053Z env: 2024-06-26T07:02:14.6966323Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:02:14.6966662Z ##[endgroup] 2024-06-26T07:02:14.7879460Z Syncing repository: pytorch/pytorch 2024-06-26T07:02:14.7880993Z ##[group]Getting Git version info 2024-06-26T07:02:14.7881739Z Working directory is '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2024-06-26T07:02:14.7882598Z [command]/usr/bin/git version 2024-06-26T07:02:14.7882971Z git version 2.40.1 2024-06-26T07:02:14.7884281Z ##[endgroup] 2024-06-26T07:02:14.7897142Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/f53a889d-4d4c-494d-8e98-ef7d85104aa3' before making global git config changes 2024-06-26T07:02:14.7898418Z Adding repository directory to the temporary git global config as a safe directory 2024-06-26T07:02:14.7902335Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-06-26T07:02:14.7929379Z Deleting the contents of '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2024-06-26T07:02:14.7933736Z ##[group]Initializing the repository 2024-06-26T07:02:14.7936562Z [command]/usr/bin/git init /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-06-26T07:02:14.7954439Z hint: Using 'master' as the name for the initial branch. This default branch name 2024-06-26T07:02:14.7955390Z hint: is subject to change. To configure the initial branch name to use in all 2024-06-26T07:02:14.7956194Z hint: of your new repositories, which will suppress this warning, call: 2024-06-26T07:02:14.7956770Z hint: 2024-06-26T07:02:14.7957208Z hint: git config --global init.defaultBranch 2024-06-26T07:02:14.7957681Z hint: 2024-06-26T07:02:14.7958196Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-06-26T07:02:14.7959043Z hint: 'development'. The just-created branch can be renamed via this command: 2024-06-26T07:02:14.7959829Z hint: 2024-06-26T07:02:14.7960147Z hint: git branch -m 2024-06-26T07:02:14.7960886Z Initialized empty Git repository in /home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/ 2024-06-26T07:02:14.7962896Z [command]/usr/bin/git remote add origin https://github.com/pytorch/pytorch 2024-06-26T07:02:14.7983576Z ##[endgroup] 2024-06-26T07:02:14.7984165Z ##[group]Disabling automatic garbage collection 2024-06-26T07:02:14.7985746Z [command]/usr/bin/git config --local gc.auto 0 2024-06-26T07:02:14.8004478Z ##[endgroup] 2024-06-26T07:02:14.8004998Z ##[group]Setting up auth 2024-06-26T07:02:14.8010830Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2024-06-26T07:02:14.8030708Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2024-06-26T07:02:14.8210692Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2024-06-26T07:02:14.8231859Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2024-06-26T07:02:14.8414050Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic *** 2024-06-26T07:02:14.8450690Z ##[endgroup] 2024-06-26T07:02:14.8451296Z ##[group]Fetching the repository 2024-06-26T07:02:14.8456606Z [command]/usr/bin/git -c protocol.version=2 fetch --prune --progress --no-recurse-submodules --quiet origin +refs/heads/*:refs/remotes/origin/* +refs/tags/*:refs/tags/* 2024-06-26T07:02:17.0809711Z remote: Enumerating objects: 987612 2024-06-26T07:02:17.0810609Z remote: Enumerating objects: 990209, done. 2024-06-26T07:02:17.0815906Z remote: Counting objects: 0% (1/2597) 2024-06-26T07:02:17.0816435Z remote: Counting objects: 1% (26/2597) 2024-06-26T07:02:17.0816960Z remote: Counting objects: 2% (52/2597) 2024-06-26T07:02:17.0819347Z remote: Counting objects: 3% (78/2597) 2024-06-26T07:02:17.0819911Z remote: Counting objects: 4% (104/2597) 2024-06-26T07:02:17.0820427Z remote: Counting objects: 5% (130/2597) 2024-06-26T07:02:17.0820962Z remote: Counting objects: 6% (156/2597) 2024-06-26T07:02:17.0823061Z remote: Counting objects: 7% (182/2597) 2024-06-26T07:02:17.0823623Z remote: Counting objects: 8% (208/2597) 2024-06-26T07:02:17.0824124Z remote: Counting objects: 9% (234/2597) 2024-06-26T07:02:17.0828437Z remote: Counting objects: 10% (260/2597) 2024-06-26T07:02:17.0828965Z remote: Counting objects: 11% (286/2597) 2024-06-26T07:02:17.0829466Z remote: Counting objects: 12% (312/2597) 2024-06-26T07:02:17.0831015Z remote: Counting objects: 13% (338/2597) 2024-06-26T07:02:17.0831613Z remote: Counting objects: 14% (364/2597) 2024-06-26T07:02:17.0832204Z remote: Counting objects: 15% (390/2597) 2024-06-26T07:02:17.0832748Z remote: Counting objects: 16% (416/2597) 2024-06-26T07:02:17.0833245Z remote: Counting objects: 17% (442/2597) 2024-06-26T07:02:17.0833747Z remote: Counting objects: 18% (468/2597) 2024-06-26T07:02:17.0834250Z remote: Counting objects: 19% (494/2597) 2024-06-26T07:02:17.0834736Z remote: Counting objects: 20% (520/2597) 2024-06-26T07:02:17.0835232Z remote: Counting objects: 21% (546/2597) 2024-06-26T07:02:17.0835728Z remote: Counting objects: 22% (572/2597) 2024-06-26T07:02:17.0836226Z remote: Counting objects: 23% (598/2597) 2024-06-26T07:02:17.0836716Z remote: Counting objects: 24% (624/2597) 2024-06-26T07:02:17.0837220Z remote: Counting objects: 25% (650/2597) 2024-06-26T07:02:17.0837720Z remote: Counting objects: 26% (676/2597) 2024-06-26T07:02:17.0838212Z remote: Counting objects: 27% (702/2597) 2024-06-26T07:02:17.0840157Z remote: Counting objects: 28% (728/2597) 2024-06-26T07:02:17.0840797Z remote: Counting objects: 29% (754/2597) 2024-06-26T07:02:17.0841294Z remote: Counting objects: 30% (780/2597) 2024-06-26T07:02:17.0842152Z remote: Counting objects: 31% (806/2597) 2024-06-26T07:02:17.0846344Z remote: Counting objects: 32% (832/2597) 2024-06-26T07:02:17.0846900Z remote: Counting objects: 33% (858/2597) 2024-06-26T07:02:17.0847394Z remote: Counting objects: 34% (883/2597) 2024-06-26T07:02:17.0847884Z remote: Counting objects: 35% (909/2597) 2024-06-26T07:02:17.0848374Z remote: Counting objects: 36% (935/2597) 2024-06-26T07:02:17.0848861Z remote: Counting objects: 37% (961/2597) 2024-06-26T07:02:17.0849366Z remote: Counting objects: 38% (987/2597) 2024-06-26T07:02:17.0853936Z remote: Counting objects: 39% (1013/2597) 2024-06-26T07:02:17.0854564Z remote: Counting objects: 40% (1039/2597) 2024-06-26T07:02:17.0855086Z remote: Counting objects: 41% (1065/2597) 2024-06-26T07:02:17.0855601Z remote: Counting objects: 42% (1091/2597) 2024-06-26T07:02:17.0856126Z remote: Counting objects: 43% (1117/2597) 2024-06-26T07:02:17.0856639Z remote: Counting objects: 44% (1143/2597) 2024-06-26T07:02:17.0857155Z remote: Counting objects: 45% (1169/2597) 2024-06-26T07:02:17.0857665Z remote: Counting objects: 46% (1195/2597) 2024-06-26T07:02:17.0863836Z remote: Counting objects: 47% (1221/2597) 2024-06-26T07:02:17.0864420Z remote: Counting objects: 48% (1247/2597) 2024-06-26T07:02:17.0864932Z remote: Counting objects: 49% (1273/2597) 2024-06-26T07:02:17.0865433Z remote: Counting objects: 50% (1299/2597) 2024-06-26T07:02:17.0866065Z remote: Counting objects: 51% (1325/2597) 2024-06-26T07:02:17.0866575Z remote: Counting objects: 52% (1351/2597) 2024-06-26T07:02:17.0867086Z remote: Counting objects: 53% (1377/2597) 2024-06-26T07:02:17.0867595Z remote: Counting objects: 54% (1403/2597) 2024-06-26T07:02:17.0868531Z remote: Counting objects: 55% (1429/2597) 2024-06-26T07:02:17.0869098Z remote: Counting objects: 56% (1455/2597) 2024-06-26T07:02:17.0869606Z remote: Counting objects: 57% (1481/2597) 2024-06-26T07:02:17.0870106Z remote: Counting objects: 58% (1507/2597) 2024-06-26T07:02:17.0870644Z remote: Counting objects: 59% (1533/2597) 2024-06-26T07:02:17.0871180Z remote: Counting objects: 60% (1559/2597) 2024-06-26T07:02:17.0871687Z remote: Counting objects: 61% (1585/2597) 2024-06-26T07:02:17.0872189Z remote: Counting objects: 62% (1611/2597) 2024-06-26T07:02:17.0872702Z remote: Counting objects: 63% (1637/2597) 2024-06-26T07:02:17.0873220Z remote: Counting objects: 64% (1663/2597) 2024-06-26T07:02:17.0873723Z remote: Counting objects: 65% (1689/2597) 2024-06-26T07:02:17.0874222Z remote: Counting objects: 66% (1715/2597) 2024-06-26T07:02:17.0874732Z remote: Counting objects: 67% (1740/2597) 2024-06-26T07:02:17.0875352Z remote: Counting objects: 68% (1766/2597) 2024-06-26T07:02:17.0875888Z remote: Counting objects: 69% (1792/2597) 2024-06-26T07:02:17.0876385Z remote: Counting objects: 70% (1818/2597) 2024-06-26T07:02:17.0876897Z remote: Counting objects: 71% (1844/2597) 2024-06-26T07:02:17.0877412Z remote: Counting objects: 72% (1870/2597) 2024-06-26T07:02:17.0877925Z remote: Counting objects: 73% (1896/2597) 2024-06-26T07:02:17.0878429Z remote: Counting objects: 74% (1922/2597) 2024-06-26T07:02:17.0878936Z remote: Counting objects: 75% (1948/2597) 2024-06-26T07:02:17.0879451Z remote: Counting objects: 76% (1974/2597) 2024-06-26T07:02:17.0879957Z remote: Counting objects: 77% (2000/2597) 2024-06-26T07:02:17.0880459Z remote: Counting objects: 78% (2026/2597) 2024-06-26T07:02:17.0881115Z remote: Counting objects: 79% (2052/2597) 2024-06-26T07:02:17.0881659Z remote: Counting objects: 80% (2078/2597) 2024-06-26T07:02:17.0882198Z remote: Counting objects: 81% (2104/2597) 2024-06-26T07:02:17.0882732Z remote: Counting objects: 82% (2130/2597) 2024-06-26T07:02:17.0883275Z remote: Counting objects: 83% (2156/2597) 2024-06-26T07:02:17.0883815Z remote: Counting objects: 84% (2182/2597) 2024-06-26T07:02:17.0884354Z remote: Counting objects: 85% (2208/2597) 2024-06-26T07:02:17.0884884Z remote: Counting objects: 86% (2234/2597) 2024-06-26T07:02:17.0885542Z remote: Counting objects: 87% (2260/2597) 2024-06-26T07:02:17.0886050Z remote: Counting objects: 88% (2286/2597) 2024-06-26T07:02:17.0886560Z remote: Counting objects: 89% (2312/2597) 2024-06-26T07:02:17.0887060Z remote: Counting objects: 90% (2338/2597) 2024-06-26T07:02:17.0887567Z remote: Counting objects: 91% (2364/2597) 2024-06-26T07:02:17.0888077Z remote: Counting objects: 92% (2390/2597) 2024-06-26T07:02:17.0888593Z remote: Counting objects: 93% (2416/2597) 2024-06-26T07:02:17.0889098Z remote: Counting objects: 94% (2442/2597) 2024-06-26T07:02:17.0889616Z remote: Counting objects: 95% (2468/2597) 2024-06-26T07:02:17.0890121Z remote: Counting objects: 96% (2494/2597) 2024-06-26T07:02:17.0890628Z remote: Counting objects: 97% (2520/2597) 2024-06-26T07:02:17.0891140Z remote: Counting objects: 98% (2546/2597) 2024-06-26T07:02:17.0891640Z remote: Counting objects: 99% (2572/2597) 2024-06-26T07:02:17.0892153Z remote: Counting objects: 100% (2597/2597) 2024-06-26T07:02:17.0892698Z remote: Counting objects: 100% (2597/2597), done. 2024-06-26T07:02:17.0988373Z remote: Compressing objects: 0% (1/1074) 2024-06-26T07:02:17.1381352Z remote: Compressing objects: 1% (11/1074) 2024-06-26T07:02:17.1766874Z remote: Compressing objects: 2% (22/1074) 2024-06-26T07:02:17.2118563Z remote: Compressing objects: 3% (33/1074) 2024-06-26T07:02:17.2311703Z remote: Compressing objects: 4% (43/1074) 2024-06-26T07:02:17.2540986Z remote: Compressing objects: 5% (54/1074) 2024-06-26T07:02:17.2722752Z remote: Compressing objects: 6% (65/1074) 2024-06-26T07:02:17.3053257Z remote: Compressing objects: 7% (76/1074) 2024-06-26T07:02:17.3804084Z remote: Compressing objects: 8% (86/1074) 2024-06-26T07:02:17.4484194Z remote: Compressing objects: 9% (97/1074) 2024-06-26T07:02:17.4837844Z remote: Compressing objects: 10% (108/1074) 2024-06-26T07:02:17.4863070Z remote: Compressing objects: 11% (119/1074) 2024-06-26T07:02:17.4954886Z remote: Compressing objects: 12% (129/1074) 2024-06-26T07:02:17.5024354Z remote: Compressing objects: 13% (140/1074) 2024-06-26T07:02:17.5066347Z remote: Compressing objects: 14% (151/1074) 2024-06-26T07:02:17.5066907Z remote: Compressing objects: 15% (162/1074) 2024-06-26T07:02:17.5122576Z remote: Compressing objects: 16% (172/1074) 2024-06-26T07:02:17.5123115Z remote: Compressing objects: 17% (183/1074) 2024-06-26T07:02:17.5123661Z remote: Compressing objects: 18% (194/1074) 2024-06-26T07:02:17.5139856Z remote: Compressing objects: 19% (205/1074) 2024-06-26T07:02:17.5159399Z remote: Compressing objects: 20% (215/1074) 2024-06-26T07:02:17.5172883Z remote: Compressing objects: 21% (226/1074) 2024-06-26T07:02:17.5186092Z remote: Compressing objects: 22% (237/1074) 2024-06-26T07:02:17.5205172Z remote: Compressing objects: 23% (248/1074) 2024-06-26T07:02:17.5214888Z remote: Compressing objects: 24% (258/1074) 2024-06-26T07:02:17.5222543Z remote: Compressing objects: 25% (269/1074) 2024-06-26T07:02:17.5230280Z remote: Compressing objects: 26% (280/1074) 2024-06-26T07:02:17.5235098Z remote: Compressing objects: 27% (290/1074) 2024-06-26T07:02:17.5239944Z remote: Compressing objects: 28% (301/1074) 2024-06-26T07:02:17.5247024Z remote: Compressing objects: 29% (312/1074) 2024-06-26T07:02:17.5254046Z remote: Compressing objects: 30% (323/1074) 2024-06-26T07:02:17.5260206Z remote: Compressing objects: 31% (333/1074) 2024-06-26T07:02:17.5267304Z remote: Compressing objects: 32% (344/1074) 2024-06-26T07:02:17.5274373Z remote: Compressing objects: 33% (355/1074) 2024-06-26T07:02:17.5285630Z remote: Compressing objects: 34% (366/1074) 2024-06-26T07:02:17.5299340Z remote: Compressing objects: 35% (376/1074) 2024-06-26T07:02:17.5317647Z remote: Compressing objects: 36% (387/1074) 2024-06-26T07:02:17.5332784Z remote: Compressing objects: 37% (398/1074) 2024-06-26T07:02:17.5347370Z remote: Compressing objects: 38% (409/1074) 2024-06-26T07:02:17.5359367Z remote: Compressing objects: 39% (419/1074) 2024-06-26T07:02:17.5374001Z remote: Compressing objects: 40% (430/1074) 2024-06-26T07:02:17.5390932Z remote: Compressing objects: 41% (441/1074) 2024-06-26T07:02:17.5403304Z remote: Compressing objects: 42% (452/1074) 2024-06-26T07:02:17.5415901Z remote: Compressing objects: 43% (462/1074) 2024-06-26T07:02:17.5421612Z remote: Compressing objects: 44% (473/1074) 2024-06-26T07:02:17.5424870Z remote: Compressing objects: 45% (484/1074) 2024-06-26T07:02:17.5431616Z remote: Compressing objects: 46% (495/1074) 2024-06-26T07:02:17.5446200Z remote: Compressing objects: 47% (505/1074) 2024-06-26T07:02:17.5455258Z remote: Compressing objects: 48% (516/1074) 2024-06-26T07:02:17.5456136Z remote: Compressing objects: 49% (527/1074) 2024-06-26T07:02:17.5461776Z remote: Compressing objects: 50% (537/1074) 2024-06-26T07:02:17.5470929Z remote: Compressing objects: 51% (548/1074) 2024-06-26T07:02:17.5481080Z remote: Compressing objects: 52% (559/1074) 2024-06-26T07:02:17.5496378Z remote: Compressing objects: 53% (570/1074) 2024-06-26T07:02:17.5514086Z remote: Compressing objects: 54% (580/1074) 2024-06-26T07:02:17.5522890Z remote: Compressing objects: 55% (591/1074) 2024-06-26T07:02:17.5530866Z remote: Compressing objects: 56% (602/1074) 2024-06-26T07:02:17.5548870Z remote: Compressing objects: 57% (613/1074) 2024-06-26T07:02:17.5552529Z remote: Compressing objects: 58% (623/1074) 2024-06-26T07:02:17.5563906Z remote: Compressing objects: 59% (634/1074) 2024-06-26T07:02:17.5572930Z remote: Compressing objects: 60% (645/1074) 2024-06-26T07:02:17.5585598Z remote: Compressing objects: 61% (656/1074) 2024-06-26T07:02:17.5591508Z remote: Compressing objects: 62% (666/1074) 2024-06-26T07:02:17.5599282Z remote: Compressing objects: 63% (677/1074) 2024-06-26T07:02:17.5609682Z remote: Compressing objects: 64% (688/1074) 2024-06-26T07:02:17.5614901Z remote: Compressing objects: 65% (699/1074) 2024-06-26T07:02:17.5617652Z remote: Compressing objects: 66% (709/1074) 2024-06-26T07:02:17.5624143Z remote: Compressing objects: 67% (720/1074) 2024-06-26T07:02:17.5628417Z remote: Compressing objects: 68% (731/1074) 2024-06-26T07:02:17.5631232Z remote: Compressing objects: 69% (742/1074) 2024-06-26T07:02:17.5635141Z remote: Compressing objects: 70% (752/1074) 2024-06-26T07:02:17.5638088Z remote: Compressing objects: 71% (763/1074) 2024-06-26T07:02:17.5641118Z remote: Compressing objects: 72% (774/1074) 2024-06-26T07:02:17.5641657Z remote: Compressing objects: 73% (785/1074) 2024-06-26T07:02:17.5644085Z remote: Compressing objects: 74% (795/1074) 2024-06-26T07:02:17.5644631Z remote: Compressing objects: 75% (806/1074) 2024-06-26T07:02:17.5645163Z remote: Compressing objects: 76% (817/1074) 2024-06-26T07:02:17.5645880Z remote: Compressing objects: 77% (827/1074) 2024-06-26T07:02:17.5646417Z remote: Compressing objects: 78% (838/1074) 2024-06-26T07:02:17.5647312Z remote: Compressing objects: 79% (849/1074) 2024-06-26T07:02:17.5650190Z remote: Compressing objects: 80% (860/1074) 2024-06-26T07:02:17.5650760Z remote: Compressing objects: 81% (870/1074) 2024-06-26T07:02:17.5652995Z remote: Compressing objects: 82% (881/1074) 2024-06-26T07:02:17.5655712Z remote: Compressing objects: 83% (892/1074) 2024-06-26T07:02:17.5656244Z remote: Compressing objects: 84% (903/1074) 2024-06-26T07:02:17.5658256Z remote: Compressing objects: 85% (913/1074) 2024-06-26T07:02:17.5658792Z remote: Compressing objects: 86% (924/1074) 2024-06-26T07:02:17.5661109Z remote: Compressing objects: 87% (935/1074) 2024-06-26T07:02:17.5661635Z remote: Compressing objects: 88% (946/1074) 2024-06-26T07:02:17.5663924Z remote: Compressing objects: 89% (956/1074) 2024-06-26T07:02:17.5664463Z remote: Compressing objects: 90% (967/1074) 2024-06-26T07:02:17.5664994Z remote: Compressing objects: 91% (978/1074) 2024-06-26T07:02:17.5666714Z remote: Compressing objects: 92% (989/1074) 2024-06-26T07:02:17.5667241Z remote: Compressing objects: 93% (999/1074) 2024-06-26T07:02:17.5669654Z remote: Compressing objects: 94% (1010/1074) 2024-06-26T07:02:17.5670211Z remote: Compressing objects: 95% (1021/1074) 2024-06-26T07:02:17.5670758Z remote: Compressing objects: 96% (1032/1074) 2024-06-26T07:02:17.5672103Z remote: Compressing objects: 97% (1042/1074) 2024-06-26T07:02:17.5672652Z remote: Compressing objects: 98% (1053/1074) 2024-06-26T07:02:17.5673192Z remote: Compressing objects: 99% (1064/1074) 2024-06-26T07:02:17.5674836Z remote: Compressing objects: 100% (1074/1074) 2024-06-26T07:02:17.5675414Z remote: Compressing objects: 100% (1074/1074), done. 2024-06-26T07:02:37.6774114Z remote: Total 990209 (delta 2062), reused 1863 (delta 1522), pack-reused 987612 2024-06-26T07:03:03.8011476Z [command]/usr/bin/git rev-parse --verify --quiet b8c4c54d347aa776934c60784e35936878ef18dc^{object} 2024-06-26T07:03:03.8031310Z b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:03:03.8035676Z ##[endgroup] 2024-06-26T07:03:03.8036335Z ##[group]Determining the checkout info 2024-06-26T07:03:03.8039171Z ##[endgroup] 2024-06-26T07:03:03.8039752Z ##[group]Checking out the ref 2024-06-26T07:03:03.8040762Z [command]/usr/bin/git checkout --quiet --force b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:03:05.0105218Z ##[endgroup] 2024-06-26T07:03:05.0105923Z ##[group]Setting up auth for fetching submodules 2024-06-26T07:03:05.0109795Z [command]/usr/bin/git config --global http.https://github.com/.extraheader AUTHORIZATION: basic *** 2024-06-26T07:03:05.0150336Z [command]/usr/bin/git config --global --unset-all url.https://github.com/.insteadOf 2024-06-26T07:03:05.0175218Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf git@github.com: 2024-06-26T07:03:05.0194237Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf org-21003710@github.com: 2024-06-26T07:03:05.0210904Z ##[endgroup] 2024-06-26T07:03:05.0211537Z ##[group]Fetching submodules 2024-06-26T07:03:05.0214888Z [command]/usr/bin/git submodule sync --recursive 2024-06-26T07:03:05.0416396Z [command]/usr/bin/git -c protocol.version=2 submodule update --init --force --recursive 2024-06-26T07:03:05.0618081Z Submodule 'android/libs/fbjni' (https://github.com/facebookincubator/fbjni.git) registered for path 'android/libs/fbjni' 2024-06-26T07:03:05.0619622Z Submodule 'third_party/NNPACK_deps/FP16' (https://github.com/Maratyszcza/FP16.git) registered for path 'third_party/FP16' 2024-06-26T07:03:05.0621149Z Submodule 'third_party/NNPACK_deps/FXdiv' (https://github.com/Maratyszcza/FXdiv.git) registered for path 'third_party/FXdiv' 2024-06-26T07:03:05.0622799Z Submodule 'third_party/NNPACK' (https://github.com/Maratyszcza/NNPACK.git) registered for path 'third_party/NNPACK' 2024-06-26T07:03:05.0624605Z Submodule 'third_party/VulkanMemoryAllocator' (https://github.com/GPUOpen-LibrariesAndSDKs/VulkanMemoryAllocator.git) registered for path 'third_party/VulkanMemoryAllocator' 2024-06-26T07:03:05.0626363Z Submodule 'third_party/XNNPACK' (https://github.com/google/XNNPACK.git) registered for path 'third_party/XNNPACK' 2024-06-26T07:03:05.0627780Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/benchmark' 2024-06-26T07:03:05.0629767Z Submodule 'third_party/cpp-httplib' (https://github.com/yhirose/cpp-httplib.git) registered for path 'third_party/cpp-httplib' 2024-06-26T07:03:05.0632056Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo.git) registered for path 'third_party/cpuinfo' 2024-06-26T07:03:05.0634382Z Submodule 'third_party/cudnn_frontend' (https://github.com/NVIDIA/cudnn-frontend.git) registered for path 'third_party/cudnn_frontend' 2024-06-26T07:03:05.0636649Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/cutlass' 2024-06-26T07:03:05.0639027Z Submodule 'third_party/eigen' (https://gitlab.com/libeigen/eigen.git) registered for path 'third_party/eigen' 2024-06-26T07:03:05.0641477Z Submodule 'third_party/fbgemm' (https://github.com/pytorch/fbgemm) registered for path 'third_party/fbgemm' 2024-06-26T07:03:05.0644104Z Submodule 'third_party/flatbuffers' (https://github.com/google/flatbuffers.git) registered for path 'third_party/flatbuffers' 2024-06-26T07:03:05.0646793Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/fmt' 2024-06-26T07:03:05.0649436Z Submodule 'third_party/foxi' (https://github.com/houseroad/foxi.git) registered for path 'third_party/foxi' 2024-06-26T07:03:05.0652432Z Submodule 'third_party/gemmlowp/gemmlowp' (https://github.com/google/gemmlowp.git) registered for path 'third_party/gemmlowp/gemmlowp' 2024-06-26T07:03:05.0655501Z Submodule 'third_party/gloo' (https://github.com/facebookincubator/gloo) registered for path 'third_party/gloo' 2024-06-26T07:03:05.0658333Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/googletest' 2024-06-26T07:03:05.0661126Z Submodule 'third_party/ideep' (https://github.com/intel/ideep) registered for path 'third_party/ideep' 2024-06-26T07:03:05.0664143Z Submodule 'third_party/ittapi' (https://github.com/intel/ittapi.git) registered for path 'third_party/ittapi' 2024-06-26T07:03:05.0667272Z Submodule 'third_party/kineto' (https://github.com/pytorch/kineto) registered for path 'third_party/kineto' 2024-06-26T07:03:05.0670576Z Submodule 'third_party/mimalloc' (https://github.com/microsoft/mimalloc.git) registered for path 'third_party/mimalloc' 2024-06-26T07:03:05.0673719Z Submodule 'third_party/nccl/nccl' (https://github.com/NVIDIA/nccl) registered for path 'third_party/nccl/nccl' 2024-06-26T07:03:05.0677047Z Submodule 'third_party/nlohmann' (https://github.com/nlohmann/json.git) registered for path 'third_party/nlohmann' 2024-06-26T07:03:05.0680296Z Submodule 'third_party/onnx' (https://github.com/onnx/onnx.git) registered for path 'third_party/onnx' 2024-06-26T07:03:05.0684037Z Submodule 'third_party/opentelemetry-cpp' (https://github.com/open-telemetry/opentelemetry-cpp.git) registered for path 'third_party/opentelemetry-cpp' 2024-06-26T07:03:05.0687458Z Submodule 'third_party/pocketfft' (https://github.com/mreineck/pocketfft) registered for path 'third_party/pocketfft' 2024-06-26T07:03:05.0691015Z Submodule 'third_party/protobuf' (https://github.com/protocolbuffers/protobuf.git) registered for path 'third_party/protobuf' 2024-06-26T07:03:05.0695004Z Submodule 'third_party/NNPACK_deps/psimd' (https://github.com/Maratyszcza/psimd.git) registered for path 'third_party/psimd' 2024-06-26T07:03:05.0698715Z Submodule 'third_party/NNPACK_deps/pthreadpool' (https://github.com/Maratyszcza/pthreadpool.git) registered for path 'third_party/pthreadpool' 2024-06-26T07:03:05.0702383Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/pybind11' 2024-06-26T07:03:05.0706113Z Submodule 'third_party/python-peachpy' (https://github.com/malfet/PeachPy.git) registered for path 'third_party/python-peachpy' 2024-06-26T07:03:05.0709809Z Submodule 'third_party/sleef' (https://github.com/shibatch/sleef) registered for path 'third_party/sleef' 2024-06-26T07:03:05.0713809Z Submodule 'third_party/tensorpipe' (https://github.com/pytorch/tensorpipe.git) registered for path 'third_party/tensorpipe' 2024-06-26T07:03:05.0733930Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/android/libs/fbjni'... 2024-06-26T07:03:05.3743044Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FP16'... 2024-06-26T07:03:05.5446919Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FXdiv'... 2024-06-26T07:03:05.7285078Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/NNPACK'... 2024-06-26T07:03:05.9723615Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/VulkanMemoryAllocator'... 2024-06-26T07:03:07.8918193Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/XNNPACK'... 2024-06-26T07:03:17.7987349Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/benchmark'... 2024-06-26T07:03:18.1488387Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpp-httplib'... 2024-06-26T07:03:18.7273298Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpuinfo'... 2024-06-26T07:03:19.3236477Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cudnn_frontend'... 2024-06-26T07:03:20.4496702Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cutlass'... 2024-06-26T07:03:22.1513652Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/eigen'... 2024-06-26T07:03:28.0014825Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm'... 2024-06-26T07:03:29.2638267Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/flatbuffers'... 2024-06-26T07:03:30.9571792Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fmt'... 2024-06-26T07:03:32.1398504Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/foxi'... 2024-06-26T07:03:32.3002712Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gemmlowp/gemmlowp'... 2024-06-26T07:03:32.6773800Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gloo'... 2024-06-26T07:03:33.0272347Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/googletest'... 2024-06-26T07:03:34.0181912Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep'... 2024-06-26T07:03:34.3304589Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ittapi'... 2024-06-26T07:03:34.5831440Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto'... 2024-06-26T07:03:36.1381459Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/mimalloc'... 2024-06-26T07:03:36.8395649Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nccl/nccl'... 2024-06-26T07:03:37.4998963Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nlohmann'... 2024-06-26T07:03:43.0808652Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx'... 2024-06-26T07:03:45.5382618Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp'... 2024-06-26T07:03:51.1612085Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pocketfft'... 2024-06-26T07:03:51.3554789Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf'... 2024-06-26T07:03:59.5115966Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/psimd'... 2024-06-26T07:03:59.6744241Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pthreadpool'... 2024-06-26T07:03:59.8517589Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pybind11'... 2024-06-26T07:04:00.8738249Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/python-peachpy'... 2024-06-26T07:04:01.1457521Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/sleef'... 2024-06-26T07:04:01.7427632Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe'... 2024-06-26T07:04:02.1580103Z Submodule path 'android/libs/fbjni': checked out '7e1e1fe3858c63c251c637ae41a20de425dde96f' 2024-06-26T07:04:02.1664107Z Submodule path 'third_party/FP16': checked out '4dfe081cf6bcd15db339cf2680b9281b8451eeb3' 2024-06-26T07:04:02.1723195Z Submodule path 'third_party/FXdiv': checked out 'b408327ac2a15ec3e43352421954f5b1967701d1' 2024-06-26T07:04:02.1901887Z Submodule path 'third_party/NNPACK': checked out 'c07e3a0400713d546e0dea2d5466dd22ea389c73' 2024-06-26T07:04:02.2206420Z Submodule path 'third_party/VulkanMemoryAllocator': checked out 'a6bfc237255a6bac1513f7c1ebde6d8aed6b5191' 2024-06-26T07:04:03.0095792Z Submodule path 'third_party/XNNPACK': checked out 'fcbf55af6cf28a4627bcd1f703ab7ad843f0f3a2' 2024-06-26T07:04:03.0265201Z Submodule path 'third_party/benchmark': checked out '0d98dba29d66e93259db7daa53a9327df767a415' 2024-06-26T07:04:03.0604849Z Submodule path 'third_party/cpp-httplib': checked out '3b6597bba913d51161383657829b7e644e59c006' 2024-06-26T07:04:03.1447098Z Submodule path 'third_party/cpuinfo': checked out '3c8b1533ac03dd6531ab6e7b9245d488f13a82a5' 2024-06-26T07:04:03.1716220Z Submodule path 'third_party/cudnn_frontend': checked out 'aa3abd4bc689d6412979c7f55f9cd132848c9c6a' 2024-06-26T07:04:03.5983627Z Submodule path 'third_party/cutlass': checked out 'bbe579a9e3beb6ea6626d9227ec32d0dae119a49' 2024-06-26T07:04:03.8097110Z Submodule path 'third_party/eigen': checked out '3147391d946bb4b6c68edd901f2add6ac1f31f8c' 2024-06-26T07:04:03.8724405Z Submodule path 'third_party/fbgemm': checked out 'dbc3157bf256f1339b3fa1fef2be89ac4078be0e' 2024-06-26T07:04:03.8736264Z Submodule 'third_party/asmjit' (https://github.com/asmjit/asmjit.git) registered for path 'third_party/fbgemm/third_party/asmjit' 2024-06-26T07:04:03.8739538Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo) registered for path 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T07:04:03.8741037Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/fbgemm/third_party/cutlass' 2024-06-26T07:04:03.8742623Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/fbgemm/third_party/googletest' 2024-06-26T07:04:03.8744307Z Submodule 'third_party/hipify_torch' (https://github.com/ROCmSoftwarePlatform/hipify_torch.git) registered for path 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T07:04:03.8759236Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/asmjit'... 2024-06-26T07:04:04.9079278Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cpuinfo'... 2024-06-26T07:04:05.5150610Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cutlass'... 2024-06-26T07:04:07.1939012Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/googletest'... 2024-06-26T07:04:08.1919981Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/hipify_torch'... 2024-06-26T07:04:08.4990213Z Submodule path 'third_party/fbgemm/third_party/asmjit': checked out 'd3fbf7c9bc7c1d1365a94a45614b91c5a3706b81' 2024-06-26T07:04:08.5827877Z Submodule path 'third_party/fbgemm/third_party/cpuinfo': checked out 'ed8b86a253800bafdb7b25c5c399f91bff9cb1f3' 2024-06-26T07:04:08.9210532Z Submodule path 'third_party/fbgemm/third_party/cutlass': checked out 'fc9ebc645b63f3a6bc80aaefde5c063fb72110d6' 2024-06-26T07:04:08.9751381Z Submodule path 'third_party/fbgemm/third_party/googletest': checked out 'cbf019de22c8dd37b2108da35b2748fd702d1796' 2024-06-26T07:04:08.9837818Z Submodule path 'third_party/fbgemm/third_party/hipify_torch': checked out '23f53b025b466d8ec3c45d52290d3442f7fbe6b1' 2024-06-26T07:04:09.0742166Z Submodule path 'third_party/flatbuffers': checked out '01834de25e4bf3975a9a00e816292b1ad0fe184b' 2024-06-26T07:04:09.1025657Z Submodule path 'third_party/fmt': checked out 'e69e5f977d458f2650bb346dadf2ad30c5320281' 2024-06-26T07:04:09.1087932Z Submodule path 'third_party/foxi': checked out 'c278588e34e535f0bb8f00df3880d26928038cad' 2024-06-26T07:04:09.1393129Z Submodule path 'third_party/gemmlowp/gemmlowp': checked out '3fb5c176c17c765a3492cd2f0321b0dab712f350' 2024-06-26T07:04:09.1590191Z Submodule path 'third_party/gloo': checked out '5354032ea08eadd7fc4456477f7f7c6308818509' 2024-06-26T07:04:09.1955831Z Submodule path 'third_party/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2024-06-26T07:04:09.2049199Z Submodule path 'third_party/ideep': checked out '55ca0191687aaf19aca5cdb7881c791e3bea442b' 2024-06-26T07:04:09.2061478Z Submodule 'mkl-dnn' (https://github.com/intel/mkl-dnn.git) registered for path 'third_party/ideep/mkl-dnn' 2024-06-26T07:04:09.2077774Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep/mkl-dnn'... 2024-06-26T07:04:20.9332478Z Submodule path 'third_party/ideep/mkl-dnn': checked out '1137e04ec0b5251ca2b4400a4fd3c667ce843d67' 2024-06-26T07:04:20.9464141Z Submodule path 'third_party/ittapi': checked out '5b8a7d7422611c3a0d799fb5fc5dd4abfae35b42' 2024-06-26T07:04:21.0232249Z Submodule path 'third_party/kineto': checked out '8681ff11e1fa54da39023076c5c43eddd87b7a8a' 2024-06-26T07:04:21.0245569Z Submodule 'libkineto/third_party/dynolog' (https://github.com/facebookincubator/dynolog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T07:04:21.0247706Z Submodule 'libkineto/third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T07:04:21.0249702Z Submodule 'libkineto/third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T07:04:21.0266700Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog'... 2024-06-26T07:04:21.5449390Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/fmt'... 2024-06-26T07:04:22.7432979Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/googletest'... 2024-06-26T07:04:23.7630625Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog': checked out '7d04a0053a845370ae06ce317a22a48e9edcc74e' 2024-06-26T07:04:23.7640471Z Submodule 'third_party/DCGM' (https://github.com/NVIDIA/DCGM.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T07:04:23.7642434Z Submodule 'third_party/cpr' (https://github.com/libcpr/cpr.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T07:04:23.7644416Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T07:04:23.7647192Z Submodule 'third_party/gflags' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T07:04:23.7649348Z Submodule 'third_party/glog' (https://github.com/google/glog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T07:04:23.7652354Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T07:04:23.7654947Z Submodule 'third_party/json' (https://github.com/nlohmann/json.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T07:04:23.7657128Z Submodule 'third_party/pfs' (https://github.com/dtrugman/pfs.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T07:04:23.7676033Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'... 2024-06-26T07:04:24.8891199Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'... 2024-06-26T07:04:25.2890947Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'... 2024-06-26T07:04:26.4687731Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'... 2024-06-26T07:04:26.7237867Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/glog'... 2024-06-26T07:04:27.2094846Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'... 2024-06-26T07:04:28.1996964Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/json'... 2024-06-26T07:04:33.7468559Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'... 2024-06-26T07:04:34.1476848Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM': checked out 'ffde4e54bc7249a6039a5e6b45b395141e1217f9' 2024-06-26T07:04:34.1612473Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr': checked out '871ed52d350214a034f6ef8a3b8f51c5ce1bd400' 2024-06-26T07:04:34.1905023Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt': checked out 'cd4af11efc9c622896a3e4cb599fa28668ca3d05' 2024-06-26T07:04:34.2001148Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags': checked out 'e171aa2d15ed9eb17054558e0b3a6a413bb01067' 2024-06-26T07:04:34.2010812Z Submodule 'doc' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T07:04:34.2028324Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'... 2024-06-26T07:04:34.4877044Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc': checked out '8411df715cf522606e3b1aca386ddfc0b63d34b4' 2024-06-26T07:04:34.5013661Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog': checked out 'b33e3bad4c46c8a6345525fd822af355e5ef9446' 2024-06-26T07:04:34.5348772Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest': checked out '58d77fa8070e8cec2dc1ed015d66b454c8d78850' 2024-06-26T07:04:34.6143936Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json': checked out '4f8fba14066156b73f1189a2b8bd568bde5284c5' 2024-06-26T07:04:34.6262332Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs': checked out 'f68a2fa8ea36c783bdd760371411fcb495aa3150' 2024-06-26T07:04:34.6557210Z Submodule path 'third_party/kineto/libkineto/third_party/fmt': checked out 'a33701196adfad74917046096bf5a2aa0ab0bb50' 2024-06-26T07:04:34.7052113Z Submodule path 'third_party/kineto/libkineto/third_party/googletest': checked out '7aca84427f224eeed3144123d5230d5871e93347' 2024-06-26T07:04:34.7356562Z Submodule path 'third_party/mimalloc': checked out 'b66e3214d8a104669c2ec05ae91ebc26a8f5ab78' 2024-06-26T07:04:34.7548544Z Submodule path 'third_party/nccl/nccl': checked out '48bb7fec7953112ff37499a272317f6663f8f600' 2024-06-26T07:04:34.8398775Z Submodule path 'third_party/nlohmann': checked out '87cda1d6646592ac5866dc703c8e1839046a6806' 2024-06-26T07:04:35.1101942Z Submodule path 'third_party/onnx': checked out '990217f043af7222348ca8f0301e17fa7b841781' 2024-06-26T07:04:35.1125294Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/onnx/third_party/benchmark' 2024-06-26T07:04:35.1153835Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/onnx/third_party/pybind11' 2024-06-26T07:04:35.1155659Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx/third_party/benchmark'... 2024-06-26T07:04:35.5614111Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx/third_party/pybind11'... 2024-06-26T07:04:36.7068057Z Submodule path 'third_party/onnx/third_party/benchmark': checked out '2dd015dfef425c866d9a43f2c67d8b52d709acb6' 2024-06-26T07:04:36.7346105Z Submodule path 'third_party/onnx/third_party/pybind11': checked out '5b0a6fc2017fcc176545afe3e09c9f9885283242' 2024-06-26T07:04:36.7867689Z Submodule path 'third_party/opentelemetry-cpp': checked out 'a799f4aed9c94b765dcdaabaeab7d5e7e2310878' 2024-06-26T07:04:36.7880080Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark) registered for path 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T07:04:36.7882066Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T07:04:36.7883893Z Submodule 'third_party/ms-gsl' (https://github.com/microsoft/GSL) registered for path 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T07:04:36.7886058Z Submodule 'third_party/nlohmann-json' (https://github.com/nlohmann/json) registered for path 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T07:04:36.7888562Z Submodule 'third_party/opentelemetry-proto' (https://github.com/open-telemetry/opentelemetry-proto) registered for path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T07:04:36.7890929Z Submodule 'third_party/opentracing-cpp' (https://github.com/opentracing/opentracing-cpp.git) registered for path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T07:04:36.7893309Z Submodule 'third_party/prometheus-cpp' (https://github.com/jupp0r/prometheus-cpp) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T07:04:36.7895153Z Submodule 'tools/vcpkg' (https://github.com/Microsoft/vcpkg) registered for path 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T07:04:36.7909512Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/benchmark'... 2024-06-26T07:04:37.3090076Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/googletest'... 2024-06-26T07:04:38.2705077Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/ms-gsl'... 2024-06-26T07:04:38.5666581Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/nlohmann-json'... 2024-06-26T07:04:44.7571292Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentelemetry-proto'... 2024-06-26T07:04:45.0252817Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentracing-cpp'... 2024-06-26T07:04:45.2206722Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp'... 2024-06-26T07:04:45.5059625Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/tools/vcpkg'... 2024-06-26T07:04:52.8436236Z Submodule path 'third_party/opentelemetry-cpp/third_party/benchmark': checked out 'd572f4777349d43653b21d6c2fc63020ab326db2' 2024-06-26T07:04:52.8762033Z Submodule path 'third_party/opentelemetry-cpp/third_party/googletest': checked out 'b796f7d44681514f58a683a3a71ff17c94edb0c1' 2024-06-26T07:04:52.8886910Z Submodule path 'third_party/opentelemetry-cpp/third_party/ms-gsl': checked out '6f4529395c5b7c2d661812257cd6780c67e54afa' 2024-06-26T07:04:52.9719975Z Submodule path 'third_party/opentelemetry-cpp/third_party/nlohmann-json': checked out 'bc889afb4c5bf1c0d8ee29ef35eaaf4c8bef8a5d' 2024-06-26T07:04:52.9813499Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto': checked out '4ca4f0335c63cda7ab31ea7ed70d6553aee14dce' 2024-06-26T07:04:52.9919208Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp': checked out '06b57f48ded1fa3bdd3d4346f6ef29e40e08eaf5' 2024-06-26T07:04:53.0032885Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp': checked out 'c9ffcdda9086ffd9e1283ea7a0276d831f3c8a8d' 2024-06-26T07:04:53.0043208Z Submodule 'civetweb' (https://github.com/civetweb/civetweb.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T07:04:53.0045077Z Submodule 'googletest' (https://github.com/google/googletest.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T07:04:53.0061001Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'... 2024-06-26T07:04:54.7135359Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'... 2024-06-26T07:04:55.9452118Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb': checked out 'eefb26f82b233268fc98577d265352720d477ba4' 2024-06-26T07:04:55.9820433Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2024-06-26T07:04:56.3367922Z Submodule path 'third_party/opentelemetry-cpp/tools/vcpkg': checked out '8eb57355a4ffb410a2e94c07b4dca2dffbee8e50' 2024-06-26T07:04:56.3448869Z Submodule path 'third_party/pocketfft': checked out '9d3ab05a7fffbc71a492bc6a17be034e83e8f0fe' 2024-06-26T07:04:56.5591969Z Submodule path 'third_party/protobuf': checked out 'd1eca4e4b421cd2997495c4b4e65cea6be4e9b8a' 2024-06-26T07:04:56.5605338Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/protobuf/third_party/benchmark' 2024-06-26T07:04:56.5607109Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/protobuf/third_party/googletest' 2024-06-26T07:04:56.5622355Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/benchmark'... 2024-06-26T07:04:56.9687848Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/googletest'... 2024-06-26T07:04:57.9313792Z Submodule path 'third_party/protobuf/third_party/benchmark': checked out '5b7683f49e1e9223cf9927b24f6fd3d6bd82e3f8' 2024-06-26T07:04:57.9936501Z Submodule path 'third_party/protobuf/third_party/googletest': checked out '5ec7f0c4a113e2f18ac2c6cc7df51ad6afc24081' 2024-06-26T07:04:57.9996420Z Submodule path 'third_party/psimd': checked out '072586a71b55b7f8c584153d223e95687148a900' 2024-06-26T07:04:58.0083597Z Submodule path 'third_party/pthreadpool': checked out '4fe0e1e183925bf8cfa6aae24237e724a96479b8' 2024-06-26T07:04:58.0361160Z Submodule path 'third_party/pybind11': checked out '3e9dfa2866941655c56877882565e7577de6fc7b' 2024-06-26T07:04:58.0580318Z Submodule path 'third_party/python-peachpy': checked out 'f45429b087dd7d5bc78bb40dc7cf06425c252d67' 2024-06-26T07:04:58.0908976Z Submodule path 'third_party/sleef': checked out '60e76d2bce17d278b439d9da17177c8f957a9e9b' 2024-06-26T07:04:58.1110707Z Submodule path 'third_party/tensorpipe': checked out '52791a2fd214b2a9dc5759d36725909c1daa7f2e' 2024-06-26T07:04:58.1122073Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/tensorpipe/third_party/googletest' 2024-06-26T07:04:58.1124069Z Submodule 'third_party/libnop' (https://github.com/google/libnop.git) registered for path 'third_party/tensorpipe/third_party/libnop' 2024-06-26T07:04:58.1125798Z Submodule 'third_party/libuv' (https://github.com/libuv/libuv.git) registered for path 'third_party/tensorpipe/third_party/libuv' 2024-06-26T07:04:58.1127770Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T07:04:58.1144785Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/googletest'... 2024-06-26T07:04:59.1135598Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libnop'... 2024-06-26T07:04:59.3667599Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libuv'... 2024-06-26T07:05:00.4087939Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11'... 2024-06-26T07:05:01.4187020Z Submodule path 'third_party/tensorpipe/third_party/googletest': checked out 'aee0f9d9b5b87796ee8a0ab26b7587ec30e8858e' 2024-06-26T07:05:01.4296995Z Submodule path 'third_party/tensorpipe/third_party/libnop': checked out '910b55815be16109f04f4180e9adee14fb4ce281' 2024-06-26T07:05:01.4862961Z Submodule path 'third_party/tensorpipe/third_party/libuv': checked out '1dff88e5161cba5c59276d2070d2e304e4dcb242' 2024-06-26T07:05:01.5091120Z Submodule path 'third_party/tensorpipe/third_party/pybind11': checked out 'a23996fce38ff6ccfbcdc09f1e63f2c4be5ea2ef' 2024-06-26T07:05:01.5101348Z Submodule 'tools/clang' (https://github.com/wjakob/clang-cindex-python3) registered for path 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T07:05:01.5118046Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11/tools/clang'... 2024-06-26T07:05:01.7070070Z Submodule path 'third_party/tensorpipe/third_party/pybind11/tools/clang': checked out '6a00cbc4a9b8e68b71caf7f774b3f9c753ae84d5' 2024-06-26T07:05:01.7092345Z [command]/usr/bin/git submodule foreach --recursive git config --local gc.auto 0 2024-06-26T07:05:01.7294256Z Entering 'android/libs/fbjni' 2024-06-26T07:05:01.7319491Z Entering 'third_party/FP16' 2024-06-26T07:05:01.7344817Z Entering 'third_party/FXdiv' 2024-06-26T07:05:01.7369553Z Entering 'third_party/NNPACK' 2024-06-26T07:05:01.7395888Z Entering 'third_party/VulkanMemoryAllocator' 2024-06-26T07:05:01.7422452Z Entering 'third_party/XNNPACK' 2024-06-26T07:05:01.7459198Z Entering 'third_party/benchmark' 2024-06-26T07:05:01.7485232Z Entering 'third_party/cpp-httplib' 2024-06-26T07:05:01.7512662Z Entering 'third_party/cpuinfo' 2024-06-26T07:05:01.7541083Z Entering 'third_party/cudnn_frontend' 2024-06-26T07:05:01.7566721Z Entering 'third_party/cutlass' 2024-06-26T07:05:01.7597999Z Entering 'third_party/eigen' 2024-06-26T07:05:01.7626374Z Entering 'third_party/fbgemm' 2024-06-26T07:05:01.7654262Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-06-26T07:05:01.7679069Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T07:05:01.7706734Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-06-26T07:05:01.7738656Z Entering 'third_party/fbgemm/third_party/googletest' 2024-06-26T07:05:01.7764175Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T07:05:01.7791041Z Entering 'third_party/flatbuffers' 2024-06-26T07:05:01.7823437Z Entering 'third_party/fmt' 2024-06-26T07:05:01.7852232Z Entering 'third_party/foxi' 2024-06-26T07:05:01.7877398Z Entering 'third_party/gemmlowp/gemmlowp' 2024-06-26T07:05:01.7904487Z Entering 'third_party/gloo' 2024-06-26T07:05:01.7932597Z Entering 'third_party/googletest' 2024-06-26T07:05:01.7961819Z Entering 'third_party/ideep' 2024-06-26T07:05:01.7987519Z Entering 'third_party/ideep/mkl-dnn' 2024-06-26T07:05:01.8020499Z Entering 'third_party/ittapi' 2024-06-26T07:05:01.8048989Z Entering 'third_party/kineto' 2024-06-26T07:05:01.8076696Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T07:05:01.8102081Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T07:05:01.8129689Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T07:05:01.8157901Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T07:05:01.8184234Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T07:05:01.8210181Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T07:05:01.8239773Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T07:05:01.8267074Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T07:05:01.8294319Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T07:05:01.8320880Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T07:05:01.8349405Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T07:05:01.8375120Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T07:05:01.8403042Z Entering 'third_party/mimalloc' 2024-06-26T07:05:01.8429968Z Entering 'third_party/nccl/nccl' 2024-06-26T07:05:01.8457116Z Entering 'third_party/nlohmann' 2024-06-26T07:05:01.8484964Z Entering 'third_party/onnx' 2024-06-26T07:05:01.8523136Z Entering 'third_party/onnx/third_party/benchmark' 2024-06-26T07:05:01.8552264Z Entering 'third_party/onnx/third_party/pybind11' 2024-06-26T07:05:01.8580456Z Entering 'third_party/opentelemetry-cpp' 2024-06-26T07:05:01.8609568Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T07:05:01.8637263Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T07:05:01.8663122Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T07:05:01.8690125Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T07:05:01.8717586Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T07:05:01.8743739Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T07:05:01.8769502Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T07:05:01.8794272Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T07:05:01.8820828Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T07:05:01.8850103Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T07:05:01.8892590Z Entering 'third_party/pocketfft' 2024-06-26T07:05:01.8921964Z Entering 'third_party/protobuf' 2024-06-26T07:05:01.8949855Z Entering 'third_party/protobuf/third_party/benchmark' 2024-06-26T07:05:01.8975885Z Entering 'third_party/protobuf/third_party/googletest' 2024-06-26T07:05:01.9002464Z Entering 'third_party/psimd' 2024-06-26T07:05:01.9030320Z Entering 'third_party/pthreadpool' 2024-06-26T07:05:01.9056837Z Entering 'third_party/pybind11' 2024-06-26T07:05:01.9084728Z Entering 'third_party/python-peachpy' 2024-06-26T07:05:01.9113769Z Entering 'third_party/sleef' 2024-06-26T07:05:01.9140565Z Entering 'third_party/tensorpipe' 2024-06-26T07:05:01.9167711Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-06-26T07:05:01.9193301Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-06-26T07:05:01.9218992Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-06-26T07:05:01.9245425Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T07:05:01.9270340Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T07:05:01.9308657Z ##[endgroup] 2024-06-26T07:05:01.9310059Z ##[group]Persisting credentials for submodules 2024-06-26T07:05:01.9313937Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'url\.https\:\/\/github\.com\/\.insteadOf' && git config --local --unset-all 'url.https://github.com/.insteadOf' || :" 2024-06-26T07:05:01.9520264Z Entering 'android/libs/fbjni' 2024-06-26T07:05:01.9557189Z Entering 'third_party/FP16' 2024-06-26T07:05:01.9592020Z Entering 'third_party/FXdiv' 2024-06-26T07:05:01.9627320Z Entering 'third_party/NNPACK' 2024-06-26T07:05:01.9662573Z Entering 'third_party/VulkanMemoryAllocator' 2024-06-26T07:05:01.9696998Z Entering 'third_party/XNNPACK' 2024-06-26T07:05:01.9741831Z Entering 'third_party/benchmark' 2024-06-26T07:05:01.9777670Z Entering 'third_party/cpp-httplib' 2024-06-26T07:05:01.9811616Z Entering 'third_party/cpuinfo' 2024-06-26T07:05:01.9847051Z Entering 'third_party/cudnn_frontend' 2024-06-26T07:05:01.9881683Z Entering 'third_party/cutlass' 2024-06-26T07:05:01.9924893Z Entering 'third_party/eigen' 2024-06-26T07:05:01.9961495Z Entering 'third_party/fbgemm' 2024-06-26T07:05:01.9997417Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-06-26T07:05:02.0031516Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T07:05:02.0064507Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-06-26T07:05:02.0101929Z Entering 'third_party/fbgemm/third_party/googletest' 2024-06-26T07:05:02.0137535Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T07:05:02.0170757Z Entering 'third_party/flatbuffers' 2024-06-26T07:05:02.0208759Z Entering 'third_party/fmt' 2024-06-26T07:05:02.0240509Z Entering 'third_party/foxi' 2024-06-26T07:05:02.0275612Z Entering 'third_party/gemmlowp/gemmlowp' 2024-06-26T07:05:02.0308495Z Entering 'third_party/gloo' 2024-06-26T07:05:02.0344451Z Entering 'third_party/googletest' 2024-06-26T07:05:02.0377312Z Entering 'third_party/ideep' 2024-06-26T07:05:02.0412078Z Entering 'third_party/ideep/mkl-dnn' 2024-06-26T07:05:02.0452235Z Entering 'third_party/ittapi' 2024-06-26T07:05:02.0487708Z Entering 'third_party/kineto' 2024-06-26T07:05:02.0522879Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T07:05:02.0558060Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T07:05:02.0592028Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T07:05:02.0626394Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T07:05:02.0660146Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T07:05:02.0693962Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T07:05:02.0729411Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T07:05:02.0763881Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T07:05:02.0799335Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T07:05:02.0834005Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T07:05:02.0868465Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T07:05:02.0901969Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T07:05:02.0936474Z Entering 'third_party/mimalloc' 2024-06-26T07:05:02.0971246Z Entering 'third_party/nccl/nccl' 2024-06-26T07:05:02.1006229Z Entering 'third_party/nlohmann' 2024-06-26T07:05:02.1042147Z Entering 'third_party/onnx' 2024-06-26T07:05:02.1089433Z Entering 'third_party/onnx/third_party/benchmark' 2024-06-26T07:05:02.1124987Z Entering 'third_party/onnx/third_party/pybind11' 2024-06-26T07:05:02.1161984Z Entering 'third_party/opentelemetry-cpp' 2024-06-26T07:05:02.1196209Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T07:05:02.1228626Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T07:05:02.1261195Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T07:05:02.1291593Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T07:05:02.1327751Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T07:05:02.1360662Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T07:05:02.1393539Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T07:05:02.1425314Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T07:05:02.1459849Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T07:05:02.1495116Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T07:05:02.1543751Z Entering 'third_party/pocketfft' 2024-06-26T07:05:02.1576319Z Entering 'third_party/protobuf' 2024-06-26T07:05:02.1612506Z Entering 'third_party/protobuf/third_party/benchmark' 2024-06-26T07:05:02.1644868Z Entering 'third_party/protobuf/third_party/googletest' 2024-06-26T07:05:02.1680996Z Entering 'third_party/psimd' 2024-06-26T07:05:02.1716113Z Entering 'third_party/pthreadpool' 2024-06-26T07:05:02.1747724Z Entering 'third_party/pybind11' 2024-06-26T07:05:02.1780307Z Entering 'third_party/python-peachpy' 2024-06-26T07:05:02.1814624Z Entering 'third_party/sleef' 2024-06-26T07:05:02.1849017Z Entering 'third_party/tensorpipe' 2024-06-26T07:05:02.1886363Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-06-26T07:05:02.1920598Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-06-26T07:05:02.1954021Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-06-26T07:05:02.1987754Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T07:05:02.2019965Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T07:05:02.2068048Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local 'http.https://github.com/.extraheader' 'AUTHORIZATION: basic ***' && git config --local --show-origin --name-only --get-regexp remote.origin.url" 2024-06-26T07:05:02.2271072Z Entering 'android/libs/fbjni' 2024-06-26T07:05:02.2302376Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/android/libs/fbjni/config remote.origin.url 2024-06-26T07:05:02.2316117Z Entering 'third_party/FP16' 2024-06-26T07:05:02.2347286Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FP16/config remote.origin.url 2024-06-26T07:05:02.2360295Z Entering 'third_party/FXdiv' 2024-06-26T07:05:02.2392095Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FXdiv/config remote.origin.url 2024-06-26T07:05:02.2404767Z Entering 'third_party/NNPACK' 2024-06-26T07:05:02.2437127Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK/config remote.origin.url 2024-06-26T07:05:02.2449616Z Entering 'third_party/VulkanMemoryAllocator' 2024-06-26T07:05:02.2480665Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/VulkanMemoryAllocator/config remote.origin.url 2024-06-26T07:05:02.2494354Z Entering 'third_party/XNNPACK' 2024-06-26T07:05:02.2526302Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/XNNPACK/config remote.origin.url 2024-06-26T07:05:02.2548663Z Entering 'third_party/benchmark' 2024-06-26T07:05:02.2580650Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/benchmark/config remote.origin.url 2024-06-26T07:05:02.2594071Z Entering 'third_party/cpp-httplib' 2024-06-26T07:05:02.2624824Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpp-httplib/config remote.origin.url 2024-06-26T07:05:02.2637711Z Entering 'third_party/cpuinfo' 2024-06-26T07:05:02.2669558Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpuinfo/config remote.origin.url 2024-06-26T07:05:02.2683784Z Entering 'third_party/cudnn_frontend' 2024-06-26T07:05:02.2715398Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cudnn_frontend/config remote.origin.url 2024-06-26T07:05:02.2728914Z Entering 'third_party/cutlass' 2024-06-26T07:05:02.2759655Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cutlass/config remote.origin.url 2024-06-26T07:05:02.2778113Z Entering 'third_party/eigen' 2024-06-26T07:05:02.2807347Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/eigen/config remote.origin.url 2024-06-26T07:05:02.2821935Z Entering 'third_party/fbgemm' 2024-06-26T07:05:02.2853776Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/config remote.origin.url 2024-06-26T07:05:02.2866672Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-06-26T07:05:02.2898443Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/asmjit/config remote.origin.url 2024-06-26T07:05:02.2911149Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T07:05:02.2942517Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cpuinfo/config remote.origin.url 2024-06-26T07:05:02.2955285Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-06-26T07:05:02.2987629Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cutlass/config remote.origin.url 2024-06-26T07:05:02.3004973Z Entering 'third_party/fbgemm/third_party/googletest' 2024-06-26T07:05:02.3035999Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/googletest/config remote.origin.url 2024-06-26T07:05:02.3048018Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T07:05:02.3080512Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/hipify_torch/config remote.origin.url 2024-06-26T07:05:02.3094652Z Entering 'third_party/flatbuffers' 2024-06-26T07:05:02.3124494Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/flatbuffers/config remote.origin.url 2024-06-26T07:05:02.3139403Z Entering 'third_party/fmt' 2024-06-26T07:05:02.3170141Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fmt/config remote.origin.url 2024-06-26T07:05:02.3183213Z Entering 'third_party/foxi' 2024-06-26T07:05:02.3213637Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/foxi/config remote.origin.url 2024-06-26T07:05:02.3227284Z Entering 'third_party/gemmlowp/gemmlowp' 2024-06-26T07:05:02.3258818Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gemmlowp/gemmlowp/config remote.origin.url 2024-06-26T07:05:02.3272496Z Entering 'third_party/gloo' 2024-06-26T07:05:02.3303320Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gloo/config remote.origin.url 2024-06-26T07:05:02.3316352Z Entering 'third_party/googletest' 2024-06-26T07:05:02.3347773Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/googletest/config remote.origin.url 2024-06-26T07:05:02.3359719Z Entering 'third_party/ideep' 2024-06-26T07:05:02.3391120Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/config remote.origin.url 2024-06-26T07:05:02.3402762Z Entering 'third_party/ideep/mkl-dnn' 2024-06-26T07:05:02.3434057Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/modules/mkl-dnn/config remote.origin.url 2024-06-26T07:05:02.3451901Z Entering 'third_party/ittapi' 2024-06-26T07:05:02.3485148Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ittapi/config remote.origin.url 2024-06-26T07:05:02.3497159Z Entering 'third_party/kineto' 2024-06-26T07:05:02.3528646Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/config remote.origin.url 2024-06-26T07:05:02.3540788Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T07:05:02.3571583Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/config remote.origin.url 2024-06-26T07:05:02.3583767Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T07:05:02.3616368Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/DCGM/config remote.origin.url 2024-06-26T07:05:02.3629738Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T07:05:02.3661555Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/cpr/config remote.origin.url 2024-06-26T07:05:02.3674060Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T07:05:02.3705410Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/fmt/config remote.origin.url 2024-06-26T07:05:02.3718562Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T07:05:02.3750565Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/config remote.origin.url 2024-06-26T07:05:02.3761611Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T07:05:02.3792706Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/modules/doc/config remote.origin.url 2024-06-26T07:05:02.3806344Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T07:05:02.3837599Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/glog/config remote.origin.url 2024-06-26T07:05:02.3849985Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T07:05:02.3882420Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/googletest/config remote.origin.url 2024-06-26T07:05:02.3895143Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T07:05:02.3925625Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/json/config remote.origin.url 2024-06-26T07:05:02.3937322Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T07:05:02.3969857Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/pfs/config remote.origin.url 2024-06-26T07:05:02.3983981Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T07:05:02.4014954Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/fmt/config remote.origin.url 2024-06-26T07:05:02.4027826Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T07:05:02.4057292Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/googletest/config remote.origin.url 2024-06-26T07:05:02.4070628Z Entering 'third_party/mimalloc' 2024-06-26T07:05:02.4103212Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/mimalloc/config remote.origin.url 2024-06-26T07:05:02.4115662Z Entering 'third_party/nccl/nccl' 2024-06-26T07:05:02.4146174Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nccl/nccl/config remote.origin.url 2024-06-26T07:05:02.4157284Z Entering 'third_party/nlohmann' 2024-06-26T07:05:02.4188687Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nlohmann/config remote.origin.url 2024-06-26T07:05:02.4200481Z Entering 'third_party/onnx' 2024-06-26T07:05:02.4231380Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/config remote.origin.url 2024-06-26T07:05:02.4256515Z Entering 'third_party/onnx/third_party/benchmark' 2024-06-26T07:05:02.4287322Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/benchmark/config remote.origin.url 2024-06-26T07:05:02.4300899Z Entering 'third_party/onnx/third_party/pybind11' 2024-06-26T07:05:02.4331328Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/pybind11/config remote.origin.url 2024-06-26T07:05:02.4344716Z Entering 'third_party/opentelemetry-cpp' 2024-06-26T07:05:02.4376954Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/config remote.origin.url 2024-06-26T07:05:02.4390932Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T07:05:02.4421901Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/benchmark/config remote.origin.url 2024-06-26T07:05:02.4434743Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T07:05:02.4465906Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/googletest/config remote.origin.url 2024-06-26T07:05:02.4478668Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T07:05:02.4509179Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/ms-gsl/config remote.origin.url 2024-06-26T07:05:02.4521637Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T07:05:02.4551339Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/nlohmann-json/config remote.origin.url 2024-06-26T07:05:02.4562818Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T07:05:02.4595006Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentelemetry-proto/config remote.origin.url 2024-06-26T07:05:02.4607196Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T07:05:02.4638054Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentracing-cpp/config remote.origin.url 2024-06-26T07:05:02.4650861Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T07:05:02.4683093Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/config remote.origin.url 2024-06-26T07:05:02.4695031Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T07:05:02.4725280Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/civetweb/config remote.origin.url 2024-06-26T07:05:02.4739162Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T07:05:02.4769765Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/googletest/config remote.origin.url 2024-06-26T07:05:02.4783365Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T07:05:02.4814395Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/tools/vcpkg/config remote.origin.url 2024-06-26T07:05:02.4841152Z Entering 'third_party/pocketfft' 2024-06-26T07:05:02.4873295Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pocketfft/config remote.origin.url 2024-06-26T07:05:02.4885521Z Entering 'third_party/protobuf' 2024-06-26T07:05:02.4915760Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/config remote.origin.url 2024-06-26T07:05:02.4930946Z Entering 'third_party/protobuf/third_party/benchmark' 2024-06-26T07:05:02.4962952Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/benchmark/config remote.origin.url 2024-06-26T07:05:02.4976265Z Entering 'third_party/protobuf/third_party/googletest' 2024-06-26T07:05:02.5006829Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/googletest/config remote.origin.url 2024-06-26T07:05:02.5020897Z Entering 'third_party/psimd' 2024-06-26T07:05:02.5052808Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/psimd/config remote.origin.url 2024-06-26T07:05:02.5066415Z Entering 'third_party/pthreadpool' 2024-06-26T07:05:02.5098688Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/pthreadpool/config remote.origin.url 2024-06-26T07:05:02.5111017Z Entering 'third_party/pybind11' 2024-06-26T07:05:02.5140640Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pybind11/config remote.origin.url 2024-06-26T07:05:02.5152954Z Entering 'third_party/python-peachpy' 2024-06-26T07:05:02.5183165Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/python-peachpy/config remote.origin.url 2024-06-26T07:05:02.5196601Z Entering 'third_party/sleef' 2024-06-26T07:05:02.5227488Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/sleef/config remote.origin.url 2024-06-26T07:05:02.5240113Z Entering 'third_party/tensorpipe' 2024-06-26T07:05:02.5273362Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/config remote.origin.url 2024-06-26T07:05:02.5284751Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-06-26T07:05:02.5315746Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/googletest/config remote.origin.url 2024-06-26T07:05:02.5327686Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-06-26T07:05:02.5359826Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libnop/config remote.origin.url 2024-06-26T07:05:02.5372539Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-06-26T07:05:02.5404089Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libuv/config remote.origin.url 2024-06-26T07:05:02.5417622Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T07:05:02.5447944Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/config remote.origin.url 2024-06-26T07:05:02.5460530Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T07:05:02.5490609Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/modules/tools/clang/config remote.origin.url 2024-06-26T07:05:02.6580841Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'git@github.com:' 2024-06-26T07:05:02.6777803Z Entering 'android/libs/fbjni' 2024-06-26T07:05:02.6802841Z Entering 'third_party/FP16' 2024-06-26T07:05:02.6833057Z Entering 'third_party/FXdiv' 2024-06-26T07:05:02.6861178Z Entering 'third_party/NNPACK' 2024-06-26T07:05:02.6888109Z Entering 'third_party/VulkanMemoryAllocator' 2024-06-26T07:05:02.6916521Z Entering 'third_party/XNNPACK' 2024-06-26T07:05:02.6956581Z Entering 'third_party/benchmark' 2024-06-26T07:05:02.6983056Z Entering 'third_party/cpp-httplib' 2024-06-26T07:05:02.7008842Z Entering 'third_party/cpuinfo' 2024-06-26T07:05:02.7037803Z Entering 'third_party/cudnn_frontend' 2024-06-26T07:05:02.7066289Z Entering 'third_party/cutlass' 2024-06-26T07:05:02.7101497Z Entering 'third_party/eigen' 2024-06-26T07:05:02.7130097Z Entering 'third_party/fbgemm' 2024-06-26T07:05:02.7155915Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-06-26T07:05:02.7181824Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T07:05:02.7207841Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-06-26T07:05:02.7238019Z Entering 'third_party/fbgemm/third_party/googletest' 2024-06-26T07:05:02.7264640Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T07:05:02.7291576Z Entering 'third_party/flatbuffers' 2024-06-26T07:05:02.7321695Z Entering 'third_party/fmt' 2024-06-26T07:05:02.7350563Z Entering 'third_party/foxi' 2024-06-26T07:05:02.7380495Z Entering 'third_party/gemmlowp/gemmlowp' 2024-06-26T07:05:02.7406552Z Entering 'third_party/gloo' 2024-06-26T07:05:02.7433676Z Entering 'third_party/googletest' 2024-06-26T07:05:02.7461614Z Entering 'third_party/ideep' 2024-06-26T07:05:02.7485280Z Entering 'third_party/ideep/mkl-dnn' 2024-06-26T07:05:02.7519263Z Entering 'third_party/ittapi' 2024-06-26T07:05:02.7547211Z Entering 'third_party/kineto' 2024-06-26T07:05:02.7573537Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T07:05:02.7601158Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T07:05:02.7630811Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T07:05:02.7660044Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T07:05:02.7688142Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T07:05:02.7714209Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T07:05:02.7743354Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T07:05:02.7771460Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T07:05:02.7797821Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T07:05:02.7824960Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T07:05:02.7855384Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T07:05:02.7882548Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T07:05:02.7912153Z Entering 'third_party/mimalloc' 2024-06-26T07:05:02.7938093Z Entering 'third_party/nccl/nccl' 2024-06-26T07:05:02.7965079Z Entering 'third_party/nlohmann' 2024-06-26T07:05:02.7992326Z Entering 'third_party/onnx' 2024-06-26T07:05:02.8032657Z Entering 'third_party/onnx/third_party/benchmark' 2024-06-26T07:05:02.8061426Z Entering 'third_party/onnx/third_party/pybind11' 2024-06-26T07:05:02.8090237Z Entering 'third_party/opentelemetry-cpp' 2024-06-26T07:05:02.8121327Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T07:05:02.8147655Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T07:05:02.8174915Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T07:05:02.8202651Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T07:05:02.8232327Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T07:05:02.8259604Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T07:05:02.8286467Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T07:05:02.8312639Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T07:05:02.8340523Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T07:05:02.8369644Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T07:05:02.8408972Z Entering 'third_party/pocketfft' 2024-06-26T07:05:02.8438553Z Entering 'third_party/protobuf' 2024-06-26T07:05:02.8465691Z Entering 'third_party/protobuf/third_party/benchmark' 2024-06-26T07:05:02.8492963Z Entering 'third_party/protobuf/third_party/googletest' 2024-06-26T07:05:02.8524459Z Entering 'third_party/psimd' 2024-06-26T07:05:02.8553559Z Entering 'third_party/pthreadpool' 2024-06-26T07:05:02.8581047Z Entering 'third_party/pybind11' 2024-06-26T07:05:02.8607014Z Entering 'third_party/python-peachpy' 2024-06-26T07:05:02.8633834Z Entering 'third_party/sleef' 2024-06-26T07:05:02.8659947Z Entering 'third_party/tensorpipe' 2024-06-26T07:05:02.8686270Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-06-26T07:05:02.8712751Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-06-26T07:05:02.8740437Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-06-26T07:05:02.8766897Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T07:05:02.8794334Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T07:05:02.8833568Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'org-21003710@github.com:' 2024-06-26T07:05:02.9039691Z Entering 'android/libs/fbjni' 2024-06-26T07:05:02.9067969Z Entering 'third_party/FP16' 2024-06-26T07:05:02.9096055Z Entering 'third_party/FXdiv' 2024-06-26T07:05:02.9124745Z Entering 'third_party/NNPACK' 2024-06-26T07:05:02.9150733Z Entering 'third_party/VulkanMemoryAllocator' 2024-06-26T07:05:02.9178761Z Entering 'third_party/XNNPACK' 2024-06-26T07:05:02.9218040Z Entering 'third_party/benchmark' 2024-06-26T07:05:02.9244488Z Entering 'third_party/cpp-httplib' 2024-06-26T07:05:02.9273634Z Entering 'third_party/cpuinfo' 2024-06-26T07:05:02.9302432Z Entering 'third_party/cudnn_frontend' 2024-06-26T07:05:02.9329723Z Entering 'third_party/cutlass' 2024-06-26T07:05:02.9363130Z Entering 'third_party/eigen' 2024-06-26T07:05:02.9390151Z Entering 'third_party/fbgemm' 2024-06-26T07:05:02.9416611Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-06-26T07:05:02.9443699Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T07:05:02.9470207Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-06-26T07:05:02.9501903Z Entering 'third_party/fbgemm/third_party/googletest' 2024-06-26T07:05:02.9529148Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T07:05:02.9558500Z Entering 'third_party/flatbuffers' 2024-06-26T07:05:02.9587900Z Entering 'third_party/fmt' 2024-06-26T07:05:02.9617666Z Entering 'third_party/foxi' 2024-06-26T07:05:02.9643506Z Entering 'third_party/gemmlowp/gemmlowp' 2024-06-26T07:05:02.9671651Z Entering 'third_party/gloo' 2024-06-26T07:05:02.9701551Z Entering 'third_party/googletest' 2024-06-26T07:05:02.9728719Z Entering 'third_party/ideep' 2024-06-26T07:05:02.9756395Z Entering 'third_party/ideep/mkl-dnn' 2024-06-26T07:05:02.9787932Z Entering 'third_party/ittapi' 2024-06-26T07:05:02.9816990Z Entering 'third_party/kineto' 2024-06-26T07:05:02.9844849Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T07:05:02.9871922Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T07:05:02.9898481Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T07:05:02.9926874Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T07:05:02.9953954Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T07:05:02.9981222Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T07:05:03.0009512Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T07:05:03.0036341Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T07:05:03.0063685Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T07:05:03.0089409Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T07:05:03.0118672Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T07:05:03.0143423Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T07:05:03.0171171Z Entering 'third_party/mimalloc' 2024-06-26T07:05:03.0200291Z Entering 'third_party/nccl/nccl' 2024-06-26T07:05:03.0227006Z Entering 'third_party/nlohmann' 2024-06-26T07:05:03.0256869Z Entering 'third_party/onnx' 2024-06-26T07:05:03.0296523Z Entering 'third_party/onnx/third_party/benchmark' 2024-06-26T07:05:03.0325061Z Entering 'third_party/onnx/third_party/pybind11' 2024-06-26T07:05:03.0353788Z Entering 'third_party/opentelemetry-cpp' 2024-06-26T07:05:03.0384185Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T07:05:03.0412328Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T07:05:03.0439943Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T07:05:03.0466736Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T07:05:03.0495315Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T07:05:03.0522569Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T07:05:03.0550739Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T07:05:03.0577771Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T07:05:03.0606964Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T07:05:03.0634527Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T07:05:03.0677931Z Entering 'third_party/pocketfft' 2024-06-26T07:05:03.0705632Z Entering 'third_party/protobuf' 2024-06-26T07:05:03.0732863Z Entering 'third_party/protobuf/third_party/benchmark' 2024-06-26T07:05:03.0760587Z Entering 'third_party/protobuf/third_party/googletest' 2024-06-26T07:05:03.0790681Z Entering 'third_party/psimd' 2024-06-26T07:05:03.0820277Z Entering 'third_party/pthreadpool' 2024-06-26T07:05:03.0847707Z Entering 'third_party/pybind11' 2024-06-26T07:05:03.0875144Z Entering 'third_party/python-peachpy' 2024-06-26T07:05:03.0902928Z Entering 'third_party/sleef' 2024-06-26T07:05:03.0929740Z Entering 'third_party/tensorpipe' 2024-06-26T07:05:03.0956505Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-06-26T07:05:03.0982994Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-06-26T07:05:03.1009163Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-06-26T07:05:03.1036826Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T07:05:03.1063576Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T07:05:03.1101777Z ##[endgroup] 2024-06-26T07:05:03.1132469Z [command]/usr/bin/git log -1 --format='%H' 2024-06-26T07:05:03.1153557Z 'b8c4c54d347aa776934c60784e35936878ef18dc' 2024-06-26T07:05:03.1322628Z Prepare all required actions 2024-06-26T07:05:03.1323068Z Getting action download info 2024-06-26T07:05:03.2761224Z ##[group]Run ./.github/actions/setup-linux 2024-06-26T07:05:03.2761648Z env: 2024-06-26T07:05:03.2761927Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:05:03.2762270Z ##[endgroup] 2024-06-26T07:05:03.2820720Z ##[group]Run set -euo pipefail 2024-06-26T07:05:03.2821142Z set -euo pipefail 2024-06-26T07:05:03.2821525Z function get_ec2_metadata() { 2024-06-26T07:05:03.2822052Z  # Pulled from instance metadata endpoint for EC2 2024-06-26T07:05:03.2822924Z  # see https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/instancedata-data-retrieval.html 2024-06-26T07:05:03.2823682Z  category=$1 2024-06-26T07:05:03.2824193Z  # If it is GCP runner (runner name contains gcp), do not run this 2024-06-26T07:05:03.2824822Z  runner_name_str=i-0ca3df5e506f33f09 2024-06-26T07:05:03.2825315Z  if [[ -f /.inarc ]]; then 2024-06-26T07:05:03.2825794Z  echo "ARC Runner, no info on ec2 metadata" 2024-06-26T07:05:03.2826352Z  elif [[ $runner_name_str == *"gcp"* ]]; then 2024-06-26T07:05:03.2827045Z  echo "Runner is from Google Cloud Platform, No info on ec2 metadata" 2024-06-26T07:05:03.2827644Z  else 2024-06-26T07:05:03.2828121Z  curl -fsSL "http://169.254.169.254/latest/meta-data/${category}" 2024-06-26T07:05:03.2828692Z  fi 2024-06-26T07:05:03.2828970Z } 2024-06-26T07:05:03.2829353Z echo "ami-id: $(get_ec2_metadata ami-id)" 2024-06-26T07:05:03.2829951Z echo "instance-id: $(get_ec2_metadata instance-id)" 2024-06-26T07:05:03.2830599Z echo "instance-type: $(get_ec2_metadata instance-type)" 2024-06-26T07:05:03.2831156Z echo "system info $(uname -a)" 2024-06-26T07:05:03.2838955Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:05:03.2839441Z env: 2024-06-26T07:05:03.2839748Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:05:03.2840114Z ##[endgroup] 2024-06-26T07:05:03.2907359Z ami-id: ami-0ce0c36d7a00b20e2 2024-06-26T07:05:03.2952721Z instance-id: i-0ca3df5e506f33f09 2024-06-26T07:05:03.2996122Z instance-type: g5.4xlarge 2024-06-26T07:05:03.3001993Z system info Linux ip-10-0-24-29.ec2.internal 4.14.336-257.562.amzn2.x86_64 #1 SMP Sat Feb 24 09:50:35 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux 2024-06-26T07:05:03.3022146Z ##[group]Run echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> $GITHUB_OUTPUT 2024-06-26T07:05:03.3023050Z echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> $GITHUB_OUTPUT 2024-06-26T07:05:03.3030934Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:05:03.3031443Z env: 2024-06-26T07:05:03.3031715Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:05:03.3032063Z ##[endgroup] 2024-06-26T07:05:03.3092171Z ##[group]Run if systemctl is-active --quiet docker; then 2024-06-26T07:05:03.3092786Z if systemctl is-active --quiet docker; then 2024-06-26T07:05:03.3093622Z  echo "Docker daemon is running..."; 2024-06-26T07:05:03.3094216Z else 2024-06-26T07:05:03.3094708Z  echo "Starting docker deamon..." && sudo systemctl start docker; 2024-06-26T07:05:03.3095290Z fi 2024-06-26T07:05:03.3102596Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:05:03.3103087Z env: 2024-06-26T07:05:03.3103365Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:05:03.3103711Z ##[endgroup] 2024-06-26T07:05:03.3139523Z Docker daemon is running... 2024-06-26T07:05:03.3183111Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2024-06-26T07:05:03.3183687Z with: 2024-06-26T07:05:03.3183957Z shell: bash 2024-06-26T07:05:03.3184251Z timeout_minutes: 5 2024-06-26T07:05:03.3184576Z max_attempts: 3 2024-06-26T07:05:03.3184892Z retry_wait_seconds: 30 2024-06-26T07:05:03.3186429Z command: AWS_ACCOUNT_ID=$(aws sts get-caller-identity|grep Account|cut -f4 -d\") aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \ --password-stdin "$AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com" 2024-06-26T07:05:03.3187883Z polling_interval_seconds: 1 2024-06-26T07:05:03.3188259Z warning_on_retry: true 2024-06-26T07:05:03.3188609Z continue_on_error: false 2024-06-26T07:05:03.3188943Z env: 2024-06-26T07:05:03.3189208Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:05:03.3189564Z AWS_RETRY_MODE: standard 2024-06-26T07:05:03.3189913Z AWS_MAX_ATTEMPTS: 5 2024-06-26T07:05:03.3190251Z AWS_DEFAULT_REGION: us-east-1 2024-06-26T07:05:03.3190614Z ##[endgroup] 2024-06-26T07:05:04.1857103Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-06-26T07:05:04.1857924Z Configure a credential helper to remove this warning. See 2024-06-26T07:05:04.1858757Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-06-26T07:05:04.1859442Z 2024-06-26T07:05:04.1859661Z Login Succeeded 2024-06-26T07:05:04.3681784Z Command completed after 1 attempt(s). 2024-06-26T07:05:04.3720954Z ##[group]Run env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-06-26T07:05:04.3721683Z env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-06-26T07:05:04.3722332Z env | grep '^CI' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-06-26T07:05:04.3730122Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:05:04.3730619Z env: 2024-06-26T07:05:04.3730898Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:05:04.3731251Z ##[endgroup] 2024-06-26T07:05:04.3791390Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2024-06-26T07:05:04.3792164Z # ignore expansion of "docker ps -q" since it could be empty 2024-06-26T07:05:04.3792758Z # shellcheck disable=SC2046 2024-06-26T07:05:04.3793222Z docker stop $(docker ps -q) || true 2024-06-26T07:05:04.3793708Z # Prune all of the docker images 2024-06-26T07:05:04.3794157Z docker system prune -af 2024-06-26T07:05:04.3801978Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:05:04.3802492Z env: 2024-06-26T07:05:04.3802775Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:05:04.3803127Z ##[endgroup] 2024-06-26T07:05:04.4046873Z "docker stop" requires at least 1 argument. 2024-06-26T07:05:04.4047517Z See 'docker stop --help'. 2024-06-26T07:05:04.4047756Z 2024-06-26T07:05:04.4047981Z Usage: docker stop [OPTIONS] CONTAINER [CONTAINER...] 2024-06-26T07:05:04.4048356Z 2024-06-26T07:05:04.4048503Z Stop one or more running containers 2024-06-26T07:05:04.4208580Z Total reclaimed space: 0B 2024-06-26T07:05:04.4247389Z ##[group]Run set +e 2024-06-26T07:05:04.4247936Z set +e 2024-06-26T07:05:04.4248384Z set -x 2024-06-26T07:05:04.4248788Z  2024-06-26T07:05:04.4249283Z PT_DOMAIN=download.pytorch.org 2024-06-26T07:05:04.4250474Z # TODO: Flaky access to download.pytorch.org https://github.com/pytorch/pytorch/issues/100400, 2024-06-26T07:05:04.4252182Z # cleaning this up once the issue is fixed. There are more than one resolved IP here, the last 2024-06-26T07:05:04.4253783Z # one is returned at random 2024-06-26T07:05:04.4254597Z RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" | tail -n1) 2024-06-26T07:05:04.4255395Z  2024-06-26T07:05:04.4255856Z if [ -z "${RESOLVED_IP}" ]; then 2024-06-26T07:05:04.4256814Z  echo "Couldn't resolve ${PT_DOMAIN}, retrying with Google DNS..." 2024-06-26T07:05:04.4257992Z  RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" @8.8.8.8 | tail -n1) 2024-06-26T07:05:04.4258848Z  2024-06-26T07:05:04.4259339Z  if [ -z "${RESOLVED_IP}" ]; then 2024-06-26T07:05:04.4260219Z  echo "Couldn't resolve ${PT_DOMAIN}, exiting..." 2024-06-26T07:05:04.4260985Z  exit 1 2024-06-26T07:05:04.4261436Z  fi 2024-06-26T07:05:04.4261847Z fi 2024-06-26T07:05:04.4262447Z  2024-06-26T07:05:04.4262991Z if grep -r "${PT_DOMAIN}" /etc/hosts; then 2024-06-26T07:05:04.4263783Z  # Clean up any old records first 2024-06-26T07:05:04.4264557Z  sudo sed -i "/${PT_DOMAIN}/d" /etc/hosts 2024-06-26T07:05:04.4265236Z fi 2024-06-26T07:05:04.4265642Z  2024-06-26T07:05:04.4266276Z echo "${RESOLVED_IP} ${PT_DOMAIN}" | sudo tee -a /etc/hosts 2024-06-26T07:05:04.4267089Z cat /etc/hosts 2024-06-26T07:05:04.4277243Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:05:04.4277967Z env: 2024-06-26T07:05:04.4278385Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:05:04.4278907Z ##[endgroup] 2024-06-26T07:05:04.4304118Z + PT_DOMAIN=download.pytorch.org 2024-06-26T07:05:04.4308036Z ++ dig -4 +short download.pytorch.org 2024-06-26T07:05:04.4308612Z ++ tail -n1 2024-06-26T07:05:04.4365882Z + RESOLVED_IP=18.160.10.28 2024-06-26T07:05:04.4366447Z + '[' -z 18.160.10.28 ']' 2024-06-26T07:05:04.4366941Z + grep -r download.pytorch.org /etc/hosts 2024-06-26T07:05:04.4372035Z 3.162.125.42 download.pytorch.org 2024-06-26T07:05:04.4372782Z + sudo sed -i /download.pytorch.org/d /etc/hosts 2024-06-26T07:05:04.4455041Z + echo '18.160.10.28 download.pytorch.org' 2024-06-26T07:05:04.4455628Z + sudo tee -a /etc/hosts 2024-06-26T07:05:04.4517315Z 18.160.10.28 download.pytorch.org 2024-06-26T07:05:04.4530288Z + cat /etc/hosts 2024-06-26T07:05:04.4534803Z 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 2024-06-26T07:05:04.4546976Z ::1 localhost6 localhost6.localdomain6 2024-06-26T07:05:04.4547478Z 18.160.10.28 download.pytorch.org 2024-06-26T07:05:04.4755248Z ##[group]Run pytorch/test-infra/.github/actions/calculate-docker-image@main 2024-06-26T07:05:04.4755856Z with: 2024-06-26T07:05:04.4756944Z docker-image-name: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:05:04.4758158Z docker-build-dir: .ci/docker 2024-06-26T07:05:04.4758522Z working-directory: . 2024-06-26T07:05:04.4758991Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:05:04.4759518Z force-push: false 2024-06-26T07:05:04.4759848Z env: 2024-06-26T07:05:04.4760119Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:05:04.4760452Z ##[endgroup] 2024-06-26T07:05:04.4779374Z ##[group]Run set -ex 2024-06-26T07:05:04.4779734Z set -ex 2024-06-26T07:05:04.4780025Z  2024-06-26T07:05:04.4780581Z # If the docker build directory or the build script doesn't exist, the action will 2024-06-26T07:05:04.4781557Z # gracefully return the docker image name as it is. Pulling docker image in Linux 2024-06-26T07:05:04.4782354Z # job could then download the pre-built image as usual 2024-06-26T07:05:04.4783084Z if [[ ! -d "${DOCKER_BUILD_DIR}" ]] || [[ ! -f "${DOCKER_BUILD_DIR}/build.sh" ]]; then 2024-06-26T07:05:04.4783744Z  echo "skip=true" >> "${GITHUB_OUTPUT}" 2024-06-26T07:05:04.4784376Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2024-06-26T07:05:04.4785053Z  2024-06-26T07:05:04.4785564Z  echo "There is no Docker build script in ${REPO_NAME} repo, skipping..." 2024-06-26T07:05:04.4786181Z  exit 0 2024-06-26T07:05:04.4786475Z else 2024-06-26T07:05:04.4786845Z  echo "skip=false" >> "${GITHUB_OUTPUT}" 2024-06-26T07:05:04.4787300Z fi 2024-06-26T07:05:04.4787569Z  2024-06-26T07:05:04.4788031Z if [[ "${DOCKER_IMAGE_NAME}" == *"${DOCKER_REGISTRY}/${REPO_NAME}"* ]]; then 2024-06-26T07:05:04.4788863Z  # The docker image name already includes the ECR prefix and tag, so we can just 2024-06-26T07:05:04.4789656Z  # use it as it is, but first let's extract the tag 2024-06-26T07:05:04.4790383Z  DOCKER_TAG=$(echo "${DOCKER_IMAGE_NAME}" | awk -F '[:,]' '{print $2}') 2024-06-26T07:05:04.4791092Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-06-26T07:05:04.4791780Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2024-06-26T07:05:04.4792333Z else 2024-06-26T07:05:04.4792765Z  DOCKER_TAG=$(git rev-parse HEAD:"${DOCKER_BUILD_DIR}") 2024-06-26T07:05:04.4793435Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-06-26T07:05:04.4794319Z  echo "docker-image=${DOCKER_REGISTRY}/${REPO_NAME}/${DOCKER_IMAGE_NAME}:${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-06-26T07:05:04.4795062Z fi 2024-06-26T07:05:04.4802617Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:05:04.4803105Z env: 2024-06-26T07:05:04.4803376Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:05:04.4803718Z REPO_NAME: pytorch 2024-06-26T07:05:04.4804831Z DOCKER_IMAGE_NAME: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:05:04.4806109Z DOCKER_BUILD_DIR: .ci/docker 2024-06-26T07:05:04.4806614Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:05:04.4807135Z ##[endgroup] 2024-06-26T07:05:04.4827401Z + [[ ! -d .ci/docker ]] 2024-06-26T07:05:04.4827823Z + [[ ! -f .ci/docker/build.sh ]] 2024-06-26T07:05:04.4828202Z + echo skip=false 2024-06-26T07:05:04.4830272Z + [[ 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 == *\3\0\8\5\3\5\3\8\5\1\1\4\.\d\k\r\.\e\c\r\.\u\s\-\e\a\s\t\-\1\.\a\m\a\z\o\n\a\w\s\.\c\o\m\/\p\y\t\o\r\c\h* ]] 2024-06-26T07:05:04.4832847Z ++ echo 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:05:04.4834038Z ++ awk -F '[:,]' '{print $2}' 2024-06-26T07:05:04.4839122Z + DOCKER_TAG=91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:05:04.4839757Z + echo docker-tag=91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:05:04.4841510Z + echo docker-image=308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:05:04.4867850Z ##[group]Run set +e 2024-06-26T07:05:04.4868213Z set +e 2024-06-26T07:05:04.4868507Z set -x 2024-06-26T07:05:04.4868791Z  2024-06-26T07:05:04.4869065Z login() { 2024-06-26T07:05:04.4869730Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2024-06-26T07:05:04.4870450Z } 2024-06-26T07:05:04.4870716Z  2024-06-26T07:05:04.4870991Z retry () { 2024-06-26T07:05:04.4871381Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2024-06-26T07:05:04.4871822Z } 2024-06-26T07:05:04.4872091Z  2024-06-26T07:05:04.4872406Z retry login "${DOCKER_REGISTRY}" 2024-06-26T07:05:04.4872817Z  2024-06-26T07:05:04.4873285Z # Check if image already exists, if it does then skip building it 2024-06-26T07:05:04.4874092Z if docker manifest inspect "${DOCKER_IMAGE}"; then 2024-06-26T07:05:04.4874595Z  exit 0 2024-06-26T07:05:04.4874890Z fi 2024-06-26T07:05:04.4875161Z  2024-06-26T07:05:04.4875663Z # NB: This part requires a full checkout. Otherwise, the merge base will 2024-06-26T07:05:04.4876503Z # be empty. The default action would be to continue rebuild the image 2024-06-26T07:05:04.4877246Z if [[ "$BASE_REVISION" = "$(git rev-parse HEAD)" ]]; then 2024-06-26T07:05:04.4877907Z  # if we're on the base branch then use the parent commit 2024-06-26T07:05:04.4878490Z  MERGE_BASE=$(git rev-parse HEAD~) 2024-06-26T07:05:04.4878917Z else 2024-06-26T07:05:04.4879388Z  # otherwise we're on a PR, so use the most recent base commit 2024-06-26T07:05:04.4880120Z  MERGE_BASE=$(git merge-base HEAD "$BASE_REVISION") 2024-06-26T07:05:04.4880642Z fi 2024-06-26T07:05:04.4880919Z  2024-06-26T07:05:04.4881238Z if [[ -z "${MERGE_BASE}" ]]; then 2024-06-26T07:05:04.4881735Z  echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2024-06-26T07:05:04.4882195Z  2024-06-26T07:05:04.4882851Z  echo "Finding merge base only works with full checkout, please set fetch-depth to 0, continuing ..." 2024-06-26T07:05:04.4883618Z  exit 0 2024-06-26T07:05:04.4883913Z fi 2024-06-26T07:05:04.4884191Z  2024-06-26T07:05:04.4884630Z if ! git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}"; then 2024-06-26T07:05:04.4885703Z  echo "Directory '${DOCKER_BUILD_DIR}' not found in commit $MERGE_BASE, you should rebase onto a more recent commit" 2024-06-26T07:05:04.4886497Z  exit 1 2024-06-26T07:05:04.4886802Z fi 2024-06-26T07:05:04.4887081Z  2024-06-26T07:05:04.4887567Z PREVIOUS_DOCKER_TAG=$(git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}") 2024-06-26T07:05:04.4888525Z # If no image exists but the hash is the same as the previous hash then we should error out here 2024-06-26T07:05:04.4889397Z if [[ "${PREVIOUS_DOCKER_TAG}" == "${DOCKER_TAG}" ]]; then 2024-06-26T07:05:04.4890405Z  echo "WARNING: Something has gone wrong and the previous image isn't available for the merge-base of your branch" 2024-06-26T07:05:04.4891502Z  echo " Will re-build docker image to store in local cache, TTS may be longer" 2024-06-26T07:05:04.4892236Z fi 2024-06-26T07:05:04.4892518Z  2024-06-26T07:05:04.4892874Z echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2024-06-26T07:05:04.4900892Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:05:04.4901395Z env: 2024-06-26T07:05:04.4901670Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:05:04.4902037Z DOCKER_BUILD_DIR: .ci/docker 2024-06-26T07:05:04.4902517Z BASE_REVISION: b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:05:04.4903793Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:05:04.4905027Z DOCKER_TAG: 91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:05:04.4905617Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:05:04.4906131Z ##[endgroup] 2024-06-26T07:05:04.4925552Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:05:04.4926213Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:05:04.4926982Z + aws ecr get-login-password --region us-east-1 2024-06-26T07:05:04.4927978Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:05:04.9030125Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-06-26T07:05:04.9030998Z Configure a credential helper to remove this warning. See 2024-06-26T07:05:04.9032278Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-06-26T07:05:04.9032794Z 2024-06-26T07:05:04.9032928Z Login Succeeded 2024-06-26T07:05:04.9044672Z + docker manifest inspect 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:05:05.0993419Z { 2024-06-26T07:05:05.0993781Z "schemaVersion": 2, 2024-06-26T07:05:05.0994399Z "mediaType": "application/vnd.docker.distribution.manifest.v2+json", 2024-06-26T07:05:05.0994982Z "config": { 2024-06-26T07:05:05.0995725Z "mediaType": "application/vnd.docker.container.image.v1+json", 2024-06-26T07:05:05.0996462Z "size": 48681, 2024-06-26T07:05:05.0997080Z "digest": "sha256:0058b15e517a024817bccd921dc9af264c964f500b3cb9b3f4649a8ac22cc2dd" 2024-06-26T07:05:05.0997818Z }, 2024-06-26T07:05:05.0998185Z "layers": [ 2024-06-26T07:05:05.0998558Z { 2024-06-26T07:05:05.0998989Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.0999656Z "size": 28580681, 2024-06-26T07:05:05.1000414Z "digest": "sha256:7a2c559011895d255fce249c00396abff5ae7e0c0a92931d0ed493e71de78e3a" 2024-06-26T07:05:05.1001332Z }, 2024-06-26T07:05:05.1001683Z { 2024-06-26T07:05:05.1002291Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1003061Z "size": 7943451, 2024-06-26T07:05:05.1003752Z "digest": "sha256:224fe954d7252f10539d243d6c9688806f7d13ad775ed02e7f7c79077844510d" 2024-06-26T07:05:05.1004368Z }, 2024-06-26T07:05:05.1004620Z { 2024-06-26T07:05:05.1005050Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1005908Z + exit 0 2024-06-26T07:05:05.1006300Z "size": 55728572, 2024-06-26T07:05:05.1007109Z "digest": "sha256:75722010b82e31715876aeeed0b2cee414296f0124fdfa061ab845ba2a158450" 2024-06-26T07:05:05.1007971Z }, 2024-06-26T07:05:05.1008299Z { 2024-06-26T07:05:05.1008838Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1009406Z "size": 186, 2024-06-26T07:05:05.1009948Z "digest": "sha256:d527cbbb87e3016fd72a18a9b468c945ad0ca27c5770b39debd6ed704db3a195" 2024-06-26T07:05:05.1010559Z }, 2024-06-26T07:05:05.1010807Z { 2024-06-26T07:05:05.1011237Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1011779Z "size": 6886, 2024-06-26T07:05:05.1012325Z "digest": "sha256:b57676e46aee1a8c82e528d78e5a13e31142524eea31c8b213d69ddcb6f1fe80" 2024-06-26T07:05:05.1013339Z }, 2024-06-26T07:05:05.1013607Z { 2024-06-26T07:05:05.1014038Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1014588Z "size": 1329001756, 2024-06-26T07:05:05.1015163Z "digest": "sha256:a8c1e85b5e14cec7af70bf304cb4d4cee6a1d25eb8215b2cf4fdc33e5af5e108" 2024-06-26T07:05:05.1015789Z }, 2024-06-26T07:05:05.1016028Z { 2024-06-26T07:05:05.1016455Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1017002Z "size": 62501, 2024-06-26T07:05:05.1017542Z "digest": "sha256:a41a8d1c11c8d80fe4e82b0d05478f8d51176ff20b8350905fc1b25c93a51198" 2024-06-26T07:05:05.1018138Z }, 2024-06-26T07:05:05.1018384Z { 2024-06-26T07:05:05.1018812Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1019347Z "size": 1684, 2024-06-26T07:05:05.1019876Z "digest": "sha256:0c12278907551c2962927d27c115f6f7bf0df894318b8aea6ece3ef01ccd0a8a" 2024-06-26T07:05:05.1020521Z }, 2024-06-26T07:05:05.1020774Z { 2024-06-26T07:05:05.1021191Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1021739Z "size": 1523, 2024-06-26T07:05:05.1022292Z "digest": "sha256:d8d1234baab3ec9ccb8bb710fc6b8ff6c10896ba2e8d27a347583eca770f9ff1" 2024-06-26T07:05:05.1022919Z }, 2024-06-26T07:05:05.1023157Z { 2024-06-26T07:05:05.1023580Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1024132Z "size": 2528295403, 2024-06-26T07:05:05.1024792Z "digest": "sha256:7ed32bc8e4696fcdb2feef850781160597b2275ad756819c4add88236b0577d5" 2024-06-26T07:05:05.1025400Z }, 2024-06-26T07:05:05.1025647Z { 2024-06-26T07:05:05.1026072Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1026609Z "size": 86016, 2024-06-26T07:05:05.1027151Z "digest": "sha256:ec1e7978c1fe161ced1d98092a51e7c5953ca5fda5577f54df9dbda4afff1b2b" 2024-06-26T07:05:05.1027768Z }, 2024-06-26T07:05:05.1028014Z { 2024-06-26T07:05:05.1028435Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1028983Z "size": 1823, 2024-06-26T07:05:05.1029509Z "digest": "sha256:309b872da805fcdf74137a887464876fa0615dc8b24199307119eb65fc2bfb49" 2024-06-26T07:05:05.1030109Z }, 2024-06-26T07:05:05.1030347Z { 2024-06-26T07:05:05.1030776Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1031324Z "size": 246737542, 2024-06-26T07:05:05.1031868Z "digest": "sha256:e82932cb002c06a782077b8e5965f8733eb8563406a23cab260d9d8c4a994f7d" 2024-06-26T07:05:05.1032464Z }, 2024-06-26T07:05:05.1032709Z { 2024-06-26T07:05:05.1033134Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1033672Z "size": 545, 2024-06-26T07:05:05.1034206Z "digest": "sha256:ca9dd73e3e9378225ebdcfd12199ef44649e34fe55003cfbc8afe2e8a4527c5b" 2024-06-26T07:05:05.1034822Z }, 2024-06-26T07:05:05.1035067Z { 2024-06-26T07:05:05.1035488Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1036031Z "size": 1283, 2024-06-26T07:05:05.1036553Z "digest": "sha256:16d76a79d5d6616e228537785ec83a869f68a402520bbc6e826201621ca6cb98" 2024-06-26T07:05:05.1037147Z }, 2024-06-26T07:05:05.1037386Z { 2024-06-26T07:05:05.1037810Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1038352Z "size": 485, 2024-06-26T07:05:05.1038885Z "digest": "sha256:4bdf41c9ecbe1651e0986ccbea4663a0556af27b7145a679cfa45c35dc96b891" 2024-06-26T07:05:05.1039509Z }, 2024-06-26T07:05:05.1039754Z { 2024-06-26T07:05:05.1040180Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1040717Z "size": 91710937, 2024-06-26T07:05:05.1041280Z "digest": "sha256:f4863801e30cdbcd1d4e6cb1cbbcde7dbcaf6ae317ca80429295741ce60ac31d" 2024-06-26T07:05:05.1041900Z }, 2024-06-26T07:05:05.1042145Z { 2024-06-26T07:05:05.1042565Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1043176Z "size": 3233, 2024-06-26T07:05:05.1043720Z "digest": "sha256:d37dd9ed8948a0d02e1198bbedadbca36477a0980dd553196385aab0c025581d" 2024-06-26T07:05:05.1044330Z }, 2024-06-26T07:05:05.1044575Z { 2024-06-26T07:05:05.1044996Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1045641Z "size": 1905, 2024-06-26T07:05:05.1046184Z "digest": "sha256:cf2f34f225dbed17c1a9a8b9ea4ad030aba797774a716dc0a82fe212324aa751" 2024-06-26T07:05:05.1046814Z }, 2024-06-26T07:05:05.1047056Z { 2024-06-26T07:05:05.1047480Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1048015Z "size": 702, 2024-06-26T07:05:05.1048545Z "digest": "sha256:df546d7b3e34396a6f2b51d8c88be976eca017bc99168d838c2c7bacabab9ec4" 2024-06-26T07:05:05.1049156Z }, 2024-06-26T07:05:05.1049395Z { 2024-06-26T07:05:05.1049822Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1050366Z "size": 2784789002, 2024-06-26T07:05:05.1050926Z "digest": "sha256:3d914950f8addfc4d657a2365c76e1143eb80b710cd3f6e9ae05640217fc6347" 2024-06-26T07:05:05.1051517Z }, 2024-06-26T07:05:05.1051759Z { 2024-06-26T07:05:05.1052184Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1052724Z "size": 381, 2024-06-26T07:05:05.1053446Z "digest": "sha256:96d0e2032184c57e62a652aaffcf0241f0d0c7a23e894ca0ad192c4a64a36583" 2024-06-26T07:05:05.1054066Z }, 2024-06-26T07:05:05.1054400Z { 2024-06-26T07:05:05.1054830Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1055370Z "size": 11879, 2024-06-26T07:05:05.1055904Z "digest": "sha256:06e12ce59790cb8b091e5d619c2a62a28329008ee184a8b9a562e3db12471f30" 2024-06-26T07:05:05.1056503Z }, 2024-06-26T07:05:05.1056743Z { 2024-06-26T07:05:05.1057169Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1057713Z "size": 803, 2024-06-26T07:05:05.1058252Z "digest": "sha256:ed712f63cde7070bdec2a6179c4c35e752c6991ddbc69fe9f2724a9903250ceb" 2024-06-26T07:05:05.1058868Z }, 2024-06-26T07:05:05.1059113Z { 2024-06-26T07:05:05.1059539Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1060134Z "size": 106, 2024-06-26T07:05:05.1060660Z "digest": "sha256:a97a71ef8a4e66234dfc2098834f8395ac5630240e60164d1a251fdb0115ba85" 2024-06-26T07:05:05.1061269Z }, 2024-06-26T07:05:05.1061524Z { 2024-06-26T07:05:05.1061954Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1062497Z "size": 503, 2024-06-26T07:05:05.1063029Z "digest": "sha256:25cd0c482ad612f936b35b4f220c580e16be982226aac8801a6a849a6bfdc221" 2024-06-26T07:05:05.1063636Z }, 2024-06-26T07:05:05.1063876Z { 2024-06-26T07:05:05.1064303Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1064854Z "size": 121477177, 2024-06-26T07:05:05.1065415Z "digest": "sha256:9bf94bc456584365fda21d0ed83b7cc690b08a71727b71c4c1e667e15028a386" 2024-06-26T07:05:05.1066027Z }, 2024-06-26T07:05:05.1066274Z { 2024-06-26T07:05:05.1066701Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1067244Z "size": 109, 2024-06-26T07:05:05.1067769Z "digest": "sha256:de45a14c9b227e4b0c9d45d42223b50a71c03522ddd9e2ca0d9517835206c823" 2024-06-26T07:05:05.1068374Z }, 2024-06-26T07:05:05.1068622Z { 2024-06-26T07:05:05.1069046Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1069594Z "size": 491, 2024-06-26T07:05:05.1070127Z "digest": "sha256:e99241e77209b0b35a0fb59a61c0821fc161190178af7e4af45e6eeaa043375e" 2024-06-26T07:05:05.1070727Z }, 2024-06-26T07:05:05.1070968Z { 2024-06-26T07:05:05.1071401Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1071949Z "size": 291, 2024-06-26T07:05:05.1072491Z "digest": "sha256:35e8f4e2a42f9df0c969dedd2199cf71719cf5ecfa676dfa014bbdeb4fdb295f" 2024-06-26T07:05:05.1073183Z }, 2024-06-26T07:05:05.1073439Z { 2024-06-26T07:05:05.1073868Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1074410Z "size": 101, 2024-06-26T07:05:05.1074940Z "digest": "sha256:a823ffa4c541394b52953391dc0a6867e26c37fe4a71fa022a2cc3f07f0ba70d" 2024-06-26T07:05:05.1075550Z }, 2024-06-26T07:05:05.1075796Z { 2024-06-26T07:05:05.1076216Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1076776Z "size": 1473, 2024-06-26T07:05:05.1077300Z "digest": "sha256:44ba272eae2064603605a6238b3f35cc6578859d660068e702a047a9cd8ab2fd" 2024-06-26T07:05:05.1077897Z }, 2024-06-26T07:05:05.1078138Z { 2024-06-26T07:05:05.1078574Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1079122Z "size": 446710781, 2024-06-26T07:05:05.1079676Z "digest": "sha256:da02d278e5240c285bc855ce4e42cd6121d5b903787f5c14f03e575ad1268650" 2024-06-26T07:05:05.1080275Z }, 2024-06-26T07:05:05.1080532Z { 2024-06-26T07:05:05.1080965Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1081510Z "size": 161, 2024-06-26T07:05:05.1082024Z "digest": "sha256:73a0ce681c295135456e190578733273276b38b4dd5babbb39298f384d43b1c6" 2024-06-26T07:05:05.1082619Z }, 2024-06-26T07:05:05.1082866Z { 2024-06-26T07:05:05.1083291Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1083836Z "size": 564, 2024-06-26T07:05:05.1084436Z "digest": "sha256:49737bd5ae709dbf7956e21fc8b05ba009e9e6c9b130b0126a73bd3d3f5efc78" 2024-06-26T07:05:05.1085057Z }, 2024-06-26T07:05:05.1085375Z { 2024-06-26T07:05:05.1085800Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1086348Z "size": 35874600, 2024-06-26T07:05:05.1086904Z "digest": "sha256:9cd4c745f8e4f9d5c9bb8050923575afad21f5b7852975a4a1981bc9eff282c5" 2024-06-26T07:05:05.1087507Z }, 2024-06-26T07:05:05.1087759Z { 2024-06-26T07:05:05.1088191Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1088736Z "size": 104, 2024-06-26T07:05:05.1089261Z "digest": "sha256:b2950a0365345d4c17a48627c905fd8930b3b3154c727f0526eb9ca547102bb7" 2024-06-26T07:05:05.1089860Z }, 2024-06-26T07:05:05.1090106Z { 2024-06-26T07:05:05.1090528Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1091071Z "size": 425, 2024-06-26T07:05:05.1091594Z "digest": "sha256:25e19d81d9fc081962ff4cbc09e098f4035419822712c19a410f5282300dfb9e" 2024-06-26T07:05:05.1092214Z }, 2024-06-26T07:05:05.1092455Z { 2024-06-26T07:05:05.1092879Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1093639Z "size": 20262084, 2024-06-26T07:05:05.1094192Z "digest": "sha256:60156b40fcbec2c25f0170b0a82fa8cd9303e0daae8bb1811fd0fc6562e88e8e" 2024-06-26T07:05:05.1094804Z }, 2024-06-26T07:05:05.1095047Z { 2024-06-26T07:05:05.1095475Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1096015Z "size": 439, 2024-06-26T07:05:05.1096534Z "digest": "sha256:7a868239227fd19b30a19927bbc8f058d247403fe5b343c55f4b4b8987918911" 2024-06-26T07:05:05.1097122Z }, 2024-06-26T07:05:05.1097365Z { 2024-06-26T07:05:05.1097781Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1098323Z "size": 702, 2024-06-26T07:05:05.1098852Z "digest": "sha256:df546d7b3e34396a6f2b51d8c88be976eca017bc99168d838c2c7bacabab9ec4" 2024-06-26T07:05:05.1099476Z }, 2024-06-26T07:05:05.1099714Z { 2024-06-26T07:05:05.1100134Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1100675Z "size": 143, 2024-06-26T07:05:05.1101194Z "digest": "sha256:83911d7c7ecf11b5932bb7449975c52e7f737a5b867691935e1ccb85ceb25b52" 2024-06-26T07:05:05.1101795Z }, 2024-06-26T07:05:05.1102038Z { 2024-06-26T07:05:05.1102459Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1103101Z "size": 135, 2024-06-26T07:05:05.1103642Z "digest": "sha256:b3c5d66c679f58c71febdd502889bd8cd3d36e5001754cdf1e30eabe21135cce" 2024-06-26T07:05:05.1104264Z }, 2024-06-26T07:05:05.1104508Z { 2024-06-26T07:05:05.1104925Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1105471Z "size": 4911495247, 2024-06-26T07:05:05.1106018Z "digest": "sha256:84b2c7a899820f6acdb22148c5e8346d8b26c33269fd01842c9573515251e1e1" 2024-06-26T07:05:05.1106610Z }, 2024-06-26T07:05:05.1106855Z { 2024-06-26T07:05:05.1107278Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1107817Z "size": 190, 2024-06-26T07:05:05.1108348Z "digest": "sha256:c1068d03a811d8dead5da9e82fdc8869205fc4ee9cb92d4f7a4acfbb5ba83950" 2024-06-26T07:05:05.1108971Z }, 2024-06-26T07:05:05.1109213Z { 2024-06-26T07:05:05.1109632Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1110169Z "size": 565, 2024-06-26T07:05:05.1110694Z "digest": "sha256:671b4a301d81074fca17d36851f81801552c4ecb2f90ff3412aa9ab6a1a91371" 2024-06-26T07:05:05.1111289Z }, 2024-06-26T07:05:05.1111532Z { 2024-06-26T07:05:05.1111948Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1112487Z "size": 43163095, 2024-06-26T07:05:05.1113037Z "digest": "sha256:67760cf5ec46ab58d3ca98637fd9b26cb47a67446bfd0db176fe5e023606aa0d" 2024-06-26T07:05:05.1113637Z }, 2024-06-26T07:05:05.1113956Z { 2024-06-26T07:05:05.1114379Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1114922Z "size": 106, 2024-06-26T07:05:05.1115448Z "digest": "sha256:ddc9740bcea2b301e99b50525059aea8d9c7121a1c8eab566561a8968438a8c2" 2024-06-26T07:05:05.1116064Z }, 2024-06-26T07:05:05.1116309Z { 2024-06-26T07:05:05.1116734Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1117271Z "size": 1213, 2024-06-26T07:05:05.1117806Z "digest": "sha256:fb2e977685609fcc01de170ba7f50a573e73e6520e47253717e92a28952c5ee8" 2024-06-26T07:05:05.1118412Z }, 2024-06-26T07:05:05.1118654Z { 2024-06-26T07:05:05.1119080Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1119652Z "size": 702, 2024-06-26T07:05:05.1120237Z "digest": "sha256:df546d7b3e34396a6f2b51d8c88be976eca017bc99168d838c2c7bacabab9ec4" 2024-06-26T07:05:05.1120842Z }, 2024-06-26T07:05:05.1121088Z { 2024-06-26T07:05:05.1121523Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1122067Z "size": 138, 2024-06-26T07:05:05.1122599Z "digest": "sha256:b599c5a8c7cb461cbd7b3c98b99960b8eb04506e05e79db1cc0cfadb14a47e91" 2024-06-26T07:05:05.1123218Z }, 2024-06-26T07:05:05.1123465Z { 2024-06-26T07:05:05.1123889Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1124432Z "size": 120, 2024-06-26T07:05:05.1124979Z "digest": "sha256:e08e88c1366827455ee7ddbf92b6ae615ceb3cbd3fb11cd03ddd31bd3fa94a9c" 2024-06-26T07:05:05.1125662Z }, 2024-06-26T07:05:05.1125904Z { 2024-06-26T07:05:05.1126328Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1126877Z "size": 1904157495, 2024-06-26T07:05:05.1127444Z "digest": "sha256:12ba7431ff38de8cf6af3052a2a52e79f4e712b8c99f5bafde3c20e63b1f570f" 2024-06-26T07:05:05.1128066Z }, 2024-06-26T07:05:05.1128309Z { 2024-06-26T07:05:05.1128733Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1129284Z "size": 172, 2024-06-26T07:05:05.1129815Z "digest": "sha256:cf7c2cb896cba6a594028cc0fd246e127a2f4481d48905a3aa12c5f5872332d4" 2024-06-26T07:05:05.1130484Z }, 2024-06-26T07:05:05.1130728Z { 2024-06-26T07:05:05.1131148Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1131694Z "size": 908, 2024-06-26T07:05:05.1132249Z "digest": "sha256:3a778ddfac2af5b3a11f49ddf2f3f1ad1731f74ba691f434ab69966d1e2a189f" 2024-06-26T07:05:05.1132934Z }, 2024-06-26T07:05:05.1133374Z { 2024-06-26T07:05:05.1133806Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1134354Z "size": 702, 2024-06-26T07:05:05.1134888Z "digest": "sha256:df546d7b3e34396a6f2b51d8c88be976eca017bc99168d838c2c7bacabab9ec4" 2024-06-26T07:05:05.1135493Z }, 2024-06-26T07:05:05.1135738Z { 2024-06-26T07:05:05.1136165Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1136716Z "size": 134, 2024-06-26T07:05:05.1137242Z "digest": "sha256:236c8f0245f4b40616a4322eaf1e1b3e178d5990db1fcaba39622ea4e79c06a1" 2024-06-26T07:05:05.1137853Z }, 2024-06-26T07:05:05.1138098Z { 2024-06-26T07:05:05.1138514Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1139058Z "size": 32, 2024-06-26T07:05:05.1139589Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-06-26T07:05:05.1140204Z }, 2024-06-26T07:05:05.1140448Z { 2024-06-26T07:05:05.1140871Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1141413Z "size": 156, 2024-06-26T07:05:05.1141959Z "digest": "sha256:dda1ce302b9a9df0c8f1145d2e3eaa03c96909bb45a792451f1fcb555b06738d" 2024-06-26T07:05:05.1142573Z }, 2024-06-26T07:05:05.1142823Z { 2024-06-26T07:05:05.1143247Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1143787Z "size": 1841, 2024-06-26T07:05:05.1144415Z "digest": "sha256:e797fe86caef19319e03f8dca92cf96838ab3bb3644f4447c6dfc04230118afa" 2024-06-26T07:05:05.1145031Z }, 2024-06-26T07:05:05.1145278Z { 2024-06-26T07:05:05.1145693Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1146246Z "size": 7529784, 2024-06-26T07:05:05.1146784Z "digest": "sha256:967190076fc0ab2bb2fc0d74e58edd3d662a537d702ff3f8b6e876230154a16f" 2024-06-26T07:05:05.1147399Z }, 2024-06-26T07:05:05.1147635Z { 2024-06-26T07:05:05.1148062Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1148604Z "size": 165, 2024-06-26T07:05:05.1149134Z "digest": "sha256:4fb0a83f06855534ef82b80dcf7c685303edb2bcbd446196066dc2ad2dd71281" 2024-06-26T07:05:05.1149738Z }, 2024-06-26T07:05:05.1149984Z { 2024-06-26T07:05:05.1150408Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1150945Z "size": 7944, 2024-06-26T07:05:05.1151484Z "digest": "sha256:68af2ec4e30a33f26947ece9f3a31b7d3b04c2bca5865d4b48618457832a1da2" 2024-06-26T07:05:05.1152100Z }, 2024-06-26T07:05:05.1152344Z { 2024-06-26T07:05:05.1152760Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1153307Z "size": 8070, 2024-06-26T07:05:05.1153838Z "digest": "sha256:cc91933e985a044c6df53caa15488d2285896f5e991f38ec068c253ceec53f14" 2024-06-26T07:05:05.1154443Z }, 2024-06-26T07:05:05.1154678Z { 2024-06-26T07:05:05.1155107Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1155655Z "size": 303, 2024-06-26T07:05:05.1156178Z "digest": "sha256:9f3187916e7dcad33cc572f8f0e949d2f507b887f99cfd6acefd14826b44960d" 2024-06-26T07:05:05.1156791Z }, 2024-06-26T07:05:05.1157033Z { 2024-06-26T07:05:05.1157456Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1157997Z "size": 7629071, 2024-06-26T07:05:05.1158521Z "digest": "sha256:52608399485738d10d779254946c9e1d536010dd45593c69bf1eb9f62f85dc24" 2024-06-26T07:05:05.1159116Z }, 2024-06-26T07:05:05.1159360Z { 2024-06-26T07:05:05.1159776Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1160320Z "size": 108, 2024-06-26T07:05:05.1160855Z "digest": "sha256:05a6f6dcc1c00bac6660923a22adc7d7c34416718f8c89daf9b3351d9365f694" 2024-06-26T07:05:05.1161463Z }, 2024-06-26T07:05:05.1161699Z { 2024-06-26T07:05:05.1162123Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1162750Z "size": 54145775, 2024-06-26T07:05:05.1163300Z "digest": "sha256:6bc9dc8315b09b27c976bfba9700767ba412d72fd0528b18bbe8f8e62005ec22" 2024-06-26T07:05:05.1163913Z }, 2024-06-26T07:05:05.1164159Z { 2024-06-26T07:05:05.1164582Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1165185Z "size": 474, 2024-06-26T07:05:05.1165716Z "digest": "sha256:1b0e27c35f07b3fbf0aeb548d1949bf1d60a420136da21789d94d196c891d981" 2024-06-26T07:05:05.1166338Z }, 2024-06-26T07:05:05.1166583Z { 2024-06-26T07:05:05.1166998Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1167547Z "size": 1374858747, 2024-06-26T07:05:05.1168093Z "digest": "sha256:95237e7311a1c5ce6937db7196c866632f44e8788514a5c0eb4a3f04da4017e6" 2024-06-26T07:05:05.1168686Z }, 2024-06-26T07:05:05.1168930Z { 2024-06-26T07:05:05.1169354Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1169896Z "size": 106, 2024-06-26T07:05:05.1170436Z "digest": "sha256:789eff6c51aada70bf75eb1acafed63c0d839b768638001500616ff6e53b854a" 2024-06-26T07:05:05.1171056Z }, 2024-06-26T07:05:05.1171299Z { 2024-06-26T07:05:05.1171730Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1172271Z "size": 558, 2024-06-26T07:05:05.1172817Z "digest": "sha256:de0f8a8c45c6077b3c5ba3b84d7f07de98353fd618dad9a1e2f368ffe00493c7" 2024-06-26T07:05:05.1173650Z }, 2024-06-26T07:05:05.1173987Z { 2024-06-26T07:05:05.1174407Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1174958Z "size": 46248513, 2024-06-26T07:05:05.1175501Z "digest": "sha256:2060028f74888d218bebdd10d723f66c33ee1c708935c4ffd4654d34912ac4dc" 2024-06-26T07:05:05.1176093Z }, 2024-06-26T07:05:05.1176338Z { 2024-06-26T07:05:05.1176761Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1177304Z "size": 111, 2024-06-26T07:05:05.1177830Z "digest": "sha256:e412c7f3b2ded440992955bd92512345cbece8a8894cd3592f714ebc758ad1a0" 2024-06-26T07:05:05.1178437Z }, 2024-06-26T07:05:05.1178687Z { 2024-06-26T07:05:05.1179113Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1179656Z "size": 32, 2024-06-26T07:05:05.1180194Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-06-26T07:05:05.1180808Z }, 2024-06-26T07:05:05.1181053Z { 2024-06-26T07:05:05.1181478Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1182028Z "size": 32, 2024-06-26T07:05:05.1182560Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-06-26T07:05:05.1183167Z }, 2024-06-26T07:05:05.1183411Z { 2024-06-26T07:05:05.1183838Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1184380Z "size": 32, 2024-06-26T07:05:05.1184908Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-06-26T07:05:05.1185518Z }, 2024-06-26T07:05:05.1185763Z { 2024-06-26T07:05:05.1186188Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:05:05.1186727Z "size": 32, 2024-06-26T07:05:05.1187254Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-06-26T07:05:05.1187862Z } 2024-06-26T07:05:05.1188098Z ] 2024-06-26T07:05:05.1188341Z } 2024-06-26T07:05:05.1323275Z ##[group]Run tag=${ECR_DOCKER_IMAGE##*/} 2024-06-26T07:05:05.1323816Z tag=${ECR_DOCKER_IMAGE##*/} 2024-06-26T07:05:05.1324365Z echo "docker pull ghcr.io/pytorch/ci-image:${tag/:/-}" 2024-06-26T07:05:05.1332331Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:05:05.1332825Z env: 2024-06-26T07:05:05.1333260Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:05:05.1334412Z ECR_DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:05:05.1335579Z ##[endgroup] 2024-06-26T07:05:05.1362056Z docker pull ghcr.io/pytorch/ci-image:pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks-91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:05:05.1410957Z ##[group]Run pytorch/test-infra/.github/actions/pull-docker-image@main 2024-06-26T07:05:05.1411525Z with: 2024-06-26T07:05:05.1412598Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:05:05.1414057Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:05:05.1414572Z env: 2024-06-26T07:05:05.1414847Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:05:05.1415194Z ##[endgroup] 2024-06-26T07:05:05.1430097Z ##[group]Run set -x 2024-06-26T07:05:05.1430438Z set -x 2024-06-26T07:05:05.1430733Z set +e 2024-06-26T07:05:05.1431022Z  2024-06-26T07:05:05.1431298Z login() { 2024-06-26T07:05:05.1431952Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2024-06-26T07:05:05.1432662Z } 2024-06-26T07:05:05.1432937Z  2024-06-26T07:05:05.1433229Z retry () { 2024-06-26T07:05:05.1433616Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2024-06-26T07:05:05.1434053Z } 2024-06-26T07:05:05.1434326Z  2024-06-26T07:05:05.1434637Z retry login "${DOCKER_REGISTRY}" 2024-06-26T07:05:05.1435147Z  2024-06-26T07:05:05.1435420Z set -e 2024-06-26T07:05:05.1435882Z # ignore output since only exit code is used for conditional 2024-06-26T07:05:05.1436573Z # only pull docker image if it's not available locally 2024-06-26T07:05:05.1437324Z if ! docker inspect --type=image "${DOCKER_IMAGE}" >/dev/null 2>/dev/null; then 2024-06-26T07:05:05.1438016Z  retry docker pull "${DOCKER_IMAGE}" 2024-06-26T07:05:05.1438450Z fi 2024-06-26T07:05:05.1446010Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:05:05.1446492Z env: 2024-06-26T07:05:05.1446764Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:05:05.1447897Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:05:05.1449183Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:05:05.1449696Z ##[endgroup] 2024-06-26T07:05:05.1467969Z + set +e 2024-06-26T07:05:05.1468462Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:05:05.1469086Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:05:05.1470572Z + aws ecr get-login-password --region us-east-1 2024-06-26T07:05:05.1471333Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:05:05.5535498Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-06-26T07:05:05.5536500Z Configure a credential helper to remove this warning. See 2024-06-26T07:05:05.5537621Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-06-26T07:05:05.5538377Z 2024-06-26T07:05:05.5538576Z Login Succeeded 2024-06-26T07:05:05.5546557Z + set -e 2024-06-26T07:05:05.5547867Z + docker inspect --type=image 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:05:05.5674153Z + retry docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:05:05.5676280Z + docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:05:05.8007540Z 91382da70d5719cd7007b6b80b71d2f48398f6b7: Pulling from pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks 2024-06-26T07:05:05.8010493Z 7a2c55901189: Pulling fs layer 2024-06-26T07:05:05.8011629Z 224fe954d725: Pulling fs layer 2024-06-26T07:05:05.8012580Z 75722010b82e: Pulling fs layer 2024-06-26T07:05:05.8013656Z d527cbbb87e3: Pulling fs layer 2024-06-26T07:05:05.8014342Z b57676e46aee: Pulling fs layer 2024-06-26T07:05:05.8015056Z a8c1e85b5e14: Pulling fs layer 2024-06-26T07:05:05.8015638Z a41a8d1c11c8: Pulling fs layer 2024-06-26T07:05:05.8016101Z 0c1227890755: Pulling fs layer 2024-06-26T07:05:05.8016640Z d8d1234baab3: Pulling fs layer 2024-06-26T07:05:05.8017163Z 7ed32bc8e469: Pulling fs layer 2024-06-26T07:05:05.8017673Z ec1e7978c1fe: Pulling fs layer 2024-06-26T07:05:05.8018100Z 309b872da805: Pulling fs layer 2024-06-26T07:05:05.8018465Z e82932cb002c: Pulling fs layer 2024-06-26T07:05:05.8018920Z ca9dd73e3e93: Pulling fs layer 2024-06-26T07:05:05.8019418Z 16d76a79d5d6: Pulling fs layer 2024-06-26T07:05:05.8019938Z 4bdf41c9ecbe: Pulling fs layer 2024-06-26T07:05:05.8020452Z f4863801e30c: Pulling fs layer 2024-06-26T07:05:05.8020965Z d37dd9ed8948: Pulling fs layer 2024-06-26T07:05:05.8021383Z cf2f34f225db: Pulling fs layer 2024-06-26T07:05:05.8021757Z df546d7b3e34: Pulling fs layer 2024-06-26T07:05:05.8022231Z 3d914950f8ad: Pulling fs layer 2024-06-26T07:05:05.8022697Z 96d0e2032184: Pulling fs layer 2024-06-26T07:05:05.8023067Z 06e12ce59790: Pulling fs layer 2024-06-26T07:05:05.8023569Z e82932cb002c: Waiting 2024-06-26T07:05:05.8023885Z ec1e7978c1fe: Waiting 2024-06-26T07:05:05.8024198Z 0c1227890755: Waiting 2024-06-26T07:05:05.8024502Z ca9dd73e3e93: Waiting 2024-06-26T07:05:05.8024831Z ed712f63cde7: Pulling fs layer 2024-06-26T07:05:05.8025187Z 309b872da805: Waiting 2024-06-26T07:05:05.8025567Z a97a71ef8a4e: Pulling fs layer 2024-06-26T07:05:05.8025945Z 16d76a79d5d6: Waiting 2024-06-26T07:05:05.8026259Z d8d1234baab3: Waiting 2024-06-26T07:05:05.8026585Z 25cd0c482ad6: Pulling fs layer 2024-06-26T07:05:05.8026944Z d527cbbb87e3: Waiting 2024-06-26T07:05:05.8027267Z 9bf94bc45658: Pulling fs layer 2024-06-26T07:05:05.8027673Z cf2f34f225db: Waiting 2024-06-26T07:05:05.8027981Z b57676e46aee: Waiting 2024-06-26T07:05:05.8028285Z a8c1e85b5e14: Waiting 2024-06-26T07:05:05.8028592Z 4bdf41c9ecbe: Waiting 2024-06-26T07:05:05.8028903Z a41a8d1c11c8: Waiting 2024-06-26T07:05:05.8029227Z de45a14c9b22: Pulling fs layer 2024-06-26T07:05:05.8029636Z f4863801e30c: Waiting 2024-06-26T07:05:05.8030156Z e99241e77209: Pulling fs layer 2024-06-26T07:05:05.8030664Z df546d7b3e34: Waiting 2024-06-26T07:05:05.8031122Z 35e8f4e2a42f: Pulling fs layer 2024-06-26T07:05:05.8031471Z 96d0e2032184: Waiting 2024-06-26T07:05:05.8031794Z a823ffa4c541: Pulling fs layer 2024-06-26T07:05:05.8032146Z 3d914950f8ad: Waiting 2024-06-26T07:05:05.8032457Z 7ed32bc8e469: Waiting 2024-06-26T07:05:05.8032776Z 44ba272eae20: Pulling fs layer 2024-06-26T07:05:05.8033148Z da02d278e524: Pulling fs layer 2024-06-26T07:05:05.8033591Z 73a0ce681c29: Pulling fs layer 2024-06-26T07:05:05.8034107Z a97a71ef8a4e: Waiting 2024-06-26T07:05:05.8034552Z 06e12ce59790: Waiting 2024-06-26T07:05:05.8034922Z 9bf94bc45658: Waiting 2024-06-26T07:05:05.8035255Z 49737bd5ae70: Pulling fs layer 2024-06-26T07:05:05.8035668Z 9cd4c745f8e4: Pulling fs layer 2024-06-26T07:05:05.8036178Z b2950a036534: Pulling fs layer 2024-06-26T07:05:05.8036680Z 25e19d81d9fc: Pulling fs layer 2024-06-26T07:05:05.8037181Z de45a14c9b22: Waiting 2024-06-26T07:05:05.8037578Z 60156b40fcbe: Pulling fs layer 2024-06-26T07:05:05.8038124Z 7a868239227f: Pulling fs layer 2024-06-26T07:05:05.8038630Z ed712f63cde7: Waiting 2024-06-26T07:05:05.8039020Z 83911d7c7ecf: Pulling fs layer 2024-06-26T07:05:05.8039389Z b3c5d66c679f: Pulling fs layer 2024-06-26T07:05:05.8039755Z 84b2c7a89982: Pulling fs layer 2024-06-26T07:05:05.8040143Z e99241e77209: Waiting 2024-06-26T07:05:05.8040460Z c1068d03a811: Pulling fs layer 2024-06-26T07:05:05.8040820Z 671b4a301d81: Pulling fs layer 2024-06-26T07:05:05.8041179Z 67760cf5ec46: Pulling fs layer 2024-06-26T07:05:05.8041573Z ddc9740bcea2: Pulling fs layer 2024-06-26T07:05:05.8041936Z fb2e97768560: Pulling fs layer 2024-06-26T07:05:05.8042279Z 44ba272eae20: Waiting 2024-06-26T07:05:05.8042585Z 60156b40fcbe: Waiting 2024-06-26T07:05:05.8043052Z 49737bd5ae70: Waiting 2024-06-26T07:05:05.8043367Z a823ffa4c541: Waiting 2024-06-26T07:05:05.8043679Z da02d278e524: Waiting 2024-06-26T07:05:05.8043989Z d37dd9ed8948: Waiting 2024-06-26T07:05:05.8044296Z 25e19d81d9fc: Waiting 2024-06-26T07:05:05.8044601Z 7a868239227f: Waiting 2024-06-26T07:05:05.8044907Z 73a0ce681c29: Waiting 2024-06-26T07:05:05.8045355Z b2950a036534: Waiting 2024-06-26T07:05:05.8045660Z 9cd4c745f8e4: Waiting 2024-06-26T07:05:05.8045967Z b3c5d66c679f: Waiting 2024-06-26T07:05:05.8046273Z 83911d7c7ecf: Waiting 2024-06-26T07:05:05.8046578Z 67760cf5ec46: Waiting 2024-06-26T07:05:05.8046878Z 84b2c7a89982: Waiting 2024-06-26T07:05:05.8047187Z ddc9740bcea2: Waiting 2024-06-26T07:05:05.8047495Z 671b4a301d81: Waiting 2024-06-26T07:05:05.8047806Z 35e8f4e2a42f: Waiting 2024-06-26T07:05:05.8048126Z b599c5a8c7cb: Pulling fs layer 2024-06-26T07:05:05.8048498Z e08e88c13668: Pulling fs layer 2024-06-26T07:05:05.8048853Z fb2e97768560: Waiting 2024-06-26T07:05:05.8049174Z 12ba7431ff38: Pulling fs layer 2024-06-26T07:05:05.8049566Z cf7c2cb896cb: Pulling fs layer 2024-06-26T07:05:05.8049986Z 3a778ddfac2a: Pulling fs layer 2024-06-26T07:05:05.8050440Z 236c8f0245f4: Pulling fs layer 2024-06-26T07:05:05.8050788Z b599c5a8c7cb: Waiting 2024-06-26T07:05:05.8051195Z 4f4fb700ef54: Pulling fs layer 2024-06-26T07:05:05.8051565Z dda1ce302b9a: Pulling fs layer 2024-06-26T07:05:05.8051914Z e08e88c13668: Waiting 2024-06-26T07:05:05.8052241Z e797fe86caef: Pulling fs layer 2024-06-26T07:05:05.8052606Z 967190076fc0: Pulling fs layer 2024-06-26T07:05:05.8052974Z 4fb0a83f0685: Pulling fs layer 2024-06-26T07:05:05.8053776Z 68af2ec4e30a: Pulling fs layer 2024-06-26T07:05:05.8054146Z cc91933e985a: Pulling fs layer 2024-06-26T07:05:05.8054508Z 9f3187916e7d: Pulling fs layer 2024-06-26T07:05:05.8054875Z 526083994857: Pulling fs layer 2024-06-26T07:05:05.8055233Z 05a6f6dcc1c0: Pulling fs layer 2024-06-26T07:05:05.8055598Z 6bc9dc8315b0: Pulling fs layer 2024-06-26T07:05:05.8055948Z 12ba7431ff38: Waiting 2024-06-26T07:05:05.8056270Z 1b0e27c35f07: Pulling fs layer 2024-06-26T07:05:05.8056633Z 95237e7311a1: Pulling fs layer 2024-06-26T07:05:05.8056995Z 789eff6c51aa: Pulling fs layer 2024-06-26T07:05:05.8057342Z 526083994857: Waiting 2024-06-26T07:05:05.8057657Z de0f8a8c45c6: Pulling fs layer 2024-06-26T07:05:05.8058030Z 2060028f7488: Pulling fs layer 2024-06-26T07:05:05.8058376Z 3a778ddfac2a: Waiting 2024-06-26T07:05:05.8058701Z e412c7f3b2de: Pulling fs layer 2024-06-26T07:05:05.8059045Z 4fb0a83f0685: Waiting 2024-06-26T07:05:05.8059351Z cc91933e985a: Waiting 2024-06-26T07:05:05.8059658Z 9f3187916e7d: Waiting 2024-06-26T07:05:05.8059966Z 68af2ec4e30a: Waiting 2024-06-26T07:05:05.8060275Z 236c8f0245f4: Waiting 2024-06-26T07:05:05.8060583Z 05a6f6dcc1c0: Waiting 2024-06-26T07:05:05.8060890Z de0f8a8c45c6: Waiting 2024-06-26T07:05:05.8061193Z e412c7f3b2de: Waiting 2024-06-26T07:05:05.8061499Z 6bc9dc8315b0: Waiting 2024-06-26T07:05:05.8061803Z 1b0e27c35f07: Waiting 2024-06-26T07:05:05.8062097Z 2060028f7488: Waiting 2024-06-26T07:05:05.8062404Z 967190076fc0: Waiting 2024-06-26T07:05:05.8062707Z e797fe86caef: Waiting 2024-06-26T07:05:05.8063013Z 789eff6c51aa: Waiting 2024-06-26T07:05:05.8063312Z 95237e7311a1: Waiting 2024-06-26T07:05:05.8063616Z 4f4fb700ef54: Waiting 2024-06-26T07:05:05.8063926Z dda1ce302b9a: Waiting 2024-06-26T07:05:05.9336452Z 224fe954d725: Download complete 2024-06-26T07:05:06.0059466Z d527cbbb87e3: Verifying Checksum 2024-06-26T07:05:06.0059957Z d527cbbb87e3: Download complete 2024-06-26T07:05:06.0838338Z b57676e46aee: Verifying Checksum 2024-06-26T07:05:06.0838861Z b57676e46aee: Download complete 2024-06-26T07:05:06.1369300Z 7a2c55901189: Verifying Checksum 2024-06-26T07:05:06.1369905Z 7a2c55901189: Download complete 2024-06-26T07:05:06.2137263Z a41a8d1c11c8: Download complete 2024-06-26T07:05:06.2875724Z 0c1227890755: Verifying Checksum 2024-06-26T07:05:06.2876277Z 0c1227890755: Download complete 2024-06-26T07:05:06.3561006Z d8d1234baab3: Verifying Checksum 2024-06-26T07:05:06.3561651Z d8d1234baab3: Download complete 2024-06-26T07:05:06.4311163Z 75722010b82e: Verifying Checksum 2024-06-26T07:05:06.4311853Z 75722010b82e: Download complete 2024-06-26T07:05:06.5187803Z ec1e7978c1fe: Download complete 2024-06-26T07:05:06.5888219Z 309b872da805: Verifying Checksum 2024-06-26T07:05:06.5888726Z 309b872da805: Download complete 2024-06-26T07:05:07.1649427Z 7a2c55901189: Pull complete 2024-06-26T07:05:07.4531299Z 224fe954d725: Pull complete 2024-06-26T07:05:08.3804575Z 75722010b82e: Pull complete 2024-06-26T07:05:08.4282582Z d527cbbb87e3: Pull complete 2024-06-26T07:05:08.4868159Z b57676e46aee: Pull complete 2024-06-26T07:05:09.1161847Z e82932cb002c: Verifying Checksum 2024-06-26T07:05:09.1162372Z e82932cb002c: Download complete 2024-06-26T07:05:09.1867571Z ca9dd73e3e93: Download complete 2024-06-26T07:05:09.2633866Z 16d76a79d5d6: Verifying Checksum 2024-06-26T07:05:09.2634572Z 16d76a79d5d6: Download complete 2024-06-26T07:05:09.3296934Z 4bdf41c9ecbe: Download complete 2024-06-26T07:05:10.2942271Z f4863801e30c: Verifying Checksum 2024-06-26T07:05:10.2942767Z f4863801e30c: Download complete 2024-06-26T07:05:10.3645021Z d37dd9ed8948: Verifying Checksum 2024-06-26T07:05:10.3645742Z d37dd9ed8948: Download complete 2024-06-26T07:05:10.4492333Z cf2f34f225db: Verifying Checksum 2024-06-26T07:05:10.4493017Z cf2f34f225db: Download complete 2024-06-26T07:05:10.5114415Z df546d7b3e34: Verifying Checksum 2024-06-26T07:05:10.5114912Z df546d7b3e34: Download complete 2024-06-26T07:05:19.4400007Z a8c1e85b5e14: Verifying Checksum 2024-06-26T07:05:19.4400638Z a8c1e85b5e14: Download complete 2024-06-26T07:05:19.5137554Z 96d0e2032184: Verifying Checksum 2024-06-26T07:05:19.5138256Z 96d0e2032184: Download complete 2024-06-26T07:05:19.6006935Z 06e12ce59790: Verifying Checksum 2024-06-26T07:05:19.6007607Z 06e12ce59790: Download complete 2024-06-26T07:05:19.6761076Z ed712f63cde7: Verifying Checksum 2024-06-26T07:05:19.6761690Z ed712f63cde7: Download complete 2024-06-26T07:05:19.7580891Z a97a71ef8a4e: Verifying Checksum 2024-06-26T07:05:19.7581485Z a97a71ef8a4e: Download complete 2024-06-26T07:05:19.8328397Z 25cd0c482ad6: Download complete 2024-06-26T07:05:21.2029730Z 9bf94bc45658: Verifying Checksum 2024-06-26T07:05:21.2867210Z 9bf94bc45658: Download complete 2024-06-26T07:05:21.2867818Z de45a14c9b22: Verifying Checksum 2024-06-26T07:05:21.2868382Z de45a14c9b22: Download complete 2024-06-26T07:05:21.3731345Z e99241e77209: Verifying Checksum 2024-06-26T07:05:21.3731897Z e99241e77209: Download complete 2024-06-26T07:05:21.4475391Z 35e8f4e2a42f: Verifying Checksum 2024-06-26T07:05:21.4475946Z 35e8f4e2a42f: Download complete 2024-06-26T07:05:21.5397634Z a823ffa4c541: Verifying Checksum 2024-06-26T07:05:21.5398239Z a823ffa4c541: Download complete 2024-06-26T07:05:21.6133685Z 44ba272eae20: Verifying Checksum 2024-06-26T07:05:21.6134311Z 44ba272eae20: Download complete 2024-06-26T07:05:26.1584195Z da02d278e524: Verifying Checksum 2024-06-26T07:05:26.1584656Z da02d278e524: Download complete 2024-06-26T07:05:26.2417915Z 73a0ce681c29: Download complete 2024-06-26T07:05:26.3220557Z 49737bd5ae70: Download complete 2024-06-26T07:05:26.7384507Z 9cd4c745f8e4: Verifying Checksum 2024-06-26T07:05:26.8219534Z 9cd4c745f8e4: Download complete 2024-06-26T07:05:26.8220003Z b2950a036534: Verifying Checksum 2024-06-26T07:05:26.8220479Z b2950a036534: Download complete 2024-06-26T07:05:26.9112719Z 25e19d81d9fc: Verifying Checksum 2024-06-26T07:05:26.9113306Z 25e19d81d9fc: Download complete 2024-06-26T07:05:27.1783877Z 60156b40fcbe: Verifying Checksum 2024-06-26T07:05:27.1784548Z 60156b40fcbe: Download complete 2024-06-26T07:05:27.2535595Z 7a868239227f: Download complete 2024-06-26T07:05:27.3359581Z 83911d7c7ecf: Download complete 2024-06-26T07:05:27.4120801Z b3c5d66c679f: Verifying Checksum 2024-06-26T07:05:27.4121273Z b3c5d66c679f: Download complete 2024-06-26T07:05:31.6909131Z 7ed32bc8e469: Verifying Checksum 2024-06-26T07:05:31.6909614Z 7ed32bc8e469: Download complete 2024-06-26T07:05:31.7772584Z c1068d03a811: Verifying Checksum 2024-06-26T07:05:31.7773036Z c1068d03a811: Download complete 2024-06-26T07:05:31.8604620Z 671b4a301d81: Verifying Checksum 2024-06-26T07:05:31.8605292Z 671b4a301d81: Download complete 2024-06-26T07:05:32.3551434Z 67760cf5ec46: Verifying Checksum 2024-06-26T07:05:32.3551984Z 67760cf5ec46: Download complete 2024-06-26T07:05:32.3899193Z a8c1e85b5e14: Pull complete 2024-06-26T07:05:32.4376611Z ddc9740bcea2: Download complete 2024-06-26T07:05:32.5163698Z fb2e97768560: Verifying Checksum 2024-06-26T07:05:32.5164125Z fb2e97768560: Download complete 2024-06-26T07:05:32.5951691Z b599c5a8c7cb: Verifying Checksum 2024-06-26T07:05:32.5952114Z b599c5a8c7cb: Download complete 2024-06-26T07:05:32.6166505Z a41a8d1c11c8: Pull complete 2024-06-26T07:05:32.6821324Z e08e88c13668: Verifying Checksum 2024-06-26T07:05:32.6821798Z e08e88c13668: Download complete 2024-06-26T07:05:32.7901714Z 0c1227890755: Pull complete 2024-06-26T07:05:33.0222502Z d8d1234baab3: Pull complete 2024-06-26T07:05:38.4212078Z 3d914950f8ad: Verifying Checksum 2024-06-26T07:05:38.4212742Z 3d914950f8ad: Download complete 2024-06-26T07:05:38.5156869Z cf7c2cb896cb: Verifying Checksum 2024-06-26T07:05:38.5157363Z cf7c2cb896cb: Download complete 2024-06-26T07:05:38.5951700Z 3a778ddfac2a: Verifying Checksum 2024-06-26T07:05:38.5952240Z 3a778ddfac2a: Download complete 2024-06-26T07:05:38.6761112Z 236c8f0245f4: Verifying Checksum 2024-06-26T07:05:38.6761602Z 236c8f0245f4: Download complete 2024-06-26T07:05:38.6884732Z 4f4fb700ef54: Verifying Checksum 2024-06-26T07:05:38.6885280Z 4f4fb700ef54: Download complete 2024-06-26T07:05:38.7767457Z dda1ce302b9a: Download complete 2024-06-26T07:05:38.8556700Z e797fe86caef: Verifying Checksum 2024-06-26T07:05:38.8557256Z e797fe86caef: Download complete 2024-06-26T07:05:38.9876336Z 967190076fc0: Download complete 2024-06-26T07:05:39.1180530Z 4fb0a83f0685: Verifying Checksum 2024-06-26T07:05:39.1181058Z 4fb0a83f0685: Download complete 2024-06-26T07:05:39.1969401Z 68af2ec4e30a: Verifying Checksum 2024-06-26T07:05:39.1970025Z 68af2ec4e30a: Download complete 2024-06-26T07:05:39.2750150Z cc91933e985a: Download complete 2024-06-26T07:05:39.3570476Z 9f3187916e7d: Verifying Checksum 2024-06-26T07:05:39.3571040Z 9f3187916e7d: Download complete 2024-06-26T07:05:39.4965655Z 526083994857: Verifying Checksum 2024-06-26T07:05:39.4966205Z 526083994857: Download complete 2024-06-26T07:05:39.5867706Z 05a6f6dcc1c0: Verifying Checksum 2024-06-26T07:05:39.5868118Z 05a6f6dcc1c0: Download complete 2024-06-26T07:05:40.2238156Z 6bc9dc8315b0: Verifying Checksum 2024-06-26T07:05:40.2238686Z 6bc9dc8315b0: Download complete 2024-06-26T07:05:40.3068499Z 1b0e27c35f07: Download complete 2024-06-26T07:06:01.8596357Z 12ba7431ff38: Verifying Checksum 2024-06-26T07:06:01.8597821Z 12ba7431ff38: Download complete 2024-06-26T07:06:01.9483789Z 789eff6c51aa: Download complete 2024-06-26T07:06:02.0136832Z de0f8a8c45c6: Download complete 2024-06-26T07:06:03.9568678Z 2060028f7488: Verifying Checksum 2024-06-26T07:06:03.9569134Z 2060028f7488: Download complete 2024-06-26T07:06:04.0472656Z e412c7f3b2de: Verifying Checksum 2024-06-26T07:06:04.0473101Z e412c7f3b2de: Download complete 2024-06-26T07:06:07.9713227Z 95237e7311a1: Verifying Checksum 2024-06-26T07:06:07.9713689Z 95237e7311a1: Download complete 2024-06-26T07:06:30.5695897Z 84b2c7a89982: Verifying Checksum 2024-06-26T07:06:30.5696450Z 84b2c7a89982: Download complete 2024-06-26T07:06:48.2146119Z 7ed32bc8e469: Pull complete 2024-06-26T07:06:48.4171189Z ec1e7978c1fe: Pull complete 2024-06-26T07:06:48.6431395Z 309b872da805: Pull complete 2024-06-26T07:06:56.0123448Z e82932cb002c: Pull complete 2024-06-26T07:06:56.2237750Z ca9dd73e3e93: Pull complete 2024-06-26T07:06:56.4496420Z 16d76a79d5d6: Pull complete 2024-06-26T07:06:56.6800957Z 4bdf41c9ecbe: Pull complete 2024-06-26T07:06:59.1026799Z f4863801e30c: Pull complete 2024-06-26T07:06:59.3292210Z d37dd9ed8948: Pull complete 2024-06-26T07:06:59.5660421Z cf2f34f225db: Pull complete 2024-06-26T07:06:59.7875928Z df546d7b3e34: Pull complete 2024-06-26T07:07:49.5252894Z 3d914950f8ad: Pull complete 2024-06-26T07:07:49.7297193Z 96d0e2032184: Pull complete 2024-06-26T07:07:49.9082846Z 06e12ce59790: Pull complete 2024-06-26T07:07:50.0522321Z ed712f63cde7: Pull complete 2024-06-26T07:07:50.1521795Z a97a71ef8a4e: Pull complete 2024-06-26T07:07:50.2683514Z 25cd0c482ad6: Pull complete 2024-06-26T07:07:53.7328003Z 9bf94bc45658: Pull complete 2024-06-26T07:07:53.9465227Z de45a14c9b22: Pull complete 2024-06-26T07:07:54.1682208Z e99241e77209: Pull complete 2024-06-26T07:07:54.3928128Z 35e8f4e2a42f: Pull complete 2024-06-26T07:07:54.6213007Z a823ffa4c541: Pull complete 2024-06-26T07:07:54.8333329Z 44ba272eae20: Pull complete 2024-06-26T07:08:03.1310348Z da02d278e524: Pull complete 2024-06-26T07:08:03.3480087Z 73a0ce681c29: Pull complete 2024-06-26T07:08:03.4504126Z 49737bd5ae70: Pull complete 2024-06-26T07:08:04.4058514Z 9cd4c745f8e4: Pull complete 2024-06-26T07:08:04.5514581Z b2950a036534: Pull complete 2024-06-26T07:08:04.7223613Z 25e19d81d9fc: Pull complete 2024-06-26T07:08:05.1853684Z 60156b40fcbe: Pull complete 2024-06-26T07:08:05.3935804Z 7a868239227f: Pull complete 2024-06-26T07:08:05.7826499Z 83911d7c7ecf: Pull complete 2024-06-26T07:08:06.0051431Z b3c5d66c679f: Pull complete 2024-06-26T07:08:45.1403945Z 84b2c7a89982: Pull complete 2024-06-26T07:08:45.3566335Z c1068d03a811: Pull complete 2024-06-26T07:08:45.5789282Z 671b4a301d81: Pull complete 2024-06-26T07:08:47.5921207Z 67760cf5ec46: Pull complete 2024-06-26T07:08:47.6375774Z ddc9740bcea2: Pull complete 2024-06-26T07:08:47.6771880Z fb2e97768560: Pull complete 2024-06-26T07:08:47.7780019Z b599c5a8c7cb: Pull complete 2024-06-26T07:08:47.8174354Z e08e88c13668: Pull complete 2024-06-26T07:09:22.3081654Z 12ba7431ff38: Pull complete 2024-06-26T07:09:22.5312544Z cf7c2cb896cb: Pull complete 2024-06-26T07:09:22.7563366Z 3a778ddfac2a: Pull complete 2024-06-26T07:09:23.2082316Z 236c8f0245f4: Pull complete 2024-06-26T07:09:23.4186145Z 4f4fb700ef54: Pull complete 2024-06-26T07:09:23.6303661Z dda1ce302b9a: Pull complete 2024-06-26T07:09:23.8435943Z e797fe86caef: Pull complete 2024-06-26T07:09:24.1401859Z 967190076fc0: Pull complete 2024-06-26T07:09:24.3343485Z 4fb0a83f0685: Pull complete 2024-06-26T07:09:24.5358651Z 68af2ec4e30a: Pull complete 2024-06-26T07:09:24.7478147Z cc91933e985a: Pull complete 2024-06-26T07:09:24.9726796Z 9f3187916e7d: Pull complete 2024-06-26T07:09:26.0862369Z 526083994857: Pull complete 2024-06-26T07:09:26.3124627Z 05a6f6dcc1c0: Pull complete 2024-06-26T07:09:28.3836780Z 6bc9dc8315b0: Pull complete 2024-06-26T07:09:28.6012659Z 1b0e27c35f07: Pull complete 2024-06-26T07:09:42.1684843Z 95237e7311a1: Pull complete 2024-06-26T07:09:42.2301100Z 789eff6c51aa: Pull complete 2024-06-26T07:09:42.2713384Z de0f8a8c45c6: Pull complete 2024-06-26T07:09:42.9677425Z 2060028f7488: Pull complete 2024-06-26T07:09:43.0222096Z e412c7f3b2de: Pull complete 2024-06-26T07:09:43.3139707Z Digest: sha256:216c88a4f79ebfa71a5dcf4d9a946548184354a3ea1f677f4b1065d28705debb 2024-06-26T07:09:43.3227983Z Status: Downloaded newer image for 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:09:43.3287287Z 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:09:43.3326911Z ##[group]Run echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> "$GITHUB_OUTPUT" 2024-06-26T07:09:43.3327849Z echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> "$GITHUB_OUTPUT" 2024-06-26T07:09:43.3336231Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:09:43.3336721Z env: 2024-06-26T07:09:43.3336997Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:09:43.3337343Z ##[endgroup] 2024-06-26T07:09:43.3495039Z ##[group]Run pytorch/test-infra/.github/actions/setup-nvidia@main 2024-06-26T07:09:43.3495578Z with: 2024-06-26T07:09:43.3495862Z driver-version: 550.54.15 2024-06-26T07:09:43.3496202Z env: 2024-06-26T07:09:43.3496478Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:09:43.3496813Z ##[endgroup] 2024-06-26T07:09:43.3535826Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2024-06-26T07:09:43.3536381Z with: 2024-06-26T07:09:43.3536655Z timeout_minutes: 10 2024-06-26T07:09:43.3536972Z max_attempts: 3 2024-06-26T07:09:43.3568318Z command: # Is it disgusting to have a full shell script here in this github action? Sure # But is it the best way to make it so that this action relies on nothing else? Absolutely set -eou pipefail DISTRIBUTION=$(. /etc/os-release;echo $ID$VERSION_ID) DRIVER_FN="NVIDIA-Linux-x86_64-${DRIVER_VERSION}.run" install_nvidia_docker2_amzn2() { ( set -x # Needed for yum-config-manager sudo yum install -y yum-utils if [[ "${DISTRIBUTION}" == "amzn2023" ]] ; then YUM_REPO_URL="https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo" else # Amazon Linux 2 YUM_REPO_URL="https://nvidia.github.io/nvidia-docker/${DISTRIBUTION}/nvidia-docker.repo" fi sudo yum-config-manager --add-repo "${YUM_REPO_URL}" sudo yum install -y nvidia-docker2 sudo systemctl restart docker ) } install_nvidia_docker2_ubuntu20() { ( set -x # Install nvidia-driver package if not installed status="$(dpkg-query -W --showformat='${db:Status-Status}' nvidia-docker2 2>&1)" if [ ! $? = 0 ] || [ ! "$status" = installed ]; then sudo apt-get install -y nvidia-docker2 sudo systemctl restart docker fi ) } pre_install_nvidia_driver_amzn2() { ( # Purge any nvidia driver installed from RHEL repo sudo yum remove -y nvidia-driver-latest-dkms ) } install_nvidia_driver_common() { ( # Try to gather more information about the runner and its existing NVIDIA driver if any echo "Before installing NVIDIA driver" lspci lsmod modinfo nvidia || true HAS_NVIDIA_DRIVER=0 # Check if NVIDIA driver has already been installed if [ -x "$(command -v nvidia-smi)" ]; then set +e # The driver exists, check its version next. Also check only the first GPU if there are more than one of them # so that the same driver version is not print over multiple lines INSTALLED_DRIVER_VERSION=$(nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0) NVIDIA_SMI_STATUS=$? if [ "$NVIDIA_SMI_STATUS" -ne 0 ] && [ "$NVIDIA_SMI_STATUS" -ne 14 ]; then echo "Failed to get NVIDIA driver version ($INSTALLED_DRIVER_VERSION). Continuing" elif [ "$INSTALLED_DRIVER_VERSION" != "$DRIVER_VERSION" ]; then echo "NVIDIA driver ($INSTALLED_DRIVER_VERSION) has been installed, but we expect to have $DRIVER_VERSION instead. Continuing" else HAS_NVIDIA_DRIVER=1 echo "NVIDIA driver ($INSTALLED_DRIVER_VERSION) has already been installed. Skipping NVIDIA driver installation" fi set -e fi if [ "$HAS_NVIDIA_DRIVER" -eq 0 ]; then # CAUTION: this may need to be updated in future if [ "${DISTRIBUTION}" != ubuntu20.04 ]; then sudo yum groupinstall -y "Development Tools" # ensure our kernel install is the same as our underlying kernel, # groupinstall "Development Tools" has a habit of mismatching kernel headers sudo yum install -y "kernel-devel-uname-r == $(uname -r)" sudo modprobe backlight fi sudo curl -fsL -o /tmp/nvidia_driver "https://s3.amazonaws.com/ossci-linux/nvidia_driver/$DRIVER_FN" set +e sudo /bin/bash /tmp/nvidia_driver -s --no-drm NVIDIA_INSTALLATION_STATUS=$? RESET_GPU=0 if [ "$NVIDIA_INSTALLATION_STATUS" -ne 0 ]; then sudo cat /var/log/nvidia-installer.log # Fail to install NVIDIA driver, try to reset the GPU RESET_GPU=1 elif [ -x "$(command -v nvidia-smi)" ]; then # Check again if nvidia-smi works even if the driver installation completes successfully INSTALLED_DRIVER_VERSION=$(nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0) NVIDIA_SMI_STATUS=$? if [ "$NVIDIA_SMI_STATUS" -ne 0 ] && [ "$NVIDIA_SMI_STATUS" -ne 14 ]; then RESET_GPU=1 fi fi if [ "$RESET_GPU" -eq 1 ]; then NVIDIA_DEVICES=$(lspci -D | grep -i NVIDIA | cut -d' ' -f1) # The GPU can get stuck in a failure state if somehow the test crashs the GPU microcode. When this # happens, we'll try to reset all NVIDIA devices https://github.com/pytorch/pytorch/issues/88388 for PCI_ID in $NVIDIA_DEVICES; do DEVICE_ENABLED=$(cat /sys/bus/pci/devices/$PCI_ID/enable) echo "Reseting $PCI_ID (enabled state: $DEVICE_ENABLED)" # This requires sudo permission of course echo "1" | sudo tee /sys/bus/pci/devices/$PCI_ID/reset sleep 1 done fi sudo rm -fv /tmp/nvidia_driver set -e fi ) } post_install_nvidia_driver_common() { ( sudo modprobe nvidia || true echo "After installing NVIDIA driver" lspci lsmod modinfo nvidia || true ( set +e nvidia-smi # NB: Annoyingly, nvidia-smi command returns successfully with return code 0 even in # the case where the driver has already crashed as it still can get the driver version # and some basic information like the bus ID. However, the rest of the information # would be missing (ERR!), for example: # # +-----------------------------------------------------------------------------+ # | NVIDIA-SMI 525.89.02 Driver Version: 525.89.02 CUDA Version: 12.0 | # |-------------------------------+----------------------+----------------------+ # | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | # | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | # | | | MIG M. | # |===============================+======================+======================| # | 0 ERR! Off | 00000000:00:1E.0 Off | ERR! | # |ERR! ERR! ERR! ERR! / ERR! | 4184MiB / 23028MiB | ERR! Default | # | | | ERR! | # +-------------------------------+----------------------+----------------------+ # # +-----------------------------------------------------------------------------+ # | Processes: | # | GPU GI CI PID Type Process name GPU Memory | # | ID ID Usage | # |=============================================================================| # +-----------------------------------------------------------------------------+ # # This should be reported as a failure instead as it will guarantee to fail when # Docker tries to run with --gpus all # # So, the correct check here is to query one of the missing piece of info like # GPU name, so that the command can fail accordingly nvidia-smi --query-gpu=gpu_name --format=csv,noheader --id=0 NVIDIA_SMI_STATUS=$? # Allowable exit statuses for nvidia-smi, see: https://github.com/NVIDIA/gpu-operator/issues/285 if [ "$NVIDIA_SMI_STATUS" -eq 0 ] || [ "$NVIDIA_SMI_STATUS" -eq 14 ]; then echo "INFO: Ignoring allowed status ${NVIDIA_SMI_STATUS}" else echo "ERROR: nvidia-smi exited with unresolved status ${NVIDIA_SMI_STATUS}" exit ${NVIDIA_SMI_STATUS} fi set -e ) ) } install_nvidia_driver_amzn2() { ( set -x pre_install_nvidia_driver_amzn2 install_nvidia_driver_common post_install_nvidia_driver_common ) } install_nvidia_driver_ubuntu20() { ( set -x install_nvidia_driver_common post_install_nvidia_driver_common ) } echo "== Installing nvidia driver ${DRIVER_FN} ==" case "${DISTRIBUTION}" in amzn*) install_nvidia_driver_amzn2 ;; ubuntu20.04) install_nvidia_driver_ubuntu20 ;; *) echo "ERROR: Unknown distribution ${DISTRIBUTION}" exit 1 ;; esac # Install container toolkit based on distribution echo "== Installing nvidia container toolkit for ${DISTRIBUTION} ==" case "${DISTRIBUTION}" in amzn*) install_nvidia_docker2_amzn2 ;; ubuntu20.04) install_nvidia_docker2_ubuntu20 ;; *) echo "ERROR: Unknown distribution ${DISTRIBUTION}" exit 1 ;; esac echo "GPU_FLAG=--gpus all -e NVIDIA_DRIVER_CAPABILITIES=all" >> "${GITHUB_ENV}" 2024-06-26T07:09:43.3601375Z retry_wait_seconds: 10 2024-06-26T07:09:43.3601737Z polling_interval_seconds: 1 2024-06-26T07:09:43.3602108Z warning_on_retry: true 2024-06-26T07:09:43.3602454Z continue_on_error: false 2024-06-26T07:09:43.3602784Z env: 2024-06-26T07:09:43.3603052Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:09:43.3603404Z DRIVER_VERSION: 550.54.15 2024-06-26T07:09:43.3603748Z ##[endgroup] 2024-06-26T07:09:43.4129835Z == Installing nvidia driver NVIDIA-Linux-x86_64-550.54.15.run == 2024-06-26T07:09:43.4130642Z + pre_install_nvidia_driver_amzn2 2024-06-26T07:09:43.4131308Z + sudo yum remove -y nvidia-driver-latest-dkms 2024-06-26T07:09:43.7175705Z Loaded plugins: extras_suggestions, langpacks, priorities, update-motd 2024-06-26T07:09:43.7563144Z No Match for argument: nvidia-driver-latest-dkms 2024-06-26T07:09:43.7805591Z No Packages marked for removal 2024-06-26T07:09:43.7919903Z + install_nvidia_driver_common 2024-06-26T07:09:43.7922261Z + echo 'Before installing NVIDIA driver' 2024-06-26T07:09:43.7922799Z + lspci 2024-06-26T07:09:43.7923094Z Before installing NVIDIA driver 2024-06-26T07:09:43.8000845Z 00:00.0 Host bridge: Intel Corporation 440FX - 82441FX PMC [Natoma] 2024-06-26T07:09:43.8001926Z 00:01.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II] 2024-06-26T07:09:43.8003304Z 00:01.3 Non-VGA unclassified device: Intel Corporation 82371AB/EB/MB PIIX4 ACPI (rev 08) 2024-06-26T07:09:43.8004480Z 00:03.0 VGA compatible controller: Amazon.com, Inc. Device 1111 2024-06-26T07:09:43.8005688Z 00:04.0 Non-Volatile memory controller: Amazon.com, Inc. Device 8061 2024-06-26T07:09:43.8006750Z 00:05.0 Ethernet controller: Amazon.com, Inc. Elastic Network Adapter (ENA) 2024-06-26T07:09:43.8007778Z 00:1e.0 3D controller: NVIDIA Corporation Device 2237 (rev a1) 2024-06-26T07:09:43.8008909Z 00:1f.0 Non-Volatile memory controller: Amazon.com, Inc. NVMe SSD Controller 2024-06-26T07:09:43.8009763Z + lsmod 2024-06-26T07:09:43.8016494Z Module Size Used by 2024-06-26T07:09:43.8016942Z nvidia_modeset 1339392 0 2024-06-26T07:09:43.8017354Z veth 16384 0 2024-06-26T07:09:43.8017726Z nvidia_uvm 4599808 0 2024-06-26T07:09:43.8018177Z nvidia 53989376 2 nvidia_uvm,nvidia_modeset 2024-06-26T07:09:43.8018655Z drm 421888 1 nvidia 2024-06-26T07:09:43.8019325Z i2c_core 77824 2 nvidia,drm 2024-06-26T07:09:43.8019797Z backlight 16384 1 nvidia_modeset 2024-06-26T07:09:43.8020287Z xt_conntrack 16384 1 2024-06-26T07:09:43.8020664Z ipt_MASQUERADE 16384 1 2024-06-26T07:09:43.8021104Z nf_nat_masquerade_ipv4 16384 1 ipt_MASQUERADE 2024-06-26T07:09:43.8021567Z nf_conntrack_netlink 49152 0 2024-06-26T07:09:43.8022055Z nfnetlink 16384 2 nf_conntrack_netlink 2024-06-26T07:09:43.8022522Z xfrm_user 45056 1 2024-06-26T07:09:43.8022925Z xfrm_algo 16384 1 xfrm_user 2024-06-26T07:09:43.8023342Z iptable_nat 16384 1 2024-06-26T07:09:43.8023723Z nf_conntrack_ipv4 16384 3 2024-06-26T07:09:43.8024142Z nf_defrag_ipv4 16384 1 nf_conntrack_ipv4 2024-06-26T07:09:43.8024618Z nf_nat_ipv4 16384 1 iptable_nat 2024-06-26T07:09:43.8025137Z nf_nat 32768 2 nf_nat_masquerade_ipv4,nf_nat_ipv4 2024-06-26T07:09:43.8026075Z nf_conntrack 155648 7 xt_conntrack,nf_nat_masquerade_ipv4,nf_conntrack_ipv4,nf_nat,ipt_MASQUERADE,nf_nat_ipv4,nf_conntrack_netlink 2024-06-26T07:09:43.8026923Z xt_addrtype 16384 2 2024-06-26T07:09:43.8027300Z iptable_filter 16384 1 2024-06-26T07:09:43.8027684Z br_netfilter 24576 0 2024-06-26T07:09:43.8028086Z bridge 172032 1 br_netfilter 2024-06-26T07:09:43.8028531Z stp 16384 1 bridge 2024-06-26T07:09:43.8028952Z llc 16384 2 bridge,stp 2024-06-26T07:09:43.8029372Z overlay 86016 0 2024-06-26T07:09:43.8029859Z sunrpc 393216 1 2024-06-26T07:09:43.8030231Z dm_mirror 28672 0 2024-06-26T07:09:43.8030623Z dm_region_hash 20480 1 dm_mirror 2024-06-26T07:09:43.8031111Z dm_log 20480 2 dm_region_hash,dm_mirror 2024-06-26T07:09:43.8031612Z dm_mod 143360 2 dm_log,dm_mirror 2024-06-26T07:09:43.8032059Z dax 69632 1 dm_mod 2024-06-26T07:09:43.8032465Z crc32_pclmul 16384 0 2024-06-26T07:09:43.8032839Z ghash_clmulni_intel 16384 0 2024-06-26T07:09:43.8033212Z pcbc 16384 0 2024-06-26T07:09:43.8033582Z aesni_intel 188416 0 2024-06-26T07:09:43.8033974Z aes_x86_64 20480 1 aesni_intel 2024-06-26T07:09:43.8034415Z crypto_simd 16384 1 aesni_intel 2024-06-26T07:09:43.8034867Z glue_helper 16384 1 aesni_intel 2024-06-26T07:09:43.8035415Z cryptd 28672 3 crypto_simd,ghash_clmulni_intel,aesni_intel 2024-06-26T07:09:43.8035959Z mousedev 24576 0 2024-06-26T07:09:43.8036319Z evdev 20480 3 2024-06-26T07:09:43.8036686Z psmouse 32768 0 2024-06-26T07:09:43.8037055Z button 16384 0 2024-06-26T07:09:43.8037416Z ena 139264 0 2024-06-26T07:09:43.8037775Z ptp 20480 1 ena 2024-06-26T07:09:43.8038168Z pps_core 20480 1 ptp 2024-06-26T07:09:43.8038562Z crc32c_intel 24576 0 2024-06-26T07:09:43.8038933Z autofs4 49152 2 2024-06-26T07:09:43.8039284Z + modinfo nvidia 2024-06-26T07:09:43.8039970Z filename: /lib/modules/4.14.336-257.562.amzn2.x86_64/kernel/drivers/video/nvidia.ko 2024-06-26T07:09:43.8040742Z alias: char-major-195-* 2024-06-26T07:09:43.8041221Z version: 550.54.15 2024-06-26T07:09:43.8041560Z supported: external 2024-06-26T07:09:43.8041897Z license: NVIDIA 2024-06-26T07:09:43.8042272Z firmware: nvidia/550.54.15/gsp_tu10x.bin 2024-06-26T07:09:43.8042759Z firmware: nvidia/550.54.15/gsp_ga10x.bin 2024-06-26T07:09:43.8043206Z srcversion: 833721318DA517F0C2FEC97 2024-06-26T07:09:43.8043670Z alias: pci:v000010DEd*sv*sd*bc06sc80i00* 2024-06-26T07:09:43.8044165Z alias: pci:v000010DEd*sv*sd*bc03sc02i00* 2024-06-26T07:09:43.8044641Z alias: pci:v000010DEd*sv*sd*bc03sc00i00* 2024-06-26T07:09:43.8045120Z depends: i2c-core,drm 2024-06-26T07:09:43.8045675Z retpoline: Y 2024-06-26T07:09:43.8045990Z name: nvidia 2024-06-26T07:09:43.8046538Z vermagic: 4.14.336-257.562.amzn2.x86_64 SMP mod_unload modversions 2024-06-26T07:09:43.8047193Z parm: NvSwitchRegDwords:NvSwitch regkey (charp) 2024-06-26T07:09:43.8047837Z parm: NvSwitchBlacklist:NvSwitchBlacklist=uuid[,uuid...] (charp) 2024-06-26T07:09:43.8048434Z parm: NVreg_ResmanDebugLevel:int 2024-06-26T07:09:43.8048879Z parm: NVreg_RmLogonRC:int 2024-06-26T07:09:43.8049311Z parm: NVreg_ModifyDeviceFiles:int 2024-06-26T07:09:43.8049773Z parm: NVreg_DeviceFileUID:int 2024-06-26T07:09:43.8050210Z parm: NVreg_DeviceFileGID:int 2024-06-26T07:09:43.8050646Z parm: NVreg_DeviceFileMode:int 2024-06-26T07:09:43.8051183Z parm: NVreg_InitializeSystemMemoryAllocations:int 2024-06-26T07:09:43.8051750Z parm: NVreg_UsePageAttributeTable:int 2024-06-26T07:09:43.8052238Z parm: NVreg_EnablePCIeGen3:int 2024-06-26T07:09:43.8052676Z parm: NVreg_EnableMSI:int 2024-06-26T07:09:43.8053313Z parm: NVreg_TCEBypassMode:int 2024-06-26T07:09:43.8053804Z parm: NVreg_EnableStreamMemOPs:int 2024-06-26T07:09:43.8054331Z parm: NVreg_RestrictProfilingToAdminUsers:int 2024-06-26T07:09:43.8054918Z parm: NVreg_PreserveVideoMemoryAllocations:int 2024-06-26T07:09:43.8055488Z parm: NVreg_EnableS0ixPowerManagement:int 2024-06-26T07:09:43.8056099Z parm: NVreg_S0ixPowerManagementVideoMemoryThreshold:int 2024-06-26T07:09:43.8056810Z parm: NVreg_DynamicPowerManagement:int 2024-06-26T07:09:43.8057427Z parm: NVreg_DynamicPowerManagementVideoMemoryThreshold:int 2024-06-26T07:09:43.8058024Z parm: NVreg_EnableGpuFirmware:int 2024-06-26T07:09:43.8058515Z parm: NVreg_EnableGpuFirmwareLogs:int 2024-06-26T07:09:43.8059048Z parm: NVreg_OpenRmEnableUnsupportedGpus:int 2024-06-26T07:09:43.8059606Z parm: NVreg_EnableUserNUMAManagement:int 2024-06-26T07:09:43.8060106Z parm: NVreg_MemoryPoolSize:int 2024-06-26T07:09:43.8060571Z parm: NVreg_KMallocHeapMaxSize:int 2024-06-26T07:09:43.8061047Z parm: NVreg_VMallocHeapMaxSize:int 2024-06-26T07:09:43.8061520Z parm: NVreg_IgnoreMMIOCheck:int 2024-06-26T07:09:43.8061998Z parm: NVreg_NvLinkDisable:int 2024-06-26T07:09:43.8062528Z parm: NVreg_EnablePCIERelaxedOrderingMode:int 2024-06-26T07:09:43.8063048Z parm: NVreg_RegisterPCIDriver:int 2024-06-26T07:09:43.8063525Z parm: NVreg_EnableResizableBar:int 2024-06-26T07:09:43.8064023Z parm: NVreg_EnableDbgBreakpoint:int 2024-06-26T07:09:43.8064526Z parm: NVreg_EnableNonblockingOpen:int 2024-06-26T07:09:43.8065008Z parm: NVreg_RegistryDwords:charp 2024-06-26T07:09:43.8065513Z parm: NVreg_RegistryDwordsPerDevice:charp 2024-06-26T07:09:43.8065997Z parm: NVreg_RmMsg:charp 2024-06-26T07:09:43.8066412Z parm: NVreg_GpuBlacklist:charp 2024-06-26T07:09:43.8066875Z parm: NVreg_TemporaryFilePath:charp 2024-06-26T07:09:43.8067357Z parm: NVreg_ExcludedGpus:charp 2024-06-26T07:09:43.8067813Z parm: NVreg_DmaRemapPeerMmio:int 2024-06-26T07:09:43.8068285Z parm: NVreg_RmNvlinkBandwidth:charp 2024-06-26T07:09:43.8068764Z parm: NVreg_ImexChannelCount:int 2024-06-26T07:09:43.8069219Z parm: rm_firmware_active:charp 2024-06-26T07:09:43.8069634Z + HAS_NVIDIA_DRIVER=0 2024-06-26T07:09:43.8070003Z ++ command -v nvidia-smi 2024-06-26T07:09:43.8070405Z + '[' -x /usr/bin/nvidia-smi ']' 2024-06-26T07:09:43.8070778Z + set +e 2024-06-26T07:09:43.8071277Z ++ nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0 2024-06-26T07:09:45.7866255Z + INSTALLED_DRIVER_VERSION=550.54.15 2024-06-26T07:09:45.7866907Z + NVIDIA_SMI_STATUS=0 2024-06-26T07:09:45.7867495Z + '[' 0 -ne 0 ']' 2024-06-26T07:09:45.7867854Z + '[' 550.54.15 '!=' 550.54.15 ']' 2024-06-26T07:09:45.7868484Z + HAS_NVIDIA_DRIVER=1 2024-06-26T07:09:45.7869206Z + echo 'NVIDIA driver (550.54.15) has already been installed. Skipping NVIDIA driver installation' 2024-06-26T07:09:45.7869906Z + set -e 2024-06-26T07:09:45.7870204Z + '[' 1 -eq 0 ']' 2024-06-26T07:09:45.7870768Z NVIDIA driver (550.54.15) has already been installed. Skipping NVIDIA driver installation 2024-06-26T07:09:45.7871445Z + post_install_nvidia_driver_common 2024-06-26T07:09:45.7871846Z + sudo modprobe nvidia 2024-06-26T07:09:45.7956767Z + echo 'After installing NVIDIA driver' 2024-06-26T07:09:45.7957239Z + lspci 2024-06-26T07:09:45.7957551Z After installing NVIDIA driver 2024-06-26T07:09:45.8039069Z 00:00.0 Host bridge: Intel Corporation 440FX - 82441FX PMC [Natoma] 2024-06-26T07:09:45.8040077Z 00:01.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II] 2024-06-26T07:09:45.8041003Z 00:01.3 Non-VGA unclassified device: Intel Corporation 82371AB/EB/MB PIIX4 ACPI (rev 08) 2024-06-26T07:09:45.8041810Z 00:03.0 VGA compatible controller: Amazon.com, Inc. Device 1111 2024-06-26T07:09:45.8042563Z 00:04.0 Non-Volatile memory controller: Amazon.com, Inc. Device 8061 2024-06-26T07:09:45.8043316Z 00:05.0 Ethernet controller: Amazon.com, Inc. Elastic Network Adapter (ENA) 2024-06-26T07:09:45.8044040Z 00:1e.0 3D controller: NVIDIA Corporation Device 2237 (rev a1) 2024-06-26T07:09:45.8044810Z 00:1f.0 Non-Volatile memory controller: Amazon.com, Inc. NVMe SSD Controller 2024-06-26T07:09:45.8045470Z + lsmod 2024-06-26T07:09:45.8052832Z Module Size Used by 2024-06-26T07:09:45.8053637Z nvidia_modeset 1339392 0 2024-06-26T07:09:45.8054409Z veth 16384 0 2024-06-26T07:09:45.8054796Z nvidia_uvm 4599808 0 2024-06-26T07:09:45.8055247Z nvidia 53989376 2 nvidia_uvm,nvidia_modeset 2024-06-26T07:09:45.8055734Z drm 421888 1 nvidia 2024-06-26T07:09:45.8056151Z i2c_core 77824 2 nvidia,drm 2024-06-26T07:09:45.8056629Z backlight 16384 1 nvidia_modeset 2024-06-26T07:09:45.8057108Z xt_conntrack 16384 1 2024-06-26T07:09:45.8057489Z ipt_MASQUERADE 16384 1 2024-06-26T07:09:45.8057917Z nf_nat_masquerade_ipv4 16384 1 ipt_MASQUERADE 2024-06-26T07:09:45.8058384Z nf_conntrack_netlink 49152 0 2024-06-26T07:09:45.8058828Z nfnetlink 16384 2 nf_conntrack_netlink 2024-06-26T07:09:45.8059284Z xfrm_user 45056 1 2024-06-26T07:09:45.8059666Z xfrm_algo 16384 1 xfrm_user 2024-06-26T07:09:45.8060083Z iptable_nat 16384 1 2024-06-26T07:09:45.8060458Z nf_conntrack_ipv4 16384 3 2024-06-26T07:09:45.8060894Z nf_defrag_ipv4 16384 1 nf_conntrack_ipv4 2024-06-26T07:09:45.8061361Z nf_nat_ipv4 16384 1 iptable_nat 2024-06-26T07:09:45.8062034Z nf_nat 32768 2 nf_nat_masquerade_ipv4,nf_nat_ipv4 2024-06-26T07:09:45.8063405Z nf_conntrack 155648 7 xt_conntrack,nf_nat_masquerade_ipv4,nf_conntrack_ipv4,nf_nat,ipt_MASQUERADE,nf_nat_ipv4,nf_conntrack_netlink 2024-06-26T07:09:45.8064574Z xt_addrtype 16384 2 2024-06-26T07:09:45.8064991Z iptable_filter 16384 1 2024-06-26T07:09:45.8065502Z br_netfilter 24576 0 2024-06-26T07:09:45.8066042Z bridge 172032 1 br_netfilter 2024-06-26T07:09:45.8066593Z stp 16384 1 bridge 2024-06-26T07:09:45.8067016Z llc 16384 2 bridge,stp 2024-06-26T07:09:45.8067442Z overlay 86016 0 2024-06-26T07:09:45.8067819Z sunrpc 393216 1 2024-06-26T07:09:45.8068189Z dm_mirror 28672 0 2024-06-26T07:09:45.8068592Z dm_region_hash 20480 1 dm_mirror 2024-06-26T07:09:45.8069084Z dm_log 20480 2 dm_region_hash,dm_mirror 2024-06-26T07:09:45.8069595Z dm_mod 143360 2 dm_log,dm_mirror 2024-06-26T07:09:45.8070037Z dax 69632 1 dm_mod 2024-06-26T07:09:45.8070444Z crc32_pclmul 16384 0 2024-06-26T07:09:45.8070821Z ghash_clmulni_intel 16384 0 2024-06-26T07:09:45.8071438Z pcbc 16384 0 2024-06-26T07:09:45.8071836Z aesni_intel 188416 0 2024-06-26T07:09:45.8072256Z aes_x86_64 20480 1 aesni_intel 2024-06-26T07:09:45.8072710Z crypto_simd 16384 1 aesni_intel 2024-06-26T07:09:45.8073168Z glue_helper 16384 1 aesni_intel 2024-06-26T07:09:45.8073723Z cryptd 28672 3 crypto_simd,ghash_clmulni_intel,aesni_intel 2024-06-26T07:09:45.8074260Z mousedev 24576 0 2024-06-26T07:09:45.8074636Z evdev 20480 3 2024-06-26T07:09:45.8074998Z psmouse 32768 0 2024-06-26T07:09:45.8075383Z button 16384 0 2024-06-26T07:09:45.8075749Z ena 139264 0 2024-06-26T07:09:45.8076121Z ptp 20480 1 ena 2024-06-26T07:09:45.8076511Z pps_core 20480 1 ptp 2024-06-26T07:09:45.8076904Z crc32c_intel 24576 0 2024-06-26T07:09:45.8077275Z autofs4 49152 2 2024-06-26T07:09:45.8077640Z + modinfo nvidia 2024-06-26T07:09:45.8078313Z filename: /lib/modules/4.14.336-257.562.amzn2.x86_64/kernel/drivers/video/nvidia.ko 2024-06-26T07:09:45.8079017Z alias: char-major-195-* 2024-06-26T07:09:45.8079404Z version: 550.54.15 2024-06-26T07:09:45.8079748Z supported: external 2024-06-26T07:09:45.8080081Z license: NVIDIA 2024-06-26T07:09:45.8080463Z firmware: nvidia/550.54.15/gsp_tu10x.bin 2024-06-26T07:09:45.8080947Z firmware: nvidia/550.54.15/gsp_ga10x.bin 2024-06-26T07:09:45.8081407Z srcversion: 833721318DA517F0C2FEC97 2024-06-26T07:09:45.8081954Z alias: pci:v000010DEd*sv*sd*bc06sc80i00* 2024-06-26T07:09:45.8082508Z alias: pci:v000010DEd*sv*sd*bc03sc02i00* 2024-06-26T07:09:45.8082991Z alias: pci:v000010DEd*sv*sd*bc03sc00i00* 2024-06-26T07:09:45.8083471Z depends: i2c-core,drm 2024-06-26T07:09:45.8083823Z retpoline: Y 2024-06-26T07:09:45.8084130Z name: nvidia 2024-06-26T07:09:45.8084682Z vermagic: 4.14.336-257.562.amzn2.x86_64 SMP mod_unload modversions 2024-06-26T07:09:45.8085327Z parm: NvSwitchRegDwords:NvSwitch regkey (charp) 2024-06-26T07:09:45.8086092Z parm: NvSwitchBlacklist:NvSwitchBlacklist=uuid[,uuid...] (charp) 2024-06-26T07:09:45.8086692Z parm: NVreg_ResmanDebugLevel:int 2024-06-26T07:09:45.8087136Z parm: NVreg_RmLogonRC:int 2024-06-26T07:09:45.8087564Z parm: NVreg_ModifyDeviceFiles:int 2024-06-26T07:09:45.8088016Z parm: NVreg_DeviceFileUID:int 2024-06-26T07:09:45.8088444Z parm: NVreg_DeviceFileGID:int 2024-06-26T07:09:45.8088889Z parm: NVreg_DeviceFileMode:int 2024-06-26T07:09:45.8089400Z parm: NVreg_InitializeSystemMemoryAllocations:int 2024-06-26T07:09:45.8089954Z parm: NVreg_UsePageAttributeTable:int 2024-06-26T07:09:45.8090431Z parm: NVreg_EnablePCIeGen3:int 2024-06-26T07:09:45.8090855Z parm: NVreg_EnableMSI:int 2024-06-26T07:09:45.8091262Z parm: NVreg_TCEBypassMode:int 2024-06-26T07:09:45.8091715Z parm: NVreg_EnableStreamMemOPs:int 2024-06-26T07:09:45.8092246Z parm: NVreg_RestrictProfilingToAdminUsers:int 2024-06-26T07:09:45.8092882Z parm: NVreg_PreserveVideoMemoryAllocations:int 2024-06-26T07:09:45.8093731Z parm: NVreg_EnableS0ixPowerManagement:int 2024-06-26T07:09:45.8094337Z parm: NVreg_S0ixPowerManagementVideoMemoryThreshold:int 2024-06-26T07:09:45.8094938Z parm: NVreg_DynamicPowerManagement:int 2024-06-26T07:09:45.8095546Z parm: NVreg_DynamicPowerManagementVideoMemoryThreshold:int 2024-06-26T07:09:45.8096137Z parm: NVreg_EnableGpuFirmware:int 2024-06-26T07:09:45.8096623Z parm: NVreg_EnableGpuFirmwareLogs:int 2024-06-26T07:09:45.8097147Z parm: NVreg_OpenRmEnableUnsupportedGpus:int 2024-06-26T07:09:45.8097685Z parm: NVreg_EnableUserNUMAManagement:int 2024-06-26T07:09:45.8098172Z parm: NVreg_MemoryPoolSize:int 2024-06-26T07:09:45.8098743Z parm: NVreg_KMallocHeapMaxSize:int 2024-06-26T07:09:45.8099228Z parm: NVreg_VMallocHeapMaxSize:int 2024-06-26T07:09:45.8099690Z parm: NVreg_IgnoreMMIOCheck:int 2024-06-26T07:09:45.8100134Z parm: NVreg_NvLinkDisable:int 2024-06-26T07:09:45.8100631Z parm: NVreg_EnablePCIERelaxedOrderingMode:int 2024-06-26T07:09:45.8101149Z parm: NVreg_RegisterPCIDriver:int 2024-06-26T07:09:45.8101616Z parm: NVreg_EnableResizableBar:int 2024-06-26T07:09:45.8102095Z parm: NVreg_EnableDbgBreakpoint:int 2024-06-26T07:09:45.8102593Z parm: NVreg_EnableNonblockingOpen:int 2024-06-26T07:09:45.8103128Z parm: NVreg_RegistryDwords:charp 2024-06-26T07:09:45.8103611Z parm: NVreg_RegistryDwordsPerDevice:charp 2024-06-26T07:09:45.8104083Z parm: NVreg_RmMsg:charp 2024-06-26T07:09:45.8104493Z parm: NVreg_GpuBlacklist:charp 2024-06-26T07:09:45.8104954Z parm: NVreg_TemporaryFilePath:charp 2024-06-26T07:09:45.8105420Z parm: NVreg_ExcludedGpus:charp 2024-06-26T07:09:45.8105872Z parm: NVreg_DmaRemapPeerMmio:int 2024-06-26T07:09:45.8106345Z parm: NVreg_RmNvlinkBandwidth:charp 2024-06-26T07:09:45.8106815Z parm: NVreg_ImexChannelCount:int 2024-06-26T07:09:45.8107258Z parm: rm_firmware_active:charp 2024-06-26T07:09:45.8107651Z + set +e 2024-06-26T07:09:45.8107956Z + nvidia-smi 2024-06-26T07:09:47.3724649Z Wed Jun 26 07:09:47 2024 2024-06-26T07:09:47.3725668Z +-----------------------------------------------------------------------------------------+ 2024-06-26T07:09:47.3726805Z | NVIDIA-SMI 550.54.15 Driver Version: 550.54.15 CUDA Version: 12.4 | 2024-06-26T07:09:47.3727601Z |-----------------------------------------+------------------------+----------------------+ 2024-06-26T07:09:47.3728392Z | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | 2024-06-26T07:09:47.3729281Z | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | 2024-06-26T07:09:47.3729973Z | | | MIG M. | 2024-06-26T07:09:47.3730519Z |=========================================+========================+======================| 2024-06-26T07:09:47.3858629Z | 0 NVIDIA A10G Off | 00000000:00:1E.0 Off | 0 | 2024-06-26T07:09:47.3859559Z | 0% 32C P0 58W / 300W | 0MiB / 23028MiB | 0% Default | 2024-06-26T07:09:47.3860275Z | | | N/A | 2024-06-26T07:09:47.3861196Z +-----------------------------------------+------------------------+----------------------+ 2024-06-26T07:09:47.3861942Z 2024-06-26T07:09:47.3862590Z +-----------------------------------------------------------------------------------------+ 2024-06-26T07:09:47.3863422Z | Processes: | 2024-06-26T07:09:47.3864282Z | GPU GI CI PID Type Process name GPU Memory | 2024-06-26T07:09:47.3864982Z | ID ID Usage | 2024-06-26T07:09:47.3865538Z |=========================================================================================| 2024-06-26T07:09:47.3866178Z | No running processes found | 2024-06-26T07:09:47.3866935Z +-----------------------------------------------------------------------------------------+ 2024-06-26T07:09:48.0105963Z + nvidia-smi --query-gpu=gpu_name --format=csv,noheader --id=0 2024-06-26T07:09:49.5797207Z NVIDIA A10G 2024-06-26T07:09:50.0220283Z + NVIDIA_SMI_STATUS=0 2024-06-26T07:09:50.0221024Z + '[' 0 -eq 0 ']' 2024-06-26T07:09:50.0221547Z + echo 'INFO: Ignoring allowed status 0' 2024-06-26T07:09:50.0222288Z + set -e 2024-06-26T07:09:50.0222597Z INFO: Ignoring allowed status 0 2024-06-26T07:09:50.0224423Z == Installing nvidia container toolkit for amzn2 == 2024-06-26T07:09:50.0226564Z + sudo yum install -y yum-utils 2024-06-26T07:09:50.3221065Z Loaded plugins: extras_suggestions, langpacks, priorities, update-motd 2024-06-26T07:09:51.7985864Z Package yum-utils-1.1.31-46.amzn2.0.1.noarch already installed and latest version 2024-06-26T07:09:51.7986565Z Nothing to do 2024-06-26T07:09:51.9485869Z + [[ amzn2 == \a\m\z\n\2\0\2\3 ]] 2024-06-26T07:09:51.9486725Z + YUM_REPO_URL=https://nvidia.github.io/nvidia-docker/amzn2/nvidia-docker.repo 2024-06-26T07:09:51.9487813Z + sudo yum-config-manager --add-repo https://nvidia.github.io/nvidia-docker/amzn2/nvidia-docker.repo 2024-06-26T07:09:52.2532165Z Loaded plugins: extras_suggestions, langpacks, priorities, update-motd 2024-06-26T07:09:52.2777525Z adding repo from: https://nvidia.github.io/nvidia-docker/amzn2/nvidia-docker.repo 2024-06-26T07:09:52.2778729Z grabbing file https://nvidia.github.io/nvidia-docker/amzn2/nvidia-docker.repo to /etc/yum.repos.d/nvidia-docker.repo 2024-06-26T07:09:52.2779690Z repo saved to /etc/yum.repos.d/nvidia-docker.repo 2024-06-26T07:09:52.2894247Z + sudo yum install -y nvidia-docker2 2024-06-26T07:09:52.5735126Z Loaded plugins: extras_suggestions, langpacks, priorities, update-motd 2024-06-26T07:09:54.0306958Z Package nvidia-docker2-2.13.0-1.noarch already installed and latest version 2024-06-26T07:09:54.0307622Z Nothing to do 2024-06-26T07:09:54.1798701Z + sudo systemctl restart docker 2024-06-26T07:10:32.4608931Z Command completed after 1 attempt(s). 2024-06-26T07:10:32.4665530Z ##[group]Run python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84 2024-06-26T07:10:32.4666299Z python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84 2024-06-26T07:10:32.4666990Z python3 -m tools.stats.monitor > usage_log.txt 2>&1 & 2024-06-26T07:10:32.4667643Z echo "monitor-script-pid=${!}" >> "${GITHUB_OUTPUT}" 2024-06-26T07:10:32.4675421Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:10:32.4675926Z env: 2024-06-26T07:10:32.4676231Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:10:32.4676702Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:10:32.4677177Z ##[endgroup] 2024-06-26T07:10:32.6852445Z Defaulting to user installation because normal site-packages is not writeable 2024-06-26T07:10:32.7002907Z Requirement already satisfied: psutil==5.9.1 in /home/ec2-user/.local/lib/python3.7/site-packages (5.9.1) 2024-06-26T07:10:32.7100040Z Requirement already satisfied: nvidia-ml-py==11.525.84 in /home/ec2-user/.local/lib/python3.7/site-packages (11.525.84) 2024-06-26T07:10:32.8028320Z Prepare all required actions 2024-06-26T07:10:32.8028865Z Getting action download info 2024-06-26T07:10:32.9150098Z Download action repository 'seemethere/download-artifact-s3@v4' (SHA:1da556a7aa0a088e3153970611f6c432d58e80e6) 2024-06-26T07:10:33.1042645Z Download action repository 'actions/download-artifact@v3' (SHA:9bc31d5ccc31df68ecc42ccf4149144866c47d8a) 2024-06-26T07:10:33.2337629Z ##[group]Run ./.github/actions/download-build-artifacts 2024-06-26T07:10:33.2338106Z with: 2024-06-26T07:10:33.2338431Z name: linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-06-26T07:10:33.2338880Z s3-bucket: gha-artifacts 2024-06-26T07:10:33.2339203Z env: 2024-06-26T07:10:33.2339467Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:10:33.2339908Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:10:33.2340421Z ##[endgroup] 2024-06-26T07:10:33.2372897Z ##[group]Run seemethere/download-artifact-s3@v4 2024-06-26T07:10:33.2373623Z with: 2024-06-26T07:10:33.2373986Z name: linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-06-26T07:10:33.2374440Z s3-bucket: gha-artifacts 2024-06-26T07:10:33.2374788Z region: us-east-1 2024-06-26T07:10:33.2375082Z env: 2024-06-26T07:10:33.2375344Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:10:33.2375786Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:10:33.2376260Z ##[endgroup] 2024-06-26T07:10:33.6482330Z (node:3978) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2024-06-26T07:10:33.6483076Z 2024-06-26T07:10:33.6483341Z Please migrate your code to use AWS SDK for JavaScript (v3). 2024-06-26T07:10:33.6484057Z For more information, check the migration guide at https://a.co/7PzMCcy 2024-06-26T07:10:33.6484996Z (Use `node --trace-warnings ...` to show where the warning was created) 2024-06-26T07:10:33.7286582Z Found 1 objects with prefix pytorch/pytorch/9673646806/linux-focal-cuda12.1-py3.10-gcc9-sm86/ 2024-06-26T07:10:33.7288235Z Starting download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2024-06-26T07:10:57.9634752Z Finished download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2024-06-26T07:10:57.9644129Z Artifact download has finished successfully 2024-06-26T07:10:57.9779484Z ##[group]Run unzip -o artifacts.zip 2024-06-26T07:10:57.9779933Z unzip -o artifacts.zip 2024-06-26T07:10:57.9787594Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:10:57.9788096Z env: 2024-06-26T07:10:57.9788371Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:10:57.9788824Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:10:57.9789303Z ##[endgroup] 2024-06-26T07:10:57.9818165Z Archive: artifacts.zip 2024-06-26T07:10:57.9819707Z creating: dist/ 2024-06-26T07:10:59.9524471Z inflating: dist/torch-2.5.0a0+gitb8c4c54-cp310-cp310-linux_x86_64.whl 2024-06-26T07:10:59.9525424Z creating: build/custom_test_artifacts/ 2024-06-26T07:10:59.9526383Z creating: build/custom_test_artifacts/custom-op-build/ 2024-06-26T07:10:59.9527321Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/ 2024-06-26T07:10:59.9528173Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/pkgRedirects/ 2024-06-26T07:10:59.9531289Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeConfigureLog.yaml 2024-06-26T07:10:59.9532218Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/ 2024-06-26T07:10:59.9533400Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-06-26T07:10:59.9534432Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-06-26T07:10:59.9535387Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-06-26T07:10:59.9536470Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-06-26T07:10:59.9537725Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-06-26T07:10:59.9538848Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-06-26T07:10:59.9539952Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-06-26T07:10:59.9541249Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-06-26T07:10:59.9542545Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-06-26T07:10:59.9543827Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-06-26T07:10:59.9545103Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-06-26T07:10:59.9546261Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-06-26T07:10:59.9547434Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-06-26T07:10:59.9548461Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/ 2024-06-26T07:10:59.9549458Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/ 2024-06-26T07:10:59.9584454Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2024-06-26T07:10:59.9622408Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2024-06-26T07:10:59.9623833Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2024-06-26T07:10:59.9666834Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2024-06-26T07:10:59.9668233Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2024-06-26T07:10:59.9669656Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2024-06-26T07:10:59.9671119Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2024-06-26T07:10:59.9672521Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2024-06-26T07:10:59.9673889Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2024-06-26T07:10:59.9675312Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2024-06-26T07:10:59.9676690Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2024-06-26T07:10:59.9678144Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2024-06-26T07:10:59.9679426Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2024-06-26T07:10:59.9680649Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c 2024-06-26T07:10:59.9681846Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin 2024-06-26T07:10:59.9683065Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2024-06-26T07:10:59.9684238Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o 2024-06-26T07:10:59.9685512Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu 2024-06-26T07:10:59.9733878Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out 2024-06-26T07:10:59.9791763Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin 2024-06-26T07:10:59.9792948Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake 2024-06-26T07:10:59.9793931Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeScratch/ 2024-06-26T07:10:59.9795380Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeTmp/ 2024-06-26T07:10:59.9797172Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/cmake.check_cache 2024-06-26T07:10:59.9798981Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/ 2024-06-26T07:10:59.9800995Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.ts 2024-06-26T07:10:59.9803280Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.make 2024-06-26T07:10:59.9804810Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/depend.make 2024-06-26T07:10:59.9805890Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/link.txt 2024-06-26T07:10:59.9806949Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/cmake_clean.cmake 2024-06-26T07:10:59.9808164Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/build.make 2024-06-26T07:10:59.9809227Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/DependInfo.cmake 2024-06-26T07:10:59.9810286Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/flags.make 2024-06-26T07:10:59.9811328Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/progress.make 2024-06-26T07:10:59.9818218Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o.d 2024-06-26T07:10:59.9945752Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o 2024-06-26T07:10:59.9946743Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/ 2024-06-26T07:10:59.9947814Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.ts 2024-06-26T07:10:59.9948996Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.make 2024-06-26T07:10:59.9950151Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/depend.make 2024-06-26T07:10:59.9951231Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/link.txt 2024-06-26T07:10:59.9952354Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/cmake_clean.cmake 2024-06-26T07:10:59.9953599Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/build.make 2024-06-26T07:10:59.9954776Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/DependInfo.cmake 2024-06-26T07:10:59.9955891Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/flags.make 2024-06-26T07:10:59.9956986Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/progress.make 2024-06-26T07:10:59.9970064Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o.d 2024-06-26T07:11:00.0049791Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o 2024-06-26T07:11:00.0050967Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-06-26T07:11:00.0052021Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/TargetDirectories.txt 2024-06-26T07:11:00.0053290Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/progress.marks 2024-06-26T07:11:00.0054216Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile2 2024-06-26T07:11:00.0055152Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile.cmake 2024-06-26T07:11:00.0056050Z inflating: build/custom_test_artifacts/custom-op-build/detect_cuda_version.cc 2024-06-26T07:11:00.0056895Z inflating: build/custom_test_artifacts/custom-op-build/CMakeCache.txt 2024-06-26T07:11:00.0057668Z inflating: build/custom_test_artifacts/custom-op-build/Makefile 2024-06-26T07:11:00.0058475Z inflating: build/custom_test_artifacts/custom-op-build/cmake_install.cmake 2024-06-26T07:11:00.0164946Z inflating: build/custom_test_artifacts/custom-op-build/libcustom_ops.so 2024-06-26T07:11:00.0225423Z inflating: build/custom_test_artifacts/custom-op-build/test_custom_ops 2024-06-26T07:11:00.0226159Z creating: build/custom_test_artifacts/jit-hook-build/ 2024-06-26T07:11:00.0226846Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/ 2024-06-26T07:11:00.0227640Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/pkgRedirects/ 2024-06-26T07:11:00.0232888Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeConfigureLog.yaml 2024-06-26T07:11:00.0233811Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/ 2024-06-26T07:11:00.0234775Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-06-26T07:11:00.0235747Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-06-26T07:11:00.0236697Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-06-26T07:11:00.0237900Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-06-26T07:11:00.0238989Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-06-26T07:11:00.0239971Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-06-26T07:11:00.0240944Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-06-26T07:11:00.0242068Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-06-26T07:11:00.0243210Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-06-26T07:11:00.0244371Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-06-26T07:11:00.0245584Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-06-26T07:11:00.0246810Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-06-26T07:11:00.0248078Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-06-26T07:11:00.0249091Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/ 2024-06-26T07:11:00.0250071Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/ 2024-06-26T07:11:00.0285084Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2024-06-26T07:11:00.0323680Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2024-06-26T07:11:00.0325177Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2024-06-26T07:11:00.0367814Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2024-06-26T07:11:00.0369202Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2024-06-26T07:11:00.0370743Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2024-06-26T07:11:00.0372190Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2024-06-26T07:11:00.0373782Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2024-06-26T07:11:00.0375851Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2024-06-26T07:11:00.0377271Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2024-06-26T07:11:00.0378651Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2024-06-26T07:11:00.0380025Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2024-06-26T07:11:00.0381287Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2024-06-26T07:11:00.0382505Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c 2024-06-26T07:11:00.0383695Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin 2024-06-26T07:11:00.0384921Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2024-06-26T07:11:00.0386083Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o 2024-06-26T07:11:00.0387269Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu 2024-06-26T07:11:00.0435115Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out 2024-06-26T07:11:00.0492597Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin 2024-06-26T07:11:00.0493900Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake 2024-06-26T07:11:00.0494924Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeScratch/ 2024-06-26T07:11:00.0495762Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeTmp/ 2024-06-26T07:11:00.0496642Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/cmake.check_cache 2024-06-26T07:11:00.0497595Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/ 2024-06-26T07:11:00.0498646Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.ts 2024-06-26T07:11:00.0499817Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.make 2024-06-26T07:11:00.0501179Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/depend.make 2024-06-26T07:11:00.0502241Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/link.txt 2024-06-26T07:11:00.0503335Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/cmake_clean.cmake 2024-06-26T07:11:00.0504475Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/build.make 2024-06-26T07:11:00.0505562Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/DependInfo.cmake 2024-06-26T07:11:00.0506663Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/flags.make 2024-06-26T07:11:00.0507743Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/progress.make 2024-06-26T07:11:00.0518259Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o.d 2024-06-26T07:11:00.0580065Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o 2024-06-26T07:11:00.0581235Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-06-26T07:11:00.0582293Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/TargetDirectories.txt 2024-06-26T07:11:00.0583239Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/progress.marks 2024-06-26T07:11:00.0584138Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile2 2024-06-26T07:11:00.0585010Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile.cmake 2024-06-26T07:11:00.0585886Z inflating: build/custom_test_artifacts/jit-hook-build/detect_cuda_version.cc 2024-06-26T07:11:00.0586719Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeCache.txt 2024-06-26T07:11:00.0587482Z inflating: build/custom_test_artifacts/jit-hook-build/Makefile 2024-06-26T07:11:00.0588273Z inflating: build/custom_test_artifacts/jit-hook-build/cmake_install.cmake 2024-06-26T07:11:00.0635229Z inflating: build/custom_test_artifacts/jit-hook-build/test_jit_hooks 2024-06-26T07:11:00.0636341Z creating: build/custom_test_artifacts/custom-backend-build/ 2024-06-26T07:11:00.0637461Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/ 2024-06-26T07:11:00.0638759Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/pkgRedirects/ 2024-06-26T07:11:00.0656472Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeConfigureLog.yaml 2024-06-26T07:11:00.0657491Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/ 2024-06-26T07:11:00.0658510Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-06-26T07:11:00.0659569Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-06-26T07:11:00.0660613Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-06-26T07:11:00.0661779Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-06-26T07:11:00.0662937Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-06-26T07:11:00.0664028Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-06-26T07:11:00.0665077Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-06-26T07:11:00.0666264Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-06-26T07:11:00.0667468Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-06-26T07:11:00.0668802Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-06-26T07:11:00.0670015Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-06-26T07:11:00.0671214Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-06-26T07:11:00.0672421Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-06-26T07:11:00.0673502Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/ 2024-06-26T07:11:00.0674557Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/ 2024-06-26T07:11:00.0693446Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2024-06-26T07:11:00.0731178Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2024-06-26T07:11:00.0732793Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2024-06-26T07:11:00.0775220Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2024-06-26T07:11:00.0776686Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2024-06-26T07:11:00.0778166Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2024-06-26T07:11:00.0779677Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2024-06-26T07:11:00.0781143Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2024-06-26T07:11:00.0782580Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2024-06-26T07:11:00.0784005Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2024-06-26T07:11:00.0785425Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2024-06-26T07:11:00.0786807Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2024-06-26T07:11:00.0788122Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2024-06-26T07:11:00.0789394Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c 2024-06-26T07:11:00.0790648Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin 2024-06-26T07:11:00.0791921Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2024-06-26T07:11:00.0793162Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o 2024-06-26T07:11:00.0794414Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu 2024-06-26T07:11:00.0842743Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out 2024-06-26T07:11:00.0900946Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin 2024-06-26T07:11:00.0902189Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake 2024-06-26T07:11:00.0903227Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeScratch/ 2024-06-26T07:11:00.0904270Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeTmp/ 2024-06-26T07:11:00.0905231Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/cmake.check_cache 2024-06-26T07:11:00.0906249Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/ 2024-06-26T07:11:00.0907371Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.ts 2024-06-26T07:11:00.0908619Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.make 2024-06-26T07:11:00.0909805Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/depend.make 2024-06-26T07:11:00.0910926Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/link.txt 2024-06-26T07:11:00.0912080Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/cmake_clean.cmake 2024-06-26T07:11:00.0913384Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/build.make 2024-06-26T07:11:00.0914618Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/DependInfo.cmake 2024-06-26T07:11:00.0915769Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/flags.make 2024-06-26T07:11:00.0916927Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/progress.make 2024-06-26T07:11:00.0918154Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o.d 2024-06-26T07:11:00.1031954Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o 2024-06-26T07:11:00.1033120Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/ 2024-06-26T07:11:00.1034578Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.ts 2024-06-26T07:11:00.1036524Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.make 2024-06-26T07:11:00.1038381Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/depend.make 2024-06-26T07:11:00.1040151Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/link.txt 2024-06-26T07:11:00.1041979Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/cmake_clean.cmake 2024-06-26T07:11:00.1043800Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/build.make 2024-06-26T07:11:00.1045223Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/DependInfo.cmake 2024-06-26T07:11:00.1046455Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/flags.make 2024-06-26T07:11:00.1047674Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/progress.make 2024-06-26T07:11:00.1056042Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o.d 2024-06-26T07:11:00.1109053Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o 2024-06-26T07:11:00.1110331Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-06-26T07:11:00.1111455Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/TargetDirectories.txt 2024-06-26T07:11:00.1112473Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/progress.marks 2024-06-26T07:11:00.1113430Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile2 2024-06-26T07:11:00.1114499Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile.cmake 2024-06-26T07:11:00.1115448Z inflating: build/custom_test_artifacts/custom-backend-build/detect_cuda_version.cc 2024-06-26T07:11:00.1116348Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeCache.txt 2024-06-26T07:11:00.1117175Z inflating: build/custom_test_artifacts/custom-backend-build/Makefile 2024-06-26T07:11:00.1118016Z inflating: build/custom_test_artifacts/custom-backend-build/cmake_install.cmake 2024-06-26T07:11:00.1215398Z inflating: build/custom_test_artifacts/custom-backend-build/libcustom_backend.so 2024-06-26T07:11:00.1256513Z inflating: build/custom_test_artifacts/custom-backend-build/test_custom_backend 2024-06-26T07:11:00.1257169Z creating: build/lib/ 2024-06-26T07:11:00.1341994Z inflating: build/lib/libprotobuf-lite.a 2024-06-26T07:11:00.1781943Z inflating: build/lib/libprotobuf.a 2024-06-26T07:11:00.1790592Z inflating: build/lib/libpthreadpool.a 2024-06-26T07:11:00.1798469Z inflating: build/lib/libcpuinfo.a 2024-06-26T07:11:00.1806295Z inflating: build/lib/libcpuinfo_internals.a 2024-06-26T07:11:00.1807011Z inflating: build/lib/libclog.a 2024-06-26T07:11:00.1824677Z inflating: build/lib/libnnpack.a 2024-06-26T07:11:00.1826800Z inflating: build/lib/libnnpack_reference_layers.a 2024-06-26T07:11:00.1889366Z inflating: build/lib/libgtest.a 2024-06-26T07:11:00.1961804Z inflating: build/lib/libbenchmark.a 2024-06-26T07:11:00.2022934Z inflating: build/lib/libasmjit.a 2024-06-26T07:11:00.2030401Z inflating: build/lib/libittnotify.a 2024-06-26T07:11:00.2057232Z inflating: build/lib/libtensorpipe_uv.a 2024-06-26T07:11:00.2179643Z inflating: build/lib/libgloo.a 2024-06-26T07:11:00.2200712Z inflating: build/lib/libfmt.a 2024-06-26T07:11:00.2289727Z inflating: build/lib/libc10.so 2024-06-26T07:11:00.2291337Z inflating: build/lib/libcaffe2_nvrtc.so 2024-06-26T07:11:00.2291947Z inflating: build/lib/libfoxi_loader.a 2024-06-26T07:11:00.2293787Z inflating: build/lib/libtorch_global_deps.so 2024-06-26T07:11:00.2312169Z inflating: build/lib/libpytorch_qnnpack.a 2024-06-26T07:11:00.2329531Z inflating: build/lib/libgmock.a 2024-06-26T07:11:00.2330085Z inflating: build/lib/libgtest_main.a 2024-06-26T07:11:00.2330827Z inflating: build/lib/libbenchmark_main.a 2024-06-26T07:11:00.2816509Z inflating: build/lib/libprotoc.a 2024-06-26T07:11:00.3186597Z inflating: build/lib/libgloo_cuda.a 2024-06-26T07:11:01.2919887Z inflating: build/lib/libdnnl.a 2024-06-26T07:11:01.3471059Z inflating: build/lib/libtensorpipe.a 2024-06-26T07:11:01.3522958Z inflating: build/lib/libc10_cuda.so 2024-06-26T07:11:01.3523860Z inflating: build/lib/libgmock_main.a 2024-06-26T07:11:01.4727684Z inflating: build/lib/libfbgemm.a 2024-06-26T07:11:01.4972905Z inflating: build/lib/libtensorpipe_cuda.a 2024-06-26T07:11:01.5470724Z inflating: build/lib/libkineto.a 2024-06-26T07:11:01.5649367Z inflating: build/lib/libXNNPACK.a 2024-06-26T07:11:01.5689324Z inflating: build/lib/libonnx_proto.a 2024-06-26T07:11:01.6354481Z inflating: build/lib/libonnx.a 2024-06-26T07:11:03.9647761Z inflating: build/lib/libtorch_cpu.so 2024-06-26T07:11:03.9651665Z inflating: build/lib/libunbox_lib.a 2024-06-26T07:11:03.9655916Z inflating: build/lib/libshm.so 2024-06-26T07:11:05.9528860Z inflating: build/lib/libtorch_cuda.so 2024-06-26T07:11:05.9529811Z inflating: build/lib/libtorch.so 2024-06-26T07:11:06.7478677Z inflating: build/lib/libtorch_cuda_linalg.so 2024-06-26T07:11:06.7480350Z inflating: build/lib/libc10d_cuda_test.so 2024-06-26T07:11:06.9377051Z inflating: build/lib/libtorch_python.so 2024-06-26T07:11:06.9444332Z inflating: build/lib/libtorchbind_test.so 2024-06-26T07:11:06.9462833Z inflating: build/lib/libjitbackend_test.so 2024-06-26T07:11:06.9487267Z inflating: build/lib/libbackend_with_compiler.so 2024-06-26T07:11:06.9520604Z inflating: build/lib/libnnapi_backend.so 2024-06-26T07:11:06.9521066Z creating: build/bin/ 2024-06-26T07:11:06.9569754Z inflating: build/bin/c10_CompileTimeFunctionPointer_test 2024-06-26T07:11:06.9619532Z inflating: build/bin/c10_DeviceGuard_test 2024-06-26T07:11:06.9668312Z inflating: build/bin/c10_Device_test 2024-06-26T07:11:06.9725511Z inflating: build/bin/c10_DispatchKeySet_test 2024-06-26T07:11:06.9777529Z inflating: build/bin/c10_Scalar_test 2024-06-26T07:11:06.9824862Z inflating: build/bin/c10_StreamGuard_test 2024-06-26T07:11:06.9877683Z inflating: build/bin/c10_InlineDeviceGuard_test 2024-06-26T07:11:06.9927529Z inflating: build/bin/c10_SymInt_test 2024-06-26T07:11:06.9981429Z inflating: build/bin/c10_InlineStreamGuard_test 2024-06-26T07:11:07.0035840Z inflating: build/bin/c10_SizesAndStrides_test 2024-06-26T07:11:07.0087473Z inflating: build/bin/c10_Bitset_test 2024-06-26T07:11:07.0156966Z inflating: build/bin/c10_cow_test 2024-06-26T07:11:07.0203971Z inflating: build/bin/c10_ConstexprCrc_test 2024-06-26T07:11:07.0252796Z inflating: build/bin/c10_DeadlockDetection_test 2024-06-26T07:11:07.0301566Z inflating: build/bin/c10_Half_test 2024-06-26T07:11:07.0355917Z inflating: build/bin/c10_LeftRight_test 2024-06-26T07:11:07.0409341Z inflating: build/bin/c10_Metaprogramming_test 2024-06-26T07:11:07.0457865Z inflating: build/bin/c10_Synchronized_test 2024-06-26T07:11:07.0511680Z inflating: build/bin/c10_ThreadLocal_test 2024-06-26T07:11:07.0561570Z inflating: build/bin/c10_TypeIndex_test 2024-06-26T07:11:07.0611537Z inflating: build/bin/c10_TypeList_test 2024-06-26T07:11:07.0658564Z inflating: build/bin/c10_TypeTraits_test 2024-06-26T07:11:07.0708717Z inflating: build/bin/c10_accumulate_test 2024-06-26T07:11:07.0762776Z inflating: build/bin/c10_bfloat16_test 2024-06-26T07:11:07.0811149Z inflating: build/bin/c10_bit_cast_test 2024-06-26T07:11:07.0865965Z inflating: build/bin/c10_complex_math_test 2024-06-26T07:11:07.0919867Z inflating: build/bin/c10_complex_test 2024-06-26T07:11:07.0971430Z inflating: build/bin/c10_exception_test 2024-06-26T07:11:07.1019896Z inflating: build/bin/c10_flags_test 2024-06-26T07:11:07.1068442Z inflating: build/bin/c10_generic_math_test 2024-06-26T07:11:07.1227285Z inflating: build/bin/c10_intrusive_ptr_test 2024-06-26T07:11:07.1276823Z inflating: build/bin/c10_irange_test 2024-06-26T07:11:07.1328694Z inflating: build/bin/c10_lazy_test 2024-06-26T07:11:07.1383967Z inflating: build/bin/c10_logging_test 2024-06-26T07:11:07.1456570Z inflating: build/bin/c10_optional_test 2024-06-26T07:11:07.1517219Z inflating: build/bin/c10_ordered_preserving_dict_test 2024-06-26T07:11:07.1569019Z inflating: build/bin/c10_registry_test 2024-06-26T07:11:07.1715072Z inflating: build/bin/c10_small_vector_test 2024-06-26T07:11:07.1765199Z inflating: build/bin/c10_ssize_test 2024-06-26T07:11:07.1816146Z inflating: build/bin/c10_string_util_test 2024-06-26T07:11:07.1872522Z inflating: build/bin/c10_string_view_test 2024-06-26T07:11:07.1921319Z inflating: build/bin/c10_tempfile_test 2024-06-26T07:11:07.1968522Z inflating: build/bin/c10_intrusive_ptr_benchmark 2024-06-26T07:11:07.2022949Z inflating: build/bin/c10_typeid_test 2024-06-26T07:11:07.2456476Z inflating: build/bin/protoc-3.13.0.0 2024-06-26T07:11:07.2889216Z inflating: build/bin/protoc 2024-06-26T07:11:07.2940346Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_1_var_test 2024-06-26T07:11:07.2991670Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_catches_stream 2024-06-26T07:11:07.3042735Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_catches_thread_and_block_and_device 2024-06-26T07:11:07.3093923Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_from_2_processes 2024-06-26T07:11:07.3145522Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_blocks_and_threads 2024-06-26T07:11:07.3196947Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_multiple_blocks 2024-06-26T07:11:07.3245398Z inflating: build/bin/c10_cuda_CUDATest 2024-06-26T07:11:07.3296829Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_same_block 2024-06-26T07:11:07.3616258Z inflating: build/bin/vec_test_all_types_DEFAULT 2024-06-26T07:11:07.3949091Z inflating: build/bin/vec_test_all_types_AVX512 2024-06-26T07:11:07.4295097Z inflating: build/bin/vec_test_all_types_AVX2 2024-06-26T07:11:07.4346577Z inflating: build/bin/FileStoreTest 2024-06-26T07:11:07.4400529Z inflating: build/bin/TCPStoreTest 2024-06-26T07:11:07.4452243Z inflating: build/bin/HashStoreTest 2024-06-26T07:11:07.4465341Z inflating: build/bin/ProcessGroupMPITest 2024-06-26T07:11:07.4517707Z inflating: build/bin/test_edge_op_registration 2024-06-26T07:11:07.4521604Z inflating: build/bin/torch_shm_manager 2024-06-26T07:11:07.4524283Z inflating: build/bin/example_allreduce 2024-06-26T07:11:07.4577827Z inflating: build/bin/test_dist_autograd 2024-06-26T07:11:07.4646101Z inflating: build/bin/test_cpp_rpc 2024-06-26T07:11:07.4647710Z inflating: build/bin/parallel_benchmark 2024-06-26T07:11:07.4712770Z inflating: build/bin/test_mobile_nnc 2024-06-26T07:11:07.4721418Z inflating: build/bin/aot_model_compiler_test 2024-06-26T07:11:07.5054987Z inflating: build/bin/test_lazy 2024-06-26T07:11:07.6199639Z inflating: build/bin/test_api 2024-06-26T07:11:07.6272027Z inflating: build/bin/Dict_test 2024-06-26T07:11:07.6322472Z inflating: build/bin/Dimname_test 2024-06-26T07:11:07.6384892Z inflating: build/bin/MaybeOwned_test 2024-06-26T07:11:07.6440676Z inflating: build/bin/NamedTensor_test 2024-06-26T07:11:07.6497857Z inflating: build/bin/apply_utils_test 2024-06-26T07:11:07.6554855Z inflating: build/bin/atest 2024-06-26T07:11:07.6617879Z inflating: build/bin/basic 2024-06-26T07:11:07.6672456Z inflating: build/bin/broadcast_test 2024-06-26T07:11:07.6723103Z inflating: build/bin/cpu_allocator_test 2024-06-26T07:11:07.6781282Z inflating: build/bin/cpu_generator_test 2024-06-26T07:11:07.6834577Z inflating: build/bin/cpu_profiling_allocator_test 2024-06-26T07:11:07.6927727Z inflating: build/bin/cpu_rng_test 2024-06-26T07:11:07.6976342Z inflating: build/bin/dispatch_key_set_test 2024-06-26T07:11:07.7025137Z inflating: build/bin/dlconvertor_test 2024-06-26T07:11:07.7081606Z inflating: build/bin/extension_backend_test 2024-06-26T07:11:07.7135703Z inflating: build/bin/half_test 2024-06-26T07:11:07.7228507Z inflating: build/bin/ivalue_test 2024-06-26T07:11:07.7276849Z inflating: build/bin/lazy_tensor_test 2024-06-26T07:11:07.7329722Z inflating: build/bin/math_kernel_test 2024-06-26T07:11:07.7382485Z inflating: build/bin/memory_format_test 2024-06-26T07:11:07.7433792Z inflating: build/bin/memory_overlapping_test 2024-06-26T07:11:07.7485480Z inflating: build/bin/mobile_memory_cleanup 2024-06-26T07:11:07.7539600Z inflating: build/bin/native_test 2024-06-26T07:11:07.7588692Z inflating: build/bin/operator_name_test 2024-06-26T07:11:07.7638627Z inflating: build/bin/operators_test 2024-06-26T07:11:07.7688933Z inflating: build/bin/packedtensoraccessor_test 2024-06-26T07:11:07.7754192Z inflating: build/bin/pow_test 2024-06-26T07:11:07.7809956Z inflating: build/bin/quantized_test 2024-06-26T07:11:07.7858842Z inflating: build/bin/reduce_ops_test 2024-06-26T07:11:07.7908448Z inflating: build/bin/reportMemoryUsage_test 2024-06-26T07:11:07.7963271Z inflating: build/bin/scalar_tensor_test 2024-06-26T07:11:07.8020118Z inflating: build/bin/scalar_test 2024-06-26T07:11:07.8070442Z inflating: build/bin/StorageUtils_test 2024-06-26T07:11:07.8121643Z inflating: build/bin/stride_properties_test 2024-06-26T07:11:07.8197541Z inflating: build/bin/tensor_iterator_test 2024-06-26T07:11:07.8250315Z inflating: build/bin/test_parallel 2024-06-26T07:11:07.8253414Z inflating: build/bin/thread_init_test 2024-06-26T07:11:07.8307140Z inflating: build/bin/type_ptr_test 2024-06-26T07:11:07.8365399Z inflating: build/bin/type_test 2024-06-26T07:11:07.8415850Z inflating: build/bin/undefined_tensor_test 2024-06-26T07:11:07.8417347Z inflating: build/bin/verify_api_visibility 2024-06-26T07:11:07.8484568Z inflating: build/bin/legacy_vmap_test 2024-06-26T07:11:07.8534852Z inflating: build/bin/weakref_test 2024-06-26T07:11:07.8584847Z inflating: build/bin/wrapdim_test 2024-06-26T07:11:07.8635433Z inflating: build/bin/xla_tensor_test 2024-06-26T07:11:07.8694273Z inflating: build/bin/IListRef_test 2024-06-26T07:11:07.8796781Z inflating: build/bin/List_test 2024-06-26T07:11:07.8861288Z inflating: build/bin/KernelFunction_test 2024-06-26T07:11:07.8979546Z inflating: build/bin/kernel_function_legacy_test 2024-06-26T07:11:07.9073205Z inflating: build/bin/kernel_function_test 2024-06-26T07:11:07.9197641Z inflating: build/bin/kernel_lambda_legacy_test 2024-06-26T07:11:07.9297937Z inflating: build/bin/kernel_lambda_test 2024-06-26T07:11:07.9357260Z inflating: build/bin/kernel_stackbased_test 2024-06-26T07:11:07.9450724Z inflating: build/bin/make_boxed_from_unboxed_functor_test 2024-06-26T07:11:07.9499970Z inflating: build/bin/CppSignature_test 2024-06-26T07:11:07.9554119Z inflating: build/bin/backend_fallback_test 2024-06-26T07:11:07.9602079Z inflating: build/bin/op_allowlist_test 2024-06-26T07:11:07.9894334Z inflating: build/bin/op_registration_test 2024-06-26T07:11:07.9956870Z inflating: build/bin/inline_container_test 2024-06-26T07:11:08.0007649Z inflating: build/bin/cuda_apply_test 2024-06-26T07:11:08.0056506Z inflating: build/bin/cuda_allocator_test 2024-06-26T07:11:08.0113872Z inflating: build/bin/cuda_atomic_ops_test 2024-06-26T07:11:08.0166758Z inflating: build/bin/cuda_caching_host_allocator_test 2024-06-26T07:11:08.0234592Z inflating: build/bin/cuda_complex_math_test 2024-06-26T07:11:08.0291979Z inflating: build/bin/cuda_complex_test 2024-06-26T07:11:08.0340315Z inflating: build/bin/cuda_device_test 2024-06-26T07:11:08.0395857Z inflating: build/bin/cuda_cub_test 2024-06-26T07:11:08.0445758Z inflating: build/bin/cuda_dlconvertor_test 2024-06-26T07:11:08.0508370Z inflating: build/bin/cuda_distributions_test 2024-06-26T07:11:08.0563929Z inflating: build/bin/cuda_generator_test 2024-06-26T07:11:08.0611670Z inflating: build/bin/cuda_half_test 2024-06-26T07:11:08.0661411Z inflating: build/bin/cuda_integer_divider_test 2024-06-26T07:11:08.0709058Z inflating: build/bin/cuda_optional_test 2024-06-26T07:11:08.0759085Z inflating: build/bin/cuda_packedtensoraccessor_test 2024-06-26T07:11:08.0810320Z inflating: build/bin/cuda_reportMemoryUsage_test 2024-06-26T07:11:08.0858850Z inflating: build/bin/cuda_allocatorTraceTracker_test 2024-06-26T07:11:08.0918276Z inflating: build/bin/cuda_stream_test 2024-06-26T07:11:08.0965734Z inflating: build/bin/cuda_cudnn_test 2024-06-26T07:11:08.1016273Z inflating: build/bin/cuda_vectorized_test 2024-06-26T07:11:08.1030663Z inflating: build/bin/tutorial_tensorexpr 2024-06-26T07:11:08.1094306Z inflating: build/bin/ProcessGroupGlooTest 2024-06-26T07:11:08.1149894Z inflating: build/bin/ProcessGroupGlooAsyncTest 2024-06-26T07:11:08.1211208Z inflating: build/bin/ProcessGroupNCCLTest 2024-06-26T07:11:08.1271832Z inflating: build/bin/ProcessGroupNCCLErrorsTest 2024-06-26T07:11:08.2078125Z inflating: build/bin/test_tensorexpr 2024-06-26T07:11:08.2638572Z inflating: build/bin/test_jit 2024-06-26T07:11:08.2639006Z creating: .additional_ci_files/ 2024-06-26T07:11:08.2693409Z inflating: .additional_ci_files/test-times.json 2024-06-26T07:11:08.2904311Z inflating: .additional_ci_files/test-class-times.json 2024-06-26T07:11:08.2929585Z ##[group]Run rm artifacts.zip 2024-06-26T07:11:08.2929966Z rm artifacts.zip 2024-06-26T07:11:08.2937943Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:11:08.2938573Z env: 2024-06-26T07:11:08.2938866Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:11:08.2939314Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:11:08.2939801Z ##[endgroup] 2024-06-26T07:11:08.4628392Z ##[group]Run df -H 2024-06-26T07:11:08.4628717Z df -H 2024-06-26T07:11:08.4636345Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:11:08.4636896Z env: 2024-06-26T07:11:08.4637163Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:11:08.4637610Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:11:08.4638094Z ##[endgroup] 2024-06-26T07:11:08.4664442Z Filesystem Size Used Avail Use% Mounted on 2024-06-26T07:11:08.4665127Z devtmpfs 34G 0 34G 0% /dev 2024-06-26T07:11:08.4666040Z tmpfs 34G 0 34G 0% /dev/shm 2024-06-26T07:11:08.4666652Z tmpfs 34G 512k 34G 1% /run 2024-06-26T07:11:08.4667183Z tmpfs 34G 0 34G 0% /sys/fs/cgroup 2024-06-26T07:11:08.4667668Z /dev/nvme0n1p1 162G 43G 119G 27% / 2024-06-26T07:11:08.4668276Z tmpfs 6.7G 0 6.7G 0% /run/user/0 2024-06-26T07:11:08.4705874Z Prepare all required actions 2024-06-26T07:11:08.4706300Z Getting action download info 2024-06-26T07:11:08.6267073Z ##[group]Run ./.github/actions/download-td-artifacts 2024-06-26T07:11:08.6267538Z with: 2024-06-26T07:11:08.6267794Z env: 2024-06-26T07:11:08.6268058Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:11:08.6268507Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:11:08.6268987Z ##[endgroup] 2024-06-26T07:11:08.6299288Z ##[group]Run seemethere/download-artifact-s3@v4 2024-06-26T07:11:08.6299729Z with: 2024-06-26T07:11:08.6299991Z name: td_results 2024-06-26T07:11:08.6300310Z s3-bucket: gha-artifacts 2024-06-26T07:11:08.6300656Z region: us-east-1 2024-06-26T07:11:08.6300949Z env: 2024-06-26T07:11:08.6301216Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:11:08.6301662Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:11:08.6302151Z ##[endgroup] 2024-06-26T07:11:09.0355715Z (node:4030) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2024-06-26T07:11:09.0356410Z 2024-06-26T07:11:09.0356669Z Please migrate your code to use AWS SDK for JavaScript (v3). 2024-06-26T07:11:09.0357377Z For more information, check the migration guide at https://a.co/7PzMCcy 2024-06-26T07:11:09.0358192Z (Use `node --trace-warnings ...` to show where the warning was created) 2024-06-26T07:11:09.1085354Z Found 0 objects with prefix pytorch/pytorch/9673646806/td_results/ 2024-06-26T07:11:09.1091385Z Artifact download has finished successfully 2024-06-26T07:11:09.1224595Z ##[group]Run mkdir -p .additional_ci_files 2024-06-26T07:11:09.1225077Z mkdir -p .additional_ci_files 2024-06-26T07:11:09.1225639Z mv td_results.json .additional_ci_files/td_results.json 2024-06-26T07:11:09.1233365Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:11:09.1233875Z env: 2024-06-26T07:11:09.1234153Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:11:09.1234619Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:11:09.1235092Z ##[endgroup] 2024-06-26T07:11:09.1282310Z mv: cannot stat 'td_results.json': No such file or directory 2024-06-26T07:11:09.1292602Z ##[error]Process completed with exit code 1. 2024-06-26T07:11:09.1344025Z ##[group]Run .github/scripts/parse_ref.py 2024-06-26T07:11:09.1344530Z .github/scripts/parse_ref.py 2024-06-26T07:11:09.1351579Z shell: /usr/bin/bash -e {0} 2024-06-26T07:11:09.1351927Z env: 2024-06-26T07:11:09.1352200Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:11:09.1352648Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:11:09.1353116Z ##[endgroup] 2024-06-26T07:11:09.1578888Z Prepare all required actions 2024-06-26T07:11:09.1615715Z ##[group]Run ./.github/actions/get-workflow-job-id 2024-06-26T07:11:09.1616173Z with: 2024-06-26T07:11:09.1616716Z github-token: *** 2024-06-26T07:11:09.1617149Z env: 2024-06-26T07:11:09.1617420Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:11:09.1617868Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:11:09.1618344Z ##[endgroup] 2024-06-26T07:11:09.1633087Z ##[group]Run set -eux 2024-06-26T07:11:09.1633419Z set -eux 2024-06-26T07:11:09.1634002Z python3 .github/scripts/get_workflow_job_id.py "${GITHUB_RUN_ID}" "${RUNNER_NAME}" 2024-06-26T07:11:09.1641859Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:11:09.1642350Z env: 2024-06-26T07:11:09.1642620Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:11:09.1643067Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:11:09.1643698Z GITHUB_TOKEN: *** 2024-06-26T07:11:09.1644001Z ##[endgroup] 2024-06-26T07:11:09.1662949Z + python3 .github/scripts/get_workflow_job_id.py 9673646806 i-0ca3df5e506f33f09 2024-06-26T07:11:09.7421595Z setting job-id=26688917434 2024-06-26T07:11:09.7422635Z setting job-name=cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (dynamic_aot_eager_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-06-26T07:11:09.7621642Z Prepare all required actions 2024-06-26T07:11:09.7622071Z Getting action download info 2024-06-26T07:11:09.8792181Z ##[group]Run ./.github/actions/filter-test-configs 2024-06-26T07:11:09.8792631Z with: 2024-06-26T07:11:09.8793080Z github-token: *** 2024-06-26T07:11:09.8799713Z test-matrix: {"include": [{"config": "dynamo_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}]} 2024-06-26T07:11:09.8807296Z job-name: cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (dynamic_aot_eager_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-06-26T07:11:09.8808225Z env: 2024-06-26T07:11:09.8808490Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:11:09.8808935Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:11:09.8809406Z ##[endgroup] 2024-06-26T07:11:09.8849594Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2024-06-26T07:11:09.8850154Z with: 2024-06-26T07:11:09.8850419Z shell: bash 2024-06-26T07:11:09.8850716Z timeout_minutes: 10 2024-06-26T07:11:09.8851036Z max_attempts: 5 2024-06-26T07:11:09.8851347Z retry_wait_seconds: 30 2024-06-26T07:11:09.8852468Z command: set -eux # PyYAML 6.0 doesn't work with MacOS x86 anymore # This must run on Python-3.7 (AmazonLinux2) so can't use request=3.32.2 python3 -m pip install requests==2.27.1 pyyaml==6.0.1 2024-06-26T07:11:09.8853773Z polling_interval_seconds: 1 2024-06-26T07:11:09.8854287Z warning_on_retry: true 2024-06-26T07:11:09.8854636Z continue_on_error: false 2024-06-26T07:11:09.8854966Z env: 2024-06-26T07:11:09.8855239Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:11:09.8855685Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:11:09.8856322Z GITHUB_TOKEN: *** 2024-06-26T07:11:09.8856623Z ##[endgroup] 2024-06-26T07:11:09.9351362Z + python3 -m pip install requests==2.27.1 pyyaml==6.0.1 2024-06-26T07:11:10.1499566Z Defaulting to user installation because normal site-packages is not writeable 2024-06-26T07:11:10.1655313Z Requirement already satisfied: requests==2.27.1 in /home/ec2-user/.local/lib/python3.7/site-packages (2.27.1) 2024-06-26T07:11:10.1800524Z Requirement already satisfied: pyyaml==6.0.1 in /home/ec2-user/.local/lib/python3.7/site-packages (6.0.1) 2024-06-26T07:11:10.1808956Z Requirement already satisfied: certifi>=2017.4.17 in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.27.1) (2024.6.2) 2024-06-26T07:11:10.1818152Z Requirement already satisfied: charset-normalizer~=2.0.0; python_version >= "3" in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.27.1) (2.0.12) 2024-06-26T07:11:10.1839185Z Requirement already satisfied: urllib3<1.27,>=1.21.1 in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.27.1) (1.26.19) 2024-06-26T07:11:10.2039091Z Requirement already satisfied: idna<4,>=2.5; python_version >= "3" in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.27.1) (3.7) 2024-06-26T07:11:10.9352652Z Command completed after 1 attempt(s). 2024-06-26T07:11:10.9394132Z ##[group]Run set -x 2024-06-26T07:11:10.9394464Z set -x 2024-06-26T07:11:10.9394758Z  2024-06-26T07:11:10.9395306Z # Use relative path here as this could be checked out anywhere, not necessarily 2024-06-26T07:11:10.9395981Z # in runner workspace 2024-06-26T07:11:10.9396505Z python3 "${GITHUB_ACTION_PATH}/../../scripts/parse_ref.py" 2024-06-26T07:11:10.9404240Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:11:10.9404741Z env: 2024-06-26T07:11:10.9405142Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:11:10.9405598Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:11:10.9406083Z ##[endgroup] 2024-06-26T07:11:10.9426057Z + python3 /home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/filter-test-configs/../../scripts/parse_ref.py 2024-06-26T07:11:10.9638028Z ##[group]Run echo "Workflow: ${GITHUB_WORKFLOW}" 2024-06-26T07:11:10.9638576Z echo "Workflow: ${GITHUB_WORKFLOW}" 2024-06-26T07:11:10.9639040Z echo "Job name: ${JOB_NAME}" 2024-06-26T07:11:10.9639440Z  2024-06-26T07:11:10.9639976Z # Use relative path here as this could be checked out anywhere, not necessarily 2024-06-26T07:11:10.9640658Z # in runner workspace 2024-06-26T07:11:10.9641219Z python3 "${GITHUB_ACTION_PATH}/../../scripts/filter_test_configs.py" \ 2024-06-26T07:11:10.9641868Z  --workflow "${GITHUB_WORKFLOW}" \ 2024-06-26T07:11:10.9642318Z  --job-name "${JOB_NAME}" \ 2024-06-26T07:11:10.9649138Z  --test-matrix "{"include": [{"config": "dynamo_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}]}" \ 2024-06-26T07:11:10.9656529Z  --selected-test-configs "" \ 2024-06-26T07:11:10.9656978Z  --pr-number "${PR_NUMBER}" \ 2024-06-26T07:11:10.9657423Z  --tag "${TAG}" \ 2024-06-26T07:11:10.9657816Z  --event-name "${EVENT_NAME}" \ 2024-06-26T07:11:10.9658270Z  --schedule "${SCHEDULE}" \ 2024-06-26T07:11:10.9658787Z  --branch "${HEAD_BRANCH}" 2024-06-26T07:11:10.9666401Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:11:10.9666899Z env: 2024-06-26T07:11:10.9667225Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:11:10.9667683Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:11:10.9668347Z GITHUB_TOKEN: *** 2024-06-26T07:11:10.9669171Z JOB_NAME: cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (dynamic_aot_eager_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-06-26T07:11:10.9670052Z PR_NUMBER: 2024-06-26T07:11:10.9670368Z TAG: ciflow/inductor/129470 2024-06-26T07:11:10.9670735Z EVENT_NAME: push 2024-06-26T07:11:10.9671039Z SCHEDULE: 2024-06-26T07:11:10.9671317Z HEAD_BRANCH: 2024-06-26T07:11:10.9671614Z ##[endgroup] 2024-06-26T07:11:10.9692020Z Workflow: inductor-periodic 2024-06-26T07:11:10.9693269Z Job name: cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (dynamic_aot_eager_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-06-26T07:11:11.1685918Z INFO:root:Found no test-config label on the PR, so all test configs are included 2024-06-26T07:11:11.3128231Z ##[group]Run echo "Filtered matrix:" 2024-06-26T07:11:11.3128689Z echo "Filtered matrix:" 2024-06-26T07:11:11.3135719Z echo "{"include": [{"config": "dynamo_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}]}" 2024-06-26T07:11:11.3142922Z  2024-06-26T07:11:11.3143197Z echo 2024-06-26T07:11:11.3143582Z echo "Is the current job unstable? False" 2024-06-26T07:11:11.3144046Z  2024-06-26T07:11:11.3144309Z echo 2024-06-26T07:11:11.3144663Z echo "Is keep-going label set? False" 2024-06-26T07:11:11.3145102Z  2024-06-26T07:11:11.3145365Z echo 2024-06-26T07:11:11.3145679Z echo "Renabled issues? " 2024-06-26T07:11:11.3153248Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:11:11.3153743Z env: 2024-06-26T07:11:11.3154012Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:11:11.3154463Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:11:11.3154940Z ##[endgroup] 2024-06-26T07:11:11.3175319Z Filtered matrix: 2024-06-26T07:11:11.3184204Z {include: [{config: dynamo_eager_torchbench, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamo_eager_torchbench, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamo_eager_huggingface, shard: 1, num_shards: 1, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamo_eager_timm, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamo_eager_timm, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: aot_eager_torchbench, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: aot_eager_torchbench, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: aot_eager_huggingface, shard: 1, num_shards: 1, runner: linux.g5.4xlarge.nvidia.gpu}, {config: aot_eager_timm, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: aot_eager_timm, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_aot_eager_torchbench, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_aot_eager_torchbench, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_aot_eager_huggingface, shard: 1, num_shards: 1, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_aot_eager_timm, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_aot_eager_timm, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}]} 2024-06-26T07:11:11.3191087Z 2024-06-26T07:11:11.3191241Z Is the current job unstable? False 2024-06-26T07:11:11.3191520Z 2024-06-26T07:11:11.3191738Z Is keep-going label set? False 2024-06-26T07:11:11.3191999Z 2024-06-26T07:11:11.3192123Z Renabled issues? 2024-06-26T07:11:11.3244197Z ##[group]Run echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2024-06-26T07:11:11.3245058Z echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2024-06-26T07:11:11.3252943Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:11:11.3253698Z env: 2024-06-26T07:11:11.3253976Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:11:11.3254421Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:11:11.3254895Z JOB_TIMEOUT: 240 2024-06-26T07:11:11.3255209Z ##[endgroup] 2024-06-26T07:11:11.3323020Z ##[group]Run set -x 2024-06-26T07:11:11.3323406Z set -x 2024-06-26T07:11:11.3323699Z  2024-06-26T07:11:11.3324052Z if [[ $TEST_CONFIG == 'multigpu' ]]; then 2024-06-26T07:11:11.3324588Z  TEST_COMMAND=.ci/pytorch/multigpu-test.sh 2024-06-26T07:11:11.3325220Z elif [[ $BUILD_ENVIRONMENT == *onnx* ]]; then 2024-06-26T07:11:11.3325727Z  TEST_COMMAND=.ci/onnx/test.sh 2024-06-26T07:11:11.3326140Z else 2024-06-26T07:11:11.3326472Z  TEST_COMMAND=.ci/pytorch/test.sh 2024-06-26T07:11:11.3326890Z fi 2024-06-26T07:11:11.3327165Z  2024-06-26T07:11:11.3327630Z # detached container should get cleaned up by teardown_ec2_linux 2024-06-26T07:11:11.3328377Z # TODO: Stop building test binaries as part of the build phase 2024-06-26T07:11:11.3329049Z # Used for GPU_FLAG since that doesn't play nice 2024-06-26T07:11:11.3329630Z # shellcheck disable=SC2086,SC2090 2024-06-26T07:11:11.3330197Z container_name=$(docker run \ 2024-06-26T07:11:11.3330613Z  ${GPU_FLAG:-} \ 2024-06-26T07:11:11.3330981Z  -e BUILD_ENVIRONMENT \ 2024-06-26T07:11:11.3331382Z  -e PR_NUMBER \ 2024-06-26T07:11:11.3331737Z  -e GITHUB_ACTIONS \ 2024-06-26T07:11:11.3332130Z  -e GITHUB_REPOSITORY \ 2024-06-26T07:11:11.3332531Z  -e GITHUB_WORKFLOW \ 2024-06-26T07:11:11.3332917Z  -e GITHUB_JOB \ 2024-06-26T07:11:11.3333401Z  -e GITHUB_RUN_ID \ 2024-06-26T07:11:11.3333782Z  -e GITHUB_RUN_NUMBER \ 2024-06-26T07:11:11.3334189Z  -e GITHUB_RUN_ATTEMPT \ 2024-06-26T07:11:11.3334577Z  -e JOB_ID \ 2024-06-26T07:11:11.3334918Z  -e JOB_NAME \ 2024-06-26T07:11:11.3335263Z  -e BASE_SHA \ 2024-06-26T07:11:11.3335607Z  -e BRANCH \ 2024-06-26T07:11:11.3335933Z  -e SHA1 \ 2024-06-26T07:11:11.3336286Z  -e AWS_DEFAULT_REGION \ 2024-06-26T07:11:11.3336685Z  -e IN_WHEEL_TEST \ 2024-06-26T07:11:11.3337062Z  -e SHARD_NUMBER \ 2024-06-26T07:11:11.3337424Z  -e TEST_CONFIG \ 2024-06-26T07:11:11.3337789Z  -e NUM_TEST_SHARDS \ 2024-06-26T07:11:11.3338180Z  -e REENABLED_ISSUES \ 2024-06-26T07:11:11.3338589Z  -e CONTINUE_THROUGH_ERROR \ 2024-06-26T07:11:11.3339002Z  -e VERBOSE_TEST_LOGS \ 2024-06-26T07:11:11.3339398Z  -e NO_TEST_TIMEOUT \ 2024-06-26T07:11:11.3339772Z  -e NO_TD \ 2024-06-26T07:11:11.3340105Z  -e TD_DISTRIBUTED \ 2024-06-26T07:11:11.3340484Z  -e PR_LABELS \ 2024-06-26T07:11:11.3340885Z  -e MAX_JOBS="$(nproc --ignore=2)" \ 2024-06-26T07:11:11.3341337Z  -e SCCACHE_BUCKET \ 2024-06-26T07:11:11.3341722Z  -e SCCACHE_S3_KEY_PREFIX \ 2024-06-26T07:11:11.3342133Z  -e XLA_CUDA \ 2024-06-26T07:11:11.3342535Z  -e XLA_CLANG_CACHE_S3_BUCKET_NAME \ 2024-06-26T07:11:11.3343044Z  -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK \ 2024-06-26T07:11:11.3343556Z  -e PYTORCH_TEST_RERUN_DISABLED_TESTS \ 2024-06-26T07:11:11.3344069Z  -e SKIP_SCCACHE_INITIALIZATION=1 \ 2024-06-26T07:11:11.3344532Z  -e HUGGING_FACE_HUB_TOKEN \ 2024-06-26T07:11:11.3344948Z  -e DASHBOARD_TAG \ 2024-06-26T07:11:11.3345413Z  --env-file="/tmp/github_env_${GITHUB_RUN_ID}" \ 2024-06-26T07:11:11.3345965Z  --security-opt seccomp=unconfined \ 2024-06-26T07:11:11.3346424Z  --cap-add=SYS_PTRACE \ 2024-06-26T07:11:11.3346814Z  --ipc=host \ 2024-06-26T07:11:11.3347160Z  --shm-size="${SHM_SIZE}" \ 2024-06-26T07:11:11.3347557Z  --tty \ 2024-06-26T07:11:11.3347872Z  --detach \ 2024-06-26T07:11:11.3348228Z  --name="${container_name}" \ 2024-06-26T07:11:11.3348637Z  --user jenkins \ 2024-06-26T07:11:11.3349220Z  -v "${GITHUB_WORKSPACE}:/var/lib/jenkins/workspace" \ 2024-06-26T07:11:11.3349789Z  -w /var/lib/jenkins/workspace \ 2024-06-26T07:11:11.3350225Z  "${DOCKER_IMAGE}" 2024-06-26T07:11:11.3350565Z ) 2024-06-26T07:11:11.3350967Z # Propagate download.pytorch.org IP to container 2024-06-26T07:11:11.3351881Z grep download.pytorch.org /etc/hosts | docker exec -i "${container_name}" sudo bash -c "/bin/cat >> /etc/hosts" 2024-06-26T07:11:11.3352845Z echo "DOCKER_CONTAINER_ID=${container_name}" >> "${GITHUB_ENV}" 2024-06-26T07:11:11.3353742Z docker exec -t "${container_name}" sh -c "pip install $(echo dist/*.whl)[opt-einsum] && ${TEST_COMMAND}" 2024-06-26T07:11:11.3361060Z shell: /usr/bin/bash -e {0} 2024-06-26T07:11:11.3361411Z env: 2024-06-26T07:11:11.3361685Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:11:11.3362126Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:11:11.3362737Z BUILD_ENVIRONMENT: linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-06-26T07:11:11.3363320Z PR_NUMBER: 2024-06-26T07:11:11.3363642Z GITHUB_REPOSITORY: pytorch/pytorch 2024-06-26T07:11:11.3364063Z GITHUB_WORKFLOW: inductor-periodic 2024-06-26T07:11:11.3364463Z GITHUB_JOB: test 2024-06-26T07:11:11.3364777Z GITHUB_RUN_ID: 9673646806 2024-06-26T07:11:11.3365194Z GITHUB_RUN_NUMBER: 45567 2024-06-26T07:11:11.3365540Z GITHUB_RUN_ATTEMPT: 1 2024-06-26T07:11:11.3365872Z JOB_ID: 26688917434 2024-06-26T07:11:11.3366701Z JOB_NAME: cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (dynamic_aot_eager_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-06-26T07:11:11.3367638Z BRANCH: 2024-06-26T07:11:11.3367966Z SHA1: b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:11:11.3368473Z BASE_SHA: b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:11:11.3368957Z TEST_CONFIG: dynamic_aot_eager_timm 2024-06-26T07:11:11.3369359Z SHARD_NUMBER: 2 2024-06-26T07:11:11.3369658Z NUM_TEST_SHARDS: 2 2024-06-26T07:11:11.3369984Z REENABLED_ISSUES: 2024-06-26T07:11:11.3370322Z CONTINUE_THROUGH_ERROR: False 2024-06-26T07:11:11.3370697Z VERBOSE_TEST_LOGS: False 2024-06-26T07:11:11.3371052Z NO_TEST_TIMEOUT: False 2024-06-26T07:11:11.3371382Z NO_TD: False 2024-06-26T07:11:11.3371681Z TD_DISTRIBUTED: False 2024-06-26T07:11:11.3372087Z SCCACHE_BUCKET: ossci-compiler-cache-circleci-v2 2024-06-26T07:11:11.3372602Z SCCACHE_S3_KEY_PREFIX: inductor-periodic 2024-06-26T07:11:11.3373024Z SHM_SIZE: 2g 2024-06-26T07:11:11.3374606Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:11:11.3375765Z XLA_CUDA: 2024-06-26T07:11:11.3376239Z XLA_CLANG_CACHE_S3_BUCKET_NAME: ossci-compiler-clang-cache-circleci-xla 2024-06-26T07:11:11.3376843Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK: 0 2024-06-26T07:11:11.3377278Z PYTORCH_TEST_RERUN_DISABLED_TESTS: 0 2024-06-26T07:11:11.3377702Z DASHBOARD_TAG: 2024-06-26T07:11:11.3378236Z HUGGING_FACE_HUB_TOKEN: *** 2024-06-26T07:11:11.3378599Z ##[endgroup] 2024-06-26T07:11:11.3397964Z + [[ dynamic_aot_eager_timm == \m\u\l\t\i\g\p\u ]] 2024-06-26T07:11:11.3398657Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *onnx* ]] 2024-06-26T07:11:11.3399171Z + TEST_COMMAND=.ci/pytorch/test.sh 2024-06-26T07:11:11.3404676Z +++ nproc --ignore=2 2024-06-26T07:11:11.3417473Z ++ docker run --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all -e BUILD_ENVIRONMENT -e PR_NUMBER -e GITHUB_ACTIONS -e GITHUB_REPOSITORY -e GITHUB_WORKFLOW -e GITHUB_JOB -e GITHUB_RUN_ID -e GITHUB_RUN_NUMBER -e GITHUB_RUN_ATTEMPT -e JOB_ID -e JOB_NAME -e BASE_SHA -e BRANCH -e SHA1 -e AWS_DEFAULT_REGION -e IN_WHEEL_TEST -e SHARD_NUMBER -e TEST_CONFIG -e NUM_TEST_SHARDS -e REENABLED_ISSUES -e CONTINUE_THROUGH_ERROR -e VERBOSE_TEST_LOGS -e NO_TEST_TIMEOUT -e NO_TD -e TD_DISTRIBUTED -e PR_LABELS -e MAX_JOBS=14 -e SCCACHE_BUCKET -e SCCACHE_S3_KEY_PREFIX -e XLA_CUDA -e XLA_CLANG_CACHE_S3_BUCKET_NAME -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK -e PYTORCH_TEST_RERUN_DISABLED_TESTS -e SKIP_SCCACHE_INITIALIZATION=1 -e HUGGING_FACE_HUB_TOKEN -e DASHBOARD_TAG --env-file=/tmp/github_env_9673646806 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --ipc=host --shm-size=2g --tty --detach --name= --user jenkins -v /home/ec2-user/actions-runner/_work/pytorch/pytorch:/var/lib/jenkins/workspace -w /var/lib/jenkins/workspace 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:11:22.4878620Z + container_name=2feb940639e95f98d292cc0177cf41c33c1dc1cf1a28c6851c24f2f2d2501d2a 2024-06-26T07:11:22.4879639Z + grep download.pytorch.org /etc/hosts 2024-06-26T07:11:22.4881773Z + docker exec -i 2feb940639e95f98d292cc0177cf41c33c1dc1cf1a28c6851c24f2f2d2501d2a sudo bash -c '/bin/cat >> /etc/hosts' 2024-06-26T07:11:22.5571634Z + echo DOCKER_CONTAINER_ID=2feb940639e95f98d292cc0177cf41c33c1dc1cf1a28c6851c24f2f2d2501d2a 2024-06-26T07:11:22.5573700Z ++ echo dist/torch-2.5.0a0+gitb8c4c54-cp310-cp310-linux_x86_64.whl 2024-06-26T07:11:22.5575526Z + docker exec -t 2feb940639e95f98d292cc0177cf41c33c1dc1cf1a28c6851c24f2f2d2501d2a sh -c 'pip install dist/torch-2.5.0a0+gitb8c4c54-cp310-cp310-linux_x86_64.whl[opt-einsum] && .ci/pytorch/test.sh' 2024-06-26T07:11:22.9371866Z Processing ./dist/torch-2.5.0a0+gitb8c4c54-cp310-cp310-linux_x86_64.whl (from torch==2.5.0a0+gitb8c4c54) 2024-06-26T07:11:23.2485216Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (3.13.1) 2024-06-26T07:11:23.2489426Z Requirement already satisfied: typing-extensions>=4.8.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (4.12.2) 2024-06-26T07:11:23.2491722Z Requirement already satisfied: sympy in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (1.12.1) 2024-06-26T07:11:23.2495548Z Requirement already satisfied: networkx in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (2.8.8) 2024-06-26T07:11:23.2497736Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (3.1.4) 2024-06-26T07:11:23.2500711Z Requirement already satisfied: fsspec in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (2024.2.0) 2024-06-26T07:11:23.2526166Z Requirement already satisfied: opt-einsum>=3.3 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (3.3.0) 2024-06-26T07:11:23.2584097Z Requirement already satisfied: numpy>=1.7 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from opt-einsum>=3.3->torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (1.21.2) 2024-06-26T07:11:23.3017531Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from jinja2->torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (2.1.5) 2024-06-26T07:11:23.3176599Z Requirement already satisfied: mpmath<1.4.0,>=1.1.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from sympy->torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (1.3.0) 2024-06-26T07:11:24.6160719Z Installing collected packages: torch 2024-06-26T07:11:33.2836715Z ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 2024-06-26T07:11:33.2838093Z timm 0.9.7 requires torchvision, which is not installed. 2024-06-26T07:11:33.2838768Z Successfully installed torch-2.5.0a0+gitb8c4c54 2024-06-26T07:11:33.3624946Z ++ dirname .ci/pytorch/test.sh 2024-06-26T07:11:33.3629797Z + source .ci/pytorch/common.sh 2024-06-26T07:11:33.3632810Z +++ dirname .ci/pytorch/common.sh 2024-06-26T07:11:33.3638208Z ++ source .ci/pytorch/common_utils.sh 2024-06-26T07:11:33.3639087Z +++ declare -f -t trap_add 2024-06-26T07:11:33.3644448Z ++ set -ex 2024-06-26T07:11:33.3645008Z ++ [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *rocm* ]] 2024-06-26T07:11:33.3645718Z ++ BUILD_TEST_LIBTORCH=0 2024-06-26T07:11:33.3646701Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *rocm* ]] 2024-06-26T07:11:33.3648423Z ++ stat -c %u /var/lib/jenkins/workspace 2024-06-26T07:11:33.3655605Z + WORKSPACE_ORIGINAL_OWNER_ID=1000 2024-06-26T07:11:33.3656052Z + trap_add cleanup_workspace EXIT 2024-06-26T07:11:33.3656522Z + trap_add_cmd=cleanup_workspace 2024-06-26T07:11:33.3658481Z + shift 2024-06-26T07:11:33.3658795Z + for trap_add_name in "$@" 2024-06-26T07:11:33.3661241Z +++ trap -p EXIT 2024-06-26T07:11:33.3662015Z ++ eval 'extract_trap_cmd ' 2024-06-26T07:11:33.3662526Z +++ extract_trap_cmd 2024-06-26T07:11:33.3663038Z +++ printf '%s\n' '' 2024-06-26T07:11:33.3663609Z ++ printf '%s\n' cleanup_workspace 2024-06-26T07:11:33.3664660Z + trap -- ' 2024-06-26T07:11:33.3665076Z cleanup_workspace' EXIT 2024-06-26T07:11:33.3665544Z + sudo chown -R jenkins /var/lib/jenkins/workspace 2024-06-26T07:11:33.8362040Z + git config --global --add safe.directory /var/lib/jenkins/workspace 2024-06-26T07:11:33.8375013Z + echo 'Environment variables:' 2024-06-26T07:11:33.8375424Z Environment variables: 2024-06-26T07:11:33.8375740Z + env 2024-06-26T07:11:33.8381556Z INSTALLED_DB=yes 2024-06-26T07:11:33.8382075Z NV_LIBCUBLAS_VERSION=12.1.3.1-1 2024-06-26T07:11:33.8382466Z NVIDIA_VISIBLE_DEVICES=all 2024-06-26T07:11:33.8382936Z NV_NVML_DEV_VERSION=12.1.105-1 2024-06-26T07:11:33.8386158Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-06-26T07:11:33.8386757Z CONTINUE_THROUGH_ERROR=False 2024-06-26T07:11:33.8387362Z NV_LIBNCCL_DEV_PACKAGE=libnccl-dev=2.17.1-1+cuda12.1 2024-06-26T07:11:33.8388107Z NV_LIBNCCL_DEV_PACKAGE_VERSION=2.17.1-1 2024-06-26T07:11:33.8388738Z BUILD_ENVIRONMENT=linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-06-26T07:11:33.8389335Z HOSTNAME=2feb940639e9 2024-06-26T07:11:33.8390205Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_aacb20c5-f38a-41e3-9b2a-6b0a0f876db8 2024-06-26T07:11:33.8391015Z GITHUB_ACTION=__self 2024-06-26T07:11:33.8391452Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2024-06-26T07:11:33.8396327Z NVIDIA_REQUIRE_CUDA=cuda>=12.1 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 brand=tesla,driver>=525,driver<526 brand=unknown,driver>=525,driver<526 brand=nvidia,driver>=525,driver<526 brand=nvidiartx,driver>=525,driver<526 brand=geforce,driver>=525,driver<526 brand=geforcertx,driver>=525,driver<526 brand=quadro,driver>=525,driver<526 brand=quadrortx,driver>=525,driver<526 brand=titan,driver>=525,driver<526 brand=titanrtx,driver>=525,driver<526 2024-06-26T07:11:33.8400315Z NV_LIBCUBLAS_DEV_PACKAGE=libcublas-dev-12-1=12.1.3.1-1 2024-06-26T07:11:33.8400823Z NV_NVTX_VERSION=12.1.105-1 2024-06-26T07:11:33.8401171Z GITHUB_RUN_NUMBER=45567 2024-06-26T07:11:33.8401526Z TEST_CONFIG=dynamic_aot_eager_timm 2024-06-26T07:11:33.8401931Z GITHUB_REPOSITORY_OWNER_ID=21003710 2024-06-26T07:11:33.8402383Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2024-06-26T07:11:33.8402837Z NV_CUDA_CUDART_DEV_VERSION=12.1.105-1 2024-06-26T07:11:33.8403270Z NV_LIBCUSPARSE_VERSION=12.1.0.106-1 2024-06-26T07:11:33.8403681Z NV_LIBNPP_VERSION=12.1.0.40-1 2024-06-26T07:11:33.8404207Z GITHUB_TRIGGERING_ACTOR=pytorch-bot[bot] 2024-06-26T07:11:33.8404888Z CMAKE_CUDA_COMPILER_LAUNCHER=/opt/cache/bin/sccache 2024-06-26T07:11:33.8405350Z GITHUB_REF_TYPE=tag 2024-06-26T07:11:33.8405664Z TORCH_CUDA_ARCH_LIST=Maxwell 2024-06-26T07:11:33.8406069Z NCCL_VERSION=2.17.1-1 2024-06-26T07:11:33.8406733Z BASE_SHA=b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:11:33.8407194Z XLA_CUDA= 2024-06-26T07:11:33.8407677Z HUGGING_FACE_HUB_TOKEN=*** 2024-06-26T07:11:33.8409618Z *** 2024-06-26T07:11:33.8409913Z CARGO_NET_GIT_FETCH_WITH_CLI=true 2024-06-26T07:11:33.8410311Z GITHUB_REPOSITORY_ID=65600975 2024-06-26T07:11:33.8410665Z GITHUB_ACTIONS=true 2024-06-26T07:11:33.8411052Z NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:11:33.8411550Z NV_NVPROF_DEV_PACKAGE=cuda-nvprof-12-1=12.1.105-1 2024-06-26T07:11:33.8412081Z NV_LIBNPP_PACKAGE=libnpp-12-1=12.1.0.40-1 2024-06-26T07:11:33.8412578Z SHA1=b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:11:33.8413313Z NV_LIBNCCL_DEV_PACKAGE_NAME=libnccl-dev 2024-06-26T07:11:33.8413917Z GITHUB_SHA=b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:11:33.8414910Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/inductor-periodic.yml@refs/tags/ciflow/inductor/129470 2024-06-26T07:11:33.8415674Z UCC_HOME=/usr 2024-06-26T07:11:33.8416012Z NV_LIBCUBLAS_DEV_VERSION=12.1.3.1-1 2024-06-26T07:11:33.8416648Z VERBOSE_TEST_LOGS=False 2024-06-26T07:11:33.8416985Z NVIDIA_PRODUCT_NAME=CUDA 2024-06-26T07:11:33.8417439Z NV_LIBCUBLAS_DEV_PACKAGE_NAME=libcublas-dev-12-1 2024-06-26T07:11:33.8417974Z GITHUB_REF=refs/tags/ciflow/inductor/129470 2024-06-26T07:11:33.8418469Z NV_CUDA_CUDART_VERSION=12.1.105-1 2024-06-26T07:11:33.8418838Z SHARD_NUMBER=2 2024-06-26T07:11:33.8419142Z GITHUB_REF_PROTECTED=false 2024-06-26T07:11:33.8419486Z HOME=/var/lib/jenkins 2024-06-26T07:11:33.8419845Z GITHUB_API_URL=https://api.github.com 2024-06-26T07:11:33.8420271Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2024-06-26T07:11:33.8420736Z UCX_COMMIT=7bb2722ff2187a0cad557ae4a6afa090569f83fb 2024-06-26T07:11:33.8421272Z SCCACHE_S3_KEY_PREFIX=inductor-periodic 2024-06-26T07:11:33.8421683Z CUDA_VERSION=12.1.1 2024-06-26T07:11:33.8422083Z NV_LIBCUBLAS_PACKAGE=libcublas-12-1=12.1.3.1-1 2024-06-26T07:11:33.8422517Z NUM_TEST_SHARDS=2 2024-06-26T07:11:33.8422818Z UCX_HOME=/usr 2024-06-26T07:11:33.8423366Z NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE=cuda-nsight-compute-12-1=12.1.1-1 2024-06-26T07:11:33.8424490Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_aacb20c5-f38a-41e3-9b2a-6b0a0f876db8 2024-06-26T07:11:33.8425945Z JOB_NAME=cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (dynamic_aot_eager_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-06-26T07:11:33.8427413Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_aacb20c5-f38a-41e3-9b2a-6b0a0f876db8 2024-06-26T07:11:33.8428531Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2024-06-26T07:11:33.8429172Z GITHUB_EVENT_NAME=push 2024-06-26T07:11:33.8429496Z DASHBOARD_TAG= 2024-06-26T07:11:33.8429791Z GITHUB_RUN_ID=9673646806 2024-06-26T07:11:33.8430230Z NV_LIBNPP_DEV_PACKAGE=libnpp-dev-12-1=12.1.0.40-1 2024-06-26T07:11:33.8430764Z NV_LIBCUBLAS_PACKAGE_NAME=libcublas-12-1 2024-06-26T07:11:33.8431759Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_aacb20c5-f38a-41e3-9b2a-6b0a0f876db8 2024-06-26T07:11:33.8432675Z GITHUB_ACTOR=pytorch-bot[bot] 2024-06-26T07:11:33.8433068Z NV_LIBNPP_DEV_VERSION=12.1.0.40-1 2024-06-26T07:11:33.8433444Z PR_NUMBER= 2024-06-26T07:11:33.8433725Z GITHUB_RUN_ATTEMPT=1 2024-06-26T07:11:33.8434065Z ANACONDA_PYTHON_VERSION=3.10 2024-06-26T07:11:33.8434532Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2024-06-26T07:11:33.8434991Z TERM=xterm 2024-06-26T07:11:33.8435318Z NV_LIBCUSPARSE_DEV_VERSION=12.1.0.106-1 2024-06-26T07:11:33.8435725Z INSTALLED_VISION=yes 2024-06-26T07:11:33.8436030Z BRANCH= 2024-06-26T07:11:33.8436314Z OPENSSL_ROOT_DIR=/opt/openssl 2024-06-26T07:11:33.8436706Z LIBRARY_PATH=/usr/local/cuda/lib64/stubs 2024-06-26T07:11:33.8437120Z CUDA_PATH=/usr/local/cuda 2024-06-26T07:11:33.8437863Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2024-06-26T07:11:33.8438608Z GITHUB_SERVER_URL=https://github.com 2024-06-26T07:11:33.8439200Z UCC_COMMIT=20eae37090a4ce1b32bcce6144ccad0b49943e0b 2024-06-26T07:11:33.8439668Z REENABLED_ISSUES= 2024-06-26T07:11:33.8439965Z SHLVL=1 2024-06-26T07:11:33.8440220Z MAX_JOBS=14 2024-06-26T07:11:33.8440526Z NV_CUDA_LIB_VERSION=12.1.1-1 2024-06-26T07:11:33.8440867Z NVARCH=x86_64 2024-06-26T07:11:33.8441165Z GITHUB_ACTOR_ID=54816060 2024-06-26T07:11:33.8441607Z GITHUB_WORKFLOW_SHA=b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:11:33.8442123Z GITHUB_REF_NAME=ciflow/inductor/129470 2024-06-26T07:11:33.8442601Z NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-1 2024-06-26T07:11:33.8443246Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2024-06-26T07:11:33.8443811Z GITHUB_JOB=test 2024-06-26T07:11:33.8444186Z NV_LIBNCCL_PACKAGE=libnccl2=2.17.1-1+cuda12.1 2024-06-26T07:11:33.8444833Z LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64 2024-06-26T07:11:33.8445350Z NO_TEST_TIMEOUT=False 2024-06-26T07:11:33.8445676Z TD_DISTRIBUTED=False 2024-06-26T07:11:33.8446036Z NV_CUDA_NSIGHT_COMPUTE_VERSION=12.1.1-1 2024-06-26T07:11:33.8446554Z GITHUB_REPOSITORY=pytorch/pytorch 2024-06-26T07:11:33.8446967Z NV_NVPROF_VERSION=12.1.105-1 2024-06-26T07:11:33.8447328Z GITHUB_RETENTION_DAYS=90 2024-06-26T07:11:33.8447664Z OPENSSL_DIR=/opt/openssl 2024-06-26T07:11:33.8448010Z GITHUB_ACTION_REPOSITORY= 2024-06-26T07:11:33.8449042Z PATH=/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-06-26T07:11:33.8450096Z GITHUB_BASE_REF= 2024-06-26T07:11:33.8450410Z NV_LIBNCCL_PACKAGE_NAME=libnccl2 2024-06-26T07:11:33.8450771Z CI=true 2024-06-26T07:11:33.8451076Z NV_LIBNCCL_PACKAGE_VERSION=2.17.1-1 2024-06-26T07:11:33.8451480Z GITHUB_REPOSITORY_OWNER=pytorch 2024-06-26T07:11:33.8451845Z JOB_ID=26688917434 2024-06-26T07:11:33.8452153Z INSTALLED_PROTOBUF=yes 2024-06-26T07:11:33.8452486Z GITHUB_HEAD_REF= 2024-06-26T07:11:33.8452778Z GITHUB_ACTION_REF= 2024-06-26T07:11:33.8453399Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2024-06-26T07:11:33.8453955Z GITHUB_WORKFLOW=inductor-periodic 2024-06-26T07:11:33.8454399Z DEBIAN_FRONTEND=noninteractive 2024-06-26T07:11:33.8455289Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_aacb20c5-f38a-41e3-9b2a-6b0a0f876db8 2024-06-26T07:11:33.8456099Z NO_TD=False 2024-06-26T07:11:33.8456397Z SKIP_SCCACHE_INITIALIZATION=1 2024-06-26T07:11:33.8456748Z _=/usr/bin/env 2024-06-26T07:11:33.8457216Z ++ python -c 'import site; print(site.getsitepackages()[0])' 2024-06-26T07:11:33.8521374Z + TORCH_INSTALL_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch 2024-06-26T07:11:33.8522635Z + TORCH_BIN_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/bin 2024-06-26T07:11:33.8523610Z + TORCH_LIB_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/lib 2024-06-26T07:11:33.8524479Z + TORCH_TEST_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/test 2024-06-26T07:11:33.8525270Z + BUILD_DIR=build 2024-06-26T07:11:33.8525607Z + BUILD_RENAMED_DIR=build_renamed 2024-06-26T07:11:33.8526091Z + BUILD_BIN_DIR=build/bin 2024-06-26T07:11:33.8526424Z + SHARD_NUMBER=2 2024-06-26T07:11:33.8526725Z + NUM_TEST_SHARDS=2 2024-06-26T07:11:33.8527037Z + export VALGRIND=ON 2024-06-26T07:11:33.8527354Z + VALGRIND=ON 2024-06-26T07:11:33.8527815Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *clang9* ]] 2024-06-26T07:11:33.8528302Z + [[ 0 == \1 ]] 2024-06-26T07:11:33.8528598Z + [[ False == \1 ]] 2024-06-26T07:11:33.8529054Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *bazel* ]] 2024-06-26T07:11:33.8529575Z ++ realpath build/custom_test_artifacts 2024-06-26T07:11:33.8532675Z + CUSTOM_TEST_ARTIFACT_BUILD_DIR=/var/lib/jenkins/workspace/build/custom_test_artifacts 2024-06-26T07:11:33.8533585Z + [[ -n '' ]] 2024-06-26T07:11:33.8533921Z + echo 'Environment variables' 2024-06-26T07:11:33.8534326Z Environment variables 2024-06-26T07:11:33.8534659Z + env 2024-06-26T07:11:33.8537344Z INSTALLED_DB=yes 2024-06-26T07:11:33.8537823Z NV_LIBCUBLAS_VERSION=12.1.3.1-1 2024-06-26T07:11:33.8538584Z NVIDIA_VISIBLE_DEVICES=all 2024-06-26T07:11:33.8539167Z NV_NVML_DEV_VERSION=12.1.105-1 2024-06-26T07:11:33.8539971Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-06-26T07:11:33.8540543Z CONTINUE_THROUGH_ERROR=False 2024-06-26T07:11:33.8541026Z NV_LIBNCCL_DEV_PACKAGE=libnccl-dev=2.17.1-1+cuda12.1 2024-06-26T07:11:33.8541596Z NV_LIBNCCL_DEV_PACKAGE_VERSION=2.17.1-1 2024-06-26T07:11:33.8542235Z BUILD_ENVIRONMENT=linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-06-26T07:11:33.8542808Z HOSTNAME=2feb940639e9 2024-06-26T07:11:33.8543880Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_aacb20c5-f38a-41e3-9b2a-6b0a0f876db8 2024-06-26T07:11:33.8544810Z GITHUB_ACTION=__self 2024-06-26T07:11:33.8545237Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2024-06-26T07:11:33.8549372Z NVIDIA_REQUIRE_CUDA=cuda>=12.1 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 brand=tesla,driver>=525,driver<526 brand=unknown,driver>=525,driver<526 brand=nvidia,driver>=525,driver<526 brand=nvidiartx,driver>=525,driver<526 brand=geforce,driver>=525,driver<526 brand=geforcertx,driver>=525,driver<526 brand=quadro,driver>=525,driver<526 brand=quadrortx,driver>=525,driver<526 brand=titan,driver>=525,driver<526 brand=titanrtx,driver>=525,driver<526 2024-06-26T07:11:33.8553373Z NV_LIBCUBLAS_DEV_PACKAGE=libcublas-dev-12-1=12.1.3.1-1 2024-06-26T07:11:33.8553873Z NV_NVTX_VERSION=12.1.105-1 2024-06-26T07:11:33.8554224Z GITHUB_RUN_NUMBER=45567 2024-06-26T07:11:33.8554582Z TEST_CONFIG=dynamic_aot_eager_timm 2024-06-26T07:11:33.8554985Z GITHUB_REPOSITORY_OWNER_ID=21003710 2024-06-26T07:11:33.8555477Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2024-06-26T07:11:33.8555950Z NV_CUDA_CUDART_DEV_VERSION=12.1.105-1 2024-06-26T07:11:33.8556388Z NV_LIBCUSPARSE_VERSION=12.1.0.106-1 2024-06-26T07:11:33.8556808Z NV_LIBNPP_VERSION=12.1.0.40-1 2024-06-26T07:11:33.8557235Z GITHUB_TRIGGERING_ACTOR=pytorch-bot[bot] 2024-06-26T07:11:33.8557731Z CMAKE_CUDA_COMPILER_LAUNCHER=/opt/cache/bin/sccache 2024-06-26T07:11:33.8558193Z GITHUB_REF_TYPE=tag 2024-06-26T07:11:33.8558510Z TORCH_CUDA_ARCH_LIST=Maxwell 2024-06-26T07:11:33.8558882Z NCCL_VERSION=2.17.1-1 2024-06-26T07:11:33.8559273Z BASE_SHA=b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:11:33.8559716Z XLA_CUDA= 2024-06-26T07:11:33.8560160Z HUGGING_FACE_HUB_TOKEN=*** 2024-06-26T07:11:33.8560552Z *** 2024-06-26T07:11:33.8560837Z CARGO_NET_GIT_FETCH_WITH_CLI=true 2024-06-26T07:11:33.8561231Z GITHUB_REPOSITORY_ID=65600975 2024-06-26T07:11:33.8561590Z GITHUB_ACTIONS=true 2024-06-26T07:11:33.8561921Z NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:11:33.8562407Z NV_NVPROF_DEV_PACKAGE=cuda-nvprof-12-1=12.1.105-1 2024-06-26T07:11:33.8562948Z NV_LIBNPP_PACKAGE=libnpp-12-1=12.1.0.40-1 2024-06-26T07:11:33.8563417Z SHA1=b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:11:33.8563920Z NV_LIBNCCL_DEV_PACKAGE_NAME=libnccl-dev 2024-06-26T07:11:33.8564434Z GITHUB_SHA=b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:11:33.8565517Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/inductor-periodic.yml@refs/tags/ciflow/inductor/129470 2024-06-26T07:11:33.8566287Z UCC_HOME=/usr 2024-06-26T07:11:33.8566616Z NV_LIBCUBLAS_DEV_VERSION=12.1.3.1-1 2024-06-26T07:11:33.8567018Z VERBOSE_TEST_LOGS=False 2024-06-26T07:11:33.8567357Z NVIDIA_PRODUCT_NAME=CUDA 2024-06-26T07:11:33.8567800Z NV_LIBCUBLAS_DEV_PACKAGE_NAME=libcublas-dev-12-1 2024-06-26T07:11:33.8568304Z GITHUB_REF=refs/tags/ciflow/inductor/129470 2024-06-26T07:11:33.8568766Z NV_CUDA_CUDART_VERSION=12.1.105-1 2024-06-26T07:11:33.8569133Z SHARD_NUMBER=2 2024-06-26T07:11:33.8569439Z GITHUB_REF_PROTECTED=false 2024-06-26T07:11:33.8569786Z HOME=/var/lib/jenkins 2024-06-26T07:11:33.8570145Z GITHUB_API_URL=https://api.github.com 2024-06-26T07:11:33.8570656Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2024-06-26T07:11:33.8571134Z UCX_COMMIT=7bb2722ff2187a0cad557ae4a6afa090569f83fb 2024-06-26T07:11:33.8571674Z SCCACHE_S3_KEY_PREFIX=inductor-periodic 2024-06-26T07:11:33.8572086Z CUDA_VERSION=12.1.1 2024-06-26T07:11:33.8572489Z NV_LIBCUBLAS_PACKAGE=libcublas-12-1=12.1.3.1-1 2024-06-26T07:11:33.8572927Z NUM_TEST_SHARDS=2 2024-06-26T07:11:33.8573473Z UCX_HOME=/usr 2024-06-26T07:11:33.8573984Z NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE=cuda-nsight-compute-12-1=12.1.1-1 2024-06-26T07:11:33.8575443Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_aacb20c5-f38a-41e3-9b2a-6b0a0f876db8 2024-06-26T07:11:33.8577153Z JOB_NAME=cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (dynamic_aot_eager_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-06-26T07:11:33.8578537Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_aacb20c5-f38a-41e3-9b2a-6b0a0f876db8 2024-06-26T07:11:33.8579755Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2024-06-26T07:11:33.8580397Z GITHUB_EVENT_NAME=push 2024-06-26T07:11:33.8580722Z DASHBOARD_TAG= 2024-06-26T07:11:33.8593784Z GITHUB_RUN_ID=9673646806 2024-06-26T07:11:33.8594316Z NV_LIBNPP_DEV_PACKAGE=libnpp-dev-12-1=12.1.0.40-1 2024-06-26T07:11:33.8594858Z NV_LIBCUBLAS_PACKAGE_NAME=libcublas-12-1 2024-06-26T07:11:33.8595861Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_aacb20c5-f38a-41e3-9b2a-6b0a0f876db8 2024-06-26T07:11:33.8596803Z GITHUB_ACTOR=pytorch-bot[bot] 2024-06-26T07:11:33.8597212Z NV_LIBNPP_DEV_VERSION=12.1.0.40-1 2024-06-26T07:11:33.8597595Z PR_NUMBER= 2024-06-26T07:11:33.8597874Z GITHUB_RUN_ATTEMPT=1 2024-06-26T07:11:33.8598190Z VALGRIND=ON 2024-06-26T07:11:33.8598488Z ANACONDA_PYTHON_VERSION=3.10 2024-06-26T07:11:33.8598927Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2024-06-26T07:11:33.8599392Z TERM=xterm 2024-06-26T07:11:33.8599740Z NV_LIBCUSPARSE_DEV_VERSION=12.1.0.106-1 2024-06-26T07:11:33.8600156Z INSTALLED_VISION=yes 2024-06-26T07:11:33.8600459Z BRANCH= 2024-06-26T07:11:33.8600743Z OPENSSL_ROOT_DIR=/opt/openssl 2024-06-26T07:11:33.8601140Z LIBRARY_PATH=/usr/local/cuda/lib64/stubs 2024-06-26T07:11:33.8601555Z CUDA_PATH=/usr/local/cuda 2024-06-26T07:11:33.8602301Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2024-06-26T07:11:33.8603061Z GITHUB_SERVER_URL=https://github.com 2024-06-26T07:11:33.8603545Z UCC_COMMIT=20eae37090a4ce1b32bcce6144ccad0b49943e0b 2024-06-26T07:11:33.8604025Z REENABLED_ISSUES= 2024-06-26T07:11:33.8604347Z SHLVL=1 2024-06-26T07:11:33.8604606Z MAX_JOBS=14 2024-06-26T07:11:33.8604989Z NV_CUDA_LIB_VERSION=12.1.1-1 2024-06-26T07:11:33.8605334Z NVARCH=x86_64 2024-06-26T07:11:33.8605629Z GITHUB_ACTOR_ID=54816060 2024-06-26T07:11:33.8606079Z GITHUB_WORKFLOW_SHA=b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:11:33.8606601Z GITHUB_REF_NAME=ciflow/inductor/129470 2024-06-26T07:11:33.8607089Z NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-1 2024-06-26T07:11:33.8607743Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2024-06-26T07:11:33.8608315Z GITHUB_JOB=test 2024-06-26T07:11:33.8608696Z NV_LIBNCCL_PACKAGE=libnccl2=2.17.1-1+cuda12.1 2024-06-26T07:11:33.8609243Z LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64 2024-06-26T07:11:33.8609752Z NO_TEST_TIMEOUT=False 2024-06-26T07:11:33.8610077Z TD_DISTRIBUTED=False 2024-06-26T07:11:33.8610448Z NV_CUDA_NSIGHT_COMPUTE_VERSION=12.1.1-1 2024-06-26T07:11:33.8610885Z GITHUB_REPOSITORY=pytorch/pytorch 2024-06-26T07:11:33.8611302Z NV_NVPROF_VERSION=12.1.105-1 2024-06-26T07:11:33.8611663Z GITHUB_RETENTION_DAYS=90 2024-06-26T07:11:33.8612001Z OPENSSL_DIR=/opt/openssl 2024-06-26T07:11:33.8612350Z GITHUB_ACTION_REPOSITORY= 2024-06-26T07:11:33.8613583Z PATH=/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-06-26T07:11:33.8614809Z GITHUB_BASE_REF= 2024-06-26T07:11:33.8615130Z NV_LIBNCCL_PACKAGE_NAME=libnccl2 2024-06-26T07:11:33.8615498Z CI=true 2024-06-26T07:11:33.8615819Z NV_LIBNCCL_PACKAGE_VERSION=2.17.1-1 2024-06-26T07:11:33.8616224Z GITHUB_REPOSITORY_OWNER=pytorch 2024-06-26T07:11:33.8616593Z JOB_ID=26688917434 2024-06-26T07:11:33.8616906Z INSTALLED_PROTOBUF=yes 2024-06-26T07:11:33.8617232Z GITHUB_HEAD_REF= 2024-06-26T07:11:33.8617523Z GITHUB_ACTION_REF= 2024-06-26T07:11:33.8617944Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2024-06-26T07:11:33.8618467Z GITHUB_WORKFLOW=inductor-periodic 2024-06-26T07:11:33.8618863Z DEBIAN_FRONTEND=noninteractive 2024-06-26T07:11:33.8619763Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_aacb20c5-f38a-41e3-9b2a-6b0a0f876db8 2024-06-26T07:11:33.8620585Z NO_TD=False 2024-06-26T07:11:33.8620889Z SKIP_SCCACHE_INITIALIZATION=1 2024-06-26T07:11:33.8621242Z _=/usr/bin/env 2024-06-26T07:11:33.8621574Z + echo 'Testing pytorch' 2024-06-26T07:11:33.8622006Z Testing pytorch 2024-06-26T07:11:33.8622329Z + export LANG=C.UTF-8 2024-06-26T07:11:33.8622652Z + LANG=C.UTF-8 2024-06-26T07:11:33.8622937Z + PR_NUMBER= 2024-06-26T07:11:33.8623284Z + [[ dynamic_aot_eager_timm == \d\e\f\a\u\l\t ]] 2024-06-26T07:11:33.8623813Z + [[ dynamic_aot_eager_timm == \d\i\s\t\r\i\b\u\t\e\d ]] 2024-06-26T07:11:33.8624358Z + [[ dynamic_aot_eager_timm == \s\l\o\w ]] 2024-06-26T07:11:33.8624999Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *slow-gradcheck* ]] 2024-06-26T07:11:33.8625686Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *cuda* ]] 2024-06-26T07:11:33.8626223Z + export PYTORCH_TESTING_DEVICE_ONLY_FOR=cuda 2024-06-26T07:11:33.8626697Z + PYTORCH_TESTING_DEVICE_ONLY_FOR=cuda 2024-06-26T07:11:33.8627150Z + [[ dynamic_aot_eager_timm == *crossref* ]] 2024-06-26T07:11:33.8627721Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *rocm* ]] 2024-06-26T07:11:33.8628336Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *xpu* ]] 2024-06-26T07:11:33.8628982Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *-bazel-* ]] 2024-06-26T07:11:33.8629542Z + pip_install --user ninja==1.10.2 2024-06-26T07:11:33.8630066Z + pip install --progress-bar off --user ninja==1.10.2 2024-06-26T07:11:34.2197131Z Collecting ninja==1.10.2 2024-06-26T07:11:34.2367890Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl.metadata (5.0 kB) 2024-06-26T07:11:34.2503771Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl (108 kB) 2024-06-26T07:11:35.5383575Z Installing collected packages: ninja 2024-06-26T07:11:35.5448496Z  WARNING: The script ninja is installed in '/var/lib/jenkins/.local/bin' which is not on PATH. 2024-06-26T07:11:35.5449744Z Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. 2024-06-26T07:11:35.5492004Z Successfully installed ninja-1.10.2 2024-06-26T07:11:35.6320943Z + export PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-06-26T07:11:35.6323063Z + PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-06-26T07:11:35.6324469Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *aarch64* ]] 2024-06-26T07:11:35.6325050Z + install_tlparse 2024-06-26T07:11:35.6325417Z + pip_install --user tlparse==0.3.7 2024-06-26T07:11:35.6325957Z + pip install --progress-bar off --user tlparse==0.3.7 2024-06-26T07:11:35.9845715Z Collecting tlparse==0.3.7 2024-06-26T07:11:35.9994098Z Downloading tlparse-0.3.7-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (346 bytes) 2024-06-26T07:11:36.0107074Z Downloading tlparse-0.3.7-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.2 MB) 2024-06-26T07:11:37.3237015Z Installing collected packages: tlparse 2024-06-26T07:11:37.3606442Z Successfully installed tlparse-0.3.7 2024-06-26T07:11:37.4409425Z ++ python -m site --user-base 2024-06-26T07:11:37.4561062Z + PATH=/var/lib/jenkins/.local/bin:/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-06-26T07:11:37.4563678Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *asan* ]] 2024-06-26T07:11:37.4564612Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *-debug* ]] 2024-06-26T07:11:37.4565727Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *-bazel-* ]] 2024-06-26T07:11:37.4566918Z + echo 'We are not in debug mode: linux-focal-cuda12.1-py3.10-gcc9-sm86. Expect the assertion to pass' 2024-06-26T07:11:37.4568056Z We are not in debug mode: linux-focal-cuda12.1-py3.10-gcc9-sm86. Expect the assertion to pass 2024-06-26T07:11:37.4568752Z + cd test 2024-06-26T07:11:37.4569275Z + python -c 'import torch; torch._C._crash_if_debug_asserts_fail(424242)' 2024-06-26T07:11:38.9151935Z + [[ dynamic_aot_eager_timm == \n\o\g\p\u\_\N\O\_\A\V\X\2 ]] 2024-06-26T07:11:38.9152767Z + [[ dynamic_aot_eager_timm == \n\o\g\p\u\_\A\V\X\5\1\2 ]] 2024-06-26T07:11:38.9153685Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *-bazel-* ]] 2024-06-26T07:11:38.9154171Z + pushd test 2024-06-26T07:11:38.9154490Z ~/workspace/test ~/workspace 2024-06-26T07:11:38.9155237Z ++ python -c 'import torch; print(torch.version.cuda)' 2024-06-26T07:11:40.4050242Z + CUDA_VERSION=12.1 2024-06-26T07:11:40.4050858Z + '[' 12.1 == 12.4 ']' 2024-06-26T07:11:40.4051196Z + ISCUDA124= 2024-06-26T07:11:40.4051479Z + popd 2024-06-26T07:11:40.4051750Z ~/workspace 2024-06-26T07:11:40.4054922Z + DYNAMO_BENCHMARK_FLAGS=() 2024-06-26T07:11:40.4055544Z + [[ dynamic_aot_eager_timm == *dynamo_eager* ]] 2024-06-26T07:11:40.4056229Z + [[ dynamic_aot_eager_timm == *aot_eager* ]] 2024-06-26T07:11:40.4056989Z + DYNAMO_BENCHMARK_FLAGS+=(--backend aot_eager) 2024-06-26T07:11:40.4057503Z + [[ dynamic_aot_eager_timm == *dynamic* ]] 2024-06-26T07:11:40.4058167Z + DYNAMO_BENCHMARK_FLAGS+=(--dynamic-shapes --dynamic-batch-only) 2024-06-26T07:11:40.4058774Z + [[ dynamic_aot_eager_timm == *cpu_inductor* ]] 2024-06-26T07:11:40.4059285Z + DYNAMO_BENCHMARK_FLAGS+=(--device cuda) 2024-06-26T07:11:40.4083553Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *libtorch* ]] 2024-06-26T07:11:40.4084351Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *-bazel-* ]] 2024-06-26T07:11:40.4086063Z + cd test 2024-06-26T07:11:40.4086694Z + python -c 'import torch; print(torch.__config__.show())' 2024-06-26T07:11:41.7662154Z PyTorch built with: 2024-06-26T07:11:41.7662875Z - GCC 9.4 2024-06-26T07:11:41.7663293Z - C++ Version: 201703 2024-06-26T07:11:41.7664133Z - Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications 2024-06-26T07:11:41.7665204Z - Intel(R) MKL-DNN v3.4.2 (Git Hash 1137e04ec0b5251ca2b4400a4fd3c667ce843d67) 2024-06-26T07:11:41.7665861Z - OpenMP 201511 (a.k.a. OpenMP 4.5) 2024-06-26T07:11:41.7666403Z - LAPACK is enabled (usually provided by MKL) 2024-06-26T07:11:41.7666879Z - NNPACK is enabled 2024-06-26T07:11:41.7667254Z - CPU capability usage: AVX2 2024-06-26T07:11:41.7667657Z - CUDA Runtime 12.1 2024-06-26T07:11:41.7668169Z - NVCC architecture flags: -gencode;arch=compute_86,code=sm_86 2024-06-26T07:11:41.7668754Z - CuDNN 90.1 (built against CUDA 12.4) 2024-06-26T07:11:41.7669197Z - Magma 2.6.1 2024-06-26T07:11:41.7676397Z - Build settings: BLAS_INFO=mkl, BUILD_TYPE=Release, CUDA_VERSION=12.1, CUDNN_VERSION=9.1.0, CXX_COMPILER=/opt/cache/bin/c++, CXX_FLAGS= -D_GLIBCXX_USE_CXX11_ABI=1 -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOROCTRACER -DUSE_FBGEMM -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -O2 -fPIC -Wall -Wextra -Werror=return-type -Werror=non-virtual-dtor -Werror=bool-operation -Wnarrowing -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-unused-parameter -Wno-unused-function -Wno-unused-result -Wno-strict-overflow -Wno-strict-aliasing -Wno-stringop-overflow -Wsuggest-override -Wno-psabi -Wno-error=pedantic -Wno-error=old-style-cast -Wno-missing-braces -fdiagnostics-color=always -faligned-new -Werror -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Wno-stringop-overflow, FORCE_FALLBACK_CUDA_MPI=1, LAPACK_INFO=mkl, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, PERF_WITH_AVX512=1, TORCH_VERSION=2.5.0, USE_CUDA=ON, USE_CUDNN=ON, USE_CUSPARSELT=ON, USE_EXCEPTION_PTR=1, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_GLOO=ON, USE_MKL=ON, USE_MKLDNN=ON, USE_MPI=ON, USE_NCCL=ON, USE_NNPACK=ON, USE_OPENMP=ON, USE_ROCM=OFF, USE_ROCM_KERNEL_ASSERT=OFF, 2024-06-26T07:11:41.7683040Z 2024-06-26T07:11:42.0283820Z + cd test 2024-06-26T07:11:42.0284510Z + python -c 'import torch; print(torch.__config__.parallel_info())' 2024-06-26T07:11:43.2627755Z ATen/Parallel: 2024-06-26T07:11:43.2628259Z at::get_num_threads() : 8 2024-06-26T07:11:43.2629214Z at::get_num_interop_threads() : 16 2024-06-26T07:11:43.2629739Z OpenMP 201511 (a.k.a. OpenMP 4.5) 2024-06-26T07:11:43.2630223Z omp_get_max_threads() : 8 2024-06-26T07:11:43.2631173Z Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications 2024-06-26T07:11:43.2631971Z mkl_get_max_threads() : 8 2024-06-26T07:11:43.2632598Z Intel(R) MKL-DNN v3.4.2 (Git Hash 1137e04ec0b5251ca2b4400a4fd3c667ce843d67) 2024-06-26T07:11:43.2633232Z std::thread::hardware_concurrency() : 16 2024-06-26T07:11:43.2633658Z Environment variables: 2024-06-26T07:11:43.2633998Z OMP_NUM_THREADS : [not set] 2024-06-26T07:11:43.2634367Z MKL_NUM_THREADS : [not set] 2024-06-26T07:11:43.2634743Z ATen parallel backend: OpenMP 2024-06-26T07:11:43.2634992Z 2024-06-26T07:11:43.5112098Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *aarch64* ]] 2024-06-26T07:11:43.5112678Z + [[ dynamic_aot_eager_timm == *backward* ]] 2024-06-26T07:11:43.5113135Z + [[ dynamic_aot_eager_timm == *xla* ]] 2024-06-26T07:11:43.5113646Z + [[ dynamic_aot_eager_timm == *executorch* ]] 2024-06-26T07:11:43.5114154Z + [[ dynamic_aot_eager_timm == \j\i\t\_\l\e\g\a\c\y ]] 2024-06-26T07:11:43.5114794Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *libtorch* ]] 2024-06-26T07:11:43.5115342Z + [[ dynamic_aot_eager_timm == distributed ]] 2024-06-26T07:11:43.5115869Z + [[ dynamic_aot_eager_timm == *inductor_distributed* ]] 2024-06-26T07:11:43.5116458Z + [[ dynamic_aot_eager_timm == *inductor-halide* ]] 2024-06-26T07:11:43.5117074Z + [[ dynamic_aot_eager_timm == *inductor-micro-benchmark* ]] 2024-06-26T07:11:43.5117617Z + [[ dynamic_aot_eager_timm == *huggingface* ]] 2024-06-26T07:11:43.5118081Z + [[ dynamic_aot_eager_timm == *timm* ]] 2024-06-26T07:11:43.5118493Z + install_torchvision 2024-06-26T07:11:43.5118812Z + local orig_preload 2024-06-26T07:11:43.5119130Z + local commit 2024-06-26T07:11:43.5119440Z ++ get_pinned_commit vision 2024-06-26T07:11:43.5119823Z ++ cat .github/ci_commit_pins/vision.txt 2024-06-26T07:11:43.5125381Z + commit=d23a6e1664d20707c11781299611436e1f0c104f 2024-06-26T07:11:43.5125841Z + orig_preload= 2024-06-26T07:11:43.5126169Z + '[' -n '' ']' 2024-06-26T07:11:43.5126982Z + pip_install --no-use-pep517 --user git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2024-06-26T07:11:43.5128393Z + pip install --progress-bar off --no-use-pep517 --user git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2024-06-26T07:11:43.8220497Z Collecting git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2024-06-26T07:11:43.8223694Z Cloning https://github.com/pytorch/vision.git (to revision d23a6e1664d20707c11781299611436e1f0c104f) to /tmp/pip-req-build-b9vq8mo5 2024-06-26T07:11:43.8240478Z Running command git clone --filter=blob:none --quiet https://github.com/pytorch/vision.git /tmp/pip-req-build-b9vq8mo5 2024-06-26T07:11:45.1647003Z Running command git rev-parse -q --verify 'sha^d23a6e1664d20707c11781299611436e1f0c104f' 2024-06-26T07:11:45.1665992Z Running command git fetch -q https://github.com/pytorch/vision.git d23a6e1664d20707c11781299611436e1f0c104f 2024-06-26T07:11:46.3732319Z Running command git checkout -q d23a6e1664d20707c11781299611436e1f0c104f 2024-06-26T07:11:46.5978174Z Resolved https://github.com/pytorch/vision.git to commit d23a6e1664d20707c11781299611436e1f0c104f 2024-06-26T07:11:48.8908054Z Preparing metadata (setup.py) ... [?25l- \ done 2024-06-26T07:11:48.8955067Z [?25hRequirement already satisfied: numpy in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (1.21.2) 2024-06-26T07:11:48.8958052Z Requirement already satisfied: torch in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (2.5.0a0+gitb8c4c54) 2024-06-26T07:11:48.8963269Z Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (10.3.0) 2024-06-26T07:11:48.9166314Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (3.13.1) 2024-06-26T07:11:48.9172789Z Requirement already satisfied: typing-extensions>=4.8.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (4.12.2) 2024-06-26T07:11:48.9175486Z Requirement already satisfied: sympy in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (1.12.1) 2024-06-26T07:11:48.9178550Z Requirement already satisfied: networkx in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (2.8.8) 2024-06-26T07:11:48.9180987Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (3.1.4) 2024-06-26T07:11:48.9184035Z Requirement already satisfied: fsspec in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (2024.2.0) 2024-06-26T07:11:48.9609577Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from jinja2->torch->torchvision==0.19.0a0+d23a6e1) (2.1.5) 2024-06-26T07:11:48.9764157Z Requirement already satisfied: mpmath<1.4.0,>=1.1.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from sympy->torch->torchvision==0.19.0a0+d23a6e1) (1.3.0) 2024-06-26T07:11:48.9837224Z Building wheels for collected packages: torchvision 2024-06-26T07:13:03.2100284Z Building wheel for torchvision (setup.py) ... [?25l- \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | done 2024-06-26T07:13:03.2126201Z [?25h Created wheel for torchvision: filename=torchvision-0.19.0a0+d23a6e1-cp310-cp310-linux_x86_64.whl size=2112818 sha256=949623181200e1a4894b9549edcf025dda4f4b27f06903a2a0eba3941989e863 2024-06-26T07:13:03.2130107Z Stored in directory: /var/lib/jenkins/.cache/pip/wheels/0e/56/35/02931e71eb23fd2b85591c7ec05b733ca7c8b328a2fd151f96 2024-06-26T07:13:03.2163242Z Successfully built torchvision 2024-06-26T07:13:04.4064745Z Installing collected packages: torchvision 2024-06-26T07:13:04.7904589Z Successfully installed torchvision-0.19.0a0+d23a6e1 2024-06-26T07:13:04.8990056Z + '[' -n '' ']' 2024-06-26T07:13:04.8990540Z + id=1 2024-06-26T07:13:04.8990969Z + test_dynamo_benchmark timm_models 1 2024-06-26T07:13:04.8991573Z ++ pwd 2024-06-26T07:13:04.8993476Z + TEST_REPORTS_DIR=/var/lib/jenkins/workspace/test/test-reports 2024-06-26T07:13:04.8995015Z + local suite=timm_models 2024-06-26T07:13:04.8995390Z + shift 2024-06-26T07:13:04.8995655Z + local shard_id=1 2024-06-26T07:13:04.8995961Z + shift 2024-06-26T07:13:04.8996300Z + [[ dynamic_aot_eager_timm == *perf_compare* ]] 2024-06-26T07:13:04.8996792Z + [[ dynamic_aot_eager_timm == *perf* ]] 2024-06-26T07:13:04.8997266Z + [[ dynamic_aot_eager_timm == *cpu_inductor* ]] 2024-06-26T07:13:04.8997757Z + [[ dynamic_aot_eager_timm == *aot_inductor* ]] 2024-06-26T07:13:04.8998833Z + test_single_dynamo_benchmark inference timm_models 1 --inference --bfloat16 2024-06-26T07:13:04.8999406Z ++ pwd 2024-06-26T07:13:04.9001113Z + TEST_REPORTS_DIR=/var/lib/jenkins/workspace/test/test-reports 2024-06-26T07:13:04.9001816Z + mkdir -p /var/lib/jenkins/workspace/test/test-reports 2024-06-26T07:13:04.9010519Z + local name=inference 2024-06-26T07:13:04.9010929Z + shift 2024-06-26T07:13:04.9011340Z + local suite=timm_models 2024-06-26T07:13:04.9011759Z + shift 2024-06-26T07:13:04.9012054Z + local shard_id=1 2024-06-26T07:13:04.9012371Z + shift 2024-06-26T07:13:04.9012636Z + partition_flags=() 2024-06-26T07:13:04.9012974Z + local partition_flags 2024-06-26T07:13:04.9013615Z + [[ -n 2 ]] 2024-06-26T07:13:04.9013924Z + [[ -n 1 ]] 2024-06-26T07:13:04.9014502Z + partition_flags=(--total-partitions "$NUM_TEST_SHARDS" --partition-id "$shard_id") 2024-06-26T07:13:04.9015185Z + [[ dynamic_aot_eager_timm == *perf_compare* ]] 2024-06-26T07:13:04.9015687Z + [[ dynamic_aot_eager_timm == *perf* ]] 2024-06-26T07:13:04.9016374Z + [[ dynamic_aot_eager_timm == *aot_inductor* ]] 2024-06-26T07:13:04.9018506Z + python benchmarks/dynamo/timm_models.py --ci --accuracy --timing --explain --backend aot_eager --dynamic-shapes --dynamic-batch-only --device cuda --inference --bfloat16 --total-partitions 2 --partition-id 1 --output /var/lib/jenkins/workspace/test/test-reports/inference_timm_models.csv 2024-06-26T07:13:10.7470080Z 2024-06-26T07:13:10.8981029Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:13:10.8981385Z 2024-06-26T07:13:10.9772363Z model.safetensors: 0% 0.00/29.6M [00:00 will be ignored 2024-06-26T07:24:10.4692664Z pass 2024-06-26T07:24:10.4741073Z TIMING: entire_frame_compile:36.43699 backend_compile:22.12635 2024-06-26T07:24:10.4742407Z STATS: call_* op count: 797 | FakeTensor.__torch_dispatch__:3595 | FakeTensorMode.__torch_dispatch__:52349 | attempt fast:1254 | fast is_contiguous:1254 | ProxyTorchDispatchMode.__torch_dispatch__:12852 2024-06-26T07:24:10.4743722Z Dynamo produced 4 graphs covering 797 ops with 7 graph breaks (5 unique) 2024-06-26T07:24:15.1895757Z 2024-06-26T07:24:15.8701379Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:24:15.8701992Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:24:15.8702473Z cuda train mobilenetv2_100 2024-06-26T07:24:39.9890381Z W0626 07:24:39.988000 140163022017152 torch/_logging/_internal.py:1040] [6/0] Profiler function will be ignored 2024-06-26T07:24:57.8213885Z pass 2024-06-26T07:24:57.8290878Z TIMING: entire_frame_compile:40.88264 backend_compile:24.95928 2024-06-26T07:24:57.8292223Z STATS: call_* op count: 796 | FakeTensor.__torch_dispatch__:3688 | FakeTensorMode.__torch_dispatch__:56272 | attempt fast:1254 | fast is_contiguous:1254 | ProxyTorchDispatchMode.__torch_dispatch__:12588 2024-06-26T07:24:57.8293680Z Dynamo produced 3 graphs covering 796 ops with 7 graph breaks (5 unique) 2024-06-26T07:25:02.7549634Z 2024-06-26T07:25:03.4969501Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:25:03.4970049Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:25:03.4970494Z cuda train mobilenetv3_large_100 2024-06-26T07:25:28.9763276Z W0626 07:25:28.975000 140142791709312 torch/_logging/_internal.py:1040] [6/0] Profiler function will be ignored 2024-06-26T07:25:49.2698855Z pass 2024-06-26T07:25:49.2760302Z TIMING: entire_frame_compile:44.68058 backend_compile:26.66641 2024-06-26T07:25:49.2762971Z STATS: call_* op count: 855 | FakeTensor.__torch_dispatch__:4200 | FakeTensorMode.__torch_dispatch__:60271 | attempt fast:1559 | fast is_contiguous:1559 | ProxyTorchDispatchMode.__torch_dispatch__:14152 2024-06-26T07:25:49.2764311Z Dynamo produced 3 graphs covering 855 ops with 7 graph breaks (5 unique) 2024-06-26T07:25:54.4161036Z 2024-06-26T07:25:55.1540292Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:25:55.1540780Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:25:55.1541354Z cuda train mobilevit_s 2024-06-26T07:26:31.5871125Z pass 2024-06-26T07:26:31.6114266Z TIMING: entire_frame_compile:34.75778 backend_compile:23.1598 2024-06-26T07:26:31.6118538Z STATS: call_* op count: 542 | FakeTensor.__torch_dispatch__:1215 | FakeTensorMode.__torch_dispatch__:47820 | attempt fast:2058 | fast is_contiguous:2052 | ProxyTorchDispatchMode.__torch_dispatch__:10817 | slow no contiguity match:6 2024-06-26T07:26:31.6120062Z Dynamo produced 3 graphs covering 542 ops with 6 graph breaks (5 unique) 2024-06-26T07:26:37.2681651Z 2024-06-26T07:26:38.3416749Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:26:38.3417205Z loading model: 0it [00:01, ?it/s] 2024-06-26T07:26:38.3417623Z cuda train nfnet_l0 2024-06-26T07:27:09.6825706Z W0626 07:27:09.681000 140119083840128 torch/_logging/_internal.py:1040] [6/0] Profiler function will be ignored 2024-06-26T07:27:39.0035692Z pass 2024-06-26T07:27:39.0368109Z TIMING: entire_frame_compile:58.17726 backend_compile:35.54445 2024-06-26T07:27:39.0370389Z STATS: call_* op count: 1232 | FakeTensorMode.__torch_dispatch__:73178 | attempt fast:784 | fast is_contiguous:784 | FakeTensor.__torch_dispatch__:4808 | ProxyTorchDispatchMode.__torch_dispatch__:21252 2024-06-26T07:27:39.0372086Z Dynamo produced 3 graphs covering 1232 ops with 7 graph breaks (5 unique) 2024-06-26T07:27:44.5091094Z 2024-06-26T07:27:45.4291614Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:27:45.4292093Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:27:45.4292535Z cuda train pit_b_224 2024-06-26T07:28:12.5409456Z pass 2024-06-26T07:28:12.5916666Z TIMING: entire_frame_compile:23.36441 backend_compile:16.4749 2024-06-26T07:28:12.5918767Z STATS: call_* op count: 438 | FakeTensor.__torch_dispatch__:1224 | FakeTensorMode.__torch_dispatch__:35313 | attempt fast:1734 | fast is_contiguous:1734 | ProxyTorchDispatchMode.__torch_dispatch__:8724 2024-06-26T07:28:12.5920089Z Dynamo produced 2 graphs covering 438 ops with 6 graph breaks (5 unique) 2024-06-26T07:28:17.2337404Z 2024-06-26T07:28:18.7605771Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:28:18.7606450Z loading model: 0it [00:01, ?it/s] 2024-06-26T07:28:18.7607107Z cuda train pnasnet5large 2024-06-26T07:29:49.5292590Z pass 2024-06-26T07:29:49.6407891Z TIMING: entire_frame_compile:81.09011 backend_compile:56.52181 2024-06-26T07:29:49.6410665Z STATS: call_* op count: 963 | FakeTensor.__torch_dispatch__:4577 | FakeTensorMode.__torch_dispatch__:147296 | attempt fast:5041 | fast is_contiguous:5017 | ProxyTorchDispatchMode.__torch_dispatch__:30261 | slow no contiguity match:24 2024-06-26T07:29:49.6412256Z Dynamo produced 2 graphs covering 963 ops with 5 graph breaks (4 unique) 2024-06-26T07:29:57.4879354Z 2024-06-26T07:29:58.7430065Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:29:58.7430537Z loading model: 0it [00:01, ?it/s] 2024-06-26T07:29:58.7433670Z cuda train poolformer_m36 2024-06-26T07:30:49.9912035Z pass 2024-06-26T07:30:50.0521955Z TIMING: entire_frame_compile:47.40386 backend_compile:32.51402 2024-06-26T07:30:50.0525440Z STATS: call_* op count: 741 | FakeTensor.__torch_dispatch__:965 | FakeTensorMode.__torch_dispatch__:62204 | attempt fast:4863 | fast is_contiguous:4791 | ProxyTorchDispatchMode.__torch_dispatch__:13481 | slow both tensors nontrivially broadcast:72 2024-06-26T07:30:50.0526990Z Dynamo produced 2 graphs covering 741 ops with 6 graph breaks (5 unique) 2024-06-26T07:30:55.7727274Z 2024-06-26T07:30:56.4615185Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:30:56.4615665Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:30:56.4619293Z cuda train regnety_002 2024-06-26T07:31:20.7738622Z pass 2024-06-26T07:31:20.7772640Z TIMING: entire_frame_compile:23.43315 backend_compile:15.57392 2024-06-26T07:31:20.7775455Z STATS: call_* op count: 369 | FakeTensor.__torch_dispatch__:657 | FakeTensorMode.__torch_dispatch__:34143 | attempt fast:1215 | fast is_contiguous:1215 | ProxyTorchDispatchMode.__torch_dispatch__:7367 2024-06-26T07:31:20.7776836Z Dynamo produced 2 graphs covering 369 ops with 6 graph breaks (5 unique) 2024-06-26T07:31:25.4739281Z 2024-06-26T07:31:26.4182762Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:31:26.4183245Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:31:26.4183677Z cuda train repvgg_a2 2024-06-26T07:31:48.1682546Z W0626 07:31:48.167000 140294062903936 torch/_logging/_internal.py:1040] [6/0] Profiler function will be ignored 2024-06-26T07:32:06.2872039Z pass 2024-06-26T07:32:06.3135410Z TIMING: entire_frame_compile:37.39492 backend_compile:22.21032 2024-06-26T07:32:06.3138337Z STATS: call_* op count: 920 | FakeTensor.__torch_dispatch__:3603 | FakeTensorMode.__torch_dispatch__:55862 | attempt fast:1571 | fast is_contiguous:1571 | ProxyTorchDispatchMode.__torch_dispatch__:13620 2024-06-26T07:32:06.3139721Z Dynamo produced 3 graphs covering 920 ops with 7 graph breaks (5 unique) 2024-06-26T07:32:11.0778578Z 2024-06-26T07:32:12.4118134Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:32:12.4118608Z loading model: 0it [00:01, ?it/s] 2024-06-26T07:32:12.4123317Z cuda train res2net101_26w_4s 2024-06-26T07:33:20.6620418Z pass 2024-06-26T07:33:20.6999437Z TIMING: entire_frame_compile:63.89179 backend_compile:50.20594 2024-06-26T07:33:20.7000856Z STATS: call_* op count: 807 | FakeTensor.__torch_dispatch__:3151 | FakeTensorMode.__torch_dispatch__:115146 | attempt fast:4307 | fast is_contiguous:4017 | slow no contiguity match:290 | ProxyTorchDispatchMode.__torch_dispatch__:21353 2024-06-26T07:33:20.7002317Z Dynamo produced 2 graphs covering 807 ops with 6 graph breaks (5 unique) 2024-06-26T07:33:27.7776922Z 2024-06-26T07:33:28.8406725Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:33:28.8407501Z loading model: 0it [00:01, ?it/s] 2024-06-26T07:33:28.8408163Z cuda train res2net50_14w_8s 2024-06-26T07:34:30.7066968Z pass 2024-06-26T07:34:30.7278946Z TIMING: entire_frame_compile:58.90609 backend_compile:46.59391 2024-06-26T07:34:30.7281668Z STATS: call_* op count: 703 | FakeTensor.__torch_dispatch__:2776 | FakeTensorMode.__torch_dispatch__:106887 | attempt fast:3843 | fast is_contiguous:3483 | slow no contiguity match:360 | ProxyTorchDispatchMode.__torch_dispatch__:18803 2024-06-26T07:34:30.7283284Z Dynamo produced 2 graphs covering 703 ops with 6 graph breaks (5 unique) 2024-06-26T07:34:37.3038344Z 2024-06-26T07:34:38.2429053Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:34:38.2429577Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:34:38.2432083Z cuda train res2next50 2024-06-26T07:35:12.3604020Z pass 2024-06-26T07:35:12.3837649Z TIMING: entire_frame_compile:31.82375 backend_compile:24.78695 2024-06-26T07:35:12.3840086Z STATS: call_* op count: 399 | FakeTensor.__torch_dispatch__:1606 | FakeTensorMode.__torch_dispatch__:57126 | attempt fast:2131 | fast is_contiguous:2011 | slow no contiguity match:120 | ProxyTorchDispatchMode.__torch_dispatch__:10643 2024-06-26T07:35:12.3841717Z Dynamo produced 2 graphs covering 399 ops with 6 graph breaks (5 unique) 2024-06-26T07:35:17.6219308Z 2024-06-26T07:35:18.2225107Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:35:18.2225875Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:35:18.2226567Z cuda train resmlp_12_224 2024-06-26T07:35:34.2287322Z pass 2024-06-26T07:35:34.2414630Z TIMING: entire_frame_compile:14.7536 backend_compile:9.9021 2024-06-26T07:35:34.2416718Z STATS: call_* op count: 216 | FakeTensor.__torch_dispatch__:486 | FakeTensorMode.__torch_dispatch__:22213 | attempt fast:1062 | slow no contiguity match:405 | fast is_contiguous:657 | ProxyTorchDispatchMode.__torch_dispatch__:6468 2024-06-26T07:35:34.2419443Z Dynamo produced 2 graphs covering 216 ops with 6 graph breaks (5 unique) 2024-06-26T07:35:38.5481856Z 2024-06-26T07:35:39.9986472Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:35:39.9987040Z loading model: 0it [00:01, ?it/s] 2024-06-26T07:35:39.9987481Z cuda train resnest101e 2024-06-26T07:36:52.6865698Z pass 2024-06-26T07:36:52.7420022Z TIMING: entire_frame_compile:66.83189 backend_compile:51.15112 2024-06-26T07:36:52.7422362Z STATS: call_* op count: 1121 | FakeTensor.__torch_dispatch__:3179 | FakeTensorMode.__torch_dispatch__:109817 | attempt fast:3898 | fast is_contiguous:3832 | ProxyTorchDispatchMode.__torch_dispatch__:23525 | slow no contiguity match:66 2024-06-26T07:36:52.7424024Z Dynamo produced 2 graphs covering 1121 ops with 6 graph breaks (5 unique) 2024-06-26T07:36:59.9964225Z 2024-06-26T07:37:00.9043404Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:37:00.9043872Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:37:00.9044295Z cuda train rexnet_100 2024-06-26T07:37:36.1862458Z W0626 07:37:36.185000 139653573767808 torch/_logging/_internal.py:1040] [6/0] Profiler function will be ignored 2024-06-26T07:38:01.6465174Z pass 2024-06-26T07:38:01.6628771Z TIMING: entire_frame_compile:59.2685 backend_compile:36.28141 2024-06-26T07:38:01.6630357Z STATS: call_* op count: 1104 | FakeTensor.__torch_dispatch__:5771 | FakeTensorMode.__torch_dispatch__:80676 | attempt fast:1766 | fast is_contiguous:1711 | slow no contiguity match:55 | ProxyTorchDispatchMode.__torch_dispatch__:19554 2024-06-26T07:38:01.6632164Z Dynamo produced 3 graphs covering 1104 ops with 7 graph breaks (5 unique) 2024-06-26T07:38:07.5007433Z 2024-06-26T07:38:08.3945001Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:38:08.3945538Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:38:08.3947160Z cuda train sebotnet33ts_256 2024-06-26T07:38:41.8170592Z pass 2024-06-26T07:38:41.8361378Z TIMING: entire_frame_compile:31.5104 backend_compile:21.02085 2024-06-26T07:38:41.8363939Z STATS: call_* op count: 510 | FakeTensor.__torch_dispatch__:603 | FakeTensorMode.__torch_dispatch__:39402 | attempt fast:1368 | fast is_contiguous:1348 | slow no contiguity match:20 | ProxyTorchDispatchMode.__torch_dispatch__:8767 2024-06-26T07:38:41.8365578Z Dynamo produced 3 graphs covering 510 ops with 6 graph breaks (5 unique) 2024-06-26T07:38:47.2446191Z 2024-06-26T07:38:48.2304922Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:38:48.2305429Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:38:48.2305875Z cuda train selecsls42b 2024-06-26T07:39:03.9207658Z pass 2024-06-26T07:39:03.9475060Z TIMING: entire_frame_compile:14.21669 backend_compile:10.78539 2024-06-26T07:39:03.9478288Z STATS: call_* op count: 137 | FakeTensor.__torch_dispatch__:837 | FakeTensorMode.__torch_dispatch__:25014 | attempt fast:966 | fast is_contiguous:951 | ProxyTorchDispatchMode.__torch_dispatch__:4891 | slow no contiguity match:15 2024-06-26T07:39:03.9480264Z Dynamo produced 2 graphs covering 137 ops with 6 graph breaks (5 unique) 2024-06-26T07:39:08.2042838Z 2024-06-26T07:39:08.8944619Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:39:08.8945094Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:39:08.8945530Z cuda train spnasnet_100 2024-06-26T07:39:32.4253029Z W0626 07:39:32.424000 140184979473024 torch/_logging/_internal.py:1040] [6/0] Profiler function will be ignored 2024-06-26T07:39:54.4232590Z pass 2024-06-26T07:39:54.4288152Z TIMING: entire_frame_compile:44.27327 backend_compile:27.01522 2024-06-26T07:39:54.4291730Z STATS: call_* op count: 976 | FakeTensor.__torch_dispatch__:4364 | FakeTensorMode.__torch_dispatch__:64144 | attempt fast:1550 | fast is_contiguous:1550 | ProxyTorchDispatchMode.__torch_dispatch__:15761 2024-06-26T07:39:54.4293224Z Dynamo produced 3 graphs covering 976 ops with 7 graph breaks (5 unique) 2024-06-26T07:39:59.4963191Z 2024-06-26T07:40:01.1995552Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:40:01.1996081Z loading model: 0it [00:01, ?it/s] 2024-06-26T07:40:01.1996533Z cuda train swin_base_patch4_window7_224 2024-06-26T07:41:27.1010321Z W0626 07:41:27.100000 139983493026432 torch/_logging/_internal.py:1040] [6/0] Profiler function will be ignored 2024-06-26T07:42:00.0864015Z pass 2024-06-26T07:42:00.1657043Z TIMING: entire_frame_compile:113.08587 backend_compile:77.41766 2024-06-26T07:42:00.1659262Z STATS: call_* op count: 2715 | FakeTensor.__torch_dispatch__:8280 | FakeTensorMode.__torch_dispatch__:148102 | attempt fast:4105 | fast is_contiguous:4009 | slow no contiguity match:96 | ProxyTorchDispatchMode.__torch_dispatch__:39913 2024-06-26T07:42:00.1660757Z Dynamo produced 3 graphs covering 2715 ops with 7 graph breaks (5 unique) 2024-06-26T07:42:09.1335437Z 2024-06-26T07:42:11.9894921Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:42:11.9895389Z loading model: 0it [00:02, ?it/s] 2024-06-26T07:42:11.9895838Z cuda train swsl_resnext101_32x16d 2024-06-26T07:42:55.9891022Z pass 2024-06-26T07:42:56.1424359Z TIMING: entire_frame_compile:33.03181 backend_compile:25.56838 2024-06-26T07:42:56.1425635Z STATS: call_* op count: 415 | FakeTensor.__torch_dispatch__:1945 | FakeTensorMode.__torch_dispatch__:60993 | attempt fast:2499 | fast is_contiguous:2499 | ProxyTorchDispatchMode.__torch_dispatch__:11922 2024-06-26T07:42:56.1426945Z Dynamo produced 2 graphs covering 415 ops with 6 graph breaks (5 unique) 2024-06-26T07:43:01.3813906Z 2024-06-26T07:43:02.1316536Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:43:02.1317206Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:43:02.1317962Z cuda train tf_efficientnet_b0 2024-06-26T07:43:34.3535115Z pass 2024-06-26T07:43:34.3650211Z TIMING: entire_frame_compile:31.13597 backend_compile:20.68574 2024-06-26T07:43:34.3653897Z STATS: call_* op count: 371 | FakeTensorMode.__torch_dispatch__:42685 | attempt fast:1732 | fast is_contiguous:1732 | FakeTensor.__torch_dispatch__:966 | ProxyTorchDispatchMode.__torch_dispatch__:9286 2024-06-26T07:43:34.3655242Z Dynamo produced 2 graphs covering 371 ops with 6 graph breaks (5 unique) 2024-06-26T07:43:39.7113306Z 2024-06-26T07:43:40.6088806Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:43:40.6089578Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:43:40.6090210Z cuda train tf_mixnet_l 2024-06-26T07:44:26.0968511Z pass 2024-06-26T07:44:26.1135328Z TIMING: entire_frame_compile:43.94415 backend_compile:29.80775 2024-06-26T07:44:26.1139228Z STATS: call_* op count: 692 | FakeTensorMode.__torch_dispatch__:61635 | attempt fast:1956 | fast is_contiguous:1956 | FakeTensor.__torch_dispatch__:1358 | ProxyTorchDispatchMode.__torch_dispatch__:13503 2024-06-26T07:44:26.1140586Z Dynamo produced 2 graphs covering 692 ops with 6 graph breaks (5 unique) 2024-06-26T07:44:32.1973366Z 2024-06-26T07:44:33.0078986Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:44:33.0079552Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:44:33.0080051Z cuda train tinynet_a 2024-06-26T07:45:10.5241378Z E0626 07:45:10.523000 140696198193792 torch/_dynamo/utils.py:1470] RMSE (res-fp64): 0.00408, (ref-fp64): 0.00019 and shape=torch.Size([32]). res.dtype: torch.float32, multiplier: 3.000000, tol: 0.010000 2024-06-26T07:45:10.5243068Z E0626 07:45:10.523000 140696198193792 torch/_dynamo/utils.py:1384] Accuracy failed for key name bn1.weight.grad 2024-06-26T07:45:10.5270816Z fail_accuracy 2024-06-26T07:45:10.5371357Z TIMING: entire_frame_compile:36.4367 backend_compile:24.6687 2024-06-26T07:45:10.5372620Z STATS: call_* op count: 435 | FakeTensor.__torch_dispatch__:1162 | FakeTensorMode.__torch_dispatch__:50056 | attempt fast:2056 | fast is_contiguous:2056 | ProxyTorchDispatchMode.__torch_dispatch__:10942 2024-06-26T07:45:10.5374148Z Dynamo produced 2 graphs covering 435 ops with 6 graph breaks (5 unique) 2024-06-26T07:45:16.1499800Z 2024-06-26T07:45:17.0050145Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:45:17.0050615Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:45:17.0054327Z cuda train tnt_s_patch16_224 2024-06-26T07:46:29.5986618Z W0626 07:46:29.597000 139791660626560 torch/_logging/_internal.py:1040] [6/0] Profiler function will be ignored 2024-06-26T07:47:04.2556556Z pass 2024-06-26T07:47:04.2824956Z TIMING: entire_frame_compile:103.67127 backend_compile:68.5326 2024-06-26T07:47:04.2826752Z STATS: call_* op count: 2000 | FakeTensor.__torch_dispatch__:8867 | FakeTensorMode.__torch_dispatch__:139978 | attempt fast:3969 | fast is_contiguous:3825 | slow no contiguity match:144 | ProxyTorchDispatchMode.__torch_dispatch__:38370 2024-06-26T07:47:04.2828236Z Dynamo produced 3 graphs covering 2000 ops with 7 graph breaks (5 unique) 2024-06-26T07:47:12.6025879Z 2024-06-26T07:47:13.8413024Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:47:13.8414048Z loading model: 0it [00:01, ?it/s] 2024-06-26T07:47:13.8415071Z cuda train twins_pcpvt_base 2024-06-26T07:48:22.8504341Z W0626 07:48:22.849000 140596028760704 torch/_logging/_internal.py:1040] [6/0] Profiler function will be ignored 2024-06-26T07:49:15.4141143Z pass 2024-06-26T07:49:15.4539316Z TIMING: entire_frame_compile:116.96527 backend_compile:78.79594 2024-06-26T07:49:15.4541255Z STATS: call_* op count: 2583 | FakeTensor.__torch_dispatch__:13549 | FakeTensorMode.__torch_dispatch__:177398 | attempt fast:4814 | fast is_contiguous:4752 | slow no contiguity match:61 | ProxyTorchDispatchMode.__torch_dispatch__:48600 | fast channels_last:1 2024-06-26T07:49:15.4543108Z Dynamo produced 3 graphs covering 2583 ops with 7 graph breaks (5 unique) 2024-06-26T07:49:23.5688707Z 2024-06-26T07:49:24.6294922Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:49:24.6295400Z loading model: 0it [00:01, ?it/s] 2024-06-26T07:49:24.6295840Z cuda train visformer_small 2024-06-26T07:49:46.1993375Z W0626 07:49:46.198000 140427548349056 torch/_logging/_internal.py:1040] [6/0] Profiler function will be ignored 2024-06-26T07:50:01.2242705Z pass 2024-06-26T07:50:01.2573830Z TIMING: entire_frame_compile:34.22673 backend_compile:21.72258 2024-06-26T07:50:01.2575155Z STATS: call_* op count: 715 | FakeTensor.__torch_dispatch__:3149 | FakeTensorMode.__torch_dispatch__:47838 | attempt fast:1457 | fast is_contiguous:1457 | ProxyTorchDispatchMode.__torch_dispatch__:12063 2024-06-26T07:50:01.2576476Z Dynamo produced 3 graphs covering 715 ops with 7 graph breaks (5 unique) 2024-06-26T07:50:06.0135171Z 2024-06-26T07:50:07.4073178Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:50:07.4073643Z loading model: 0it [00:01, ?it/s] 2024-06-26T07:50:07.4074760Z cuda train vit_base_patch16_224 2024-06-26T07:50:31.5352700Z W0626 07:50:31.534000 139903327646336 torch/_logging/_internal.py:1040] [6/0] Profiler function will be ignored 2024-06-26T07:50:46.8285025Z pass 2024-06-26T07:50:46.9178373Z TIMING: entire_frame_compile:34.52051 backend_compile:22.5619 2024-06-26T07:50:46.9179871Z STATS: call_* op count: 855 | FakeTensor.__torch_dispatch__:4013 | FakeTensorMode.__torch_dispatch__:53053 | attempt fast:1591 | fast is_contiguous:1591 | ProxyTorchDispatchMode.__torch_dispatch__:14361 2024-06-26T07:50:46.9181184Z Dynamo produced 3 graphs covering 855 ops with 7 graph breaks (5 unique) 2024-06-26T07:50:51.7144576Z 2024-06-26T07:50:52.6867894Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:50:52.6868584Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:50:52.6869115Z cuda train volo_d1_224 2024-06-26T07:51:45.2115050Z W0626 07:51:45.210000 140292635624064 torch/_logging/_internal.py:1040] [6/0] Profiler function will be ignored 2024-06-26T07:52:10.6626674Z pass 2024-06-26T07:52:10.6857174Z TIMING: entire_frame_compile:74.59752 backend_compile:51.38405 2024-06-26T07:52:10.6860012Z STATS: call_* op count: 1454 | FakeTensor.__torch_dispatch__:6396 | FakeTensorMode.__torch_dispatch__:106066 | attempt fast:2894 | fast is_contiguous:2711 | slow no contiguity match:183 | ProxyTorchDispatchMode.__torch_dispatch__:27449 2024-06-26T07:52:10.6862289Z Dynamo produced 3 graphs covering 1454 ops with 7 graph breaks (5 unique) 2024-06-26T07:52:17.3098387Z 2024-06-26T07:52:21.3291032Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:52:21.3292001Z loading model: 0it [00:04, ?it/s] 2024-06-26T07:52:21.3292926Z cuda train xcit_large_24_p8_224 2024-06-26T07:52:21.4195110Z WARNING:common:fp64 golden ref were not generated for xcit_large_24_p8_224. Setting accuracy check to cosine 2024-06-26T07:54:03.5627991Z W0626 07:54:03.561000 140050370986624 torch/_logging/_internal.py:1040] [6/0] Profiler function will be ignored 2024-06-26T07:55:10.7181986Z pass_due_to_skip 2024-06-26T07:55:10.9780117Z TIMING: entire_frame_compile:165.01117 backend_compile:110.48812 2024-06-26T07:55:10.9781704Z STATS: call_* op count: 3216 | FakeTensor.__torch_dispatch__:15231 | FakeTensorMode.__torch_dispatch__:234692 | attempt fast:7060 | fast is_contiguous:4957 | slow no contiguity match:1502 | fast channels_last:601 | ProxyTorchDispatchMode.__torch_dispatch__:63689 2024-06-26T07:55:10.9783292Z Dynamo produced 3 graphs covering 3216 ops with 7 graph breaks (5 unique) 2024-06-26T07:55:18.3410096Z accuracy pass_rate=93.55% 2024-06-26T07:55:18.3413380Z calls_captured gmean=759.70x mean=959.806x 2024-06-26T07:55:18.3417312Z unique_graphs gmean=2.49x mean=2.548x 2024-06-26T07:55:18.3420912Z graph_breaks gmean=6.39x mean=6.419x 2024-06-26T07:55:18.3425171Z unique_graph_breaks gmean=4.96x mean=4.968x 2024-06-26T07:55:18.3429126Z autograd_captures gmean=0.00x mean=0.000x 2024-06-26T07:55:18.3432475Z autograd_compiles gmean=0.00x mean=0.000x 2024-06-26T07:55:18.3436362Z cudagraph_skips gmean=0.00x mean=0.000x 2024-06-26T07:55:18.9281191Z + python benchmarks/dynamo/check_accuracy.py --actual /var/lib/jenkins/workspace/test/test-reports/training_timm_models.csv --expected benchmarks/dynamo/ci_expected_accuracy//dynamic_aot_eager_timm_training.csv 2024-06-26T07:55:19.1684134Z mixnet_l PASS 2024-06-26T07:55:19.1689591Z mnasnet_100 PASS 2024-06-26T07:55:19.1694449Z mobilenetv2_100 PASS 2024-06-26T07:55:19.1699539Z mobilenetv3_large_100 PASS 2024-06-26T07:55:19.1704325Z mobilevit_s PASS 2024-06-26T07:55:19.1709539Z nfnet_l0 PASS 2024-06-26T07:55:19.1714392Z pit_b_224 PASS 2024-06-26T07:55:19.1719487Z pnasnet5large PASS 2024-06-26T07:55:19.1724788Z poolformer_m36 PASS 2024-06-26T07:55:19.1729987Z regnety_002 PASS 2024-06-26T07:55:19.1734506Z repvgg_a2 PASS 2024-06-26T07:55:19.1739581Z res2net101_26w_4s PASS 2024-06-26T07:55:19.1744039Z res2net50_14w_8s PASS 2024-06-26T07:55:19.1748749Z res2next50 PASS 2024-06-26T07:55:19.1753466Z resmlp_12_224 PASS 2024-06-26T07:55:19.1758197Z resnest101e PASS 2024-06-26T07:55:19.1762949Z rexnet_100 PASS 2024-06-26T07:55:19.1767902Z sebotnet33ts_256 PASS 2024-06-26T07:55:19.1772609Z selecsls42b PASS 2024-06-26T07:55:19.1777472Z spnasnet_100 PASS 2024-06-26T07:55:19.1782066Z swin_base_patch4_window7_224 PASS 2024-06-26T07:55:19.1786783Z swsl_resnext101_32x16d PASS 2024-06-26T07:55:19.1791592Z tf_efficientnet_b0 PASS 2024-06-26T07:55:19.1796348Z tf_mixnet_l PASS 2024-06-26T07:55:19.1801092Z tinynet_a XFAIL 2024-06-26T07:55:19.1805847Z tnt_s_patch16_224 PASS 2024-06-26T07:55:19.1810929Z twins_pcpvt_base PASS 2024-06-26T07:55:19.1815769Z visformer_small PASS 2024-06-26T07:55:19.1820463Z vit_base_patch16_224 PASS 2024-06-26T07:55:19.1825310Z volo_d1_224 PASS 2024-06-26T07:55:19.1829672Z xcit_large_24_p8_224 XFAIL 2024-06-26T07:55:19.2205220Z + python benchmarks/dynamo/check_graph_breaks.py --actual /var/lib/jenkins/workspace/test/test-reports/training_timm_models.csv --expected benchmarks/dynamo/ci_expected_accuracy//dynamic_aot_eager_timm_training.csv 2024-06-26T07:55:19.4777772Z mixnet_l PASS 2024-06-26T07:55:19.4778668Z mnasnet_100 PASS 2024-06-26T07:55:19.4784623Z mobilenetv2_100 PASS 2024-06-26T07:55:19.4790137Z mobilenetv3_large_100 PASS 2024-06-26T07:55:19.4795229Z mobilevit_s PASS 2024-06-26T07:55:19.4799975Z nfnet_l0 PASS 2024-06-26T07:55:19.4805190Z pit_b_224 PASS 2024-06-26T07:55:19.4810197Z pnasnet5large PASS 2024-06-26T07:55:19.4815233Z poolformer_m36 PASS 2024-06-26T07:55:19.4819982Z regnety_002 PASS 2024-06-26T07:55:19.4824897Z repvgg_a2 PASS 2024-06-26T07:55:19.4829704Z res2net101_26w_4s PASS 2024-06-26T07:55:19.4834553Z res2net50_14w_8s PASS 2024-06-26T07:55:19.4839258Z res2next50 PASS 2024-06-26T07:55:19.4844016Z resmlp_12_224 PASS 2024-06-26T07:55:19.4849579Z resnest101e PASS 2024-06-26T07:55:19.4854612Z rexnet_100 PASS 2024-06-26T07:55:19.4859766Z sebotnet33ts_256 PASS 2024-06-26T07:55:19.4864486Z selecsls42b PASS 2024-06-26T07:55:19.4869271Z spnasnet_100 PASS 2024-06-26T07:55:19.4874197Z swin_base_patch4_window7_224 PASS 2024-06-26T07:55:19.4879469Z swsl_resnext101_32x16d PASS 2024-06-26T07:55:19.4884208Z tf_efficientnet_b0 PASS 2024-06-26T07:55:19.4889720Z tf_mixnet_l PASS 2024-06-26T07:55:19.4894604Z tinynet_a PASS 2024-06-26T07:55:19.4899471Z tnt_s_patch16_224 PASS 2024-06-26T07:55:19.4904291Z twins_pcpvt_base PASS 2024-06-26T07:55:19.4908955Z visformer_small PASS 2024-06-26T07:55:19.4913749Z vit_base_patch16_224 PASS 2024-06-26T07:55:19.4918513Z volo_d1_224 PASS 2024-06-26T07:55:19.4923320Z xcit_large_24_p8_224 PASS 2024-06-26T07:55:19.5302739Z + cleanup_workspace 2024-06-26T07:55:19.5303688Z + echo 'sudo may print the following warning message that can be ignored. The chown command will still run.' 2024-06-26T07:55:19.5304782Z sudo may print the following warning message that can be ignored. The chown command will still run. 2024-06-26T07:55:19.5305690Z + echo ' sudo: setrlimit(RLIMIT_STACK): Operation not permitted' 2024-06-26T07:55:19.5306381Z sudo: setrlimit(RLIMIT_STACK): Operation not permitted 2024-06-26T07:55:19.5307180Z + echo 'For more details refer to https://github.com/sudo-project/sudo/issues/42' 2024-06-26T07:55:19.5308059Z For more details refer to https://github.com/sudo-project/sudo/issues/42 2024-06-26T07:55:19.5308760Z + sudo chown -R 1000 /var/lib/jenkins/workspace 2024-06-26T07:55:19.9328054Z ##[group]Run cat test/**/*_toprint.log || true 2024-06-26T07:55:19.9328581Z cat test/**/*_toprint.log || true 2024-06-26T07:55:19.9336831Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:55:19.9337451Z env: 2024-06-26T07:55:19.9337738Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:55:19.9338186Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:55:19.9338922Z DOCKER_CONTAINER_ID: 2feb940639e95f98d292cc0177cf41c33c1dc1cf1a28c6851c24f2f2d2501d2a 2024-06-26T07:55:19.9339571Z ##[endgroup] 2024-06-26T07:55:19.9401566Z cat: test/**/*_toprint.log: No such file or directory 2024-06-26T07:55:19.9431056Z ##[group]Run kill "$MONITOR_SCRIPT_PID" 2024-06-26T07:55:19.9431590Z kill "$MONITOR_SCRIPT_PID" 2024-06-26T07:55:19.9439147Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:55:19.9439747Z env: 2024-06-26T07:55:19.9440029Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:55:19.9440522Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:55:19.9441269Z DOCKER_CONTAINER_ID: 2feb940639e95f98d292cc0177cf41c33c1dc1cf1a28c6851c24f2f2d2501d2a 2024-06-26T07:55:19.9441974Z MONITOR_SCRIPT_PID: 3947 2024-06-26T07:55:19.9442320Z ##[endgroup] 2024-06-26T07:55:19.9639545Z Prepare all required actions 2024-06-26T07:55:19.9639987Z Getting action download info 2024-06-26T07:55:20.1136192Z Download action repository 'actions/upload-artifact@v3' (SHA:a8a3f3ad30e3422c9c7b888a15615d19a852ae32) 2024-06-26T07:55:20.2768356Z ##[group]Run ./.github/actions/upload-test-artifacts 2024-06-26T07:55:20.2768822Z with: 2024-06-26T07:55:20.2769357Z file-suffix: test-dynamic_aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_26688917434 2024-06-26T07:55:20.2770024Z s3-bucket: gha-artifacts 2024-06-26T07:55:20.2770359Z env: 2024-06-26T07:55:20.2770631Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:55:20.2771079Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:55:20.2771813Z DOCKER_CONTAINER_ID: 2feb940639e95f98d292cc0177cf41c33c1dc1cf1a28c6851c24f2f2d2501d2a 2024-06-26T07:55:20.2772591Z ##[endgroup] 2024-06-26T07:55:20.2796968Z ##[group]Run # Remove any previous test jsons if they exist 2024-06-26T07:55:20.2797612Z # Remove any previous test jsons if they exist 2024-06-26T07:55:20.2798127Z rm -f test-jsons-*.zip 2024-06-26T07:55:20.2798645Z zip -r "test-jsons-${FILE_SUFFIX}.zip" test -i '*.json' 2024-06-26T07:55:20.2806595Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:55:20.2807103Z env: 2024-06-26T07:55:20.2807390Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:55:20.2807830Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:55:20.2808568Z DOCKER_CONTAINER_ID: 2feb940639e95f98d292cc0177cf41c33c1dc1cf1a28c6851c24f2f2d2501d2a 2024-06-26T07:55:20.2809461Z FILE_SUFFIX: test-dynamic_aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_26688917434 2024-06-26T07:55:20.2810113Z ##[endgroup] 2024-06-26T07:55:20.2982977Z adding: test/allowlist_for_publicAPI.json (deflated 79%) 2024-06-26T07:55:20.3013039Z adding: test/benchmark_utils/callgrind_artifacts.json (deflated 92%) 2024-06-26T07:55:20.3014792Z adding: test/minioptest_failures_dict.json (deflated 70%) 2024-06-26T07:55:20.3019199Z adding: test/profiler/profiler_utils_mock_events.json (deflated 87%) 2024-06-26T07:55:20.3044586Z ##[group]Run # Remove any previous test reports if they exist 2024-06-26T07:55:20.3045230Z # Remove any previous test reports if they exist 2024-06-26T07:55:20.3045864Z rm -f test-reports-*.zip 2024-06-26T07:55:20.3046458Z zip -r "test-reports-${FILE_SUFFIX}.zip" test -i '*.xml' -i '*.csv' 2024-06-26T07:55:20.3054397Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:55:20.3054887Z env: 2024-06-26T07:55:20.3055167Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:55:20.3055623Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:55:20.3056362Z DOCKER_CONTAINER_ID: 2feb940639e95f98d292cc0177cf41c33c1dc1cf1a28c6851c24f2f2d2501d2a 2024-06-26T07:55:20.3057327Z FILE_SUFFIX: test-dynamic_aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_26688917434 2024-06-26T07:55:20.3057981Z ##[endgroup] 2024-06-26T07:55:20.3215794Z adding: test/test-reports/inference_timm_models.csv (deflated 68%) 2024-06-26T07:55:20.3216751Z adding: test/test-reports/training_timm_models.csv (deflated 66%) 2024-06-26T07:55:20.3220711Z adding: test/test-reports/training_timm_model_graph_breaks.csv (deflated 97%) 2024-06-26T07:55:20.3221631Z adding: test/test-reports/training_timm_model_graph_break_deduped.csv (deflated 74%) 2024-06-26T07:55:20.3247563Z ##[group]Run # Remove any previous usage logs if they exist 2024-06-26T07:55:20.3248221Z # Remove any previous usage logs if they exist 2024-06-26T07:55:20.3248722Z rm -f logs-*.zip 2024-06-26T07:55:20.3249393Z # this workflow is also run in bazel build test, but we dont generate usage reports for it 2024-06-26T07:55:20.3250196Z # so check to see if the file exists first 2024-06-26T07:55:20.3250694Z if [ -f 'usage_log.txt' ]; then 2024-06-26T07:55:20.3251225Z  zip "logs-${FILE_SUFFIX}.zip" 'usage_log.txt' 2024-06-26T07:55:20.3251705Z fi 2024-06-26T07:55:20.3252183Z if ls test/**/*.log 1> /dev/null 2>&1; then 2024-06-26T07:55:20.3252761Z  zip -r "logs-${FILE_SUFFIX}.zip" test -i '*.log' 2024-06-26T07:55:20.3253463Z fi 2024-06-26T07:55:20.3260860Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:55:20.3261355Z env: 2024-06-26T07:55:20.3261636Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:55:20.3262086Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:55:20.3262816Z DOCKER_CONTAINER_ID: 2feb940639e95f98d292cc0177cf41c33c1dc1cf1a28c6851c24f2f2d2501d2a 2024-06-26T07:55:20.3263722Z FILE_SUFFIX: test-dynamic_aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_26688917434 2024-06-26T07:55:20.3264372Z ##[endgroup] 2024-06-26T07:55:20.3334966Z adding: usage_log.txt (deflated 92%) 2024-06-26T07:55:20.3402469Z ##[group]Run # Remove any previous debugging artifacts if they exist 2024-06-26T07:55:20.3403182Z # Remove any previous debugging artifacts if they exist 2024-06-26T07:55:20.3403755Z rm -f debug-*.zip 2024-06-26T07:55:20.3404144Z if [ -d 'test/debug' ]; then 2024-06-26T07:55:20.3404667Z  zip -r "debug-${FILE_SUFFIX}.zip" test/debug 2024-06-26T07:55:20.3405143Z fi 2024-06-26T07:55:20.3412295Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:55:20.3412799Z env: 2024-06-26T07:55:20.3413301Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:55:20.3413758Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:55:20.3414510Z DOCKER_CONTAINER_ID: 2feb940639e95f98d292cc0177cf41c33c1dc1cf1a28c6851c24f2f2d2501d2a 2024-06-26T07:55:20.3415399Z FILE_SUFFIX: test-dynamic_aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_26688917434 2024-06-26T07:55:20.3416063Z ##[endgroup] 2024-06-26T07:55:20.3489356Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-06-26T07:55:20.3489790Z with: 2024-06-26T07:55:20.3490074Z s3-bucket: gha-artifacts 2024-06-26T07:55:20.3490519Z s3-prefix: pytorch/pytorch/9673646806/1/artifact 2024-06-26T07:55:20.3490995Z retention-days: 14 2024-06-26T07:55:20.3491323Z if-no-files-found: warn 2024-06-26T07:55:20.3491681Z path: test-jsons-*.zip 2024-06-26T07:55:20.3492020Z name: artifact 2024-06-26T07:55:20.3492320Z region: us-east-1 2024-06-26T07:55:20.3492614Z env: 2024-06-26T07:55:20.3492889Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:55:20.3493621Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:55:20.3494348Z DOCKER_CONTAINER_ID: 2feb940639e95f98d292cc0177cf41c33c1dc1cf1a28c6851c24f2f2d2501d2a 2024-06-26T07:55:20.3494990Z ##[endgroup] 2024-06-26T07:55:20.6534583Z NOTE: s3-prefix specified, ignoring name parameter 2024-06-26T07:55:20.6535185Z With the provided path, there will be 1 file uploaded 2024-06-26T07:55:20.6535813Z Uploading to s3 prefix: pytorch/pytorch/9673646806/1/artifact 2024-06-26T07:55:20.6561152Z Starting upload of test-jsons-test-dynamic_aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_26688917434.zip 2024-06-26T07:55:20.8595413Z Finished upload of test-jsons-test-dynamic_aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_26688917434.zip 2024-06-26T07:55:20.8722057Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-06-26T07:55:20.8722490Z with: 2024-06-26T07:55:20.8722772Z s3-bucket: gha-artifacts 2024-06-26T07:55:20.8723194Z s3-prefix: pytorch/pytorch/9673646806/1/artifact 2024-06-26T07:55:20.8723655Z retention-days: 14 2024-06-26T07:55:20.8723981Z if-no-files-found: error 2024-06-26T07:55:20.8724343Z path: test-reports-*.zip 2024-06-26T07:55:20.8724690Z name: artifact 2024-06-26T07:55:20.8724984Z region: us-east-1 2024-06-26T07:55:20.8725284Z env: 2024-06-26T07:55:20.8725641Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:55:20.8726085Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:55:20.8726826Z DOCKER_CONTAINER_ID: 2feb940639e95f98d292cc0177cf41c33c1dc1cf1a28c6851c24f2f2d2501d2a 2024-06-26T07:55:20.8727517Z ##[endgroup] 2024-06-26T07:55:21.1859099Z NOTE: s3-prefix specified, ignoring name parameter 2024-06-26T07:55:21.1859993Z With the provided path, there will be 1 file uploaded 2024-06-26T07:55:21.1860611Z Uploading to s3 prefix: pytorch/pytorch/9673646806/1/artifact 2024-06-26T07:55:21.1885987Z Starting upload of test-reports-test-dynamic_aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_26688917434.zip 2024-06-26T07:55:21.3032994Z Finished upload of test-reports-test-dynamic_aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_26688917434.zip 2024-06-26T07:55:21.3160147Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-06-26T07:55:21.3160589Z with: 2024-06-26T07:55:21.3160873Z s3-bucket: gha-artifacts 2024-06-26T07:55:21.3161296Z s3-prefix: pytorch/pytorch/9673646806/1/artifact 2024-06-26T07:55:21.3161766Z retention-days: 14 2024-06-26T07:55:21.3162218Z if-no-files-found: ignore 2024-06-26T07:55:21.3162573Z path: logs-*.zip 2024-06-26T07:55:21.3162884Z name: artifact 2024-06-26T07:55:21.3163178Z region: us-east-1 2024-06-26T07:55:21.3163480Z env: 2024-06-26T07:55:21.3163771Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:55:21.3164223Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:55:21.3164949Z DOCKER_CONTAINER_ID: 2feb940639e95f98d292cc0177cf41c33c1dc1cf1a28c6851c24f2f2d2501d2a 2024-06-26T07:55:21.3165682Z ##[endgroup] 2024-06-26T07:55:21.6224614Z NOTE: s3-prefix specified, ignoring name parameter 2024-06-26T07:55:21.6225213Z With the provided path, there will be 1 file uploaded 2024-06-26T07:55:21.6225821Z Uploading to s3 prefix: pytorch/pytorch/9673646806/1/artifact 2024-06-26T07:55:21.6254047Z Starting upload of logs-test-dynamic_aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_26688917434.zip 2024-06-26T07:55:21.7517363Z Finished upload of logs-test-dynamic_aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_26688917434.zip 2024-06-26T07:55:21.7669909Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-06-26T07:55:21.7670340Z with: 2024-06-26T07:55:21.7670620Z s3-bucket: gha-artifacts 2024-06-26T07:55:21.7671041Z s3-prefix: pytorch/pytorch/9673646806/1/artifact 2024-06-26T07:55:21.7671527Z retention-days: 14 2024-06-26T07:55:21.7671858Z if-no-files-found: ignore 2024-06-26T07:55:21.7672209Z path: debug-*.zip 2024-06-26T07:55:21.7672519Z name: artifact 2024-06-26T07:55:21.7672814Z region: us-east-1 2024-06-26T07:55:21.7673108Z env: 2024-06-26T07:55:21.7673382Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:55:21.7673827Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:55:21.7674545Z DOCKER_CONTAINER_ID: 2feb940639e95f98d292cc0177cf41c33c1dc1cf1a28c6851c24f2f2d2501d2a 2024-06-26T07:55:21.7675175Z ##[endgroup] 2024-06-26T07:55:22.0661775Z No files were found with the provided path: debug-*.zip. No artifacts will be uploaded. 2024-06-26T07:55:22.0789577Z ##[group]Run # shellcheck disable=SC2156 2024-06-26T07:55:22.0790079Z # shellcheck disable=SC2156 2024-06-26T07:55:22.0790883Z find . -iname "core.[1-9]*" -exec docker exec "${DOCKER_CONTAINER_ID}" sh -c "gdb python {} -ex 'bt' -ex 'q'" \; 2024-06-26T07:55:22.0799230Z shell: /usr/bin/bash -e {0} 2024-06-26T07:55:22.0799573Z env: 2024-06-26T07:55:22.0799843Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:55:22.0800287Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:55:22.0801016Z DOCKER_CONTAINER_ID: 2feb940639e95f98d292cc0177cf41c33c1dc1cf1a28c6851c24f2f2d2501d2a 2024-06-26T07:55:22.0801655Z ##[endgroup] 2024-06-26T07:55:22.2433470Z ##[group]Run pytorch/test-infra/.github/actions/teardown-linux@main 2024-06-26T07:55:22.2434031Z with: 2024-06-26T07:55:22.2434291Z env: 2024-06-26T07:55:22.2434561Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:55:22.2435005Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:55:22.2435747Z DOCKER_CONTAINER_ID: 2feb940639e95f98d292cc0177cf41c33c1dc1cf1a28c6851c24f2f2d2501d2a 2024-06-26T07:55:22.2436398Z ##[endgroup] 2024-06-26T07:55:22.2466702Z ##[group]Run set -eou pipefail 2024-06-26T07:55:22.2467115Z set -eou pipefail 2024-06-26T07:55:22.2467465Z  2024-06-26T07:55:22.2467970Z echo "Holding runner for 2 hours until all ssh sessions have logged out" 2024-06-26T07:55:22.2468609Z for _ in $(seq 1440); do 2024-06-26T07:55:22.2469082Z  # Break if no ssh session exists anymore 2024-06-26T07:55:22.2469576Z  if [ "$(who)" = "" ]; then 2024-06-26T07:55:22.2469975Z  break 2024-06-26T07:55:22.2470325Z  fi 2024-06-26T07:55:22.2470617Z  echo "." 2024-06-26T07:55:22.2470942Z  sleep 5 2024-06-26T07:55:22.2471252Z done 2024-06-26T07:55:22.2478636Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:55:22.2479125Z env: 2024-06-26T07:55:22.2479396Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:55:22.2479839Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:55:22.2480684Z DOCKER_CONTAINER_ID: 2feb940639e95f98d292cc0177cf41c33c1dc1cf1a28c6851c24f2f2d2501d2a 2024-06-26T07:55:22.2481317Z ##[endgroup] 2024-06-26T07:55:22.2501043Z Holding runner for 2 hours until all ssh sessions have logged out 2024-06-26T07:55:22.2537535Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2024-06-26T07:55:22.2538495Z # ignore expansion of "docker ps -q" since it could be empty 2024-06-26T07:55:22.2539092Z # shellcheck disable=SC2046 2024-06-26T07:55:22.2539562Z docker stop $(docker ps -q) || true 2024-06-26T07:55:22.2540045Z # Prune all of the docker images 2024-06-26T07:55:22.2540480Z docker system prune -af 2024-06-26T07:55:22.2547363Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:55:22.2547865Z env: 2024-06-26T07:55:22.2548143Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:55:22.2548585Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:55:22.2549332Z DOCKER_CONTAINER_ID: 2feb940639e95f98d292cc0177cf41c33c1dc1cf1a28c6851c24f2f2d2501d2a 2024-06-26T07:55:22.2549973Z ##[endgroup] 2024-06-26T07:55:22.5744216Z 2feb940639e9 2024-06-26T07:55:23.3146753Z Deleted Containers: 2024-06-26T07:55:23.3147512Z 2feb940639e95f98d292cc0177cf41c33c1dc1cf1a28c6851c24f2f2d2501d2a 2024-06-26T07:55:23.3148087Z 2024-06-26T07:55:28.2757335Z Deleted Images: 2024-06-26T07:55:28.2759241Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:55:28.2762338Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks@sha256:216c88a4f79ebfa71a5dcf4d9a946548184354a3ea1f677f4b1065d28705debb 2024-06-26T07:55:28.2764178Z deleted: sha256:0058b15e517a024817bccd921dc9af264c964f500b3cb9b3f4649a8ac22cc2dd 2024-06-26T07:55:28.2765008Z deleted: sha256:754ead7012f0b7691885a9660f02e80be6cee8c5665486fb995c1fb06adb6e92 2024-06-26T07:55:28.2765951Z deleted: sha256:fbe4496d8830e11be86d8f222522e7956f32f85bfc06b05ea53961f34a58af74 2024-06-26T07:55:28.2766930Z deleted: sha256:1c83814aa1a1a7e0cc998e3479bdab8e8766b975560cbf00690acf39ed899a80 2024-06-26T07:55:28.2767789Z deleted: sha256:e9ea8e61942c7f8ae4aab97b8d102b01d6bb4b6cf2a605808cd34130a17d8a0f 2024-06-26T07:55:28.2768820Z deleted: sha256:acc5fc32588cd95e082a6ce35e48d0f303ae8f96e3ab65c4e375b85e1f3c4a92 2024-06-26T07:55:28.2769856Z deleted: sha256:a93e53400904d29e4185d3be942ea34f19572ea438962788ae4e9b3d9bf4c498 2024-06-26T07:55:28.2770884Z deleted: sha256:c97092b88b5e4c77c68bbc4b51afab64e38719af1ff58013ec49a696cdd40a6e 2024-06-26T07:55:28.2771718Z deleted: sha256:b132889c90d67ffa53655846603e3fcc2372c23f04dbdbc54690a39d304eb89b 2024-06-26T07:55:28.2772535Z deleted: sha256:915d54081ed607710624abe3f2490114c745858831f4fc13396bd3b4b9a121bc 2024-06-26T07:55:28.2773977Z deleted: sha256:bfa8d446c498c87f535aef102695564de1b22c755e6c63944ae2f5073a2b31ec 2024-06-26T07:55:28.2774980Z deleted: sha256:e71460fb363c29e70bbe357d680aaa7ae694f094ef2f2713609158ad90611744 2024-06-26T07:55:28.2775902Z deleted: sha256:84079bb1b4ee1d0119ae3d3e701de460a1324912297c675425c9a36d30fcdb0f 2024-06-26T07:55:28.2776816Z deleted: sha256:d86ac3ca148d4758cb03b493fdd49109d8f1a2c7c85c4b755493c3c4529553e5 2024-06-26T07:55:28.2777642Z deleted: sha256:532b3ab97c44a673a0d5f62ee46fa6a83248a84de8877754a612355be56ed0a3 2024-06-26T07:55:28.2778488Z deleted: sha256:617e2a35f25ae24500c88c0c9b8475f0687fbcbed3d200013b4c99c6d8941aff 2024-06-26T07:55:28.2779342Z deleted: sha256:b88120bcd5a26a660c09c5df13176e0ef098fb2c8cdb57d74ab0796a3d1194d6 2024-06-26T07:55:28.2780165Z deleted: sha256:c016b2e7764735243205fb76fa9a273bb3dd4bf05532288e3a613ce022131ac3 2024-06-26T07:55:28.2781042Z deleted: sha256:bcaca462c390deddd2995de2d245a7495e7d2e1e94f0edad30a573c83d0588fd 2024-06-26T07:55:28.2781867Z deleted: sha256:9e260eba003d5c25d7b410e5c4c3093845d9e46611896840901c689d7fbf8ee6 2024-06-26T07:55:28.2782839Z deleted: sha256:3e62b86f8b911a9b59c62d55f063e71683ae6a01c22418db5d27930712adaad6 2024-06-26T07:55:28.2783668Z deleted: sha256:905920ccb1d88449b8dde686c34a4b2a8b6f59e78ac44916b189ea3593b9fbbb 2024-06-26T07:55:28.2784488Z deleted: sha256:961201237e03acd5061406238dd7a3c1343ac888d7583212cd0ab5ae1b4f0540 2024-06-26T07:55:28.2785315Z deleted: sha256:70047a2aac62159fa28fb4dbd4567ec2ffbab68fe046967e09acb0eb3e5cb9cb 2024-06-26T07:55:28.2786179Z deleted: sha256:1ec680ad781436ae65fa987f5fa1ed032ecd5c82a6e35eea6707de501f62c0f4 2024-06-26T07:55:28.2787086Z deleted: sha256:ef859623a50e85abf6e6c1dbd6188aa765a66cc7b2bd618a1cbe4825b7b2bd91 2024-06-26T07:55:28.2787926Z deleted: sha256:404ade5cacff59773b93ab438bfa64cd3a171d07f6f168bdc4a5d4bfa0b43526 2024-06-26T07:55:28.2788926Z deleted: sha256:5b27de6ee3d9f2f18217bf18dec725f7b4954c0e48c85d35752634c22d62209b 2024-06-26T07:55:28.2789952Z deleted: sha256:498e39c575b3fa069acaac7e46b91b4e54ae3a05f2ada5c4347091f346f25d4c 2024-06-26T07:55:28.2790791Z deleted: sha256:1405919d2694d65669b1f4c842282021afe89208ce86570e96464903733da2d0 2024-06-26T07:55:28.2791601Z deleted: sha256:d5b41e5d70896c0472fc3e6da0516a17d89cd6635dc75010ecddc31ce9690fad 2024-06-26T07:55:28.2792427Z deleted: sha256:18e9379b62b9d0bb40293d28a652eafaee66a499f66f0776bf14e37a513101b7 2024-06-26T07:55:28.2793241Z deleted: sha256:a781f80ed00ff2926a699fd01a309bb0b4fb7d5655eb652c205bb9c7f811035f 2024-06-26T07:55:28.2794064Z deleted: sha256:c0430973b7cf759075330ee29c79bfd1312c91e6033d9dd883b4b1c29743a171 2024-06-26T07:55:28.2794899Z deleted: sha256:e733b3d66efb9342e5a283376c0e1ddffa47a42fecc26e61ecaf0a3472885d97 2024-06-26T07:55:28.2795724Z deleted: sha256:8929c0b2047f74b84c82c39eff9077a92ae1a828cde00c9ab78fb3e0ed5e0283 2024-06-26T07:55:28.2796539Z deleted: sha256:f5b56155fb58a0a60fe6391d3581cf91610ed69d4f0a321257c19944da296a52 2024-06-26T07:55:28.2797356Z deleted: sha256:b54d2cb355238d1aa91e58df93064447b80f53706d1ca62823acc834f5ac54fe 2024-06-26T07:55:28.2798255Z deleted: sha256:e7311285af9eeddb51aa5629aa98386e89f1456ff32843b6aee6443247edf66c 2024-06-26T07:55:28.2799279Z deleted: sha256:67657ceec347da8dc8085d5731633efeac115ba677fa4b7c5966c4260f7abab0 2024-06-26T07:55:28.2800257Z deleted: sha256:b496e50409dbf414930fc9b4437aa0aa4ce27bc7840e050ae459aaffcf9aca86 2024-06-26T07:55:28.2801063Z deleted: sha256:8f5276170cc4a60d36ad7b964a502306b29546254cedcbcb101ea9123497d2c0 2024-06-26T07:55:28.2801873Z deleted: sha256:53d524d1564745e96a7e515462171b73184d9f1ff5454b32fcfbbca39d361467 2024-06-26T07:55:28.2802698Z deleted: sha256:2acbadb00d69b6aca575f04baba4ea26ae2b5c2d85f09945004ad93a78a8eb75 2024-06-26T07:55:28.2803669Z deleted: sha256:02665efeff878aeb603c1edb2e21cb700c171c025d64f5aae1b2b20b12f3964a 2024-06-26T07:55:28.2804508Z deleted: sha256:19bd23e9a51dfe883a8b8d2ff6d66ff1b3476b8912856406bb79b81762aa6d4b 2024-06-26T07:55:28.2805326Z deleted: sha256:73aa8637bf9299d6298dabd858480c274a62117388f2ca1d5e9eb15c6d1e4155 2024-06-26T07:55:28.2806239Z deleted: sha256:5f8968406305f348b1caebc0e035187d6e9965ace7b9d5f2f21114d37c9fe2e1 2024-06-26T07:55:28.2807061Z deleted: sha256:d827104914db0c503cf5c81f13e2456bf4efce42d4cf1f8d5d70838207278bee 2024-06-26T07:55:28.2807874Z deleted: sha256:867b219724f2f1aaf56f42e3e9f03a5d64bdca8a6a72407efd10328aeea5d510 2024-06-26T07:55:28.2808767Z deleted: sha256:b9ff2a7cceb9237b26bcb17728edf8a558eec5a76f63626e84f80541dfc0f1d4 2024-06-26T07:55:28.2809602Z deleted: sha256:be73f509106819007ce2b0f5a1301ac56ae583cb6c1fb69bee93efa0840368f1 2024-06-26T07:55:28.2810431Z deleted: sha256:2a11c07c915c3fdbb4e73096dea73ea950c970d50fe1a5764060bd62b7b7cf2c 2024-06-26T07:55:28.2811269Z deleted: sha256:5e9989622e2abc1c72f8184343507b45d75e4ff971edb68b96cbcd75ae484ff5 2024-06-26T07:55:28.2812098Z deleted: sha256:05ce642bd9cf5a9205bff107df28b1d6cef7d5f6ab3ea944d28c032ec61270df 2024-06-26T07:55:28.2812920Z deleted: sha256:017702617f6c07b73f2088678f4710b794cfe897a213a5cf122a0e2519eae0ac 2024-06-26T07:55:28.2813952Z deleted: sha256:44b3b37bb1ca39dc5cf356de41a23a5c12f605a1992813e408087fb2b0ad6d1c 2024-06-26T07:55:28.2814770Z deleted: sha256:8c387982e9f27db357a1d149dc149cabc0bd04668ad6956387a5072682dada67 2024-06-26T07:55:28.2815700Z deleted: sha256:10d415dca4e3fbb88a747b40317f3c6333c041ba8f73855f67fb9fe981fae5ee 2024-06-26T07:55:28.2816530Z deleted: sha256:6c65469bf0f53dcd625faefe363b8f3136c08388a6cf64d9158e8576e4ee89b1 2024-06-26T07:55:28.2817378Z deleted: sha256:027db5d8b76deeefbd8c34b485ab7ff14ed2a3e6800425c1ce0d77c2e9fdd4ab 2024-06-26T07:55:28.2818276Z deleted: sha256:24941234ad28cf5c8174d7cf18326c10b4e17f2c2137672ea0322df461597dd7 2024-06-26T07:55:28.2819305Z deleted: sha256:240ea2eebfa8519d6c2d88f4c99e66ce4e038d000f93ce8d03726c01d81180ef 2024-06-26T07:55:28.2820333Z deleted: sha256:09e823cb391a69f6a195e3ca8a41624b5f8b34eee14c6eb36277de814a91966e 2024-06-26T07:55:28.2821229Z deleted: sha256:730479d695169a6593bf0ac16b377491dce65175a6d158e012422367d04577fd 2024-06-26T07:55:28.2822037Z deleted: sha256:b0a30f9f7bd5459ff662453b9346a7ba8ea8db1191528345c1953eab4aa2f54e 2024-06-26T07:55:28.2822858Z deleted: sha256:75cefa87effaa3ad361c74642839923101f0f9982f814f3c9e2ed4ad52f2a008 2024-06-26T07:55:28.2823690Z deleted: sha256:6f97db87ba9512e615e871c6982000602982e1e5a5be334a56e7292251e84e00 2024-06-26T07:55:28.2824505Z deleted: sha256:35a033279d5c9bd6b862bfa9331d8fcbf98bbaf778a778fabc882384db9204f8 2024-06-26T07:55:28.2825329Z deleted: sha256:ab9b00c496073d62e69e032178858d3d6d4c4bab9e87065d3785c6da57351d00 2024-06-26T07:55:28.2826139Z deleted: sha256:7ed947299e109c2459de6e240d86f049c30f93f2380659ce441d8737b8cd065f 2024-06-26T07:55:28.2826947Z deleted: sha256:410d5a7f7a9a1cb4551c106b9cc728a9dcff598f9be231a351ce6a0a33f81e64 2024-06-26T07:55:28.2827779Z deleted: sha256:5f0021bb56efa14bb93978c01513e2a1187ba30e69bdb0546d0ef39b30873f88 2024-06-26T07:55:28.2828739Z deleted: sha256:c1601aa97eb84151c14da3aeea351201bd99144d36d66b397f6555d80245d86d 2024-06-26T07:55:28.2829768Z deleted: sha256:72af05a89be22accdc1ca5d66dcbbb33993a9ef5997f849df1d4ba4c48049f25 2024-06-26T07:55:28.2830731Z deleted: sha256:38b90c9663dcaa2bc57a4dd3008298e7ea93e9535fa42312b4dc4246e7491af9 2024-06-26T07:55:28.2831589Z deleted: sha256:bda61b6cefb3ec8eeb74fef1ca1c7f9a5845fe5e8f07b8123323e897425d5c29 2024-06-26T07:55:28.2832426Z deleted: sha256:5a18e1aa877074529a84cbddf19f8d5403787823378ceae6b72fb62f78d43037 2024-06-26T07:55:28.2833255Z deleted: sha256:6c3e7df31590f02f10cb71fc4eb27653e9b428df2e6e5421a455b062bd2e39f9 2024-06-26T07:55:28.2833744Z 2024-06-26T07:55:28.2833892Z Total reclaimed space: 36.29GB 2024-06-26T07:55:28.2899352Z Post job cleanup. 2024-06-26T07:55:28.2952191Z Post job cleanup. 2024-06-26T07:55:28.3786511Z [command]/usr/bin/git version 2024-06-26T07:55:28.3830711Z git version 2.40.1 2024-06-26T07:55:28.3870667Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/7875dc30-2744-4a30-9390-26876f1a9159' before making global git config changes 2024-06-26T07:55:28.3872232Z Adding repository directory to the temporary git global config as a safe directory 2024-06-26T07:55:28.3876570Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-06-26T07:55:28.3903772Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2024-06-26T07:55:28.3932516Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2024-06-26T07:55:28.4148998Z Entering 'android/libs/fbjni' 2024-06-26T07:55:28.4186780Z Entering 'third_party/FP16' 2024-06-26T07:55:28.4225726Z Entering 'third_party/FXdiv' 2024-06-26T07:55:28.4262229Z Entering 'third_party/NNPACK' 2024-06-26T07:55:28.4298598Z Entering 'third_party/VulkanMemoryAllocator' 2024-06-26T07:55:28.4335632Z Entering 'third_party/XNNPACK' 2024-06-26T07:55:28.4382846Z Entering 'third_party/benchmark' 2024-06-26T07:55:28.4420493Z Entering 'third_party/cpp-httplib' 2024-06-26T07:55:28.4457602Z Entering 'third_party/cpuinfo' 2024-06-26T07:55:28.4494937Z Entering 'third_party/cudnn_frontend' 2024-06-26T07:55:28.4531690Z Entering 'third_party/cutlass' 2024-06-26T07:55:28.4572117Z Entering 'third_party/eigen' 2024-06-26T07:55:28.4609401Z Entering 'third_party/fbgemm' 2024-06-26T07:55:28.4647329Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-06-26T07:55:28.4682715Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T07:55:28.4720692Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-06-26T07:55:28.4760339Z Entering 'third_party/fbgemm/third_party/googletest' 2024-06-26T07:55:28.4795326Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T07:55:28.4831329Z Entering 'third_party/flatbuffers' 2024-06-26T07:55:28.4869402Z Entering 'third_party/fmt' 2024-06-26T07:55:28.4904536Z Entering 'third_party/foxi' 2024-06-26T07:55:28.4939323Z Entering 'third_party/gemmlowp/gemmlowp' 2024-06-26T07:55:28.4973764Z Entering 'third_party/gloo' 2024-06-26T07:55:28.5010171Z Entering 'third_party/googletest' 2024-06-26T07:55:28.5046169Z Entering 'third_party/ideep' 2024-06-26T07:55:28.5081739Z Entering 'third_party/ideep/mkl-dnn' 2024-06-26T07:55:28.5123827Z Entering 'third_party/ittapi' 2024-06-26T07:55:28.5158335Z Entering 'third_party/kineto' 2024-06-26T07:55:28.5194676Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T07:55:28.5228942Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T07:55:28.5264917Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T07:55:28.5300147Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T07:55:28.5333712Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T07:55:28.5366992Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T07:55:28.5404174Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T07:55:28.5439785Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T07:55:28.5473248Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T07:55:28.5507044Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T07:55:28.5542361Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T07:55:28.5576794Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T07:55:28.5612124Z Entering 'third_party/mimalloc' 2024-06-26T07:55:28.5645799Z Entering 'third_party/nccl/nccl' 2024-06-26T07:55:28.5679903Z Entering 'third_party/nlohmann' 2024-06-26T07:55:28.5716494Z Entering 'third_party/onnx' 2024-06-26T07:55:28.5762467Z Entering 'third_party/onnx/third_party/benchmark' 2024-06-26T07:55:28.5799640Z Entering 'third_party/onnx/third_party/pybind11' 2024-06-26T07:55:28.5835691Z Entering 'third_party/opentelemetry-cpp' 2024-06-26T07:55:28.5870629Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T07:55:28.5905001Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T07:55:28.5939225Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T07:55:28.5973467Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T07:55:28.6008819Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T07:55:28.6043848Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T07:55:28.6078603Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T07:55:28.6111048Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T07:55:28.6146098Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T07:55:28.6181902Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T07:55:28.6231572Z Entering 'third_party/pocketfft' 2024-06-26T07:55:28.6266168Z Entering 'third_party/protobuf' 2024-06-26T07:55:28.6303252Z Entering 'third_party/protobuf/third_party/benchmark' 2024-06-26T07:55:28.6337961Z Entering 'third_party/protobuf/third_party/googletest' 2024-06-26T07:55:28.6373799Z Entering 'third_party/psimd' 2024-06-26T07:55:28.6406188Z Entering 'third_party/pthreadpool' 2024-06-26T07:55:28.6441539Z Entering 'third_party/pybind11' 2024-06-26T07:55:28.6476309Z Entering 'third_party/python-peachpy' 2024-06-26T07:55:28.6510876Z Entering 'third_party/sleef' 2024-06-26T07:55:28.6544488Z Entering 'third_party/tensorpipe' 2024-06-26T07:55:28.6579115Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-06-26T07:55:28.6614768Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-06-26T07:55:28.6649627Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-06-26T07:55:28.6684114Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T07:55:28.6718885Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T07:55:28.6772334Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2024-06-26T07:55:28.6794380Z http.https://github.com/.extraheader 2024-06-26T07:55:28.6803653Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader 2024-06-26T07:55:28.6828145Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2024-06-26T07:55:28.7033846Z Entering 'android/libs/fbjni' 2024-06-26T07:55:28.7055698Z http.https://github.com/.extraheader 2024-06-26T07:55:28.7080778Z Entering 'third_party/FP16' 2024-06-26T07:55:28.7101178Z http.https://github.com/.extraheader 2024-06-26T07:55:28.7123155Z Entering 'third_party/FXdiv' 2024-06-26T07:55:28.7145965Z http.https://github.com/.extraheader 2024-06-26T07:55:28.7170261Z Entering 'third_party/NNPACK' 2024-06-26T07:55:28.7192538Z http.https://github.com/.extraheader 2024-06-26T07:55:28.7216896Z Entering 'third_party/VulkanMemoryAllocator' 2024-06-26T07:55:28.7239775Z http.https://github.com/.extraheader 2024-06-26T07:55:28.7266199Z Entering 'third_party/XNNPACK' 2024-06-26T07:55:28.7288351Z http.https://github.com/.extraheader 2024-06-26T07:55:28.7322644Z Entering 'third_party/benchmark' 2024-06-26T07:55:28.7344419Z http.https://github.com/.extraheader 2024-06-26T07:55:28.7366869Z Entering 'third_party/cpp-httplib' 2024-06-26T07:55:28.7389309Z http.https://github.com/.extraheader 2024-06-26T07:55:28.7411838Z Entering 'third_party/cpuinfo' 2024-06-26T07:55:28.7434181Z http.https://github.com/.extraheader 2024-06-26T07:55:28.7458787Z Entering 'third_party/cudnn_frontend' 2024-06-26T07:55:28.7480674Z http.https://github.com/.extraheader 2024-06-26T07:55:28.7505395Z Entering 'third_party/cutlass' 2024-06-26T07:55:28.7527618Z http.https://github.com/.extraheader 2024-06-26T07:55:28.7555930Z Entering 'third_party/eigen' 2024-06-26T07:55:28.7578452Z http.https://github.com/.extraheader 2024-06-26T07:55:28.7602916Z Entering 'third_party/fbgemm' 2024-06-26T07:55:28.7624878Z http.https://github.com/.extraheader 2024-06-26T07:55:28.7648333Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-06-26T07:55:28.7670044Z http.https://github.com/.extraheader 2024-06-26T07:55:28.7693726Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T07:55:28.7715312Z http.https://github.com/.extraheader 2024-06-26T07:55:28.7738404Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-06-26T07:55:28.7759282Z http.https://github.com/.extraheader 2024-06-26T07:55:28.7786987Z Entering 'third_party/fbgemm/third_party/googletest' 2024-06-26T07:55:28.7808211Z http.https://github.com/.extraheader 2024-06-26T07:55:28.7832111Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T07:55:28.7853507Z http.https://github.com/.extraheader 2024-06-26T07:55:28.7877033Z Entering 'third_party/flatbuffers' 2024-06-26T07:55:28.7898437Z http.https://github.com/.extraheader 2024-06-26T07:55:28.7923863Z Entering 'third_party/fmt' 2024-06-26T07:55:28.7946249Z http.https://github.com/.extraheader 2024-06-26T07:55:28.7970002Z Entering 'third_party/foxi' 2024-06-26T07:55:28.7992014Z http.https://github.com/.extraheader 2024-06-26T07:55:28.8016038Z Entering 'third_party/gemmlowp/gemmlowp' 2024-06-26T07:55:28.8036817Z http.https://github.com/.extraheader 2024-06-26T07:55:28.8060877Z Entering 'third_party/gloo' 2024-06-26T07:55:28.8082817Z http.https://github.com/.extraheader 2024-06-26T07:55:28.8106478Z Entering 'third_party/googletest' 2024-06-26T07:55:28.8127248Z http.https://github.com/.extraheader 2024-06-26T07:55:28.8150650Z Entering 'third_party/ideep' 2024-06-26T07:55:28.8172341Z http.https://github.com/.extraheader 2024-06-26T07:55:28.8194989Z Entering 'third_party/ideep/mkl-dnn' 2024-06-26T07:55:28.8216289Z http.https://github.com/.extraheader 2024-06-26T07:55:28.8244649Z Entering 'third_party/ittapi' 2024-06-26T07:55:28.8265895Z http.https://github.com/.extraheader 2024-06-26T07:55:28.8288549Z Entering 'third_party/kineto' 2024-06-26T07:55:28.8310741Z http.https://github.com/.extraheader 2024-06-26T07:55:28.8334859Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T07:55:28.8355443Z http.https://github.com/.extraheader 2024-06-26T07:55:28.8378977Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T07:55:28.8400516Z http.https://github.com/.extraheader 2024-06-26T07:55:28.8423752Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T07:55:28.8445668Z http.https://github.com/.extraheader 2024-06-26T07:55:28.8470518Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T07:55:28.8491622Z http.https://github.com/.extraheader 2024-06-26T07:55:28.8516026Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T07:55:28.8538065Z http.https://github.com/.extraheader 2024-06-26T07:55:28.8560212Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T07:55:28.8581955Z http.https://github.com/.extraheader 2024-06-26T07:55:28.8606638Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T07:55:28.8627586Z http.https://github.com/.extraheader 2024-06-26T07:55:28.8649912Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T07:55:28.8671540Z http.https://github.com/.extraheader 2024-06-26T07:55:28.8696385Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T07:55:28.8717888Z http.https://github.com/.extraheader 2024-06-26T07:55:28.8742474Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T07:55:28.8763579Z http.https://github.com/.extraheader 2024-06-26T07:55:28.8788261Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T07:55:28.8809152Z http.https://github.com/.extraheader 2024-06-26T07:55:28.8831290Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T07:55:28.8851803Z http.https://github.com/.extraheader 2024-06-26T07:55:28.8876019Z Entering 'third_party/mimalloc' 2024-06-26T07:55:28.8898110Z http.https://github.com/.extraheader 2024-06-26T07:55:28.8921537Z Entering 'third_party/nccl/nccl' 2024-06-26T07:55:28.8942504Z http.https://github.com/.extraheader 2024-06-26T07:55:28.8962919Z Entering 'third_party/nlohmann' 2024-06-26T07:55:28.8985083Z http.https://github.com/.extraheader 2024-06-26T07:55:28.9008859Z Entering 'third_party/onnx' 2024-06-26T07:55:28.9030788Z http.https://github.com/.extraheader 2024-06-26T07:55:28.9066355Z Entering 'third_party/onnx/third_party/benchmark' 2024-06-26T07:55:28.9087945Z http.https://github.com/.extraheader 2024-06-26T07:55:28.9110091Z Entering 'third_party/onnx/third_party/pybind11' 2024-06-26T07:55:28.9130901Z http.https://github.com/.extraheader 2024-06-26T07:55:28.9155893Z Entering 'third_party/opentelemetry-cpp' 2024-06-26T07:55:28.9177746Z http.https://github.com/.extraheader 2024-06-26T07:55:28.9202204Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T07:55:28.9225107Z http.https://github.com/.extraheader 2024-06-26T07:55:28.9249477Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T07:55:28.9270482Z http.https://github.com/.extraheader 2024-06-26T07:55:28.9294588Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T07:55:28.9316290Z http.https://github.com/.extraheader 2024-06-26T07:55:28.9340350Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T07:55:28.9361501Z http.https://github.com/.extraheader 2024-06-26T07:55:28.9385378Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T07:55:28.9406338Z http.https://github.com/.extraheader 2024-06-26T07:55:28.9430250Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T07:55:28.9451211Z http.https://github.com/.extraheader 2024-06-26T07:55:28.9473323Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T07:55:28.9492830Z http.https://github.com/.extraheader 2024-06-26T07:55:28.9516817Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T07:55:28.9538817Z http.https://github.com/.extraheader 2024-06-26T07:55:28.9563779Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T07:55:28.9584730Z http.https://github.com/.extraheader 2024-06-26T07:55:28.9610163Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T07:55:28.9633067Z http.https://github.com/.extraheader 2024-06-26T07:55:28.9674268Z Entering 'third_party/pocketfft' 2024-06-26T07:55:28.9696147Z http.https://github.com/.extraheader 2024-06-26T07:55:28.9720423Z Entering 'third_party/protobuf' 2024-06-26T07:55:28.9742834Z http.https://github.com/.extraheader 2024-06-26T07:55:28.9765382Z Entering 'third_party/protobuf/third_party/benchmark' 2024-06-26T07:55:28.9786980Z http.https://github.com/.extraheader 2024-06-26T07:55:28.9810568Z Entering 'third_party/protobuf/third_party/googletest' 2024-06-26T07:55:28.9832733Z http.https://github.com/.extraheader 2024-06-26T07:55:28.9858577Z Entering 'third_party/psimd' 2024-06-26T07:55:28.9879949Z http.https://github.com/.extraheader 2024-06-26T07:55:28.9904613Z Entering 'third_party/pthreadpool' 2024-06-26T07:55:28.9926444Z http.https://github.com/.extraheader 2024-06-26T07:55:28.9949280Z Entering 'third_party/pybind11' 2024-06-26T07:55:28.9969637Z http.https://github.com/.extraheader 2024-06-26T07:55:28.9994412Z Entering 'third_party/python-peachpy' 2024-06-26T07:55:29.0015605Z http.https://github.com/.extraheader 2024-06-26T07:55:29.0037870Z Entering 'third_party/sleef' 2024-06-26T07:55:29.0058428Z http.https://github.com/.extraheader 2024-06-26T07:55:29.0081785Z Entering 'third_party/tensorpipe' 2024-06-26T07:55:29.0104163Z http.https://github.com/.extraheader 2024-06-26T07:55:29.0126377Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-06-26T07:55:29.0148273Z http.https://github.com/.extraheader 2024-06-26T07:55:29.0171830Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-06-26T07:55:29.0192702Z http.https://github.com/.extraheader 2024-06-26T07:55:29.0215971Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-06-26T07:55:29.0237544Z http.https://github.com/.extraheader 2024-06-26T07:55:29.0260893Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T07:55:29.0281685Z http.https://github.com/.extraheader 2024-06-26T07:55:29.0301892Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T07:55:29.0323413Z http.https://github.com/.extraheader 2024-06-26T07:55:29.0451269Z A job completed hook has been configured by the self-hosted runner administrator 2024-06-26T07:55:29.0468410Z ##[group]Run '/home/ec2-user/runner-scripts/cleanup.sh' 2024-06-26T07:55:29.0475433Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:55:29.0475944Z ##[endgroup] 2024-06-26T07:55:29.6271010Z Cleaning up orphan processes