2024-06-26T07:05:08.4537860Z Current runner version: '2.317.0' 2024-06-26T07:05:08.4544164Z Runner name: 'i-04a4d8372606379d8' 2024-06-26T07:05:08.4544978Z Runner group name: 'Default' 2024-06-26T07:05:08.4545947Z Machine name: 'ip-10-0-54-186' 2024-06-26T07:05:08.4550900Z ##[group]GITHUB_TOKEN Permissions 2024-06-26T07:05:08.4552885Z Actions: read 2024-06-26T07:05:08.4553423Z Attestations: read 2024-06-26T07:05:08.4554026Z Checks: read 2024-06-26T07:05:08.4554585Z Contents: read 2024-06-26T07:05:08.4555126Z Deployments: read 2024-06-26T07:05:08.4555664Z Discussions: read 2024-06-26T07:05:08.4556233Z Issues: read 2024-06-26T07:05:08.4556795Z Metadata: read 2024-06-26T07:05:08.4557343Z Packages: read 2024-06-26T07:05:08.4557854Z Pages: read 2024-06-26T07:05:08.4558386Z PullRequests: read 2024-06-26T07:05:08.4558987Z RepositoryProjects: read 2024-06-26T07:05:08.4559606Z SecurityEvents: read 2024-06-26T07:05:08.4560225Z Statuses: read 2024-06-26T07:05:08.4560769Z ##[endgroup] 2024-06-26T07:05:08.4563960Z Secret source: Actions 2024-06-26T07:05:08.4564791Z Prepare workflow directory 2024-06-26T07:05:08.8167832Z Prepare all required actions 2024-06-26T07:05:08.8358499Z Getting action download info 2024-06-26T07:05:09.0539242Z Download action repository 'pytorch/test-infra@main' (SHA:43a2ce341cc31288e9a38b65ce600a7f43021bd5) 2024-06-26T07:05:09.3668572Z Download action repository 'pytorch/pytorch@main' (SHA:c422a9549d2b320b47a9391f6cbcf592b2876c88) 2024-06-26T07:05:12.2702476Z Download action repository 'aws-actions/configure-aws-credentials@v3' (SHA:50ac8dd1e1b10d09dac7b8727528b91bed831ac0) 2024-06-26T07:05:12.4072220Z Download action repository 'seemethere/upload-artifact-s3@v5' (SHA:baba72d0712b404f646cebe0730933554ebce96a) 2024-06-26T07:05:12.6828063Z Getting action download info 2024-06-26T07:05:12.7829666Z Download action repository 'malfet/checkout@silent-checkout' (SHA:e07af140b3ccefc05679e3755b9db68f4ee4589c) 2024-06-26T07:05:12.9504986Z Getting action download info 2024-06-26T07:05:13.0583295Z Download action repository 'nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482' (SHA:3e91a01664abd3c5cd539100d10d33b9c5b68482) 2024-06-26T07:05:13.1984210Z Uses: pytorch/pytorch/.github/workflows/_linux-test.yml@refs/tags/ciflow/inductor/129470 (b8c4c54d347aa776934c60784e35936878ef18dc) 2024-06-26T07:05:13.1986404Z ##[group] Inputs 2024-06-26T07:05:13.1986870Z build-environment: linux-focal-cuda12.4-py3.10-gcc9-sm86 2024-06-26T07:05:13.1988116Z test-matrix: {"include": [{"config": "inductor_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}]} 2024-06-26T07:05:13.1990059Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:05:13.1991313Z sync-tag: linux-focal-cuda12_4-py3_10-gcc9-inductor-test 2024-06-26T07:05:13.1992293Z timeout-minutes: 240 2024-06-26T07:05:13.1992639Z use-gha: 2024-06-26T07:05:13.1992938Z dashboard-tag: 2024-06-26T07:05:13.1993274Z s3-bucket: gha-artifacts 2024-06-26T07:05:13.1993623Z aws-role-to-assume: 2024-06-26T07:05:13.1993957Z ##[endgroup] 2024-06-26T07:05:13.1994793Z Complete job name: cuda12.4-py3.10-gcc9-sm86 / test (inductor_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-06-26T07:05:13.2574466Z A job started hook has been configured by the self-hosted runner administrator 2024-06-26T07:05:13.2713002Z ##[group]Run '/home/ec2-user/runner-scripts/cleanup.sh' 2024-06-26T07:05:13.2723406Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:05:13.2723927Z ##[endgroup] 2024-06-26T07:05:14.4956192Z ##[group]Run pytorch/test-infra/.github/actions/setup-ssh@main 2024-06-26T07:05:14.4956824Z with: 2024-06-26T07:05:14.4957582Z github-secret: *** 2024-06-26T07:05:14.4958591Z instructions: All testing is done inside the container, to start an interactive session run: docker exec -it $(docker container ps --format '{{.ID}}') bash 2024-06-26T07:05:14.4959807Z activate-with-label: false 2024-06-26T07:05:14.4960253Z label: with-ssh 2024-06-26T07:05:14.4960673Z remove-existing-keys: true 2024-06-26T07:05:14.4961139Z fail-silently: true 2024-06-26T07:05:14.4961540Z env: 2024-06-26T07:05:14.4961897Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:05:14.4962324Z ##[endgroup] 2024-06-26T07:05:14.5827269Z Please see https://github.com/pytorch/pytorch/wiki/Debugging-using-with-ssh-for-Github-Actions for more info. 2024-06-26T07:05:14.5828356Z ciflow reference detected, attempting to extract PR number 2024-06-26T07:05:14.9122186Z Grabbing public ssh keys from https://github.com/pytorch-bot[bot].keys 2024-06-26T07:05:14.9871443Z No SSH keys found for user pytorch-bot[bot] 2024-06-26T07:05:14.9872443Z Grabbing public ssh keys from https://github.com/leslie-fang-intel.keys 2024-06-26T07:05:15.0638783Z No SSH keys found for user leslie-fang-intel 2024-06-26T07:05:15.0745932Z ##[group]Run pytorch/pytorch/.github/actions/checkout-pytorch@main 2024-06-26T07:05:15.0746590Z with: 2024-06-26T07:05:15.0746958Z submodules: recursive 2024-06-26T07:05:15.0747349Z fetch-depth: 0 2024-06-26T07:05:15.0747660Z env: 2024-06-26T07:05:15.0747987Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:05:15.0748416Z ##[endgroup] 2024-06-26T07:05:15.0970434Z ##[group]Run retry () { 2024-06-26T07:05:15.0970836Z retry () { 2024-06-26T07:05:15.0971401Z  $* || (sleep 1 && $*) || (sleep 2 && $*) || (sleep 4 && $*) || (sleep 8 && $*) 2024-06-26T07:05:15.0971948Z } 2024-06-26T07:05:15.0972265Z echo "${GITHUB_WORKSPACE}" 2024-06-26T07:05:15.0972688Z if [ -z "${NO_SUDO}" ]; then 2024-06-26T07:05:15.0973158Z  retry sudo rm -rf "${GITHUB_WORKSPACE}" 2024-06-26T07:05:15.0973608Z else 2024-06-26T07:05:15.0973951Z  retry rm -rf "${GITHUB_WORKSPACE}" 2024-06-26T07:05:15.0974495Z fi 2024-06-26T07:05:15.0974844Z mkdir "${GITHUB_WORKSPACE}" 2024-06-26T07:05:15.0983448Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:05:15.0983961Z env: 2024-06-26T07:05:15.0984245Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:05:15.0984587Z NO_SUDO: 2024-06-26T07:05:15.0984854Z ##[endgroup] 2024-06-26T07:05:15.1007029Z /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-06-26T07:05:17.3952678Z ##[group]Run malfet/checkout@silent-checkout 2024-06-26T07:05:17.3953127Z with: 2024-06-26T07:05:17.3953456Z ref: b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:05:17.3953908Z fetch-depth: 0 2024-06-26T07:05:17.3954230Z submodules: recursive 2024-06-26T07:05:17.3954566Z quiet-checkout: true 2024-06-26T07:05:17.3954919Z repository: pytorch/pytorch 2024-06-26T07:05:17.3955407Z token: *** 2024-06-26T07:05:17.3955703Z ssh-strict: true 2024-06-26T07:05:17.3956022Z persist-credentials: true 2024-06-26T07:05:17.3956387Z clean: true 2024-06-26T07:05:17.3956720Z sparse-checkout-cone-mode: true 2024-06-26T07:05:17.3957118Z lfs: false 2024-06-26T07:05:17.3957414Z set-safe-directory: true 2024-06-26T07:05:17.3957762Z env: 2024-06-26T07:05:17.3958039Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:05:17.3958387Z ##[endgroup] 2024-06-26T07:05:17.4875990Z Syncing repository: pytorch/pytorch 2024-06-26T07:05:17.4877588Z ##[group]Getting Git version info 2024-06-26T07:05:17.4878379Z Working directory is '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2024-06-26T07:05:17.4879222Z [command]/usr/bin/git version 2024-06-26T07:05:17.4879587Z git version 2.40.1 2024-06-26T07:05:17.4880939Z ##[endgroup] 2024-06-26T07:05:17.4892027Z Copying '/home/ec2-user/.gitconfig' to '/home/ec2-user/actions-runner/_work/_temp/ccda9555-1f07-4c64-ae06-e31fd8b2ebe1/.gitconfig' 2024-06-26T07:05:17.4893823Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/ccda9555-1f07-4c64-ae06-e31fd8b2ebe1' before making global git config changes 2024-06-26T07:05:17.4895139Z Adding repository directory to the temporary git global config as a safe directory 2024-06-26T07:05:17.4896225Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-06-26T07:05:17.4919746Z Deleting the contents of '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2024-06-26T07:05:17.4923557Z ##[group]Initializing the repository 2024-06-26T07:05:17.4926190Z [command]/usr/bin/git init /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-06-26T07:05:17.4944929Z hint: Using 'master' as the name for the initial branch. This default branch name 2024-06-26T07:05:17.4945796Z hint: is subject to change. To configure the initial branch name to use in all 2024-06-26T07:05:17.4946610Z hint: of your new repositories, which will suppress this warning, call: 2024-06-26T07:05:17.4947389Z hint: 2024-06-26T07:05:17.4947837Z hint: git config --global init.defaultBranch 2024-06-26T07:05:17.4948310Z hint: 2024-06-26T07:05:17.4949011Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-06-26T07:05:17.4949861Z hint: 'development'. The just-created branch can be renamed via this command: 2024-06-26T07:05:17.4950446Z hint: 2024-06-26T07:05:17.4950768Z hint: git branch -m 2024-06-26T07:05:17.4951496Z Initialized empty Git repository in /home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/ 2024-06-26T07:05:17.4952961Z [command]/usr/bin/git remote add origin https://github.com/pytorch/pytorch 2024-06-26T07:05:17.4979885Z ##[endgroup] 2024-06-26T07:05:17.4980904Z ##[group]Disabling automatic garbage collection 2024-06-26T07:05:17.4983660Z [command]/usr/bin/git config --local gc.auto 0 2024-06-26T07:05:17.5003369Z ##[endgroup] 2024-06-26T07:05:17.5003992Z ##[group]Setting up auth 2024-06-26T07:05:17.5009008Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2024-06-26T07:05:17.5030217Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2024-06-26T07:05:17.5224508Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2024-06-26T07:05:17.5250222Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2024-06-26T07:05:17.5447307Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic *** 2024-06-26T07:05:17.5487034Z ##[endgroup] 2024-06-26T07:05:17.5487866Z ##[group]Fetching the repository 2024-06-26T07:05:17.5494281Z [command]/usr/bin/git -c protocol.version=2 fetch --prune --progress --no-recurse-submodules --quiet origin +refs/heads/*:refs/remotes/origin/* +refs/tags/*:refs/tags/* 2024-06-26T07:05:19.9766152Z remote: Enumerating objects: 987619 2024-06-26T07:05:19.9767388Z remote: Enumerating objects: 990225, done. 2024-06-26T07:05:19.9771212Z remote: Counting objects: 0% (1/2606) 2024-06-26T07:05:19.9772404Z remote: Counting objects: 1% (27/2606) 2024-06-26T07:05:19.9773914Z remote: Counting objects: 2% (53/2606) 2024-06-26T07:05:19.9775145Z remote: Counting objects: 3% (79/2606) 2024-06-26T07:05:19.9775838Z remote: Counting objects: 4% (105/2606) 2024-06-26T07:05:19.9782054Z remote: Counting objects: 5% (131/2606) 2024-06-26T07:05:19.9782866Z remote: Counting objects: 6% (157/2606) 2024-06-26T07:05:19.9783463Z remote: Counting objects: 7% (183/2606) 2024-06-26T07:05:19.9784044Z remote: Counting objects: 8% (209/2606) 2024-06-26T07:05:19.9787224Z remote: Counting objects: 9% (235/2606) 2024-06-26T07:05:19.9788046Z remote: Counting objects: 10% (261/2606) 2024-06-26T07:05:19.9788715Z remote: Counting objects: 11% (287/2606) 2024-06-26T07:05:19.9789307Z remote: Counting objects: 12% (313/2606) 2024-06-26T07:05:19.9789903Z remote: Counting objects: 13% (339/2606) 2024-06-26T07:05:19.9790499Z remote: Counting objects: 14% (365/2606) 2024-06-26T07:05:19.9791387Z remote: Counting objects: 15% (391/2606) 2024-06-26T07:05:19.9791980Z remote: Counting objects: 16% (417/2606) 2024-06-26T07:05:19.9792567Z remote: Counting objects: 17% (444/2606) 2024-06-26T07:05:19.9793156Z remote: Counting objects: 18% (470/2606) 2024-06-26T07:05:19.9793750Z remote: Counting objects: 19% (496/2606) 2024-06-26T07:05:19.9794346Z remote: Counting objects: 20% (522/2606) 2024-06-26T07:05:19.9794931Z remote: Counting objects: 21% (548/2606) 2024-06-26T07:05:19.9795541Z remote: Counting objects: 22% (574/2606) 2024-06-26T07:05:19.9796135Z remote: Counting objects: 23% (600/2606) 2024-06-26T07:05:19.9796723Z remote: Counting objects: 24% (626/2606) 2024-06-26T07:05:19.9797307Z remote: Counting objects: 25% (652/2606) 2024-06-26T07:05:19.9798006Z remote: Counting objects: 26% (678/2606) 2024-06-26T07:05:19.9798600Z remote: Counting objects: 27% (704/2606) 2024-06-26T07:05:19.9799201Z remote: Counting objects: 28% (730/2606) 2024-06-26T07:05:19.9799787Z remote: Counting objects: 29% (756/2606) 2024-06-26T07:05:19.9800378Z remote: Counting objects: 30% (782/2606) 2024-06-26T07:05:19.9800968Z remote: Counting objects: 31% (808/2606) 2024-06-26T07:05:19.9801562Z remote: Counting objects: 32% (834/2606) 2024-06-26T07:05:19.9802151Z remote: Counting objects: 33% (860/2606) 2024-06-26T07:05:19.9802743Z remote: Counting objects: 34% (887/2606) 2024-06-26T07:05:19.9803336Z remote: Counting objects: 35% (913/2606) 2024-06-26T07:05:19.9803925Z remote: Counting objects: 36% (939/2606) 2024-06-26T07:05:19.9804690Z remote: Counting objects: 37% (965/2606) 2024-06-26T07:05:19.9805378Z remote: Counting objects: 38% (991/2606) 2024-06-26T07:05:19.9805977Z remote: Counting objects: 39% (1017/2606) 2024-06-26T07:05:19.9806653Z remote: Counting objects: 40% (1043/2606) 2024-06-26T07:05:19.9807238Z remote: Counting objects: 41% (1069/2606) 2024-06-26T07:05:19.9807827Z remote: Counting objects: 42% (1095/2606) 2024-06-26T07:05:19.9808428Z remote: Counting objects: 43% (1121/2606) 2024-06-26T07:05:19.9809104Z remote: Counting objects: 44% (1147/2606) 2024-06-26T07:05:19.9809720Z remote: Counting objects: 45% (1173/2606) 2024-06-26T07:05:19.9810319Z remote: Counting objects: 46% (1199/2606) 2024-06-26T07:05:19.9810915Z remote: Counting objects: 47% (1225/2606) 2024-06-26T07:05:19.9811600Z remote: Counting objects: 48% (1251/2606) 2024-06-26T07:05:19.9812183Z remote: Counting objects: 49% (1277/2606) 2024-06-26T07:05:19.9812808Z remote: Counting objects: 50% (1303/2606) 2024-06-26T07:05:19.9813463Z remote: Counting objects: 51% (1330/2606) 2024-06-26T07:05:19.9814060Z remote: Counting objects: 52% (1356/2606) 2024-06-26T07:05:19.9814744Z remote: Counting objects: 53% (1382/2606) 2024-06-26T07:05:19.9815332Z remote: Counting objects: 54% (1408/2606) 2024-06-26T07:05:19.9815922Z remote: Counting objects: 55% (1434/2606) 2024-06-26T07:05:19.9816509Z remote: Counting objects: 56% (1460/2606) 2024-06-26T07:05:19.9817091Z remote: Counting objects: 57% (1486/2606) 2024-06-26T07:05:19.9817782Z remote: Counting objects: 58% (1512/2606) 2024-06-26T07:05:19.9818378Z remote: Counting objects: 59% (1538/2606) 2024-06-26T07:05:19.9818974Z remote: Counting objects: 60% (1564/2606) 2024-06-26T07:05:19.9819566Z remote: Counting objects: 61% (1590/2606) 2024-06-26T07:05:19.9820410Z remote: Counting objects: 62% (1616/2606) 2024-06-26T07:05:19.9821026Z remote: Counting objects: 63% (1642/2606) 2024-06-26T07:05:19.9821629Z remote: Counting objects: 64% (1668/2606) 2024-06-26T07:05:19.9822220Z remote: Counting objects: 65% (1694/2606) 2024-06-26T07:05:19.9822922Z remote: Counting objects: 66% (1720/2606) 2024-06-26T07:05:19.9823516Z remote: Counting objects: 67% (1747/2606) 2024-06-26T07:05:19.9824110Z remote: Counting objects: 68% (1773/2606) 2024-06-26T07:05:19.9824705Z remote: Counting objects: 69% (1799/2606) 2024-06-26T07:05:19.9825293Z remote: Counting objects: 70% (1825/2606) 2024-06-26T07:05:19.9825889Z remote: Counting objects: 71% (1851/2606) 2024-06-26T07:05:19.9826483Z remote: Counting objects: 72% (1877/2606) 2024-06-26T07:05:19.9827080Z remote: Counting objects: 73% (1903/2606) 2024-06-26T07:05:19.9827671Z remote: Counting objects: 74% (1929/2606) 2024-06-26T07:05:19.9828284Z remote: Counting objects: 75% (1955/2606) 2024-06-26T07:05:19.9828882Z remote: Counting objects: 76% (1981/2606) 2024-06-26T07:05:19.9829548Z remote: Counting objects: 77% (2007/2606) 2024-06-26T07:05:19.9830136Z remote: Counting objects: 78% (2033/2606) 2024-06-26T07:05:19.9830734Z remote: Counting objects: 79% (2059/2606) 2024-06-26T07:05:19.9831322Z remote: Counting objects: 80% (2085/2606) 2024-06-26T07:05:19.9831907Z remote: Counting objects: 81% (2111/2606) 2024-06-26T07:05:19.9832488Z remote: Counting objects: 82% (2137/2606) 2024-06-26T07:05:19.9833075Z remote: Counting objects: 83% (2163/2606) 2024-06-26T07:05:19.9833660Z remote: Counting objects: 84% (2190/2606) 2024-06-26T07:05:19.9834246Z remote: Counting objects: 85% (2216/2606) 2024-06-26T07:05:19.9834833Z remote: Counting objects: 86% (2242/2606) 2024-06-26T07:05:19.9835420Z remote: Counting objects: 87% (2268/2606) 2024-06-26T07:05:19.9836007Z remote: Counting objects: 88% (2294/2606) 2024-06-26T07:05:19.9836597Z remote: Counting objects: 89% (2320/2606) 2024-06-26T07:05:19.9837184Z remote: Counting objects: 90% (2346/2606) 2024-06-26T07:05:19.9837772Z remote: Counting objects: 91% (2372/2606) 2024-06-26T07:05:19.9838365Z remote: Counting objects: 92% (2398/2606) 2024-06-26T07:05:19.9838952Z remote: Counting objects: 93% (2424/2606) 2024-06-26T07:05:19.9839530Z remote: Counting objects: 94% (2450/2606) 2024-06-26T07:05:19.9840117Z remote: Counting objects: 95% (2476/2606) 2024-06-26T07:05:19.9840705Z remote: Counting objects: 96% (2502/2606) 2024-06-26T07:05:19.9841291Z remote: Counting objects: 97% (2528/2606) 2024-06-26T07:05:19.9841870Z remote: Counting objects: 98% (2554/2606) 2024-06-26T07:05:19.9842457Z remote: Counting objects: 99% (2580/2606) 2024-06-26T07:05:19.9843050Z remote: Counting objects: 100% (2606/2606) 2024-06-26T07:05:19.9843676Z remote: Counting objects: 100% (2606/2606), done. 2024-06-26T07:05:19.9954757Z remote: Compressing objects: 0% (1/1078) 2024-06-26T07:05:20.0392187Z remote: Compressing objects: 1% (11/1078) 2024-06-26T07:05:20.0802107Z remote: Compressing objects: 2% (22/1078) 2024-06-26T07:05:20.1255548Z remote: Compressing objects: 3% (33/1078) 2024-06-26T07:05:20.1478098Z remote: Compressing objects: 4% (44/1078) 2024-06-26T07:05:20.1768267Z remote: Compressing objects: 5% (54/1078) 2024-06-26T07:05:20.1991720Z remote: Compressing objects: 6% (65/1078) 2024-06-26T07:05:20.2427017Z remote: Compressing objects: 7% (76/1078) 2024-06-26T07:05:20.3314947Z remote: Compressing objects: 8% (87/1078) 2024-06-26T07:05:20.4114915Z remote: Compressing objects: 9% (98/1078) 2024-06-26T07:05:20.4363250Z remote: Compressing objects: 10% (108/1078) 2024-06-26T07:05:20.4547869Z remote: Compressing objects: 11% (119/1078) 2024-06-26T07:05:20.4658014Z remote: Compressing objects: 12% (130/1078) 2024-06-26T07:05:20.4658744Z remote: Compressing objects: 13% (141/1078) 2024-06-26T07:05:20.4783416Z remote: Compressing objects: 14% (151/1078) 2024-06-26T07:05:20.4784265Z remote: Compressing objects: 15% (162/1078) 2024-06-26T07:05:20.4851151Z remote: Compressing objects: 16% (173/1078) 2024-06-26T07:05:20.4851893Z remote: Compressing objects: 17% (184/1078) 2024-06-26T07:05:20.4852506Z remote: Compressing objects: 18% (195/1078) 2024-06-26T07:05:20.4868418Z remote: Compressing objects: 19% (205/1078) 2024-06-26T07:05:20.4892852Z remote: Compressing objects: 20% (216/1078) 2024-06-26T07:05:20.4910956Z remote: Compressing objects: 21% (227/1078) 2024-06-26T07:05:20.4920315Z remote: Compressing objects: 22% (238/1078) 2024-06-26T07:05:20.4957821Z remote: Compressing objects: 23% (248/1078) 2024-06-26T07:05:20.4965366Z remote: Compressing objects: 24% (259/1078) 2024-06-26T07:05:20.4967377Z remote: Compressing objects: 25% (270/1078) 2024-06-26T07:05:20.4974717Z remote: Compressing objects: 26% (281/1078) 2024-06-26T07:05:20.4977217Z remote: Compressing objects: 27% (292/1078) 2024-06-26T07:05:20.4983878Z remote: Compressing objects: 28% (302/1078) 2024-06-26T07:05:20.4992892Z remote: Compressing objects: 29% (313/1078) 2024-06-26T07:05:20.5003312Z remote: Compressing objects: 30% (324/1078) 2024-06-26T07:05:20.5009652Z remote: Compressing objects: 31% (335/1078) 2024-06-26T07:05:20.5019312Z remote: Compressing objects: 32% (345/1078) 2024-06-26T07:05:20.5023578Z remote: Compressing objects: 33% (356/1078) 2024-06-26T07:05:20.5036416Z remote: Compressing objects: 34% (367/1078) 2024-06-26T07:05:20.5051764Z remote: Compressing objects: 35% (378/1078) 2024-06-26T07:05:20.5074156Z remote: Compressing objects: 36% (389/1078) 2024-06-26T07:05:20.5084433Z remote: Compressing objects: 37% (399/1078) 2024-06-26T07:05:20.5103490Z remote: Compressing objects: 38% (410/1078) 2024-06-26T07:05:20.5120536Z remote: Compressing objects: 39% (421/1078) 2024-06-26T07:05:20.5139906Z remote: Compressing objects: 40% (432/1078) 2024-06-26T07:05:20.5157405Z remote: Compressing objects: 41% (442/1078) 2024-06-26T07:05:20.5168600Z remote: Compressing objects: 42% (453/1078) 2024-06-26T07:05:20.5186373Z remote: Compressing objects: 43% (464/1078) 2024-06-26T07:05:20.5189723Z remote: Compressing objects: 44% (475/1078) 2024-06-26T07:05:20.5191260Z remote: Compressing objects: 45% (486/1078) 2024-06-26T07:05:20.5199823Z remote: Compressing objects: 46% (496/1078) 2024-06-26T07:05:20.5221219Z remote: Compressing objects: 47% (507/1078) 2024-06-26T07:05:20.5227385Z remote: Compressing objects: 48% (518/1078) 2024-06-26T07:05:20.5235354Z remote: Compressing objects: 49% (529/1078) 2024-06-26T07:05:20.5236982Z remote: Compressing objects: 50% (539/1078) 2024-06-26T07:05:20.5247432Z remote: Compressing objects: 51% (550/1078) 2024-06-26T07:05:20.5265531Z remote: Compressing objects: 52% (561/1078) 2024-06-26T07:05:20.5286506Z remote: Compressing objects: 53% (572/1078) 2024-06-26T07:05:20.5298118Z remote: Compressing objects: 54% (583/1078) 2024-06-26T07:05:20.5303938Z remote: Compressing objects: 55% (593/1078) 2024-06-26T07:05:20.5321492Z remote: Compressing objects: 56% (604/1078) 2024-06-26T07:05:20.5331783Z remote: Compressing objects: 57% (615/1078) 2024-06-26T07:05:20.5344151Z remote: Compressing objects: 58% (626/1078) 2024-06-26T07:05:20.5353308Z remote: Compressing objects: 59% (637/1078) 2024-06-26T07:05:20.5366948Z remote: Compressing objects: 60% (647/1078) 2024-06-26T07:05:20.5384982Z remote: Compressing objects: 61% (658/1078) 2024-06-26T07:05:20.5385611Z remote: Compressing objects: 62% (669/1078) 2024-06-26T07:05:20.5389731Z remote: Compressing objects: 63% (680/1078) 2024-06-26T07:05:20.5399031Z remote: Compressing objects: 64% (690/1078) 2024-06-26T07:05:20.5403909Z remote: Compressing objects: 65% (701/1078) 2024-06-26T07:05:20.5407079Z remote: Compressing objects: 66% (712/1078) 2024-06-26T07:05:20.5416887Z remote: Compressing objects: 67% (723/1078) 2024-06-26T07:05:20.5420792Z remote: Compressing objects: 68% (734/1078) 2024-06-26T07:05:20.5424118Z remote: Compressing objects: 69% (744/1078) 2024-06-26T07:05:20.5428491Z remote: Compressing objects: 70% (755/1078) 2024-06-26T07:05:20.5431611Z remote: Compressing objects: 71% (766/1078) 2024-06-26T07:05:20.5432433Z remote: Compressing objects: 72% (777/1078) 2024-06-26T07:05:20.5433048Z remote: Compressing objects: 73% (787/1078) 2024-06-26T07:05:20.5434799Z remote: Compressing objects: 74% (798/1078) 2024-06-26T07:05:20.5435680Z remote: Compressing objects: 75% (809/1078) 2024-06-26T07:05:20.5436304Z remote: Compressing objects: 76% (820/1078) 2024-06-26T07:05:20.5436922Z remote: Compressing objects: 77% (831/1078) 2024-06-26T07:05:20.5442995Z remote: Compressing objects: 78% (841/1078) 2024-06-26T07:05:20.5447005Z remote: Compressing objects: 79% (852/1078) 2024-06-26T07:05:20.5447737Z remote: Compressing objects: 80% (863/1078) 2024-06-26T07:05:20.5448359Z remote: Compressing objects: 81% (874/1078) 2024-06-26T07:05:20.5448956Z remote: Compressing objects: 82% (884/1078) 2024-06-26T07:05:20.5449569Z remote: Compressing objects: 83% (895/1078) 2024-06-26T07:05:20.5451842Z remote: Compressing objects: 84% (906/1078) 2024-06-26T07:05:20.5454003Z remote: Compressing objects: 85% (917/1078) 2024-06-26T07:05:20.5456535Z remote: Compressing objects: 86% (928/1078) 2024-06-26T07:05:20.5458775Z remote: Compressing objects: 87% (938/1078) 2024-06-26T07:05:20.5461169Z remote: Compressing objects: 88% (949/1078) 2024-06-26T07:05:20.5461790Z remote: Compressing objects: 89% (960/1078) 2024-06-26T07:05:20.5462821Z remote: Compressing objects: 90% (971/1078) 2024-06-26T07:05:20.5463736Z remote: Compressing objects: 91% (981/1078) 2024-06-26T07:05:20.5465238Z remote: Compressing objects: 92% (992/1078) 2024-06-26T07:05:20.5471829Z remote: Compressing objects: 93% (1003/1078) 2024-06-26T07:05:20.5480798Z remote: Compressing objects: 94% (1014/1078) 2024-06-26T07:05:20.5481537Z remote: Compressing objects: 95% (1025/1078) 2024-06-26T07:05:20.5482253Z remote: Compressing objects: 96% (1035/1078) 2024-06-26T07:05:20.5482866Z remote: Compressing objects: 97% (1046/1078) 2024-06-26T07:05:20.5483483Z remote: Compressing objects: 98% (1057/1078) 2024-06-26T07:05:20.5484090Z remote: Compressing objects: 99% (1068/1078) 2024-06-26T07:05:20.5484716Z remote: Compressing objects: 100% (1078/1078) 2024-06-26T07:05:20.5485367Z remote: Compressing objects: 100% (1078/1078), done. 2024-06-26T07:05:40.5648350Z remote: Total 990225 (delta 2067), reused 1874 (delta 1527), pack-reused 987619 2024-06-26T07:06:05.5911903Z [command]/usr/bin/git rev-parse --verify --quiet b8c4c54d347aa776934c60784e35936878ef18dc^{object} 2024-06-26T07:06:05.5929672Z b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:06:05.5932930Z ##[endgroup] 2024-06-26T07:06:05.5933479Z ##[group]Determining the checkout info 2024-06-26T07:06:05.5935551Z ##[endgroup] 2024-06-26T07:06:05.5936116Z ##[group]Checking out the ref 2024-06-26T07:06:05.5937279Z [command]/usr/bin/git checkout --quiet --force b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:06:06.8205079Z ##[endgroup] 2024-06-26T07:06:06.8205860Z ##[group]Setting up auth for fetching submodules 2024-06-26T07:06:06.8209957Z [command]/usr/bin/git config --global http.https://github.com/.extraheader AUTHORIZATION: basic *** 2024-06-26T07:06:06.8267668Z [command]/usr/bin/git config --global --unset-all url.https://github.com/.insteadOf 2024-06-26T07:06:06.8293247Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf git@github.com: 2024-06-26T07:06:06.8317868Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf org-21003710@github.com: 2024-06-26T07:06:06.8339578Z ##[endgroup] 2024-06-26T07:06:06.8340454Z ##[group]Fetching submodules 2024-06-26T07:06:06.8344207Z [command]/usr/bin/git submodule sync --recursive 2024-06-26T07:06:06.8557518Z [command]/usr/bin/git -c protocol.version=2 submodule update --init --force --recursive 2024-06-26T07:06:06.8761396Z Submodule 'android/libs/fbjni' (https://github.com/facebookincubator/fbjni.git) registered for path 'android/libs/fbjni' 2024-06-26T07:06:06.8762864Z Submodule 'third_party/NNPACK_deps/FP16' (https://github.com/Maratyszcza/FP16.git) registered for path 'third_party/FP16' 2024-06-26T07:06:06.8764587Z Submodule 'third_party/NNPACK_deps/FXdiv' (https://github.com/Maratyszcza/FXdiv.git) registered for path 'third_party/FXdiv' 2024-06-26T07:06:06.8766047Z Submodule 'third_party/NNPACK' (https://github.com/Maratyszcza/NNPACK.git) registered for path 'third_party/NNPACK' 2024-06-26T07:06:06.8768154Z Submodule 'third_party/VulkanMemoryAllocator' (https://github.com/GPUOpen-LibrariesAndSDKs/VulkanMemoryAllocator.git) registered for path 'third_party/VulkanMemoryAllocator' 2024-06-26T07:06:06.8770147Z Submodule 'third_party/XNNPACK' (https://github.com/google/XNNPACK.git) registered for path 'third_party/XNNPACK' 2024-06-26T07:06:06.8771790Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/benchmark' 2024-06-26T07:06:06.8773880Z Submodule 'third_party/cpp-httplib' (https://github.com/yhirose/cpp-httplib.git) registered for path 'third_party/cpp-httplib' 2024-06-26T07:06:06.8776134Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo.git) registered for path 'third_party/cpuinfo' 2024-06-26T07:06:06.8778422Z Submodule 'third_party/cudnn_frontend' (https://github.com/NVIDIA/cudnn-frontend.git) registered for path 'third_party/cudnn_frontend' 2024-06-26T07:06:06.8781090Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/cutlass' 2024-06-26T07:06:06.8783562Z Submodule 'third_party/eigen' (https://gitlab.com/libeigen/eigen.git) registered for path 'third_party/eigen' 2024-06-26T07:06:06.8786031Z Submodule 'third_party/fbgemm' (https://github.com/pytorch/fbgemm) registered for path 'third_party/fbgemm' 2024-06-26T07:06:06.8788560Z Submodule 'third_party/flatbuffers' (https://github.com/google/flatbuffers.git) registered for path 'third_party/flatbuffers' 2024-06-26T07:06:06.8790952Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/fmt' 2024-06-26T07:06:06.8793474Z Submodule 'third_party/foxi' (https://github.com/houseroad/foxi.git) registered for path 'third_party/foxi' 2024-06-26T07:06:06.8796338Z Submodule 'third_party/gemmlowp/gemmlowp' (https://github.com/google/gemmlowp.git) registered for path 'third_party/gemmlowp/gemmlowp' 2024-06-26T07:06:06.8798980Z Submodule 'third_party/gloo' (https://github.com/facebookincubator/gloo) registered for path 'third_party/gloo' 2024-06-26T07:06:06.8801697Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/googletest' 2024-06-26T07:06:06.8804408Z Submodule 'third_party/ideep' (https://github.com/intel/ideep) registered for path 'third_party/ideep' 2024-06-26T07:06:06.8807407Z Submodule 'third_party/ittapi' (https://github.com/intel/ittapi.git) registered for path 'third_party/ittapi' 2024-06-26T07:06:06.8810389Z Submodule 'third_party/kineto' (https://github.com/pytorch/kineto) registered for path 'third_party/kineto' 2024-06-26T07:06:06.8813652Z Submodule 'third_party/mimalloc' (https://github.com/microsoft/mimalloc.git) registered for path 'third_party/mimalloc' 2024-06-26T07:06:06.8817058Z Submodule 'third_party/nccl/nccl' (https://github.com/NVIDIA/nccl) registered for path 'third_party/nccl/nccl' 2024-06-26T07:06:06.8820522Z Submodule 'third_party/nlohmann' (https://github.com/nlohmann/json.git) registered for path 'third_party/nlohmann' 2024-06-26T07:06:06.8824034Z Submodule 'third_party/onnx' (https://github.com/onnx/onnx.git) registered for path 'third_party/onnx' 2024-06-26T07:06:06.8827598Z Submodule 'third_party/opentelemetry-cpp' (https://github.com/open-telemetry/opentelemetry-cpp.git) registered for path 'third_party/opentelemetry-cpp' 2024-06-26T07:06:06.8830708Z Submodule 'third_party/pocketfft' (https://github.com/mreineck/pocketfft) registered for path 'third_party/pocketfft' 2024-06-26T07:06:06.8834225Z Submodule 'third_party/protobuf' (https://github.com/protocolbuffers/protobuf.git) registered for path 'third_party/protobuf' 2024-06-26T07:06:06.8837661Z Submodule 'third_party/NNPACK_deps/psimd' (https://github.com/Maratyszcza/psimd.git) registered for path 'third_party/psimd' 2024-06-26T07:06:06.8841438Z Submodule 'third_party/NNPACK_deps/pthreadpool' (https://github.com/Maratyszcza/pthreadpool.git) registered for path 'third_party/pthreadpool' 2024-06-26T07:06:06.8844855Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/pybind11' 2024-06-26T07:06:06.8848558Z Submodule 'third_party/python-peachpy' (https://github.com/malfet/PeachPy.git) registered for path 'third_party/python-peachpy' 2024-06-26T07:06:06.8852139Z Submodule 'third_party/sleef' (https://github.com/shibatch/sleef) registered for path 'third_party/sleef' 2024-06-26T07:06:06.8856337Z Submodule 'third_party/tensorpipe' (https://github.com/pytorch/tensorpipe.git) registered for path 'third_party/tensorpipe' 2024-06-26T07:06:06.8876834Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/android/libs/fbjni'... 2024-06-26T07:06:07.1837046Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FP16'... 2024-06-26T07:06:07.3298634Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FXdiv'... 2024-06-26T07:06:07.5236099Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/NNPACK'... 2024-06-26T07:06:07.7878665Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/VulkanMemoryAllocator'... 2024-06-26T07:06:09.8354734Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/XNNPACK'... 2024-06-26T07:06:19.7502687Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/benchmark'... 2024-06-26T07:06:20.1272008Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpp-httplib'... 2024-06-26T07:06:20.5804241Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpuinfo'... 2024-06-26T07:06:21.2082012Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cudnn_frontend'... 2024-06-26T07:06:22.3664499Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cutlass'... 2024-06-26T07:06:24.0382186Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/eigen'... 2024-06-26T07:06:29.9453424Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm'... 2024-06-26T07:06:31.2991735Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/flatbuffers'... 2024-06-26T07:06:32.9757319Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fmt'... 2024-06-26T07:06:34.2465818Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/foxi'... 2024-06-26T07:06:34.4580586Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gemmlowp/gemmlowp'... 2024-06-26T07:06:34.8292513Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gloo'... 2024-06-26T07:06:35.1405183Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/googletest'... 2024-06-26T07:06:36.1548637Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep'... 2024-06-26T07:06:36.4859757Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ittapi'... 2024-06-26T07:06:36.7130536Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto'... 2024-06-26T07:06:38.2229458Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/mimalloc'... 2024-06-26T07:06:38.9275252Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nccl/nccl'... 2024-06-26T07:06:39.6411342Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nlohmann'... 2024-06-26T07:06:45.3753217Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx'... 2024-06-26T07:06:47.6909828Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp'... 2024-06-26T07:06:53.2517115Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pocketfft'... 2024-06-26T07:06:53.4560759Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf'... 2024-06-26T07:07:01.7694566Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/psimd'... 2024-06-26T07:07:01.9271607Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pthreadpool'... 2024-06-26T07:07:02.1460996Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pybind11'... 2024-06-26T07:07:03.1183125Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/python-peachpy'... 2024-06-26T07:07:03.3719765Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/sleef'... 2024-06-26T07:07:04.9343357Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe'... 2024-06-26T07:07:05.3711668Z Submodule path 'android/libs/fbjni': checked out '7e1e1fe3858c63c251c637ae41a20de425dde96f' 2024-06-26T07:07:05.3796424Z Submodule path 'third_party/FP16': checked out '4dfe081cf6bcd15db339cf2680b9281b8451eeb3' 2024-06-26T07:07:05.3855561Z Submodule path 'third_party/FXdiv': checked out 'b408327ac2a15ec3e43352421954f5b1967701d1' 2024-06-26T07:07:05.4038179Z Submodule path 'third_party/NNPACK': checked out 'c07e3a0400713d546e0dea2d5466dd22ea389c73' 2024-06-26T07:07:05.4346854Z Submodule path 'third_party/VulkanMemoryAllocator': checked out 'a6bfc237255a6bac1513f7c1ebde6d8aed6b5191' 2024-06-26T07:07:06.2134775Z Submodule path 'third_party/XNNPACK': checked out 'fcbf55af6cf28a4627bcd1f703ab7ad843f0f3a2' 2024-06-26T07:07:06.2312983Z Submodule path 'third_party/benchmark': checked out '0d98dba29d66e93259db7daa53a9327df767a415' 2024-06-26T07:07:06.2655754Z Submodule path 'third_party/cpp-httplib': checked out '3b6597bba913d51161383657829b7e644e59c006' 2024-06-26T07:07:06.3504190Z Submodule path 'third_party/cpuinfo': checked out '3c8b1533ac03dd6531ab6e7b9245d488f13a82a5' 2024-06-26T07:07:06.3773297Z Submodule path 'third_party/cudnn_frontend': checked out 'aa3abd4bc689d6412979c7f55f9cd132848c9c6a' 2024-06-26T07:07:06.8055248Z Submodule path 'third_party/cutlass': checked out 'bbe579a9e3beb6ea6626d9227ec32d0dae119a49' 2024-06-26T07:07:07.0200213Z Submodule path 'third_party/eigen': checked out '3147391d946bb4b6c68edd901f2add6ac1f31f8c' 2024-06-26T07:07:07.0836300Z Submodule path 'third_party/fbgemm': checked out 'dbc3157bf256f1339b3fa1fef2be89ac4078be0e' 2024-06-26T07:07:07.0849682Z Submodule 'third_party/asmjit' (https://github.com/asmjit/asmjit.git) registered for path 'third_party/fbgemm/third_party/asmjit' 2024-06-26T07:07:07.0852612Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo) registered for path 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T07:07:07.0854126Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/fbgemm/third_party/cutlass' 2024-06-26T07:07:07.0855927Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/fbgemm/third_party/googletest' 2024-06-26T07:07:07.0858621Z Submodule 'third_party/hipify_torch' (https://github.com/ROCmSoftwarePlatform/hipify_torch.git) registered for path 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T07:07:07.0877221Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/asmjit'... 2024-06-26T07:07:08.1033850Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cpuinfo'... 2024-06-26T07:07:08.6533337Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cutlass'... 2024-06-26T07:07:10.3640459Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/googletest'... 2024-06-26T07:07:11.3585317Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/hipify_torch'... 2024-06-26T07:07:11.6666976Z Submodule path 'third_party/fbgemm/third_party/asmjit': checked out 'd3fbf7c9bc7c1d1365a94a45614b91c5a3706b81' 2024-06-26T07:07:11.7504608Z Submodule path 'third_party/fbgemm/third_party/cpuinfo': checked out 'ed8b86a253800bafdb7b25c5c399f91bff9cb1f3' 2024-06-26T07:07:12.0924447Z Submodule path 'third_party/fbgemm/third_party/cutlass': checked out 'fc9ebc645b63f3a6bc80aaefde5c063fb72110d6' 2024-06-26T07:07:12.1474658Z Submodule path 'third_party/fbgemm/third_party/googletest': checked out 'cbf019de22c8dd37b2108da35b2748fd702d1796' 2024-06-26T07:07:12.1573215Z Submodule path 'third_party/fbgemm/third_party/hipify_torch': checked out '23f53b025b466d8ec3c45d52290d3442f7fbe6b1' 2024-06-26T07:07:12.2498282Z Submodule path 'third_party/flatbuffers': checked out '01834de25e4bf3975a9a00e816292b1ad0fe184b' 2024-06-26T07:07:12.2783178Z Submodule path 'third_party/fmt': checked out 'e69e5f977d458f2650bb346dadf2ad30c5320281' 2024-06-26T07:07:12.2850220Z Submodule path 'third_party/foxi': checked out 'c278588e34e535f0bb8f00df3880d26928038cad' 2024-06-26T07:07:12.3158896Z Submodule path 'third_party/gemmlowp/gemmlowp': checked out '3fb5c176c17c765a3492cd2f0321b0dab712f350' 2024-06-26T07:07:12.3358415Z Submodule path 'third_party/gloo': checked out '5354032ea08eadd7fc4456477f7f7c6308818509' 2024-06-26T07:07:12.3724124Z Submodule path 'third_party/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2024-06-26T07:07:12.3818898Z Submodule path 'third_party/ideep': checked out '55ca0191687aaf19aca5cdb7881c791e3bea442b' 2024-06-26T07:07:12.3829343Z Submodule 'mkl-dnn' (https://github.com/intel/mkl-dnn.git) registered for path 'third_party/ideep/mkl-dnn' 2024-06-26T07:07:12.3844147Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep/mkl-dnn'... 2024-06-26T07:07:24.6528217Z Submodule path 'third_party/ideep/mkl-dnn': checked out '1137e04ec0b5251ca2b4400a4fd3c667ce843d67' 2024-06-26T07:07:24.6668552Z Submodule path 'third_party/ittapi': checked out '5b8a7d7422611c3a0d799fb5fc5dd4abfae35b42' 2024-06-26T07:07:24.7449665Z Submodule path 'third_party/kineto': checked out '8681ff11e1fa54da39023076c5c43eddd87b7a8a' 2024-06-26T07:07:24.7461640Z Submodule 'libkineto/third_party/dynolog' (https://github.com/facebookincubator/dynolog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T07:07:24.7463940Z Submodule 'libkineto/third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T07:07:24.7465680Z Submodule 'libkineto/third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T07:07:24.7482947Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog'... 2024-06-26T07:07:25.2770869Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/fmt'... 2024-06-26T07:07:26.4934422Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/googletest'... 2024-06-26T07:07:27.5448319Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog': checked out '7d04a0053a845370ae06ce317a22a48e9edcc74e' 2024-06-26T07:07:27.5458655Z Submodule 'third_party/DCGM' (https://github.com/NVIDIA/DCGM.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T07:07:27.5460505Z Submodule 'third_party/cpr' (https://github.com/libcpr/cpr.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T07:07:27.5462683Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T07:07:27.5464445Z Submodule 'third_party/gflags' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T07:07:27.5492341Z Submodule 'third_party/glog' (https://github.com/google/glog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T07:07:27.5494374Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T07:07:27.5496188Z Submodule 'third_party/json' (https://github.com/nlohmann/json.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T07:07:27.5497881Z Submodule 'third_party/pfs' (https://github.com/dtrugman/pfs.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T07:07:27.5499493Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'... 2024-06-26T07:07:28.6138984Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'... 2024-06-26T07:07:28.9682716Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'... 2024-06-26T07:07:30.1475095Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'... 2024-06-26T07:07:30.4348994Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/glog'... 2024-06-26T07:07:30.9089906Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'... 2024-06-26T07:07:31.9081310Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/json'... 2024-06-26T07:07:37.4135414Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'... 2024-06-26T07:07:37.8172978Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM': checked out 'ffde4e54bc7249a6039a5e6b45b395141e1217f9' 2024-06-26T07:07:37.8307546Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr': checked out '871ed52d350214a034f6ef8a3b8f51c5ce1bd400' 2024-06-26T07:07:37.8594427Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt': checked out 'cd4af11efc9c622896a3e4cb599fa28668ca3d05' 2024-06-26T07:07:37.8688099Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags': checked out 'e171aa2d15ed9eb17054558e0b3a6a413bb01067' 2024-06-26T07:07:37.8698206Z Submodule 'doc' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T07:07:37.8713920Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'... 2024-06-26T07:07:38.3120839Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc': checked out '8411df715cf522606e3b1aca386ddfc0b63d34b4' 2024-06-26T07:07:38.3257785Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog': checked out 'b33e3bad4c46c8a6345525fd822af355e5ef9446' 2024-06-26T07:07:38.3589149Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest': checked out '58d77fa8070e8cec2dc1ed015d66b454c8d78850' 2024-06-26T07:07:38.4400090Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json': checked out '4f8fba14066156b73f1189a2b8bd568bde5284c5' 2024-06-26T07:07:38.4516472Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs': checked out 'f68a2fa8ea36c783bdd760371411fcb495aa3150' 2024-06-26T07:07:38.4804990Z Submodule path 'third_party/kineto/libkineto/third_party/fmt': checked out 'a33701196adfad74917046096bf5a2aa0ab0bb50' 2024-06-26T07:07:38.5289905Z Submodule path 'third_party/kineto/libkineto/third_party/googletest': checked out '7aca84427f224eeed3144123d5230d5871e93347' 2024-06-26T07:07:38.5589708Z Submodule path 'third_party/mimalloc': checked out 'b66e3214d8a104669c2ec05ae91ebc26a8f5ab78' 2024-06-26T07:07:38.5799889Z Submodule path 'third_party/nccl/nccl': checked out '48bb7fec7953112ff37499a272317f6663f8f600' 2024-06-26T07:07:38.6657896Z Submodule path 'third_party/nlohmann': checked out '87cda1d6646592ac5866dc703c8e1839046a6806' 2024-06-26T07:07:38.9375603Z Submodule path 'third_party/onnx': checked out '990217f043af7222348ca8f0301e17fa7b841781' 2024-06-26T07:07:38.9401907Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/onnx/third_party/benchmark' 2024-06-26T07:07:38.9403830Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/onnx/third_party/pybind11' 2024-06-26T07:07:38.9420782Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx/third_party/benchmark'... 2024-06-26T07:07:39.3923409Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx/third_party/pybind11'... 2024-06-26T07:07:40.4429361Z Submodule path 'third_party/onnx/third_party/benchmark': checked out '2dd015dfef425c866d9a43f2c67d8b52d709acb6' 2024-06-26T07:07:40.4713889Z Submodule path 'third_party/onnx/third_party/pybind11': checked out '5b0a6fc2017fcc176545afe3e09c9f9885283242' 2024-06-26T07:07:40.5239683Z Submodule path 'third_party/opentelemetry-cpp': checked out 'a799f4aed9c94b765dcdaabaeab7d5e7e2310878' 2024-06-26T07:07:40.5256846Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark) registered for path 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T07:07:40.5264455Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T07:07:40.5266539Z Submodule 'third_party/ms-gsl' (https://github.com/microsoft/GSL) registered for path 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T07:07:40.5268402Z Submodule 'third_party/nlohmann-json' (https://github.com/nlohmann/json) registered for path 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T07:07:40.5270531Z Submodule 'third_party/opentelemetry-proto' (https://github.com/open-telemetry/opentelemetry-proto) registered for path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T07:07:40.5272513Z Submodule 'third_party/opentracing-cpp' (https://github.com/opentracing/opentracing-cpp.git) registered for path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T07:07:40.5274344Z Submodule 'third_party/prometheus-cpp' (https://github.com/jupp0r/prometheus-cpp) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T07:07:40.5275889Z Submodule 'tools/vcpkg' (https://github.com/Microsoft/vcpkg) registered for path 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T07:07:40.5289365Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/benchmark'... 2024-06-26T07:07:40.9274900Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/googletest'... 2024-06-26T07:07:41.8713208Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/ms-gsl'... 2024-06-26T07:07:42.1740376Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/nlohmann-json'... 2024-06-26T07:07:48.1964799Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentelemetry-proto'... 2024-06-26T07:07:48.5113014Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentracing-cpp'... 2024-06-26T07:07:48.6827467Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp'... 2024-06-26T07:07:49.0216959Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/tools/vcpkg'... 2024-06-26T07:07:56.5446430Z Submodule path 'third_party/opentelemetry-cpp/third_party/benchmark': checked out 'd572f4777349d43653b21d6c2fc63020ab326db2' 2024-06-26T07:07:56.5779483Z Submodule path 'third_party/opentelemetry-cpp/third_party/googletest': checked out 'b796f7d44681514f58a683a3a71ff17c94edb0c1' 2024-06-26T07:07:56.5906290Z Submodule path 'third_party/opentelemetry-cpp/third_party/ms-gsl': checked out '6f4529395c5b7c2d661812257cd6780c67e54afa' 2024-06-26T07:07:56.6742420Z Submodule path 'third_party/opentelemetry-cpp/third_party/nlohmann-json': checked out 'bc889afb4c5bf1c0d8ee29ef35eaaf4c8bef8a5d' 2024-06-26T07:07:56.6839332Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto': checked out '4ca4f0335c63cda7ab31ea7ed70d6553aee14dce' 2024-06-26T07:07:56.6945604Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp': checked out '06b57f48ded1fa3bdd3d4346f6ef29e40e08eaf5' 2024-06-26T07:07:56.7060203Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp': checked out 'c9ffcdda9086ffd9e1283ea7a0276d831f3c8a8d' 2024-06-26T07:07:56.7070871Z Submodule 'civetweb' (https://github.com/civetweb/civetweb.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T07:07:56.7072957Z Submodule 'googletest' (https://github.com/google/googletest.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T07:07:56.7090087Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'... 2024-06-26T07:07:58.4082335Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'... 2024-06-26T07:07:59.5432287Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb': checked out 'eefb26f82b233268fc98577d265352720d477ba4' 2024-06-26T07:07:59.5804032Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2024-06-26T07:07:59.9416477Z Submodule path 'third_party/opentelemetry-cpp/tools/vcpkg': checked out '8eb57355a4ffb410a2e94c07b4dca2dffbee8e50' 2024-06-26T07:07:59.9507655Z Submodule path 'third_party/pocketfft': checked out '9d3ab05a7fffbc71a492bc6a17be034e83e8f0fe' 2024-06-26T07:08:00.1679581Z Submodule path 'third_party/protobuf': checked out 'd1eca4e4b421cd2997495c4b4e65cea6be4e9b8a' 2024-06-26T07:08:00.1694582Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/protobuf/third_party/benchmark' 2024-06-26T07:08:00.1696318Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/protobuf/third_party/googletest' 2024-06-26T07:08:00.1714407Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/benchmark'... 2024-06-26T07:08:00.5570568Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/googletest'... 2024-06-26T07:08:01.5694417Z Submodule path 'third_party/protobuf/third_party/benchmark': checked out '5b7683f49e1e9223cf9927b24f6fd3d6bd82e3f8' 2024-06-26T07:08:01.6319895Z Submodule path 'third_party/protobuf/third_party/googletest': checked out '5ec7f0c4a113e2f18ac2c6cc7df51ad6afc24081' 2024-06-26T07:08:01.6380572Z Submodule path 'third_party/psimd': checked out '072586a71b55b7f8c584153d223e95687148a900' 2024-06-26T07:08:01.6469088Z Submodule path 'third_party/pthreadpool': checked out '4fe0e1e183925bf8cfa6aae24237e724a96479b8' 2024-06-26T07:08:01.6748914Z Submodule path 'third_party/pybind11': checked out '3e9dfa2866941655c56877882565e7577de6fc7b' 2024-06-26T07:08:01.6970312Z Submodule path 'third_party/python-peachpy': checked out 'f45429b087dd7d5bc78bb40dc7cf06425c252d67' 2024-06-26T07:08:01.7301307Z Submodule path 'third_party/sleef': checked out '60e76d2bce17d278b439d9da17177c8f957a9e9b' 2024-06-26T07:08:01.7505403Z Submodule path 'third_party/tensorpipe': checked out '52791a2fd214b2a9dc5759d36725909c1daa7f2e' 2024-06-26T07:08:01.7516990Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/tensorpipe/third_party/googletest' 2024-06-26T07:08:01.7518886Z Submodule 'third_party/libnop' (https://github.com/google/libnop.git) registered for path 'third_party/tensorpipe/third_party/libnop' 2024-06-26T07:08:01.7520716Z Submodule 'third_party/libuv' (https://github.com/libuv/libuv.git) registered for path 'third_party/tensorpipe/third_party/libuv' 2024-06-26T07:08:01.7522552Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T07:08:01.7538339Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/googletest'... 2024-06-26T07:08:02.6913620Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libnop'... 2024-06-26T07:08:02.9421117Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libuv'... 2024-06-26T07:08:03.9642307Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11'... 2024-06-26T07:08:05.0446692Z Submodule path 'third_party/tensorpipe/third_party/googletest': checked out 'aee0f9d9b5b87796ee8a0ab26b7587ec30e8858e' 2024-06-26T07:08:05.0560130Z Submodule path 'third_party/tensorpipe/third_party/libnop': checked out '910b55815be16109f04f4180e9adee14fb4ce281' 2024-06-26T07:08:05.1130650Z Submodule path 'third_party/tensorpipe/third_party/libuv': checked out '1dff88e5161cba5c59276d2070d2e304e4dcb242' 2024-06-26T07:08:05.1361123Z Submodule path 'third_party/tensorpipe/third_party/pybind11': checked out 'a23996fce38ff6ccfbcdc09f1e63f2c4be5ea2ef' 2024-06-26T07:08:05.1372293Z Submodule 'tools/clang' (https://github.com/wjakob/clang-cindex-python3) registered for path 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T07:08:05.1388152Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11/tools/clang'... 2024-06-26T07:08:05.3252181Z Submodule path 'third_party/tensorpipe/third_party/pybind11/tools/clang': checked out '6a00cbc4a9b8e68b71caf7f774b3f9c753ae84d5' 2024-06-26T07:08:05.3275178Z [command]/usr/bin/git submodule foreach --recursive git config --local gc.auto 0 2024-06-26T07:08:05.3474655Z Entering 'android/libs/fbjni' 2024-06-26T07:08:05.3499812Z Entering 'third_party/FP16' 2024-06-26T07:08:05.3525207Z Entering 'third_party/FXdiv' 2024-06-26T07:08:05.3550320Z Entering 'third_party/NNPACK' 2024-06-26T07:08:05.3577854Z Entering 'third_party/VulkanMemoryAllocator' 2024-06-26T07:08:05.3605611Z Entering 'third_party/XNNPACK' 2024-06-26T07:08:05.3643032Z Entering 'third_party/benchmark' 2024-06-26T07:08:05.3669720Z Entering 'third_party/cpp-httplib' 2024-06-26T07:08:05.3697092Z Entering 'third_party/cpuinfo' 2024-06-26T07:08:05.3723009Z Entering 'third_party/cudnn_frontend' 2024-06-26T07:08:05.3748802Z Entering 'third_party/cutlass' 2024-06-26T07:08:05.3778818Z Entering 'third_party/eigen' 2024-06-26T07:08:05.3805692Z Entering 'third_party/fbgemm' 2024-06-26T07:08:05.3834294Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-06-26T07:08:05.3861226Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T07:08:05.3890413Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-06-26T07:08:05.3920457Z Entering 'third_party/fbgemm/third_party/googletest' 2024-06-26T07:08:05.3945619Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T07:08:05.3973877Z Entering 'third_party/flatbuffers' 2024-06-26T07:08:05.4003572Z Entering 'third_party/fmt' 2024-06-26T07:08:05.4029804Z Entering 'third_party/foxi' 2024-06-26T07:08:05.4057145Z Entering 'third_party/gemmlowp/gemmlowp' 2024-06-26T07:08:05.4084518Z Entering 'third_party/gloo' 2024-06-26T07:08:05.4113372Z Entering 'third_party/googletest' 2024-06-26T07:08:05.4138365Z Entering 'third_party/ideep' 2024-06-26T07:08:05.4164040Z Entering 'third_party/ideep/mkl-dnn' 2024-06-26T07:08:05.4198103Z Entering 'third_party/ittapi' 2024-06-26T07:08:05.4225634Z Entering 'third_party/kineto' 2024-06-26T07:08:05.4251797Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T07:08:05.4280005Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T07:08:05.4309911Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T07:08:05.4337058Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T07:08:05.4366038Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T07:08:05.4394310Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T07:08:05.4421218Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T07:08:05.4448486Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T07:08:05.4477012Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T07:08:05.4505922Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T07:08:05.4534969Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T07:08:05.4563234Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T07:08:05.4590658Z Entering 'third_party/mimalloc' 2024-06-26T07:08:05.4618663Z Entering 'third_party/nccl/nccl' 2024-06-26T07:08:05.4649265Z Entering 'third_party/nlohmann' 2024-06-26T07:08:05.4676192Z Entering 'third_party/onnx' 2024-06-26T07:08:05.4715216Z Entering 'third_party/onnx/third_party/benchmark' 2024-06-26T07:08:05.4743187Z Entering 'third_party/onnx/third_party/pybind11' 2024-06-26T07:08:05.4769371Z Entering 'third_party/opentelemetry-cpp' 2024-06-26T07:08:05.4800047Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T07:08:05.4826175Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T07:08:05.4853086Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T07:08:05.4881404Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T07:08:05.4908232Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T07:08:05.4934212Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T07:08:05.4962435Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T07:08:05.4988614Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T07:08:05.5018485Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T07:08:05.5048385Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T07:08:05.5089858Z Entering 'third_party/pocketfft' 2024-06-26T07:08:05.5119750Z Entering 'third_party/protobuf' 2024-06-26T07:08:05.5151306Z Entering 'third_party/protobuf/third_party/benchmark' 2024-06-26T07:08:05.5178219Z Entering 'third_party/protobuf/third_party/googletest' 2024-06-26T07:08:05.5208234Z Entering 'third_party/psimd' 2024-06-26T07:08:05.5234104Z Entering 'third_party/pthreadpool' 2024-06-26T07:08:05.5259036Z Entering 'third_party/pybind11' 2024-06-26T07:08:05.5287940Z Entering 'third_party/python-peachpy' 2024-06-26T07:08:05.5314649Z Entering 'third_party/sleef' 2024-06-26T07:08:05.5344158Z Entering 'third_party/tensorpipe' 2024-06-26T07:08:05.5373512Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-06-26T07:08:05.5399361Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-06-26T07:08:05.5426038Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-06-26T07:08:05.5453490Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T07:08:05.5479414Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T07:08:05.5521493Z ##[endgroup] 2024-06-26T07:08:05.5523928Z ##[group]Persisting credentials for submodules 2024-06-26T07:08:05.5527546Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'url\.https\:\/\/github\.com\/\.insteadOf' && git config --local --unset-all 'url.https://github.com/.insteadOf' || :" 2024-06-26T07:08:05.5741040Z Entering 'android/libs/fbjni' 2024-06-26T07:08:05.5773164Z Entering 'third_party/FP16' 2024-06-26T07:08:05.5809495Z Entering 'third_party/FXdiv' 2024-06-26T07:08:05.5845528Z Entering 'third_party/NNPACK' 2024-06-26T07:08:05.5880933Z Entering 'third_party/VulkanMemoryAllocator' 2024-06-26T07:08:05.5916333Z Entering 'third_party/XNNPACK' 2024-06-26T07:08:05.5958988Z Entering 'third_party/benchmark' 2024-06-26T07:08:05.5995102Z Entering 'third_party/cpp-httplib' 2024-06-26T07:08:05.6029780Z Entering 'third_party/cpuinfo' 2024-06-26T07:08:05.6066592Z Entering 'third_party/cudnn_frontend' 2024-06-26T07:08:05.6101587Z Entering 'third_party/cutlass' 2024-06-26T07:08:05.6141986Z Entering 'third_party/eigen' 2024-06-26T07:08:05.6176421Z Entering 'third_party/fbgemm' 2024-06-26T07:08:05.6210774Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-06-26T07:08:05.6246039Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T07:08:05.6280237Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-06-26T07:08:05.6320209Z Entering 'third_party/fbgemm/third_party/googletest' 2024-06-26T07:08:05.6352678Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T07:08:05.6389327Z Entering 'third_party/flatbuffers' 2024-06-26T07:08:05.6425026Z Entering 'third_party/fmt' 2024-06-26T07:08:05.6459957Z Entering 'third_party/foxi' 2024-06-26T07:08:05.6496818Z Entering 'third_party/gemmlowp/gemmlowp' 2024-06-26T07:08:05.6533855Z Entering 'third_party/gloo' 2024-06-26T07:08:05.6569736Z Entering 'third_party/googletest' 2024-06-26T07:08:05.6606495Z Entering 'third_party/ideep' 2024-06-26T07:08:05.6639788Z Entering 'third_party/ideep/mkl-dnn' 2024-06-26T07:08:05.6679953Z Entering 'third_party/ittapi' 2024-06-26T07:08:05.6715619Z Entering 'third_party/kineto' 2024-06-26T07:08:05.6750589Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T07:08:05.6786051Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T07:08:05.6821925Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T07:08:05.6856130Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T07:08:05.6887438Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T07:08:05.6921569Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T07:08:05.6956642Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T07:08:05.6991096Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T07:08:05.7025549Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T07:08:05.7059519Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T07:08:05.7095803Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T07:08:05.7130253Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T07:08:05.7166532Z Entering 'third_party/mimalloc' 2024-06-26T07:08:05.7202235Z Entering 'third_party/nccl/nccl' 2024-06-26T07:08:05.7236830Z Entering 'third_party/nlohmann' 2024-06-26T07:08:05.7272464Z Entering 'third_party/onnx' 2024-06-26T07:08:05.7318337Z Entering 'third_party/onnx/third_party/benchmark' 2024-06-26T07:08:05.7353926Z Entering 'third_party/onnx/third_party/pybind11' 2024-06-26T07:08:05.7389159Z Entering 'third_party/opentelemetry-cpp' 2024-06-26T07:08:05.7426036Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T07:08:05.7460409Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T07:08:05.7495052Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T07:08:05.7529388Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T07:08:05.7566132Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T07:08:05.7599859Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T07:08:05.7634218Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T07:08:05.7667338Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T07:08:05.7702036Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T07:08:05.7736871Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T07:08:05.7787172Z Entering 'third_party/pocketfft' 2024-06-26T07:08:05.7821420Z Entering 'third_party/protobuf' 2024-06-26T07:08:05.7856175Z Entering 'third_party/protobuf/third_party/benchmark' 2024-06-26T07:08:05.7890305Z Entering 'third_party/protobuf/third_party/googletest' 2024-06-26T07:08:05.7927363Z Entering 'third_party/psimd' 2024-06-26T07:08:05.7963685Z Entering 'third_party/pthreadpool' 2024-06-26T07:08:05.7997371Z Entering 'third_party/pybind11' 2024-06-26T07:08:05.8032264Z Entering 'third_party/python-peachpy' 2024-06-26T07:08:05.8066686Z Entering 'third_party/sleef' 2024-06-26T07:08:05.8102391Z Entering 'third_party/tensorpipe' 2024-06-26T07:08:05.8136661Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-06-26T07:08:05.8169506Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-06-26T07:08:05.8203853Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-06-26T07:08:05.8238990Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T07:08:05.8272239Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T07:08:05.8319278Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local 'http.https://github.com/.extraheader' 'AUTHORIZATION: basic ***' && git config --local --show-origin --name-only --get-regexp remote.origin.url" 2024-06-26T07:08:05.8532328Z Entering 'android/libs/fbjni' 2024-06-26T07:08:05.8563432Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/android/libs/fbjni/config remote.origin.url 2024-06-26T07:08:05.8578054Z Entering 'third_party/FP16' 2024-06-26T07:08:05.8610267Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FP16/config remote.origin.url 2024-06-26T07:08:05.8624560Z Entering 'third_party/FXdiv' 2024-06-26T07:08:05.8656652Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FXdiv/config remote.origin.url 2024-06-26T07:08:05.8669285Z Entering 'third_party/NNPACK' 2024-06-26T07:08:05.8700739Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK/config remote.origin.url 2024-06-26T07:08:05.8713001Z Entering 'third_party/VulkanMemoryAllocator' 2024-06-26T07:08:05.8744059Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/VulkanMemoryAllocator/config remote.origin.url 2024-06-26T07:08:05.8758128Z Entering 'third_party/XNNPACK' 2024-06-26T07:08:05.8788756Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/XNNPACK/config remote.origin.url 2024-06-26T07:08:05.8810164Z Entering 'third_party/benchmark' 2024-06-26T07:08:05.8841744Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/benchmark/config remote.origin.url 2024-06-26T07:08:05.8855534Z Entering 'third_party/cpp-httplib' 2024-06-26T07:08:05.8888637Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpp-httplib/config remote.origin.url 2024-06-26T07:08:05.8902878Z Entering 'third_party/cpuinfo' 2024-06-26T07:08:05.8933726Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpuinfo/config remote.origin.url 2024-06-26T07:08:05.8946951Z Entering 'third_party/cudnn_frontend' 2024-06-26T07:08:05.8977889Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cudnn_frontend/config remote.origin.url 2024-06-26T07:08:05.8990164Z Entering 'third_party/cutlass' 2024-06-26T07:08:05.9022641Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cutlass/config remote.origin.url 2024-06-26T07:08:05.9041086Z Entering 'third_party/eigen' 2024-06-26T07:08:05.9073144Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/eigen/config remote.origin.url 2024-06-26T07:08:05.9088817Z Entering 'third_party/fbgemm' 2024-06-26T07:08:05.9121830Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/config remote.origin.url 2024-06-26T07:08:05.9135196Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-06-26T07:08:05.9166819Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/asmjit/config remote.origin.url 2024-06-26T07:08:05.9178673Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T07:08:05.9212026Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cpuinfo/config remote.origin.url 2024-06-26T07:08:05.9225805Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-06-26T07:08:05.9256173Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cutlass/config remote.origin.url 2024-06-26T07:08:05.9271873Z Entering 'third_party/fbgemm/third_party/googletest' 2024-06-26T07:08:05.9303263Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/googletest/config remote.origin.url 2024-06-26T07:08:05.9316228Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T07:08:05.9349122Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/hipify_torch/config remote.origin.url 2024-06-26T07:08:05.9363813Z Entering 'third_party/flatbuffers' 2024-06-26T07:08:05.9396337Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/flatbuffers/config remote.origin.url 2024-06-26T07:08:05.9412335Z Entering 'third_party/fmt' 2024-06-26T07:08:05.9444752Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fmt/config remote.origin.url 2024-06-26T07:08:05.9456312Z Entering 'third_party/foxi' 2024-06-26T07:08:05.9488460Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/foxi/config remote.origin.url 2024-06-26T07:08:05.9501185Z Entering 'third_party/gemmlowp/gemmlowp' 2024-06-26T07:08:05.9532715Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gemmlowp/gemmlowp/config remote.origin.url 2024-06-26T07:08:05.9546318Z Entering 'third_party/gloo' 2024-06-26T07:08:05.9579036Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gloo/config remote.origin.url 2024-06-26T07:08:05.9592262Z Entering 'third_party/googletest' 2024-06-26T07:08:05.9623897Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/googletest/config remote.origin.url 2024-06-26T07:08:05.9637576Z Entering 'third_party/ideep' 2024-06-26T07:08:05.9667811Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/config remote.origin.url 2024-06-26T07:08:05.9679260Z Entering 'third_party/ideep/mkl-dnn' 2024-06-26T07:08:05.9709923Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/modules/mkl-dnn/config remote.origin.url 2024-06-26T07:08:05.9728152Z Entering 'third_party/ittapi' 2024-06-26T07:08:05.9763706Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ittapi/config remote.origin.url 2024-06-26T07:08:05.9776710Z Entering 'third_party/kineto' 2024-06-26T07:08:05.9810268Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/config remote.origin.url 2024-06-26T07:08:05.9822988Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T07:08:05.9853614Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/config remote.origin.url 2024-06-26T07:08:05.9867526Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T07:08:05.9899166Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/DCGM/config remote.origin.url 2024-06-26T07:08:05.9913954Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T07:08:05.9947121Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/cpr/config remote.origin.url 2024-06-26T07:08:05.9960393Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T07:08:05.9991940Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/fmt/config remote.origin.url 2024-06-26T07:08:06.0004995Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T07:08:06.0037536Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/config remote.origin.url 2024-06-26T07:08:06.0049557Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T07:08:06.0082253Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/modules/doc/config remote.origin.url 2024-06-26T07:08:06.0097154Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T07:08:06.0128205Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/glog/config remote.origin.url 2024-06-26T07:08:06.0139714Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T07:08:06.0170646Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/googletest/config remote.origin.url 2024-06-26T07:08:06.0183896Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T07:08:06.0216920Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/json/config remote.origin.url 2024-06-26T07:08:06.0230574Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T07:08:06.0261992Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/pfs/config remote.origin.url 2024-06-26T07:08:06.0276801Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T07:08:06.0308294Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/fmt/config remote.origin.url 2024-06-26T07:08:06.0321761Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T07:08:06.0354547Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/googletest/config remote.origin.url 2024-06-26T07:08:06.0368991Z Entering 'third_party/mimalloc' 2024-06-26T07:08:06.0401158Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/mimalloc/config remote.origin.url 2024-06-26T07:08:06.0415415Z Entering 'third_party/nccl/nccl' 2024-06-26T07:08:06.0447825Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nccl/nccl/config remote.origin.url 2024-06-26T07:08:06.0459792Z Entering 'third_party/nlohmann' 2024-06-26T07:08:06.0490062Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nlohmann/config remote.origin.url 2024-06-26T07:08:06.0503490Z Entering 'third_party/onnx' 2024-06-26T07:08:06.0535248Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/config remote.origin.url 2024-06-26T07:08:06.0560105Z Entering 'third_party/onnx/third_party/benchmark' 2024-06-26T07:08:06.0594393Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/benchmark/config remote.origin.url 2024-06-26T07:08:06.0608868Z Entering 'third_party/onnx/third_party/pybind11' 2024-06-26T07:08:06.0640622Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/pybind11/config remote.origin.url 2024-06-26T07:08:06.0655224Z Entering 'third_party/opentelemetry-cpp' 2024-06-26T07:08:06.0689401Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/config remote.origin.url 2024-06-26T07:08:06.0705113Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T07:08:06.0736545Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/benchmark/config remote.origin.url 2024-06-26T07:08:06.0748792Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T07:08:06.0781281Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/googletest/config remote.origin.url 2024-06-26T07:08:06.0793208Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T07:08:06.0823937Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/ms-gsl/config remote.origin.url 2024-06-26T07:08:06.0837509Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T07:08:06.0869354Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/nlohmann-json/config remote.origin.url 2024-06-26T07:08:06.0882744Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T07:08:06.0916277Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentelemetry-proto/config remote.origin.url 2024-06-26T07:08:06.0928111Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T07:08:06.0961651Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentracing-cpp/config remote.origin.url 2024-06-26T07:08:06.0973870Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T07:08:06.1006774Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/config remote.origin.url 2024-06-26T07:08:06.1019461Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T07:08:06.1052600Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/civetweb/config remote.origin.url 2024-06-26T07:08:06.1066585Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T07:08:06.1097482Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/googletest/config remote.origin.url 2024-06-26T07:08:06.1111361Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T07:08:06.1145474Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/tools/vcpkg/config remote.origin.url 2024-06-26T07:08:06.1173438Z Entering 'third_party/pocketfft' 2024-06-26T07:08:06.1206814Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pocketfft/config remote.origin.url 2024-06-26T07:08:06.1218771Z Entering 'third_party/protobuf' 2024-06-26T07:08:06.1251139Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/config remote.origin.url 2024-06-26T07:08:06.1267451Z Entering 'third_party/protobuf/third_party/benchmark' 2024-06-26T07:08:06.1298188Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/benchmark/config remote.origin.url 2024-06-26T07:08:06.1310590Z Entering 'third_party/protobuf/third_party/googletest' 2024-06-26T07:08:06.1342322Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/googletest/config remote.origin.url 2024-06-26T07:08:06.1356993Z Entering 'third_party/psimd' 2024-06-26T07:08:06.1389438Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/psimd/config remote.origin.url 2024-06-26T07:08:06.1403591Z Entering 'third_party/pthreadpool' 2024-06-26T07:08:06.1436312Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/pthreadpool/config remote.origin.url 2024-06-26T07:08:06.1449015Z Entering 'third_party/pybind11' 2024-06-26T07:08:06.1482258Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pybind11/config remote.origin.url 2024-06-26T07:08:06.1495324Z Entering 'third_party/python-peachpy' 2024-06-26T07:08:06.1526474Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/python-peachpy/config remote.origin.url 2024-06-26T07:08:06.1538362Z Entering 'third_party/sleef' 2024-06-26T07:08:06.1570090Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/sleef/config remote.origin.url 2024-06-26T07:08:06.1585287Z Entering 'third_party/tensorpipe' 2024-06-26T07:08:06.1617076Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/config remote.origin.url 2024-06-26T07:08:06.1629515Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-06-26T07:08:06.1661079Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/googletest/config remote.origin.url 2024-06-26T07:08:06.1674141Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-06-26T07:08:06.1705222Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libnop/config remote.origin.url 2024-06-26T07:08:06.1717992Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-06-26T07:08:06.1749870Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libuv/config remote.origin.url 2024-06-26T07:08:06.1762577Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T07:08:06.1795619Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/config remote.origin.url 2024-06-26T07:08:06.1807660Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T07:08:06.1839211Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/modules/tools/clang/config remote.origin.url 2024-06-26T07:08:06.2679537Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'git@github.com:' 2024-06-26T07:08:06.2888576Z Entering 'android/libs/fbjni' 2024-06-26T07:08:06.2916478Z Entering 'third_party/FP16' 2024-06-26T07:08:06.2943941Z Entering 'third_party/FXdiv' 2024-06-26T07:08:06.2970322Z Entering 'third_party/NNPACK' 2024-06-26T07:08:06.2997906Z Entering 'third_party/VulkanMemoryAllocator' 2024-06-26T07:08:06.3028431Z Entering 'third_party/XNNPACK' 2024-06-26T07:08:06.3066525Z Entering 'third_party/benchmark' 2024-06-26T07:08:06.3095395Z Entering 'third_party/cpp-httplib' 2024-06-26T07:08:06.3124206Z Entering 'third_party/cpuinfo' 2024-06-26T07:08:06.3151705Z Entering 'third_party/cudnn_frontend' 2024-06-26T07:08:06.3178247Z Entering 'third_party/cutlass' 2024-06-26T07:08:06.3212180Z Entering 'third_party/eigen' 2024-06-26T07:08:06.3244208Z Entering 'third_party/fbgemm' 2024-06-26T07:08:06.3270785Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-06-26T07:08:06.3298966Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T07:08:06.3328009Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-06-26T07:08:06.3359966Z Entering 'third_party/fbgemm/third_party/googletest' 2024-06-26T07:08:06.3389061Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T07:08:06.3416142Z Entering 'third_party/flatbuffers' 2024-06-26T07:08:06.3448422Z Entering 'third_party/fmt' 2024-06-26T07:08:06.3476798Z Entering 'third_party/foxi' 2024-06-26T07:08:06.3505282Z Entering 'third_party/gemmlowp/gemmlowp' 2024-06-26T07:08:06.3533902Z Entering 'third_party/gloo' 2024-06-26T07:08:06.3564086Z Entering 'third_party/googletest' 2024-06-26T07:08:06.3592034Z Entering 'third_party/ideep' 2024-06-26T07:08:06.3618340Z Entering 'third_party/ideep/mkl-dnn' 2024-06-26T07:08:06.3651758Z Entering 'third_party/ittapi' 2024-06-26T07:08:06.3679528Z Entering 'third_party/kineto' 2024-06-26T07:08:06.3705586Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T07:08:06.3732683Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T07:08:06.3762092Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T07:08:06.3790483Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T07:08:06.3818298Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T07:08:06.3847102Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T07:08:06.3876565Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T07:08:06.3905414Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T07:08:06.3933406Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T07:08:06.3962846Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T07:08:06.3991864Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T07:08:06.4019727Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T07:08:06.4050215Z Entering 'third_party/mimalloc' 2024-06-26T07:08:06.4080395Z Entering 'third_party/nccl/nccl' 2024-06-26T07:08:06.4108967Z Entering 'third_party/nlohmann' 2024-06-26T07:08:06.4136835Z Entering 'third_party/onnx' 2024-06-26T07:08:06.4178370Z Entering 'third_party/onnx/third_party/benchmark' 2024-06-26T07:08:06.4208503Z Entering 'third_party/onnx/third_party/pybind11' 2024-06-26T07:08:06.4239950Z Entering 'third_party/opentelemetry-cpp' 2024-06-26T07:08:06.4270475Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T07:08:06.4299132Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T07:08:06.4326627Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T07:08:06.4355155Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T07:08:06.4384471Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T07:08:06.4410341Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T07:08:06.4439580Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T07:08:06.4465427Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T07:08:06.4493882Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T07:08:06.4522938Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T07:08:06.4566550Z Entering 'third_party/pocketfft' 2024-06-26T07:08:06.4598688Z Entering 'third_party/protobuf' 2024-06-26T07:08:06.4626939Z Entering 'third_party/protobuf/third_party/benchmark' 2024-06-26T07:08:06.4654542Z Entering 'third_party/protobuf/third_party/googletest' 2024-06-26T07:08:06.4685582Z Entering 'third_party/psimd' 2024-06-26T07:08:06.4714215Z Entering 'third_party/pthreadpool' 2024-06-26T07:08:06.4740653Z Entering 'third_party/pybind11' 2024-06-26T07:08:06.4769642Z Entering 'third_party/python-peachpy' 2024-06-26T07:08:06.4798031Z Entering 'third_party/sleef' 2024-06-26T07:08:06.4827080Z Entering 'third_party/tensorpipe' 2024-06-26T07:08:06.4853595Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-06-26T07:08:06.4882507Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-06-26T07:08:06.4909042Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-06-26T07:08:06.4936635Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T07:08:06.4965133Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T07:08:06.5007482Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'org-21003710@github.com:' 2024-06-26T07:08:06.5212740Z Entering 'android/libs/fbjni' 2024-06-26T07:08:06.5243550Z Entering 'third_party/FP16' 2024-06-26T07:08:06.5273168Z Entering 'third_party/FXdiv' 2024-06-26T07:08:06.5298927Z Entering 'third_party/NNPACK' 2024-06-26T07:08:06.5329578Z Entering 'third_party/VulkanMemoryAllocator' 2024-06-26T07:08:06.5357417Z Entering 'third_party/XNNPACK' 2024-06-26T07:08:06.5395468Z Entering 'third_party/benchmark' 2024-06-26T07:08:06.5422940Z Entering 'third_party/cpp-httplib' 2024-06-26T07:08:06.5449632Z Entering 'third_party/cpuinfo' 2024-06-26T07:08:06.5476466Z Entering 'third_party/cudnn_frontend' 2024-06-26T07:08:06.5504016Z Entering 'third_party/cutlass' 2024-06-26T07:08:06.5533336Z Entering 'third_party/eigen' 2024-06-26T07:08:06.5561104Z Entering 'third_party/fbgemm' 2024-06-26T07:08:06.5589138Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-06-26T07:08:06.5617417Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T07:08:06.5646105Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-06-26T07:08:06.5677966Z Entering 'third_party/fbgemm/third_party/googletest' 2024-06-26T07:08:06.5706401Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T07:08:06.5734309Z Entering 'third_party/flatbuffers' 2024-06-26T07:08:06.5766078Z Entering 'third_party/fmt' 2024-06-26T07:08:06.5793834Z Entering 'third_party/foxi' 2024-06-26T07:08:06.5823696Z Entering 'third_party/gemmlowp/gemmlowp' 2024-06-26T07:08:06.5852699Z Entering 'third_party/gloo' 2024-06-26T07:08:06.5881010Z Entering 'third_party/googletest' 2024-06-26T07:08:06.5907917Z Entering 'third_party/ideep' 2024-06-26T07:08:06.5933984Z Entering 'third_party/ideep/mkl-dnn' 2024-06-26T07:08:06.5967179Z Entering 'third_party/ittapi' 2024-06-26T07:08:06.5993797Z Entering 'third_party/kineto' 2024-06-26T07:08:06.6024580Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T07:08:06.6051516Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T07:08:06.6081814Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T07:08:06.6108078Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T07:08:06.6140764Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T07:08:06.6168298Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T07:08:06.6198015Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T07:08:06.6227072Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T07:08:06.6254053Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T07:08:06.6282838Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T07:08:06.6309569Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T07:08:06.6336350Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T07:08:06.6365090Z Entering 'third_party/mimalloc' 2024-06-26T07:08:06.6392861Z Entering 'third_party/nccl/nccl' 2024-06-26T07:08:06.6423380Z Entering 'third_party/nlohmann' 2024-06-26T07:08:06.6452862Z Entering 'third_party/onnx' 2024-06-26T07:08:06.6491690Z Entering 'third_party/onnx/third_party/benchmark' 2024-06-26T07:08:06.6519517Z Entering 'third_party/onnx/third_party/pybind11' 2024-06-26T07:08:06.6551665Z Entering 'third_party/opentelemetry-cpp' 2024-06-26T07:08:06.6582117Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T07:08:06.6608744Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T07:08:06.6636181Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T07:08:06.6662056Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T07:08:06.6690891Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T07:08:06.6718856Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T07:08:06.6746057Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T07:08:06.6772699Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T07:08:06.6802696Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T07:08:06.6830811Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T07:08:06.6871931Z Entering 'third_party/pocketfft' 2024-06-26T07:08:06.6902286Z Entering 'third_party/protobuf' 2024-06-26T07:08:06.6933294Z Entering 'third_party/protobuf/third_party/benchmark' 2024-06-26T07:08:06.6961908Z Entering 'third_party/protobuf/third_party/googletest' 2024-06-26T07:08:06.6992374Z Entering 'third_party/psimd' 2024-06-26T07:08:06.7019376Z Entering 'third_party/pthreadpool' 2024-06-26T07:08:06.7045591Z Entering 'third_party/pybind11' 2024-06-26T07:08:06.7074269Z Entering 'third_party/python-peachpy' 2024-06-26T07:08:06.7102958Z Entering 'third_party/sleef' 2024-06-26T07:08:06.7127940Z Entering 'third_party/tensorpipe' 2024-06-26T07:08:06.7157830Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-06-26T07:08:06.7186961Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-06-26T07:08:06.7214218Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-06-26T07:08:06.7240557Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T07:08:06.7269426Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T07:08:06.7310368Z ##[endgroup] 2024-06-26T07:08:06.7343974Z [command]/usr/bin/git log -1 --format='%H' 2024-06-26T07:08:06.7366352Z 'b8c4c54d347aa776934c60784e35936878ef18dc' 2024-06-26T07:08:06.7536548Z Prepare all required actions 2024-06-26T07:08:06.7536995Z Getting action download info 2024-06-26T07:08:06.8904934Z ##[group]Run ./.github/actions/setup-linux 2024-06-26T07:08:06.8905353Z env: 2024-06-26T07:08:06.8905631Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:08:06.8905976Z ##[endgroup] 2024-06-26T07:08:06.8963609Z ##[group]Run set -euo pipefail 2024-06-26T07:08:06.8964179Z set -euo pipefail 2024-06-26T07:08:06.8964572Z function get_ec2_metadata() { 2024-06-26T07:08:06.8965103Z  # Pulled from instance metadata endpoint for EC2 2024-06-26T07:08:06.8965978Z  # see https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/instancedata-data-retrieval.html 2024-06-26T07:08:06.8966732Z  category=$1 2024-06-26T07:08:06.8967251Z  # If it is GCP runner (runner name contains gcp), do not run this 2024-06-26T07:08:06.8967880Z  runner_name_str=i-04a4d8372606379d8 2024-06-26T07:08:06.8968367Z  if [[ -f /.inarc ]]; then 2024-06-26T07:08:06.8968852Z  echo "ARC Runner, no info on ec2 metadata" 2024-06-26T07:08:06.8969413Z  elif [[ $runner_name_str == *"gcp"* ]]; then 2024-06-26T07:08:06.8970090Z  echo "Runner is from Google Cloud Platform, No info on ec2 metadata" 2024-06-26T07:08:06.8970688Z  else 2024-06-26T07:08:06.8971179Z  curl -fsSL "http://169.254.169.254/latest/meta-data/${category}" 2024-06-26T07:08:06.8971748Z  fi 2024-06-26T07:08:06.8972033Z } 2024-06-26T07:08:06.8972392Z echo "ami-id: $(get_ec2_metadata ami-id)" 2024-06-26T07:08:06.8972964Z echo "instance-id: $(get_ec2_metadata instance-id)" 2024-06-26T07:08:06.8973606Z echo "instance-type: $(get_ec2_metadata instance-type)" 2024-06-26T07:08:06.8974260Z echo "system info $(uname -a)" 2024-06-26T07:08:06.8982062Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:08:06.8982545Z env: 2024-06-26T07:08:06.8982828Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:08:06.8983173Z ##[endgroup] 2024-06-26T07:08:06.9055098Z ami-id: ami-0ce0c36d7a00b20e2 2024-06-26T07:08:06.9094509Z instance-id: i-04a4d8372606379d8 2024-06-26T07:08:06.9132475Z instance-type: g5.4xlarge 2024-06-26T07:08:06.9139386Z system info Linux ip-10-0-54-186.ec2.internal 4.14.336-257.562.amzn2.x86_64 #1 SMP Sat Feb 24 09:50:35 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux 2024-06-26T07:08:06.9159304Z ##[group]Run echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> $GITHUB_OUTPUT 2024-06-26T07:08:06.9160209Z echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> $GITHUB_OUTPUT 2024-06-26T07:08:06.9168154Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:08:06.9168642Z env: 2024-06-26T07:08:06.9168928Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:08:06.9169276Z ##[endgroup] 2024-06-26T07:08:06.9230347Z ##[group]Run if systemctl is-active --quiet docker; then 2024-06-26T07:08:06.9231158Z if systemctl is-active --quiet docker; then 2024-06-26T07:08:06.9231691Z  echo "Docker daemon is running..."; 2024-06-26T07:08:06.9232133Z else 2024-06-26T07:08:06.9232612Z  echo "Starting docker deamon..." && sudo systemctl start docker; 2024-06-26T07:08:06.9233180Z fi 2024-06-26T07:08:06.9240586Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:08:06.9241087Z env: 2024-06-26T07:08:06.9241366Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:08:06.9241713Z ##[endgroup] 2024-06-26T07:08:06.9282207Z Docker daemon is running... 2024-06-26T07:08:06.9324391Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2024-06-26T07:08:06.9324934Z with: 2024-06-26T07:08:06.9325199Z shell: bash 2024-06-26T07:08:06.9325487Z timeout_minutes: 5 2024-06-26T07:08:06.9325807Z max_attempts: 3 2024-06-26T07:08:06.9326122Z retry_wait_seconds: 30 2024-06-26T07:08:06.9327581Z command: AWS_ACCOUNT_ID=$(aws sts get-caller-identity|grep Account|cut -f4 -d\") aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \ --password-stdin "$AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com" 2024-06-26T07:08:06.9328979Z polling_interval_seconds: 1 2024-06-26T07:08:06.9329352Z warning_on_retry: true 2024-06-26T07:08:06.9329701Z continue_on_error: false 2024-06-26T07:08:06.9330131Z env: 2024-06-26T07:08:06.9330396Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:08:06.9330749Z AWS_RETRY_MODE: standard 2024-06-26T07:08:06.9331093Z AWS_MAX_ATTEMPTS: 5 2024-06-26T07:08:06.9331426Z AWS_DEFAULT_REGION: us-east-1 2024-06-26T07:08:06.9331798Z ##[endgroup] 2024-06-26T07:08:07.7882630Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-06-26T07:08:07.7883419Z Configure a credential helper to remove this warning. See 2024-06-26T07:08:07.7885816Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-06-26T07:08:07.7886540Z 2024-06-26T07:08:07.7886729Z Login Succeeded 2024-06-26T07:08:07.9820310Z Command completed after 1 attempt(s). 2024-06-26T07:08:07.9863011Z ##[group]Run env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-06-26T07:08:07.9863750Z env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-06-26T07:08:07.9864471Z env | grep '^CI' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-06-26T07:08:07.9872292Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:08:07.9872780Z env: 2024-06-26T07:08:07.9873062Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:08:07.9873409Z ##[endgroup] 2024-06-26T07:08:07.9934576Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2024-06-26T07:08:07.9935380Z # ignore expansion of "docker ps -q" since it could be empty 2024-06-26T07:08:07.9935959Z # shellcheck disable=SC2046 2024-06-26T07:08:07.9936411Z docker stop $(docker ps -q) || true 2024-06-26T07:08:07.9936894Z # Prune all of the docker images 2024-06-26T07:08:07.9937338Z docker system prune -af 2024-06-26T07:08:07.9944814Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:08:07.9945334Z env: 2024-06-26T07:08:07.9945648Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:08:07.9945990Z ##[endgroup] 2024-06-26T07:08:08.0193031Z "docker stop" requires at least 1 argument. 2024-06-26T07:08:08.0193762Z See 'docker stop --help'. 2024-06-26T07:08:08.0194085Z 2024-06-26T07:08:08.0194377Z Usage: docker stop [OPTIONS] CONTAINER [CONTAINER...] 2024-06-26T07:08:08.0194861Z 2024-06-26T07:08:08.0195072Z Stop one or more running containers 2024-06-26T07:08:08.0345065Z Total reclaimed space: 0B 2024-06-26T07:08:08.0374432Z ##[group]Run set +e 2024-06-26T07:08:08.0374792Z set +e 2024-06-26T07:08:08.0375093Z set -x 2024-06-26T07:08:08.0375388Z  2024-06-26T07:08:08.0375711Z PT_DOMAIN=download.pytorch.org 2024-06-26T07:08:08.0376498Z # TODO: Flaky access to download.pytorch.org https://github.com/pytorch/pytorch/issues/100400, 2024-06-26T07:08:08.0377542Z # cleaning this up once the issue is fixed. There are more than one resolved IP here, the last 2024-06-26T07:08:08.0378281Z # one is returned at random 2024-06-26T07:08:08.0378823Z RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" | tail -n1) 2024-06-26T07:08:08.0379328Z  2024-06-26T07:08:08.0379645Z if [ -z "${RESOLVED_IP}" ]; then 2024-06-26T07:08:08.0380575Z  echo "Couldn't resolve ${PT_DOMAIN}, retrying with Google DNS..." 2024-06-26T07:08:08.0381338Z  RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" @8.8.8.8 | tail -n1) 2024-06-26T07:08:08.0381877Z  2024-06-26T07:08:08.0382205Z  if [ -z "${RESOLVED_IP}" ]; then 2024-06-26T07:08:08.0382753Z  echo "Couldn't resolve ${PT_DOMAIN}, exiting..." 2024-06-26T07:08:08.0383255Z  exit 1 2024-06-26T07:08:08.0383562Z  fi 2024-06-26T07:08:08.0383853Z fi 2024-06-26T07:08:08.0384278Z  2024-06-26T07:08:08.0384636Z if grep -r "${PT_DOMAIN}" /etc/hosts; then 2024-06-26T07:08:08.0385144Z  # Clean up any old records first 2024-06-26T07:08:08.0385695Z  sudo sed -i "/${PT_DOMAIN}/d" /etc/hosts 2024-06-26T07:08:08.0386142Z fi 2024-06-26T07:08:08.0386410Z  2024-06-26T07:08:08.0386944Z echo "${RESOLVED_IP} ${PT_DOMAIN}" | sudo tee -a /etc/hosts 2024-06-26T07:08:08.0387485Z cat /etc/hosts 2024-06-26T07:08:08.0395110Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:08:08.0395647Z env: 2024-06-26T07:08:08.0395935Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:08:08.0396285Z ##[endgroup] 2024-06-26T07:08:08.0418503Z + PT_DOMAIN=download.pytorch.org 2024-06-26T07:08:08.0422724Z ++ dig -4 +short download.pytorch.org 2024-06-26T07:08:08.0423171Z ++ tail -n1 2024-06-26T07:08:08.0509676Z + RESOLVED_IP=18.67.76.42 2024-06-26T07:08:08.0510130Z + '[' -z 18.67.76.42 ']' 2024-06-26T07:08:08.0510723Z + grep -r download.pytorch.org /etc/hosts 2024-06-26T07:08:08.0515933Z 18.160.10.36 download.pytorch.org 2024-06-26T07:08:08.0516488Z + sudo sed -i /download.pytorch.org/d /etc/hosts 2024-06-26T07:08:08.0617611Z + echo '18.67.76.42 download.pytorch.org' 2024-06-26T07:08:08.0618334Z + sudo tee -a /etc/hosts 2024-06-26T07:08:08.0973990Z 18.67.76.42 download.pytorch.org 2024-06-26T07:08:08.0986904Z + cat /etc/hosts 2024-06-26T07:08:08.0991575Z 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 2024-06-26T07:08:08.1004027Z ::1 localhost6 localhost6.localdomain6 2024-06-26T07:08:08.1004524Z 18.67.76.42 download.pytorch.org 2024-06-26T07:08:08.1207685Z ##[group]Run pytorch/test-infra/.github/actions/calculate-docker-image@main 2024-06-26T07:08:08.1208276Z with: 2024-06-26T07:08:08.1209332Z docker-image-name: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:08:08.1210530Z docker-build-dir: .ci/docker 2024-06-26T07:08:08.1210902Z working-directory: . 2024-06-26T07:08:08.1211362Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:08:08.1211877Z force-push: false 2024-06-26T07:08:08.1212172Z env: 2024-06-26T07:08:08.1212440Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:08:08.1212790Z ##[endgroup] 2024-06-26T07:08:08.1229937Z ##[group]Run set -ex 2024-06-26T07:08:08.1230311Z set -ex 2024-06-26T07:08:08.1230775Z  2024-06-26T07:08:08.1231328Z # If the docker build directory or the build script doesn't exist, the action will 2024-06-26T07:08:08.1232278Z # gracefully return the docker image name as it is. Pulling docker image in Linux 2024-06-26T07:08:08.1233061Z # job could then download the pre-built image as usual 2024-06-26T07:08:08.1233787Z if [[ ! -d "${DOCKER_BUILD_DIR}" ]] || [[ ! -f "${DOCKER_BUILD_DIR}/build.sh" ]]; then 2024-06-26T07:08:08.1234454Z  echo "skip=true" >> "${GITHUB_OUTPUT}" 2024-06-26T07:08:08.1235081Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2024-06-26T07:08:08.1235639Z  2024-06-26T07:08:08.1236196Z  echo "There is no Docker build script in ${REPO_NAME} repo, skipping..." 2024-06-26T07:08:08.1236817Z  exit 0 2024-06-26T07:08:08.1237140Z else 2024-06-26T07:08:08.1237513Z  echo "skip=false" >> "${GITHUB_OUTPUT}" 2024-06-26T07:08:08.1237957Z fi 2024-06-26T07:08:08.1238238Z  2024-06-26T07:08:08.1238712Z if [[ "${DOCKER_IMAGE_NAME}" == *"${DOCKER_REGISTRY}/${REPO_NAME}"* ]]; then 2024-06-26T07:08:08.1239550Z  # The docker image name already includes the ECR prefix and tag, so we can just 2024-06-26T07:08:08.1240310Z  # use it as it is, but first let's extract the tag 2024-06-26T07:08:08.1241011Z  DOCKER_TAG=$(echo "${DOCKER_IMAGE_NAME}" | awk -F '[:,]' '{print $2}') 2024-06-26T07:08:08.1241738Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-06-26T07:08:08.1242435Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2024-06-26T07:08:08.1242988Z else 2024-06-26T07:08:08.1243428Z  DOCKER_TAG=$(git rev-parse HEAD:"${DOCKER_BUILD_DIR}") 2024-06-26T07:08:08.1244212Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-06-26T07:08:08.1245100Z  echo "docker-image=${DOCKER_REGISTRY}/${REPO_NAME}/${DOCKER_IMAGE_NAME}:${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-06-26T07:08:08.1245889Z fi 2024-06-26T07:08:08.1253489Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:08:08.1254098Z env: 2024-06-26T07:08:08.1254377Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:08:08.1254722Z REPO_NAME: pytorch 2024-06-26T07:08:08.1255821Z DOCKER_IMAGE_NAME: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:08:08.1257008Z DOCKER_BUILD_DIR: .ci/docker 2024-06-26T07:08:08.1257497Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:08:08.1258003Z ##[endgroup] 2024-06-26T07:08:08.1277612Z + [[ ! -d .ci/docker ]] 2024-06-26T07:08:08.1278029Z + [[ ! -f .ci/docker/build.sh ]] 2024-06-26T07:08:08.1278428Z + echo skip=false 2024-06-26T07:08:08.1280379Z + [[ 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 == *\3\0\8\5\3\5\3\8\5\1\1\4\.\d\k\r\.\e\c\r\.\u\s\-\e\a\s\t\-\1\.\a\m\a\z\o\n\a\w\s\.\c\o\m\/\p\y\t\o\r\c\h* ]] 2024-06-26T07:08:08.1283910Z ++ echo 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:08:08.1285718Z ++ awk -F '[:,]' '{print $2}' 2024-06-26T07:08:08.1289784Z + DOCKER_TAG=91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:08:08.1290636Z + echo docker-tag=91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:08:08.1292077Z + echo docker-image=308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:08:08.1319051Z ##[group]Run set +e 2024-06-26T07:08:08.1319436Z set +e 2024-06-26T07:08:08.1319743Z set -x 2024-06-26T07:08:08.1320034Z  2024-06-26T07:08:08.1320322Z login() { 2024-06-26T07:08:08.1320980Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2024-06-26T07:08:08.1321693Z } 2024-06-26T07:08:08.1321968Z  2024-06-26T07:08:08.1322251Z retry () { 2024-06-26T07:08:08.1322646Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2024-06-26T07:08:08.1323099Z } 2024-06-26T07:08:08.1323373Z  2024-06-26T07:08:08.1323697Z retry login "${DOCKER_REGISTRY}" 2024-06-26T07:08:08.1324110Z  2024-06-26T07:08:08.1324574Z # Check if image already exists, if it does then skip building it 2024-06-26T07:08:08.1325272Z if docker manifest inspect "${DOCKER_IMAGE}"; then 2024-06-26T07:08:08.1325831Z  exit 0 2024-06-26T07:08:08.1326139Z fi 2024-06-26T07:08:08.1326421Z  2024-06-26T07:08:08.1326923Z # NB: This part requires a full checkout. Otherwise, the merge base will 2024-06-26T07:08:08.1327747Z # be empty. The default action would be to continue rebuild the image 2024-06-26T07:08:08.1328483Z if [[ "$BASE_REVISION" = "$(git rev-parse HEAD)" ]]; then 2024-06-26T07:08:08.1329150Z  # if we're on the base branch then use the parent commit 2024-06-26T07:08:08.1329742Z  MERGE_BASE=$(git rev-parse HEAD~) 2024-06-26T07:08:08.1330174Z else 2024-06-26T07:08:08.1330644Z  # otherwise we're on a PR, so use the most recent base commit 2024-06-26T07:08:08.1331316Z  MERGE_BASE=$(git merge-base HEAD "$BASE_REVISION") 2024-06-26T07:08:08.1331822Z fi 2024-06-26T07:08:08.1332116Z  2024-06-26T07:08:08.1332441Z if [[ -z "${MERGE_BASE}" ]]; then 2024-06-26T07:08:08.1332937Z  echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2024-06-26T07:08:08.1333497Z  2024-06-26T07:08:08.1334278Z  echo "Finding merge base only works with full checkout, please set fetch-depth to 0, continuing ..." 2024-06-26T07:08:08.1335034Z  exit 0 2024-06-26T07:08:08.1335336Z fi 2024-06-26T07:08:08.1335622Z  2024-06-26T07:08:08.1336060Z if ! git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}"; then 2024-06-26T07:08:08.1337018Z  echo "Directory '${DOCKER_BUILD_DIR}' not found in commit $MERGE_BASE, you should rebase onto a more recent commit" 2024-06-26T07:08:08.1337802Z  exit 1 2024-06-26T07:08:08.1338110Z fi 2024-06-26T07:08:08.1338400Z  2024-06-26T07:08:08.1338883Z PREVIOUS_DOCKER_TAG=$(git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}") 2024-06-26T07:08:08.1339809Z # If no image exists but the hash is the same as the previous hash then we should error out here 2024-06-26T07:08:08.1340908Z if [[ "${PREVIOUS_DOCKER_TAG}" == "${DOCKER_TAG}" ]]; then 2024-06-26T07:08:08.1341865Z  echo "WARNING: Something has gone wrong and the previous image isn't available for the merge-base of your branch" 2024-06-26T07:08:08.1342932Z  echo " Will re-build docker image to store in local cache, TTS may be longer" 2024-06-26T07:08:08.1343678Z fi 2024-06-26T07:08:08.1343960Z  2024-06-26T07:08:08.1344324Z echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2024-06-26T07:08:08.1352096Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:08:08.1352594Z env: 2024-06-26T07:08:08.1352874Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:08:08.1353242Z DOCKER_BUILD_DIR: .ci/docker 2024-06-26T07:08:08.1353707Z BASE_REVISION: b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:08:08.1354953Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:08:08.1356220Z DOCKER_TAG: 91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:08:08.1356809Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:08:08.1357319Z ##[endgroup] 2024-06-26T07:08:08.1376604Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:08:08.1377268Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:08:08.1378276Z + aws ecr get-login-password --region us-east-1 2024-06-26T07:08:08.1379236Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:08:08.5383696Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-06-26T07:08:08.5384558Z Configure a credential helper to remove this warning. See 2024-06-26T07:08:08.5385505Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-06-26T07:08:08.5386142Z 2024-06-26T07:08:08.5386277Z Login Succeeded 2024-06-26T07:08:08.5395335Z + docker manifest inspect 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:08:08.7387755Z { 2024-06-26T07:08:08.7388189Z "schemaVersion": 2, 2024-06-26T07:08:08.7388940Z "mediaType": "application/vnd.docker.distribution.manifest.v2+json", 2024-06-26T07:08:08.7389537Z "config": { 2024-06-26T07:08:08.7389990Z "mediaType": "application/vnd.docker.container.image.v1+json", 2024-06-26T07:08:08.7390532Z "size": 49644, 2024-06-26T07:08:08.7391092Z "digest": "sha256:e7d48c2cbd3d9b87b03afe1b0df8f064acd2699045900da46dadf7d133480a59" 2024-06-26T07:08:08.7391768Z }, 2024-06-26T07:08:08.7392106Z "layers": [ 2024-06-26T07:08:08.7392502Z { 2024-06-26T07:08:08.7393084Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7393826Z "size": 28584317, 2024-06-26T07:08:08.7394560Z "digest": "sha256:63e9bbe323274e77e58d77c6ab6802d247458f784222fbb07a2556d6ec74ee05" 2024-06-26T07:08:08.7395660Z }, 2024-06-26T07:08:08.7396014Z { 2024-06-26T07:08:08.7396587Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7397330Z "size": 7944771, 2024-06-26T07:08:08.7398149Z "digest": "sha256:cfb3d849840ee60cee7b02bad68c1fc3c15928ebcd88f327754766b670578ed6" 2024-06-26T07:08:08.7398778Z }, 2024-06-26T07:08:08.7399024Z { 2024-06-26T07:08:08.7399456Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7400078Z "size": 57593718, 2024-06-26T07:08:08.7400856Z "digest": "sha256:968831e596a6288f0fed9b8612ee4ee8e75511037c4305058805492c5162e481" 2024-06-26T07:08:08.7401450Z }, 2024-06-26T07:08:08.7401706Z { 2024-06-26T07:08:08.7402137Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7402690Z "size": 187, 2024-06-26T07:08:08.7403225Z "digest": "sha256:ea310eb267ca1cab61b6b16f566cd28bfd59a741395a011f5e76716e15ba57c6" 2024-06-26T07:08:08.7403846Z }, 2024-06-26T07:08:08.7404109Z { 2024-06-26T07:08:08.7404540Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7405084Z "size": 6885, 2024-06-26T07:08:08.7405636Z "digest": "sha256:3af11d09e9cd1eb9c379f0a4071231e5a5642eb728b4b33bcb76be291f3c9488" 2024-06-26T07:08:08.7406290Z }, 2024-06-26T07:08:08.7406711Z { 2024-06-26T07:08:08.7407147Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7407695Z "size": 1361380219, 2024-06-26T07:08:08.7408253Z "digest": "sha256:ebfec18059b91e56882881ac34754f917861edb5f732c395d2a1a851bbd6db46" 2024-06-26T07:08:08.7408847Z }, 2024-06-26T07:08:08.7409099Z { 2024-06-26T07:08:08.7409532Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7410076Z "size": 62686, 2024-06-26T07:08:08.7410612Z "digest": "sha256:533b4aebf16914c763b7b0de3ce657590c6f979045e9fdf1f816adaf68d8a4d3" 2024-06-26T07:08:08.7411223Z }, 2024-06-26T07:08:08.7411476Z { 2024-06-26T07:08:08.7411901Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7412448Z "size": 1685, 2024-06-26T07:08:08.7412983Z "digest": "sha256:9dd75d06a0910f28cb1e484b8808724e5a6ee570ecb8fc04631368f546b39ed9" 2024-06-26T07:08:08.7413591Z }, 2024-06-26T07:08:08.7413925Z { 2024-06-26T07:08:08.7414360Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7414905Z "size": 1523, 2024-06-26T07:08:08.7415439Z "digest": "sha256:30bfca4dd3492d60ed8035b0eeb1229897041140db117f5663465a551e25851d" 2024-06-26T07:08:08.7416082Z }, 2024-06-26T07:08:08.7416338Z { 2024-06-26T07:08:08.7416768Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7417323Z "size": 2608186849, 2024-06-26T07:08:08.7417884Z "digest": "sha256:1b57ce94cad9a5097d99b8d6f7bcd51df5a162fc3c5f5686b689b76993724bc8" 2024-06-26T07:08:08.7418502Z }, 2024-06-26T07:08:08.7418753Z { 2024-06-26T07:08:08.7419175Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7419728Z "size": 86631, 2024-06-26T07:08:08.7420483Z "digest": "sha256:9ee6bdb31195dd42fd98147a75d540efe0c5708e0ecda866a0bca060084fddab" 2024-06-26T07:08:08.7421096Z }, 2024-06-26T07:08:08.7421341Z { 2024-06-26T07:08:08.7421778Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7422323Z "size": 1823, 2024-06-26T07:08:08.7422864Z "digest": "sha256:ee3624ae37279188ae1b8234c84dd6ef73e08e0d47f5bcdae71b074e76bc9d3d" 2024-06-26T07:08:08.7423465Z }, 2024-06-26T07:08:08.7423722Z { 2024-06-26T07:08:08.7424153Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7424693Z "size": 245740686, 2024-06-26T07:08:08.7425248Z "digest": "sha256:7813623661508ecef7ea82adbc87a31b2365eab7e0f40f452599dc093335b55c" 2024-06-26T07:08:08.7425848Z }, 2024-06-26T07:08:08.7426106Z { 2024-06-26T07:08:08.7426530Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7427154Z "size": 546, 2024-06-26T07:08:08.7427710Z "digest": "sha256:9b08a0698a8acd9f6f4aca5fcf77b3dfaafdb9acc3b1773ac8bd0ab95f4f559a" 2024-06-26T07:08:08.7428336Z }, 2024-06-26T07:08:08.7428582Z { 2024-06-26T07:08:08.7429014Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7429568Z "size": 1287, 2024-06-26T07:08:08.7430122Z "digest": "sha256:7b7b1bdcbcc9c46ac60fba4fc2466d5c42f5759493cde3bb98c6570d4d4a0fe0" 2024-06-26T07:08:08.7430738Z }, 2024-06-26T07:08:08.7430987Z { 2024-06-26T07:08:08.7431423Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7431958Z "size": 485, 2024-06-26T07:08:08.7432496Z "digest": "sha256:2d176cec9db3304b5a5c4b22717eb363aceec7c6683832ab07fa653bddd056d2" 2024-06-26T07:08:08.7433107Z }, 2024-06-26T07:08:08.7433362Z { 2024-06-26T07:08:08.7433785Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7434333Z "size": 91711722, 2024-06-26T07:08:08.7434894Z "digest": "sha256:cba4658f6a4a3027448a41ab8d0140caf0c7f88e52064c13fddaaa96f57f4c17" 2024-06-26T07:08:08.7435501Z }, 2024-06-26T07:08:08.7435791Z { 2024-06-26T07:08:08.7436229Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7436778Z "size": 3236, 2024-06-26T07:08:08.7437368Z "digest": "sha256:23b5517a7953f885dd26596ad67bd40bf66f7e0de0fd085073129d4797318e93" 2024-06-26T07:08:08.7437973Z }, 2024-06-26T07:08:08.7438232Z { 2024-06-26T07:08:08.7438672Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7439212Z "size": 1906, 2024-06-26T07:08:08.7439740Z "digest": "sha256:df0096280bdbf2bda44279839121c44b92b452c811944842490e27a100d43afa" 2024-06-26T07:08:08.7440340Z }, 2024-06-26T07:08:08.7440595Z { 2024-06-26T07:08:08.7441019Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7441573Z "size": 701, 2024-06-26T07:08:08.7442110Z "digest": "sha256:7454066a3d8e8de9a95e09dcf7ebb617a9211152c7a93c14602c3eaa0bfada5e" 2024-06-26T07:08:08.7442725Z }, 2024-06-26T07:08:08.7442970Z { 2024-06-26T07:08:08.7443401Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7443950Z "size": 2800676235, 2024-06-26T07:08:08.7444511Z "digest": "sha256:6d6f4e10cdaab6e61a20c168c32ce33442679a2904440ee70e5f73bdc7a333f9" 2024-06-26T07:08:08.7445120Z }, 2024-06-26T07:08:08.7445376Z { 2024-06-26T07:08:08.7445823Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7446393Z "size": 381, 2024-06-26T07:08:08.7446929Z "digest": "sha256:cbb2f8884ff2f08c1506a4239f24e669b4d2570b17a6d565dbf4d6ff09967ffe" 2024-06-26T07:08:08.7447537Z }, 2024-06-26T07:08:08.7447788Z { 2024-06-26T07:08:08.7448210Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7448757Z "size": 11884, 2024-06-26T07:08:08.7449313Z "digest": "sha256:ff99b372daac9bbf6d7ed53bf3a13d861e5481fa413509dd07b4eca89d33eb5a" 2024-06-26T07:08:08.7449936Z }, 2024-06-26T07:08:08.7450182Z { 2024-06-26T07:08:08.7450611Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7451155Z "size": 803, 2024-06-26T07:08:08.7451703Z "digest": "sha256:be64fa49eeafe614dfde751dedd7943dacee92c63a14b96f70883921f48ea2ad" 2024-06-26T07:08:08.7452327Z }, 2024-06-26T07:08:08.7452578Z { 2024-06-26T07:08:08.7453007Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7453545Z "size": 106, 2024-06-26T07:08:08.7454156Z "digest": "sha256:13e86101f8af83d45e0a882b25c508c99f1039ea52ec791d0ca0b15075780ba8" 2024-06-26T07:08:08.7454754Z }, 2024-06-26T07:08:08.7455004Z { 2024-06-26T07:08:08.7455427Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7455975Z "size": 504, 2024-06-26T07:08:08.7456504Z "digest": "sha256:6593f0a66be9f407a072fcf27a5e1610f17f11c05d9e321d81f87f2ace448183" 2024-06-26T07:08:08.7457162Z }, 2024-06-26T07:08:08.7457415Z { 2024-06-26T07:08:08.7457845Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7458404Z "size": 121477253, 2024-06-26T07:08:08.7458961Z "digest": "sha256:1b30bd2fbb84b8b9c9a808813226c10322406609ac5f28906d35f32f63e7e533" 2024-06-26T07:08:08.7459570Z }, 2024-06-26T07:08:08.7459824Z { 2024-06-26T07:08:08.7460372Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7460912Z "size": 109, 2024-06-26T07:08:08.7461444Z "digest": "sha256:2192e794bf7429b6bb2d1c0b847843ec7d6ccd461378755d404877e2ea22367b" 2024-06-26T07:08:08.7462047Z }, 2024-06-26T07:08:08.7462293Z { 2024-06-26T07:08:08.7462728Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7463277Z "size": 490, 2024-06-26T07:08:08.7463799Z "digest": "sha256:028168f5e8d46269269d44a154749a92eb9e4db95194c9c7952d75fdf9bf9724" 2024-06-26T07:08:08.7464382Z }, 2024-06-26T07:08:08.7464644Z { 2024-06-26T07:08:08.7465073Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7465621Z "size": 297, 2024-06-26T07:08:08.7466209Z "digest": "sha256:4b2cffe5f919caab7ddc734454591fb4be35295fba19b08792cff995b2f276a4" 2024-06-26T07:08:08.7466828Z }, 2024-06-26T07:08:08.7467169Z { 2024-06-26T07:08:08.7467605Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7468142Z "size": 103, 2024-06-26T07:08:08.7468672Z "digest": "sha256:340ec058739ef8635db4e96bca19a61d3e99728b9cff847c56ff6473d805a50d" 2024-06-26T07:08:08.7469278Z }, 2024-06-26T07:08:08.7469522Z { 2024-06-26T07:08:08.7469952Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7470497Z "size": 1474, 2024-06-26T07:08:08.7471048Z "digest": "sha256:54d3435eb7bb51dde703ed78f15e27c749edcffda9ba59dcb58afae63c21e8c2" 2024-06-26T07:08:08.7471658Z }, 2024-06-26T07:08:08.7471912Z { 2024-06-26T07:08:08.7472341Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7472889Z "size": 446711170, 2024-06-26T07:08:08.7473457Z "digest": "sha256:2a0a83b318ababab37ca3bfcd55c3b18bbd9fa86e1c6aa15cce35ac76fa0d861" 2024-06-26T07:08:08.7474087Z }, 2024-06-26T07:08:08.7474339Z { 2024-06-26T07:08:08.7474770Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7475314Z "size": 158, 2024-06-26T07:08:08.7475848Z "digest": "sha256:4923a3f1456efc88ea7278de228a2bdb1e80ba784c735ad2c7fb83fa30247bbc" 2024-06-26T07:08:08.7476507Z }, 2024-06-26T07:08:08.7476753Z { 2024-06-26T07:08:08.7477179Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7477720Z "size": 564, 2024-06-26T07:08:08.7478253Z "digest": "sha256:a3cf7711a64b8f29c42d779973b3887aa5c018fb3c519cddfe21a7ad4adc5d7a" 2024-06-26T07:08:08.7478850Z }, 2024-06-26T07:08:08.7479099Z { 2024-06-26T07:08:08.7479530Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7480081Z "size": 35866956, 2024-06-26T07:08:08.7480629Z "digest": "sha256:9b330ec9c5f5326d6ca1ad1e8f00551b63f4b33e36c5b6ed08727dba5274e427" 2024-06-26T07:08:08.7481235Z }, 2024-06-26T07:08:08.7481495Z { 2024-06-26T07:08:08.7481920Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7482466Z "size": 104, 2024-06-26T07:08:08.7482998Z "digest": "sha256:578e8684b0dd62cc1bbcfe3773d63c395219efa2882c898c502b73e211f93c1d" 2024-06-26T07:08:08.7483598Z }, 2024-06-26T07:08:08.7483844Z { 2024-06-26T07:08:08.7484275Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7484814Z "size": 426, 2024-06-26T07:08:08.7485356Z "digest": "sha256:0be96edb295ccccd2633f47ae8b9c771196bc6acedfeb98e8a8317194e3d3a69" 2024-06-26T07:08:08.7486017Z }, 2024-06-26T07:08:08.7486272Z { 2024-06-26T07:08:08.7486702Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7487319Z "size": 20262083, 2024-06-26T07:08:08.7487866Z "digest": "sha256:f8cc0024874727e0abb67e208e0b858588da47aa83d759d341b42e69d08c7b8b" 2024-06-26T07:08:08.7488461Z }, 2024-06-26T07:08:08.7488716Z { 2024-06-26T07:08:08.7489137Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7489683Z "size": 439, 2024-06-26T07:08:08.7490209Z "digest": "sha256:0f8c404a49903396bf3074fdabb1d8e580f25f8491adc79c63e2e4b9e1f58c10" 2024-06-26T07:08:08.7490814Z }, 2024-06-26T07:08:08.7491061Z { 2024-06-26T07:08:08.7491489Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7492036Z "size": 701, 2024-06-26T07:08:08.7492567Z "digest": "sha256:7454066a3d8e8de9a95e09dcf7ebb617a9211152c7a93c14602c3eaa0bfada5e" 2024-06-26T07:08:08.7493162Z }, 2024-06-26T07:08:08.7493420Z { 2024-06-26T07:08:08.7493940Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7494474Z "size": 141, 2024-06-26T07:08:08.7495043Z "digest": "sha256:81f06ec3ad2eacdde9ca0fba9edcb5bb4daa0ce53d47a367d5f1c93a0498f47d" 2024-06-26T07:08:08.7495703Z }, 2024-06-26T07:08:08.7495982Z { 2024-06-26T07:08:08.7496404Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7496955Z "size": 136, 2024-06-26T07:08:08.7497541Z "digest": "sha256:15cb896a08c77e954532754de424be80448dbe89f02d2ceee1726dfbb0d13c00" 2024-06-26T07:08:08.7498153Z }, 2024-06-26T07:08:08.7498399Z { 2024-06-26T07:08:08.7498835Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7499387Z "size": 4911495392, 2024-06-26T07:08:08.7499943Z "digest": "sha256:70f24c0071799d23886a2bde3de22579c6ccbeab9f32ad10db4fbb86748359d3" 2024-06-26T07:08:08.7500649Z }, 2024-06-26T07:08:08.7500902Z { 2024-06-26T07:08:08.7501338Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7501876Z "size": 190, 2024-06-26T07:08:08.7502431Z "digest": "sha256:d6e5b2cdad18c8465ac6fbb119197e164a8c97ca1cd2fabcc283d75390c609d7" 2024-06-26T07:08:08.7503057Z }, 2024-06-26T07:08:08.7503314Z { 2024-06-26T07:08:08.7503739Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7504292Z "size": 566, 2024-06-26T07:08:08.7504833Z "digest": "sha256:d613fbc17c49d7880b9bb8ce020ca503055881227ff77daf9931db0e838009cc" 2024-06-26T07:08:08.7505444Z }, 2024-06-26T07:08:08.7505690Z { 2024-06-26T07:08:08.7506170Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7506716Z "size": 43163752, 2024-06-26T07:08:08.7507267Z "digest": "sha256:f60db448a4cf61af4de5135e9d47f077847e92fa7d4369ea7a15d782913ddae0" 2024-06-26T07:08:08.7507875Z }, 2024-06-26T07:08:08.7508126Z { 2024-06-26T07:08:08.7508558Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7509100Z "size": 106, 2024-06-26T07:08:08.7509625Z "digest": "sha256:77d3743428f27e62adbb1755c963bb6050b293260408ff3e35b3cd29416d1ec8" 2024-06-26T07:08:08.7510233Z }, 2024-06-26T07:08:08.7510485Z { 2024-06-26T07:08:08.7510909Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7511454Z "size": 1213, 2024-06-26T07:08:08.7512004Z "digest": "sha256:246f548b4992ec948ddcdaeda2779ece425be96304d241f556691ddcb43081a1" 2024-06-26T07:08:08.7512614Z }, 2024-06-26T07:08:08.7512863Z { 2024-06-26T07:08:08.7513295Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7513841Z "size": 701, 2024-06-26T07:08:08.7514390Z "digest": "sha256:7454066a3d8e8de9a95e09dcf7ebb617a9211152c7a93c14602c3eaa0bfada5e" 2024-06-26T07:08:08.7514999Z }, 2024-06-26T07:08:08.7515252Z { 2024-06-26T07:08:08.7515681Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7516224Z "size": 138, 2024-06-26T07:08:08.7516756Z "digest": "sha256:7347b8d528ae7d715b23105b2c8c1ca9dcef925f0360526a23dca384b89802b2" 2024-06-26T07:08:08.7517432Z }, 2024-06-26T07:08:08.7517684Z { 2024-06-26T07:08:08.7518105Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7518648Z "size": 120, 2024-06-26T07:08:08.7519181Z "digest": "sha256:f5fdfb720d778718fee5f39d48b041e44f7d0a79c85c96bc3135b853b506e339" 2024-06-26T07:08:08.7519792Z }, 2024-06-26T07:08:08.7520037Z { 2024-06-26T07:08:08.7520464Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7521013Z "size": 1904165241, 2024-06-26T07:08:08.7521570Z "digest": "sha256:39eccd4fa4cacc38279baa0f2805d587775ff2e5a6e3e690820106385122b03f" 2024-06-26T07:08:08.7522176Z }, 2024-06-26T07:08:08.7522431Z { 2024-06-26T07:08:08.7522857Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7523394Z "size": 171, 2024-06-26T07:08:08.7523922Z "digest": "sha256:8690fc49f7f82a9b8432517aefe2df3b8744b46901f0994e04cf88a5f94ff72a" 2024-06-26T07:08:08.7524522Z }, 2024-06-26T07:08:08.7524778Z { 2024-06-26T07:08:08.7525200Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7525773Z "size": 908, 2024-06-26T07:08:08.7526320Z "digest": "sha256:8d7518f93a82a0fc5f7025e252a0ad7d852687c5958e337860fdbcb833e94638" 2024-06-26T07:08:08.7526914Z }, 2024-06-26T07:08:08.7527238Z { 2024-06-26T07:08:08.7527668Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7528212Z "size": 701, 2024-06-26T07:08:08.7528735Z "digest": "sha256:7454066a3d8e8de9a95e09dcf7ebb617a9211152c7a93c14602c3eaa0bfada5e" 2024-06-26T07:08:08.7529337Z }, 2024-06-26T07:08:08.7529588Z { 2024-06-26T07:08:08.7530017Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7530555Z "size": 134, 2024-06-26T07:08:08.7531098Z "digest": "sha256:32afbdb75edead6a7949b50e3a9df52a07401168263fc4e3d0a48caf2e6b007b" 2024-06-26T07:08:08.7531719Z }, 2024-06-26T07:08:08.7531963Z { 2024-06-26T07:08:08.7532391Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7532941Z "size": 32, 2024-06-26T07:08:08.7533478Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-06-26T07:08:08.7534145Z }, 2024-06-26T07:08:08.7534397Z { 2024-06-26T07:08:08.7534837Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7535381Z "size": 156, 2024-06-26T07:08:08.7535918Z "digest": "sha256:29fa11d7e3f843bf8f97f94b44e1ccee56a8a0f757225e61249ec61ea09285a6" 2024-06-26T07:08:08.7536576Z }, 2024-06-26T07:08:08.7536830Z { 2024-06-26T07:08:08.7537264Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7537802Z "size": 1841, 2024-06-26T07:08:08.7538343Z "digest": "sha256:4fad4714694523fb61fdebda512ec545265b8d440e12d7e5cb2e0733bd1ab623" 2024-06-26T07:08:08.7538954Z }, 2024-06-26T07:08:08.7539201Z { 2024-06-26T07:08:08.7539631Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7540303Z "size": 7529784, 2024-06-26T07:08:08.7540858Z "digest": "sha256:64f272eae1dbffd659ddf30f628ade1707991bb8f8955d71793faa1333f0adbd" 2024-06-26T07:08:08.7541461Z }, 2024-06-26T07:08:08.7541714Z { 2024-06-26T07:08:08.7542149Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7542699Z "size": 164, 2024-06-26T07:08:08.7543228Z "digest": "sha256:7e5a573d67ada9f6563a45a648813a80eabdace41a9ddb4f060334e71c23c54b" 2024-06-26T07:08:08.7543837Z }, 2024-06-26T07:08:08.7544089Z { 2024-06-26T07:08:08.7544511Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7545055Z "size": 7944, 2024-06-26T07:08:08.7545597Z "digest": "sha256:bb11a9f8be67176857e7e6d2af7b07b48dec6f95b49db4975fe76db0db3d6f6f" 2024-06-26T07:08:08.7546214Z }, 2024-06-26T07:08:08.7546459Z { 2024-06-26T07:08:08.7546893Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7547520Z "size": 8070, 2024-06-26T07:08:08.7548062Z "digest": "sha256:3ff78522fefe4a25273fa0e89550a748e2d6291be0a078b0a8b6abd554ee985d" 2024-06-26T07:08:08.7548661Z }, 2024-06-26T07:08:08.7548919Z { 2024-06-26T07:08:08.7549357Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7549912Z "size": 303, 2024-06-26T07:08:08.7550443Z "digest": "sha256:79fb75b4561bf33c20e79e5f2c1e9f41ac01ed5e6ca70d927fcc9208735f715e" 2024-06-26T07:08:08.7551058Z }, 2024-06-26T07:08:08.7551314Z { 2024-06-26T07:08:08.7551740Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7552287Z "size": 7629627, 2024-06-26T07:08:08.7552829Z "digest": "sha256:5f47c3db012a3a2c5b18e32a9e1131012cd2d831872c4df937a461a60488a3be" 2024-06-26T07:08:08.7553432Z }, 2024-06-26T07:08:08.7553676Z { 2024-06-26T07:08:08.7554103Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7554646Z "size": 108, 2024-06-26T07:08:08.7555172Z "digest": "sha256:4db47072195da67747e4785caba4c434979990d1c379813a6728ed85ab1d8508" 2024-06-26T07:08:08.7555797Z }, 2024-06-26T07:08:08.7556068Z { 2024-06-26T07:08:08.7556495Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7557039Z "size": 54145777, 2024-06-26T07:08:08.7557653Z "digest": "sha256:2d3f55b15ec02cdcf6276839811c63508418cc99d2c2a9a0845969401fa09469" 2024-06-26T07:08:08.7558252Z }, 2024-06-26T07:08:08.7558506Z { 2024-06-26T07:08:08.7558929Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7559480Z "size": 474, 2024-06-26T07:08:08.7560010Z "digest": "sha256:b948d493b64026cf04be83a2e80f5ee81b10ce8165942a1b747e0d4c60840cfc" 2024-06-26T07:08:08.7560605Z }, 2024-06-26T07:08:08.7560852Z { 2024-06-26T07:08:08.7561287Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7561842Z "size": 1374858502, 2024-06-26T07:08:08.7562408Z "digest": "sha256:a7f6534d479c5ae8e53c7227610f43d9f74a352690f07b8cde3fbefb08e8aadf" 2024-06-26T07:08:08.7563008Z }, 2024-06-26T07:08:08.7563264Z { 2024-06-26T07:08:08.7563699Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7564236Z "size": 106, 2024-06-26T07:08:08.7564781Z "digest": "sha256:5f87f50e4f6cc6e9ab3ab17362c2f2f58d82d93a25c747e48b2fd93f95cbcb05" 2024-06-26T07:08:08.7565390Z }, 2024-06-26T07:08:08.7565645Z { 2024-06-26T07:08:08.7566114Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7566658Z "size": 558, 2024-06-26T07:08:08.7567182Z "digest": "sha256:629b88f68f9b74389f93d83244a3a1b1d019b1be702c153676c6fda5f1d86ff9" 2024-06-26T07:08:08.7567778Z }, 2024-06-26T07:08:08.7568026Z { 2024-06-26T07:08:08.7568452Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7568999Z "size": 46248418, 2024-06-26T07:08:08.7569543Z "digest": "sha256:07e387a2f37267d95a9fe93028134f1b7fb2abd82237aec7114ec03a619cf65a" 2024-06-26T07:08:08.7570142Z }, 2024-06-26T07:08:08.7570397Z { 2024-06-26T07:08:08.7570823Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7571359Z "size": 111, 2024-06-26T07:08:08.7571903Z "digest": "sha256:34d8f3f114f8990e13a79c92c5d7f03cfc2c77e61288fd67cf9feec6d7e5d0c8" 2024-06-26T07:08:08.7572515Z }, 2024-06-26T07:08:08.7572769Z { 2024-06-26T07:08:08.7573192Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7573796Z "size": 32, 2024-06-26T07:08:08.7574328Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-06-26T07:08:08.7574937Z }, 2024-06-26T07:08:08.7575179Z { 2024-06-26T07:08:08.7575606Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7576146Z "size": 32, 2024-06-26T07:08:08.7576669Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-06-26T07:08:08.7577277Z }, 2024-06-26T07:08:08.7577593Z { 2024-06-26T07:08:08.7578021Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7578556Z "size": 32, 2024-06-26T07:08:08.7579085Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-06-26T07:08:08.7579695Z }, 2024-06-26T07:08:08.7579945Z { 2024-06-26T07:08:08.7580468Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:08:08.7581012Z "size": 32, 2024-06-26T07:08:08.7581538Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-06-26T07:08:08.7582139Z } 2024-06-26T07:08:08.7582379Z ] 2024-06-26T07:08:08.7582626Z } 2024-06-26T07:08:08.7582892Z + exit 0 2024-06-26T07:08:08.7701197Z ##[group]Run tag=${ECR_DOCKER_IMAGE##*/} 2024-06-26T07:08:08.7701680Z tag=${ECR_DOCKER_IMAGE##*/} 2024-06-26T07:08:08.7702225Z echo "docker pull ghcr.io/pytorch/ci-image:${tag/:/-}" 2024-06-26T07:08:08.7710220Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:08:08.7710718Z env: 2024-06-26T07:08:08.7710995Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:08:08.7712116Z ECR_DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:08:08.7713249Z ##[endgroup] 2024-06-26T07:08:08.7735718Z docker pull ghcr.io/pytorch/ci-image:pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks-91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:08:08.7784229Z ##[group]Run pytorch/test-infra/.github/actions/pull-docker-image@main 2024-06-26T07:08:08.7784794Z with: 2024-06-26T07:08:08.7785844Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:08:08.7787114Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:08:08.7787637Z env: 2024-06-26T07:08:08.7787917Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:08:08.7788260Z ##[endgroup] 2024-06-26T07:08:08.7803214Z ##[group]Run set -x 2024-06-26T07:08:08.7803548Z set -x 2024-06-26T07:08:08.7803846Z set +e 2024-06-26T07:08:08.7804132Z  2024-06-26T07:08:08.7804404Z login() { 2024-06-26T07:08:08.7805054Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2024-06-26T07:08:08.7805752Z } 2024-06-26T07:08:08.7806029Z  2024-06-26T07:08:08.7806326Z retry () { 2024-06-26T07:08:08.7806718Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2024-06-26T07:08:08.7807156Z } 2024-06-26T07:08:08.7807435Z  2024-06-26T07:08:08.7807754Z retry login "${DOCKER_REGISTRY}" 2024-06-26T07:08:08.7808161Z  2024-06-26T07:08:08.7808436Z set -e 2024-06-26T07:08:08.7808910Z # ignore output since only exit code is used for conditional 2024-06-26T07:08:08.7809619Z # only pull docker image if it's not available locally 2024-06-26T07:08:08.7810373Z if ! docker inspect --type=image "${DOCKER_IMAGE}" >/dev/null 2>/dev/null; then 2024-06-26T07:08:08.7811059Z  retry docker pull "${DOCKER_IMAGE}" 2024-06-26T07:08:08.7811492Z fi 2024-06-26T07:08:08.7819147Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:08:08.7819639Z env: 2024-06-26T07:08:08.7819924Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:08:08.7821275Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:08:08.7822545Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:08:08.7823054Z ##[endgroup] 2024-06-26T07:08:08.7841595Z + set +e 2024-06-26T07:08:08.7842197Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:08:08.7842845Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:08:08.7845048Z + aws ecr get-login-password --region us-east-1 2024-06-26T07:08:08.7845814Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:08:09.1878100Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-06-26T07:08:09.1879170Z Configure a credential helper to remove this warning. See 2024-06-26T07:08:09.1880267Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-06-26T07:08:09.1880824Z 2024-06-26T07:08:09.1880949Z Login Succeeded 2024-06-26T07:08:09.1887966Z + set -e 2024-06-26T07:08:09.1889379Z + docker inspect --type=image 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:08:09.2014850Z + retry docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:08:09.2017032Z + docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:08:09.4412549Z 91382da70d5719cd7007b6b80b71d2f48398f6b7: Pulling from pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks 2024-06-26T07:08:09.4414074Z 63e9bbe32327: Pulling fs layer 2024-06-26T07:08:09.4414648Z cfb3d849840e: Pulling fs layer 2024-06-26T07:08:09.4415363Z 968831e596a6: Pulling fs layer 2024-06-26T07:08:09.4416061Z ea310eb267ca: Pulling fs layer 2024-06-26T07:08:09.4416577Z 3af11d09e9cd: Pulling fs layer 2024-06-26T07:08:09.4417078Z ebfec18059b9: Pulling fs layer 2024-06-26T07:08:09.4417599Z 533b4aebf169: Pulling fs layer 2024-06-26T07:08:09.4418100Z 9dd75d06a091: Pulling fs layer 2024-06-26T07:08:09.4418583Z 30bfca4dd349: Pulling fs layer 2024-06-26T07:08:09.4419079Z 1b57ce94cad9: Pulling fs layer 2024-06-26T07:08:09.4419602Z 9ee6bdb31195: Pulling fs layer 2024-06-26T07:08:09.4420286Z ee3624ae3727: Pulling fs layer 2024-06-26T07:08:09.4420798Z 781362366150: Pulling fs layer 2024-06-26T07:08:09.4421284Z 9b08a0698a8a: Pulling fs layer 2024-06-26T07:08:09.4421781Z 7b7b1bdcbcc9: Pulling fs layer 2024-06-26T07:08:09.4422265Z 2d176cec9db3: Pulling fs layer 2024-06-26T07:08:09.4422761Z cba4658f6a4a: Pulling fs layer 2024-06-26T07:08:09.4423231Z ebfec18059b9: Waiting 2024-06-26T07:08:09.4423673Z 23b5517a7953: Pulling fs layer 2024-06-26T07:08:09.4424160Z df0096280bdb: Pulling fs layer 2024-06-26T07:08:09.4424651Z 7454066a3d8e: Pulling fs layer 2024-06-26T07:08:09.4425146Z 6d6f4e10cdaa: Pulling fs layer 2024-06-26T07:08:09.4425618Z cbb2f8884ff2: Pulling fs layer 2024-06-26T07:08:09.4426013Z ff99b372daac: Pulling fs layer 2024-06-26T07:08:09.4426435Z 533b4aebf169: Waiting 2024-06-26T07:08:09.4426787Z be64fa49eeaf: Pulling fs layer 2024-06-26T07:08:09.4427347Z 13e86101f8af: Pulling fs layer 2024-06-26T07:08:09.4427864Z 6593f0a66be9: Pulling fs layer 2024-06-26T07:08:09.4428418Z 1b30bd2fbb84: Pulling fs layer 2024-06-26T07:08:09.4428976Z 2192e794bf74: Pulling fs layer 2024-06-26T07:08:09.4429437Z 028168f5e8d4: Pulling fs layer 2024-06-26T07:08:09.4429882Z 4b2cffe5f919: Pulling fs layer 2024-06-26T07:08:09.4430270Z 340ec058739e: Pulling fs layer 2024-06-26T07:08:09.4430652Z 54d3435eb7bb: Pulling fs layer 2024-06-26T07:08:09.4431030Z 2a0a83b318ab: Pulling fs layer 2024-06-26T07:08:09.4431404Z 9dd75d06a091: Waiting 2024-06-26T07:08:09.4431757Z 4923a3f1456e: Pulling fs layer 2024-06-26T07:08:09.4432145Z a3cf7711a64b: Pulling fs layer 2024-06-26T07:08:09.4432577Z 9b330ec9c5f5: Pulling fs layer 2024-06-26T07:08:09.4433006Z 30bfca4dd349: Waiting 2024-06-26T07:08:09.4433458Z 1b57ce94cad9: Waiting 2024-06-26T07:08:09.4433940Z 578e8684b0dd: Pulling fs layer 2024-06-26T07:08:09.4434436Z 0be96edb295c: Pulling fs layer 2024-06-26T07:08:09.4434813Z f8cc00248747: Pulling fs layer 2024-06-26T07:08:09.4435170Z 9ee6bdb31195: Waiting 2024-06-26T07:08:09.4435640Z 0f8c404a4990: Pulling fs layer 2024-06-26T07:08:09.4436010Z 81f06ec3ad2e: Pulling fs layer 2024-06-26T07:08:09.4436409Z ee3624ae3727: Waiting 2024-06-26T07:08:09.4436762Z 7454066a3d8e: Waiting 2024-06-26T07:08:09.4437140Z 15cb896a08c7: Pulling fs layer 2024-06-26T07:08:09.4437560Z 70f24c007179: Pulling fs layer 2024-06-26T07:08:09.4437919Z 781362366150: Waiting 2024-06-26T07:08:09.4438255Z d6e5b2cdad18: Pulling fs layer 2024-06-26T07:08:09.4438669Z d613fbc17c49: Pulling fs layer 2024-06-26T07:08:09.4439063Z f60db448a4cf: Pulling fs layer 2024-06-26T07:08:09.4439423Z 6d6f4e10cdaa: Waiting 2024-06-26T07:08:09.4439747Z 77d3743428f2: Pulling fs layer 2024-06-26T07:08:09.4440159Z 246f548b4992: Pulling fs layer 2024-06-26T07:08:09.4440528Z 7347b8d528ae: Pulling fs layer 2024-06-26T07:08:09.4441005Z 9b08a0698a8a: Waiting 2024-06-26T07:08:09.4441454Z cbb2f8884ff2: Waiting 2024-06-26T07:08:09.4441937Z f5fdfb720d77: Pulling fs layer 2024-06-26T07:08:09.4442461Z 13e86101f8af: Waiting 2024-06-26T07:08:09.4442934Z 39eccd4fa4ca: Pulling fs layer 2024-06-26T07:08:09.4443472Z 8690fc49f7f8: Pulling fs layer 2024-06-26T07:08:09.4443982Z ff99b372daac: Waiting 2024-06-26T07:08:09.4444451Z 8d7518f93a82: Pulling fs layer 2024-06-26T07:08:09.4444962Z 6593f0a66be9: Waiting 2024-06-26T07:08:09.4445424Z be64fa49eeaf: Waiting 2024-06-26T07:08:09.4445887Z 7b7b1bdcbcc9: Waiting 2024-06-26T07:08:09.4446366Z 32afbdb75ede: Pulling fs layer 2024-06-26T07:08:09.4446896Z 4f4fb700ef54: Pulling fs layer 2024-06-26T07:08:09.4447410Z 2d176cec9db3: Waiting 2024-06-26T07:08:09.4448037Z 29fa11d7e3f8: Pulling fs layer 2024-06-26T07:08:09.4448554Z cba4658f6a4a: Waiting 2024-06-26T07:08:09.4449009Z 1b30bd2fbb84: Waiting 2024-06-26T07:08:09.4449465Z ea310eb267ca: Waiting 2024-06-26T07:08:09.4449938Z 4fad47146945: Pulling fs layer 2024-06-26T07:08:09.4450473Z 64f272eae1db: Pulling fs layer 2024-06-26T07:08:09.4451003Z df0096280bdb: Waiting 2024-06-26T07:08:09.4451474Z 7e5a573d67ad: Pulling fs layer 2024-06-26T07:08:09.4452006Z bb11a9f8be67: Pulling fs layer 2024-06-26T07:08:09.4452543Z 3ff78522fefe: Pulling fs layer 2024-06-26T07:08:09.4453053Z 23b5517a7953: Waiting 2024-06-26T07:08:09.4453497Z 2192e794bf74: Waiting 2024-06-26T07:08:09.4454056Z 79fb75b4561b: Pulling fs layer 2024-06-26T07:08:09.4454605Z 5f47c3db012a: Pulling fs layer 2024-06-26T07:08:09.4455144Z 4db47072195d: Pulling fs layer 2024-06-26T07:08:09.4455660Z 70f24c007179: Waiting 2024-06-26T07:08:09.4456121Z 2d3f55b15ec0: Pulling fs layer 2024-06-26T07:08:09.4456694Z 39eccd4fa4ca: Waiting 2024-06-26T07:08:09.4457178Z b948d493b640: Pulling fs layer 2024-06-26T07:08:09.4457690Z 028168f5e8d4: Waiting 2024-06-26T07:08:09.4458138Z d6e5b2cdad18: Waiting 2024-06-26T07:08:09.4458590Z 246f548b4992: Waiting 2024-06-26T07:08:09.4459063Z a7f6534d479c: Pulling fs layer 2024-06-26T07:08:09.4459601Z 5f87f50e4f6c: Pulling fs layer 2024-06-26T07:08:09.4460278Z 629b88f68f9b: Pulling fs layer 2024-06-26T07:08:09.4460799Z d613fbc17c49: Waiting 2024-06-26T07:08:09.4461247Z 8690fc49f7f8: Waiting 2024-06-26T07:08:09.4461708Z 07e387a2f372: Pulling fs layer 2024-06-26T07:08:09.4462238Z 34d8f3f114f8: Pulling fs layer 2024-06-26T07:08:09.4462755Z 4b2cffe5f919: Waiting 2024-06-26T07:08:09.4463198Z 77d3743428f2: Waiting 2024-06-26T07:08:09.4463650Z 64f272eae1db: Waiting 2024-06-26T07:08:09.4464104Z 7347b8d528ae: Waiting 2024-06-26T07:08:09.4464562Z f60db448a4cf: Waiting 2024-06-26T07:08:09.4465004Z 32afbdb75ede: Waiting 2024-06-26T07:08:09.4465448Z 8d7518f93a82: Waiting 2024-06-26T07:08:09.4465887Z 340ec058739e: Waiting 2024-06-26T07:08:09.4466359Z f5fdfb720d77: Waiting 2024-06-26T07:08:09.4466823Z 4f4fb700ef54: Waiting 2024-06-26T07:08:09.4467270Z 7e5a573d67ad: Waiting 2024-06-26T07:08:09.4467719Z a7f6534d479c: Waiting 2024-06-26T07:08:09.4468161Z bb11a9f8be67: Waiting 2024-06-26T07:08:09.4468611Z 29fa11d7e3f8: Waiting 2024-06-26T07:08:09.4469052Z 54d3435eb7bb: Waiting 2024-06-26T07:08:09.4469499Z 5f87f50e4f6c: Waiting 2024-06-26T07:08:09.4469940Z 2d3f55b15ec0: Waiting 2024-06-26T07:08:09.4470379Z 4fad47146945: Waiting 2024-06-26T07:08:09.4470960Z 34d8f3f114f8: Waiting 2024-06-26T07:08:09.4471400Z 79fb75b4561b: Waiting 2024-06-26T07:08:09.4471847Z 2a0a83b318ab: Waiting 2024-06-26T07:08:09.4472291Z 629b88f68f9b: Waiting 2024-06-26T07:08:09.4472748Z 07e387a2f372: Waiting 2024-06-26T07:08:09.4473191Z 81f06ec3ad2e: Waiting 2024-06-26T07:08:09.4473640Z 3ff78522fefe: Waiting 2024-06-26T07:08:09.4474071Z 0be96edb295c: Waiting 2024-06-26T07:08:09.4474474Z 578e8684b0dd: Waiting 2024-06-26T07:08:09.4474808Z a3cf7711a64b: Waiting 2024-06-26T07:08:09.4475128Z 4db47072195d: Waiting 2024-06-26T07:08:09.4475441Z b948d493b640: Waiting 2024-06-26T07:08:09.4475750Z 5f47c3db012a: Waiting 2024-06-26T07:08:09.5968543Z cfb3d849840e: Verifying Checksum 2024-06-26T07:08:09.5969147Z cfb3d849840e: Download complete 2024-06-26T07:08:09.6665370Z ea310eb267ca: Verifying Checksum 2024-06-26T07:08:09.6665954Z ea310eb267ca: Download complete 2024-06-26T07:08:09.7406482Z 3af11d09e9cd: Verifying Checksum 2024-06-26T07:08:09.7407118Z 3af11d09e9cd: Download complete 2024-06-26T07:08:09.8001540Z 63e9bbe32327: Verifying Checksum 2024-06-26T07:08:09.8002100Z 63e9bbe32327: Download complete 2024-06-26T07:08:09.8803116Z 533b4aebf169: Verifying Checksum 2024-06-26T07:08:09.8803554Z 533b4aebf169: Download complete 2024-06-26T07:08:09.9700510Z 9dd75d06a091: Verifying Checksum 2024-06-26T07:08:09.9701087Z 9dd75d06a091: Download complete 2024-06-26T07:08:10.0434331Z 30bfca4dd349: Download complete 2024-06-26T07:08:10.3197127Z 968831e596a6: Verifying Checksum 2024-06-26T07:08:10.3197956Z 968831e596a6: Download complete 2024-06-26T07:08:10.3963006Z 9ee6bdb31195: Download complete 2024-06-26T07:08:10.4691608Z ee3624ae3727: Download complete 2024-06-26T07:08:10.8018193Z 63e9bbe32327: Pull complete 2024-06-26T07:08:11.0966059Z cfb3d849840e: Pull complete 2024-06-26T07:08:12.0555937Z 968831e596a6: Pull complete 2024-06-26T07:08:12.0983686Z ea310eb267ca: Pull complete 2024-06-26T07:08:12.1498625Z 3af11d09e9cd: Pull complete 2024-06-26T07:08:13.0868175Z 781362366150: Verifying Checksum 2024-06-26T07:08:13.0868721Z 781362366150: Download complete 2024-06-26T07:08:13.2524708Z 7b7b1bdcbcc9: Verifying Checksum 2024-06-26T07:08:13.2525168Z 7b7b1bdcbcc9: Download complete 2024-06-26T07:08:13.3508266Z 2d176cec9db3: Verifying Checksum 2024-06-26T07:08:13.3508794Z 2d176cec9db3: Download complete 2024-06-26T07:08:14.4998878Z cba4658f6a4a: Verifying Checksum 2024-06-26T07:08:14.4999714Z cba4658f6a4a: Download complete 2024-06-26T07:08:14.6059626Z 23b5517a7953: Download complete 2024-06-26T07:08:14.7111211Z df0096280bdb: Download complete 2024-06-26T07:08:14.7873576Z 7454066a3d8e: Verifying Checksum 2024-06-26T07:08:14.7874380Z 7454066a3d8e: Download complete 2024-06-26T07:08:35.7243216Z ebfec18059b9: Verifying Checksum 2024-06-26T07:08:35.7243692Z ebfec18059b9: Download complete 2024-06-26T07:08:35.8305946Z cbb2f8884ff2: Verifying Checksum 2024-06-26T07:08:35.8306536Z cbb2f8884ff2: Download complete 2024-06-26T07:08:35.9122511Z ff99b372daac: Download complete 2024-06-26T07:08:36.0095736Z be64fa49eeaf: Verifying Checksum 2024-06-26T07:08:36.0096249Z be64fa49eeaf: Download complete 2024-06-26T07:08:36.1132633Z 13e86101f8af: Verifying Checksum 2024-06-26T07:08:36.1133202Z 13e86101f8af: Download complete 2024-06-26T07:08:36.1972988Z 6593f0a66be9: Verifying Checksum 2024-06-26T07:08:36.1973712Z 6593f0a66be9: Download complete 2024-06-26T07:08:39.4206625Z 1b30bd2fbb84: Verifying Checksum 2024-06-26T07:08:39.4207124Z 1b30bd2fbb84: Download complete 2024-06-26T07:08:39.5220992Z 2192e794bf74: Download complete 2024-06-26T07:08:39.6186442Z 028168f5e8d4: Verifying Checksum 2024-06-26T07:08:39.6187027Z 028168f5e8d4: Download complete 2024-06-26T07:08:39.6932599Z 4b2cffe5f919: Verifying Checksum 2024-06-26T07:08:39.6933175Z 4b2cffe5f919: Download complete 2024-06-26T07:08:39.7975731Z 340ec058739e: Verifying Checksum 2024-06-26T07:08:39.7976366Z 340ec058739e: Download complete 2024-06-26T07:08:39.8779199Z 54d3435eb7bb: Verifying Checksum 2024-06-26T07:08:39.8779822Z 54d3435eb7bb: Download complete 2024-06-26T07:08:48.3964094Z ebfec18059b9: Pull complete 2024-06-26T07:08:48.6306505Z 533b4aebf169: Pull complete 2024-06-26T07:08:48.8752555Z 9dd75d06a091: Pull complete 2024-06-26T07:08:49.1178362Z 30bfca4dd349: Pull complete 2024-06-26T07:08:52.4317795Z 2a0a83b318ab: Verifying Checksum 2024-06-26T07:08:52.4318271Z 2a0a83b318ab: Download complete 2024-06-26T07:08:52.5070301Z 4923a3f1456e: Verifying Checksum 2024-06-26T07:08:52.5070728Z 4923a3f1456e: Download complete 2024-06-26T07:08:52.6020849Z a3cf7711a64b: Download complete 2024-06-26T07:08:54.2325637Z 9b330ec9c5f5: Verifying Checksum 2024-06-26T07:08:54.2326152Z 9b330ec9c5f5: Download complete 2024-06-26T07:08:54.3028963Z 578e8684b0dd: Download complete 2024-06-26T07:08:54.4244915Z 0be96edb295c: Verifying Checksum 2024-06-26T07:08:54.4245482Z 0be96edb295c: Download complete 2024-06-26T07:08:54.9574968Z f8cc00248747: Download complete 2024-06-26T07:08:55.0623973Z 0f8c404a4990: Verifying Checksum 2024-06-26T07:08:55.0624803Z 0f8c404a4990: Download complete 2024-06-26T07:08:55.1333851Z 81f06ec3ad2e: Verifying Checksum 2024-06-26T07:08:55.1334326Z 81f06ec3ad2e: Download complete 2024-06-26T07:08:55.3098689Z 15cb896a08c7: Download complete 2024-06-26T07:09:07.5025286Z 1b57ce94cad9: Verifying Checksum 2024-06-26T07:09:07.5025919Z 1b57ce94cad9: Download complete 2024-06-26T07:09:07.6013581Z d6e5b2cdad18: Verifying Checksum 2024-06-26T07:09:07.6014179Z d6e5b2cdad18: Download complete 2024-06-26T07:09:07.6881333Z d613fbc17c49: Download complete 2024-06-26T07:09:08.6905794Z f60db448a4cf: Verifying Checksum 2024-06-26T07:09:08.6906558Z f60db448a4cf: Download complete 2024-06-26T07:09:08.7707044Z 77d3743428f2: Verifying Checksum 2024-06-26T07:09:08.7707468Z 77d3743428f2: Download complete 2024-06-26T07:09:08.8654552Z 246f548b4992: Verifying Checksum 2024-06-26T07:09:08.8655090Z 246f548b4992: Download complete 2024-06-26T07:09:08.9478978Z 7347b8d528ae: Verifying Checksum 2024-06-26T07:09:08.9479550Z 7347b8d528ae: Download complete 2024-06-26T07:09:09.0269168Z f5fdfb720d77: Verifying Checksum 2024-06-26T07:09:09.0269707Z f5fdfb720d77: Download complete 2024-06-26T07:09:25.0698362Z 6d6f4e10cdaa: Verifying Checksum 2024-06-26T07:09:25.0698982Z 6d6f4e10cdaa: Download complete 2024-06-26T07:09:25.1844456Z 8690fc49f7f8: Verifying Checksum 2024-06-26T07:09:25.1845133Z 8690fc49f7f8: Download complete 2024-06-26T07:09:25.2664803Z 8d7518f93a82: Verifying Checksum 2024-06-26T07:09:25.2665428Z 8d7518f93a82: Download complete 2024-06-26T07:09:25.3375571Z 32afbdb75ede: Download complete 2024-06-26T07:09:25.3470213Z 4f4fb700ef54: Download complete 2024-06-26T07:09:25.4438973Z 29fa11d7e3f8: Download complete 2024-06-26T07:09:25.5260586Z 4fad47146945: Verifying Checksum 2024-06-26T07:09:25.5261131Z 4fad47146945: Download complete 2024-06-26T07:09:25.8897142Z 64f272eae1db: Verifying Checksum 2024-06-26T07:09:25.8897637Z 64f272eae1db: Download complete 2024-06-26T07:09:25.9631168Z 7e5a573d67ad: Verifying Checksum 2024-06-26T07:09:25.9631745Z 7e5a573d67ad: Download complete 2024-06-26T07:09:26.0473873Z bb11a9f8be67: Verifying Checksum 2024-06-26T07:09:26.0474541Z bb11a9f8be67: Download complete 2024-06-26T07:09:26.1366300Z 3ff78522fefe: Download complete 2024-06-26T07:09:26.2431614Z 79fb75b4561b: Verifying Checksum 2024-06-26T07:09:26.2432239Z 79fb75b4561b: Download complete 2024-06-26T07:09:26.5712327Z 5f47c3db012a: Verifying Checksum 2024-06-26T07:09:26.5712979Z 5f47c3db012a: Download complete 2024-06-26T07:09:26.6463378Z 4db47072195d: Verifying Checksum 2024-06-26T07:09:26.6463870Z 4db47072195d: Download complete 2024-06-26T07:09:27.8459479Z 2d3f55b15ec0: Verifying Checksum 2024-06-26T07:09:27.9180366Z 2d3f55b15ec0: Download complete 2024-06-26T07:09:27.9180844Z b948d493b640: Download complete 2024-06-26T07:09:38.1917815Z 1b57ce94cad9: Pull complete 2024-06-26T07:09:38.4155930Z 9ee6bdb31195: Pull complete 2024-06-26T07:09:38.6293406Z ee3624ae3727: Pull complete 2024-06-26T07:09:46.0974688Z 781362366150: Pull complete 2024-06-26T07:09:46.3185067Z 9b08a0698a8a: Pull complete 2024-06-26T07:09:46.5703354Z 7b7b1bdcbcc9: Pull complete 2024-06-26T07:09:46.8048234Z 2d176cec9db3: Pull complete 2024-06-26T07:09:49.1189730Z cba4658f6a4a: Pull complete 2024-06-26T07:09:49.2735752Z 23b5517a7953: Pull complete 2024-06-26T07:09:49.4501333Z df0096280bdb: Pull complete 2024-06-26T07:09:49.6312934Z 7454066a3d8e: Pull complete 2024-06-26T07:09:55.9850990Z 39eccd4fa4ca: Verifying Checksum 2024-06-26T07:09:55.9852879Z 39eccd4fa4ca: Download complete 2024-06-26T07:09:56.0778327Z 5f87f50e4f6c: Verifying Checksum 2024-06-26T07:09:56.0779008Z 5f87f50e4f6c: Download complete 2024-06-26T07:09:56.1714363Z 629b88f68f9b: Download complete 2024-06-26T07:09:57.6536843Z 07e387a2f372: Verifying Checksum 2024-06-26T07:09:57.6537317Z 07e387a2f372: Download complete 2024-06-26T07:09:57.7671874Z 34d8f3f114f8: Verifying Checksum 2024-06-26T07:09:57.7673553Z 34d8f3f114f8: Download complete 2024-06-26T07:10:02.9158560Z a7f6534d479c: Verifying Checksum 2024-06-26T07:10:02.9159035Z a7f6534d479c: Download complete 2024-06-26T07:10:55.4579751Z 6d6f4e10cdaa: Pull complete 2024-06-26T07:10:55.9419687Z cbb2f8884ff2: Pull complete 2024-06-26T07:10:56.1870360Z ff99b372daac: Pull complete 2024-06-26T07:10:56.4014144Z be64fa49eeaf: Pull complete 2024-06-26T07:10:56.6277861Z 13e86101f8af: Pull complete 2024-06-26T07:10:56.7880277Z 6593f0a66be9: Pull complete 2024-06-26T07:11:00.4189197Z 1b30bd2fbb84: Pull complete 2024-06-26T07:11:00.5413260Z 2192e794bf74: Pull complete 2024-06-26T07:11:00.6654000Z 028168f5e8d4: Pull complete 2024-06-26T07:11:00.8717216Z 4b2cffe5f919: Pull complete 2024-06-26T07:11:01.0967832Z 340ec058739e: Pull complete 2024-06-26T07:11:01.3083384Z 54d3435eb7bb: Pull complete 2024-06-26T07:11:02.4717136Z 70f24c007179: Verifying Checksum 2024-06-26T07:11:02.4718873Z 70f24c007179: Download complete 2024-06-26T07:11:09.6466762Z 2a0a83b318ab: Pull complete 2024-06-26T07:11:09.8387561Z 4923a3f1456e: Pull complete 2024-06-26T07:11:09.9496495Z a3cf7711a64b: Pull complete 2024-06-26T07:11:10.9230796Z 9b330ec9c5f5: Pull complete 2024-06-26T07:11:11.1607041Z 578e8684b0dd: Pull complete 2024-06-26T07:11:11.3690381Z 0be96edb295c: Pull complete 2024-06-26T07:11:11.8047319Z f8cc00248747: Pull complete 2024-06-26T07:11:12.0298638Z 0f8c404a4990: Pull complete 2024-06-26T07:11:12.4754146Z 81f06ec3ad2e: Pull complete 2024-06-26T07:11:12.7113577Z 15cb896a08c7: Pull complete 2024-06-26T07:11:52.2739888Z 70f24c007179: Pull complete 2024-06-26T07:11:52.6082565Z d6e5b2cdad18: Pull complete 2024-06-26T07:11:53.0082523Z d613fbc17c49: Pull complete 2024-06-26T07:11:55.1730190Z f60db448a4cf: Pull complete 2024-06-26T07:11:55.3973371Z 77d3743428f2: Pull complete 2024-06-26T07:11:55.5779372Z 246f548b4992: Pull complete 2024-06-26T07:11:56.0412788Z 7347b8d528ae: Pull complete 2024-06-26T07:11:56.2629743Z f5fdfb720d77: Pull complete 2024-06-26T07:12:30.7092165Z 39eccd4fa4ca: Pull complete 2024-06-26T07:12:30.9232609Z 8690fc49f7f8: Pull complete 2024-06-26T07:12:31.1355674Z 8d7518f93a82: Pull complete 2024-06-26T07:12:31.2726294Z 32afbdb75ede: Pull complete 2024-06-26T07:12:31.3131537Z 4f4fb700ef54: Pull complete 2024-06-26T07:12:31.3417068Z 29fa11d7e3f8: Pull complete 2024-06-26T07:12:31.3900582Z 4fad47146945: Pull complete 2024-06-26T07:12:31.5977184Z 64f272eae1db: Pull complete 2024-06-26T07:12:31.6346985Z 7e5a573d67ad: Pull complete 2024-06-26T07:12:31.6709115Z bb11a9f8be67: Pull complete 2024-06-26T07:12:31.7037698Z 3ff78522fefe: Pull complete 2024-06-26T07:12:31.7622251Z 79fb75b4561b: Pull complete 2024-06-26T07:12:32.7809978Z 5f47c3db012a: Pull complete 2024-06-26T07:12:33.0172506Z 4db47072195d: Pull complete 2024-06-26T07:12:35.0876736Z 2d3f55b15ec0: Pull complete 2024-06-26T07:12:35.3153352Z b948d493b640: Pull complete 2024-06-26T07:12:49.1471398Z a7f6534d479c: Pull complete 2024-06-26T07:12:49.3948738Z 5f87f50e4f6c: Pull complete 2024-06-26T07:12:49.6216812Z 629b88f68f9b: Pull complete 2024-06-26T07:12:50.5142210Z 07e387a2f372: Pull complete 2024-06-26T07:12:50.7427623Z 34d8f3f114f8: Pull complete 2024-06-26T07:12:51.8594057Z Digest: sha256:037160f9b5ec877b659f1e94829492249e0bd2fc1a009ee3abbf0528226f6e1a 2024-06-26T07:12:51.9062025Z Status: Downloaded newer image for 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:12:51.9256687Z 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:12:51.9296950Z ##[group]Run echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> "$GITHUB_OUTPUT" 2024-06-26T07:12:51.9297850Z echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> "$GITHUB_OUTPUT" 2024-06-26T07:12:51.9306478Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:12:51.9306982Z env: 2024-06-26T07:12:51.9307272Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:12:51.9307620Z ##[endgroup] 2024-06-26T07:12:51.9459349Z ##[group]Run pytorch/test-infra/.github/actions/setup-nvidia@main 2024-06-26T07:12:51.9459897Z with: 2024-06-26T07:12:51.9460440Z driver-version: 550.54.15 2024-06-26T07:12:51.9460789Z env: 2024-06-26T07:12:51.9461069Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:12:51.9461408Z ##[endgroup] 2024-06-26T07:12:51.9568971Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2024-06-26T07:12:51.9569517Z with: 2024-06-26T07:12:51.9569794Z timeout_minutes: 10 2024-06-26T07:12:51.9570121Z max_attempts: 3 2024-06-26T07:12:51.9600998Z command: # Is it disgusting to have a full shell script here in this github action? Sure # But is it the best way to make it so that this action relies on nothing else? Absolutely set -eou pipefail DISTRIBUTION=$(. /etc/os-release;echo $ID$VERSION_ID) DRIVER_FN="NVIDIA-Linux-x86_64-${DRIVER_VERSION}.run" install_nvidia_docker2_amzn2() { ( set -x # Needed for yum-config-manager sudo yum install -y yum-utils if [[ "${DISTRIBUTION}" == "amzn2023" ]] ; then YUM_REPO_URL="https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo" else # Amazon Linux 2 YUM_REPO_URL="https://nvidia.github.io/nvidia-docker/${DISTRIBUTION}/nvidia-docker.repo" fi sudo yum-config-manager --add-repo "${YUM_REPO_URL}" sudo yum install -y nvidia-docker2 sudo systemctl restart docker ) } install_nvidia_docker2_ubuntu20() { ( set -x # Install nvidia-driver package if not installed status="$(dpkg-query -W --showformat='${db:Status-Status}' nvidia-docker2 2>&1)" if [ ! $? = 0 ] || [ ! "$status" = installed ]; then sudo apt-get install -y nvidia-docker2 sudo systemctl restart docker fi ) } pre_install_nvidia_driver_amzn2() { ( # Purge any nvidia driver installed from RHEL repo sudo yum remove -y nvidia-driver-latest-dkms ) } install_nvidia_driver_common() { ( # Try to gather more information about the runner and its existing NVIDIA driver if any echo "Before installing NVIDIA driver" lspci lsmod modinfo nvidia || true HAS_NVIDIA_DRIVER=0 # Check if NVIDIA driver has already been installed if [ -x "$(command -v nvidia-smi)" ]; then set +e # The driver exists, check its version next. Also check only the first GPU if there are more than one of them # so that the same driver version is not print over multiple lines INSTALLED_DRIVER_VERSION=$(nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0) NVIDIA_SMI_STATUS=$? if [ "$NVIDIA_SMI_STATUS" -ne 0 ] && [ "$NVIDIA_SMI_STATUS" -ne 14 ]; then echo "Failed to get NVIDIA driver version ($INSTALLED_DRIVER_VERSION). Continuing" elif [ "$INSTALLED_DRIVER_VERSION" != "$DRIVER_VERSION" ]; then echo "NVIDIA driver ($INSTALLED_DRIVER_VERSION) has been installed, but we expect to have $DRIVER_VERSION instead. Continuing" else HAS_NVIDIA_DRIVER=1 echo "NVIDIA driver ($INSTALLED_DRIVER_VERSION) has already been installed. Skipping NVIDIA driver installation" fi set -e fi if [ "$HAS_NVIDIA_DRIVER" -eq 0 ]; then # CAUTION: this may need to be updated in future if [ "${DISTRIBUTION}" != ubuntu20.04 ]; then sudo yum groupinstall -y "Development Tools" # ensure our kernel install is the same as our underlying kernel, # groupinstall "Development Tools" has a habit of mismatching kernel headers sudo yum install -y "kernel-devel-uname-r == $(uname -r)" sudo modprobe backlight fi sudo curl -fsL -o /tmp/nvidia_driver "https://s3.amazonaws.com/ossci-linux/nvidia_driver/$DRIVER_FN" set +e sudo /bin/bash /tmp/nvidia_driver -s --no-drm NVIDIA_INSTALLATION_STATUS=$? RESET_GPU=0 if [ "$NVIDIA_INSTALLATION_STATUS" -ne 0 ]; then sudo cat /var/log/nvidia-installer.log # Fail to install NVIDIA driver, try to reset the GPU RESET_GPU=1 elif [ -x "$(command -v nvidia-smi)" ]; then # Check again if nvidia-smi works even if the driver installation completes successfully INSTALLED_DRIVER_VERSION=$(nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0) NVIDIA_SMI_STATUS=$? if [ "$NVIDIA_SMI_STATUS" -ne 0 ] && [ "$NVIDIA_SMI_STATUS" -ne 14 ]; then RESET_GPU=1 fi fi if [ "$RESET_GPU" -eq 1 ]; then NVIDIA_DEVICES=$(lspci -D | grep -i NVIDIA | cut -d' ' -f1) # The GPU can get stuck in a failure state if somehow the test crashs the GPU microcode. When this # happens, we'll try to reset all NVIDIA devices https://github.com/pytorch/pytorch/issues/88388 for PCI_ID in $NVIDIA_DEVICES; do DEVICE_ENABLED=$(cat /sys/bus/pci/devices/$PCI_ID/enable) echo "Reseting $PCI_ID (enabled state: $DEVICE_ENABLED)" # This requires sudo permission of course echo "1" | sudo tee /sys/bus/pci/devices/$PCI_ID/reset sleep 1 done fi sudo rm -fv /tmp/nvidia_driver set -e fi ) } post_install_nvidia_driver_common() { ( sudo modprobe nvidia || true echo "After installing NVIDIA driver" lspci lsmod modinfo nvidia || true ( set +e nvidia-smi # NB: Annoyingly, nvidia-smi command returns successfully with return code 0 even in # the case where the driver has already crashed as it still can get the driver version # and some basic information like the bus ID. However, the rest of the information # would be missing (ERR!), for example: # # +-----------------------------------------------------------------------------+ # | NVIDIA-SMI 525.89.02 Driver Version: 525.89.02 CUDA Version: 12.0 | # |-------------------------------+----------------------+----------------------+ # | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | # | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | # | | | MIG M. | # |===============================+======================+======================| # | 0 ERR! Off | 00000000:00:1E.0 Off | ERR! | # |ERR! ERR! ERR! ERR! / ERR! | 4184MiB / 23028MiB | ERR! Default | # | | | ERR! | # +-------------------------------+----------------------+----------------------+ # # +-----------------------------------------------------------------------------+ # | Processes: | # | GPU GI CI PID Type Process name GPU Memory | # | ID ID Usage | # |=============================================================================| # +-----------------------------------------------------------------------------+ # # This should be reported as a failure instead as it will guarantee to fail when # Docker tries to run with --gpus all # # So, the correct check here is to query one of the missing piece of info like # GPU name, so that the command can fail accordingly nvidia-smi --query-gpu=gpu_name --format=csv,noheader --id=0 NVIDIA_SMI_STATUS=$? # Allowable exit statuses for nvidia-smi, see: https://github.com/NVIDIA/gpu-operator/issues/285 if [ "$NVIDIA_SMI_STATUS" -eq 0 ] || [ "$NVIDIA_SMI_STATUS" -eq 14 ]; then echo "INFO: Ignoring allowed status ${NVIDIA_SMI_STATUS}" else echo "ERROR: nvidia-smi exited with unresolved status ${NVIDIA_SMI_STATUS}" exit ${NVIDIA_SMI_STATUS} fi set -e ) ) } install_nvidia_driver_amzn2() { ( set -x pre_install_nvidia_driver_amzn2 install_nvidia_driver_common post_install_nvidia_driver_common ) } install_nvidia_driver_ubuntu20() { ( set -x install_nvidia_driver_common post_install_nvidia_driver_common ) } echo "== Installing nvidia driver ${DRIVER_FN} ==" case "${DISTRIBUTION}" in amzn*) install_nvidia_driver_amzn2 ;; ubuntu20.04) install_nvidia_driver_ubuntu20 ;; *) echo "ERROR: Unknown distribution ${DISTRIBUTION}" exit 1 ;; esac # Install container toolkit based on distribution echo "== Installing nvidia container toolkit for ${DISTRIBUTION} ==" case "${DISTRIBUTION}" in amzn*) install_nvidia_docker2_amzn2 ;; ubuntu20.04) install_nvidia_docker2_ubuntu20 ;; *) echo "ERROR: Unknown distribution ${DISTRIBUTION}" exit 1 ;; esac echo "GPU_FLAG=--gpus all -e NVIDIA_DRIVER_CAPABILITIES=all" >> "${GITHUB_ENV}" 2024-06-26T07:12:51.9632464Z retry_wait_seconds: 10 2024-06-26T07:12:51.9632832Z polling_interval_seconds: 1 2024-06-26T07:12:51.9633203Z warning_on_retry: true 2024-06-26T07:12:51.9633552Z continue_on_error: false 2024-06-26T07:12:51.9633879Z env: 2024-06-26T07:12:51.9634147Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:12:51.9634495Z DRIVER_VERSION: 550.54.15 2024-06-26T07:12:51.9634838Z ##[endgroup] 2024-06-26T07:12:52.0170867Z == Installing nvidia driver NVIDIA-Linux-x86_64-550.54.15.run == 2024-06-26T07:12:52.0171680Z + pre_install_nvidia_driver_amzn2 2024-06-26T07:12:52.0172194Z + sudo yum remove -y nvidia-driver-latest-dkms 2024-06-26T07:12:52.3207288Z Loaded plugins: extras_suggestions, langpacks, priorities, update-motd 2024-06-26T07:12:52.3596842Z No Match for argument: nvidia-driver-latest-dkms 2024-06-26T07:12:52.3835322Z No Packages marked for removal 2024-06-26T07:12:52.3951503Z + install_nvidia_driver_common 2024-06-26T07:12:52.3955189Z + echo 'Before installing NVIDIA driver' 2024-06-26T07:12:52.3955671Z + lspci 2024-06-26T07:12:52.3955962Z Before installing NVIDIA driver 2024-06-26T07:12:52.4034891Z 00:00.0 Host bridge: Intel Corporation 440FX - 82441FX PMC [Natoma] 2024-06-26T07:12:52.4035683Z 00:01.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II] 2024-06-26T07:12:52.4036618Z 00:01.3 Non-VGA unclassified device: Intel Corporation 82371AB/EB/MB PIIX4 ACPI (rev 08) 2024-06-26T07:12:52.4037691Z 00:03.0 VGA compatible controller: Amazon.com, Inc. Device 1111 2024-06-26T07:12:52.4038537Z 00:04.0 Non-Volatile memory controller: Amazon.com, Inc. Device 8061 2024-06-26T07:12:52.4039286Z 00:05.0 Ethernet controller: Amazon.com, Inc. Elastic Network Adapter (ENA) 2024-06-26T07:12:52.4040001Z 00:1e.0 3D controller: NVIDIA Corporation Device 2237 (rev a1) 2024-06-26T07:12:52.4040772Z 00:1f.0 Non-Volatile memory controller: Amazon.com, Inc. NVMe SSD Controller 2024-06-26T07:12:52.4041354Z + lsmod 2024-06-26T07:12:52.4048319Z Module Size Used by 2024-06-26T07:12:52.4048748Z ib_core 266240 0 2024-06-26T07:12:52.4049127Z nvidia_modeset 1339392 0 2024-06-26T07:12:52.4049613Z nvidia_uvm 4599808 0 2024-06-26T07:12:52.4050244Z nvidia 53989376 2 nvidia_uvm,nvidia_modeset 2024-06-26T07:12:52.4050910Z drm 421888 1 nvidia 2024-06-26T07:12:52.4051675Z i2c_core 77824 2 nvidia,drm 2024-06-26T07:12:52.4052314Z veth 16384 0 2024-06-26T07:12:52.4052937Z backlight 16384 1 nvidia_modeset 2024-06-26T07:12:52.4053574Z xt_conntrack 16384 1 2024-06-26T07:12:52.4054297Z ipt_MASQUERADE 16384 1 2024-06-26T07:12:52.4054921Z nf_nat_masquerade_ipv4 16384 1 ipt_MASQUERADE 2024-06-26T07:12:52.4055585Z nf_conntrack_netlink 49152 0 2024-06-26T07:12:52.4056250Z nfnetlink 16384 2 nf_conntrack_netlink 2024-06-26T07:12:52.4056926Z xfrm_user 45056 1 2024-06-26T07:12:52.4057358Z xfrm_algo 16384 1 xfrm_user 2024-06-26T07:12:52.4057781Z iptable_nat 16384 1 2024-06-26T07:12:52.4058164Z nf_conntrack_ipv4 16384 3 2024-06-26T07:12:52.4058588Z nf_defrag_ipv4 16384 1 nf_conntrack_ipv4 2024-06-26T07:12:52.4059065Z nf_nat_ipv4 16384 1 iptable_nat 2024-06-26T07:12:52.4059608Z nf_nat 32768 2 nf_nat_masquerade_ipv4,nf_nat_ipv4 2024-06-26T07:12:52.4060894Z nf_conntrack 155648 7 xt_conntrack,nf_nat_masquerade_ipv4,nf_conntrack_ipv4,nf_nat,ipt_MASQUERADE,nf_nat_ipv4,nf_conntrack_netlink 2024-06-26T07:12:52.4061732Z xt_addrtype 16384 2 2024-06-26T07:12:52.4062112Z iptable_filter 16384 1 2024-06-26T07:12:52.4062490Z br_netfilter 24576 0 2024-06-26T07:12:52.4062899Z bridge 172032 1 br_netfilter 2024-06-26T07:12:52.4063335Z stp 16384 1 bridge 2024-06-26T07:12:52.4063759Z llc 16384 2 bridge,stp 2024-06-26T07:12:52.4064180Z overlay 86016 0 2024-06-26T07:12:52.4064546Z sunrpc 393216 1 2024-06-26T07:12:52.4064980Z dm_mirror 28672 0 2024-06-26T07:12:52.4065382Z dm_region_hash 20480 1 dm_mirror 2024-06-26T07:12:52.4065869Z dm_log 20480 2 dm_region_hash,dm_mirror 2024-06-26T07:12:52.4066377Z dm_mod 143360 2 dm_log,dm_mirror 2024-06-26T07:12:52.4066822Z dax 69632 1 dm_mod 2024-06-26T07:12:52.4067223Z crc32_pclmul 16384 0 2024-06-26T07:12:52.4067605Z ghash_clmulni_intel 16384 0 2024-06-26T07:12:52.4067985Z pcbc 16384 0 2024-06-26T07:12:52.4068348Z aesni_intel 188416 0 2024-06-26T07:12:52.4068747Z aes_x86_64 20480 1 aesni_intel 2024-06-26T07:12:52.4069197Z crypto_simd 16384 1 aesni_intel 2024-06-26T07:12:52.4069646Z glue_helper 16384 1 aesni_intel 2024-06-26T07:12:52.4070195Z cryptd 28672 3 crypto_simd,ghash_clmulni_intel,aesni_intel 2024-06-26T07:12:52.4070732Z mousedev 24576 0 2024-06-26T07:12:52.4071104Z evdev 20480 3 2024-06-26T07:12:52.4071476Z psmouse 32768 0 2024-06-26T07:12:52.4071837Z button 16384 0 2024-06-26T07:12:52.4072203Z ena 139264 0 2024-06-26T07:12:52.4072615Z ptp 20480 1 ena 2024-06-26T07:12:52.4073027Z pps_core 20480 1 ptp 2024-06-26T07:12:52.4073421Z crc32c_intel 24576 0 2024-06-26T07:12:52.4074009Z autofs4 49152 2 2024-06-26T07:12:52.4074369Z + modinfo nvidia 2024-06-26T07:12:52.4075010Z filename: /lib/modules/4.14.336-257.562.amzn2.x86_64/kernel/drivers/video/nvidia.ko 2024-06-26T07:12:52.4075691Z alias: char-major-195-* 2024-06-26T07:12:52.4076072Z version: 550.54.15 2024-06-26T07:12:52.4076418Z supported: external 2024-06-26T07:12:52.4076753Z license: NVIDIA 2024-06-26T07:12:52.4077129Z firmware: nvidia/550.54.15/gsp_tu10x.bin 2024-06-26T07:12:52.4077609Z firmware: nvidia/550.54.15/gsp_ga10x.bin 2024-06-26T07:12:52.4078060Z srcversion: 833721318DA517F0C2FEC97 2024-06-26T07:12:52.4078524Z alias: pci:v000010DEd*sv*sd*bc06sc80i00* 2024-06-26T07:12:52.4079022Z alias: pci:v000010DEd*sv*sd*bc03sc02i00* 2024-06-26T07:12:52.4079508Z alias: pci:v000010DEd*sv*sd*bc03sc00i00* 2024-06-26T07:12:52.4080055Z depends: i2c-core,drm 2024-06-26T07:12:52.4080418Z retpoline: Y 2024-06-26T07:12:52.4080738Z name: nvidia 2024-06-26T07:12:52.4081286Z vermagic: 4.14.336-257.562.amzn2.x86_64 SMP mod_unload modversions 2024-06-26T07:12:52.4081926Z parm: NvSwitchRegDwords:NvSwitch regkey (charp) 2024-06-26T07:12:52.4082566Z parm: NvSwitchBlacklist:NvSwitchBlacklist=uuid[,uuid...] (charp) 2024-06-26T07:12:52.4083155Z parm: NVreg_ResmanDebugLevel:int 2024-06-26T07:12:52.4083594Z parm: NVreg_RmLogonRC:int 2024-06-26T07:12:52.4084020Z parm: NVreg_ModifyDeviceFiles:int 2024-06-26T07:12:52.4084474Z parm: NVreg_DeviceFileUID:int 2024-06-26T07:12:52.4084911Z parm: NVreg_DeviceFileGID:int 2024-06-26T07:12:52.4085347Z parm: NVreg_DeviceFileMode:int 2024-06-26T07:12:52.4085870Z parm: NVreg_InitializeSystemMemoryAllocations:int 2024-06-26T07:12:52.4086428Z parm: NVreg_UsePageAttributeTable:int 2024-06-26T07:12:52.4086912Z parm: NVreg_EnablePCIeGen3:int 2024-06-26T07:12:52.4087337Z parm: NVreg_EnableMSI:int 2024-06-26T07:12:52.4087761Z parm: NVreg_TCEBypassMode:int 2024-06-26T07:12:52.4088215Z parm: NVreg_EnableStreamMemOPs:int 2024-06-26T07:12:52.4088743Z parm: NVreg_RestrictProfilingToAdminUsers:int 2024-06-26T07:12:52.4089312Z parm: NVreg_PreserveVideoMemoryAllocations:int 2024-06-26T07:12:52.4089870Z parm: NVreg_EnableS0ixPowerManagement:int 2024-06-26T07:12:52.4090478Z parm: NVreg_S0ixPowerManagementVideoMemoryThreshold:int 2024-06-26T07:12:52.4091066Z parm: NVreg_DynamicPowerManagement:int 2024-06-26T07:12:52.4091665Z parm: NVreg_DynamicPowerManagementVideoMemoryThreshold:int 2024-06-26T07:12:52.4092255Z parm: NVreg_EnableGpuFirmware:int 2024-06-26T07:12:52.4092741Z parm: NVreg_EnableGpuFirmwareLogs:int 2024-06-26T07:12:52.4093274Z parm: NVreg_OpenRmEnableUnsupportedGpus:int 2024-06-26T07:12:52.4093911Z parm: NVreg_EnableUserNUMAManagement:int 2024-06-26T07:12:52.4094420Z parm: NVreg_MemoryPoolSize:int 2024-06-26T07:12:52.4094892Z parm: NVreg_KMallocHeapMaxSize:int 2024-06-26T07:12:52.4095374Z parm: NVreg_VMallocHeapMaxSize:int 2024-06-26T07:12:52.4095840Z parm: NVreg_IgnoreMMIOCheck:int 2024-06-26T07:12:52.4096284Z parm: NVreg_NvLinkDisable:int 2024-06-26T07:12:52.4096785Z parm: NVreg_EnablePCIERelaxedOrderingMode:int 2024-06-26T07:12:52.4097309Z parm: NVreg_RegisterPCIDriver:int 2024-06-26T07:12:52.4097777Z parm: NVreg_EnableResizableBar:int 2024-06-26T07:12:52.4098263Z parm: NVreg_EnableDbgBreakpoint:int 2024-06-26T07:12:52.4098757Z parm: NVreg_EnableNonblockingOpen:int 2024-06-26T07:12:52.4099240Z parm: NVreg_RegistryDwords:charp 2024-06-26T07:12:52.4099728Z parm: NVreg_RegistryDwordsPerDevice:charp 2024-06-26T07:12:52.4100420Z parm: NVreg_RmMsg:charp 2024-06-26T07:12:52.4100837Z parm: NVreg_GpuBlacklist:charp 2024-06-26T07:12:52.4101394Z parm: NVreg_TemporaryFilePath:charp 2024-06-26T07:12:52.4101864Z parm: NVreg_ExcludedGpus:charp 2024-06-26T07:12:52.4102317Z parm: NVreg_DmaRemapPeerMmio:int 2024-06-26T07:12:52.4102790Z parm: NVreg_RmNvlinkBandwidth:charp 2024-06-26T07:12:52.4103261Z parm: NVreg_ImexChannelCount:int 2024-06-26T07:12:52.4103714Z parm: rm_firmware_active:charp 2024-06-26T07:12:52.4104129Z + HAS_NVIDIA_DRIVER=0 2024-06-26T07:12:52.4104507Z ++ command -v nvidia-smi 2024-06-26T07:12:52.4104896Z + '[' -x /usr/bin/nvidia-smi ']' 2024-06-26T07:12:52.4105265Z + set +e 2024-06-26T07:12:52.4105767Z ++ nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0 2024-06-26T07:12:54.3932978Z + INSTALLED_DRIVER_VERSION=550.54.15 2024-06-26T07:12:54.3933615Z + NVIDIA_SMI_STATUS=0 2024-06-26T07:12:54.3934339Z + '[' 0 -ne 0 ']' 2024-06-26T07:12:54.3935141Z + '[' 550.54.15 '!=' 550.54.15 ']' 2024-06-26T07:12:54.3935547Z + HAS_NVIDIA_DRIVER=1 2024-06-26T07:12:54.3936448Z + echo 'NVIDIA driver (550.54.15) has already been installed. Skipping NVIDIA driver installation' 2024-06-26T07:12:54.3937408Z + set -e 2024-06-26T07:12:54.3937827Z + '[' 1 -eq 0 ']' 2024-06-26T07:12:54.3938602Z NVIDIA driver (550.54.15) has already been installed. Skipping NVIDIA driver installation 2024-06-26T07:12:54.3939553Z + post_install_nvidia_driver_common 2024-06-26T07:12:54.3940385Z + sudo modprobe nvidia 2024-06-26T07:12:54.4035106Z + echo 'After installing NVIDIA driver' 2024-06-26T07:12:54.4035665Z + lspci 2024-06-26T07:12:54.4035968Z After installing NVIDIA driver 2024-06-26T07:12:54.4120890Z 00:00.0 Host bridge: Intel Corporation 440FX - 82441FX PMC [Natoma] 2024-06-26T07:12:54.4121893Z 00:01.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II] 2024-06-26T07:12:54.4122825Z 00:01.3 Non-VGA unclassified device: Intel Corporation 82371AB/EB/MB PIIX4 ACPI (rev 08) 2024-06-26T07:12:54.4123634Z 00:03.0 VGA compatible controller: Amazon.com, Inc. Device 1111 2024-06-26T07:12:54.4124380Z 00:04.0 Non-Volatile memory controller: Amazon.com, Inc. Device 8061 2024-06-26T07:12:54.4125174Z 00:05.0 Ethernet controller: Amazon.com, Inc. Elastic Network Adapter (ENA) 2024-06-26T07:12:54.4125884Z 00:1e.0 3D controller: NVIDIA Corporation Device 2237 (rev a1) 2024-06-26T07:12:54.4126656Z 00:1f.0 Non-Volatile memory controller: Amazon.com, Inc. NVMe SSD Controller 2024-06-26T07:12:54.4127236Z + lsmod 2024-06-26T07:12:54.4135282Z Module Size Used by 2024-06-26T07:12:54.4135724Z ib_core 266240 0 2024-06-26T07:12:54.4136169Z nvidia_modeset 1339392 0 2024-06-26T07:12:54.4136687Z nvidia_uvm 4599808 0 2024-06-26T07:12:54.4137269Z nvidia 53989376 2 nvidia_uvm,nvidia_modeset 2024-06-26T07:12:54.4137864Z drm 421888 1 nvidia 2024-06-26T07:12:54.4138370Z i2c_core 77824 2 nvidia,drm 2024-06-26T07:12:54.4138887Z veth 16384 0 2024-06-26T07:12:54.4139434Z backlight 16384 1 nvidia_modeset 2024-06-26T07:12:54.4140270Z xt_conntrack 16384 1 2024-06-26T07:12:54.4140802Z ipt_MASQUERADE 16384 1 2024-06-26T07:12:54.4141268Z nf_nat_masquerade_ipv4 16384 1 ipt_MASQUERADE 2024-06-26T07:12:54.4141738Z nf_conntrack_netlink 49152 0 2024-06-26T07:12:54.4142193Z nfnetlink 16384 2 nf_conntrack_netlink 2024-06-26T07:12:54.4142664Z xfrm_user 45056 1 2024-06-26T07:12:54.4143061Z xfrm_algo 16384 1 xfrm_user 2024-06-26T07:12:54.4143478Z iptable_nat 16384 1 2024-06-26T07:12:54.4143862Z nf_conntrack_ipv4 16384 3 2024-06-26T07:12:54.4144424Z nf_defrag_ipv4 16384 1 nf_conntrack_ipv4 2024-06-26T07:12:54.4145117Z nf_nat_ipv4 16384 1 iptable_nat 2024-06-26T07:12:54.4145802Z nf_nat 32768 2 nf_nat_masquerade_ipv4,nf_nat_ipv4 2024-06-26T07:12:54.4147048Z nf_conntrack 155648 7 xt_conntrack,nf_nat_masquerade_ipv4,nf_conntrack_ipv4,nf_nat,ipt_MASQUERADE,nf_nat_ipv4,nf_conntrack_netlink 2024-06-26T07:12:54.4148410Z xt_addrtype 16384 2 2024-06-26T07:12:54.4148917Z iptable_filter 16384 1 2024-06-26T07:12:54.4149335Z br_netfilter 24576 0 2024-06-26T07:12:54.4149750Z bridge 172032 1 br_netfilter 2024-06-26T07:12:54.4150189Z stp 16384 1 bridge 2024-06-26T07:12:54.4150605Z llc 16384 2 bridge,stp 2024-06-26T07:12:54.4151021Z overlay 86016 0 2024-06-26T07:12:54.4151391Z sunrpc 393216 1 2024-06-26T07:12:54.4151806Z dm_mirror 28672 0 2024-06-26T07:12:54.4152200Z dm_region_hash 20480 1 dm_mirror 2024-06-26T07:12:54.4152779Z dm_log 20480 2 dm_region_hash,dm_mirror 2024-06-26T07:12:54.4153293Z dm_mod 143360 2 dm_log,dm_mirror 2024-06-26T07:12:54.4153741Z dax 69632 1 dm_mod 2024-06-26T07:12:54.4154272Z crc32_pclmul 16384 0 2024-06-26T07:12:54.4154692Z ghash_clmulni_intel 16384 0 2024-06-26T07:12:54.4155107Z pcbc 16384 0 2024-06-26T07:12:54.4155474Z aesni_intel 188416 0 2024-06-26T07:12:54.4155876Z aes_x86_64 20480 1 aesni_intel 2024-06-26T07:12:54.4156333Z crypto_simd 16384 1 aesni_intel 2024-06-26T07:12:54.4156788Z glue_helper 16384 1 aesni_intel 2024-06-26T07:12:54.4157331Z cryptd 28672 3 crypto_simd,ghash_clmulni_intel,aesni_intel 2024-06-26T07:12:54.4157867Z mousedev 24576 0 2024-06-26T07:12:54.4158242Z evdev 20480 3 2024-06-26T07:12:54.4158612Z psmouse 32768 0 2024-06-26T07:12:54.4158975Z button 16384 0 2024-06-26T07:12:54.4159341Z ena 139264 0 2024-06-26T07:12:54.4159713Z ptp 20480 1 ena 2024-06-26T07:12:54.4160109Z pps_core 20480 1 ptp 2024-06-26T07:12:54.4160504Z crc32c_intel 24576 0 2024-06-26T07:12:54.4160873Z autofs4 49152 2 2024-06-26T07:12:54.4161235Z + modinfo nvidia 2024-06-26T07:12:54.4161926Z filename: /lib/modules/4.14.336-257.562.amzn2.x86_64/kernel/drivers/video/nvidia.ko 2024-06-26T07:12:54.4162608Z alias: char-major-195-* 2024-06-26T07:12:54.4162995Z version: 550.54.15 2024-06-26T07:12:54.4163344Z supported: external 2024-06-26T07:12:54.4163692Z license: NVIDIA 2024-06-26T07:12:54.4164067Z firmware: nvidia/550.54.15/gsp_tu10x.bin 2024-06-26T07:12:54.4164554Z firmware: nvidia/550.54.15/gsp_ga10x.bin 2024-06-26T07:12:54.4165018Z srcversion: 833721318DA517F0C2FEC97 2024-06-26T07:12:54.4165483Z alias: pci:v000010DEd*sv*sd*bc06sc80i00* 2024-06-26T07:12:54.4165990Z alias: pci:v000010DEd*sv*sd*bc03sc02i00* 2024-06-26T07:12:54.4166491Z alias: pci:v000010DEd*sv*sd*bc03sc00i00* 2024-06-26T07:12:54.4166980Z depends: i2c-core,drm 2024-06-26T07:12:54.4167338Z retpoline: Y 2024-06-26T07:12:54.4167661Z name: nvidia 2024-06-26T07:12:54.4168215Z vermagic: 4.14.336-257.562.amzn2.x86_64 SMP mod_unload modversions 2024-06-26T07:12:54.4168879Z parm: NvSwitchRegDwords:NvSwitch regkey (charp) 2024-06-26T07:12:54.4169508Z parm: NvSwitchBlacklist:NvSwitchBlacklist=uuid[,uuid...] (charp) 2024-06-26T07:12:54.4170099Z parm: NVreg_ResmanDebugLevel:int 2024-06-26T07:12:54.4170543Z parm: NVreg_RmLogonRC:int 2024-06-26T07:12:54.4170971Z parm: NVreg_ModifyDeviceFiles:int 2024-06-26T07:12:54.4171414Z parm: NVreg_DeviceFileUID:int 2024-06-26T07:12:54.4171844Z parm: NVreg_DeviceFileGID:int 2024-06-26T07:12:54.4172276Z parm: NVreg_DeviceFileMode:int 2024-06-26T07:12:54.4172798Z parm: NVreg_InitializeSystemMemoryAllocations:int 2024-06-26T07:12:54.4173345Z parm: NVreg_UsePageAttributeTable:int 2024-06-26T07:12:54.4173933Z parm: NVreg_EnablePCIeGen3:int 2024-06-26T07:12:54.4174371Z parm: NVreg_EnableMSI:int 2024-06-26T07:12:54.4174827Z parm: NVreg_TCEBypassMode:int 2024-06-26T07:12:54.4175367Z parm: NVreg_EnableStreamMemOPs:int 2024-06-26T07:12:54.4175888Z parm: NVreg_RestrictProfilingToAdminUsers:int 2024-06-26T07:12:54.4176460Z parm: NVreg_PreserveVideoMemoryAllocations:int 2024-06-26T07:12:54.4177007Z parm: NVreg_EnableS0ixPowerManagement:int 2024-06-26T07:12:54.4177606Z parm: NVreg_S0ixPowerManagementVideoMemoryThreshold:int 2024-06-26T07:12:54.4178195Z parm: NVreg_DynamicPowerManagement:int 2024-06-26T07:12:54.4178804Z parm: NVreg_DynamicPowerManagementVideoMemoryThreshold:int 2024-06-26T07:12:54.4179380Z parm: NVreg_EnableGpuFirmware:int 2024-06-26T07:12:54.4179866Z parm: NVreg_EnableGpuFirmwareLogs:int 2024-06-26T07:12:54.4180632Z parm: NVreg_OpenRmEnableUnsupportedGpus:int 2024-06-26T07:12:54.4181178Z parm: NVreg_EnableUserNUMAManagement:int 2024-06-26T07:12:54.4181759Z parm: NVreg_MemoryPoolSize:int 2024-06-26T07:12:54.4182232Z parm: NVreg_KMallocHeapMaxSize:int 2024-06-26T07:12:54.4182732Z parm: NVreg_VMallocHeapMaxSize:int 2024-06-26T07:12:54.4183197Z parm: NVreg_IgnoreMMIOCheck:int 2024-06-26T07:12:54.4183634Z parm: NVreg_NvLinkDisable:int 2024-06-26T07:12:54.4184133Z parm: NVreg_EnablePCIERelaxedOrderingMode:int 2024-06-26T07:12:54.4184648Z parm: NVreg_RegisterPCIDriver:int 2024-06-26T07:12:54.4185173Z parm: NVreg_EnableResizableBar:int 2024-06-26T07:12:54.4185646Z parm: NVreg_EnableDbgBreakpoint:int 2024-06-26T07:12:54.4186139Z parm: NVreg_EnableNonblockingOpen:int 2024-06-26T07:12:54.4186618Z parm: NVreg_RegistryDwords:charp 2024-06-26T07:12:54.4187104Z parm: NVreg_RegistryDwordsPerDevice:charp 2024-06-26T07:12:54.4187580Z parm: NVreg_RmMsg:charp 2024-06-26T07:12:54.4187988Z parm: NVreg_GpuBlacklist:charp 2024-06-26T07:12:54.4188462Z parm: NVreg_TemporaryFilePath:charp 2024-06-26T07:12:54.4188921Z parm: NVreg_ExcludedGpus:charp 2024-06-26T07:12:54.4189380Z parm: NVreg_DmaRemapPeerMmio:int 2024-06-26T07:12:54.4189870Z parm: NVreg_RmNvlinkBandwidth:charp 2024-06-26T07:12:54.4190347Z parm: NVreg_ImexChannelCount:int 2024-06-26T07:12:54.4190797Z parm: rm_firmware_active:charp 2024-06-26T07:12:54.4191201Z + set +e 2024-06-26T07:12:54.4191520Z + nvidia-smi 2024-06-26T07:12:55.9814661Z Wed Jun 26 07:12:55 2024 2024-06-26T07:12:55.9829750Z +-----------------------------------------------------------------------------------------+ 2024-06-26T07:12:55.9830785Z | NVIDIA-SMI 550.54.15 Driver Version: 550.54.15 CUDA Version: 12.4 | 2024-06-26T07:12:55.9831571Z |-----------------------------------------+------------------------+----------------------+ 2024-06-26T07:12:55.9832378Z | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | 2024-06-26T07:12:55.9833263Z | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | 2024-06-26T07:12:55.9833957Z | | | MIG M. | 2024-06-26T07:12:55.9834495Z |=========================================+========================+======================| 2024-06-26T07:12:55.9943142Z | 0 NVIDIA A10G Off | 00000000:00:1E.0 Off | 0 | 2024-06-26T07:12:55.9945047Z | 0% 34C P0 60W / 300W | 0MiB / 23028MiB | 0% Default | 2024-06-26T07:12:55.9946027Z | | | N/A | 2024-06-26T07:12:55.9946714Z +-----------------------------------------+------------------------+----------------------+ 2024-06-26T07:12:55.9947292Z 2024-06-26T07:12:55.9947964Z +-----------------------------------------------------------------------------------------+ 2024-06-26T07:12:55.9948831Z | Processes: | 2024-06-26T07:12:55.9949529Z | GPU GI CI PID Type Process name GPU Memory | 2024-06-26T07:12:55.9950224Z | ID ID Usage | 2024-06-26T07:12:55.9950785Z |=========================================================================================| 2024-06-26T07:12:55.9951433Z | No running processes found | 2024-06-26T07:12:55.9952191Z +-----------------------------------------------------------------------------------------+ 2024-06-26T07:12:56.6051015Z + nvidia-smi --query-gpu=gpu_name --format=csv,noheader --id=0 2024-06-26T07:12:58.1560895Z NVIDIA A10G 2024-06-26T07:12:58.6018076Z + NVIDIA_SMI_STATUS=0 2024-06-26T07:12:58.6019081Z + '[' 0 -eq 0 ']' 2024-06-26T07:12:58.6019582Z + echo 'INFO: Ignoring allowed status 0' 2024-06-26T07:12:58.6020487Z + set -e 2024-06-26T07:12:58.6020792Z INFO: Ignoring allowed status 0 2024-06-26T07:12:58.6022137Z == Installing nvidia container toolkit for amzn2 == 2024-06-26T07:12:58.6024019Z + sudo yum install -y yum-utils 2024-06-26T07:12:58.9080413Z Loaded plugins: extras_suggestions, langpacks, priorities, update-motd 2024-06-26T07:13:00.3943093Z Package yum-utils-1.1.31-46.amzn2.0.1.noarch already installed and latest version 2024-06-26T07:13:00.3943792Z Nothing to do 2024-06-26T07:13:00.5458248Z + [[ amzn2 == \a\m\z\n\2\0\2\3 ]] 2024-06-26T07:13:00.5459415Z + YUM_REPO_URL=https://nvidia.github.io/nvidia-docker/amzn2/nvidia-docker.repo 2024-06-26T07:13:00.5461140Z + sudo yum-config-manager --add-repo https://nvidia.github.io/nvidia-docker/amzn2/nvidia-docker.repo 2024-06-26T07:13:00.8721712Z Loaded plugins: extras_suggestions, langpacks, priorities, update-motd 2024-06-26T07:13:00.8960231Z adding repo from: https://nvidia.github.io/nvidia-docker/amzn2/nvidia-docker.repo 2024-06-26T07:13:00.8961405Z grabbing file https://nvidia.github.io/nvidia-docker/amzn2/nvidia-docker.repo to /etc/yum.repos.d/nvidia-docker.repo 2024-06-26T07:13:00.8962502Z repo saved to /etc/yum.repos.d/nvidia-docker.repo 2024-06-26T07:13:00.9078021Z + sudo yum install -y nvidia-docker2 2024-06-26T07:13:01.2192904Z Loaded plugins: extras_suggestions, langpacks, priorities, update-motd 2024-06-26T07:13:02.6693067Z Package nvidia-docker2-2.13.0-1.noarch already installed and latest version 2024-06-26T07:13:02.6693939Z Nothing to do 2024-06-26T07:13:02.8173845Z + sudo systemctl restart docker 2024-06-26T07:13:36.0626496Z Command completed after 1 attempt(s). 2024-06-26T07:13:36.0684008Z ##[group]Run python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84 2024-06-26T07:13:36.0684760Z python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84 2024-06-26T07:13:36.0685437Z python3 -m tools.stats.monitor > usage_log.txt 2>&1 & 2024-06-26T07:13:36.0686077Z echo "monitor-script-pid=${!}" >> "${GITHUB_OUTPUT}" 2024-06-26T07:13:36.0693826Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:13:36.0694397Z env: 2024-06-26T07:13:36.0694675Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:13:36.0695122Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:13:36.0695590Z ##[endgroup] 2024-06-26T07:13:36.2916105Z Defaulting to user installation because normal site-packages is not writeable 2024-06-26T07:13:36.3079208Z Requirement already satisfied: psutil==5.9.1 in /home/ec2-user/.local/lib/python3.7/site-packages (5.9.1) 2024-06-26T07:13:36.3180597Z Requirement already satisfied: nvidia-ml-py==11.525.84 in /home/ec2-user/.local/lib/python3.7/site-packages (11.525.84) 2024-06-26T07:13:36.4277617Z Prepare all required actions 2024-06-26T07:13:36.4278339Z Getting action download info 2024-06-26T07:13:36.5401198Z Download action repository 'seemethere/download-artifact-s3@v4' (SHA:1da556a7aa0a088e3153970611f6c432d58e80e6) 2024-06-26T07:13:36.7012449Z Download action repository 'actions/download-artifact@v3' (SHA:9bc31d5ccc31df68ecc42ccf4149144866c47d8a) 2024-06-26T07:13:36.8272514Z ##[group]Run ./.github/actions/download-build-artifacts 2024-06-26T07:13:36.8273014Z with: 2024-06-26T07:13:36.8273360Z name: linux-focal-cuda12.4-py3.10-gcc9-sm86 2024-06-26T07:13:36.8273814Z s3-bucket: gha-artifacts 2024-06-26T07:13:36.8274163Z env: 2024-06-26T07:13:36.8274440Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:13:36.8274904Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:13:36.8275397Z ##[endgroup] 2024-06-26T07:13:36.8307320Z ##[group]Run seemethere/download-artifact-s3@v4 2024-06-26T07:13:36.8307771Z with: 2024-06-26T07:13:36.8308148Z name: linux-focal-cuda12.4-py3.10-gcc9-sm86 2024-06-26T07:13:36.8308605Z s3-bucket: gha-artifacts 2024-06-26T07:13:36.8308965Z region: us-east-1 2024-06-26T07:13:36.8309271Z env: 2024-06-26T07:13:36.8309549Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:13:36.8310008Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:13:36.8310507Z ##[endgroup] 2024-06-26T07:13:37.2474910Z (node:20674) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2024-06-26T07:13:37.2475774Z 2024-06-26T07:13:37.2476038Z Please migrate your code to use AWS SDK for JavaScript (v3). 2024-06-26T07:13:37.2476770Z For more information, check the migration guide at https://a.co/7PzMCcy 2024-06-26T07:13:37.2477779Z (Use `node --trace-warnings ...` to show where the warning was created) 2024-06-26T07:13:37.3208753Z Found 1 objects with prefix pytorch/pytorch/9673646808/linux-focal-cuda12.4-py3.10-gcc9-sm86/ 2024-06-26T07:13:37.3210012Z Starting download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2024-06-26T07:14:02.4882363Z Finished download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2024-06-26T07:14:02.4888086Z Artifact download has finished successfully 2024-06-26T07:14:02.5041343Z ##[group]Run unzip -o artifacts.zip 2024-06-26T07:14:02.5041990Z unzip -o artifacts.zip 2024-06-26T07:14:02.5049464Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:14:02.5049954Z env: 2024-06-26T07:14:02.5050235Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:14:02.5050687Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:14:02.5051157Z ##[endgroup] 2024-06-26T07:14:02.5076786Z Archive: artifacts.zip 2024-06-26T07:14:02.5078410Z creating: dist/ 2024-06-26T07:14:04.4879611Z inflating: dist/torch-2.5.0a0+gitb8c4c54-cp310-cp310-linux_x86_64.whl 2024-06-26T07:14:04.4880895Z creating: build/custom_test_artifacts/ 2024-06-26T07:14:04.4881559Z creating: build/custom_test_artifacts/custom-op-build/ 2024-06-26T07:14:04.4882289Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/ 2024-06-26T07:14:04.4883110Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/pkgRedirects/ 2024-06-26T07:14:04.4886692Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeConfigureLog.yaml 2024-06-26T07:14:04.4887782Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/ 2024-06-26T07:14:04.4888895Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-06-26T07:14:04.4889873Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-06-26T07:14:04.4890815Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-06-26T07:14:04.4892023Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-06-26T07:14:04.4893297Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-06-26T07:14:04.4894386Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-06-26T07:14:04.4895367Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-06-26T07:14:04.4896484Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-06-26T07:14:04.4897762Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-06-26T07:14:04.4898887Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-06-26T07:14:04.4900276Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-06-26T07:14:04.4901487Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-06-26T07:14:04.4902713Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-06-26T07:14:04.4903738Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/ 2024-06-26T07:14:04.4904726Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/ 2024-06-26T07:14:04.4942337Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2024-06-26T07:14:04.4982003Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2024-06-26T07:14:04.4983406Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2024-06-26T07:14:04.5028320Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2024-06-26T07:14:04.5029697Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2024-06-26T07:14:04.5031093Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2024-06-26T07:14:04.5032533Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2024-06-26T07:14:04.5033914Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2024-06-26T07:14:04.5035264Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2024-06-26T07:14:04.5036622Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2024-06-26T07:14:04.5037981Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2024-06-26T07:14:04.5039294Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2024-06-26T07:14:04.5040550Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2024-06-26T07:14:04.5041803Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c 2024-06-26T07:14:04.5042998Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin 2024-06-26T07:14:04.5044204Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2024-06-26T07:14:04.5045383Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o 2024-06-26T07:14:04.5046568Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu 2024-06-26T07:14:04.5111847Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out 2024-06-26T07:14:04.5183102Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin 2024-06-26T07:14:04.5184262Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake 2024-06-26T07:14:04.5185333Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeScratch/ 2024-06-26T07:14:04.5186191Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeTmp/ 2024-06-26T07:14:04.5187085Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/cmake.check_cache 2024-06-26T07:14:04.5188008Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/ 2024-06-26T07:14:04.5189028Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.ts 2024-06-26T07:14:04.5190166Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.make 2024-06-26T07:14:04.5191279Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/depend.make 2024-06-26T07:14:04.5192334Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/link.txt 2024-06-26T07:14:04.5193395Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/cmake_clean.cmake 2024-06-26T07:14:04.5194470Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/build.make 2024-06-26T07:14:04.5195549Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/DependInfo.cmake 2024-06-26T07:14:04.5196605Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/flags.make 2024-06-26T07:14:04.5197664Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/progress.make 2024-06-26T07:14:04.5210657Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o.d 2024-06-26T07:14:04.5339454Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o 2024-06-26T07:14:04.5341434Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/ 2024-06-26T07:14:04.5342505Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.ts 2024-06-26T07:14:04.5343710Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.make 2024-06-26T07:14:04.5344855Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/depend.make 2024-06-26T07:14:04.5345932Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/link.txt 2024-06-26T07:14:04.5347045Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/cmake_clean.cmake 2024-06-26T07:14:04.5348168Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/build.make 2024-06-26T07:14:04.5349291Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/DependInfo.cmake 2024-06-26T07:14:04.5350410Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/flags.make 2024-06-26T07:14:04.5351508Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/progress.make 2024-06-26T07:14:04.5364720Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o.d 2024-06-26T07:14:04.5445496Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o 2024-06-26T07:14:04.5447837Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-06-26T07:14:04.5449929Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/TargetDirectories.txt 2024-06-26T07:14:04.5451939Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/progress.marks 2024-06-26T07:14:04.5452875Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile2 2024-06-26T07:14:04.5453774Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile.cmake 2024-06-26T07:14:04.5454758Z inflating: build/custom_test_artifacts/custom-op-build/detect_cuda_version.cc 2024-06-26T07:14:04.5455678Z inflating: build/custom_test_artifacts/custom-op-build/CMakeCache.txt 2024-06-26T07:14:04.5456456Z inflating: build/custom_test_artifacts/custom-op-build/Makefile 2024-06-26T07:14:04.5457254Z inflating: build/custom_test_artifacts/custom-op-build/cmake_install.cmake 2024-06-26T07:14:04.5560314Z inflating: build/custom_test_artifacts/custom-op-build/libcustom_ops.so 2024-06-26T07:14:04.5620878Z inflating: build/custom_test_artifacts/custom-op-build/test_custom_ops 2024-06-26T07:14:04.5621697Z creating: build/custom_test_artifacts/jit-hook-build/ 2024-06-26T07:14:04.5622389Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/ 2024-06-26T07:14:04.5623190Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/pkgRedirects/ 2024-06-26T07:14:04.5628800Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeConfigureLog.yaml 2024-06-26T07:14:04.5629715Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/ 2024-06-26T07:14:04.5630638Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-06-26T07:14:04.5631595Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-06-26T07:14:04.5632541Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-06-26T07:14:04.5633604Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-06-26T07:14:04.5634784Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-06-26T07:14:04.5635762Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-06-26T07:14:04.5636728Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-06-26T07:14:04.5637846Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-06-26T07:14:04.5638984Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-06-26T07:14:04.5640431Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-06-26T07:14:04.5641672Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-06-26T07:14:04.5642942Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-06-26T07:14:04.5644192Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-06-26T07:14:04.5645220Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/ 2024-06-26T07:14:04.5646198Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/ 2024-06-26T07:14:04.5683985Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2024-06-26T07:14:04.5723817Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2024-06-26T07:14:04.5725223Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2024-06-26T07:14:04.5769319Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2024-06-26T07:14:04.5770805Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2024-06-26T07:14:04.5772468Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2024-06-26T07:14:04.5774113Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2024-06-26T07:14:04.5775663Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2024-06-26T07:14:04.5777084Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2024-06-26T07:14:04.5778535Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2024-06-26T07:14:04.5779945Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2024-06-26T07:14:04.5781689Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2024-06-26T07:14:04.5782982Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2024-06-26T07:14:04.5784181Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c 2024-06-26T07:14:04.5799514Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin 2024-06-26T07:14:04.5800749Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2024-06-26T07:14:04.5801923Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o 2024-06-26T07:14:04.5803123Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu 2024-06-26T07:14:04.5852471Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out 2024-06-26T07:14:04.5924897Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin 2024-06-26T07:14:04.5926278Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake 2024-06-26T07:14:04.5927310Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeScratch/ 2024-06-26T07:14:04.5928239Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeTmp/ 2024-06-26T07:14:04.5929176Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/cmake.check_cache 2024-06-26T07:14:04.5930152Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/ 2024-06-26T07:14:04.5931277Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.ts 2024-06-26T07:14:04.5932534Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.make 2024-06-26T07:14:04.5933677Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/depend.make 2024-06-26T07:14:04.5934813Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/link.txt 2024-06-26T07:14:04.5935908Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/cmake_clean.cmake 2024-06-26T07:14:04.5937008Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/build.make 2024-06-26T07:14:04.5938100Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/DependInfo.cmake 2024-06-26T07:14:04.5939193Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/flags.make 2024-06-26T07:14:04.5941020Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/progress.make 2024-06-26T07:14:04.5953177Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o.d 2024-06-26T07:14:04.6014917Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o 2024-06-26T07:14:04.6016121Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-06-26T07:14:04.6017186Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/TargetDirectories.txt 2024-06-26T07:14:04.6018283Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/progress.marks 2024-06-26T07:14:04.6019200Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile2 2024-06-26T07:14:04.6020289Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile.cmake 2024-06-26T07:14:04.6021439Z inflating: build/custom_test_artifacts/jit-hook-build/detect_cuda_version.cc 2024-06-26T07:14:04.6022324Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeCache.txt 2024-06-26T07:14:04.6023093Z inflating: build/custom_test_artifacts/jit-hook-build/Makefile 2024-06-26T07:14:04.6023899Z inflating: build/custom_test_artifacts/jit-hook-build/cmake_install.cmake 2024-06-26T07:14:04.6071258Z inflating: build/custom_test_artifacts/jit-hook-build/test_jit_hooks 2024-06-26T07:14:04.6072062Z creating: build/custom_test_artifacts/custom-backend-build/ 2024-06-26T07:14:04.6072822Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/ 2024-06-26T07:14:04.6073715Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/pkgRedirects/ 2024-06-26T07:14:04.6079108Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeConfigureLog.yaml 2024-06-26T07:14:04.6080090Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/ 2024-06-26T07:14:04.6081087Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-06-26T07:14:04.6082178Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-06-26T07:14:04.6083204Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-06-26T07:14:04.6084346Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-06-26T07:14:04.6085497Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-06-26T07:14:04.6086552Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-06-26T07:14:04.6087602Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-06-26T07:14:04.6088792Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-06-26T07:14:04.6089996Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-06-26T07:14:04.6091190Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-06-26T07:14:04.6092434Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-06-26T07:14:04.6093652Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-06-26T07:14:04.6094973Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-06-26T07:14:04.6096062Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/ 2024-06-26T07:14:04.6097117Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/ 2024-06-26T07:14:04.6134432Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2024-06-26T07:14:04.6174055Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2024-06-26T07:14:04.6175681Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2024-06-26T07:14:04.6219791Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2024-06-26T07:14:04.6221580Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2024-06-26T07:14:04.6223231Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2024-06-26T07:14:04.6224761Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2024-06-26T07:14:04.6226216Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2024-06-26T07:14:04.6227651Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2024-06-26T07:14:04.6229081Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2024-06-26T07:14:04.6230521Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2024-06-26T07:14:04.6231932Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2024-06-26T07:14:04.6233259Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2024-06-26T07:14:04.6234542Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c 2024-06-26T07:14:04.6235806Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin 2024-06-26T07:14:04.6237093Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2024-06-26T07:14:04.6238329Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o 2024-06-26T07:14:04.6239588Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu 2024-06-26T07:14:04.6303480Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out 2024-06-26T07:14:04.6374797Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin 2024-06-26T07:14:04.6376040Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake 2024-06-26T07:14:04.6377085Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeScratch/ 2024-06-26T07:14:04.6378006Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeTmp/ 2024-06-26T07:14:04.6378988Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/cmake.check_cache 2024-06-26T07:14:04.6380118Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/ 2024-06-26T07:14:04.6381248Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.ts 2024-06-26T07:14:04.6382497Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.make 2024-06-26T07:14:04.6383692Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/depend.make 2024-06-26T07:14:04.6384825Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/link.txt 2024-06-26T07:14:04.6385996Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/cmake_clean.cmake 2024-06-26T07:14:04.6387271Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/build.make 2024-06-26T07:14:04.6388450Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/DependInfo.cmake 2024-06-26T07:14:04.6389623Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/flags.make 2024-06-26T07:14:04.6390861Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/progress.make 2024-06-26T07:14:04.6392135Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o.d 2024-06-26T07:14:04.6508433Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o 2024-06-26T07:14:04.6509592Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/ 2024-06-26T07:14:04.6510769Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.ts 2024-06-26T07:14:04.6512125Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.make 2024-06-26T07:14:04.6513383Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/depend.make 2024-06-26T07:14:04.6514575Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/link.txt 2024-06-26T07:14:04.6515802Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/cmake_clean.cmake 2024-06-26T07:14:04.6517023Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/build.make 2024-06-26T07:14:04.6518249Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/DependInfo.cmake 2024-06-26T07:14:04.6519475Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/flags.make 2024-06-26T07:14:04.6520700Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/progress.make 2024-06-26T07:14:04.6534252Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o.d 2024-06-26T07:14:04.6587596Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o 2024-06-26T07:14:04.6588877Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-06-26T07:14:04.6589997Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/TargetDirectories.txt 2024-06-26T07:14:04.6591020Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/progress.marks 2024-06-26T07:14:04.6591978Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile2 2024-06-26T07:14:04.6592927Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile.cmake 2024-06-26T07:14:04.6593872Z inflating: build/custom_test_artifacts/custom-backend-build/detect_cuda_version.cc 2024-06-26T07:14:04.6594769Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeCache.txt 2024-06-26T07:14:04.6595611Z inflating: build/custom_test_artifacts/custom-backend-build/Makefile 2024-06-26T07:14:04.6596465Z inflating: build/custom_test_artifacts/custom-backend-build/cmake_install.cmake 2024-06-26T07:14:04.6695563Z inflating: build/custom_test_artifacts/custom-backend-build/libcustom_backend.so 2024-06-26T07:14:04.6736952Z inflating: build/custom_test_artifacts/custom-backend-build/test_custom_backend 2024-06-26T07:14:04.6737583Z creating: build/lib/ 2024-06-26T07:14:04.6823942Z inflating: build/lib/libprotobuf-lite.a 2024-06-26T07:14:04.7262074Z inflating: build/lib/libprotobuf.a 2024-06-26T07:14:04.7271703Z inflating: build/lib/libpthreadpool.a 2024-06-26T07:14:04.7279736Z inflating: build/lib/libcpuinfo.a 2024-06-26T07:14:04.7287357Z inflating: build/lib/libcpuinfo_internals.a 2024-06-26T07:14:04.7287989Z inflating: build/lib/libclog.a 2024-06-26T07:14:04.7306642Z inflating: build/lib/libnnpack.a 2024-06-26T07:14:04.7309081Z inflating: build/lib/libnnpack_reference_layers.a 2024-06-26T07:14:04.7371367Z inflating: build/lib/libgtest.a 2024-06-26T07:14:04.7444221Z inflating: build/lib/libbenchmark.a 2024-06-26T07:14:04.7505762Z inflating: build/lib/libasmjit.a 2024-06-26T07:14:04.7513074Z inflating: build/lib/libittnotify.a 2024-06-26T07:14:04.7540364Z inflating: build/lib/libtensorpipe_uv.a 2024-06-26T07:14:04.7662627Z inflating: build/lib/libgloo.a 2024-06-26T07:14:04.7683738Z inflating: build/lib/libfmt.a 2024-06-26T07:14:04.7685477Z inflating: build/lib/libcaffe2_nvrtc.so 2024-06-26T07:14:04.7686114Z inflating: build/lib/libfoxi_loader.a 2024-06-26T07:14:04.7775272Z inflating: build/lib/libc10.so 2024-06-26T07:14:04.7776749Z inflating: build/lib/libtorch_global_deps.so 2024-06-26T07:14:04.7795667Z inflating: build/lib/libpytorch_qnnpack.a 2024-06-26T07:14:04.7813704Z inflating: build/lib/libgmock.a 2024-06-26T07:14:04.7814918Z inflating: build/lib/libgtest_main.a 2024-06-26T07:14:04.7815838Z inflating: build/lib/libbenchmark_main.a 2024-06-26T07:14:04.8298749Z inflating: build/lib/libprotoc.a 2024-06-26T07:14:04.8668873Z inflating: build/lib/libgloo_cuda.a 2024-06-26T07:14:05.8402460Z inflating: build/lib/libdnnl.a 2024-06-26T07:14:05.8952284Z inflating: build/lib/libtensorpipe.a 2024-06-26T07:14:05.9005140Z inflating: build/lib/libc10_cuda.so 2024-06-26T07:14:05.9005685Z inflating: build/lib/libgmock_main.a 2024-06-26T07:14:06.0211682Z inflating: build/lib/libfbgemm.a 2024-06-26T07:14:06.0712313Z inflating: build/lib/libkineto.a 2024-06-26T07:14:06.0957280Z inflating: build/lib/libtensorpipe_cuda.a 2024-06-26T07:14:06.1135368Z inflating: build/lib/libXNNPACK.a 2024-06-26T07:14:06.1176068Z inflating: build/lib/libonnx_proto.a 2024-06-26T07:14:06.1842576Z inflating: build/lib/libonnx.a 2024-06-26T07:14:08.5136117Z inflating: build/lib/libtorch_cpu.so 2024-06-26T07:14:08.5140320Z inflating: build/lib/libunbox_lib.a 2024-06-26T07:14:08.5144663Z inflating: build/lib/libshm.so 2024-06-26T07:14:10.4973609Z inflating: build/lib/libtorch_cuda.so 2024-06-26T07:14:10.4974401Z inflating: build/lib/libtorch.so 2024-06-26T07:14:10.4977167Z inflating: build/lib/libc10d_cuda_test.so 2024-06-26T07:14:11.3493711Z inflating: build/lib/libtorch_cuda_linalg.so 2024-06-26T07:14:11.5391067Z inflating: build/lib/libtorch_python.so 2024-06-26T07:14:11.5457708Z inflating: build/lib/libtorchbind_test.so 2024-06-26T07:14:11.5477471Z inflating: build/lib/libjitbackend_test.so 2024-06-26T07:14:11.5502564Z inflating: build/lib/libbackend_with_compiler.so 2024-06-26T07:14:11.5536111Z inflating: build/lib/libnnapi_backend.so 2024-06-26T07:14:11.5536586Z creating: build/bin/ 2024-06-26T07:14:11.5585424Z inflating: build/bin/c10_CompileTimeFunctionPointer_test 2024-06-26T07:14:11.5635472Z inflating: build/bin/c10_DeviceGuard_test 2024-06-26T07:14:11.5684823Z inflating: build/bin/c10_Device_test 2024-06-26T07:14:11.5742564Z inflating: build/bin/c10_DispatchKeySet_test 2024-06-26T07:14:11.5794720Z inflating: build/bin/c10_Scalar_test 2024-06-26T07:14:11.5842403Z inflating: build/bin/c10_StreamGuard_test 2024-06-26T07:14:11.5892112Z inflating: build/bin/c10_SymInt_test 2024-06-26T07:14:11.5945460Z inflating: build/bin/c10_InlineDeviceGuard_test 2024-06-26T07:14:11.5999658Z inflating: build/bin/c10_InlineStreamGuard_test 2024-06-26T07:14:11.6054436Z inflating: build/bin/c10_SizesAndStrides_test 2024-06-26T07:14:11.6124159Z inflating: build/bin/c10_cow_test 2024-06-26T07:14:11.6176509Z inflating: build/bin/c10_Bitset_test 2024-06-26T07:14:11.6225016Z inflating: build/bin/c10_ConstexprCrc_test 2024-06-26T07:14:11.6273272Z inflating: build/bin/c10_DeadlockDetection_test 2024-06-26T07:14:11.6322733Z inflating: build/bin/c10_Half_test 2024-06-26T07:14:11.6377501Z inflating: build/bin/c10_LeftRight_test 2024-06-26T07:14:11.6431175Z inflating: build/bin/c10_Metaprogramming_test 2024-06-26T07:14:11.6479885Z inflating: build/bin/c10_Synchronized_test 2024-06-26T07:14:11.6534117Z inflating: build/bin/c10_ThreadLocal_test 2024-06-26T07:14:11.6584401Z inflating: build/bin/c10_TypeIndex_test 2024-06-26T07:14:11.6634347Z inflating: build/bin/c10_TypeList_test 2024-06-26T07:14:11.6681956Z inflating: build/bin/c10_TypeTraits_test 2024-06-26T07:14:11.6732739Z inflating: build/bin/c10_accumulate_test 2024-06-26T07:14:11.6786737Z inflating: build/bin/c10_bfloat16_test 2024-06-26T07:14:11.6835832Z inflating: build/bin/c10_bit_cast_test 2024-06-26T07:14:11.6890716Z inflating: build/bin/c10_complex_math_test 2024-06-26T07:14:11.6944952Z inflating: build/bin/c10_complex_test 2024-06-26T07:14:11.6996286Z inflating: build/bin/c10_exception_test 2024-06-26T07:14:11.7045468Z inflating: build/bin/c10_flags_test 2024-06-26T07:14:11.7095322Z inflating: build/bin/c10_generic_math_test 2024-06-26T07:14:11.7256735Z inflating: build/bin/c10_intrusive_ptr_test 2024-06-26T07:14:11.7306474Z inflating: build/bin/c10_irange_test 2024-06-26T07:14:11.7358759Z inflating: build/bin/c10_lazy_test 2024-06-26T07:14:11.7414291Z inflating: build/bin/c10_logging_test 2024-06-26T07:14:11.7475168Z inflating: build/bin/c10_ordered_preserving_dict_test 2024-06-26T07:14:11.7548112Z inflating: build/bin/c10_optional_test 2024-06-26T07:14:11.7600496Z inflating: build/bin/c10_registry_test 2024-06-26T07:14:11.7746506Z inflating: build/bin/c10_small_vector_test 2024-06-26T07:14:11.7796780Z inflating: build/bin/c10_ssize_test 2024-06-26T07:14:11.7847429Z inflating: build/bin/c10_string_util_test 2024-06-26T07:14:11.7896524Z inflating: build/bin/c10_tempfile_test 2024-06-26T07:14:11.7953701Z inflating: build/bin/c10_string_view_test 2024-06-26T07:14:11.8001547Z inflating: build/bin/c10_intrusive_ptr_benchmark 2024-06-26T07:14:11.8055713Z inflating: build/bin/c10_typeid_test 2024-06-26T07:14:11.8489970Z inflating: build/bin/protoc-3.13.0.0 2024-06-26T07:14:11.8923435Z inflating: build/bin/protoc 2024-06-26T07:14:11.8974925Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_catches_stream 2024-06-26T07:14:11.9026735Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_1_var_test 2024-06-26T07:14:11.9078290Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_catches_thread_and_block_and_device 2024-06-26T07:14:11.9128944Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_from_2_processes 2024-06-26T07:14:11.9180722Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_blocks_and_threads 2024-06-26T07:14:11.9232171Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_multiple_blocks 2024-06-26T07:14:11.9280481Z inflating: build/bin/c10_cuda_CUDATest 2024-06-26T07:14:11.9331936Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_same_block 2024-06-26T07:14:11.9649596Z inflating: build/bin/vec_test_all_types_DEFAULT 2024-06-26T07:14:11.9982290Z inflating: build/bin/vec_test_all_types_AVX512 2024-06-26T07:14:12.0329026Z inflating: build/bin/vec_test_all_types_AVX2 2024-06-26T07:14:12.0380128Z inflating: build/bin/FileStoreTest 2024-06-26T07:14:12.0434301Z inflating: build/bin/TCPStoreTest 2024-06-26T07:14:12.0486534Z inflating: build/bin/HashStoreTest 2024-06-26T07:14:12.0499768Z inflating: build/bin/ProcessGroupMPITest 2024-06-26T07:14:12.0552197Z inflating: build/bin/test_edge_op_registration 2024-06-26T07:14:12.0556380Z inflating: build/bin/torch_shm_manager 2024-06-26T07:14:12.0559296Z inflating: build/bin/example_allreduce 2024-06-26T07:14:12.0612822Z inflating: build/bin/test_dist_autograd 2024-06-26T07:14:12.0680681Z inflating: build/bin/test_cpp_rpc 2024-06-26T07:14:12.0682935Z inflating: build/bin/parallel_benchmark 2024-06-26T07:14:12.0748269Z inflating: build/bin/test_mobile_nnc 2024-06-26T07:14:12.0757084Z inflating: build/bin/aot_model_compiler_test 2024-06-26T07:14:12.1090361Z inflating: build/bin/test_lazy 2024-06-26T07:14:12.2236312Z inflating: build/bin/test_api 2024-06-26T07:14:12.2308033Z inflating: build/bin/Dict_test 2024-06-26T07:14:12.2358718Z inflating: build/bin/Dimname_test 2024-06-26T07:14:12.2421433Z inflating: build/bin/MaybeOwned_test 2024-06-26T07:14:12.2477141Z inflating: build/bin/NamedTensor_test 2024-06-26T07:14:12.2535537Z inflating: build/bin/apply_utils_test 2024-06-26T07:14:12.2592879Z inflating: build/bin/atest 2024-06-26T07:14:12.2654332Z inflating: build/bin/basic 2024-06-26T07:14:12.2707921Z inflating: build/bin/broadcast_test 2024-06-26T07:14:12.2757325Z inflating: build/bin/cpu_allocator_test 2024-06-26T07:14:12.2814333Z inflating: build/bin/cpu_generator_test 2024-06-26T07:14:12.2866152Z inflating: build/bin/cpu_profiling_allocator_test 2024-06-26T07:14:12.2957761Z inflating: build/bin/cpu_rng_test 2024-06-26T07:14:12.3006458Z inflating: build/bin/dispatch_key_set_test 2024-06-26T07:14:12.3055146Z inflating: build/bin/dlconvertor_test 2024-06-26T07:14:12.3111914Z inflating: build/bin/extension_backend_test 2024-06-26T07:14:12.3166143Z inflating: build/bin/half_test 2024-06-26T07:14:12.3258792Z inflating: build/bin/ivalue_test 2024-06-26T07:14:12.3307454Z inflating: build/bin/lazy_tensor_test 2024-06-26T07:14:12.3361045Z inflating: build/bin/math_kernel_test 2024-06-26T07:14:12.3413329Z inflating: build/bin/memory_format_test 2024-06-26T07:14:12.3465153Z inflating: build/bin/memory_overlapping_test 2024-06-26T07:14:12.3516845Z inflating: build/bin/mobile_memory_cleanup 2024-06-26T07:14:12.3571510Z inflating: build/bin/native_test 2024-06-26T07:14:12.3620987Z inflating: build/bin/operator_name_test 2024-06-26T07:14:12.3671236Z inflating: build/bin/operators_test 2024-06-26T07:14:12.3721683Z inflating: build/bin/packedtensoraccessor_test 2024-06-26T07:14:12.3787114Z inflating: build/bin/pow_test 2024-06-26T07:14:12.3844196Z inflating: build/bin/quantized_test 2024-06-26T07:14:12.3892480Z inflating: build/bin/reduce_ops_test 2024-06-26T07:14:12.3942620Z inflating: build/bin/reportMemoryUsage_test 2024-06-26T07:14:12.3998060Z inflating: build/bin/scalar_tensor_test 2024-06-26T07:14:12.4055188Z inflating: build/bin/scalar_test 2024-06-26T07:14:12.4105779Z inflating: build/bin/StorageUtils_test 2024-06-26T07:14:12.4157090Z inflating: build/bin/stride_properties_test 2024-06-26T07:14:12.4233167Z inflating: build/bin/tensor_iterator_test 2024-06-26T07:14:12.4285864Z inflating: build/bin/test_parallel 2024-06-26T07:14:12.4288890Z inflating: build/bin/thread_init_test 2024-06-26T07:14:12.4343429Z inflating: build/bin/type_ptr_test 2024-06-26T07:14:12.4401914Z inflating: build/bin/type_test 2024-06-26T07:14:12.4452704Z inflating: build/bin/undefined_tensor_test 2024-06-26T07:14:12.4454436Z inflating: build/bin/verify_api_visibility 2024-06-26T07:14:12.4522569Z inflating: build/bin/legacy_vmap_test 2024-06-26T07:14:12.4572919Z inflating: build/bin/weakref_test 2024-06-26T07:14:12.4622943Z inflating: build/bin/wrapdim_test 2024-06-26T07:14:12.4673173Z inflating: build/bin/xla_tensor_test 2024-06-26T07:14:12.4776221Z inflating: build/bin/List_test 2024-06-26T07:14:12.4834743Z inflating: build/bin/IListRef_test 2024-06-26T07:14:12.4953278Z inflating: build/bin/kernel_function_legacy_test 2024-06-26T07:14:12.5018025Z inflating: build/bin/KernelFunction_test 2024-06-26T07:14:12.5112041Z inflating: build/bin/kernel_function_test 2024-06-26T07:14:12.5236736Z inflating: build/bin/kernel_lambda_legacy_test 2024-06-26T07:14:12.5337914Z inflating: build/bin/kernel_lambda_test 2024-06-26T07:14:12.5397321Z inflating: build/bin/kernel_stackbased_test 2024-06-26T07:14:12.5490948Z inflating: build/bin/make_boxed_from_unboxed_functor_test 2024-06-26T07:14:12.5540742Z inflating: build/bin/CppSignature_test 2024-06-26T07:14:12.5589697Z inflating: build/bin/op_allowlist_test 2024-06-26T07:14:12.5644967Z inflating: build/bin/backend_fallback_test 2024-06-26T07:14:12.5936320Z inflating: build/bin/op_registration_test 2024-06-26T07:14:12.5998337Z inflating: build/bin/inline_container_test 2024-06-26T07:14:12.6049968Z inflating: build/bin/cuda_apply_test 2024-06-26T07:14:12.6099544Z inflating: build/bin/cuda_allocator_test 2024-06-26T07:14:12.6152808Z inflating: build/bin/cuda_caching_host_allocator_test 2024-06-26T07:14:12.6210296Z inflating: build/bin/cuda_atomic_ops_test 2024-06-26T07:14:12.6278941Z inflating: build/bin/cuda_complex_math_test 2024-06-26T07:14:12.6336302Z inflating: build/bin/cuda_complex_test 2024-06-26T07:14:12.6385364Z inflating: build/bin/cuda_device_test 2024-06-26T07:14:12.6442216Z inflating: build/bin/cuda_cub_test 2024-06-26T07:14:12.6491792Z inflating: build/bin/cuda_dlconvertor_test 2024-06-26T07:14:12.6554982Z inflating: build/bin/cuda_distributions_test 2024-06-26T07:14:12.6610238Z inflating: build/bin/cuda_generator_test 2024-06-26T07:14:12.6658652Z inflating: build/bin/cuda_half_test 2024-06-26T07:14:12.6708768Z inflating: build/bin/cuda_integer_divider_test 2024-06-26T07:14:12.6757168Z inflating: build/bin/cuda_optional_test 2024-06-26T07:14:12.6807583Z inflating: build/bin/cuda_packedtensoraccessor_test 2024-06-26T07:14:12.6858941Z inflating: build/bin/cuda_reportMemoryUsage_test 2024-06-26T07:14:12.6907621Z inflating: build/bin/cuda_allocatorTraceTracker_test 2024-06-26T07:14:12.6966757Z inflating: build/bin/cuda_stream_test 2024-06-26T07:14:12.7016769Z inflating: build/bin/cuda_cudnn_test 2024-06-26T07:14:12.7068061Z inflating: build/bin/cuda_vectorized_test 2024-06-26T07:14:12.7082686Z inflating: build/bin/tutorial_tensorexpr 2024-06-26T07:14:12.7146527Z inflating: build/bin/ProcessGroupGlooTest 2024-06-26T07:14:12.7202509Z inflating: build/bin/ProcessGroupGlooAsyncTest 2024-06-26T07:14:12.7264177Z inflating: build/bin/ProcessGroupNCCLTest 2024-06-26T07:14:12.7325988Z inflating: build/bin/ProcessGroupNCCLErrorsTest 2024-06-26T07:14:12.8132749Z inflating: build/bin/test_tensorexpr 2024-06-26T07:14:12.8694643Z inflating: build/bin/test_jit 2024-06-26T07:14:12.8695232Z creating: .additional_ci_files/ 2024-06-26T07:14:12.8749202Z inflating: .additional_ci_files/test-times.json 2024-06-26T07:14:12.8961832Z inflating: .additional_ci_files/test-class-times.json 2024-06-26T07:14:12.8987716Z ##[group]Run rm artifacts.zip 2024-06-26T07:14:12.8988108Z rm artifacts.zip 2024-06-26T07:14:12.8996871Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:14:12.8997362Z env: 2024-06-26T07:14:12.8997651Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:14:12.8998090Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:14:12.8998567Z ##[endgroup] 2024-06-26T07:14:13.0275493Z ##[group]Run df -H 2024-06-26T07:14:13.0275819Z df -H 2024-06-26T07:14:13.0283381Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:14:13.0283893Z env: 2024-06-26T07:14:13.0284177Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:14:13.0284636Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:14:13.0285124Z ##[endgroup] 2024-06-26T07:14:13.0312046Z Filesystem Size Used Avail Use% Mounted on 2024-06-26T07:14:13.0312587Z devtmpfs 34G 0 34G 0% /dev 2024-06-26T07:14:13.0313277Z tmpfs 34G 0 34G 0% /dev/shm 2024-06-26T07:14:13.0313949Z tmpfs 34G 455k 34G 1% /run 2024-06-26T07:14:13.0314629Z tmpfs 34G 0 34G 0% /sys/fs/cgroup 2024-06-26T07:14:13.0315913Z /dev/nvme0n1p1 162G 78G 84G 49% / 2024-06-26T07:14:13.0353657Z Prepare all required actions 2024-06-26T07:14:13.0354113Z Getting action download info 2024-06-26T07:14:13.1646459Z ##[group]Run ./.github/actions/download-td-artifacts 2024-06-26T07:14:13.1646928Z with: 2024-06-26T07:14:13.1647193Z env: 2024-06-26T07:14:13.1647474Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:14:13.1648070Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:14:13.1648545Z ##[endgroup] 2024-06-26T07:14:13.1679379Z ##[group]Run seemethere/download-artifact-s3@v4 2024-06-26T07:14:13.1679816Z with: 2024-06-26T07:14:13.1680081Z name: td_results 2024-06-26T07:14:13.1680402Z s3-bucket: gha-artifacts 2024-06-26T07:14:13.1680754Z region: us-east-1 2024-06-26T07:14:13.1681048Z env: 2024-06-26T07:14:13.1681317Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:14:13.1681763Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:14:13.1682236Z ##[endgroup] 2024-06-26T07:14:13.5749704Z (node:20726) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2024-06-26T07:14:13.5750584Z 2024-06-26T07:14:13.5750857Z Please migrate your code to use AWS SDK for JavaScript (v3). 2024-06-26T07:14:13.5751580Z For more information, check the migration guide at https://a.co/7PzMCcy 2024-06-26T07:14:13.5752418Z (Use `node --trace-warnings ...` to show where the warning was created) 2024-06-26T07:14:13.6436776Z Found 0 objects with prefix pytorch/pytorch/9673646808/td_results/ 2024-06-26T07:14:13.6443608Z Artifact download has finished successfully 2024-06-26T07:14:13.6591879Z ##[group]Run mkdir -p .additional_ci_files 2024-06-26T07:14:13.6592362Z mkdir -p .additional_ci_files 2024-06-26T07:14:13.6592916Z mv td_results.json .additional_ci_files/td_results.json 2024-06-26T07:14:13.6600754Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:14:13.6601252Z env: 2024-06-26T07:14:13.6601528Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:14:13.6601985Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:14:13.6602461Z ##[endgroup] 2024-06-26T07:14:13.6640590Z mv: cannot stat 'td_results.json': No such file or directory 2024-06-26T07:14:13.6651062Z ##[error]Process completed with exit code 1. 2024-06-26T07:14:13.6682055Z ##[group]Run .github/scripts/parse_ref.py 2024-06-26T07:14:13.6682541Z .github/scripts/parse_ref.py 2024-06-26T07:14:13.6689361Z shell: /usr/bin/bash -e {0} 2024-06-26T07:14:13.6689715Z env: 2024-06-26T07:14:13.6689999Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:14:13.6690449Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:14:13.6690924Z ##[endgroup] 2024-06-26T07:14:13.6915013Z Prepare all required actions 2024-06-26T07:14:13.6951421Z ##[group]Run ./.github/actions/get-workflow-job-id 2024-06-26T07:14:13.6951875Z with: 2024-06-26T07:14:13.6952421Z github-token: *** 2024-06-26T07:14:13.6952735Z env: 2024-06-26T07:14:13.6953004Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:14:13.6953456Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:14:13.6953940Z ##[endgroup] 2024-06-26T07:14:13.6968761Z ##[group]Run set -eux 2024-06-26T07:14:13.6969099Z set -eux 2024-06-26T07:14:13.6969686Z python3 .github/scripts/get_workflow_job_id.py "${GITHUB_RUN_ID}" "${RUNNER_NAME}" 2024-06-26T07:14:13.6977295Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:14:13.6977792Z env: 2024-06-26T07:14:13.6978113Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:14:13.6978590Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:14:13.6979215Z GITHUB_TOKEN: *** 2024-06-26T07:14:13.6979518Z ##[endgroup] 2024-06-26T07:14:13.6999207Z + python3 .github/scripts/get_workflow_job_id.py 9673646808 i-04a4d8372606379d8 2024-06-26T07:14:16.4115170Z setting job-id=26688921813 2024-06-26T07:14:16.4115998Z setting job-name=cuda12.4-py3.10-gcc9-sm86 / test (inductor_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-06-26T07:14:16.4308026Z Prepare all required actions 2024-06-26T07:14:16.4308468Z Getting action download info 2024-06-26T07:14:16.5331978Z ##[group]Run ./.github/actions/filter-test-configs 2024-06-26T07:14:16.5332435Z with: 2024-06-26T07:14:16.5332882Z github-token: *** 2024-06-26T07:14:16.5333951Z test-matrix: {"include": [{"config": "inductor_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}]} 2024-06-26T07:14:16.5335588Z job-name: cuda12.4-py3.10-gcc9-sm86 / test (inductor_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-06-26T07:14:16.5336269Z env: 2024-06-26T07:14:16.5336549Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:14:16.5336999Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:14:16.5337473Z ##[endgroup] 2024-06-26T07:14:16.5376977Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2024-06-26T07:14:16.5377522Z with: 2024-06-26T07:14:16.5377830Z shell: bash 2024-06-26T07:14:16.5378127Z timeout_minutes: 10 2024-06-26T07:14:16.5378455Z max_attempts: 5 2024-06-26T07:14:16.5378774Z retry_wait_seconds: 30 2024-06-26T07:14:16.5379864Z command: set -eux # PyYAML 6.0 doesn't work with MacOS x86 anymore # This must run on Python-3.7 (AmazonLinux2) so can't use request=3.32.2 python3 -m pip install requests==2.27.1 pyyaml==6.0.1 2024-06-26T07:14:16.5381153Z polling_interval_seconds: 1 2024-06-26T07:14:16.5381523Z warning_on_retry: true 2024-06-26T07:14:16.5381875Z continue_on_error: false 2024-06-26T07:14:16.5382215Z env: 2024-06-26T07:14:16.5382487Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:14:16.5382933Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:14:16.5383566Z GITHUB_TOKEN: *** 2024-06-26T07:14:16.5383896Z ##[endgroup] 2024-06-26T07:14:16.5883402Z + python3 -m pip install requests==2.27.1 pyyaml==6.0.1 2024-06-26T07:14:16.8036743Z Defaulting to user installation because normal site-packages is not writeable 2024-06-26T07:14:16.8197267Z Requirement already satisfied: requests==2.27.1 in /home/ec2-user/.local/lib/python3.7/site-packages (2.27.1) 2024-06-26T07:14:16.8340535Z Requirement already satisfied: pyyaml==6.0.1 in /home/ec2-user/.local/lib/python3.7/site-packages (6.0.1) 2024-06-26T07:14:16.8349384Z Requirement already satisfied: idna<4,>=2.5; python_version >= "3" in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.27.1) (3.7) 2024-06-26T07:14:16.8362707Z Requirement already satisfied: charset-normalizer~=2.0.0; python_version >= "3" in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.27.1) (2.0.12) 2024-06-26T07:14:16.8382659Z Requirement already satisfied: urllib3<1.27,>=1.21.1 in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.27.1) (1.26.19) 2024-06-26T07:14:16.8581095Z Requirement already satisfied: certifi>=2017.4.17 in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.27.1) (2024.6.2) 2024-06-26T07:14:17.5881887Z Command completed after 1 attempt(s). 2024-06-26T07:14:17.5925540Z ##[group]Run set -x 2024-06-26T07:14:17.5925885Z set -x 2024-06-26T07:14:17.5926187Z  2024-06-26T07:14:17.5926740Z # Use relative path here as this could be checked out anywhere, not necessarily 2024-06-26T07:14:17.5927409Z # in runner workspace 2024-06-26T07:14:17.5927941Z python3 "${GITHUB_ACTION_PATH}/../../scripts/parse_ref.py" 2024-06-26T07:14:17.5935874Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:14:17.5936366Z env: 2024-06-26T07:14:17.5936643Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:14:17.5937091Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:14:17.5937559Z ##[endgroup] 2024-06-26T07:14:17.5957716Z + python3 /home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/filter-test-configs/../../scripts/parse_ref.py 2024-06-26T07:14:17.6170888Z ##[group]Run echo "Workflow: ${GITHUB_WORKFLOW}" 2024-06-26T07:14:17.6171554Z echo "Workflow: ${GITHUB_WORKFLOW}" 2024-06-26T07:14:17.6172019Z echo "Job name: ${JOB_NAME}" 2024-06-26T07:14:17.6172422Z  2024-06-26T07:14:17.6172961Z # Use relative path here as this could be checked out anywhere, not necessarily 2024-06-26T07:14:17.6173631Z # in runner workspace 2024-06-26T07:14:17.6174196Z python3 "${GITHUB_ACTION_PATH}/../../scripts/filter_test_configs.py" \ 2024-06-26T07:14:17.6175055Z  --workflow "${GITHUB_WORKFLOW}" \ 2024-06-26T07:14:17.6175520Z  --job-name "${JOB_NAME}" \ 2024-06-26T07:14:17.6176734Z  --test-matrix "{"include": [{"config": "inductor_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}]}" \ 2024-06-26T07:14:17.6177954Z  --selected-test-configs "" \ 2024-06-26T07:14:17.6178409Z  --pr-number "${PR_NUMBER}" \ 2024-06-26T07:14:17.6178844Z  --tag "${TAG}" \ 2024-06-26T07:14:17.6179245Z  --event-name "${EVENT_NAME}" \ 2024-06-26T07:14:17.6179696Z  --schedule "${SCHEDULE}" \ 2024-06-26T07:14:17.6180281Z  --branch "${HEAD_BRANCH}" 2024-06-26T07:14:17.6187955Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:14:17.6188451Z env: 2024-06-26T07:14:17.6188734Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:14:17.6189189Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:14:17.6189887Z GITHUB_TOKEN: *** 2024-06-26T07:14:17.6190529Z JOB_NAME: cuda12.4-py3.10-gcc9-sm86 / test (inductor_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-06-26T07:14:17.6191211Z PR_NUMBER: 2024-06-26T07:14:17.6191522Z TAG: ciflow/inductor/129470 2024-06-26T07:14:17.6191891Z EVENT_NAME: push 2024-06-26T07:14:17.6192204Z SCHEDULE: 2024-06-26T07:14:17.6192497Z HEAD_BRANCH: 2024-06-26T07:14:17.6192791Z ##[endgroup] 2024-06-26T07:14:17.6212288Z Workflow: inductor 2024-06-26T07:14:17.6213311Z Job name: cuda12.4-py3.10-gcc9-sm86 / test (inductor_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-06-26T07:14:17.9059932Z INFO:root:Found no test-config label on the PR, so all test configs are included 2024-06-26T07:14:18.0385294Z ##[group]Run echo "Filtered matrix:" 2024-06-26T07:14:18.0385735Z echo "Filtered matrix:" 2024-06-26T07:14:18.0386853Z echo "{"include": [{"config": "inductor_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}]}" 2024-06-26T07:14:18.0387996Z  2024-06-26T07:14:18.0388271Z echo 2024-06-26T07:14:18.0388648Z echo "Is the current job unstable? False" 2024-06-26T07:14:18.0389101Z  2024-06-26T07:14:18.0389376Z echo 2024-06-26T07:14:18.0389733Z echo "Is keep-going label set? False" 2024-06-26T07:14:18.0390172Z  2024-06-26T07:14:18.0390495Z echo 2024-06-26T07:14:18.0390811Z echo "Renabled issues? " 2024-06-26T07:14:18.0398407Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:14:18.0398893Z env: 2024-06-26T07:14:18.0399159Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:14:18.0399608Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:14:18.0400077Z ##[endgroup] 2024-06-26T07:14:18.0423064Z Filtered matrix: 2024-06-26T07:14:18.0424334Z {include: [{config: inductor_timm, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: inductor_timm, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}]} 2024-06-26T07:14:18.0425266Z 2024-06-26T07:14:18.0425418Z Is the current job unstable? False 2024-06-26T07:14:18.0425705Z 2024-06-26T07:14:18.0425989Z Is keep-going label set? False 2024-06-26T07:14:18.0426252Z 2024-06-26T07:14:18.0426380Z Renabled issues? 2024-06-26T07:14:18.0467672Z ##[group]Run echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2024-06-26T07:14:18.0468367Z echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2024-06-26T07:14:18.0476010Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:14:18.0476490Z env: 2024-06-26T07:14:18.0476767Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:14:18.0477215Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:14:18.0477691Z JOB_TIMEOUT: 240 2024-06-26T07:14:18.0477992Z ##[endgroup] 2024-06-26T07:14:18.0545830Z ##[group]Run set -x 2024-06-26T07:14:18.0546217Z set -x 2024-06-26T07:14:18.0546510Z  2024-06-26T07:14:18.0546858Z if [[ $TEST_CONFIG == 'multigpu' ]]; then 2024-06-26T07:14:18.0547385Z  TEST_COMMAND=.ci/pytorch/multigpu-test.sh 2024-06-26T07:14:18.0547935Z elif [[ $BUILD_ENVIRONMENT == *onnx* ]]; then 2024-06-26T07:14:18.0548433Z  TEST_COMMAND=.ci/onnx/test.sh 2024-06-26T07:14:18.0548839Z else 2024-06-26T07:14:18.0549170Z  TEST_COMMAND=.ci/pytorch/test.sh 2024-06-26T07:14:18.0549599Z fi 2024-06-26T07:14:18.0549875Z  2024-06-26T07:14:18.0550331Z # detached container should get cleaned up by teardown_ec2_linux 2024-06-26T07:14:18.0551057Z # TODO: Stop building test binaries as part of the build phase 2024-06-26T07:14:18.0551720Z # Used for GPU_FLAG since that doesn't play nice 2024-06-26T07:14:18.0552300Z # shellcheck disable=SC2086,SC2090 2024-06-26T07:14:18.0552760Z container_name=$(docker run \ 2024-06-26T07:14:18.0553175Z  ${GPU_FLAG:-} \ 2024-06-26T07:14:18.0553546Z  -e BUILD_ENVIRONMENT \ 2024-06-26T07:14:18.0553938Z  -e PR_NUMBER \ 2024-06-26T07:14:18.0554287Z  -e GITHUB_ACTIONS \ 2024-06-26T07:14:18.0554679Z  -e GITHUB_REPOSITORY \ 2024-06-26T07:14:18.0555079Z  -e GITHUB_WORKFLOW \ 2024-06-26T07:14:18.0555460Z  -e GITHUB_JOB \ 2024-06-26T07:14:18.0555809Z  -e GITHUB_RUN_ID \ 2024-06-26T07:14:18.0556187Z  -e GITHUB_RUN_NUMBER \ 2024-06-26T07:14:18.0556593Z  -e GITHUB_RUN_ATTEMPT \ 2024-06-26T07:14:18.0556973Z  -e JOB_ID \ 2024-06-26T07:14:18.0557311Z  -e JOB_NAME \ 2024-06-26T07:14:18.0557655Z  -e BASE_SHA \ 2024-06-26T07:14:18.0557996Z  -e BRANCH \ 2024-06-26T07:14:18.0558317Z  -e SHA1 \ 2024-06-26T07:14:18.0558661Z  -e AWS_DEFAULT_REGION \ 2024-06-26T07:14:18.0559067Z  -e IN_WHEEL_TEST \ 2024-06-26T07:14:18.0559441Z  -e SHARD_NUMBER \ 2024-06-26T07:14:18.0559800Z  -e TEST_CONFIG \ 2024-06-26T07:14:18.0560196Z  -e NUM_TEST_SHARDS \ 2024-06-26T07:14:18.0560610Z  -e REENABLED_ISSUES \ 2024-06-26T07:14:18.0561018Z  -e CONTINUE_THROUGH_ERROR \ 2024-06-26T07:14:18.0561429Z  -e VERBOSE_TEST_LOGS \ 2024-06-26T07:14:18.0561827Z  -e NO_TEST_TIMEOUT \ 2024-06-26T07:14:18.0562200Z  -e NO_TD \ 2024-06-26T07:14:18.0562532Z  -e TD_DISTRIBUTED \ 2024-06-26T07:14:18.0562906Z  -e PR_LABELS \ 2024-06-26T07:14:18.0563308Z  -e MAX_JOBS="$(nproc --ignore=2)" \ 2024-06-26T07:14:18.0563757Z  -e SCCACHE_BUCKET \ 2024-06-26T07:14:18.0564139Z  -e SCCACHE_S3_KEY_PREFIX \ 2024-06-26T07:14:18.0564541Z  -e XLA_CUDA \ 2024-06-26T07:14:18.0564945Z  -e XLA_CLANG_CACHE_S3_BUCKET_NAME \ 2024-06-26T07:14:18.0565457Z  -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK \ 2024-06-26T07:14:18.0565968Z  -e PYTORCH_TEST_RERUN_DISABLED_TESTS \ 2024-06-26T07:14:18.0566474Z  -e SKIP_SCCACHE_INITIALIZATION=1 \ 2024-06-26T07:14:18.0566933Z  -e HUGGING_FACE_HUB_TOKEN \ 2024-06-26T07:14:18.0567348Z  -e DASHBOARD_TAG \ 2024-06-26T07:14:18.0567810Z  --env-file="/tmp/github_env_${GITHUB_RUN_ID}" \ 2024-06-26T07:14:18.0568356Z  --security-opt seccomp=unconfined \ 2024-06-26T07:14:18.0568816Z  --cap-add=SYS_PTRACE \ 2024-06-26T07:14:18.0569202Z  --ipc=host \ 2024-06-26T07:14:18.0569551Z  --shm-size="${SHM_SIZE}" \ 2024-06-26T07:14:18.0569945Z  --tty \ 2024-06-26T07:14:18.0570260Z  --detach \ 2024-06-26T07:14:18.0570616Z  --name="${container_name}" \ 2024-06-26T07:14:18.0571067Z  --user jenkins \ 2024-06-26T07:14:18.0571622Z  -v "${GITHUB_WORKSPACE}:/var/lib/jenkins/workspace" \ 2024-06-26T07:14:18.0572261Z  -w /var/lib/jenkins/workspace \ 2024-06-26T07:14:18.0572688Z  "${DOCKER_IMAGE}" 2024-06-26T07:14:18.0573028Z ) 2024-06-26T07:14:18.0573427Z # Propagate download.pytorch.org IP to container 2024-06-26T07:14:18.0574326Z grep download.pytorch.org /etc/hosts | docker exec -i "${container_name}" sudo bash -c "/bin/cat >> /etc/hosts" 2024-06-26T07:14:18.0575378Z echo "DOCKER_CONTAINER_ID=${container_name}" >> "${GITHUB_ENV}" 2024-06-26T07:14:18.0576268Z docker exec -t "${container_name}" sh -c "pip install $(echo dist/*.whl)[opt-einsum] && ${TEST_COMMAND}" 2024-06-26T07:14:18.0583644Z shell: /usr/bin/bash -e {0} 2024-06-26T07:14:18.0583994Z env: 2024-06-26T07:14:18.0584270Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:14:18.0584710Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:14:18.0585310Z BUILD_ENVIRONMENT: linux-focal-cuda12.4-py3.10-gcc9-sm86 2024-06-26T07:14:18.0585811Z PR_NUMBER: 2024-06-26T07:14:18.0586131Z GITHUB_REPOSITORY: pytorch/pytorch 2024-06-26T07:14:18.0586540Z GITHUB_WORKFLOW: inductor 2024-06-26T07:14:18.0586891Z GITHUB_JOB: test 2024-06-26T07:14:18.0587203Z GITHUB_RUN_ID: 9673646808 2024-06-26T07:14:18.0587557Z GITHUB_RUN_NUMBER: 76977 2024-06-26T07:14:18.0587899Z GITHUB_RUN_ATTEMPT: 1 2024-06-26T07:14:18.0588227Z JOB_ID: 26688921813 2024-06-26T07:14:18.0588839Z JOB_NAME: cuda12.4-py3.10-gcc9-sm86 / test (inductor_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-06-26T07:14:18.0589513Z BRANCH: 2024-06-26T07:14:18.0589841Z SHA1: b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:14:18.0590387Z BASE_SHA: b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:14:18.0590863Z TEST_CONFIG: inductor_timm 2024-06-26T07:14:18.0591216Z SHARD_NUMBER: 2 2024-06-26T07:14:18.0591517Z NUM_TEST_SHARDS: 2 2024-06-26T07:14:18.0591836Z REENABLED_ISSUES: 2024-06-26T07:14:18.0592175Z CONTINUE_THROUGH_ERROR: False 2024-06-26T07:14:18.0592555Z VERBOSE_TEST_LOGS: False 2024-06-26T07:14:18.0592907Z NO_TEST_TIMEOUT: False 2024-06-26T07:14:18.0593240Z NO_TD: False 2024-06-26T07:14:18.0593539Z TD_DISTRIBUTED: False 2024-06-26T07:14:18.0593942Z SCCACHE_BUCKET: ossci-compiler-cache-circleci-v2 2024-06-26T07:14:18.0594427Z SCCACHE_S3_KEY_PREFIX: inductor 2024-06-26T07:14:18.0594806Z SHM_SIZE: 2g 2024-06-26T07:14:18.0595859Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:14:18.0596981Z XLA_CUDA: 2024-06-26T07:14:18.0597452Z XLA_CLANG_CACHE_S3_BUCKET_NAME: ossci-compiler-clang-cache-circleci-xla 2024-06-26T07:14:18.0598055Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK: 0 2024-06-26T07:14:18.0598484Z PYTORCH_TEST_RERUN_DISABLED_TESTS: 0 2024-06-26T07:14:18.0598879Z DASHBOARD_TAG: 2024-06-26T07:14:18.0599379Z HUGGING_FACE_HUB_TOKEN: *** 2024-06-26T07:14:18.0599746Z ##[endgroup] 2024-06-26T07:14:18.0618958Z + [[ inductor_timm == \m\u\l\t\i\g\p\u ]] 2024-06-26T07:14:18.0619666Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm86 == *onnx* ]] 2024-06-26T07:14:18.0620494Z + TEST_COMMAND=.ci/pytorch/test.sh 2024-06-26T07:14:18.0626116Z +++ nproc --ignore=2 2024-06-26T07:14:18.0638152Z ++ docker run --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all -e BUILD_ENVIRONMENT -e PR_NUMBER -e GITHUB_ACTIONS -e GITHUB_REPOSITORY -e GITHUB_WORKFLOW -e GITHUB_JOB -e GITHUB_RUN_ID -e GITHUB_RUN_NUMBER -e GITHUB_RUN_ATTEMPT -e JOB_ID -e JOB_NAME -e BASE_SHA -e BRANCH -e SHA1 -e AWS_DEFAULT_REGION -e IN_WHEEL_TEST -e SHARD_NUMBER -e TEST_CONFIG -e NUM_TEST_SHARDS -e REENABLED_ISSUES -e CONTINUE_THROUGH_ERROR -e VERBOSE_TEST_LOGS -e NO_TEST_TIMEOUT -e NO_TD -e TD_DISTRIBUTED -e PR_LABELS -e MAX_JOBS=14 -e SCCACHE_BUCKET -e SCCACHE_S3_KEY_PREFIX -e XLA_CUDA -e XLA_CLANG_CACHE_S3_BUCKET_NAME -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK -e PYTORCH_TEST_RERUN_DISABLED_TESTS -e SKIP_SCCACHE_INITIALIZATION=1 -e HUGGING_FACE_HUB_TOKEN -e DASHBOARD_TAG --env-file=/tmp/github_env_9673646808 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --ipc=host --shm-size=2g --tty --detach --name= --user jenkins -v /home/ec2-user/actions-runner/_work/pytorch/pytorch:/var/lib/jenkins/workspace -w /var/lib/jenkins/workspace 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:14:29.3073682Z + container_name=249a6a65c36f4edeb56240cd27b55909b4682aa8673bdc7100a79ce2261abf95 2024-06-26T07:14:29.3074686Z + grep download.pytorch.org /etc/hosts 2024-06-26T07:14:29.3076185Z + docker exec -i 249a6a65c36f4edeb56240cd27b55909b4682aa8673bdc7100a79ce2261abf95 sudo bash -c '/bin/cat >> /etc/hosts' 2024-06-26T07:14:29.3700745Z + echo DOCKER_CONTAINER_ID=249a6a65c36f4edeb56240cd27b55909b4682aa8673bdc7100a79ce2261abf95 2024-06-26T07:14:29.3702280Z ++ echo dist/torch-2.5.0a0+gitb8c4c54-cp310-cp310-linux_x86_64.whl 2024-06-26T07:14:29.3704179Z + docker exec -t 249a6a65c36f4edeb56240cd27b55909b4682aa8673bdc7100a79ce2261abf95 sh -c 'pip install dist/torch-2.5.0a0+gitb8c4c54-cp310-cp310-linux_x86_64.whl[opt-einsum] && .ci/pytorch/test.sh' 2024-06-26T07:14:29.7533959Z Processing ./dist/torch-2.5.0a0+gitb8c4c54-cp310-cp310-linux_x86_64.whl (from torch==2.5.0a0+gitb8c4c54) 2024-06-26T07:14:30.0679741Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (3.13.1) 2024-06-26T07:14:30.0685255Z Requirement already satisfied: typing-extensions>=4.8.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (4.12.2) 2024-06-26T07:14:30.0687666Z Requirement already satisfied: sympy in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (1.12.1) 2024-06-26T07:14:30.0689849Z Requirement already satisfied: networkx in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (2.8.8) 2024-06-26T07:14:30.0691933Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (3.1.4) 2024-06-26T07:14:30.0696180Z Requirement already satisfied: fsspec in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (2024.2.0) 2024-06-26T07:14:30.0720843Z Requirement already satisfied: opt-einsum>=3.3 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (3.3.0) 2024-06-26T07:14:30.0778061Z Requirement already satisfied: numpy>=1.7 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from opt-einsum>=3.3->torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (1.21.2) 2024-06-26T07:14:30.1202777Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from jinja2->torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (2.1.5) 2024-06-26T07:14:30.1357460Z Requirement already satisfied: mpmath<1.4.0,>=1.1.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from sympy->torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (1.3.0) 2024-06-26T07:14:31.4310912Z Installing collected packages: torch 2024-06-26T07:14:40.1713174Z ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 2024-06-26T07:14:40.1714502Z timm 0.9.7 requires torchvision, which is not installed. 2024-06-26T07:14:40.1715219Z Successfully installed torch-2.5.0a0+gitb8c4c54 2024-06-26T07:14:40.2467260Z ++ dirname .ci/pytorch/test.sh 2024-06-26T07:14:40.2473146Z + source .ci/pytorch/common.sh 2024-06-26T07:14:40.2475708Z +++ dirname .ci/pytorch/common.sh 2024-06-26T07:14:40.2481786Z ++ source .ci/pytorch/common_utils.sh 2024-06-26T07:14:40.2483389Z +++ declare -f -t trap_add 2024-06-26T07:14:40.2489097Z ++ set -ex 2024-06-26T07:14:40.2489639Z ++ [[ linux-focal-cuda12.4-py3.10-gcc9-sm86 == *rocm* ]] 2024-06-26T07:14:40.2490273Z ++ BUILD_TEST_LIBTORCH=0 2024-06-26T07:14:40.2491244Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm86 != *rocm* ]] 2024-06-26T07:14:40.2493312Z ++ stat -c %u /var/lib/jenkins/workspace 2024-06-26T07:14:40.2501425Z + WORKSPACE_ORIGINAL_OWNER_ID=1000 2024-06-26T07:14:40.2501883Z + trap_add cleanup_workspace EXIT 2024-06-26T07:14:40.2502372Z + trap_add_cmd=cleanup_workspace 2024-06-26T07:14:40.2502758Z + shift 2024-06-26T07:14:40.2503046Z + for trap_add_name in "$@" 2024-06-26T07:14:40.2506440Z +++ trap -p EXIT 2024-06-26T07:14:40.2507333Z ++ eval 'extract_trap_cmd ' 2024-06-26T07:14:40.2507807Z +++ extract_trap_cmd 2024-06-26T07:14:40.2508290Z +++ printf '%s\n' '' 2024-06-26T07:14:40.2508782Z ++ printf '%s\n' cleanup_workspace 2024-06-26T07:14:40.2509356Z + trap -- ' 2024-06-26T07:14:40.2509753Z cleanup_workspace' EXIT 2024-06-26T07:14:40.2510237Z + sudo chown -R jenkins /var/lib/jenkins/workspace 2024-06-26T07:14:40.7533005Z + git config --global --add safe.directory /var/lib/jenkins/workspace 2024-06-26T07:14:40.7545516Z + echo 'Environment variables:' 2024-06-26T07:14:40.7546114Z Environment variables: 2024-06-26T07:14:40.7546525Z + env 2024-06-26T07:14:40.7550849Z INSTALLED_DB=yes 2024-06-26T07:14:40.7551436Z NV_LIBCUBLAS_VERSION=12.4.2.65-1 2024-06-26T07:14:40.7552013Z NVIDIA_VISIBLE_DEVICES=all 2024-06-26T07:14:40.7552580Z NV_NVML_DEV_VERSION=12.4.99-1 2024-06-26T07:14:40.7553258Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-06-26T07:14:40.7553978Z CONTINUE_THROUGH_ERROR=False 2024-06-26T07:14:40.7554689Z NV_LIBNCCL_DEV_PACKAGE=libnccl-dev=2.20.5-1+cuda12.4 2024-06-26T07:14:40.7555490Z NV_LIBNCCL_DEV_PACKAGE_VERSION=2.20.5-1 2024-06-26T07:14:40.7556296Z BUILD_ENVIRONMENT=linux-focal-cuda12.4-py3.10-gcc9-sm86 2024-06-26T07:14:40.7556971Z HOSTNAME=249a6a65c36f 2024-06-26T07:14:40.7557825Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_24305146-3780-461c-9a6f-6a8ef628a774 2024-06-26T07:14:40.7558657Z GITHUB_ACTION=__self 2024-06-26T07:14:40.7558999Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2024-06-26T07:14:40.7564269Z NVIDIA_REQUIRE_CUDA=cuda>=12.4 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 brand=tesla,driver>=525,driver<526 brand=unknown,driver>=525,driver<526 brand=nvidia,driver>=525,driver<526 brand=nvidiartx,driver>=525,driver<526 brand=geforce,driver>=525,driver<526 brand=geforcertx,driver>=525,driver<526 brand=quadro,driver>=525,driver<526 brand=quadrortx,driver>=525,driver<526 brand=titan,driver>=525,driver<526 brand=titanrtx,driver>=525,driver<526 brand=tesla,driver>=535,driver<536 brand=unknown,driver>=535,driver<536 brand=nvidia,driver>=535,driver<536 brand=nvidiartx,driver>=535,driver<536 brand=geforce,driver>=535,driver<536 brand=geforcertx,driver>=535,driver<536 brand=quadro,driver>=535,driver<536 brand=quadrortx,driver>=535,driver<536 brand=titan,driver>=535,driver<536 brand=titanrtx,driver>=535,driver<536 2024-06-26T07:14:40.7569962Z NV_LIBCUBLAS_DEV_PACKAGE=libcublas-dev-12-4=12.4.2.65-1 2024-06-26T07:14:40.7570467Z NV_NVTX_VERSION=12.4.99-1 2024-06-26T07:14:40.7570818Z GITHUB_RUN_NUMBER=76977 2024-06-26T07:14:40.7571155Z TEST_CONFIG=inductor_timm 2024-06-26T07:14:40.7577957Z GITHUB_REPOSITORY_OWNER_ID=21003710 2024-06-26T07:14:40.7578500Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2024-06-26T07:14:40.7578986Z NV_CUDA_CUDART_DEV_VERSION=12.4.99-1 2024-06-26T07:14:40.7579412Z NV_LIBCUSPARSE_VERSION=12.3.0.142-1 2024-06-26T07:14:40.7579834Z NV_LIBNPP_VERSION=12.2.5.2-1 2024-06-26T07:14:40.7580617Z GITHUB_TRIGGERING_ACTOR=pytorch-bot[bot] 2024-06-26T07:14:40.7581492Z CMAKE_CUDA_COMPILER_LAUNCHER=/opt/cache/bin/sccache 2024-06-26T07:14:40.7581943Z GITHUB_REF_TYPE=tag 2024-06-26T07:14:40.7582261Z TORCH_CUDA_ARCH_LIST=Maxwell 2024-06-26T07:14:40.7582630Z NCCL_VERSION=2.20.5-1 2024-06-26T07:14:40.7583008Z BASE_SHA=b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:14:40.7583437Z XLA_CUDA= 2024-06-26T07:14:40.7583951Z HUGGING_FACE_HUB_TOKEN=*** 2024-06-26T07:14:40.7584656Z *** 2024-06-26T07:14:40.7584945Z CARGO_NET_GIT_FETCH_WITH_CLI=true 2024-06-26T07:14:40.7585380Z GITHUB_REPOSITORY_ID=65600975 2024-06-26T07:14:40.7585754Z GITHUB_ACTIONS=true 2024-06-26T07:14:40.7586088Z NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:14:40.7586570Z NV_NVPROF_DEV_PACKAGE=cuda-nvprof-12-4=12.4.99-1 2024-06-26T07:14:40.7587087Z NV_LIBNPP_PACKAGE=libnpp-12-4=12.2.5.2-1 2024-06-26T07:14:40.7587546Z SHA1=b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:14:40.7588038Z NV_LIBNCCL_DEV_PACKAGE_NAME=libnccl-dev 2024-06-26T07:14:40.7588524Z GITHUB_SHA=b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:14:40.7589302Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/inductor.yml@refs/tags/ciflow/inductor/129470 2024-06-26T07:14:40.7589999Z UCC_HOME=/usr 2024-06-26T07:14:40.7590337Z NV_LIBCUBLAS_DEV_VERSION=12.4.2.65-1 2024-06-26T07:14:40.7590732Z VERBOSE_TEST_LOGS=False 2024-06-26T07:14:40.7591076Z NVIDIA_PRODUCT_NAME=CUDA 2024-06-26T07:14:40.7591522Z NV_LIBCUBLAS_DEV_PACKAGE_NAME=libcublas-dev-12-4 2024-06-26T07:14:40.7592009Z GITHUB_REF=refs/tags/ciflow/inductor/129470 2024-06-26T07:14:40.7592457Z NV_CUDA_CUDART_VERSION=12.4.99-1 2024-06-26T07:14:40.7592829Z SHARD_NUMBER=2 2024-06-26T07:14:40.7593135Z GITHUB_REF_PROTECTED=false 2024-06-26T07:14:40.7593479Z HOME=/var/lib/jenkins 2024-06-26T07:14:40.7593841Z GITHUB_API_URL=https://api.github.com 2024-06-26T07:14:40.7594272Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2024-06-26T07:14:40.7594740Z UCX_COMMIT=7bb2722ff2187a0cad557ae4a6afa090569f83fb 2024-06-26T07:14:40.7595213Z SCCACHE_S3_KEY_PREFIX=inductor 2024-06-26T07:14:40.7595590Z CUDA_VERSION=12.4.0 2024-06-26T07:14:40.7596012Z NV_LIBCUBLAS_PACKAGE=libcublas-12-4=12.4.2.65-1 2024-06-26T07:14:40.7596443Z NUM_TEST_SHARDS=2 2024-06-26T07:14:40.7596734Z UCX_HOME=/usr 2024-06-26T07:14:40.7597246Z NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE=cuda-nsight-compute-12-4=12.4.0-1 2024-06-26T07:14:40.7598294Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_24305146-3780-461c-9a6f-6a8ef628a774 2024-06-26T07:14:40.7599436Z JOB_NAME=cuda12.4-py3.10-gcc9-sm86 / test (inductor_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-06-26T07:14:40.7600956Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_24305146-3780-461c-9a6f-6a8ef628a774 2024-06-26T07:14:40.7602357Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2024-06-26T07:14:40.7603326Z GITHUB_EVENT_NAME=push 2024-06-26T07:14:40.7603810Z DASHBOARD_TAG= 2024-06-26T07:14:40.7604257Z GITHUB_RUN_ID=9673646808 2024-06-26T07:14:40.7604801Z NV_LIBNPP_DEV_PACKAGE=libnpp-dev-12-4=12.2.5.2-1 2024-06-26T07:14:40.7605393Z NV_LIBCUBLAS_PACKAGE_NAME=libcublas-12-4 2024-06-26T07:14:40.7606356Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_24305146-3780-461c-9a6f-6a8ef628a774 2024-06-26T07:14:40.7607597Z GITHUB_ACTOR=pytorch-bot[bot] 2024-06-26T07:14:40.7608005Z NV_LIBNPP_DEV_VERSION=12.2.5.2-1 2024-06-26T07:14:40.7608376Z PR_NUMBER= 2024-06-26T07:14:40.7608660Z GITHUB_RUN_ATTEMPT=1 2024-06-26T07:14:40.7608986Z ANACONDA_PYTHON_VERSION=3.10 2024-06-26T07:14:40.7609422Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2024-06-26T07:14:40.7609871Z TERM=xterm 2024-06-26T07:14:40.7610745Z NV_LIBCUSPARSE_DEV_VERSION=12.3.0.142-1 2024-06-26T07:14:40.7611254Z INSTALLED_VISION=yes 2024-06-26T07:14:40.7611955Z BRANCH= 2024-06-26T07:14:40.7612243Z OPENSSL_ROOT_DIR=/opt/openssl 2024-06-26T07:14:40.7612630Z LIBRARY_PATH=/usr/local/cuda/lib64/stubs 2024-06-26T07:14:40.7613047Z CUDA_PATH=/usr/local/cuda 2024-06-26T07:14:40.7614081Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2024-06-26T07:14:40.7615086Z GITHUB_SERVER_URL=https://github.com 2024-06-26T07:14:40.7615591Z UCC_COMMIT=20eae37090a4ce1b32bcce6144ccad0b49943e0b 2024-06-26T07:14:40.7616048Z REENABLED_ISSUES= 2024-06-26T07:14:40.7616345Z SHLVL=1 2024-06-26T07:14:40.7616605Z MAX_JOBS=14 2024-06-26T07:14:40.7616917Z NV_CUDA_LIB_VERSION=12.4.0-1 2024-06-26T07:14:40.7617269Z NVARCH=x86_64 2024-06-26T07:14:40.7617564Z GITHUB_ACTOR_ID=54816060 2024-06-26T07:14:40.7618001Z GITHUB_WORKFLOW_SHA=b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:14:40.7618521Z GITHUB_REF_NAME=ciflow/inductor/129470 2024-06-26T07:14:40.7619000Z NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-4 2024-06-26T07:14:40.7619821Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2024-06-26T07:14:40.7620696Z GITHUB_JOB=test 2024-06-26T07:14:40.7621375Z NV_LIBNCCL_PACKAGE=libnccl2=2.20.5-1+cuda12.4 2024-06-26T07:14:40.7621931Z LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64 2024-06-26T07:14:40.7622593Z NO_TEST_TIMEOUT=False 2024-06-26T07:14:40.7623049Z TD_DISTRIBUTED=False 2024-06-26T07:14:40.7623421Z NV_CUDA_NSIGHT_COMPUTE_VERSION=12.4.0-1 2024-06-26T07:14:40.7623859Z GITHUB_REPOSITORY=pytorch/pytorch 2024-06-26T07:14:40.7624257Z NV_NVPROF_VERSION=12.4.99-1 2024-06-26T07:14:40.7624626Z GITHUB_RETENTION_DAYS=90 2024-06-26T07:14:40.7624973Z OPENSSL_DIR=/opt/openssl 2024-06-26T07:14:40.7625324Z GITHUB_ACTION_REPOSITORY= 2024-06-26T07:14:40.7626555Z PATH=/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-06-26T07:14:40.7628313Z GITHUB_BASE_REF= 2024-06-26T07:14:40.7628740Z NV_LIBNCCL_PACKAGE_NAME=libnccl2 2024-06-26T07:14:40.7629112Z CI=true 2024-06-26T07:14:40.7629431Z NV_LIBNCCL_PACKAGE_VERSION=2.20.5-1 2024-06-26T07:14:40.7629844Z GITHUB_REPOSITORY_OWNER=pytorch 2024-06-26T07:14:40.7630210Z JOB_ID=26688921813 2024-06-26T07:14:40.7630531Z INSTALLED_PROTOBUF=yes 2024-06-26T07:14:40.7631017Z GITHUB_HEAD_REF= 2024-06-26T07:14:40.7631318Z GITHUB_ACTION_REF= 2024-06-26T07:14:40.7632089Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2024-06-26T07:14:40.7632793Z GITHUB_WORKFLOW=inductor 2024-06-26T07:14:40.7633150Z DEBIAN_FRONTEND=noninteractive 2024-06-26T07:14:40.7634034Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_24305146-3780-461c-9a6f-6a8ef628a774 2024-06-26T07:14:40.7634822Z NO_TD=False 2024-06-26T07:14:40.7635165Z SKIP_SCCACHE_INITIALIZATION=1 2024-06-26T07:14:40.7635521Z _=/usr/bin/env 2024-06-26T07:14:40.7636180Z ++ python -c 'import site; print(site.getsitepackages()[0])' 2024-06-26T07:14:40.7705557Z + TORCH_INSTALL_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch 2024-06-26T07:14:40.7706694Z + TORCH_BIN_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/bin 2024-06-26T07:14:40.7707733Z + TORCH_LIB_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/lib 2024-06-26T07:14:40.7708787Z + TORCH_TEST_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/test 2024-06-26T07:14:40.7709499Z + BUILD_DIR=build 2024-06-26T07:14:40.7709944Z + BUILD_RENAMED_DIR=build_renamed 2024-06-26T07:14:40.7710466Z + BUILD_BIN_DIR=build/bin 2024-06-26T07:14:40.7710811Z + SHARD_NUMBER=2 2024-06-26T07:14:40.7711120Z + NUM_TEST_SHARDS=2 2024-06-26T07:14:40.7711433Z + export VALGRIND=ON 2024-06-26T07:14:40.7711751Z + VALGRIND=ON 2024-06-26T07:14:40.7712228Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm86 == *clang9* ]] 2024-06-26T07:14:40.7712722Z + [[ 0 == \1 ]] 2024-06-26T07:14:40.7713011Z + [[ False == \1 ]] 2024-06-26T07:14:40.7713476Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm86 != *bazel* ]] 2024-06-26T07:14:40.7713999Z ++ realpath build/custom_test_artifacts 2024-06-26T07:14:40.7718355Z + CUSTOM_TEST_ARTIFACT_BUILD_DIR=/var/lib/jenkins/workspace/build/custom_test_artifacts 2024-06-26T07:14:40.7719056Z + [[ -n '' ]] 2024-06-26T07:14:40.7719416Z + echo 'Environment variables' 2024-06-26T07:14:40.7720108Z Environment variables 2024-06-26T07:14:40.7720441Z + env 2024-06-26T07:14:40.7724247Z INSTALLED_DB=yes 2024-06-26T07:14:40.7724775Z NV_LIBCUBLAS_VERSION=12.4.2.65-1 2024-06-26T07:14:40.7725609Z NVIDIA_VISIBLE_DEVICES=all 2024-06-26T07:14:40.7726124Z NV_NVML_DEV_VERSION=12.4.99-1 2024-06-26T07:14:40.7726941Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-06-26T07:14:40.7727687Z CONTINUE_THROUGH_ERROR=False 2024-06-26T07:14:40.7728344Z NV_LIBNCCL_DEV_PACKAGE=libnccl-dev=2.20.5-1+cuda12.4 2024-06-26T07:14:40.7730314Z NV_LIBNCCL_DEV_PACKAGE_VERSION=2.20.5-1 2024-06-26T07:14:40.7731126Z BUILD_ENVIRONMENT=linux-focal-cuda12.4-py3.10-gcc9-sm86 2024-06-26T07:14:40.7732271Z HOSTNAME=249a6a65c36f 2024-06-26T07:14:40.7733823Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_24305146-3780-461c-9a6f-6a8ef628a774 2024-06-26T07:14:40.7734756Z GITHUB_ACTION=__self 2024-06-26T07:14:40.7735304Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2024-06-26T07:14:40.7742101Z NVIDIA_REQUIRE_CUDA=cuda>=12.4 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 brand=tesla,driver>=525,driver<526 brand=unknown,driver>=525,driver<526 brand=nvidia,driver>=525,driver<526 brand=nvidiartx,driver>=525,driver<526 brand=geforce,driver>=525,driver<526 brand=geforcertx,driver>=525,driver<526 brand=quadro,driver>=525,driver<526 brand=quadrortx,driver>=525,driver<526 brand=titan,driver>=525,driver<526 brand=titanrtx,driver>=525,driver<526 brand=tesla,driver>=535,driver<536 brand=unknown,driver>=535,driver<536 brand=nvidia,driver>=535,driver<536 brand=nvidiartx,driver>=535,driver<536 brand=geforce,driver>=535,driver<536 brand=geforcertx,driver>=535,driver<536 brand=quadro,driver>=535,driver<536 brand=quadrortx,driver>=535,driver<536 brand=titan,driver>=535,driver<536 brand=titanrtx,driver>=535,driver<536 2024-06-26T07:14:40.7749726Z NV_LIBCUBLAS_DEV_PACKAGE=libcublas-dev-12-4=12.4.2.65-1 2024-06-26T07:14:40.7750331Z NV_NVTX_VERSION=12.4.99-1 2024-06-26T07:14:40.7750893Z GITHUB_RUN_NUMBER=76977 2024-06-26T07:14:40.7751254Z TEST_CONFIG=inductor_timm 2024-06-26T07:14:40.7751627Z GITHUB_REPOSITORY_OWNER_ID=21003710 2024-06-26T07:14:40.7752100Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2024-06-26T07:14:40.7752762Z NV_CUDA_CUDART_DEV_VERSION=12.4.99-1 2024-06-26T07:14:40.7753204Z NV_LIBCUSPARSE_VERSION=12.3.0.142-1 2024-06-26T07:14:40.7754025Z NV_LIBNPP_VERSION=12.2.5.2-1 2024-06-26T07:14:40.7754476Z GITHUB_TRIGGERING_ACTOR=pytorch-bot[bot] 2024-06-26T07:14:40.7754968Z CMAKE_CUDA_COMPILER_LAUNCHER=/opt/cache/bin/sccache 2024-06-26T07:14:40.7755437Z GITHUB_REF_TYPE=tag 2024-06-26T07:14:40.7755768Z TORCH_CUDA_ARCH_LIST=Maxwell 2024-06-26T07:14:40.7756149Z NCCL_VERSION=2.20.5-1 2024-06-26T07:14:40.7756553Z BASE_SHA=b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:14:40.7757188Z XLA_CUDA= 2024-06-26T07:14:40.7757697Z HUGGING_FACE_HUB_TOKEN=*** 2024-06-26T07:14:40.7758100Z *** 2024-06-26T07:14:40.7758577Z CARGO_NET_GIT_FETCH_WITH_CLI=true 2024-06-26T07:14:40.7759463Z GITHUB_REPOSITORY_ID=65600975 2024-06-26T07:14:40.7760218Z GITHUB_ACTIONS=true 2024-06-26T07:14:40.7760553Z NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:14:40.7761054Z NV_NVPROF_DEV_PACKAGE=cuda-nvprof-12-4=12.4.99-1 2024-06-26T07:14:40.7761580Z NV_LIBNPP_PACKAGE=libnpp-12-4=12.2.5.2-1 2024-06-26T07:14:40.7762417Z SHA1=b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:14:40.7762922Z NV_LIBNCCL_DEV_PACKAGE_NAME=libnccl-dev 2024-06-26T07:14:40.7763406Z GITHUB_SHA=b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:14:40.7764551Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/inductor.yml@refs/tags/ciflow/inductor/129470 2024-06-26T07:14:40.7765274Z UCC_HOME=/usr 2024-06-26T07:14:40.7765769Z NV_LIBCUBLAS_DEV_VERSION=12.4.2.65-1 2024-06-26T07:14:40.7766265Z VERBOSE_TEST_LOGS=False 2024-06-26T07:14:40.7766616Z NVIDIA_PRODUCT_NAME=CUDA 2024-06-26T07:14:40.7767360Z NV_LIBCUBLAS_DEV_PACKAGE_NAME=libcublas-dev-12-4 2024-06-26T07:14:40.7768394Z GITHUB_REF=refs/tags/ciflow/inductor/129470 2024-06-26T07:14:40.7769007Z NV_CUDA_CUDART_VERSION=12.4.99-1 2024-06-26T07:14:40.7769387Z SHARD_NUMBER=2 2024-06-26T07:14:40.7769711Z GITHUB_REF_PROTECTED=false 2024-06-26T07:14:40.7770287Z HOME=/var/lib/jenkins 2024-06-26T07:14:40.7770663Z GITHUB_API_URL=https://api.github.com 2024-06-26T07:14:40.7771305Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2024-06-26T07:14:40.7771790Z UCX_COMMIT=7bb2722ff2187a0cad557ae4a6afa090569f83fb 2024-06-26T07:14:40.7772485Z SCCACHE_S3_KEY_PREFIX=inductor 2024-06-26T07:14:40.7793245Z CUDA_VERSION=12.4.0 2024-06-26T07:14:40.7793776Z NV_LIBCUBLAS_PACKAGE=libcublas-12-4=12.4.2.65-1 2024-06-26T07:14:40.7794235Z NUM_TEST_SHARDS=2 2024-06-26T07:14:40.7794535Z UCX_HOME=/usr 2024-06-26T07:14:40.7795067Z NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE=cuda-nsight-compute-12-4=12.4.0-1 2024-06-26T07:14:40.7796131Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_24305146-3780-461c-9a6f-6a8ef628a774 2024-06-26T07:14:40.7797285Z JOB_NAME=cuda12.4-py3.10-gcc9-sm86 / test (inductor_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-06-26T07:14:40.7798427Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_24305146-3780-461c-9a6f-6a8ef628a774 2024-06-26T07:14:40.7799508Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2024-06-26T07:14:40.7800164Z GITHUB_EVENT_NAME=push 2024-06-26T07:14:40.7800500Z DASHBOARD_TAG= 2024-06-26T07:14:40.7800804Z GITHUB_RUN_ID=9673646808 2024-06-26T07:14:40.7801264Z NV_LIBNPP_DEV_PACKAGE=libnpp-dev-12-4=12.2.5.2-1 2024-06-26T07:14:40.7801788Z NV_LIBCUBLAS_PACKAGE_NAME=libcublas-12-4 2024-06-26T07:14:40.7802757Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_24305146-3780-461c-9a6f-6a8ef628a774 2024-06-26T07:14:40.7803629Z GITHUB_ACTOR=pytorch-bot[bot] 2024-06-26T07:14:40.7804035Z NV_LIBNPP_DEV_VERSION=12.2.5.2-1 2024-06-26T07:14:40.7804408Z PR_NUMBER= 2024-06-26T07:14:40.7804704Z GITHUB_RUN_ATTEMPT=1 2024-06-26T07:14:40.7805046Z VALGRIND=ON 2024-06-26T07:14:40.7805368Z ANACONDA_PYTHON_VERSION=3.10 2024-06-26T07:14:40.7805805Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2024-06-26T07:14:40.7806262Z TERM=xterm 2024-06-26T07:14:40.7806587Z NV_LIBCUSPARSE_DEV_VERSION=12.3.0.142-1 2024-06-26T07:14:40.7808118Z INSTALLED_VISION=yes 2024-06-26T07:14:40.7808440Z BRANCH= 2024-06-26T07:14:40.7808729Z OPENSSL_ROOT_DIR=/opt/openssl 2024-06-26T07:14:40.7809132Z LIBRARY_PATH=/usr/local/cuda/lib64/stubs 2024-06-26T07:14:40.7809560Z CUDA_PATH=/usr/local/cuda 2024-06-26T07:14:40.7810302Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2024-06-26T07:14:40.7811184Z GITHUB_SERVER_URL=https://github.com 2024-06-26T07:14:40.7811674Z UCC_COMMIT=20eae37090a4ce1b32bcce6144ccad0b49943e0b 2024-06-26T07:14:40.7812132Z REENABLED_ISSUES= 2024-06-26T07:14:40.7813235Z SHLVL=1 2024-06-26T07:14:40.7813777Z MAX_JOBS=14 2024-06-26T07:14:40.7814115Z NV_CUDA_LIB_VERSION=12.4.0-1 2024-06-26T07:14:40.7814752Z NVARCH=x86_64 2024-06-26T07:14:40.7815097Z GITHUB_ACTOR_ID=54816060 2024-06-26T07:14:40.7815558Z GITHUB_WORKFLOW_SHA=b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:14:40.7816213Z GITHUB_REF_NAME=ciflow/inductor/129470 2024-06-26T07:14:40.7816932Z NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-4 2024-06-26T07:14:40.7817575Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2024-06-26T07:14:40.7818292Z GITHUB_JOB=test 2024-06-26T07:14:40.7818697Z NV_LIBNCCL_PACKAGE=libnccl2=2.20.5-1+cuda12.4 2024-06-26T07:14:40.7819409Z LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64 2024-06-26T07:14:40.7820206Z NO_TEST_TIMEOUT=False 2024-06-26T07:14:40.7820569Z TD_DISTRIBUTED=False 2024-06-26T07:14:40.7821310Z NV_CUDA_NSIGHT_COMPUTE_VERSION=12.4.0-1 2024-06-26T07:14:40.7821825Z GITHUB_REPOSITORY=pytorch/pytorch 2024-06-26T07:14:40.7822228Z NV_NVPROF_VERSION=12.4.99-1 2024-06-26T07:14:40.7822772Z GITHUB_RETENTION_DAYS=90 2024-06-26T07:14:40.7823123Z OPENSSL_DIR=/opt/openssl 2024-06-26T07:14:40.7823464Z GITHUB_ACTION_REPOSITORY= 2024-06-26T07:14:40.7824705Z PATH=/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-06-26T07:14:40.7825798Z GITHUB_BASE_REF= 2024-06-26T07:14:40.7826309Z NV_LIBNCCL_PACKAGE_NAME=libnccl2 2024-06-26T07:14:40.7826680Z CI=true 2024-06-26T07:14:40.7827012Z NV_LIBNCCL_PACKAGE_VERSION=2.20.5-1 2024-06-26T07:14:40.7827428Z GITHUB_REPOSITORY_OWNER=pytorch 2024-06-26T07:14:40.7827799Z JOB_ID=26688921813 2024-06-26T07:14:40.7828977Z INSTALLED_PROTOBUF=yes 2024-06-26T07:14:40.7829421Z GITHUB_HEAD_REF= 2024-06-26T07:14:40.7829780Z GITHUB_ACTION_REF= 2024-06-26T07:14:40.7830333Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2024-06-26T07:14:40.7830893Z GITHUB_WORKFLOW=inductor 2024-06-26T07:14:40.7831253Z DEBIAN_FRONTEND=noninteractive 2024-06-26T07:14:40.7832217Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_24305146-3780-461c-9a6f-6a8ef628a774 2024-06-26T07:14:40.7833312Z NO_TD=False 2024-06-26T07:14:40.7833631Z SKIP_SCCACHE_INITIALIZATION=1 2024-06-26T07:14:40.7833989Z _=/usr/bin/env 2024-06-26T07:14:40.7834333Z + echo 'Testing pytorch' 2024-06-26T07:14:40.7834670Z Testing pytorch 2024-06-26T07:14:40.7834998Z + export LANG=C.UTF-8 2024-06-26T07:14:40.7835336Z + LANG=C.UTF-8 2024-06-26T07:14:40.7835628Z + PR_NUMBER= 2024-06-26T07:14:40.7835955Z + [[ inductor_timm == \d\e\f\a\u\l\t ]] 2024-06-26T07:14:40.7836420Z + [[ inductor_timm == \d\i\s\t\r\i\b\u\t\e\d ]] 2024-06-26T07:14:40.7836878Z + [[ inductor_timm == \s\l\o\w ]] 2024-06-26T07:14:40.7837562Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm86 == *slow-gradcheck* ]] 2024-06-26T07:14:40.7838415Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm86 == *cuda* ]] 2024-06-26T07:14:40.7839286Z + export PYTORCH_TESTING_DEVICE_ONLY_FOR=cuda 2024-06-26T07:14:40.7839764Z + PYTORCH_TESTING_DEVICE_ONLY_FOR=cuda 2024-06-26T07:14:40.7840191Z + [[ inductor_timm == *crossref* ]] 2024-06-26T07:14:40.7840941Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm86 == *rocm* ]] 2024-06-26T07:14:40.7841815Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm86 == *xpu* ]] 2024-06-26T07:14:40.7842848Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm86 != *-bazel-* ]] 2024-06-26T07:14:40.7843411Z + pip_install --user ninja==1.10.2 2024-06-26T07:14:40.7844160Z + pip install --progress-bar off --user ninja==1.10.2 2024-06-26T07:14:41.1367534Z Collecting ninja==1.10.2 2024-06-26T07:14:41.1529549Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl.metadata (5.0 kB) 2024-06-26T07:14:41.1666365Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl (108 kB) 2024-06-26T07:14:42.4588241Z Installing collected packages: ninja 2024-06-26T07:14:42.4655021Z  WARNING: The script ninja is installed in '/var/lib/jenkins/.local/bin' which is not on PATH. 2024-06-26T07:14:42.4656320Z Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. 2024-06-26T07:14:42.4694331Z Successfully installed ninja-1.10.2 2024-06-26T07:14:42.5537728Z + export PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-06-26T07:14:42.5539823Z + PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-06-26T07:14:42.5541569Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm86 == *aarch64* ]] 2024-06-26T07:14:42.5542081Z + install_tlparse 2024-06-26T07:14:42.5542451Z + pip_install --user tlparse==0.3.7 2024-06-26T07:14:42.5543431Z + pip install --progress-bar off --user tlparse==0.3.7 2024-06-26T07:14:42.9049187Z Collecting tlparse==0.3.7 2024-06-26T07:14:42.9212864Z Downloading tlparse-0.3.7-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (346 bytes) 2024-06-26T07:14:42.9316968Z Downloading tlparse-0.3.7-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.2 MB) 2024-06-26T07:14:44.2494361Z Installing collected packages: tlparse 2024-06-26T07:14:44.2870738Z Successfully installed tlparse-0.3.7 2024-06-26T07:14:44.3698257Z ++ python -m site --user-base 2024-06-26T07:14:44.3851638Z + PATH=/var/lib/jenkins/.local/bin:/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-06-26T07:14:44.3853475Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm86 == *asan* ]] 2024-06-26T07:14:44.3854124Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm86 == *-debug* ]] 2024-06-26T07:14:44.3854891Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm86 != *-bazel-* ]] 2024-06-26T07:14:44.3855825Z + echo 'We are not in debug mode: linux-focal-cuda12.4-py3.10-gcc9-sm86. Expect the assertion to pass' 2024-06-26T07:14:44.3857149Z We are not in debug mode: linux-focal-cuda12.4-py3.10-gcc9-sm86. Expect the assertion to pass 2024-06-26T07:14:44.3858045Z + cd test 2024-06-26T07:14:44.3858572Z + python -c 'import torch; torch._C._crash_if_debug_asserts_fail(424242)' 2024-06-26T07:14:45.8814504Z + [[ inductor_timm == \n\o\g\p\u\_\N\O\_\A\V\X\2 ]] 2024-06-26T07:14:45.8815081Z + [[ inductor_timm == \n\o\g\p\u\_\A\V\X\5\1\2 ]] 2024-06-26T07:14:45.8815834Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm86 != *-bazel-* ]] 2024-06-26T07:14:45.8816340Z + pushd test 2024-06-26T07:14:45.8816675Z ~/workspace/test ~/workspace 2024-06-26T07:14:45.8817617Z ++ python -c 'import torch; print(torch.version.cuda)' 2024-06-26T07:14:47.3635166Z + CUDA_VERSION=12.4 2024-06-26T07:14:47.3635706Z + '[' 12.4 == 12.4 ']' 2024-06-26T07:14:47.3636076Z + ISCUDA124=cu124 2024-06-26T07:14:47.3636391Z + popd 2024-06-26T07:14:47.3636662Z ~/workspace 2024-06-26T07:14:47.3640263Z + DYNAMO_BENCHMARK_FLAGS=() 2024-06-26T07:14:47.3640811Z + [[ inductor_timm == *dynamo_eager* ]] 2024-06-26T07:14:47.3641277Z + [[ inductor_timm == *aot_eager* ]] 2024-06-26T07:14:47.3641715Z + [[ inductor_timm == *aot_inductor* ]] 2024-06-26T07:14:47.3642147Z + [[ inductor_timm == *inductor* ]] 2024-06-26T07:14:47.3642551Z + [[ inductor_timm != *perf* ]] 2024-06-26T07:14:47.3643032Z + DYNAMO_BENCHMARK_FLAGS+=(--inductor) 2024-06-26T07:14:47.3643464Z + [[ inductor_timm == *dynamic* ]] 2024-06-26T07:14:47.3643884Z + [[ inductor_timm == *cpu_inductor* ]] 2024-06-26T07:14:47.3644367Z + DYNAMO_BENCHMARK_FLAGS+=(--device cuda) 2024-06-26T07:14:47.3671431Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm86 == *libtorch* ]] 2024-06-26T07:14:47.3672179Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm86 == *-bazel-* ]] 2024-06-26T07:14:47.3672947Z + cd test 2024-06-26T07:14:47.3673401Z + python -c 'import torch; print(torch.__config__.show())' 2024-06-26T07:14:48.7070084Z PyTorch built with: 2024-06-26T07:14:48.7070814Z - GCC 9.4 2024-06-26T07:14:48.7071271Z - C++ Version: 201703 2024-06-26T07:14:48.7072282Z - Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications 2024-06-26T07:14:48.7073349Z - Intel(R) MKL-DNN v3.4.2 (Git Hash 1137e04ec0b5251ca2b4400a4fd3c667ce843d67) 2024-06-26T07:14:48.7074014Z - OpenMP 201511 (a.k.a. OpenMP 4.5) 2024-06-26T07:14:48.7074522Z - LAPACK is enabled (usually provided by MKL) 2024-06-26T07:14:48.7075009Z - NNPACK is enabled 2024-06-26T07:14:48.7075399Z - CPU capability usage: AVX2 2024-06-26T07:14:48.7075811Z - CUDA Runtime 12.4 2024-06-26T07:14:48.7076325Z - NVCC architecture flags: -gencode;arch=compute_86,code=sm_86 2024-06-26T07:14:48.7076874Z - CuDNN 90.1 2024-06-26T07:14:48.7077201Z - Magma 2.6.1 2024-06-26T07:14:48.7084381Z - Build settings: BLAS_INFO=mkl, BUILD_TYPE=Release, CUDA_VERSION=12.4, CUDNN_VERSION=9.1.0, CXX_COMPILER=/opt/cache/bin/c++, CXX_FLAGS= -D_GLIBCXX_USE_CXX11_ABI=1 -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOROCTRACER -DUSE_FBGEMM -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -O2 -fPIC -Wall -Wextra -Werror=return-type -Werror=non-virtual-dtor -Werror=bool-operation -Wnarrowing -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-unused-parameter -Wno-unused-function -Wno-unused-result -Wno-strict-overflow -Wno-strict-aliasing -Wno-stringop-overflow -Wsuggest-override -Wno-psabi -Wno-error=pedantic -Wno-error=old-style-cast -Wno-missing-braces -fdiagnostics-color=always -faligned-new -Werror -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Wno-stringop-overflow, FORCE_FALLBACK_CUDA_MPI=1, LAPACK_INFO=mkl, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, PERF_WITH_AVX512=1, TORCH_VERSION=2.5.0, USE_CUDA=ON, USE_CUDNN=ON, USE_CUSPARSELT=ON, USE_EXCEPTION_PTR=1, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_GLOO=ON, USE_MKL=ON, USE_MKLDNN=ON, USE_MPI=ON, USE_NCCL=ON, USE_NNPACK=ON, USE_OPENMP=ON, USE_ROCM=OFF, USE_ROCM_KERNEL_ASSERT=OFF, 2024-06-26T07:14:48.7090953Z 2024-06-26T07:14:48.9855583Z + cd test 2024-06-26T07:14:48.9856297Z + python -c 'import torch; print(torch.__config__.parallel_info())' 2024-06-26T07:14:50.1961414Z ATen/Parallel: 2024-06-26T07:14:50.1962002Z at::get_num_threads() : 8 2024-06-26T07:14:50.1962496Z at::get_num_interop_threads() : 16 2024-06-26T07:14:50.1963001Z OpenMP 201511 (a.k.a. OpenMP 4.5) 2024-06-26T07:14:50.1963438Z omp_get_max_threads() : 8 2024-06-26T07:14:50.1964405Z Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications 2024-06-26T07:14:50.1965196Z mkl_get_max_threads() : 8 2024-06-26T07:14:50.1965805Z Intel(R) MKL-DNN v3.4.2 (Git Hash 1137e04ec0b5251ca2b4400a4fd3c667ce843d67) 2024-06-26T07:14:50.1966435Z std::thread::hardware_concurrency() : 16 2024-06-26T07:14:50.1966898Z Environment variables: 2024-06-26T07:14:50.1967254Z OMP_NUM_THREADS : [not set] 2024-06-26T07:14:50.1967619Z MKL_NUM_THREADS : [not set] 2024-06-26T07:14:50.1967993Z ATen parallel backend: OpenMP 2024-06-26T07:14:50.1968242Z 2024-06-26T07:14:50.4380343Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm86 == *aarch64* ]] 2024-06-26T07:14:50.4380915Z + [[ inductor_timm == *backward* ]] 2024-06-26T07:14:50.4381450Z + [[ inductor_timm == *xla* ]] 2024-06-26T07:14:50.4381999Z + [[ inductor_timm == *executorch* ]] 2024-06-26T07:14:50.4382492Z + [[ inductor_timm == \j\i\t\_\l\e\g\a\c\y ]] 2024-06-26T07:14:50.4383126Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm86 == *libtorch* ]] 2024-06-26T07:14:50.4383749Z + [[ inductor_timm == distributed ]] 2024-06-26T07:14:50.4384249Z + [[ inductor_timm == *inductor_distributed* ]] 2024-06-26T07:14:50.4384835Z + [[ inductor_timm == *inductor-halide* ]] 2024-06-26T07:14:50.4385384Z + [[ inductor_timm == *inductor-micro-benchmark* ]] 2024-06-26T07:14:50.4385881Z + [[ inductor_timm == *huggingface* ]] 2024-06-26T07:14:50.4386302Z + [[ inductor_timm == *timm* ]] 2024-06-26T07:14:50.4386681Z + install_torchvision 2024-06-26T07:14:50.4387012Z + local orig_preload 2024-06-26T07:14:50.4387332Z + local commit 2024-06-26T07:14:50.4387641Z ++ get_pinned_commit vision 2024-06-26T07:14:50.4388029Z ++ cat .github/ci_commit_pins/vision.txt 2024-06-26T07:14:50.4396226Z + commit=d23a6e1664d20707c11781299611436e1f0c104f 2024-06-26T07:14:50.4396836Z + orig_preload= 2024-06-26T07:14:50.4397190Z + '[' -n '' ']' 2024-06-26T07:14:50.4398016Z + pip_install --no-use-pep517 --user git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2024-06-26T07:14:50.4399414Z + pip install --progress-bar off --no-use-pep517 --user git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2024-06-26T07:14:50.7507687Z Collecting git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2024-06-26T07:14:50.7511298Z Cloning https://github.com/pytorch/vision.git (to revision d23a6e1664d20707c11781299611436e1f0c104f) to /tmp/pip-req-build-d1gsu9s4 2024-06-26T07:14:50.7525688Z Running command git clone --filter=blob:none --quiet https://github.com/pytorch/vision.git /tmp/pip-req-build-d1gsu9s4 2024-06-26T07:14:52.0883648Z Running command git rev-parse -q --verify 'sha^d23a6e1664d20707c11781299611436e1f0c104f' 2024-06-26T07:14:52.0903520Z Running command git fetch -q https://github.com/pytorch/vision.git d23a6e1664d20707c11781299611436e1f0c104f 2024-06-26T07:14:53.2903375Z Running command git checkout -q d23a6e1664d20707c11781299611436e1f0c104f 2024-06-26T07:14:53.5852791Z Resolved https://github.com/pytorch/vision.git to commit d23a6e1664d20707c11781299611436e1f0c104f 2024-06-26T07:14:55.8964878Z Preparing metadata (setup.py) ... [?25l- \ done 2024-06-26T07:14:55.9013963Z [?25hRequirement already satisfied: numpy in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (1.21.2) 2024-06-26T07:14:55.9016094Z Requirement already satisfied: torch in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (2.5.0a0+gitb8c4c54) 2024-06-26T07:14:55.9021645Z Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (10.3.0) 2024-06-26T07:14:55.9224078Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (3.13.1) 2024-06-26T07:14:55.9230088Z Requirement already satisfied: typing-extensions>=4.8.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (4.12.2) 2024-06-26T07:14:55.9232420Z Requirement already satisfied: sympy in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (1.12.1) 2024-06-26T07:14:55.9235497Z Requirement already satisfied: networkx in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (2.8.8) 2024-06-26T07:14:55.9238071Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (3.1.4) 2024-06-26T07:14:55.9240755Z Requirement already satisfied: fsspec in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (2024.2.0) 2024-06-26T07:14:55.9659778Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from jinja2->torch->torchvision==0.19.0a0+d23a6e1) (2.1.5) 2024-06-26T07:14:55.9811820Z Requirement already satisfied: mpmath<1.4.0,>=1.1.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from sympy->torch->torchvision==0.19.0a0+d23a6e1) (1.3.0) 2024-06-26T07:14:55.9884682Z Building wheels for collected packages: torchvision 2024-06-26T07:16:06.4743343Z Building wheel for torchvision (setup.py) ... [?25l- \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | done 2024-06-26T07:16:06.4771557Z [?25h Created wheel for torchvision: filename=torchvision-0.19.0a0+d23a6e1-cp310-cp310-linux_x86_64.whl size=2023555 sha256=f37671f42023743d8b0c6b5be6eccf160831a2e4cbb44a4e4bf0c301d9946eb9 2024-06-26T07:16:06.4773540Z Stored in directory: /var/lib/jenkins/.cache/pip/wheels/0e/56/35/02931e71eb23fd2b85591c7ec05b733ca7c8b328a2fd151f96 2024-06-26T07:16:06.4808203Z Successfully built torchvision 2024-06-26T07:16:07.6832387Z Installing collected packages: torchvision 2024-06-26T07:16:08.0655038Z Successfully installed torchvision-0.19.0a0+d23a6e1 2024-06-26T07:16:08.1746966Z + '[' -n '' ']' 2024-06-26T07:16:08.1747414Z + id=1 2024-06-26T07:16:08.1748045Z + test_dynamo_benchmark timm_models 1 2024-06-26T07:16:08.1748909Z ++ pwd 2024-06-26T07:16:08.1751398Z + TEST_REPORTS_DIR=/var/lib/jenkins/workspace/test/test-reports 2024-06-26T07:16:08.1751940Z + local suite=timm_models 2024-06-26T07:16:08.1755574Z + shift 2024-06-26T07:16:08.1756034Z + local shard_id=1 2024-06-26T07:16:08.1756357Z + shift 2024-06-26T07:16:08.1756671Z + [[ inductor_timm == *perf_compare* ]] 2024-06-26T07:16:08.1757108Z + [[ inductor_timm == *perf* ]] 2024-06-26T07:16:08.1757582Z + [[ inductor_timm == *cpu_inductor* ]] 2024-06-26T07:16:08.1758157Z + [[ inductor_timm == *aot_inductor* ]] 2024-06-26T07:16:08.1759082Z + test_single_dynamo_benchmark inference timm_models 1 --inference --bfloat16 2024-06-26T07:16:08.1759664Z ++ pwd 2024-06-26T07:16:08.1760127Z + TEST_REPORTS_DIR=/var/lib/jenkins/workspace/test/test-reports 2024-06-26T07:16:08.1760791Z + mkdir -p /var/lib/jenkins/workspace/test/test-reports 2024-06-26T07:16:08.1768716Z + local name=inference 2024-06-26T07:16:08.1769243Z + shift 2024-06-26T07:16:08.1769622Z + local suite=timm_models 2024-06-26T07:16:08.1769968Z + shift 2024-06-26T07:16:08.1770247Z + local shard_id=1 2024-06-26T07:16:08.1770639Z + shift 2024-06-26T07:16:08.1770923Z + partition_flags=() 2024-06-26T07:16:08.1771285Z + local partition_flags 2024-06-26T07:16:08.1771688Z + [[ -n 2 ]] 2024-06-26T07:16:08.1772002Z + [[ -n 1 ]] 2024-06-26T07:16:08.1772591Z + partition_flags=(--total-partitions "$NUM_TEST_SHARDS" --partition-id "$shard_id") 2024-06-26T07:16:08.1773238Z + [[ inductor_timm == *perf_compare* ]] 2024-06-26T07:16:08.1773794Z + [[ inductor_timm == *perf* ]] 2024-06-26T07:16:08.1774199Z + [[ inductor_timm == *aot_inductor* ]] 2024-06-26T07:16:08.1775735Z + python benchmarks/dynamo/timm_models.py --ci --accuracy --timing --explain --inductor --device cuda --inference --bfloat16 --total-partitions 2 --partition-id 1 --output /var/lib/jenkins/workspace/test/test-reports/inference_timm_models.csv 2024-06-26T07:16:14.0397064Z 2024-06-26T07:16:14.1846622Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:16:14.1846961Z 2024-06-26T07:16:14.3351428Z model.safetensors: 0% 0.00/29.6M [00:00 will be ignored 2024-06-26T07:35:58.7912776Z pass 2024-06-26T07:35:58.7957953Z TIMING: entire_frame_compile:69.32564 code_gen:29.94015 inductor_compile:50.29008 backend_compile:57.94501 2024-06-26T07:35:58.7959231Z STATS: call_* op count: 797 | FakeTensor.__torch_dispatch__:16656 | FakeTensorMode.__torch_dispatch__:84942 | ProxyTorchDispatchMode.__torch_dispatch__:17697 2024-06-26T07:35:58.7960331Z Dynamo produced 4 graphs covering 797 ops with 7 graph breaks (5 unique) 2024-06-26T07:36:05.8965524Z 2024-06-26T07:36:06.6374100Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:36:06.6374706Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:36:06.6375142Z cuda train mobilenetv2_100 2024-06-26T07:36:47.2324009Z W0626 07:36:47.231000 140318868042368 torch/_logging/_internal.py:1040] [6/0] Profiler function will be ignored 2024-06-26T07:37:30.7681343Z pass 2024-06-26T07:37:30.7727273Z TIMING: entire_frame_compile:66.17819 code_gen:26.7346 inductor_compile:48.62337 backend_compile:54.81546 2024-06-26T07:37:30.7729126Z STATS: call_* op count: 796 | FakeTensor.__torch_dispatch__:17634 | FakeTensorMode.__torch_dispatch__:86783 | ProxyTorchDispatchMode.__torch_dispatch__:17713 2024-06-26T07:37:30.7730250Z Dynamo produced 3 graphs covering 796 ops with 7 graph breaks (5 unique) 2024-06-26T07:37:37.8693385Z 2024-06-26T07:37:38.6889239Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:37:38.6889829Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:37:38.6891453Z cuda train mobilenetv3_large_100 2024-06-26T07:38:22.6350291Z W0626 07:38:22.634000 139992215732864 torch/_logging/_internal.py:1040] [6/0] Profiler function will be ignored 2024-06-26T07:39:13.0005915Z pass 2024-06-26T07:39:13.0074831Z TIMING: entire_frame_compile:73.82706 code_gen:32.00445 inductor_compile:55.90188 backend_compile:61.69254 2024-06-26T07:39:13.0076104Z STATS: call_* op count: 855 | FakeTensor.__torch_dispatch__:19057 | FakeTensorMode.__torch_dispatch__:93236 | ProxyTorchDispatchMode.__torch_dispatch__:19569 2024-06-26T07:39:13.0080091Z Dynamo produced 3 graphs covering 855 ops with 7 graph breaks (5 unique) 2024-06-26T07:39:20.4202860Z 2024-06-26T07:39:21.2266035Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:39:21.2266498Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:39:21.2266942Z cuda train mobilevit_s 2024-06-26T07:40:38.8072489Z pass 2024-06-26T07:40:38.8150422Z TIMING: entire_frame_compile:34.58756 code_gen:39.98243 inductor_compile:57.15268 backend_compile:29.94837 2024-06-26T07:40:38.8152606Z STATS: call_* op count: 503 | FakeTensor.__torch_dispatch__:11221 | FakeTensorMode.__torch_dispatch__:58485 | ProxyTorchDispatchMode.__torch_dispatch__:16472 2024-06-26T07:40:38.8153742Z Dynamo produced 3 graphs covering 503 ops with 6 graph breaks (5 unique) 2024-06-26T07:40:44.4617558Z 2024-06-26T07:40:45.5661163Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:40:45.5661725Z loading model: 0it [00:01, ?it/s] 2024-06-26T07:40:45.5663545Z cuda train nfnet_l0 2024-06-26T07:41:30.1013623Z W0626 07:41:30.100000 139793488962176 torch/_logging/_internal.py:1040] [6/0] Profiler function will be ignored 2024-06-26T07:42:35.9565235Z pass 2024-06-26T07:42:35.9791810Z TIMING: entire_frame_compile:87.54467 code_gen:31.18279 inductor_compile:56.78359 backend_compile:68.25454 2024-06-26T07:42:35.9793237Z STATS: call_* op count: 1232 | FakeTensorMode.__torch_dispatch__:113308 | FakeTensor.__torch_dispatch__:21204 | ProxyTorchDispatchMode.__torch_dispatch__:25953 2024-06-26T07:42:35.9794544Z Dynamo produced 3 graphs covering 1232 ops with 7 graph breaks (5 unique) 2024-06-26T07:42:43.6573857Z 2024-06-26T07:42:44.6521192Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:42:44.6521710Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:42:44.6522151Z cuda train pit_b_224 2024-06-26T07:43:17.1727629Z pass 2024-06-26T07:43:17.2200655Z TIMING: entire_frame_compile:16.0972 code_gen:10.41505 inductor_compile:18.12919 backend_compile:13.78998 2024-06-26T07:43:17.2203263Z STATS: call_* op count: 404 | FakeTensor.__torch_dispatch__:7227 | FakeTensorMode.__torch_dispatch__:41296 | ProxyTorchDispatchMode.__torch_dispatch__:12561 2024-06-26T07:43:17.2204397Z Dynamo produced 2 graphs covering 404 ops with 6 graph breaks (5 unique) 2024-06-26T07:43:21.8969700Z 2024-06-26T07:43:23.4701224Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:43:23.4702104Z loading model: 0it [00:01, ?it/s] 2024-06-26T07:43:23.4702981Z cuda train pnasnet5large 2024-06-26T07:47:48.3945473Z pass 2024-06-26T07:47:48.5086222Z TIMING: entire_frame_compile:108.14479 code_gen:160.76715 inductor_compile:203.53113 backend_compile:97.72525 2024-06-26T07:47:48.5090112Z STATS: call_* op count: 963 | FakeTensor.__torch_dispatch__:38589 | FakeTensorMode.__torch_dispatch__:198131 | ProxyTorchDispatchMode.__torch_dispatch__:49820 2024-06-26T07:47:48.5091662Z Dynamo produced 2 graphs covering 963 ops with 5 graph breaks (4 unique) 2024-06-26T07:48:01.0054125Z 2024-06-26T07:48:02.6190890Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:48:02.6191501Z loading model: 0it [00:01, ?it/s] 2024-06-26T07:48:02.6191955Z cuda train poolformer_m36 2024-06-26T07:51:33.1400509Z pass 2024-06-26T07:51:33.1794872Z TIMING: entire_frame_compile:56.61906 code_gen:156.66203 inductor_compile:180.17844 backend_compile:49.62826 2024-06-26T07:51:33.1798305Z STATS: call_* op count: 741 | FakeTensor.__torch_dispatch__:16757 | FakeTensorMode.__torch_dispatch__:80099 | ProxyTorchDispatchMode.__torch_dispatch__:22827 2024-06-26T07:51:33.1799443Z Dynamo produced 2 graphs covering 741 ops with 6 graph breaks (5 unique) 2024-06-26T07:51:41.2370889Z 2024-06-26T07:51:41.9902315Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:51:41.9902823Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:51:41.9903988Z cuda train regnety_002 2024-06-26T07:52:20.8169125Z pass 2024-06-26T07:52:20.8204027Z TIMING: entire_frame_compile:23.56336 code_gen:13.1682 inductor_compile:23.15931 backend_compile:19.08049 2024-06-26T07:52:20.8206007Z STATS: call_* op count: 369 | FakeTensor.__torch_dispatch__:9014 | FakeTensorMode.__torch_dispatch__:45506 | ProxyTorchDispatchMode.__torch_dispatch__:12209 2024-06-26T07:52:20.8207147Z Dynamo produced 2 graphs covering 369 ops with 6 graph breaks (5 unique) 2024-06-26T07:52:25.9379687Z 2024-06-26T07:52:26.9404120Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:52:26.9404620Z loading model: 0it [00:01, ?it/s] 2024-06-26T07:52:26.9405055Z cuda train repvgg_a2 2024-06-26T07:53:09.8719988Z W0626 07:53:09.871000 139932018242176 torch/_logging/_internal.py:1040] [6/0] Profiler function will be ignored 2024-06-26T07:53:55.6225901Z pass 2024-06-26T07:53:55.6387663Z TIMING: entire_frame_compile:71.13401 code_gen:27.59716 inductor_compile:48.9148 backend_compile:58.09524 2024-06-26T07:53:55.6388942Z STATS: call_* op count: 920 | FakeTensor.__torch_dispatch__:17660 | FakeTensorMode.__torch_dispatch__:90130 | ProxyTorchDispatchMode.__torch_dispatch__:18975 2024-06-26T07:53:55.6390051Z Dynamo produced 3 graphs covering 920 ops with 7 graph breaks (5 unique) 2024-06-26T07:54:02.8799229Z 2024-06-26T07:54:04.3217410Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:54:04.3217978Z loading model: 0it [00:01, ?it/s] 2024-06-26T07:54:04.3218458Z cuda train res2net101_26w_4s 2024-06-26T07:56:17.3541113Z pass 2024-06-26T07:56:17.3865839Z TIMING: entire_frame_compile:78.31341 code_gen:55.98821 inductor_compile:91.26846 backend_compile:72.99709 2024-06-26T07:56:17.3868098Z STATS: call_* op count: 807 | FakeTensor.__torch_dispatch__:33531 | FakeTensorMode.__torch_dispatch__:158054 | ProxyTorchDispatchMode.__torch_dispatch__:37834 2024-06-26T07:56:17.3869238Z Dynamo produced 2 graphs covering 807 ops with 6 graph breaks (5 unique) 2024-06-26T07:56:27.7854985Z 2024-06-26T07:56:28.9470100Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:56:28.9470570Z loading model: 0it [00:01, ?it/s] 2024-06-26T07:56:28.9471002Z cuda train res2net50_14w_8s 2024-06-26T07:58:28.9725320Z pass 2024-06-26T07:58:28.9919116Z TIMING: entire_frame_compile:69.60832 code_gen:50.64537 inductor_compile:82.73421 backend_compile:65.01598 2024-06-26T07:58:28.9920453Z STATS: call_* op count: 703 | FakeTensor.__torch_dispatch__:29747 | FakeTensorMode.__torch_dispatch__:143048 | ProxyTorchDispatchMode.__torch_dispatch__:33247 2024-06-26T07:58:28.9921602Z Dynamo produced 2 graphs covering 703 ops with 6 graph breaks (5 unique) 2024-06-26T07:58:38.3271497Z 2024-06-26T07:58:39.3443920Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:58:39.3444406Z loading model: 0it [00:01, ?it/s] 2024-06-26T07:58:39.3444831Z cuda train res2next50 2024-06-26T07:59:45.3935190Z pass 2024-06-26T07:59:45.4104039Z TIMING: entire_frame_compile:35.76704 code_gen:26.60891 inductor_compile:44.9941 backend_compile:32.90121 2024-06-26T07:59:45.4105913Z STATS: call_* op count: 399 | FakeTensor.__torch_dispatch__:16673 | FakeTensorMode.__torch_dispatch__:78559 | ProxyTorchDispatchMode.__torch_dispatch__:18879 2024-06-26T07:59:45.4107272Z Dynamo produced 2 graphs covering 399 ops with 6 graph breaks (5 unique) 2024-06-26T07:59:51.5363276Z 2024-06-26T07:59:52.1808535Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:59:52.1809016Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:59:52.1809489Z cuda train resmlp_12_224 2024-06-26T08:00:12.6933941Z pass 2024-06-26T08:00:12.7056879Z TIMING: entire_frame_compile:10.95063 code_gen:5.98724 inductor_compile:10.49963 backend_compile:8.82952 2024-06-26T08:00:12.7058126Z STATS: call_* op count: 216 | FakeTensor.__torch_dispatch__:4403 | FakeTensorMode.__torch_dispatch__:25576 | ProxyTorchDispatchMode.__torch_dispatch__:8345 2024-06-26T08:00:12.7061153Z Dynamo produced 2 graphs covering 216 ops with 6 graph breaks (5 unique) 2024-06-26T08:00:17.0361388Z 2024-06-26T08:00:18.5319518Z loading model: 0it [00:00, ?it/s] 2024-06-26T08:00:18.5320497Z loading model: 0it [00:01, ?it/s] 2024-06-26T08:00:18.5321377Z cuda train resnest101e 2024-06-26T08:02:17.4638841Z pass 2024-06-26T08:02:17.5034208Z TIMING: entire_frame_compile:64.21401 code_gen:43.89921 inductor_compile:77.51169 backend_compile:57.89017 2024-06-26T08:02:17.5035854Z STATS: call_* op count: 1022 | FakeTensor.__torch_dispatch__:29732 | FakeTensorMode.__torch_dispatch__:145831 | ProxyTorchDispatchMode.__torch_dispatch__:38715 2024-06-26T08:02:17.5037121Z Dynamo produced 2 graphs covering 1022 ops with 6 graph breaks (5 unique) 2024-06-26T08:02:26.1751504Z 2024-06-26T08:02:27.1316064Z loading model: 0it [00:00, ?it/s] 2024-06-26T08:02:27.1316544Z loading model: 0it [00:00, ?it/s] 2024-06-26T08:02:27.1316972Z cuda train rexnet_100 2024-06-26T08:03:30.3094559Z W0626 08:03:30.308000 140598339101312 torch/_logging/_internal.py:1040] [6/0] Profiler function will be ignored 2024-06-26T08:04:35.0170317Z pass 2024-06-26T08:04:35.0248209Z TIMING: entire_frame_compile:97.77765 code_gen:46.69655 inductor_compile:76.76746 backend_compile:81.16748 2024-06-26T08:04:35.0250844Z STATS: call_* op count: 1104 | FakeTensor.__torch_dispatch__:25154 | FakeTensorMode.__torch_dispatch__:123572 | ProxyTorchDispatchMode.__torch_dispatch__:26051 2024-06-26T08:04:35.0251992Z Dynamo produced 3 graphs covering 1104 ops with 7 graph breaks (5 unique) 2024-06-26T08:04:43.9549988Z 2024-06-26T08:04:44.9410740Z loading model: 0it [00:00, ?it/s] 2024-06-26T08:04:44.9411210Z loading model: 0it [00:00, ?it/s] 2024-06-26T08:04:44.9411719Z cuda train sebotnet33ts_256 2024-06-26T08:05:47.3491727Z pass 2024-06-26T08:05:47.3615506Z TIMING: entire_frame_compile:35.35711 code_gen:27.0695 inductor_compile:40.60432 backend_compile:30.91658 2024-06-26T08:05:47.3617259Z STATS: call_* op count: 466 | FakeTensor.__torch_dispatch__:9493 | FakeTensorMode.__torch_dispatch__:50071 | ProxyTorchDispatchMode.__torch_dispatch__:13430 2024-06-26T08:05:47.3618407Z Dynamo produced 3 graphs covering 466 ops with 6 graph breaks (5 unique) 2024-06-26T08:05:52.9529696Z 2024-06-26T08:05:54.0501869Z loading model: 0it [00:00, ?it/s] 2024-06-26T08:05:54.0502349Z loading model: 0it [00:01, ?it/s] 2024-06-26T08:05:54.0502787Z cuda train selecsls42b 2024-06-26T08:06:24.4005852Z pass 2024-06-26T08:06:24.4272134Z TIMING: entire_frame_compile:17.54683 code_gen:10.85764 inductor_compile:19.17185 backend_compile:15.96881 2024-06-26T08:06:24.4274350Z STATS: call_* op count: 137 | FakeTensor.__torch_dispatch__:7417 | FakeTensorMode.__torch_dispatch__:35237 | ProxyTorchDispatchMode.__torch_dispatch__:8917 2024-06-26T08:06:24.4275486Z Dynamo produced 2 graphs covering 137 ops with 6 graph breaks (5 unique) 2024-06-26T08:06:29.2061123Z 2024-06-26T08:06:29.9706992Z loading model: 0it [00:00, ?it/s] 2024-06-26T08:06:29.9707496Z loading model: 0it [00:00, ?it/s] 2024-06-26T08:06:29.9710579Z cuda train spnasnet_100 2024-06-26T08:07:16.0198738Z W0626 08:07:16.019000 139850084668032 torch/_logging/_internal.py:1040] [6/0] Profiler function will be ignored 2024-06-26T08:08:09.7203916Z pass 2024-06-26T08:08:09.7244127Z TIMING: entire_frame_compile:80.43998 code_gen:31.62765 inductor_compile:56.81621 backend_compile:66.92975 2024-06-26T08:08:09.7245551Z STATS: call_* op count: 976 | FakeTensor.__torch_dispatch__:20401 | FakeTensorMode.__torch_dispatch__:104011 | ProxyTorchDispatchMode.__torch_dispatch__:21710 2024-06-26T08:08:09.7246756Z Dynamo produced 3 graphs covering 976 ops with 7 graph breaks (5 unique) 2024-06-26T08:08:17.6893034Z 2024-06-26T08:08:19.4328257Z loading model: 0it [00:00, ?it/s] 2024-06-26T08:08:19.4328722Z loading model: 0it [00:01, ?it/s] 2024-06-26T08:08:19.4329186Z cuda train swin_base_patch4_window7_224 2024-06-26T08:09:52.2464479Z skipping cudagraphs due to deterministic index put. Found from : 2024-06-26T08:09:52.2467361Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/timm_models.py", line 371, in torch_dynamo_resume_in_forward_and_backward_pass_at_369 2024-06-26T08:09:52.2468382Z pred = mod(*cloned_inputs) 2024-06-26T08:09:52.2469396Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1668, in _call_impl 2024-06-26T08:09:52.2470249Z return forward_call(*args, **kwargs) 2024-06-26T08:09:52.2471702Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/timm/models/swin_transformer.py", line 617, in forward 2024-06-26T08:09:52.2472651Z x = self.forward_features(x) 2024-06-26T08:09:52.2473579Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/timm/models/swin_transformer.py", line 609, in forward_features 2024-06-26T08:09:52.2474438Z x = self.layers(x) 2024-06-26T08:09:52.2475271Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1668, in _call_impl 2024-06-26T08:09:52.2476107Z return forward_call(*args, **kwargs) 2024-06-26T08:09:52.2477016Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/timm/models/swin_transformer.py", line 443, in forward 2024-06-26T08:09:52.2477812Z x = self.blocks(x) 2024-06-26T08:09:52.2478634Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1668, in _call_impl 2024-06-26T08:09:52.2479469Z return forward_call(*args, **kwargs) 2024-06-26T08:09:52.2480379Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/timm/models/swin_transformer.py", line 323, in forward 2024-06-26T08:09:52.2481246Z x = x + self.drop_path1(self._attn(self.norm1(x))) 2024-06-26T08:09:52.2482187Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/timm/models/swin_transformer.py", line 307, in _attn 2024-06-26T08:09:52.2483234Z attn_windows = self.attn(x_windows, mask=self.attn_mask) # nW*B, window_size*window_size, C 2024-06-26T08:09:52.2484384Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1668, in _call_impl 2024-06-26T08:09:52.2485201Z return forward_call(*args, **kwargs) 2024-06-26T08:09:52.2486102Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/timm/models/swin_transformer.py", line 172, in forward 2024-06-26T08:09:52.2486933Z attn = attn + self._get_rel_pos_bias() 2024-06-26T08:09:52.2487909Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/timm/models/swin_transformer.py", line 143, in _get_rel_pos_bias 2024-06-26T08:09:52.2488877Z relative_position_bias = self.relative_position_bias_table[ 2024-06-26T08:09:52.2489271Z 2024-06-26T08:09:52.8185824Z W0626 08:09:52.817000 140453252592256 torch/_logging/_internal.py:1040] [6/0] Profiler function will be ignored 2024-06-26T08:11:17.9665161Z pass 2024-06-26T08:11:18.0109270Z TIMING: entire_frame_compile:133.81613 code_gen:60.36019 inductor_compile:101.59597 backend_compile:114.56835 2024-06-26T08:11:18.0112135Z STATS: call_* op count: 2473 | FakeTensor.__torch_dispatch__:31970 | FakeTensorMode.__torch_dispatch__:201006 | ProxyTorchDispatchMode.__torch_dispatch__:50112 2024-06-26T08:11:18.0113306Z Dynamo produced 3 graphs covering 2473 ops with 7 graph breaks (5 unique) 2024-06-26T08:11:28.0385742Z 2024-06-26T08:11:30.9691552Z loading model: 0it [00:00, ?it/s] 2024-06-26T08:11:30.9692335Z loading model: 0it [00:02, ?it/s] 2024-06-26T08:11:30.9693059Z cuda train swsl_resnext101_32x16d 2024-06-26T08:12:42.4834479Z pass 2024-06-26T08:12:42.6172447Z TIMING: entire_frame_compile:37.95664 code_gen:19.84471 inductor_compile:38.57164 backend_compile:34.63611 2024-06-26T08:12:42.6174396Z STATS: call_* op count: 415 | FakeTensor.__torch_dispatch__:18037 | FakeTensorMode.__torch_dispatch__:85923 | ProxyTorchDispatchMode.__torch_dispatch__:22001 2024-06-26T08:12:42.6175504Z Dynamo produced 2 graphs covering 415 ops with 6 graph breaks (5 unique) 2024-06-26T08:12:48.9612033Z 2024-06-26T08:12:49.8489905Z loading model: 0it [00:00, ?it/s] 2024-06-26T08:12:49.8490384Z loading model: 0it [00:00, ?it/s] 2024-06-26T08:12:49.8492593Z cuda train tf_efficientnet_b0 2024-06-26T08:13:42.8768100Z pass 2024-06-26T08:13:42.8848605Z TIMING: entire_frame_compile:31.11629 code_gen:20.88901 inductor_compile:34.8672 backend_compile:26.27789 2024-06-26T08:13:42.8851855Z STATS: call_* op count: 371 | FakeTensorMode.__torch_dispatch__:55697 | FakeTensor.__torch_dispatch__:11937 | ProxyTorchDispatchMode.__torch_dispatch__:14649 2024-06-26T08:13:42.8853164Z Dynamo produced 2 graphs covering 371 ops with 6 graph breaks (5 unique) 2024-06-26T08:13:48.8673325Z 2024-06-26T08:13:49.8144330Z loading model: 0it [00:00, ?it/s] 2024-06-26T08:13:49.8144808Z loading model: 0it [00:00, ?it/s] 2024-06-26T08:13:49.8145252Z cuda train tf_mixnet_l 2024-06-26T08:15:03.7913412Z pass 2024-06-26T08:15:03.8000688Z TIMING: entire_frame_compile:43.81986 code_gen:30.36165 inductor_compile:48.6536 backend_compile:36.94921 2024-06-26T08:15:03.8001974Z STATS: call_* op count: 692 | FakeTensorMode.__torch_dispatch__:79852 | FakeTensor.__torch_dispatch__:15299 | ProxyTorchDispatchMode.__torch_dispatch__:19823 2024-06-26T08:15:03.8005129Z Dynamo produced 2 graphs covering 692 ops with 6 graph breaks (5 unique) 2024-06-26T08:15:10.7161912Z 2024-06-26T08:15:11.6044190Z loading model: 0it [00:00, ?it/s] 2024-06-26T08:15:11.6044865Z loading model: 0it [00:00, ?it/s] 2024-06-26T08:15:11.6045496Z cuda train tinynet_a 2024-06-26T08:16:10.2709382Z pass 2024-06-26T08:16:10.2789945Z TIMING: entire_frame_compile:34.70567 code_gen:22.13822 inductor_compile:38.29961 backend_compile:29.40264 2024-06-26T08:16:10.2791214Z STATS: call_* op count: 435 | FakeTensor.__torch_dispatch__:14095 | FakeTensorMode.__torch_dispatch__:65530 | ProxyTorchDispatchMode.__torch_dispatch__:17283 2024-06-26T08:16:10.2792322Z Dynamo produced 2 graphs covering 435 ops with 6 graph breaks (5 unique) 2024-06-26T08:16:16.5396246Z 2024-06-26T08:16:17.4624119Z loading model: 0it [00:00, ?it/s] 2024-06-26T08:16:17.4624581Z loading model: 0it [00:00, ?it/s] 2024-06-26T08:16:17.4625045Z cuda train tnt_s_patch16_224 2024-06-26T08:17:25.7655527Z skipping cudagraphs due to deterministic index put. Found from : 2024-06-26T08:17:25.7657612Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/timm_models.py", line 371, in torch_dynamo_resume_in_forward_and_backward_pass_at_369 2024-06-26T08:17:25.7658581Z pred = mod(*cloned_inputs) 2024-06-26T08:17:25.7659628Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1668, in _call_impl 2024-06-26T08:17:25.7660991Z return forward_call(*args, **kwargs) 2024-06-26T08:17:25.7662047Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/timm/models/tnt.py", line 333, in forward 2024-06-26T08:17:25.7664984Z x = self.forward_features(x) 2024-06-26T08:17:25.7665995Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/timm/models/tnt.py", line 309, in forward_features 2024-06-26T08:17:25.7666862Z pixel_embed = self.pixel_embed(x, self.pixel_pos) 2024-06-26T08:17:25.7667825Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1668, in _call_impl 2024-06-26T08:17:25.7668649Z return forward_call(*args, **kwargs) 2024-06-26T08:17:25.7669469Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/timm/models/tnt.py", line 182, in forward 2024-06-26T08:17:25.7670199Z x = self.unfold(x) 2024-06-26T08:17:25.7670408Z 2024-06-26T08:17:25.9677796Z W0626 08:17:25.966000 139950240219776 torch/_logging/_internal.py:1040] [6/0] Profiler function will be ignored 2024-06-26T08:18:51.2883229Z pass 2024-06-26T08:18:51.3122608Z TIMING: entire_frame_compile:120.72213 code_gen:46.18763 inductor_compile:85.62446 backend_compile:104.33168 2024-06-26T08:18:51.3125137Z STATS: call_* op count: 1922 | FakeTensor.__torch_dispatch__:32685 | FakeTensorMode.__torch_dispatch__:196587 | ProxyTorchDispatchMode.__torch_dispatch__:49260 2024-06-26T08:18:51.3126395Z Dynamo produced 3 graphs covering 1922 ops with 7 graph breaks (5 unique) 2024-06-26T08:19:01.9945520Z 2024-06-26T08:19:03.2817107Z loading model: 0it [00:00, ?it/s] 2024-06-26T08:19:03.2817682Z loading model: 0it [00:01, ?it/s] 2024-06-26T08:19:03.2818138Z cuda train twins_pcpvt_base 2024-06-26T08:20:20.1617803Z W0626 08:20:20.160000 140429911065216 torch/_logging/_internal.py:1040] [6/0] Profiler function will be ignored 2024-06-26T08:22:37.8675406Z pass 2024-06-26T08:22:37.8974805Z TIMING: entire_frame_compile:166.98557 code_gen:65.1795 inductor_compile:121.8336 backend_compile:141.66584 2024-06-26T08:22:37.8977372Z STATS: call_* op count: 2517 | FakeTensor.__torch_dispatch__:47362 | FakeTensorMode.__torch_dispatch__:258285 | ProxyTorchDispatchMode.__torch_dispatch__:59071 2024-06-26T08:22:37.8979601Z Dynamo produced 3 graphs covering 2517 ops with 7 graph breaks (5 unique) 2024-06-26T08:22:50.6113900Z 2024-06-26T08:22:51.7453298Z loading model: 0it [00:00, ?it/s] 2024-06-26T08:22:51.7453937Z loading model: 0it [00:01, ?it/s] 2024-06-26T08:22:51.7454380Z cuda train visformer_small 2024-06-26T08:23:25.6792788Z W0626 08:23:25.678000 140043297899136 torch/_logging/_internal.py:1040] [6/0] Profiler function will be ignored 2024-06-26T08:24:00.4903505Z pass 2024-06-26T08:24:00.5148304Z TIMING: entire_frame_compile:53.64507 code_gen:20.33857 inductor_compile:36.13028 backend_compile:45.39345 2024-06-26T08:24:00.5150624Z STATS: call_* op count: 699 | FakeTensor.__torch_dispatch__:13870 | FakeTensorMode.__torch_dispatch__:72860 | ProxyTorchDispatchMode.__torch_dispatch__:15868 2024-06-26T08:24:00.5151901Z Dynamo produced 3 graphs covering 699 ops with 7 graph breaks (5 unique) 2024-06-26T08:24:06.4954068Z 2024-06-26T08:24:07.9574569Z loading model: 0it [00:00, ?it/s] 2024-06-26T08:24:07.9575042Z loading model: 0it [00:01, ?it/s] 2024-06-26T08:24:07.9575487Z cuda train vit_base_patch16_224 2024-06-26T08:24:34.4807649Z W0626 08:24:34.479000 140369840415360 torch/_logging/_internal.py:1040] [6/0] Profiler function will be ignored 2024-06-26T08:25:12.8476440Z pass 2024-06-26T08:25:12.8964633Z TIMING: entire_frame_compile:48.52987 code_gen:19.11628 inductor_compile:34.63189 backend_compile:41.29718 2024-06-26T08:25:12.8967698Z STATS: call_* op count: 829 | FakeTensor.__torch_dispatch__:13986 | FakeTensorMode.__torch_dispatch__:75674 | ProxyTorchDispatchMode.__torch_dispatch__:17807 2024-06-26T08:25:12.8968830Z Dynamo produced 3 graphs covering 829 ops with 7 graph breaks (5 unique) 2024-06-26T08:25:18.9451579Z 2024-06-26T08:25:19.9803388Z loading model: 0it [00:00, ?it/s] 2024-06-26T08:25:19.9803981Z loading model: 0it [00:01, ?it/s] 2024-06-26T08:25:19.9804508Z cuda train volo_d1_224 2024-06-26T08:25:57.6262749Z skipping cudagraphs due to deterministic index put. Found from : 2024-06-26T08:25:57.6265541Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/timm_models.py", line 371, in torch_dynamo_resume_in_forward_and_backward_pass_at_369 2024-06-26T08:25:57.6267043Z pred = mod(*cloned_inputs) 2024-06-26T08:25:57.6268258Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1668, in _call_impl 2024-06-26T08:25:57.6269403Z return forward_call(*args, **kwargs) 2024-06-26T08:25:57.6270449Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/timm/models/volo.py", line 725, in forward 2024-06-26T08:25:57.6271439Z x = self.forward_features(x) 2024-06-26T08:25:57.6272310Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/timm/models/volo.py", line 698, in forward_features 2024-06-26T08:25:57.6273110Z x = self.forward_tokens(x) 2024-06-26T08:25:57.6273940Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/timm/models/volo.py", line 625, in forward_tokens 2024-06-26T08:25:57.6274703Z x = block(x) 2024-06-26T08:25:57.6275491Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1668, in _call_impl 2024-06-26T08:25:57.6276319Z return forward_call(*args, **kwargs) 2024-06-26T08:25:57.6277156Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/timm/models/volo.py", line 134, in forward 2024-06-26T08:25:57.6278295Z x = x + self.drop_path(self.attn(self.norm1(x))) 2024-06-26T08:25:57.6279246Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1668, in _call_impl 2024-06-26T08:25:57.6280069Z return forward_call(*args, **kwargs) 2024-06-26T08:25:57.6280899Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/timm/models/volo.py", line 88, in forward 2024-06-26T08:25:57.6281944Z x = F.fold(x, output_size=(H, W), kernel_size=self.kernel_size, padding=self.padding, stride=self.stride) 2024-06-26T08:25:57.6282522Z 2024-06-26T08:26:25.0432817Z W0626 08:26:25.042000 140121781559936 torch/_logging/_internal.py:1040] [6/0] Profiler function will be ignored 2024-06-26T08:27:27.8090285Z pass 2024-06-26T08:27:27.8204201Z TIMING: entire_frame_compile:94.35002 code_gen:45.84774 inductor_compile:75.53521 backend_compile:82.15645 2024-06-26T08:27:27.8205518Z STATS: call_* op count: 1410 | FakeTensor.__torch_dispatch__:23496 | FakeTensorMode.__torch_dispatch__:143231 | ProxyTorchDispatchMode.__torch_dispatch__:35802 2024-06-26T08:27:27.8206661Z Dynamo produced 3 graphs covering 1410 ops with 7 graph breaks (5 unique) 2024-06-26T08:27:36.1905152Z 2024-06-26T08:27:39.3795340Z loading model: 0it [00:00, ?it/s] 2024-06-26T08:27:39.3797860Z loading model: 0it [00:03, ?it/s] 2024-06-26T08:27:39.3798945Z cuda train xcit_large_24_p8_224 2024-06-26T08:27:39.4689406Z WARNING:common:fp64 golden ref were not generated for xcit_large_24_p8_224. Setting accuracy check to cosine 2024-06-26T08:29:27.6718129Z W0626 08:29:27.671000 140499635737216 torch/_logging/_internal.py:1040] [6/0] Profiler function will be ignored 2024-06-26T08:32:11.5936537Z pass_due_to_skip 2024-06-26T08:32:11.6354541Z TIMING: entire_frame_compile:211.53967 code_gen:81.94517 inductor_compile:153.7892 backend_compile:179.81315 2024-06-26T08:32:11.6356776Z STATS: call_* op count: 3114 | FakeTensor.__torch_dispatch__:61154 | FakeTensorMode.__torch_dispatch__:326702 | ProxyTorchDispatchMode.__torch_dispatch__:78435 2024-06-26T08:32:11.6358069Z Dynamo produced 3 graphs covering 3114 ops with 7 graph breaks (5 unique) 2024-06-26T08:32:24.4629283Z accuracy pass_rate=96.77% 2024-06-26T08:32:24.4633275Z calls_captured gmean=744.81x mean=934.323x 2024-06-26T08:32:24.4637268Z unique_graphs gmean=2.49x mean=2.548x 2024-06-26T08:32:24.4641544Z graph_breaks gmean=6.39x mean=6.419x 2024-06-26T08:32:24.4646086Z unique_graph_breaks gmean=4.96x mean=4.968x 2024-06-26T08:32:24.4650252Z autograd_captures gmean=0.00x mean=0.000x 2024-06-26T08:32:24.4654734Z autograd_compiles gmean=0.00x mean=0.000x 2024-06-26T08:32:24.4659106Z cudagraph_skips gmean=0.00x mean=0.097x 2024-06-26T08:32:26.2852326Z + python benchmarks/dynamo/check_accuracy.py --actual /var/lib/jenkins/workspace/test/test-reports/training_timm_models.csv --expected benchmarks/dynamo/ci_expected_accuracy/cu124/inductor_timm_training.csv 2024-06-26T08:32:26.5406888Z mixnet_l PASS 2024-06-26T08:32:26.5411553Z mnasnet_100 PASS 2024-06-26T08:32:26.5416024Z mobilenetv2_100 PASS 2024-06-26T08:32:26.5420622Z mobilenetv3_large_100 PASS 2024-06-26T08:32:26.5425182Z mobilevit_s PASS 2024-06-26T08:32:26.5429632Z nfnet_l0 PASS 2024-06-26T08:32:26.5433971Z pit_b_224 PASS 2024-06-26T08:32:26.5438491Z pnasnet5large PASS 2024-06-26T08:32:26.5442863Z poolformer_m36 PASS 2024-06-26T08:32:26.5447292Z regnety_002 PASS 2024-06-26T08:32:26.5451548Z repvgg_a2 PASS 2024-06-26T08:32:26.5456400Z res2net101_26w_4s PASS 2024-06-26T08:32:26.5460811Z res2net50_14w_8s PASS 2024-06-26T08:32:26.5465201Z res2next50 PASS 2024-06-26T08:32:26.5469684Z resmlp_12_224 PASS 2024-06-26T08:32:26.5474068Z resnest101e PASS 2024-06-26T08:32:26.5478525Z rexnet_100 PASS 2024-06-26T08:32:26.5482878Z sebotnet33ts_256 PASS 2024-06-26T08:32:26.5487284Z selecsls42b PASS 2024-06-26T08:32:26.5491602Z spnasnet_100 PASS 2024-06-26T08:32:26.5496355Z swin_base_patch4_window7_224 PASS 2024-06-26T08:32:26.5500583Z swsl_resnext101_32x16d PASS 2024-06-26T08:32:26.5505355Z tf_efficientnet_b0 PASS 2024-06-26T08:32:26.5509731Z tf_mixnet_l PASS 2024-06-26T08:32:26.5513971Z tinynet_a PASS 2024-06-26T08:32:26.5518368Z tnt_s_patch16_224 PASS 2024-06-26T08:32:26.5522633Z twins_pcpvt_base PASS 2024-06-26T08:32:26.5527150Z visformer_small PASS 2024-06-26T08:32:26.5531619Z vit_base_patch16_224 PASS 2024-06-26T08:32:26.5536122Z volo_d1_224 PASS 2024-06-26T08:32:26.5540675Z xcit_large_24_p8_224 XFAIL 2024-06-26T08:32:26.5917438Z + python benchmarks/dynamo/check_graph_breaks.py --actual /var/lib/jenkins/workspace/test/test-reports/training_timm_models.csv --expected benchmarks/dynamo/ci_expected_accuracy/cu124/inductor_timm_training.csv 2024-06-26T08:32:26.8508538Z mixnet_l PASS 2024-06-26T08:32:26.8512734Z mnasnet_100 PASS 2024-06-26T08:32:26.8518119Z mobilenetv2_100 PASS 2024-06-26T08:32:26.8522894Z mobilenetv3_large_100 PASS 2024-06-26T08:32:26.8528113Z mobilevit_s PASS 2024-06-26T08:32:26.8533139Z nfnet_l0 PASS 2024-06-26T08:32:26.8539313Z pit_b_224 PASS 2024-06-26T08:32:26.8544684Z pnasnet5large PASS 2024-06-26T08:32:26.8549734Z poolformer_m36 PASS 2024-06-26T08:32:26.8554556Z regnety_002 PASS 2024-06-26T08:32:26.8559175Z repvgg_a2 PASS 2024-06-26T08:32:26.8564014Z res2net101_26w_4s PASS 2024-06-26T08:32:26.8568781Z res2net50_14w_8s PASS 2024-06-26T08:32:26.8573627Z res2next50 PASS 2024-06-26T08:32:26.8579421Z resmlp_12_224 PASS 2024-06-26T08:32:26.8584805Z resnest101e PASS 2024-06-26T08:32:26.8589590Z rexnet_100 PASS 2024-06-26T08:32:26.8594591Z sebotnet33ts_256 PASS 2024-06-26T08:32:26.8599259Z selecsls42b PASS 2024-06-26T08:32:26.8604151Z spnasnet_100 PASS 2024-06-26T08:32:26.8608850Z swin_base_patch4_window7_224 PASS 2024-06-26T08:32:26.8613827Z swsl_resnext101_32x16d PASS 2024-06-26T08:32:26.8619299Z tf_efficientnet_b0 PASS 2024-06-26T08:32:26.8624533Z tf_mixnet_l PASS 2024-06-26T08:32:26.8629123Z tinynet_a PASS 2024-06-26T08:32:26.8633962Z tnt_s_patch16_224 PASS 2024-06-26T08:32:26.8638586Z twins_pcpvt_base PASS 2024-06-26T08:32:26.8643493Z visformer_small PASS 2024-06-26T08:32:26.8648109Z vit_base_patch16_224 PASS 2024-06-26T08:32:26.8652892Z volo_d1_224 PASS 2024-06-26T08:32:26.8657798Z xcit_large_24_p8_224 PASS 2024-06-26T08:32:26.9050381Z + cleanup_workspace 2024-06-26T08:32:26.9051442Z + echo 'sudo may print the following warning message that can be ignored. The chown command will still run.' 2024-06-26T08:32:26.9052922Z sudo may print the following warning message that can be ignored. The chown command will still run. 2024-06-26T08:32:26.9055723Z + echo ' sudo: setrlimit(RLIMIT_STACK): Operation not permitted' 2024-06-26T08:32:26.9056434Z sudo: setrlimit(RLIMIT_STACK): Operation not permitted 2024-06-26T08:32:26.9057679Z + echo 'For more details refer to https://github.com/sudo-project/sudo/issues/42' 2024-06-26T08:32:26.9058545Z For more details refer to https://github.com/sudo-project/sudo/issues/42 2024-06-26T08:32:26.9059226Z + sudo chown -R 1000 /var/lib/jenkins/workspace 2024-06-26T08:32:27.5821046Z ##[group]Run cat test/**/*_toprint.log || true 2024-06-26T08:32:27.5821762Z cat test/**/*_toprint.log || true 2024-06-26T08:32:27.5831581Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T08:32:27.5832280Z env: 2024-06-26T08:32:27.5832661Z GIT_DEFAULT_BRANCH: main 2024-06-26T08:32:27.5833275Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T08:32:27.5834289Z DOCKER_CONTAINER_ID: 249a6a65c36f4edeb56240cd27b55909b4682aa8673bdc7100a79ce2261abf95 2024-06-26T08:32:27.5835196Z ##[endgroup] 2024-06-26T08:32:27.5901820Z cat: test/**/*_toprint.log: No such file or directory 2024-06-26T08:32:27.5943162Z ##[group]Run kill "$MONITOR_SCRIPT_PID" 2024-06-26T08:32:27.5943633Z kill "$MONITOR_SCRIPT_PID" 2024-06-26T08:32:27.5950703Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T08:32:27.5951190Z env: 2024-06-26T08:32:27.5951471Z GIT_DEFAULT_BRANCH: main 2024-06-26T08:32:27.5951923Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T08:32:27.5952698Z DOCKER_CONTAINER_ID: 249a6a65c36f4edeb56240cd27b55909b4682aa8673bdc7100a79ce2261abf95 2024-06-26T08:32:27.5953344Z MONITOR_SCRIPT_PID: 20644 2024-06-26T08:32:27.5953700Z ##[endgroup] 2024-06-26T08:32:27.6136919Z Prepare all required actions 2024-06-26T08:32:27.6137426Z Getting action download info 2024-06-26T08:32:27.7920136Z Download action repository 'actions/upload-artifact@v3' (SHA:a8a3f3ad30e3422c9c7b888a15615d19a852ae32) 2024-06-26T08:32:27.9525052Z ##[group]Run ./.github/actions/upload-test-artifacts 2024-06-26T08:32:27.9525520Z with: 2024-06-26T08:32:27.9526014Z file-suffix: test-inductor_timm-2-2-linux.g5.4xlarge.nvidia.gpu_26688921813 2024-06-26T08:32:27.9526649Z s3-bucket: gha-artifacts 2024-06-26T08:32:27.9526979Z env: 2024-06-26T08:32:27.9527261Z GIT_DEFAULT_BRANCH: main 2024-06-26T08:32:27.9527706Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T08:32:27.9528434Z DOCKER_CONTAINER_ID: 249a6a65c36f4edeb56240cd27b55909b4682aa8673bdc7100a79ce2261abf95 2024-06-26T08:32:27.9529061Z ##[endgroup] 2024-06-26T08:32:27.9554838Z ##[group]Run # Remove any previous test jsons if they exist 2024-06-26T08:32:27.9555484Z # Remove any previous test jsons if they exist 2024-06-26T08:32:27.9555988Z rm -f test-jsons-*.zip 2024-06-26T08:32:27.9556498Z zip -r "test-jsons-${FILE_SUFFIX}.zip" test -i '*.json' 2024-06-26T08:32:27.9564284Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T08:32:27.9564771Z env: 2024-06-26T08:32:27.9565049Z GIT_DEFAULT_BRANCH: main 2024-06-26T08:32:27.9565489Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T08:32:27.9566204Z DOCKER_CONTAINER_ID: 249a6a65c36f4edeb56240cd27b55909b4682aa8673bdc7100a79ce2261abf95 2024-06-26T08:32:27.9567056Z FILE_SUFFIX: test-inductor_timm-2-2-linux.g5.4xlarge.nvidia.gpu_26688921813 2024-06-26T08:32:27.9567643Z ##[endgroup] 2024-06-26T08:32:27.9742812Z adding: test/allowlist_for_publicAPI.json (deflated 79%) 2024-06-26T08:32:27.9771990Z adding: test/benchmark_utils/callgrind_artifacts.json (deflated 92%) 2024-06-26T08:32:27.9772703Z adding: test/minioptest_failures_dict.json (deflated 70%) 2024-06-26T08:32:27.9778725Z adding: test/profiler/profiler_utils_mock_events.json (deflated 87%) 2024-06-26T08:32:27.9804006Z ##[group]Run # Remove any previous test reports if they exist 2024-06-26T08:32:27.9804643Z # Remove any previous test reports if they exist 2024-06-26T08:32:27.9805160Z rm -f test-reports-*.zip 2024-06-26T08:32:27.9805742Z zip -r "test-reports-${FILE_SUFFIX}.zip" test -i '*.xml' -i '*.csv' 2024-06-26T08:32:27.9813344Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T08:32:27.9814093Z env: 2024-06-26T08:32:27.9814373Z GIT_DEFAULT_BRANCH: main 2024-06-26T08:32:27.9814818Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T08:32:27.9815542Z DOCKER_CONTAINER_ID: 249a6a65c36f4edeb56240cd27b55909b4682aa8673bdc7100a79ce2261abf95 2024-06-26T08:32:27.9816372Z FILE_SUFFIX: test-inductor_timm-2-2-linux.g5.4xlarge.nvidia.gpu_26688921813 2024-06-26T08:32:27.9816966Z ##[endgroup] 2024-06-26T08:32:27.9977296Z adding: test/test-reports/inference_timm_models.csv (deflated 68%) 2024-06-26T08:32:27.9978999Z adding: test/test-reports/training_timm_models.csv (deflated 66%) 2024-06-26T08:32:27.9982141Z adding: test/test-reports/training_timm_model_graph_breaks.csv (deflated 97%) 2024-06-26T08:32:27.9983494Z adding: test/test-reports/training_timm_model_graph_break_deduped.csv (deflated 74%) 2024-06-26T08:32:28.0006931Z ##[group]Run # Remove any previous usage logs if they exist 2024-06-26T08:32:28.0007548Z # Remove any previous usage logs if they exist 2024-06-26T08:32:28.0008059Z rm -f logs-*.zip 2024-06-26T08:32:28.0008718Z # this workflow is also run in bazel build test, but we dont generate usage reports for it 2024-06-26T08:32:28.0009485Z # so check to see if the file exists first 2024-06-26T08:32:28.0009982Z if [ -f 'usage_log.txt' ]; then 2024-06-26T08:32:28.0010507Z  zip "logs-${FILE_SUFFIX}.zip" 'usage_log.txt' 2024-06-26T08:32:28.0010986Z fi 2024-06-26T08:32:28.0011468Z if ls test/**/*.log 1> /dev/null 2>&1; then 2024-06-26T08:32:28.0012035Z  zip -r "logs-${FILE_SUFFIX}.zip" test -i '*.log' 2024-06-26T08:32:28.0012527Z fi 2024-06-26T08:32:28.0021157Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T08:32:28.0021653Z env: 2024-06-26T08:32:28.0021926Z GIT_DEFAULT_BRANCH: main 2024-06-26T08:32:28.0022370Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T08:32:28.0023087Z DOCKER_CONTAINER_ID: 249a6a65c36f4edeb56240cd27b55909b4682aa8673bdc7100a79ce2261abf95 2024-06-26T08:32:28.0023938Z FILE_SUFFIX: test-inductor_timm-2-2-linux.g5.4xlarge.nvidia.gpu_26688921813 2024-06-26T08:32:28.0024517Z ##[endgroup] 2024-06-26T08:32:28.0093484Z adding: usage_log.txt (deflated 92%) 2024-06-26T08:32:28.0182812Z ##[group]Run # Remove any previous debugging artifacts if they exist 2024-06-26T08:32:28.0183574Z # Remove any previous debugging artifacts if they exist 2024-06-26T08:32:28.0184113Z rm -f debug-*.zip 2024-06-26T08:32:28.0184501Z if [ -d 'test/debug' ]; then 2024-06-26T08:32:28.0185002Z  zip -r "debug-${FILE_SUFFIX}.zip" test/debug 2024-06-26T08:32:28.0185464Z fi 2024-06-26T08:32:28.0192547Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T08:32:28.0193084Z env: 2024-06-26T08:32:28.0193363Z GIT_DEFAULT_BRANCH: main 2024-06-26T08:32:28.0193804Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T08:32:28.0194537Z DOCKER_CONTAINER_ID: 249a6a65c36f4edeb56240cd27b55909b4682aa8673bdc7100a79ce2261abf95 2024-06-26T08:32:28.0195382Z FILE_SUFFIX: test-inductor_timm-2-2-linux.g5.4xlarge.nvidia.gpu_26688921813 2024-06-26T08:32:28.0195981Z ##[endgroup] 2024-06-26T08:32:28.0269187Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-06-26T08:32:28.0269615Z with: 2024-06-26T08:32:28.0269895Z s3-bucket: gha-artifacts 2024-06-26T08:32:28.0270318Z s3-prefix: pytorch/pytorch/9673646808/1/artifact 2024-06-26T08:32:28.0270785Z retention-days: 14 2024-06-26T08:32:28.0271112Z if-no-files-found: warn 2024-06-26T08:32:28.0271464Z path: test-jsons-*.zip 2024-06-26T08:32:28.0271798Z name: artifact 2024-06-26T08:32:28.0272097Z region: us-east-1 2024-06-26T08:32:28.0272411Z env: 2024-06-26T08:32:28.0272708Z GIT_DEFAULT_BRANCH: main 2024-06-26T08:32:28.0273149Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T08:32:28.0273864Z DOCKER_CONTAINER_ID: 249a6a65c36f4edeb56240cd27b55909b4682aa8673bdc7100a79ce2261abf95 2024-06-26T08:32:28.0274613Z ##[endgroup] 2024-06-26T08:32:28.3429233Z NOTE: s3-prefix specified, ignoring name parameter 2024-06-26T08:32:28.3430035Z With the provided path, there will be 1 file uploaded 2024-06-26T08:32:28.3430656Z Uploading to s3 prefix: pytorch/pytorch/9673646808/1/artifact 2024-06-26T08:32:28.3456981Z Starting upload of test-jsons-test-inductor_timm-2-2-linux.g5.4xlarge.nvidia.gpu_26688921813.zip 2024-06-26T08:32:28.4637695Z Finished upload of test-jsons-test-inductor_timm-2-2-linux.g5.4xlarge.nvidia.gpu_26688921813.zip 2024-06-26T08:32:28.4769579Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-06-26T08:32:28.4770011Z with: 2024-06-26T08:32:28.4770295Z s3-bucket: gha-artifacts 2024-06-26T08:32:28.4770714Z s3-prefix: pytorch/pytorch/9673646808/1/artifact 2024-06-26T08:32:28.4771172Z retention-days: 14 2024-06-26T08:32:28.4771500Z if-no-files-found: error 2024-06-26T08:32:28.4771858Z path: test-reports-*.zip 2024-06-26T08:32:28.4772199Z name: artifact 2024-06-26T08:32:28.4772501Z region: us-east-1 2024-06-26T08:32:28.4772823Z env: 2024-06-26T08:32:28.4773133Z GIT_DEFAULT_BRANCH: main 2024-06-26T08:32:28.4773579Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T08:32:28.4774456Z DOCKER_CONTAINER_ID: 249a6a65c36f4edeb56240cd27b55909b4682aa8673bdc7100a79ce2261abf95 2024-06-26T08:32:28.4775097Z ##[endgroup] 2024-06-26T08:32:28.7822466Z NOTE: s3-prefix specified, ignoring name parameter 2024-06-26T08:32:28.7823392Z With the provided path, there will be 1 file uploaded 2024-06-26T08:32:28.7824065Z Uploading to s3 prefix: pytorch/pytorch/9673646808/1/artifact 2024-06-26T08:32:28.7849188Z Starting upload of test-reports-test-inductor_timm-2-2-linux.g5.4xlarge.nvidia.gpu_26688921813.zip 2024-06-26T08:32:28.9278364Z Finished upload of test-reports-test-inductor_timm-2-2-linux.g5.4xlarge.nvidia.gpu_26688921813.zip 2024-06-26T08:32:28.9411430Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-06-26T08:32:28.9411860Z with: 2024-06-26T08:32:28.9412163Z s3-bucket: gha-artifacts 2024-06-26T08:32:28.9412587Z s3-prefix: pytorch/pytorch/9673646808/1/artifact 2024-06-26T08:32:28.9413052Z retention-days: 14 2024-06-26T08:32:28.9413412Z if-no-files-found: ignore 2024-06-26T08:32:28.9413934Z path: logs-*.zip 2024-06-26T08:32:28.9414248Z name: artifact 2024-06-26T08:32:28.9414544Z region: us-east-1 2024-06-26T08:32:28.9414842Z env: 2024-06-26T08:32:28.9415117Z GIT_DEFAULT_BRANCH: main 2024-06-26T08:32:28.9415580Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T08:32:28.9416300Z DOCKER_CONTAINER_ID: 249a6a65c36f4edeb56240cd27b55909b4682aa8673bdc7100a79ce2261abf95 2024-06-26T08:32:28.9416934Z ##[endgroup] 2024-06-26T08:32:29.2461190Z NOTE: s3-prefix specified, ignoring name parameter 2024-06-26T08:32:29.2461842Z With the provided path, there will be 1 file uploaded 2024-06-26T08:32:29.2462468Z Uploading to s3 prefix: pytorch/pytorch/9673646808/1/artifact 2024-06-26T08:32:29.2487516Z Starting upload of logs-test-inductor_timm-2-2-linux.g5.4xlarge.nvidia.gpu_26688921813.zip 2024-06-26T08:32:29.4244311Z Finished upload of logs-test-inductor_timm-2-2-linux.g5.4xlarge.nvidia.gpu_26688921813.zip 2024-06-26T08:32:29.4373355Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-06-26T08:32:29.4373893Z with: 2024-06-26T08:32:29.4374205Z s3-bucket: gha-artifacts 2024-06-26T08:32:29.4374626Z s3-prefix: pytorch/pytorch/9673646808/1/artifact 2024-06-26T08:32:29.4375090Z retention-days: 14 2024-06-26T08:32:29.4375418Z if-no-files-found: ignore 2024-06-26T08:32:29.4375790Z path: debug-*.zip 2024-06-26T08:32:29.4376101Z name: artifact 2024-06-26T08:32:29.4376395Z region: us-east-1 2024-06-26T08:32:29.4376693Z env: 2024-06-26T08:32:29.4376972Z GIT_DEFAULT_BRANCH: main 2024-06-26T08:32:29.4377419Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T08:32:29.4378135Z DOCKER_CONTAINER_ID: 249a6a65c36f4edeb56240cd27b55909b4682aa8673bdc7100a79ce2261abf95 2024-06-26T08:32:29.4378763Z ##[endgroup] 2024-06-26T08:32:29.7388996Z No files were found with the provided path: debug-*.zip. No artifacts will be uploaded. 2024-06-26T08:32:29.7518676Z ##[group]Run # shellcheck disable=SC2156 2024-06-26T08:32:29.7519156Z # shellcheck disable=SC2156 2024-06-26T08:32:29.7519938Z find . -iname "core.[1-9]*" -exec docker exec "${DOCKER_CONTAINER_ID}" sh -c "gdb python {} -ex 'bt' -ex 'q'" \; 2024-06-26T08:32:29.7528027Z shell: /usr/bin/bash -e {0} 2024-06-26T08:32:29.7528381Z env: 2024-06-26T08:32:29.7528662Z GIT_DEFAULT_BRANCH: main 2024-06-26T08:32:29.7529116Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T08:32:29.7529839Z DOCKER_CONTAINER_ID: 249a6a65c36f4edeb56240cd27b55909b4682aa8673bdc7100a79ce2261abf95 2024-06-26T08:32:29.7530471Z ##[endgroup] 2024-06-26T08:32:29.9146206Z ##[group]Run pytorch/test-infra/.github/actions/teardown-linux@main 2024-06-26T08:32:29.9146761Z with: 2024-06-26T08:32:29.9147026Z env: 2024-06-26T08:32:29.9147303Z GIT_DEFAULT_BRANCH: main 2024-06-26T08:32:29.9147759Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T08:32:29.9148482Z DOCKER_CONTAINER_ID: 249a6a65c36f4edeb56240cd27b55909b4682aa8673bdc7100a79ce2261abf95 2024-06-26T08:32:29.9149108Z ##[endgroup] 2024-06-26T08:32:29.9167650Z ##[group]Run set -eou pipefail 2024-06-26T08:32:29.9168215Z set -eou pipefail 2024-06-26T08:32:29.9168685Z  2024-06-26T08:32:29.9169190Z echo "Holding runner for 2 hours until all ssh sessions have logged out" 2024-06-26T08:32:29.9169815Z for _ in $(seq 1440); do 2024-06-26T08:32:29.9170287Z  # Break if no ssh session exists anymore 2024-06-26T08:32:29.9170777Z  if [ "$(who)" = "" ]; then 2024-06-26T08:32:29.9171179Z  break 2024-06-26T08:32:29.9171521Z  fi 2024-06-26T08:32:29.9171815Z  echo "." 2024-06-26T08:32:29.9172141Z  sleep 5 2024-06-26T08:32:29.9172453Z done 2024-06-26T08:32:29.9180850Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T08:32:29.9181335Z env: 2024-06-26T08:32:29.9181610Z GIT_DEFAULT_BRANCH: main 2024-06-26T08:32:29.9182055Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T08:32:29.9182775Z DOCKER_CONTAINER_ID: 249a6a65c36f4edeb56240cd27b55909b4682aa8673bdc7100a79ce2261abf95 2024-06-26T08:32:29.9183393Z ##[endgroup] 2024-06-26T08:32:29.9225389Z Holding runner for 2 hours until all ssh sessions have logged out 2024-06-26T08:32:29.9261234Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2024-06-26T08:32:29.9261992Z # ignore expansion of "docker ps -q" since it could be empty 2024-06-26T08:32:29.9262578Z # shellcheck disable=SC2046 2024-06-26T08:32:29.9263045Z docker stop $(docker ps -q) || true 2024-06-26T08:32:29.9263521Z # Prune all of the docker images 2024-06-26T08:32:29.9263997Z docker system prune -af 2024-06-26T08:32:29.9271184Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T08:32:29.9271678Z env: 2024-06-26T08:32:29.9271957Z GIT_DEFAULT_BRANCH: main 2024-06-26T08:32:29.9272395Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T08:32:29.9273117Z DOCKER_CONTAINER_ID: 249a6a65c36f4edeb56240cd27b55909b4682aa8673bdc7100a79ce2261abf95 2024-06-26T08:32:29.9273749Z ##[endgroup] 2024-06-26T08:32:30.2346735Z 249a6a65c36f 2024-06-26T08:32:30.9849653Z Deleted Containers: 2024-06-26T08:32:30.9850411Z 249a6a65c36f4edeb56240cd27b55909b4682aa8673bdc7100a79ce2261abf95 2024-06-26T08:32:30.9850937Z 2024-06-26T08:32:36.1679728Z Deleted Images: 2024-06-26T08:32:36.1681432Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T08:32:36.1684406Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks@sha256:037160f9b5ec877b659f1e94829492249e0bd2fc1a009ee3abbf0528226f6e1a 2024-06-26T08:32:36.1686696Z deleted: sha256:e7d48c2cbd3d9b87b03afe1b0df8f064acd2699045900da46dadf7d133480a59 2024-06-26T08:32:36.1687678Z deleted: sha256:56cb1338e9c083bd52998e89707e7796d2076b75d38a4def8bdc390b09511272 2024-06-26T08:32:36.1688559Z deleted: sha256:e4f4dc56f19dff895aba0d0764be8a9b2d5eadb0350e39ef2401ad14a1725555 2024-06-26T08:32:36.1689424Z deleted: sha256:ccd0cc8e6b80dc180d9ae9bf7129188a0183f3021d4f7205fb22c70b4865a51f 2024-06-26T08:32:36.1690250Z deleted: sha256:07ee1ed44447072463e81661242679474300fb0cab8e2efc170d318f5ca17e0b 2024-06-26T08:32:36.1691068Z deleted: sha256:7d480e3665e9347b658cdef638ff40fee05921f054b515f1bdac9fc0d5fdb8c1 2024-06-26T08:32:36.1691870Z deleted: sha256:fe676c4616c3712c172faf5e49864862b4e629766d8ab9f38af262a4468f5650 2024-06-26T08:32:36.1692861Z deleted: sha256:3dbebbbadfeceea4c3ccb7c77ef7ecbbcdfd212e4beee6d7d489e65f49d89a90 2024-06-26T08:32:36.1693873Z deleted: sha256:22bd2973961153bc8ab449fca8d86c80936170384f00ecfeeb5efbdebdb6e84e 2024-06-26T08:32:36.1694714Z deleted: sha256:10477ae85e23c18fd7dcd95c40657ad49696aa57c4c20941fa2c7ab052728e09 2024-06-26T08:32:36.1695517Z deleted: sha256:8410267dca5208c1582c4a52de7fb2801e7887a2779c181b7a23ce57ebfbb008 2024-06-26T08:32:36.1696327Z deleted: sha256:bf30542cfbf1c12c49030191b999d756519bf481b5477d9fa44c32419a9c30be 2024-06-26T08:32:36.1697125Z deleted: sha256:635e54f5585d54558c1955c10669c50393d2368f03a190f8811a4016020edb73 2024-06-26T08:32:36.1697933Z deleted: sha256:0dd1fd07a4dead7fda569708ee10f10de8fc31c76ca30041a404cea37e1c19ff 2024-06-26T08:32:36.1698765Z deleted: sha256:4d06049f595a3759da1cab03bd7c99eb1b1d97cea3ad2363d1fdcf43059970c2 2024-06-26T08:32:36.1699609Z deleted: sha256:3d3bc0f0a839991ea0e57ccfcbfd29c167d266005477821f9aca68f5a87feeb5 2024-06-26T08:32:36.1700788Z deleted: sha256:4ab7133a18afeadd5c16b3e4979be85d1fb0499128dd32d1b8c98b193c1711f5 2024-06-26T08:32:36.1701805Z deleted: sha256:fc964b13d0fd03e090216eb77a4754b629e9004e11fba0d3e1202abd27988fa1 2024-06-26T08:32:36.1702730Z deleted: sha256:a777e01489a9ff8b6e20ce95f1d6c8d15a1bded5ac905b15b648c9c92b04b101 2024-06-26T08:32:36.1703563Z deleted: sha256:2eebf26a98dffe366a7887e5899e97a80b53b838516c319048f4beb0ad8e4659 2024-06-26T08:32:36.1704377Z deleted: sha256:38bbdf32635223ffc465f6959fbadb47f90be1abd9926a2a60448c521d3fa074 2024-06-26T08:32:36.1705193Z deleted: sha256:b151839b5fa84f51c1b1fb71afd0639f67708d671f4e74850796f279467b0ac2 2024-06-26T08:32:36.1705996Z deleted: sha256:116df6e53a016f2c085d6caaf47932f4a633692267ceadb6ae7c9faf674a295f 2024-06-26T08:32:36.1706797Z deleted: sha256:e2211d0ac2a12b1346a0a3975332c72a959052abd5d616a77cb83dc7281c60e4 2024-06-26T08:32:36.1707608Z deleted: sha256:28e58c5f46e119f7b6f4fd1593400d4374c49be979440a4eafce95cec06387c8 2024-06-26T08:32:36.1708470Z deleted: sha256:01894278d553aade6feee2f7e4e8918dfbe7c6ba0157c79f35285100a4c54cfc 2024-06-26T08:32:36.1709285Z deleted: sha256:e1bf74447204782e0e427c1219add26732c05f04094f25b0af6801dbf3708d34 2024-06-26T08:32:36.1710078Z deleted: sha256:354656042a44c89c55ec82b1cd1a1495c45bab6f2a3cd49c4610b3e131be14ac 2024-06-26T08:32:36.1710888Z deleted: sha256:66a7c705ab3667d09765f0960a1dc0ae4bf89e1533be4f879225bd67c6bd5b6c 2024-06-26T08:32:36.1711708Z deleted: sha256:e63b3bfdaf329aa1767471b68871d5cfcea58f939c3ca58b873ae17280620dcb 2024-06-26T08:32:36.1712848Z deleted: sha256:65ed448ec65a94b57a576fefadfe7ae8e2255417ae04fed109c6ab154c64d0d2 2024-06-26T08:32:36.1713860Z deleted: sha256:17e3a3018dc9ae93cb79e1809453b7e45067eafa698db11fe6eff1885c46dff2 2024-06-26T08:32:36.1714704Z deleted: sha256:914a2cbbfb84a001645b97dcdaeb33fdfcb508adf5361862898214b596582384 2024-06-26T08:32:36.1715542Z deleted: sha256:5f3b10b9fc66885bc6548dcb2cb08a9a37c54bcf0db47c9821e160f707d566f7 2024-06-26T08:32:36.1716376Z deleted: sha256:ab9e8d80d594f5e8ac7fa84004b2b6727cb32d2aa902780ed699040364a2f7d3 2024-06-26T08:32:36.1717200Z deleted: sha256:16bd34f9f8150ce41e2edc26216d4d14c2225b1cc601e645c6c0386cbae43261 2024-06-26T08:32:36.1718015Z deleted: sha256:9227c94c6eaad947b21138ba760e718a302a81b71e264d909da46c24773303ed 2024-06-26T08:32:36.1718943Z deleted: sha256:04235d257525c35422388d13951e4cd36dd37a308721bbd75049f9242e139af0 2024-06-26T08:32:36.1719761Z deleted: sha256:bbf5e8b82ccde9f7f66c9038f3bb7f6717186e2a712e0fd78d318f9b67d1f372 2024-06-26T08:32:36.1720595Z deleted: sha256:a002748e7ef21d251e450ab4715c95cb34f9358ce9bcdd31c5fe7831fe74e98e 2024-06-26T08:32:36.1721418Z deleted: sha256:8acad1619d75bf2f4264dafe4df2e7103c33f31ca6162470083760c26a18609f 2024-06-26T08:32:36.1722243Z deleted: sha256:80338d70f5f600d143f45d02636da59c04612df3e9f1ce47aecb8e809d4f232c 2024-06-26T08:32:36.1723067Z deleted: sha256:38dd48bef6af3d6595132e5d52ef581cbf0693d81b1de1b0f2e11612993d3931 2024-06-26T08:32:36.1723903Z deleted: sha256:b879830930db52d73ad3ac6a096919dd54d86eeb8ee00fbaa3c5d377d876b6d7 2024-06-26T08:32:36.1724814Z deleted: sha256:806976237f8c5a8f583ebbac403d293ae72d19b628c4d73296ddff22ce7fcc21 2024-06-26T08:32:36.1725648Z deleted: sha256:12f4e35bb106aa9d1242cd608d97754669252c7d3633081be5cad2c015786ed0 2024-06-26T08:32:36.1726496Z deleted: sha256:efce19acd8c8040fcb7191130d7bbc2efa23cfc4fefda16d7b3140edd60ed51a 2024-06-26T08:32:36.1727347Z deleted: sha256:503474c932ead012cf40c51fc5744c6965cebda92fcd2ae01ca2080cc7cc8a5f 2024-06-26T08:32:36.1728163Z deleted: sha256:57e4d7c423aa2bf3667a72ff53b2062278268e7cf946839d7433aa0e986b2da9 2024-06-26T08:32:36.1728985Z deleted: sha256:59afee679a7263f5b925a6761a91fe4662d1833935efa83ae29c9f6b4c0dff5d 2024-06-26T08:32:36.1729796Z deleted: sha256:9cc102e9cf6f43b61504c2a669813c840a83667a9c73df7982504f50d5bee6a6 2024-06-26T08:32:36.1730628Z deleted: sha256:cb13d295b36de44b3ef5bf5c043afe1289e5a6ef4ff275649cf7a2526259246b 2024-06-26T08:32:36.1731463Z deleted: sha256:05c68da10d4f675a9ebb009a262bc994756446a8c7fcbf6bf5ccb1c46ece9f2d 2024-06-26T08:32:36.1732296Z deleted: sha256:aebc797800d33984f39d68d5198d6a36dee176874411e27e4c2f1afd98219fae 2024-06-26T08:32:36.1733132Z deleted: sha256:7dc0bc48c310f2dac988fb7100325f00a2169da8202bbe960b3bac06993afb44 2024-06-26T08:32:36.1734075Z deleted: sha256:63e5b2172d1a99f70b1e305a540c25a8374ad06620f39be9beef073f2a8abf39 2024-06-26T08:32:36.1734898Z deleted: sha256:3249b2c20d60a5ad96998d9f8ac9610c2a2336c9cb7d3e23aed549da8a1cefea 2024-06-26T08:32:36.1735713Z deleted: sha256:1e9d132301840d90f74e943daba8e4f210ea43a17f0361309add3cbfc4b8c3de 2024-06-26T08:32:36.1736524Z deleted: sha256:6fe299c368f1e977100d5aa0d740c430cd7f2cd052dbcce145b75073c4bbe92c 2024-06-26T08:32:36.1737346Z deleted: sha256:936e3fad232efd49441a1c15be7b4d7d33cf3fa0fea3401e364c15bb88d7a7df 2024-06-26T08:32:36.1738188Z deleted: sha256:ed89ccf22c7e15739fb9a8bba8734987bfaf1f4ed2c10d8d7cedf59344f17065 2024-06-26T08:32:36.1739005Z deleted: sha256:3edf405b311fc456bc694b304965ac6e02420a185dea5b1e271e9371685db53f 2024-06-26T08:32:36.1739835Z deleted: sha256:791d5b6d87aeebbf087b42221bed92d66f3743fcf4dac393c6faaf28a91d1178 2024-06-26T08:32:36.1740905Z deleted: sha256:8259441b85d03ea8b557e9a0e21e27d4c6ffaad0b3e0a831ac373e5571fc0b9a 2024-06-26T08:32:36.1741719Z deleted: sha256:f2b1062b70de50e2fa03bfc5369ea678fa065f9e0f79fccf296c5720d68fa40c 2024-06-26T08:32:36.1742552Z deleted: sha256:c87ec1cad0bc363e628805cf92ce50f45917aa771536cce573e6ea726904c4f5 2024-06-26T08:32:36.1743379Z deleted: sha256:f980b7a6f28ce9f397abb6f39ec3d02d54168d92fda720ae419c385610a4cbc0 2024-06-26T08:32:36.1744202Z deleted: sha256:2d81ead3471707daaf9265962f0dae7053a8cffc2baa7cc2b7e03818855f1b58 2024-06-26T08:32:36.1745017Z deleted: sha256:433544e4353c9e0269dc71fa16c00ddcecdcd5676ed0df618c7b51ac78e23053 2024-06-26T08:32:36.1745839Z deleted: sha256:fc24af9fd5121adfbc7b75df0abb1ef8c2d3868f33b7b6b1e8bf4e214fac4bd6 2024-06-26T08:32:36.1746662Z deleted: sha256:ce1492ad94b71204f8b3fb8903d0ad48a96652635e7fc9347e430639ca15a737 2024-06-26T08:32:36.1747458Z deleted: sha256:96f2ae9435e6e12f68a88dc404c8079b2796639589970c34894a86ccff3f3732 2024-06-26T08:32:36.1748272Z deleted: sha256:5310d2bc0952e7c6d8cbade7ecafd88ce3a04d9da303fa6419583e13a02b58a9 2024-06-26T08:32:36.1749077Z deleted: sha256:099076d608a55a027d60f5b572a3991a8d690a01500acf2c696933a7e6d38650 2024-06-26T08:32:36.1749876Z deleted: sha256:862b05d0f8f7e3dff2d04bd49784a9901f4e22c5dd6544ae72eb3be05e23fffe 2024-06-26T08:32:36.1750804Z deleted: sha256:f7a888e5f7904827f6d71cebcba5169dbc7a78b20f228b9b9b625f38e0c52f24 2024-06-26T08:32:36.1751632Z deleted: sha256:ab9f75a4a7a636aae480f630eaddc05133dda64f1c42445b617c97d3d209991c 2024-06-26T08:32:36.1752468Z deleted: sha256:56dda0c9cee64db5c10d5dd5f08c6f6707263f5ee98e8a075d635e5be996e855 2024-06-26T08:32:36.1753298Z deleted: sha256:5faf9c0a9efe4675ecd21a4ec417d51077d5e75da9e673161a94e7d6cd43f92c 2024-06-26T08:32:36.1753795Z 2024-06-26T08:32:36.1753949Z Total reclaimed space: 36.54GB 2024-06-26T08:32:36.1815590Z Post job cleanup. 2024-06-26T08:32:36.1863433Z Post job cleanup. 2024-06-26T08:32:36.2671746Z [command]/usr/bin/git version 2024-06-26T08:32:36.2705680Z git version 2.40.1 2024-06-26T08:32:36.2738229Z Copying '/home/ec2-user/.gitconfig' to '/home/ec2-user/actions-runner/_work/_temp/fcabd561-8b92-4c74-b0f9-0d0ed00fdf4d/.gitconfig' 2024-06-26T08:32:36.2749512Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/fcabd561-8b92-4c74-b0f9-0d0ed00fdf4d' before making global git config changes 2024-06-26T08:32:36.2750743Z Adding repository directory to the temporary git global config as a safe directory 2024-06-26T08:32:36.2754679Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-06-26T08:32:36.2782258Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2024-06-26T08:32:36.2804929Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2024-06-26T08:32:36.3018001Z Entering 'android/libs/fbjni' 2024-06-26T08:32:36.3053554Z Entering 'third_party/FP16' 2024-06-26T08:32:36.3089454Z Entering 'third_party/FXdiv' 2024-06-26T08:32:36.3124059Z Entering 'third_party/NNPACK' 2024-06-26T08:32:36.3159563Z Entering 'third_party/VulkanMemoryAllocator' 2024-06-26T08:32:36.3196952Z Entering 'third_party/XNNPACK' 2024-06-26T08:32:36.3242641Z Entering 'third_party/benchmark' 2024-06-26T08:32:36.3278676Z Entering 'third_party/cpp-httplib' 2024-06-26T08:32:36.3316081Z Entering 'third_party/cpuinfo' 2024-06-26T08:32:36.3353368Z Entering 'third_party/cudnn_frontend' 2024-06-26T08:32:36.3391471Z Entering 'third_party/cutlass' 2024-06-26T08:32:36.3433872Z Entering 'third_party/eigen' 2024-06-26T08:32:36.3471412Z Entering 'third_party/fbgemm' 2024-06-26T08:32:36.3506632Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-06-26T08:32:36.3542124Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T08:32:36.3577929Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-06-26T08:32:36.3618653Z Entering 'third_party/fbgemm/third_party/googletest' 2024-06-26T08:32:36.3653994Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T08:32:36.3689989Z Entering 'third_party/flatbuffers' 2024-06-26T08:32:36.3726666Z Entering 'third_party/fmt' 2024-06-26T08:32:36.3763293Z Entering 'third_party/foxi' 2024-06-26T08:32:36.3798223Z Entering 'third_party/gemmlowp/gemmlowp' 2024-06-26T08:32:36.3834240Z Entering 'third_party/gloo' 2024-06-26T08:32:36.3870207Z Entering 'third_party/googletest' 2024-06-26T08:32:36.3903996Z Entering 'third_party/ideep' 2024-06-26T08:32:36.3935548Z Entering 'third_party/ideep/mkl-dnn' 2024-06-26T08:32:36.3975376Z Entering 'third_party/ittapi' 2024-06-26T08:32:36.4010095Z Entering 'third_party/kineto' 2024-06-26T08:32:36.4046567Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T08:32:36.4080733Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T08:32:36.4115190Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T08:32:36.4149039Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T08:32:36.4184783Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T08:32:36.4219201Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T08:32:36.4255461Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T08:32:36.4288858Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T08:32:36.4325838Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T08:32:36.4361977Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T08:32:36.4398289Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T08:32:36.4433093Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T08:32:36.4469062Z Entering 'third_party/mimalloc' 2024-06-26T08:32:36.4504119Z Entering 'third_party/nccl/nccl' 2024-06-26T08:32:36.4537300Z Entering 'third_party/nlohmann' 2024-06-26T08:32:36.4572725Z Entering 'third_party/onnx' 2024-06-26T08:32:36.4621505Z Entering 'third_party/onnx/third_party/benchmark' 2024-06-26T08:32:36.4656133Z Entering 'third_party/onnx/third_party/pybind11' 2024-06-26T08:32:36.4692856Z Entering 'third_party/opentelemetry-cpp' 2024-06-26T08:32:36.4731022Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T08:32:36.4766461Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T08:32:36.4802689Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T08:32:36.4836063Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T08:32:36.4871593Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T08:32:36.4906320Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T08:32:36.4945183Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T08:32:36.4978500Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T08:32:36.5014957Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T08:32:36.5050642Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T08:32:36.5101693Z Entering 'third_party/pocketfft' 2024-06-26T08:32:36.5137630Z Entering 'third_party/protobuf' 2024-06-26T08:32:36.5176219Z Entering 'third_party/protobuf/third_party/benchmark' 2024-06-26T08:32:36.5211978Z Entering 'third_party/protobuf/third_party/googletest' 2024-06-26T08:32:36.5248679Z Entering 'third_party/psimd' 2024-06-26T08:32:36.5285837Z Entering 'third_party/pthreadpool' 2024-06-26T08:32:36.5322290Z Entering 'third_party/pybind11' 2024-06-26T08:32:36.5356705Z Entering 'third_party/python-peachpy' 2024-06-26T08:32:36.5393207Z Entering 'third_party/sleef' 2024-06-26T08:32:36.5425472Z Entering 'third_party/tensorpipe' 2024-06-26T08:32:36.5459349Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-06-26T08:32:36.5493699Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-06-26T08:32:36.5526343Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-06-26T08:32:36.5561751Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T08:32:36.5594829Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T08:32:36.5644136Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2024-06-26T08:32:36.5662727Z http.https://github.com/.extraheader 2024-06-26T08:32:36.5670943Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader 2024-06-26T08:32:36.5699627Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2024-06-26T08:32:36.5905292Z Entering 'android/libs/fbjni' 2024-06-26T08:32:36.5926619Z http.https://github.com/.extraheader 2024-06-26T08:32:36.5952396Z Entering 'third_party/FP16' 2024-06-26T08:32:36.5974247Z http.https://github.com/.extraheader 2024-06-26T08:32:36.5998208Z Entering 'third_party/FXdiv' 2024-06-26T08:32:36.6020231Z http.https://github.com/.extraheader 2024-06-26T08:32:36.6044901Z Entering 'third_party/NNPACK' 2024-06-26T08:32:36.6066523Z http.https://github.com/.extraheader 2024-06-26T08:32:36.6090019Z Entering 'third_party/VulkanMemoryAllocator' 2024-06-26T08:32:36.6111491Z http.https://github.com/.extraheader 2024-06-26T08:32:36.6135519Z Entering 'third_party/XNNPACK' 2024-06-26T08:32:36.6157346Z http.https://github.com/.extraheader 2024-06-26T08:32:36.6193852Z Entering 'third_party/benchmark' 2024-06-26T08:32:36.6215377Z http.https://github.com/.extraheader 2024-06-26T08:32:36.6239912Z Entering 'third_party/cpp-httplib' 2024-06-26T08:32:36.6261543Z http.https://github.com/.extraheader 2024-06-26T08:32:36.6285360Z Entering 'third_party/cpuinfo' 2024-06-26T08:32:36.6307472Z http.https://github.com/.extraheader 2024-06-26T08:32:36.6332266Z Entering 'third_party/cudnn_frontend' 2024-06-26T08:32:36.6354658Z http.https://github.com/.extraheader 2024-06-26T08:32:36.6377458Z Entering 'third_party/cutlass' 2024-06-26T08:32:36.6399750Z http.https://github.com/.extraheader 2024-06-26T08:32:36.6428909Z Entering 'third_party/eigen' 2024-06-26T08:32:36.6450539Z http.https://github.com/.extraheader 2024-06-26T08:32:36.6477747Z Entering 'third_party/fbgemm' 2024-06-26T08:32:36.6499885Z http.https://github.com/.extraheader 2024-06-26T08:32:36.6524851Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-06-26T08:32:36.6546927Z http.https://github.com/.extraheader 2024-06-26T08:32:36.6569566Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T08:32:36.6591666Z http.https://github.com/.extraheader 2024-06-26T08:32:36.6616050Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-06-26T08:32:36.6639046Z http.https://github.com/.extraheader 2024-06-26T08:32:36.6666660Z Entering 'third_party/fbgemm/third_party/googletest' 2024-06-26T08:32:36.6687846Z http.https://github.com/.extraheader 2024-06-26T08:32:36.6711133Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T08:32:36.6732330Z http.https://github.com/.extraheader 2024-06-26T08:32:36.6757410Z Entering 'third_party/flatbuffers' 2024-06-26T08:32:36.6779207Z http.https://github.com/.extraheader 2024-06-26T08:32:36.6803491Z Entering 'third_party/fmt' 2024-06-26T08:32:36.6825179Z http.https://github.com/.extraheader 2024-06-26T08:32:36.6849116Z Entering 'third_party/foxi' 2024-06-26T08:32:36.6871422Z http.https://github.com/.extraheader 2024-06-26T08:32:36.6894136Z Entering 'third_party/gemmlowp/gemmlowp' 2024-06-26T08:32:36.6916078Z http.https://github.com/.extraheader 2024-06-26T08:32:36.6941930Z Entering 'third_party/gloo' 2024-06-26T08:32:36.6963104Z http.https://github.com/.extraheader 2024-06-26T08:32:36.6985843Z Entering 'third_party/googletest' 2024-06-26T08:32:36.7007068Z http.https://github.com/.extraheader 2024-06-26T08:32:36.7029680Z Entering 'third_party/ideep' 2024-06-26T08:32:36.7051051Z http.https://github.com/.extraheader 2024-06-26T08:32:36.7072643Z Entering 'third_party/ideep/mkl-dnn' 2024-06-26T08:32:36.7094023Z http.https://github.com/.extraheader 2024-06-26T08:32:36.7121968Z Entering 'third_party/ittapi' 2024-06-26T08:32:36.7143127Z http.https://github.com/.extraheader 2024-06-26T08:32:36.7166438Z Entering 'third_party/kineto' 2024-06-26T08:32:36.7187891Z http.https://github.com/.extraheader 2024-06-26T08:32:36.7212163Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T08:32:36.7233933Z http.https://github.com/.extraheader 2024-06-26T08:32:36.7258358Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T08:32:36.7280622Z http.https://github.com/.extraheader 2024-06-26T08:32:36.7306501Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T08:32:36.7328712Z http.https://github.com/.extraheader 2024-06-26T08:32:36.7352688Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T08:32:36.7374849Z http.https://github.com/.extraheader 2024-06-26T08:32:36.7400373Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T08:32:36.7422449Z http.https://github.com/.extraheader 2024-06-26T08:32:36.7445641Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T08:32:36.7466792Z http.https://github.com/.extraheader 2024-06-26T08:32:36.7492872Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T08:32:36.7514874Z http.https://github.com/.extraheader 2024-06-26T08:32:36.7538409Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T08:32:36.7558940Z http.https://github.com/.extraheader 2024-06-26T08:32:36.7584132Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T08:32:36.7605193Z http.https://github.com/.extraheader 2024-06-26T08:32:36.7629402Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T08:32:36.7650865Z http.https://github.com/.extraheader 2024-06-26T08:32:36.7675349Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T08:32:36.7696321Z http.https://github.com/.extraheader 2024-06-26T08:32:36.7720815Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T08:32:36.7742307Z http.https://github.com/.extraheader 2024-06-26T08:32:36.7768838Z Entering 'third_party/mimalloc' 2024-06-26T08:32:36.7791069Z http.https://github.com/.extraheader 2024-06-26T08:32:36.7813872Z Entering 'third_party/nccl/nccl' 2024-06-26T08:32:36.7835952Z http.https://github.com/.extraheader 2024-06-26T08:32:36.7859944Z Entering 'third_party/nlohmann' 2024-06-26T08:32:36.7881364Z http.https://github.com/.extraheader 2024-06-26T08:32:36.7907487Z Entering 'third_party/onnx' 2024-06-26T08:32:36.7929078Z http.https://github.com/.extraheader 2024-06-26T08:32:36.7966597Z Entering 'third_party/onnx/third_party/benchmark' 2024-06-26T08:32:36.7988090Z http.https://github.com/.extraheader 2024-06-26T08:32:36.8011768Z Entering 'third_party/onnx/third_party/pybind11' 2024-06-26T08:32:36.8033296Z http.https://github.com/.extraheader 2024-06-26T08:32:36.8057695Z Entering 'third_party/opentelemetry-cpp' 2024-06-26T08:32:36.8081116Z http.https://github.com/.extraheader 2024-06-26T08:32:36.8107028Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T08:32:36.8127711Z http.https://github.com/.extraheader 2024-06-26T08:32:36.8152155Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T08:32:36.8173265Z http.https://github.com/.extraheader 2024-06-26T08:32:36.8196523Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T08:32:36.8218599Z http.https://github.com/.extraheader 2024-06-26T08:32:36.8243085Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T08:32:36.8264017Z http.https://github.com/.extraheader 2024-06-26T08:32:36.8289749Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T08:32:36.8311742Z http.https://github.com/.extraheader 2024-06-26T08:32:36.8336162Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T08:32:36.8357820Z http.https://github.com/.extraheader 2024-06-26T08:32:36.8383289Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T08:32:36.8405331Z http.https://github.com/.extraheader 2024-06-26T08:32:36.8427886Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T08:32:36.8448601Z http.https://github.com/.extraheader 2024-06-26T08:32:36.8473315Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T08:32:36.8494356Z http.https://github.com/.extraheader 2024-06-26T08:32:36.8520465Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T08:32:36.8541864Z http.https://github.com/.extraheader 2024-06-26T08:32:36.8579611Z Entering 'third_party/pocketfft' 2024-06-26T08:32:36.8602778Z http.https://github.com/.extraheader 2024-06-26T08:32:36.8628112Z Entering 'third_party/protobuf' 2024-06-26T08:32:36.8649286Z http.https://github.com/.extraheader 2024-06-26T08:32:36.8676612Z Entering 'third_party/protobuf/third_party/benchmark' 2024-06-26T08:32:36.8697773Z http.https://github.com/.extraheader 2024-06-26T08:32:36.8720755Z Entering 'third_party/protobuf/third_party/googletest' 2024-06-26T08:32:36.8742161Z http.https://github.com/.extraheader 2024-06-26T08:32:36.8766331Z Entering 'third_party/psimd' 2024-06-26T08:32:36.8789655Z http.https://github.com/.extraheader 2024-06-26T08:32:36.8812380Z Entering 'third_party/pthreadpool' 2024-06-26T08:32:36.8834724Z http.https://github.com/.extraheader 2024-06-26T08:32:36.8857527Z Entering 'third_party/pybind11' 2024-06-26T08:32:36.8879276Z http.https://github.com/.extraheader 2024-06-26T08:32:36.8899517Z Entering 'third_party/python-peachpy' 2024-06-26T08:32:36.8921255Z http.https://github.com/.extraheader 2024-06-26T08:32:36.8943838Z Entering 'third_party/sleef' 2024-06-26T08:32:36.8965544Z http.https://github.com/.extraheader 2024-06-26T08:32:36.8988529Z Entering 'third_party/tensorpipe' 2024-06-26T08:32:36.9009866Z http.https://github.com/.extraheader 2024-06-26T08:32:36.9034422Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-06-26T08:32:36.9054072Z http.https://github.com/.extraheader 2024-06-26T08:32:36.9077629Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-06-26T08:32:36.9098064Z http.https://github.com/.extraheader 2024-06-26T08:32:36.9120993Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-06-26T08:32:36.9142063Z http.https://github.com/.extraheader 2024-06-26T08:32:36.9165551Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T08:32:36.9186788Z http.https://github.com/.extraheader 2024-06-26T08:32:36.9208663Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T08:32:36.9231056Z http.https://github.com/.extraheader 2024-06-26T08:32:36.9330997Z A job completed hook has been configured by the self-hosted runner administrator 2024-06-26T08:32:36.9348427Z ##[group]Run '/home/ec2-user/runner-scripts/cleanup.sh' 2024-06-26T08:32:36.9355041Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T08:32:36.9355568Z ##[endgroup] 2024-06-26T08:32:38.2414274Z Cleaning up orphan processes