2024-06-26T07:01:02.6894155Z Current runner version: '2.317.0' 2024-06-26T07:01:02.6900472Z Runner name: 'i-0588e66a1f859cab2' 2024-06-26T07:01:02.6901304Z Runner group name: 'Default' 2024-06-26T07:01:02.6902293Z Machine name: 'ip-10-0-47-211' 2024-06-26T07:01:02.6907384Z ##[group]GITHUB_TOKEN Permissions 2024-06-26T07:01:02.6909375Z Actions: read 2024-06-26T07:01:02.6909933Z Attestations: read 2024-06-26T07:01:02.6910570Z Checks: read 2024-06-26T07:01:02.6911065Z Contents: read 2024-06-26T07:01:02.6911605Z Deployments: read 2024-06-26T07:01:02.6912172Z Discussions: read 2024-06-26T07:01:02.6912696Z Issues: read 2024-06-26T07:01:02.6913262Z Metadata: read 2024-06-26T07:01:02.6913839Z Packages: read 2024-06-26T07:01:02.6914367Z Pages: read 2024-06-26T07:01:02.6914868Z PullRequests: read 2024-06-26T07:01:02.6915464Z RepositoryProjects: read 2024-06-26T07:01:02.6916094Z SecurityEvents: read 2024-06-26T07:01:02.6916697Z Statuses: read 2024-06-26T07:01:02.6917219Z ##[endgroup] 2024-06-26T07:01:02.6920428Z Secret source: Actions 2024-06-26T07:01:02.6921254Z Prepare workflow directory 2024-06-26T07:01:03.0469611Z Prepare all required actions 2024-06-26T07:01:03.0650118Z Getting action download info 2024-06-26T07:01:03.2236063Z Download action repository 'pytorch/test-infra@main' (SHA:43a2ce341cc31288e9a38b65ce600a7f43021bd5) 2024-06-26T07:01:03.5285067Z Download action repository 'pytorch/pytorch@main' (SHA:c422a9549d2b320b47a9391f6cbcf592b2876c88) 2024-06-26T07:01:06.2187042Z Download action repository 'aws-actions/configure-aws-credentials@v3' (SHA:50ac8dd1e1b10d09dac7b8727528b91bed831ac0) 2024-06-26T07:01:06.3544238Z Download action repository 'seemethere/upload-artifact-s3@v5' (SHA:baba72d0712b404f646cebe0730933554ebce96a) 2024-06-26T07:01:06.6100313Z Getting action download info 2024-06-26T07:01:06.7099019Z Download action repository 'malfet/checkout@silent-checkout' (SHA:e07af140b3ccefc05679e3755b9db68f4ee4589c) 2024-06-26T07:01:06.8846104Z Getting action download info 2024-06-26T07:01:07.0820033Z Download action repository 'nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482' (SHA:3e91a01664abd3c5cd539100d10d33b9c5b68482) 2024-06-26T07:01:07.2667595Z Uses: pytorch/pytorch/.github/workflows/_linux-test.yml@refs/tags/ciflow/inductor/129470 (b8c4c54d347aa776934c60784e35936878ef18dc) 2024-06-26T07:01:07.2669896Z ##[group] Inputs 2024-06-26T07:01:07.2670393Z build-environment: linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-06-26T07:01:07.2679054Z test-matrix: {"include": [{"config": "inductor", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_distributed", "shard": 1, "num_shards": 1, "runner": "linux.g5.12xlarge.nvidia.gpu"}, {"config": "inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_cpp_wrapper_abi_compatible", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}]} 2024-06-26T07:01:07.2688490Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:01:07.2689867Z sync-tag: 2024-06-26T07:01:07.2690741Z timeout-minutes: 240 2024-06-26T07:01:07.2691093Z use-gha: 2024-06-26T07:01:07.2691390Z dashboard-tag: 2024-06-26T07:01:07.2691727Z s3-bucket: gha-artifacts 2024-06-26T07:01:07.2692099Z aws-role-to-assume: 2024-06-26T07:01:07.2692450Z ##[endgroup] 2024-06-26T07:01:07.2693415Z Complete job name: cuda12.1-py3.10-gcc9-sm86 / test (inductor_cpp_wrapper_abi_compatible, 1, 1, linux.g5.4xlarge.nvidia.gpu) 2024-06-26T07:01:07.3258835Z A job started hook has been configured by the self-hosted runner administrator 2024-06-26T07:01:07.3397119Z ##[group]Run '/home/ec2-user/runner-scripts/cleanup.sh' 2024-06-26T07:01:07.3407613Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:01:07.3408160Z ##[endgroup] 2024-06-26T07:01:08.6022094Z ##[group]Run pytorch/test-infra/.github/actions/setup-ssh@main 2024-06-26T07:01:08.6022660Z with: 2024-06-26T07:01:08.6023375Z github-secret: *** 2024-06-26T07:01:08.6024352Z instructions: All testing is done inside the container, to start an interactive session run: docker exec -it $(docker container ps --format '{{.ID}}') bash 2024-06-26T07:01:08.6025371Z activate-with-label: false 2024-06-26T07:01:08.6025757Z label: with-ssh 2024-06-26T07:01:08.6026096Z remove-existing-keys: true 2024-06-26T07:01:08.6026471Z fail-silently: true 2024-06-26T07:01:08.6026802Z env: 2024-06-26T07:01:08.6027114Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:01:08.6027480Z ##[endgroup] 2024-06-26T07:01:08.6889078Z Please see https://github.com/pytorch/pytorch/wiki/Debugging-using-with-ssh-for-Github-Actions for more info. 2024-06-26T07:01:08.6890161Z ciflow reference detected, attempting to extract PR number 2024-06-26T07:01:08.9703988Z Grabbing public ssh keys from https://github.com/pytorch-bot[bot].keys 2024-06-26T07:01:09.0321413Z No SSH keys found for user pytorch-bot[bot] 2024-06-26T07:01:09.0322246Z Grabbing public ssh keys from https://github.com/leslie-fang-intel.keys 2024-06-26T07:01:09.0907659Z No SSH keys found for user leslie-fang-intel 2024-06-26T07:01:09.1012627Z ##[group]Run pytorch/pytorch/.github/actions/checkout-pytorch@main 2024-06-26T07:01:09.1013189Z with: 2024-06-26T07:01:09.1013476Z submodules: recursive 2024-06-26T07:01:09.1013817Z fetch-depth: 0 2024-06-26T07:01:09.1014156Z env: 2024-06-26T07:01:09.1014534Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:01:09.1014939Z ##[endgroup] 2024-06-26T07:01:09.1206832Z ##[group]Run retry () { 2024-06-26T07:01:09.1207253Z retry () { 2024-06-26T07:01:09.1207825Z  $* || (sleep 1 && $*) || (sleep 2 && $*) || (sleep 4 && $*) || (sleep 8 && $*) 2024-06-26T07:01:09.1208483Z } 2024-06-26T07:01:09.1209100Z echo "${GITHUB_WORKSPACE}" 2024-06-26T07:01:09.1209569Z if [ -z "${NO_SUDO}" ]; then 2024-06-26T07:01:09.1210140Z  retry sudo rm -rf "${GITHUB_WORKSPACE}" 2024-06-26T07:01:09.1210657Z else 2024-06-26T07:01:09.1211059Z  retry rm -rf "${GITHUB_WORKSPACE}" 2024-06-26T07:01:09.1211577Z fi 2024-06-26T07:01:09.1212009Z mkdir "${GITHUB_WORKSPACE}" 2024-06-26T07:01:09.1220297Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:01:09.1220853Z env: 2024-06-26T07:01:09.1221254Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:01:09.1221658Z NO_SUDO: 2024-06-26T07:01:09.1249799Z ##[endgroup] 2024-06-26T07:01:09.1274269Z /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-06-26T07:01:12.1235539Z ##[group]Run malfet/checkout@silent-checkout 2024-06-26T07:01:12.1235989Z with: 2024-06-26T07:01:12.1236314Z ref: b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:01:12.1236761Z fetch-depth: 0 2024-06-26T07:01:12.1237084Z submodules: recursive 2024-06-26T07:01:12.1237431Z quiet-checkout: true 2024-06-26T07:01:12.1237785Z repository: pytorch/pytorch 2024-06-26T07:01:12.1238279Z token: *** 2024-06-26T07:01:12.1238578Z ssh-strict: true 2024-06-26T07:01:12.1238911Z persist-credentials: true 2024-06-26T07:01:12.1239267Z clean: true 2024-06-26T07:01:12.1239608Z sparse-checkout-cone-mode: true 2024-06-26T07:01:12.1240004Z lfs: false 2024-06-26T07:01:12.1240312Z set-safe-directory: true 2024-06-26T07:01:12.1240650Z env: 2024-06-26T07:01:12.1240928Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:01:12.1241280Z ##[endgroup] 2024-06-26T07:01:12.2161693Z Syncing repository: pytorch/pytorch 2024-06-26T07:01:12.2163257Z ##[group]Getting Git version info 2024-06-26T07:01:12.2164236Z Working directory is '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2024-06-26T07:01:12.2165171Z [command]/usr/bin/git version 2024-06-26T07:01:12.2165544Z git version 2.40.1 2024-06-26T07:01:12.2167076Z ##[endgroup] 2024-06-26T07:01:12.2178806Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/153f9c85-d6f8-494b-a76b-e32ad80f9eb5' before making global git config changes 2024-06-26T07:01:12.2180132Z Adding repository directory to the temporary git global config as a safe directory 2024-06-26T07:01:12.2181280Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-06-26T07:01:12.2207752Z Deleting the contents of '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2024-06-26T07:01:12.2212173Z ##[group]Initializing the repository 2024-06-26T07:01:12.2215196Z [command]/usr/bin/git init /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-06-26T07:01:12.2235007Z hint: Using 'master' as the name for the initial branch. This default branch name 2024-06-26T07:01:12.2236042Z hint: is subject to change. To configure the initial branch name to use in all 2024-06-26T07:01:12.2236860Z hint: of your new repositories, which will suppress this warning, call: 2024-06-26T07:01:12.2237433Z hint: 2024-06-26T07:01:12.2238073Z hint: git config --global init.defaultBranch 2024-06-26T07:01:12.2238553Z hint: 2024-06-26T07:01:12.2239076Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-06-26T07:01:12.2239933Z hint: 'development'. The just-created branch can be renamed via this command: 2024-06-26T07:01:12.2240701Z hint: 2024-06-26T07:01:12.2241025Z hint: git branch -m 2024-06-26T07:01:12.2241774Z Initialized empty Git repository in /home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/ 2024-06-26T07:01:12.2243754Z [command]/usr/bin/git remote add origin https://github.com/pytorch/pytorch 2024-06-26T07:01:12.2263422Z ##[endgroup] 2024-06-26T07:01:12.2264035Z ##[group]Disabling automatic garbage collection 2024-06-26T07:01:12.2266211Z [command]/usr/bin/git config --local gc.auto 0 2024-06-26T07:01:12.2284851Z ##[endgroup] 2024-06-26T07:01:12.2285433Z ##[group]Setting up auth 2024-06-26T07:01:12.2291226Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2024-06-26T07:01:12.2311599Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2024-06-26T07:01:12.2501868Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2024-06-26T07:01:12.2522713Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2024-06-26T07:01:12.2715536Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic *** 2024-06-26T07:01:12.2754672Z ##[endgroup] 2024-06-26T07:01:12.2755259Z ##[group]Fetching the repository 2024-06-26T07:01:12.2760561Z [command]/usr/bin/git -c protocol.version=2 fetch --prune --progress --no-recurse-submodules --quiet origin +refs/heads/*:refs/remotes/origin/* +refs/tags/*:refs/tags/* 2024-06-26T07:01:14.3296507Z remote: Enumerating objects: 987612 2024-06-26T07:01:14.3297098Z remote: Enumerating objects: 990209, done. 2024-06-26T07:01:14.3299265Z remote: Counting objects: 0% (1/2597) 2024-06-26T07:01:14.3302408Z remote: Counting objects: 1% (26/2597) 2024-06-26T07:01:14.3303079Z remote: Counting objects: 2% (52/2597) 2024-06-26T07:01:14.3303603Z remote: Counting objects: 3% (78/2597) 2024-06-26T07:01:14.3304122Z remote: Counting objects: 4% (104/2597) 2024-06-26T07:01:14.3304649Z remote: Counting objects: 5% (130/2597) 2024-06-26T07:01:14.3305164Z remote: Counting objects: 6% (156/2597) 2024-06-26T07:01:14.3306923Z remote: Counting objects: 7% (182/2597) 2024-06-26T07:01:14.3307464Z remote: Counting objects: 8% (208/2597) 2024-06-26T07:01:14.3307991Z remote: Counting objects: 9% (234/2597) 2024-06-26T07:01:14.3308503Z remote: Counting objects: 10% (260/2597) 2024-06-26T07:01:14.3311544Z remote: Counting objects: 11% (286/2597) 2024-06-26T07:01:14.3312094Z remote: Counting objects: 12% (312/2597) 2024-06-26T07:01:14.3312713Z remote: Counting objects: 13% (338/2597) 2024-06-26T07:01:14.3313227Z remote: Counting objects: 14% (364/2597) 2024-06-26T07:01:14.3313886Z remote: Counting objects: 15% (390/2597) 2024-06-26T07:01:14.3314415Z remote: Counting objects: 16% (416/2597) 2024-06-26T07:01:14.3314928Z remote: Counting objects: 17% (442/2597) 2024-06-26T07:01:14.3315473Z remote: Counting objects: 18% (468/2597) 2024-06-26T07:01:14.3316034Z remote: Counting objects: 19% (494/2597) 2024-06-26T07:01:14.3316548Z remote: Counting objects: 20% (520/2597) 2024-06-26T07:01:14.3317058Z remote: Counting objects: 21% (546/2597) 2024-06-26T07:01:14.3317609Z remote: Counting objects: 22% (572/2597) 2024-06-26T07:01:14.3318119Z remote: Counting objects: 23% (598/2597) 2024-06-26T07:01:14.3318620Z remote: Counting objects: 24% (624/2597) 2024-06-26T07:01:14.3319205Z remote: Counting objects: 25% (650/2597) 2024-06-26T07:01:14.3319722Z remote: Counting objects: 26% (676/2597) 2024-06-26T07:01:14.3320280Z remote: Counting objects: 27% (702/2597) 2024-06-26T07:01:14.3321000Z remote: Counting objects: 28% (728/2597) 2024-06-26T07:01:14.3321520Z remote: Counting objects: 29% (754/2597) 2024-06-26T07:01:14.3322104Z remote: Counting objects: 30% (780/2597) 2024-06-26T07:01:14.3322700Z remote: Counting objects: 31% (806/2597) 2024-06-26T07:01:14.3323237Z remote: Counting objects: 32% (832/2597) 2024-06-26T07:01:14.3323839Z remote: Counting objects: 33% (858/2597) 2024-06-26T07:01:14.3324351Z remote: Counting objects: 34% (883/2597) 2024-06-26T07:01:14.3324861Z remote: Counting objects: 35% (909/2597) 2024-06-26T07:01:14.3325361Z remote: Counting objects: 36% (935/2597) 2024-06-26T07:01:14.3325890Z remote: Counting objects: 37% (961/2597) 2024-06-26T07:01:14.3326399Z remote: Counting objects: 38% (987/2597) 2024-06-26T07:01:14.3326964Z remote: Counting objects: 39% (1013/2597) 2024-06-26T07:01:14.3327495Z remote: Counting objects: 40% (1039/2597) 2024-06-26T07:01:14.3328044Z remote: Counting objects: 41% (1065/2597) 2024-06-26T07:01:14.3328820Z remote: Counting objects: 42% (1091/2597) 2024-06-26T07:01:14.3329364Z remote: Counting objects: 43% (1117/2597) 2024-06-26T07:01:14.3329888Z remote: Counting objects: 44% (1143/2597) 2024-06-26T07:01:14.3330412Z remote: Counting objects: 45% (1169/2597) 2024-06-26T07:01:14.3331077Z remote: Counting objects: 46% (1195/2597) 2024-06-26T07:01:14.3331604Z remote: Counting objects: 47% (1221/2597) 2024-06-26T07:01:14.3332120Z remote: Counting objects: 48% (1247/2597) 2024-06-26T07:01:14.3332640Z remote: Counting objects: 49% (1273/2597) 2024-06-26T07:01:14.3333163Z remote: Counting objects: 50% (1299/2597) 2024-06-26T07:01:14.3335176Z remote: Counting objects: 51% (1325/2597) 2024-06-26T07:01:14.3335705Z remote: Counting objects: 52% (1351/2597) 2024-06-26T07:01:14.3336243Z remote: Counting objects: 53% (1377/2597) 2024-06-26T07:01:14.3336768Z remote: Counting objects: 54% (1403/2597) 2024-06-26T07:01:14.3338819Z remote: Counting objects: 55% (1429/2597) 2024-06-26T07:01:14.3339423Z remote: Counting objects: 56% (1455/2597) 2024-06-26T07:01:14.3339962Z remote: Counting objects: 57% (1481/2597) 2024-06-26T07:01:14.3340631Z remote: Counting objects: 58% (1507/2597) 2024-06-26T07:01:14.3341152Z remote: Counting objects: 59% (1533/2597) 2024-06-26T07:01:14.3341688Z remote: Counting objects: 60% (1559/2597) 2024-06-26T07:01:14.3342399Z remote: Counting objects: 61% (1585/2597) 2024-06-26T07:01:14.3343066Z remote: Counting objects: 62% (1611/2597) 2024-06-26T07:01:14.3343625Z remote: Counting objects: 63% (1637/2597) 2024-06-26T07:01:14.3344323Z remote: Counting objects: 64% (1663/2597) 2024-06-26T07:01:14.3344952Z remote: Counting objects: 65% (1689/2597) 2024-06-26T07:01:14.3345485Z remote: Counting objects: 66% (1715/2597) 2024-06-26T07:01:14.3346036Z remote: Counting objects: 67% (1740/2597) 2024-06-26T07:01:14.3346555Z remote: Counting objects: 68% (1766/2597) 2024-06-26T07:01:14.3347125Z remote: Counting objects: 69% (1792/2597) 2024-06-26T07:01:14.3347636Z remote: Counting objects: 70% (1818/2597) 2024-06-26T07:01:14.3348159Z remote: Counting objects: 71% (1844/2597) 2024-06-26T07:01:14.3348676Z remote: Counting objects: 72% (1870/2597) 2024-06-26T07:01:14.3349194Z remote: Counting objects: 73% (1896/2597) 2024-06-26T07:01:14.3349707Z remote: Counting objects: 74% (1922/2597) 2024-06-26T07:01:14.3350225Z remote: Counting objects: 75% (1948/2597) 2024-06-26T07:01:14.3350745Z remote: Counting objects: 76% (1974/2597) 2024-06-26T07:01:14.3351265Z remote: Counting objects: 77% (2000/2597) 2024-06-26T07:01:14.3351775Z remote: Counting objects: 78% (2026/2597) 2024-06-26T07:01:14.3352380Z remote: Counting objects: 79% (2052/2597) 2024-06-26T07:01:14.3352904Z remote: Counting objects: 80% (2078/2597) 2024-06-26T07:01:14.3353422Z remote: Counting objects: 81% (2104/2597) 2024-06-26T07:01:14.3353935Z remote: Counting objects: 82% (2130/2597) 2024-06-26T07:01:14.3354456Z remote: Counting objects: 83% (2156/2597) 2024-06-26T07:01:14.3354980Z remote: Counting objects: 84% (2182/2597) 2024-06-26T07:01:14.3355505Z remote: Counting objects: 85% (2208/2597) 2024-06-26T07:01:14.3356017Z remote: Counting objects: 86% (2234/2597) 2024-06-26T07:01:14.3356534Z remote: Counting objects: 87% (2260/2597) 2024-06-26T07:01:14.3357053Z remote: Counting objects: 88% (2286/2597) 2024-06-26T07:01:14.3357570Z remote: Counting objects: 89% (2312/2597) 2024-06-26T07:01:14.3358084Z remote: Counting objects: 90% (2338/2597) 2024-06-26T07:01:14.3358603Z remote: Counting objects: 91% (2364/2597) 2024-06-26T07:01:14.3359129Z remote: Counting objects: 92% (2390/2597) 2024-06-26T07:01:14.3359652Z remote: Counting objects: 93% (2416/2597) 2024-06-26T07:01:14.3360163Z remote: Counting objects: 94% (2442/2597) 2024-06-26T07:01:14.3360683Z remote: Counting objects: 95% (2468/2597) 2024-06-26T07:01:14.3361201Z remote: Counting objects: 96% (2494/2597) 2024-06-26T07:01:14.3361777Z remote: Counting objects: 97% (2520/2597) 2024-06-26T07:01:14.3362291Z remote: Counting objects: 98% (2546/2597) 2024-06-26T07:01:14.3362809Z remote: Counting objects: 99% (2572/2597) 2024-06-26T07:01:14.3363326Z remote: Counting objects: 100% (2597/2597) 2024-06-26T07:01:14.3363885Z remote: Counting objects: 100% (2597/2597), done. 2024-06-26T07:01:14.3468560Z remote: Compressing objects: 0% (1/1074) 2024-06-26T07:01:14.3824613Z remote: Compressing objects: 1% (11/1074) 2024-06-26T07:01:14.4210601Z remote: Compressing objects: 2% (22/1074) 2024-06-26T07:01:14.4551997Z remote: Compressing objects: 3% (33/1074) 2024-06-26T07:01:14.4746683Z remote: Compressing objects: 4% (43/1074) 2024-06-26T07:01:14.4967706Z remote: Compressing objects: 5% (54/1074) 2024-06-26T07:01:14.5143078Z remote: Compressing objects: 6% (65/1074) 2024-06-26T07:01:14.5471890Z remote: Compressing objects: 7% (76/1074) 2024-06-26T07:01:14.6213264Z remote: Compressing objects: 8% (86/1074) 2024-06-26T07:01:14.6883873Z remote: Compressing objects: 9% (97/1074) 2024-06-26T07:01:14.7239394Z remote: Compressing objects: 10% (108/1074) 2024-06-26T07:01:14.7265083Z remote: Compressing objects: 11% (119/1074) 2024-06-26T07:01:14.7357484Z remote: Compressing objects: 12% (129/1074) 2024-06-26T07:01:14.7426801Z remote: Compressing objects: 13% (140/1074) 2024-06-26T07:01:14.7467224Z remote: Compressing objects: 14% (151/1074) 2024-06-26T07:01:14.7467803Z remote: Compressing objects: 15% (162/1074) 2024-06-26T07:01:14.7526933Z remote: Compressing objects: 16% (172/1074) 2024-06-26T07:01:14.7528490Z remote: Compressing objects: 17% (183/1074) 2024-06-26T07:01:14.7529355Z remote: Compressing objects: 18% (194/1074) 2024-06-26T07:01:14.7544794Z remote: Compressing objects: 19% (205/1074) 2024-06-26T07:01:14.7564084Z remote: Compressing objects: 20% (215/1074) 2024-06-26T07:01:14.7579329Z remote: Compressing objects: 21% (226/1074) 2024-06-26T07:01:14.7592179Z remote: Compressing objects: 22% (237/1074) 2024-06-26T07:01:14.7610956Z remote: Compressing objects: 23% (248/1074) 2024-06-26T07:01:14.7621714Z remote: Compressing objects: 24% (258/1074) 2024-06-26T07:01:14.7629216Z remote: Compressing objects: 25% (269/1074) 2024-06-26T07:01:14.7635239Z remote: Compressing objects: 26% (280/1074) 2024-06-26T07:01:14.7639660Z remote: Compressing objects: 27% (290/1074) 2024-06-26T07:01:14.7647198Z remote: Compressing objects: 28% (301/1074) 2024-06-26T07:01:14.7654948Z remote: Compressing objects: 29% (312/1074) 2024-06-26T07:01:14.7658414Z remote: Compressing objects: 30% (323/1074) 2024-06-26T07:01:14.7663418Z remote: Compressing objects: 31% (333/1074) 2024-06-26T07:01:14.7668396Z remote: Compressing objects: 32% (344/1074) 2024-06-26T07:01:14.7677322Z remote: Compressing objects: 33% (355/1074) 2024-06-26T07:01:14.7690526Z remote: Compressing objects: 34% (366/1074) 2024-06-26T07:01:14.7706062Z remote: Compressing objects: 35% (376/1074) 2024-06-26T07:01:14.7727437Z remote: Compressing objects: 36% (387/1074) 2024-06-26T07:01:14.7736636Z remote: Compressing objects: 37% (398/1074) 2024-06-26T07:01:14.7750018Z remote: Compressing objects: 38% (409/1074) 2024-06-26T07:01:14.7765692Z remote: Compressing objects: 39% (419/1074) 2024-06-26T07:01:14.7784529Z remote: Compressing objects: 40% (430/1074) 2024-06-26T07:01:14.7796857Z remote: Compressing objects: 41% (441/1074) 2024-06-26T07:01:14.7811574Z remote: Compressing objects: 42% (452/1074) 2024-06-26T07:01:14.7820602Z remote: Compressing objects: 43% (462/1074) 2024-06-26T07:01:14.7827529Z remote: Compressing objects: 44% (473/1074) 2024-06-26T07:01:14.7830203Z remote: Compressing objects: 45% (484/1074) 2024-06-26T07:01:14.7838000Z remote: Compressing objects: 46% (495/1074) 2024-06-26T07:01:14.7852064Z remote: Compressing objects: 47% (505/1074) 2024-06-26T07:01:14.7860884Z remote: Compressing objects: 48% (516/1074) 2024-06-26T07:01:14.7863981Z remote: Compressing objects: 49% (527/1074) 2024-06-26T07:01:14.7868605Z remote: Compressing objects: 50% (537/1074) 2024-06-26T07:01:14.7877476Z remote: Compressing objects: 51% (548/1074) 2024-06-26T07:01:14.7886664Z remote: Compressing objects: 52% (559/1074) 2024-06-26T07:01:14.7901086Z remote: Compressing objects: 53% (570/1074) 2024-06-26T07:01:14.7917701Z remote: Compressing objects: 54% (580/1074) 2024-06-26T07:01:14.7927101Z remote: Compressing objects: 55% (591/1074) 2024-06-26T07:01:14.7936941Z remote: Compressing objects: 56% (602/1074) 2024-06-26T07:01:14.7948417Z remote: Compressing objects: 57% (613/1074) 2024-06-26T07:01:14.7959080Z remote: Compressing objects: 58% (623/1074) 2024-06-26T07:01:14.7970000Z remote: Compressing objects: 59% (634/1074) 2024-06-26T07:01:14.7982028Z remote: Compressing objects: 60% (645/1074) 2024-06-26T07:01:14.7985506Z remote: Compressing objects: 61% (656/1074) 2024-06-26T07:01:14.7994663Z remote: Compressing objects: 62% (666/1074) 2024-06-26T07:01:14.8003484Z remote: Compressing objects: 63% (677/1074) 2024-06-26T07:01:14.8015547Z remote: Compressing objects: 64% (688/1074) 2024-06-26T07:01:14.8022296Z remote: Compressing objects: 65% (699/1074) 2024-06-26T07:01:14.8022982Z remote: Compressing objects: 66% (709/1074) 2024-06-26T07:01:14.8027688Z remote: Compressing objects: 67% (720/1074) 2024-06-26T07:01:14.8035515Z remote: Compressing objects: 68% (731/1074) 2024-06-26T07:01:14.8038242Z remote: Compressing objects: 69% (742/1074) 2024-06-26T07:01:14.8041045Z remote: Compressing objects: 70% (752/1074) 2024-06-26T07:01:14.8043855Z remote: Compressing objects: 71% (763/1074) 2024-06-26T07:01:14.8046538Z remote: Compressing objects: 72% (774/1074) 2024-06-26T07:01:14.8053329Z remote: Compressing objects: 73% (785/1074) 2024-06-26T07:01:14.8053954Z remote: Compressing objects: 74% (795/1074) 2024-06-26T07:01:14.8054546Z remote: Compressing objects: 75% (806/1074) 2024-06-26T07:01:14.8055095Z remote: Compressing objects: 76% (817/1074) 2024-06-26T07:01:14.8055749Z remote: Compressing objects: 77% (827/1074) 2024-06-26T07:01:14.8056307Z remote: Compressing objects: 78% (838/1074) 2024-06-26T07:01:14.8056855Z remote: Compressing objects: 79% (849/1074) 2024-06-26T07:01:14.8057777Z remote: Compressing objects: 80% (860/1074) 2024-06-26T07:01:14.8058326Z remote: Compressing objects: 81% (870/1074) 2024-06-26T07:01:14.8058871Z remote: Compressing objects: 82% (881/1074) 2024-06-26T07:01:14.8060351Z remote: Compressing objects: 83% (892/1074) 2024-06-26T07:01:14.8060904Z remote: Compressing objects: 84% (903/1074) 2024-06-26T07:01:14.8066879Z remote: Compressing objects: 85% (913/1074) 2024-06-26T07:01:14.8069181Z remote: Compressing objects: 86% (924/1074) 2024-06-26T07:01:14.8069731Z remote: Compressing objects: 87% (935/1074) 2024-06-26T07:01:14.8072294Z remote: Compressing objects: 88% (946/1074) 2024-06-26T07:01:14.8072850Z remote: Compressing objects: 89% (956/1074) 2024-06-26T07:01:14.8073405Z remote: Compressing objects: 90% (967/1074) 2024-06-26T07:01:14.8073943Z remote: Compressing objects: 91% (978/1074) 2024-06-26T07:01:14.8074489Z remote: Compressing objects: 92% (989/1074) 2024-06-26T07:01:14.8075041Z remote: Compressing objects: 93% (999/1074) 2024-06-26T07:01:14.8075596Z remote: Compressing objects: 94% (1010/1074) 2024-06-26T07:01:14.8077209Z remote: Compressing objects: 95% (1021/1074) 2024-06-26T07:01:14.8077781Z remote: Compressing objects: 96% (1032/1074) 2024-06-26T07:01:14.8084762Z remote: Compressing objects: 97% (1042/1074) 2024-06-26T07:01:14.8085334Z remote: Compressing objects: 98% (1053/1074) 2024-06-26T07:01:14.8085894Z remote: Compressing objects: 99% (1064/1074) 2024-06-26T07:01:14.8086443Z remote: Compressing objects: 100% (1074/1074) 2024-06-26T07:01:14.8087039Z remote: Compressing objects: 100% (1074/1074), done. 2024-06-26T07:01:34.9074950Z remote: Total 990209 (delta 2062), reused 1863 (delta 1522), pack-reused 987612 2024-06-26T07:01:58.6293657Z [command]/usr/bin/git rev-parse --verify --quiet b8c4c54d347aa776934c60784e35936878ef18dc^{object} 2024-06-26T07:01:58.6311042Z b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:01:58.6314043Z ##[endgroup] 2024-06-26T07:01:58.6314604Z ##[group]Determining the checkout info 2024-06-26T07:01:58.6317135Z ##[endgroup] 2024-06-26T07:01:58.6317685Z ##[group]Checking out the ref 2024-06-26T07:01:58.6318467Z [command]/usr/bin/git checkout --quiet --force b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:01:59.8527692Z ##[endgroup] 2024-06-26T07:01:59.8528323Z ##[group]Setting up auth for fetching submodules 2024-06-26T07:01:59.8532571Z [command]/usr/bin/git config --global http.https://github.com/.extraheader AUTHORIZATION: basic *** 2024-06-26T07:01:59.8579090Z [command]/usr/bin/git config --global --unset-all url.https://github.com/.insteadOf 2024-06-26T07:01:59.8599758Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf git@github.com: 2024-06-26T07:01:59.8625484Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf org-21003710@github.com: 2024-06-26T07:01:59.8647285Z ##[endgroup] 2024-06-26T07:01:59.8647832Z ##[group]Fetching submodules 2024-06-26T07:01:59.8650998Z [command]/usr/bin/git submodule sync --recursive 2024-06-26T07:01:59.8857461Z [command]/usr/bin/git -c protocol.version=2 submodule update --init --force --recursive 2024-06-26T07:01:59.9062428Z Submodule 'android/libs/fbjni' (https://github.com/facebookincubator/fbjni.git) registered for path 'android/libs/fbjni' 2024-06-26T07:01:59.9063920Z Submodule 'third_party/NNPACK_deps/FP16' (https://github.com/Maratyszcza/FP16.git) registered for path 'third_party/FP16' 2024-06-26T07:01:59.9065538Z Submodule 'third_party/NNPACK_deps/FXdiv' (https://github.com/Maratyszcza/FXdiv.git) registered for path 'third_party/FXdiv' 2024-06-26T07:01:59.9067337Z Submodule 'third_party/NNPACK' (https://github.com/Maratyszcza/NNPACK.git) registered for path 'third_party/NNPACK' 2024-06-26T07:01:59.9069828Z Submodule 'third_party/VulkanMemoryAllocator' (https://github.com/GPUOpen-LibrariesAndSDKs/VulkanMemoryAllocator.git) registered for path 'third_party/VulkanMemoryAllocator' 2024-06-26T07:01:59.9071822Z Submodule 'third_party/XNNPACK' (https://github.com/google/XNNPACK.git) registered for path 'third_party/XNNPACK' 2024-06-26T07:01:59.9074561Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/benchmark' 2024-06-26T07:01:59.9077204Z Submodule 'third_party/cpp-httplib' (https://github.com/yhirose/cpp-httplib.git) registered for path 'third_party/cpp-httplib' 2024-06-26T07:01:59.9079753Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo.git) registered for path 'third_party/cpuinfo' 2024-06-26T07:01:59.9082553Z Submodule 'third_party/cudnn_frontend' (https://github.com/NVIDIA/cudnn-frontend.git) registered for path 'third_party/cudnn_frontend' 2024-06-26T07:01:59.9085185Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/cutlass' 2024-06-26T07:01:59.9087979Z Submodule 'third_party/eigen' (https://gitlab.com/libeigen/eigen.git) registered for path 'third_party/eigen' 2024-06-26T07:01:59.9091242Z Submodule 'third_party/fbgemm' (https://github.com/pytorch/fbgemm) registered for path 'third_party/fbgemm' 2024-06-26T07:01:59.9094284Z Submodule 'third_party/flatbuffers' (https://github.com/google/flatbuffers.git) registered for path 'third_party/flatbuffers' 2024-06-26T07:01:59.9097139Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/fmt' 2024-06-26T07:01:59.9100336Z Submodule 'third_party/foxi' (https://github.com/houseroad/foxi.git) registered for path 'third_party/foxi' 2024-06-26T07:01:59.9103711Z Submodule 'third_party/gemmlowp/gemmlowp' (https://github.com/google/gemmlowp.git) registered for path 'third_party/gemmlowp/gemmlowp' 2024-06-26T07:01:59.9106696Z Submodule 'third_party/gloo' (https://github.com/facebookincubator/gloo) registered for path 'third_party/gloo' 2024-06-26T07:01:59.9110062Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/googletest' 2024-06-26T07:01:59.9113240Z Submodule 'third_party/ideep' (https://github.com/intel/ideep) registered for path 'third_party/ideep' 2024-06-26T07:01:59.9116690Z Submodule 'third_party/ittapi' (https://github.com/intel/ittapi.git) registered for path 'third_party/ittapi' 2024-06-26T07:01:59.9120164Z Submodule 'third_party/kineto' (https://github.com/pytorch/kineto) registered for path 'third_party/kineto' 2024-06-26T07:01:59.9123844Z Submodule 'third_party/mimalloc' (https://github.com/microsoft/mimalloc.git) registered for path 'third_party/mimalloc' 2024-06-26T07:01:59.9127391Z Submodule 'third_party/nccl/nccl' (https://github.com/NVIDIA/nccl) registered for path 'third_party/nccl/nccl' 2024-06-26T07:01:59.9131424Z Submodule 'third_party/nlohmann' (https://github.com/nlohmann/json.git) registered for path 'third_party/nlohmann' 2024-06-26T07:01:59.9135004Z Submodule 'third_party/onnx' (https://github.com/onnx/onnx.git) registered for path 'third_party/onnx' 2024-06-26T07:01:59.9139162Z Submodule 'third_party/opentelemetry-cpp' (https://github.com/open-telemetry/opentelemetry-cpp.git) registered for path 'third_party/opentelemetry-cpp' 2024-06-26T07:01:59.9143000Z Submodule 'third_party/pocketfft' (https://github.com/mreineck/pocketfft) registered for path 'third_party/pocketfft' 2024-06-26T07:01:59.9146931Z Submodule 'third_party/protobuf' (https://github.com/protocolbuffers/protobuf.git) registered for path 'third_party/protobuf' 2024-06-26T07:01:59.9150903Z Submodule 'third_party/NNPACK_deps/psimd' (https://github.com/Maratyszcza/psimd.git) registered for path 'third_party/psimd' 2024-06-26T07:01:59.9155089Z Submodule 'third_party/NNPACK_deps/pthreadpool' (https://github.com/Maratyszcza/pthreadpool.git) registered for path 'third_party/pthreadpool' 2024-06-26T07:01:59.9159222Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/pybind11' 2024-06-26T07:01:59.9163387Z Submodule 'third_party/python-peachpy' (https://github.com/malfet/PeachPy.git) registered for path 'third_party/python-peachpy' 2024-06-26T07:01:59.9167525Z Submodule 'third_party/sleef' (https://github.com/shibatch/sleef) registered for path 'third_party/sleef' 2024-06-26T07:01:59.9172394Z Submodule 'third_party/tensorpipe' (https://github.com/pytorch/tensorpipe.git) registered for path 'third_party/tensorpipe' 2024-06-26T07:01:59.9192108Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/android/libs/fbjni'... 2024-06-26T07:02:00.1532881Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FP16'... 2024-06-26T07:02:00.3474241Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FXdiv'... 2024-06-26T07:02:00.5064674Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/NNPACK'... 2024-06-26T07:02:00.7288262Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/VulkanMemoryAllocator'... 2024-06-26T07:02:02.6638073Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/XNNPACK'... 2024-06-26T07:02:12.3870892Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/benchmark'... 2024-06-26T07:02:12.7296648Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpp-httplib'... 2024-06-26T07:02:13.2042913Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpuinfo'... 2024-06-26T07:02:13.7841010Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cudnn_frontend'... 2024-06-26T07:02:14.9218123Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cutlass'... 2024-06-26T07:02:16.6458639Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/eigen'... 2024-06-26T07:02:22.5205641Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm'... 2024-06-26T07:02:23.7493895Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/flatbuffers'... 2024-06-26T07:02:25.3671656Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fmt'... 2024-06-26T07:02:26.6009504Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/foxi'... 2024-06-26T07:02:26.7557025Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gemmlowp/gemmlowp'... 2024-06-26T07:02:27.1643254Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gloo'... 2024-06-26T07:02:27.4720438Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/googletest'... 2024-06-26T07:02:28.4993025Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep'... 2024-06-26T07:02:28.8103432Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ittapi'... 2024-06-26T07:02:29.0525805Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto'... 2024-06-26T07:02:30.5181707Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/mimalloc'... 2024-06-26T07:02:31.2562936Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nccl/nccl'... 2024-06-26T07:02:31.8948415Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nlohmann'... 2024-06-26T07:02:37.4653055Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx'... 2024-06-26T07:02:39.8692640Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp'... 2024-06-26T07:02:45.4470522Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pocketfft'... 2024-06-26T07:02:45.7025531Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf'... 2024-06-26T07:02:54.1019485Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/psimd'... 2024-06-26T07:02:54.2780198Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pthreadpool'... 2024-06-26T07:02:54.4481067Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pybind11'... 2024-06-26T07:02:55.4782765Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/python-peachpy'... 2024-06-26T07:02:55.7481208Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/sleef'... 2024-06-26T07:02:56.3556171Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe'... 2024-06-26T07:02:56.7785573Z Submodule path 'android/libs/fbjni': checked out '7e1e1fe3858c63c251c637ae41a20de425dde96f' 2024-06-26T07:02:56.7871111Z Submodule path 'third_party/FP16': checked out '4dfe081cf6bcd15db339cf2680b9281b8451eeb3' 2024-06-26T07:02:56.7935489Z Submodule path 'third_party/FXdiv': checked out 'b408327ac2a15ec3e43352421954f5b1967701d1' 2024-06-26T07:02:56.8119516Z Submodule path 'third_party/NNPACK': checked out 'c07e3a0400713d546e0dea2d5466dd22ea389c73' 2024-06-26T07:02:56.8424627Z Submodule path 'third_party/VulkanMemoryAllocator': checked out 'a6bfc237255a6bac1513f7c1ebde6d8aed6b5191' 2024-06-26T07:02:57.6199777Z Submodule path 'third_party/XNNPACK': checked out 'fcbf55af6cf28a4627bcd1f703ab7ad843f0f3a2' 2024-06-26T07:02:57.6380071Z Submodule path 'third_party/benchmark': checked out '0d98dba29d66e93259db7daa53a9327df767a415' 2024-06-26T07:02:57.6720617Z Submodule path 'third_party/cpp-httplib': checked out '3b6597bba913d51161383657829b7e644e59c006' 2024-06-26T07:02:57.7571119Z Submodule path 'third_party/cpuinfo': checked out '3c8b1533ac03dd6531ab6e7b9245d488f13a82a5' 2024-06-26T07:02:57.7844061Z Submodule path 'third_party/cudnn_frontend': checked out 'aa3abd4bc689d6412979c7f55f9cd132848c9c6a' 2024-06-26T07:02:58.2127805Z Submodule path 'third_party/cutlass': checked out 'bbe579a9e3beb6ea6626d9227ec32d0dae119a49' 2024-06-26T07:02:58.4259195Z Submodule path 'third_party/eigen': checked out '3147391d946bb4b6c68edd901f2add6ac1f31f8c' 2024-06-26T07:02:58.4901181Z Submodule path 'third_party/fbgemm': checked out 'dbc3157bf256f1339b3fa1fef2be89ac4078be0e' 2024-06-26T07:02:58.4912634Z Submodule 'third_party/asmjit' (https://github.com/asmjit/asmjit.git) registered for path 'third_party/fbgemm/third_party/asmjit' 2024-06-26T07:02:58.4915795Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo) registered for path 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T07:02:58.4917771Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/fbgemm/third_party/cutlass' 2024-06-26T07:02:58.4919793Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/fbgemm/third_party/googletest' 2024-06-26T07:02:58.4921497Z Submodule 'third_party/hipify_torch' (https://github.com/ROCmSoftwarePlatform/hipify_torch.git) registered for path 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T07:02:58.4939253Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/asmjit'... 2024-06-26T07:02:59.3901778Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cpuinfo'... 2024-06-26T07:02:59.9925960Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cutlass'... 2024-06-26T07:03:01.7186692Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/googletest'... 2024-06-26T07:03:02.6862973Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/hipify_torch'... 2024-06-26T07:03:03.2887989Z Submodule path 'third_party/fbgemm/third_party/asmjit': checked out 'd3fbf7c9bc7c1d1365a94a45614b91c5a3706b81' 2024-06-26T07:03:03.3726252Z Submodule path 'third_party/fbgemm/third_party/cpuinfo': checked out 'ed8b86a253800bafdb7b25c5c399f91bff9cb1f3' 2024-06-26T07:03:03.7150193Z Submodule path 'third_party/fbgemm/third_party/cutlass': checked out 'fc9ebc645b63f3a6bc80aaefde5c063fb72110d6' 2024-06-26T07:03:03.7692955Z Submodule path 'third_party/fbgemm/third_party/googletest': checked out 'cbf019de22c8dd37b2108da35b2748fd702d1796' 2024-06-26T07:03:03.7777629Z Submodule path 'third_party/fbgemm/third_party/hipify_torch': checked out '23f53b025b466d8ec3c45d52290d3442f7fbe6b1' 2024-06-26T07:03:03.8679071Z Submodule path 'third_party/flatbuffers': checked out '01834de25e4bf3975a9a00e816292b1ad0fe184b' 2024-06-26T07:03:03.8965797Z Submodule path 'third_party/fmt': checked out 'e69e5f977d458f2650bb346dadf2ad30c5320281' 2024-06-26T07:03:03.9033285Z Submodule path 'third_party/foxi': checked out 'c278588e34e535f0bb8f00df3880d26928038cad' 2024-06-26T07:03:03.9339990Z Submodule path 'third_party/gemmlowp/gemmlowp': checked out '3fb5c176c17c765a3492cd2f0321b0dab712f350' 2024-06-26T07:03:03.9537309Z Submodule path 'third_party/gloo': checked out '5354032ea08eadd7fc4456477f7f7c6308818509' 2024-06-26T07:03:03.9903484Z Submodule path 'third_party/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2024-06-26T07:03:04.0000225Z Submodule path 'third_party/ideep': checked out '55ca0191687aaf19aca5cdb7881c791e3bea442b' 2024-06-26T07:03:04.0010493Z Submodule 'mkl-dnn' (https://github.com/intel/mkl-dnn.git) registered for path 'third_party/ideep/mkl-dnn' 2024-06-26T07:03:04.0027418Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep/mkl-dnn'... 2024-06-26T07:03:15.7218413Z Submodule path 'third_party/ideep/mkl-dnn': checked out '1137e04ec0b5251ca2b4400a4fd3c667ce843d67' 2024-06-26T07:03:15.7355530Z Submodule path 'third_party/ittapi': checked out '5b8a7d7422611c3a0d799fb5fc5dd4abfae35b42' 2024-06-26T07:03:15.8136925Z Submodule path 'third_party/kineto': checked out '8681ff11e1fa54da39023076c5c43eddd87b7a8a' 2024-06-26T07:03:15.8147945Z Submodule 'libkineto/third_party/dynolog' (https://github.com/facebookincubator/dynolog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T07:03:15.8149636Z Submodule 'libkineto/third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T07:03:15.8151323Z Submodule 'libkineto/third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T07:03:15.8170288Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog'... 2024-06-26T07:03:16.3612122Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/fmt'... 2024-06-26T07:03:17.5949893Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/googletest'... 2024-06-26T07:03:18.6213345Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog': checked out '7d04a0053a845370ae06ce317a22a48e9edcc74e' 2024-06-26T07:03:18.6223199Z Submodule 'third_party/DCGM' (https://github.com/NVIDIA/DCGM.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T07:03:18.6224915Z Submodule 'third_party/cpr' (https://github.com/libcpr/cpr.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T07:03:18.6226723Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T07:03:18.6228610Z Submodule 'third_party/gflags' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T07:03:18.6230627Z Submodule 'third_party/glog' (https://github.com/google/glog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T07:03:18.6232892Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T07:03:18.6234907Z Submodule 'third_party/json' (https://github.com/nlohmann/json.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T07:03:18.6237114Z Submodule 'third_party/pfs' (https://github.com/dtrugman/pfs.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T07:03:18.6255969Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'... 2024-06-26T07:03:19.7412582Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'... 2024-06-26T07:03:20.0788345Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'... 2024-06-26T07:03:21.2843652Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'... 2024-06-26T07:03:21.5507784Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/glog'... 2024-06-26T07:03:22.0175555Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'... 2024-06-26T07:03:22.9936639Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/json'... 2024-06-26T07:03:28.5190474Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'... 2024-06-26T07:03:28.8481498Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM': checked out 'ffde4e54bc7249a6039a5e6b45b395141e1217f9' 2024-06-26T07:03:28.8620565Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr': checked out '871ed52d350214a034f6ef8a3b8f51c5ce1bd400' 2024-06-26T07:03:28.8919055Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt': checked out 'cd4af11efc9c622896a3e4cb599fa28668ca3d05' 2024-06-26T07:03:28.9020812Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags': checked out 'e171aa2d15ed9eb17054558e0b3a6a413bb01067' 2024-06-26T07:03:28.9030849Z Submodule 'doc' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T07:03:28.9049161Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'... 2024-06-26T07:03:29.1719528Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc': checked out '8411df715cf522606e3b1aca386ddfc0b63d34b4' 2024-06-26T07:03:29.1857106Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog': checked out 'b33e3bad4c46c8a6345525fd822af355e5ef9446' 2024-06-26T07:03:29.2197937Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest': checked out '58d77fa8070e8cec2dc1ed015d66b454c8d78850' 2024-06-26T07:03:29.3004032Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json': checked out '4f8fba14066156b73f1189a2b8bd568bde5284c5' 2024-06-26T07:03:29.3120588Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs': checked out 'f68a2fa8ea36c783bdd760371411fcb495aa3150' 2024-06-26T07:03:29.3416094Z Submodule path 'third_party/kineto/libkineto/third_party/fmt': checked out 'a33701196adfad74917046096bf5a2aa0ab0bb50' 2024-06-26T07:03:29.3913981Z Submodule path 'third_party/kineto/libkineto/third_party/googletest': checked out '7aca84427f224eeed3144123d5230d5871e93347' 2024-06-26T07:03:29.4216738Z Submodule path 'third_party/mimalloc': checked out 'b66e3214d8a104669c2ec05ae91ebc26a8f5ab78' 2024-06-26T07:03:29.4411665Z Submodule path 'third_party/nccl/nccl': checked out '48bb7fec7953112ff37499a272317f6663f8f600' 2024-06-26T07:03:29.5268981Z Submodule path 'third_party/nlohmann': checked out '87cda1d6646592ac5866dc703c8e1839046a6806' 2024-06-26T07:03:29.8009812Z Submodule path 'third_party/onnx': checked out '990217f043af7222348ca8f0301e17fa7b841781' 2024-06-26T07:03:29.8032965Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/onnx/third_party/benchmark' 2024-06-26T07:03:29.8035285Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/onnx/third_party/pybind11' 2024-06-26T07:03:29.8063992Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx/third_party/benchmark'... 2024-06-26T07:03:30.2284837Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx/third_party/pybind11'... 2024-06-26T07:03:31.2940231Z Submodule path 'third_party/onnx/third_party/benchmark': checked out '2dd015dfef425c866d9a43f2c67d8b52d709acb6' 2024-06-26T07:03:31.3224090Z Submodule path 'third_party/onnx/third_party/pybind11': checked out '5b0a6fc2017fcc176545afe3e09c9f9885283242' 2024-06-26T07:03:31.3746643Z Submodule path 'third_party/opentelemetry-cpp': checked out 'a799f4aed9c94b765dcdaabaeab7d5e7e2310878' 2024-06-26T07:03:31.3758624Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark) registered for path 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T07:03:31.3761182Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T07:03:31.3763648Z Submodule 'third_party/ms-gsl' (https://github.com/microsoft/GSL) registered for path 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T07:03:31.3765960Z Submodule 'third_party/nlohmann-json' (https://github.com/nlohmann/json) registered for path 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T07:03:31.3768271Z Submodule 'third_party/opentelemetry-proto' (https://github.com/open-telemetry/opentelemetry-proto) registered for path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T07:03:31.3771074Z Submodule 'third_party/opentracing-cpp' (https://github.com/opentracing/opentracing-cpp.git) registered for path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T07:03:31.3773481Z Submodule 'third_party/prometheus-cpp' (https://github.com/jupp0r/prometheus-cpp) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T07:03:31.3776322Z Submodule 'tools/vcpkg' (https://github.com/Microsoft/vcpkg) registered for path 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T07:03:31.3792288Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/benchmark'... 2024-06-26T07:03:31.8182955Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/googletest'... 2024-06-26T07:03:32.9340457Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/ms-gsl'... 2024-06-26T07:03:33.2806898Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/nlohmann-json'... 2024-06-26T07:03:38.7453809Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentelemetry-proto'... 2024-06-26T07:03:39.0876403Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentracing-cpp'... 2024-06-26T07:03:39.2712630Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp'... 2024-06-26T07:03:39.5787011Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/tools/vcpkg'... 2024-06-26T07:03:46.9157492Z Submodule path 'third_party/opentelemetry-cpp/third_party/benchmark': checked out 'd572f4777349d43653b21d6c2fc63020ab326db2' 2024-06-26T07:03:46.9489375Z Submodule path 'third_party/opentelemetry-cpp/third_party/googletest': checked out 'b796f7d44681514f58a683a3a71ff17c94edb0c1' 2024-06-26T07:03:46.9620826Z Submodule path 'third_party/opentelemetry-cpp/third_party/ms-gsl': checked out '6f4529395c5b7c2d661812257cd6780c67e54afa' 2024-06-26T07:03:47.0469452Z Submodule path 'third_party/opentelemetry-cpp/third_party/nlohmann-json': checked out 'bc889afb4c5bf1c0d8ee29ef35eaaf4c8bef8a5d' 2024-06-26T07:03:47.0564375Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto': checked out '4ca4f0335c63cda7ab31ea7ed70d6553aee14dce' 2024-06-26T07:03:47.0672427Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp': checked out '06b57f48ded1fa3bdd3d4346f6ef29e40e08eaf5' 2024-06-26T07:03:47.0787938Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp': checked out 'c9ffcdda9086ffd9e1283ea7a0276d831f3c8a8d' 2024-06-26T07:03:47.0799522Z Submodule 'civetweb' (https://github.com/civetweb/civetweb.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T07:03:47.0801964Z Submodule 'googletest' (https://github.com/google/googletest.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T07:03:47.0818760Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'... 2024-06-26T07:03:48.8479796Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'... 2024-06-26T07:03:50.0281036Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb': checked out 'eefb26f82b233268fc98577d265352720d477ba4' 2024-06-26T07:03:50.0646397Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2024-06-26T07:03:50.4387330Z Submodule path 'third_party/opentelemetry-cpp/tools/vcpkg': checked out '8eb57355a4ffb410a2e94c07b4dca2dffbee8e50' 2024-06-26T07:03:50.4465901Z Submodule path 'third_party/pocketfft': checked out '9d3ab05a7fffbc71a492bc6a17be034e83e8f0fe' 2024-06-26T07:03:50.6674480Z Submodule path 'third_party/protobuf': checked out 'd1eca4e4b421cd2997495c4b4e65cea6be4e9b8a' 2024-06-26T07:03:50.6687789Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/protobuf/third_party/benchmark' 2024-06-26T07:03:50.6690755Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/protobuf/third_party/googletest' 2024-06-26T07:03:50.6706071Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/benchmark'... 2024-06-26T07:03:51.0319303Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/googletest'... 2024-06-26T07:03:51.9930783Z Submodule path 'third_party/protobuf/third_party/benchmark': checked out '5b7683f49e1e9223cf9927b24f6fd3d6bd82e3f8' 2024-06-26T07:03:52.0552952Z Submodule path 'third_party/protobuf/third_party/googletest': checked out '5ec7f0c4a113e2f18ac2c6cc7df51ad6afc24081' 2024-06-26T07:03:52.0615401Z Submodule path 'third_party/psimd': checked out '072586a71b55b7f8c584153d223e95687148a900' 2024-06-26T07:03:52.0706882Z Submodule path 'third_party/pthreadpool': checked out '4fe0e1e183925bf8cfa6aae24237e724a96479b8' 2024-06-26T07:03:52.0986966Z Submodule path 'third_party/pybind11': checked out '3e9dfa2866941655c56877882565e7577de6fc7b' 2024-06-26T07:03:52.1209669Z Submodule path 'third_party/python-peachpy': checked out 'f45429b087dd7d5bc78bb40dc7cf06425c252d67' 2024-06-26T07:03:52.1547022Z Submodule path 'third_party/sleef': checked out '60e76d2bce17d278b439d9da17177c8f957a9e9b' 2024-06-26T07:03:52.1748131Z Submodule path 'third_party/tensorpipe': checked out '52791a2fd214b2a9dc5759d36725909c1daa7f2e' 2024-06-26T07:03:52.1758606Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/tensorpipe/third_party/googletest' 2024-06-26T07:03:52.1760547Z Submodule 'third_party/libnop' (https://github.com/google/libnop.git) registered for path 'third_party/tensorpipe/third_party/libnop' 2024-06-26T07:03:52.1762429Z Submodule 'third_party/libuv' (https://github.com/libuv/libuv.git) registered for path 'third_party/tensorpipe/third_party/libuv' 2024-06-26T07:03:52.1764107Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T07:03:52.1782081Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/googletest'... 2024-06-26T07:03:53.1388672Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libnop'... 2024-06-26T07:03:53.3479996Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libuv'... 2024-06-26T07:03:54.3853603Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11'... 2024-06-26T07:03:55.4446380Z Submodule path 'third_party/tensorpipe/third_party/googletest': checked out 'aee0f9d9b5b87796ee8a0ab26b7587ec30e8858e' 2024-06-26T07:03:55.4560855Z Submodule path 'third_party/tensorpipe/third_party/libnop': checked out '910b55815be16109f04f4180e9adee14fb4ce281' 2024-06-26T07:03:55.5125266Z Submodule path 'third_party/tensorpipe/third_party/libuv': checked out '1dff88e5161cba5c59276d2070d2e304e4dcb242' 2024-06-26T07:03:55.5362683Z Submodule path 'third_party/tensorpipe/third_party/pybind11': checked out 'a23996fce38ff6ccfbcdc09f1e63f2c4be5ea2ef' 2024-06-26T07:03:55.5373612Z Submodule 'tools/clang' (https://github.com/wjakob/clang-cindex-python3) registered for path 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T07:03:55.5392807Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11/tools/clang'... 2024-06-26T07:03:55.7064347Z Submodule path 'third_party/tensorpipe/third_party/pybind11/tools/clang': checked out '6a00cbc4a9b8e68b71caf7f774b3f9c753ae84d5' 2024-06-26T07:03:55.7089379Z [command]/usr/bin/git submodule foreach --recursive git config --local gc.auto 0 2024-06-26T07:03:55.7291131Z Entering 'android/libs/fbjni' 2024-06-26T07:03:55.7318560Z Entering 'third_party/FP16' 2024-06-26T07:03:55.7344226Z Entering 'third_party/FXdiv' 2024-06-26T07:03:55.7372347Z Entering 'third_party/NNPACK' 2024-06-26T07:03:55.7400151Z Entering 'third_party/VulkanMemoryAllocator' 2024-06-26T07:03:55.7428298Z Entering 'third_party/XNNPACK' 2024-06-26T07:03:55.7468357Z Entering 'third_party/benchmark' 2024-06-26T07:03:55.7496965Z Entering 'third_party/cpp-httplib' 2024-06-26T07:03:55.7524359Z Entering 'third_party/cpuinfo' 2024-06-26T07:03:55.7552300Z Entering 'third_party/cudnn_frontend' 2024-06-26T07:03:55.7581435Z Entering 'third_party/cutlass' 2024-06-26T07:03:55.7615906Z Entering 'third_party/eigen' 2024-06-26T07:03:55.7647263Z Entering 'third_party/fbgemm' 2024-06-26T07:03:55.7675345Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-06-26T07:03:55.7704680Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T07:03:55.7732859Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-06-26T07:03:55.7765389Z Entering 'third_party/fbgemm/third_party/googletest' 2024-06-26T07:03:55.7793822Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T07:03:55.7824845Z Entering 'third_party/flatbuffers' 2024-06-26T07:03:55.7854512Z Entering 'third_party/fmt' 2024-06-26T07:03:55.7881413Z Entering 'third_party/foxi' 2024-06-26T07:03:55.7910780Z Entering 'third_party/gemmlowp/gemmlowp' 2024-06-26T07:03:55.7936992Z Entering 'third_party/gloo' 2024-06-26T07:03:55.7965497Z Entering 'third_party/googletest' 2024-06-26T07:03:55.7995516Z Entering 'third_party/ideep' 2024-06-26T07:03:55.8021175Z Entering 'third_party/ideep/mkl-dnn' 2024-06-26T07:03:55.8051848Z Entering 'third_party/ittapi' 2024-06-26T07:03:55.8084684Z Entering 'third_party/kineto' 2024-06-26T07:03:55.8114234Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T07:03:55.8142181Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T07:03:55.8170967Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T07:03:55.8195357Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T07:03:55.8220330Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T07:03:55.8246793Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T07:03:55.8273350Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T07:03:55.8302380Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T07:03:55.8328189Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T07:03:55.8355920Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T07:03:55.8383728Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T07:03:55.8410576Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T07:03:55.8437863Z Entering 'third_party/mimalloc' 2024-06-26T07:03:55.8468026Z Entering 'third_party/nccl/nccl' 2024-06-26T07:03:55.8498844Z Entering 'third_party/nlohmann' 2024-06-26T07:03:55.8527475Z Entering 'third_party/onnx' 2024-06-26T07:03:55.8568550Z Entering 'third_party/onnx/third_party/benchmark' 2024-06-26T07:03:55.8598193Z Entering 'third_party/onnx/third_party/pybind11' 2024-06-26T07:03:55.8629103Z Entering 'third_party/opentelemetry-cpp' 2024-06-26T07:03:55.8660711Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T07:03:55.8688972Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T07:03:55.8717016Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T07:03:55.8744200Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T07:03:55.8771518Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T07:03:55.8802011Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T07:03:55.8832173Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T07:03:55.8860014Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T07:03:55.8889087Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T07:03:55.8919420Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T07:03:55.8963723Z Entering 'third_party/pocketfft' 2024-06-26T07:03:55.8993966Z Entering 'third_party/protobuf' 2024-06-26T07:03:55.9023897Z Entering 'third_party/protobuf/third_party/benchmark' 2024-06-26T07:03:55.9051331Z Entering 'third_party/protobuf/third_party/googletest' 2024-06-26T07:03:55.9080996Z Entering 'third_party/psimd' 2024-06-26T07:03:55.9108352Z Entering 'third_party/pthreadpool' 2024-06-26T07:03:55.9138540Z Entering 'third_party/pybind11' 2024-06-26T07:03:55.9166379Z Entering 'third_party/python-peachpy' 2024-06-26T07:03:55.9195106Z Entering 'third_party/sleef' 2024-06-26T07:03:55.9224778Z Entering 'third_party/tensorpipe' 2024-06-26T07:03:55.9254156Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-06-26T07:03:55.9284131Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-06-26T07:03:55.9312565Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-06-26T07:03:55.9337873Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T07:03:55.9363270Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T07:03:55.9402940Z ##[endgroup] 2024-06-26T07:03:55.9405011Z ##[group]Persisting credentials for submodules 2024-06-26T07:03:55.9407980Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'url\.https\:\/\/github\.com\/\.insteadOf' && git config --local --unset-all 'url.https://github.com/.insteadOf' || :" 2024-06-26T07:03:55.9617423Z Entering 'android/libs/fbjni' 2024-06-26T07:03:55.9653492Z Entering 'third_party/FP16' 2024-06-26T07:03:55.9689451Z Entering 'third_party/FXdiv' 2024-06-26T07:03:55.9723324Z Entering 'third_party/NNPACK' 2024-06-26T07:03:55.9759010Z Entering 'third_party/VulkanMemoryAllocator' 2024-06-26T07:03:55.9792620Z Entering 'third_party/XNNPACK' 2024-06-26T07:03:55.9840194Z Entering 'third_party/benchmark' 2024-06-26T07:03:55.9875524Z Entering 'third_party/cpp-httplib' 2024-06-26T07:03:55.9910437Z Entering 'third_party/cpuinfo' 2024-06-26T07:03:55.9946320Z Entering 'third_party/cudnn_frontend' 2024-06-26T07:03:55.9980407Z Entering 'third_party/cutlass' 2024-06-26T07:03:56.0017753Z Entering 'third_party/eigen' 2024-06-26T07:03:56.0054171Z Entering 'third_party/fbgemm' 2024-06-26T07:03:56.0090888Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-06-26T07:03:56.0125131Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T07:03:56.0162628Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-06-26T07:03:56.0199422Z Entering 'third_party/fbgemm/third_party/googletest' 2024-06-26T07:03:56.0235575Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T07:03:56.0271909Z Entering 'third_party/flatbuffers' 2024-06-26T07:03:56.0309715Z Entering 'third_party/fmt' 2024-06-26T07:03:56.0345996Z Entering 'third_party/foxi' 2024-06-26T07:03:56.0379934Z Entering 'third_party/gemmlowp/gemmlowp' 2024-06-26T07:03:56.0413773Z Entering 'third_party/gloo' 2024-06-26T07:03:56.0447838Z Entering 'third_party/googletest' 2024-06-26T07:03:56.0483297Z Entering 'third_party/ideep' 2024-06-26T07:03:56.0517981Z Entering 'third_party/ideep/mkl-dnn' 2024-06-26T07:03:56.0557991Z Entering 'third_party/ittapi' 2024-06-26T07:03:56.0595451Z Entering 'third_party/kineto' 2024-06-26T07:03:56.0630807Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T07:03:56.0666234Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T07:03:56.0700967Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T07:03:56.0736136Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T07:03:56.0770477Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T07:03:56.0804167Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T07:03:56.0840479Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T07:03:56.0876562Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T07:03:56.0909518Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T07:03:56.0945100Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T07:03:56.0981666Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T07:03:56.1015668Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T07:03:56.1050846Z Entering 'third_party/mimalloc' 2024-06-26T07:03:56.1085249Z Entering 'third_party/nccl/nccl' 2024-06-26T07:03:56.1117474Z Entering 'third_party/nlohmann' 2024-06-26T07:03:56.1154497Z Entering 'third_party/onnx' 2024-06-26T07:03:56.1201651Z Entering 'third_party/onnx/third_party/benchmark' 2024-06-26T07:03:56.1235640Z Entering 'third_party/onnx/third_party/pybind11' 2024-06-26T07:03:56.1270336Z Entering 'third_party/opentelemetry-cpp' 2024-06-26T07:03:56.1308451Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T07:03:56.1341229Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T07:03:56.1376058Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T07:03:56.1410772Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T07:03:56.1445861Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T07:03:56.1481226Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T07:03:56.1516292Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T07:03:56.1549128Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T07:03:56.1585001Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T07:03:56.1620939Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T07:03:56.1668566Z Entering 'third_party/pocketfft' 2024-06-26T07:03:56.1704731Z Entering 'third_party/protobuf' 2024-06-26T07:03:56.1742159Z Entering 'third_party/protobuf/third_party/benchmark' 2024-06-26T07:03:56.1777011Z Entering 'third_party/protobuf/third_party/googletest' 2024-06-26T07:03:56.1811216Z Entering 'third_party/psimd' 2024-06-26T07:03:56.1847997Z Entering 'third_party/pthreadpool' 2024-06-26T07:03:56.1882005Z Entering 'third_party/pybind11' 2024-06-26T07:03:56.1917811Z Entering 'third_party/python-peachpy' 2024-06-26T07:03:56.1950697Z Entering 'third_party/sleef' 2024-06-26T07:03:56.1986457Z Entering 'third_party/tensorpipe' 2024-06-26T07:03:56.2019358Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-06-26T07:03:56.2053464Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-06-26T07:03:56.2085381Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-06-26T07:03:56.2119972Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T07:03:56.2154227Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T07:03:56.2201552Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local 'http.https://github.com/.extraheader' 'AUTHORIZATION: basic ***' && git config --local --show-origin --name-only --get-regexp remote.origin.url" 2024-06-26T07:03:56.2409638Z Entering 'android/libs/fbjni' 2024-06-26T07:03:56.2441893Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/android/libs/fbjni/config remote.origin.url 2024-06-26T07:03:56.2456274Z Entering 'third_party/FP16' 2024-06-26T07:03:56.2489854Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FP16/config remote.origin.url 2024-06-26T07:03:56.2503679Z Entering 'third_party/FXdiv' 2024-06-26T07:03:56.2534505Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FXdiv/config remote.origin.url 2024-06-26T07:03:56.2546258Z Entering 'third_party/NNPACK' 2024-06-26T07:03:56.2578080Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK/config remote.origin.url 2024-06-26T07:03:56.2593001Z Entering 'third_party/VulkanMemoryAllocator' 2024-06-26T07:03:56.2624956Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/VulkanMemoryAllocator/config remote.origin.url 2024-06-26T07:03:56.2639485Z Entering 'third_party/XNNPACK' 2024-06-26T07:03:56.2670988Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/XNNPACK/config remote.origin.url 2024-06-26T07:03:56.2693929Z Entering 'third_party/benchmark' 2024-06-26T07:03:56.2726615Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/benchmark/config remote.origin.url 2024-06-26T07:03:56.2739795Z Entering 'third_party/cpp-httplib' 2024-06-26T07:03:56.2774513Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpp-httplib/config remote.origin.url 2024-06-26T07:03:56.2789112Z Entering 'third_party/cpuinfo' 2024-06-26T07:03:56.2820408Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpuinfo/config remote.origin.url 2024-06-26T07:03:56.2835240Z Entering 'third_party/cudnn_frontend' 2024-06-26T07:03:56.2868140Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cudnn_frontend/config remote.origin.url 2024-06-26T07:03:56.2882490Z Entering 'third_party/cutlass' 2024-06-26T07:03:56.2914251Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cutlass/config remote.origin.url 2024-06-26T07:03:56.2934257Z Entering 'third_party/eigen' 2024-06-26T07:03:56.2966712Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/eigen/config remote.origin.url 2024-06-26T07:03:56.2982327Z Entering 'third_party/fbgemm' 2024-06-26T07:03:56.3014067Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/config remote.origin.url 2024-06-26T07:03:56.3027308Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-06-26T07:03:56.3060168Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/asmjit/config remote.origin.url 2024-06-26T07:03:56.3073908Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T07:03:56.3105847Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cpuinfo/config remote.origin.url 2024-06-26T07:03:56.3118376Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-06-26T07:03:56.3151322Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cutlass/config remote.origin.url 2024-06-26T07:03:56.3169678Z Entering 'third_party/fbgemm/third_party/googletest' 2024-06-26T07:03:56.3200641Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/googletest/config remote.origin.url 2024-06-26T07:03:56.3213170Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T07:03:56.3244180Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/hipify_torch/config remote.origin.url 2024-06-26T07:03:56.3258988Z Entering 'third_party/flatbuffers' 2024-06-26T07:03:56.3292728Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/flatbuffers/config remote.origin.url 2024-06-26T07:03:56.3307693Z Entering 'third_party/fmt' 2024-06-26T07:03:56.3339280Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fmt/config remote.origin.url 2024-06-26T07:03:56.3353861Z Entering 'third_party/foxi' 2024-06-26T07:03:56.3385435Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/foxi/config remote.origin.url 2024-06-26T07:03:56.3398995Z Entering 'third_party/gemmlowp/gemmlowp' 2024-06-26T07:03:56.3430441Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gemmlowp/gemmlowp/config remote.origin.url 2024-06-26T07:03:56.3443938Z Entering 'third_party/gloo' 2024-06-26T07:03:56.3475024Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gloo/config remote.origin.url 2024-06-26T07:03:56.3489148Z Entering 'third_party/googletest' 2024-06-26T07:03:56.3520209Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/googletest/config remote.origin.url 2024-06-26T07:03:56.3533546Z Entering 'third_party/ideep' 2024-06-26T07:03:56.3562798Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/config remote.origin.url 2024-06-26T07:03:56.3576267Z Entering 'third_party/ideep/mkl-dnn' 2024-06-26T07:03:56.3606469Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/modules/mkl-dnn/config remote.origin.url 2024-06-26T07:03:56.3626188Z Entering 'third_party/ittapi' 2024-06-26T07:03:56.3658963Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ittapi/config remote.origin.url 2024-06-26T07:03:56.3673297Z Entering 'third_party/kineto' 2024-06-26T07:03:56.3704260Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/config remote.origin.url 2024-06-26T07:03:56.3717910Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T07:03:56.3749756Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/config remote.origin.url 2024-06-26T07:03:56.3762451Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T07:03:56.3796516Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/DCGM/config remote.origin.url 2024-06-26T07:03:56.3810049Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T07:03:56.3841413Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/cpr/config remote.origin.url 2024-06-26T07:03:56.3853954Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T07:03:56.3885240Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/fmt/config remote.origin.url 2024-06-26T07:03:56.3898651Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T07:03:56.3931474Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/config remote.origin.url 2024-06-26T07:03:56.3943607Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T07:03:56.3976206Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/modules/doc/config remote.origin.url 2024-06-26T07:03:56.3989816Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T07:03:56.4023851Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/glog/config remote.origin.url 2024-06-26T07:03:56.4036516Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T07:03:56.4069263Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/googletest/config remote.origin.url 2024-06-26T07:03:56.4082737Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T07:03:56.4115544Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/json/config remote.origin.url 2024-06-26T07:03:56.4127954Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T07:03:56.4159680Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/pfs/config remote.origin.url 2024-06-26T07:03:56.4173399Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T07:03:56.4204003Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/fmt/config remote.origin.url 2024-06-26T07:03:56.4216637Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T07:03:56.4248392Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/googletest/config remote.origin.url 2024-06-26T07:03:56.4263331Z Entering 'third_party/mimalloc' 2024-06-26T07:03:56.4295349Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/mimalloc/config remote.origin.url 2024-06-26T07:03:56.4308314Z Entering 'third_party/nccl/nccl' 2024-06-26T07:03:56.4341980Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nccl/nccl/config remote.origin.url 2024-06-26T07:03:56.4355953Z Entering 'third_party/nlohmann' 2024-06-26T07:03:56.4388028Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nlohmann/config remote.origin.url 2024-06-26T07:03:56.4401698Z Entering 'third_party/onnx' 2024-06-26T07:03:56.4433854Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/config remote.origin.url 2024-06-26T07:03:56.4460412Z Entering 'third_party/onnx/third_party/benchmark' 2024-06-26T07:03:56.4494384Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/benchmark/config remote.origin.url 2024-06-26T07:03:56.4507970Z Entering 'third_party/onnx/third_party/pybind11' 2024-06-26T07:03:56.4539235Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/pybind11/config remote.origin.url 2024-06-26T07:03:56.4554050Z Entering 'third_party/opentelemetry-cpp' 2024-06-26T07:03:56.4585991Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/config remote.origin.url 2024-06-26T07:03:56.4600886Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T07:03:56.4632578Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/benchmark/config remote.origin.url 2024-06-26T07:03:56.4645404Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T07:03:56.4675412Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/googletest/config remote.origin.url 2024-06-26T07:03:56.4686654Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T07:03:56.4718910Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/ms-gsl/config remote.origin.url 2024-06-26T07:03:56.4732188Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T07:03:56.4763174Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/nlohmann-json/config remote.origin.url 2024-06-26T07:03:56.4777810Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T07:03:56.4809543Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentelemetry-proto/config remote.origin.url 2024-06-26T07:03:56.4822168Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T07:03:56.4853794Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentracing-cpp/config remote.origin.url 2024-06-26T07:03:56.4866690Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T07:03:56.4898722Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/config remote.origin.url 2024-06-26T07:03:56.4911361Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T07:03:56.4942493Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/civetweb/config remote.origin.url 2024-06-26T07:03:56.4956767Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T07:03:56.4987286Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/googletest/config remote.origin.url 2024-06-26T07:03:56.4999221Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T07:03:56.5031605Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/tools/vcpkg/config remote.origin.url 2024-06-26T07:03:56.5058776Z Entering 'third_party/pocketfft' 2024-06-26T07:03:56.5091093Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pocketfft/config remote.origin.url 2024-06-26T07:03:56.5104352Z Entering 'third_party/protobuf' 2024-06-26T07:03:56.5136980Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/config remote.origin.url 2024-06-26T07:03:56.5153134Z Entering 'third_party/protobuf/third_party/benchmark' 2024-06-26T07:03:56.5184922Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/benchmark/config remote.origin.url 2024-06-26T07:03:56.5197982Z Entering 'third_party/protobuf/third_party/googletest' 2024-06-26T07:03:56.5229983Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/googletest/config remote.origin.url 2024-06-26T07:03:56.5244715Z Entering 'third_party/psimd' 2024-06-26T07:03:56.5276587Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/psimd/config remote.origin.url 2024-06-26T07:03:56.5290022Z Entering 'third_party/pthreadpool' 2024-06-26T07:03:56.5322572Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/pthreadpool/config remote.origin.url 2024-06-26T07:03:56.5335366Z Entering 'third_party/pybind11' 2024-06-26T07:03:56.5365261Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pybind11/config remote.origin.url 2024-06-26T07:03:56.5376857Z Entering 'third_party/python-peachpy' 2024-06-26T07:03:56.5408065Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/python-peachpy/config remote.origin.url 2024-06-26T07:03:56.5421933Z Entering 'third_party/sleef' 2024-06-26T07:03:56.5454861Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/sleef/config remote.origin.url 2024-06-26T07:03:56.5467467Z Entering 'third_party/tensorpipe' 2024-06-26T07:03:56.5499574Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/config remote.origin.url 2024-06-26T07:03:56.5512326Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-06-26T07:03:56.5544235Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/googletest/config remote.origin.url 2024-06-26T07:03:56.5557959Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-06-26T07:03:56.5590235Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libnop/config remote.origin.url 2024-06-26T07:03:56.5603530Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-06-26T07:03:56.5636431Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libuv/config remote.origin.url 2024-06-26T07:03:56.5649595Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T07:03:56.5682178Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/config remote.origin.url 2024-06-26T07:03:56.5694461Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T07:03:56.5726934Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/modules/tools/clang/config remote.origin.url 2024-06-26T07:03:56.6627327Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'git@github.com:' 2024-06-26T07:03:56.6826694Z Entering 'android/libs/fbjni' 2024-06-26T07:03:56.6852924Z Entering 'third_party/FP16' 2024-06-26T07:03:56.6877999Z Entering 'third_party/FXdiv' 2024-06-26T07:03:56.6907450Z Entering 'third_party/NNPACK' 2024-06-26T07:03:56.6933222Z Entering 'third_party/VulkanMemoryAllocator' 2024-06-26T07:03:56.6960711Z Entering 'third_party/XNNPACK' 2024-06-26T07:03:56.6999850Z Entering 'third_party/benchmark' 2024-06-26T07:03:56.7027345Z Entering 'third_party/cpp-httplib' 2024-06-26T07:03:56.7055972Z Entering 'third_party/cpuinfo' 2024-06-26T07:03:56.7085309Z Entering 'third_party/cudnn_frontend' 2024-06-26T07:03:56.7113821Z Entering 'third_party/cutlass' 2024-06-26T07:03:56.7147974Z Entering 'third_party/eigen' 2024-06-26T07:03:56.7179026Z Entering 'third_party/fbgemm' 2024-06-26T07:03:56.7207446Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-06-26T07:03:56.7234893Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T07:03:56.7264643Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-06-26T07:03:56.7295180Z Entering 'third_party/fbgemm/third_party/googletest' 2024-06-26T07:03:56.7322152Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T07:03:56.7350538Z Entering 'third_party/flatbuffers' 2024-06-26T07:03:56.7378798Z Entering 'third_party/fmt' 2024-06-26T07:03:56.7407956Z Entering 'third_party/foxi' 2024-06-26T07:03:56.7435203Z Entering 'third_party/gemmlowp/gemmlowp' 2024-06-26T07:03:56.7463343Z Entering 'third_party/gloo' 2024-06-26T07:03:56.7493077Z Entering 'third_party/googletest' 2024-06-26T07:03:56.7521169Z Entering 'third_party/ideep' 2024-06-26T07:03:56.7549782Z Entering 'third_party/ideep/mkl-dnn' 2024-06-26T07:03:56.7583145Z Entering 'third_party/ittapi' 2024-06-26T07:03:56.7612661Z Entering 'third_party/kineto' 2024-06-26T07:03:56.7641334Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T07:03:56.7667341Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T07:03:56.7696754Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T07:03:56.7725277Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T07:03:56.7754942Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T07:03:56.7782557Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T07:03:56.7813160Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T07:03:56.7839846Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T07:03:56.7868204Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T07:03:56.7894426Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T07:03:56.7922463Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T07:03:56.7949150Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T07:03:56.7979280Z Entering 'third_party/mimalloc' 2024-06-26T07:03:56.8006254Z Entering 'third_party/nccl/nccl' 2024-06-26T07:03:56.8035049Z Entering 'third_party/nlohmann' 2024-06-26T07:03:56.8064719Z Entering 'third_party/onnx' 2024-06-26T07:03:56.8106513Z Entering 'third_party/onnx/third_party/benchmark' 2024-06-26T07:03:56.8135031Z Entering 'third_party/onnx/third_party/pybind11' 2024-06-26T07:03:56.8164943Z Entering 'third_party/opentelemetry-cpp' 2024-06-26T07:03:56.8194799Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T07:03:56.8223127Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T07:03:56.8251827Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T07:03:56.8279401Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T07:03:56.8307585Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T07:03:56.8335562Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T07:03:56.8362443Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T07:03:56.8388621Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T07:03:56.8418800Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T07:03:56.8447539Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T07:03:56.8492935Z Entering 'third_party/pocketfft' 2024-06-26T07:03:56.8522906Z Entering 'third_party/protobuf' 2024-06-26T07:03:56.8557435Z Entering 'third_party/protobuf/third_party/benchmark' 2024-06-26T07:03:56.8582756Z Entering 'third_party/protobuf/third_party/googletest' 2024-06-26T07:03:56.8611874Z Entering 'third_party/psimd' 2024-06-26T07:03:56.8639585Z Entering 'third_party/pthreadpool' 2024-06-26T07:03:56.8669216Z Entering 'third_party/pybind11' 2024-06-26T07:03:56.8698130Z Entering 'third_party/python-peachpy' 2024-06-26T07:03:56.8726693Z Entering 'third_party/sleef' 2024-06-26T07:03:56.8756378Z Entering 'third_party/tensorpipe' 2024-06-26T07:03:56.8783934Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-06-26T07:03:56.8812124Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-06-26T07:03:56.8838702Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-06-26T07:03:56.8865481Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T07:03:56.8891280Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T07:03:56.8932861Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'org-21003710@github.com:' 2024-06-26T07:03:56.9142567Z Entering 'android/libs/fbjni' 2024-06-26T07:03:56.9171744Z Entering 'third_party/FP16' 2024-06-26T07:03:56.9202468Z Entering 'third_party/FXdiv' 2024-06-26T07:03:56.9228742Z Entering 'third_party/NNPACK' 2024-06-26T07:03:56.9256381Z Entering 'third_party/VulkanMemoryAllocator' 2024-06-26T07:03:56.9284625Z Entering 'third_party/XNNPACK' 2024-06-26T07:03:56.9323450Z Entering 'third_party/benchmark' 2024-06-26T07:03:56.9352776Z Entering 'third_party/cpp-httplib' 2024-06-26T07:03:56.9379664Z Entering 'third_party/cpuinfo' 2024-06-26T07:03:56.9409573Z Entering 'third_party/cudnn_frontend' 2024-06-26T07:03:56.9438416Z Entering 'third_party/cutlass' 2024-06-26T07:03:56.9473440Z Entering 'third_party/eigen' 2024-06-26T07:03:56.9502597Z Entering 'third_party/fbgemm' 2024-06-26T07:03:56.9530751Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-06-26T07:03:56.9557118Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T07:03:56.9585248Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-06-26T07:03:56.9616841Z Entering 'third_party/fbgemm/third_party/googletest' 2024-06-26T07:03:56.9644739Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T07:03:56.9675057Z Entering 'third_party/flatbuffers' 2024-06-26T07:03:56.9705309Z Entering 'third_party/fmt' 2024-06-26T07:03:56.9735556Z Entering 'third_party/foxi' 2024-06-26T07:03:56.9765065Z Entering 'third_party/gemmlowp/gemmlowp' 2024-06-26T07:03:56.9795084Z Entering 'third_party/gloo' 2024-06-26T07:03:56.9822793Z Entering 'third_party/googletest' 2024-06-26T07:03:56.9849196Z Entering 'third_party/ideep' 2024-06-26T07:03:56.9876153Z Entering 'third_party/ideep/mkl-dnn' 2024-06-26T07:03:56.9910719Z Entering 'third_party/ittapi' 2024-06-26T07:03:56.9936633Z Entering 'third_party/kineto' 2024-06-26T07:03:56.9966278Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T07:03:56.9995076Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T07:03:57.0023252Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T07:03:57.0050407Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T07:03:57.0077295Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T07:03:57.0104715Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T07:03:57.0131485Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T07:03:57.0158397Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T07:03:57.0186271Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T07:03:57.0214929Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T07:03:57.0242179Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T07:03:57.0270720Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T07:03:57.0301033Z Entering 'third_party/mimalloc' 2024-06-26T07:03:57.0329418Z Entering 'third_party/nccl/nccl' 2024-06-26T07:03:57.0357745Z Entering 'third_party/nlohmann' 2024-06-26T07:03:57.0386594Z Entering 'third_party/onnx' 2024-06-26T07:03:57.0424303Z Entering 'third_party/onnx/third_party/benchmark' 2024-06-26T07:03:57.0454135Z Entering 'third_party/onnx/third_party/pybind11' 2024-06-26T07:03:57.0482818Z Entering 'third_party/opentelemetry-cpp' 2024-06-26T07:03:57.0514809Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T07:03:57.0541996Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T07:03:57.0569423Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T07:03:57.0598967Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T07:03:57.0626893Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T07:03:57.0656151Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T07:03:57.0681608Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T07:03:57.0707672Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T07:03:57.0737615Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T07:03:57.0766418Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T07:03:57.0811409Z Entering 'third_party/pocketfft' 2024-06-26T07:03:57.0838756Z Entering 'third_party/protobuf' 2024-06-26T07:03:57.0870437Z Entering 'third_party/protobuf/third_party/benchmark' 2024-06-26T07:03:57.0898491Z Entering 'third_party/protobuf/third_party/googletest' 2024-06-26T07:03:57.0929173Z Entering 'third_party/psimd' 2024-06-26T07:03:57.0956362Z Entering 'third_party/pthreadpool' 2024-06-26T07:03:57.0985627Z Entering 'third_party/pybind11' 2024-06-26T07:03:57.1016019Z Entering 'third_party/python-peachpy' 2024-06-26T07:03:57.1042439Z Entering 'third_party/sleef' 2024-06-26T07:03:57.1069223Z Entering 'third_party/tensorpipe' 2024-06-26T07:03:57.1097321Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-06-26T07:03:57.1125107Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-06-26T07:03:57.1154348Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-06-26T07:03:57.1182138Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T07:03:57.1210235Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T07:03:57.1247499Z ##[endgroup] 2024-06-26T07:03:57.1276704Z [command]/usr/bin/git log -1 --format='%H' 2024-06-26T07:03:57.1298119Z 'b8c4c54d347aa776934c60784e35936878ef18dc' 2024-06-26T07:03:57.1466206Z Prepare all required actions 2024-06-26T07:03:57.1466671Z Getting action download info 2024-06-26T07:03:57.2978419Z ##[group]Run ./.github/actions/setup-linux 2024-06-26T07:03:57.2978859Z env: 2024-06-26T07:03:57.2979146Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:03:57.2979498Z ##[endgroup] 2024-06-26T07:03:57.3039106Z ##[group]Run set -euo pipefail 2024-06-26T07:03:57.3039549Z set -euo pipefail 2024-06-26T07:03:57.3039945Z function get_ec2_metadata() { 2024-06-26T07:03:57.3040494Z  # Pulled from instance metadata endpoint for EC2 2024-06-26T07:03:57.3041406Z  # see https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/instancedata-data-retrieval.html 2024-06-26T07:03:57.3042186Z  category=$1 2024-06-26T07:03:57.3042742Z  # If it is GCP runner (runner name contains gcp), do not run this 2024-06-26T07:03:57.3043392Z  runner_name_str=i-0588e66a1f859cab2 2024-06-26T07:03:57.3043899Z  if [[ -f /.inarc ]]; then 2024-06-26T07:03:57.3044411Z  echo "ARC Runner, no info on ec2 metadata" 2024-06-26T07:03:57.3044985Z  elif [[ $runner_name_str == *"gcp"* ]]; then 2024-06-26T07:03:57.3045688Z  echo "Runner is from Google Cloud Platform, No info on ec2 metadata" 2024-06-26T07:03:57.3046304Z  else 2024-06-26T07:03:57.3046810Z  curl -fsSL "http://169.254.169.254/latest/meta-data/${category}" 2024-06-26T07:03:57.3047388Z  fi 2024-06-26T07:03:57.3047676Z } 2024-06-26T07:03:57.3048046Z echo "ami-id: $(get_ec2_metadata ami-id)" 2024-06-26T07:03:57.3048811Z echo "instance-id: $(get_ec2_metadata instance-id)" 2024-06-26T07:03:57.3049479Z echo "instance-type: $(get_ec2_metadata instance-type)" 2024-06-26T07:03:57.3050065Z echo "system info $(uname -a)" 2024-06-26T07:03:57.3057790Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:03:57.3058302Z env: 2024-06-26T07:03:57.3058585Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:03:57.3058941Z ##[endgroup] 2024-06-26T07:03:57.3126078Z ami-id: ami-0ce0c36d7a00b20e2 2024-06-26T07:03:57.3165375Z instance-id: i-0588e66a1f859cab2 2024-06-26T07:03:57.3207437Z instance-type: g5.4xlarge 2024-06-26T07:03:57.3213394Z system info Linux ip-10-0-47-211.ec2.internal 4.14.336-257.562.amzn2.x86_64 #1 SMP Sat Feb 24 09:50:35 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux 2024-06-26T07:03:57.3232674Z ##[group]Run echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> $GITHUB_OUTPUT 2024-06-26T07:03:57.3233601Z echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> $GITHUB_OUTPUT 2024-06-26T07:03:57.3241531Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:03:57.3242192Z env: 2024-06-26T07:03:57.3242484Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:03:57.3242846Z ##[endgroup] 2024-06-26T07:03:57.3303649Z ##[group]Run if systemctl is-active --quiet docker; then 2024-06-26T07:03:57.3304275Z if systemctl is-active --quiet docker; then 2024-06-26T07:03:57.3304826Z  echo "Docker daemon is running..."; 2024-06-26T07:03:57.3305289Z else 2024-06-26T07:03:57.3305788Z  echo "Starting docker deamon..." && sudo systemctl start docker; 2024-06-26T07:03:57.3306380Z fi 2024-06-26T07:03:57.3313453Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:03:57.3313956Z env: 2024-06-26T07:03:57.3314242Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:03:57.3314598Z ##[endgroup] 2024-06-26T07:03:57.3350550Z Docker daemon is running... 2024-06-26T07:03:57.3392770Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2024-06-26T07:03:57.3393340Z with: 2024-06-26T07:03:57.3393618Z shell: bash 2024-06-26T07:03:57.3393933Z timeout_minutes: 5 2024-06-26T07:03:57.3394268Z max_attempts: 3 2024-06-26T07:03:57.3394595Z retry_wait_seconds: 30 2024-06-26T07:03:57.3396151Z command: AWS_ACCOUNT_ID=$(aws sts get-caller-identity|grep Account|cut -f4 -d\") aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \ --password-stdin "$AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com" 2024-06-26T07:03:57.3397597Z polling_interval_seconds: 1 2024-06-26T07:03:57.3397988Z warning_on_retry: true 2024-06-26T07:03:57.3398356Z continue_on_error: false 2024-06-26T07:03:57.3398705Z env: 2024-06-26T07:03:57.3398983Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:03:57.3399355Z AWS_RETRY_MODE: standard 2024-06-26T07:03:57.3399720Z AWS_MAX_ATTEMPTS: 5 2024-06-26T07:03:57.3400072Z AWS_DEFAULT_REGION: us-east-1 2024-06-26T07:03:57.3400453Z ##[endgroup] 2024-06-26T07:03:58.1828421Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-06-26T07:03:58.1829312Z Configure a credential helper to remove this warning. See 2024-06-26T07:03:58.1830167Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-06-26T07:03:58.1830710Z 2024-06-26T07:03:58.1830857Z Login Succeeded 2024-06-26T07:03:58.3885021Z Command completed after 1 attempt(s). 2024-06-26T07:03:58.3924981Z ##[group]Run env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-06-26T07:03:58.3925717Z env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-06-26T07:03:58.3926379Z env | grep '^CI' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-06-26T07:03:58.3934538Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:03:58.3935040Z env: 2024-06-26T07:03:58.3935327Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:03:58.3935683Z ##[endgroup] 2024-06-26T07:03:58.3995552Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2024-06-26T07:03:58.3996342Z # ignore expansion of "docker ps -q" since it could be empty 2024-06-26T07:03:58.3996963Z # shellcheck disable=SC2046 2024-06-26T07:03:58.3997441Z docker stop $(docker ps -q) || true 2024-06-26T07:03:58.3997944Z # Prune all of the docker images 2024-06-26T07:03:58.3998409Z docker system prune -af 2024-06-26T07:03:58.4006285Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:03:58.4006800Z env: 2024-06-26T07:03:58.4007080Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:03:58.4007435Z ##[endgroup] 2024-06-26T07:03:58.4248808Z "docker stop" requires at least 1 argument. 2024-06-26T07:03:58.4249582Z See 'docker stop --help'. 2024-06-26T07:03:58.4249826Z 2024-06-26T07:03:58.4250055Z Usage: docker stop [OPTIONS] CONTAINER [CONTAINER...] 2024-06-26T07:03:58.4250441Z 2024-06-26T07:03:58.4250592Z Stop one or more running containers 2024-06-26T07:03:58.4401476Z Total reclaimed space: 0B 2024-06-26T07:03:58.4431377Z ##[group]Run set +e 2024-06-26T07:03:58.4431741Z set +e 2024-06-26T07:03:58.4432175Z set -x 2024-06-26T07:03:58.4432470Z  2024-06-26T07:03:58.4432819Z PT_DOMAIN=download.pytorch.org 2024-06-26T07:03:58.4433654Z # TODO: Flaky access to download.pytorch.org https://github.com/pytorch/pytorch/issues/100400, 2024-06-26T07:03:58.4434747Z # cleaning this up once the issue is fixed. There are more than one resolved IP here, the last 2024-06-26T07:03:58.4435502Z # one is returned at random 2024-06-26T07:03:58.4436052Z RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" | tail -n1) 2024-06-26T07:03:58.4436561Z  2024-06-26T07:03:58.4436880Z if [ -z "${RESOLVED_IP}" ]; then 2024-06-26T07:03:58.4437504Z  echo "Couldn't resolve ${PT_DOMAIN}, retrying with Google DNS..." 2024-06-26T07:03:58.4438274Z  RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" @8.8.8.8 | tail -n1) 2024-06-26T07:03:58.4438825Z  2024-06-26T07:03:58.4439153Z  if [ -z "${RESOLVED_IP}" ]; then 2024-06-26T07:03:58.4439720Z  echo "Couldn't resolve ${PT_DOMAIN}, exiting..." 2024-06-26T07:03:58.4440240Z  exit 1 2024-06-26T07:03:58.4440551Z  fi 2024-06-26T07:03:58.4440841Z fi 2024-06-26T07:03:58.4441219Z  2024-06-26T07:03:58.4441588Z if grep -r "${PT_DOMAIN}" /etc/hosts; then 2024-06-26T07:03:58.4442107Z  # Clean up any old records first 2024-06-26T07:03:58.4442621Z  sudo sed -i "/${PT_DOMAIN}/d" /etc/hosts 2024-06-26T07:03:58.4443081Z fi 2024-06-26T07:03:58.4443354Z  2024-06-26T07:03:58.4443787Z echo "${RESOLVED_IP} ${PT_DOMAIN}" | sudo tee -a /etc/hosts 2024-06-26T07:03:58.4444337Z cat /etc/hosts 2024-06-26T07:03:58.4452695Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:03:58.4453194Z env: 2024-06-26T07:03:58.4453481Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:03:58.4453836Z ##[endgroup] 2024-06-26T07:03:58.4474224Z + PT_DOMAIN=download.pytorch.org 2024-06-26T07:03:58.4477961Z ++ dig -4 +short download.pytorch.org 2024-06-26T07:03:58.4478406Z ++ tail -n1 2024-06-26T07:03:58.4582294Z + RESOLVED_IP=18.160.10.22 2024-06-26T07:03:58.4582854Z + '[' -z 18.160.10.22 ']' 2024-06-26T07:03:58.4583324Z + grep -r download.pytorch.org /etc/hosts 2024-06-26T07:03:58.4588717Z 18.160.10.28 download.pytorch.org 2024-06-26T07:03:58.4589369Z + sudo sed -i /download.pytorch.org/d /etc/hosts 2024-06-26T07:03:58.4682625Z + echo '18.160.10.22 download.pytorch.org' 2024-06-26T07:03:58.4683219Z + sudo tee -a /etc/hosts 2024-06-26T07:03:58.4925666Z 18.160.10.22 download.pytorch.org 2024-06-26T07:03:58.4938641Z + cat /etc/hosts 2024-06-26T07:03:58.4943144Z 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 2024-06-26T07:03:58.4957109Z ::1 localhost6 localhost6.localdomain6 2024-06-26T07:03:58.4957621Z 18.160.10.22 download.pytorch.org 2024-06-26T07:03:58.5143869Z ##[group]Run pytorch/test-infra/.github/actions/calculate-docker-image@main 2024-06-26T07:03:58.5144498Z with: 2024-06-26T07:03:58.5145597Z docker-image-name: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:03:58.5146820Z docker-build-dir: .ci/docker 2024-06-26T07:03:58.5147197Z working-directory: . 2024-06-26T07:03:58.5147662Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:03:58.5148187Z force-push: false 2024-06-26T07:03:58.5148479Z env: 2024-06-26T07:03:58.5148748Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:03:58.5149087Z ##[endgroup] 2024-06-26T07:03:58.5166627Z ##[group]Run set -ex 2024-06-26T07:03:58.5166981Z set -ex 2024-06-26T07:03:58.5167275Z  2024-06-26T07:03:58.5167834Z # If the docker build directory or the build script doesn't exist, the action will 2024-06-26T07:03:58.5169073Z # gracefully return the docker image name as it is. Pulling docker image in Linux 2024-06-26T07:03:58.5170036Z # job could then download the pre-built image as usual 2024-06-26T07:03:58.5170785Z if [[ ! -d "${DOCKER_BUILD_DIR}" ]] || [[ ! -f "${DOCKER_BUILD_DIR}/build.sh" ]]; then 2024-06-26T07:03:58.5171458Z  echo "skip=true" >> "${GITHUB_OUTPUT}" 2024-06-26T07:03:58.5172101Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2024-06-26T07:03:58.5172670Z  2024-06-26T07:03:58.5173184Z  echo "There is no Docker build script in ${REPO_NAME} repo, skipping..." 2024-06-26T07:03:58.5173809Z  exit 0 2024-06-26T07:03:58.5174109Z else 2024-06-26T07:03:58.5174479Z  echo "skip=false" >> "${GITHUB_OUTPUT}" 2024-06-26T07:03:58.5174928Z fi 2024-06-26T07:03:58.5175209Z  2024-06-26T07:03:58.5175683Z if [[ "${DOCKER_IMAGE_NAME}" == *"${DOCKER_REGISTRY}/${REPO_NAME}"* ]]; then 2024-06-26T07:03:58.5176542Z  # The docker image name already includes the ECR prefix and tag, so we can just 2024-06-26T07:03:58.5177338Z  # use it as it is, but first let's extract the tag 2024-06-26T07:03:58.5178061Z  DOCKER_TAG=$(echo "${DOCKER_IMAGE_NAME}" | awk -F '[:,]' '{print $2}') 2024-06-26T07:03:58.5178797Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-06-26T07:03:58.5179500Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2024-06-26T07:03:58.5180056Z else 2024-06-26T07:03:58.5180618Z  DOCKER_TAG=$(git rev-parse HEAD:"${DOCKER_BUILD_DIR}") 2024-06-26T07:03:58.5181288Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-06-26T07:03:58.5182196Z  echo "docker-image=${DOCKER_REGISTRY}/${REPO_NAME}/${DOCKER_IMAGE_NAME}:${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-06-26T07:03:58.5182945Z fi 2024-06-26T07:03:58.5190597Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:03:58.5191109Z env: 2024-06-26T07:03:58.5191397Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:03:58.5191744Z REPO_NAME: pytorch 2024-06-26T07:03:58.5192892Z DOCKER_IMAGE_NAME: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:03:58.5194103Z DOCKER_BUILD_DIR: .ci/docker 2024-06-26T07:03:58.5194600Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:03:58.5195117Z ##[endgroup] 2024-06-26T07:03:58.5217089Z + [[ ! -d .ci/docker ]] 2024-06-26T07:03:58.5217535Z + [[ ! -f .ci/docker/build.sh ]] 2024-06-26T07:03:58.5217926Z + echo skip=false 2024-06-26T07:03:58.5219920Z + [[ 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 == *\3\0\8\5\3\5\3\8\5\1\1\4\.\d\k\r\.\e\c\r\.\u\s\-\e\a\s\t\-\1\.\a\m\a\z\o\n\a\w\s\.\c\o\m\/\p\y\t\o\r\c\h* ]] 2024-06-26T07:03:58.5222625Z ++ echo 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:03:58.5223845Z ++ awk -F '[:,]' '{print $2}' 2024-06-26T07:03:58.5229343Z + DOCKER_TAG=91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:03:58.5230002Z + echo docker-tag=91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:03:58.5231730Z + echo docker-image=308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:03:58.5258526Z ##[group]Run set +e 2024-06-26T07:03:58.5258897Z set +e 2024-06-26T07:03:58.5259204Z set -x 2024-06-26T07:03:58.5259493Z  2024-06-26T07:03:58.5259776Z login() { 2024-06-26T07:03:58.5260589Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2024-06-26T07:03:58.5261310Z } 2024-06-26T07:03:58.5261584Z  2024-06-26T07:03:58.5261971Z retry () { 2024-06-26T07:03:58.5262368Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2024-06-26T07:03:58.5262824Z } 2024-06-26T07:03:58.5263096Z  2024-06-26T07:03:58.5263417Z retry login "${DOCKER_REGISTRY}" 2024-06-26T07:03:58.5263844Z  2024-06-26T07:03:58.5264319Z # Check if image already exists, if it does then skip building it 2024-06-26T07:03:58.5265035Z if docker manifest inspect "${DOCKER_IMAGE}"; then 2024-06-26T07:03:58.5265545Z  exit 0 2024-06-26T07:03:58.5265851Z fi 2024-06-26T07:03:58.5266124Z  2024-06-26T07:03:58.5266635Z # NB: This part requires a full checkout. Otherwise, the merge base will 2024-06-26T07:03:58.5267476Z # be empty. The default action would be to continue rebuild the image 2024-06-26T07:03:58.5268228Z if [[ "$BASE_REVISION" = "$(git rev-parse HEAD)" ]]; then 2024-06-26T07:03:58.5268906Z  # if we're on the base branch then use the parent commit 2024-06-26T07:03:58.5269520Z  MERGE_BASE=$(git rev-parse HEAD~) 2024-06-26T07:03:58.5269956Z else 2024-06-26T07:03:58.5270435Z  # otherwise we're on a PR, so use the most recent base commit 2024-06-26T07:03:58.5271127Z  MERGE_BASE=$(git merge-base HEAD "$BASE_REVISION") 2024-06-26T07:03:58.5271640Z fi 2024-06-26T07:03:58.5271929Z  2024-06-26T07:03:58.5272251Z if [[ -z "${MERGE_BASE}" ]]; then 2024-06-26T07:03:58.5272775Z  echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2024-06-26T07:03:58.5273266Z  2024-06-26T07:03:58.5273931Z  echo "Finding merge base only works with full checkout, please set fetch-depth to 0, continuing ..." 2024-06-26T07:03:58.5274695Z  exit 0 2024-06-26T07:03:58.5274996Z fi 2024-06-26T07:03:58.5275277Z  2024-06-26T07:03:58.5275722Z if ! git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}"; then 2024-06-26T07:03:58.5276710Z  echo "Directory '${DOCKER_BUILD_DIR}' not found in commit $MERGE_BASE, you should rebase onto a more recent commit" 2024-06-26T07:03:58.5277513Z  exit 1 2024-06-26T07:03:58.5277822Z fi 2024-06-26T07:03:58.5278107Z  2024-06-26T07:03:58.5278603Z PREVIOUS_DOCKER_TAG=$(git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}") 2024-06-26T07:03:58.5279552Z # If no image exists but the hash is the same as the previous hash then we should error out here 2024-06-26T07:03:58.5280432Z if [[ "${PREVIOUS_DOCKER_TAG}" == "${DOCKER_TAG}" ]]; then 2024-06-26T07:03:58.5281405Z  echo "WARNING: Something has gone wrong and the previous image isn't available for the merge-base of your branch" 2024-06-26T07:03:58.5282514Z  echo " Will re-build docker image to store in local cache, TTS may be longer" 2024-06-26T07:03:58.5283258Z fi 2024-06-26T07:03:58.5283540Z  2024-06-26T07:03:58.5283915Z echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2024-06-26T07:03:58.5291824Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:03:58.5292333Z env: 2024-06-26T07:03:58.5292610Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:03:58.5292981Z DOCKER_BUILD_DIR: .ci/docker 2024-06-26T07:03:58.5293456Z BASE_REVISION: b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:03:58.5294735Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:03:58.5295979Z DOCKER_TAG: 91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:03:58.5296582Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:03:58.5297104Z ##[endgroup] 2024-06-26T07:03:58.5316439Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:03:58.5317118Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:03:58.5318064Z + aws ecr get-login-password --region us-east-1 2024-06-26T07:03:58.5318966Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:03:58.9378816Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-06-26T07:03:58.9379715Z Configure a credential helper to remove this warning. See 2024-06-26T07:03:58.9380868Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-06-26T07:03:58.9381449Z 2024-06-26T07:03:58.9381575Z Login Succeeded 2024-06-26T07:03:58.9391275Z + docker manifest inspect 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:03:59.1422015Z { 2024-06-26T07:03:59.1422458Z "schemaVersion": 2, 2024-06-26T07:03:59.1423201Z "mediaType": "application/vnd.docker.distribution.manifest.v2+json", 2024-06-26T07:03:59.1423947Z "config": { 2024-06-26T07:03:59.1424555Z "mediaType": "application/vnd.docker.container.image.v1+json", 2024-06-26T07:03:59.1425305Z "size": 48681, 2024-06-26T07:03:59.1425855Z "digest": "sha256:0058b15e517a024817bccd921dc9af264c964f500b3cb9b3f4649a8ac22cc2dd" 2024-06-26T07:03:59.1426487Z }, 2024-06-26T07:03:59.1426755Z "layers": [ 2024-06-26T07:03:59.1427034Z { 2024-06-26T07:03:59.1427475Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1428053Z "size": 28580681, 2024-06-26T07:03:59.1433412Z "digest": "sha256:7a2c559011895d255fce249c00396abff5ae7e0c0a92931d0ed493e71de78e3a" 2024-06-26T07:03:59.1434254Z + exit 0 2024-06-26T07:03:59.1434532Z }, 2024-06-26T07:03:59.1434871Z { 2024-06-26T07:03:59.1435466Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1436149Z "size": 7943451, 2024-06-26T07:03:59.1436729Z "digest": "sha256:224fe954d7252f10539d243d6c9688806f7d13ad775ed02e7f7c79077844510d" 2024-06-26T07:03:59.1437391Z }, 2024-06-26T07:03:59.1437645Z { 2024-06-26T07:03:59.1438166Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1438940Z "size": 55728572, 2024-06-26T07:03:59.1439687Z "digest": "sha256:75722010b82e31715876aeeed0b2cee414296f0124fdfa061ab845ba2a158450" 2024-06-26T07:03:59.1440368Z }, 2024-06-26T07:03:59.1440634Z { 2024-06-26T07:03:59.1441210Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1442015Z "size": 186, 2024-06-26T07:03:59.1442781Z "digest": "sha256:d527cbbb87e3016fd72a18a9b468c945ad0ca27c5770b39debd6ed704db3a195" 2024-06-26T07:03:59.1443635Z }, 2024-06-26T07:03:59.1443968Z { 2024-06-26T07:03:59.1444567Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1445332Z "size": 6886, 2024-06-26T07:03:59.1446066Z "digest": "sha256:b57676e46aee1a8c82e528d78e5a13e31142524eea31c8b213d69ddcb6f1fe80" 2024-06-26T07:03:59.1447044Z }, 2024-06-26T07:03:59.1447303Z { 2024-06-26T07:03:59.1447748Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1448316Z "size": 1329001756, 2024-06-26T07:03:59.1449172Z "digest": "sha256:a8c1e85b5e14cec7af70bf304cb4d4cee6a1d25eb8215b2cf4fdc33e5af5e108" 2024-06-26T07:03:59.1449820Z }, 2024-06-26T07:03:59.1450072Z { 2024-06-26T07:03:59.1450501Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1451065Z "size": 62501, 2024-06-26T07:03:59.1451623Z "digest": "sha256:a41a8d1c11c8d80fe4e82b0d05478f8d51176ff20b8350905fc1b25c93a51198" 2024-06-26T07:03:59.1452405Z }, 2024-06-26T07:03:59.1452744Z { 2024-06-26T07:03:59.1453379Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1454125Z "size": 1684, 2024-06-26T07:03:59.1454833Z "digest": "sha256:0c12278907551c2962927d27c115f6f7bf0df894318b8aea6ece3ef01ccd0a8a" 2024-06-26T07:03:59.1455636Z }, 2024-06-26T07:03:59.1455984Z { 2024-06-26T07:03:59.1456575Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1457327Z "size": 1523, 2024-06-26T07:03:59.1457898Z "digest": "sha256:d8d1234baab3ec9ccb8bb710fc6b8ff6c10896ba2e8d27a347583eca770f9ff1" 2024-06-26T07:03:59.1458540Z }, 2024-06-26T07:03:59.1458790Z { 2024-06-26T07:03:59.1459229Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1459801Z "size": 2528295403, 2024-06-26T07:03:59.1460605Z "digest": "sha256:7ed32bc8e4696fcdb2feef850781160597b2275ad756819c4add88236b0577d5" 2024-06-26T07:03:59.1461441Z }, 2024-06-26T07:03:59.1461765Z { 2024-06-26T07:03:59.1462335Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1463145Z "size": 86016, 2024-06-26T07:03:59.1463774Z "digest": "sha256:ec1e7978c1fe161ced1d98092a51e7c5953ca5fda5577f54df9dbda4afff1b2b" 2024-06-26T07:03:59.1464455Z }, 2024-06-26T07:03:59.1464710Z { 2024-06-26T07:03:59.1465156Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1465727Z "size": 1823, 2024-06-26T07:03:59.1466351Z "digest": "sha256:309b872da805fcdf74137a887464876fa0615dc8b24199307119eb65fc2bfb49" 2024-06-26T07:03:59.1466969Z }, 2024-06-26T07:03:59.1467218Z { 2024-06-26T07:03:59.1467659Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1468224Z "size": 246737542, 2024-06-26T07:03:59.1468792Z "digest": "sha256:e82932cb002c06a782077b8e5965f8733eb8563406a23cab260d9d8c4a994f7d" 2024-06-26T07:03:59.1469402Z }, 2024-06-26T07:03:59.1469646Z { 2024-06-26T07:03:59.1470088Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1470643Z "size": 545, 2024-06-26T07:03:59.1471202Z "digest": "sha256:ca9dd73e3e9378225ebdcfd12199ef44649e34fe55003cfbc8afe2e8a4527c5b" 2024-06-26T07:03:59.1471828Z }, 2024-06-26T07:03:59.1472078Z { 2024-06-26T07:03:59.1472520Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1473078Z "size": 1283, 2024-06-26T07:03:59.1473611Z "digest": "sha256:16d76a79d5d6616e228537785ec83a869f68a402520bbc6e826201621ca6cb98" 2024-06-26T07:03:59.1474217Z }, 2024-06-26T07:03:59.1474468Z { 2024-06-26T07:03:59.1474912Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1475463Z "size": 485, 2024-06-26T07:03:59.1476021Z "digest": "sha256:4bdf41c9ecbe1651e0986ccbea4663a0556af27b7145a679cfa45c35dc96b891" 2024-06-26T07:03:59.1476654Z }, 2024-06-26T07:03:59.1476900Z { 2024-06-26T07:03:59.1477339Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1477900Z "size": 91710937, 2024-06-26T07:03:59.1478477Z "digest": "sha256:f4863801e30cdbcd1d4e6cb1cbbcde7dbcaf6ae317ca80429295741ce60ac31d" 2024-06-26T07:03:59.1479106Z }, 2024-06-26T07:03:59.1479362Z { 2024-06-26T07:03:59.1479800Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1480467Z "size": 3233, 2024-06-26T07:03:59.1481023Z "digest": "sha256:d37dd9ed8948a0d02e1198bbedadbca36477a0980dd553196385aab0c025581d" 2024-06-26T07:03:59.1481656Z }, 2024-06-26T07:03:59.1481908Z { 2024-06-26T07:03:59.1482339Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1482897Z "size": 1905, 2024-06-26T07:03:59.1483492Z "digest": "sha256:cf2f34f225dbed17c1a9a8b9ea4ad030aba797774a716dc0a82fe212324aa751" 2024-06-26T07:03:59.1484142Z }, 2024-06-26T07:03:59.1484387Z { 2024-06-26T07:03:59.1484828Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1485389Z "size": 702, 2024-06-26T07:03:59.1485939Z "digest": "sha256:df546d7b3e34396a6f2b51d8c88be976eca017bc99168d838c2c7bacabab9ec4" 2024-06-26T07:03:59.1486711Z }, 2024-06-26T07:03:59.1487061Z { 2024-06-26T07:03:59.1487623Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1488382Z "size": 2784789002, 2024-06-26T07:03:59.1489446Z "digest": "sha256:3d914950f8addfc4d657a2365c76e1143eb80b710cd3f6e9ae05640217fc6347" 2024-06-26T07:03:59.1490549Z }, 2024-06-26T07:03:59.1490918Z { 2024-06-26T07:03:59.1491522Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1492273Z "size": 381, 2024-06-26T07:03:59.1492967Z "digest": "sha256:96d0e2032184c57e62a652aaffcf0241f0d0c7a23e894ca0ad192c4a64a36583" 2024-06-26T07:03:59.1493802Z }, 2024-06-26T07:03:59.1494144Z { 2024-06-26T07:03:59.1494683Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1495250Z "size": 11879, 2024-06-26T07:03:59.1495799Z "digest": "sha256:06e12ce59790cb8b091e5d619c2a62a28329008ee184a8b9a562e3db12471f30" 2024-06-26T07:03:59.1496410Z }, 2024-06-26T07:03:59.1496656Z { 2024-06-26T07:03:59.1497098Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1497663Z "size": 803, 2024-06-26T07:03:59.1498227Z "digest": "sha256:ed712f63cde7070bdec2a6179c4c35e752c6991ddbc69fe9f2724a9903250ceb" 2024-06-26T07:03:59.1498855Z }, 2024-06-26T07:03:59.1499108Z { 2024-06-26T07:03:59.1499550Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1500118Z "size": 106, 2024-06-26T07:03:59.1500743Z "digest": "sha256:a97a71ef8a4e66234dfc2098834f8395ac5630240e60164d1a251fdb0115ba85" 2024-06-26T07:03:59.1501359Z }, 2024-06-26T07:03:59.1501613Z { 2024-06-26T07:03:59.1502047Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1502608Z "size": 503, 2024-06-26T07:03:59.1503204Z "digest": "sha256:25cd0c482ad612f936b35b4f220c580e16be982226aac8801a6a849a6bfdc221" 2024-06-26T07:03:59.1503827Z }, 2024-06-26T07:03:59.1504071Z { 2024-06-26T07:03:59.1504514Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1505078Z "size": 121477177, 2024-06-26T07:03:59.1505655Z "digest": "sha256:9bf94bc456584365fda21d0ed83b7cc690b08a71727b71c4c1e667e15028a386" 2024-06-26T07:03:59.1506264Z }, 2024-06-26T07:03:59.1506520Z { 2024-06-26T07:03:59.1506965Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1507531Z "size": 109, 2024-06-26T07:03:59.1508081Z "digest": "sha256:de45a14c9b227e4b0c9d45d42223b50a71c03522ddd9e2ca0d9517835206c823" 2024-06-26T07:03:59.1508700Z }, 2024-06-26T07:03:59.1508953Z { 2024-06-26T07:03:59.1509388Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1509950Z "size": 491, 2024-06-26T07:03:59.1510494Z "digest": "sha256:e99241e77209b0b35a0fb59a61c0821fc161190178af7e4af45e6eeaa043375e" 2024-06-26T07:03:59.1511118Z }, 2024-06-26T07:03:59.1511360Z { 2024-06-26T07:03:59.1511800Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1512361Z "size": 291, 2024-06-26T07:03:59.1512924Z "digest": "sha256:35e8f4e2a42f9df0c969dedd2199cf71719cf5ecfa676dfa014bbdeb4fdb295f" 2024-06-26T07:03:59.1513685Z }, 2024-06-26T07:03:59.1513941Z { 2024-06-26T07:03:59.1514392Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1514948Z "size": 101, 2024-06-26T07:03:59.1515491Z "digest": "sha256:a823ffa4c541394b52953391dc0a6867e26c37fe4a71fa022a2cc3f07f0ba70d" 2024-06-26T07:03:59.1516110Z }, 2024-06-26T07:03:59.1516366Z { 2024-06-26T07:03:59.1516801Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1517365Z "size": 1473, 2024-06-26T07:03:59.1517902Z "digest": "sha256:44ba272eae2064603605a6238b3f35cc6578859d660068e702a047a9cd8ab2fd" 2024-06-26T07:03:59.1518508Z }, 2024-06-26T07:03:59.1518751Z { 2024-06-26T07:03:59.1519192Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1519757Z "size": 446710781, 2024-06-26T07:03:59.1520318Z "digest": "sha256:da02d278e5240c285bc855ce4e42cd6121d5b903787f5c14f03e575ad1268650" 2024-06-26T07:03:59.1520937Z }, 2024-06-26T07:03:59.1521196Z { 2024-06-26T07:03:59.1521639Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1522269Z "size": 161, 2024-06-26T07:03:59.1522800Z "digest": "sha256:73a0ce681c295135456e190578733273276b38b4dd5babbb39298f384d43b1c6" 2024-06-26T07:03:59.1523406Z }, 2024-06-26T07:03:59.1523695Z { 2024-06-26T07:03:59.1524146Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1524706Z "size": 564, 2024-06-26T07:03:59.1525258Z "digest": "sha256:49737bd5ae709dbf7956e21fc8b05ba009e9e6c9b130b0126a73bd3d3f5efc78" 2024-06-26T07:03:59.1525886Z }, 2024-06-26T07:03:59.1526133Z { 2024-06-26T07:03:59.1526575Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1527140Z "size": 35874600, 2024-06-26T07:03:59.1527700Z "digest": "sha256:9cd4c745f8e4f9d5c9bb8050923575afad21f5b7852975a4a1981bc9eff282c5" 2024-06-26T07:03:59.1528323Z }, 2024-06-26T07:03:59.1528757Z { 2024-06-26T07:03:59.1529237Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1529797Z "size": 104, 2024-06-26T07:03:59.1530325Z "digest": "sha256:b2950a0365345d4c17a48627c905fd8930b3b3154c727f0526eb9ca547102bb7" 2024-06-26T07:03:59.1530929Z }, 2024-06-26T07:03:59.1531180Z { 2024-06-26T07:03:59.1531610Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1532168Z "size": 425, 2024-06-26T07:03:59.1532708Z "digest": "sha256:25e19d81d9fc081962ff4cbc09e098f4035419822712c19a410f5282300dfb9e" 2024-06-26T07:03:59.1533317Z }, 2024-06-26T07:03:59.1533564Z { 2024-06-26T07:03:59.1534052Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1534617Z "size": 20262084, 2024-06-26T07:03:59.1535190Z "digest": "sha256:60156b40fcbec2c25f0170b0a82fa8cd9303e0daae8bb1811fd0fc6562e88e8e" 2024-06-26T07:03:59.1535820Z }, 2024-06-26T07:03:59.1536072Z { 2024-06-26T07:03:59.1536518Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1537072Z "size": 439, 2024-06-26T07:03:59.1537610Z "digest": "sha256:7a868239227fd19b30a19927bbc8f058d247403fe5b343c55f4b4b8987918911" 2024-06-26T07:03:59.1538218Z }, 2024-06-26T07:03:59.1538468Z { 2024-06-26T07:03:59.1538900Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1539458Z "size": 702, 2024-06-26T07:03:59.1540006Z "digest": "sha256:df546d7b3e34396a6f2b51d8c88be976eca017bc99168d838c2c7bacabab9ec4" 2024-06-26T07:03:59.1540682Z }, 2024-06-26T07:03:59.1540934Z { 2024-06-26T07:03:59.1541371Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1541933Z "size": 143, 2024-06-26T07:03:59.1542460Z "digest": "sha256:83911d7c7ecf11b5932bb7449975c52e7f737a5b867691935e1ccb85ceb25b52" 2024-06-26T07:03:59.1543085Z }, 2024-06-26T07:03:59.1543336Z { 2024-06-26T07:03:59.1543777Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1544438Z "size": 135, 2024-06-26T07:03:59.1544996Z "digest": "sha256:b3c5d66c679f58c71febdd502889bd8cd3d36e5001754cdf1e30eabe21135cce" 2024-06-26T07:03:59.1545633Z }, 2024-06-26T07:03:59.1545878Z { 2024-06-26T07:03:59.1546319Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1546893Z "size": 4911495247, 2024-06-26T07:03:59.1547450Z "digest": "sha256:84b2c7a899820f6acdb22148c5e8346d8b26c33269fd01842c9573515251e1e1" 2024-06-26T07:03:59.1548053Z }, 2024-06-26T07:03:59.1548304Z { 2024-06-26T07:03:59.1548750Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1549311Z "size": 190, 2024-06-26T07:03:59.1549862Z "digest": "sha256:c1068d03a811d8dead5da9e82fdc8869205fc4ee9cb92d4f7a4acfbb5ba83950" 2024-06-26T07:03:59.1550489Z }, 2024-06-26T07:03:59.1550740Z { 2024-06-26T07:03:59.1551176Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1551725Z "size": 565, 2024-06-26T07:03:59.1552267Z "digest": "sha256:671b4a301d81074fca17d36851f81801552c4ecb2f90ff3412aa9ab6a1a91371" 2024-06-26T07:03:59.1552955Z }, 2024-06-26T07:03:59.1553198Z { 2024-06-26T07:03:59.1553636Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1554206Z "size": 43163095, 2024-06-26T07:03:59.1554778Z "digest": "sha256:67760cf5ec46ab58d3ca98637fd9b26cb47a67446bfd0db176fe5e023606aa0d" 2024-06-26T07:03:59.1555394Z }, 2024-06-26T07:03:59.1555646Z { 2024-06-26T07:03:59.1556085Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1556641Z "size": 106, 2024-06-26T07:03:59.1557180Z "digest": "sha256:ddc9740bcea2b301e99b50525059aea8d9c7121a1c8eab566561a8968438a8c2" 2024-06-26T07:03:59.1557796Z }, 2024-06-26T07:03:59.1558043Z { 2024-06-26T07:03:59.1558475Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1559053Z "size": 1213, 2024-06-26T07:03:59.1559602Z "digest": "sha256:fb2e977685609fcc01de170ba7f50a573e73e6520e47253717e92a28952c5ee8" 2024-06-26T07:03:59.1560222Z }, 2024-06-26T07:03:59.1560465Z { 2024-06-26T07:03:59.1560906Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1561461Z "size": 702, 2024-06-26T07:03:59.1562005Z "digest": "sha256:df546d7b3e34396a6f2b51d8c88be976eca017bc99168d838c2c7bacabab9ec4" 2024-06-26T07:03:59.1562625Z }, 2024-06-26T07:03:59.1562878Z { 2024-06-26T07:03:59.1563365Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1563920Z "size": 138, 2024-06-26T07:03:59.1564468Z "digest": "sha256:b599c5a8c7cb461cbd7b3c98b99960b8eb04506e05e79db1cc0cfadb14a47e91" 2024-06-26T07:03:59.1565101Z }, 2024-06-26T07:03:59.1565353Z { 2024-06-26T07:03:59.1565783Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1566340Z "size": 120, 2024-06-26T07:03:59.1566897Z "digest": "sha256:e08e88c1366827455ee7ddbf92b6ae615ceb3cbd3fb11cd03ddd31bd3fa94a9c" 2024-06-26T07:03:59.1567520Z }, 2024-06-26T07:03:59.1567764Z { 2024-06-26T07:03:59.1568212Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1568950Z "size": 1904157495, 2024-06-26T07:03:59.1569531Z "digest": "sha256:12ba7431ff38de8cf6af3052a2a52e79f4e712b8c99f5bafde3c20e63b1f570f" 2024-06-26T07:03:59.1570145Z }, 2024-06-26T07:03:59.1570402Z { 2024-06-26T07:03:59.1570841Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1571402Z "size": 172, 2024-06-26T07:03:59.1571946Z "digest": "sha256:cf7c2cb896cba6a594028cc0fd246e127a2f4481d48905a3aa12c5f5872332d4" 2024-06-26T07:03:59.1572572Z }, 2024-06-26T07:03:59.1572825Z { 2024-06-26T07:03:59.1573303Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1573861Z "size": 908, 2024-06-26T07:03:59.1574419Z "digest": "sha256:3a778ddfac2af5b3a11f49ddf2f3f1ad1731f74ba691f434ab69966d1e2a189f" 2024-06-26T07:03:59.1575149Z }, 2024-06-26T07:03:59.1575397Z { 2024-06-26T07:03:59.1575835Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1576402Z "size": 702, 2024-06-26T07:03:59.1576951Z "digest": "sha256:df546d7b3e34396a6f2b51d8c88be976eca017bc99168d838c2c7bacabab9ec4" 2024-06-26T07:03:59.1577567Z }, 2024-06-26T07:03:59.1577818Z { 2024-06-26T07:03:59.1578260Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1578807Z "size": 134, 2024-06-26T07:03:59.1579346Z "digest": "sha256:236c8f0245f4b40616a4322eaf1e1b3e178d5990db1fcaba39622ea4e79c06a1" 2024-06-26T07:03:59.1579964Z }, 2024-06-26T07:03:59.1580288Z { 2024-06-26T07:03:59.1580722Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1581284Z "size": 32, 2024-06-26T07:03:59.1581830Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-06-26T07:03:59.1582449Z }, 2024-06-26T07:03:59.1582699Z { 2024-06-26T07:03:59.1583137Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1583783Z "size": 156, 2024-06-26T07:03:59.1584338Z "digest": "sha256:dda1ce302b9a9df0c8f1145d2e3eaa03c96909bb45a792451f1fcb555b06738d" 2024-06-26T07:03:59.1584961Z }, 2024-06-26T07:03:59.1585215Z { 2024-06-26T07:03:59.1585657Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1586211Z "size": 1841, 2024-06-26T07:03:59.1586766Z "digest": "sha256:e797fe86caef19319e03f8dca92cf96838ab3bb3644f4447c6dfc04230118afa" 2024-06-26T07:03:59.1587390Z }, 2024-06-26T07:03:59.1587647Z { 2024-06-26T07:03:59.1588077Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1588635Z "size": 7529784, 2024-06-26T07:03:59.1589202Z "digest": "sha256:967190076fc0ab2bb2fc0d74e58edd3d662a537d702ff3f8b6e876230154a16f" 2024-06-26T07:03:59.1589820Z }, 2024-06-26T07:03:59.1590060Z { 2024-06-26T07:03:59.1590511Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1591078Z "size": 165, 2024-06-26T07:03:59.1591618Z "digest": "sha256:4fb0a83f06855534ef82b80dcf7c685303edb2bcbd446196066dc2ad2dd71281" 2024-06-26T07:03:59.1592245Z }, 2024-06-26T07:03:59.1592495Z { 2024-06-26T07:03:59.1592933Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1593491Z "size": 7944, 2024-06-26T07:03:59.1594047Z "digest": "sha256:68af2ec4e30a33f26947ece9f3a31b7d3b04c2bca5865d4b48618457832a1da2" 2024-06-26T07:03:59.1594674Z }, 2024-06-26T07:03:59.1594924Z { 2024-06-26T07:03:59.1595354Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1595912Z "size": 8070, 2024-06-26T07:03:59.1596457Z "digest": "sha256:cc91933e985a044c6df53caa15488d2285896f5e991f38ec068c253ceec53f14" 2024-06-26T07:03:59.1597069Z }, 2024-06-26T07:03:59.1597310Z { 2024-06-26T07:03:59.1597753Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1598311Z "size": 303, 2024-06-26T07:03:59.1598855Z "digest": "sha256:9f3187916e7dcad33cc572f8f0e949d2f507b887f99cfd6acefd14826b44960d" 2024-06-26T07:03:59.1599479Z }, 2024-06-26T07:03:59.1599727Z { 2024-06-26T07:03:59.1600170Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1600722Z "size": 7629071, 2024-06-26T07:03:59.1601255Z "digest": "sha256:52608399485738d10d779254946c9e1d536010dd45593c69bf1eb9f62f85dc24" 2024-06-26T07:03:59.1601857Z }, 2024-06-26T07:03:59.1602109Z { 2024-06-26T07:03:59.1602541Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1603103Z "size": 108, 2024-06-26T07:03:59.1603653Z "digest": "sha256:05a6f6dcc1c00bac6660923a22adc7d7c34416718f8c89daf9b3351d9365f694" 2024-06-26T07:03:59.1604328Z }, 2024-06-26T07:03:59.1604572Z { 2024-06-26T07:03:59.1605011Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1605631Z "size": 54145775, 2024-06-26T07:03:59.1606193Z "digest": "sha256:6bc9dc8315b09b27c976bfba9700767ba412d72fd0528b18bbe8f8e62005ec22" 2024-06-26T07:03:59.1606821Z }, 2024-06-26T07:03:59.1607072Z { 2024-06-26T07:03:59.1607506Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1608058Z "size": 474, 2024-06-26T07:03:59.1608752Z "digest": "sha256:1b0e27c35f07b3fbf0aeb548d1949bf1d60a420136da21789d94d196c891d981" 2024-06-26T07:03:59.1609393Z }, 2024-06-26T07:03:59.1609647Z { 2024-06-26T07:03:59.1610083Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1610641Z "size": 1374858747, 2024-06-26T07:03:59.1611209Z "digest": "sha256:95237e7311a1c5ce6937db7196c866632f44e8788514a5c0eb4a3f04da4017e6" 2024-06-26T07:03:59.1611807Z }, 2024-06-26T07:03:59.1612057Z { 2024-06-26T07:03:59.1612494Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1613048Z "size": 106, 2024-06-26T07:03:59.1613604Z "digest": "sha256:789eff6c51aada70bf75eb1acafed63c0d839b768638001500616ff6e53b854a" 2024-06-26T07:03:59.1614378Z }, 2024-06-26T07:03:59.1614629Z { 2024-06-26T07:03:59.1615069Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1615619Z "size": 558, 2024-06-26T07:03:59.1616173Z "digest": "sha256:de0f8a8c45c6077b3c5ba3b84d7f07de98353fd618dad9a1e2f368ffe00493c7" 2024-06-26T07:03:59.1616802Z }, 2024-06-26T07:03:59.1617046Z { 2024-06-26T07:03:59.1617485Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1618046Z "size": 46248513, 2024-06-26T07:03:59.1618599Z "digest": "sha256:2060028f74888d218bebdd10d723f66c33ee1c708935c4ffd4654d34912ac4dc" 2024-06-26T07:03:59.1619214Z }, 2024-06-26T07:03:59.1619464Z { 2024-06-26T07:03:59.1619904Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1620523Z "size": 111, 2024-06-26T07:03:59.1621062Z "digest": "sha256:e412c7f3b2ded440992955bd92512345cbece8a8894cd3592f714ebc758ad1a0" 2024-06-26T07:03:59.1621685Z }, 2024-06-26T07:03:59.1621936Z { 2024-06-26T07:03:59.1622373Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1622922Z "size": 32, 2024-06-26T07:03:59.1623469Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-06-26T07:03:59.1624096Z }, 2024-06-26T07:03:59.1624339Z { 2024-06-26T07:03:59.1624781Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1625338Z "size": 32, 2024-06-26T07:03:59.1625884Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-06-26T07:03:59.1626496Z }, 2024-06-26T07:03:59.1626749Z { 2024-06-26T07:03:59.1627187Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1627750Z "size": 32, 2024-06-26T07:03:59.1628292Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-06-26T07:03:59.1628911Z }, 2024-06-26T07:03:59.1629160Z { 2024-06-26T07:03:59.1629599Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:03:59.1630157Z "size": 32, 2024-06-26T07:03:59.1630696Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-06-26T07:03:59.1631318Z } 2024-06-26T07:03:59.1631558Z ] 2024-06-26T07:03:59.1631808Z } 2024-06-26T07:03:59.1752397Z ##[group]Run tag=${ECR_DOCKER_IMAGE##*/} 2024-06-26T07:03:59.1752893Z tag=${ECR_DOCKER_IMAGE##*/} 2024-06-26T07:03:59.1753449Z echo "docker pull ghcr.io/pytorch/ci-image:${tag/:/-}" 2024-06-26T07:03:59.1761360Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:03:59.1761868Z env: 2024-06-26T07:03:59.1762153Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:03:59.1763318Z ECR_DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:03:59.1764499Z ##[endgroup] 2024-06-26T07:03:59.1787366Z docker pull ghcr.io/pytorch/ci-image:pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks-91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:03:59.1836511Z ##[group]Run pytorch/test-infra/.github/actions/pull-docker-image@main 2024-06-26T07:03:59.1837095Z with: 2024-06-26T07:03:59.1838175Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:03:59.1839490Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:03:59.1840017Z env: 2024-06-26T07:03:59.1840299Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:03:59.1840657Z ##[endgroup] 2024-06-26T07:03:59.1856499Z ##[group]Run set -x 2024-06-26T07:03:59.1856844Z set -x 2024-06-26T07:03:59.1857151Z set +e 2024-06-26T07:03:59.1857448Z  2024-06-26T07:03:59.1857723Z login() { 2024-06-26T07:03:59.1858394Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2024-06-26T07:03:59.1859235Z } 2024-06-26T07:03:59.1859520Z  2024-06-26T07:03:59.1859825Z retry () { 2024-06-26T07:03:59.1860316Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2024-06-26T07:03:59.1860769Z } 2024-06-26T07:03:59.1861050Z  2024-06-26T07:03:59.1861370Z retry login "${DOCKER_REGISTRY}" 2024-06-26T07:03:59.1861785Z  2024-06-26T07:03:59.1862058Z set -e 2024-06-26T07:03:59.1862541Z # ignore output since only exit code is used for conditional 2024-06-26T07:03:59.1863252Z # only pull docker image if it's not available locally 2024-06-26T07:03:59.1864019Z if ! docker inspect --type=image "${DOCKER_IMAGE}" >/dev/null 2>/dev/null; then 2024-06-26T07:03:59.1864727Z  retry docker pull "${DOCKER_IMAGE}" 2024-06-26T07:03:59.1865171Z fi 2024-06-26T07:03:59.1872715Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:03:59.1873229Z env: 2024-06-26T07:03:59.1873515Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:03:59.1874669Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:03:59.1875977Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:03:59.1876497Z ##[endgroup] 2024-06-26T07:03:59.1894833Z + set +e 2024-06-26T07:03:59.1895338Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:03:59.1895973Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:03:59.1897698Z + aws ecr get-login-password --region us-east-1 2024-06-26T07:03:59.1898699Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:03:59.5953587Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-06-26T07:03:59.5954569Z Configure a credential helper to remove this warning. See 2024-06-26T07:03:59.5955478Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-06-26T07:03:59.5956036Z 2024-06-26T07:03:59.5956163Z Login Succeeded 2024-06-26T07:03:59.5963413Z + set -e 2024-06-26T07:03:59.5964746Z + docker inspect --type=image 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:03:59.6088962Z + retry docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:03:59.6091148Z + docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:03:59.8275946Z 91382da70d5719cd7007b6b80b71d2f48398f6b7: Pulling from pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks 2024-06-26T07:03:59.8283116Z 7a2c55901189: Pulling fs layer 2024-06-26T07:03:59.8283709Z 224fe954d725: Pulling fs layer 2024-06-26T07:03:59.8284405Z 75722010b82e: Pulling fs layer 2024-06-26T07:03:59.8284956Z d527cbbb87e3: Pulling fs layer 2024-06-26T07:03:59.8285351Z b57676e46aee: Pulling fs layer 2024-06-26T07:03:59.8285748Z a8c1e85b5e14: Pulling fs layer 2024-06-26T07:03:59.8286197Z a41a8d1c11c8: Pulling fs layer 2024-06-26T07:03:59.8286668Z 0c1227890755: Pulling fs layer 2024-06-26T07:03:59.8287162Z d8d1234baab3: Pulling fs layer 2024-06-26T07:03:59.8287567Z 7ed32bc8e469: Pulling fs layer 2024-06-26T07:03:59.8288008Z ec1e7978c1fe: Pulling fs layer 2024-06-26T07:03:59.8288394Z 309b872da805: Pulling fs layer 2024-06-26T07:03:59.8289052Z e82932cb002c: Pulling fs layer 2024-06-26T07:03:59.8289572Z ca9dd73e3e93: Pulling fs layer 2024-06-26T07:03:59.8290063Z b57676e46aee: Waiting 2024-06-26T07:03:59.8290516Z 16d76a79d5d6: Pulling fs layer 2024-06-26T07:03:59.8290903Z a8c1e85b5e14: Waiting 2024-06-26T07:03:59.8291418Z 4bdf41c9ecbe: Pulling fs layer 2024-06-26T07:03:59.8291917Z a41a8d1c11c8: Waiting 2024-06-26T07:03:59.8292312Z f4863801e30c: Pulling fs layer 2024-06-26T07:03:59.8292832Z d37dd9ed8948: Pulling fs layer 2024-06-26T07:03:59.8293367Z d527cbbb87e3: Waiting 2024-06-26T07:03:59.8294107Z cf2f34f225db: Pulling fs layer 2024-06-26T07:03:59.8294496Z df546d7b3e34: Pulling fs layer 2024-06-26T07:03:59.8294990Z 3d914950f8ad: Pulling fs layer 2024-06-26T07:03:59.8295483Z 0c1227890755: Waiting 2024-06-26T07:03:59.8295826Z 96d0e2032184: Pulling fs layer 2024-06-26T07:03:59.8296681Z 06e12ce59790: Pulling fs layer 2024-06-26T07:03:59.8297196Z ed712f63cde7: Pulling fs layer 2024-06-26T07:03:59.8297605Z a97a71ef8a4e: Pulling fs layer 2024-06-26T07:03:59.8297987Z 25cd0c482ad6: Pulling fs layer 2024-06-26T07:03:59.8298349Z 309b872da805: Waiting 2024-06-26T07:03:59.8298673Z ca9dd73e3e93: Waiting 2024-06-26T07:03:59.8298998Z 7ed32bc8e469: Waiting 2024-06-26T07:03:59.8299311Z e82932cb002c: Waiting 2024-06-26T07:03:59.8299661Z 9bf94bc45658: Pulling fs layer 2024-06-26T07:03:59.8300143Z ec1e7978c1fe: Waiting 2024-06-26T07:03:59.8300607Z d8d1234baab3: Waiting 2024-06-26T07:03:59.8300951Z de45a14c9b22: Pulling fs layer 2024-06-26T07:03:59.8301333Z e99241e77209: Pulling fs layer 2024-06-26T07:03:59.8301693Z 16d76a79d5d6: Waiting 2024-06-26T07:03:59.8302008Z 96d0e2032184: Waiting 2024-06-26T07:03:59.8302339Z 35e8f4e2a42f: Pulling fs layer 2024-06-26T07:03:59.8302939Z ed712f63cde7: Waiting 2024-06-26T07:03:59.8303289Z 06e12ce59790: Waiting 2024-06-26T07:03:59.8303637Z a823ffa4c541: Pulling fs layer 2024-06-26T07:03:59.8304012Z 4bdf41c9ecbe: Waiting 2024-06-26T07:03:59.8304344Z a97a71ef8a4e: Waiting 2024-06-26T07:03:59.8304658Z f4863801e30c: Waiting 2024-06-26T07:03:59.8304968Z cf2f34f225db: Waiting 2024-06-26T07:03:59.8305375Z 3d914950f8ad: Waiting 2024-06-26T07:03:59.8305711Z 44ba272eae20: Pulling fs layer 2024-06-26T07:03:59.8306079Z d37dd9ed8948: Waiting 2024-06-26T07:03:59.8306408Z da02d278e524: Pulling fs layer 2024-06-26T07:03:59.8306781Z df546d7b3e34: Waiting 2024-06-26T07:03:59.8307109Z de45a14c9b22: Waiting 2024-06-26T07:03:59.8307423Z a823ffa4c541: Waiting 2024-06-26T07:03:59.8307842Z 73a0ce681c29: Pulling fs layer 2024-06-26T07:03:59.8308210Z e99241e77209: Waiting 2024-06-26T07:03:59.8308543Z 49737bd5ae70: Pulling fs layer 2024-06-26T07:03:59.8308921Z 9cd4c745f8e4: Pulling fs layer 2024-06-26T07:03:59.8309305Z b2950a036534: Pulling fs layer 2024-06-26T07:03:59.8309667Z 44ba272eae20: Waiting 2024-06-26T07:03:59.8309998Z 25e19d81d9fc: Pulling fs layer 2024-06-26T07:03:59.8310529Z 60156b40fcbe: Pulling fs layer 2024-06-26T07:03:59.8310891Z b2950a036534: Waiting 2024-06-26T07:03:59.8311219Z 7a868239227f: Pulling fs layer 2024-06-26T07:03:59.8311576Z 25e19d81d9fc: Waiting 2024-06-26T07:03:59.8311905Z 9cd4c745f8e4: Waiting 2024-06-26T07:03:59.8312223Z 60156b40fcbe: Waiting 2024-06-26T07:03:59.8312542Z 25cd0c482ad6: Waiting 2024-06-26T07:03:59.8313063Z 7a868239227f: Waiting 2024-06-26T07:03:59.8313398Z 83911d7c7ecf: Pulling fs layer 2024-06-26T07:03:59.8313787Z b3c5d66c679f: Pulling fs layer 2024-06-26T07:03:59.8314147Z 83911d7c7ecf: Waiting 2024-06-26T07:03:59.8314613Z 84b2c7a89982: Pulling fs layer 2024-06-26T07:03:59.8314999Z c1068d03a811: Pulling fs layer 2024-06-26T07:03:59.8315376Z 671b4a301d81: Pulling fs layer 2024-06-26T07:03:59.8315746Z 67760cf5ec46: Pulling fs layer 2024-06-26T07:03:59.8316110Z 84b2c7a89982: Waiting 2024-06-26T07:03:59.8316446Z ddc9740bcea2: Pulling fs layer 2024-06-26T07:03:59.8316827Z fb2e97768560: Pulling fs layer 2024-06-26T07:03:59.8317181Z c1068d03a811: Waiting 2024-06-26T07:03:59.8317519Z b599c5a8c7cb: Pulling fs layer 2024-06-26T07:03:59.8317883Z 671b4a301d81: Waiting 2024-06-26T07:03:59.8318210Z e08e88c13668: Pulling fs layer 2024-06-26T07:03:59.8318708Z 12ba7431ff38: Pulling fs layer 2024-06-26T07:03:59.8319089Z cf7c2cb896cb: Pulling fs layer 2024-06-26T07:03:59.8319470Z 3a778ddfac2a: Pulling fs layer 2024-06-26T07:03:59.8319841Z 236c8f0245f4: Pulling fs layer 2024-06-26T07:03:59.8320202Z 12ba7431ff38: Waiting 2024-06-26T07:03:59.8320589Z cf7c2cb896cb: Waiting 2024-06-26T07:03:59.8320931Z 4f4fb700ef54: Pulling fs layer 2024-06-26T07:03:59.8321378Z 236c8f0245f4: Waiting 2024-06-26T07:03:59.8321718Z dda1ce302b9a: Pulling fs layer 2024-06-26T07:03:59.8322091Z b599c5a8c7cb: Waiting 2024-06-26T07:03:59.8322412Z 4f4fb700ef54: Waiting 2024-06-26T07:03:59.8322745Z e797fe86caef: Pulling fs layer 2024-06-26T07:03:59.8323112Z dda1ce302b9a: Waiting 2024-06-26T07:03:59.8323445Z 967190076fc0: Pulling fs layer 2024-06-26T07:03:59.8323816Z 4fb0a83f0685: Pulling fs layer 2024-06-26T07:03:59.8324201Z 68af2ec4e30a: Pulling fs layer 2024-06-26T07:03:59.8324704Z 3a778ddfac2a: Waiting 2024-06-26T07:03:59.8325041Z cc91933e985a: Pulling fs layer 2024-06-26T07:03:59.8325400Z 967190076fc0: Waiting 2024-06-26T07:03:59.8325737Z 9f3187916e7d: Pulling fs layer 2024-06-26T07:03:59.8326101Z da02d278e524: Waiting 2024-06-26T07:03:59.8326434Z 526083994857: Pulling fs layer 2024-06-26T07:03:59.8326921Z 68af2ec4e30a: Waiting 2024-06-26T07:03:59.8327251Z 9f3187916e7d: Waiting 2024-06-26T07:03:59.8327577Z cc91933e985a: Waiting 2024-06-26T07:03:59.8327914Z 05a6f6dcc1c0: Pulling fs layer 2024-06-26T07:03:59.8328282Z e797fe86caef: Waiting 2024-06-26T07:03:59.8328874Z 526083994857: Waiting 2024-06-26T07:03:59.8329223Z 6bc9dc8315b0: Pulling fs layer 2024-06-26T07:03:59.8329580Z 4fb0a83f0685: Waiting 2024-06-26T07:03:59.8329915Z 1b0e27c35f07: Pulling fs layer 2024-06-26T07:03:59.8330292Z 95237e7311a1: Pulling fs layer 2024-06-26T07:03:59.8330663Z 789eff6c51aa: Pulling fs layer 2024-06-26T07:03:59.8331046Z de0f8a8c45c6: Pulling fs layer 2024-06-26T07:03:59.8331423Z 2060028f7488: Pulling fs layer 2024-06-26T07:03:59.8331802Z e412c7f3b2de: Pulling fs layer 2024-06-26T07:03:59.8332160Z 789eff6c51aa: Waiting 2024-06-26T07:03:59.8332481Z de0f8a8c45c6: Waiting 2024-06-26T07:03:59.8332800Z 05a6f6dcc1c0: Waiting 2024-06-26T07:03:59.8333137Z 2060028f7488: Waiting 2024-06-26T07:03:59.8333477Z e412c7f3b2de: Waiting 2024-06-26T07:03:59.8333792Z 1b0e27c35f07: Waiting 2024-06-26T07:03:59.8334111Z 95237e7311a1: Waiting 2024-06-26T07:03:59.9932804Z 224fe954d725: Verifying Checksum 2024-06-26T07:03:59.9933291Z 224fe954d725: Download complete 2024-06-26T07:04:00.0767377Z d527cbbb87e3: Verifying Checksum 2024-06-26T07:04:00.1477800Z b57676e46aee: Verifying Checksum 2024-06-26T07:04:00.1478388Z b57676e46aee: Download complete 2024-06-26T07:04:00.1969065Z 7a2c55901189: Verifying Checksum 2024-06-26T07:04:00.1969613Z 7a2c55901189: Download complete 2024-06-26T07:04:00.2877412Z a41a8d1c11c8: Download complete 2024-06-26T07:04:00.3585287Z 0c1227890755: Download complete 2024-06-26T07:04:00.4412255Z d8d1234baab3: Download complete 2024-06-26T07:04:00.4610682Z 75722010b82e: Verifying Checksum 2024-06-26T07:04:00.4611317Z 75722010b82e: Download complete 2024-06-26T07:04:00.5493039Z ec1e7978c1fe: Verifying Checksum 2024-06-26T07:04:00.5493716Z ec1e7978c1fe: Download complete 2024-06-26T07:04:00.6286090Z 309b872da805: Download complete 2024-06-26T07:04:01.2396155Z 7a2c55901189: Pull complete 2024-06-26T07:04:01.5617835Z 224fe954d725: Pull complete 2024-06-26T07:04:02.5248329Z 75722010b82e: Pull complete 2024-06-26T07:04:02.5901243Z d527cbbb87e3: Pull complete 2024-06-26T07:04:02.6455708Z b57676e46aee: Pull complete 2024-06-26T07:04:03.1591783Z e82932cb002c: Verifying Checksum 2024-06-26T07:04:03.1592423Z e82932cb002c: Download complete 2024-06-26T07:04:03.2404195Z ca9dd73e3e93: Download complete 2024-06-26T07:04:03.3144268Z 16d76a79d5d6: Download complete 2024-06-26T07:04:03.4179025Z 4bdf41c9ecbe: Verifying Checksum 2024-06-26T07:04:03.4180548Z 4bdf41c9ecbe: Download complete 2024-06-26T07:04:04.3959833Z f4863801e30c: Verifying Checksum 2024-06-26T07:04:04.3960410Z f4863801e30c: Download complete 2024-06-26T07:04:04.4836497Z d37dd9ed8948: Verifying Checksum 2024-06-26T07:04:04.4837044Z d37dd9ed8948: Download complete 2024-06-26T07:04:04.5653335Z cf2f34f225db: Verifying Checksum 2024-06-26T07:04:04.5653844Z cf2f34f225db: Download complete 2024-06-26T07:04:04.6555418Z df546d7b3e34: Verifying Checksum 2024-06-26T07:04:04.6556039Z df546d7b3e34: Download complete 2024-06-26T07:04:13.4997216Z a8c1e85b5e14: Verifying Checksum 2024-06-26T07:04:13.4997856Z a8c1e85b5e14: Download complete 2024-06-26T07:04:13.5712084Z 96d0e2032184: Verifying Checksum 2024-06-26T07:04:13.5712932Z 96d0e2032184: Download complete 2024-06-26T07:04:13.6526627Z 06e12ce59790: Verifying Checksum 2024-06-26T07:04:13.6527117Z 06e12ce59790: Download complete 2024-06-26T07:04:13.7243927Z ed712f63cde7: Verifying Checksum 2024-06-26T07:04:13.7244503Z ed712f63cde7: Download complete 2024-06-26T07:04:13.8267601Z a97a71ef8a4e: Verifying Checksum 2024-06-26T07:04:13.8268200Z a97a71ef8a4e: Download complete 2024-06-26T07:04:13.9119952Z 25cd0c482ad6: Verifying Checksum 2024-06-26T07:04:13.9120469Z 25cd0c482ad6: Download complete 2024-06-26T07:04:15.1738962Z 9bf94bc45658: Verifying Checksum 2024-06-26T07:04:15.1739461Z 9bf94bc45658: Download complete 2024-06-26T07:04:15.2719935Z de45a14c9b22: Verifying Checksum 2024-06-26T07:04:15.2720577Z de45a14c9b22: Download complete 2024-06-26T07:04:15.3472874Z e99241e77209: Verifying Checksum 2024-06-26T07:04:15.3473532Z e99241e77209: Download complete 2024-06-26T07:04:15.4261897Z 35e8f4e2a42f: Verifying Checksum 2024-06-26T07:04:15.4262450Z 35e8f4e2a42f: Download complete 2024-06-26T07:04:15.5046123Z a823ffa4c541: Verifying Checksum 2024-06-26T07:04:15.5046751Z a823ffa4c541: Download complete 2024-06-26T07:04:15.5733085Z 44ba272eae20: Verifying Checksum 2024-06-26T07:04:15.5733944Z 44ba272eae20: Download complete 2024-06-26T07:04:20.0987353Z da02d278e524: Verifying Checksum 2024-06-26T07:04:20.0987870Z da02d278e524: Download complete 2024-06-26T07:04:20.1991198Z 73a0ce681c29: Verifying Checksum 2024-06-26T07:04:20.1991850Z 73a0ce681c29: Download complete 2024-06-26T07:04:20.2852333Z 49737bd5ae70: Download complete 2024-06-26T07:04:20.8632568Z 9cd4c745f8e4: Verifying Checksum 2024-06-26T07:04:20.8633332Z 9cd4c745f8e4: Download complete 2024-06-26T07:04:20.9524814Z b2950a036534: Verifying Checksum 2024-06-26T07:04:20.9525388Z b2950a036534: Download complete 2024-06-26T07:04:21.0353863Z 25e19d81d9fc: Download complete 2024-06-26T07:04:21.3207634Z 60156b40fcbe: Verifying Checksum 2024-06-26T07:04:21.3208186Z 60156b40fcbe: Download complete 2024-06-26T07:04:21.3903598Z 7a868239227f: Verifying Checksum 2024-06-26T07:04:21.3904321Z 7a868239227f: Download complete 2024-06-26T07:04:21.4661469Z 83911d7c7ecf: Download complete 2024-06-26T07:04:21.5546147Z b3c5d66c679f: Verifying Checksum 2024-06-26T07:04:21.5546805Z b3c5d66c679f: Download complete 2024-06-26T07:04:25.7846802Z 7ed32bc8e469: Verifying Checksum 2024-06-26T07:04:25.7847416Z 7ed32bc8e469: Download complete 2024-06-26T07:04:25.8651575Z c1068d03a811: Verifying Checksum 2024-06-26T07:04:25.8652122Z c1068d03a811: Download complete 2024-06-26T07:04:25.9436659Z 671b4a301d81: Download complete 2024-06-26T07:04:26.4317261Z 67760cf5ec46: Download complete 2024-06-26T07:04:26.5154449Z ddc9740bcea2: Download complete 2024-06-26T07:04:26.5815706Z fb2e97768560: Download complete 2024-06-26T07:04:26.6323026Z a8c1e85b5e14: Pull complete 2024-06-26T07:04:26.6509552Z b599c5a8c7cb: Verifying Checksum 2024-06-26T07:04:26.6510305Z b599c5a8c7cb: Download complete 2024-06-26T07:04:26.7340971Z e08e88c13668: Download complete 2024-06-26T07:04:26.8467187Z a41a8d1c11c8: Pull complete 2024-06-26T07:04:27.0621219Z 0c1227890755: Pull complete 2024-06-26T07:04:27.2796605Z d8d1234baab3: Pull complete 2024-06-26T07:04:32.5570558Z 3d914950f8ad: Verifying Checksum 2024-06-26T07:04:32.5571058Z 3d914950f8ad: Download complete 2024-06-26T07:04:32.6445360Z cf7c2cb896cb: Verifying Checksum 2024-06-26T07:04:32.6445856Z cf7c2cb896cb: Download complete 2024-06-26T07:04:32.7238339Z 3a778ddfac2a: Verifying Checksum 2024-06-26T07:04:32.7239032Z 3a778ddfac2a: Download complete 2024-06-26T07:04:32.7948736Z 236c8f0245f4: Verifying Checksum 2024-06-26T07:04:32.7949282Z 236c8f0245f4: Download complete 2024-06-26T07:04:32.8037261Z 4f4fb700ef54: Verifying Checksum 2024-06-26T07:04:32.8037828Z 4f4fb700ef54: Download complete 2024-06-26T07:04:32.8928468Z dda1ce302b9a: Verifying Checksum 2024-06-26T07:04:32.8929460Z dda1ce302b9a: Download complete 2024-06-26T07:04:32.9841171Z e797fe86caef: Verifying Checksum 2024-06-26T07:04:32.9841816Z e797fe86caef: Download complete 2024-06-26T07:04:33.1119750Z 967190076fc0: Verifying Checksum 2024-06-26T07:04:33.1120239Z 967190076fc0: Download complete 2024-06-26T07:04:33.1922768Z 4fb0a83f0685: Download complete 2024-06-26T07:04:33.2620610Z 68af2ec4e30a: Download complete 2024-06-26T07:04:33.3452748Z cc91933e985a: Verifying Checksum 2024-06-26T07:04:33.3453567Z cc91933e985a: Download complete 2024-06-26T07:04:33.4231556Z 9f3187916e7d: Verifying Checksum 2024-06-26T07:04:33.4232046Z 9f3187916e7d: Download complete 2024-06-26T07:04:33.5525402Z 526083994857: Verifying Checksum 2024-06-26T07:04:33.5525966Z 526083994857: Download complete 2024-06-26T07:04:33.6234504Z 05a6f6dcc1c0: Download complete 2024-06-26T07:04:34.2281983Z 6bc9dc8315b0: Verifying Checksum 2024-06-26T07:04:34.2282520Z 6bc9dc8315b0: Download complete 2024-06-26T07:04:34.2922197Z 1b0e27c35f07: Verifying Checksum 2024-06-26T07:04:34.2922718Z 1b0e27c35f07: Download complete 2024-06-26T07:04:56.5104911Z 12ba7431ff38: Verifying Checksum 2024-06-26T07:04:56.5106588Z 12ba7431ff38: Download complete 2024-06-26T07:04:56.5806100Z 789eff6c51aa: Download complete 2024-06-26T07:04:56.6696892Z de0f8a8c45c6: Verifying Checksum 2024-06-26T07:04:56.6697691Z de0f8a8c45c6: Download complete 2024-06-26T07:04:58.0467637Z 2060028f7488: Verifying Checksum 2024-06-26T07:04:58.0468268Z 2060028f7488: Download complete 2024-06-26T07:04:58.1335278Z e412c7f3b2de: Verifying Checksum 2024-06-26T07:04:58.1335944Z e412c7f3b2de: Download complete 2024-06-26T07:05:02.3478081Z 95237e7311a1: Verifying Checksum 2024-06-26T07:05:02.3478574Z 95237e7311a1: Download complete 2024-06-26T07:05:25.4341415Z 84b2c7a89982: Verifying Checksum 2024-06-26T07:05:25.4341904Z 84b2c7a89982: Download complete 2024-06-26T07:05:43.0390299Z 7ed32bc8e469: Pull complete 2024-06-26T07:05:43.2396798Z ec1e7978c1fe: Pull complete 2024-06-26T07:05:43.4460462Z 309b872da805: Pull complete 2024-06-26T07:05:50.8786561Z e82932cb002c: Pull complete 2024-06-26T07:05:51.0989304Z ca9dd73e3e93: Pull complete 2024-06-26T07:05:51.3014879Z 16d76a79d5d6: Pull complete 2024-06-26T07:05:51.5062346Z 4bdf41c9ecbe: Pull complete 2024-06-26T07:05:53.9333379Z f4863801e30c: Pull complete 2024-06-26T07:05:54.1258440Z d37dd9ed8948: Pull complete 2024-06-26T07:05:54.3317547Z cf2f34f225db: Pull complete 2024-06-26T07:05:54.5323246Z df546d7b3e34: Pull complete 2024-06-26T07:06:44.2332648Z 3d914950f8ad: Pull complete 2024-06-26T07:06:44.3852273Z 96d0e2032184: Pull complete 2024-06-26T07:06:44.5397625Z 06e12ce59790: Pull complete 2024-06-26T07:06:44.6742670Z ed712f63cde7: Pull complete 2024-06-26T07:06:44.8988667Z a97a71ef8a4e: Pull complete 2024-06-26T07:06:45.0860858Z 25cd0c482ad6: Pull complete 2024-06-26T07:06:48.6398756Z 9bf94bc45658: Pull complete 2024-06-26T07:06:48.8306610Z de45a14c9b22: Pull complete 2024-06-26T07:06:48.9588386Z e99241e77209: Pull complete 2024-06-26T07:06:49.1654641Z 35e8f4e2a42f: Pull complete 2024-06-26T07:06:49.3712928Z a823ffa4c541: Pull complete 2024-06-26T07:06:49.5824419Z 44ba272eae20: Pull complete 2024-06-26T07:06:57.9279079Z da02d278e524: Pull complete 2024-06-26T07:06:58.1010762Z 73a0ce681c29: Pull complete 2024-06-26T07:06:58.2372294Z 49737bd5ae70: Pull complete 2024-06-26T07:06:59.1599970Z 9cd4c745f8e4: Pull complete 2024-06-26T07:06:59.3538740Z b2950a036534: Pull complete 2024-06-26T07:06:59.5314284Z 25e19d81d9fc: Pull complete 2024-06-26T07:06:59.9194660Z 60156b40fcbe: Pull complete 2024-06-26T07:07:00.1053044Z 7a868239227f: Pull complete 2024-06-26T07:07:00.5684879Z 83911d7c7ecf: Pull complete 2024-06-26T07:07:00.7629678Z b3c5d66c679f: Pull complete 2024-06-26T07:07:39.2460934Z 84b2c7a89982: Pull complete 2024-06-26T07:07:39.3810693Z c1068d03a811: Pull complete 2024-06-26T07:07:39.4167055Z 671b4a301d81: Pull complete 2024-06-26T07:07:41.3263361Z 67760cf5ec46: Pull complete 2024-06-26T07:07:41.3647830Z ddc9740bcea2: Pull complete 2024-06-26T07:07:41.3969811Z fb2e97768560: Pull complete 2024-06-26T07:07:41.5256072Z b599c5a8c7cb: Pull complete 2024-06-26T07:07:41.5568803Z e08e88c13668: Pull complete 2024-06-26T07:08:16.1707920Z 12ba7431ff38: Pull complete 2024-06-26T07:08:16.2958664Z cf7c2cb896cb: Pull complete 2024-06-26T07:08:16.4894766Z 3a778ddfac2a: Pull complete 2024-06-26T07:08:16.9661567Z 236c8f0245f4: Pull complete 2024-06-26T07:08:17.1784553Z 4f4fb700ef54: Pull complete 2024-06-26T07:08:17.3722443Z dda1ce302b9a: Pull complete 2024-06-26T07:08:17.5679518Z e797fe86caef: Pull complete 2024-06-26T07:08:17.9656785Z 967190076fc0: Pull complete 2024-06-26T07:08:18.1847467Z 4fb0a83f0685: Pull complete 2024-06-26T07:08:18.3942515Z 68af2ec4e30a: Pull complete 2024-06-26T07:08:18.6050399Z cc91933e985a: Pull complete 2024-06-26T07:08:18.7712481Z 9f3187916e7d: Pull complete 2024-06-26T07:08:19.8664696Z 526083994857: Pull complete 2024-06-26T07:08:20.0656036Z 05a6f6dcc1c0: Pull complete 2024-06-26T07:08:22.1012921Z 6bc9dc8315b0: Pull complete 2024-06-26T07:08:22.2332898Z 1b0e27c35f07: Pull complete 2024-06-26T07:08:35.5443834Z 95237e7311a1: Pull complete 2024-06-26T07:08:35.6057697Z 789eff6c51aa: Pull complete 2024-06-26T07:08:35.6442234Z de0f8a8c45c6: Pull complete 2024-06-26T07:08:36.3506489Z 2060028f7488: Pull complete 2024-06-26T07:08:36.4024428Z e412c7f3b2de: Pull complete 2024-06-26T07:08:36.6841018Z Digest: sha256:216c88a4f79ebfa71a5dcf4d9a946548184354a3ea1f677f4b1065d28705debb 2024-06-26T07:08:36.6873704Z Status: Downloaded newer image for 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:08:36.6900917Z 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:08:36.6951377Z ##[group]Run echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> "$GITHUB_OUTPUT" 2024-06-26T07:08:36.6952389Z echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> "$GITHUB_OUTPUT" 2024-06-26T07:08:36.6960483Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:08:36.6960997Z env: 2024-06-26T07:08:36.6961284Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:08:36.6961638Z ##[endgroup] 2024-06-26T07:08:36.7116213Z ##[group]Run pytorch/test-infra/.github/actions/setup-nvidia@main 2024-06-26T07:08:36.7116771Z with: 2024-06-26T07:08:36.7117062Z driver-version: 550.54.15 2024-06-26T07:08:36.7117411Z env: 2024-06-26T07:08:36.7117683Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:08:36.7118034Z ##[endgroup] 2024-06-26T07:08:36.7157900Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2024-06-26T07:08:36.7158459Z with: 2024-06-26T07:08:36.7158732Z timeout_minutes: 10 2024-06-26T07:08:36.7159050Z max_attempts: 3 2024-06-26T07:08:36.7190543Z command: # Is it disgusting to have a full shell script here in this github action? Sure # But is it the best way to make it so that this action relies on nothing else? Absolutely set -eou pipefail DISTRIBUTION=$(. /etc/os-release;echo $ID$VERSION_ID) DRIVER_FN="NVIDIA-Linux-x86_64-${DRIVER_VERSION}.run" install_nvidia_docker2_amzn2() { ( set -x # Needed for yum-config-manager sudo yum install -y yum-utils if [[ "${DISTRIBUTION}" == "amzn2023" ]] ; then YUM_REPO_URL="https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo" else # Amazon Linux 2 YUM_REPO_URL="https://nvidia.github.io/nvidia-docker/${DISTRIBUTION}/nvidia-docker.repo" fi sudo yum-config-manager --add-repo "${YUM_REPO_URL}" sudo yum install -y nvidia-docker2 sudo systemctl restart docker ) } install_nvidia_docker2_ubuntu20() { ( set -x # Install nvidia-driver package if not installed status="$(dpkg-query -W --showformat='${db:Status-Status}' nvidia-docker2 2>&1)" if [ ! $? = 0 ] || [ ! "$status" = installed ]; then sudo apt-get install -y nvidia-docker2 sudo systemctl restart docker fi ) } pre_install_nvidia_driver_amzn2() { ( # Purge any nvidia driver installed from RHEL repo sudo yum remove -y nvidia-driver-latest-dkms ) } install_nvidia_driver_common() { ( # Try to gather more information about the runner and its existing NVIDIA driver if any echo "Before installing NVIDIA driver" lspci lsmod modinfo nvidia || true HAS_NVIDIA_DRIVER=0 # Check if NVIDIA driver has already been installed if [ -x "$(command -v nvidia-smi)" ]; then set +e # The driver exists, check its version next. Also check only the first GPU if there are more than one of them # so that the same driver version is not print over multiple lines INSTALLED_DRIVER_VERSION=$(nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0) NVIDIA_SMI_STATUS=$? if [ "$NVIDIA_SMI_STATUS" -ne 0 ] && [ "$NVIDIA_SMI_STATUS" -ne 14 ]; then echo "Failed to get NVIDIA driver version ($INSTALLED_DRIVER_VERSION). Continuing" elif [ "$INSTALLED_DRIVER_VERSION" != "$DRIVER_VERSION" ]; then echo "NVIDIA driver ($INSTALLED_DRIVER_VERSION) has been installed, but we expect to have $DRIVER_VERSION instead. Continuing" else HAS_NVIDIA_DRIVER=1 echo "NVIDIA driver ($INSTALLED_DRIVER_VERSION) has already been installed. Skipping NVIDIA driver installation" fi set -e fi if [ "$HAS_NVIDIA_DRIVER" -eq 0 ]; then # CAUTION: this may need to be updated in future if [ "${DISTRIBUTION}" != ubuntu20.04 ]; then sudo yum groupinstall -y "Development Tools" # ensure our kernel install is the same as our underlying kernel, # groupinstall "Development Tools" has a habit of mismatching kernel headers sudo yum install -y "kernel-devel-uname-r == $(uname -r)" sudo modprobe backlight fi sudo curl -fsL -o /tmp/nvidia_driver "https://s3.amazonaws.com/ossci-linux/nvidia_driver/$DRIVER_FN" set +e sudo /bin/bash /tmp/nvidia_driver -s --no-drm NVIDIA_INSTALLATION_STATUS=$? RESET_GPU=0 if [ "$NVIDIA_INSTALLATION_STATUS" -ne 0 ]; then sudo cat /var/log/nvidia-installer.log # Fail to install NVIDIA driver, try to reset the GPU RESET_GPU=1 elif [ -x "$(command -v nvidia-smi)" ]; then # Check again if nvidia-smi works even if the driver installation completes successfully INSTALLED_DRIVER_VERSION=$(nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0) NVIDIA_SMI_STATUS=$? if [ "$NVIDIA_SMI_STATUS" -ne 0 ] && [ "$NVIDIA_SMI_STATUS" -ne 14 ]; then RESET_GPU=1 fi fi if [ "$RESET_GPU" -eq 1 ]; then NVIDIA_DEVICES=$(lspci -D | grep -i NVIDIA | cut -d' ' -f1) # The GPU can get stuck in a failure state if somehow the test crashs the GPU microcode. When this # happens, we'll try to reset all NVIDIA devices https://github.com/pytorch/pytorch/issues/88388 for PCI_ID in $NVIDIA_DEVICES; do DEVICE_ENABLED=$(cat /sys/bus/pci/devices/$PCI_ID/enable) echo "Reseting $PCI_ID (enabled state: $DEVICE_ENABLED)" # This requires sudo permission of course echo "1" | sudo tee /sys/bus/pci/devices/$PCI_ID/reset sleep 1 done fi sudo rm -fv /tmp/nvidia_driver set -e fi ) } post_install_nvidia_driver_common() { ( sudo modprobe nvidia || true echo "After installing NVIDIA driver" lspci lsmod modinfo nvidia || true ( set +e nvidia-smi # NB: Annoyingly, nvidia-smi command returns successfully with return code 0 even in # the case where the driver has already crashed as it still can get the driver version # and some basic information like the bus ID. However, the rest of the information # would be missing (ERR!), for example: # # +-----------------------------------------------------------------------------+ # | NVIDIA-SMI 525.89.02 Driver Version: 525.89.02 CUDA Version: 12.0 | # |-------------------------------+----------------------+----------------------+ # | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | # | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | # | | | MIG M. | # |===============================+======================+======================| # | 0 ERR! Off | 00000000:00:1E.0 Off | ERR! | # |ERR! ERR! ERR! ERR! / ERR! | 4184MiB / 23028MiB | ERR! Default | # | | | ERR! | # +-------------------------------+----------------------+----------------------+ # # +-----------------------------------------------------------------------------+ # | Processes: | # | GPU GI CI PID Type Process name GPU Memory | # | ID ID Usage | # |=============================================================================| # +-----------------------------------------------------------------------------+ # # This should be reported as a failure instead as it will guarantee to fail when # Docker tries to run with --gpus all # # So, the correct check here is to query one of the missing piece of info like # GPU name, so that the command can fail accordingly nvidia-smi --query-gpu=gpu_name --format=csv,noheader --id=0 NVIDIA_SMI_STATUS=$? # Allowable exit statuses for nvidia-smi, see: https://github.com/NVIDIA/gpu-operator/issues/285 if [ "$NVIDIA_SMI_STATUS" -eq 0 ] || [ "$NVIDIA_SMI_STATUS" -eq 14 ]; then echo "INFO: Ignoring allowed status ${NVIDIA_SMI_STATUS}" else echo "ERROR: nvidia-smi exited with unresolved status ${NVIDIA_SMI_STATUS}" exit ${NVIDIA_SMI_STATUS} fi set -e ) ) } install_nvidia_driver_amzn2() { ( set -x pre_install_nvidia_driver_amzn2 install_nvidia_driver_common post_install_nvidia_driver_common ) } install_nvidia_driver_ubuntu20() { ( set -x install_nvidia_driver_common post_install_nvidia_driver_common ) } echo "== Installing nvidia driver ${DRIVER_FN} ==" case "${DISTRIBUTION}" in amzn*) install_nvidia_driver_amzn2 ;; ubuntu20.04) install_nvidia_driver_ubuntu20 ;; *) echo "ERROR: Unknown distribution ${DISTRIBUTION}" exit 1 ;; esac # Install container toolkit based on distribution echo "== Installing nvidia container toolkit for ${DISTRIBUTION} ==" case "${DISTRIBUTION}" in amzn*) install_nvidia_docker2_amzn2 ;; ubuntu20.04) install_nvidia_docker2_ubuntu20 ;; *) echo "ERROR: Unknown distribution ${DISTRIBUTION}" exit 1 ;; esac echo "GPU_FLAG=--gpus all -e NVIDIA_DRIVER_CAPABILITIES=all" >> "${GITHUB_ENV}" 2024-06-26T07:08:36.7222397Z retry_wait_seconds: 10 2024-06-26T07:08:36.7222769Z polling_interval_seconds: 1 2024-06-26T07:08:36.7223144Z warning_on_retry: true 2024-06-26T07:08:36.7223501Z continue_on_error: false 2024-06-26T07:08:36.7223840Z env: 2024-06-26T07:08:36.7224115Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:08:36.7224474Z DRIVER_VERSION: 550.54.15 2024-06-26T07:08:36.7224832Z ##[endgroup] 2024-06-26T07:08:36.7739435Z == Installing nvidia driver NVIDIA-Linux-x86_64-550.54.15.run == 2024-06-26T07:08:36.7740316Z + pre_install_nvidia_driver_amzn2 2024-06-26T07:08:36.7741006Z + sudo yum remove -y nvidia-driver-latest-dkms 2024-06-26T07:08:37.0874327Z Loaded plugins: extras_suggestions, langpacks, priorities, update-motd 2024-06-26T07:08:37.1262777Z No Match for argument: nvidia-driver-latest-dkms 2024-06-26T07:08:37.1502559Z No Packages marked for removal 2024-06-26T07:08:37.1627167Z + install_nvidia_driver_common 2024-06-26T07:08:37.1629753Z + echo 'Before installing NVIDIA driver' 2024-06-26T07:08:37.1630444Z + lspci 2024-06-26T07:08:37.1630890Z Before installing NVIDIA driver 2024-06-26T07:08:37.1711644Z 00:00.0 Host bridge: Intel Corporation 440FX - 82441FX PMC [Natoma] 2024-06-26T07:08:37.1712668Z 00:01.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II] 2024-06-26T07:08:37.1713641Z 00:01.3 Non-VGA unclassified device: Intel Corporation 82371AB/EB/MB PIIX4 ACPI (rev 08) 2024-06-26T07:08:37.1714631Z 00:03.0 VGA compatible controller: Amazon.com, Inc. Device 1111 2024-06-26T07:08:37.1715668Z 00:04.0 Non-Volatile memory controller: Amazon.com, Inc. Device 8061 2024-06-26T07:08:37.1716449Z 00:05.0 Ethernet controller: Amazon.com, Inc. Elastic Network Adapter (ENA) 2024-06-26T07:08:37.1717408Z 00:1e.0 3D controller: NVIDIA Corporation Device 2237 (rev a1) 2024-06-26T07:08:37.1718221Z 00:1f.0 Non-Volatile memory controller: Amazon.com, Inc. NVMe SSD Controller 2024-06-26T07:08:37.1718821Z + lsmod 2024-06-26T07:08:37.1732399Z Module Size Used by 2024-06-26T07:08:37.1733136Z xt_nat 16384 0 2024-06-26T07:08:37.1733723Z ib_core 266240 0 2024-06-26T07:08:37.1734174Z nvidia_modeset 1339392 0 2024-06-26T07:08:37.1734552Z veth 16384 0 2024-06-26T07:08:37.1734984Z nvidia_uvm 4599808 0 2024-06-26T07:08:37.1735846Z nvidia 53989376 2 nvidia_uvm,nvidia_modeset 2024-06-26T07:08:37.1736517Z drm 421888 1 nvidia 2024-06-26T07:08:37.1737092Z i2c_core 77824 2 nvidia,drm 2024-06-26T07:08:37.1737730Z backlight 16384 1 nvidia_modeset 2024-06-26T07:08:37.1738228Z xt_conntrack 16384 1 2024-06-26T07:08:37.1738623Z ipt_MASQUERADE 16384 1 2024-06-26T07:08:37.1739066Z nf_nat_masquerade_ipv4 16384 1 ipt_MASQUERADE 2024-06-26T07:08:37.1739620Z nf_conntrack_netlink 49152 0 2024-06-26T07:08:37.1740491Z nfnetlink 16384 2 nf_conntrack_netlink 2024-06-26T07:08:37.1741221Z xfrm_user 45056 1 2024-06-26T07:08:37.1741641Z xfrm_algo 16384 1 xfrm_user 2024-06-26T07:08:37.1742065Z iptable_nat 16384 1 2024-06-26T07:08:37.1742558Z nf_conntrack_ipv4 16384 3 2024-06-26T07:08:37.1743146Z nf_defrag_ipv4 16384 1 nf_conntrack_ipv4 2024-06-26T07:08:37.1743744Z nf_nat_ipv4 16384 1 iptable_nat 2024-06-26T07:08:37.1744337Z nf_nat 32768 3 nf_nat_masquerade_ipv4,nf_nat_ipv4,xt_nat 2024-06-26T07:08:37.1745370Z nf_conntrack 155648 8 xt_conntrack,nf_nat_masquerade_ipv4,nf_conntrack_ipv4,nf_nat,ipt_MASQUERADE,nf_nat_ipv4,xt_nat,nf_conntrack_netlink 2024-06-26T07:08:37.1746548Z xt_addrtype 16384 2 2024-06-26T07:08:37.1747065Z iptable_filter 16384 1 2024-06-26T07:08:37.1747511Z br_netfilter 24576 0 2024-06-26T07:08:37.1747931Z bridge 172032 1 br_netfilter 2024-06-26T07:08:37.1748381Z stp 16384 1 bridge 2024-06-26T07:08:37.1748931Z llc 16384 2 bridge,stp 2024-06-26T07:08:37.1749623Z overlay 86016 0 2024-06-26T07:08:37.1750131Z sunrpc 393216 1 2024-06-26T07:08:37.1750606Z dm_mirror 28672 0 2024-06-26T07:08:37.1751015Z dm_region_hash 20480 1 dm_mirror 2024-06-26T07:08:37.1751686Z dm_log 20480 2 dm_region_hash,dm_mirror 2024-06-26T07:08:37.1752334Z dm_mod 143360 2 dm_log,dm_mirror 2024-06-26T07:08:37.1752786Z dax 69632 1 dm_mod 2024-06-26T07:08:37.1753200Z crc32_pclmul 16384 0 2024-06-26T07:08:37.1753595Z ghash_clmulni_intel 16384 0 2024-06-26T07:08:37.1754029Z pcbc 16384 0 2024-06-26T07:08:37.1754401Z aesni_intel 188416 0 2024-06-26T07:08:37.1754892Z aes_x86_64 20480 1 aesni_intel 2024-06-26T07:08:37.1755348Z crypto_simd 16384 1 aesni_intel 2024-06-26T07:08:37.1755814Z glue_helper 16384 1 aesni_intel 2024-06-26T07:08:37.1756379Z cryptd 28672 3 crypto_simd,ghash_clmulni_intel,aesni_intel 2024-06-26T07:08:37.1756939Z mousedev 24576 0 2024-06-26T07:08:37.1757318Z evdev 20480 3 2024-06-26T07:08:37.1757687Z psmouse 32768 0 2024-06-26T07:08:37.1758062Z button 16384 0 2024-06-26T07:08:37.1758475Z ena 139264 0 2024-06-26T07:08:37.1758862Z ptp 20480 1 ena 2024-06-26T07:08:37.1759269Z pps_core 20480 1 ptp 2024-06-26T07:08:37.1759665Z crc32c_intel 24576 0 2024-06-26T07:08:37.1760056Z autofs4 49152 2 2024-06-26T07:08:37.1760423Z + modinfo nvidia 2024-06-26T07:08:37.1761103Z filename: /lib/modules/4.14.336-257.562.amzn2.x86_64/kernel/drivers/video/nvidia.ko 2024-06-26T07:08:37.1761805Z alias: char-major-195-* 2024-06-26T07:08:37.1762198Z version: 550.54.15 2024-06-26T07:08:37.1762556Z supported: external 2024-06-26T07:08:37.1762906Z license: NVIDIA 2024-06-26T07:08:37.1763298Z firmware: nvidia/550.54.15/gsp_tu10x.bin 2024-06-26T07:08:37.1763813Z firmware: nvidia/550.54.15/gsp_ga10x.bin 2024-06-26T07:08:37.1764286Z srcversion: 833721318DA517F0C2FEC97 2024-06-26T07:08:37.1764757Z alias: pci:v000010DEd*sv*sd*bc06sc80i00* 2024-06-26T07:08:37.1765271Z alias: pci:v000010DEd*sv*sd*bc03sc02i00* 2024-06-26T07:08:37.1765889Z alias: pci:v000010DEd*sv*sd*bc03sc00i00* 2024-06-26T07:08:37.1766391Z depends: i2c-core,drm 2024-06-26T07:08:37.1766750Z retpoline: Y 2024-06-26T07:08:37.1767067Z name: nvidia 2024-06-26T07:08:37.1767632Z vermagic: 4.14.336-257.562.amzn2.x86_64 SMP mod_unload modversions 2024-06-26T07:08:37.1768306Z parm: NvSwitchRegDwords:NvSwitch regkey (charp) 2024-06-26T07:08:37.1769288Z parm: NvSwitchBlacklist:NvSwitchBlacklist=uuid[,uuid...] (charp) 2024-06-26T07:08:37.1769898Z parm: NVreg_ResmanDebugLevel:int 2024-06-26T07:08:37.1770355Z parm: NVreg_RmLogonRC:int 2024-06-26T07:08:37.1770809Z parm: NVreg_ModifyDeviceFiles:int 2024-06-26T07:08:37.1771276Z parm: NVreg_DeviceFileUID:int 2024-06-26T07:08:37.1771731Z parm: NVreg_DeviceFileGID:int 2024-06-26T07:08:37.1772231Z parm: NVreg_DeviceFileMode:int 2024-06-26T07:08:37.1772768Z parm: NVreg_InitializeSystemMemoryAllocations:int 2024-06-26T07:08:37.1773362Z parm: NVreg_UsePageAttributeTable:int 2024-06-26T07:08:37.1773856Z parm: NVreg_EnablePCIeGen3:int 2024-06-26T07:08:37.1774301Z parm: NVreg_EnableMSI:int 2024-06-26T07:08:37.1774722Z parm: NVreg_TCEBypassMode:int 2024-06-26T07:08:37.1775195Z parm: NVreg_EnableStreamMemOPs:int 2024-06-26T07:08:37.1775743Z parm: NVreg_RestrictProfilingToAdminUsers:int 2024-06-26T07:08:37.1776357Z parm: NVreg_PreserveVideoMemoryAllocations:int 2024-06-26T07:08:37.1776928Z parm: NVreg_EnableS0ixPowerManagement:int 2024-06-26T07:08:37.1777559Z parm: NVreg_S0ixPowerManagementVideoMemoryThreshold:int 2024-06-26T07:08:37.1778322Z parm: NVreg_DynamicPowerManagement:int 2024-06-26T07:08:37.1778955Z parm: NVreg_DynamicPowerManagementVideoMemoryThreshold:int 2024-06-26T07:08:37.1779556Z parm: NVreg_EnableGpuFirmware:int 2024-06-26T07:08:37.1780207Z parm: NVreg_EnableGpuFirmwareLogs:int 2024-06-26T07:08:37.1780763Z parm: NVreg_OpenRmEnableUnsupportedGpus:int 2024-06-26T07:08:37.1781330Z parm: NVreg_EnableUserNUMAManagement:int 2024-06-26T07:08:37.1781841Z parm: NVreg_MemoryPoolSize:int 2024-06-26T07:08:37.1782317Z parm: NVreg_KMallocHeapMaxSize:int 2024-06-26T07:08:37.1782815Z parm: NVreg_VMallocHeapMaxSize:int 2024-06-26T07:08:37.1783301Z parm: NVreg_IgnoreMMIOCheck:int 2024-06-26T07:08:37.1783753Z parm: NVreg_NvLinkDisable:int 2024-06-26T07:08:37.1784274Z parm: NVreg_EnablePCIERelaxedOrderingMode:int 2024-06-26T07:08:37.1784814Z parm: NVreg_RegisterPCIDriver:int 2024-06-26T07:08:37.1785307Z parm: NVreg_EnableResizableBar:int 2024-06-26T07:08:37.1785812Z parm: NVreg_EnableDbgBreakpoint:int 2024-06-26T07:08:37.1786330Z parm: NVreg_EnableNonblockingOpen:int 2024-06-26T07:08:37.1786829Z parm: NVreg_RegistryDwords:charp 2024-06-26T07:08:37.1787342Z parm: NVreg_RegistryDwordsPerDevice:charp 2024-06-26T07:08:37.1787836Z parm: NVreg_RmMsg:charp 2024-06-26T07:08:37.1788259Z parm: NVreg_GpuBlacklist:charp 2024-06-26T07:08:37.1788741Z parm: NVreg_TemporaryFilePath:charp 2024-06-26T07:08:37.1789212Z parm: NVreg_ExcludedGpus:charp 2024-06-26T07:08:37.1789679Z parm: NVreg_DmaRemapPeerMmio:int 2024-06-26T07:08:37.1790170Z parm: NVreg_RmNvlinkBandwidth:charp 2024-06-26T07:08:37.1790665Z parm: NVreg_ImexChannelCount:int 2024-06-26T07:08:37.1791121Z parm: rm_firmware_active:charp 2024-06-26T07:08:37.1791543Z + HAS_NVIDIA_DRIVER=0 2024-06-26T07:08:37.1791966Z ++ command -v nvidia-smi 2024-06-26T07:08:37.1792402Z + '[' -x /usr/bin/nvidia-smi ']' 2024-06-26T07:08:37.1792780Z + set +e 2024-06-26T07:08:37.1793297Z ++ nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0 2024-06-26T07:08:39.1633936Z + INSTALLED_DRIVER_VERSION=550.54.15 2024-06-26T07:08:39.1634434Z + NVIDIA_SMI_STATUS=0 2024-06-26T07:08:39.1635406Z + '[' 0 -ne 0 ']' 2024-06-26T07:08:39.1635934Z + '[' 550.54.15 '!=' 550.54.15 ']' 2024-06-26T07:08:39.1636418Z + HAS_NVIDIA_DRIVER=1 2024-06-26T07:08:39.1637175Z + echo 'NVIDIA driver (550.54.15) has already been installed. Skipping NVIDIA driver installation' 2024-06-26T07:08:39.1637896Z + set -e 2024-06-26T07:08:39.1638212Z + '[' 1 -eq 0 ']' 2024-06-26T07:08:39.1638549Z + post_install_nvidia_driver_common 2024-06-26T07:08:39.1639230Z NVIDIA driver (550.54.15) has already been installed. Skipping NVIDIA driver installation 2024-06-26T07:08:39.1639911Z + sudo modprobe nvidia 2024-06-26T07:08:39.1733074Z + echo 'After installing NVIDIA driver' 2024-06-26T07:08:39.1733753Z + lspci 2024-06-26T07:08:39.1734170Z After installing NVIDIA driver 2024-06-26T07:08:39.1812018Z 00:00.0 Host bridge: Intel Corporation 440FX - 82441FX PMC [Natoma] 2024-06-26T07:08:39.1813039Z 00:01.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II] 2024-06-26T07:08:39.1813993Z 00:01.3 Non-VGA unclassified device: Intel Corporation 82371AB/EB/MB PIIX4 ACPI (rev 08) 2024-06-26T07:08:39.1814813Z 00:03.0 VGA compatible controller: Amazon.com, Inc. Device 1111 2024-06-26T07:08:39.1815583Z 00:04.0 Non-Volatile memory controller: Amazon.com, Inc. Device 8061 2024-06-26T07:08:39.1817538Z 00:05.0 Ethernet controller: Amazon.com, Inc. Elastic Network Adapter (ENA) 2024-06-26T07:08:39.1818275Z 00:1e.0 3D controller: NVIDIA Corporation Device 2237 (rev a1) 2024-06-26T07:08:39.1819081Z 00:1f.0 Non-Volatile memory controller: Amazon.com, Inc. NVMe SSD Controller 2024-06-26T07:08:39.1819685Z + lsmod 2024-06-26T07:08:39.1826889Z Module Size Used by 2024-06-26T07:08:39.1827818Z xt_nat 16384 0 2024-06-26T07:08:39.1828328Z ib_core 266240 0 2024-06-26T07:08:39.1828841Z nvidia_modeset 1339392 0 2024-06-26T07:08:39.1829293Z veth 16384 0 2024-06-26T07:08:39.1829668Z nvidia_uvm 4599808 0 2024-06-26T07:08:39.1830139Z nvidia 53989376 2 nvidia_uvm,nvidia_modeset 2024-06-26T07:08:39.1830638Z drm 421888 1 nvidia 2024-06-26T07:08:39.1831071Z i2c_core 77824 2 nvidia,drm 2024-06-26T07:08:39.1831542Z backlight 16384 1 nvidia_modeset 2024-06-26T07:08:39.1831996Z xt_conntrack 16384 1 2024-06-26T07:08:39.1832393Z ipt_MASQUERADE 16384 1 2024-06-26T07:08:39.1832876Z nf_nat_masquerade_ipv4 16384 1 ipt_MASQUERADE 2024-06-26T07:08:39.1833356Z nf_conntrack_netlink 49152 0 2024-06-26T07:08:39.1833816Z nfnetlink 16384 2 nf_conntrack_netlink 2024-06-26T07:08:39.1834400Z xfrm_user 45056 1 2024-06-26T07:08:39.1834930Z xfrm_algo 16384 1 xfrm_user 2024-06-26T07:08:39.1835519Z iptable_nat 16384 1 2024-06-26T07:08:39.1835914Z nf_conntrack_ipv4 16384 3 2024-06-26T07:08:39.1836362Z nf_defrag_ipv4 16384 1 nf_conntrack_ipv4 2024-06-26T07:08:39.1836998Z nf_nat_ipv4 16384 1 iptable_nat 2024-06-26T07:08:39.1837820Z nf_nat 32768 3 nf_nat_masquerade_ipv4,nf_nat_ipv4,xt_nat 2024-06-26T07:08:39.1839205Z nf_conntrack 155648 8 xt_conntrack,nf_nat_masquerade_ipv4,nf_conntrack_ipv4,nf_nat,ipt_MASQUERADE,nf_nat_ipv4,xt_nat,nf_conntrack_netlink 2024-06-26T07:08:39.1840470Z xt_addrtype 16384 2 2024-06-26T07:08:39.1841042Z iptable_filter 16384 1 2024-06-26T07:08:39.1841593Z br_netfilter 24576 0 2024-06-26T07:08:39.1842163Z bridge 172032 1 br_netfilter 2024-06-26T07:08:39.1842792Z stp 16384 1 bridge 2024-06-26T07:08:39.1843456Z llc 16384 2 bridge,stp 2024-06-26T07:08:39.1844005Z overlay 86016 0 2024-06-26T07:08:39.1844480Z sunrpc 393216 1 2024-06-26T07:08:39.1844917Z dm_mirror 28672 0 2024-06-26T07:08:39.1845325Z dm_region_hash 20480 1 dm_mirror 2024-06-26T07:08:39.1845830Z dm_log 20480 2 dm_region_hash,dm_mirror 2024-06-26T07:08:39.1846503Z dm_mod 143360 2 dm_log,dm_mirror 2024-06-26T07:08:39.1846971Z dax 69632 1 dm_mod 2024-06-26T07:08:39.1847388Z crc32_pclmul 16384 0 2024-06-26T07:08:39.1847770Z ghash_clmulni_intel 16384 0 2024-06-26T07:08:39.1848162Z pcbc 16384 0 2024-06-26T07:08:39.1848538Z aesni_intel 188416 0 2024-06-26T07:08:39.1849242Z aes_x86_64 20480 1 aesni_intel 2024-06-26T07:08:39.1849699Z crypto_simd 16384 1 aesni_intel 2024-06-26T07:08:39.1850160Z glue_helper 16384 1 aesni_intel 2024-06-26T07:08:39.1850730Z cryptd 28672 3 crypto_simd,ghash_clmulni_intel,aesni_intel 2024-06-26T07:08:39.1851301Z mousedev 24576 0 2024-06-26T07:08:39.1851674Z evdev 20480 3 2024-06-26T07:08:39.1852048Z psmouse 32768 0 2024-06-26T07:08:39.1852420Z button 16384 0 2024-06-26T07:08:39.1852790Z ena 139264 0 2024-06-26T07:08:39.1853167Z ptp 20480 1 ena 2024-06-26T07:08:39.1853573Z pps_core 20480 1 ptp 2024-06-26T07:08:39.1853974Z crc32c_intel 24576 0 2024-06-26T07:08:39.1854343Z autofs4 49152 2 2024-06-26T07:08:39.1854710Z + modinfo nvidia 2024-06-26T07:08:39.1855374Z filename: /lib/modules/4.14.336-257.562.amzn2.x86_64/kernel/drivers/video/nvidia.ko 2024-06-26T07:08:39.1856090Z alias: char-major-195-* 2024-06-26T07:08:39.1856475Z version: 550.54.15 2024-06-26T07:08:39.1856829Z supported: external 2024-06-26T07:08:39.1857175Z license: NVIDIA 2024-06-26T07:08:39.1857564Z firmware: nvidia/550.54.15/gsp_tu10x.bin 2024-06-26T07:08:39.1858161Z firmware: nvidia/550.54.15/gsp_ga10x.bin 2024-06-26T07:08:39.1858636Z srcversion: 833721318DA517F0C2FEC97 2024-06-26T07:08:39.1859111Z alias: pci:v000010DEd*sv*sd*bc06sc80i00* 2024-06-26T07:08:39.1859621Z alias: pci:v000010DEd*sv*sd*bc03sc02i00* 2024-06-26T07:08:39.1860250Z alias: pci:v000010DEd*sv*sd*bc03sc00i00* 2024-06-26T07:08:39.1860753Z depends: i2c-core,drm 2024-06-26T07:08:39.1861120Z retpoline: Y 2024-06-26T07:08:39.1861430Z name: nvidia 2024-06-26T07:08:39.1861998Z vermagic: 4.14.336-257.562.amzn2.x86_64 SMP mod_unload modversions 2024-06-26T07:08:39.1862678Z parm: NvSwitchRegDwords:NvSwitch regkey (charp) 2024-06-26T07:08:39.1863358Z parm: NvSwitchBlacklist:NvSwitchBlacklist=uuid[,uuid...] (charp) 2024-06-26T07:08:39.1863973Z parm: NVreg_ResmanDebugLevel:int 2024-06-26T07:08:39.1864431Z parm: NVreg_RmLogonRC:int 2024-06-26T07:08:39.1864875Z parm: NVreg_ModifyDeviceFiles:int 2024-06-26T07:08:39.1865351Z parm: NVreg_DeviceFileUID:int 2024-06-26T07:08:39.1865797Z parm: NVreg_DeviceFileGID:int 2024-06-26T07:08:39.1866238Z parm: NVreg_DeviceFileMode:int 2024-06-26T07:08:39.1866781Z parm: NVreg_InitializeSystemMemoryAllocations:int 2024-06-26T07:08:39.1867366Z parm: NVreg_UsePageAttributeTable:int 2024-06-26T07:08:39.1867871Z parm: NVreg_EnablePCIeGen3:int 2024-06-26T07:08:39.1868302Z parm: NVreg_EnableMSI:int 2024-06-26T07:08:39.1868729Z parm: NVreg_TCEBypassMode:int 2024-06-26T07:08:39.1869197Z parm: NVreg_EnableStreamMemOPs:int 2024-06-26T07:08:39.1869742Z parm: NVreg_RestrictProfilingToAdminUsers:int 2024-06-26T07:08:39.1870342Z parm: NVreg_PreserveVideoMemoryAllocations:int 2024-06-26T07:08:39.1870915Z parm: NVreg_EnableS0ixPowerManagement:int 2024-06-26T07:08:39.1871540Z parm: NVreg_S0ixPowerManagementVideoMemoryThreshold:int 2024-06-26T07:08:39.1872159Z parm: NVreg_DynamicPowerManagement:int 2024-06-26T07:08:39.1872781Z parm: NVreg_DynamicPowerManagementVideoMemoryThreshold:int 2024-06-26T07:08:39.1873389Z parm: NVreg_EnableGpuFirmware:int 2024-06-26T07:08:39.1873898Z parm: NVreg_EnableGpuFirmwareLogs:int 2024-06-26T07:08:39.1874543Z parm: NVreg_OpenRmEnableUnsupportedGpus:int 2024-06-26T07:08:39.1875109Z parm: NVreg_EnableUserNUMAManagement:int 2024-06-26T07:08:39.1875619Z parm: NVreg_MemoryPoolSize:int 2024-06-26T07:08:39.1876091Z parm: NVreg_KMallocHeapMaxSize:int 2024-06-26T07:08:39.1876610Z parm: NVreg_VMallocHeapMaxSize:int 2024-06-26T07:08:39.1877111Z parm: NVreg_IgnoreMMIOCheck:int 2024-06-26T07:08:39.1877579Z parm: NVreg_NvLinkDisable:int 2024-06-26T07:08:39.1878092Z parm: NVreg_EnablePCIERelaxedOrderingMode:int 2024-06-26T07:08:39.1878635Z parm: NVreg_RegisterPCIDriver:int 2024-06-26T07:08:39.1879134Z parm: NVreg_EnableResizableBar:int 2024-06-26T07:08:39.1879624Z parm: NVreg_EnableDbgBreakpoint:int 2024-06-26T07:08:39.1880142Z parm: NVreg_EnableNonblockingOpen:int 2024-06-26T07:08:39.1880641Z parm: NVreg_RegistryDwords:charp 2024-06-26T07:08:39.1881163Z parm: NVreg_RegistryDwordsPerDevice:charp 2024-06-26T07:08:39.1881660Z parm: NVreg_RmMsg:charp 2024-06-26T07:08:39.1882088Z parm: NVreg_GpuBlacklist:charp 2024-06-26T07:08:39.1882574Z parm: NVreg_TemporaryFilePath:charp 2024-06-26T07:08:39.1883104Z parm: NVreg_ExcludedGpus:charp 2024-06-26T07:08:39.1883562Z parm: NVreg_DmaRemapPeerMmio:int 2024-06-26T07:08:39.1884059Z parm: NVreg_RmNvlinkBandwidth:charp 2024-06-26T07:08:39.1884545Z parm: NVreg_ImexChannelCount:int 2024-06-26T07:08:39.1885007Z parm: rm_firmware_active:charp 2024-06-26T07:08:39.1885420Z + set +e 2024-06-26T07:08:39.1885744Z + nvidia-smi 2024-06-26T07:08:40.7564451Z Wed Jun 26 07:08:40 2024 2024-06-26T07:08:40.7565327Z +-----------------------------------------------------------------------------------------+ 2024-06-26T07:08:40.7566383Z | NVIDIA-SMI 550.54.15 Driver Version: 550.54.15 CUDA Version: 12.4 | 2024-06-26T07:08:40.7567278Z |-----------------------------------------+------------------------+----------------------+ 2024-06-26T07:08:40.7568090Z | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | 2024-06-26T07:08:40.7569303Z | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | 2024-06-26T07:08:40.7570010Z | | | MIG M. | 2024-06-26T07:08:40.7570576Z |=========================================+========================+======================| 2024-06-26T07:08:40.7692040Z | 0 NVIDIA A10G Off | 00000000:00:1E.0 Off | 0 | 2024-06-26T07:08:40.7692794Z | 0% 33C P0 59W / 300W | 0MiB / 23028MiB | 0% Default | 2024-06-26T07:08:40.7693449Z | | | N/A | 2024-06-26T07:08:40.7694264Z +-----------------------------------------+------------------------+----------------------+ 2024-06-26T07:08:40.7694939Z 2024-06-26T07:08:40.7695610Z +-----------------------------------------------------------------------------------------+ 2024-06-26T07:08:40.7696250Z | Processes: | 2024-06-26T07:08:40.7696973Z | GPU GI CI PID Type Process name GPU Memory | 2024-06-26T07:08:40.7697687Z | ID ID Usage | 2024-06-26T07:08:40.7698260Z |=========================================================================================| 2024-06-26T07:08:40.7698922Z | No running processes found | 2024-06-26T07:08:40.7699680Z +-----------------------------------------------------------------------------------------+ 2024-06-26T07:08:41.3903243Z + nvidia-smi --query-gpu=gpu_name --format=csv,noheader --id=0 2024-06-26T07:08:42.9577865Z NVIDIA A10G 2024-06-26T07:08:43.3961577Z + NVIDIA_SMI_STATUS=0 2024-06-26T07:08:43.3962255Z + '[' 0 -eq 0 ']' 2024-06-26T07:08:43.3962784Z + echo 'INFO: Ignoring allowed status 0' 2024-06-26T07:08:43.3963314Z + set -e 2024-06-26T07:08:43.3963683Z INFO: Ignoring allowed status 0 2024-06-26T07:08:43.3965824Z == Installing nvidia container toolkit for amzn2 == 2024-06-26T07:08:43.3967988Z + sudo yum install -y yum-utils 2024-06-26T07:08:43.6987324Z Loaded plugins: extras_suggestions, langpacks, priorities, update-motd 2024-06-26T07:08:45.4035017Z Package yum-utils-1.1.31-46.amzn2.0.1.noarch already installed and latest version 2024-06-26T07:08:45.4035761Z Nothing to do 2024-06-26T07:08:45.5519872Z + [[ amzn2 == \a\m\z\n\2\0\2\3 ]] 2024-06-26T07:08:45.5534749Z + YUM_REPO_URL=https://nvidia.github.io/nvidia-docker/amzn2/nvidia-docker.repo 2024-06-26T07:08:45.5535849Z + sudo yum-config-manager --add-repo https://nvidia.github.io/nvidia-docker/amzn2/nvidia-docker.repo 2024-06-26T07:08:45.8708584Z Loaded plugins: extras_suggestions, langpacks, priorities, update-motd 2024-06-26T07:08:45.8947451Z adding repo from: https://nvidia.github.io/nvidia-docker/amzn2/nvidia-docker.repo 2024-06-26T07:08:45.8948655Z grabbing file https://nvidia.github.io/nvidia-docker/amzn2/nvidia-docker.repo to /etc/yum.repos.d/nvidia-docker.repo 2024-06-26T07:08:45.8949632Z repo saved to /etc/yum.repos.d/nvidia-docker.repo 2024-06-26T07:08:45.9061634Z + sudo yum install -y nvidia-docker2 2024-06-26T07:08:46.2049477Z Loaded plugins: extras_suggestions, langpacks, priorities, update-motd 2024-06-26T07:08:47.6668591Z Package nvidia-docker2-2.13.0-1.noarch already installed and latest version 2024-06-26T07:08:47.6669614Z Nothing to do 2024-06-26T07:08:47.8138357Z + sudo systemctl restart docker 2024-06-26T07:09:27.8267140Z Command completed after 1 attempt(s). 2024-06-26T07:09:27.8323617Z ##[group]Run python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84 2024-06-26T07:09:27.8324397Z python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84 2024-06-26T07:09:27.8325100Z python3 -m tools.stats.monitor > usage_log.txt 2>&1 & 2024-06-26T07:09:27.8325772Z echo "monitor-script-pid=${!}" >> "${GITHUB_OUTPUT}" 2024-06-26T07:09:27.8333889Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:09:27.8334395Z env: 2024-06-26T07:09:27.8334683Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:09:27.8335144Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:09:27.8335628Z ##[endgroup] 2024-06-26T07:09:28.0552312Z Defaulting to user installation because normal site-packages is not writeable 2024-06-26T07:09:28.0711079Z Requirement already satisfied: psutil==5.9.1 in /home/ec2-user/.local/lib/python3.7/site-packages (5.9.1) 2024-06-26T07:09:28.0810470Z Requirement already satisfied: nvidia-ml-py==11.525.84 in /home/ec2-user/.local/lib/python3.7/site-packages (11.525.84) 2024-06-26T07:09:28.1746612Z Prepare all required actions 2024-06-26T07:09:28.1747127Z Getting action download info 2024-06-26T07:09:28.2891880Z Download action repository 'seemethere/download-artifact-s3@v4' (SHA:1da556a7aa0a088e3153970611f6c432d58e80e6) 2024-06-26T07:09:28.4614736Z Download action repository 'actions/download-artifact@v3' (SHA:9bc31d5ccc31df68ecc42ccf4149144866c47d8a) 2024-06-26T07:09:28.6036587Z ##[group]Run ./.github/actions/download-build-artifacts 2024-06-26T07:09:28.6037073Z with: 2024-06-26T07:09:28.6037416Z name: linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-06-26T07:09:28.6037880Z s3-bucket: gha-artifacts 2024-06-26T07:09:28.6038222Z env: 2024-06-26T07:09:28.6038491Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:09:28.6038963Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:09:28.6039452Z ##[endgroup] 2024-06-26T07:09:29.6398662Z ##[group]Run seemethere/download-artifact-s3@v4 2024-06-26T07:09:29.6399117Z with: 2024-06-26T07:09:29.6399493Z name: linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-06-26T07:09:29.6399958Z s3-bucket: gha-artifacts 2024-06-26T07:09:29.6400314Z region: us-east-1 2024-06-26T07:09:29.6400625Z env: 2024-06-26T07:09:29.6400911Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:09:29.6401371Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:09:29.6401858Z ##[endgroup] 2024-06-26T07:09:30.0511666Z (node:9176) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2024-06-26T07:09:30.0512464Z 2024-06-26T07:09:30.0512740Z Please migrate your code to use AWS SDK for JavaScript (v3). 2024-06-26T07:09:30.0513487Z For more information, check the migration guide at https://a.co/7PzMCcy 2024-06-26T07:09:30.0514404Z (Use `node --trace-warnings ...` to show where the warning was created) 2024-06-26T07:09:30.1191628Z Found 1 objects with prefix pytorch/pytorch/9673646808/linux-focal-cuda12.1-py3.10-gcc9-sm86/ 2024-06-26T07:09:30.1192752Z Starting download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2024-06-26T07:09:37.6038536Z Finished download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2024-06-26T07:09:37.6044839Z Artifact download has finished successfully 2024-06-26T07:09:37.6203905Z ##[group]Run unzip -o artifacts.zip 2024-06-26T07:09:37.6204359Z unzip -o artifacts.zip 2024-06-26T07:09:37.6212614Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:09:37.6213128Z env: 2024-06-26T07:09:37.6213408Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:09:37.6213871Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:09:37.6214361Z ##[endgroup] 2024-06-26T07:09:37.6240590Z Archive: artifacts.zip 2024-06-26T07:09:37.6242125Z creating: dist/ 2024-06-26T07:09:39.5934133Z inflating: dist/torch-2.5.0a0+gitb8c4c54-cp310-cp310-linux_x86_64.whl 2024-06-26T07:09:39.5935013Z creating: build/custom_test_artifacts/ 2024-06-26T07:09:39.5935715Z creating: build/custom_test_artifacts/custom-op-build/ 2024-06-26T07:09:39.5936472Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/ 2024-06-26T07:09:39.5937324Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/pkgRedirects/ 2024-06-26T07:09:39.5941479Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeConfigureLog.yaml 2024-06-26T07:09:39.5942527Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/ 2024-06-26T07:09:39.5943756Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-06-26T07:09:39.5945002Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-06-26T07:09:39.5946237Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-06-26T07:09:39.5947452Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-06-26T07:09:39.5949031Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-06-26T07:09:39.5950341Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-06-26T07:09:39.5951594Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-06-26T07:09:39.5952917Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-06-26T07:09:39.5954477Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-06-26T07:09:39.5955644Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-06-26T07:09:39.5956800Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-06-26T07:09:39.5958000Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-06-26T07:09:39.5959176Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-06-26T07:09:39.5960223Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/ 2024-06-26T07:09:39.5961242Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/ 2024-06-26T07:09:39.5993458Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2024-06-26T07:09:39.6031254Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2024-06-26T07:09:39.6032741Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2024-06-26T07:09:39.6075364Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2024-06-26T07:09:39.6077348Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2024-06-26T07:09:39.6079245Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2024-06-26T07:09:39.6081367Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2024-06-26T07:09:39.6083113Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2024-06-26T07:09:39.6084545Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2024-06-26T07:09:39.6085974Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2024-06-26T07:09:39.6087567Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2024-06-26T07:09:39.6089125Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2024-06-26T07:09:39.6090438Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2024-06-26T07:09:39.6091688Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c 2024-06-26T07:09:39.6092926Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin 2024-06-26T07:09:39.6094175Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2024-06-26T07:09:39.6095387Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o 2024-06-26T07:09:39.6096627Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu 2024-06-26T07:09:39.6141604Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out 2024-06-26T07:09:39.6199255Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin 2024-06-26T07:09:39.6202324Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake 2024-06-26T07:09:39.6204981Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeScratch/ 2024-06-26T07:09:39.6206739Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeTmp/ 2024-06-26T07:09:39.6208972Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/cmake.check_cache 2024-06-26T07:09:39.6210427Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/ 2024-06-26T07:09:39.6211471Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.ts 2024-06-26T07:09:39.6212640Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.make 2024-06-26T07:09:39.6213753Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/depend.make 2024-06-26T07:09:39.6214812Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/link.txt 2024-06-26T07:09:39.6215910Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/cmake_clean.cmake 2024-06-26T07:09:39.6217003Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/build.make 2024-06-26T07:09:39.6218095Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/DependInfo.cmake 2024-06-26T07:09:39.6219182Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/flags.make 2024-06-26T07:09:39.6220265Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/progress.make 2024-06-26T07:09:39.6224418Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o.d 2024-06-26T07:09:39.6351560Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o 2024-06-26T07:09:39.6352990Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/ 2024-06-26T07:09:39.6354458Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.ts 2024-06-26T07:09:39.6355756Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.make 2024-06-26T07:09:39.6356940Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/depend.make 2024-06-26T07:09:39.6358046Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/link.txt 2024-06-26T07:09:39.6359358Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/cmake_clean.cmake 2024-06-26T07:09:39.6360523Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/build.make 2024-06-26T07:09:39.6361682Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/DependInfo.cmake 2024-06-26T07:09:39.6362829Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/flags.make 2024-06-26T07:09:39.6363958Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/progress.make 2024-06-26T07:09:39.6375072Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o.d 2024-06-26T07:09:39.6455304Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o 2024-06-26T07:09:39.6456780Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-06-26T07:09:39.6458121Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/TargetDirectories.txt 2024-06-26T07:09:39.6459223Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/progress.marks 2024-06-26T07:09:39.6460415Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile2 2024-06-26T07:09:39.6461433Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile.cmake 2024-06-26T07:09:39.6462352Z inflating: build/custom_test_artifacts/custom-op-build/detect_cuda_version.cc 2024-06-26T07:09:39.6463206Z inflating: build/custom_test_artifacts/custom-op-build/CMakeCache.txt 2024-06-26T07:09:39.6464002Z inflating: build/custom_test_artifacts/custom-op-build/Makefile 2024-06-26T07:09:39.6464824Z inflating: build/custom_test_artifacts/custom-op-build/cmake_install.cmake 2024-06-26T07:09:39.6569773Z inflating: build/custom_test_artifacts/custom-op-build/libcustom_ops.so 2024-06-26T07:09:39.6628971Z inflating: build/custom_test_artifacts/custom-op-build/test_custom_ops 2024-06-26T07:09:39.6629940Z creating: build/custom_test_artifacts/jit-hook-build/ 2024-06-26T07:09:39.6630660Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/ 2024-06-26T07:09:39.6631488Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/pkgRedirects/ 2024-06-26T07:09:39.6636514Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeConfigureLog.yaml 2024-06-26T07:09:39.6637666Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/ 2024-06-26T07:09:39.6638727Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-06-26T07:09:39.6640004Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-06-26T07:09:39.6641158Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-06-26T07:09:39.6642340Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-06-26T07:09:39.6643754Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-06-26T07:09:39.6645005Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-06-26T07:09:39.6646281Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-06-26T07:09:39.6647728Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-06-26T07:09:39.6649308Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-06-26T07:09:39.6650444Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-06-26T07:09:39.6651582Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-06-26T07:09:39.6652916Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-06-26T07:09:39.6654089Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-06-26T07:09:39.6655131Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/ 2024-06-26T07:09:39.6656145Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/ 2024-06-26T07:09:39.6687616Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2024-06-26T07:09:39.6725109Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2024-06-26T07:09:39.6726579Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2024-06-26T07:09:39.6770107Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2024-06-26T07:09:39.6771825Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2024-06-26T07:09:39.6773753Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2024-06-26T07:09:39.6775426Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2024-06-26T07:09:39.6776934Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2024-06-26T07:09:39.6778352Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2024-06-26T07:09:39.6779746Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2024-06-26T07:09:39.6781246Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2024-06-26T07:09:39.6782629Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2024-06-26T07:09:39.6783920Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2024-06-26T07:09:39.6785169Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c 2024-06-26T07:09:39.6786386Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin 2024-06-26T07:09:39.6787620Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2024-06-26T07:09:39.6788829Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o 2024-06-26T07:09:39.6790062Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu 2024-06-26T07:09:39.6834856Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out 2024-06-26T07:09:39.6892759Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin 2024-06-26T07:09:39.6894400Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake 2024-06-26T07:09:39.6895793Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeScratch/ 2024-06-26T07:09:39.6896968Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeTmp/ 2024-06-26T07:09:39.6898093Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/cmake.check_cache 2024-06-26T07:09:39.6899058Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/ 2024-06-26T07:09:39.6900147Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.ts 2024-06-26T07:09:39.6901572Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.make 2024-06-26T07:09:39.6902739Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/depend.make 2024-06-26T07:09:39.6903822Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/link.txt 2024-06-26T07:09:39.6904944Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/cmake_clean.cmake 2024-06-26T07:09:39.6906074Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/build.make 2024-06-26T07:09:39.6907206Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/DependInfo.cmake 2024-06-26T07:09:39.6908335Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/flags.make 2024-06-26T07:09:39.6909447Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/progress.make 2024-06-26T07:09:39.6917936Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o.d 2024-06-26T07:09:39.6979398Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o 2024-06-26T07:09:39.6981026Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-06-26T07:09:39.6982223Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/TargetDirectories.txt 2024-06-26T07:09:39.6983231Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/progress.marks 2024-06-26T07:09:39.6984362Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile2 2024-06-26T07:09:39.6985279Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile.cmake 2024-06-26T07:09:39.6986195Z inflating: build/custom_test_artifacts/jit-hook-build/detect_cuda_version.cc 2024-06-26T07:09:39.6987054Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeCache.txt 2024-06-26T07:09:39.6987842Z inflating: build/custom_test_artifacts/jit-hook-build/Makefile 2024-06-26T07:09:39.6988666Z inflating: build/custom_test_artifacts/jit-hook-build/cmake_install.cmake 2024-06-26T07:09:39.7032634Z inflating: build/custom_test_artifacts/jit-hook-build/test_jit_hooks 2024-06-26T07:09:39.7033590Z creating: build/custom_test_artifacts/custom-backend-build/ 2024-06-26T07:09:39.7034360Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/ 2024-06-26T07:09:39.7035263Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/pkgRedirects/ 2024-06-26T07:09:39.7040528Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeConfigureLog.yaml 2024-06-26T07:09:39.7041707Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/ 2024-06-26T07:09:39.7042857Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-06-26T07:09:39.7044272Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-06-26T07:09:39.7045649Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-06-26T07:09:39.7046924Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-06-26T07:09:39.7048482Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-06-26T07:09:39.7050100Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-06-26T07:09:39.7051355Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-06-26T07:09:39.7052984Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-06-26T07:09:39.7054461Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-06-26T07:09:39.7055677Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-06-26T07:09:39.7056900Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-06-26T07:09:39.7058140Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-06-26T07:09:39.7078921Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-06-26T07:09:39.7080118Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/ 2024-06-26T07:09:39.7081204Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/ 2024-06-26T07:09:39.7092255Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2024-06-26T07:09:39.7130140Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2024-06-26T07:09:39.7133476Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2024-06-26T07:09:39.7173778Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2024-06-26T07:09:39.7175591Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2024-06-26T07:09:39.7177111Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2024-06-26T07:09:39.7178661Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2024-06-26T07:09:39.7180169Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2024-06-26T07:09:39.7195159Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2024-06-26T07:09:39.7197094Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2024-06-26T07:09:39.7199035Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2024-06-26T07:09:39.7200723Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2024-06-26T07:09:39.7202083Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2024-06-26T07:09:39.7203403Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c 2024-06-26T07:09:39.7204692Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin 2024-06-26T07:09:39.7205987Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2024-06-26T07:09:39.7207250Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o 2024-06-26T07:09:39.7208538Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu 2024-06-26T07:09:39.7259063Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out 2024-06-26T07:09:39.7318323Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin 2024-06-26T07:09:39.7320713Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake 2024-06-26T07:09:39.7322159Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeScratch/ 2024-06-26T07:09:39.7323108Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeTmp/ 2024-06-26T07:09:39.7324099Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/cmake.check_cache 2024-06-26T07:09:39.7325138Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/ 2024-06-26T07:09:39.7326384Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.ts 2024-06-26T07:09:39.7327659Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.make 2024-06-26T07:09:39.7329054Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/depend.make 2024-06-26T07:09:39.7330225Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/link.txt 2024-06-26T07:09:39.7331433Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/cmake_clean.cmake 2024-06-26T07:09:39.7332745Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/build.make 2024-06-26T07:09:39.7333956Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/DependInfo.cmake 2024-06-26T07:09:39.7335161Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/flags.make 2024-06-26T07:09:39.7336354Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/progress.make 2024-06-26T07:09:39.7337618Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o.d 2024-06-26T07:09:39.7448457Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o 2024-06-26T07:09:39.7450784Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/ 2024-06-26T07:09:39.7451995Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.ts 2024-06-26T07:09:39.7453346Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.make 2024-06-26T07:09:39.7454638Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/depend.make 2024-06-26T07:09:39.7455857Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/link.txt 2024-06-26T07:09:39.7457117Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/cmake_clean.cmake 2024-06-26T07:09:39.7458382Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/build.make 2024-06-26T07:09:39.7459662Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/DependInfo.cmake 2024-06-26T07:09:39.7461041Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/flags.make 2024-06-26T07:09:39.7462294Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/progress.make 2024-06-26T07:09:39.7470675Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o.d 2024-06-26T07:09:39.7523388Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o 2024-06-26T07:09:39.7524880Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-06-26T07:09:39.7526049Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/TargetDirectories.txt 2024-06-26T07:09:39.7527101Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/progress.marks 2024-06-26T07:09:39.7528234Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile2 2024-06-26T07:09:39.7529385Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile.cmake 2024-06-26T07:09:39.7530372Z inflating: build/custom_test_artifacts/custom-backend-build/detect_cuda_version.cc 2024-06-26T07:09:39.7531297Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeCache.txt 2024-06-26T07:09:39.7532141Z inflating: build/custom_test_artifacts/custom-backend-build/Makefile 2024-06-26T07:09:39.7533021Z inflating: build/custom_test_artifacts/custom-backend-build/cmake_install.cmake 2024-06-26T07:09:39.7629474Z inflating: build/custom_test_artifacts/custom-backend-build/libcustom_backend.so 2024-06-26T07:09:39.7669864Z inflating: build/custom_test_artifacts/custom-backend-build/test_custom_backend 2024-06-26T07:09:39.7670516Z creating: build/lib/ 2024-06-26T07:09:39.7755221Z inflating: build/lib/libprotobuf-lite.a 2024-06-26T07:09:39.8194010Z inflating: build/lib/libprotobuf.a 2024-06-26T07:09:39.8202885Z inflating: build/lib/libpthreadpool.a 2024-06-26T07:09:39.8210754Z inflating: build/lib/libcpuinfo.a 2024-06-26T07:09:39.8218416Z inflating: build/lib/libcpuinfo_internals.a 2024-06-26T07:09:39.8219479Z inflating: build/lib/libclog.a 2024-06-26T07:09:39.8236490Z inflating: build/lib/libnnpack.a 2024-06-26T07:09:39.8238418Z inflating: build/lib/libnnpack_reference_layers.a 2024-06-26T07:09:39.8300585Z inflating: build/lib/libgtest.a 2024-06-26T07:09:39.8372583Z inflating: build/lib/libbenchmark.a 2024-06-26T07:09:39.8434182Z inflating: build/lib/libasmjit.a 2024-06-26T07:09:39.8441248Z inflating: build/lib/libittnotify.a 2024-06-26T07:09:39.8467976Z inflating: build/lib/libtensorpipe_uv.a 2024-06-26T07:09:39.8589985Z inflating: build/lib/libgloo.a 2024-06-26T07:09:39.8611014Z inflating: build/lib/libfmt.a 2024-06-26T07:09:39.8699569Z inflating: build/lib/libc10.so 2024-06-26T07:09:39.8701158Z inflating: build/lib/libcaffe2_nvrtc.so 2024-06-26T07:09:39.8701659Z inflating: build/lib/libfoxi_loader.a 2024-06-26T07:09:39.8703005Z inflating: build/lib/libtorch_global_deps.so 2024-06-26T07:09:39.8721491Z inflating: build/lib/libpytorch_qnnpack.a 2024-06-26T07:09:39.8738896Z inflating: build/lib/libgmock.a 2024-06-26T07:09:39.8739358Z inflating: build/lib/libgtest_main.a 2024-06-26T07:09:39.8739976Z inflating: build/lib/libbenchmark_main.a 2024-06-26T07:09:39.9225212Z inflating: build/lib/libprotoc.a 2024-06-26T07:09:39.9595126Z inflating: build/lib/libgloo_cuda.a 2024-06-26T07:09:40.9313735Z inflating: build/lib/libdnnl.a 2024-06-26T07:09:40.9863434Z inflating: build/lib/libtensorpipe.a 2024-06-26T07:09:40.9915993Z inflating: build/lib/libc10_cuda.so 2024-06-26T07:09:40.9916464Z inflating: build/lib/libgmock_main.a 2024-06-26T07:09:41.1117243Z inflating: build/lib/libfbgemm.a 2024-06-26T07:09:41.1361779Z inflating: build/lib/libtensorpipe_cuda.a 2024-06-26T07:09:41.1858346Z inflating: build/lib/libkineto.a 2024-06-26T07:09:41.2035855Z inflating: build/lib/libXNNPACK.a 2024-06-26T07:09:41.2076328Z inflating: build/lib/libonnx_proto.a 2024-06-26T07:09:41.2740735Z inflating: build/lib/libonnx.a 2024-06-26T07:09:43.6010636Z inflating: build/lib/libtorch_cpu.so 2024-06-26T07:09:43.6014379Z inflating: build/lib/libunbox_lib.a 2024-06-26T07:09:43.6018199Z inflating: build/lib/libshm.so 2024-06-26T07:09:45.5872180Z inflating: build/lib/libtorch_cuda.so 2024-06-26T07:09:45.5873168Z inflating: build/lib/libtorch.so 2024-06-26T07:09:45.5875459Z inflating: build/lib/libc10d_cuda_test.so 2024-06-26T07:09:46.3816912Z inflating: build/lib/libtorch_cuda_linalg.so 2024-06-26T07:09:46.5707603Z inflating: build/lib/libtorch_python.so 2024-06-26T07:09:46.5774453Z inflating: build/lib/libtorchbind_test.so 2024-06-26T07:09:46.5794387Z inflating: build/lib/libjitbackend_test.so 2024-06-26T07:09:46.5818838Z inflating: build/lib/libbackend_with_compiler.so 2024-06-26T07:09:46.5852288Z inflating: build/lib/libnnapi_backend.so 2024-06-26T07:09:46.5852866Z creating: build/bin/ 2024-06-26T07:09:46.5901269Z inflating: build/bin/c10_CompileTimeFunctionPointer_test 2024-06-26T07:09:46.5951139Z inflating: build/bin/c10_DeviceGuard_test 2024-06-26T07:09:46.5999933Z inflating: build/bin/c10_Device_test 2024-06-26T07:09:46.6057281Z inflating: build/bin/c10_DispatchKeySet_test 2024-06-26T07:09:46.6109350Z inflating: build/bin/c10_Scalar_test 2024-06-26T07:09:46.6156791Z inflating: build/bin/c10_StreamGuard_test 2024-06-26T07:09:46.6206214Z inflating: build/bin/c10_SymInt_test 2024-06-26T07:09:46.6258996Z inflating: build/bin/c10_InlineDeviceGuard_test 2024-06-26T07:09:46.6312987Z inflating: build/bin/c10_InlineStreamGuard_test 2024-06-26T07:09:46.6367525Z inflating: build/bin/c10_SizesAndStrides_test 2024-06-26T07:09:46.6436362Z inflating: build/bin/c10_cow_test 2024-06-26T07:09:46.6488921Z inflating: build/bin/c10_Bitset_test 2024-06-26T07:09:46.6536275Z inflating: build/bin/c10_ConstexprCrc_test 2024-06-26T07:09:46.6583930Z inflating: build/bin/c10_DeadlockDetection_test 2024-06-26T07:09:46.6632926Z inflating: build/bin/c10_Half_test 2024-06-26T07:09:46.6688244Z inflating: build/bin/c10_LeftRight_test 2024-06-26T07:09:46.6740998Z inflating: build/bin/c10_Metaprogramming_test 2024-06-26T07:09:46.6789375Z inflating: build/bin/c10_Synchronized_test 2024-06-26T07:09:46.6843116Z inflating: build/bin/c10_ThreadLocal_test 2024-06-26T07:09:46.6893056Z inflating: build/bin/c10_TypeIndex_test 2024-06-26T07:09:46.6942700Z inflating: build/bin/c10_TypeList_test 2024-06-26T07:09:46.6990146Z inflating: build/bin/c10_TypeTraits_test 2024-06-26T07:09:46.7040787Z inflating: build/bin/c10_accumulate_test 2024-06-26T07:09:46.7095377Z inflating: build/bin/c10_bfloat16_test 2024-06-26T07:09:46.7143440Z inflating: build/bin/c10_bit_cast_test 2024-06-26T07:09:46.7198063Z inflating: build/bin/c10_complex_math_test 2024-06-26T07:09:46.7251992Z inflating: build/bin/c10_complex_test 2024-06-26T07:09:46.7303035Z inflating: build/bin/c10_exception_test 2024-06-26T07:09:46.7351837Z inflating: build/bin/c10_flags_test 2024-06-26T07:09:46.7400423Z inflating: build/bin/c10_generic_math_test 2024-06-26T07:09:46.7559100Z inflating: build/bin/c10_intrusive_ptr_test 2024-06-26T07:09:46.7608151Z inflating: build/bin/c10_irange_test 2024-06-26T07:09:46.7660097Z inflating: build/bin/c10_lazy_test 2024-06-26T07:09:46.7715510Z inflating: build/bin/c10_logging_test 2024-06-26T07:09:46.7788010Z inflating: build/bin/c10_optional_test 2024-06-26T07:09:46.7848153Z inflating: build/bin/c10_ordered_preserving_dict_test 2024-06-26T07:09:46.7901126Z inflating: build/bin/c10_registry_test 2024-06-26T07:09:46.8046311Z inflating: build/bin/c10_small_vector_test 2024-06-26T07:09:46.8097014Z inflating: build/bin/c10_ssize_test 2024-06-26T07:09:46.8146695Z inflating: build/bin/c10_string_util_test 2024-06-26T07:09:46.8204276Z inflating: build/bin/c10_string_view_test 2024-06-26T07:09:46.8252589Z inflating: build/bin/c10_tempfile_test 2024-06-26T07:09:46.8300248Z inflating: build/bin/c10_intrusive_ptr_benchmark 2024-06-26T07:09:46.8353857Z inflating: build/bin/c10_typeid_test 2024-06-26T07:09:46.8786541Z inflating: build/bin/protoc-3.13.0.0 2024-06-26T07:09:46.9219165Z inflating: build/bin/protoc 2024-06-26T07:09:46.9270579Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_1_var_test 2024-06-26T07:09:46.9321850Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_catches_stream 2024-06-26T07:09:46.9373542Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_catches_thread_and_block_and_device 2024-06-26T07:09:46.9423419Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_from_2_processes 2024-06-26T07:09:46.9474502Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_blocks_and_threads 2024-06-26T07:09:46.9525624Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_multiple_blocks 2024-06-26T07:09:46.9573200Z inflating: build/bin/c10_cuda_CUDATest 2024-06-26T07:09:46.9624588Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_same_block 2024-06-26T07:09:46.9942596Z inflating: build/bin/vec_test_all_types_DEFAULT 2024-06-26T07:09:47.0275335Z inflating: build/bin/vec_test_all_types_AVX512 2024-06-26T07:09:47.0622045Z inflating: build/bin/vec_test_all_types_AVX2 2024-06-26T07:09:47.0672888Z inflating: build/bin/FileStoreTest 2024-06-26T07:09:47.0726697Z inflating: build/bin/TCPStoreTest 2024-06-26T07:09:47.0779171Z inflating: build/bin/HashStoreTest 2024-06-26T07:09:47.0791504Z inflating: build/bin/ProcessGroupMPITest 2024-06-26T07:09:47.0843705Z inflating: build/bin/test_edge_op_registration 2024-06-26T07:09:47.0847645Z inflating: build/bin/torch_shm_manager 2024-06-26T07:09:47.0850417Z inflating: build/bin/example_allreduce 2024-06-26T07:09:47.0903590Z inflating: build/bin/test_dist_autograd 2024-06-26T07:09:47.0971689Z inflating: build/bin/test_cpp_rpc 2024-06-26T07:09:47.0972915Z inflating: build/bin/parallel_benchmark 2024-06-26T07:09:47.1038030Z inflating: build/bin/test_mobile_nnc 2024-06-26T07:09:47.1046473Z inflating: build/bin/aot_model_compiler_test 2024-06-26T07:09:47.1379655Z inflating: build/bin/test_lazy 2024-06-26T07:09:47.2524811Z inflating: build/bin/test_api 2024-06-26T07:09:47.2595651Z inflating: build/bin/Dict_test 2024-06-26T07:09:47.2645989Z inflating: build/bin/Dimname_test 2024-06-26T07:09:47.2708603Z inflating: build/bin/MaybeOwned_test 2024-06-26T07:09:47.2764002Z inflating: build/bin/NamedTensor_test 2024-06-26T07:09:47.2821464Z inflating: build/bin/apply_utils_test 2024-06-26T07:09:47.2878578Z inflating: build/bin/atest 2024-06-26T07:09:47.2939667Z inflating: build/bin/basic 2024-06-26T07:09:47.2992929Z inflating: build/bin/broadcast_test 2024-06-26T07:09:47.3042250Z inflating: build/bin/cpu_allocator_test 2024-06-26T07:09:47.3098621Z inflating: build/bin/cpu_generator_test 2024-06-26T07:09:47.3150022Z inflating: build/bin/cpu_profiling_allocator_test 2024-06-26T07:09:47.3240356Z inflating: build/bin/cpu_rng_test 2024-06-26T07:09:47.3289241Z inflating: build/bin/dispatch_key_set_test 2024-06-26T07:09:47.3337748Z inflating: build/bin/dlconvertor_test 2024-06-26T07:09:47.3394235Z inflating: build/bin/extension_backend_test 2024-06-26T07:09:47.3448288Z inflating: build/bin/half_test 2024-06-26T07:09:47.3541706Z inflating: build/bin/ivalue_test 2024-06-26T07:09:47.3589909Z inflating: build/bin/lazy_tensor_test 2024-06-26T07:09:47.3643197Z inflating: build/bin/math_kernel_test 2024-06-26T07:09:47.3695482Z inflating: build/bin/memory_format_test 2024-06-26T07:09:47.3747091Z inflating: build/bin/memory_overlapping_test 2024-06-26T07:09:47.3798543Z inflating: build/bin/mobile_memory_cleanup 2024-06-26T07:09:47.3852918Z inflating: build/bin/native_test 2024-06-26T07:09:47.3902728Z inflating: build/bin/operator_name_test 2024-06-26T07:09:47.3952133Z inflating: build/bin/operators_test 2024-06-26T07:09:47.4002334Z inflating: build/bin/packedtensoraccessor_test 2024-06-26T07:09:47.4067741Z inflating: build/bin/pow_test 2024-06-26T07:09:47.4123116Z inflating: build/bin/quantized_test 2024-06-26T07:09:47.4171672Z inflating: build/bin/reduce_ops_test 2024-06-26T07:09:47.4221404Z inflating: build/bin/reportMemoryUsage_test 2024-06-26T07:09:47.4276255Z inflating: build/bin/scalar_tensor_test 2024-06-26T07:09:47.4333351Z inflating: build/bin/scalar_test 2024-06-26T07:09:47.4383662Z inflating: build/bin/StorageUtils_test 2024-06-26T07:09:47.4434519Z inflating: build/bin/stride_properties_test 2024-06-26T07:09:47.4511936Z inflating: build/bin/tensor_iterator_test 2024-06-26T07:09:47.4564527Z inflating: build/bin/test_parallel 2024-06-26T07:09:47.4567286Z inflating: build/bin/thread_init_test 2024-06-26T07:09:47.4621638Z inflating: build/bin/type_ptr_test 2024-06-26T07:09:47.4680419Z inflating: build/bin/type_test 2024-06-26T07:09:47.4731223Z inflating: build/bin/undefined_tensor_test 2024-06-26T07:09:47.4732256Z inflating: build/bin/verify_api_visibility 2024-06-26T07:09:47.4799956Z inflating: build/bin/legacy_vmap_test 2024-06-26T07:09:47.4850285Z inflating: build/bin/weakref_test 2024-06-26T07:09:47.4900354Z inflating: build/bin/wrapdim_test 2024-06-26T07:09:47.4950554Z inflating: build/bin/xla_tensor_test 2024-06-26T07:09:47.5009944Z inflating: build/bin/IListRef_test 2024-06-26T07:09:47.5111689Z inflating: build/bin/List_test 2024-06-26T07:09:47.5176675Z inflating: build/bin/KernelFunction_test 2024-06-26T07:09:47.5295042Z inflating: build/bin/kernel_function_legacy_test 2024-06-26T07:09:47.5388799Z inflating: build/bin/kernel_function_test 2024-06-26T07:09:47.5513290Z inflating: build/bin/kernel_lambda_legacy_test 2024-06-26T07:09:47.5614254Z inflating: build/bin/kernel_lambda_test 2024-06-26T07:09:47.5674044Z inflating: build/bin/kernel_stackbased_test 2024-06-26T07:09:47.5768368Z inflating: build/bin/make_boxed_from_unboxed_functor_test 2024-06-26T07:09:47.5816953Z inflating: build/bin/CppSignature_test 2024-06-26T07:09:47.5871226Z inflating: build/bin/backend_fallback_test 2024-06-26T07:09:47.5918643Z inflating: build/bin/op_allowlist_test 2024-06-26T07:09:47.5981155Z inflating: build/bin/inline_container_test 2024-06-26T07:09:47.6273122Z inflating: build/bin/op_registration_test 2024-06-26T07:09:47.6323857Z inflating: build/bin/cuda_apply_test 2024-06-26T07:09:47.6373293Z inflating: build/bin/cuda_allocator_test 2024-06-26T07:09:47.6430785Z inflating: build/bin/cuda_atomic_ops_test 2024-06-26T07:09:47.6484314Z inflating: build/bin/cuda_caching_host_allocator_test 2024-06-26T07:09:47.6551600Z inflating: build/bin/cuda_complex_math_test 2024-06-26T07:09:47.6610085Z inflating: build/bin/cuda_complex_test 2024-06-26T07:09:47.6657725Z inflating: build/bin/cuda_device_test 2024-06-26T07:09:47.6712779Z inflating: build/bin/cuda_cub_test 2024-06-26T07:09:47.6761967Z inflating: build/bin/cuda_dlconvertor_test 2024-06-26T07:09:47.6824699Z inflating: build/bin/cuda_distributions_test 2024-06-26T07:09:47.6879426Z inflating: build/bin/cuda_generator_test 2024-06-26T07:09:47.6928059Z inflating: build/bin/cuda_half_test 2024-06-26T07:09:47.6978290Z inflating: build/bin/cuda_integer_divider_test 2024-06-26T07:09:47.7025361Z inflating: build/bin/cuda_optional_test 2024-06-26T07:09:47.7075330Z inflating: build/bin/cuda_packedtensoraccessor_test 2024-06-26T07:09:47.7126851Z inflating: build/bin/cuda_reportMemoryUsage_test 2024-06-26T07:09:47.7174952Z inflating: build/bin/cuda_allocatorTraceTracker_test 2024-06-26T07:09:47.7233773Z inflating: build/bin/cuda_stream_test 2024-06-26T07:09:47.7281439Z inflating: build/bin/cuda_cudnn_test 2024-06-26T07:09:47.7332094Z inflating: build/bin/cuda_vectorized_test 2024-06-26T07:09:47.7346694Z inflating: build/bin/tutorial_tensorexpr 2024-06-26T07:09:47.7410930Z inflating: build/bin/ProcessGroupGlooTest 2024-06-26T07:09:47.7466201Z inflating: build/bin/ProcessGroupGlooAsyncTest 2024-06-26T07:09:47.7527928Z inflating: build/bin/ProcessGroupNCCLTest 2024-06-26T07:09:47.7588061Z inflating: build/bin/ProcessGroupNCCLErrorsTest 2024-06-26T07:09:47.8393813Z inflating: build/bin/test_tensorexpr 2024-06-26T07:09:47.8952763Z inflating: build/bin/test_jit 2024-06-26T07:09:47.8953333Z creating: .additional_ci_files/ 2024-06-26T07:09:47.9007163Z inflating: .additional_ci_files/test-times.json 2024-06-26T07:09:47.9217417Z inflating: .additional_ci_files/test-class-times.json 2024-06-26T07:09:47.9243168Z ##[group]Run rm artifacts.zip 2024-06-26T07:09:47.9243570Z rm artifacts.zip 2024-06-26T07:09:47.9253302Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:09:47.9253821Z env: 2024-06-26T07:09:47.9254117Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:09:47.9254584Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:09:47.9255084Z ##[endgroup] 2024-06-26T07:09:47.9964546Z ##[group]Run df -H 2024-06-26T07:09:47.9965022Z df -H 2024-06-26T07:09:47.9975462Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:09:47.9976233Z env: 2024-06-26T07:09:47.9976638Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:09:47.9977330Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:09:47.9978046Z ##[endgroup] 2024-06-26T07:09:48.0006029Z Filesystem Size Used Avail Use% Mounted on 2024-06-26T07:09:48.0006725Z devtmpfs 34G 0 34G 0% /dev 2024-06-26T07:09:48.0007277Z tmpfs 34G 0 34G 0% /dev/shm 2024-06-26T07:09:48.0007993Z tmpfs 34G 455k 34G 1% /run 2024-06-26T07:09:48.0008945Z tmpfs 34G 0 34G 0% /sys/fs/cgroup 2024-06-26T07:09:48.0009668Z /dev/nvme0n1p1 162G 48G 114G 30% / 2024-06-26T07:09:48.0066344Z Prepare all required actions 2024-06-26T07:09:48.0067001Z Getting action download info 2024-06-26T07:09:48.1222669Z ##[group]Run ./.github/actions/download-td-artifacts 2024-06-26T07:09:48.1223171Z with: 2024-06-26T07:09:48.1223454Z env: 2024-06-26T07:09:48.1223737Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:09:48.1224202Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:09:48.1224697Z ##[endgroup] 2024-06-26T07:09:48.1255850Z ##[group]Run seemethere/download-artifact-s3@v4 2024-06-26T07:09:48.1256311Z with: 2024-06-26T07:09:48.1256583Z name: td_results 2024-06-26T07:09:48.1256911Z s3-bucket: gha-artifacts 2024-06-26T07:09:48.1257270Z region: us-east-1 2024-06-26T07:09:48.1257588Z env: 2024-06-26T07:09:48.1257861Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:09:48.1258324Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:09:48.1258815Z ##[endgroup] 2024-06-26T07:09:48.5282687Z (node:9198) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2024-06-26T07:09:48.5284080Z 2024-06-26T07:09:48.5284606Z Please migrate your code to use AWS SDK for JavaScript (v3). 2024-06-26T07:09:48.5286082Z For more information, check the migration guide at https://a.co/7PzMCcy 2024-06-26T07:09:48.5287778Z (Use `node --trace-warnings ...` to show where the warning was created) 2024-06-26T07:09:48.5976298Z Found 0 objects with prefix pytorch/pytorch/9673646808/td_results/ 2024-06-26T07:09:48.5983323Z Artifact download has finished successfully 2024-06-26T07:09:48.6113197Z ##[group]Run mkdir -p .additional_ci_files 2024-06-26T07:09:48.6113692Z mkdir -p .additional_ci_files 2024-06-26T07:09:48.6114268Z mv td_results.json .additional_ci_files/td_results.json 2024-06-26T07:09:48.6122113Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:09:48.6122660Z env: 2024-06-26T07:09:48.6122948Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:09:48.6123424Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:09:48.6123915Z ##[endgroup] 2024-06-26T07:09:48.6158848Z mv: cannot stat 'td_results.json': No such file or directory 2024-06-26T07:09:48.6169513Z ##[error]Process completed with exit code 1. 2024-06-26T07:09:48.6201139Z ##[group]Run .github/scripts/parse_ref.py 2024-06-26T07:09:48.6201635Z .github/scripts/parse_ref.py 2024-06-26T07:09:48.6208894Z shell: /usr/bin/bash -e {0} 2024-06-26T07:09:48.6209347Z env: 2024-06-26T07:09:48.6209640Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:09:48.6210110Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:09:48.6210599Z ##[endgroup] 2024-06-26T07:09:48.6435656Z Prepare all required actions 2024-06-26T07:09:48.6472589Z ##[group]Run ./.github/actions/get-workflow-job-id 2024-06-26T07:09:48.6473442Z with: 2024-06-26T07:09:48.6473987Z github-token: *** 2024-06-26T07:09:48.6474300Z env: 2024-06-26T07:09:48.6474575Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:09:48.6475039Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:09:48.6475530Z ##[endgroup] 2024-06-26T07:09:48.6491076Z ##[group]Run set -eux 2024-06-26T07:09:48.6491426Z set -eux 2024-06-26T07:09:48.6492030Z python3 .github/scripts/get_workflow_job_id.py "${GITHUB_RUN_ID}" "${RUNNER_NAME}" 2024-06-26T07:09:48.6499649Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:09:48.6500274Z env: 2024-06-26T07:09:48.6500564Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:09:48.6501032Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:09:48.6501687Z GITHUB_TOKEN: *** 2024-06-26T07:09:48.6502003Z ##[endgroup] 2024-06-26T07:09:48.6522202Z + python3 .github/scripts/get_workflow_job_id.py 9673646808 i-0588e66a1f859cab2 2024-06-26T07:09:49.8910153Z setting job-id=26688912903 2024-06-26T07:09:49.8911106Z setting job-name=cuda12.1-py3.10-gcc9-sm86 / test (inductor_cpp_wrapper_abi_compatible, 1, 1, linux.g5.4xlarge.nvidia.gpu) 2024-06-26T07:09:49.9130008Z Prepare all required actions 2024-06-26T07:09:49.9130462Z Getting action download info 2024-06-26T07:09:50.0236167Z ##[group]Run ./.github/actions/filter-test-configs 2024-06-26T07:09:50.0236635Z with: 2024-06-26T07:09:50.0237094Z github-token: *** 2024-06-26T07:09:50.0245321Z test-matrix: {"include": [{"config": "inductor", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_distributed", "shard": 1, "num_shards": 1, "runner": "linux.g5.12xlarge.nvidia.gpu"}, {"config": "inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_cpp_wrapper_abi_compatible", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}]} 2024-06-26T07:09:50.0254465Z job-name: cuda12.1-py3.10-gcc9-sm86 / test (inductor_cpp_wrapper_abi_compatible, 1, 1, linux.g5.4xlarge.nvidia.gpu) 2024-06-26T07:09:50.0255258Z env: 2024-06-26T07:09:50.0255539Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:09:50.0256010Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:09:50.0256494Z ##[endgroup] 2024-06-26T07:09:50.0297202Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2024-06-26T07:09:50.0297759Z with: 2024-06-26T07:09:50.0298168Z shell: bash 2024-06-26T07:09:50.0298477Z timeout_minutes: 10 2024-06-26T07:09:50.0298815Z max_attempts: 5 2024-06-26T07:09:50.0299129Z retry_wait_seconds: 30 2024-06-26T07:09:50.0300352Z command: set -eux # PyYAML 6.0 doesn't work with MacOS x86 anymore # This must run on Python-3.7 (AmazonLinux2) so can't use request=3.32.2 python3 -m pip install requests==2.27.1 pyyaml==6.0.1 2024-06-26T07:09:50.0301540Z polling_interval_seconds: 1 2024-06-26T07:09:50.0301921Z warning_on_retry: true 2024-06-26T07:09:50.0302268Z continue_on_error: false 2024-06-26T07:09:50.0302613Z env: 2024-06-26T07:09:50.0302894Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:09:50.0303359Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:09:50.0304001Z GITHUB_TOKEN: *** 2024-06-26T07:09:50.0304325Z ##[endgroup] 2024-06-26T07:09:50.0791302Z + python3 -m pip install requests==2.27.1 pyyaml==6.0.1 2024-06-26T07:09:50.2909939Z Defaulting to user installation because normal site-packages is not writeable 2024-06-26T07:09:50.3061019Z Requirement already satisfied: requests==2.27.1 in /home/ec2-user/.local/lib/python3.7/site-packages (2.27.1) 2024-06-26T07:09:50.3201518Z Requirement already satisfied: pyyaml==6.0.1 in /home/ec2-user/.local/lib/python3.7/site-packages (6.0.1) 2024-06-26T07:09:50.3210006Z Requirement already satisfied: idna<4,>=2.5; python_version >= "3" in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.27.1) (3.7) 2024-06-26T07:09:50.3222288Z Requirement already satisfied: charset-normalizer~=2.0.0; python_version >= "3" in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.27.1) (2.0.12) 2024-06-26T07:09:50.3241484Z Requirement already satisfied: urllib3<1.27,>=1.21.1 in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.27.1) (1.26.19) 2024-06-26T07:09:50.3434557Z Requirement already satisfied: certifi>=2017.4.17 in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.27.1) (2024.6.2) 2024-06-26T07:09:51.0795133Z Command completed after 1 attempt(s). 2024-06-26T07:09:51.0835253Z ##[group]Run set -x 2024-06-26T07:09:51.0835589Z set -x 2024-06-26T07:09:51.0835888Z  2024-06-26T07:09:51.0836454Z # Use relative path here as this could be checked out anywhere, not necessarily 2024-06-26T07:09:51.0837140Z # in runner workspace 2024-06-26T07:09:51.0837677Z python3 "${GITHUB_ACTION_PATH}/../../scripts/parse_ref.py" 2024-06-26T07:09:51.0845514Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:09:51.0846019Z env: 2024-06-26T07:09:51.0846294Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:09:51.0846756Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:09:51.0847250Z ##[endgroup] 2024-06-26T07:09:51.0867975Z + python3 /home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/filter-test-configs/../../scripts/parse_ref.py 2024-06-26T07:09:51.1064011Z ##[group]Run echo "Workflow: ${GITHUB_WORKFLOW}" 2024-06-26T07:09:51.1064601Z echo "Workflow: ${GITHUB_WORKFLOW}" 2024-06-26T07:09:51.1065073Z echo "Job name: ${JOB_NAME}" 2024-06-26T07:09:51.1065483Z  2024-06-26T07:09:51.1066067Z # Use relative path here as this could be checked out anywhere, not necessarily 2024-06-26T07:09:51.1066761Z # in runner workspace 2024-06-26T07:09:51.1067348Z python3 "${GITHUB_ACTION_PATH}/../../scripts/filter_test_configs.py" \ 2024-06-26T07:09:51.1068005Z  --workflow "${GITHUB_WORKFLOW}" \ 2024-06-26T07:09:51.1068472Z  --job-name "${JOB_NAME}" \ 2024-06-26T07:09:51.1076939Z  --test-matrix "{"include": [{"config": "inductor", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_distributed", "shard": 1, "num_shards": 1, "runner": "linux.g5.12xlarge.nvidia.gpu"}, {"config": "inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_cpp_wrapper_abi_compatible", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}]}" \ 2024-06-26T07:09:51.1085675Z  --selected-test-configs "" \ 2024-06-26T07:09:51.1086149Z  --pr-number "${PR_NUMBER}" \ 2024-06-26T07:09:51.1086579Z  --tag "${TAG}" \ 2024-06-26T07:09:51.1086982Z  --event-name "${EVENT_NAME}" \ 2024-06-26T07:09:51.1087434Z  --schedule "${SCHEDULE}" \ 2024-06-26T07:09:51.1087883Z  --branch "${HEAD_BRANCH}" 2024-06-26T07:09:51.1112837Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:09:51.1113351Z env: 2024-06-26T07:09:51.1113634Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:09:51.1114109Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:09:51.1114795Z GITHUB_TOKEN: *** 2024-06-26T07:09:51.1115534Z JOB_NAME: cuda12.1-py3.10-gcc9-sm86 / test (inductor_cpp_wrapper_abi_compatible, 1, 1, linux.g5.4xlarge.nvidia.gpu) 2024-06-26T07:09:51.1116342Z PR_NUMBER: 2024-06-26T07:09:51.1116660Z TAG: ciflow/inductor/129470 2024-06-26T07:09:51.1117037Z EVENT_NAME: push 2024-06-26T07:09:51.1117351Z SCHEDULE: 2024-06-26T07:09:51.1117640Z HEAD_BRANCH: 2024-06-26T07:09:51.1117944Z ##[endgroup] 2024-06-26T07:09:51.1138220Z Workflow: inductor 2024-06-26T07:09:51.1139183Z Job name: cuda12.1-py3.10-gcc9-sm86 / test (inductor_cpp_wrapper_abi_compatible, 1, 1, linux.g5.4xlarge.nvidia.gpu) 2024-06-26T07:09:51.3319408Z INFO:root:Found no test-config label on the PR, so all test configs are included 2024-06-26T07:09:51.4770678Z ##[group]Run echo "Filtered matrix:" 2024-06-26T07:09:51.4771155Z echo "Filtered matrix:" 2024-06-26T07:09:51.4779549Z echo "{"include": [{"config": "inductor", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_distributed", "shard": 1, "num_shards": 1, "runner": "linux.g5.12xlarge.nvidia.gpu"}, {"config": "inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_cpp_wrapper_abi_compatible", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}]}" 2024-06-26T07:09:51.4788315Z  2024-06-26T07:09:51.4788602Z echo 2024-06-26T07:09:51.4788992Z echo "Is the current job unstable? False" 2024-06-26T07:09:51.4789448Z  2024-06-26T07:09:51.4789723Z echo 2024-06-26T07:09:51.4790090Z echo "Is keep-going label set? False" 2024-06-26T07:09:51.4790536Z  2024-06-26T07:09:51.4790805Z echo 2024-06-26T07:09:51.4791126Z echo "Renabled issues? " 2024-06-26T07:09:51.4798850Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:09:51.4799360Z env: 2024-06-26T07:09:51.4799635Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:09:51.4800100Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:09:51.4800591Z ##[endgroup] 2024-06-26T07:09:51.4820775Z Filtered matrix: 2024-06-26T07:09:51.4831059Z {include: [{config: inductor, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: inductor, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: inductor_distributed, shard: 1, num_shards: 1, runner: linux.g5.12xlarge.nvidia.gpu}, {config: inductor_huggingface, shard: 1, num_shards: 1, runner: linux.g5.4xlarge.nvidia.gpu}, {config: inductor_timm, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: inductor_timm, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: inductor_torchbench, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: inductor_torchbench, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_inductor_huggingface, shard: 1, num_shards: 1, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_inductor_timm, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_inductor_timm, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_inductor_torchbench, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_inductor_torchbench, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: aot_inductor_huggingface, shard: 1, num_shards: 1, runner: linux.g5.4xlarge.nvidia.gpu}, {config: aot_inductor_timm, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: aot_inductor_timm, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: aot_inductor_torchbench, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: aot_inductor_torchbench, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: inductor_cpp_wrapper_abi_compatible, shard: 1, num_shards: 1, runner: linux.g5.4xlarge.nvidia.gpu}]} 2024-06-26T07:09:51.4839321Z 2024-06-26T07:09:51.4839485Z Is the current job unstable? False 2024-06-26T07:09:51.4839772Z 2024-06-26T07:09:51.4840005Z Is keep-going label set? False 2024-06-26T07:09:51.4840461Z 2024-06-26T07:09:51.4840584Z Renabled issues? 2024-06-26T07:09:51.4881312Z ##[group]Run echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2024-06-26T07:09:51.4882037Z echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2024-06-26T07:09:51.4889958Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:09:51.4890459Z env: 2024-06-26T07:09:51.4890744Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:09:51.4891210Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:09:51.4891703Z JOB_TIMEOUT: 240 2024-06-26T07:09:51.4892007Z ##[endgroup] 2024-06-26T07:09:51.4961771Z ##[group]Run set -x 2024-06-26T07:09:51.4962173Z set -x 2024-06-26T07:09:51.4962474Z  2024-06-26T07:09:51.4962836Z if [[ $TEST_CONFIG == 'multigpu' ]]; then 2024-06-26T07:09:51.4963388Z  TEST_COMMAND=.ci/pytorch/multigpu-test.sh 2024-06-26T07:09:51.4964014Z elif [[ $BUILD_ENVIRONMENT == *onnx* ]]; then 2024-06-26T07:09:51.4964553Z  TEST_COMMAND=.ci/onnx/test.sh 2024-06-26T07:09:51.4964973Z else 2024-06-26T07:09:51.4965321Z  TEST_COMMAND=.ci/pytorch/test.sh 2024-06-26T07:09:51.4965751Z fi 2024-06-26T07:09:51.4966031Z  2024-06-26T07:09:51.4966510Z # detached container should get cleaned up by teardown_ec2_linux 2024-06-26T07:09:51.4967276Z # TODO: Stop building test binaries as part of the build phase 2024-06-26T07:09:51.4967972Z # Used for GPU_FLAG since that doesn't play nice 2024-06-26T07:09:51.4968736Z # shellcheck disable=SC2086,SC2090 2024-06-26T07:09:51.4969273Z container_name=$(docker run \ 2024-06-26T07:09:51.4969703Z  ${GPU_FLAG:-} \ 2024-06-26T07:09:51.4970085Z  -e BUILD_ENVIRONMENT \ 2024-06-26T07:09:51.4970495Z  -e PR_NUMBER \ 2024-06-26T07:09:51.4970863Z  -e GITHUB_ACTIONS \ 2024-06-26T07:09:51.4971263Z  -e GITHUB_REPOSITORY \ 2024-06-26T07:09:51.4971682Z  -e GITHUB_WORKFLOW \ 2024-06-26T07:09:51.4972078Z  -e GITHUB_JOB \ 2024-06-26T07:09:51.4972442Z  -e GITHUB_RUN_ID \ 2024-06-26T07:09:51.4972827Z  -e GITHUB_RUN_NUMBER \ 2024-06-26T07:09:51.4973240Z  -e GITHUB_RUN_ATTEMPT \ 2024-06-26T07:09:51.4973637Z  -e JOB_ID \ 2024-06-26T07:09:51.4973980Z  -e JOB_NAME \ 2024-06-26T07:09:51.4974332Z  -e BASE_SHA \ 2024-06-26T07:09:51.4974680Z  -e BRANCH \ 2024-06-26T07:09:51.4975011Z  -e SHA1 \ 2024-06-26T07:09:51.4975363Z  -e AWS_DEFAULT_REGION \ 2024-06-26T07:09:51.4975780Z  -e IN_WHEEL_TEST \ 2024-06-26T07:09:51.4976163Z  -e SHARD_NUMBER \ 2024-06-26T07:09:51.4976534Z  -e TEST_CONFIG \ 2024-06-26T07:09:51.4976909Z  -e NUM_TEST_SHARDS \ 2024-06-26T07:09:51.4977307Z  -e REENABLED_ISSUES \ 2024-06-26T07:09:51.4977727Z  -e CONTINUE_THROUGH_ERROR \ 2024-06-26T07:09:51.4978160Z  -e VERBOSE_TEST_LOGS \ 2024-06-26T07:09:51.4978570Z  -e NO_TEST_TIMEOUT \ 2024-06-26T07:09:51.4978953Z  -e NO_TD \ 2024-06-26T07:09:51.4979303Z  -e TD_DISTRIBUTED \ 2024-06-26T07:09:51.4979685Z  -e PR_LABELS \ 2024-06-26T07:09:51.4980204Z  -e MAX_JOBS="$(nproc --ignore=2)" \ 2024-06-26T07:09:51.4980673Z  -e SCCACHE_BUCKET \ 2024-06-26T07:09:51.4981072Z  -e SCCACHE_S3_KEY_PREFIX \ 2024-06-26T07:09:51.4981487Z  -e XLA_CUDA \ 2024-06-26T07:09:51.4981910Z  -e XLA_CLANG_CACHE_S3_BUCKET_NAME \ 2024-06-26T07:09:51.4982433Z  -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK \ 2024-06-26T07:09:51.4982961Z  -e PYTORCH_TEST_RERUN_DISABLED_TESTS \ 2024-06-26T07:09:51.4983492Z  -e SKIP_SCCACHE_INITIALIZATION=1 \ 2024-06-26T07:09:51.4983969Z  -e HUGGING_FACE_HUB_TOKEN \ 2024-06-26T07:09:51.4984399Z  -e DASHBOARD_TAG \ 2024-06-26T07:09:51.4985027Z  --env-file="/tmp/github_env_${GITHUB_RUN_ID}" \ 2024-06-26T07:09:51.4985601Z  --security-opt seccomp=unconfined \ 2024-06-26T07:09:51.4986075Z  --cap-add=SYS_PTRACE \ 2024-06-26T07:09:51.4986475Z  --ipc=host \ 2024-06-26T07:09:51.4986842Z  --shm-size="${SHM_SIZE}" \ 2024-06-26T07:09:51.4987246Z  --tty \ 2024-06-26T07:09:51.4987570Z  --detach \ 2024-06-26T07:09:51.4987938Z  --name="${container_name}" \ 2024-06-26T07:09:51.4988361Z  --user jenkins \ 2024-06-26T07:09:51.4988933Z  -v "${GITHUB_WORKSPACE}:/var/lib/jenkins/workspace" \ 2024-06-26T07:09:51.4989519Z  -w /var/lib/jenkins/workspace \ 2024-06-26T07:09:51.4989969Z  "${DOCKER_IMAGE}" 2024-06-26T07:09:51.4990326Z ) 2024-06-26T07:09:51.4990743Z # Propagate download.pytorch.org IP to container 2024-06-26T07:09:51.4991675Z grep download.pytorch.org /etc/hosts | docker exec -i "${container_name}" sudo bash -c "/bin/cat >> /etc/hosts" 2024-06-26T07:09:51.4992660Z echo "DOCKER_CONTAINER_ID=${container_name}" >> "${GITHUB_ENV}" 2024-06-26T07:09:51.4993579Z docker exec -t "${container_name}" sh -c "pip install $(echo dist/*.whl)[opt-einsum] && ${TEST_COMMAND}" 2024-06-26T07:09:51.5001100Z shell: /usr/bin/bash -e {0} 2024-06-26T07:09:51.5001465Z env: 2024-06-26T07:09:51.5001746Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:09:51.5002211Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:09:51.5002825Z BUILD_ENVIRONMENT: linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-06-26T07:09:51.5003335Z PR_NUMBER: 2024-06-26T07:09:51.5003668Z GITHUB_REPOSITORY: pytorch/pytorch 2024-06-26T07:09:51.5004093Z GITHUB_WORKFLOW: inductor 2024-06-26T07:09:51.5004444Z GITHUB_JOB: test 2024-06-26T07:09:51.5004767Z GITHUB_RUN_ID: 9673646808 2024-06-26T07:09:51.5005130Z GITHUB_RUN_NUMBER: 76977 2024-06-26T07:09:51.5005480Z GITHUB_RUN_ATTEMPT: 1 2024-06-26T07:09:51.5005824Z JOB_ID: 26688912903 2024-06-26T07:09:51.5006561Z JOB_NAME: cuda12.1-py3.10-gcc9-sm86 / test (inductor_cpp_wrapper_abi_compatible, 1, 1, linux.g5.4xlarge.nvidia.gpu) 2024-06-26T07:09:51.5007348Z BRANCH: 2024-06-26T07:09:51.5007680Z SHA1: b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:09:51.5008198Z BASE_SHA: b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:09:51.5008921Z TEST_CONFIG: inductor_cpp_wrapper_abi_compatible 2024-06-26T07:09:51.5009395Z SHARD_NUMBER: 1 2024-06-26T07:09:51.5009700Z NUM_TEST_SHARDS: 1 2024-06-26T07:09:51.5010030Z REENABLED_ISSUES: 2024-06-26T07:09:51.5010385Z CONTINUE_THROUGH_ERROR: False 2024-06-26T07:09:51.5010777Z VERBOSE_TEST_LOGS: False 2024-06-26T07:09:51.5011132Z NO_TEST_TIMEOUT: False 2024-06-26T07:09:51.5011471Z NO_TD: False 2024-06-26T07:09:51.5011777Z TD_DISTRIBUTED: False 2024-06-26T07:09:51.5012198Z SCCACHE_BUCKET: ossci-compiler-cache-circleci-v2 2024-06-26T07:09:51.5012686Z SCCACHE_S3_KEY_PREFIX: inductor 2024-06-26T07:09:51.5013074Z SHM_SIZE: 2g 2024-06-26T07:09:51.5014164Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:09:51.5015343Z XLA_CUDA: 2024-06-26T07:09:51.5015822Z XLA_CLANG_CACHE_S3_BUCKET_NAME: ossci-compiler-clang-cache-circleci-xla 2024-06-26T07:09:51.5016437Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK: 0 2024-06-26T07:09:51.5016883Z PYTORCH_TEST_RERUN_DISABLED_TESTS: 0 2024-06-26T07:09:51.5017300Z DASHBOARD_TAG: 2024-06-26T07:09:51.5017824Z HUGGING_FACE_HUB_TOKEN: *** 2024-06-26T07:09:51.5018192Z ##[endgroup] 2024-06-26T07:09:51.5037406Z + [[ inductor_cpp_wrapper_abi_compatible == \m\u\l\t\i\g\p\u ]] 2024-06-26T07:09:51.5038221Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *onnx* ]] 2024-06-26T07:09:51.5038749Z + TEST_COMMAND=.ci/pytorch/test.sh 2024-06-26T07:09:51.5044234Z +++ nproc --ignore=2 2024-06-26T07:09:51.5065582Z ++ docker run --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all -e BUILD_ENVIRONMENT -e PR_NUMBER -e GITHUB_ACTIONS -e GITHUB_REPOSITORY -e GITHUB_WORKFLOW -e GITHUB_JOB -e GITHUB_RUN_ID -e GITHUB_RUN_NUMBER -e GITHUB_RUN_ATTEMPT -e JOB_ID -e JOB_NAME -e BASE_SHA -e BRANCH -e SHA1 -e AWS_DEFAULT_REGION -e IN_WHEEL_TEST -e SHARD_NUMBER -e TEST_CONFIG -e NUM_TEST_SHARDS -e REENABLED_ISSUES -e CONTINUE_THROUGH_ERROR -e VERBOSE_TEST_LOGS -e NO_TEST_TIMEOUT -e NO_TD -e TD_DISTRIBUTED -e PR_LABELS -e MAX_JOBS=14 -e SCCACHE_BUCKET -e SCCACHE_S3_KEY_PREFIX -e XLA_CUDA -e XLA_CLANG_CACHE_S3_BUCKET_NAME -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK -e PYTORCH_TEST_RERUN_DISABLED_TESTS -e SKIP_SCCACHE_INITIALIZATION=1 -e HUGGING_FACE_HUB_TOKEN -e DASHBOARD_TAG --env-file=/tmp/github_env_9673646808 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --ipc=host --shm-size=2g --tty --detach --name= --user jenkins -v /home/ec2-user/actions-runner/_work/pytorch/pytorch:/var/lib/jenkins/workspace -w /var/lib/jenkins/workspace 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:10:02.7242915Z + container_name=21f4e73c270d5ddb5f96e416bc6cbb7b3c0b9b5ecf60cf56efca911c1edbc7fd 2024-06-26T07:10:02.7244092Z + grep download.pytorch.org /etc/hosts 2024-06-26T07:10:02.7245603Z + docker exec -i 21f4e73c270d5ddb5f96e416bc6cbb7b3c0b9b5ecf60cf56efca911c1edbc7fd sudo bash -c '/bin/cat >> /etc/hosts' 2024-06-26T07:10:02.7845401Z + echo DOCKER_CONTAINER_ID=21f4e73c270d5ddb5f96e416bc6cbb7b3c0b9b5ecf60cf56efca911c1edbc7fd 2024-06-26T07:10:02.7848986Z ++ echo dist/torch-2.5.0a0+gitb8c4c54-cp310-cp310-linux_x86_64.whl 2024-06-26T07:10:02.7851321Z + docker exec -t 21f4e73c270d5ddb5f96e416bc6cbb7b3c0b9b5ecf60cf56efca911c1edbc7fd sh -c 'pip install dist/torch-2.5.0a0+gitb8c4c54-cp310-cp310-linux_x86_64.whl[opt-einsum] && .ci/pytorch/test.sh' 2024-06-26T07:10:03.1560111Z Processing ./dist/torch-2.5.0a0+gitb8c4c54-cp310-cp310-linux_x86_64.whl (from torch==2.5.0a0+gitb8c4c54) 2024-06-26T07:10:03.4696684Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (3.13.1) 2024-06-26T07:10:03.4698828Z Requirement already satisfied: typing-extensions>=4.8.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (4.12.2) 2024-06-26T07:10:03.4701727Z Requirement already satisfied: sympy in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (1.12.1) 2024-06-26T07:10:03.4705622Z Requirement already satisfied: networkx in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (2.8.8) 2024-06-26T07:10:03.4709229Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (3.1.4) 2024-06-26T07:10:03.4712889Z Requirement already satisfied: fsspec in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (2024.2.0) 2024-06-26T07:10:03.4739474Z Requirement already satisfied: opt-einsum>=3.3 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (3.3.0) 2024-06-26T07:10:03.4800202Z Requirement already satisfied: numpy>=1.7 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from opt-einsum>=3.3->torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (1.21.2) 2024-06-26T07:10:03.5236130Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from jinja2->torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (2.1.5) 2024-06-26T07:10:03.5395247Z Requirement already satisfied: mpmath<1.4.0,>=1.1.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from sympy->torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (1.3.0) 2024-06-26T07:10:04.8602824Z Installing collected packages: torch 2024-06-26T07:10:13.5694495Z ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 2024-06-26T07:10:13.5695901Z timm 0.9.7 requires torchvision, which is not installed. 2024-06-26T07:10:13.5696604Z Successfully installed torch-2.5.0a0+gitb8c4c54 2024-06-26T07:10:13.6561286Z ++ dirname .ci/pytorch/test.sh 2024-06-26T07:10:13.6563922Z + source .ci/pytorch/common.sh 2024-06-26T07:10:13.6566737Z +++ dirname .ci/pytorch/common.sh 2024-06-26T07:10:13.6573453Z ++ source .ci/pytorch/common_utils.sh 2024-06-26T07:10:13.6574411Z +++ declare -f -t trap_add 2024-06-26T07:10:13.6579189Z ++ set -ex 2024-06-26T07:10:13.6579745Z ++ [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *rocm* ]] 2024-06-26T07:10:13.6581729Z ++ BUILD_TEST_LIBTORCH=0 2024-06-26T07:10:13.6582638Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *rocm* ]] 2024-06-26T07:10:13.6583768Z ++ stat -c %u /var/lib/jenkins/workspace 2024-06-26T07:10:13.6592546Z + WORKSPACE_ORIGINAL_OWNER_ID=1000 2024-06-26T07:10:13.6593003Z + trap_add cleanup_workspace EXIT 2024-06-26T07:10:13.6593432Z + trap_add_cmd=cleanup_workspace 2024-06-26T07:10:13.6593812Z + shift 2024-06-26T07:10:13.6594111Z + for trap_add_name in "$@" 2024-06-26T07:10:13.6597922Z +++ trap -p EXIT 2024-06-26T07:10:13.6599844Z ++ eval 'extract_trap_cmd ' 2024-06-26T07:10:13.6600223Z +++ extract_trap_cmd 2024-06-26T07:10:13.6600588Z +++ printf '%s\n' '' 2024-06-26T07:10:13.6600984Z ++ printf '%s\n' cleanup_workspace 2024-06-26T07:10:13.6602193Z + trap -- ' 2024-06-26T07:10:13.6602566Z cleanup_workspace' EXIT 2024-06-26T07:10:13.6603054Z + sudo chown -R jenkins /var/lib/jenkins/workspace 2024-06-26T07:10:14.1602069Z + git config --global --add safe.directory /var/lib/jenkins/workspace 2024-06-26T07:10:14.1616170Z + echo 'Environment variables:' 2024-06-26T07:10:14.1616815Z Environment variables: 2024-06-26T07:10:14.1617163Z + env 2024-06-26T07:10:14.1624734Z INSTALLED_DB=yes 2024-06-26T07:10:14.1625520Z NV_LIBCUBLAS_VERSION=12.1.3.1-1 2024-06-26T07:10:14.1626068Z NVIDIA_VISIBLE_DEVICES=all 2024-06-26T07:10:14.1626466Z NV_NVML_DEV_VERSION=12.1.105-1 2024-06-26T07:10:14.1627072Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-06-26T07:10:14.1627658Z CONTINUE_THROUGH_ERROR=False 2024-06-26T07:10:14.1628155Z NV_LIBNCCL_DEV_PACKAGE=libnccl-dev=2.17.1-1+cuda12.1 2024-06-26T07:10:14.1628713Z NV_LIBNCCL_DEV_PACKAGE_VERSION=2.17.1-1 2024-06-26T07:10:14.1629463Z BUILD_ENVIRONMENT=linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-06-26T07:10:14.1630130Z HOSTNAME=21f4e73c270d 2024-06-26T07:10:14.1631200Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_2acb925d-322f-46fb-9e2b-74414d6526d0 2024-06-26T07:10:14.1632102Z GITHUB_ACTION=__self 2024-06-26T07:10:14.1632465Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2024-06-26T07:10:14.1636246Z NVIDIA_REQUIRE_CUDA=cuda>=12.1 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 brand=tesla,driver>=525,driver<526 brand=unknown,driver>=525,driver<526 brand=nvidia,driver>=525,driver<526 brand=nvidiartx,driver>=525,driver<526 brand=geforce,driver>=525,driver<526 brand=geforcertx,driver>=525,driver<526 brand=quadro,driver>=525,driver<526 brand=quadrortx,driver>=525,driver<526 brand=titan,driver>=525,driver<526 brand=titanrtx,driver>=525,driver<526 2024-06-26T07:10:14.1640149Z NV_LIBCUBLAS_DEV_PACKAGE=libcublas-dev-12-1=12.1.3.1-1 2024-06-26T07:10:14.1640661Z NV_NVTX_VERSION=12.1.105-1 2024-06-26T07:10:14.1641026Z GITHUB_RUN_NUMBER=76977 2024-06-26T07:10:14.1641440Z TEST_CONFIG=inductor_cpp_wrapper_abi_compatible 2024-06-26T07:10:14.1641924Z GITHUB_REPOSITORY_OWNER_ID=21003710 2024-06-26T07:10:14.1642719Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2024-06-26T07:10:14.1643196Z NV_CUDA_CUDART_DEV_VERSION=12.1.105-1 2024-06-26T07:10:14.1643643Z NV_LIBCUSPARSE_VERSION=12.1.0.106-1 2024-06-26T07:10:14.1644076Z NV_LIBNPP_VERSION=12.1.0.40-1 2024-06-26T07:10:14.1644523Z GITHUB_TRIGGERING_ACTOR=pytorch-bot[bot] 2024-06-26T07:10:14.1645034Z CMAKE_CUDA_COMPILER_LAUNCHER=/opt/cache/bin/sccache 2024-06-26T07:10:14.1645508Z GITHUB_REF_TYPE=tag 2024-06-26T07:10:14.1645833Z TORCH_CUDA_ARCH_LIST=Maxwell 2024-06-26T07:10:14.1646216Z NCCL_VERSION=2.17.1-1 2024-06-26T07:10:14.1646729Z BASE_SHA=b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:10:14.1647179Z XLA_CUDA= 2024-06-26T07:10:14.1647684Z HUGGING_FACE_HUB_TOKEN=*** 2024-06-26T07:10:14.1649524Z *** 2024-06-26T07:10:14.1649859Z CARGO_NET_GIT_FETCH_WITH_CLI=true 2024-06-26T07:10:14.1650269Z GITHUB_REPOSITORY_ID=65600975 2024-06-26T07:10:14.1650636Z GITHUB_ACTIONS=true 2024-06-26T07:10:14.1650980Z NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:10:14.1651506Z NV_NVPROF_DEV_PACKAGE=cuda-nvprof-12-1=12.1.105-1 2024-06-26T07:10:14.1652051Z NV_LIBNPP_PACKAGE=libnpp-12-1=12.1.0.40-1 2024-06-26T07:10:14.1652521Z SHA1=b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:10:14.1653029Z NV_LIBNCCL_DEV_PACKAGE_NAME=libnccl-dev 2024-06-26T07:10:14.1653520Z GITHUB_SHA=b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:10:14.1654324Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/inductor.yml@refs/tags/ciflow/inductor/129470 2024-06-26T07:10:14.1655041Z UCC_HOME=/usr 2024-06-26T07:10:14.1655390Z NV_LIBCUBLAS_DEV_VERSION=12.1.3.1-1 2024-06-26T07:10:14.1655807Z VERBOSE_TEST_LOGS=False 2024-06-26T07:10:14.1656161Z NVIDIA_PRODUCT_NAME=CUDA 2024-06-26T07:10:14.1656620Z NV_LIBCUBLAS_DEV_PACKAGE_NAME=libcublas-dev-12-1 2024-06-26T07:10:14.1657129Z GITHUB_REF=refs/tags/ciflow/inductor/129470 2024-06-26T07:10:14.1657604Z NV_CUDA_CUDART_VERSION=12.1.105-1 2024-06-26T07:10:14.1657984Z SHARD_NUMBER=1 2024-06-26T07:10:14.1658306Z GITHUB_REF_PROTECTED=false 2024-06-26T07:10:14.1658670Z HOME=/var/lib/jenkins 2024-06-26T07:10:14.1659044Z GITHUB_API_URL=https://api.github.com 2024-06-26T07:10:14.1659485Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2024-06-26T07:10:14.1659971Z UCX_COMMIT=7bb2722ff2187a0cad557ae4a6afa090569f83fb 2024-06-26T07:10:14.1660629Z SCCACHE_S3_KEY_PREFIX=inductor 2024-06-26T07:10:14.1661010Z CUDA_VERSION=12.1.1 2024-06-26T07:10:14.1661432Z NV_LIBCUBLAS_PACKAGE=libcublas-12-1=12.1.3.1-1 2024-06-26T07:10:14.1661877Z NUM_TEST_SHARDS=1 2024-06-26T07:10:14.1662188Z UCX_HOME=/usr 2024-06-26T07:10:14.1662698Z NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE=cuda-nsight-compute-12-1=12.1.1-1 2024-06-26T07:10:14.1663791Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_2acb925d-322f-46fb-9e2b-74414d6526d0 2024-06-26T07:10:14.1665107Z JOB_NAME=cuda12.1-py3.10-gcc9-sm86 / test (inductor_cpp_wrapper_abi_compatible, 1, 1, linux.g5.4xlarge.nvidia.gpu) 2024-06-26T07:10:14.1666395Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_2acb925d-322f-46fb-9e2b-74414d6526d0 2024-06-26T07:10:14.1667517Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2024-06-26T07:10:14.1668180Z GITHUB_EVENT_NAME=push 2024-06-26T07:10:14.1668518Z DASHBOARD_TAG= 2024-06-26T07:10:14.1668826Z GITHUB_RUN_ID=9673646808 2024-06-26T07:10:14.1669289Z NV_LIBNPP_DEV_PACKAGE=libnpp-dev-12-1=12.1.0.40-1 2024-06-26T07:10:14.1669824Z NV_LIBCUBLAS_PACKAGE_NAME=libcublas-12-1 2024-06-26T07:10:14.1670832Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_2acb925d-322f-46fb-9e2b-74414d6526d0 2024-06-26T07:10:14.1671748Z GITHUB_ACTOR=pytorch-bot[bot] 2024-06-26T07:10:14.1672162Z NV_LIBNPP_DEV_VERSION=12.1.0.40-1 2024-06-26T07:10:14.1672539Z PR_NUMBER= 2024-06-26T07:10:14.1672830Z GITHUB_RUN_ATTEMPT=1 2024-06-26T07:10:14.1673178Z ANACONDA_PYTHON_VERSION=3.10 2024-06-26T07:10:14.1673625Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2024-06-26T07:10:14.1674087Z TERM=xterm 2024-06-26T07:10:14.1674547Z NV_LIBCUSPARSE_DEV_VERSION=12.1.0.106-1 2024-06-26T07:10:14.1674972Z INSTALLED_VISION=yes 2024-06-26T07:10:14.1675284Z BRANCH= 2024-06-26T07:10:14.1675574Z OPENSSL_ROOT_DIR=/opt/openssl 2024-06-26T07:10:14.1675983Z LIBRARY_PATH=/usr/local/cuda/lib64/stubs 2024-06-26T07:10:14.1676409Z CUDA_PATH=/usr/local/cuda 2024-06-26T07:10:14.1677168Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2024-06-26T07:10:14.1677933Z GITHUB_SERVER_URL=https://github.com 2024-06-26T07:10:14.1678427Z UCC_COMMIT=20eae37090a4ce1b32bcce6144ccad0b49943e0b 2024-06-26T07:10:14.1678966Z REENABLED_ISSUES= 2024-06-26T07:10:14.1679275Z SHLVL=1 2024-06-26T07:10:14.1679571Z MAX_JOBS=14 2024-06-26T07:10:14.1679922Z NV_CUDA_LIB_VERSION=12.1.1-1 2024-06-26T07:10:14.1680275Z NVARCH=x86_64 2024-06-26T07:10:14.1680579Z GITHUB_ACTOR_ID=54816060 2024-06-26T07:10:14.1681047Z GITHUB_WORKFLOW_SHA=b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:10:14.1681588Z GITHUB_REF_NAME=ciflow/inductor/129470 2024-06-26T07:10:14.1682081Z NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-1 2024-06-26T07:10:14.1682751Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2024-06-26T07:10:14.1683333Z GITHUB_JOB=test 2024-06-26T07:10:14.1683730Z NV_LIBNCCL_PACKAGE=libnccl2=2.17.1-1+cuda12.1 2024-06-26T07:10:14.1684301Z LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64 2024-06-26T07:10:14.1684823Z NO_TEST_TIMEOUT=False 2024-06-26T07:10:14.1685162Z TD_DISTRIBUTED=False 2024-06-26T07:10:14.1685540Z NV_CUDA_NSIGHT_COMPUTE_VERSION=12.1.1-1 2024-06-26T07:10:14.1685995Z GITHUB_REPOSITORY=pytorch/pytorch 2024-06-26T07:10:14.1686423Z NV_NVPROF_VERSION=12.1.105-1 2024-06-26T07:10:14.1686794Z GITHUB_RETENTION_DAYS=90 2024-06-26T07:10:14.1687144Z OPENSSL_DIR=/opt/openssl 2024-06-26T07:10:14.1687504Z GITHUB_ACTION_REPOSITORY= 2024-06-26T07:10:14.1688685Z PATH=/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-06-26T07:10:14.1689769Z GITHUB_BASE_REF= 2024-06-26T07:10:14.1690094Z NV_LIBNCCL_PACKAGE_NAME=libnccl2 2024-06-26T07:10:14.1690468Z CI=true 2024-06-26T07:10:14.1690792Z NV_LIBNCCL_PACKAGE_VERSION=2.17.1-1 2024-06-26T07:10:14.1691213Z GITHUB_REPOSITORY_OWNER=pytorch 2024-06-26T07:10:14.1691596Z JOB_ID=26688912903 2024-06-26T07:10:14.1691919Z INSTALLED_PROTOBUF=yes 2024-06-26T07:10:14.1692256Z GITHUB_HEAD_REF= 2024-06-26T07:10:14.1692556Z GITHUB_ACTION_REF= 2024-06-26T07:10:14.1692992Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2024-06-26T07:10:14.1693469Z GITHUB_WORKFLOW=inductor 2024-06-26T07:10:14.1693842Z DEBIAN_FRONTEND=noninteractive 2024-06-26T07:10:14.1694749Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_2acb925d-322f-46fb-9e2b-74414d6526d0 2024-06-26T07:10:14.1695575Z NO_TD=False 2024-06-26T07:10:14.1695884Z SKIP_SCCACHE_INITIALIZATION=1 2024-06-26T07:10:14.1696250Z _=/usr/bin/env 2024-06-26T07:10:14.1696733Z ++ python -c 'import site; print(site.getsitepackages()[0])' 2024-06-26T07:10:14.1771474Z + TORCH_INSTALL_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch 2024-06-26T07:10:14.1772665Z + TORCH_BIN_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/bin 2024-06-26T07:10:14.1773654Z + TORCH_LIB_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/lib 2024-06-26T07:10:14.1774617Z + TORCH_TEST_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/test 2024-06-26T07:10:14.1775270Z + BUILD_DIR=build 2024-06-26T07:10:14.1775703Z + BUILD_RENAMED_DIR=build_renamed 2024-06-26T07:10:14.1776257Z + BUILD_BIN_DIR=build/bin 2024-06-26T07:10:14.1776604Z + SHARD_NUMBER=1 2024-06-26T07:10:14.1776941Z + NUM_TEST_SHARDS=1 2024-06-26T07:10:14.1777307Z + export VALGRIND=ON 2024-06-26T07:10:14.1777629Z + VALGRIND=ON 2024-06-26T07:10:14.1778182Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *clang9* ]] 2024-06-26T07:10:14.1778743Z + [[ 0 == \1 ]] 2024-06-26T07:10:14.1779051Z + [[ False == \1 ]] 2024-06-26T07:10:14.1779767Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *bazel* ]] 2024-06-26T07:10:14.1780524Z ++ realpath build/custom_test_artifacts 2024-06-26T07:10:14.1783239Z + CUSTOM_TEST_ARTIFACT_BUILD_DIR=/var/lib/jenkins/workspace/build/custom_test_artifacts 2024-06-26T07:10:14.1784003Z + [[ -n '' ]] 2024-06-26T07:10:14.1784354Z + echo 'Environment variables' 2024-06-26T07:10:14.1784746Z Environment variables 2024-06-26T07:10:14.1785079Z + env 2024-06-26T07:10:14.1787828Z INSTALLED_DB=yes 2024-06-26T07:10:14.1788695Z NV_LIBCUBLAS_VERSION=12.1.3.1-1 2024-06-26T07:10:14.1789303Z NVIDIA_VISIBLE_DEVICES=all 2024-06-26T07:10:14.1789939Z NV_NVML_DEV_VERSION=12.1.105-1 2024-06-26T07:10:14.1790763Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-06-26T07:10:14.1791527Z CONTINUE_THROUGH_ERROR=False 2024-06-26T07:10:14.1792181Z NV_LIBNCCL_DEV_PACKAGE=libnccl-dev=2.17.1-1+cuda12.1 2024-06-26T07:10:14.1792840Z NV_LIBNCCL_DEV_PACKAGE_VERSION=2.17.1-1 2024-06-26T07:10:14.1793628Z BUILD_ENVIRONMENT=linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-06-26T07:10:14.1794207Z HOSTNAME=21f4e73c270d 2024-06-26T07:10:14.1795336Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_2acb925d-322f-46fb-9e2b-74414d6526d0 2024-06-26T07:10:14.1796410Z GITHUB_ACTION=__self 2024-06-26T07:10:14.1796844Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2024-06-26T07:10:14.1800768Z NVIDIA_REQUIRE_CUDA=cuda>=12.1 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 brand=tesla,driver>=525,driver<526 brand=unknown,driver>=525,driver<526 brand=nvidia,driver>=525,driver<526 brand=nvidiartx,driver>=525,driver<526 brand=geforce,driver>=525,driver<526 brand=geforcertx,driver>=525,driver<526 brand=quadro,driver>=525,driver<526 brand=quadrortx,driver>=525,driver<526 brand=titan,driver>=525,driver<526 brand=titanrtx,driver>=525,driver<526 2024-06-26T07:10:14.1804707Z NV_LIBCUBLAS_DEV_PACKAGE=libcublas-dev-12-1=12.1.3.1-1 2024-06-26T07:10:14.1805235Z NV_NVTX_VERSION=12.1.105-1 2024-06-26T07:10:14.1805591Z GITHUB_RUN_NUMBER=76977 2024-06-26T07:10:14.1806011Z TEST_CONFIG=inductor_cpp_wrapper_abi_compatible 2024-06-26T07:10:14.1806495Z GITHUB_REPOSITORY_OWNER_ID=21003710 2024-06-26T07:10:14.1806968Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2024-06-26T07:10:14.1807446Z NV_CUDA_CUDART_DEV_VERSION=12.1.105-1 2024-06-26T07:10:14.1807901Z NV_LIBCUSPARSE_VERSION=12.1.0.106-1 2024-06-26T07:10:14.1808339Z NV_LIBNPP_VERSION=12.1.0.40-1 2024-06-26T07:10:14.1809069Z GITHUB_TRIGGERING_ACTOR=pytorch-bot[bot] 2024-06-26T07:10:14.1809588Z CMAKE_CUDA_COMPILER_LAUNCHER=/opt/cache/bin/sccache 2024-06-26T07:10:14.1810062Z GITHUB_REF_TYPE=tag 2024-06-26T07:10:14.1810400Z TORCH_CUDA_ARCH_LIST=Maxwell 2024-06-26T07:10:14.1810776Z NCCL_VERSION=2.17.1-1 2024-06-26T07:10:14.1811179Z BASE_SHA=b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:10:14.1811627Z XLA_CUDA= 2024-06-26T07:10:14.1812084Z HUGGING_FACE_HUB_TOKEN=*** 2024-06-26T07:10:14.1812475Z *** 2024-06-26T07:10:14.1812766Z CARGO_NET_GIT_FETCH_WITH_CLI=true 2024-06-26T07:10:14.1813172Z GITHUB_REPOSITORY_ID=65600975 2024-06-26T07:10:14.1813545Z GITHUB_ACTIONS=true 2024-06-26T07:10:14.1813882Z NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:10:14.1814388Z NV_NVPROF_DEV_PACKAGE=cuda-nvprof-12-1=12.1.105-1 2024-06-26T07:10:14.1814936Z NV_LIBNPP_PACKAGE=libnpp-12-1=12.1.0.40-1 2024-06-26T07:10:14.1815416Z SHA1=b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:10:14.1815920Z NV_LIBNCCL_DEV_PACKAGE_NAME=libnccl-dev 2024-06-26T07:10:14.1816410Z GITHUB_SHA=b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:10:14.1817222Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/inductor.yml@refs/tags/ciflow/inductor/129470 2024-06-26T07:10:14.1817949Z UCC_HOME=/usr 2024-06-26T07:10:14.1818428Z NV_LIBCUBLAS_DEV_VERSION=12.1.3.1-1 2024-06-26T07:10:14.1818839Z VERBOSE_TEST_LOGS=False 2024-06-26T07:10:14.1819193Z NVIDIA_PRODUCT_NAME=CUDA 2024-06-26T07:10:14.1819655Z NV_LIBCUBLAS_DEV_PACKAGE_NAME=libcublas-dev-12-1 2024-06-26T07:10:14.1820335Z GITHUB_REF=refs/tags/ciflow/inductor/129470 2024-06-26T07:10:14.1820815Z NV_CUDA_CUDART_VERSION=12.1.105-1 2024-06-26T07:10:14.1821202Z SHARD_NUMBER=1 2024-06-26T07:10:14.1821512Z GITHUB_REF_PROTECTED=false 2024-06-26T07:10:14.1821874Z HOME=/var/lib/jenkins 2024-06-26T07:10:14.1822250Z GITHUB_API_URL=https://api.github.com 2024-06-26T07:10:14.1822782Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2024-06-26T07:10:14.1823277Z UCX_COMMIT=7bb2722ff2187a0cad557ae4a6afa090569f83fb 2024-06-26T07:10:14.1823778Z SCCACHE_S3_KEY_PREFIX=inductor 2024-06-26T07:10:14.1824158Z CUDA_VERSION=12.1.1 2024-06-26T07:10:14.1824583Z NV_LIBCUBLAS_PACKAGE=libcublas-12-1=12.1.3.1-1 2024-06-26T07:10:14.1825038Z NUM_TEST_SHARDS=1 2024-06-26T07:10:14.1825356Z UCX_HOME=/usr 2024-06-26T07:10:14.1825887Z NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE=cuda-nsight-compute-12-1=12.1.1-1 2024-06-26T07:10:14.1826970Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_2acb925d-322f-46fb-9e2b-74414d6526d0 2024-06-26T07:10:14.1828279Z JOB_NAME=cuda12.1-py3.10-gcc9-sm86 / test (inductor_cpp_wrapper_abi_compatible, 1, 1, linux.g5.4xlarge.nvidia.gpu) 2024-06-26T07:10:14.1829579Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_2acb925d-322f-46fb-9e2b-74414d6526d0 2024-06-26T07:10:14.1830764Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2024-06-26T07:10:14.1831428Z GITHUB_EVENT_NAME=push 2024-06-26T07:10:14.1831766Z DASHBOARD_TAG= 2024-06-26T07:10:14.1832078Z GITHUB_RUN_ID=9673646808 2024-06-26T07:10:14.1832540Z NV_LIBNPP_DEV_PACKAGE=libnpp-dev-12-1=12.1.0.40-1 2024-06-26T07:10:14.1833077Z NV_LIBCUBLAS_PACKAGE_NAME=libcublas-12-1 2024-06-26T07:10:14.1834081Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_2acb925d-322f-46fb-9e2b-74414d6526d0 2024-06-26T07:10:14.1834999Z GITHUB_ACTOR=pytorch-bot[bot] 2024-06-26T07:10:14.1835418Z NV_LIBNPP_DEV_VERSION=12.1.0.40-1 2024-06-26T07:10:14.1835795Z PR_NUMBER= 2024-06-26T07:10:14.1836092Z GITHUB_RUN_ATTEMPT=1 2024-06-26T07:10:14.1836418Z VALGRIND=ON 2024-06-26T07:10:14.1836728Z ANACONDA_PYTHON_VERSION=3.10 2024-06-26T07:10:14.1837176Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2024-06-26T07:10:14.1837639Z TERM=xterm 2024-06-26T07:10:14.1837983Z NV_LIBCUSPARSE_DEV_VERSION=12.1.0.106-1 2024-06-26T07:10:14.1838418Z INSTALLED_VISION=yes 2024-06-26T07:10:14.1838739Z BRANCH= 2024-06-26T07:10:14.1839030Z OPENSSL_ROOT_DIR=/opt/openssl 2024-06-26T07:10:14.1839440Z LIBRARY_PATH=/usr/local/cuda/lib64/stubs 2024-06-26T07:10:14.1839867Z CUDA_PATH=/usr/local/cuda 2024-06-26T07:10:14.1840629Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2024-06-26T07:10:14.1841399Z GITHUB_SERVER_URL=https://github.com 2024-06-26T07:10:14.1854714Z UCC_COMMIT=20eae37090a4ce1b32bcce6144ccad0b49943e0b 2024-06-26T07:10:14.1855193Z REENABLED_ISSUES= 2024-06-26T07:10:14.1855491Z SHLVL=1 2024-06-26T07:10:14.1855760Z MAX_JOBS=14 2024-06-26T07:10:14.1856102Z NV_CUDA_LIB_VERSION=12.1.1-1 2024-06-26T07:10:14.1856453Z NVARCH=x86_64 2024-06-26T07:10:14.1856756Z GITHUB_ACTOR_ID=54816060 2024-06-26T07:10:14.1857219Z GITHUB_WORKFLOW_SHA=b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:10:14.1857751Z GITHUB_REF_NAME=ciflow/inductor/129470 2024-06-26T07:10:14.1858248Z NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-1 2024-06-26T07:10:14.1858918Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2024-06-26T07:10:14.1859495Z GITHUB_JOB=test 2024-06-26T07:10:14.1859889Z NV_LIBNCCL_PACKAGE=libnccl2=2.17.1-1+cuda12.1 2024-06-26T07:10:14.1860613Z LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64 2024-06-26T07:10:14.1861133Z NO_TEST_TIMEOUT=False 2024-06-26T07:10:14.1861471Z TD_DISTRIBUTED=False 2024-06-26T07:10:14.1861994Z NV_CUDA_NSIGHT_COMPUTE_VERSION=12.1.1-1 2024-06-26T07:10:14.1862441Z GITHUB_REPOSITORY=pytorch/pytorch 2024-06-26T07:10:14.1862869Z NV_NVPROF_VERSION=12.1.105-1 2024-06-26T07:10:14.1863233Z GITHUB_RETENTION_DAYS=90 2024-06-26T07:10:14.1863599Z OPENSSL_DIR=/opt/openssl 2024-06-26T07:10:14.1863953Z GITHUB_ACTION_REPOSITORY= 2024-06-26T07:10:14.1864998Z PATH=/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-06-26T07:10:14.1866060Z GITHUB_BASE_REF= 2024-06-26T07:10:14.1866479Z NV_LIBNCCL_PACKAGE_NAME=libnccl2 2024-06-26T07:10:14.1866861Z CI=true 2024-06-26T07:10:14.1867181Z NV_LIBNCCL_PACKAGE_VERSION=2.17.1-1 2024-06-26T07:10:14.1867600Z GITHUB_REPOSITORY_OWNER=pytorch 2024-06-26T07:10:14.1867978Z JOB_ID=26688912903 2024-06-26T07:10:14.1868290Z INSTALLED_PROTOBUF=yes 2024-06-26T07:10:14.1868622Z GITHUB_HEAD_REF= 2024-06-26T07:10:14.1868922Z GITHUB_ACTION_REF= 2024-06-26T07:10:14.1869372Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2024-06-26T07:10:14.1869848Z GITHUB_WORKFLOW=inductor 2024-06-26T07:10:14.1870204Z DEBIAN_FRONTEND=noninteractive 2024-06-26T07:10:14.1871114Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_2acb925d-322f-46fb-9e2b-74414d6526d0 2024-06-26T07:10:14.1871934Z NO_TD=False 2024-06-26T07:10:14.1872243Z SKIP_SCCACHE_INITIALIZATION=1 2024-06-26T07:10:14.1872607Z _=/usr/bin/env 2024-06-26T07:10:14.1872948Z + echo 'Testing pytorch' 2024-06-26T07:10:14.1873299Z Testing pytorch 2024-06-26T07:10:14.1873634Z + export LANG=C.UTF-8 2024-06-26T07:10:14.1873972Z + LANG=C.UTF-8 2024-06-26T07:10:14.1874280Z + PR_NUMBER= 2024-06-26T07:10:14.1874698Z + [[ inductor_cpp_wrapper_abi_compatible == \d\e\f\a\u\l\t ]] 2024-06-26T07:10:14.1875363Z + [[ inductor_cpp_wrapper_abi_compatible == \d\i\s\t\r\i\b\u\t\e\d ]] 2024-06-26T07:10:14.1875996Z + [[ inductor_cpp_wrapper_abi_compatible == \s\l\o\w ]] 2024-06-26T07:10:14.1876691Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *slow-gradcheck* ]] 2024-06-26T07:10:14.1877399Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *cuda* ]] 2024-06-26T07:10:14.1877954Z + export PYTORCH_TESTING_DEVICE_ONLY_FOR=cuda 2024-06-26T07:10:14.1878426Z + PYTORCH_TESTING_DEVICE_ONLY_FOR=cuda 2024-06-26T07:10:14.1878946Z + [[ inductor_cpp_wrapper_abi_compatible == *crossref* ]] 2024-06-26T07:10:14.1879598Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *rocm* ]] 2024-06-26T07:10:14.1880227Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *xpu* ]] 2024-06-26T07:10:14.1880888Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *-bazel-* ]] 2024-06-26T07:10:14.1881455Z + pip_install --user ninja==1.10.2 2024-06-26T07:10:14.1881996Z + pip install --progress-bar off --user ninja==1.10.2 2024-06-26T07:10:14.5438641Z Collecting ninja==1.10.2 2024-06-26T07:10:14.5597021Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl.metadata (5.0 kB) 2024-06-26T07:10:14.5738210Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl (108 kB) 2024-06-26T07:10:15.8864337Z Installing collected packages: ninja 2024-06-26T07:10:15.8932268Z  WARNING: The script ninja is installed in '/var/lib/jenkins/.local/bin' which is not on PATH. 2024-06-26T07:10:15.8934786Z Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. 2024-06-26T07:10:15.8974682Z Successfully installed ninja-1.10.2 2024-06-26T07:10:15.9880260Z + export PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-06-26T07:10:15.9882415Z + PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-06-26T07:10:15.9883859Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *aarch64* ]] 2024-06-26T07:10:15.9884620Z + install_tlparse 2024-06-26T07:10:15.9885013Z + pip_install --user tlparse==0.3.7 2024-06-26T07:10:15.9885569Z + pip install --progress-bar off --user tlparse==0.3.7 2024-06-26T07:10:16.3460858Z Collecting tlparse==0.3.7 2024-06-26T07:10:16.3609476Z Downloading tlparse-0.3.7-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (346 bytes) 2024-06-26T07:10:16.3723638Z Downloading tlparse-0.3.7-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.2 MB) 2024-06-26T07:10:17.7142924Z Installing collected packages: tlparse 2024-06-26T07:10:17.7529622Z Successfully installed tlparse-0.3.7 2024-06-26T07:10:17.8392518Z ++ python -m site --user-base 2024-06-26T07:10:17.8546164Z + PATH=/var/lib/jenkins/.local/bin:/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-06-26T07:10:17.8547994Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *asan* ]] 2024-06-26T07:10:17.8548855Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *-debug* ]] 2024-06-26T07:10:17.8549531Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *-bazel-* ]] 2024-06-26T07:10:17.8550484Z + echo 'We are not in debug mode: linux-focal-cuda12.1-py3.10-gcc9-sm86. Expect the assertion to pass' 2024-06-26T07:10:17.8551877Z We are not in debug mode: linux-focal-cuda12.1-py3.10-gcc9-sm86. Expect the assertion to pass 2024-06-26T07:10:17.8552599Z + cd test 2024-06-26T07:10:17.8553132Z + python -c 'import torch; torch._C._crash_if_debug_asserts_fail(424242)' 2024-06-26T07:10:19.3621656Z + [[ inductor_cpp_wrapper_abi_compatible == \n\o\g\p\u\_\N\O\_\A\V\X\2 ]] 2024-06-26T07:10:19.3622450Z + [[ inductor_cpp_wrapper_abi_compatible == \n\o\g\p\u\_\A\V\X\5\1\2 ]] 2024-06-26T07:10:19.3623324Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *-bazel-* ]] 2024-06-26T07:10:19.3623910Z + pushd test 2024-06-26T07:10:19.3624270Z ~/workspace/test ~/workspace 2024-06-26T07:10:19.3624815Z ++ python -c 'import torch; print(torch.version.cuda)' 2024-06-26T07:10:20.8419588Z + CUDA_VERSION=12.1 2024-06-26T07:10:20.8420329Z + '[' 12.1 == 12.4 ']' 2024-06-26T07:10:20.8420668Z + ISCUDA124= 2024-06-26T07:10:20.8420997Z + popd 2024-06-26T07:10:20.8421309Z ~/workspace 2024-06-26T07:10:20.8424299Z + DYNAMO_BENCHMARK_FLAGS=() 2024-06-26T07:10:20.8424947Z + [[ inductor_cpp_wrapper_abi_compatible == *dynamo_eager* ]] 2024-06-26T07:10:20.8425581Z + [[ inductor_cpp_wrapper_abi_compatible == *aot_eager* ]] 2024-06-26T07:10:20.8426199Z + [[ inductor_cpp_wrapper_abi_compatible == *aot_inductor* ]] 2024-06-26T07:10:20.8426832Z + [[ inductor_cpp_wrapper_abi_compatible == *inductor* ]] 2024-06-26T07:10:20.8427411Z + [[ inductor_cpp_wrapper_abi_compatible != *perf* ]] 2024-06-26T07:10:20.8427984Z + DYNAMO_BENCHMARK_FLAGS+=(--inductor) 2024-06-26T07:10:20.8428511Z + [[ inductor_cpp_wrapper_abi_compatible == *dynamic* ]] 2024-06-26T07:10:20.8429123Z + [[ inductor_cpp_wrapper_abi_compatible == *cpu_inductor* ]] 2024-06-26T07:10:20.8429724Z + DYNAMO_BENCHMARK_FLAGS+=(--device cuda) 2024-06-26T07:10:20.8451813Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *libtorch* ]] 2024-06-26T07:10:20.8452510Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *-bazel-* ]] 2024-06-26T07:10:20.8453008Z + cd test 2024-06-26T07:10:20.8453452Z + python -c 'import torch; print(torch.__config__.show())' 2024-06-26T07:10:22.1995894Z PyTorch built with: 2024-06-26T07:10:22.1996459Z - GCC 9.4 2024-06-26T07:10:22.1996799Z - C++ Version: 201703 2024-06-26T07:10:22.1997705Z - Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications 2024-06-26T07:10:22.1998817Z - Intel(R) MKL-DNN v3.4.2 (Git Hash 1137e04ec0b5251ca2b4400a4fd3c667ce843d67) 2024-06-26T07:10:22.1999514Z - OpenMP 201511 (a.k.a. OpenMP 4.5) 2024-06-26T07:10:22.2000042Z - LAPACK is enabled (usually provided by MKL) 2024-06-26T07:10:22.2000533Z - NNPACK is enabled 2024-06-26T07:10:22.2000927Z - CPU capability usage: AVX2 2024-06-26T07:10:22.2001656Z - CUDA Runtime 12.1 2024-06-26T07:10:22.2002185Z - NVCC architecture flags: -gencode;arch=compute_86,code=sm_86 2024-06-26T07:10:22.2002804Z - CuDNN 90.1 (built against CUDA 12.4) 2024-06-26T07:10:22.2003256Z - Magma 2.6.1 2024-06-26T07:10:22.2010673Z - Build settings: BLAS_INFO=mkl, BUILD_TYPE=Release, CUDA_VERSION=12.1, CUDNN_VERSION=9.1.0, CXX_COMPILER=/opt/cache/bin/c++, CXX_FLAGS= -D_GLIBCXX_USE_CXX11_ABI=1 -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOROCTRACER -DUSE_FBGEMM -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -O2 -fPIC -Wall -Wextra -Werror=return-type -Werror=non-virtual-dtor -Werror=bool-operation -Wnarrowing -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-unused-parameter -Wno-unused-function -Wno-unused-result -Wno-strict-overflow -Wno-strict-aliasing -Wno-stringop-overflow -Wsuggest-override -Wno-psabi -Wno-error=pedantic -Wno-error=old-style-cast -Wno-missing-braces -fdiagnostics-color=always -faligned-new -Werror -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Wno-stringop-overflow, FORCE_FALLBACK_CUDA_MPI=1, LAPACK_INFO=mkl, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, PERF_WITH_AVX512=1, TORCH_VERSION=2.5.0, USE_CUDA=ON, USE_CUDNN=ON, USE_CUSPARSELT=ON, USE_EXCEPTION_PTR=1, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_GLOO=ON, USE_MKL=ON, USE_MKLDNN=ON, USE_MPI=ON, USE_NCCL=ON, USE_NNPACK=ON, USE_OPENMP=ON, USE_ROCM=OFF, USE_ROCM_KERNEL_ASSERT=OFF, 2024-06-26T07:10:22.2017285Z 2024-06-26T07:10:22.4703426Z + cd test 2024-06-26T07:10:22.4704406Z + python -c 'import torch; print(torch.__config__.parallel_info())' 2024-06-26T07:10:23.6783211Z ATen/Parallel: 2024-06-26T07:10:23.6783650Z at::get_num_threads() : 8 2024-06-26T07:10:23.6784074Z at::get_num_interop_threads() : 16 2024-06-26T07:10:23.6784517Z OpenMP 201511 (a.k.a. OpenMP 4.5) 2024-06-26T07:10:23.6784926Z omp_get_max_threads() : 8 2024-06-26T07:10:23.6785912Z Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications 2024-06-26T07:10:23.6786752Z mkl_get_max_threads() : 8 2024-06-26T07:10:23.6787390Z Intel(R) MKL-DNN v3.4.2 (Git Hash 1137e04ec0b5251ca2b4400a4fd3c667ce843d67) 2024-06-26T07:10:23.6788043Z std::thread::hardware_concurrency() : 16 2024-06-26T07:10:23.6788505Z Environment variables: 2024-06-26T07:10:23.6788868Z OMP_NUM_THREADS : [not set] 2024-06-26T07:10:23.6789260Z MKL_NUM_THREADS : [not set] 2024-06-26T07:10:23.6789646Z ATen parallel backend: OpenMP 2024-06-26T07:10:23.6789921Z 2024-06-26T07:10:23.9211445Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *aarch64* ]] 2024-06-26T07:10:23.9212155Z + [[ inductor_cpp_wrapper_abi_compatible == *backward* ]] 2024-06-26T07:10:23.9212747Z + [[ inductor_cpp_wrapper_abi_compatible == *xla* ]] 2024-06-26T07:10:23.9213336Z + [[ inductor_cpp_wrapper_abi_compatible == *executorch* ]] 2024-06-26T07:10:23.9214172Z + [[ inductor_cpp_wrapper_abi_compatible == \j\i\t\_\l\e\g\a\c\y ]] 2024-06-26T07:10:23.9214924Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *libtorch* ]] 2024-06-26T07:10:23.9215549Z + [[ inductor_cpp_wrapper_abi_compatible == distributed ]] 2024-06-26T07:10:23.9216200Z + [[ inductor_cpp_wrapper_abi_compatible == *inductor_distributed* ]] 2024-06-26T07:10:23.9216956Z + [[ inductor_cpp_wrapper_abi_compatible == *inductor-halide* ]] 2024-06-26T07:10:23.9217726Z + [[ inductor_cpp_wrapper_abi_compatible == *inductor-micro-benchmark* ]] 2024-06-26T07:10:23.9218426Z + [[ inductor_cpp_wrapper_abi_compatible == *huggingface* ]] 2024-06-26T07:10:23.9219022Z + [[ inductor_cpp_wrapper_abi_compatible == *timm* ]] 2024-06-26T07:10:23.9219621Z + [[ inductor_cpp_wrapper_abi_compatible == *torchbench* ]] 2024-06-26T07:10:23.9220484Z + [[ inductor_cpp_wrapper_abi_compatible == *inductor_cpp_wrapper_abi_compatible* ]] 2024-06-26T07:10:23.9221111Z + install_torchvision 2024-06-26T07:10:23.9221444Z + local orig_preload 2024-06-26T07:10:23.9221774Z + local commit 2024-06-26T07:10:23.9222390Z ++ get_pinned_commit vision 2024-06-26T07:10:23.9222793Z ++ cat .github/ci_commit_pins/vision.txt 2024-06-26T07:10:23.9226380Z + commit=d23a6e1664d20707c11781299611436e1f0c104f 2024-06-26T07:10:23.9226846Z + orig_preload= 2024-06-26T07:10:23.9227193Z + '[' -n '' ']' 2024-06-26T07:10:23.9228034Z + pip_install --no-use-pep517 --user git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2024-06-26T07:10:23.9229466Z + pip install --progress-bar off --no-use-pep517 --user git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2024-06-26T07:10:24.2341521Z Collecting git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2024-06-26T07:10:24.2345264Z Cloning https://github.com/pytorch/vision.git (to revision d23a6e1664d20707c11781299611436e1f0c104f) to /tmp/pip-req-build-1ax0cvm4 2024-06-26T07:10:24.2360321Z Running command git clone --filter=blob:none --quiet https://github.com/pytorch/vision.git /tmp/pip-req-build-1ax0cvm4 2024-06-26T07:10:25.5969304Z Running command git rev-parse -q --verify 'sha^d23a6e1664d20707c11781299611436e1f0c104f' 2024-06-26T07:10:25.5984472Z Running command git fetch -q https://github.com/pytorch/vision.git d23a6e1664d20707c11781299611436e1f0c104f 2024-06-26T07:10:26.8008934Z Running command git checkout -q d23a6e1664d20707c11781299611436e1f0c104f 2024-06-26T07:10:27.0645849Z Resolved https://github.com/pytorch/vision.git to commit d23a6e1664d20707c11781299611436e1f0c104f 2024-06-26T07:10:29.3851805Z Preparing metadata (setup.py) ... [?25l- \ done 2024-06-26T07:10:29.3899269Z [?25hRequirement already satisfied: numpy in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (1.21.2) 2024-06-26T07:10:29.3902024Z Requirement already satisfied: torch in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (2.5.0a0+gitb8c4c54) 2024-06-26T07:10:29.3907184Z Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (10.3.0) 2024-06-26T07:10:29.4116563Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (3.13.1) 2024-06-26T07:10:29.4122924Z Requirement already satisfied: typing-extensions>=4.8.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (4.12.2) 2024-06-26T07:10:29.4125248Z Requirement already satisfied: sympy in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (1.12.1) 2024-06-26T07:10:29.4126891Z Requirement already satisfied: networkx in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (2.8.8) 2024-06-26T07:10:29.4128777Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (3.1.4) 2024-06-26T07:10:29.4131566Z Requirement already satisfied: fsspec in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (2024.2.0) 2024-06-26T07:10:29.4564927Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from jinja2->torch->torchvision==0.19.0a0+d23a6e1) (2.1.5) 2024-06-26T07:10:29.4723056Z Requirement already satisfied: mpmath<1.4.0,>=1.1.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from sympy->torch->torchvision==0.19.0a0+d23a6e1) (1.3.0) 2024-06-26T07:10:29.4796186Z Building wheels for collected packages: torchvision 2024-06-26T07:11:42.5296815Z Building wheel for torchvision (setup.py) ... [?25l- \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - done 2024-06-26T07:11:42.5323678Z [?25h Created wheel for torchvision: filename=torchvision-0.19.0a0+d23a6e1-cp310-cp310-linux_x86_64.whl size=2112977 sha256=b5a22a99216b3ce54f1ed2a19c70039b8516aa0c9643d10fdda3c661745d8c43 2024-06-26T07:11:42.5326727Z Stored in directory: /var/lib/jenkins/.cache/pip/wheels/0e/56/35/02931e71eb23fd2b85591c7ec05b733ca7c8b328a2fd151f96 2024-06-26T07:11:42.5365125Z Successfully built torchvision 2024-06-26T07:11:43.7512917Z Installing collected packages: torchvision 2024-06-26T07:11:44.1332088Z Successfully installed torchvision-0.19.0a0+d23a6e1 2024-06-26T07:11:44.2489322Z + '[' -n '' ']' 2024-06-26T07:11:44.2489759Z + test_inductor_cpp_wrapper_abi_compatible 2024-06-26T07:11:44.2492380Z + export TORCHINDUCTOR_ABI_COMPATIBLE=1 2024-06-26T07:11:44.2493373Z + TORCHINDUCTOR_ABI_COMPATIBLE=1 2024-06-26T07:11:44.2495658Z ++ pwd 2024-06-26T07:11:44.2496275Z + TEST_REPORTS_DIR=/var/lib/jenkins/workspace/test/test-reports 2024-06-26T07:11:44.2496960Z + mkdir -p /var/lib/jenkins/workspace/test/test-reports 2024-06-26T07:11:44.2505040Z + echo 'Testing Inductor cpp wrapper mode with TORCHINDUCTOR_ABI_COMPATIBLE=1' 2024-06-26T07:11:44.2506132Z Testing Inductor cpp wrapper mode with TORCHINDUCTOR_ABI_COMPATIBLE=1 2024-06-26T07:11:44.2507001Z + PYTORCH_TESTING_DEVICE_ONLY_FOR= 2024-06-26T07:11:44.2507852Z + python test/run_test.py --include inductor/test_cpu_cpp_wrapper 2024-06-26T07:11:44.3383301Z /var/lib/jenkins/workspace/test/run_test.py:21: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html 2024-06-26T07:11:44.3384468Z import pkg_resources 2024-06-26T07:11:46.5018848Z No TD results found 2024-06-26T07:11:46.5020369Z Downloading https://ossci-metrics.s3.amazonaws.com/slow-tests.json to /var/lib/jenkins/workspace/test/.pytorch-slow-tests.json 2024-06-26T07:11:46.5437951Z Downloading https://ossci-metrics.s3.amazonaws.com/disabled-tests-condensed.json to /var/lib/jenkins/workspace/test/.pytorch-disabled-tests.json 2024-06-26T07:11:46.5917066Z Ignoring disabled issues: [''] 2024-06-26T07:11:46.6038082Z ##[warning] Gathered no stats from artifacts for linux-focal-cuda12.1-py3.10-gcc9-sm86 build env and inductor_cpp_wrapper_abi_compatible test config. Using default build env and inductor_cpp_wrapper_abi_compatible test config instead. 2024-06-26T07:11:46.6381802Z ##[warning] Gathered no stats from artifacts for linux-focal-cuda12.1-py3.10-gcc9-sm86 build env and inductor_cpp_wrapper_abi_compatible test config. Using default build env and inductor_cpp_wrapper_abi_compatible test config instead. 2024-06-26T07:11:46.6390998Z Running all tests 2024-06-26T07:11:46.6394998Z Running parallel tests on 3 processes 2024-06-26T07:11:46.6395672Z Name: tests to run (est. time: 6.17min) 2024-06-26T07:11:46.6396172Z Serial tests (0): 2024-06-26T07:11:46.6396582Z Parallel tests (2): 2024-06-26T07:11:46.6397081Z inductor/test_cpu_cpp_wrapper 1/2 2024-06-26T07:11:46.6397620Z inductor/test_cpu_cpp_wrapper 2/2 2024-06-26T07:11:46.6398124Z Name: excluded (est. time: 0.0min) 2024-06-26T07:11:46.6399050Z Serial tests (0): 2024-06-26T07:11:46.6399495Z Parallel tests (0): 2024-06-26T07:11:46.6400324Z Starting test batch 'tests to run' 0.0 seconds after initiating testing 2024-06-26T07:11:46.6450850Z Running inductor/test_cpu_cpp_wrapper 1/2 ... [2024-06-26 07:11:46.644622] 2024-06-26T07:11:46.6455822Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_cpu_cpp_wrapper.py', '-m', 'serial', '--shard-id=1', '--num-shards=2', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 07:11:46.645102] 2024-06-26T07:11:54.4254026Z 2024-06-26T07:11:54.4255818Z inductor/test_cpu_cpp_wrapper 1/2 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_cpu_cpp_wrapper_1.2_18b5b8ee628158d6_.log 2024-06-26T07:11:54.4257017Z Running 0 items in this shard: 2024-06-26T07:11:54.4257286Z 2024-06-26T07:11:54.4257707Z Running inductor/test_cpu_cpp_wrapper 2/2 ... [2024-06-26 07:11:54.425305] 2024-06-26T07:11:54.4261712Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_cpu_cpp_wrapper.py', '-m', 'serial', '--shard-id=2', '--num-shards=2', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 07:11:54.425674] 2024-06-26T07:12:00.3004066Z 2024-06-26T07:12:00.3005724Z inductor/test_cpu_cpp_wrapper 2/2 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_cpu_cpp_wrapper_2.2_9053486926a03a0f_.log 2024-06-26T07:12:00.3006848Z Running 0 items in this shard: 2024-06-26T07:12:00.3007131Z 2024-06-26T07:12:00.3010846Z Running inductor/test_cpu_cpp_wrapper 1/2 ... [2024-06-26 07:12:00.300692] 2024-06-26T07:12:00.3012343Z Running inductor/test_cpu_cpp_wrapper 2/2 ... [2024-06-26 07:12:00.300936] 2024-06-26T07:12:00.3014757Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_cpu_cpp_wrapper.py', '-m', 'not serial', '--shard-id=1', '--num-shards=2', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 07:12:00.301098] 2024-06-26T07:12:00.3017606Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_cpu_cpp_wrapper.py', '-m', 'not serial', '--shard-id=2', '--num-shards=2', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 07:12:00.301295] 2024-06-26T07:17:00.2365467Z 2024-06-26T07:17:00.2369562Z inductor/test_cpu_cpp_wrapper 1/2 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_cpu_cpp_wrapper_1.2_b9e36bd7b67b4e9d_.log 2024-06-26T07:17:00.2403452Z Running 64 items in this shard: test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_add_complex4_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_adding_tensor_offsets_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_cat_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_conv2d_binary_inplace_fusion_pass_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_conv2d_unary_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_cumsum_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_custom_op_1_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_dtype_sympy_expr_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_dynamic_qlinear_qat_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_index_put1_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_linear1_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_linear2_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_lstm_packed_change_input_sizes_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_polar_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_profiler_mark_wrapper_call_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_qconv2d_add_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_qconv2d_dequant_promotion_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_qconv2d_maxpool2d_linear_dynamic_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_qlinear_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_qlinear_dequant_promotion_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_randn_with_dtype_and_device_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_reduction1_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_relu_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_repeat_interleave_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_scalar_output_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_scatter1_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_scatter5_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_scatter6_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_scatter_reduce2_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_silu_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_sum_dtype_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_view_as_complex_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_add_complex_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_bitwise_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_bmm1_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_conv2d_binary_inplace_fusion_pass_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_cumsum_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_dynamic_qlinear_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_dynamic_qlinear_qat_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_embedding_bag_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_linear2_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_lstm_packed_change_input_sizes_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_mm_views_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_polar_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_profiler_mark_wrapper_call_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_qconv2d_add_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_qconv2d_add_relu_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_qconv2d_dequant_promotion_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_qconv2d_maxpool2d_linear_dynamic_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_qlinear_add_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_qlinear_add_relu_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_qlinear_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_qlinear_dequant_promotion_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_qlinear_gelu_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_randint_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_reduction1_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_scalar_input_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_scalar_output_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_scaled_dot_product_attention_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_scatter1_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_scatter3_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_scatter_reduce1_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_scatter_reduce2_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_tensor2_cpu_dynamic_shapes_cpp_wrapper 2024-06-26T07:17:00.2436869Z 2024-06-26T07:19:28.8917147Z 2024-06-26T07:19:28.8919242Z inductor/test_cpu_cpp_wrapper 2/2 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_cpu_cpp_wrapper_2.2_cae3b70f35a53334_.log 2024-06-26T07:19:28.8960053Z Running 76 items in this shard: test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_add_complex_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_as_strided_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_bernoulli1_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_bitwise_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_bmm1_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_bmm2_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_conv2d_binary_inplace_fusion_failed_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_conv_transpose2d_packed_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_custom_op_2_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_custom_op_3_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_dynamic_qlinear_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_embedding_bag_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_index_put_deterministic_fallback_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_inductor_layout_optimization_input_mutations_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_int_div_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_mm_views_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_multi_threading_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_multihead_attention_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_qconv2d_add_relu_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_qconv2d_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_qconv2d_relu_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_qlinear_add_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_qlinear_add_relu_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_qlinear_gelu_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_qlinear_relu_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_randint_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_scalar_input_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_scaled_dot_product_attention_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_scatter2_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_scatter3_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_scatter4_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_scatter_reduce1_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_scatter_reduce3_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_sort_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_sum_int_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_tensor2_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_transpose_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::TestCppWrapper::test_view_as_real_cpu_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_add_complex4_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_adding_tensor_offsets_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_as_strided_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_bernoulli1_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_bmm2_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_cat_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_conv2d_binary_inplace_fusion_failed_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_conv2d_unary_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_conv_transpose2d_packed_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_custom_op_1_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_custom_op_2_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_custom_op_3_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_dtype_sympy_expr_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_index_put1_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_index_put_deterministic_fallback_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_inductor_layout_optimization_input_mutations_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_int_div_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_linear1_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_multi_threading_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_multihead_attention_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_qconv2d_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_qconv2d_relu_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_qlinear_relu_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_randn_with_dtype_and_device_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_relu_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_repeat_interleave_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_scatter2_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_scatter4_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_scatter5_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_scatter6_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_scatter_reduce3_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_silu_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_sort_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_sum_dtype_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_sum_int_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_transpose_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_view_as_complex_cpu_dynamic_shapes_cpp_wrapper, test/inductor/test_cpu_cpp_wrapper.py::DynamicShapesCppWrapperCpuTests::test_view_as_real_cpu_dynamic_shapes_cpp_wrapper 2024-06-26T07:19:28.8998895Z 2024-06-26T07:19:29.9147997Z + python test/run_test.py --include inductor/test_cuda_cpp_wrapper 2024-06-26T07:19:30.0009287Z /var/lib/jenkins/workspace/test/run_test.py:21: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html 2024-06-26T07:19:30.0010437Z import pkg_resources 2024-06-26T07:19:32.0884301Z No TD results found 2024-06-26T07:19:32.0886541Z Downloading https://ossci-metrics.s3.amazonaws.com/slow-tests.json to /var/lib/jenkins/workspace/test/.pytorch-slow-tests.json 2024-06-26T07:19:32.0889485Z Downloading https://ossci-metrics.s3.amazonaws.com/disabled-tests-condensed.json to /var/lib/jenkins/workspace/test/.pytorch-disabled-tests.json 2024-06-26T07:19:32.0983753Z ##[warning] Gathered no stats from artifacts for linux-focal-cuda12.1-py3.10-gcc9-sm86 build env and inductor_cpp_wrapper_abi_compatible test config. Using default build env and inductor_cpp_wrapper_abi_compatible test config instead. 2024-06-26T07:19:32.1347177Z ##[warning] Gathered no stats from artifacts for linux-focal-cuda12.1-py3.10-gcc9-sm86 build env and inductor_cpp_wrapper_abi_compatible test config. Using default build env and inductor_cpp_wrapper_abi_compatible test config instead. 2024-06-26T07:19:32.1356584Z Running all tests 2024-06-26T07:19:32.1359893Z Running parallel tests on 3 processes 2024-06-26T07:19:32.1360562Z Name: tests to run (est. time: 7.49min) 2024-06-26T07:19:32.1361105Z Serial tests (0): 2024-06-26T07:19:32.1361438Z Parallel tests (2): 2024-06-26T07:19:32.1361820Z inductor/test_cuda_cpp_wrapper 1/2 2024-06-26T07:19:32.1363651Z inductor/test_cuda_cpp_wrapper 2/2 2024-06-26T07:19:32.1364199Z Name: excluded (est. time: 0.0min) 2024-06-26T07:19:32.1364657Z Serial tests (0): 2024-06-26T07:19:32.1364994Z Parallel tests (0): 2024-06-26T07:19:32.1365607Z Starting test batch 'tests to run' 0.0 seconds after initiating testing 2024-06-26T07:19:32.1405696Z Running inductor/test_cuda_cpp_wrapper 1/2 ... [2024-06-26 07:19:32.140195] 2024-06-26T07:19:32.1409427Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_cuda_cpp_wrapper.py', '-m', 'serial', '--shard-id=1', '--num-shards=2', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 07:19:32.140497] 2024-06-26T07:19:38.0170980Z 2024-06-26T07:19:38.0172531Z inductor/test_cuda_cpp_wrapper 1/2 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_cuda_cpp_wrapper_1.2_01507df6205c0c2f_.log 2024-06-26T07:19:38.0173664Z Running 0 items in this shard: 2024-06-26T07:19:38.0173935Z 2024-06-26T07:19:38.0175938Z Running inductor/test_cuda_cpp_wrapper 2/2 ... [2024-06-26 07:19:38.017159] 2024-06-26T07:19:38.0179516Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_cuda_cpp_wrapper.py', '-m', 'serial', '--shard-id=2', '--num-shards=2', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 07:19:38.017567] 2024-06-26T07:19:43.7421025Z 2024-06-26T07:19:43.7422608Z inductor/test_cuda_cpp_wrapper 2/2 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_cuda_cpp_wrapper_2.2_9b0319518f18533a_.log 2024-06-26T07:19:43.7423757Z Running 0 items in this shard: 2024-06-26T07:19:43.7424379Z 2024-06-26T07:19:43.7428925Z Running inductor/test_cuda_cpp_wrapper 1/2 ... [2024-06-26 07:19:43.742344] 2024-06-26T07:19:43.7430153Z Running inductor/test_cuda_cpp_wrapper 2/2 ... [2024-06-26 07:19:43.742420] 2024-06-26T07:19:43.7432199Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_cuda_cpp_wrapper.py', '-m', 'not serial', '--shard-id=1', '--num-shards=2', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 07:19:43.742747] 2024-06-26T07:19:43.7435216Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_cuda_cpp_wrapper.py', '-m', 'not serial', '--shard-id=2', '--num-shards=2', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 07:19:43.742807] 2024-06-26T07:26:25.0205658Z 2024-06-26T07:26:25.0207371Z inductor/test_cuda_cpp_wrapper 2/2 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_cuda_cpp_wrapper_2.2_422cb75bc65b5a23_.log 2024-06-26T07:26:25.0234607Z Running 45 items in this shard: test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_adding_tensor_offsets_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_bitwise_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_bmm1_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_buffer_use_after_remove_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_cat_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_convolution1_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_custom_op_1_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_custom_op_2_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_fft_real_input_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_index_tensor_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_linear_relu_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_mm_views_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_multi_device_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_multi_threading_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_randint_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_reduction1_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_repeat_interleave_2_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_roi_align_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_scalar_input_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_scaled_dot_product_attention_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_scaled_dot_product_efficient_attention_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_silu_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_adding_tensor_offsets_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_batch_norm_2d_2_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_bernoulli1_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_conv_backward_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_convolution1_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_custom_op_1_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_custom_op_2_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_custom_op_3_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_fft_real_input_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_fft_real_input_real_output_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_inductor_layout_optimization_input_mutations_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_layer_norm_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_linear1_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_multi_device_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_multi_threading_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_randint_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_relu_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_scalar_input_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_scaled_dot_product_attention_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_scaled_dot_product_efficient_attention_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_silu_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_sort_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_sum_int_cuda_dynamic_shapes_cuda_wrapper 2024-06-26T07:26:25.0258947Z 2024-06-26T07:28:00.3881766Z 2024-06-26T07:28:00.3883583Z inductor/test_cuda_cpp_wrapper 1/2 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_cuda_cpp_wrapper_1.2_c8714cba63e7993b_.log 2024-06-26T07:28:00.3916232Z Running 51 items in this shard: test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_add_complex4_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_add_complex_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_addmm_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_as_strided_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_batch_norm_2d_2_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_bernoulli1_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_bmm2_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_cat_slice_cat_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_conv_backward_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_custom_op_3_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_embedding_bag_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_fft_real_input_real_output_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_foreach_cpp_wrapper_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_index_put_deterministic_fallback_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_inductor_layout_optimization_input_mutations_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_insignificant_strides_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_layer_norm_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_linear1_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_linear2_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_pow3_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_profiler_mark_wrapper_call_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_relu_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_sort_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_sum_dtype_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_sum_int_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::TestCudaWrapper::test_transpose_cuda_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_add_complex4_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_add_complex_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_addmm_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_as_strided_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_bitwise_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_bmm1_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_bmm2_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_buffer_use_after_remove_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_cat_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_cat_slice_cat_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_embedding_bag_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_foreach_cpp_wrapper_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_index_put_deterministic_fallback_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_index_tensor_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_insignificant_strides_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_linear2_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_linear_relu_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_mm_views_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_pow3_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_profiler_mark_wrapper_call_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_reduction1_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_repeat_interleave_2_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_roi_align_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_sum_dtype_cuda_dynamic_shapes_cuda_wrapper, test/inductor/test_cuda_cpp_wrapper.py::DynamicShapesCudaWrapperCudaTests::test_transpose_cuda_dynamic_shapes_cuda_wrapper 2024-06-26T07:28:00.3943660Z 2024-06-26T07:28:01.4451897Z + TORCHINDUCTOR_CPP_WRAPPER=1 2024-06-26T07:28:01.4453623Z + python benchmarks/dynamo/timm_models.py --device cuda --accuracy --amp --training --inductor --disable-cudagraphs --only vit_base_patch16_224 --output /var/lib/jenkins/workspace/test/test-reports/inductor_cpp_wrapper_training.csv 2024-06-26T07:28:04.4297473Z 2024-06-26T07:28:05.3498803Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:28:05.3499243Z 2024-06-26T07:28:05.4668364Z model.safetensors: 0% 0.00/346M [00:00 will be ignored 2024-06-26T07:30:08.0082432Z pass 2024-06-26T07:30:11.1158856Z + python benchmarks/dynamo/check_accuracy.py --actual /var/lib/jenkins/workspace/test/test-reports/inductor_cpp_wrapper_training.csv --expected benchmarks/dynamo/ci_expected_accuracy//inductor_timm_training.csv 2024-06-26T07:30:11.3732205Z vit_base_patch16_224 PASS 2024-06-26T07:30:11.4111747Z + cleanup_workspace 2024-06-26T07:30:11.4112728Z + echo 'sudo may print the following warning message that can be ignored. The chown command will still run.' 2024-06-26T07:30:11.4114106Z sudo may print the following warning message that can be ignored. The chown command will still run. 2024-06-26T07:30:11.4117013Z + echo ' sudo: setrlimit(RLIMIT_STACK): Operation not permitted' 2024-06-26T07:30:11.4117943Z sudo: setrlimit(RLIMIT_STACK): Operation not permitted 2024-06-26T07:30:11.4119008Z + echo 'For more details refer to https://github.com/sudo-project/sudo/issues/42' 2024-06-26T07:30:11.4119924Z For more details refer to https://github.com/sudo-project/sudo/issues/42 2024-06-26T07:30:11.4120635Z + sudo chown -R 1000 /var/lib/jenkins/workspace 2024-06-26T07:30:12.0445109Z ##[group]Run cat test/**/*_toprint.log || true 2024-06-26T07:30:12.0445642Z cat test/**/*_toprint.log || true 2024-06-26T07:30:12.0454698Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:30:12.0455219Z env: 2024-06-26T07:30:12.0455497Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:30:12.0455959Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:30:12.0456715Z DOCKER_CONTAINER_ID: 21f4e73c270d5ddb5f96e416bc6cbb7b3c0b9b5ecf60cf56efca911c1edbc7fd 2024-06-26T07:30:12.0457371Z ##[endgroup] 2024-06-26T07:30:12.0621600Z cat: test/**/*_toprint.log: No such file or directory 2024-06-26T07:30:12.0650573Z ##[group]Run kill "$MONITOR_SCRIPT_PID" 2024-06-26T07:30:12.0651053Z kill "$MONITOR_SCRIPT_PID" 2024-06-26T07:30:12.0658751Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:30:12.0659276Z env: 2024-06-26T07:30:12.0659566Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:30:12.0660042Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:30:12.0660977Z DOCKER_CONTAINER_ID: 21f4e73c270d5ddb5f96e416bc6cbb7b3c0b9b5ecf60cf56efca911c1edbc7fd 2024-06-26T07:30:12.0661711Z MONITOR_SCRIPT_PID: 9150 2024-06-26T07:30:12.0662065Z ##[endgroup] 2024-06-26T07:30:12.0867877Z Prepare all required actions 2024-06-26T07:30:12.0868339Z Getting action download info 2024-06-26T07:30:12.2176455Z Download action repository 'actions/upload-artifact@v3' (SHA:a8a3f3ad30e3422c9c7b888a15615d19a852ae32) 2024-06-26T07:30:12.3802793Z ##[group]Run ./.github/actions/upload-test-artifacts 2024-06-26T07:30:12.3803265Z with: 2024-06-26T07:30:12.3803890Z file-suffix: test-inductor_cpp_wrapper_abi_compatible-1-1-linux.g5.4xlarge.nvidia.gpu_26688912903 2024-06-26T07:30:12.3804646Z s3-bucket: gha-artifacts 2024-06-26T07:30:12.3804992Z env: 2024-06-26T07:30:12.3805267Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:30:12.3805730Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:30:12.3806489Z DOCKER_CONTAINER_ID: 21f4e73c270d5ddb5f96e416bc6cbb7b3c0b9b5ecf60cf56efca911c1edbc7fd 2024-06-26T07:30:12.3807152Z ##[endgroup] 2024-06-26T07:30:12.3832082Z ##[group]Run # Remove any previous test jsons if they exist 2024-06-26T07:30:12.3832757Z # Remove any previous test jsons if they exist 2024-06-26T07:30:12.3833294Z rm -f test-jsons-*.zip 2024-06-26T07:30:12.3833827Z zip -r "test-jsons-${FILE_SUFFIX}.zip" test -i '*.json' 2024-06-26T07:30:12.3841696Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:30:12.3842217Z env: 2024-06-26T07:30:12.3842501Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:30:12.3842956Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:30:12.3843707Z DOCKER_CONTAINER_ID: 21f4e73c270d5ddb5f96e416bc6cbb7b3c0b9b5ecf60cf56efca911c1edbc7fd 2024-06-26T07:30:12.3844698Z FILE_SUFFIX: test-inductor_cpp_wrapper_abi_compatible-1-1-linux.g5.4xlarge.nvidia.gpu_26688912903 2024-06-26T07:30:12.3845431Z ##[endgroup] 2024-06-26T07:30:12.4023190Z adding: test/allowlist_for_publicAPI.json (deflated 79%) 2024-06-26T07:30:12.4053188Z adding: test/benchmark_utils/callgrind_artifacts.json (deflated 92%) 2024-06-26T07:30:12.4054631Z adding: test/minioptest_failures_dict.json (deflated 70%) 2024-06-26T07:30:12.4059767Z adding: test/profiler/profiler_utils_mock_events.json (deflated 87%) 2024-06-26T07:30:12.4061827Z adding: test/test-reports/td_exclusions-0f4a708b8c33ebd02083.json (deflated 17%) 2024-06-26T07:30:12.4062778Z adding: test/test-reports/td_exclusions-802e15357f5601769dfd.json (deflated 15%) 2024-06-26T07:30:12.4063569Z adding: test/.pytorch-slow-tests.json (deflated 77%) 2024-06-26T07:30:12.4068442Z adding: test/.pytorch-disabled-tests.json (deflated 84%) 2024-06-26T07:30:12.4094982Z ##[group]Run # Remove any previous test reports if they exist 2024-06-26T07:30:12.4095645Z # Remove any previous test reports if they exist 2024-06-26T07:30:12.4096182Z rm -f test-reports-*.zip 2024-06-26T07:30:12.4096784Z zip -r "test-reports-${FILE_SUFFIX}.zip" test -i '*.xml' -i '*.csv' 2024-06-26T07:30:12.4104555Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:30:12.4105063Z env: 2024-06-26T07:30:12.4105359Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:30:12.4105828Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:30:12.4106578Z DOCKER_CONTAINER_ID: 21f4e73c270d5ddb5f96e416bc6cbb7b3c0b9b5ecf60cf56efca911c1edbc7fd 2024-06-26T07:30:12.4107575Z FILE_SUFFIX: test-inductor_cpp_wrapper_abi_compatible-1-1-linux.g5.4xlarge.nvidia.gpu_26688912903 2024-06-26T07:30:12.4108303Z ##[endgroup] 2024-06-26T07:30:12.4268915Z adding: test/test-reports/python-pytest/inductor.test_cpu_cpp_wrapper/inductor.test_cpu_cpp_wrapper-b9b2047d9fd8d101.xml (deflated 28%) 2024-06-26T07:30:12.4270493Z adding: test/test-reports/python-pytest/inductor.test_cpu_cpp_wrapper/inductor.test_cpu_cpp_wrapper-23f9534895fe2e83.xml (deflated 28%) 2024-06-26T07:30:12.4272868Z adding: test/test-reports/python-pytest/inductor.test_cpu_cpp_wrapper/inductor.test_cpu_cpp_wrapper-d0bb6b53404b8cd4.xml (deflated 91%) 2024-06-26T07:30:12.4276632Z adding: test/test-reports/python-pytest/inductor.test_cpu_cpp_wrapper/inductor.test_cpu_cpp_wrapper-3509ad8cb877d10e.xml (deflated 92%) 2024-06-26T07:30:12.4279059Z adding: test/test-reports/python-pytest/inductor.test_cuda_cpp_wrapper/inductor.test_cuda_cpp_wrapper-145d207a2e7031b6.xml (deflated 28%) 2024-06-26T07:30:12.4281391Z adding: test/test-reports/python-pytest/inductor.test_cuda_cpp_wrapper/inductor.test_cuda_cpp_wrapper-1211e58ea312bbf7.xml (deflated 28%) 2024-06-26T07:30:12.4283689Z adding: test/test-reports/python-pytest/inductor.test_cuda_cpp_wrapper/inductor.test_cuda_cpp_wrapper-fe5c8e0398e32601.xml (deflated 89%) 2024-06-26T07:30:12.4285534Z adding: test/test-reports/python-pytest/inductor.test_cuda_cpp_wrapper/inductor.test_cuda_cpp_wrapper-ea461a56304857b8.xml (deflated 89%) 2024-06-26T07:30:12.4286841Z adding: test/test-reports/inductor_cpp_wrapper_training.csv (deflated 33%) 2024-06-26T07:30:12.4309997Z ##[group]Run # Remove any previous usage logs if they exist 2024-06-26T07:30:12.4310739Z # Remove any previous usage logs if they exist 2024-06-26T07:30:12.4311295Z rm -f logs-*.zip 2024-06-26T07:30:12.4312007Z # this workflow is also run in bazel build test, but we dont generate usage reports for it 2024-06-26T07:30:12.4312802Z # so check to see if the file exists first 2024-06-26T07:30:12.4313306Z if [ -f 'usage_log.txt' ]; then 2024-06-26T07:30:12.4313844Z  zip "logs-${FILE_SUFFIX}.zip" 'usage_log.txt' 2024-06-26T07:30:12.4314335Z fi 2024-06-26T07:30:12.4314703Z if ls test/**/*.log 1> /dev/null 2>&1; then 2024-06-26T07:30:12.4315278Z  zip -r "logs-${FILE_SUFFIX}.zip" test -i '*.log' 2024-06-26T07:30:12.4315777Z fi 2024-06-26T07:30:12.4323141Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:30:12.4323645Z env: 2024-06-26T07:30:12.4323923Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:30:12.4324385Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:30:12.4325152Z DOCKER_CONTAINER_ID: 21f4e73c270d5ddb5f96e416bc6cbb7b3c0b9b5ecf60cf56efca911c1edbc7fd 2024-06-26T07:30:12.4326155Z FILE_SUFFIX: test-inductor_cpp_wrapper_abi_compatible-1-1-linux.g5.4xlarge.nvidia.gpu_26688912903 2024-06-26T07:30:12.4326877Z ##[endgroup] 2024-06-26T07:30:12.4366577Z adding: usage_log.txt (deflated 92%) 2024-06-26T07:30:12.4545252Z adding: test/test-reports/inductor.test_cpu_cpp_wrapper_1.2_18b5b8ee628158d6_.log (deflated 51%) 2024-06-26T07:30:12.4546866Z adding: test/test-reports/inductor.test_cpu_cpp_wrapper_2.2_9053486926a03a0f_.log (deflated 51%) 2024-06-26T07:30:12.4548432Z adding: test/test-reports/inductor.test_cpu_cpp_wrapper_1.2_b9e36bd7b67b4e9d_.log (deflated 89%) 2024-06-26T07:30:12.4552009Z adding: test/test-reports/inductor.test_cpu_cpp_wrapper_2.2_cae3b70f35a53334_.log (deflated 89%) 2024-06-26T07:30:12.4553644Z adding: test/test-reports/inductor.test_cuda_cpp_wrapper_1.2_01507df6205c0c2f_.log (deflated 51%) 2024-06-26T07:30:12.4555219Z adding: test/test-reports/inductor.test_cuda_cpp_wrapper_2.2_9b0319518f18533a_.log (deflated 51%) 2024-06-26T07:30:12.4556844Z adding: test/test-reports/inductor.test_cuda_cpp_wrapper_2.2_422cb75bc65b5a23_.log (deflated 88%) 2024-06-26T07:30:12.4558454Z adding: test/test-reports/inductor.test_cuda_cpp_wrapper_1.2_c8714cba63e7993b_.log (deflated 88%) 2024-06-26T07:30:12.4584029Z ##[group]Run # Remove any previous debugging artifacts if they exist 2024-06-26T07:30:12.4584763Z # Remove any previous debugging artifacts if they exist 2024-06-26T07:30:12.4585327Z rm -f debug-*.zip 2024-06-26T07:30:12.4585726Z if [ -d 'test/debug' ]; then 2024-06-26T07:30:12.4586234Z  zip -r "debug-${FILE_SUFFIX}.zip" test/debug 2024-06-26T07:30:12.4586718Z fi 2024-06-26T07:30:12.4594044Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:30:12.4594540Z env: 2024-06-26T07:30:12.4594826Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:30:12.4595295Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:30:12.4596175Z DOCKER_CONTAINER_ID: 21f4e73c270d5ddb5f96e416bc6cbb7b3c0b9b5ecf60cf56efca911c1edbc7fd 2024-06-26T07:30:12.4597376Z FILE_SUFFIX: test-inductor_cpp_wrapper_abi_compatible-1-1-linux.g5.4xlarge.nvidia.gpu_26688912903 2024-06-26T07:30:12.4598102Z ##[endgroup] 2024-06-26T07:30:12.4671626Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-06-26T07:30:12.4672065Z with: 2024-06-26T07:30:12.4672354Z s3-bucket: gha-artifacts 2024-06-26T07:30:12.4672790Z s3-prefix: pytorch/pytorch/9673646808/1/artifact 2024-06-26T07:30:12.4673270Z retention-days: 14 2024-06-26T07:30:12.4673606Z if-no-files-found: warn 2024-06-26T07:30:12.4673965Z path: test-jsons-*.zip 2024-06-26T07:30:12.4674322Z name: artifact 2024-06-26T07:30:12.4674625Z region: us-east-1 2024-06-26T07:30:12.4674931Z env: 2024-06-26T07:30:12.4675210Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:30:12.4675666Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:30:12.4676423Z DOCKER_CONTAINER_ID: 21f4e73c270d5ddb5f96e416bc6cbb7b3c0b9b5ecf60cf56efca911c1edbc7fd 2024-06-26T07:30:12.4677087Z ##[endgroup] 2024-06-26T07:30:12.7738474Z NOTE: s3-prefix specified, ignoring name parameter 2024-06-26T07:30:12.7739389Z With the provided path, there will be 1 file uploaded 2024-06-26T07:30:12.7740360Z Uploading to s3 prefix: pytorch/pytorch/9673646808/1/artifact 2024-06-26T07:30:12.7767299Z Starting upload of test-jsons-test-inductor_cpp_wrapper_abi_compatible-1-1-linux.g5.4xlarge.nvidia.gpu_26688912903.zip 2024-06-26T07:30:12.9029724Z Finished upload of test-jsons-test-inductor_cpp_wrapper_abi_compatible-1-1-linux.g5.4xlarge.nvidia.gpu_26688912903.zip 2024-06-26T07:30:12.9160309Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-06-26T07:30:12.9160761Z with: 2024-06-26T07:30:12.9161055Z s3-bucket: gha-artifacts 2024-06-26T07:30:12.9161489Z s3-prefix: pytorch/pytorch/9673646808/1/artifact 2024-06-26T07:30:12.9161968Z retention-days: 14 2024-06-26T07:30:12.9162304Z if-no-files-found: error 2024-06-26T07:30:12.9162678Z path: test-reports-*.zip 2024-06-26T07:30:12.9163056Z name: artifact 2024-06-26T07:30:12.9163360Z region: us-east-1 2024-06-26T07:30:12.9163665Z env: 2024-06-26T07:30:12.9163943Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:30:12.9164404Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:30:12.9165150Z DOCKER_CONTAINER_ID: 21f4e73c270d5ddb5f96e416bc6cbb7b3c0b9b5ecf60cf56efca911c1edbc7fd 2024-06-26T07:30:12.9165806Z ##[endgroup] 2024-06-26T07:30:13.2183818Z NOTE: s3-prefix specified, ignoring name parameter 2024-06-26T07:30:13.2184437Z With the provided path, there will be 1 file uploaded 2024-06-26T07:30:13.2185064Z Uploading to s3 prefix: pytorch/pytorch/9673646808/1/artifact 2024-06-26T07:30:13.2210744Z Starting upload of test-reports-test-inductor_cpp_wrapper_abi_compatible-1-1-linux.g5.4xlarge.nvidia.gpu_26688912903.zip 2024-06-26T07:30:13.3200433Z Finished upload of test-reports-test-inductor_cpp_wrapper_abi_compatible-1-1-linux.g5.4xlarge.nvidia.gpu_26688912903.zip 2024-06-26T07:30:13.3360568Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-06-26T07:30:13.3361037Z with: 2024-06-26T07:30:13.3361326Z s3-bucket: gha-artifacts 2024-06-26T07:30:13.3361814Z s3-prefix: pytorch/pytorch/9673646808/1/artifact 2024-06-26T07:30:13.3362292Z retention-days: 14 2024-06-26T07:30:13.3362635Z if-no-files-found: ignore 2024-06-26T07:30:13.3362997Z path: logs-*.zip 2024-06-26T07:30:13.3363310Z name: artifact 2024-06-26T07:30:13.3363621Z region: us-east-1 2024-06-26T07:30:13.3363915Z env: 2024-06-26T07:30:13.3364200Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:30:13.3364662Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:30:13.3365414Z DOCKER_CONTAINER_ID: 21f4e73c270d5ddb5f96e416bc6cbb7b3c0b9b5ecf60cf56efca911c1edbc7fd 2024-06-26T07:30:13.3366060Z ##[endgroup] 2024-06-26T07:30:13.6472074Z NOTE: s3-prefix specified, ignoring name parameter 2024-06-26T07:30:13.6472953Z With the provided path, there will be 1 file uploaded 2024-06-26T07:30:13.6473829Z Uploading to s3 prefix: pytorch/pytorch/9673646808/1/artifact 2024-06-26T07:30:13.6501084Z Starting upload of logs-test-inductor_cpp_wrapper_abi_compatible-1-1-linux.g5.4xlarge.nvidia.gpu_26688912903.zip 2024-06-26T07:30:13.7593112Z Finished upload of logs-test-inductor_cpp_wrapper_abi_compatible-1-1-linux.g5.4xlarge.nvidia.gpu_26688912903.zip 2024-06-26T07:30:13.7724707Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-06-26T07:30:13.7725163Z with: 2024-06-26T07:30:13.7725453Z s3-bucket: gha-artifacts 2024-06-26T07:30:13.7725889Z s3-prefix: pytorch/pytorch/9673646808/1/artifact 2024-06-26T07:30:13.7726366Z retention-days: 14 2024-06-26T07:30:13.7726706Z if-no-files-found: ignore 2024-06-26T07:30:13.7727077Z path: debug-*.zip 2024-06-26T07:30:13.7727404Z name: artifact 2024-06-26T07:30:13.7727706Z region: us-east-1 2024-06-26T07:30:13.7728012Z env: 2024-06-26T07:30:13.7728291Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:30:13.7729008Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:30:13.7729780Z DOCKER_CONTAINER_ID: 21f4e73c270d5ddb5f96e416bc6cbb7b3c0b9b5ecf60cf56efca911c1edbc7fd 2024-06-26T07:30:13.7730445Z ##[endgroup] 2024-06-26T07:30:14.0770085Z No files were found with the provided path: debug-*.zip. No artifacts will be uploaded. 2024-06-26T07:30:14.0899885Z ##[group]Run # shellcheck disable=SC2156 2024-06-26T07:30:14.0900513Z # shellcheck disable=SC2156 2024-06-26T07:30:14.0901324Z find . -iname "core.[1-9]*" -exec docker exec "${DOCKER_CONTAINER_ID}" sh -c "gdb python {} -ex 'bt' -ex 'q'" \; 2024-06-26T07:30:14.0909418Z shell: /usr/bin/bash -e {0} 2024-06-26T07:30:14.0909779Z env: 2024-06-26T07:30:14.0910069Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:30:14.0910536Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:30:14.0911289Z DOCKER_CONTAINER_ID: 21f4e73c270d5ddb5f96e416bc6cbb7b3c0b9b5ecf60cf56efca911c1edbc7fd 2024-06-26T07:30:14.0911951Z ##[endgroup] 2024-06-26T07:30:14.2546464Z ##[group]Run pytorch/test-infra/.github/actions/teardown-linux@main 2024-06-26T07:30:14.2547055Z with: 2024-06-26T07:30:14.2547320Z env: 2024-06-26T07:30:14.2547602Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:30:14.2548062Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:30:14.2548834Z DOCKER_CONTAINER_ID: 21f4e73c270d5ddb5f96e416bc6cbb7b3c0b9b5ecf60cf56efca911c1edbc7fd 2024-06-26T07:30:14.2549498Z ##[endgroup] 2024-06-26T07:30:14.2567006Z ##[group]Run set -eou pipefail 2024-06-26T07:30:14.2567423Z set -eou pipefail 2024-06-26T07:30:14.2567786Z  2024-06-26T07:30:14.2568317Z echo "Holding runner for 2 hours until all ssh sessions have logged out" 2024-06-26T07:30:14.2569097Z for _ in $(seq 1440); do 2024-06-26T07:30:14.2569591Z  # Break if no ssh session exists anymore 2024-06-26T07:30:14.2570106Z  if [ "$(who)" = "" ]; then 2024-06-26T07:30:14.2570522Z  break 2024-06-26T07:30:14.2570872Z  fi 2024-06-26T07:30:14.2571173Z  echo "." 2024-06-26T07:30:14.2571508Z  sleep 5 2024-06-26T07:30:14.2571837Z done 2024-06-26T07:30:14.2579366Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:30:14.2579869Z env: 2024-06-26T07:30:14.2580219Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:30:14.2580689Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:30:14.2581464Z DOCKER_CONTAINER_ID: 21f4e73c270d5ddb5f96e416bc6cbb7b3c0b9b5ecf60cf56efca911c1edbc7fd 2024-06-26T07:30:14.2582125Z ##[endgroup] 2024-06-26T07:30:14.2601732Z Holding runner for 2 hours until all ssh sessions have logged out 2024-06-26T07:30:14.2638541Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2024-06-26T07:30:14.2639326Z # ignore expansion of "docker ps -q" since it could be empty 2024-06-26T07:30:14.2639928Z # shellcheck disable=SC2046 2024-06-26T07:30:14.2640414Z docker stop $(docker ps -q) || true 2024-06-26T07:30:14.2640898Z # Prune all of the docker images 2024-06-26T07:30:14.2641477Z docker system prune -af 2024-06-26T07:30:14.2648777Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:30:14.2649293Z env: 2024-06-26T07:30:14.2649569Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:30:14.2650037Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:30:14.2650807Z DOCKER_CONTAINER_ID: 21f4e73c270d5ddb5f96e416bc6cbb7b3c0b9b5ecf60cf56efca911c1edbc7fd 2024-06-26T07:30:14.2651476Z ##[endgroup] 2024-06-26T07:30:14.5583783Z 21f4e73c270d 2024-06-26T07:30:14.9869535Z Deleted Containers: 2024-06-26T07:30:14.9870123Z 21f4e73c270d5ddb5f96e416bc6cbb7b3c0b9b5ecf60cf56efca911c1edbc7fd 2024-06-26T07:30:14.9870597Z 2024-06-26T07:30:19.9889675Z Deleted Images: 2024-06-26T07:30:19.9891398Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:30:19.9893673Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks@sha256:216c88a4f79ebfa71a5dcf4d9a946548184354a3ea1f677f4b1065d28705debb 2024-06-26T07:30:19.9895280Z deleted: sha256:0058b15e517a024817bccd921dc9af264c964f500b3cb9b3f4649a8ac22cc2dd 2024-06-26T07:30:19.9896137Z deleted: sha256:754ead7012f0b7691885a9660f02e80be6cee8c5665486fb995c1fb06adb6e92 2024-06-26T07:30:19.9896971Z deleted: sha256:fbe4496d8830e11be86d8f222522e7956f32f85bfc06b05ea53961f34a58af74 2024-06-26T07:30:19.9897812Z deleted: sha256:1c83814aa1a1a7e0cc998e3479bdab8e8766b975560cbf00690acf39ed899a80 2024-06-26T07:30:19.9898678Z deleted: sha256:e9ea8e61942c7f8ae4aab97b8d102b01d6bb4b6cf2a605808cd34130a17d8a0f 2024-06-26T07:30:19.9899531Z deleted: sha256:acc5fc32588cd95e082a6ce35e48d0f303ae8f96e3ab65c4e375b85e1f3c4a92 2024-06-26T07:30:19.9900544Z deleted: sha256:a93e53400904d29e4185d3be942ea34f19572ea438962788ae4e9b3d9bf4c498 2024-06-26T07:30:19.9901602Z deleted: sha256:c97092b88b5e4c77c68bbc4b51afab64e38719af1ff58013ec49a696cdd40a6e 2024-06-26T07:30:19.9902462Z deleted: sha256:b132889c90d67ffa53655846603e3fcc2372c23f04dbdbc54690a39d304eb89b 2024-06-26T07:30:19.9903280Z deleted: sha256:915d54081ed607710624abe3f2490114c745858831f4fc13396bd3b4b9a121bc 2024-06-26T07:30:19.9904115Z deleted: sha256:bfa8d446c498c87f535aef102695564de1b22c755e6c63944ae2f5073a2b31ec 2024-06-26T07:30:19.9904964Z deleted: sha256:e71460fb363c29e70bbe357d680aaa7ae694f094ef2f2713609158ad90611744 2024-06-26T07:30:19.9905800Z deleted: sha256:84079bb1b4ee1d0119ae3d3e701de460a1324912297c675425c9a36d30fcdb0f 2024-06-26T07:30:19.9906644Z deleted: sha256:d86ac3ca148d4758cb03b493fdd49109d8f1a2c7c85c4b755493c3c4529553e5 2024-06-26T07:30:19.9907492Z deleted: sha256:532b3ab97c44a673a0d5f62ee46fa6a83248a84de8877754a612355be56ed0a3 2024-06-26T07:30:19.9908331Z deleted: sha256:617e2a35f25ae24500c88c0c9b8475f0687fbcbed3d200013b4c99c6d8941aff 2024-06-26T07:30:19.9909181Z deleted: sha256:b88120bcd5a26a660c09c5df13176e0ef098fb2c8cdb57d74ab0796a3d1194d6 2024-06-26T07:30:19.9910018Z deleted: sha256:c016b2e7764735243205fb76fa9a273bb3dd4bf05532288e3a613ce022131ac3 2024-06-26T07:30:19.9910875Z deleted: sha256:bcaca462c390deddd2995de2d245a7495e7d2e1e94f0edad30a573c83d0588fd 2024-06-26T07:30:19.9911731Z deleted: sha256:9e260eba003d5c25d7b410e5c4c3093845d9e46611896840901c689d7fbf8ee6 2024-06-26T07:30:19.9912566Z deleted: sha256:3e62b86f8b911a9b59c62d55f063e71683ae6a01c22418db5d27930712adaad6 2024-06-26T07:30:19.9913401Z deleted: sha256:905920ccb1d88449b8dde686c34a4b2a8b6f59e78ac44916b189ea3593b9fbbb 2024-06-26T07:30:19.9914449Z deleted: sha256:961201237e03acd5061406238dd7a3c1343ac888d7583212cd0ab5ae1b4f0540 2024-06-26T07:30:19.9915492Z deleted: sha256:70047a2aac62159fa28fb4dbd4567ec2ffbab68fe046967e09acb0eb3e5cb9cb 2024-06-26T07:30:19.9916362Z deleted: sha256:1ec680ad781436ae65fa987f5fa1ed032ecd5c82a6e35eea6707de501f62c0f4 2024-06-26T07:30:19.9917276Z deleted: sha256:ef859623a50e85abf6e6c1dbd6188aa765a66cc7b2bd618a1cbe4825b7b2bd91 2024-06-26T07:30:19.9918140Z deleted: sha256:404ade5cacff59773b93ab438bfa64cd3a171d07f6f168bdc4a5d4bfa0b43526 2024-06-26T07:30:19.9919147Z deleted: sha256:5b27de6ee3d9f2f18217bf18dec725f7b4954c0e48c85d35752634c22d62209b 2024-06-26T07:30:19.9920002Z deleted: sha256:498e39c575b3fa069acaac7e46b91b4e54ae3a05f2ada5c4347091f346f25d4c 2024-06-26T07:30:19.9920834Z deleted: sha256:1405919d2694d65669b1f4c842282021afe89208ce86570e96464903733da2d0 2024-06-26T07:30:19.9921655Z deleted: sha256:d5b41e5d70896c0472fc3e6da0516a17d89cd6635dc75010ecddc31ce9690fad 2024-06-26T07:30:19.9922502Z deleted: sha256:18e9379b62b9d0bb40293d28a652eafaee66a499f66f0776bf14e37a513101b7 2024-06-26T07:30:19.9923347Z deleted: sha256:a781f80ed00ff2926a699fd01a309bb0b4fb7d5655eb652c205bb9c7f811035f 2024-06-26T07:30:19.9924190Z deleted: sha256:c0430973b7cf759075330ee29c79bfd1312c91e6033d9dd883b4b1c29743a171 2024-06-26T07:30:19.9925029Z deleted: sha256:e733b3d66efb9342e5a283376c0e1ddffa47a42fecc26e61ecaf0a3472885d97 2024-06-26T07:30:19.9925873Z deleted: sha256:8929c0b2047f74b84c82c39eff9077a92ae1a828cde00c9ab78fb3e0ed5e0283 2024-06-26T07:30:19.9926727Z deleted: sha256:f5b56155fb58a0a60fe6391d3581cf91610ed69d4f0a321257c19944da296a52 2024-06-26T07:30:19.9927566Z deleted: sha256:b54d2cb355238d1aa91e58df93064447b80f53706d1ca62823acc834f5ac54fe 2024-06-26T07:30:19.9928403Z deleted: sha256:e7311285af9eeddb51aa5629aa98386e89f1456ff32843b6aee6443247edf66c 2024-06-26T07:30:19.9929720Z deleted: sha256:67657ceec347da8dc8085d5731633efeac115ba677fa4b7c5966c4260f7abab0 2024-06-26T07:30:19.9930572Z deleted: sha256:b496e50409dbf414930fc9b4437aa0aa4ce27bc7840e050ae459aaffcf9aca86 2024-06-26T07:30:19.9931413Z deleted: sha256:8f5276170cc4a60d36ad7b964a502306b29546254cedcbcb101ea9123497d2c0 2024-06-26T07:30:19.9932240Z deleted: sha256:53d524d1564745e96a7e515462171b73184d9f1ff5454b32fcfbbca39d361467 2024-06-26T07:30:19.9933084Z deleted: sha256:2acbadb00d69b6aca575f04baba4ea26ae2b5c2d85f09945004ad93a78a8eb75 2024-06-26T07:30:19.9934107Z deleted: sha256:02665efeff878aeb603c1edb2e21cb700c171c025d64f5aae1b2b20b12f3964a 2024-06-26T07:30:19.9934972Z deleted: sha256:19bd23e9a51dfe883a8b8d2ff6d66ff1b3476b8912856406bb79b81762aa6d4b 2024-06-26T07:30:19.9935825Z deleted: sha256:73aa8637bf9299d6298dabd858480c274a62117388f2ca1d5e9eb15c6d1e4155 2024-06-26T07:30:19.9936652Z deleted: sha256:5f8968406305f348b1caebc0e035187d6e9965ace7b9d5f2f21114d37c9fe2e1 2024-06-26T07:30:19.9937494Z deleted: sha256:d827104914db0c503cf5c81f13e2456bf4efce42d4cf1f8d5d70838207278bee 2024-06-26T07:30:19.9938341Z deleted: sha256:867b219724f2f1aaf56f42e3e9f03a5d64bdca8a6a72407efd10328aeea5d510 2024-06-26T07:30:19.9939195Z deleted: sha256:b9ff2a7cceb9237b26bcb17728edf8a558eec5a76f63626e84f80541dfc0f1d4 2024-06-26T07:30:19.9940039Z deleted: sha256:be73f509106819007ce2b0f5a1301ac56ae583cb6c1fb69bee93efa0840368f1 2024-06-26T07:30:19.9941008Z deleted: sha256:2a11c07c915c3fdbb4e73096dea73ea950c970d50fe1a5764060bd62b7b7cf2c 2024-06-26T07:30:19.9941854Z deleted: sha256:5e9989622e2abc1c72f8184343507b45d75e4ff971edb68b96cbcd75ae484ff5 2024-06-26T07:30:19.9942703Z deleted: sha256:05ce642bd9cf5a9205bff107df28b1d6cef7d5f6ab3ea944d28c032ec61270df 2024-06-26T07:30:19.9943544Z deleted: sha256:017702617f6c07b73f2088678f4710b794cfe897a213a5cf122a0e2519eae0ac 2024-06-26T07:30:19.9944361Z deleted: sha256:44b3b37bb1ca39dc5cf356de41a23a5c12f605a1992813e408087fb2b0ad6d1c 2024-06-26T07:30:19.9945200Z deleted: sha256:8c387982e9f27db357a1d149dc149cabc0bd04668ad6956387a5072682dada67 2024-06-26T07:30:19.9946033Z deleted: sha256:10d415dca4e3fbb88a747b40317f3c6333c041ba8f73855f67fb9fe981fae5ee 2024-06-26T07:30:19.9946874Z deleted: sha256:6c65469bf0f53dcd625faefe363b8f3136c08388a6cf64d9158e8576e4ee89b1 2024-06-26T07:30:19.9947722Z deleted: sha256:027db5d8b76deeefbd8c34b485ab7ff14ed2a3e6800425c1ce0d77c2e9fdd4ab 2024-06-26T07:30:19.9948567Z deleted: sha256:24941234ad28cf5c8174d7cf18326c10b4e17f2c2137672ea0322df461597dd7 2024-06-26T07:30:19.9949419Z deleted: sha256:240ea2eebfa8519d6c2d88f4c99e66ce4e038d000f93ce8d03726c01d81180ef 2024-06-26T07:30:19.9950261Z deleted: sha256:09e823cb391a69f6a195e3ca8a41624b5f8b34eee14c6eb36277de814a91966e 2024-06-26T07:30:19.9951156Z deleted: sha256:730479d695169a6593bf0ac16b377491dce65175a6d158e012422367d04577fd 2024-06-26T07:30:19.9951979Z deleted: sha256:b0a30f9f7bd5459ff662453b9346a7ba8ea8db1191528345c1953eab4aa2f54e 2024-06-26T07:30:19.9952817Z deleted: sha256:75cefa87effaa3ad361c74642839923101f0f9982f814f3c9e2ed4ad52f2a008 2024-06-26T07:30:19.9953658Z deleted: sha256:6f97db87ba9512e615e871c6982000602982e1e5a5be334a56e7292251e84e00 2024-06-26T07:30:19.9954484Z deleted: sha256:35a033279d5c9bd6b862bfa9331d8fcbf98bbaf778a778fabc882384db9204f8 2024-06-26T07:30:19.9955322Z deleted: sha256:ab9b00c496073d62e69e032178858d3d6d4c4bab9e87065d3785c6da57351d00 2024-06-26T07:30:19.9956143Z deleted: sha256:7ed947299e109c2459de6e240d86f049c30f93f2380659ce441d8737b8cd065f 2024-06-26T07:30:19.9956982Z deleted: sha256:410d5a7f7a9a1cb4551c106b9cc728a9dcff598f9be231a351ce6a0a33f81e64 2024-06-26T07:30:19.9957823Z deleted: sha256:5f0021bb56efa14bb93978c01513e2a1187ba30e69bdb0546d0ef39b30873f88 2024-06-26T07:30:19.9958655Z deleted: sha256:c1601aa97eb84151c14da3aeea351201bd99144d36d66b397f6555d80245d86d 2024-06-26T07:30:19.9959512Z deleted: sha256:72af05a89be22accdc1ca5d66dcbbb33993a9ef5997f849df1d4ba4c48049f25 2024-06-26T07:30:19.9960364Z deleted: sha256:38b90c9663dcaa2bc57a4dd3008298e7ea93e9535fa42312b4dc4246e7491af9 2024-06-26T07:30:19.9961219Z deleted: sha256:bda61b6cefb3ec8eeb74fef1ca1c7f9a5845fe5e8f07b8123323e897425d5c29 2024-06-26T07:30:19.9962068Z deleted: sha256:5a18e1aa877074529a84cbddf19f8d5403787823378ceae6b72fb62f78d43037 2024-06-26T07:30:19.9962904Z deleted: sha256:6c3e7df31590f02f10cb71fc4eb27653e9b428df2e6e5421a455b062bd2e39f9 2024-06-26T07:30:19.9963405Z 2024-06-26T07:30:19.9963557Z Total reclaimed space: 31.72GB 2024-06-26T07:30:20.0027559Z Post job cleanup. 2024-06-26T07:30:20.0090021Z Post job cleanup. 2024-06-26T07:30:20.0895029Z [command]/usr/bin/git version 2024-06-26T07:30:20.0936622Z git version 2.40.1 2024-06-26T07:30:20.0975501Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/fd4f9d86-c303-4b52-a2a0-d19da5441605' before making global git config changes 2024-06-26T07:30:20.0976783Z Adding repository directory to the temporary git global config as a safe directory 2024-06-26T07:30:20.0981371Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-06-26T07:30:20.1013693Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2024-06-26T07:30:20.1036202Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2024-06-26T07:30:20.1254363Z Entering 'android/libs/fbjni' 2024-06-26T07:30:20.1292495Z Entering 'third_party/FP16' 2024-06-26T07:30:20.1331292Z Entering 'third_party/FXdiv' 2024-06-26T07:30:20.1368292Z Entering 'third_party/NNPACK' 2024-06-26T07:30:20.1404761Z Entering 'third_party/VulkanMemoryAllocator' 2024-06-26T07:30:20.1440526Z Entering 'third_party/XNNPACK' 2024-06-26T07:30:20.1490435Z Entering 'third_party/benchmark' 2024-06-26T07:30:20.1527045Z Entering 'third_party/cpp-httplib' 2024-06-26T07:30:20.1562800Z Entering 'third_party/cpuinfo' 2024-06-26T07:30:20.1599050Z Entering 'third_party/cudnn_frontend' 2024-06-26T07:30:20.1635035Z Entering 'third_party/cutlass' 2024-06-26T07:30:20.1678986Z Entering 'third_party/eigen' 2024-06-26T07:30:20.1715709Z Entering 'third_party/fbgemm' 2024-06-26T07:30:20.1753841Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-06-26T07:30:20.1790215Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T07:30:20.1822825Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-06-26T07:30:20.1864044Z Entering 'third_party/fbgemm/third_party/googletest' 2024-06-26T07:30:20.1897433Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T07:30:20.1934137Z Entering 'third_party/flatbuffers' 2024-06-26T07:30:20.1967749Z Entering 'third_party/fmt' 2024-06-26T07:30:20.2002077Z Entering 'third_party/foxi' 2024-06-26T07:30:20.2038415Z Entering 'third_party/gemmlowp/gemmlowp' 2024-06-26T07:30:20.2072876Z Entering 'third_party/gloo' 2024-06-26T07:30:20.2109352Z Entering 'third_party/googletest' 2024-06-26T07:30:20.2146525Z Entering 'third_party/ideep' 2024-06-26T07:30:20.2180734Z Entering 'third_party/ideep/mkl-dnn' 2024-06-26T07:30:20.2221316Z Entering 'third_party/ittapi' 2024-06-26T07:30:20.2254675Z Entering 'third_party/kineto' 2024-06-26T07:30:20.2287825Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T07:30:20.2323448Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T07:30:20.2359397Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T07:30:20.2394332Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T07:30:20.2427469Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T07:30:20.2461607Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T07:30:20.2497305Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T07:30:20.2532604Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T07:30:20.2567540Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T07:30:20.2600594Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T07:30:20.2636807Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T07:30:20.2670781Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T07:30:20.2706414Z Entering 'third_party/mimalloc' 2024-06-26T07:30:20.2743511Z Entering 'third_party/nccl/nccl' 2024-06-26T07:30:20.2779210Z Entering 'third_party/nlohmann' 2024-06-26T07:30:20.2815438Z Entering 'third_party/onnx' 2024-06-26T07:30:20.2863476Z Entering 'third_party/onnx/third_party/benchmark' 2024-06-26T07:30:20.2899983Z Entering 'third_party/onnx/third_party/pybind11' 2024-06-26T07:30:20.2938115Z Entering 'third_party/opentelemetry-cpp' 2024-06-26T07:30:20.2974111Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T07:30:20.3009196Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T07:30:20.3044145Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T07:30:20.3079727Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T07:30:20.3114991Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T07:30:20.3147679Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T07:30:20.3182736Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T07:30:20.3215838Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T07:30:20.3250691Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T07:30:20.3287530Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T07:30:20.3340814Z Entering 'third_party/pocketfft' 2024-06-26T07:30:20.3376236Z Entering 'third_party/protobuf' 2024-06-26T07:30:20.3413266Z Entering 'third_party/protobuf/third_party/benchmark' 2024-06-26T07:30:20.3449892Z Entering 'third_party/protobuf/third_party/googletest' 2024-06-26T07:30:20.3485978Z Entering 'third_party/psimd' 2024-06-26T07:30:20.3522399Z Entering 'third_party/pthreadpool' 2024-06-26T07:30:20.3560159Z Entering 'third_party/pybind11' 2024-06-26T07:30:20.3597151Z Entering 'third_party/python-peachpy' 2024-06-26T07:30:20.3631545Z Entering 'third_party/sleef' 2024-06-26T07:30:20.3666944Z Entering 'third_party/tensorpipe' 2024-06-26T07:30:20.3702526Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-06-26T07:30:20.3737672Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-06-26T07:30:20.3769662Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-06-26T07:30:20.3803417Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T07:30:20.3838066Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T07:30:20.3890940Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2024-06-26T07:30:20.3908192Z http.https://github.com/.extraheader 2024-06-26T07:30:20.3915617Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader 2024-06-26T07:30:20.3944350Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2024-06-26T07:30:20.4156517Z Entering 'android/libs/fbjni' 2024-06-26T07:30:20.4179209Z http.https://github.com/.extraheader 2024-06-26T07:30:20.4204564Z Entering 'third_party/FP16' 2024-06-26T07:30:20.4227785Z http.https://github.com/.extraheader 2024-06-26T07:30:20.4250169Z Entering 'third_party/FXdiv' 2024-06-26T07:30:20.4271944Z http.https://github.com/.extraheader 2024-06-26T07:30:20.4296281Z Entering 'third_party/NNPACK' 2024-06-26T07:30:20.4318282Z http.https://github.com/.extraheader 2024-06-26T07:30:20.4340804Z Entering 'third_party/VulkanMemoryAllocator' 2024-06-26T07:30:20.4362455Z http.https://github.com/.extraheader 2024-06-26T07:30:20.4387160Z Entering 'third_party/XNNPACK' 2024-06-26T07:30:20.4409335Z http.https://github.com/.extraheader 2024-06-26T07:30:20.4443962Z Entering 'third_party/benchmark' 2024-06-26T07:30:20.4465955Z http.https://github.com/.extraheader 2024-06-26T07:30:20.4489817Z Entering 'third_party/cpp-httplib' 2024-06-26T07:30:20.4510426Z http.https://github.com/.extraheader 2024-06-26T07:30:20.4534788Z Entering 'third_party/cpuinfo' 2024-06-26T07:30:20.4556477Z http.https://github.com/.extraheader 2024-06-26T07:30:20.4578460Z Entering 'third_party/cudnn_frontend' 2024-06-26T07:30:20.4601919Z http.https://github.com/.extraheader 2024-06-26T07:30:20.4625997Z Entering 'third_party/cutlass' 2024-06-26T07:30:20.4646687Z http.https://github.com/.extraheader 2024-06-26T07:30:20.4675593Z Entering 'third_party/eigen' 2024-06-26T07:30:20.4696603Z http.https://github.com/.extraheader 2024-06-26T07:30:20.4722043Z Entering 'third_party/fbgemm' 2024-06-26T07:30:20.4744549Z http.https://github.com/.extraheader 2024-06-26T07:30:20.4767728Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-06-26T07:30:20.4788947Z http.https://github.com/.extraheader 2024-06-26T07:30:20.4812917Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T07:30:20.4834759Z http.https://github.com/.extraheader 2024-06-26T07:30:20.4856782Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-06-26T07:30:20.4878497Z http.https://github.com/.extraheader 2024-06-26T07:30:20.4905585Z Entering 'third_party/fbgemm/third_party/googletest' 2024-06-26T07:30:20.4927256Z http.https://github.com/.extraheader 2024-06-26T07:30:20.4952716Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T07:30:20.4973067Z http.https://github.com/.extraheader 2024-06-26T07:30:20.4998227Z Entering 'third_party/flatbuffers' 2024-06-26T07:30:20.5021367Z http.https://github.com/.extraheader 2024-06-26T07:30:20.5046618Z Entering 'third_party/fmt' 2024-06-26T07:30:20.5069712Z http.https://github.com/.extraheader 2024-06-26T07:30:20.5094985Z Entering 'third_party/foxi' 2024-06-26T07:30:20.5117707Z http.https://github.com/.extraheader 2024-06-26T07:30:20.5142902Z Entering 'third_party/gemmlowp/gemmlowp' 2024-06-26T07:30:20.5164722Z http.https://github.com/.extraheader 2024-06-26T07:30:20.5190083Z Entering 'third_party/gloo' 2024-06-26T07:30:20.5213354Z http.https://github.com/.extraheader 2024-06-26T07:30:20.5236939Z Entering 'third_party/googletest' 2024-06-26T07:30:20.5259746Z http.https://github.com/.extraheader 2024-06-26T07:30:20.5284433Z Entering 'third_party/ideep' 2024-06-26T07:30:20.5306245Z http.https://github.com/.extraheader 2024-06-26T07:30:20.5329659Z Entering 'third_party/ideep/mkl-dnn' 2024-06-26T07:30:20.5350796Z http.https://github.com/.extraheader 2024-06-26T07:30:20.5379067Z Entering 'third_party/ittapi' 2024-06-26T07:30:20.5400078Z http.https://github.com/.extraheader 2024-06-26T07:30:20.5422438Z Entering 'third_party/kineto' 2024-06-26T07:30:20.5444123Z http.https://github.com/.extraheader 2024-06-26T07:30:20.5467709Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T07:30:20.5489048Z http.https://github.com/.extraheader 2024-06-26T07:30:20.5512021Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T07:30:20.5534027Z http.https://github.com/.extraheader 2024-06-26T07:30:20.5559579Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T07:30:20.5581483Z http.https://github.com/.extraheader 2024-06-26T07:30:20.5604918Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T07:30:20.5626707Z http.https://github.com/.extraheader 2024-06-26T07:30:20.5651562Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T07:30:20.5672283Z http.https://github.com/.extraheader 2024-06-26T07:30:20.5695723Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T07:30:20.5717136Z http.https://github.com/.extraheader 2024-06-26T07:30:20.5740656Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T07:30:20.5762118Z http.https://github.com/.extraheader 2024-06-26T07:30:20.5785383Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T07:30:20.5805037Z http.https://github.com/.extraheader 2024-06-26T07:30:20.5828708Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T07:30:20.5849945Z http.https://github.com/.extraheader 2024-06-26T07:30:20.5874469Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T07:30:20.5896568Z http.https://github.com/.extraheader 2024-06-26T07:30:20.5921968Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T07:30:20.5944253Z http.https://github.com/.extraheader 2024-06-26T07:30:20.5969100Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T07:30:20.5990764Z http.https://github.com/.extraheader 2024-06-26T07:30:20.6016535Z Entering 'third_party/mimalloc' 2024-06-26T07:30:20.6039605Z http.https://github.com/.extraheader 2024-06-26T07:30:20.6062660Z Entering 'third_party/nccl/nccl' 2024-06-26T07:30:20.6082681Z http.https://github.com/.extraheader 2024-06-26T07:30:20.6105969Z Entering 'third_party/nlohmann' 2024-06-26T07:30:20.6126715Z http.https://github.com/.extraheader 2024-06-26T07:30:20.6150070Z Entering 'third_party/onnx' 2024-06-26T07:30:20.6172374Z http.https://github.com/.extraheader 2024-06-26T07:30:20.6206599Z Entering 'third_party/onnx/third_party/benchmark' 2024-06-26T07:30:20.6229328Z http.https://github.com/.extraheader 2024-06-26T07:30:20.6253956Z Entering 'third_party/onnx/third_party/pybind11' 2024-06-26T07:30:20.6275442Z http.https://github.com/.extraheader 2024-06-26T07:30:20.6301904Z Entering 'third_party/opentelemetry-cpp' 2024-06-26T07:30:20.6324589Z http.https://github.com/.extraheader 2024-06-26T07:30:20.6351077Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T07:30:20.6372480Z http.https://github.com/.extraheader 2024-06-26T07:30:20.6396274Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T07:30:20.6417803Z http.https://github.com/.extraheader 2024-06-26T07:30:20.6442066Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T07:30:20.6463257Z http.https://github.com/.extraheader 2024-06-26T07:30:20.6485797Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T07:30:20.6509024Z http.https://github.com/.extraheader 2024-06-26T07:30:20.6533710Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T07:30:20.6555110Z http.https://github.com/.extraheader 2024-06-26T07:30:20.6577601Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T07:30:20.6598373Z http.https://github.com/.extraheader 2024-06-26T07:30:20.6622665Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T07:30:20.6644624Z http.https://github.com/.extraheader 2024-06-26T07:30:20.6668259Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T07:30:20.6689469Z http.https://github.com/.extraheader 2024-06-26T07:30:20.6715200Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T07:30:20.6736949Z http.https://github.com/.extraheader 2024-06-26T07:30:20.6762033Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T07:30:20.6784875Z http.https://github.com/.extraheader 2024-06-26T07:30:20.6825314Z Entering 'third_party/pocketfft' 2024-06-26T07:30:20.6847471Z http.https://github.com/.extraheader 2024-06-26T07:30:20.6870977Z Entering 'third_party/protobuf' 2024-06-26T07:30:20.6893623Z http.https://github.com/.extraheader 2024-06-26T07:30:20.6918831Z Entering 'third_party/protobuf/third_party/benchmark' 2024-06-26T07:30:20.6940411Z http.https://github.com/.extraheader 2024-06-26T07:30:20.6962936Z Entering 'third_party/protobuf/third_party/googletest' 2024-06-26T07:30:20.6983891Z http.https://github.com/.extraheader 2024-06-26T07:30:20.7009046Z Entering 'third_party/psimd' 2024-06-26T07:30:20.7030971Z http.https://github.com/.extraheader 2024-06-26T07:30:20.7055530Z Entering 'third_party/pthreadpool' 2024-06-26T07:30:20.7077490Z http.https://github.com/.extraheader 2024-06-26T07:30:20.7099579Z Entering 'third_party/pybind11' 2024-06-26T07:30:20.7120717Z http.https://github.com/.extraheader 2024-06-26T07:30:20.7146173Z Entering 'third_party/python-peachpy' 2024-06-26T07:30:20.7167846Z http.https://github.com/.extraheader 2024-06-26T07:30:20.7191400Z Entering 'third_party/sleef' 2024-06-26T07:30:20.7213392Z http.https://github.com/.extraheader 2024-06-26T07:30:20.7236122Z Entering 'third_party/tensorpipe' 2024-06-26T07:30:20.7258063Z http.https://github.com/.extraheader 2024-06-26T07:30:20.7281477Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-06-26T07:30:20.7302911Z http.https://github.com/.extraheader 2024-06-26T07:30:20.7326288Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-06-26T07:30:20.7347997Z http.https://github.com/.extraheader 2024-06-26T07:30:20.7372717Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-06-26T07:30:20.7394224Z http.https://github.com/.extraheader 2024-06-26T07:30:20.7416869Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T07:30:20.7437351Z http.https://github.com/.extraheader 2024-06-26T07:30:20.7459818Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T07:30:20.7481271Z http.https://github.com/.extraheader 2024-06-26T07:30:20.7582123Z A job completed hook has been configured by the self-hosted runner administrator 2024-06-26T07:30:20.7599347Z ##[group]Run '/home/ec2-user/runner-scripts/cleanup.sh' 2024-06-26T07:30:20.7605984Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:30:20.7606534Z ##[endgroup] 2024-06-26T07:30:22.0259328Z Cleaning up orphan processes