2024-06-26T07:03:39.2152699Z Current runner version: '2.317.0' 2024-06-26T07:03:39.2158864Z Runner name: 'i-0e78f3ec154b9b15a' 2024-06-26T07:03:39.2159721Z Runner group name: 'Default' 2024-06-26T07:03:39.2160714Z Machine name: 'ip-10-0-36-112' 2024-06-26T07:03:39.2165584Z ##[group]GITHUB_TOKEN Permissions 2024-06-26T07:03:39.2167630Z Actions: read 2024-06-26T07:03:39.2168170Z Attestations: read 2024-06-26T07:03:39.2168780Z Checks: read 2024-06-26T07:03:39.2169312Z Contents: read 2024-06-26T07:03:39.2169835Z Deployments: read 2024-06-26T07:03:39.2170391Z Discussions: read 2024-06-26T07:03:39.2170955Z Issues: read 2024-06-26T07:03:39.2171515Z Metadata: read 2024-06-26T07:03:39.2172018Z Packages: read 2024-06-26T07:03:39.2172567Z Pages: read 2024-06-26T07:03:39.2173087Z PullRequests: read 2024-06-26T07:03:39.2173643Z RepositoryProjects: read 2024-06-26T07:03:39.2174293Z SecurityEvents: read 2024-06-26T07:03:39.2174899Z Statuses: read 2024-06-26T07:03:39.2175427Z ##[endgroup] 2024-06-26T07:03:39.2178908Z Secret source: Actions 2024-06-26T07:03:39.2179694Z Prepare workflow directory 2024-06-26T07:03:39.5727444Z Prepare all required actions 2024-06-26T07:03:39.5920096Z Getting action download info 2024-06-26T07:03:39.7727131Z Download action repository 'pytorch/test-infra@main' (SHA:43a2ce341cc31288e9a38b65ce600a7f43021bd5) 2024-06-26T07:03:40.1325129Z Download action repository 'pytorch/pytorch@main' (SHA:c422a9549d2b320b47a9391f6cbcf592b2876c88) 2024-06-26T07:03:42.9361208Z Download action repository 'aws-actions/configure-aws-credentials@v3' (SHA:50ac8dd1e1b10d09dac7b8727528b91bed831ac0) 2024-06-26T07:03:43.0690368Z Download action repository 'seemethere/upload-artifact-s3@v5' (SHA:baba72d0712b404f646cebe0730933554ebce96a) 2024-06-26T07:03:43.5354004Z Getting action download info 2024-06-26T07:03:43.6421342Z Download action repository 'malfet/checkout@silent-checkout' (SHA:e07af140b3ccefc05679e3755b9db68f4ee4589c) 2024-06-26T07:03:43.8118642Z Getting action download info 2024-06-26T07:03:43.9065648Z Download action repository 'nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482' (SHA:3e91a01664abd3c5cd539100d10d33b9c5b68482) 2024-06-26T07:03:44.0474191Z Uses: pytorch/pytorch/.github/workflows/_linux-test.yml@refs/tags/ciflow/inductor/129470 (b8c4c54d347aa776934c60784e35936878ef18dc) 2024-06-26T07:03:44.0476473Z ##[group] Inputs 2024-06-26T07:03:44.0476963Z build-environment: linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-06-26T07:03:44.0483823Z test-matrix: {"include": [{"config": "dynamo_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}]} 2024-06-26T07:03:44.0491554Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:03:44.0492718Z sync-tag: 2024-06-26T07:03:44.0493556Z timeout-minutes: 240 2024-06-26T07:03:44.0493898Z use-gha: 2024-06-26T07:03:44.0494195Z dashboard-tag: 2024-06-26T07:03:44.0494530Z s3-bucket: gha-artifacts 2024-06-26T07:03:44.0494888Z aws-role-to-assume: 2024-06-26T07:03:44.0495237Z ##[endgroup] 2024-06-26T07:03:44.0496242Z Complete job name: cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (aot_eager_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-06-26T07:03:44.1073140Z A job started hook has been configured by the self-hosted runner administrator 2024-06-26T07:03:44.1210907Z ##[group]Run '/home/ec2-user/runner-scripts/cleanup.sh' 2024-06-26T07:03:44.1221427Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:03:44.1221963Z ##[endgroup] 2024-06-26T07:03:44.9711228Z ##[group]Run pytorch/test-infra/.github/actions/setup-ssh@main 2024-06-26T07:03:44.9711786Z with: 2024-06-26T07:03:44.9712478Z github-secret: *** 2024-06-26T07:03:44.9713411Z instructions: All testing is done inside the container, to start an interactive session run: docker exec -it $(docker container ps --format '{{.ID}}') bash 2024-06-26T07:03:44.9714417Z activate-with-label: false 2024-06-26T07:03:44.9714800Z label: with-ssh 2024-06-26T07:03:44.9715160Z remove-existing-keys: true 2024-06-26T07:03:44.9715567Z fail-silently: true 2024-06-26T07:03:44.9715906Z env: 2024-06-26T07:03:44.9716201Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:03:44.9716564Z ##[endgroup] 2024-06-26T07:03:45.0570993Z Please see https://github.com/pytorch/pytorch/wiki/Debugging-using-with-ssh-for-Github-Actions for more info. 2024-06-26T07:03:45.0572048Z ciflow reference detected, attempting to extract PR number 2024-06-26T07:03:45.3093098Z Grabbing public ssh keys from https://github.com/pytorch-bot[bot].keys 2024-06-26T07:03:45.3630493Z No SSH keys found for user pytorch-bot[bot] 2024-06-26T07:03:45.3631293Z Grabbing public ssh keys from https://github.com/leslie-fang-intel.keys 2024-06-26T07:03:45.4362498Z No SSH keys found for user leslie-fang-intel 2024-06-26T07:03:45.4467452Z ##[group]Run pytorch/pytorch/.github/actions/checkout-pytorch@main 2024-06-26T07:03:45.4468044Z with: 2024-06-26T07:03:45.4468377Z submodules: recursive 2024-06-26T07:03:45.4468805Z fetch-depth: 0 2024-06-26T07:03:45.4469142Z env: 2024-06-26T07:03:45.4469464Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:03:45.4469873Z ##[endgroup] 2024-06-26T07:03:45.4688841Z ##[group]Run retry () { 2024-06-26T07:03:45.4689245Z retry () { 2024-06-26T07:03:45.4689770Z  $* || (sleep 1 && $*) || (sleep 2 && $*) || (sleep 4 && $*) || (sleep 8 && $*) 2024-06-26T07:03:45.4690336Z } 2024-06-26T07:03:45.4690660Z echo "${GITHUB_WORKSPACE}" 2024-06-26T07:03:45.4691086Z if [ -z "${NO_SUDO}" ]; then 2024-06-26T07:03:45.4691583Z  retry sudo rm -rf "${GITHUB_WORKSPACE}" 2024-06-26T07:03:45.4692044Z else 2024-06-26T07:03:45.4692403Z  retry rm -rf "${GITHUB_WORKSPACE}" 2024-06-26T07:03:45.4692832Z fi 2024-06-26T07:03:45.4693183Z mkdir "${GITHUB_WORKSPACE}" 2024-06-26T07:03:45.4701463Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:03:45.4701982Z env: 2024-06-26T07:03:45.4702279Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:03:45.4702642Z NO_SUDO: 2024-06-26T07:03:45.4702933Z ##[endgroup] 2024-06-26T07:03:45.4725955Z /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-06-26T07:03:47.6561134Z ##[group]Run malfet/checkout@silent-checkout 2024-06-26T07:03:47.6561574Z with: 2024-06-26T07:03:47.6561909Z ref: b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:03:47.6562353Z fetch-depth: 0 2024-06-26T07:03:47.6562673Z submodules: recursive 2024-06-26T07:03:47.6563017Z quiet-checkout: true 2024-06-26T07:03:47.6563525Z repository: pytorch/pytorch 2024-06-26T07:03:47.6564023Z token: *** 2024-06-26T07:03:47.6564326Z ssh-strict: true 2024-06-26T07:03:47.6564652Z persist-credentials: true 2024-06-26T07:03:47.6565017Z clean: true 2024-06-26T07:03:47.6565359Z sparse-checkout-cone-mode: true 2024-06-26T07:03:47.6565752Z lfs: false 2024-06-26T07:03:47.6566057Z set-safe-directory: true 2024-06-26T07:03:47.6566397Z env: 2024-06-26T07:03:47.6566677Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:03:47.6567035Z ##[endgroup] 2024-06-26T07:03:47.7481894Z Syncing repository: pytorch/pytorch 2024-06-26T07:03:47.7483584Z ##[group]Getting Git version info 2024-06-26T07:03:47.7484380Z Working directory is '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2024-06-26T07:03:47.7485248Z [command]/usr/bin/git version 2024-06-26T07:03:47.7485624Z git version 2.40.1 2024-06-26T07:03:47.7487045Z ##[endgroup] 2024-06-26T07:03:47.7498642Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/b905baef-de51-419c-9928-4408c9327e55' before making global git config changes 2024-06-26T07:03:47.7499913Z Adding repository directory to the temporary git global config as a safe directory 2024-06-26T07:03:47.7501054Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-06-26T07:03:47.7523420Z Deleting the contents of '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2024-06-26T07:03:47.7527470Z ##[group]Initializing the repository 2024-06-26T07:03:47.7530312Z [command]/usr/bin/git init /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-06-26T07:03:47.7549982Z hint: Using 'master' as the name for the initial branch. This default branch name 2024-06-26T07:03:47.7551399Z hint: is subject to change. To configure the initial branch name to use in all 2024-06-26T07:03:47.7552485Z hint: of your new repositories, which will suppress this warning, call: 2024-06-26T07:03:47.7553072Z hint: 2024-06-26T07:03:47.7553785Z hint: git config --global init.defaultBranch 2024-06-26T07:03:47.7554300Z hint: 2024-06-26T07:03:47.7554829Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-06-26T07:03:47.7555679Z hint: 'development'. The just-created branch can be renamed via this command: 2024-06-26T07:03:47.7556452Z hint: 2024-06-26T07:03:47.7556791Z hint: git branch -m 2024-06-26T07:03:47.7557547Z Initialized empty Git repository in /home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/ 2024-06-26T07:03:47.7559045Z [command]/usr/bin/git remote add origin https://github.com/pytorch/pytorch 2024-06-26T07:03:47.7583642Z ##[endgroup] 2024-06-26T07:03:47.7584247Z ##[group]Disabling automatic garbage collection 2024-06-26T07:03:47.7586570Z [command]/usr/bin/git config --local gc.auto 0 2024-06-26T07:03:47.7606915Z ##[endgroup] 2024-06-26T07:03:47.7607446Z ##[group]Setting up auth 2024-06-26T07:03:47.7612745Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2024-06-26T07:03:47.7633162Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2024-06-26T07:03:47.7825214Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2024-06-26T07:03:47.7846572Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2024-06-26T07:03:47.8040311Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic *** 2024-06-26T07:03:47.8083462Z ##[endgroup] 2024-06-26T07:03:47.8084031Z ##[group]Fetching the repository 2024-06-26T07:03:47.8089864Z [command]/usr/bin/git -c protocol.version=2 fetch --prune --progress --no-recurse-submodules --quiet origin +refs/heads/*:refs/remotes/origin/* +refs/tags/*:refs/tags/* 2024-06-26T07:03:49.9625074Z remote: Enumerating objects: 987612 2024-06-26T07:03:49.9625903Z remote: Enumerating objects: 990209, done. 2024-06-26T07:03:49.9629800Z remote: Counting objects: 0% (1/2597) 2024-06-26T07:03:49.9630366Z remote: Counting objects: 1% (26/2597) 2024-06-26T07:03:49.9631053Z remote: Counting objects: 2% (52/2597) 2024-06-26T07:03:49.9632953Z remote: Counting objects: 3% (78/2597) 2024-06-26T07:03:49.9633485Z remote: Counting objects: 4% (104/2597) 2024-06-26T07:03:49.9634014Z remote: Counting objects: 5% (130/2597) 2024-06-26T07:03:49.9635773Z remote: Counting objects: 6% (156/2597) 2024-06-26T07:03:49.9636315Z remote: Counting objects: 7% (182/2597) 2024-06-26T07:03:49.9636991Z remote: Counting objects: 8% (208/2597) 2024-06-26T07:03:49.9637508Z remote: Counting objects: 9% (234/2597) 2024-06-26T07:03:49.9638010Z remote: Counting objects: 10% (260/2597) 2024-06-26T07:03:49.9638678Z remote: Counting objects: 11% (286/2597) 2024-06-26T07:03:49.9639268Z remote: Counting objects: 12% (312/2597) 2024-06-26T07:03:49.9639781Z remote: Counting objects: 13% (338/2597) 2024-06-26T07:03:49.9640280Z remote: Counting objects: 14% (364/2597) 2024-06-26T07:03:49.9640801Z remote: Counting objects: 15% (390/2597) 2024-06-26T07:03:49.9641311Z remote: Counting objects: 16% (416/2597) 2024-06-26T07:03:49.9641831Z remote: Counting objects: 17% (442/2597) 2024-06-26T07:03:49.9642387Z remote: Counting objects: 18% (468/2597) 2024-06-26T07:03:49.9642902Z remote: Counting objects: 19% (494/2597) 2024-06-26T07:03:49.9643415Z remote: Counting objects: 20% (520/2597) 2024-06-26T07:03:49.9643924Z remote: Counting objects: 21% (546/2597) 2024-06-26T07:03:49.9644433Z remote: Counting objects: 22% (572/2597) 2024-06-26T07:03:49.9644948Z remote: Counting objects: 23% (598/2597) 2024-06-26T07:03:49.9645457Z remote: Counting objects: 24% (624/2597) 2024-06-26T07:03:49.9645973Z remote: Counting objects: 25% (650/2597) 2024-06-26T07:03:49.9646476Z remote: Counting objects: 26% (676/2597) 2024-06-26T07:03:49.9646999Z remote: Counting objects: 27% (702/2597) 2024-06-26T07:03:49.9647661Z remote: Counting objects: 28% (728/2597) 2024-06-26T07:03:49.9648183Z remote: Counting objects: 29% (754/2597) 2024-06-26T07:03:49.9648689Z remote: Counting objects: 30% (780/2597) 2024-06-26T07:03:49.9649219Z remote: Counting objects: 31% (806/2597) 2024-06-26T07:03:49.9649741Z remote: Counting objects: 32% (832/2597) 2024-06-26T07:03:49.9650260Z remote: Counting objects: 33% (858/2597) 2024-06-26T07:03:49.9650771Z remote: Counting objects: 34% (883/2597) 2024-06-26T07:03:49.9652439Z remote: Counting objects: 35% (909/2597) 2024-06-26T07:03:49.9652966Z remote: Counting objects: 36% (935/2597) 2024-06-26T07:03:49.9653480Z remote: Counting objects: 37% (961/2597) 2024-06-26T07:03:49.9653995Z remote: Counting objects: 38% (987/2597) 2024-06-26T07:03:49.9654510Z remote: Counting objects: 39% (1013/2597) 2024-06-26T07:03:49.9657209Z remote: Counting objects: 40% (1039/2597) 2024-06-26T07:03:49.9657932Z remote: Counting objects: 41% (1065/2597) 2024-06-26T07:03:49.9658469Z remote: Counting objects: 42% (1091/2597) 2024-06-26T07:03:49.9658996Z remote: Counting objects: 43% (1117/2597) 2024-06-26T07:03:49.9659523Z remote: Counting objects: 44% (1143/2597) 2024-06-26T07:03:49.9660256Z remote: Counting objects: 45% (1169/2597) 2024-06-26T07:03:49.9660794Z remote: Counting objects: 46% (1195/2597) 2024-06-26T07:03:49.9661321Z remote: Counting objects: 47% (1221/2597) 2024-06-26T07:03:49.9661862Z remote: Counting objects: 48% (1247/2597) 2024-06-26T07:03:49.9665433Z remote: Counting objects: 49% (1273/2597) 2024-06-26T07:03:49.9665992Z remote: Counting objects: 50% (1299/2597) 2024-06-26T07:03:49.9666626Z remote: Counting objects: 51% (1325/2597) 2024-06-26T07:03:49.9667164Z remote: Counting objects: 52% (1351/2597) 2024-06-26T07:03:49.9667701Z remote: Counting objects: 53% (1377/2597) 2024-06-26T07:03:49.9668254Z remote: Counting objects: 54% (1403/2597) 2024-06-26T07:03:49.9668785Z remote: Counting objects: 55% (1429/2597) 2024-06-26T07:03:49.9669311Z remote: Counting objects: 56% (1455/2597) 2024-06-26T07:03:49.9669848Z remote: Counting objects: 57% (1481/2597) 2024-06-26T07:03:49.9670378Z remote: Counting objects: 58% (1507/2597) 2024-06-26T07:03:49.9671009Z remote: Counting objects: 59% (1533/2597) 2024-06-26T07:03:49.9671530Z remote: Counting objects: 60% (1559/2597) 2024-06-26T07:03:49.9672060Z remote: Counting objects: 61% (1585/2597) 2024-06-26T07:03:49.9672582Z remote: Counting objects: 62% (1611/2597) 2024-06-26T07:03:49.9673122Z remote: Counting objects: 63% (1637/2597) 2024-06-26T07:03:49.9673650Z remote: Counting objects: 64% (1663/2597) 2024-06-26T07:03:49.9674169Z remote: Counting objects: 65% (1689/2597) 2024-06-26T07:03:49.9674714Z remote: Counting objects: 66% (1715/2597) 2024-06-26T07:03:49.9675237Z remote: Counting objects: 67% (1740/2597) 2024-06-26T07:03:49.9675760Z remote: Counting objects: 68% (1766/2597) 2024-06-26T07:03:49.9676275Z remote: Counting objects: 69% (1792/2597) 2024-06-26T07:03:49.9676798Z remote: Counting objects: 70% (1818/2597) 2024-06-26T07:03:49.9677331Z remote: Counting objects: 71% (1844/2597) 2024-06-26T07:03:49.9677856Z remote: Counting objects: 72% (1870/2597) 2024-06-26T07:03:49.9678378Z remote: Counting objects: 73% (1896/2597) 2024-06-26T07:03:49.9678905Z remote: Counting objects: 74% (1922/2597) 2024-06-26T07:03:49.9679434Z remote: Counting objects: 75% (1948/2597) 2024-06-26T07:03:49.9679967Z remote: Counting objects: 76% (1974/2597) 2024-06-26T07:03:49.9680487Z remote: Counting objects: 77% (2000/2597) 2024-06-26T07:03:49.9681015Z remote: Counting objects: 78% (2026/2597) 2024-06-26T07:03:49.9681624Z remote: Counting objects: 79% (2052/2597) 2024-06-26T07:03:49.9682155Z remote: Counting objects: 80% (2078/2597) 2024-06-26T07:03:49.9682679Z remote: Counting objects: 81% (2104/2597) 2024-06-26T07:03:49.9683213Z remote: Counting objects: 82% (2130/2597) 2024-06-26T07:03:49.9683743Z remote: Counting objects: 83% (2156/2597) 2024-06-26T07:03:49.9684276Z remote: Counting objects: 84% (2182/2597) 2024-06-26T07:03:49.9684802Z remote: Counting objects: 85% (2208/2597) 2024-06-26T07:03:49.9685332Z remote: Counting objects: 86% (2234/2597) 2024-06-26T07:03:49.9685860Z remote: Counting objects: 87% (2260/2597) 2024-06-26T07:03:49.9686392Z remote: Counting objects: 88% (2286/2597) 2024-06-26T07:03:49.9686921Z remote: Counting objects: 89% (2312/2597) 2024-06-26T07:03:49.9687451Z remote: Counting objects: 90% (2338/2597) 2024-06-26T07:03:49.9687986Z remote: Counting objects: 91% (2364/2597) 2024-06-26T07:03:49.9688521Z remote: Counting objects: 92% (2390/2597) 2024-06-26T07:03:49.9689045Z remote: Counting objects: 93% (2416/2597) 2024-06-26T07:03:49.9689575Z remote: Counting objects: 94% (2442/2597) 2024-06-26T07:03:49.9690104Z remote: Counting objects: 95% (2468/2597) 2024-06-26T07:03:49.9690627Z remote: Counting objects: 96% (2494/2597) 2024-06-26T07:03:49.9691156Z remote: Counting objects: 97% (2520/2597) 2024-06-26T07:03:49.9691694Z remote: Counting objects: 98% (2546/2597) 2024-06-26T07:03:49.9692226Z remote: Counting objects: 99% (2572/2597) 2024-06-26T07:03:49.9692754Z remote: Counting objects: 100% (2597/2597) 2024-06-26T07:03:49.9693315Z remote: Counting objects: 100% (2597/2597), done. 2024-06-26T07:03:49.9793222Z remote: Compressing objects: 0% (1/1074) 2024-06-26T07:03:50.0172058Z remote: Compressing objects: 1% (11/1074) 2024-06-26T07:03:50.0546060Z remote: Compressing objects: 2% (22/1074) 2024-06-26T07:03:50.0875858Z remote: Compressing objects: 3% (33/1074) 2024-06-26T07:03:50.1067746Z remote: Compressing objects: 4% (43/1074) 2024-06-26T07:03:50.1312861Z remote: Compressing objects: 5% (54/1074) 2024-06-26T07:03:50.1493993Z remote: Compressing objects: 6% (65/1074) 2024-06-26T07:03:50.1835939Z remote: Compressing objects: 7% (76/1074) 2024-06-26T07:03:50.2575035Z remote: Compressing objects: 8% (86/1074) 2024-06-26T07:03:50.3273051Z remote: Compressing objects: 9% (97/1074) 2024-06-26T07:03:50.3610840Z remote: Compressing objects: 10% (108/1074) 2024-06-26T07:03:50.3651692Z remote: Compressing objects: 11% (119/1074) 2024-06-26T07:03:50.3730149Z remote: Compressing objects: 12% (129/1074) 2024-06-26T07:03:50.3805946Z remote: Compressing objects: 13% (140/1074) 2024-06-26T07:03:50.3839032Z remote: Compressing objects: 14% (151/1074) 2024-06-26T07:03:50.3839650Z remote: Compressing objects: 15% (162/1074) 2024-06-26T07:03:50.3900349Z remote: Compressing objects: 16% (172/1074) 2024-06-26T07:03:50.3900931Z remote: Compressing objects: 17% (183/1074) 2024-06-26T07:03:50.3901496Z remote: Compressing objects: 18% (194/1074) 2024-06-26T07:03:50.3912367Z remote: Compressing objects: 19% (205/1074) 2024-06-26T07:03:50.3930231Z remote: Compressing objects: 20% (215/1074) 2024-06-26T07:03:50.3950302Z remote: Compressing objects: 21% (226/1074) 2024-06-26T07:03:50.3961810Z remote: Compressing objects: 22% (237/1074) 2024-06-26T07:03:50.3981398Z remote: Compressing objects: 23% (248/1074) 2024-06-26T07:03:50.3989805Z remote: Compressing objects: 24% (258/1074) 2024-06-26T07:03:50.3996651Z remote: Compressing objects: 25% (269/1074) 2024-06-26T07:03:50.4004194Z remote: Compressing objects: 26% (280/1074) 2024-06-26T07:03:50.4012426Z remote: Compressing objects: 27% (290/1074) 2024-06-26T07:03:50.4016382Z remote: Compressing objects: 28% (301/1074) 2024-06-26T07:03:50.4020245Z remote: Compressing objects: 29% (312/1074) 2024-06-26T07:03:50.4027080Z remote: Compressing objects: 30% (323/1074) 2024-06-26T07:03:50.4031951Z remote: Compressing objects: 31% (333/1074) 2024-06-26T07:03:50.4037667Z remote: Compressing objects: 32% (344/1074) 2024-06-26T07:03:50.4045811Z remote: Compressing objects: 33% (355/1074) 2024-06-26T07:03:50.4057414Z remote: Compressing objects: 34% (366/1074) 2024-06-26T07:03:50.4072820Z remote: Compressing objects: 35% (376/1074) 2024-06-26T07:03:50.4088901Z remote: Compressing objects: 36% (387/1074) 2024-06-26T07:03:50.4104127Z remote: Compressing objects: 37% (398/1074) 2024-06-26T07:03:50.4118725Z remote: Compressing objects: 38% (409/1074) 2024-06-26T07:03:50.4134656Z remote: Compressing objects: 39% (419/1074) 2024-06-26T07:03:50.4156565Z remote: Compressing objects: 40% (430/1074) 2024-06-26T07:03:50.4174621Z remote: Compressing objects: 41% (441/1074) 2024-06-26T07:03:50.4186202Z remote: Compressing objects: 42% (452/1074) 2024-06-26T07:03:50.4191793Z remote: Compressing objects: 43% (462/1074) 2024-06-26T07:03:50.4197071Z remote: Compressing objects: 44% (473/1074) 2024-06-26T07:03:50.4200033Z remote: Compressing objects: 45% (484/1074) 2024-06-26T07:03:50.4207818Z remote: Compressing objects: 46% (495/1074) 2024-06-26T07:03:50.4220301Z remote: Compressing objects: 47% (505/1074) 2024-06-26T07:03:50.4230682Z remote: Compressing objects: 48% (516/1074) 2024-06-26T07:03:50.4234286Z remote: Compressing objects: 49% (527/1074) 2024-06-26T07:03:50.4238230Z remote: Compressing objects: 50% (537/1074) 2024-06-26T07:03:50.4247287Z remote: Compressing objects: 51% (548/1074) 2024-06-26T07:03:50.4258402Z remote: Compressing objects: 52% (559/1074) 2024-06-26T07:03:50.4272618Z remote: Compressing objects: 53% (570/1074) 2024-06-26T07:03:50.4288229Z remote: Compressing objects: 54% (580/1074) 2024-06-26T07:03:50.4296003Z remote: Compressing objects: 55% (591/1074) 2024-06-26T07:03:50.4313770Z remote: Compressing objects: 56% (602/1074) 2024-06-26T07:03:50.4321341Z remote: Compressing objects: 57% (613/1074) 2024-06-26T07:03:50.4338499Z remote: Compressing objects: 58% (623/1074) 2024-06-26T07:03:50.4346924Z remote: Compressing objects: 59% (634/1074) 2024-06-26T07:03:50.4355455Z remote: Compressing objects: 60% (645/1074) 2024-06-26T07:03:50.4364517Z remote: Compressing objects: 61% (656/1074) 2024-06-26T07:03:50.4369406Z remote: Compressing objects: 62% (666/1074) 2024-06-26T07:03:50.4374511Z remote: Compressing objects: 63% (677/1074) 2024-06-26T07:03:50.4384568Z remote: Compressing objects: 64% (688/1074) 2024-06-26T07:03:50.4393725Z remote: Compressing objects: 65% (699/1074) 2024-06-26T07:03:50.4397999Z remote: Compressing objects: 66% (709/1074) 2024-06-26T07:03:50.4406509Z remote: Compressing objects: 67% (720/1074) 2024-06-26T07:03:50.4411130Z remote: Compressing objects: 68% (731/1074) 2024-06-26T07:03:50.4411703Z remote: Compressing objects: 69% (742/1074) 2024-06-26T07:03:50.4415424Z remote: Compressing objects: 70% (752/1074) 2024-06-26T07:03:50.4419869Z remote: Compressing objects: 71% (763/1074) 2024-06-26T07:03:50.4420449Z remote: Compressing objects: 72% (774/1074) 2024-06-26T07:03:50.4421014Z remote: Compressing objects: 73% (785/1074) 2024-06-26T07:03:50.4421573Z remote: Compressing objects: 74% (795/1074) 2024-06-26T07:03:50.4422139Z remote: Compressing objects: 75% (806/1074) 2024-06-26T07:03:50.4422695Z remote: Compressing objects: 76% (817/1074) 2024-06-26T07:03:50.4423377Z remote: Compressing objects: 77% (827/1074) 2024-06-26T07:03:50.4423938Z remote: Compressing objects: 78% (838/1074) 2024-06-26T07:03:50.4424497Z remote: Compressing objects: 79% (849/1074) 2024-06-26T07:03:50.4428163Z remote: Compressing objects: 80% (860/1074) 2024-06-26T07:03:50.4432682Z remote: Compressing objects: 81% (870/1074) 2024-06-26T07:03:50.4433254Z remote: Compressing objects: 82% (881/1074) 2024-06-26T07:03:50.4433804Z remote: Compressing objects: 83% (892/1074) 2024-06-26T07:03:50.4434352Z remote: Compressing objects: 84% (903/1074) 2024-06-26T07:03:50.4434902Z remote: Compressing objects: 85% (913/1074) 2024-06-26T07:03:50.4437163Z remote: Compressing objects: 86% (924/1074) 2024-06-26T07:03:50.4441490Z remote: Compressing objects: 87% (935/1074) 2024-06-26T07:03:50.4442049Z remote: Compressing objects: 88% (946/1074) 2024-06-26T07:03:50.4442605Z remote: Compressing objects: 89% (956/1074) 2024-06-26T07:03:50.4443169Z remote: Compressing objects: 90% (967/1074) 2024-06-26T07:03:50.4443720Z remote: Compressing objects: 91% (978/1074) 2024-06-26T07:03:50.4450791Z remote: Compressing objects: 92% (989/1074) 2024-06-26T07:03:50.4451360Z remote: Compressing objects: 93% (999/1074) 2024-06-26T07:03:50.4455461Z remote: Compressing objects: 94% (1010/1074) 2024-06-26T07:03:50.4456059Z remote: Compressing objects: 95% (1021/1074) 2024-06-26T07:03:50.4456637Z remote: Compressing objects: 96% (1032/1074) 2024-06-26T07:03:50.4457332Z remote: Compressing objects: 97% (1042/1074) 2024-06-26T07:03:50.4457902Z remote: Compressing objects: 98% (1053/1074) 2024-06-26T07:03:50.4458463Z remote: Compressing objects: 99% (1064/1074) 2024-06-26T07:03:50.4459135Z remote: Compressing objects: 100% (1074/1074) 2024-06-26T07:03:50.4459733Z remote: Compressing objects: 100% (1074/1074), done. 2024-06-26T07:04:10.5753909Z remote: Total 990209 (delta 2062), reused 1863 (delta 1522), pack-reused 987612 2024-06-26T07:04:34.8838609Z [command]/usr/bin/git rev-parse --verify --quiet b8c4c54d347aa776934c60784e35936878ef18dc^{object} 2024-06-26T07:04:34.8857767Z b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:04:34.8861627Z ##[endgroup] 2024-06-26T07:04:34.8862328Z ##[group]Determining the checkout info 2024-06-26T07:04:34.8865923Z ##[endgroup] 2024-06-26T07:04:34.8866547Z ##[group]Checking out the ref 2024-06-26T07:04:34.8867328Z [command]/usr/bin/git checkout --quiet --force b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:04:36.0995423Z ##[endgroup] 2024-06-26T07:04:36.0996047Z ##[group]Setting up auth for fetching submodules 2024-06-26T07:04:36.0999908Z [command]/usr/bin/git config --global http.https://github.com/.extraheader AUTHORIZATION: basic *** 2024-06-26T07:04:36.1046802Z [command]/usr/bin/git config --global --unset-all url.https://github.com/.insteadOf 2024-06-26T07:04:36.1067469Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf git@github.com: 2024-06-26T07:04:36.1092314Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf org-21003710@github.com: 2024-06-26T07:04:36.1109334Z ##[endgroup] 2024-06-26T07:04:36.1109886Z ##[group]Fetching submodules 2024-06-26T07:04:36.1112916Z [command]/usr/bin/git submodule sync --recursive 2024-06-26T07:04:36.1321712Z [command]/usr/bin/git -c protocol.version=2 submodule update --init --force --recursive 2024-06-26T07:04:36.1526820Z Submodule 'android/libs/fbjni' (https://github.com/facebookincubator/fbjni.git) registered for path 'android/libs/fbjni' 2024-06-26T07:04:36.1528256Z Submodule 'third_party/NNPACK_deps/FP16' (https://github.com/Maratyszcza/FP16.git) registered for path 'third_party/FP16' 2024-06-26T07:04:36.1529703Z Submodule 'third_party/NNPACK_deps/FXdiv' (https://github.com/Maratyszcza/FXdiv.git) registered for path 'third_party/FXdiv' 2024-06-26T07:04:36.1531290Z Submodule 'third_party/NNPACK' (https://github.com/Maratyszcza/NNPACK.git) registered for path 'third_party/NNPACK' 2024-06-26T07:04:36.1533027Z Submodule 'third_party/VulkanMemoryAllocator' (https://github.com/GPUOpen-LibrariesAndSDKs/VulkanMemoryAllocator.git) registered for path 'third_party/VulkanMemoryAllocator' 2024-06-26T07:04:36.1534704Z Submodule 'third_party/XNNPACK' (https://github.com/google/XNNPACK.git) registered for path 'third_party/XNNPACK' 2024-06-26T07:04:36.1536457Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/benchmark' 2024-06-26T07:04:36.1538487Z Submodule 'third_party/cpp-httplib' (https://github.com/yhirose/cpp-httplib.git) registered for path 'third_party/cpp-httplib' 2024-06-26T07:04:36.1541008Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo.git) registered for path 'third_party/cpuinfo' 2024-06-26T07:04:36.1543261Z Submodule 'third_party/cudnn_frontend' (https://github.com/NVIDIA/cudnn-frontend.git) registered for path 'third_party/cudnn_frontend' 2024-06-26T07:04:36.1545057Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/cutlass' 2024-06-26T07:04:36.1547629Z Submodule 'third_party/eigen' (https://gitlab.com/libeigen/eigen.git) registered for path 'third_party/eigen' 2024-06-26T07:04:36.1549953Z Submodule 'third_party/fbgemm' (https://github.com/pytorch/fbgemm) registered for path 'third_party/fbgemm' 2024-06-26T07:04:36.1552708Z Submodule 'third_party/flatbuffers' (https://github.com/google/flatbuffers.git) registered for path 'third_party/flatbuffers' 2024-06-26T07:04:36.1555074Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/fmt' 2024-06-26T07:04:36.1557648Z Submodule 'third_party/foxi' (https://github.com/houseroad/foxi.git) registered for path 'third_party/foxi' 2024-06-26T07:04:36.1560455Z Submodule 'third_party/gemmlowp/gemmlowp' (https://github.com/google/gemmlowp.git) registered for path 'third_party/gemmlowp/gemmlowp' 2024-06-26T07:04:36.1562994Z Submodule 'third_party/gloo' (https://github.com/facebookincubator/gloo) registered for path 'third_party/gloo' 2024-06-26T07:04:36.1565784Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/googletest' 2024-06-26T07:04:36.1568462Z Submodule 'third_party/ideep' (https://github.com/intel/ideep) registered for path 'third_party/ideep' 2024-06-26T07:04:36.1571454Z Submodule 'third_party/ittapi' (https://github.com/intel/ittapi.git) registered for path 'third_party/ittapi' 2024-06-26T07:04:36.1574369Z Submodule 'third_party/kineto' (https://github.com/pytorch/kineto) registered for path 'third_party/kineto' 2024-06-26T07:04:36.1577769Z Submodule 'third_party/mimalloc' (https://github.com/microsoft/mimalloc.git) registered for path 'third_party/mimalloc' 2024-06-26T07:04:36.1581037Z Submodule 'third_party/nccl/nccl' (https://github.com/NVIDIA/nccl) registered for path 'third_party/nccl/nccl' 2024-06-26T07:04:36.1584146Z Submodule 'third_party/nlohmann' (https://github.com/nlohmann/json.git) registered for path 'third_party/nlohmann' 2024-06-26T07:04:36.1587260Z Submodule 'third_party/onnx' (https://github.com/onnx/onnx.git) registered for path 'third_party/onnx' 2024-06-26T07:04:36.1591032Z Submodule 'third_party/opentelemetry-cpp' (https://github.com/open-telemetry/opentelemetry-cpp.git) registered for path 'third_party/opentelemetry-cpp' 2024-06-26T07:04:36.1594226Z Submodule 'third_party/pocketfft' (https://github.com/mreineck/pocketfft) registered for path 'third_party/pocketfft' 2024-06-26T07:04:36.1597615Z Submodule 'third_party/protobuf' (https://github.com/protocolbuffers/protobuf.git) registered for path 'third_party/protobuf' 2024-06-26T07:04:36.1601080Z Submodule 'third_party/NNPACK_deps/psimd' (https://github.com/Maratyszcza/psimd.git) registered for path 'third_party/psimd' 2024-06-26T07:04:36.1604708Z Submodule 'third_party/NNPACK_deps/pthreadpool' (https://github.com/Maratyszcza/pthreadpool.git) registered for path 'third_party/pthreadpool' 2024-06-26T07:04:36.1608298Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/pybind11' 2024-06-26T07:04:36.1611960Z Submodule 'third_party/python-peachpy' (https://github.com/malfet/PeachPy.git) registered for path 'third_party/python-peachpy' 2024-06-26T07:04:36.1615525Z Submodule 'third_party/sleef' (https://github.com/shibatch/sleef) registered for path 'third_party/sleef' 2024-06-26T07:04:36.1620022Z Submodule 'third_party/tensorpipe' (https://github.com/pytorch/tensorpipe.git) registered for path 'third_party/tensorpipe' 2024-06-26T07:04:36.1639664Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/android/libs/fbjni'... 2024-06-26T07:04:36.3957474Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FP16'... 2024-06-26T07:04:36.5642084Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FXdiv'... 2024-06-26T07:04:36.7512083Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/NNPACK'... 2024-06-26T07:04:36.9935247Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/VulkanMemoryAllocator'... 2024-06-26T07:04:38.9623187Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/XNNPACK'... 2024-06-26T07:04:48.9751149Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/benchmark'... 2024-06-26T07:04:49.3187918Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpp-httplib'... 2024-06-26T07:04:49.8027599Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpuinfo'... 2024-06-26T07:04:50.4083451Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cudnn_frontend'... 2024-06-26T07:04:51.5929025Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cutlass'... 2024-06-26T07:04:53.3014011Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/eigen'... 2024-06-26T07:04:59.2334557Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm'... 2024-06-26T07:05:00.5654057Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/flatbuffers'... 2024-06-26T07:05:02.2718633Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fmt'... 2024-06-26T07:05:03.5154090Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/foxi'... 2024-06-26T07:05:03.6610138Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gemmlowp/gemmlowp'... 2024-06-26T07:05:04.0418560Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gloo'... 2024-06-26T07:05:04.3536534Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/googletest'... 2024-06-26T07:05:05.3540176Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep'... 2024-06-26T07:05:05.6848146Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ittapi'... 2024-06-26T07:05:05.9593784Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto'... 2024-06-26T07:05:07.4441685Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/mimalloc'... 2024-06-26T07:05:08.1475114Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nccl/nccl'... 2024-06-26T07:05:08.8800123Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nlohmann'... 2024-06-26T07:05:14.6160718Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx'... 2024-06-26T07:05:17.0331335Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp'... 2024-06-26T07:05:22.6247662Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pocketfft'... 2024-06-26T07:05:22.8224898Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf'... 2024-06-26T07:05:31.3051091Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/psimd'... 2024-06-26T07:05:31.4592368Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pthreadpool'... 2024-06-26T07:05:31.6982181Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pybind11'... 2024-06-26T07:05:32.7171413Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/python-peachpy'... 2024-06-26T07:05:32.9920809Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/sleef'... 2024-06-26T07:05:33.5773579Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe'... 2024-06-26T07:05:33.9831451Z Submodule path 'android/libs/fbjni': checked out '7e1e1fe3858c63c251c637ae41a20de425dde96f' 2024-06-26T07:05:33.9917120Z Submodule path 'third_party/FP16': checked out '4dfe081cf6bcd15db339cf2680b9281b8451eeb3' 2024-06-26T07:05:33.9977968Z Submodule path 'third_party/FXdiv': checked out 'b408327ac2a15ec3e43352421954f5b1967701d1' 2024-06-26T07:05:34.0157749Z Submodule path 'third_party/NNPACK': checked out 'c07e3a0400713d546e0dea2d5466dd22ea389c73' 2024-06-26T07:05:34.0460434Z Submodule path 'third_party/VulkanMemoryAllocator': checked out 'a6bfc237255a6bac1513f7c1ebde6d8aed6b5191' 2024-06-26T07:05:34.8248662Z Submodule path 'third_party/XNNPACK': checked out 'fcbf55af6cf28a4627bcd1f703ab7ad843f0f3a2' 2024-06-26T07:05:34.8423223Z Submodule path 'third_party/benchmark': checked out '0d98dba29d66e93259db7daa53a9327df767a415' 2024-06-26T07:05:34.8765272Z Submodule path 'third_party/cpp-httplib': checked out '3b6597bba913d51161383657829b7e644e59c006' 2024-06-26T07:05:34.9621435Z Submodule path 'third_party/cpuinfo': checked out '3c8b1533ac03dd6531ab6e7b9245d488f13a82a5' 2024-06-26T07:05:34.9888707Z Submodule path 'third_party/cudnn_frontend': checked out 'aa3abd4bc689d6412979c7f55f9cd132848c9c6a' 2024-06-26T07:05:35.4172235Z Submodule path 'third_party/cutlass': checked out 'bbe579a9e3beb6ea6626d9227ec32d0dae119a49' 2024-06-26T07:05:35.6308253Z Submodule path 'third_party/eigen': checked out '3147391d946bb4b6c68edd901f2add6ac1f31f8c' 2024-06-26T07:05:35.6951530Z Submodule path 'third_party/fbgemm': checked out 'dbc3157bf256f1339b3fa1fef2be89ac4078be0e' 2024-06-26T07:05:35.6963758Z Submodule 'third_party/asmjit' (https://github.com/asmjit/asmjit.git) registered for path 'third_party/fbgemm/third_party/asmjit' 2024-06-26T07:05:35.6966507Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo) registered for path 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T07:05:35.6967999Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/fbgemm/third_party/cutlass' 2024-06-26T07:05:35.6969540Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/fbgemm/third_party/googletest' 2024-06-26T07:05:35.6971231Z Submodule 'third_party/hipify_torch' (https://github.com/ROCmSoftwarePlatform/hipify_torch.git) registered for path 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T07:05:35.6988156Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/asmjit'... 2024-06-26T07:05:36.6334910Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cpuinfo'... 2024-06-26T07:05:37.2014978Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cutlass'... 2024-06-26T07:05:38.9408558Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/googletest'... 2024-06-26T07:05:39.8575426Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/hipify_torch'... 2024-06-26T07:05:40.2302567Z Submodule path 'third_party/fbgemm/third_party/asmjit': checked out 'd3fbf7c9bc7c1d1365a94a45614b91c5a3706b81' 2024-06-26T07:05:40.3144082Z Submodule path 'third_party/fbgemm/third_party/cpuinfo': checked out 'ed8b86a253800bafdb7b25c5c399f91bff9cb1f3' 2024-06-26T07:05:40.6561589Z Submodule path 'third_party/fbgemm/third_party/cutlass': checked out 'fc9ebc645b63f3a6bc80aaefde5c063fb72110d6' 2024-06-26T07:05:40.7100744Z Submodule path 'third_party/fbgemm/third_party/googletest': checked out 'cbf019de22c8dd37b2108da35b2748fd702d1796' 2024-06-26T07:05:40.7188538Z Submodule path 'third_party/fbgemm/third_party/hipify_torch': checked out '23f53b025b466d8ec3c45d52290d3442f7fbe6b1' 2024-06-26T07:05:40.8109075Z Submodule path 'third_party/flatbuffers': checked out '01834de25e4bf3975a9a00e816292b1ad0fe184b' 2024-06-26T07:05:40.8391025Z Submodule path 'third_party/fmt': checked out 'e69e5f977d458f2650bb346dadf2ad30c5320281' 2024-06-26T07:05:40.8454006Z Submodule path 'third_party/foxi': checked out 'c278588e34e535f0bb8f00df3880d26928038cad' 2024-06-26T07:05:40.8759652Z Submodule path 'third_party/gemmlowp/gemmlowp': checked out '3fb5c176c17c765a3492cd2f0321b0dab712f350' 2024-06-26T07:05:40.8958437Z Submodule path 'third_party/gloo': checked out '5354032ea08eadd7fc4456477f7f7c6308818509' 2024-06-26T07:05:40.9331682Z Submodule path 'third_party/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2024-06-26T07:05:40.9426735Z Submodule path 'third_party/ideep': checked out '55ca0191687aaf19aca5cdb7881c791e3bea442b' 2024-06-26T07:05:40.9437824Z Submodule 'mkl-dnn' (https://github.com/intel/mkl-dnn.git) registered for path 'third_party/ideep/mkl-dnn' 2024-06-26T07:05:40.9455050Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep/mkl-dnn'... 2024-06-26T07:05:52.8836178Z Submodule path 'third_party/ideep/mkl-dnn': checked out '1137e04ec0b5251ca2b4400a4fd3c667ce843d67' 2024-06-26T07:05:52.8972204Z Submodule path 'third_party/ittapi': checked out '5b8a7d7422611c3a0d799fb5fc5dd4abfae35b42' 2024-06-26T07:05:52.9748399Z Submodule path 'third_party/kineto': checked out '8681ff11e1fa54da39023076c5c43eddd87b7a8a' 2024-06-26T07:05:52.9759490Z Submodule 'libkineto/third_party/dynolog' (https://github.com/facebookincubator/dynolog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T07:05:52.9761252Z Submodule 'libkineto/third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T07:05:52.9763215Z Submodule 'libkineto/third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T07:05:52.9783054Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog'... 2024-06-26T07:05:53.5158713Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/fmt'... 2024-06-26T07:05:54.7565627Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/googletest'... 2024-06-26T07:05:55.7877379Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog': checked out '7d04a0053a845370ae06ce317a22a48e9edcc74e' 2024-06-26T07:05:55.7887244Z Submodule 'third_party/DCGM' (https://github.com/NVIDIA/DCGM.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T07:05:55.7889114Z Submodule 'third_party/cpr' (https://github.com/libcpr/cpr.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T07:05:55.7891363Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T07:05:55.7893558Z Submodule 'third_party/gflags' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T07:05:55.7895685Z Submodule 'third_party/glog' (https://github.com/google/glog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T07:05:55.7898540Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T07:05:55.7900861Z Submodule 'third_party/json' (https://github.com/nlohmann/json.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T07:05:55.7902704Z Submodule 'third_party/pfs' (https://github.com/dtrugman/pfs.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T07:05:55.7920863Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'... 2024-06-26T07:05:56.8932805Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'... 2024-06-26T07:05:57.2406262Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'... 2024-06-26T07:05:58.5092835Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'... 2024-06-26T07:05:58.7987797Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/glog'... 2024-06-26T07:05:59.2804702Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'... 2024-06-26T07:06:00.2499782Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/json'... 2024-06-26T07:06:06.0016354Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'... 2024-06-26T07:06:06.3478845Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM': checked out 'ffde4e54bc7249a6039a5e6b45b395141e1217f9' 2024-06-26T07:06:06.3615965Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr': checked out '871ed52d350214a034f6ef8a3b8f51c5ce1bd400' 2024-06-26T07:06:06.3907640Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt': checked out 'cd4af11efc9c622896a3e4cb599fa28668ca3d05' 2024-06-26T07:06:06.4003422Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags': checked out 'e171aa2d15ed9eb17054558e0b3a6a413bb01067' 2024-06-26T07:06:06.4014346Z Submodule 'doc' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T07:06:06.4031946Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'... 2024-06-26T07:06:06.7280037Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc': checked out '8411df715cf522606e3b1aca386ddfc0b63d34b4' 2024-06-26T07:06:06.7417709Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog': checked out 'b33e3bad4c46c8a6345525fd822af355e5ef9446' 2024-06-26T07:06:06.7754742Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest': checked out '58d77fa8070e8cec2dc1ed015d66b454c8d78850' 2024-06-26T07:06:06.8565080Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json': checked out '4f8fba14066156b73f1189a2b8bd568bde5284c5' 2024-06-26T07:06:06.8684156Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs': checked out 'f68a2fa8ea36c783bdd760371411fcb495aa3150' 2024-06-26T07:06:06.8978765Z Submodule path 'third_party/kineto/libkineto/third_party/fmt': checked out 'a33701196adfad74917046096bf5a2aa0ab0bb50' 2024-06-26T07:06:06.9471596Z Submodule path 'third_party/kineto/libkineto/third_party/googletest': checked out '7aca84427f224eeed3144123d5230d5871e93347' 2024-06-26T07:06:06.9773774Z Submodule path 'third_party/mimalloc': checked out 'b66e3214d8a104669c2ec05ae91ebc26a8f5ab78' 2024-06-26T07:06:06.9965561Z Submodule path 'third_party/nccl/nccl': checked out '48bb7fec7953112ff37499a272317f6663f8f600' 2024-06-26T07:06:07.0822424Z Submodule path 'third_party/nlohmann': checked out '87cda1d6646592ac5866dc703c8e1839046a6806' 2024-06-26T07:06:07.3595175Z Submodule path 'third_party/onnx': checked out '990217f043af7222348ca8f0301e17fa7b841781' 2024-06-26T07:06:07.3624256Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/onnx/third_party/benchmark' 2024-06-26T07:06:07.3625813Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/onnx/third_party/pybind11' 2024-06-26T07:06:07.3643842Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx/third_party/benchmark'... 2024-06-26T07:06:07.8156634Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx/third_party/pybind11'... 2024-06-26T07:06:08.9855909Z Submodule path 'third_party/onnx/third_party/benchmark': checked out '2dd015dfef425c866d9a43f2c67d8b52d709acb6' 2024-06-26T07:06:09.0131784Z Submodule path 'third_party/onnx/third_party/pybind11': checked out '5b0a6fc2017fcc176545afe3e09c9f9885283242' 2024-06-26T07:06:09.0656306Z Submodule path 'third_party/opentelemetry-cpp': checked out 'a799f4aed9c94b765dcdaabaeab7d5e7e2310878' 2024-06-26T07:06:09.0668389Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark) registered for path 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T07:06:09.0670267Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T07:06:09.0672219Z Submodule 'third_party/ms-gsl' (https://github.com/microsoft/GSL) registered for path 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T07:06:09.0674288Z Submodule 'third_party/nlohmann-json' (https://github.com/nlohmann/json) registered for path 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T07:06:09.0676380Z Submodule 'third_party/opentelemetry-proto' (https://github.com/open-telemetry/opentelemetry-proto) registered for path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T07:06:09.0678596Z Submodule 'third_party/opentracing-cpp' (https://github.com/opentracing/opentracing-cpp.git) registered for path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T07:06:09.0680703Z Submodule 'third_party/prometheus-cpp' (https://github.com/jupp0r/prometheus-cpp) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T07:06:09.0682522Z Submodule 'tools/vcpkg' (https://github.com/Microsoft/vcpkg) registered for path 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T07:06:09.0698314Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/benchmark'... 2024-06-26T07:06:09.4734108Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/googletest'... 2024-06-26T07:06:10.4263166Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/ms-gsl'... 2024-06-26T07:06:10.7525313Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/nlohmann-json'... 2024-06-26T07:06:16.6591624Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentelemetry-proto'... 2024-06-26T07:06:16.9382072Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentracing-cpp'... 2024-06-26T07:06:17.1187853Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp'... 2024-06-26T07:06:17.4179359Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/tools/vcpkg'... 2024-06-26T07:06:24.9899273Z Submodule path 'third_party/opentelemetry-cpp/third_party/benchmark': checked out 'd572f4777349d43653b21d6c2fc63020ab326db2' 2024-06-26T07:06:25.0230712Z Submodule path 'third_party/opentelemetry-cpp/third_party/googletest': checked out 'b796f7d44681514f58a683a3a71ff17c94edb0c1' 2024-06-26T07:06:25.0356213Z Submodule path 'third_party/opentelemetry-cpp/third_party/ms-gsl': checked out '6f4529395c5b7c2d661812257cd6780c67e54afa' 2024-06-26T07:06:25.1192660Z Submodule path 'third_party/opentelemetry-cpp/third_party/nlohmann-json': checked out 'bc889afb4c5bf1c0d8ee29ef35eaaf4c8bef8a5d' 2024-06-26T07:06:25.1290900Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto': checked out '4ca4f0335c63cda7ab31ea7ed70d6553aee14dce' 2024-06-26T07:06:25.1396349Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp': checked out '06b57f48ded1fa3bdd3d4346f6ef29e40e08eaf5' 2024-06-26T07:06:25.1507616Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp': checked out 'c9ffcdda9086ffd9e1283ea7a0276d831f3c8a8d' 2024-06-26T07:06:25.1517878Z Submodule 'civetweb' (https://github.com/civetweb/civetweb.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T07:06:25.1519726Z Submodule 'googletest' (https://github.com/google/googletest.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T07:06:25.1535828Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'... 2024-06-26T07:06:26.9352481Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'... 2024-06-26T07:06:28.1243960Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb': checked out 'eefb26f82b233268fc98577d265352720d477ba4' 2024-06-26T07:06:28.1610539Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2024-06-26T07:06:28.5247660Z Submodule path 'third_party/opentelemetry-cpp/tools/vcpkg': checked out '8eb57355a4ffb410a2e94c07b4dca2dffbee8e50' 2024-06-26T07:06:28.5334051Z Submodule path 'third_party/pocketfft': checked out '9d3ab05a7fffbc71a492bc6a17be034e83e8f0fe' 2024-06-26T07:06:28.7519826Z Submodule path 'third_party/protobuf': checked out 'd1eca4e4b421cd2997495c4b4e65cea6be4e9b8a' 2024-06-26T07:06:28.7534654Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/protobuf/third_party/benchmark' 2024-06-26T07:06:28.7536595Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/protobuf/third_party/googletest' 2024-06-26T07:06:28.7554879Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/benchmark'... 2024-06-26T07:06:29.1119069Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/googletest'... 2024-06-26T07:06:30.1273375Z Submodule path 'third_party/protobuf/third_party/benchmark': checked out '5b7683f49e1e9223cf9927b24f6fd3d6bd82e3f8' 2024-06-26T07:06:30.1895426Z Submodule path 'third_party/protobuf/third_party/googletest': checked out '5ec7f0c4a113e2f18ac2c6cc7df51ad6afc24081' 2024-06-26T07:06:30.1955922Z Submodule path 'third_party/psimd': checked out '072586a71b55b7f8c584153d223e95687148a900' 2024-06-26T07:06:30.2044556Z Submodule path 'third_party/pthreadpool': checked out '4fe0e1e183925bf8cfa6aae24237e724a96479b8' 2024-06-26T07:06:30.2326269Z Submodule path 'third_party/pybind11': checked out '3e9dfa2866941655c56877882565e7577de6fc7b' 2024-06-26T07:06:30.2550846Z Submodule path 'third_party/python-peachpy': checked out 'f45429b087dd7d5bc78bb40dc7cf06425c252d67' 2024-06-26T07:06:30.2879931Z Submodule path 'third_party/sleef': checked out '60e76d2bce17d278b439d9da17177c8f957a9e9b' 2024-06-26T07:06:30.3080721Z Submodule path 'third_party/tensorpipe': checked out '52791a2fd214b2a9dc5759d36725909c1daa7f2e' 2024-06-26T07:06:30.3091694Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/tensorpipe/third_party/googletest' 2024-06-26T07:06:30.3093705Z Submodule 'third_party/libnop' (https://github.com/google/libnop.git) registered for path 'third_party/tensorpipe/third_party/libnop' 2024-06-26T07:06:30.3095545Z Submodule 'third_party/libuv' (https://github.com/libuv/libuv.git) registered for path 'third_party/tensorpipe/third_party/libuv' 2024-06-26T07:06:30.3097573Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T07:06:30.3114635Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/googletest'... 2024-06-26T07:06:31.2839492Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libnop'... 2024-06-26T07:06:31.5382503Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libuv'... 2024-06-26T07:06:32.5893339Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11'... 2024-06-26T07:06:33.6678190Z Submodule path 'third_party/tensorpipe/third_party/googletest': checked out 'aee0f9d9b5b87796ee8a0ab26b7587ec30e8858e' 2024-06-26T07:06:33.6790020Z Submodule path 'third_party/tensorpipe/third_party/libnop': checked out '910b55815be16109f04f4180e9adee14fb4ce281' 2024-06-26T07:06:33.7351654Z Submodule path 'third_party/tensorpipe/third_party/libuv': checked out '1dff88e5161cba5c59276d2070d2e304e4dcb242' 2024-06-26T07:06:33.7578677Z Submodule path 'third_party/tensorpipe/third_party/pybind11': checked out 'a23996fce38ff6ccfbcdc09f1e63f2c4be5ea2ef' 2024-06-26T07:06:33.7587174Z Submodule 'tools/clang' (https://github.com/wjakob/clang-cindex-python3) registered for path 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T07:06:33.7604734Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11/tools/clang'... 2024-06-26T07:06:33.9279383Z Submodule path 'third_party/tensorpipe/third_party/pybind11/tools/clang': checked out '6a00cbc4a9b8e68b71caf7f774b3f9c753ae84d5' 2024-06-26T07:06:33.9301040Z [command]/usr/bin/git submodule foreach --recursive git config --local gc.auto 0 2024-06-26T07:06:33.9506817Z Entering 'android/libs/fbjni' 2024-06-26T07:06:33.9536246Z Entering 'third_party/FP16' 2024-06-26T07:06:33.9562295Z Entering 'third_party/FXdiv' 2024-06-26T07:06:33.9591322Z Entering 'third_party/NNPACK' 2024-06-26T07:06:33.9616258Z Entering 'third_party/VulkanMemoryAllocator' 2024-06-26T07:06:33.9644228Z Entering 'third_party/XNNPACK' 2024-06-26T07:06:33.9683191Z Entering 'third_party/benchmark' 2024-06-26T07:06:33.9711438Z Entering 'third_party/cpp-httplib' 2024-06-26T07:06:33.9737724Z Entering 'third_party/cpuinfo' 2024-06-26T07:06:33.9766898Z Entering 'third_party/cudnn_frontend' 2024-06-26T07:06:33.9793732Z Entering 'third_party/cutlass' 2024-06-26T07:06:33.9828737Z Entering 'third_party/eigen' 2024-06-26T07:06:33.9859466Z Entering 'third_party/fbgemm' 2024-06-26T07:06:33.9886748Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-06-26T07:06:33.9915811Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T07:06:33.9945061Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-06-26T07:06:33.9975694Z Entering 'third_party/fbgemm/third_party/googletest' 2024-06-26T07:06:34.0002417Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T07:06:34.0027992Z Entering 'third_party/flatbuffers' 2024-06-26T07:06:34.0058180Z Entering 'third_party/fmt' 2024-06-26T07:06:34.0085917Z Entering 'third_party/foxi' 2024-06-26T07:06:34.0114585Z Entering 'third_party/gemmlowp/gemmlowp' 2024-06-26T07:06:34.0143065Z Entering 'third_party/gloo' 2024-06-26T07:06:34.0171641Z Entering 'third_party/googletest' 2024-06-26T07:06:34.0202259Z Entering 'third_party/ideep' 2024-06-26T07:06:34.0228092Z Entering 'third_party/ideep/mkl-dnn' 2024-06-26T07:06:34.0261515Z Entering 'third_party/ittapi' 2024-06-26T07:06:34.0288134Z Entering 'third_party/kineto' 2024-06-26T07:06:34.0315050Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T07:06:34.0343800Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T07:06:34.0373042Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T07:06:34.0401228Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T07:06:34.0427763Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T07:06:34.0455199Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T07:06:34.0484537Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T07:06:34.0511610Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T07:06:34.0540190Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T07:06:34.0568013Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T07:06:34.0595336Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T07:06:34.0623487Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T07:06:34.0651239Z Entering 'third_party/mimalloc' 2024-06-26T07:06:34.0678135Z Entering 'third_party/nccl/nccl' 2024-06-26T07:06:34.0705296Z Entering 'third_party/nlohmann' 2024-06-26T07:06:34.0733049Z Entering 'third_party/onnx' 2024-06-26T07:06:34.0775147Z Entering 'third_party/onnx/third_party/benchmark' 2024-06-26T07:06:34.0805444Z Entering 'third_party/onnx/third_party/pybind11' 2024-06-26T07:06:34.0834481Z Entering 'third_party/opentelemetry-cpp' 2024-06-26T07:06:34.0864506Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T07:06:34.0891149Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T07:06:34.0919096Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T07:06:34.0945806Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T07:06:34.0974305Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T07:06:34.1003229Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T07:06:34.1030325Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T07:06:34.1056109Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T07:06:34.1084925Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T07:06:34.1111890Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T07:06:34.1155597Z Entering 'third_party/pocketfft' 2024-06-26T07:06:34.1183480Z Entering 'third_party/protobuf' 2024-06-26T07:06:34.1215358Z Entering 'third_party/protobuf/third_party/benchmark' 2024-06-26T07:06:34.1243481Z Entering 'third_party/protobuf/third_party/googletest' 2024-06-26T07:06:34.1274064Z Entering 'third_party/psimd' 2024-06-26T07:06:34.1301413Z Entering 'third_party/pthreadpool' 2024-06-26T07:06:34.1329407Z Entering 'third_party/pybind11' 2024-06-26T07:06:34.1358128Z Entering 'third_party/python-peachpy' 2024-06-26T07:06:34.1383506Z Entering 'third_party/sleef' 2024-06-26T07:06:34.1410788Z Entering 'third_party/tensorpipe' 2024-06-26T07:06:34.1439562Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-06-26T07:06:34.1467784Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-06-26T07:06:34.1493443Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-06-26T07:06:34.1521798Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T07:06:34.1547920Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T07:06:34.1586627Z ##[endgroup] 2024-06-26T07:06:34.1588666Z ##[group]Persisting credentials for submodules 2024-06-26T07:06:34.1591281Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'url\.https\:\/\/github\.com\/\.insteadOf' && git config --local --unset-all 'url.https://github.com/.insteadOf' || :" 2024-06-26T07:06:34.1804956Z Entering 'android/libs/fbjni' 2024-06-26T07:06:34.1839087Z Entering 'third_party/FP16' 2024-06-26T07:06:34.1874111Z Entering 'third_party/FXdiv' 2024-06-26T07:06:34.1907185Z Entering 'third_party/NNPACK' 2024-06-26T07:06:34.1942450Z Entering 'third_party/VulkanMemoryAllocator' 2024-06-26T07:06:34.1973421Z Entering 'third_party/XNNPACK' 2024-06-26T07:06:34.2019748Z Entering 'third_party/benchmark' 2024-06-26T07:06:34.2055511Z Entering 'third_party/cpp-httplib' 2024-06-26T07:06:34.2088150Z Entering 'third_party/cpuinfo' 2024-06-26T07:06:34.2123065Z Entering 'third_party/cudnn_frontend' 2024-06-26T07:06:34.2157607Z Entering 'third_party/cutlass' 2024-06-26T07:06:34.2199384Z Entering 'third_party/eigen' 2024-06-26T07:06:34.2235007Z Entering 'third_party/fbgemm' 2024-06-26T07:06:34.2269774Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-06-26T07:06:34.2302980Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T07:06:34.2337289Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-06-26T07:06:34.2376249Z Entering 'third_party/fbgemm/third_party/googletest' 2024-06-26T07:06:34.2411569Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T07:06:34.2446016Z Entering 'third_party/flatbuffers' 2024-06-26T07:06:34.2484254Z Entering 'third_party/fmt' 2024-06-26T07:06:34.2518679Z Entering 'third_party/foxi' 2024-06-26T07:06:34.2553643Z Entering 'third_party/gemmlowp/gemmlowp' 2024-06-26T07:06:34.2588034Z Entering 'third_party/gloo' 2024-06-26T07:06:34.2623376Z Entering 'third_party/googletest' 2024-06-26T07:06:34.2657652Z Entering 'third_party/ideep' 2024-06-26T07:06:34.2691269Z Entering 'third_party/ideep/mkl-dnn' 2024-06-26T07:06:34.2731747Z Entering 'third_party/ittapi' 2024-06-26T07:06:34.2768517Z Entering 'third_party/kineto' 2024-06-26T07:06:34.2803712Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T07:06:34.2838583Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T07:06:34.2875377Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T07:06:34.2910113Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T07:06:34.2946179Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T07:06:34.2980192Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T07:06:34.3016368Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T07:06:34.3051062Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T07:06:34.3085844Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T07:06:34.3118423Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T07:06:34.3153946Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T07:06:34.3187292Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T07:06:34.3222756Z Entering 'third_party/mimalloc' 2024-06-26T07:06:34.3255579Z Entering 'third_party/nccl/nccl' 2024-06-26T07:06:34.3291017Z Entering 'third_party/nlohmann' 2024-06-26T07:06:34.3326089Z Entering 'third_party/onnx' 2024-06-26T07:06:34.3373298Z Entering 'third_party/onnx/third_party/benchmark' 2024-06-26T07:06:34.3408438Z Entering 'third_party/onnx/third_party/pybind11' 2024-06-26T07:06:34.3446436Z Entering 'third_party/opentelemetry-cpp' 2024-06-26T07:06:34.3481161Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T07:06:34.3515979Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T07:06:34.3550077Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T07:06:34.3581849Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T07:06:34.3618089Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T07:06:34.3652167Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T07:06:34.3687240Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T07:06:34.3721635Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T07:06:34.3757670Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T07:06:34.3792719Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T07:06:34.3841530Z Entering 'third_party/pocketfft' 2024-06-26T07:06:34.3877681Z Entering 'third_party/protobuf' 2024-06-26T07:06:34.3913588Z Entering 'third_party/protobuf/third_party/benchmark' 2024-06-26T07:06:34.3948059Z Entering 'third_party/protobuf/third_party/googletest' 2024-06-26T07:06:34.3981463Z Entering 'third_party/psimd' 2024-06-26T07:06:34.4016801Z Entering 'third_party/pthreadpool' 2024-06-26T07:06:34.4051748Z Entering 'third_party/pybind11' 2024-06-26T07:06:34.4087500Z Entering 'third_party/python-peachpy' 2024-06-26T07:06:34.4122652Z Entering 'third_party/sleef' 2024-06-26T07:06:34.4156691Z Entering 'third_party/tensorpipe' 2024-06-26T07:06:34.4188985Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-06-26T07:06:34.4223046Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-06-26T07:06:34.4257840Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-06-26T07:06:34.4289437Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T07:06:34.4323272Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T07:06:34.4369240Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local 'http.https://github.com/.extraheader' 'AUTHORIZATION: basic ***' && git config --local --show-origin --name-only --get-regexp remote.origin.url" 2024-06-26T07:06:34.4577846Z Entering 'android/libs/fbjni' 2024-06-26T07:06:34.4611133Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/android/libs/fbjni/config remote.origin.url 2024-06-26T07:06:34.4625108Z Entering 'third_party/FP16' 2024-06-26T07:06:34.4657234Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FP16/config remote.origin.url 2024-06-26T07:06:34.4670071Z Entering 'third_party/FXdiv' 2024-06-26T07:06:34.4702146Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FXdiv/config remote.origin.url 2024-06-26T07:06:34.4715518Z Entering 'third_party/NNPACK' 2024-06-26T07:06:34.4746641Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK/config remote.origin.url 2024-06-26T07:06:34.4760451Z Entering 'third_party/VulkanMemoryAllocator' 2024-06-26T07:06:34.4792324Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/VulkanMemoryAllocator/config remote.origin.url 2024-06-26T07:06:34.4806248Z Entering 'third_party/XNNPACK' 2024-06-26T07:06:34.4838238Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/XNNPACK/config remote.origin.url 2024-06-26T07:06:34.4861416Z Entering 'third_party/benchmark' 2024-06-26T07:06:34.4892869Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/benchmark/config remote.origin.url 2024-06-26T07:06:34.4906818Z Entering 'third_party/cpp-httplib' 2024-06-26T07:06:34.4938715Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpp-httplib/config remote.origin.url 2024-06-26T07:06:34.4952576Z Entering 'third_party/cpuinfo' 2024-06-26T07:06:34.4983660Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpuinfo/config remote.origin.url 2024-06-26T07:06:34.4998459Z Entering 'third_party/cudnn_frontend' 2024-06-26T07:06:34.5032952Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cudnn_frontend/config remote.origin.url 2024-06-26T07:06:34.5045435Z Entering 'third_party/cutlass' 2024-06-26T07:06:34.5076635Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cutlass/config remote.origin.url 2024-06-26T07:06:34.5095694Z Entering 'third_party/eigen' 2024-06-26T07:06:34.5128326Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/eigen/config remote.origin.url 2024-06-26T07:06:34.5142892Z Entering 'third_party/fbgemm' 2024-06-26T07:06:34.5174275Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/config remote.origin.url 2024-06-26T07:06:34.5187995Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-06-26T07:06:34.5220075Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/asmjit/config remote.origin.url 2024-06-26T07:06:34.5233343Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T07:06:34.5264705Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cpuinfo/config remote.origin.url 2024-06-26T07:06:34.5277656Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-06-26T07:06:34.5310530Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cutlass/config remote.origin.url 2024-06-26T07:06:34.5327311Z Entering 'third_party/fbgemm/third_party/googletest' 2024-06-26T07:06:34.5358182Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/googletest/config remote.origin.url 2024-06-26T07:06:34.5370974Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T07:06:34.5401710Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/hipify_torch/config remote.origin.url 2024-06-26T07:06:34.5414294Z Entering 'third_party/flatbuffers' 2024-06-26T07:06:34.5447330Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/flatbuffers/config remote.origin.url 2024-06-26T07:06:34.5463097Z Entering 'third_party/fmt' 2024-06-26T07:06:34.5494996Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fmt/config remote.origin.url 2024-06-26T07:06:34.5508131Z Entering 'third_party/foxi' 2024-06-26T07:06:34.5541096Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/foxi/config remote.origin.url 2024-06-26T07:06:34.5554647Z Entering 'third_party/gemmlowp/gemmlowp' 2024-06-26T07:06:34.5586118Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gemmlowp/gemmlowp/config remote.origin.url 2024-06-26T07:06:34.5600382Z Entering 'third_party/gloo' 2024-06-26T07:06:34.5632293Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gloo/config remote.origin.url 2024-06-26T07:06:34.5646214Z Entering 'third_party/googletest' 2024-06-26T07:06:34.5677784Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/googletest/config remote.origin.url 2024-06-26T07:06:34.5690229Z Entering 'third_party/ideep' 2024-06-26T07:06:34.5722222Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/config remote.origin.url 2024-06-26T07:06:34.5734841Z Entering 'third_party/ideep/mkl-dnn' 2024-06-26T07:06:34.5766444Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/modules/mkl-dnn/config remote.origin.url 2024-06-26T07:06:34.5785472Z Entering 'third_party/ittapi' 2024-06-26T07:06:34.5819453Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ittapi/config remote.origin.url 2024-06-26T07:06:34.5833132Z Entering 'third_party/kineto' 2024-06-26T07:06:34.5863943Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/config remote.origin.url 2024-06-26T07:06:34.5877029Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T07:06:34.5909629Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/config remote.origin.url 2024-06-26T07:06:34.5922314Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T07:06:34.5954684Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/DCGM/config remote.origin.url 2024-06-26T07:06:34.5969110Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T07:06:34.6001798Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/cpr/config remote.origin.url 2024-06-26T07:06:34.6014992Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T07:06:34.6048167Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/fmt/config remote.origin.url 2024-06-26T07:06:34.6061672Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T07:06:34.6094569Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/config remote.origin.url 2024-06-26T07:06:34.6106871Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T07:06:34.6138564Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/modules/doc/config remote.origin.url 2024-06-26T07:06:34.6151333Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T07:06:34.6185352Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/glog/config remote.origin.url 2024-06-26T07:06:34.6198676Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T07:06:34.6231091Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/googletest/config remote.origin.url 2024-06-26T07:06:34.6244236Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T07:06:34.6276821Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/json/config remote.origin.url 2024-06-26T07:06:34.6290208Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T07:06:34.6323871Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/pfs/config remote.origin.url 2024-06-26T07:06:34.6336533Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T07:06:34.6370281Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/fmt/config remote.origin.url 2024-06-26T07:06:34.6382773Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T07:06:34.6414214Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/googletest/config remote.origin.url 2024-06-26T07:06:34.6427566Z Entering 'third_party/mimalloc' 2024-06-26T07:06:34.6459544Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/mimalloc/config remote.origin.url 2024-06-26T07:06:34.6472240Z Entering 'third_party/nccl/nccl' 2024-06-26T07:06:34.6504554Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nccl/nccl/config remote.origin.url 2024-06-26T07:06:34.6518763Z Entering 'third_party/nlohmann' 2024-06-26T07:06:34.6549507Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nlohmann/config remote.origin.url 2024-06-26T07:06:34.6563903Z Entering 'third_party/onnx' 2024-06-26T07:06:34.6595194Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/config remote.origin.url 2024-06-26T07:06:34.6621857Z Entering 'third_party/onnx/third_party/benchmark' 2024-06-26T07:06:34.6653205Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/benchmark/config remote.origin.url 2024-06-26T07:06:34.6666261Z Entering 'third_party/onnx/third_party/pybind11' 2024-06-26T07:06:34.6698337Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/pybind11/config remote.origin.url 2024-06-26T07:06:34.6714426Z Entering 'third_party/opentelemetry-cpp' 2024-06-26T07:06:34.6746013Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/config remote.origin.url 2024-06-26T07:06:34.6759367Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T07:06:34.6789792Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/benchmark/config remote.origin.url 2024-06-26T07:06:34.6803134Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T07:06:34.6834229Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/googletest/config remote.origin.url 2024-06-26T07:06:34.6847516Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T07:06:34.6879678Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/ms-gsl/config remote.origin.url 2024-06-26T07:06:34.6892340Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T07:06:34.6924680Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/nlohmann-json/config remote.origin.url 2024-06-26T07:06:34.6937809Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T07:06:34.6970183Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentelemetry-proto/config remote.origin.url 2024-06-26T07:06:34.6983060Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T07:06:34.7014176Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentracing-cpp/config remote.origin.url 2024-06-26T07:06:34.7025247Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T07:06:34.7056817Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/config remote.origin.url 2024-06-26T07:06:34.7068711Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T07:06:34.7099175Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/civetweb/config remote.origin.url 2024-06-26T07:06:34.7114264Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T07:06:34.7146712Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/googletest/config remote.origin.url 2024-06-26T07:06:34.7161452Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T07:06:34.7194305Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/tools/vcpkg/config remote.origin.url 2024-06-26T07:06:34.7221953Z Entering 'third_party/pocketfft' 2024-06-26T07:06:34.7254435Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pocketfft/config remote.origin.url 2024-06-26T07:06:34.7268182Z Entering 'third_party/protobuf' 2024-06-26T07:06:34.7298394Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/config remote.origin.url 2024-06-26T07:06:34.7313158Z Entering 'third_party/protobuf/third_party/benchmark' 2024-06-26T07:06:34.7344451Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/benchmark/config remote.origin.url 2024-06-26T07:06:34.7356302Z Entering 'third_party/protobuf/third_party/googletest' 2024-06-26T07:06:34.7386156Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/googletest/config remote.origin.url 2024-06-26T07:06:34.7399525Z Entering 'third_party/psimd' 2024-06-26T07:06:34.7430746Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/psimd/config remote.origin.url 2024-06-26T07:06:34.7444260Z Entering 'third_party/pthreadpool' 2024-06-26T07:06:34.7474494Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/pthreadpool/config remote.origin.url 2024-06-26T07:06:34.7486037Z Entering 'third_party/pybind11' 2024-06-26T07:06:34.7518062Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pybind11/config remote.origin.url 2024-06-26T07:06:34.7530043Z Entering 'third_party/python-peachpy' 2024-06-26T07:06:34.7562906Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/python-peachpy/config remote.origin.url 2024-06-26T07:06:34.7575847Z Entering 'third_party/sleef' 2024-06-26T07:06:34.7606756Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/sleef/config remote.origin.url 2024-06-26T07:06:34.7621167Z Entering 'third_party/tensorpipe' 2024-06-26T07:06:34.7651983Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/config remote.origin.url 2024-06-26T07:06:34.7664302Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-06-26T07:06:34.7696266Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/googletest/config remote.origin.url 2024-06-26T07:06:34.7708479Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-06-26T07:06:34.7739450Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libnop/config remote.origin.url 2024-06-26T07:06:34.7752230Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-06-26T07:06:34.7783182Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libuv/config remote.origin.url 2024-06-26T07:06:34.7795137Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T07:06:34.7824367Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/config remote.origin.url 2024-06-26T07:06:34.7835548Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T07:06:34.7866228Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/modules/tools/clang/config remote.origin.url 2024-06-26T07:06:34.8803555Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'git@github.com:' 2024-06-26T07:06:34.9009739Z Entering 'android/libs/fbjni' 2024-06-26T07:06:34.9036309Z Entering 'third_party/FP16' 2024-06-26T07:06:34.9061676Z Entering 'third_party/FXdiv' 2024-06-26T07:06:34.9087180Z Entering 'third_party/NNPACK' 2024-06-26T07:06:34.9114581Z Entering 'third_party/VulkanMemoryAllocator' 2024-06-26T07:06:34.9141653Z Entering 'third_party/XNNPACK' 2024-06-26T07:06:34.9182786Z Entering 'third_party/benchmark' 2024-06-26T07:06:34.9209391Z Entering 'third_party/cpp-httplib' 2024-06-26T07:06:34.9237879Z Entering 'third_party/cpuinfo' 2024-06-26T07:06:34.9265608Z Entering 'third_party/cudnn_frontend' 2024-06-26T07:06:34.9294608Z Entering 'third_party/cutlass' 2024-06-26T07:06:34.9327953Z Entering 'third_party/eigen' 2024-06-26T07:06:34.9359302Z Entering 'third_party/fbgemm' 2024-06-26T07:06:34.9384898Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-06-26T07:06:34.9412000Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T07:06:34.9441960Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-06-26T07:06:34.9476644Z Entering 'third_party/fbgemm/third_party/googletest' 2024-06-26T07:06:34.9504345Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T07:06:34.9532525Z Entering 'third_party/flatbuffers' 2024-06-26T07:06:34.9565445Z Entering 'third_party/fmt' 2024-06-26T07:06:34.9593486Z Entering 'third_party/foxi' 2024-06-26T07:06:34.9621685Z Entering 'third_party/gemmlowp/gemmlowp' 2024-06-26T07:06:34.9649184Z Entering 'third_party/gloo' 2024-06-26T07:06:34.9676445Z Entering 'third_party/googletest' 2024-06-26T07:06:34.9704981Z Entering 'third_party/ideep' 2024-06-26T07:06:34.9731177Z Entering 'third_party/ideep/mkl-dnn' 2024-06-26T07:06:34.9765488Z Entering 'third_party/ittapi' 2024-06-26T07:06:34.9792255Z Entering 'third_party/kineto' 2024-06-26T07:06:34.9820668Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T07:06:34.9848129Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T07:06:34.9876089Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T07:06:34.9902923Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T07:06:34.9929665Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T07:06:34.9957515Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T07:06:34.9986077Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T07:06:35.0013910Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T07:06:35.0042341Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T07:06:35.0069176Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T07:06:35.0098621Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T07:06:35.0127389Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T07:06:35.0156920Z Entering 'third_party/mimalloc' 2024-06-26T07:06:35.0185673Z Entering 'third_party/nccl/nccl' 2024-06-26T07:06:35.0212833Z Entering 'third_party/nlohmann' 2024-06-26T07:06:35.0242532Z Entering 'third_party/onnx' 2024-06-26T07:06:35.0282580Z Entering 'third_party/onnx/third_party/benchmark' 2024-06-26T07:06:35.0313286Z Entering 'third_party/onnx/third_party/pybind11' 2024-06-26T07:06:35.0342507Z Entering 'third_party/opentelemetry-cpp' 2024-06-26T07:06:35.0373603Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T07:06:35.0402491Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T07:06:35.0427672Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T07:06:35.0455475Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T07:06:35.0485154Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T07:06:35.0511748Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T07:06:35.0539747Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T07:06:35.0566976Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T07:06:35.0595534Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T07:06:35.0622474Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T07:06:35.0666214Z Entering 'third_party/pocketfft' 2024-06-26T07:06:35.0693461Z Entering 'third_party/protobuf' 2024-06-26T07:06:35.0725333Z Entering 'third_party/protobuf/third_party/benchmark' 2024-06-26T07:06:35.0751956Z Entering 'third_party/protobuf/third_party/googletest' 2024-06-26T07:06:35.0779556Z Entering 'third_party/psimd' 2024-06-26T07:06:35.0807761Z Entering 'third_party/pthreadpool' 2024-06-26T07:06:35.0837996Z Entering 'third_party/pybind11' 2024-06-26T07:06:35.0865812Z Entering 'third_party/python-peachpy' 2024-06-26T07:06:35.0895222Z Entering 'third_party/sleef' 2024-06-26T07:06:35.0922761Z Entering 'third_party/tensorpipe' 2024-06-26T07:06:35.0950875Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-06-26T07:06:35.0978225Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-06-26T07:06:35.1005733Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-06-26T07:06:35.1033659Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T07:06:35.1060788Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T07:06:35.1102713Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'org-21003710@github.com:' 2024-06-26T07:06:35.1308767Z Entering 'android/libs/fbjni' 2024-06-26T07:06:35.1337533Z Entering 'third_party/FP16' 2024-06-26T07:06:35.1366203Z Entering 'third_party/FXdiv' 2024-06-26T07:06:35.1395216Z Entering 'third_party/NNPACK' 2024-06-26T07:06:35.1425399Z Entering 'third_party/VulkanMemoryAllocator' 2024-06-26T07:06:35.1453110Z Entering 'third_party/XNNPACK' 2024-06-26T07:06:35.1494137Z Entering 'third_party/benchmark' 2024-06-26T07:06:35.1519635Z Entering 'third_party/cpp-httplib' 2024-06-26T07:06:35.1548188Z Entering 'third_party/cpuinfo' 2024-06-26T07:06:35.1575488Z Entering 'third_party/cudnn_frontend' 2024-06-26T07:06:35.1604833Z Entering 'third_party/cutlass' 2024-06-26T07:06:35.1636925Z Entering 'third_party/eigen' 2024-06-26T07:06:35.1667123Z Entering 'third_party/fbgemm' 2024-06-26T07:06:35.1694546Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-06-26T07:06:35.1723311Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T07:06:35.1750835Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-06-26T07:06:35.1783661Z Entering 'third_party/fbgemm/third_party/googletest' 2024-06-26T07:06:35.1810160Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T07:06:35.1837236Z Entering 'third_party/flatbuffers' 2024-06-26T07:06:35.1867218Z Entering 'third_party/fmt' 2024-06-26T07:06:35.1893964Z Entering 'third_party/foxi' 2024-06-26T07:06:35.1923998Z Entering 'third_party/gemmlowp/gemmlowp' 2024-06-26T07:06:35.1952134Z Entering 'third_party/gloo' 2024-06-26T07:06:35.1980624Z Entering 'third_party/googletest' 2024-06-26T07:06:35.2007497Z Entering 'third_party/ideep' 2024-06-26T07:06:35.2036611Z Entering 'third_party/ideep/mkl-dnn' 2024-06-26T07:06:35.2068910Z Entering 'third_party/ittapi' 2024-06-26T07:06:35.2096539Z Entering 'third_party/kineto' 2024-06-26T07:06:35.2126327Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T07:06:35.2152704Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T07:06:35.2181111Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T07:06:35.2208972Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T07:06:35.2237121Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T07:06:35.2264598Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T07:06:35.2294707Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T07:06:35.2324035Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T07:06:35.2351423Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T07:06:35.2379875Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T07:06:35.2406882Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T07:06:35.2435351Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T07:06:35.2463510Z Entering 'third_party/mimalloc' 2024-06-26T07:06:35.2490966Z Entering 'third_party/nccl/nccl' 2024-06-26T07:06:35.2517419Z Entering 'third_party/nlohmann' 2024-06-26T07:06:35.2548068Z Entering 'third_party/onnx' 2024-06-26T07:06:35.2589985Z Entering 'third_party/onnx/third_party/benchmark' 2024-06-26T07:06:35.2617958Z Entering 'third_party/onnx/third_party/pybind11' 2024-06-26T07:06:35.2647563Z Entering 'third_party/opentelemetry-cpp' 2024-06-26T07:06:35.2679782Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T07:06:35.2707578Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T07:06:35.2734367Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T07:06:35.2764424Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T07:06:35.2792259Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T07:06:35.2818646Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T07:06:35.2847717Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T07:06:35.2875959Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T07:06:35.2905499Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T07:06:35.2934914Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T07:06:35.2978349Z Entering 'third_party/pocketfft' 2024-06-26T07:06:35.3007518Z Entering 'third_party/protobuf' 2024-06-26T07:06:35.3038882Z Entering 'third_party/protobuf/third_party/benchmark' 2024-06-26T07:06:35.3064322Z Entering 'third_party/protobuf/third_party/googletest' 2024-06-26T07:06:35.3093893Z Entering 'third_party/psimd' 2024-06-26T07:06:35.3120807Z Entering 'third_party/pthreadpool' 2024-06-26T07:06:35.3149011Z Entering 'third_party/pybind11' 2024-06-26T07:06:35.3176919Z Entering 'third_party/python-peachpy' 2024-06-26T07:06:35.3206786Z Entering 'third_party/sleef' 2024-06-26T07:06:35.3233274Z Entering 'third_party/tensorpipe' 2024-06-26T07:06:35.3261771Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-06-26T07:06:35.3289856Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-06-26T07:06:35.3317423Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-06-26T07:06:35.3347028Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T07:06:35.3373856Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T07:06:35.3414169Z ##[endgroup] 2024-06-26T07:06:35.3447406Z [command]/usr/bin/git log -1 --format='%H' 2024-06-26T07:06:35.3469326Z 'b8c4c54d347aa776934c60784e35936878ef18dc' 2024-06-26T07:06:35.3645482Z Prepare all required actions 2024-06-26T07:06:35.3645934Z Getting action download info 2024-06-26T07:06:35.5051697Z ##[group]Run ./.github/actions/setup-linux 2024-06-26T07:06:35.5052132Z env: 2024-06-26T07:06:35.5052424Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:06:35.5052775Z ##[endgroup] 2024-06-26T07:06:35.5111271Z ##[group]Run set -euo pipefail 2024-06-26T07:06:35.5111710Z set -euo pipefail 2024-06-26T07:06:35.5112112Z function get_ec2_metadata() { 2024-06-26T07:06:35.5112648Z  # Pulled from instance metadata endpoint for EC2 2024-06-26T07:06:35.5113539Z  # see https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/instancedata-data-retrieval.html 2024-06-26T07:06:35.5114310Z  category=$1 2024-06-26T07:06:35.5114851Z  # If it is GCP runner (runner name contains gcp), do not run this 2024-06-26T07:06:35.5115497Z  runner_name_str=i-0e78f3ec154b9b15a 2024-06-26T07:06:35.5116006Z  if [[ -f /.inarc ]]; then 2024-06-26T07:06:35.5116514Z  echo "ARC Runner, no info on ec2 metadata" 2024-06-26T07:06:35.5117084Z  elif [[ $runner_name_str == *"gcp"* ]]; then 2024-06-26T07:06:35.5117792Z  echo "Runner is from Google Cloud Platform, No info on ec2 metadata" 2024-06-26T07:06:35.5118412Z  else 2024-06-26T07:06:35.5118917Z  curl -fsSL "http://169.254.169.254/latest/meta-data/${category}" 2024-06-26T07:06:35.5119494Z  fi 2024-06-26T07:06:35.5119796Z } 2024-06-26T07:06:35.5120168Z echo "ami-id: $(get_ec2_metadata ami-id)" 2024-06-26T07:06:35.5120760Z echo "instance-id: $(get_ec2_metadata instance-id)" 2024-06-26T07:06:35.5121417Z echo "instance-type: $(get_ec2_metadata instance-type)" 2024-06-26T07:06:35.5121998Z echo "system info $(uname -a)" 2024-06-26T07:06:35.5129809Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:06:35.5130318Z env: 2024-06-26T07:06:35.5130608Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:06:35.5130973Z ##[endgroup] 2024-06-26T07:06:35.5203087Z ami-id: ami-0ce0c36d7a00b20e2 2024-06-26T07:06:35.5245731Z instance-id: i-0e78f3ec154b9b15a 2024-06-26T07:06:35.5286808Z instance-type: g5.4xlarge 2024-06-26T07:06:35.5292718Z system info Linux ip-10-0-36-112.ec2.internal 4.14.336-257.562.amzn2.x86_64 #1 SMP Sat Feb 24 09:50:35 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux 2024-06-26T07:06:35.5313687Z ##[group]Run echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> $GITHUB_OUTPUT 2024-06-26T07:06:35.5314607Z echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> $GITHUB_OUTPUT 2024-06-26T07:06:35.5322691Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:06:35.5323195Z env: 2024-06-26T07:06:35.5323482Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:06:35.5323841Z ##[endgroup] 2024-06-26T07:06:35.5385599Z ##[group]Run if systemctl is-active --quiet docker; then 2024-06-26T07:06:35.5386223Z if systemctl is-active --quiet docker; then 2024-06-26T07:06:35.5386777Z  echo "Docker daemon is running..."; 2024-06-26T07:06:35.5387358Z else 2024-06-26T07:06:35.5387868Z  echo "Starting docker deamon..." && sudo systemctl start docker; 2024-06-26T07:06:35.5388458Z fi 2024-06-26T07:06:35.5396042Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:06:35.5396541Z env: 2024-06-26T07:06:35.5396837Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:06:35.5397200Z ##[endgroup] 2024-06-26T07:06:35.5432122Z Docker daemon is running... 2024-06-26T07:06:35.5474450Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2024-06-26T07:06:35.5475016Z with: 2024-06-26T07:06:35.5475298Z shell: bash 2024-06-26T07:06:35.5475600Z timeout_minutes: 5 2024-06-26T07:06:35.5475934Z max_attempts: 3 2024-06-26T07:06:35.5476257Z retry_wait_seconds: 30 2024-06-26T07:06:35.5477760Z command: AWS_ACCOUNT_ID=$(aws sts get-caller-identity|grep Account|cut -f4 -d\") aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \ --password-stdin "$AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com" 2024-06-26T07:06:35.5479191Z polling_interval_seconds: 1 2024-06-26T07:06:35.5479572Z warning_on_retry: true 2024-06-26T07:06:35.5479931Z continue_on_error: false 2024-06-26T07:06:35.5480277Z env: 2024-06-26T07:06:35.5480558Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:06:35.5480922Z AWS_RETRY_MODE: standard 2024-06-26T07:06:35.5481280Z AWS_MAX_ATTEMPTS: 5 2024-06-26T07:06:35.5481630Z AWS_DEFAULT_REGION: us-east-1 2024-06-26T07:06:35.5482003Z ##[endgroup] 2024-06-26T07:06:36.3917068Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-06-26T07:06:36.3918034Z Configure a credential helper to remove this warning. See 2024-06-26T07:06:36.3918960Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-06-26T07:06:36.3919483Z 2024-06-26T07:06:36.3919634Z Login Succeeded 2024-06-26T07:06:36.5964278Z Command completed after 1 attempt(s). 2024-06-26T07:06:36.6005082Z ##[group]Run env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-06-26T07:06:36.6005819Z env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-06-26T07:06:36.6006469Z env | grep '^CI' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-06-26T07:06:36.6014214Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:06:36.6014717Z env: 2024-06-26T07:06:36.6015001Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:06:36.6015363Z ##[endgroup] 2024-06-26T07:06:36.6074086Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2024-06-26T07:06:36.6074865Z # ignore expansion of "docker ps -q" since it could be empty 2024-06-26T07:06:36.6075462Z # shellcheck disable=SC2046 2024-06-26T07:06:36.6075935Z docker stop $(docker ps -q) || true 2024-06-26T07:06:36.6076430Z # Prune all of the docker images 2024-06-26T07:06:36.6076890Z docker system prune -af 2024-06-26T07:06:36.6084532Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:06:36.6085053Z env: 2024-06-26T07:06:36.6085349Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:06:36.6085718Z ##[endgroup] 2024-06-26T07:06:36.6317701Z "docker stop" requires at least 1 argument. 2024-06-26T07:06:36.6318451Z See 'docker stop --help'. 2024-06-26T07:06:36.6318708Z 2024-06-26T07:06:36.6318943Z Usage: docker stop [OPTIONS] CONTAINER [CONTAINER...] 2024-06-26T07:06:36.6319329Z 2024-06-26T07:06:36.6319488Z Stop one or more running containers 2024-06-26T07:06:36.6458734Z Total reclaimed space: 0B 2024-06-26T07:06:36.6487763Z ##[group]Run set +e 2024-06-26T07:06:36.6488128Z set +e 2024-06-26T07:06:36.6488436Z set -x 2024-06-26T07:06:36.6488736Z  2024-06-26T07:06:36.6489066Z PT_DOMAIN=download.pytorch.org 2024-06-26T07:06:36.6489865Z # TODO: Flaky access to download.pytorch.org https://github.com/pytorch/pytorch/issues/100400, 2024-06-26T07:06:36.6490949Z # cleaning this up once the issue is fixed. There are more than one resolved IP here, the last 2024-06-26T07:06:36.6491822Z # one is returned at random 2024-06-26T07:06:36.6492369Z RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" | tail -n1) 2024-06-26T07:06:36.6492887Z  2024-06-26T07:06:36.6493201Z if [ -z "${RESOLVED_IP}" ]; then 2024-06-26T07:06:36.6493870Z  echo "Couldn't resolve ${PT_DOMAIN}, retrying with Google DNS..." 2024-06-26T07:06:36.6494643Z  RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" @8.8.8.8 | tail -n1) 2024-06-26T07:06:36.6495202Z  2024-06-26T07:06:36.6495525Z  if [ -z "${RESOLVED_IP}" ]; then 2024-06-26T07:06:36.6496083Z  echo "Couldn't resolve ${PT_DOMAIN}, exiting..." 2024-06-26T07:06:36.6496596Z  exit 1 2024-06-26T07:06:36.6497182Z  fi 2024-06-26T07:06:36.6497552Z fi 2024-06-26T07:06:36.6497937Z  2024-06-26T07:06:36.6498310Z if grep -r "${PT_DOMAIN}" /etc/hosts; then 2024-06-26T07:06:36.6498839Z  # Clean up any old records first 2024-06-26T07:06:36.6499356Z  sudo sed -i "/${PT_DOMAIN}/d" /etc/hosts 2024-06-26T07:06:36.6499817Z fi 2024-06-26T07:06:36.6500104Z  2024-06-26T07:06:36.6500533Z echo "${RESOLVED_IP} ${PT_DOMAIN}" | sudo tee -a /etc/hosts 2024-06-26T07:06:36.6501089Z cat /etc/hosts 2024-06-26T07:06:36.6508781Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:06:36.6509306Z env: 2024-06-26T07:06:36.6509593Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:06:36.6509955Z ##[endgroup] 2024-06-26T07:06:36.6529397Z + PT_DOMAIN=download.pytorch.org 2024-06-26T07:06:36.6532688Z ++ dig -4 +short download.pytorch.org 2024-06-26T07:06:36.6533323Z ++ tail -n1 2024-06-26T07:06:36.6792386Z + RESOLVED_IP=18.160.10.28 2024-06-26T07:06:36.6792866Z + '[' -z 18.160.10.28 ']' 2024-06-26T07:06:36.6793329Z + grep -r download.pytorch.org /etc/hosts 2024-06-26T07:06:36.6799440Z 18.160.10.28 download.pytorch.org 2024-06-26T07:06:36.6800789Z + sudo sed -i /download.pytorch.org/d /etc/hosts 2024-06-26T07:06:36.6898889Z + echo '18.160.10.28 download.pytorch.org' 2024-06-26T07:06:36.6899398Z + sudo tee -a /etc/hosts 2024-06-26T07:06:36.7169510Z 18.160.10.28 download.pytorch.org 2024-06-26T07:06:36.7183387Z + cat /etc/hosts 2024-06-26T07:06:36.7187172Z 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 2024-06-26T07:06:36.7200652Z ::1 localhost6 localhost6.localdomain6 2024-06-26T07:06:36.7201156Z 18.160.10.28 download.pytorch.org 2024-06-26T07:06:36.7407785Z ##[group]Run pytorch/test-infra/.github/actions/calculate-docker-image@main 2024-06-26T07:06:36.7408376Z with: 2024-06-26T07:06:36.7409447Z docker-image-name: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:06:36.7410637Z docker-build-dir: .ci/docker 2024-06-26T07:06:36.7411010Z working-directory: . 2024-06-26T07:06:36.7411485Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:06:36.7412002Z force-push: false 2024-06-26T07:06:36.7412296Z env: 2024-06-26T07:06:36.7412566Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:06:36.7412905Z ##[endgroup] 2024-06-26T07:06:36.7429974Z ##[group]Run set -ex 2024-06-26T07:06:36.7430346Z set -ex 2024-06-26T07:06:36.7430757Z  2024-06-26T07:06:36.7431316Z # If the docker build directory or the build script doesn't exist, the action will 2024-06-26T07:06:36.7432266Z # gracefully return the docker image name as it is. Pulling docker image in Linux 2024-06-26T07:06:36.7433047Z # job could then download the pre-built image as usual 2024-06-26T07:06:36.7433780Z if [[ ! -d "${DOCKER_BUILD_DIR}" ]] || [[ ! -f "${DOCKER_BUILD_DIR}/build.sh" ]]; then 2024-06-26T07:06:36.7434445Z  echo "skip=true" >> "${GITHUB_OUTPUT}" 2024-06-26T07:06:36.7435070Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2024-06-26T07:06:36.7435769Z  2024-06-26T07:06:36.7436278Z  echo "There is no Docker build script in ${REPO_NAME} repo, skipping..." 2024-06-26T07:06:36.7436905Z  exit 0 2024-06-26T07:06:36.7437208Z else 2024-06-26T07:06:36.7437578Z  echo "skip=false" >> "${GITHUB_OUTPUT}" 2024-06-26T07:06:36.7438032Z fi 2024-06-26T07:06:36.7438324Z  2024-06-26T07:06:36.7438803Z if [[ "${DOCKER_IMAGE_NAME}" == *"${DOCKER_REGISTRY}/${REPO_NAME}"* ]]; then 2024-06-26T07:06:36.7439664Z  # The docker image name already includes the ECR prefix and tag, so we can just 2024-06-26T07:06:36.7440447Z  # use it as it is, but first let's extract the tag 2024-06-26T07:06:36.7441164Z  DOCKER_TAG=$(echo "${DOCKER_IMAGE_NAME}" | awk -F '[:,]' '{print $2}') 2024-06-26T07:06:36.7441898Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-06-26T07:06:36.7442613Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2024-06-26T07:06:36.7443183Z else 2024-06-26T07:06:36.7443630Z  DOCKER_TAG=$(git rev-parse HEAD:"${DOCKER_BUILD_DIR}") 2024-06-26T07:06:36.7444312Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-06-26T07:06:36.7445218Z  echo "docker-image=${DOCKER_REGISTRY}/${REPO_NAME}/${DOCKER_IMAGE_NAME}:${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-06-26T07:06:36.7445978Z fi 2024-06-26T07:06:36.7453628Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:06:36.7454128Z env: 2024-06-26T07:06:36.7454409Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:06:36.7454769Z REPO_NAME: pytorch 2024-06-26T07:06:36.7455903Z DOCKER_IMAGE_NAME: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:06:36.7457338Z DOCKER_BUILD_DIR: .ci/docker 2024-06-26T07:06:36.7457853Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:06:36.7458383Z ##[endgroup] 2024-06-26T07:06:36.7479115Z + [[ ! -d .ci/docker ]] 2024-06-26T07:06:36.7479591Z + [[ ! -f .ci/docker/build.sh ]] 2024-06-26T07:06:36.7479976Z + echo skip=false 2024-06-26T07:06:36.7481983Z + [[ 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 == *\3\0\8\5\3\5\3\8\5\1\1\4\.\d\k\r\.\e\c\r\.\u\s\-\e\a\s\t\-\1\.\a\m\a\z\o\n\a\w\s\.\c\o\m\/\p\y\t\o\r\c\h* ]] 2024-06-26T07:06:36.7484613Z ++ echo 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:06:36.7485793Z ++ awk -F '[:,]' '{print $2}' 2024-06-26T07:06:36.7490880Z + DOCKER_TAG=91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:06:36.7491627Z + echo docker-tag=91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:06:36.7493295Z + echo docker-image=308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:06:36.7518486Z ##[group]Run set +e 2024-06-26T07:06:36.7518858Z set +e 2024-06-26T07:06:36.7519163Z set -x 2024-06-26T07:06:36.7519449Z  2024-06-26T07:06:36.7519727Z login() { 2024-06-26T07:06:36.7520385Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2024-06-26T07:06:36.7521092Z } 2024-06-26T07:06:36.7521361Z  2024-06-26T07:06:36.7521643Z retry () { 2024-06-26T07:06:36.7522033Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2024-06-26T07:06:36.7522481Z } 2024-06-26T07:06:36.7522751Z  2024-06-26T07:06:36.7523069Z retry login "${DOCKER_REGISTRY}" 2024-06-26T07:06:36.7523481Z  2024-06-26T07:06:36.7523947Z # Check if image already exists, if it does then skip building it 2024-06-26T07:06:36.7524755Z if docker manifest inspect "${DOCKER_IMAGE}"; then 2024-06-26T07:06:36.7525251Z  exit 0 2024-06-26T07:06:36.7525550Z fi 2024-06-26T07:06:36.7525820Z  2024-06-26T07:06:36.7526321Z # NB: This part requires a full checkout. Otherwise, the merge base will 2024-06-26T07:06:36.7527139Z # be empty. The default action would be to continue rebuild the image 2024-06-26T07:06:36.7527877Z if [[ "$BASE_REVISION" = "$(git rev-parse HEAD)" ]]; then 2024-06-26T07:06:36.7528539Z  # if we're on the base branch then use the parent commit 2024-06-26T07:06:36.7529130Z  MERGE_BASE=$(git rev-parse HEAD~) 2024-06-26T07:06:36.7529566Z else 2024-06-26T07:06:36.7530033Z  # otherwise we're on a PR, so use the most recent base commit 2024-06-26T07:06:36.7530714Z  MERGE_BASE=$(git merge-base HEAD "$BASE_REVISION") 2024-06-26T07:06:36.7531223Z fi 2024-06-26T07:06:36.7531500Z  2024-06-26T07:06:36.7531816Z if [[ -z "${MERGE_BASE}" ]]; then 2024-06-26T07:06:36.7532307Z  echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2024-06-26T07:06:36.7532760Z  2024-06-26T07:06:36.7533403Z  echo "Finding merge base only works with full checkout, please set fetch-depth to 0, continuing ..." 2024-06-26T07:06:36.7534150Z  exit 0 2024-06-26T07:06:36.7534442Z fi 2024-06-26T07:06:36.7534719Z  2024-06-26T07:06:36.7535154Z if ! git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}"; then 2024-06-26T07:06:36.7536115Z  echo "Directory '${DOCKER_BUILD_DIR}' not found in commit $MERGE_BASE, you should rebase onto a more recent commit" 2024-06-26T07:06:36.7536896Z  exit 1 2024-06-26T07:06:36.7537437Z fi 2024-06-26T07:06:36.7537718Z  2024-06-26T07:06:36.7538204Z PREVIOUS_DOCKER_TAG=$(git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}") 2024-06-26T07:06:36.7539143Z # If no image exists but the hash is the same as the previous hash then we should error out here 2024-06-26T07:06:36.7540007Z if [[ "${PREVIOUS_DOCKER_TAG}" == "${DOCKER_TAG}" ]]; then 2024-06-26T07:06:36.7540960Z  echo "WARNING: Something has gone wrong and the previous image isn't available for the merge-base of your branch" 2024-06-26T07:06:36.7542046Z  echo " Will re-build docker image to store in local cache, TTS may be longer" 2024-06-26T07:06:36.7542788Z fi 2024-06-26T07:06:36.7543067Z  2024-06-26T07:06:36.7543430Z echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2024-06-26T07:06:36.7550390Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:06:36.7550974Z env: 2024-06-26T07:06:36.7551257Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:06:36.7551628Z DOCKER_BUILD_DIR: .ci/docker 2024-06-26T07:06:36.7552102Z BASE_REVISION: b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:06:36.7553357Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:06:36.7554595Z DOCKER_TAG: 91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:06:36.7555190Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:06:36.7555703Z ##[endgroup] 2024-06-26T07:06:36.7574511Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:06:36.7575173Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:06:36.7575943Z + aws ecr get-login-password --region us-east-1 2024-06-26T07:06:36.7576827Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:06:37.1711994Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-06-26T07:06:37.1712854Z Configure a credential helper to remove this warning. See 2024-06-26T07:06:37.1713698Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-06-26T07:06:37.1714417Z 2024-06-26T07:06:37.1714563Z Login Succeeded 2024-06-26T07:06:37.1723682Z + docker manifest inspect 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:06:37.3839867Z { 2024-06-26T07:06:37.3840259Z "schemaVersion": 2, 2024-06-26T07:06:37.3840990Z "mediaType": "application/vnd.docker.distribution.manifest.v2+json", 2024-06-26T07:06:37.3841740Z "config": { 2024-06-26T07:06:37.3842206Z "mediaType": "application/vnd.docker.container.image.v1+json", 2024-06-26T07:06:37.3842791Z "size": 48681, 2024-06-26T07:06:37.3843375Z "digest": "sha256:0058b15e517a024817bccd921dc9af264c964f500b3cb9b3f4649a8ac22cc2dd" 2024-06-26T07:06:37.3844190Z }, 2024-06-26T07:06:37.3844521Z "layers": [ 2024-06-26T07:06:37.3844812Z { 2024-06-26T07:06:37.3845260Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3845843Z "size": 28580681, 2024-06-26T07:06:37.3846406Z "digest": "sha256:7a2c559011895d255fce249c00396abff5ae7e0c0a92931d0ed493e71de78e3a" 2024-06-26T07:06:37.3847036Z }, 2024-06-26T07:06:37.3847306Z { 2024-06-26T07:06:37.3847803Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3848476Z "size": 7943451, 2024-06-26T07:06:37.3849101Z "digest": "sha256:224fe954d7252f10539d243d6c9688806f7d13ad775ed02e7f7c79077844510d" 2024-06-26T07:06:37.3849920Z }, 2024-06-26T07:06:37.3850255Z { 2024-06-26T07:06:37.3850957Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3851689Z "size": 55728572, 2024-06-26T07:06:37.3853719Z "digest": "sha256:75722010b82e31715876aeeed0b2cee414296f0124fdfa061ab845ba2a158450" 2024-06-26T07:06:37.3854543Z }, 2024-06-26T07:06:37.3854886Z { 2024-06-26T07:06:37.3855463Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3856214Z "size": 186, 2024-06-26T07:06:37.3857217Z "digest": "sha256:d527cbbb87e3016fd72a18a9b468c945ad0ca27c5770b39debd6ed704db3a195" 2024-06-26T07:06:37.3858095Z }, 2024-06-26T07:06:37.3858451Z { 2024-06-26T07:06:37.3859088Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3859917Z "size": 6886, 2024-06-26T07:06:37.3860736Z "digest": "sha256:b57676e46aee1a8c82e528d78e5a13e31142524eea31c8b213d69ddcb6f1fe80" 2024-06-26T07:06:37.3861692Z }, 2024-06-26T07:06:37.3862306Z { 2024-06-26T07:06:37.3862976Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3863839Z "size": 1329001756, 2024-06-26T07:06:37.3864700Z "digest": "sha256:a8c1e85b5e14cec7af70bf304cb4d4cee6a1d25eb8215b2cf4fdc33e5af5e108" 2024-06-26T07:06:37.3865683Z }, 2024-06-26T07:06:37.3866062Z { 2024-06-26T07:06:37.3866712Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3867508Z "size": 62501, 2024-06-26T07:06:37.3868120Z "digest": "sha256:a41a8d1c11c8d80fe4e82b0d05478f8d51176ff20b8350905fc1b25c93a51198" 2024-06-26T07:06:37.3868743Z }, 2024-06-26T07:06:37.3868996Z { 2024-06-26T07:06:37.3869439Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3869997Z "size": 1684, 2024-06-26T07:06:37.3870668Z "digest": "sha256:0c12278907551c2962927d27c115f6f7bf0df894318b8aea6ece3ef01ccd0a8a" 2024-06-26T07:06:37.3871283Z }, 2024-06-26T07:06:37.3871549Z { 2024-06-26T07:06:37.3872002Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3872557Z "size": 1523, 2024-06-26T07:06:37.3873126Z "digest": "sha256:d8d1234baab3ec9ccb8bb710fc6b8ff6c10896ba2e8d27a347583eca770f9ff1" 2024-06-26T07:06:37.3873765Z }, 2024-06-26T07:06:37.3874024Z { 2024-06-26T07:06:37.3874455Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3875022Z "size": 2528295403, 2024-06-26T07:06:37.3875606Z "digest": "sha256:7ed32bc8e4696fcdb2feef850781160597b2275ad756819c4add88236b0577d5" 2024-06-26T07:06:37.3876369Z }, 2024-06-26T07:06:37.3876620Z { 2024-06-26T07:06:37.3877063Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3877621Z "size": 86016, 2024-06-26T07:06:37.3878191Z "digest": "sha256:ec1e7978c1fe161ced1d98092a51e7c5953ca5fda5577f54df9dbda4afff1b2b" 2024-06-26T07:06:37.3878812Z }, 2024-06-26T07:06:37.3879072Z { 2024-06-26T07:06:37.3879518Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3880062Z "size": 1823, 2024-06-26T07:06:37.3880609Z "digest": "sha256:309b872da805fcdf74137a887464876fa0615dc8b24199307119eb65fc2bfb49" 2024-06-26T07:06:37.3881225Z }, 2024-06-26T07:06:37.3881480Z { 2024-06-26T07:06:37.3881911Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3882475Z "size": 246737542, 2024-06-26T07:06:37.3883041Z "digest": "sha256:e82932cb002c06a782077b8e5965f8733eb8563406a23cab260d9d8c4a994f7d" 2024-06-26T07:06:37.3883665Z }, 2024-06-26T07:06:37.3883921Z { 2024-06-26T07:06:37.3884367Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3884927Z "size": 545, 2024-06-26T07:06:37.3885477Z "digest": "sha256:ca9dd73e3e9378225ebdcfd12199ef44649e34fe55003cfbc8afe2e8a4527c5b" 2024-06-26T07:06:37.3886105Z }, 2024-06-26T07:06:37.3886369Z { 2024-06-26T07:06:37.3886807Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3887357Z "size": 1283, 2024-06-26T07:06:37.3887895Z "digest": "sha256:16d76a79d5d6616e228537785ec83a869f68a402520bbc6e826201621ca6cb98" 2024-06-26T07:06:37.3888503Z }, 2024-06-26T07:06:37.3888761Z { 2024-06-26T07:06:37.3889194Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3889747Z "size": 485, 2024-06-26T07:06:37.3890305Z "digest": "sha256:4bdf41c9ecbe1651e0986ccbea4663a0556af27b7145a679cfa45c35dc96b891" 2024-06-26T07:06:37.3890943Z }, 2024-06-26T07:06:37.3891196Z { 2024-06-26T07:06:37.3891635Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3892198Z "size": 91710937, 2024-06-26T07:06:37.3892773Z "digest": "sha256:f4863801e30cdbcd1d4e6cb1cbbcde7dbcaf6ae317ca80429295741ce60ac31d" 2024-06-26T07:06:37.3893408Z }, 2024-06-26T07:06:37.3893666Z { 2024-06-26T07:06:37.3894105Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3894656Z "size": 3233, 2024-06-26T07:06:37.3895274Z "digest": "sha256:d37dd9ed8948a0d02e1198bbedadbca36477a0980dd553196385aab0c025581d" 2024-06-26T07:06:37.3895908Z }, 2024-06-26T07:06:37.3896167Z { 2024-06-26T07:06:37.3896597Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3897372Z "size": 1905, 2024-06-26T07:06:37.3897938Z "digest": "sha256:cf2f34f225dbed17c1a9a8b9ea4ad030aba797774a716dc0a82fe212324aa751" 2024-06-26T07:06:37.3898562Z }, 2024-06-26T07:06:37.3898825Z { 2024-06-26T07:06:37.3899269Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3899830Z "size": 702, 2024-06-26T07:06:37.3900375Z "digest": "sha256:df546d7b3e34396a6f2b51d8c88be976eca017bc99168d838c2c7bacabab9ec4" 2024-06-26T07:06:37.3900997Z }, 2024-06-26T07:06:37.3901256Z { 2024-06-26T07:06:37.3901697Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3902247Z "size": 2784789002, 2024-06-26T07:06:37.3902823Z "digest": "sha256:3d914950f8addfc4d657a2365c76e1143eb80b710cd3f6e9ae05640217fc6347" 2024-06-26T07:06:37.3903445Z }, 2024-06-26T07:06:37.3903709Z { 2024-06-26T07:06:37.3904144Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3904701Z "size": 381, 2024-06-26T07:06:37.3905246Z "digest": "sha256:96d0e2032184c57e62a652aaffcf0241f0d0c7a23e894ca0ad192c4a64a36583" 2024-06-26T07:06:37.3905864Z }, 2024-06-26T07:06:37.3906127Z { 2024-06-26T07:06:37.3906670Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3907231Z "size": 11879, 2024-06-26T07:06:37.3907775Z "digest": "sha256:06e12ce59790cb8b091e5d619c2a62a28329008ee184a8b9a562e3db12471f30" 2024-06-26T07:06:37.3908466Z }, 2024-06-26T07:06:37.3908721Z { 2024-06-26T07:06:37.3909151Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3909690Z "size": 803, 2024-06-26T07:06:37.3910240Z "digest": "sha256:ed712f63cde7070bdec2a6179c4c35e752c6991ddbc69fe9f2724a9903250ceb" 2024-06-26T07:06:37.3910937Z }, 2024-06-26T07:06:37.3911182Z { 2024-06-26T07:06:37.3911613Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3912164Z "size": 106, 2024-06-26T07:06:37.3912707Z "digest": "sha256:a97a71ef8a4e66234dfc2098834f8395ac5630240e60164d1a251fdb0115ba85" 2024-06-26T07:06:37.3913302Z }, 2024-06-26T07:06:37.3913553Z { 2024-06-26T07:06:37.3913988Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3914547Z "size": 503, 2024-06-26T07:06:37.3915080Z "digest": "sha256:25cd0c482ad612f936b35b4f220c580e16be982226aac8801a6a849a6bfdc221" 2024-06-26T07:06:37.3915699Z }, 2024-06-26T07:06:37.3915952Z { 2024-06-26T07:06:37.3916375Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3916937Z "size": 121477177, 2024-06-26T07:06:37.3917502Z "digest": "sha256:9bf94bc456584365fda21d0ed83b7cc690b08a71727b71c4c1e667e15028a386" 2024-06-26T07:06:37.3918118Z }, 2024-06-26T07:06:37.3918362Z { 2024-06-26T07:06:37.3918799Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3919484Z "size": 109, 2024-06-26T07:06:37.3920032Z "digest": "sha256:de45a14c9b227e4b0c9d45d42223b50a71c03522ddd9e2ca0d9517835206c823" 2024-06-26T07:06:37.3920635Z }, 2024-06-26T07:06:37.3920890Z { 2024-06-26T07:06:37.3921323Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3921883Z "size": 491, 2024-06-26T07:06:37.3922410Z "digest": "sha256:e99241e77209b0b35a0fb59a61c0821fc161190178af7e4af45e6eeaa043375e" 2024-06-26T07:06:37.3923023Z }, 2024-06-26T07:06:37.3923275Z { 2024-06-26T07:06:37.3923707Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3924267Z "size": 291, 2024-06-26T07:06:37.3924820Z "digest": "sha256:35e8f4e2a42f9df0c969dedd2199cf71719cf5ecfa676dfa014bbdeb4fdb295f" 2024-06-26T07:06:37.3925437Z }, 2024-06-26T07:06:37.3925788Z { 2024-06-26T07:06:37.3926235Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3926790Z "size": 101, 2024-06-26T07:06:37.3927330Z "digest": "sha256:a823ffa4c541394b52953391dc0a6867e26c37fe4a71fa022a2cc3f07f0ba70d" 2024-06-26T07:06:37.3927938Z }, 2024-06-26T07:06:37.3928195Z { 2024-06-26T07:06:37.3928629Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3929186Z "size": 1473, 2024-06-26T07:06:37.3929722Z "digest": "sha256:44ba272eae2064603605a6238b3f35cc6578859d660068e702a047a9cd8ab2fd" 2024-06-26T07:06:37.3930329Z }, 2024-06-26T07:06:37.3930582Z { 2024-06-26T07:06:37.3931013Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3931567Z "size": 446710781, 2024-06-26T07:06:37.3932138Z "digest": "sha256:da02d278e5240c285bc855ce4e42cd6121d5b903787f5c14f03e575ad1268650" 2024-06-26T07:06:37.3932751Z }, 2024-06-26T07:06:37.3933002Z { 2024-06-26T07:06:37.3933445Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3933995Z "size": 161, 2024-06-26T07:06:37.3934523Z "digest": "sha256:73a0ce681c295135456e190578733273276b38b4dd5babbb39298f384d43b1c6" 2024-06-26T07:06:37.3935117Z }, 2024-06-26T07:06:37.3935378Z { 2024-06-26T07:06:37.3935814Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3936356Z "size": 564, 2024-06-26T07:06:37.3936903Z "digest": "sha256:49737bd5ae709dbf7956e21fc8b05ba009e9e6c9b130b0126a73bd3d3f5efc78" 2024-06-26T07:06:37.3937870Z }, 2024-06-26T07:06:37.3938128Z { 2024-06-26T07:06:37.3938554Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3939111Z "size": 35874600, 2024-06-26T07:06:37.3939677Z "digest": "sha256:9cd4c745f8e4f9d5c9bb8050923575afad21f5b7852975a4a1981bc9eff282c5" 2024-06-26T07:06:37.3940381Z + exit 0 2024-06-26T07:06:37.3940652Z }, 2024-06-26T07:06:37.3940905Z { 2024-06-26T07:06:37.3941335Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3941888Z "size": 104, 2024-06-26T07:06:37.3942413Z "digest": "sha256:b2950a0365345d4c17a48627c905fd8930b3b3154c727f0526eb9ca547102bb7" 2024-06-26T07:06:37.3943007Z }, 2024-06-26T07:06:37.3943258Z { 2024-06-26T07:06:37.3943688Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3944236Z "size": 425, 2024-06-26T07:06:37.3944758Z "digest": "sha256:25e19d81d9fc081962ff4cbc09e098f4035419822712c19a410f5282300dfb9e" 2024-06-26T07:06:37.3945372Z }, 2024-06-26T07:06:37.3945630Z { 2024-06-26T07:06:37.3946061Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3946606Z "size": 20262084, 2024-06-26T07:06:37.3947173Z "digest": "sha256:60156b40fcbec2c25f0170b0a82fa8cd9303e0daae8bb1811fd0fc6562e88e8e" 2024-06-26T07:06:37.3947787Z }, 2024-06-26T07:06:37.3948039Z { 2024-06-26T07:06:37.3948470Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3949019Z "size": 439, 2024-06-26T07:06:37.3949549Z "digest": "sha256:7a868239227fd19b30a19927bbc8f058d247403fe5b343c55f4b4b8987918911" 2024-06-26T07:06:37.3950138Z }, 2024-06-26T07:06:37.3950391Z { 2024-06-26T07:06:37.3950914Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3951460Z "size": 702, 2024-06-26T07:06:37.3951999Z "digest": "sha256:df546d7b3e34396a6f2b51d8c88be976eca017bc99168d838c2c7bacabab9ec4" 2024-06-26T07:06:37.3952626Z }, 2024-06-26T07:06:37.3952879Z { 2024-06-26T07:06:37.3953311Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3953849Z "size": 143, 2024-06-26T07:06:37.3954387Z "digest": "sha256:83911d7c7ecf11b5932bb7449975c52e7f737a5b867691935e1ccb85ceb25b52" 2024-06-26T07:06:37.3954993Z }, 2024-06-26T07:06:37.3955248Z { 2024-06-26T07:06:37.3955672Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3956300Z "size": 135, 2024-06-26T07:06:37.3956853Z "digest": "sha256:b3c5d66c679f58c71febdd502889bd8cd3d36e5001754cdf1e30eabe21135cce" 2024-06-26T07:06:37.3957469Z }, 2024-06-26T07:06:37.3957720Z { 2024-06-26T07:06:37.3958151Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3958708Z "size": 4911495247, 2024-06-26T07:06:37.3959258Z "digest": "sha256:84b2c7a899820f6acdb22148c5e8346d8b26c33269fd01842c9573515251e1e1" 2024-06-26T07:06:37.3959865Z }, 2024-06-26T07:06:37.3960124Z { 2024-06-26T07:06:37.3960554Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3961096Z "size": 190, 2024-06-26T07:06:37.3961647Z "digest": "sha256:c1068d03a811d8dead5da9e82fdc8869205fc4ee9cb92d4f7a4acfbb5ba83950" 2024-06-26T07:06:37.3962270Z }, 2024-06-26T07:06:37.3962516Z { 2024-06-26T07:06:37.3962946Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3963495Z "size": 565, 2024-06-26T07:06:37.3964031Z "digest": "sha256:671b4a301d81074fca17d36851f81801552c4ecb2f90ff3412aa9ab6a1a91371" 2024-06-26T07:06:37.3964627Z }, 2024-06-26T07:06:37.3964877Z { 2024-06-26T07:06:37.3965304Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3965855Z "size": 43163095, 2024-06-26T07:06:37.3966408Z "digest": "sha256:67760cf5ec46ab58d3ca98637fd9b26cb47a67446bfd0db176fe5e023606aa0d" 2024-06-26T07:06:37.3967019Z }, 2024-06-26T07:06:37.3967342Z { 2024-06-26T07:06:37.3967777Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3968319Z "size": 106, 2024-06-26T07:06:37.3968867Z "digest": "sha256:ddc9740bcea2b301e99b50525059aea8d9c7121a1c8eab566561a8968438a8c2" 2024-06-26T07:06:37.3969488Z }, 2024-06-26T07:06:37.3969732Z { 2024-06-26T07:06:37.3970161Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3970712Z "size": 1213, 2024-06-26T07:06:37.3971253Z "digest": "sha256:fb2e977685609fcc01de170ba7f50a573e73e6520e47253717e92a28952c5ee8" 2024-06-26T07:06:37.3971848Z }, 2024-06-26T07:06:37.3972105Z { 2024-06-26T07:06:37.3972536Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3973111Z "size": 702, 2024-06-26T07:06:37.3973648Z "digest": "sha256:df546d7b3e34396a6f2b51d8c88be976eca017bc99168d838c2c7bacabab9ec4" 2024-06-26T07:06:37.3974264Z }, 2024-06-26T07:06:37.3974521Z { 2024-06-26T07:06:37.3974953Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3975505Z "size": 138, 2024-06-26T07:06:37.3976056Z "digest": "sha256:b599c5a8c7cb461cbd7b3c98b99960b8eb04506e05e79db1cc0cfadb14a47e91" 2024-06-26T07:06:37.3976671Z }, 2024-06-26T07:06:37.3976916Z { 2024-06-26T07:06:37.3977554Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3978105Z "size": 120, 2024-06-26T07:06:37.3978661Z "digest": "sha256:e08e88c1366827455ee7ddbf92b6ae615ceb3cbd3fb11cd03ddd31bd3fa94a9c" 2024-06-26T07:06:37.3979271Z }, 2024-06-26T07:06:37.3979527Z { 2024-06-26T07:06:37.3979959Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3980515Z "size": 1904157495, 2024-06-26T07:06:37.3981084Z "digest": "sha256:12ba7431ff38de8cf6af3052a2a52e79f4e712b8c99f5bafde3c20e63b1f570f" 2024-06-26T07:06:37.3981707Z }, 2024-06-26T07:06:37.3981962Z { 2024-06-26T07:06:37.3982386Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3982947Z "size": 172, 2024-06-26T07:06:37.3983494Z "digest": "sha256:cf7c2cb896cba6a594028cc0fd246e127a2f4481d48905a3aa12c5f5872332d4" 2024-06-26T07:06:37.3984111Z }, 2024-06-26T07:06:37.3984362Z { 2024-06-26T07:06:37.3984793Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3985342Z "size": 908, 2024-06-26T07:06:37.3985894Z "digest": "sha256:3a778ddfac2af5b3a11f49ddf2f3f1ad1731f74ba691f434ab69966d1e2a189f" 2024-06-26T07:06:37.3986608Z }, 2024-06-26T07:06:37.3986868Z { 2024-06-26T07:06:37.3987303Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3987854Z "size": 702, 2024-06-26T07:06:37.3988395Z "digest": "sha256:df546d7b3e34396a6f2b51d8c88be976eca017bc99168d838c2c7bacabab9ec4" 2024-06-26T07:06:37.3989013Z }, 2024-06-26T07:06:37.3989268Z { 2024-06-26T07:06:37.3989696Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3990251Z "size": 134, 2024-06-26T07:06:37.3990892Z "digest": "sha256:236c8f0245f4b40616a4322eaf1e1b3e178d5990db1fcaba39622ea4e79c06a1" 2024-06-26T07:06:37.3991503Z }, 2024-06-26T07:06:37.3991752Z { 2024-06-26T07:06:37.3992186Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3992740Z "size": 32, 2024-06-26T07:06:37.3993288Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-06-26T07:06:37.3993898Z }, 2024-06-26T07:06:37.3994159Z { 2024-06-26T07:06:37.3994592Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3995134Z "size": 156, 2024-06-26T07:06:37.3995683Z "digest": "sha256:dda1ce302b9a9df0c8f1145d2e3eaa03c96909bb45a792451f1fcb555b06738d" 2024-06-26T07:06:37.3996306Z }, 2024-06-26T07:06:37.3996559Z { 2024-06-26T07:06:37.3996983Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.3997530Z "size": 1841, 2024-06-26T07:06:37.3998156Z "digest": "sha256:e797fe86caef19319e03f8dca92cf96838ab3bb3644f4447c6dfc04230118afa" 2024-06-26T07:06:37.3998774Z }, 2024-06-26T07:06:37.3999022Z { 2024-06-26T07:06:37.3999458Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.4000015Z "size": 7529784, 2024-06-26T07:06:37.4000569Z "digest": "sha256:967190076fc0ab2bb2fc0d74e58edd3d662a537d702ff3f8b6e876230154a16f" 2024-06-26T07:06:37.4001174Z }, 2024-06-26T07:06:37.4001427Z { 2024-06-26T07:06:37.4001865Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.4002411Z "size": 165, 2024-06-26T07:06:37.4002953Z "digest": "sha256:4fb0a83f06855534ef82b80dcf7c685303edb2bcbd446196066dc2ad2dd71281" 2024-06-26T07:06:37.4003565Z }, 2024-06-26T07:06:37.4003819Z { 2024-06-26T07:06:37.4004244Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.4004797Z "size": 7944, 2024-06-26T07:06:37.4005345Z "digest": "sha256:68af2ec4e30a33f26947ece9f3a31b7d3b04c2bca5865d4b48618457832a1da2" 2024-06-26T07:06:37.4005970Z }, 2024-06-26T07:06:37.4006219Z { 2024-06-26T07:06:37.4006654Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.4007201Z "size": 8070, 2024-06-26T07:06:37.4007736Z "digest": "sha256:cc91933e985a044c6df53caa15488d2285896f5e991f38ec068c253ceec53f14" 2024-06-26T07:06:37.4008345Z }, 2024-06-26T07:06:37.4008596Z { 2024-06-26T07:06:37.4009032Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.4009574Z "size": 303, 2024-06-26T07:06:37.4010120Z "digest": "sha256:9f3187916e7dcad33cc572f8f0e949d2f507b887f99cfd6acefd14826b44960d" 2024-06-26T07:06:37.4010735Z }, 2024-06-26T07:06:37.4010993Z { 2024-06-26T07:06:37.4011417Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.4011970Z "size": 7629071, 2024-06-26T07:06:37.4012504Z "digest": "sha256:52608399485738d10d779254946c9e1d536010dd45593c69bf1eb9f62f85dc24" 2024-06-26T07:06:37.4013100Z }, 2024-06-26T07:06:37.4013349Z { 2024-06-26T07:06:37.4013779Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.4014325Z "size": 108, 2024-06-26T07:06:37.4014864Z "digest": "sha256:05a6f6dcc1c00bac6660923a22adc7d7c34416718f8c89daf9b3351d9365f694" 2024-06-26T07:06:37.4015486Z }, 2024-06-26T07:06:37.4015740Z { 2024-06-26T07:06:37.4016174Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.4016812Z "size": 54145775, 2024-06-26T07:06:37.4017583Z "digest": "sha256:6bc9dc8315b09b27c976bfba9700767ba412d72fd0528b18bbe8f8e62005ec22" 2024-06-26T07:06:37.4018203Z }, 2024-06-26T07:06:37.4018458Z { 2024-06-26T07:06:37.4018885Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.4019430Z "size": 474, 2024-06-26T07:06:37.4019971Z "digest": "sha256:1b0e27c35f07b3fbf0aeb548d1949bf1d60a420136da21789d94d196c891d981" 2024-06-26T07:06:37.4020582Z }, 2024-06-26T07:06:37.4020835Z { 2024-06-26T07:06:37.4021264Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.4021808Z "size": 1374858747, 2024-06-26T07:06:37.4022354Z "digest": "sha256:95237e7311a1c5ce6937db7196c866632f44e8788514a5c0eb4a3f04da4017e6" 2024-06-26T07:06:37.4022951Z }, 2024-06-26T07:06:37.4023203Z { 2024-06-26T07:06:37.4023634Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.4024171Z "size": 106, 2024-06-26T07:06:37.4024725Z "digest": "sha256:789eff6c51aada70bf75eb1acafed63c0d839b768638001500616ff6e53b854a" 2024-06-26T07:06:37.4025342Z }, 2024-06-26T07:06:37.4025594Z { 2024-06-26T07:06:37.4026018Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.4026567Z "size": 558, 2024-06-26T07:06:37.4027116Z "digest": "sha256:de0f8a8c45c6077b3c5ba3b84d7f07de98353fd618dad9a1e2f368ffe00493c7" 2024-06-26T07:06:37.4027729Z }, 2024-06-26T07:06:37.4028064Z { 2024-06-26T07:06:37.4028496Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.4029048Z "size": 46248513, 2024-06-26T07:06:37.4029595Z "digest": "sha256:2060028f74888d218bebdd10d723f66c33ee1c708935c4ffd4654d34912ac4dc" 2024-06-26T07:06:37.4030196Z }, 2024-06-26T07:06:37.4030544Z { 2024-06-26T07:06:37.4030983Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.4031521Z "size": 111, 2024-06-26T07:06:37.4032063Z "digest": "sha256:e412c7f3b2ded440992955bd92512345cbece8a8894cd3592f714ebc758ad1a0" 2024-06-26T07:06:37.4032671Z }, 2024-06-26T07:06:37.4032915Z { 2024-06-26T07:06:37.4033347Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.4033897Z "size": 32, 2024-06-26T07:06:37.4034443Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-06-26T07:06:37.4035051Z }, 2024-06-26T07:06:37.4035305Z { 2024-06-26T07:06:37.4035738Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.4036292Z "size": 32, 2024-06-26T07:06:37.4036823Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-06-26T07:06:37.4037442Z }, 2024-06-26T07:06:37.4037695Z { 2024-06-26T07:06:37.4038126Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.4038668Z "size": 32, 2024-06-26T07:06:37.4039216Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-06-26T07:06:37.4039829Z }, 2024-06-26T07:06:37.4040078Z { 2024-06-26T07:06:37.4040509Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T07:06:37.4041059Z "size": 32, 2024-06-26T07:06:37.4041596Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-06-26T07:06:37.4042195Z } 2024-06-26T07:06:37.4042450Z ] 2024-06-26T07:06:37.4042702Z } 2024-06-26T07:06:37.4157030Z ##[group]Run tag=${ECR_DOCKER_IMAGE##*/} 2024-06-26T07:06:37.4157541Z tag=${ECR_DOCKER_IMAGE##*/} 2024-06-26T07:06:37.4158103Z echo "docker pull ghcr.io/pytorch/ci-image:${tag/:/-}" 2024-06-26T07:06:37.4166131Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:06:37.4166640Z env: 2024-06-26T07:06:37.4166929Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:06:37.4168075Z ECR_DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:06:37.4169273Z ##[endgroup] 2024-06-26T07:06:37.4192469Z docker pull ghcr.io/pytorch/ci-image:pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks-91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:06:37.4239935Z ##[group]Run pytorch/test-infra/.github/actions/pull-docker-image@main 2024-06-26T07:06:37.4240510Z with: 2024-06-26T07:06:37.4241576Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:06:37.4242884Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:06:37.4243406Z env: 2024-06-26T07:06:37.4243700Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:06:37.4244094Z ##[endgroup] 2024-06-26T07:06:37.4259785Z ##[group]Run set -x 2024-06-26T07:06:37.4260131Z set -x 2024-06-26T07:06:37.4260439Z set +e 2024-06-26T07:06:37.4260737Z  2024-06-26T07:06:37.4261024Z login() { 2024-06-26T07:06:37.4261683Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2024-06-26T07:06:37.4262395Z } 2024-06-26T07:06:37.4262678Z  2024-06-26T07:06:37.4263000Z retry () { 2024-06-26T07:06:37.4263404Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2024-06-26T07:06:37.4263852Z } 2024-06-26T07:06:37.4264167Z  2024-06-26T07:06:37.4264516Z retry login "${DOCKER_REGISTRY}" 2024-06-26T07:06:37.4265048Z  2024-06-26T07:06:37.4265339Z set -e 2024-06-26T07:06:37.4265821Z # ignore output since only exit code is used for conditional 2024-06-26T07:06:37.4266530Z # only pull docker image if it's not available locally 2024-06-26T07:06:37.4267297Z if ! docker inspect --type=image "${DOCKER_IMAGE}" >/dev/null 2>/dev/null; then 2024-06-26T07:06:37.4268008Z  retry docker pull "${DOCKER_IMAGE}" 2024-06-26T07:06:37.4268465Z fi 2024-06-26T07:06:37.4275252Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:06:37.4275757Z env: 2024-06-26T07:06:37.4276054Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:06:37.4277204Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:06:37.4278514Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:06:37.4279047Z ##[endgroup] 2024-06-26T07:06:37.4298555Z + set +e 2024-06-26T07:06:37.4299676Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:06:37.4301081Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:06:37.4302382Z + aws ecr get-login-password --region us-east-1 2024-06-26T07:06:37.4303886Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T07:06:37.8381953Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-06-26T07:06:37.8383004Z Configure a credential helper to remove this warning. See 2024-06-26T07:06:37.8383877Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-06-26T07:06:37.8384413Z 2024-06-26T07:06:37.8384550Z Login Succeeded 2024-06-26T07:06:37.8393143Z + set -e 2024-06-26T07:06:37.8394523Z + docker inspect --type=image 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:06:37.8513315Z + retry docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:06:37.8515426Z + docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:06:38.0625985Z 91382da70d5719cd7007b6b80b71d2f48398f6b7: Pulling from pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks 2024-06-26T07:06:38.0629164Z 7a2c55901189: Pulling fs layer 2024-06-26T07:06:38.0630190Z 224fe954d725: Pulling fs layer 2024-06-26T07:06:38.0631570Z 75722010b82e: Pulling fs layer 2024-06-26T07:06:38.0632284Z d527cbbb87e3: Pulling fs layer 2024-06-26T07:06:38.0632856Z b57676e46aee: Pulling fs layer 2024-06-26T07:06:38.0633405Z a8c1e85b5e14: Pulling fs layer 2024-06-26T07:06:38.0633985Z a41a8d1c11c8: Pulling fs layer 2024-06-26T07:06:38.0634578Z 0c1227890755: Pulling fs layer 2024-06-26T07:06:38.0635126Z d8d1234baab3: Pulling fs layer 2024-06-26T07:06:38.0635669Z 7ed32bc8e469: Pulling fs layer 2024-06-26T07:06:38.0636218Z ec1e7978c1fe: Pulling fs layer 2024-06-26T07:06:38.0636762Z 309b872da805: Pulling fs layer 2024-06-26T07:06:38.0637317Z e82932cb002c: Pulling fs layer 2024-06-26T07:06:38.0637861Z ca9dd73e3e93: Pulling fs layer 2024-06-26T07:06:38.0638404Z 16d76a79d5d6: Pulling fs layer 2024-06-26T07:06:38.0638934Z 0c1227890755: Waiting 2024-06-26T07:06:38.0639492Z 4bdf41c9ecbe: Pulling fs layer 2024-06-26T07:06:38.0640049Z f4863801e30c: Pulling fs layer 2024-06-26T07:06:38.0640575Z d8d1234baab3: Waiting 2024-06-26T07:06:38.0641041Z d37dd9ed8948: Pulling fs layer 2024-06-26T07:06:38.0641531Z cf2f34f225db: Pulling fs layer 2024-06-26T07:06:38.0641925Z df546d7b3e34: Pulling fs layer 2024-06-26T07:06:38.0642309Z 3d914950f8ad: Pulling fs layer 2024-06-26T07:06:38.0642689Z 96d0e2032184: Pulling fs layer 2024-06-26T07:06:38.0643372Z 06e12ce59790: Pulling fs layer 2024-06-26T07:06:38.0643818Z ed712f63cde7: Pulling fs layer 2024-06-26T07:06:38.0644209Z a97a71ef8a4e: Pulling fs layer 2024-06-26T07:06:38.0644651Z 25cd0c482ad6: Pulling fs layer 2024-06-26T07:06:38.0645043Z 9bf94bc45658: Pulling fs layer 2024-06-26T07:06:38.0645422Z de45a14c9b22: Pulling fs layer 2024-06-26T07:06:38.0645798Z e99241e77209: Pulling fs layer 2024-06-26T07:06:38.0646164Z 35e8f4e2a42f: Pulling fs layer 2024-06-26T07:06:38.0646539Z a823ffa4c541: Pulling fs layer 2024-06-26T07:06:38.0647028Z 44ba272eae20: Pulling fs layer 2024-06-26T07:06:38.0647519Z b57676e46aee: Waiting 2024-06-26T07:06:38.0647967Z da02d278e524: Pulling fs layer 2024-06-26T07:06:38.0648482Z 73a0ce681c29: Pulling fs layer 2024-06-26T07:06:38.0648966Z ec1e7978c1fe: Waiting 2024-06-26T07:06:38.0649409Z 49737bd5ae70: Pulling fs layer 2024-06-26T07:06:38.0649919Z 9cd4c745f8e4: Pulling fs layer 2024-06-26T07:06:38.0650425Z b2950a036534: Pulling fs layer 2024-06-26T07:06:38.0650799Z 309b872da805: Waiting 2024-06-26T07:06:38.0651111Z f4863801e30c: Waiting 2024-06-26T07:06:38.0651430Z 7ed32bc8e469: Waiting 2024-06-26T07:06:38.0651768Z 25e19d81d9fc: Pulling fs layer 2024-06-26T07:06:38.0652153Z 60156b40fcbe: Pulling fs layer 2024-06-26T07:06:38.0652508Z d527cbbb87e3: Waiting 2024-06-26T07:06:38.0652829Z e82932cb002c: Waiting 2024-06-26T07:06:38.0653163Z 7a868239227f: Pulling fs layer 2024-06-26T07:06:38.0653516Z df546d7b3e34: Waiting 2024-06-26T07:06:38.0653838Z d37dd9ed8948: Waiting 2024-06-26T07:06:38.0654156Z 25cd0c482ad6: Waiting 2024-06-26T07:06:38.0654491Z 83911d7c7ecf: Pulling fs layer 2024-06-26T07:06:38.0654846Z cf2f34f225db: Waiting 2024-06-26T07:06:38.0655163Z 96d0e2032184: Waiting 2024-06-26T07:06:38.0655496Z b3c5d66c679f: Pulling fs layer 2024-06-26T07:06:38.0655895Z 84b2c7a89982: Pulling fs layer 2024-06-26T07:06:38.0656278Z c1068d03a811: Pulling fs layer 2024-06-26T07:06:38.0656630Z a97a71ef8a4e: Waiting 2024-06-26T07:06:38.0657229Z 06e12ce59790: Waiting 2024-06-26T07:06:38.0657585Z 671b4a301d81: Pulling fs layer 2024-06-26T07:06:38.0657954Z 67760cf5ec46: Pulling fs layer 2024-06-26T07:06:38.0658313Z ed712f63cde7: Waiting 2024-06-26T07:06:38.0658635Z a8c1e85b5e14: Waiting 2024-06-26T07:06:38.0658975Z ddc9740bcea2: Pulling fs layer 2024-06-26T07:06:38.0659346Z fb2e97768560: Pulling fs layer 2024-06-26T07:06:38.0659710Z ca9dd73e3e93: Waiting 2024-06-26T07:06:38.0660046Z b599c5a8c7cb: Pulling fs layer 2024-06-26T07:06:38.0660409Z 49737bd5ae70: Waiting 2024-06-26T07:06:38.0660738Z e08e88c13668: Pulling fs layer 2024-06-26T07:06:38.0661116Z 12ba7431ff38: Pulling fs layer 2024-06-26T07:06:38.0661476Z e99241e77209: Waiting 2024-06-26T07:06:38.0661803Z cf7c2cb896cb: Pulling fs layer 2024-06-26T07:06:38.0662296Z 3d914950f8ad: Waiting 2024-06-26T07:06:38.0662622Z a41a8d1c11c8: Waiting 2024-06-26T07:06:38.0662962Z 3a778ddfac2a: Pulling fs layer 2024-06-26T07:06:38.0663324Z 4bdf41c9ecbe: Waiting 2024-06-26T07:06:38.0663659Z 236c8f0245f4: Pulling fs layer 2024-06-26T07:06:38.0664024Z 16d76a79d5d6: Waiting 2024-06-26T07:06:38.0664334Z 35e8f4e2a42f: Waiting 2024-06-26T07:06:38.0664671Z 4f4fb700ef54: Pulling fs layer 2024-06-26T07:06:38.0665052Z dda1ce302b9a: Pulling fs layer 2024-06-26T07:06:38.0665435Z e797fe86caef: Pulling fs layer 2024-06-26T07:06:38.0665801Z 967190076fc0: Pulling fs layer 2024-06-26T07:06:38.0666173Z 4fb0a83f0685: Pulling fs layer 2024-06-26T07:06:38.0666553Z 68af2ec4e30a: Pulling fs layer 2024-06-26T07:06:38.0666927Z cc91933e985a: Pulling fs layer 2024-06-26T07:06:38.0667295Z 9f3187916e7d: Pulling fs layer 2024-06-26T07:06:38.0667656Z 526083994857: Pulling fs layer 2024-06-26T07:06:38.0668020Z 05a6f6dcc1c0: Pulling fs layer 2024-06-26T07:06:38.0668370Z c1068d03a811: Waiting 2024-06-26T07:06:38.0668703Z ddc9740bcea2: Waiting 2024-06-26T07:06:38.0669043Z 6bc9dc8315b0: Pulling fs layer 2024-06-26T07:06:38.0669419Z 1b0e27c35f07: Pulling fs layer 2024-06-26T07:06:38.0669786Z 95237e7311a1: Pulling fs layer 2024-06-26T07:06:38.0670140Z fb2e97768560: Waiting 2024-06-26T07:06:38.0670618Z b3c5d66c679f: Waiting 2024-06-26T07:06:38.0670949Z 789eff6c51aa: Pulling fs layer 2024-06-26T07:06:38.0671310Z de0f8a8c45c6: Pulling fs layer 2024-06-26T07:06:38.0671674Z 2060028f7488: Pulling fs layer 2024-06-26T07:06:38.0672022Z 67760cf5ec46: Waiting 2024-06-26T07:06:38.0672330Z 671b4a301d81: Waiting 2024-06-26T07:06:38.0672645Z 44ba272eae20: Waiting 2024-06-26T07:06:38.0672961Z da02d278e524: Waiting 2024-06-26T07:06:38.0673295Z e412c7f3b2de: Pulling fs layer 2024-06-26T07:06:38.0673647Z b2950a036534: Waiting 2024-06-26T07:06:38.0673964Z 7a868239227f: Waiting 2024-06-26T07:06:38.0674277Z 60156b40fcbe: Waiting 2024-06-26T07:06:38.0674586Z 84b2c7a89982: Waiting 2024-06-26T07:06:38.0674905Z b599c5a8c7cb: Waiting 2024-06-26T07:06:38.0675232Z e797fe86caef: Waiting 2024-06-26T07:06:38.0675539Z 236c8f0245f4: Waiting 2024-06-26T07:06:38.0675839Z 4f4fb700ef54: Waiting 2024-06-26T07:06:38.0676157Z dda1ce302b9a: Waiting 2024-06-26T07:06:38.0676475Z e08e88c13668: Waiting 2024-06-26T07:06:38.0676794Z 967190076fc0: Waiting 2024-06-26T07:06:38.0677102Z 789eff6c51aa: Waiting 2024-06-26T07:06:38.0677416Z 12ba7431ff38: Waiting 2024-06-26T07:06:38.0677731Z 9cd4c745f8e4: Waiting 2024-06-26T07:06:38.0678038Z 4fb0a83f0685: Waiting 2024-06-26T07:06:38.0678350Z cc91933e985a: Waiting 2024-06-26T07:06:38.0678659Z 9f3187916e7d: Waiting 2024-06-26T07:06:38.0678962Z 2060028f7488: Waiting 2024-06-26T07:06:38.0679258Z 526083994857: Waiting 2024-06-26T07:06:38.0679567Z 05a6f6dcc1c0: Waiting 2024-06-26T07:06:38.0679885Z a823ffa4c541: Waiting 2024-06-26T07:06:38.0680193Z 6bc9dc8315b0: Waiting 2024-06-26T07:06:38.0680509Z 95237e7311a1: Waiting 2024-06-26T07:06:38.0680824Z 1b0e27c35f07: Waiting 2024-06-26T07:06:38.0681147Z 68af2ec4e30a: Waiting 2024-06-26T07:06:38.0681456Z 3a778ddfac2a: Waiting 2024-06-26T07:06:38.0681774Z de0f8a8c45c6: Waiting 2024-06-26T07:06:38.0682091Z 25e19d81d9fc: Waiting 2024-06-26T07:06:38.0682409Z 9bf94bc45658: Waiting 2024-06-26T07:06:38.0682717Z cf7c2cb896cb: Waiting 2024-06-26T07:06:38.0683034Z e412c7f3b2de: Waiting 2024-06-26T07:06:38.1987804Z 224fe954d725: Verifying Checksum 2024-06-26T07:06:38.1988469Z 224fe954d725: Download complete 2024-06-26T07:06:38.2713984Z d527cbbb87e3: Verifying Checksum 2024-06-26T07:06:38.2714639Z d527cbbb87e3: Download complete 2024-06-26T07:06:38.3502269Z b57676e46aee: Verifying Checksum 2024-06-26T07:06:38.3502796Z b57676e46aee: Download complete 2024-06-26T07:06:38.4104867Z 7a2c55901189: Verifying Checksum 2024-06-26T07:06:38.4105469Z 7a2c55901189: Download complete 2024-06-26T07:06:38.4894467Z a41a8d1c11c8: Download complete 2024-06-26T07:06:38.5685786Z 0c1227890755: Verifying Checksum 2024-06-26T07:06:38.6402719Z d8d1234baab3: Verifying Checksum 2024-06-26T07:06:38.6403217Z d8d1234baab3: Download complete 2024-06-26T07:06:38.6873965Z 75722010b82e: Verifying Checksum 2024-06-26T07:06:38.6874568Z 75722010b82e: Download complete 2024-06-26T07:06:38.7716048Z ec1e7978c1fe: Download complete 2024-06-26T07:06:38.8571892Z 309b872da805: Verifying Checksum 2024-06-26T07:06:38.8572341Z 309b872da805: Download complete 2024-06-26T07:06:39.4318892Z 7a2c55901189: Pull complete 2024-06-26T07:06:39.7104293Z 224fe954d725: Pull complete 2024-06-26T07:06:40.7005349Z 75722010b82e: Pull complete 2024-06-26T07:06:40.7478692Z d527cbbb87e3: Pull complete 2024-06-26T07:06:40.8083296Z b57676e46aee: Pull complete 2024-06-26T07:06:41.3842555Z e82932cb002c: Verifying Checksum 2024-06-26T07:06:41.3843135Z e82932cb002c: Download complete 2024-06-26T07:06:41.4670795Z ca9dd73e3e93: Verifying Checksum 2024-06-26T07:06:41.4671376Z ca9dd73e3e93: Download complete 2024-06-26T07:06:41.5478993Z 16d76a79d5d6: Download complete 2024-06-26T07:06:41.6276906Z 4bdf41c9ecbe: Verifying Checksum 2024-06-26T07:06:41.6277497Z 4bdf41c9ecbe: Download complete 2024-06-26T07:06:42.5948007Z f4863801e30c: Verifying Checksum 2024-06-26T07:06:42.5948606Z f4863801e30c: Download complete 2024-06-26T07:06:42.6788810Z d37dd9ed8948: Download complete 2024-06-26T07:06:42.7558291Z cf2f34f225db: Verifying Checksum 2024-06-26T07:06:42.7559018Z cf2f34f225db: Download complete 2024-06-26T07:06:42.8391940Z df546d7b3e34: Verifying Checksum 2024-06-26T07:06:42.8392384Z df546d7b3e34: Download complete 2024-06-26T07:06:51.7039647Z a8c1e85b5e14: Verifying Checksum 2024-06-26T07:06:51.7040138Z a8c1e85b5e14: Download complete 2024-06-26T07:06:51.7860368Z 96d0e2032184: Verifying Checksum 2024-06-26T07:06:51.7860977Z 96d0e2032184: Download complete 2024-06-26T07:06:51.8617529Z 06e12ce59790: Verifying Checksum 2024-06-26T07:06:51.8618538Z 06e12ce59790: Download complete 2024-06-26T07:06:51.9444922Z ed712f63cde7: Verifying Checksum 2024-06-26T07:06:51.9445492Z ed712f63cde7: Download complete 2024-06-26T07:06:52.0520850Z a97a71ef8a4e: Verifying Checksum 2024-06-26T07:06:52.0521457Z a97a71ef8a4e: Download complete 2024-06-26T07:06:52.1275189Z 25cd0c482ad6: Verifying Checksum 2024-06-26T07:06:52.1275773Z 25cd0c482ad6: Download complete 2024-06-26T07:06:53.4024433Z 9bf94bc45658: Download complete 2024-06-26T07:06:53.5135738Z de45a14c9b22: Verifying Checksum 2024-06-26T07:06:53.5136262Z de45a14c9b22: Download complete 2024-06-26T07:06:53.6036950Z e99241e77209: Verifying Checksum 2024-06-26T07:06:53.6037524Z e99241e77209: Download complete 2024-06-26T07:06:53.6693712Z 35e8f4e2a42f: Verifying Checksum 2024-06-26T07:06:53.6694305Z 35e8f4e2a42f: Download complete 2024-06-26T07:06:53.7776875Z a823ffa4c541: Verifying Checksum 2024-06-26T07:06:53.7777572Z a823ffa4c541: Download complete 2024-06-26T07:06:53.8624711Z 44ba272eae20: Verifying Checksum 2024-06-26T07:06:53.8625157Z 44ba272eae20: Download complete 2024-06-26T07:06:58.3910590Z da02d278e524: Verifying Checksum 2024-06-26T07:06:58.3911122Z da02d278e524: Download complete 2024-06-26T07:06:58.4721459Z 73a0ce681c29: Verifying Checksum 2024-06-26T07:06:58.4722019Z 73a0ce681c29: Download complete 2024-06-26T07:06:58.5830097Z 49737bd5ae70: Verifying Checksum 2024-06-26T07:06:58.5830728Z 49737bd5ae70: Download complete 2024-06-26T07:06:59.0007173Z 9cd4c745f8e4: Verifying Checksum 2024-06-26T07:06:59.0007696Z 9cd4c745f8e4: Download complete 2024-06-26T07:06:59.0715042Z b2950a036534: Download complete 2024-06-26T07:06:59.1470007Z 25e19d81d9fc: Verifying Checksum 2024-06-26T07:06:59.1470552Z 25e19d81d9fc: Download complete 2024-06-26T07:06:59.4317815Z 60156b40fcbe: Verifying Checksum 2024-06-26T07:06:59.4318321Z 60156b40fcbe: Download complete 2024-06-26T07:06:59.5123346Z 7a868239227f: Download complete 2024-06-26T07:06:59.5924206Z 83911d7c7ecf: Download complete 2024-06-26T07:06:59.6726076Z b3c5d66c679f: Verifying Checksum 2024-06-26T07:06:59.6726631Z b3c5d66c679f: Download complete 2024-06-26T07:07:04.0774701Z 7ed32bc8e469: Verifying Checksum 2024-06-26T07:07:04.0775232Z 7ed32bc8e469: Download complete 2024-06-26T07:07:04.1588064Z c1068d03a811: Download complete 2024-06-26T07:07:04.2431568Z 671b4a301d81: Verifying Checksum 2024-06-26T07:07:04.2432045Z 671b4a301d81: Download complete 2024-06-26T07:07:04.4233944Z a8c1e85b5e14: Pull complete 2024-06-26T07:07:04.6515605Z a41a8d1c11c8: Pull complete 2024-06-26T07:07:04.7420990Z 67760cf5ec46: Verifying Checksum 2024-06-26T07:07:04.7421460Z 67760cf5ec46: Download complete 2024-06-26T07:07:04.8120896Z ddc9740bcea2: Download complete 2024-06-26T07:07:04.8963535Z 0c1227890755: Pull complete 2024-06-26T07:07:04.9239095Z fb2e97768560: Verifying Checksum 2024-06-26T07:07:05.0063524Z b599c5a8c7cb: Verifying Checksum 2024-06-26T07:07:05.0063967Z b599c5a8c7cb: Download complete 2024-06-26T07:07:05.0816753Z e08e88c13668: Download complete 2024-06-26T07:07:05.1323079Z d8d1234baab3: Pull complete 2024-06-26T07:07:10.7494763Z 3d914950f8ad: Verifying Checksum 2024-06-26T07:07:10.7495329Z 3d914950f8ad: Download complete 2024-06-26T07:07:10.8365300Z cf7c2cb896cb: Download complete 2024-06-26T07:07:10.9074141Z 3a778ddfac2a: Verifying Checksum 2024-06-26T07:07:10.9074832Z 3a778ddfac2a: Download complete 2024-06-26T07:07:10.9827391Z 236c8f0245f4: Verifying Checksum 2024-06-26T07:07:10.9827954Z 236c8f0245f4: Download complete 2024-06-26T07:07:10.9923664Z 4f4fb700ef54: Verifying Checksum 2024-06-26T07:07:10.9925160Z 4f4fb700ef54: Download complete 2024-06-26T07:07:11.0727044Z dda1ce302b9a: Verifying Checksum 2024-06-26T07:07:11.0727589Z dda1ce302b9a: Download complete 2024-06-26T07:07:11.1780886Z e797fe86caef: Verifying Checksum 2024-06-26T07:07:11.1782636Z e797fe86caef: Download complete 2024-06-26T07:07:11.4470773Z 967190076fc0: Verifying Checksum 2024-06-26T07:07:11.4471288Z 967190076fc0: Download complete 2024-06-26T07:07:11.5217583Z 4fb0a83f0685: Verifying Checksum 2024-06-26T07:07:11.5218125Z 4fb0a83f0685: Download complete 2024-06-26T07:07:11.5989637Z 68af2ec4e30a: Download complete 2024-06-26T07:07:11.6725854Z cc91933e985a: Download complete 2024-06-26T07:07:11.7415347Z 9f3187916e7d: Download complete 2024-06-26T07:07:11.8714370Z 526083994857: Verifying Checksum 2024-06-26T07:07:11.8714980Z 526083994857: Download complete 2024-06-26T07:07:11.9563050Z 05a6f6dcc1c0: Verifying Checksum 2024-06-26T07:07:11.9563607Z 05a6f6dcc1c0: Download complete 2024-06-26T07:07:12.5486678Z 6bc9dc8315b0: Verifying Checksum 2024-06-26T07:07:12.5487322Z 6bc9dc8315b0: Download complete 2024-06-26T07:07:12.6267480Z 1b0e27c35f07: Verifying Checksum 2024-06-26T07:07:12.6268171Z 1b0e27c35f07: Download complete 2024-06-26T07:07:34.6582886Z 12ba7431ff38: Verifying Checksum 2024-06-26T07:07:34.6583373Z 12ba7431ff38: Download complete 2024-06-26T07:07:34.7462850Z 789eff6c51aa: Download complete 2024-06-26T07:07:34.8236010Z de0f8a8c45c6: Download complete 2024-06-26T07:07:36.0944337Z 2060028f7488: Verifying Checksum 2024-06-26T07:07:36.0944835Z 2060028f7488: Download complete 2024-06-26T07:07:36.1682619Z e412c7f3b2de: Verifying Checksum 2024-06-26T07:07:36.1683080Z e412c7f3b2de: Download complete 2024-06-26T07:07:40.5051056Z 95237e7311a1: Verifying Checksum 2024-06-26T07:07:40.5051563Z 95237e7311a1: Download complete 2024-06-26T07:08:02.1919540Z 84b2c7a89982: Verifying Checksum 2024-06-26T07:08:02.1920084Z 84b2c7a89982: Download complete 2024-06-26T07:08:20.6908428Z 7ed32bc8e469: Pull complete 2024-06-26T07:08:20.9252452Z ec1e7978c1fe: Pull complete 2024-06-26T07:08:21.1516022Z 309b872da805: Pull complete 2024-06-26T07:08:28.4427720Z e82932cb002c: Pull complete 2024-06-26T07:08:28.6646045Z ca9dd73e3e93: Pull complete 2024-06-26T07:08:28.8856739Z 16d76a79d5d6: Pull complete 2024-06-26T07:08:29.1019542Z 4bdf41c9ecbe: Pull complete 2024-06-26T07:08:31.4849453Z f4863801e30c: Pull complete 2024-06-26T07:08:31.7041720Z d37dd9ed8948: Pull complete 2024-06-26T07:08:31.9265611Z cf2f34f225db: Pull complete 2024-06-26T07:08:32.1392457Z df546d7b3e34: Pull complete 2024-06-26T07:09:21.3024219Z 3d914950f8ad: Pull complete 2024-06-26T07:09:21.5227809Z 96d0e2032184: Pull complete 2024-06-26T07:09:21.7338696Z 06e12ce59790: Pull complete 2024-06-26T07:09:21.9349879Z ed712f63cde7: Pull complete 2024-06-26T07:09:22.0634103Z a97a71ef8a4e: Pull complete 2024-06-26T07:09:22.1541152Z 25cd0c482ad6: Pull complete 2024-06-26T07:09:25.4754485Z 9bf94bc45658: Pull complete 2024-06-26T07:09:25.5942111Z de45a14c9b22: Pull complete 2024-06-26T07:09:25.6877856Z e99241e77209: Pull complete 2024-06-26T07:09:25.7957031Z 35e8f4e2a42f: Pull complete 2024-06-26T07:09:25.9059616Z a823ffa4c541: Pull complete 2024-06-26T07:09:26.1156871Z 44ba272eae20: Pull complete 2024-06-26T07:09:34.3966461Z da02d278e524: Pull complete 2024-06-26T07:09:34.5587565Z 73a0ce681c29: Pull complete 2024-06-26T07:09:34.7733197Z 49737bd5ae70: Pull complete 2024-06-26T07:09:35.7731813Z 9cd4c745f8e4: Pull complete 2024-06-26T07:09:35.8984548Z b2950a036534: Pull complete 2024-06-26T07:09:36.0720430Z 25e19d81d9fc: Pull complete 2024-06-26T07:09:36.5024803Z 60156b40fcbe: Pull complete 2024-06-26T07:09:36.6424784Z 7a868239227f: Pull complete 2024-06-26T07:09:37.0649873Z 83911d7c7ecf: Pull complete 2024-06-26T07:09:37.2861689Z b3c5d66c679f: Pull complete 2024-06-26T07:10:16.5893391Z 84b2c7a89982: Pull complete 2024-06-26T07:10:16.8122114Z c1068d03a811: Pull complete 2024-06-26T07:10:16.8665157Z 671b4a301d81: Pull complete 2024-06-26T07:10:18.8204200Z 67760cf5ec46: Pull complete 2024-06-26T07:10:18.8549436Z ddc9740bcea2: Pull complete 2024-06-26T07:10:18.9087578Z fb2e97768560: Pull complete 2024-06-26T07:10:18.9945330Z b599c5a8c7cb: Pull complete 2024-06-26T07:10:19.0345771Z e08e88c13668: Pull complete 2024-06-26T07:10:53.5089170Z 12ba7431ff38: Pull complete 2024-06-26T07:10:53.7198754Z cf7c2cb896cb: Pull complete 2024-06-26T07:10:53.9296049Z 3a778ddfac2a: Pull complete 2024-06-26T07:10:54.4067216Z 236c8f0245f4: Pull complete 2024-06-26T07:10:54.6234672Z 4f4fb700ef54: Pull complete 2024-06-26T07:10:54.8478355Z dda1ce302b9a: Pull complete 2024-06-26T07:10:55.0724244Z e797fe86caef: Pull complete 2024-06-26T07:10:55.4427597Z 967190076fc0: Pull complete 2024-06-26T07:10:55.6799681Z 4fb0a83f0685: Pull complete 2024-06-26T07:10:55.8625369Z 68af2ec4e30a: Pull complete 2024-06-26T07:10:56.0893384Z cc91933e985a: Pull complete 2024-06-26T07:10:56.2942910Z 9f3187916e7d: Pull complete 2024-06-26T07:10:57.4022606Z 526083994857: Pull complete 2024-06-26T07:10:57.6013711Z 05a6f6dcc1c0: Pull complete 2024-06-26T07:10:59.6512052Z 6bc9dc8315b0: Pull complete 2024-06-26T07:10:59.8715315Z 1b0e27c35f07: Pull complete 2024-06-26T07:11:13.3856146Z 95237e7311a1: Pull complete 2024-06-26T07:11:13.4352135Z 789eff6c51aa: Pull complete 2024-06-26T07:11:13.4840305Z de0f8a8c45c6: Pull complete 2024-06-26T07:11:14.2180310Z 2060028f7488: Pull complete 2024-06-26T07:11:14.3145589Z e412c7f3b2de: Pull complete 2024-06-26T07:11:15.0907858Z Digest: sha256:216c88a4f79ebfa71a5dcf4d9a946548184354a3ea1f677f4b1065d28705debb 2024-06-26T07:11:15.1306706Z Status: Downloaded newer image for 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:11:15.1507947Z 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:11:15.1548715Z ##[group]Run echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> "$GITHUB_OUTPUT" 2024-06-26T07:11:15.1549656Z echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> "$GITHUB_OUTPUT" 2024-06-26T07:11:15.1557996Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:11:15.1558734Z env: 2024-06-26T07:11:15.1559056Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:11:15.1559418Z ##[endgroup] 2024-06-26T07:11:15.1717816Z ##[group]Run pytorch/test-infra/.github/actions/setup-nvidia@main 2024-06-26T07:11:15.1718362Z with: 2024-06-26T07:11:15.1718661Z driver-version: 550.54.15 2024-06-26T07:11:15.1719014Z env: 2024-06-26T07:11:15.1719304Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:11:15.1719649Z ##[endgroup] 2024-06-26T07:11:15.1783662Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2024-06-26T07:11:15.1784225Z with: 2024-06-26T07:11:15.1784511Z timeout_minutes: 10 2024-06-26T07:11:15.1784844Z max_attempts: 3 2024-06-26T07:11:15.1815781Z command: # Is it disgusting to have a full shell script here in this github action? Sure # But is it the best way to make it so that this action relies on nothing else? Absolutely set -eou pipefail DISTRIBUTION=$(. /etc/os-release;echo $ID$VERSION_ID) DRIVER_FN="NVIDIA-Linux-x86_64-${DRIVER_VERSION}.run" install_nvidia_docker2_amzn2() { ( set -x # Needed for yum-config-manager sudo yum install -y yum-utils if [[ "${DISTRIBUTION}" == "amzn2023" ]] ; then YUM_REPO_URL="https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo" else # Amazon Linux 2 YUM_REPO_URL="https://nvidia.github.io/nvidia-docker/${DISTRIBUTION}/nvidia-docker.repo" fi sudo yum-config-manager --add-repo "${YUM_REPO_URL}" sudo yum install -y nvidia-docker2 sudo systemctl restart docker ) } install_nvidia_docker2_ubuntu20() { ( set -x # Install nvidia-driver package if not installed status="$(dpkg-query -W --showformat='${db:Status-Status}' nvidia-docker2 2>&1)" if [ ! $? = 0 ] || [ ! "$status" = installed ]; then sudo apt-get install -y nvidia-docker2 sudo systemctl restart docker fi ) } pre_install_nvidia_driver_amzn2() { ( # Purge any nvidia driver installed from RHEL repo sudo yum remove -y nvidia-driver-latest-dkms ) } install_nvidia_driver_common() { ( # Try to gather more information about the runner and its existing NVIDIA driver if any echo "Before installing NVIDIA driver" lspci lsmod modinfo nvidia || true HAS_NVIDIA_DRIVER=0 # Check if NVIDIA driver has already been installed if [ -x "$(command -v nvidia-smi)" ]; then set +e # The driver exists, check its version next. Also check only the first GPU if there are more than one of them # so that the same driver version is not print over multiple lines INSTALLED_DRIVER_VERSION=$(nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0) NVIDIA_SMI_STATUS=$? if [ "$NVIDIA_SMI_STATUS" -ne 0 ] && [ "$NVIDIA_SMI_STATUS" -ne 14 ]; then echo "Failed to get NVIDIA driver version ($INSTALLED_DRIVER_VERSION). Continuing" elif [ "$INSTALLED_DRIVER_VERSION" != "$DRIVER_VERSION" ]; then echo "NVIDIA driver ($INSTALLED_DRIVER_VERSION) has been installed, but we expect to have $DRIVER_VERSION instead. Continuing" else HAS_NVIDIA_DRIVER=1 echo "NVIDIA driver ($INSTALLED_DRIVER_VERSION) has already been installed. Skipping NVIDIA driver installation" fi set -e fi if [ "$HAS_NVIDIA_DRIVER" -eq 0 ]; then # CAUTION: this may need to be updated in future if [ "${DISTRIBUTION}" != ubuntu20.04 ]; then sudo yum groupinstall -y "Development Tools" # ensure our kernel install is the same as our underlying kernel, # groupinstall "Development Tools" has a habit of mismatching kernel headers sudo yum install -y "kernel-devel-uname-r == $(uname -r)" sudo modprobe backlight fi sudo curl -fsL -o /tmp/nvidia_driver "https://s3.amazonaws.com/ossci-linux/nvidia_driver/$DRIVER_FN" set +e sudo /bin/bash /tmp/nvidia_driver -s --no-drm NVIDIA_INSTALLATION_STATUS=$? RESET_GPU=0 if [ "$NVIDIA_INSTALLATION_STATUS" -ne 0 ]; then sudo cat /var/log/nvidia-installer.log # Fail to install NVIDIA driver, try to reset the GPU RESET_GPU=1 elif [ -x "$(command -v nvidia-smi)" ]; then # Check again if nvidia-smi works even if the driver installation completes successfully INSTALLED_DRIVER_VERSION=$(nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0) NVIDIA_SMI_STATUS=$? if [ "$NVIDIA_SMI_STATUS" -ne 0 ] && [ "$NVIDIA_SMI_STATUS" -ne 14 ]; then RESET_GPU=1 fi fi if [ "$RESET_GPU" -eq 1 ]; then NVIDIA_DEVICES=$(lspci -D | grep -i NVIDIA | cut -d' ' -f1) # The GPU can get stuck in a failure state if somehow the test crashs the GPU microcode. When this # happens, we'll try to reset all NVIDIA devices https://github.com/pytorch/pytorch/issues/88388 for PCI_ID in $NVIDIA_DEVICES; do DEVICE_ENABLED=$(cat /sys/bus/pci/devices/$PCI_ID/enable) echo "Reseting $PCI_ID (enabled state: $DEVICE_ENABLED)" # This requires sudo permission of course echo "1" | sudo tee /sys/bus/pci/devices/$PCI_ID/reset sleep 1 done fi sudo rm -fv /tmp/nvidia_driver set -e fi ) } post_install_nvidia_driver_common() { ( sudo modprobe nvidia || true echo "After installing NVIDIA driver" lspci lsmod modinfo nvidia || true ( set +e nvidia-smi # NB: Annoyingly, nvidia-smi command returns successfully with return code 0 even in # the case where the driver has already crashed as it still can get the driver version # and some basic information like the bus ID. However, the rest of the information # would be missing (ERR!), for example: # # +-----------------------------------------------------------------------------+ # | NVIDIA-SMI 525.89.02 Driver Version: 525.89.02 CUDA Version: 12.0 | # |-------------------------------+----------------------+----------------------+ # | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | # | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | # | | | MIG M. | # |===============================+======================+======================| # | 0 ERR! Off | 00000000:00:1E.0 Off | ERR! | # |ERR! ERR! ERR! ERR! / ERR! | 4184MiB / 23028MiB | ERR! Default | # | | | ERR! | # +-------------------------------+----------------------+----------------------+ # # +-----------------------------------------------------------------------------+ # | Processes: | # | GPU GI CI PID Type Process name GPU Memory | # | ID ID Usage | # |=============================================================================| # +-----------------------------------------------------------------------------+ # # This should be reported as a failure instead as it will guarantee to fail when # Docker tries to run with --gpus all # # So, the correct check here is to query one of the missing piece of info like # GPU name, so that the command can fail accordingly nvidia-smi --query-gpu=gpu_name --format=csv,noheader --id=0 NVIDIA_SMI_STATUS=$? # Allowable exit statuses for nvidia-smi, see: https://github.com/NVIDIA/gpu-operator/issues/285 if [ "$NVIDIA_SMI_STATUS" -eq 0 ] || [ "$NVIDIA_SMI_STATUS" -eq 14 ]; then echo "INFO: Ignoring allowed status ${NVIDIA_SMI_STATUS}" else echo "ERROR: nvidia-smi exited with unresolved status ${NVIDIA_SMI_STATUS}" exit ${NVIDIA_SMI_STATUS} fi set -e ) ) } install_nvidia_driver_amzn2() { ( set -x pre_install_nvidia_driver_amzn2 install_nvidia_driver_common post_install_nvidia_driver_common ) } install_nvidia_driver_ubuntu20() { ( set -x install_nvidia_driver_common post_install_nvidia_driver_common ) } echo "== Installing nvidia driver ${DRIVER_FN} ==" case "${DISTRIBUTION}" in amzn*) install_nvidia_driver_amzn2 ;; ubuntu20.04) install_nvidia_driver_ubuntu20 ;; *) echo "ERROR: Unknown distribution ${DISTRIBUTION}" exit 1 ;; esac # Install container toolkit based on distribution echo "== Installing nvidia container toolkit for ${DISTRIBUTION} ==" case "${DISTRIBUTION}" in amzn*) install_nvidia_docker2_amzn2 ;; ubuntu20.04) install_nvidia_docker2_ubuntu20 ;; *) echo "ERROR: Unknown distribution ${DISTRIBUTION}" exit 1 ;; esac echo "GPU_FLAG=--gpus all -e NVIDIA_DRIVER_CAPABILITIES=all" >> "${GITHUB_ENV}" 2024-06-26T07:11:15.1847978Z retry_wait_seconds: 10 2024-06-26T07:11:15.1848352Z polling_interval_seconds: 1 2024-06-26T07:11:15.1848729Z warning_on_retry: true 2024-06-26T07:11:15.1849088Z continue_on_error: false 2024-06-26T07:11:15.1849435Z env: 2024-06-26T07:11:15.1849711Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:11:15.1850073Z DRIVER_VERSION: 550.54.15 2024-06-26T07:11:15.1850429Z ##[endgroup] 2024-06-26T07:11:15.2361792Z == Installing nvidia driver NVIDIA-Linux-x86_64-550.54.15.run == 2024-06-26T07:11:15.2362570Z + pre_install_nvidia_driver_amzn2 2024-06-26T07:11:15.2363109Z + sudo yum remove -y nvidia-driver-latest-dkms 2024-06-26T07:11:15.5406496Z Loaded plugins: extras_suggestions, langpacks, priorities, update-motd 2024-06-26T07:11:15.5792876Z No Match for argument: nvidia-driver-latest-dkms 2024-06-26T07:11:15.6034398Z No Packages marked for removal 2024-06-26T07:11:15.6153909Z + install_nvidia_driver_common 2024-06-26T07:11:15.6158566Z + echo 'Before installing NVIDIA driver' 2024-06-26T07:11:15.6159127Z Before installing NVIDIA driver 2024-06-26T07:11:15.6159696Z + lspci 2024-06-26T07:11:15.6237441Z 00:00.0 Host bridge: Intel Corporation 440FX - 82441FX PMC [Natoma] 2024-06-26T07:11:15.6238370Z 00:01.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II] 2024-06-26T07:11:15.6239472Z 00:01.3 Non-VGA unclassified device: Intel Corporation 82371AB/EB/MB PIIX4 ACPI (rev 08) 2024-06-26T07:11:15.6240627Z 00:03.0 VGA compatible controller: Amazon.com, Inc. Device 1111 2024-06-26T07:11:15.6241670Z 00:04.0 Non-Volatile memory controller: Amazon.com, Inc. Device 8061 2024-06-26T07:11:15.6242444Z 00:05.0 Ethernet controller: Amazon.com, Inc. Elastic Network Adapter (ENA) 2024-06-26T07:11:15.6243184Z 00:1e.0 3D controller: NVIDIA Corporation Device 2237 (rev a1) 2024-06-26T07:11:15.6243982Z 00:1f.0 Non-Volatile memory controller: Amazon.com, Inc. NVMe SSD Controller 2024-06-26T07:11:15.6244583Z + lsmod 2024-06-26T07:11:15.6252146Z Module Size Used by 2024-06-26T07:11:15.6252770Z xt_nat 16384 0 2024-06-26T07:11:15.6253335Z ib_core 266240 0 2024-06-26T07:11:15.6253880Z nvidia_modeset 1339392 0 2024-06-26T07:11:15.6254429Z veth 16384 0 2024-06-26T07:11:15.6254951Z nvidia_uvm 4599808 0 2024-06-26T07:11:15.6255891Z nvidia 53989376 2 nvidia_uvm,nvidia_modeset 2024-06-26T07:11:15.6256625Z drm 421888 1 nvidia 2024-06-26T07:11:15.6257492Z i2c_core 77824 2 nvidia,drm 2024-06-26T07:11:15.6258172Z backlight 16384 1 nvidia_modeset 2024-06-26T07:11:15.6258809Z xt_conntrack 16384 1 2024-06-26T07:11:15.6259364Z ipt_MASQUERADE 16384 1 2024-06-26T07:11:15.6260021Z nf_nat_masquerade_ipv4 16384 1 ipt_MASQUERADE 2024-06-26T07:11:15.6260748Z nf_conntrack_netlink 49152 0 2024-06-26T07:11:15.6261342Z nfnetlink 16384 2 nf_conntrack_netlink 2024-06-26T07:11:15.6262016Z xfrm_user 45056 1 2024-06-26T07:11:15.6262582Z xfrm_algo 16384 1 xfrm_user 2024-06-26T07:11:15.6263192Z iptable_nat 16384 1 2024-06-26T07:11:15.6263738Z nf_conntrack_ipv4 16384 3 2024-06-26T07:11:15.6264380Z nf_defrag_ipv4 16384 1 nf_conntrack_ipv4 2024-06-26T07:11:15.6265076Z nf_nat_ipv4 16384 1 iptable_nat 2024-06-26T07:11:15.6265656Z nf_nat 32768 3 nf_nat_masquerade_ipv4,nf_nat_ipv4,xt_nat 2024-06-26T07:11:15.6266671Z nf_conntrack 155648 8 xt_conntrack,nf_nat_masquerade_ipv4,nf_conntrack_ipv4,nf_nat,ipt_MASQUERADE,nf_nat_ipv4,xt_nat,nf_conntrack_netlink 2024-06-26T07:11:15.6267574Z xt_addrtype 16384 2 2024-06-26T07:11:15.6268063Z iptable_filter 16384 1 2024-06-26T07:11:15.6268614Z br_netfilter 24576 0 2024-06-26T07:11:15.6269256Z bridge 172032 1 br_netfilter 2024-06-26T07:11:15.6269876Z stp 16384 1 bridge 2024-06-26T07:11:15.6270489Z llc 16384 2 bridge,stp 2024-06-26T07:11:15.6271466Z overlay 86016 0 2024-06-26T07:11:15.6272029Z sunrpc 393216 1 2024-06-26T07:11:15.6272562Z dm_mirror 28672 0 2024-06-26T07:11:15.6273115Z dm_region_hash 20480 1 dm_mirror 2024-06-26T07:11:15.6273803Z dm_log 20480 2 dm_region_hash,dm_mirror 2024-06-26T07:11:15.6274460Z dm_mod 143360 2 dm_log,dm_mirror 2024-06-26T07:11:15.6275122Z dax 69632 1 dm_mod 2024-06-26T07:11:15.6275636Z crc32_pclmul 16384 0 2024-06-26T07:11:15.6276177Z ghash_clmulni_intel 16384 0 2024-06-26T07:11:15.6276725Z pcbc 16384 0 2024-06-26T07:11:15.6277268Z aesni_intel 188416 0 2024-06-26T07:11:15.6277841Z aes_x86_64 20480 1 aesni_intel 2024-06-26T07:11:15.6278520Z crypto_simd 16384 1 aesni_intel 2024-06-26T07:11:15.6279167Z glue_helper 16384 1 aesni_intel 2024-06-26T07:11:15.6280002Z cryptd 28672 3 crypto_simd,ghash_clmulni_intel,aesni_intel 2024-06-26T07:11:15.6280795Z mousedev 24576 0 2024-06-26T07:11:15.6281322Z evdev 20480 3 2024-06-26T07:11:15.6281838Z psmouse 32768 0 2024-06-26T07:11:15.6282360Z button 16384 0 2024-06-26T07:11:15.6282875Z ena 139264 0 2024-06-26T07:11:15.6283405Z ptp 20480 1 ena 2024-06-26T07:11:15.6283948Z pps_core 20480 1 ptp 2024-06-26T07:11:15.6284497Z crc32c_intel 24576 0 2024-06-26T07:11:15.6285017Z autofs4 49152 2 2024-06-26T07:11:15.6285514Z + modinfo nvidia 2024-06-26T07:11:15.6286439Z filename: /lib/modules/4.14.336-257.562.amzn2.x86_64/kernel/drivers/video/nvidia.ko 2024-06-26T07:11:15.6287408Z alias: char-major-195-* 2024-06-26T07:11:15.6287943Z version: 550.54.15 2024-06-26T07:11:15.6288427Z supported: external 2024-06-26T07:11:15.6288914Z license: NVIDIA 2024-06-26T07:11:15.6289435Z firmware: nvidia/550.54.15/gsp_tu10x.bin 2024-06-26T07:11:15.6290127Z firmware: nvidia/550.54.15/gsp_ga10x.bin 2024-06-26T07:11:15.6290814Z srcversion: 833721318DA517F0C2FEC97 2024-06-26T07:11:15.6291457Z alias: pci:v000010DEd*sv*sd*bc06sc80i00* 2024-06-26T07:11:15.6292150Z alias: pci:v000010DEd*sv*sd*bc03sc02i00* 2024-06-26T07:11:15.6293045Z alias: pci:v000010DEd*sv*sd*bc03sc00i00* 2024-06-26T07:11:15.6293729Z depends: i2c-core,drm 2024-06-26T07:11:15.6294240Z retpoline: Y 2024-06-26T07:11:15.6294677Z name: nvidia 2024-06-26T07:11:15.6295432Z vermagic: 4.14.336-257.562.amzn2.x86_64 SMP mod_unload modversions 2024-06-26T07:11:15.6296335Z parm: NvSwitchRegDwords:NvSwitch regkey (charp) 2024-06-26T07:11:15.6297460Z parm: NvSwitchBlacklist:NvSwitchBlacklist=uuid[,uuid...] (charp) 2024-06-26T07:11:15.6298292Z parm: NVreg_ResmanDebugLevel:int 2024-06-26T07:11:15.6298907Z parm: NVreg_RmLogonRC:int 2024-06-26T07:11:15.6299513Z parm: NVreg_ModifyDeviceFiles:int 2024-06-26T07:11:15.6300159Z parm: NVreg_DeviceFileUID:int 2024-06-26T07:11:15.6300763Z parm: NVreg_DeviceFileGID:int 2024-06-26T07:11:15.6301361Z parm: NVreg_DeviceFileMode:int 2024-06-26T07:11:15.6302090Z parm: NVreg_InitializeSystemMemoryAllocations:int 2024-06-26T07:11:15.6302883Z parm: NVreg_UsePageAttributeTable:int 2024-06-26T07:11:15.6303548Z parm: NVreg_EnablePCIeGen3:int 2024-06-26T07:11:15.6304139Z parm: NVreg_EnableMSI:int 2024-06-26T07:11:15.6304731Z parm: NVreg_TCEBypassMode:int 2024-06-26T07:11:15.6305369Z parm: NVreg_EnableStreamMemOPs:int 2024-06-26T07:11:15.6306110Z parm: NVreg_RestrictProfilingToAdminUsers:int 2024-06-26T07:11:15.6306909Z parm: NVreg_PreserveVideoMemoryAllocations:int 2024-06-26T07:11:15.6307687Z parm: NVreg_EnableS0ixPowerManagement:int 2024-06-26T07:11:15.6308531Z parm: NVreg_S0ixPowerManagementVideoMemoryThreshold:int 2024-06-26T07:11:15.6309550Z parm: NVreg_DynamicPowerManagement:int 2024-06-26T07:11:15.6310398Z parm: NVreg_DynamicPowerManagementVideoMemoryThreshold:int 2024-06-26T07:11:15.6311363Z parm: NVreg_EnableGpuFirmware:int 2024-06-26T07:11:15.6312052Z parm: NVreg_EnableGpuFirmwareLogs:int 2024-06-26T07:11:15.6312797Z parm: NVreg_OpenRmEnableUnsupportedGpus:int 2024-06-26T07:11:15.6313563Z parm: NVreg_EnableUserNUMAManagement:int 2024-06-26T07:11:15.6314260Z parm: NVreg_MemoryPoolSize:int 2024-06-26T07:11:15.6314912Z parm: NVreg_KMallocHeapMaxSize:int 2024-06-26T07:11:15.6315582Z parm: NVreg_VMallocHeapMaxSize:int 2024-06-26T07:11:15.6316247Z parm: NVreg_IgnoreMMIOCheck:int 2024-06-26T07:11:15.6316874Z parm: NVreg_NvLinkDisable:int 2024-06-26T07:11:15.6317839Z parm: NVreg_EnablePCIERelaxedOrderingMode:int 2024-06-26T07:11:15.6318575Z parm: NVreg_RegisterPCIDriver:int 2024-06-26T07:11:15.6319241Z parm: NVreg_EnableResizableBar:int 2024-06-26T07:11:15.6319889Z parm: NVreg_EnableDbgBreakpoint:int 2024-06-26T07:11:15.6320587Z parm: NVreg_EnableNonblockingOpen:int 2024-06-26T07:11:15.6321260Z parm: NVreg_RegistryDwords:charp 2024-06-26T07:11:15.6321884Z parm: NVreg_RegistryDwordsPerDevice:charp 2024-06-26T07:11:15.6322415Z parm: NVreg_RmMsg:charp 2024-06-26T07:11:15.6322858Z parm: NVreg_GpuBlacklist:charp 2024-06-26T07:11:15.6323360Z parm: NVreg_TemporaryFilePath:charp 2024-06-26T07:11:15.6323868Z parm: NVreg_ExcludedGpus:charp 2024-06-26T07:11:15.6324360Z parm: NVreg_DmaRemapPeerMmio:int 2024-06-26T07:11:15.6324878Z parm: NVreg_RmNvlinkBandwidth:charp 2024-06-26T07:11:15.6325357Z parm: NVreg_ImexChannelCount:int 2024-06-26T07:11:15.6325820Z parm: rm_firmware_active:charp 2024-06-26T07:11:15.6326246Z + HAS_NVIDIA_DRIVER=0 2024-06-26T07:11:15.6326664Z ++ command -v nvidia-smi 2024-06-26T07:11:15.6327068Z + '[' -x /usr/bin/nvidia-smi ']' 2024-06-26T07:11:15.6327450Z + set +e 2024-06-26T07:11:15.6327954Z ++ nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0 2024-06-26T07:11:17.6165430Z + INSTALLED_DRIVER_VERSION=550.54.15 2024-06-26T07:11:17.6166065Z + NVIDIA_SMI_STATUS=0 2024-06-26T07:11:17.6166955Z + '[' 0 -ne 0 ']' 2024-06-26T07:11:17.6167356Z + '[' 550.54.15 '!=' 550.54.15 ']' 2024-06-26T07:11:17.6167751Z + HAS_NVIDIA_DRIVER=1 2024-06-26T07:11:17.6168488Z + echo 'NVIDIA driver (550.54.15) has already been installed. Skipping NVIDIA driver installation' 2024-06-26T07:11:17.6169223Z + set -e 2024-06-26T07:11:17.6169550Z + '[' 1 -eq 0 ']' 2024-06-26T07:11:17.6170142Z NVIDIA driver (550.54.15) has already been installed. Skipping NVIDIA driver installation 2024-06-26T07:11:17.6170845Z + post_install_nvidia_driver_common 2024-06-26T07:11:17.6171271Z + sudo modprobe nvidia 2024-06-26T07:11:17.6267889Z + echo 'After installing NVIDIA driver' 2024-06-26T07:11:17.6268347Z + lspci 2024-06-26T07:11:17.6269274Z After installing NVIDIA driver 2024-06-26T07:11:17.6346566Z 00:00.0 Host bridge: Intel Corporation 440FX - 82441FX PMC [Natoma] 2024-06-26T07:11:17.6347387Z 00:01.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II] 2024-06-26T07:11:17.6348347Z 00:01.3 Non-VGA unclassified device: Intel Corporation 82371AB/EB/MB PIIX4 ACPI (rev 08) 2024-06-26T07:11:17.6349159Z 00:03.0 VGA compatible controller: Amazon.com, Inc. Device 1111 2024-06-26T07:11:17.6349928Z 00:04.0 Non-Volatile memory controller: Amazon.com, Inc. Device 8061 2024-06-26T07:11:17.6350705Z 00:05.0 Ethernet controller: Amazon.com, Inc. Elastic Network Adapter (ENA) 2024-06-26T07:11:17.6351513Z 00:1e.0 3D controller: NVIDIA Corporation Device 2237 (rev a1) 2024-06-26T07:11:17.6352313Z 00:1f.0 Non-Volatile memory controller: Amazon.com, Inc. NVMe SSD Controller 2024-06-26T07:11:17.6352904Z + lsmod 2024-06-26T07:11:17.6360442Z Module Size Used by 2024-06-26T07:11:17.6360889Z xt_nat 16384 0 2024-06-26T07:11:17.6361504Z ib_core 266240 0 2024-06-26T07:11:17.6361896Z nvidia_modeset 1339392 0 2024-06-26T07:11:17.6362291Z veth 16384 0 2024-06-26T07:11:17.6362679Z nvidia_uvm 4599808 0 2024-06-26T07:11:17.6363153Z nvidia 53989376 2 nvidia_uvm,nvidia_modeset 2024-06-26T07:11:17.6363648Z drm 421888 1 nvidia 2024-06-26T07:11:17.6364088Z i2c_core 77824 2 nvidia,drm 2024-06-26T07:11:17.6364578Z backlight 16384 1 nvidia_modeset 2024-06-26T07:11:17.6365041Z xt_conntrack 16384 1 2024-06-26T07:11:17.6365432Z ipt_MASQUERADE 16384 1 2024-06-26T07:11:17.6365889Z nf_nat_masquerade_ipv4 16384 1 ipt_MASQUERADE 2024-06-26T07:11:17.6366383Z nf_conntrack_netlink 49152 0 2024-06-26T07:11:17.6366846Z nfnetlink 16384 2 nf_conntrack_netlink 2024-06-26T07:11:17.6367327Z xfrm_user 45056 1 2024-06-26T07:11:17.6367741Z xfrm_algo 16384 1 xfrm_user 2024-06-26T07:11:17.6368196Z iptable_nat 16384 1 2024-06-26T07:11:17.6368621Z nf_conntrack_ipv4 16384 3 2024-06-26T07:11:17.6369057Z nf_defrag_ipv4 16384 1 nf_conntrack_ipv4 2024-06-26T07:11:17.6369562Z nf_nat_ipv4 16384 1 iptable_nat 2024-06-26T07:11:17.6370135Z nf_nat 32768 3 nf_nat_masquerade_ipv4,nf_nat_ipv4,xt_nat 2024-06-26T07:11:17.6371144Z nf_conntrack 155648 8 xt_conntrack,nf_nat_masquerade_ipv4,nf_conntrack_ipv4,nf_nat,ipt_MASQUERADE,nf_nat_ipv4,xt_nat,nf_conntrack_netlink 2024-06-26T07:11:17.6372024Z xt_addrtype 16384 2 2024-06-26T07:11:17.6372424Z iptable_filter 16384 1 2024-06-26T07:11:17.6372821Z br_netfilter 24576 0 2024-06-26T07:11:17.6373247Z bridge 172032 1 br_netfilter 2024-06-26T07:11:17.6373696Z stp 16384 1 bridge 2024-06-26T07:11:17.6374139Z llc 16384 2 bridge,stp 2024-06-26T07:11:17.6374567Z overlay 86016 0 2024-06-26T07:11:17.6374957Z sunrpc 393216 1 2024-06-26T07:11:17.6375329Z dm_mirror 28672 0 2024-06-26T07:11:17.6375735Z dm_region_hash 20480 1 dm_mirror 2024-06-26T07:11:17.6376236Z dm_log 20480 2 dm_region_hash,dm_mirror 2024-06-26T07:11:17.6376869Z dm_mod 143360 2 dm_log,dm_mirror 2024-06-26T07:11:17.6377606Z dax 69632 1 dm_mod 2024-06-26T07:11:17.6378022Z crc32_pclmul 16384 0 2024-06-26T07:11:17.6378411Z ghash_clmulni_intel 16384 0 2024-06-26T07:11:17.6378794Z pcbc 16384 0 2024-06-26T07:11:17.6379177Z aesni_intel 188416 0 2024-06-26T07:11:17.6379582Z aes_x86_64 20480 1 aesni_intel 2024-06-26T07:11:17.6380046Z crypto_simd 16384 1 aesni_intel 2024-06-26T07:11:17.6380542Z glue_helper 16384 1 aesni_intel 2024-06-26T07:11:17.6381147Z cryptd 28672 3 crypto_simd,ghash_clmulni_intel,aesni_intel 2024-06-26T07:11:17.6381804Z mousedev 24576 0 2024-06-26T07:11:17.6382188Z evdev 20480 3 2024-06-26T07:11:17.6382562Z psmouse 32768 0 2024-06-26T07:11:17.6382950Z button 16384 0 2024-06-26T07:11:17.6383329Z ena 139264 0 2024-06-26T07:11:17.6383711Z ptp 20480 1 ena 2024-06-26T07:11:17.6384130Z pps_core 20480 1 ptp 2024-06-26T07:11:17.6384540Z crc32c_intel 24576 0 2024-06-26T07:11:17.6384921Z autofs4 49152 2 2024-06-26T07:11:17.6385286Z + modinfo nvidia 2024-06-26T07:11:17.6385983Z filename: /lib/modules/4.14.336-257.562.amzn2.x86_64/kernel/drivers/video/nvidia.ko 2024-06-26T07:11:17.6386689Z alias: char-major-195-* 2024-06-26T07:11:17.6387089Z version: 550.54.15 2024-06-26T07:11:17.6387439Z supported: external 2024-06-26T07:11:17.6387792Z license: NVIDIA 2024-06-26T07:11:17.6388187Z firmware: nvidia/550.54.15/gsp_tu10x.bin 2024-06-26T07:11:17.6388803Z firmware: nvidia/550.54.15/gsp_ga10x.bin 2024-06-26T07:11:17.6389267Z srcversion: 833721318DA517F0C2FEC97 2024-06-26T07:11:17.6389748Z alias: pci:v000010DEd*sv*sd*bc06sc80i00* 2024-06-26T07:11:17.6390262Z alias: pci:v000010DEd*sv*sd*bc03sc02i00* 2024-06-26T07:11:17.6390860Z alias: pci:v000010DEd*sv*sd*bc03sc00i00* 2024-06-26T07:11:17.6391359Z depends: i2c-core,drm 2024-06-26T07:11:17.6391731Z retpoline: Y 2024-06-26T07:11:17.6392052Z name: nvidia 2024-06-26T07:11:17.6392620Z vermagic: 4.14.336-257.562.amzn2.x86_64 SMP mod_unload modversions 2024-06-26T07:11:17.6393275Z parm: NvSwitchRegDwords:NvSwitch regkey (charp) 2024-06-26T07:11:17.6393921Z parm: NvSwitchBlacklist:NvSwitchBlacklist=uuid[,uuid...] (charp) 2024-06-26T07:11:17.6394518Z parm: NVreg_ResmanDebugLevel:int 2024-06-26T07:11:17.6394975Z parm: NVreg_RmLogonRC:int 2024-06-26T07:11:17.6395414Z parm: NVreg_ModifyDeviceFiles:int 2024-06-26T07:11:17.6395896Z parm: NVreg_DeviceFileUID:int 2024-06-26T07:11:17.6396347Z parm: NVreg_DeviceFileGID:int 2024-06-26T07:11:17.6396792Z parm: NVreg_DeviceFileMode:int 2024-06-26T07:11:17.6397333Z parm: NVreg_InitializeSystemMemoryAllocations:int 2024-06-26T07:11:17.6397907Z parm: NVreg_UsePageAttributeTable:int 2024-06-26T07:11:17.6398407Z parm: NVreg_EnablePCIeGen3:int 2024-06-26T07:11:17.6398841Z parm: NVreg_EnableMSI:int 2024-06-26T07:11:17.6399268Z parm: NVreg_TCEBypassMode:int 2024-06-26T07:11:17.6399736Z parm: NVreg_EnableStreamMemOPs:int 2024-06-26T07:11:17.6400284Z parm: NVreg_RestrictProfilingToAdminUsers:int 2024-06-26T07:11:17.6400868Z parm: NVreg_PreserveVideoMemoryAllocations:int 2024-06-26T07:11:17.6401501Z parm: NVreg_EnableS0ixPowerManagement:int 2024-06-26T07:11:17.6402124Z parm: NVreg_S0ixPowerManagementVideoMemoryThreshold:int 2024-06-26T07:11:17.6402736Z parm: NVreg_DynamicPowerManagement:int 2024-06-26T07:11:17.6403349Z parm: NVreg_DynamicPowerManagementVideoMemoryThreshold:int 2024-06-26T07:11:17.6403960Z parm: NVreg_EnableGpuFirmware:int 2024-06-26T07:11:17.6404465Z parm: NVreg_EnableGpuFirmwareLogs:int 2024-06-26T07:11:17.6405106Z parm: NVreg_OpenRmEnableUnsupportedGpus:int 2024-06-26T07:11:17.6405669Z parm: NVreg_EnableUserNUMAManagement:int 2024-06-26T07:11:17.6406179Z parm: NVreg_MemoryPoolSize:int 2024-06-26T07:11:17.6406663Z parm: NVreg_KMallocHeapMaxSize:int 2024-06-26T07:11:17.6407160Z parm: NVreg_VMallocHeapMaxSize:int 2024-06-26T07:11:17.6407644Z parm: NVreg_IgnoreMMIOCheck:int 2024-06-26T07:11:17.6408103Z parm: NVreg_NvLinkDisable:int 2024-06-26T07:11:17.6408619Z parm: NVreg_EnablePCIERelaxedOrderingMode:int 2024-06-26T07:11:17.6409150Z parm: NVreg_RegisterPCIDriver:int 2024-06-26T07:11:17.6409651Z parm: NVreg_EnableResizableBar:int 2024-06-26T07:11:17.6410161Z parm: NVreg_EnableDbgBreakpoint:int 2024-06-26T07:11:17.6410677Z parm: NVreg_EnableNonblockingOpen:int 2024-06-26T07:11:17.6411168Z parm: NVreg_RegistryDwords:charp 2024-06-26T07:11:17.6411686Z parm: NVreg_RegistryDwordsPerDevice:charp 2024-06-26T07:11:17.6412175Z parm: NVreg_RmMsg:charp 2024-06-26T07:11:17.6412599Z parm: NVreg_GpuBlacklist:charp 2024-06-26T07:11:17.6413072Z parm: NVreg_TemporaryFilePath:charp 2024-06-26T07:11:17.6413554Z parm: NVreg_ExcludedGpus:charp 2024-06-26T07:11:17.6414029Z parm: NVreg_DmaRemapPeerMmio:int 2024-06-26T07:11:17.6414521Z parm: NVreg_RmNvlinkBandwidth:charp 2024-06-26T07:11:17.6415002Z parm: NVreg_ImexChannelCount:int 2024-06-26T07:11:17.6415474Z parm: rm_firmware_active:charp 2024-06-26T07:11:17.6415887Z + set +e 2024-06-26T07:11:17.6416201Z + nvidia-smi 2024-06-26T07:11:19.1844118Z Wed Jun 26 07:11:19 2024 2024-06-26T07:11:19.1845394Z +-----------------------------------------------------------------------------------------+ 2024-06-26T07:11:19.1846457Z | NVIDIA-SMI 550.54.15 Driver Version: 550.54.15 CUDA Version: 12.4 | 2024-06-26T07:11:19.1847371Z |-----------------------------------------+------------------------+----------------------+ 2024-06-26T07:11:19.1848179Z | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | 2024-06-26T07:11:19.1849093Z | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | 2024-06-26T07:11:19.1849801Z | | | MIG M. | 2024-06-26T07:11:19.1850364Z |=========================================+========================+======================| 2024-06-26T07:11:19.1936099Z | 0 NVIDIA A10G Off | 00000000:00:1E.0 Off | 0 | 2024-06-26T07:11:19.1937408Z | 0% 34C P0 63W / 300W | 0MiB / 23028MiB | 0% Default | 2024-06-26T07:11:19.1938223Z | | | N/A | 2024-06-26T07:11:19.1939164Z +-----------------------------------------+------------------------+----------------------+ 2024-06-26T07:11:19.1939948Z 2024-06-26T07:11:19.1940842Z +-----------------------------------------------------------------------------------------+ 2024-06-26T07:11:19.1941509Z | Processes: | 2024-06-26T07:11:19.1955873Z | GPU GI CI PID Type Process name GPU Memory | 2024-06-26T07:11:19.1956740Z | ID ID Usage | 2024-06-26T07:11:19.1957338Z |=========================================================================================| 2024-06-26T07:11:19.1958012Z | No running processes found | 2024-06-26T07:11:19.1958814Z +-----------------------------------------------------------------------------------------+ 2024-06-26T07:11:19.8145682Z + nvidia-smi --query-gpu=gpu_name --format=csv,noheader --id=0 2024-06-26T07:11:21.3661145Z NVIDIA A10G 2024-06-26T07:11:21.7987040Z + NVIDIA_SMI_STATUS=0 2024-06-26T07:11:21.7987721Z + '[' 0 -eq 0 ']' 2024-06-26T07:11:21.7988168Z + echo 'INFO: Ignoring allowed status 0' 2024-06-26T07:11:21.7988615Z + set -e 2024-06-26T07:11:21.7988991Z INFO: Ignoring allowed status 0 2024-06-26T07:11:21.7991070Z == Installing nvidia container toolkit for amzn2 == 2024-06-26T07:11:21.7993266Z + sudo yum install -y yum-utils 2024-06-26T07:11:22.1039286Z Loaded plugins: extras_suggestions, langpacks, priorities, update-motd 2024-06-26T07:11:23.5983612Z Package yum-utils-1.1.31-46.amzn2.0.1.noarch already installed and latest version 2024-06-26T07:11:23.5984322Z Nothing to do 2024-06-26T07:11:23.7486752Z + [[ amzn2 == \a\m\z\n\2\0\2\3 ]] 2024-06-26T07:11:23.7487743Z + YUM_REPO_URL=https://nvidia.github.io/nvidia-docker/amzn2/nvidia-docker.repo 2024-06-26T07:11:23.7488817Z + sudo yum-config-manager --add-repo https://nvidia.github.io/nvidia-docker/amzn2/nvidia-docker.repo 2024-06-26T07:11:24.0769009Z Loaded plugins: extras_suggestions, langpacks, priorities, update-motd 2024-06-26T07:11:24.1001551Z adding repo from: https://nvidia.github.io/nvidia-docker/amzn2/nvidia-docker.repo 2024-06-26T07:11:24.1002723Z grabbing file https://nvidia.github.io/nvidia-docker/amzn2/nvidia-docker.repo to /etc/yum.repos.d/nvidia-docker.repo 2024-06-26T07:11:24.1003687Z repo saved to /etc/yum.repos.d/nvidia-docker.repo 2024-06-26T07:11:24.1119661Z + sudo yum install -y nvidia-docker2 2024-06-26T07:11:24.4168476Z Loaded plugins: extras_suggestions, langpacks, priorities, update-motd 2024-06-26T07:11:25.9149771Z Package nvidia-docker2-2.13.0-1.noarch already installed and latest version 2024-06-26T07:11:25.9150964Z Nothing to do 2024-06-26T07:11:26.0628437Z + sudo systemctl restart docker 2024-06-26T07:12:03.2821222Z Command completed after 1 attempt(s). 2024-06-26T07:12:03.2879672Z ##[group]Run python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84 2024-06-26T07:12:03.2880439Z python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84 2024-06-26T07:12:03.2881138Z python3 -m tools.stats.monitor > usage_log.txt 2>&1 & 2024-06-26T07:12:03.2881804Z echo "monitor-script-pid=${!}" >> "${GITHUB_OUTPUT}" 2024-06-26T07:12:03.2889524Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:12:03.2890025Z env: 2024-06-26T07:12:03.2890311Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:12:03.2890776Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:12:03.2891270Z ##[endgroup] 2024-06-26T07:12:03.5094158Z Defaulting to user installation because normal site-packages is not writeable 2024-06-26T07:12:03.5261134Z Requirement already satisfied: psutil==5.9.1 in /home/ec2-user/.local/lib/python3.7/site-packages (5.9.1) 2024-06-26T07:12:03.5362036Z Requirement already satisfied: nvidia-ml-py==11.525.84 in /home/ec2-user/.local/lib/python3.7/site-packages (11.525.84) 2024-06-26T07:12:03.6466599Z Prepare all required actions 2024-06-26T07:12:03.6467319Z Getting action download info 2024-06-26T07:12:03.7622946Z Download action repository 'seemethere/download-artifact-s3@v4' (SHA:1da556a7aa0a088e3153970611f6c432d58e80e6) 2024-06-26T07:12:03.9223605Z Download action repository 'actions/download-artifact@v3' (SHA:9bc31d5ccc31df68ecc42ccf4149144866c47d8a) 2024-06-26T07:12:04.0459464Z ##[group]Run ./.github/actions/download-build-artifacts 2024-06-26T07:12:04.0459957Z with: 2024-06-26T07:12:04.0460317Z name: linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-06-26T07:12:04.0460788Z s3-bucket: gha-artifacts 2024-06-26T07:12:04.0461147Z env: 2024-06-26T07:12:04.0461453Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:12:04.0461914Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:12:04.0462439Z ##[endgroup] 2024-06-26T07:12:04.0495140Z ##[group]Run seemethere/download-artifact-s3@v4 2024-06-26T07:12:04.0495637Z with: 2024-06-26T07:12:04.0496067Z name: linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-06-26T07:12:04.0496564Z s3-bucket: gha-artifacts 2024-06-26T07:12:04.0497126Z region: us-east-1 2024-06-26T07:12:04.0497477Z env: 2024-06-26T07:12:04.0497793Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:12:04.0498278Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:12:04.0498821Z ##[endgroup] 2024-06-26T07:12:04.4561674Z (node:27481) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2024-06-26T07:12:04.4562388Z 2024-06-26T07:12:04.4562656Z Please migrate your code to use AWS SDK for JavaScript (v3). 2024-06-26T07:12:04.4563415Z For more information, check the migration guide at https://a.co/7PzMCcy 2024-06-26T07:12:04.4564299Z (Use `node --trace-warnings ...` to show where the warning was created) 2024-06-26T07:12:04.5329597Z Found 1 objects with prefix pytorch/pytorch/9673646806/linux-focal-cuda12.1-py3.10-gcc9-sm86/ 2024-06-26T07:12:04.5330702Z Starting download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2024-06-26T07:12:12.0256588Z Finished download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2024-06-26T07:12:12.0262698Z Artifact download has finished successfully 2024-06-26T07:12:12.0421639Z ##[group]Run unzip -o artifacts.zip 2024-06-26T07:12:12.0422210Z unzip -o artifacts.zip 2024-06-26T07:12:12.0429872Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:12:12.0430394Z env: 2024-06-26T07:12:12.0430827Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:12:12.0431286Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:12:12.0431772Z ##[endgroup] 2024-06-26T07:12:12.0457911Z Archive: artifacts.zip 2024-06-26T07:12:12.0459648Z creating: dist/ 2024-06-26T07:12:14.0179815Z inflating: dist/torch-2.5.0a0+gitb8c4c54-cp310-cp310-linux_x86_64.whl 2024-06-26T07:12:14.0180672Z creating: build/custom_test_artifacts/ 2024-06-26T07:12:14.0181373Z creating: build/custom_test_artifacts/custom-op-build/ 2024-06-26T07:12:14.0182113Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/ 2024-06-26T07:12:14.0182954Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/pkgRedirects/ 2024-06-26T07:12:14.0185626Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeConfigureLog.yaml 2024-06-26T07:12:14.0186572Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/ 2024-06-26T07:12:14.0187529Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-06-26T07:12:14.0188533Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-06-26T07:12:14.0189517Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-06-26T07:12:14.0190754Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-06-26T07:12:14.0192066Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-06-26T07:12:14.0193087Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-06-26T07:12:14.0194100Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-06-26T07:12:14.0195268Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-06-26T07:12:14.0196453Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-06-26T07:12:14.0197751Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-06-26T07:12:14.0198962Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-06-26T07:12:14.0200426Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-06-26T07:12:14.0201652Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-06-26T07:12:14.0202707Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/ 2024-06-26T07:12:14.0203729Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/ 2024-06-26T07:12:14.0240186Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2024-06-26T07:12:14.0277953Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2024-06-26T07:12:14.0279414Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2024-06-26T07:12:14.0322125Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2024-06-26T07:12:14.0323541Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2024-06-26T07:12:14.0324994Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2024-06-26T07:12:14.0326491Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2024-06-26T07:12:14.0327934Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2024-06-26T07:12:14.0329347Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2024-06-26T07:12:14.0330749Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2024-06-26T07:12:14.0332349Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2024-06-26T07:12:14.0333730Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2024-06-26T07:12:14.0335037Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2024-06-26T07:12:14.0336290Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c 2024-06-26T07:12:14.0337764Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin 2024-06-26T07:12:14.0339018Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2024-06-26T07:12:14.0340227Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o 2024-06-26T07:12:14.0341468Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu 2024-06-26T07:12:14.0390612Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out 2024-06-26T07:12:14.0448363Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin 2024-06-26T07:12:14.0449662Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake 2024-06-26T07:12:14.0451652Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeScratch/ 2024-06-26T07:12:14.0453386Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeTmp/ 2024-06-26T07:12:14.0455203Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/cmake.check_cache 2024-06-26T07:12:14.0457391Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/ 2024-06-26T07:12:14.0459275Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.ts 2024-06-26T07:12:14.0460438Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.make 2024-06-26T07:12:14.0461560Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/depend.make 2024-06-26T07:12:14.0462605Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/link.txt 2024-06-26T07:12:14.0463685Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/cmake_clean.cmake 2024-06-26T07:12:14.0464786Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/build.make 2024-06-26T07:12:14.0465892Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/DependInfo.cmake 2024-06-26T07:12:14.0466992Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/flags.make 2024-06-26T07:12:14.0468075Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/progress.make 2024-06-26T07:12:14.0475369Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o.d 2024-06-26T07:12:14.0602502Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o 2024-06-26T07:12:14.0603520Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/ 2024-06-26T07:12:14.0604637Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.ts 2024-06-26T07:12:14.0605865Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.make 2024-06-26T07:12:14.0607046Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/depend.make 2024-06-26T07:12:14.0608154Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/link.txt 2024-06-26T07:12:14.0609461Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/cmake_clean.cmake 2024-06-26T07:12:14.0610627Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/build.make 2024-06-26T07:12:14.0611781Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/DependInfo.cmake 2024-06-26T07:12:14.0612938Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/flags.make 2024-06-26T07:12:14.0614079Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/progress.make 2024-06-26T07:12:14.0627887Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o.d 2024-06-26T07:12:14.0708104Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o 2024-06-26T07:12:14.0709785Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-06-26T07:12:14.0710966Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/TargetDirectories.txt 2024-06-26T07:12:14.0712063Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/progress.marks 2024-06-26T07:12:14.0712989Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile2 2024-06-26T07:12:14.0713897Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile.cmake 2024-06-26T07:12:14.0714797Z inflating: build/custom_test_artifacts/custom-op-build/detect_cuda_version.cc 2024-06-26T07:12:14.0715657Z inflating: build/custom_test_artifacts/custom-op-build/CMakeCache.txt 2024-06-26T07:12:14.0716453Z inflating: build/custom_test_artifacts/custom-op-build/Makefile 2024-06-26T07:12:14.0717277Z inflating: build/custom_test_artifacts/custom-op-build/cmake_install.cmake 2024-06-26T07:12:14.0822443Z inflating: build/custom_test_artifacts/custom-op-build/libcustom_ops.so 2024-06-26T07:12:14.0881608Z inflating: build/custom_test_artifacts/custom-op-build/test_custom_ops 2024-06-26T07:12:14.0882351Z creating: build/custom_test_artifacts/jit-hook-build/ 2024-06-26T07:12:14.0883058Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/ 2024-06-26T07:12:14.0883880Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/pkgRedirects/ 2024-06-26T07:12:14.0888884Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeConfigureLog.yaml 2024-06-26T07:12:14.0889819Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/ 2024-06-26T07:12:14.0890760Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-06-26T07:12:14.0891750Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-06-26T07:12:14.0892707Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-06-26T07:12:14.0894066Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-06-26T07:12:14.0895289Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-06-26T07:12:14.0896289Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-06-26T07:12:14.0897470Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-06-26T07:12:14.0898623Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-06-26T07:12:14.0899789Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-06-26T07:12:14.0900939Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-06-26T07:12:14.0902164Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-06-26T07:12:14.0903437Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-06-26T07:12:14.0904576Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-06-26T07:12:14.0905594Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/ 2024-06-26T07:12:14.0906581Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/ 2024-06-26T07:12:14.0940443Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2024-06-26T07:12:14.0978677Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2024-06-26T07:12:14.0980131Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2024-06-26T07:12:14.1022192Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2024-06-26T07:12:14.1023745Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2024-06-26T07:12:14.1025424Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2024-06-26T07:12:14.1027073Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2024-06-26T07:12:14.1028607Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2024-06-26T07:12:14.1030058Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2024-06-26T07:12:14.1031578Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2024-06-26T07:12:14.1032966Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2024-06-26T07:12:14.1034312Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2024-06-26T07:12:14.1035583Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2024-06-26T07:12:14.1036813Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c 2024-06-26T07:12:14.1038022Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin 2024-06-26T07:12:14.1039234Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2024-06-26T07:12:14.1040417Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o 2024-06-26T07:12:14.1041625Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu 2024-06-26T07:12:14.1088479Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out 2024-06-26T07:12:14.1147447Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin 2024-06-26T07:12:14.1149722Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake 2024-06-26T07:12:14.1151186Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeScratch/ 2024-06-26T07:12:14.1152368Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeTmp/ 2024-06-26T07:12:14.1153383Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/cmake.check_cache 2024-06-26T07:12:14.1154336Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/ 2024-06-26T07:12:14.1155392Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.ts 2024-06-26T07:12:14.1156712Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.make 2024-06-26T07:12:14.1157857Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/depend.make 2024-06-26T07:12:14.1158935Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/link.txt 2024-06-26T07:12:14.1160035Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/cmake_clean.cmake 2024-06-26T07:12:14.1161162Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/build.make 2024-06-26T07:12:14.1162283Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/DependInfo.cmake 2024-06-26T07:12:14.1163395Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/flags.make 2024-06-26T07:12:14.1164497Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/progress.make 2024-06-26T07:12:14.1171574Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o.d 2024-06-26T07:12:14.1233028Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o 2024-06-26T07:12:14.1234578Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-06-26T07:12:14.1235858Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/TargetDirectories.txt 2024-06-26T07:12:14.1252522Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/progress.marks 2024-06-26T07:12:14.1253702Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile2 2024-06-26T07:12:14.1254622Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile.cmake 2024-06-26T07:12:14.1255527Z inflating: build/custom_test_artifacts/jit-hook-build/detect_cuda_version.cc 2024-06-26T07:12:14.1256389Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeCache.txt 2024-06-26T07:12:14.1257436Z inflating: build/custom_test_artifacts/jit-hook-build/Makefile 2024-06-26T07:12:14.1258253Z inflating: build/custom_test_artifacts/jit-hook-build/cmake_install.cmake 2024-06-26T07:12:14.1286624Z inflating: build/custom_test_artifacts/jit-hook-build/test_jit_hooks 2024-06-26T07:12:14.1287557Z creating: build/custom_test_artifacts/custom-backend-build/ 2024-06-26T07:12:14.1288333Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/ 2024-06-26T07:12:14.1289216Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/pkgRedirects/ 2024-06-26T07:12:14.1294167Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeConfigureLog.yaml 2024-06-26T07:12:14.1295313Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/ 2024-06-26T07:12:14.1296351Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-06-26T07:12:14.1297924Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-06-26T07:12:14.1299220Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-06-26T07:12:14.1300394Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-06-26T07:12:14.1301820Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-06-26T07:12:14.1303104Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-06-26T07:12:14.1304486Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-06-26T07:12:14.1305880Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-06-26T07:12:14.1307573Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-06-26T07:12:14.1308785Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-06-26T07:12:14.1310006Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-06-26T07:12:14.1311348Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-06-26T07:12:14.1312590Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-06-26T07:12:14.1313689Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/ 2024-06-26T07:12:14.1314760Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/ 2024-06-26T07:12:14.1346430Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2024-06-26T07:12:14.1384237Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2024-06-26T07:12:14.1385856Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2024-06-26T07:12:14.1428388Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2024-06-26T07:12:14.1430258Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2024-06-26T07:12:14.1431847Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2024-06-26T07:12:14.1433371Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2024-06-26T07:12:14.1434849Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2024-06-26T07:12:14.1453099Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2024-06-26T07:12:14.1454588Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2024-06-26T07:12:14.1456057Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2024-06-26T07:12:14.1457871Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2024-06-26T07:12:14.1459361Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2024-06-26T07:12:14.1460676Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c 2024-06-26T07:12:14.1461969Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin 2024-06-26T07:12:14.1463272Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2024-06-26T07:12:14.1464535Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o 2024-06-26T07:12:14.1465821Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu 2024-06-26T07:12:14.1517040Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out 2024-06-26T07:12:14.1574907Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin 2024-06-26T07:12:14.1576158Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake 2024-06-26T07:12:14.1577671Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeScratch/ 2024-06-26T07:12:14.1578606Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeTmp/ 2024-06-26T07:12:14.1579580Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/cmake.check_cache 2024-06-26T07:12:14.1580584Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/ 2024-06-26T07:12:14.1581702Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.ts 2024-06-26T07:12:14.1582942Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.make 2024-06-26T07:12:14.1584143Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/depend.make 2024-06-26T07:12:14.1585272Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/link.txt 2024-06-26T07:12:14.1586451Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/cmake_clean.cmake 2024-06-26T07:12:14.1587742Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/build.make 2024-06-26T07:12:14.1588996Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/DependInfo.cmake 2024-06-26T07:12:14.1590180Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/flags.make 2024-06-26T07:12:14.1591458Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/progress.make 2024-06-26T07:12:14.1592689Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o.d 2024-06-26T07:12:14.1705252Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o 2024-06-26T07:12:14.1706524Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/ 2024-06-26T07:12:14.1707712Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.ts 2024-06-26T07:12:14.1709020Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.make 2024-06-26T07:12:14.1710330Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/depend.make 2024-06-26T07:12:14.1711653Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/link.txt 2024-06-26T07:12:14.1712900Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/cmake_clean.cmake 2024-06-26T07:12:14.1714142Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/build.make 2024-06-26T07:12:14.1715380Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/DependInfo.cmake 2024-06-26T07:12:14.1716625Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/flags.make 2024-06-26T07:12:14.1717853Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/progress.make 2024-06-26T07:12:14.1728867Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o.d 2024-06-26T07:12:14.1781661Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o 2024-06-26T07:12:14.1782947Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-06-26T07:12:14.1784095Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/TargetDirectories.txt 2024-06-26T07:12:14.1785247Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/progress.marks 2024-06-26T07:12:14.1786347Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile2 2024-06-26T07:12:14.1787313Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile.cmake 2024-06-26T07:12:14.1788278Z inflating: build/custom_test_artifacts/custom-backend-build/detect_cuda_version.cc 2024-06-26T07:12:14.1789195Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeCache.txt 2024-06-26T07:12:14.1790040Z inflating: build/custom_test_artifacts/custom-backend-build/Makefile 2024-06-26T07:12:14.1791054Z inflating: build/custom_test_artifacts/custom-backend-build/cmake_install.cmake 2024-06-26T07:12:14.1887127Z inflating: build/custom_test_artifacts/custom-backend-build/libcustom_backend.so 2024-06-26T07:12:14.1928381Z inflating: build/custom_test_artifacts/custom-backend-build/test_custom_backend 2024-06-26T07:12:14.1929540Z creating: build/lib/ 2024-06-26T07:12:14.2013643Z inflating: build/lib/libprotobuf-lite.a 2024-06-26T07:12:14.2451213Z inflating: build/lib/libprotobuf.a 2024-06-26T07:12:14.2460825Z inflating: build/lib/libpthreadpool.a 2024-06-26T07:12:14.2468478Z inflating: build/lib/libcpuinfo.a 2024-06-26T07:12:14.2476147Z inflating: build/lib/libcpuinfo_internals.a 2024-06-26T07:12:14.2476968Z inflating: build/lib/libclog.a 2024-06-26T07:12:14.2494238Z inflating: build/lib/libnnpack.a 2024-06-26T07:12:14.2496239Z inflating: build/lib/libnnpack_reference_layers.a 2024-06-26T07:12:14.2558647Z inflating: build/lib/libgtest.a 2024-06-26T07:12:14.2630452Z inflating: build/lib/libbenchmark.a 2024-06-26T07:12:14.2692567Z inflating: build/lib/libasmjit.a 2024-06-26T07:12:14.2699320Z inflating: build/lib/libittnotify.a 2024-06-26T07:12:14.2725695Z inflating: build/lib/libtensorpipe_uv.a 2024-06-26T07:12:14.2848757Z inflating: build/lib/libgloo.a 2024-06-26T07:12:14.2869143Z inflating: build/lib/libfmt.a 2024-06-26T07:12:14.2957985Z inflating: build/lib/libc10.so 2024-06-26T07:12:14.2959523Z inflating: build/lib/libcaffe2_nvrtc.so 2024-06-26T07:12:14.2960131Z inflating: build/lib/libfoxi_loader.a 2024-06-26T07:12:14.2961011Z inflating: build/lib/libtorch_global_deps.so 2024-06-26T07:12:14.2980121Z inflating: build/lib/libpytorch_qnnpack.a 2024-06-26T07:12:14.2997285Z inflating: build/lib/libgmock.a 2024-06-26T07:12:14.2997924Z inflating: build/lib/libgtest_main.a 2024-06-26T07:12:14.2998515Z inflating: build/lib/libbenchmark_main.a 2024-06-26T07:12:14.3483330Z inflating: build/lib/libprotoc.a 2024-06-26T07:12:14.3853528Z inflating: build/lib/libgloo_cuda.a 2024-06-26T07:12:15.3557969Z inflating: build/lib/libdnnl.a 2024-06-26T07:12:15.4106555Z inflating: build/lib/libtensorpipe.a 2024-06-26T07:12:15.4158918Z inflating: build/lib/libc10_cuda.so 2024-06-26T07:12:15.4159406Z inflating: build/lib/libgmock_main.a 2024-06-26T07:12:15.5357823Z inflating: build/lib/libfbgemm.a 2024-06-26T07:12:15.5602335Z inflating: build/lib/libtensorpipe_cuda.a 2024-06-26T07:12:15.6098919Z inflating: build/lib/libkineto.a 2024-06-26T07:12:15.6275836Z inflating: build/lib/libXNNPACK.a 2024-06-26T07:12:15.6316613Z inflating: build/lib/libonnx_proto.a 2024-06-26T07:12:15.6980785Z inflating: build/lib/libonnx.a 2024-06-26T07:12:18.0201221Z inflating: build/lib/libtorch_cpu.so 2024-06-26T07:12:18.0205920Z inflating: build/lib/libunbox_lib.a 2024-06-26T07:12:18.0210661Z inflating: build/lib/libshm.so 2024-06-26T07:12:20.0035479Z inflating: build/lib/libtorch_cuda.so 2024-06-26T07:12:20.0036475Z inflating: build/lib/libtorch.so 2024-06-26T07:12:20.7962614Z inflating: build/lib/libtorch_cuda_linalg.so 2024-06-26T07:12:20.7964175Z inflating: build/lib/libc10d_cuda_test.so 2024-06-26T07:12:20.9857683Z inflating: build/lib/libtorch_python.so 2024-06-26T07:12:20.9923443Z inflating: build/lib/libtorchbind_test.so 2024-06-26T07:12:20.9943495Z inflating: build/lib/libjitbackend_test.so 2024-06-26T07:12:20.9968230Z inflating: build/lib/libbackend_with_compiler.so 2024-06-26T07:12:21.0001655Z inflating: build/lib/libnnapi_backend.so 2024-06-26T07:12:21.0002244Z creating: build/bin/ 2024-06-26T07:12:21.0050641Z inflating: build/bin/c10_CompileTimeFunctionPointer_test 2024-06-26T07:12:21.0100914Z inflating: build/bin/c10_DeviceGuard_test 2024-06-26T07:12:21.0149080Z inflating: build/bin/c10_Device_test 2024-06-26T07:12:21.0206828Z inflating: build/bin/c10_DispatchKeySet_test 2024-06-26T07:12:21.0258697Z inflating: build/bin/c10_Scalar_test 2024-06-26T07:12:21.0305789Z inflating: build/bin/c10_StreamGuard_test 2024-06-26T07:12:21.0358822Z inflating: build/bin/c10_InlineDeviceGuard_test 2024-06-26T07:12:21.0408019Z inflating: build/bin/c10_SymInt_test 2024-06-26T07:12:21.0462204Z inflating: build/bin/c10_InlineStreamGuard_test 2024-06-26T07:12:21.0516909Z inflating: build/bin/c10_SizesAndStrides_test 2024-06-26T07:12:21.0567902Z inflating: build/bin/c10_Bitset_test 2024-06-26T07:12:21.0637390Z inflating: build/bin/c10_cow_test 2024-06-26T07:12:21.0684506Z inflating: build/bin/c10_ConstexprCrc_test 2024-06-26T07:12:21.0733447Z inflating: build/bin/c10_DeadlockDetection_test 2024-06-26T07:12:21.0782142Z inflating: build/bin/c10_Half_test 2024-06-26T07:12:21.0836690Z inflating: build/bin/c10_LeftRight_test 2024-06-26T07:12:21.0890454Z inflating: build/bin/c10_Metaprogramming_test 2024-06-26T07:12:21.0939265Z inflating: build/bin/c10_Synchronized_test 2024-06-26T07:12:21.0992840Z inflating: build/bin/c10_ThreadLocal_test 2024-06-26T07:12:21.1042724Z inflating: build/bin/c10_TypeIndex_test 2024-06-26T07:12:21.1092636Z inflating: build/bin/c10_TypeList_test 2024-06-26T07:12:21.1139803Z inflating: build/bin/c10_TypeTraits_test 2024-06-26T07:12:21.1190000Z inflating: build/bin/c10_accumulate_test 2024-06-26T07:12:21.1243625Z inflating: build/bin/c10_bfloat16_test 2024-06-26T07:12:21.1292861Z inflating: build/bin/c10_bit_cast_test 2024-06-26T07:12:21.1347552Z inflating: build/bin/c10_complex_math_test 2024-06-26T07:12:21.1401678Z inflating: build/bin/c10_complex_test 2024-06-26T07:12:21.1453207Z inflating: build/bin/c10_exception_test 2024-06-26T07:12:21.1501604Z inflating: build/bin/c10_flags_test 2024-06-26T07:12:21.1550085Z inflating: build/bin/c10_generic_math_test 2024-06-26T07:12:21.1708332Z inflating: build/bin/c10_intrusive_ptr_test 2024-06-26T07:12:21.1757780Z inflating: build/bin/c10_irange_test 2024-06-26T07:12:21.1809684Z inflating: build/bin/c10_lazy_test 2024-06-26T07:12:21.1865159Z inflating: build/bin/c10_logging_test 2024-06-26T07:12:21.1938141Z inflating: build/bin/c10_optional_test 2024-06-26T07:12:21.1998786Z inflating: build/bin/c10_ordered_preserving_dict_test 2024-06-26T07:12:21.2050556Z inflating: build/bin/c10_registry_test 2024-06-26T07:12:21.2196828Z inflating: build/bin/c10_small_vector_test 2024-06-26T07:12:21.2246322Z inflating: build/bin/c10_ssize_test 2024-06-26T07:12:21.2296735Z inflating: build/bin/c10_string_util_test 2024-06-26T07:12:21.2354059Z inflating: build/bin/c10_string_view_test 2024-06-26T07:12:21.2402991Z inflating: build/bin/c10_tempfile_test 2024-06-26T07:12:21.2450227Z inflating: build/bin/c10_intrusive_ptr_benchmark 2024-06-26T07:12:21.2504571Z inflating: build/bin/c10_typeid_test 2024-06-26T07:12:21.2936008Z inflating: build/bin/protoc-3.13.0.0 2024-06-26T07:12:21.3367752Z inflating: build/bin/protoc 2024-06-26T07:12:21.3419370Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_1_var_test 2024-06-26T07:12:21.3470580Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_catches_stream 2024-06-26T07:12:21.3521757Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_catches_thread_and_block_and_device 2024-06-26T07:12:21.3572766Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_from_2_processes 2024-06-26T07:12:21.3623793Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_blocks_and_threads 2024-06-26T07:12:21.3675665Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_multiple_blocks 2024-06-26T07:12:21.3722352Z inflating: build/bin/c10_cuda_CUDATest 2024-06-26T07:12:21.3773448Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_same_block 2024-06-26T07:12:21.4091349Z inflating: build/bin/vec_test_all_types_DEFAULT 2024-06-26T07:12:21.4423666Z inflating: build/bin/vec_test_all_types_AVX512 2024-06-26T07:12:21.4769300Z inflating: build/bin/vec_test_all_types_AVX2 2024-06-26T07:12:21.4820676Z inflating: build/bin/FileStoreTest 2024-06-26T07:12:21.4874740Z inflating: build/bin/TCPStoreTest 2024-06-26T07:12:21.4926629Z inflating: build/bin/HashStoreTest 2024-06-26T07:12:21.4939941Z inflating: build/bin/ProcessGroupMPITest 2024-06-26T07:12:21.4992289Z inflating: build/bin/test_edge_op_registration 2024-06-26T07:12:21.4996433Z inflating: build/bin/torch_shm_manager 2024-06-26T07:12:21.4999267Z inflating: build/bin/example_allreduce 2024-06-26T07:12:21.5052962Z inflating: build/bin/test_dist_autograd 2024-06-26T07:12:21.5120490Z inflating: build/bin/test_cpp_rpc 2024-06-26T07:12:21.5122417Z inflating: build/bin/parallel_benchmark 2024-06-26T07:12:21.5187399Z inflating: build/bin/test_mobile_nnc 2024-06-26T07:12:21.5196263Z inflating: build/bin/aot_model_compiler_test 2024-06-26T07:12:21.5529091Z inflating: build/bin/test_lazy 2024-06-26T07:12:21.6670425Z inflating: build/bin/test_api 2024-06-26T07:12:21.6741910Z inflating: build/bin/Dict_test 2024-06-26T07:12:21.6792450Z inflating: build/bin/Dimname_test 2024-06-26T07:12:21.6855485Z inflating: build/bin/MaybeOwned_test 2024-06-26T07:12:21.6910881Z inflating: build/bin/NamedTensor_test 2024-06-26T07:12:21.6968170Z inflating: build/bin/apply_utils_test 2024-06-26T07:12:21.7025540Z inflating: build/bin/atest 2024-06-26T07:12:21.7086709Z inflating: build/bin/basic 2024-06-26T07:12:21.7140024Z inflating: build/bin/broadcast_test 2024-06-26T07:12:21.7189431Z inflating: build/bin/cpu_allocator_test 2024-06-26T07:12:21.7245898Z inflating: build/bin/cpu_generator_test 2024-06-26T07:12:21.7298463Z inflating: build/bin/cpu_profiling_allocator_test 2024-06-26T07:12:21.7388059Z inflating: build/bin/cpu_rng_test 2024-06-26T07:12:21.7436751Z inflating: build/bin/dispatch_key_set_test 2024-06-26T07:12:21.7485471Z inflating: build/bin/dlconvertor_test 2024-06-26T07:12:21.7542065Z inflating: build/bin/extension_backend_test 2024-06-26T07:12:21.7595565Z inflating: build/bin/half_test 2024-06-26T07:12:21.7688363Z inflating: build/bin/ivalue_test 2024-06-26T07:12:21.7736585Z inflating: build/bin/lazy_tensor_test 2024-06-26T07:12:21.7789482Z inflating: build/bin/math_kernel_test 2024-06-26T07:12:21.7842125Z inflating: build/bin/memory_format_test 2024-06-26T07:12:21.7894084Z inflating: build/bin/memory_overlapping_test 2024-06-26T07:12:21.7945168Z inflating: build/bin/mobile_memory_cleanup 2024-06-26T07:12:21.8000114Z inflating: build/bin/native_test 2024-06-26T07:12:21.8048602Z inflating: build/bin/operator_name_test 2024-06-26T07:12:21.8099121Z inflating: build/bin/operators_test 2024-06-26T07:12:21.8148927Z inflating: build/bin/packedtensoraccessor_test 2024-06-26T07:12:21.8214777Z inflating: build/bin/pow_test 2024-06-26T07:12:21.8270057Z inflating: build/bin/quantized_test 2024-06-26T07:12:21.8318853Z inflating: build/bin/reduce_ops_test 2024-06-26T07:12:21.8368503Z inflating: build/bin/reportMemoryUsage_test 2024-06-26T07:12:21.8423665Z inflating: build/bin/scalar_tensor_test 2024-06-26T07:12:21.8480456Z inflating: build/bin/scalar_test 2024-06-26T07:12:21.8530804Z inflating: build/bin/StorageUtils_test 2024-06-26T07:12:21.8581846Z inflating: build/bin/stride_properties_test 2024-06-26T07:12:21.8658185Z inflating: build/bin/tensor_iterator_test 2024-06-26T07:12:21.8710725Z inflating: build/bin/test_parallel 2024-06-26T07:12:21.8714210Z inflating: build/bin/thread_init_test 2024-06-26T07:12:21.8768012Z inflating: build/bin/type_ptr_test 2024-06-26T07:12:21.8826025Z inflating: build/bin/type_test 2024-06-26T07:12:21.8877210Z inflating: build/bin/undefined_tensor_test 2024-06-26T07:12:21.8878371Z inflating: build/bin/verify_api_visibility 2024-06-26T07:12:21.8945224Z inflating: build/bin/legacy_vmap_test 2024-06-26T07:12:21.8995237Z inflating: build/bin/weakref_test 2024-06-26T07:12:21.9045426Z inflating: build/bin/wrapdim_test 2024-06-26T07:12:21.9095770Z inflating: build/bin/xla_tensor_test 2024-06-26T07:12:21.9153546Z inflating: build/bin/IListRef_test 2024-06-26T07:12:21.9256013Z inflating: build/bin/List_test 2024-06-26T07:12:21.9320554Z inflating: build/bin/KernelFunction_test 2024-06-26T07:12:21.9438586Z inflating: build/bin/kernel_function_legacy_test 2024-06-26T07:12:21.9532030Z inflating: build/bin/kernel_function_test 2024-06-26T07:12:21.9656466Z inflating: build/bin/kernel_lambda_legacy_test 2024-06-26T07:12:21.9756902Z inflating: build/bin/kernel_lambda_test 2024-06-26T07:12:21.9815696Z inflating: build/bin/kernel_stackbased_test 2024-06-26T07:12:21.9908014Z inflating: build/bin/make_boxed_from_unboxed_functor_test 2024-06-26T07:12:21.9957416Z inflating: build/bin/CppSignature_test 2024-06-26T07:12:22.0011679Z inflating: build/bin/backend_fallback_test 2024-06-26T07:12:22.0058965Z inflating: build/bin/op_allowlist_test 2024-06-26T07:12:22.0349964Z inflating: build/bin/op_registration_test 2024-06-26T07:12:22.0411965Z inflating: build/bin/inline_container_test 2024-06-26T07:12:22.0463018Z inflating: build/bin/cuda_apply_test 2024-06-26T07:12:22.0512383Z inflating: build/bin/cuda_allocator_test 2024-06-26T07:12:22.0569740Z inflating: build/bin/cuda_atomic_ops_test 2024-06-26T07:12:22.0622525Z inflating: build/bin/cuda_caching_host_allocator_test 2024-06-26T07:12:22.0690193Z inflating: build/bin/cuda_complex_math_test 2024-06-26T07:12:22.0747536Z inflating: build/bin/cuda_complex_test 2024-06-26T07:12:22.0796080Z inflating: build/bin/cuda_device_test 2024-06-26T07:12:22.0851088Z inflating: build/bin/cuda_cub_test 2024-06-26T07:12:22.0900782Z inflating: build/bin/cuda_dlconvertor_test 2024-06-26T07:12:22.0963072Z inflating: build/bin/cuda_distributions_test 2024-06-26T07:12:22.1018382Z inflating: build/bin/cuda_generator_test 2024-06-26T07:12:22.1066327Z inflating: build/bin/cuda_half_test 2024-06-26T07:12:22.1115840Z inflating: build/bin/cuda_integer_divider_test 2024-06-26T07:12:22.1163369Z inflating: build/bin/cuda_optional_test 2024-06-26T07:12:22.1213234Z inflating: build/bin/cuda_packedtensoraccessor_test 2024-06-26T07:12:22.1264326Z inflating: build/bin/cuda_reportMemoryUsage_test 2024-06-26T07:12:22.1312565Z inflating: build/bin/cuda_allocatorTraceTracker_test 2024-06-26T07:12:22.1371853Z inflating: build/bin/cuda_stream_test 2024-06-26T07:12:22.1420116Z inflating: build/bin/cuda_cudnn_test 2024-06-26T07:12:22.1469971Z inflating: build/bin/cuda_vectorized_test 2024-06-26T07:12:22.1484504Z inflating: build/bin/tutorial_tensorexpr 2024-06-26T07:12:22.1548100Z inflating: build/bin/ProcessGroupGlooTest 2024-06-26T07:12:22.1604125Z inflating: build/bin/ProcessGroupGlooAsyncTest 2024-06-26T07:12:22.1664921Z inflating: build/bin/ProcessGroupNCCLTest 2024-06-26T07:12:22.1725063Z inflating: build/bin/ProcessGroupNCCLErrorsTest 2024-06-26T07:12:22.2529055Z inflating: build/bin/test_tensorexpr 2024-06-26T07:12:22.3088273Z inflating: build/bin/test_jit 2024-06-26T07:12:22.3088770Z creating: .additional_ci_files/ 2024-06-26T07:12:22.3141702Z inflating: .additional_ci_files/test-times.json 2024-06-26T07:12:22.3352800Z inflating: .additional_ci_files/test-class-times.json 2024-06-26T07:12:22.3379860Z ##[group]Run rm artifacts.zip 2024-06-26T07:12:22.3380265Z rm artifacts.zip 2024-06-26T07:12:22.3389105Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:12:22.3389618Z env: 2024-06-26T07:12:22.3389914Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:12:22.3390387Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:12:22.3390968Z ##[endgroup] 2024-06-26T07:12:22.4099737Z ##[group]Run df -H 2024-06-26T07:12:22.4100075Z df -H 2024-06-26T07:12:22.4107766Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:12:22.4108279Z env: 2024-06-26T07:12:22.4108568Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:12:22.4109035Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:12:22.4109518Z ##[endgroup] 2024-06-26T07:12:22.4135953Z Filesystem Size Used Avail Use% Mounted on 2024-06-26T07:12:22.4136522Z devtmpfs 34G 0 34G 0% /dev 2024-06-26T07:12:22.4137302Z tmpfs 34G 0 34G 0% /dev/shm 2024-06-26T07:12:22.4138191Z tmpfs 34G 455k 34G 1% /run 2024-06-26T07:12:22.4138712Z tmpfs 34G 0 34G 0% /sys/fs/cgroup 2024-06-26T07:12:22.4139209Z /dev/nvme0n1p1 162G 44G 118G 27% / 2024-06-26T07:12:22.4176536Z Prepare all required actions 2024-06-26T07:12:22.4177138Z Getting action download info 2024-06-26T07:12:22.5542297Z ##[group]Run ./.github/actions/download-td-artifacts 2024-06-26T07:12:22.5542764Z with: 2024-06-26T07:12:22.5543019Z env: 2024-06-26T07:12:22.5543292Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:12:22.5543744Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:12:22.5544215Z ##[endgroup] 2024-06-26T07:12:22.5575510Z ##[group]Run seemethere/download-artifact-s3@v4 2024-06-26T07:12:22.5575968Z with: 2024-06-26T07:12:22.5576245Z name: td_results 2024-06-26T07:12:22.5576575Z s3-bucket: gha-artifacts 2024-06-26T07:12:22.5577088Z region: us-east-1 2024-06-26T07:12:22.5577402Z env: 2024-06-26T07:12:22.5577686Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:12:22.5578165Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:12:22.5578658Z ##[endgroup] 2024-06-26T07:12:22.9599507Z (node:27503) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2024-06-26T07:12:22.9600331Z 2024-06-26T07:12:22.9600608Z Please migrate your code to use AWS SDK for JavaScript (v3). 2024-06-26T07:12:22.9601354Z For more information, check the migration guide at https://a.co/7PzMCcy 2024-06-26T07:12:22.9602268Z (Use `node --trace-warnings ...` to show where the warning was created) 2024-06-26T07:12:23.0316214Z Found 0 objects with prefix pytorch/pytorch/9673646806/td_results/ 2024-06-26T07:12:23.0323152Z Artifact download has finished successfully 2024-06-26T07:12:23.0466439Z ##[group]Run mkdir -p .additional_ci_files 2024-06-26T07:12:23.0466961Z mkdir -p .additional_ci_files 2024-06-26T07:12:23.0467529Z mv td_results.json .additional_ci_files/td_results.json 2024-06-26T07:12:23.0475787Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:12:23.0476304Z env: 2024-06-26T07:12:23.0476602Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:12:23.0477096Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:12:23.0477617Z ##[endgroup] 2024-06-26T07:12:23.0511698Z mv: cannot stat 'td_results.json': No such file or directory 2024-06-26T07:12:23.0525318Z ##[error]Process completed with exit code 1. 2024-06-26T07:12:23.0557695Z ##[group]Run .github/scripts/parse_ref.py 2024-06-26T07:12:23.0558189Z .github/scripts/parse_ref.py 2024-06-26T07:12:23.0564904Z shell: /usr/bin/bash -e {0} 2024-06-26T07:12:23.0565267Z env: 2024-06-26T07:12:23.0565569Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:12:23.0566052Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:12:23.0566554Z ##[endgroup] 2024-06-26T07:12:23.0795299Z Prepare all required actions 2024-06-26T07:12:23.0832725Z ##[group]Run ./.github/actions/get-workflow-job-id 2024-06-26T07:12:23.0833337Z with: 2024-06-26T07:12:23.0833912Z github-token: *** 2024-06-26T07:12:23.0834245Z env: 2024-06-26T07:12:23.0834542Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:12:23.0835016Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:12:23.0835513Z ##[endgroup] 2024-06-26T07:12:23.0850829Z ##[group]Run set -eux 2024-06-26T07:12:23.0851185Z set -eux 2024-06-26T07:12:23.0851784Z python3 .github/scripts/get_workflow_job_id.py "${GITHUB_RUN_ID}" "${RUNNER_NAME}" 2024-06-26T07:12:23.0859975Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:12:23.0860482Z env: 2024-06-26T07:12:23.0860780Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:12:23.0861243Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:12:23.0861906Z GITHUB_TOKEN: *** 2024-06-26T07:12:23.0862234Z ##[endgroup] 2024-06-26T07:12:23.0881330Z + python3 .github/scripts/get_workflow_job_id.py 9673646806 i-0e78f3ec154b9b15a 2024-06-26T07:12:23.6870629Z setting job-id=26688916732 2024-06-26T07:12:23.6871654Z setting job-name=cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (aot_eager_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-06-26T07:12:23.7066268Z Prepare all required actions 2024-06-26T07:12:23.7066718Z Getting action download info 2024-06-26T07:12:23.8114631Z ##[group]Run ./.github/actions/filter-test-configs 2024-06-26T07:12:23.8115088Z with: 2024-06-26T07:12:23.8115555Z github-token: *** 2024-06-26T07:12:23.8122116Z test-matrix: {"include": [{"config": "dynamo_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}]} 2024-06-26T07:12:23.8129469Z job-name: cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (aot_eager_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-06-26T07:12:23.8130326Z env: 2024-06-26T07:12:23.8130608Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:12:23.8131066Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:12:23.8131562Z ##[endgroup] 2024-06-26T07:12:23.8172676Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2024-06-26T07:12:23.8173234Z with: 2024-06-26T07:12:23.8173518Z shell: bash 2024-06-26T07:12:23.8173829Z timeout_minutes: 10 2024-06-26T07:12:23.8174166Z max_attempts: 5 2024-06-26T07:12:23.8174488Z retry_wait_seconds: 30 2024-06-26T07:12:23.8175606Z command: set -eux # PyYAML 6.0 doesn't work with MacOS x86 anymore # This must run on Python-3.7 (AmazonLinux2) so can't use request=3.32.2 python3 -m pip install requests==2.27.1 pyyaml==6.0.1 2024-06-26T07:12:23.8177066Z polling_interval_seconds: 1 2024-06-26T07:12:23.8177460Z warning_on_retry: true 2024-06-26T07:12:23.8177817Z continue_on_error: false 2024-06-26T07:12:23.8178166Z env: 2024-06-26T07:12:23.8178454Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:12:23.8178911Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:12:23.8179554Z GITHUB_TOKEN: *** 2024-06-26T07:12:23.8179878Z ##[endgroup] 2024-06-26T07:12:23.8659578Z + python3 -m pip install requests==2.27.1 pyyaml==6.0.1 2024-06-26T07:12:24.0802188Z Defaulting to user installation because normal site-packages is not writeable 2024-06-26T07:12:24.0958677Z Requirement already satisfied: requests==2.27.1 in /home/ec2-user/.local/lib/python3.7/site-packages (2.27.1) 2024-06-26T07:12:24.1101157Z Requirement already satisfied: pyyaml==6.0.1 in /home/ec2-user/.local/lib/python3.7/site-packages (6.0.1) 2024-06-26T07:12:24.1109846Z Requirement already satisfied: charset-normalizer~=2.0.0; python_version >= "3" in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.27.1) (2.0.12) 2024-06-26T07:12:24.1130379Z Requirement already satisfied: certifi>=2017.4.17 in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.27.1) (2024.6.2) 2024-06-26T07:12:24.1138920Z Requirement already satisfied: idna<4,>=2.5; python_version >= "3" in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.27.1) (3.7) 2024-06-26T07:12:24.1150171Z Requirement already satisfied: urllib3<1.27,>=1.21.1 in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.27.1) (1.26.19) 2024-06-26T07:12:24.8661833Z Command completed after 1 attempt(s). 2024-06-26T07:12:24.8701393Z ##[group]Run set -x 2024-06-26T07:12:24.8701740Z set -x 2024-06-26T07:12:24.8702056Z  2024-06-26T07:12:24.8702617Z # Use relative path here as this could be checked out anywhere, not necessarily 2024-06-26T07:12:24.8703297Z # in runner workspace 2024-06-26T07:12:24.8703838Z python3 "${GITHUB_ACTION_PATH}/../../scripts/parse_ref.py" 2024-06-26T07:12:24.8711767Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:12:24.8712277Z env: 2024-06-26T07:12:24.8712577Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:12:24.8713040Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:12:24.8713530Z ##[endgroup] 2024-06-26T07:12:24.8733630Z + python3 /home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/filter-test-configs/../../scripts/parse_ref.py 2024-06-26T07:12:24.8949083Z ##[group]Run echo "Workflow: ${GITHUB_WORKFLOW}" 2024-06-26T07:12:24.8949648Z echo "Workflow: ${GITHUB_WORKFLOW}" 2024-06-26T07:12:24.8950129Z echo "Job name: ${JOB_NAME}" 2024-06-26T07:12:24.8950620Z  2024-06-26T07:12:24.8951171Z # Use relative path here as this could be checked out anywhere, not necessarily 2024-06-26T07:12:24.8951874Z # in runner workspace 2024-06-26T07:12:24.8952497Z python3 "${GITHUB_ACTION_PATH}/../../scripts/filter_test_configs.py" \ 2024-06-26T07:12:24.8953165Z  --workflow "${GITHUB_WORKFLOW}" \ 2024-06-26T07:12:24.8953627Z  --job-name "${JOB_NAME}" \ 2024-06-26T07:12:24.8960401Z  --test-matrix "{"include": [{"config": "dynamo_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}]}" \ 2024-06-26T07:12:24.8967550Z  --selected-test-configs "" \ 2024-06-26T07:12:24.8968024Z  --pr-number "${PR_NUMBER}" \ 2024-06-26T07:12:24.8968455Z  --tag "${TAG}" \ 2024-06-26T07:12:24.8968864Z  --event-name "${EVENT_NAME}" \ 2024-06-26T07:12:24.8969325Z  --schedule "${SCHEDULE}" \ 2024-06-26T07:12:24.8969880Z  --branch "${HEAD_BRANCH}" 2024-06-26T07:12:24.8977703Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:12:24.8978210Z env: 2024-06-26T07:12:24.8978507Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:12:24.8978986Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:12:24.8979676Z GITHUB_TOKEN: *** 2024-06-26T07:12:24.8980484Z JOB_NAME: cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (aot_eager_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-06-26T07:12:24.8981347Z PR_NUMBER: 2024-06-26T07:12:24.8981690Z TAG: ciflow/inductor/129470 2024-06-26T07:12:24.8982086Z EVENT_NAME: push 2024-06-26T07:12:24.8982417Z SCHEDULE: 2024-06-26T07:12:24.8982732Z HEAD_BRANCH: 2024-06-26T07:12:24.8983049Z ##[endgroup] 2024-06-26T07:12:24.9002648Z Workflow: inductor-periodic 2024-06-26T07:12:24.9003631Z Job name: cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (aot_eager_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-06-26T07:12:25.1027244Z INFO:root:Found no test-config label on the PR, so all test configs are included 2024-06-26T07:12:25.2446322Z ##[group]Run echo "Filtered matrix:" 2024-06-26T07:12:25.2446794Z echo "Filtered matrix:" 2024-06-26T07:12:25.2453381Z echo "{"include": [{"config": "dynamo_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}]}" 2024-06-26T07:12:25.2460670Z  2024-06-26T07:12:25.2460962Z echo 2024-06-26T07:12:25.2461364Z echo "Is the current job unstable? False" 2024-06-26T07:12:25.2461829Z  2024-06-26T07:12:25.2462115Z echo 2024-06-26T07:12:25.2462490Z echo "Is keep-going label set? False" 2024-06-26T07:12:25.2462944Z  2024-06-26T07:12:25.2463223Z echo 2024-06-26T07:12:25.2463552Z echo "Renabled issues? " 2024-06-26T07:12:25.2471322Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:12:25.2471837Z env: 2024-06-26T07:12:25.2472123Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:12:25.2472591Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:12:25.2473140Z ##[endgroup] 2024-06-26T07:12:25.2492570Z Filtered matrix: 2024-06-26T07:12:25.2501213Z {include: [{config: dynamo_eager_torchbench, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamo_eager_torchbench, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamo_eager_huggingface, shard: 1, num_shards: 1, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamo_eager_timm, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamo_eager_timm, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: aot_eager_torchbench, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: aot_eager_torchbench, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: aot_eager_huggingface, shard: 1, num_shards: 1, runner: linux.g5.4xlarge.nvidia.gpu}, {config: aot_eager_timm, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: aot_eager_timm, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_aot_eager_torchbench, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_aot_eager_torchbench, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_aot_eager_huggingface, shard: 1, num_shards: 1, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_aot_eager_timm, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_aot_eager_timm, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}]} 2024-06-26T07:12:25.2507936Z 2024-06-26T07:12:25.2508094Z Is the current job unstable? False 2024-06-26T07:12:25.2508386Z 2024-06-26T07:12:25.2508645Z Is keep-going label set? False 2024-06-26T07:12:25.2508904Z 2024-06-26T07:12:25.2509041Z Renabled issues? 2024-06-26T07:12:25.2549021Z ##[group]Run echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2024-06-26T07:12:25.2549730Z echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2024-06-26T07:12:25.2557269Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:12:25.2557767Z env: 2024-06-26T07:12:25.2558061Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:12:25.2558524Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:12:25.2559028Z JOB_TIMEOUT: 240 2024-06-26T07:12:25.2559342Z ##[endgroup] 2024-06-26T07:12:25.2629585Z ##[group]Run set -x 2024-06-26T07:12:25.2629995Z set -x 2024-06-26T07:12:25.2630313Z  2024-06-26T07:12:25.2630779Z if [[ $TEST_CONFIG == 'multigpu' ]]; then 2024-06-26T07:12:25.2631338Z  TEST_COMMAND=.ci/pytorch/multigpu-test.sh 2024-06-26T07:12:25.2631915Z elif [[ $BUILD_ENVIRONMENT == *onnx* ]]; then 2024-06-26T07:12:25.2632497Z  TEST_COMMAND=.ci/onnx/test.sh 2024-06-26T07:12:25.2632930Z else 2024-06-26T07:12:25.2633286Z  TEST_COMMAND=.ci/pytorch/test.sh 2024-06-26T07:12:25.2633724Z fi 2024-06-26T07:12:25.2634023Z  2024-06-26T07:12:25.2634508Z # detached container should get cleaned up by teardown_ec2_linux 2024-06-26T07:12:25.2635274Z # TODO: Stop building test binaries as part of the build phase 2024-06-26T07:12:25.2635972Z # Used for GPU_FLAG since that doesn't play nice 2024-06-26T07:12:25.2636707Z # shellcheck disable=SC2086,SC2090 2024-06-26T07:12:25.2637183Z container_name=$(docker run \ 2024-06-26T07:12:25.2637621Z  ${GPU_FLAG:-} \ 2024-06-26T07:12:25.2638016Z  -e BUILD_ENVIRONMENT \ 2024-06-26T07:12:25.2638435Z  -e PR_NUMBER \ 2024-06-26T07:12:25.2638807Z  -e GITHUB_ACTIONS \ 2024-06-26T07:12:25.2639217Z  -e GITHUB_REPOSITORY \ 2024-06-26T07:12:25.2639646Z  -e GITHUB_WORKFLOW \ 2024-06-26T07:12:25.2640043Z  -e GITHUB_JOB \ 2024-06-26T07:12:25.2640411Z  -e GITHUB_RUN_ID \ 2024-06-26T07:12:25.2640810Z  -e GITHUB_RUN_NUMBER \ 2024-06-26T07:12:25.2641231Z  -e GITHUB_RUN_ATTEMPT \ 2024-06-26T07:12:25.2641638Z  -e JOB_ID \ 2024-06-26T07:12:25.2641994Z  -e JOB_NAME \ 2024-06-26T07:12:25.2642357Z  -e BASE_SHA \ 2024-06-26T07:12:25.2642722Z  -e BRANCH \ 2024-06-26T07:12:25.2643064Z  -e SHA1 \ 2024-06-26T07:12:25.2643434Z  -e AWS_DEFAULT_REGION \ 2024-06-26T07:12:25.2643860Z  -e IN_WHEEL_TEST \ 2024-06-26T07:12:25.2644256Z  -e SHARD_NUMBER \ 2024-06-26T07:12:25.2644632Z  -e TEST_CONFIG \ 2024-06-26T07:12:25.2645016Z  -e NUM_TEST_SHARDS \ 2024-06-26T07:12:25.2645423Z  -e REENABLED_ISSUES \ 2024-06-26T07:12:25.2645860Z  -e CONTINUE_THROUGH_ERROR \ 2024-06-26T07:12:25.2646293Z  -e VERBOSE_TEST_LOGS \ 2024-06-26T07:12:25.2646709Z  -e NO_TEST_TIMEOUT \ 2024-06-26T07:12:25.2647104Z  -e NO_TD \ 2024-06-26T07:12:25.2647455Z  -e TD_DISTRIBUTED \ 2024-06-26T07:12:25.2647858Z  -e PR_LABELS \ 2024-06-26T07:12:25.2648281Z  -e MAX_JOBS="$(nproc --ignore=2)" \ 2024-06-26T07:12:25.2648753Z  -e SCCACHE_BUCKET \ 2024-06-26T07:12:25.2649156Z  -e SCCACHE_S3_KEY_PREFIX \ 2024-06-26T07:12:25.2649579Z  -e XLA_CUDA \ 2024-06-26T07:12:25.2650005Z  -e XLA_CLANG_CACHE_S3_BUCKET_NAME \ 2024-06-26T07:12:25.2650530Z  -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK \ 2024-06-26T07:12:25.2651066Z  -e PYTORCH_TEST_RERUN_DISABLED_TESTS \ 2024-06-26T07:12:25.2651597Z  -e SKIP_SCCACHE_INITIALIZATION=1 \ 2024-06-26T07:12:25.2652080Z  -e HUGGING_FACE_HUB_TOKEN \ 2024-06-26T07:12:25.2652515Z  -e DASHBOARD_TAG \ 2024-06-26T07:12:25.2652999Z  --env-file="/tmp/github_env_${GITHUB_RUN_ID}" \ 2024-06-26T07:12:25.2653569Z  --security-opt seccomp=unconfined \ 2024-06-26T07:12:25.2654051Z  --cap-add=SYS_PTRACE \ 2024-06-26T07:12:25.2654459Z  --ipc=host \ 2024-06-26T07:12:25.2654827Z  --shm-size="${SHM_SIZE}" \ 2024-06-26T07:12:25.2655239Z  --tty \ 2024-06-26T07:12:25.2655570Z  --detach \ 2024-06-26T07:12:25.2655943Z  --name="${container_name}" \ 2024-06-26T07:12:25.2656373Z  --user jenkins \ 2024-06-26T07:12:25.2657110Z  -v "${GITHUB_WORKSPACE}:/var/lib/jenkins/workspace" \ 2024-06-26T07:12:25.2657701Z  -w /var/lib/jenkins/workspace \ 2024-06-26T07:12:25.2658150Z  "${DOCKER_IMAGE}" 2024-06-26T07:12:25.2658506Z ) 2024-06-26T07:12:25.2658924Z # Propagate download.pytorch.org IP to container 2024-06-26T07:12:25.2659852Z grep download.pytorch.org /etc/hosts | docker exec -i "${container_name}" sudo bash -c "/bin/cat >> /etc/hosts" 2024-06-26T07:12:25.2660827Z echo "DOCKER_CONTAINER_ID=${container_name}" >> "${GITHUB_ENV}" 2024-06-26T07:12:25.2661744Z docker exec -t "${container_name}" sh -c "pip install $(echo dist/*.whl)[opt-einsum] && ${TEST_COMMAND}" 2024-06-26T07:12:25.2669094Z shell: /usr/bin/bash -e {0} 2024-06-26T07:12:25.2669464Z env: 2024-06-26T07:12:25.2669763Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:12:25.2670229Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:12:25.2671006Z BUILD_ENVIRONMENT: linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-06-26T07:12:25.2671529Z PR_NUMBER: 2024-06-26T07:12:25.2671870Z GITHUB_REPOSITORY: pytorch/pytorch 2024-06-26T07:12:25.2672317Z GITHUB_WORKFLOW: inductor-periodic 2024-06-26T07:12:25.2672740Z GITHUB_JOB: test 2024-06-26T07:12:25.2673076Z GITHUB_RUN_ID: 9673646806 2024-06-26T07:12:25.2673455Z GITHUB_RUN_NUMBER: 45567 2024-06-26T07:12:25.2673818Z GITHUB_RUN_ATTEMPT: 1 2024-06-26T07:12:25.2674172Z JOB_ID: 26688916732 2024-06-26T07:12:25.2674994Z JOB_NAME: cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (aot_eager_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-06-26T07:12:25.2675870Z BRANCH: 2024-06-26T07:12:25.2676217Z SHA1: b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:12:25.2676745Z BASE_SHA: b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:12:25.2677238Z TEST_CONFIG: aot_eager_timm 2024-06-26T07:12:25.2677617Z SHARD_NUMBER: 2 2024-06-26T07:12:25.2677940Z NUM_TEST_SHARDS: 2 2024-06-26T07:12:25.2678291Z REENABLED_ISSUES: 2024-06-26T07:12:25.2678652Z CONTINUE_THROUGH_ERROR: False 2024-06-26T07:12:25.2679052Z VERBOSE_TEST_LOGS: False 2024-06-26T07:12:25.2679426Z NO_TEST_TIMEOUT: False 2024-06-26T07:12:25.2679780Z NO_TD: False 2024-06-26T07:12:25.2680100Z TD_DISTRIBUTED: False 2024-06-26T07:12:25.2680528Z SCCACHE_BUCKET: ossci-compiler-cache-circleci-v2 2024-06-26T07:12:25.2681064Z SCCACHE_S3_KEY_PREFIX: inductor-periodic 2024-06-26T07:12:25.2681507Z SHM_SIZE: 2g 2024-06-26T07:12:25.2682609Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:12:25.2683780Z XLA_CUDA: 2024-06-26T07:12:25.2684279Z XLA_CLANG_CACHE_S3_BUCKET_NAME: ossci-compiler-clang-cache-circleci-xla 2024-06-26T07:12:25.2684910Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK: 0 2024-06-26T07:12:25.2685363Z PYTORCH_TEST_RERUN_DISABLED_TESTS: 0 2024-06-26T07:12:25.2685786Z DASHBOARD_TAG: 2024-06-26T07:12:25.2686319Z HUGGING_FACE_HUB_TOKEN: *** 2024-06-26T07:12:25.2686699Z ##[endgroup] 2024-06-26T07:12:25.2706223Z + [[ aot_eager_timm == \m\u\l\t\i\g\p\u ]] 2024-06-26T07:12:25.2707001Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *onnx* ]] 2024-06-26T07:12:25.2707542Z + TEST_COMMAND=.ci/pytorch/test.sh 2024-06-26T07:12:25.2713538Z +++ nproc --ignore=2 2024-06-26T07:12:25.2729335Z ++ docker run --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all -e BUILD_ENVIRONMENT -e PR_NUMBER -e GITHUB_ACTIONS -e GITHUB_REPOSITORY -e GITHUB_WORKFLOW -e GITHUB_JOB -e GITHUB_RUN_ID -e GITHUB_RUN_NUMBER -e GITHUB_RUN_ATTEMPT -e JOB_ID -e JOB_NAME -e BASE_SHA -e BRANCH -e SHA1 -e AWS_DEFAULT_REGION -e IN_WHEEL_TEST -e SHARD_NUMBER -e TEST_CONFIG -e NUM_TEST_SHARDS -e REENABLED_ISSUES -e CONTINUE_THROUGH_ERROR -e VERBOSE_TEST_LOGS -e NO_TEST_TIMEOUT -e NO_TD -e TD_DISTRIBUTED -e PR_LABELS -e MAX_JOBS=14 -e SCCACHE_BUCKET -e SCCACHE_S3_KEY_PREFIX -e XLA_CUDA -e XLA_CLANG_CACHE_S3_BUCKET_NAME -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK -e PYTORCH_TEST_RERUN_DISABLED_TESTS -e SKIP_SCCACHE_INITIALIZATION=1 -e HUGGING_FACE_HUB_TOKEN -e DASHBOARD_TAG --env-file=/tmp/github_env_9673646806 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --ipc=host --shm-size=2g --tty --detach --name= --user jenkins -v /home/ec2-user/actions-runner/_work/pytorch/pytorch:/var/lib/jenkins/workspace -w /var/lib/jenkins/workspace 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:12:36.4841054Z + container_name=2b79e741618d7986dd1aa63a74f0acea4dd87abeed793c8c159fc5b900d83932 2024-06-26T07:12:36.4842023Z + grep download.pytorch.org /etc/hosts 2024-06-26T07:12:36.4843764Z + docker exec -i 2b79e741618d7986dd1aa63a74f0acea4dd87abeed793c8c159fc5b900d83932 sudo bash -c '/bin/cat >> /etc/hosts' 2024-06-26T07:12:36.5539403Z + echo DOCKER_CONTAINER_ID=2b79e741618d7986dd1aa63a74f0acea4dd87abeed793c8c159fc5b900d83932 2024-06-26T07:12:36.5542316Z ++ echo dist/torch-2.5.0a0+gitb8c4c54-cp310-cp310-linux_x86_64.whl 2024-06-26T07:12:36.5543999Z + docker exec -t 2b79e741618d7986dd1aa63a74f0acea4dd87abeed793c8c159fc5b900d83932 sh -c 'pip install dist/torch-2.5.0a0+gitb8c4c54-cp310-cp310-linux_x86_64.whl[opt-einsum] && .ci/pytorch/test.sh' 2024-06-26T07:12:36.9338557Z Processing ./dist/torch-2.5.0a0+gitb8c4c54-cp310-cp310-linux_x86_64.whl (from torch==2.5.0a0+gitb8c4c54) 2024-06-26T07:12:37.2465665Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (3.13.1) 2024-06-26T07:12:37.2470200Z Requirement already satisfied: typing-extensions>=4.8.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (4.12.2) 2024-06-26T07:12:37.2472669Z Requirement already satisfied: sympy in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (1.12.1) 2024-06-26T07:12:37.2475192Z Requirement already satisfied: networkx in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (2.8.8) 2024-06-26T07:12:37.2478336Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (3.1.4) 2024-06-26T07:12:37.2480454Z Requirement already satisfied: fsspec in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (2024.2.0) 2024-06-26T07:12:37.2506139Z Requirement already satisfied: opt-einsum>=3.3 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (3.3.0) 2024-06-26T07:12:37.2563350Z Requirement already satisfied: numpy>=1.7 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from opt-einsum>=3.3->torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (1.21.2) 2024-06-26T07:12:37.2989929Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from jinja2->torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (2.1.5) 2024-06-26T07:12:37.3145498Z Requirement already satisfied: mpmath<1.4.0,>=1.1.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from sympy->torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (1.3.0) 2024-06-26T07:12:38.6163118Z Installing collected packages: torch 2024-06-26T07:12:47.2980616Z ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 2024-06-26T07:12:47.2981986Z timm 0.9.7 requires torchvision, which is not installed. 2024-06-26T07:12:47.2982683Z Successfully installed torch-2.5.0a0+gitb8c4c54 2024-06-26T07:12:47.3758107Z ++ dirname .ci/pytorch/test.sh 2024-06-26T07:12:47.3762551Z + source .ci/pytorch/common.sh 2024-06-26T07:12:47.3764522Z +++ dirname .ci/pytorch/common.sh 2024-06-26T07:12:47.3770061Z ++ source .ci/pytorch/common_utils.sh 2024-06-26T07:12:47.3771018Z +++ declare -f -t trap_add 2024-06-26T07:12:47.3777226Z ++ set -ex 2024-06-26T07:12:47.3777894Z ++ [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *rocm* ]] 2024-06-26T07:12:47.3781693Z ++ BUILD_TEST_LIBTORCH=0 2024-06-26T07:12:47.3782736Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *rocm* ]] 2024-06-26T07:12:47.3783349Z ++ stat -c %u /var/lib/jenkins/workspace 2024-06-26T07:12:47.3790383Z + WORKSPACE_ORIGINAL_OWNER_ID=1000 2024-06-26T07:12:47.3790939Z + trap_add cleanup_workspace EXIT 2024-06-26T07:12:47.3791372Z + trap_add_cmd=cleanup_workspace 2024-06-26T07:12:47.3791769Z + shift 2024-06-26T07:12:47.3792068Z + for trap_add_name in "$@" 2024-06-26T07:12:47.3795525Z +++ trap -p EXIT 2024-06-26T07:12:47.3797203Z ++ eval 'extract_trap_cmd ' 2024-06-26T07:12:47.3797593Z +++ extract_trap_cmd 2024-06-26T07:12:47.3797969Z +++ printf '%s\n' '' 2024-06-26T07:12:47.3798359Z ++ printf '%s\n' cleanup_workspace 2024-06-26T07:12:47.3799286Z + trap -- ' 2024-06-26T07:12:47.3799649Z cleanup_workspace' EXIT 2024-06-26T07:12:47.3800122Z + sudo chown -R jenkins /var/lib/jenkins/workspace 2024-06-26T07:12:47.8685463Z + git config --global --add safe.directory /var/lib/jenkins/workspace 2024-06-26T07:12:47.8696689Z + echo 'Environment variables:' 2024-06-26T07:12:47.8697383Z Environment variables: 2024-06-26T07:12:47.8697730Z + env 2024-06-26T07:12:47.8702848Z INSTALLED_DB=yes 2024-06-26T07:12:47.8703612Z NV_LIBCUBLAS_VERSION=12.1.3.1-1 2024-06-26T07:12:47.8704201Z NVIDIA_VISIBLE_DEVICES=all 2024-06-26T07:12:47.8704765Z NV_NVML_DEV_VERSION=12.1.105-1 2024-06-26T07:12:47.8705623Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-06-26T07:12:47.8706429Z CONTINUE_THROUGH_ERROR=False 2024-06-26T07:12:47.8707167Z NV_LIBNCCL_DEV_PACKAGE=libnccl-dev=2.17.1-1+cuda12.1 2024-06-26T07:12:47.8707911Z NV_LIBNCCL_DEV_PACKAGE_VERSION=2.17.1-1 2024-06-26T07:12:47.8708757Z BUILD_ENVIRONMENT=linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-06-26T07:12:47.8709552Z HOSTNAME=2b79e741618d 2024-06-26T07:12:47.8710967Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_1ab83591-102a-4941-85f6-ba20d1ebcb0d 2024-06-26T07:12:47.8712170Z GITHUB_ACTION=__self 2024-06-26T07:12:47.8712663Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2024-06-26T07:12:47.8718572Z NVIDIA_REQUIRE_CUDA=cuda>=12.1 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 brand=tesla,driver>=525,driver<526 brand=unknown,driver>=525,driver<526 brand=nvidia,driver>=525,driver<526 brand=nvidiartx,driver>=525,driver<526 brand=geforce,driver>=525,driver<526 brand=geforcertx,driver>=525,driver<526 brand=quadro,driver>=525,driver<526 brand=quadrortx,driver>=525,driver<526 brand=titan,driver>=525,driver<526 brand=titanrtx,driver>=525,driver<526 2024-06-26T07:12:47.8724879Z NV_LIBCUBLAS_DEV_PACKAGE=libcublas-dev-12-1=12.1.3.1-1 2024-06-26T07:12:47.8725681Z NV_NVTX_VERSION=12.1.105-1 2024-06-26T07:12:47.8726213Z GITHUB_RUN_NUMBER=45567 2024-06-26T07:12:47.8726738Z TEST_CONFIG=aot_eager_timm 2024-06-26T07:12:47.8727275Z GITHUB_REPOSITORY_OWNER_ID=21003710 2024-06-26T07:12:47.8727986Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2024-06-26T07:12:47.8728689Z NV_CUDA_CUDART_DEV_VERSION=12.1.105-1 2024-06-26T07:12:47.8729382Z NV_LIBCUSPARSE_VERSION=12.1.0.106-1 2024-06-26T07:12:47.8730032Z NV_LIBNPP_VERSION=12.1.0.40-1 2024-06-26T07:12:47.8730739Z GITHUB_TRIGGERING_ACTOR=pytorch-bot[bot] 2024-06-26T07:12:47.8731499Z CMAKE_CUDA_COMPILER_LAUNCHER=/opt/cache/bin/sccache 2024-06-26T07:12:47.8732180Z GITHUB_REF_TYPE=tag 2024-06-26T07:12:47.8732695Z TORCH_CUDA_ARCH_LIST=Maxwell 2024-06-26T07:12:47.8733286Z NCCL_VERSION=2.17.1-1 2024-06-26T07:12:47.8733872Z BASE_SHA=b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:12:47.8734782Z XLA_CUDA= 2024-06-26T07:12:47.8735520Z HUGGING_FACE_HUB_TOKEN=*** 2024-06-26T07:12:47.8737919Z *** 2024-06-26T07:12:47.8738385Z CARGO_NET_GIT_FETCH_WITH_CLI=true 2024-06-26T07:12:47.8739002Z GITHUB_REPOSITORY_ID=65600975 2024-06-26T07:12:47.8739599Z GITHUB_ACTIONS=true 2024-06-26T07:12:47.8740176Z NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:12:47.8740940Z NV_NVPROF_DEV_PACKAGE=cuda-nvprof-12-1=12.1.105-1 2024-06-26T07:12:47.8741758Z NV_LIBNPP_PACKAGE=libnpp-12-1=12.1.0.40-1 2024-06-26T07:12:47.8742464Z SHA1=b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:12:47.8743236Z NV_LIBNCCL_DEV_PACKAGE_NAME=libnccl-dev 2024-06-26T07:12:47.8743991Z GITHUB_SHA=b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:12:47.8745439Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/inductor-periodic.yml@refs/tags/ciflow/inductor/129470 2024-06-26T07:12:47.8746609Z UCC_HOME=/usr 2024-06-26T07:12:47.8747152Z NV_LIBCUBLAS_DEV_VERSION=12.1.3.1-1 2024-06-26T07:12:47.8747972Z VERBOSE_TEST_LOGS=False 2024-06-26T07:12:47.8748454Z NVIDIA_PRODUCT_NAME=CUDA 2024-06-26T07:12:47.8749123Z NV_LIBCUBLAS_DEV_PACKAGE_NAME=libcublas-dev-12-1 2024-06-26T07:12:47.8749921Z GITHUB_REF=refs/tags/ciflow/inductor/129470 2024-06-26T07:12:47.8750812Z NV_CUDA_CUDART_VERSION=12.1.105-1 2024-06-26T07:12:47.8751390Z SHARD_NUMBER=2 2024-06-26T07:12:47.8751866Z GITHUB_REF_PROTECTED=false 2024-06-26T07:12:47.8752433Z HOME=/var/lib/jenkins 2024-06-26T07:12:47.8753004Z GITHUB_API_URL=https://api.github.com 2024-06-26T07:12:47.8753675Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2024-06-26T07:12:47.8754402Z UCX_COMMIT=7bb2722ff2187a0cad557ae4a6afa090569f83fb 2024-06-26T07:12:47.8755267Z SCCACHE_S3_KEY_PREFIX=inductor-periodic 2024-06-26T07:12:47.8755920Z CUDA_VERSION=12.1.1 2024-06-26T07:12:47.8756543Z NV_LIBCUBLAS_PACKAGE=libcublas-12-1=12.1.3.1-1 2024-06-26T07:12:47.8757241Z NUM_TEST_SHARDS=2 2024-06-26T07:12:47.8757716Z UCX_HOME=/usr 2024-06-26T07:12:47.8758481Z NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE=cuda-nsight-compute-12-1=12.1.1-1 2024-06-26T07:12:47.8760194Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_1ab83591-102a-4941-85f6-ba20d1ebcb0d 2024-06-26T07:12:47.8762392Z JOB_NAME=cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (aot_eager_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-06-26T07:12:47.8764529Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_1ab83591-102a-4941-85f6-ba20d1ebcb0d 2024-06-26T07:12:47.8766328Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2024-06-26T07:12:47.8767353Z GITHUB_EVENT_NAME=push 2024-06-26T07:12:47.8767863Z DASHBOARD_TAG= 2024-06-26T07:12:47.8768327Z GITHUB_RUN_ID=9673646806 2024-06-26T07:12:47.8769055Z NV_LIBNPP_DEV_PACKAGE=libnpp-dev-12-1=12.1.0.40-1 2024-06-26T07:12:47.8769879Z NV_LIBCUBLAS_PACKAGE_NAME=libcublas-12-1 2024-06-26T07:12:47.8771468Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_1ab83591-102a-4941-85f6-ba20d1ebcb0d 2024-06-26T07:12:47.8772933Z GITHUB_ACTOR=pytorch-bot[bot] 2024-06-26T07:12:47.8773598Z NV_LIBNPP_DEV_VERSION=12.1.0.40-1 2024-06-26T07:12:47.8774158Z PR_NUMBER= 2024-06-26T07:12:47.8774588Z GITHUB_RUN_ATTEMPT=1 2024-06-26T07:12:47.8775100Z ANACONDA_PYTHON_VERSION=3.10 2024-06-26T07:12:47.8775757Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2024-06-26T07:12:47.8776455Z TERM=xterm 2024-06-26T07:12:47.8777311Z NV_LIBCUSPARSE_DEV_VERSION=12.1.0.106-1 2024-06-26T07:12:47.8777987Z INSTALLED_VISION=yes 2024-06-26T07:12:47.8778455Z BRANCH= 2024-06-26T07:12:47.8778896Z OPENSSL_ROOT_DIR=/opt/openssl 2024-06-26T07:12:47.8779522Z LIBRARY_PATH=/usr/local/cuda/lib64/stubs 2024-06-26T07:12:47.8780207Z CUDA_PATH=/usr/local/cuda 2024-06-26T07:12:47.8781397Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2024-06-26T07:12:47.8782592Z GITHUB_SERVER_URL=https://github.com 2024-06-26T07:12:47.8783337Z UCC_COMMIT=20eae37090a4ce1b32bcce6144ccad0b49943e0b 2024-06-26T07:12:47.8784240Z REENABLED_ISSUES= 2024-06-26T07:12:47.8784712Z SHLVL=1 2024-06-26T07:12:47.8785116Z MAX_JOBS=14 2024-06-26T07:12:47.8785608Z NV_CUDA_LIB_VERSION=12.1.1-1 2024-06-26T07:12:47.8786138Z NVARCH=x86_64 2024-06-26T07:12:47.8786581Z GITHUB_ACTOR_ID=54816060 2024-06-26T07:12:47.8787269Z GITHUB_WORKFLOW_SHA=b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:12:47.8788087Z GITHUB_REF_NAME=ciflow/inductor/129470 2024-06-26T07:12:47.8788845Z NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-1 2024-06-26T07:12:47.8789860Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2024-06-26T07:12:47.8790840Z GITHUB_JOB=test 2024-06-26T07:12:47.8791479Z NV_LIBNCCL_PACKAGE=libnccl2=2.17.1-1+cuda12.1 2024-06-26T07:12:47.8792348Z LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64 2024-06-26T07:12:47.8793166Z NO_TEST_TIMEOUT=False 2024-06-26T07:12:47.8793687Z TD_DISTRIBUTED=False 2024-06-26T07:12:47.8794280Z NV_CUDA_NSIGHT_COMPUTE_VERSION=12.1.1-1 2024-06-26T07:12:47.8795112Z GITHUB_REPOSITORY=pytorch/pytorch 2024-06-26T07:12:47.8795796Z NV_NVPROF_VERSION=12.1.105-1 2024-06-26T07:12:47.8796344Z GITHUB_RETENTION_DAYS=90 2024-06-26T07:12:47.8796871Z OPENSSL_DIR=/opt/openssl 2024-06-26T07:12:47.8797442Z GITHUB_ACTION_REPOSITORY= 2024-06-26T07:12:47.8799086Z PATH=/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-06-26T07:12:47.8800689Z GITHUB_BASE_REF= 2024-06-26T07:12:47.8801122Z NV_LIBNCCL_PACKAGE_NAME=libnccl2 2024-06-26T07:12:47.8801638Z CI=true 2024-06-26T07:12:47.8802141Z NV_LIBNCCL_PACKAGE_VERSION=2.17.1-1 2024-06-26T07:12:47.8802775Z GITHUB_REPOSITORY_OWNER=pytorch 2024-06-26T07:12:47.8803322Z JOB_ID=26688916732 2024-06-26T07:12:47.8803790Z INSTALLED_PROTOBUF=yes 2024-06-26T07:12:47.8804310Z GITHUB_HEAD_REF= 2024-06-26T07:12:47.8804764Z GITHUB_ACTION_REF= 2024-06-26T07:12:47.8805434Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2024-06-26T07:12:47.8806220Z GITHUB_WORKFLOW=inductor-periodic 2024-06-26T07:12:47.8806765Z DEBIAN_FRONTEND=noninteractive 2024-06-26T07:12:47.8808142Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_1ab83591-102a-4941-85f6-ba20d1ebcb0d 2024-06-26T07:12:47.8809425Z NO_TD=False 2024-06-26T07:12:47.8809882Z SKIP_SCCACHE_INITIALIZATION=1 2024-06-26T07:12:47.8810431Z _=/usr/bin/env 2024-06-26T07:12:47.8811174Z ++ python -c 'import site; print(site.getsitepackages()[0])' 2024-06-26T07:12:47.8873365Z + TORCH_INSTALL_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch 2024-06-26T07:12:47.8874268Z + TORCH_BIN_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/bin 2024-06-26T07:12:47.8875138Z + TORCH_LIB_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/lib 2024-06-26T07:12:47.8876020Z + TORCH_TEST_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/test 2024-06-26T07:12:47.8876644Z + BUILD_DIR=build 2024-06-26T07:12:47.8876988Z + BUILD_RENAMED_DIR=build_renamed 2024-06-26T07:12:47.8877415Z + BUILD_BIN_DIR=build/bin 2024-06-26T07:12:47.8877766Z + SHARD_NUMBER=2 2024-06-26T07:12:47.8878087Z + NUM_TEST_SHARDS=2 2024-06-26T07:12:47.8878423Z + export VALGRIND=ON 2024-06-26T07:12:47.8878750Z + VALGRIND=ON 2024-06-26T07:12:47.8879235Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *clang9* ]] 2024-06-26T07:12:47.8879744Z + [[ 0 == \1 ]] 2024-06-26T07:12:47.8880058Z + [[ False == \1 ]] 2024-06-26T07:12:47.8880534Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *bazel* ]] 2024-06-26T07:12:47.8881073Z ++ realpath build/custom_test_artifacts 2024-06-26T07:12:47.8885107Z + CUSTOM_TEST_ARTIFACT_BUILD_DIR=/var/lib/jenkins/workspace/build/custom_test_artifacts 2024-06-26T07:12:47.8885813Z + [[ -n '' ]] 2024-06-26T07:12:47.8886173Z + echo 'Environment variables' 2024-06-26T07:12:47.8886570Z Environment variables 2024-06-26T07:12:47.8886905Z + env 2024-06-26T07:12:47.8890498Z INSTALLED_DB=yes 2024-06-26T07:12:47.8890921Z NV_LIBCUBLAS_VERSION=12.1.3.1-1 2024-06-26T07:12:47.8891473Z NVIDIA_VISIBLE_DEVICES=all 2024-06-26T07:12:47.8892165Z NV_NVML_DEV_VERSION=12.1.105-1 2024-06-26T07:12:47.8892969Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-06-26T07:12:47.8893787Z CONTINUE_THROUGH_ERROR=False 2024-06-26T07:12:47.8894295Z NV_LIBNCCL_DEV_PACKAGE=libnccl-dev=2.17.1-1+cuda12.1 2024-06-26T07:12:47.8894833Z NV_LIBNCCL_DEV_PACKAGE_VERSION=2.17.1-1 2024-06-26T07:12:47.8895429Z BUILD_ENVIRONMENT=linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-06-26T07:12:47.8896019Z HOSTNAME=2b79e741618d 2024-06-26T07:12:47.8897228Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_1ab83591-102a-4941-85f6-ba20d1ebcb0d 2024-06-26T07:12:47.8898090Z GITHUB_ACTION=__self 2024-06-26T07:12:47.8898457Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2024-06-26T07:12:47.8902337Z NVIDIA_REQUIRE_CUDA=cuda>=12.1 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 brand=tesla,driver>=525,driver<526 brand=unknown,driver>=525,driver<526 brand=nvidia,driver>=525,driver<526 brand=nvidiartx,driver>=525,driver<526 brand=geforce,driver>=525,driver<526 brand=geforcertx,driver>=525,driver<526 brand=quadro,driver>=525,driver<526 brand=quadrortx,driver>=525,driver<526 brand=titan,driver>=525,driver<526 brand=titanrtx,driver>=525,driver<526 2024-06-26T07:12:47.8906414Z NV_LIBCUBLAS_DEV_PACKAGE=libcublas-dev-12-1=12.1.3.1-1 2024-06-26T07:12:47.8906938Z NV_NVTX_VERSION=12.1.105-1 2024-06-26T07:12:47.8907299Z GITHUB_RUN_NUMBER=45567 2024-06-26T07:12:47.8907661Z TEST_CONFIG=aot_eager_timm 2024-06-26T07:12:47.8908048Z GITHUB_REPOSITORY_OWNER_ID=21003710 2024-06-26T07:12:47.8908523Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2024-06-26T07:12:47.8909003Z NV_CUDA_CUDART_DEV_VERSION=12.1.105-1 2024-06-26T07:12:47.8909469Z NV_LIBCUSPARSE_VERSION=12.1.0.106-1 2024-06-26T07:12:47.8909907Z NV_LIBNPP_VERSION=12.1.0.40-1 2024-06-26T07:12:47.8910353Z GITHUB_TRIGGERING_ACTOR=pytorch-bot[bot] 2024-06-26T07:12:47.8910996Z CMAKE_CUDA_COMPILER_LAUNCHER=/opt/cache/bin/sccache 2024-06-26T07:12:47.8911479Z GITHUB_REF_TYPE=tag 2024-06-26T07:12:47.8911819Z TORCH_CUDA_ARCH_LIST=Maxwell 2024-06-26T07:12:47.8912206Z NCCL_VERSION=2.17.1-1 2024-06-26T07:12:47.8912610Z BASE_SHA=b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:12:47.8913068Z XLA_CUDA= 2024-06-26T07:12:47.8913576Z HUGGING_FACE_HUB_TOKEN=*** 2024-06-26T07:12:47.8913977Z *** 2024-06-26T07:12:47.8914273Z CARGO_NET_GIT_FETCH_WITH_CLI=true 2024-06-26T07:12:47.8914686Z GITHUB_REPOSITORY_ID=65600975 2024-06-26T07:12:47.8915065Z GITHUB_ACTIONS=true 2024-06-26T07:12:47.8915409Z NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:12:47.8915912Z NV_NVPROF_DEV_PACKAGE=cuda-nvprof-12-1=12.1.105-1 2024-06-26T07:12:47.8916457Z NV_LIBNPP_PACKAGE=libnpp-12-1=12.1.0.40-1 2024-06-26T07:12:47.8916952Z SHA1=b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:12:47.8917458Z NV_LIBNCCL_DEV_PACKAGE_NAME=libnccl-dev 2024-06-26T07:12:47.8917948Z GITHUB_SHA=b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:12:47.8918873Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/inductor-periodic.yml@refs/tags/ciflow/inductor/129470 2024-06-26T07:12:47.8919647Z UCC_HOME=/usr 2024-06-26T07:12:47.8919990Z NV_LIBCUBLAS_DEV_VERSION=12.1.3.1-1 2024-06-26T07:12:47.8920402Z VERBOSE_TEST_LOGS=False 2024-06-26T07:12:47.8920757Z NVIDIA_PRODUCT_NAME=CUDA 2024-06-26T07:12:47.8921211Z NV_LIBCUBLAS_DEV_PACKAGE_NAME=libcublas-dev-12-1 2024-06-26T07:12:47.8921718Z GITHUB_REF=refs/tags/ciflow/inductor/129470 2024-06-26T07:12:47.8922197Z NV_CUDA_CUDART_VERSION=12.1.105-1 2024-06-26T07:12:47.8922586Z SHARD_NUMBER=2 2024-06-26T07:12:47.8922903Z GITHUB_REF_PROTECTED=false 2024-06-26T07:12:47.8923271Z HOME=/var/lib/jenkins 2024-06-26T07:12:47.8923651Z GITHUB_API_URL=https://api.github.com 2024-06-26T07:12:47.8924195Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2024-06-26T07:12:47.8924681Z UCX_COMMIT=7bb2722ff2187a0cad557ae4a6afa090569f83fb 2024-06-26T07:12:47.8925231Z SCCACHE_S3_KEY_PREFIX=inductor-periodic 2024-06-26T07:12:47.8925665Z CUDA_VERSION=12.1.1 2024-06-26T07:12:47.8926086Z NV_LIBCUBLAS_PACKAGE=libcublas-12-1=12.1.3.1-1 2024-06-26T07:12:47.8926537Z NUM_TEST_SHARDS=2 2024-06-26T07:12:47.8926855Z UCX_HOME=/usr 2024-06-26T07:12:47.8927371Z NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE=cuda-nsight-compute-12-1=12.1.1-1 2024-06-26T07:12:47.8928437Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_1ab83591-102a-4941-85f6-ba20d1ebcb0d 2024-06-26T07:12:47.8929870Z JOB_NAME=cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (aot_eager_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-06-26T07:12:47.8931222Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_1ab83591-102a-4941-85f6-ba20d1ebcb0d 2024-06-26T07:12:47.8932343Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2024-06-26T07:12:47.8933066Z GITHUB_EVENT_NAME=push 2024-06-26T07:12:47.8933403Z DASHBOARD_TAG= 2024-06-26T07:12:47.8933721Z GITHUB_RUN_ID=9673646806 2024-06-26T07:12:47.8934186Z NV_LIBNPP_DEV_PACKAGE=libnpp-dev-12-1=12.1.0.40-1 2024-06-26T07:12:47.8950976Z NV_LIBCUBLAS_PACKAGE_NAME=libcublas-12-1 2024-06-26T07:12:47.8951989Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_1ab83591-102a-4941-85f6-ba20d1ebcb0d 2024-06-26T07:12:47.8952902Z GITHUB_ACTOR=pytorch-bot[bot] 2024-06-26T07:12:47.8953323Z NV_LIBNPP_DEV_VERSION=12.1.0.40-1 2024-06-26T07:12:47.8953707Z PR_NUMBER= 2024-06-26T07:12:47.8954009Z GITHUB_RUN_ATTEMPT=1 2024-06-26T07:12:47.8954342Z VALGRIND=ON 2024-06-26T07:12:47.8954650Z ANACONDA_PYTHON_VERSION=3.10 2024-06-26T07:12:47.8955106Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2024-06-26T07:12:47.8955571Z TERM=xterm 2024-06-26T07:12:47.8955919Z NV_LIBCUSPARSE_DEV_VERSION=12.1.0.106-1 2024-06-26T07:12:47.8956357Z INSTALLED_VISION=yes 2024-06-26T07:12:47.8956690Z BRANCH= 2024-06-26T07:12:47.8956990Z OPENSSL_ROOT_DIR=/opt/openssl 2024-06-26T07:12:47.8957401Z LIBRARY_PATH=/usr/local/cuda/lib64/stubs 2024-06-26T07:12:47.8957836Z CUDA_PATH=/usr/local/cuda 2024-06-26T07:12:47.8958591Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2024-06-26T07:12:47.8959405Z GITHUB_SERVER_URL=https://github.com 2024-06-26T07:12:47.8959897Z UCC_COMMIT=20eae37090a4ce1b32bcce6144ccad0b49943e0b 2024-06-26T07:12:47.8960381Z REENABLED_ISSUES= 2024-06-26T07:12:47.8960697Z SHLVL=1 2024-06-26T07:12:47.8960975Z MAX_JOBS=14 2024-06-26T07:12:47.8961292Z NV_CUDA_LIB_VERSION=12.1.1-1 2024-06-26T07:12:47.8961660Z NVARCH=x86_64 2024-06-26T07:12:47.8961975Z GITHUB_ACTOR_ID=54816060 2024-06-26T07:12:47.8962437Z GITHUB_WORKFLOW_SHA=b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T07:12:47.8962986Z GITHUB_REF_NAME=ciflow/inductor/129470 2024-06-26T07:12:47.8963492Z NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-1 2024-06-26T07:12:47.8964161Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2024-06-26T07:12:47.8964743Z GITHUB_JOB=test 2024-06-26T07:12:47.8965156Z NV_LIBNCCL_PACKAGE=libnccl2=2.17.1-1+cuda12.1 2024-06-26T07:12:47.8965722Z LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64 2024-06-26T07:12:47.8966246Z NO_TEST_TIMEOUT=False 2024-06-26T07:12:47.8966585Z TD_DISTRIBUTED=False 2024-06-26T07:12:47.8966975Z NV_CUDA_NSIGHT_COMPUTE_VERSION=12.1.1-1 2024-06-26T07:12:47.8967430Z GITHUB_REPOSITORY=pytorch/pytorch 2024-06-26T07:12:47.8967863Z NV_NVPROF_VERSION=12.1.105-1 2024-06-26T07:12:47.8968241Z GITHUB_RETENTION_DAYS=90 2024-06-26T07:12:47.8968607Z OPENSSL_DIR=/opt/openssl 2024-06-26T07:12:47.8968971Z GITHUB_ACTION_REPOSITORY= 2024-06-26T07:12:47.8970009Z PATH=/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-06-26T07:12:47.8971071Z GITHUB_BASE_REF= 2024-06-26T07:12:47.8971553Z NV_LIBNCCL_PACKAGE_NAME=libnccl2 2024-06-26T07:12:47.8971949Z CI=true 2024-06-26T07:12:47.8972274Z NV_LIBNCCL_PACKAGE_VERSION=2.17.1-1 2024-06-26T07:12:47.8972703Z GITHUB_REPOSITORY_OWNER=pytorch 2024-06-26T07:12:47.8973092Z JOB_ID=26688916732 2024-06-26T07:12:47.8973424Z INSTALLED_PROTOBUF=yes 2024-06-26T07:12:47.8973765Z GITHUB_HEAD_REF= 2024-06-26T07:12:47.8974085Z GITHUB_ACTION_REF= 2024-06-26T07:12:47.8974527Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2024-06-26T07:12:47.8975056Z GITHUB_WORKFLOW=inductor-periodic 2024-06-26T07:12:47.8975467Z DEBIAN_FRONTEND=noninteractive 2024-06-26T07:12:47.8976365Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_1ab83591-102a-4941-85f6-ba20d1ebcb0d 2024-06-26T07:12:47.8977545Z NO_TD=False 2024-06-26T07:12:47.8977867Z SKIP_SCCACHE_INITIALIZATION=1 2024-06-26T07:12:47.8978247Z _=/usr/bin/env 2024-06-26T07:12:47.8978615Z + echo 'Testing pytorch' 2024-06-26T07:12:47.8979083Z Testing pytorch 2024-06-26T07:12:47.8979422Z + export LANG=C.UTF-8 2024-06-26T07:12:47.8979776Z + LANG=C.UTF-8 2024-06-26T07:12:47.8980109Z + PR_NUMBER= 2024-06-26T07:12:47.8980450Z + [[ aot_eager_timm == \d\e\f\a\u\l\t ]] 2024-06-26T07:12:47.8980926Z + [[ aot_eager_timm == \d\i\s\t\r\i\b\u\t\e\d ]] 2024-06-26T07:12:47.8981409Z + [[ aot_eager_timm == \s\l\o\w ]] 2024-06-26T07:12:47.8982015Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *slow-gradcheck* ]] 2024-06-26T07:12:47.8982712Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *cuda* ]] 2024-06-26T07:12:47.8983261Z + export PYTORCH_TESTING_DEVICE_ONLY_FOR=cuda 2024-06-26T07:12:47.8983749Z + PYTORCH_TESTING_DEVICE_ONLY_FOR=cuda 2024-06-26T07:12:47.8984193Z + [[ aot_eager_timm == *crossref* ]] 2024-06-26T07:12:47.8984739Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *rocm* ]] 2024-06-26T07:12:47.8985380Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *xpu* ]] 2024-06-26T07:12:47.8986029Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *-bazel-* ]] 2024-06-26T07:12:47.8986598Z + pip_install --user ninja==1.10.2 2024-06-26T07:12:47.8987135Z + pip install --progress-bar off --user ninja==1.10.2 2024-06-26T07:12:48.2542236Z Collecting ninja==1.10.2 2024-06-26T07:12:48.2693212Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl.metadata (5.0 kB) 2024-06-26T07:12:48.2823683Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl (108 kB) 2024-06-26T07:12:49.5514041Z Installing collected packages: ninja 2024-06-26T07:12:49.5581015Z  WARNING: The script ninja is installed in '/var/lib/jenkins/.local/bin' which is not on PATH. 2024-06-26T07:12:49.5582279Z Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. 2024-06-26T07:12:49.5626446Z Successfully installed ninja-1.10.2 2024-06-26T07:12:49.6436117Z + export PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-06-26T07:12:49.6438245Z + PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-06-26T07:12:49.6439682Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *aarch64* ]] 2024-06-26T07:12:49.6440208Z + install_tlparse 2024-06-26T07:12:49.6440595Z + pip_install --user tlparse==0.3.7 2024-06-26T07:12:49.6441152Z + pip install --progress-bar off --user tlparse==0.3.7 2024-06-26T07:12:49.9926195Z Collecting tlparse==0.3.7 2024-06-26T07:12:50.0073904Z Downloading tlparse-0.3.7-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (346 bytes) 2024-06-26T07:12:50.0178211Z Downloading tlparse-0.3.7-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.2 MB) 2024-06-26T07:12:51.3241315Z Installing collected packages: tlparse 2024-06-26T07:12:51.3607787Z Successfully installed tlparse-0.3.7 2024-06-26T07:12:51.4426278Z ++ python -m site --user-base 2024-06-26T07:12:51.4578929Z + PATH=/var/lib/jenkins/.local/bin:/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-06-26T07:12:51.4580698Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *asan* ]] 2024-06-26T07:12:51.4581482Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *-debug* ]] 2024-06-26T07:12:51.4582304Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *-bazel-* ]] 2024-06-26T07:12:51.4583251Z + echo 'We are not in debug mode: linux-focal-cuda12.1-py3.10-gcc9-sm86. Expect the assertion to pass' 2024-06-26T07:12:51.4584391Z We are not in debug mode: linux-focal-cuda12.1-py3.10-gcc9-sm86. Expect the assertion to pass 2024-06-26T07:12:51.4585117Z + cd test 2024-06-26T07:12:51.4585661Z + python -c 'import torch; torch._C._crash_if_debug_asserts_fail(424242)' 2024-06-26T07:12:52.9295411Z + [[ aot_eager_timm == \n\o\g\p\u\_\N\O\_\A\V\X\2 ]] 2024-06-26T07:12:52.9296389Z + [[ aot_eager_timm == \n\o\g\p\u\_\A\V\X\5\1\2 ]] 2024-06-26T07:12:52.9297623Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *-bazel-* ]] 2024-06-26T07:12:52.9298136Z + pushd test 2024-06-26T07:12:52.9298476Z ~/workspace/test ~/workspace 2024-06-26T07:12:52.9299026Z ++ python -c 'import torch; print(torch.version.cuda)' 2024-06-26T07:12:54.4063412Z + CUDA_VERSION=12.1 2024-06-26T07:12:54.4063983Z + '[' 12.1 == 12.4 ']' 2024-06-26T07:12:54.4064331Z + ISCUDA124= 2024-06-26T07:12:54.4064645Z + popd 2024-06-26T07:12:54.4064915Z ~/workspace 2024-06-26T07:12:54.4067793Z + DYNAMO_BENCHMARK_FLAGS=() 2024-06-26T07:12:54.4068393Z + [[ aot_eager_timm == *dynamo_eager* ]] 2024-06-26T07:12:54.4068974Z + [[ aot_eager_timm == *aot_eager* ]] 2024-06-26T07:12:54.4069537Z + DYNAMO_BENCHMARK_FLAGS+=(--backend aot_eager) 2024-06-26T07:12:54.4070084Z + [[ aot_eager_timm == *dynamic* ]] 2024-06-26T07:12:54.4070543Z + [[ aot_eager_timm == *cpu_inductor* ]] 2024-06-26T07:12:54.4071230Z + DYNAMO_BENCHMARK_FLAGS+=(--device cuda) 2024-06-26T07:12:54.4095966Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *libtorch* ]] 2024-06-26T07:12:54.4096671Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *-bazel-* ]] 2024-06-26T07:12:54.4099529Z + cd test 2024-06-26T07:12:54.4100552Z + python -c 'import torch; print(torch.__config__.show())' 2024-06-26T07:12:55.7617702Z PyTorch built with: 2024-06-26T07:12:55.7618332Z - GCC 9.4 2024-06-26T07:12:55.7618692Z - C++ Version: 201703 2024-06-26T07:12:55.7619553Z - Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications 2024-06-26T07:12:55.7620823Z - Intel(R) MKL-DNN v3.4.2 (Git Hash 1137e04ec0b5251ca2b4400a4fd3c667ce843d67) 2024-06-26T07:12:55.7621511Z - OpenMP 201511 (a.k.a. OpenMP 4.5) 2024-06-26T07:12:55.7622063Z - LAPACK is enabled (usually provided by MKL) 2024-06-26T07:12:55.7622552Z - NNPACK is enabled 2024-06-26T07:12:55.7622945Z - CPU capability usage: AVX2 2024-06-26T07:12:55.7623381Z - CUDA Runtime 12.1 2024-06-26T07:12:55.7623905Z - NVCC architecture flags: -gencode;arch=compute_86,code=sm_86 2024-06-26T07:12:55.7624514Z - CuDNN 90.1 (built against CUDA 12.4) 2024-06-26T07:12:55.7624962Z - Magma 2.6.1 2024-06-26T07:12:55.7632363Z - Build settings: BLAS_INFO=mkl, BUILD_TYPE=Release, CUDA_VERSION=12.1, CUDNN_VERSION=9.1.0, CXX_COMPILER=/opt/cache/bin/c++, CXX_FLAGS= -D_GLIBCXX_USE_CXX11_ABI=1 -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOROCTRACER -DUSE_FBGEMM -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -O2 -fPIC -Wall -Wextra -Werror=return-type -Werror=non-virtual-dtor -Werror=bool-operation -Wnarrowing -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-unused-parameter -Wno-unused-function -Wno-unused-result -Wno-strict-overflow -Wno-strict-aliasing -Wno-stringop-overflow -Wsuggest-override -Wno-psabi -Wno-error=pedantic -Wno-error=old-style-cast -Wno-missing-braces -fdiagnostics-color=always -faligned-new -Werror -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Wno-stringop-overflow, FORCE_FALLBACK_CUDA_MPI=1, LAPACK_INFO=mkl, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, PERF_WITH_AVX512=1, TORCH_VERSION=2.5.0, USE_CUDA=ON, USE_CUDNN=ON, USE_CUSPARSELT=ON, USE_EXCEPTION_PTR=1, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_GLOO=ON, USE_MKL=ON, USE_MKLDNN=ON, USE_MPI=ON, USE_NCCL=ON, USE_NNPACK=ON, USE_OPENMP=ON, USE_ROCM=OFF, USE_ROCM_KERNEL_ASSERT=OFF, 2024-06-26T07:12:55.7638823Z 2024-06-26T07:12:56.0362248Z + cd test 2024-06-26T07:12:56.0362952Z + python -c 'import torch; print(torch.__config__.parallel_info())' 2024-06-26T07:12:57.2502649Z ATen/Parallel: 2024-06-26T07:12:57.2503198Z at::get_num_threads() : 8 2024-06-26T07:12:57.2503685Z at::get_num_interop_threads() : 16 2024-06-26T07:12:57.2504243Z OpenMP 201511 (a.k.a. OpenMP 4.5) 2024-06-26T07:12:57.2504788Z omp_get_max_threads() : 8 2024-06-26T07:12:57.2505907Z Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications 2024-06-26T07:12:57.2507082Z mkl_get_max_threads() : 8 2024-06-26T07:12:57.2507719Z Intel(R) MKL-DNN v3.4.2 (Git Hash 1137e04ec0b5251ca2b4400a4fd3c667ce843d67) 2024-06-26T07:12:57.2508381Z std::thread::hardware_concurrency() : 16 2024-06-26T07:12:57.2508833Z Environment variables: 2024-06-26T07:12:57.2509207Z OMP_NUM_THREADS : [not set] 2024-06-26T07:12:57.2509600Z MKL_NUM_THREADS : [not set] 2024-06-26T07:12:57.2509993Z ATen parallel backend: OpenMP 2024-06-26T07:12:57.2510260Z 2024-06-26T07:12:57.4921976Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *aarch64* ]] 2024-06-26T07:12:57.4922723Z + [[ aot_eager_timm == *backward* ]] 2024-06-26T07:12:57.4923301Z + [[ aot_eager_timm == *xla* ]] 2024-06-26T07:12:57.4923789Z + [[ aot_eager_timm == *executorch* ]] 2024-06-26T07:12:57.4924297Z + [[ aot_eager_timm == \j\i\t\_\l\e\g\a\c\y ]] 2024-06-26T07:12:57.4925091Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *libtorch* ]] 2024-06-26T07:12:57.4925855Z + [[ aot_eager_timm == distributed ]] 2024-06-26T07:12:57.4926329Z + [[ aot_eager_timm == *inductor_distributed* ]] 2024-06-26T07:12:57.4926869Z + [[ aot_eager_timm == *inductor-halide* ]] 2024-06-26T07:12:57.4927422Z + [[ aot_eager_timm == *inductor-micro-benchmark* ]] 2024-06-26T07:12:57.4927930Z + [[ aot_eager_timm == *huggingface* ]] 2024-06-26T07:12:57.4928365Z + [[ aot_eager_timm == *timm* ]] 2024-06-26T07:12:57.4928752Z + install_torchvision 2024-06-26T07:12:57.4929098Z + local orig_preload 2024-06-26T07:12:57.4929430Z + local commit 2024-06-26T07:12:57.4929745Z ++ get_pinned_commit vision 2024-06-26T07:12:57.4930135Z ++ cat .github/ci_commit_pins/vision.txt 2024-06-26T07:12:57.4935102Z + commit=d23a6e1664d20707c11781299611436e1f0c104f 2024-06-26T07:12:57.4935637Z + orig_preload= 2024-06-26T07:12:57.4936029Z + '[' -n '' ']' 2024-06-26T07:12:57.4937072Z + pip_install --no-use-pep517 --user git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2024-06-26T07:12:57.4938640Z + pip install --progress-bar off --no-use-pep517 --user git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2024-06-26T07:12:57.8008607Z Collecting git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2024-06-26T07:12:57.8013095Z Cloning https://github.com/pytorch/vision.git (to revision d23a6e1664d20707c11781299611436e1f0c104f) to /tmp/pip-req-build-zu_ripai 2024-06-26T07:12:57.8029046Z Running command git clone --filter=blob:none --quiet https://github.com/pytorch/vision.git /tmp/pip-req-build-zu_ripai 2024-06-26T07:12:59.2624902Z Running command git rev-parse -q --verify 'sha^d23a6e1664d20707c11781299611436e1f0c104f' 2024-06-26T07:12:59.2644167Z Running command git fetch -q https://github.com/pytorch/vision.git d23a6e1664d20707c11781299611436e1f0c104f 2024-06-26T07:13:00.4657325Z Running command git checkout -q d23a6e1664d20707c11781299611436e1f0c104f 2024-06-26T07:13:00.6946252Z Resolved https://github.com/pytorch/vision.git to commit d23a6e1664d20707c11781299611436e1f0c104f 2024-06-26T07:13:02.9806085Z Preparing metadata (setup.py) ... [?25l- \ done 2024-06-26T07:13:02.9852867Z [?25hRequirement already satisfied: numpy in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (1.21.2) 2024-06-26T07:13:02.9855616Z Requirement already satisfied: torch in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (2.5.0a0+gitb8c4c54) 2024-06-26T07:13:02.9861266Z Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (10.3.0) 2024-06-26T07:13:03.0063102Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (3.13.1) 2024-06-26T07:13:03.0069988Z Requirement already satisfied: typing-extensions>=4.8.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (4.12.2) 2024-06-26T07:13:03.0072290Z Requirement already satisfied: sympy in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (1.12.1) 2024-06-26T07:13:03.0075276Z Requirement already satisfied: networkx in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (2.8.8) 2024-06-26T07:13:03.0078161Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (3.1.4) 2024-06-26T07:13:03.0080673Z Requirement already satisfied: fsspec in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (2024.2.0) 2024-06-26T07:13:03.0504739Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from jinja2->torch->torchvision==0.19.0a0+d23a6e1) (2.1.5) 2024-06-26T07:13:03.0659122Z Requirement already satisfied: mpmath<1.4.0,>=1.1.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from sympy->torch->torchvision==0.19.0a0+d23a6e1) (1.3.0) 2024-06-26T07:13:03.0730586Z Building wheels for collected packages: torchvision 2024-06-26T07:14:16.8659748Z Building wheel for torchvision (setup.py) ... [?25l- \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - done 2024-06-26T07:14:16.8686198Z [?25h Created wheel for torchvision: filename=torchvision-0.19.0a0+d23a6e1-cp310-cp310-linux_x86_64.whl size=2113188 sha256=ae35737589ce0a4691042dc67334a74a30444b228686d7d7c19214c70dc5a376 2024-06-26T07:14:16.8688570Z Stored in directory: /var/lib/jenkins/.cache/pip/wheels/0e/56/35/02931e71eb23fd2b85591c7ec05b733ca7c8b328a2fd151f96 2024-06-26T07:14:16.8722880Z Successfully built torchvision 2024-06-26T07:14:18.0642585Z Installing collected packages: torchvision 2024-06-26T07:14:18.4438846Z Successfully installed torchvision-0.19.0a0+d23a6e1 2024-06-26T07:14:18.5516881Z + '[' -n '' ']' 2024-06-26T07:14:18.5517285Z + id=1 2024-06-26T07:14:18.5517605Z + test_dynamo_benchmark timm_models 1 2024-06-26T07:14:18.5520424Z ++ pwd 2024-06-26T07:14:18.5522938Z + TEST_REPORTS_DIR=/var/lib/jenkins/workspace/test/test-reports 2024-06-26T07:14:18.5523565Z + local suite=timm_models 2024-06-26T07:14:18.5523961Z + shift 2024-06-26T07:14:18.5524251Z + local shard_id=1 2024-06-26T07:14:18.5524659Z + shift 2024-06-26T07:14:18.5524996Z + [[ aot_eager_timm == *perf_compare* ]] 2024-06-26T07:14:18.5525601Z + [[ aot_eager_timm == *perf* ]] 2024-06-26T07:14:18.5526127Z + [[ aot_eager_timm == *cpu_inductor* ]] 2024-06-26T07:14:18.5528706Z + [[ aot_eager_timm == *aot_inductor* ]] 2024-06-26T07:14:18.5529625Z + test_single_dynamo_benchmark inference timm_models 1 --inference --bfloat16 2024-06-26T07:14:18.5530307Z ++ pwd 2024-06-26T07:14:18.5530834Z + TEST_REPORTS_DIR=/var/lib/jenkins/workspace/test/test-reports 2024-06-26T07:14:18.5531519Z + mkdir -p /var/lib/jenkins/workspace/test/test-reports 2024-06-26T07:14:18.5538981Z + local name=inference 2024-06-26T07:14:18.5539369Z + shift 2024-06-26T07:14:18.5539724Z + local suite=timm_models 2024-06-26T07:14:18.5540116Z + shift 2024-06-26T07:14:18.5540457Z + local shard_id=1 2024-06-26T07:14:18.5540770Z + shift 2024-06-26T07:14:18.5541061Z + partition_flags=() 2024-06-26T07:14:18.5541417Z + local partition_flags 2024-06-26T07:14:18.5541824Z + [[ -n 2 ]] 2024-06-26T07:14:18.5542158Z + [[ -n 1 ]] 2024-06-26T07:14:18.5542762Z + partition_flags=(--total-partitions "$NUM_TEST_SHARDS" --partition-id "$shard_id") 2024-06-26T07:14:18.5543450Z + [[ aot_eager_timm == *perf_compare* ]] 2024-06-26T07:14:18.5543900Z + [[ aot_eager_timm == *perf* ]] 2024-06-26T07:14:18.5544319Z + [[ aot_eager_timm == *aot_inductor* ]] 2024-06-26T07:14:18.5545948Z + python benchmarks/dynamo/timm_models.py --ci --accuracy --timing --explain --backend aot_eager --device cuda --inference --bfloat16 --total-partitions 2 --partition-id 1 --output /var/lib/jenkins/workspace/test/test-reports/inference_timm_models.csv 2024-06-26T07:14:24.4254446Z 2024-06-26T07:14:24.7100888Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:14:24.7101234Z 2024-06-26T07:14:24.7695175Z model.safetensors: 0% 0.00/29.6M [00:00 will be ignored 2024-06-26T07:23:23.8430957Z pass 2024-06-26T07:23:23.8478665Z TIMING: entire_frame_compile:26.40515 backend_compile:14.83152 2024-06-26T07:23:23.8481647Z STATS: call_* op count: 797 | FakeTensor.__torch_dispatch__:3595 | FakeTensorMode.__torch_dispatch__:47518 | ProxyTorchDispatchMode.__torch_dispatch__:12852 2024-06-26T07:23:23.8482847Z Dynamo produced 4 graphs covering 797 ops with 7 graph breaks (5 unique) 2024-06-26T07:23:28.0342948Z 2024-06-26T07:23:28.7150980Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:23:28.7151493Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:23:28.7151963Z cuda train mobilenetv2_100 2024-06-26T07:23:38.2611505Z W0626 07:23:38.260000 140296728887936 torch/_logging/_internal.py:1040] [6/0] Profiler function will be ignored 2024-06-26T07:23:55.4809383Z pass 2024-06-26T07:23:55.4884911Z TIMING: entire_frame_compile:25.51751 backend_compile:14.17051 2024-06-26T07:23:55.4886107Z STATS: call_* op count: 796 | FakeTensor.__torch_dispatch__:3572 | FakeTensorMode.__torch_dispatch__:46936 | ProxyTorchDispatchMode.__torch_dispatch__:12588 2024-06-26T07:23:55.4887268Z Dynamo produced 3 graphs covering 796 ops with 7 graph breaks (5 unique) 2024-06-26T07:23:59.5939378Z 2024-06-26T07:24:00.3614501Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:24:00.3615115Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:24:00.3615591Z cuda train mobilenetv3_large_100 2024-06-26T07:24:10.1275290Z W0626 07:24:10.126000 140576728756864 torch/_logging/_internal.py:1040] [6/0] Profiler function will be ignored 2024-06-26T07:24:30.0906028Z pass 2024-06-26T07:24:30.0965925Z TIMING: entire_frame_compile:28.6604 backend_compile:16.40986 2024-06-26T07:24:30.0968456Z STATS: call_* op count: 855 | FakeTensor.__torch_dispatch__:4136 | FakeTensorMode.__torch_dispatch__:50873 | ProxyTorchDispatchMode.__torch_dispatch__:14152 2024-06-26T07:24:30.0969644Z Dynamo produced 3 graphs covering 855 ops with 7 graph breaks (5 unique) 2024-06-26T07:24:34.3101124Z 2024-06-26T07:24:35.0487408Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:24:35.0487915Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:24:35.0488377Z cuda train mobilevit_s 2024-06-26T07:24:47.9833050Z pass 2024-06-26T07:24:48.0073089Z TIMING: entire_frame_compile:11.28084 backend_compile:6.69718 2024-06-26T07:24:48.0074315Z STATS: call_* op count: 503 | FakeTensor.__torch_dispatch__:1143 | FakeTensorMode.__torch_dispatch__:33487 | ProxyTorchDispatchMode.__torch_dispatch__:10817 2024-06-26T07:24:48.0075530Z Dynamo produced 3 graphs covering 503 ops with 6 graph breaks (5 unique) 2024-06-26T07:24:51.9301167Z 2024-06-26T07:24:52.9668764Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:24:52.9669512Z loading model: 0it [00:01, ?it/s] 2024-06-26T07:24:52.9670175Z cuda train nfnet_l0 2024-06-26T07:25:08.2439496Z W0626 07:25:08.243000 140083434472064 torch/_logging/_internal.py:1040] [6/0] Profiler function will be ignored 2024-06-26T07:25:37.0364585Z pass 2024-06-26T07:25:37.0696169Z TIMING: entire_frame_compile:41.60776 backend_compile:22.71468 2024-06-26T07:25:37.0697546Z STATS: call_* op count: 1232 | FakeTensorMode.__torch_dispatch__:64877 | FakeTensor.__torch_dispatch__:4716 | ProxyTorchDispatchMode.__torch_dispatch__:21252 2024-06-26T07:25:37.0698710Z Dynamo produced 3 graphs covering 1232 ops with 7 graph breaks (5 unique) 2024-06-26T07:25:41.5263136Z 2024-06-26T07:25:42.4450338Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:25:42.4450941Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:25:42.4451405Z cuda train pit_b_224 2024-06-26T07:25:53.0890361Z pass 2024-06-26T07:25:53.1396457Z TIMING: entire_frame_compile:6.92559 backend_compile:4.65574 2024-06-26T07:25:53.1397756Z STATS: call_* op count: 404 | FakeTensor.__torch_dispatch__:1224 | FakeTensorMode.__torch_dispatch__:23774 | ProxyTorchDispatchMode.__torch_dispatch__:8724 2024-06-26T07:25:53.1399300Z Dynamo produced 2 graphs covering 404 ops with 6 graph breaks (5 unique) 2024-06-26T07:25:56.8784916Z 2024-06-26T07:25:58.3742531Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:25:58.3743472Z loading model: 0it [00:01, ?it/s] 2024-06-26T07:25:58.3744394Z cuda train pnasnet5large 2024-06-26T07:26:39.1973873Z pass 2024-06-26T07:26:39.3084088Z TIMING: entire_frame_compile:31.19856 backend_compile:20.31849 2024-06-26T07:26:39.3086443Z STATS: call_* op count: 963 | FakeTensor.__torch_dispatch__:4577 | FakeTensorMode.__torch_dispatch__:114936 | ProxyTorchDispatchMode.__torch_dispatch__:30261 2024-06-26T07:26:39.3087612Z Dynamo produced 2 graphs covering 963 ops with 5 graph breaks (4 unique) 2024-06-26T07:26:43.6104259Z 2024-06-26T07:26:44.8349026Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:26:44.8349596Z loading model: 0it [00:01, ?it/s] 2024-06-26T07:26:44.8353479Z cuda train poolformer_m36 2024-06-26T07:27:04.0814317Z pass 2024-06-26T07:27:04.1420499Z TIMING: entire_frame_compile:15.42292 backend_compile:8.39842 2024-06-26T07:27:04.1421792Z STATS: call_* op count: 741 | FakeTensor.__torch_dispatch__:965 | FakeTensorMode.__torch_dispatch__:39329 | ProxyTorchDispatchMode.__torch_dispatch__:13481 2024-06-26T07:27:04.1422956Z Dynamo produced 2 graphs covering 741 ops with 6 graph breaks (5 unique) 2024-06-26T07:27:08.0653664Z 2024-06-26T07:27:08.7472451Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:27:08.7473172Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:27:08.7473855Z cuda train regnety_002 2024-06-26T07:27:19.3564932Z pass 2024-06-26T07:27:19.3598727Z TIMING: entire_frame_compile:9.73632 backend_compile:5.28154 2024-06-26T07:27:19.3601140Z STATS: call_* op count: 369 | FakeTensor.__torch_dispatch__:657 | FakeTensorMode.__torch_dispatch__:26584 | ProxyTorchDispatchMode.__torch_dispatch__:7367 2024-06-26T07:27:19.3602333Z Dynamo produced 2 graphs covering 369 ops with 6 graph breaks (5 unique) 2024-06-26T07:27:23.1395407Z 2024-06-26T07:27:24.0826680Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:27:24.0827180Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:27:24.0827639Z cuda train repvgg_a2 2024-06-26T07:27:36.4643584Z W0626 07:27:36.463000 140218566808192 torch/_logging/_internal.py:1040] [6/0] Profiler function will be ignored 2024-06-26T07:27:54.3814535Z pass 2024-06-26T07:27:54.4077317Z TIMING: entire_frame_compile:27.81732 backend_compile:15.18843 2024-06-26T07:27:54.4080100Z STATS: call_* op count: 920 | FakeTensor.__torch_dispatch__:3603 | FakeTensorMode.__torch_dispatch__:50856 | ProxyTorchDispatchMode.__torch_dispatch__:13620 2024-06-26T07:27:54.4081335Z Dynamo produced 3 graphs covering 920 ops with 7 graph breaks (5 unique) 2024-06-26T07:27:58.5291588Z 2024-06-26T07:27:59.8250287Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:27:59.8250837Z loading model: 0it [00:01, ?it/s] 2024-06-26T07:27:59.8251605Z cuda train res2net101_26w_4s 2024-06-26T07:28:26.0162066Z pass 2024-06-26T07:28:26.0541904Z TIMING: entire_frame_compile:21.87671 backend_compile:16.3451 2024-06-26T07:28:26.0543019Z STATS: call_* op count: 807 | FakeTensor.__torch_dispatch__:3151 | FakeTensorMode.__torch_dispatch__:90674 | ProxyTorchDispatchMode.__torch_dispatch__:21353 2024-06-26T07:28:26.0547153Z Dynamo produced 2 graphs covering 807 ops with 6 graph breaks (5 unique) 2024-06-26T07:28:30.1282387Z 2024-06-26T07:28:31.1548590Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:28:31.1549135Z loading model: 0it [00:01, ?it/s] 2024-06-26T07:28:31.1549600Z cuda train res2net50_14w_8s 2024-06-26T07:28:53.6694667Z pass 2024-06-26T07:28:53.6904806Z TIMING: entire_frame_compile:19.5835 backend_compile:15.01502 2024-06-26T07:28:53.6907267Z STATS: call_* op count: 703 | FakeTensor.__torch_dispatch__:2776 | FakeTensorMode.__torch_dispatch__:83387 | ProxyTorchDispatchMode.__torch_dispatch__:18803 2024-06-26T07:28:53.6908962Z Dynamo produced 2 graphs covering 703 ops with 6 graph breaks (5 unique) 2024-06-26T07:28:57.8012542Z 2024-06-26T07:28:58.7065255Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:28:58.7065762Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:28:58.7066220Z cuda train res2next50 2024-06-26T07:29:11.9488887Z pass 2024-06-26T07:29:11.9722355Z TIMING: entire_frame_compile:10.97494 backend_compile:8.10928 2024-06-26T07:29:11.9723597Z STATS: call_* op count: 399 | FakeTensor.__torch_dispatch__:1606 | FakeTensorMode.__torch_dispatch__:45488 | ProxyTorchDispatchMode.__torch_dispatch__:10643 2024-06-26T07:29:11.9726652Z Dynamo produced 2 graphs covering 399 ops with 6 graph breaks (5 unique) 2024-06-26T07:29:15.8176198Z 2024-06-26T07:29:16.3917000Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:29:16.3917500Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:29:16.3917953Z cuda train resmlp_12_224 2024-06-26T07:29:22.7039120Z pass 2024-06-26T07:29:22.7165109Z TIMING: entire_frame_compile:5.07292 backend_compile:2.97831 2024-06-26T07:29:22.7166201Z STATS: call_* op count: 216 | FakeTensor.__torch_dispatch__:486 | FakeTensorMode.__torch_dispatch__:15052 | ProxyTorchDispatchMode.__torch_dispatch__:6468 2024-06-26T07:29:22.7167342Z Dynamo produced 2 graphs covering 216 ops with 6 graph breaks (5 unique) 2024-06-26T07:29:26.4036536Z 2024-06-26T07:29:27.8293079Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:29:27.8293634Z loading model: 0it [00:01, ?it/s] 2024-06-26T07:29:27.8294177Z cuda train resnest101e 2024-06-26T07:29:55.1506700Z pass 2024-06-26T07:29:55.2060378Z TIMING: entire_frame_compile:21.10235 backend_compile:14.95468 2024-06-26T07:29:55.2062814Z STATS: call_* op count: 1022 | FakeTensor.__torch_dispatch__:3179 | FakeTensorMode.__torch_dispatch__:84923 | ProxyTorchDispatchMode.__torch_dispatch__:23525 2024-06-26T07:29:55.2063997Z Dynamo produced 2 graphs covering 1022 ops with 6 graph breaks (5 unique) 2024-06-26T07:29:59.2367393Z 2024-06-26T07:30:00.1255198Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:30:00.1258026Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:30:00.1260626Z cuda train rexnet_100 2024-06-26T07:30:13.9289769Z W0626 07:30:13.927000 140172175536768 torch/_logging/_internal.py:1040] [6/0] Profiler function will be ignored 2024-06-26T07:30:39.4379773Z pass 2024-06-26T07:30:39.4539995Z TIMING: entire_frame_compile:37.87741 backend_compile:21.13266 2024-06-26T07:30:39.4543416Z STATS: call_* op count: 1104 | FakeTensor.__torch_dispatch__:5737 | FakeTensorMode.__torch_dispatch__:69031 | ProxyTorchDispatchMode.__torch_dispatch__:19554 2024-06-26T07:30:39.4544587Z Dynamo produced 3 graphs covering 1104 ops with 7 graph breaks (5 unique) 2024-06-26T07:30:43.8950093Z 2024-06-26T07:30:44.7728233Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:30:44.7728816Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:30:44.7732105Z cuda train sebotnet33ts_256 2024-06-26T07:30:56.8210818Z pass 2024-06-26T07:30:56.8401502Z TIMING: entire_frame_compile:10.15688 backend_compile:5.76107 2024-06-26T07:30:56.8402811Z STATS: call_* op count: 466 | FakeTensor.__torch_dispatch__:495 | FakeTensorMode.__torch_dispatch__:28170 | ProxyTorchDispatchMode.__torch_dispatch__:8767 2024-06-26T07:30:56.8403947Z Dynamo produced 3 graphs covering 466 ops with 6 graph breaks (5 unique) 2024-06-26T07:31:00.7460425Z 2024-06-26T07:31:01.7194666Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:31:01.7195162Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:31:01.7195609Z cuda train selecsls42b 2024-06-26T07:31:08.3488772Z pass 2024-06-26T07:31:08.3753233Z TIMING: entire_frame_compile:5.16776 backend_compile:3.6352 2024-06-26T07:31:08.3754312Z STATS: call_* op count: 137 | FakeTensor.__torch_dispatch__:837 | FakeTensorMode.__torch_dispatch__:20420 | ProxyTorchDispatchMode.__torch_dispatch__:4891 2024-06-26T07:31:08.3755752Z Dynamo produced 2 graphs covering 137 ops with 6 graph breaks (5 unique) 2024-06-26T07:31:12.0814952Z 2024-06-26T07:31:12.7772591Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:31:12.7773089Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:31:12.7774965Z cuda train spnasnet_100 2024-06-26T07:31:24.7126776Z W0626 07:31:24.711000 140188679725696 torch/_logging/_internal.py:1040] [6/0] Profiler function will be ignored 2024-06-26T07:31:46.4518449Z pass 2024-06-26T07:31:46.4573845Z TIMING: entire_frame_compile:32.25484 backend_compile:17.97382 2024-06-26T07:31:46.4577328Z STATS: call_* op count: 976 | FakeTensor.__torch_dispatch__:4364 | FakeTensorMode.__torch_dispatch__:58185 | ProxyTorchDispatchMode.__torch_dispatch__:15761 2024-06-26T07:31:46.4578497Z Dynamo produced 3 graphs covering 976 ops with 7 graph breaks (5 unique) 2024-06-26T07:31:50.7112066Z 2024-06-26T07:31:52.3793768Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:31:52.3794287Z loading model: 0it [00:01, ?it/s] 2024-06-26T07:31:52.3794760Z cuda train swin_base_patch4_window7_224 2024-06-26T07:32:17.2084805Z W0626 07:32:17.207000 140189848691328 torch/_logging/_internal.py:1040] [6/0] Profiler function will be ignored 2024-06-26T07:32:49.4074425Z pass 2024-06-26T07:32:49.4882469Z TIMING: entire_frame_compile:51.2707 backend_compile:32.24151 2024-06-26T07:32:49.4884575Z STATS: call_* op count: 2473 | FakeTensor.__torch_dispatch__:8284 | FakeTensorMode.__torch_dispatch__:114519 | ProxyTorchDispatchMode.__torch_dispatch__:39913 2024-06-26T07:32:49.4885755Z Dynamo produced 3 graphs covering 2473 ops with 7 graph breaks (5 unique) 2024-06-26T07:32:54.2096377Z 2024-06-26T07:32:57.0484749Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:32:57.0485236Z loading model: 0it [00:02, ?it/s] 2024-06-26T07:32:57.0485703Z cuda train swsl_resnext101_32x16d 2024-06-26T07:33:20.1312130Z pass 2024-06-26T07:33:20.2844166Z TIMING: entire_frame_compile:12.1509 backend_compile:8.75208 2024-06-26T07:33:20.2845301Z STATS: call_* op count: 415 | FakeTensor.__torch_dispatch__:1945 | FakeTensorMode.__torch_dispatch__:50015 | ProxyTorchDispatchMode.__torch_dispatch__:11922 2024-06-26T07:33:20.2847837Z Dynamo produced 2 graphs covering 415 ops with 6 graph breaks (5 unique) 2024-06-26T07:33:24.1588705Z 2024-06-26T07:33:24.9036631Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:33:24.9037136Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:33:24.9037613Z cuda train tf_efficientnet_b0 2024-06-26T07:33:37.1075969Z pass 2024-06-26T07:33:37.1191054Z TIMING: entire_frame_compile:10.91098 backend_compile:6.14283 2024-06-26T07:33:37.1192149Z STATS: call_* op count: 371 | FakeTensorMode.__torch_dispatch__:30980 | FakeTensor.__torch_dispatch__:808 | ProxyTorchDispatchMode.__torch_dispatch__:9286 2024-06-26T07:33:37.1193273Z Dynamo produced 2 graphs covering 371 ops with 6 graph breaks (5 unique) 2024-06-26T07:33:40.9352209Z 2024-06-26T07:33:41.7828971Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:33:41.7829487Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:33:41.7829935Z cuda train tf_mixnet_l 2024-06-26T07:33:59.7571204Z pass 2024-06-26T07:33:59.7738256Z TIMING: entire_frame_compile:16.42993 backend_compile:9.29046 2024-06-26T07:33:59.7739382Z STATS: call_* op count: 692 | FakeTensorMode.__torch_dispatch__:46078 | FakeTensor.__torch_dispatch__:1198 | ProxyTorchDispatchMode.__torch_dispatch__:13503 2024-06-26T07:33:59.7740513Z Dynamo produced 2 graphs covering 692 ops with 6 graph breaks (5 unique) 2024-06-26T07:34:03.7375275Z 2024-06-26T07:34:04.5272112Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:34:04.5272617Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:34:04.5273063Z cuda train tinynet_a 2024-06-26T07:34:18.1901028Z E0626 07:34:18.189000 140198023443072 torch/_dynamo/utils.py:1470] RMSE (res-fp64): 0.00408, (ref-fp64): 0.00019 and shape=torch.Size([32]). res.dtype: torch.float32, multiplier: 3.000000, tol: 0.010000 2024-06-26T07:34:18.1903152Z E0626 07:34:18.189000 140198023443072 torch/_dynamo/utils.py:1384] Accuracy failed for key name bn1.weight.grad 2024-06-26T07:34:18.1928488Z fail_accuracy 2024-06-26T07:34:18.2027701Z TIMING: entire_frame_compile:12.6112 backend_compile:7.29552 2024-06-26T07:34:18.2028790Z STATS: call_* op count: 435 | FakeTensor.__torch_dispatch__:968 | FakeTensorMode.__torch_dispatch__:36443 | ProxyTorchDispatchMode.__torch_dispatch__:10942 2024-06-26T07:34:18.2029914Z Dynamo produced 2 graphs covering 435 ops with 6 graph breaks (5 unique) 2024-06-26T07:34:22.0832152Z 2024-06-26T07:34:22.9210022Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:34:22.9210515Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:34:22.9214104Z cuda train tnt_s_patch16_224 2024-06-26T07:34:40.9244383Z W0626 07:34:40.923000 140256155476608 torch/_logging/_internal.py:1040] [6/0] Profiler function will be ignored 2024-06-26T07:35:14.9971941Z pass 2024-06-26T07:35:15.0240485Z TIMING: entire_frame_compile:48.57141 backend_compile:31.52561 2024-06-26T07:35:15.0243762Z STATS: call_* op count: 1922 | FakeTensor.__torch_dispatch__:9011 | FakeTensorMode.__torch_dispatch__:109710 | ProxyTorchDispatchMode.__torch_dispatch__:38370 2024-06-26T07:35:15.0245013Z Dynamo produced 3 graphs covering 1922 ops with 7 graph breaks (5 unique) 2024-06-26T07:35:19.7790365Z 2024-06-26T07:35:20.9821256Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:35:20.9821780Z loading model: 0it [00:01, ?it/s] 2024-06-26T07:35:20.9822250Z cuda train twins_pcpvt_base 2024-06-26T07:35:42.4961973Z W0626 07:35:42.495000 139875421921920 torch/_logging/_internal.py:1040] [6/0] Profiler function will be ignored 2024-06-26T07:36:33.9700418Z pass 2024-06-26T07:36:34.0097223Z TIMING: entire_frame_compile:68.4943 backend_compile:42.83277 2024-06-26T07:36:34.0098469Z STATS: call_* op count: 2517 | FakeTensor.__torch_dispatch__:13565 | FakeTensorMode.__torch_dispatch__:144742 | ProxyTorchDispatchMode.__torch_dispatch__:48600 2024-06-26T07:36:34.0099790Z Dynamo produced 3 graphs covering 2517 ops with 7 graph breaks (5 unique) 2024-06-26T07:36:39.2908950Z 2024-06-26T07:36:40.3562016Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:36:40.3562509Z loading model: 0it [00:01, ?it/s] 2024-06-26T07:36:40.3565077Z cuda train visformer_small 2024-06-26T07:36:48.4881498Z W0626 07:36:48.487000 139861118468736 torch/_logging/_internal.py:1040] [6/0] Profiler function will be ignored 2024-06-26T07:37:03.2218472Z pass 2024-06-26T07:37:03.2555236Z TIMING: entire_frame_compile:20.51112 backend_compile:12.11496 2024-06-26T07:37:03.2559421Z STATS: call_* op count: 699 | FakeTensor.__torch_dispatch__:3149 | FakeTensorMode.__torch_dispatch__:40360 | ProxyTorchDispatchMode.__torch_dispatch__:12063 2024-06-26T07:37:03.2561891Z Dynamo produced 3 graphs covering 699 ops with 7 graph breaks (5 unique) 2024-06-26T07:37:07.2415533Z 2024-06-26T07:37:08.6356205Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:37:08.6356846Z loading model: 0it [00:01, ?it/s] 2024-06-26T07:37:08.6357391Z cuda train vit_base_patch16_224 2024-06-26T07:37:19.0387588Z W0626 07:37:19.037000 140212666278528 torch/_logging/_internal.py:1040] [6/0] Profiler function will be ignored 2024-06-26T07:37:33.7096512Z pass 2024-06-26T07:37:33.7988171Z TIMING: entire_frame_compile:20.1976 backend_compile:12.73635 2024-06-26T07:37:33.7990884Z STATS: call_* op count: 829 | FakeTensor.__torch_dispatch__:4013 | FakeTensorMode.__torch_dispatch__:42578 | ProxyTorchDispatchMode.__torch_dispatch__:14361 2024-06-26T07:37:33.7992064Z Dynamo produced 3 graphs covering 829 ops with 7 graph breaks (5 unique) 2024-06-26T07:37:37.7855725Z 2024-06-26T07:37:38.7489003Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:37:38.7490414Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:37:38.7491309Z cuda train volo_d1_224 2024-06-26T07:37:53.1647675Z W0626 07:37:53.163000 139642171384448 torch/_logging/_internal.py:1040] [6/0] Profiler function will be ignored 2024-06-26T07:38:18.2438306Z pass 2024-06-26T07:38:18.2666673Z TIMING: entire_frame_compile:35.85094 backend_compile:23.07094 2024-06-26T07:38:18.2669439Z STATS: call_* op count: 1410 | FakeTensor.__torch_dispatch__:6540 | FakeTensorMode.__torch_dispatch__:79746 | ProxyTorchDispatchMode.__torch_dispatch__:27449 2024-06-26T07:38:18.2670732Z Dynamo produced 3 graphs covering 1410 ops with 7 graph breaks (5 unique) 2024-06-26T07:38:22.6629862Z 2024-06-26T07:38:25.7588088Z loading model: 0it [00:00, ?it/s] 2024-06-26T07:38:25.7588682Z loading model: 0it [00:03, ?it/s] 2024-06-26T07:38:25.7589167Z cuda train xcit_large_24_p8_224 2024-06-26T07:38:25.8466775Z WARNING:common:fp64 golden ref were not generated for xcit_large_24_p8_224. Setting accuracy check to cosine 2024-06-26T07:38:53.7576909Z W0626 07:38:53.756000 140650980020864 torch/_logging/_internal.py:1040] [6/0] Profiler function will be ignored 2024-06-26T07:39:55.7964772Z pass_due_to_skip 2024-06-26T07:39:56.0563509Z TIMING: entire_frame_compile:85.24904 backend_compile:54.59365 2024-06-26T07:39:56.0565764Z STATS: call_* op count: 3114 | FakeTensor.__torch_dispatch__:15519 | FakeTensorMode.__torch_dispatch__:184981 | ProxyTorchDispatchMode.__torch_dispatch__:63689 2024-06-26T07:39:56.0566928Z Dynamo produced 3 graphs covering 3114 ops with 7 graph breaks (5 unique) 2024-06-26T07:39:58.8190089Z accuracy pass_rate=93.55% 2024-06-26T07:39:58.8194092Z calls_captured gmean=744.81x mean=934.323x 2024-06-26T07:39:58.8198232Z unique_graphs gmean=2.49x mean=2.548x 2024-06-26T07:39:58.8202057Z graph_breaks gmean=6.39x mean=6.419x 2024-06-26T07:39:58.8205978Z unique_graph_breaks gmean=4.96x mean=4.968x 2024-06-26T07:39:58.8209685Z autograd_captures gmean=0.00x mean=0.000x 2024-06-26T07:39:58.8213772Z autograd_compiles gmean=0.00x mean=0.000x 2024-06-26T07:39:58.8217993Z cudagraph_skips gmean=0.00x mean=0.000x 2024-06-26T07:39:59.4234143Z + python benchmarks/dynamo/check_accuracy.py --actual /var/lib/jenkins/workspace/test/test-reports/training_timm_models.csv --expected benchmarks/dynamo/ci_expected_accuracy//aot_eager_timm_training.csv 2024-06-26T07:39:59.6787714Z mixnet_l PASS 2024-06-26T07:39:59.6791644Z mnasnet_100 PASS 2024-06-26T07:39:59.6796820Z mobilenetv2_100 PASS 2024-06-26T07:39:59.6801383Z mobilenetv3_large_100 PASS 2024-06-26T07:39:59.6806271Z mobilevit_s PASS 2024-06-26T07:39:59.6811230Z nfnet_l0 PASS 2024-06-26T07:39:59.6816347Z pit_b_224 PASS 2024-06-26T07:39:59.6821754Z pnasnet5large PASS 2024-06-26T07:39:59.6827104Z poolformer_m36 PASS 2024-06-26T07:39:59.6831892Z regnety_002 PASS 2024-06-26T07:39:59.6837028Z repvgg_a2 PASS 2024-06-26T07:39:59.6841952Z res2net101_26w_4s PASS 2024-06-26T07:39:59.6847030Z res2net50_14w_8s PASS 2024-06-26T07:39:59.6851914Z res2next50 PASS 2024-06-26T07:39:59.6856890Z resmlp_12_224 PASS 2024-06-26T07:39:59.6862086Z resnest101e PASS 2024-06-26T07:39:59.6867065Z rexnet_100 PASS 2024-06-26T07:39:59.6872118Z sebotnet33ts_256 PASS 2024-06-26T07:39:59.6877306Z selecsls42b PASS 2024-06-26T07:39:59.6882337Z spnasnet_100 PASS 2024-06-26T07:39:59.6887509Z swin_base_patch4_window7_224 PASS 2024-06-26T07:39:59.6892293Z swsl_resnext101_32x16d PASS 2024-06-26T07:39:59.6897389Z tf_efficientnet_b0 PASS 2024-06-26T07:39:59.6902441Z tf_mixnet_l PASS 2024-06-26T07:39:59.6907403Z tinynet_a XFAIL 2024-06-26T07:39:59.6912514Z tnt_s_patch16_224 PASS 2024-06-26T07:39:59.6918005Z twins_pcpvt_base PASS 2024-06-26T07:39:59.6922722Z visformer_small PASS 2024-06-26T07:39:59.6927483Z vit_base_patch16_224 PASS 2024-06-26T07:39:59.6932433Z volo_d1_224 PASS 2024-06-26T07:39:59.6937766Z xcit_large_24_p8_224 XFAIL 2024-06-26T07:39:59.7312461Z + python benchmarks/dynamo/check_graph_breaks.py --actual /var/lib/jenkins/workspace/test/test-reports/training_timm_models.csv --expected benchmarks/dynamo/ci_expected_accuracy//aot_eager_timm_training.csv 2024-06-26T07:39:59.9880103Z mixnet_l PASS 2024-06-26T07:39:59.9884581Z mnasnet_100 PASS 2024-06-26T07:39:59.9889024Z mobilenetv2_100 PASS 2024-06-26T07:39:59.9893165Z mobilenetv3_large_100 PASS 2024-06-26T07:39:59.9897614Z mobilevit_s PASS 2024-06-26T07:39:59.9902302Z nfnet_l0 PASS 2024-06-26T07:39:59.9906686Z pit_b_224 PASS 2024-06-26T07:39:59.9911363Z pnasnet5large PASS 2024-06-26T07:39:59.9915702Z poolformer_m36 PASS 2024-06-26T07:39:59.9920070Z regnety_002 PASS 2024-06-26T07:39:59.9924571Z repvgg_a2 PASS 2024-06-26T07:39:59.9928921Z res2net101_26w_4s PASS 2024-06-26T07:39:59.9933302Z res2net50_14w_8s PASS 2024-06-26T07:39:59.9937632Z res2next50 PASS 2024-06-26T07:39:59.9942296Z resmlp_12_224 PASS 2024-06-26T07:39:59.9946602Z resnest101e PASS 2024-06-26T07:39:59.9951060Z rexnet_100 PASS 2024-06-26T07:39:59.9955682Z sebotnet33ts_256 PASS 2024-06-26T07:39:59.9960027Z selecsls42b PASS 2024-06-26T07:39:59.9964200Z spnasnet_100 PASS 2024-06-26T07:39:59.9968705Z swin_base_patch4_window7_224 PASS 2024-06-26T07:39:59.9973484Z swsl_resnext101_32x16d PASS 2024-06-26T07:39:59.9977937Z tf_efficientnet_b0 PASS 2024-06-26T07:39:59.9982402Z tf_mixnet_l PASS 2024-06-26T07:39:59.9986828Z tinynet_a PASS 2024-06-26T07:39:59.9991265Z tnt_s_patch16_224 PASS 2024-06-26T07:39:59.9995664Z twins_pcpvt_base PASS 2024-06-26T07:40:00.0000181Z visformer_small PASS 2024-06-26T07:40:00.0004510Z vit_base_patch16_224 PASS 2024-06-26T07:40:00.0008754Z volo_d1_224 PASS 2024-06-26T07:40:00.0013144Z xcit_large_24_p8_224 PASS 2024-06-26T07:40:00.0387473Z + cleanup_workspace 2024-06-26T07:40:00.0388499Z + echo 'sudo may print the following warning message that can be ignored. The chown command will still run.' 2024-06-26T07:40:00.0389600Z sudo may print the following warning message that can be ignored. The chown command will still run. 2024-06-26T07:40:00.0390606Z + echo ' sudo: setrlimit(RLIMIT_STACK): Operation not permitted' 2024-06-26T07:40:00.0391256Z sudo: setrlimit(RLIMIT_STACK): Operation not permitted 2024-06-26T07:40:00.0392076Z + echo 'For more details refer to https://github.com/sudo-project/sudo/issues/42' 2024-06-26T07:40:00.0392982Z For more details refer to https://github.com/sudo-project/sudo/issues/42 2024-06-26T07:40:00.0393685Z + sudo chown -R 1000 /var/lib/jenkins/workspace 2024-06-26T07:40:00.5815534Z ##[group]Run cat test/**/*_toprint.log || true 2024-06-26T07:40:00.5816059Z cat test/**/*_toprint.log || true 2024-06-26T07:40:00.5823929Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:40:00.5824548Z env: 2024-06-26T07:40:00.5824831Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:40:00.5825292Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:40:00.5826031Z DOCKER_CONTAINER_ID: 2b79e741618d7986dd1aa63a74f0acea4dd87abeed793c8c159fc5b900d83932 2024-06-26T07:40:00.5826688Z ##[endgroup] 2024-06-26T07:40:00.5888335Z cat: test/**/*_toprint.log: No such file or directory 2024-06-26T07:40:00.5917176Z ##[group]Run kill "$MONITOR_SCRIPT_PID" 2024-06-26T07:40:00.5917642Z kill "$MONITOR_SCRIPT_PID" 2024-06-26T07:40:00.5925224Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:40:00.5925730Z env: 2024-06-26T07:40:00.5926007Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:40:00.5926467Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:40:00.5927214Z DOCKER_CONTAINER_ID: 2b79e741618d7986dd1aa63a74f0acea4dd87abeed793c8c159fc5b900d83932 2024-06-26T07:40:00.5927883Z MONITOR_SCRIPT_PID: 27450 2024-06-26T07:40:00.5928240Z ##[endgroup] 2024-06-26T07:40:00.6114377Z Prepare all required actions 2024-06-26T07:40:00.6114888Z Getting action download info 2024-06-26T07:40:00.7677837Z Download action repository 'actions/upload-artifact@v3' (SHA:a8a3f3ad30e3422c9c7b888a15615d19a852ae32) 2024-06-26T07:40:00.9205953Z ##[group]Run ./.github/actions/upload-test-artifacts 2024-06-26T07:40:00.9206434Z with: 2024-06-26T07:40:00.9206994Z file-suffix: test-aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_26688916732 2024-06-26T07:40:00.9207634Z s3-bucket: gha-artifacts 2024-06-26T07:40:00.9207991Z env: 2024-06-26T07:40:00.9208277Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:40:00.9208741Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:40:00.9209496Z DOCKER_CONTAINER_ID: 2b79e741618d7986dd1aa63a74f0acea4dd87abeed793c8c159fc5b900d83932 2024-06-26T07:40:00.9210155Z ##[endgroup] 2024-06-26T07:40:00.9235948Z ##[group]Run # Remove any previous test jsons if they exist 2024-06-26T07:40:00.9236637Z # Remove any previous test jsons if they exist 2024-06-26T07:40:00.9237189Z rm -f test-jsons-*.zip 2024-06-26T07:40:00.9237713Z zip -r "test-jsons-${FILE_SUFFIX}.zip" test -i '*.json' 2024-06-26T07:40:00.9245488Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:40:00.9245998Z env: 2024-06-26T07:40:00.9246289Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:40:00.9246744Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:40:00.9247489Z DOCKER_CONTAINER_ID: 2b79e741618d7986dd1aa63a74f0acea4dd87abeed793c8c159fc5b900d83932 2024-06-26T07:40:00.9248360Z FILE_SUFFIX: test-aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_26688916732 2024-06-26T07:40:00.9248978Z ##[endgroup] 2024-06-26T07:40:00.9422259Z adding: test/allowlist_for_publicAPI.json (deflated 79%) 2024-06-26T07:40:00.9450993Z adding: test/benchmark_utils/callgrind_artifacts.json (deflated 92%) 2024-06-26T07:40:00.9451711Z adding: test/minioptest_failures_dict.json (deflated 70%) 2024-06-26T07:40:00.9457943Z adding: test/profiler/profiler_utils_mock_events.json (deflated 87%) 2024-06-26T07:40:00.9484419Z ##[group]Run # Remove any previous test reports if they exist 2024-06-26T07:40:00.9485067Z # Remove any previous test reports if they exist 2024-06-26T07:40:00.9485610Z rm -f test-reports-*.zip 2024-06-26T07:40:00.9486212Z zip -r "test-reports-${FILE_SUFFIX}.zip" test -i '*.xml' -i '*.csv' 2024-06-26T07:40:00.9493825Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:40:00.9494318Z env: 2024-06-26T07:40:00.9494608Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:40:00.9495069Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:40:00.9495809Z DOCKER_CONTAINER_ID: 2b79e741618d7986dd1aa63a74f0acea4dd87abeed793c8c159fc5b900d83932 2024-06-26T07:40:00.9496668Z FILE_SUFFIX: test-aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_26688916732 2024-06-26T07:40:00.9497533Z ##[endgroup] 2024-06-26T07:40:00.9656717Z adding: test/test-reports/inference_timm_models.csv (deflated 68%) 2024-06-26T07:40:00.9658047Z adding: test/test-reports/training_timm_models.csv (deflated 66%) 2024-06-26T07:40:00.9661972Z adding: test/test-reports/training_timm_model_graph_breaks.csv (deflated 97%) 2024-06-26T07:40:00.9662925Z adding: test/test-reports/training_timm_model_graph_break_deduped.csv (deflated 74%) 2024-06-26T07:40:00.9689041Z ##[group]Run # Remove any previous usage logs if they exist 2024-06-26T07:40:00.9689680Z # Remove any previous usage logs if they exist 2024-06-26T07:40:00.9690189Z rm -f logs-*.zip 2024-06-26T07:40:00.9690868Z # this workflow is also run in bazel build test, but we dont generate usage reports for it 2024-06-26T07:40:00.9691669Z # so check to see if the file exists first 2024-06-26T07:40:00.9692188Z if [ -f 'usage_log.txt' ]; then 2024-06-26T07:40:00.9692725Z  zip "logs-${FILE_SUFFIX}.zip" 'usage_log.txt' 2024-06-26T07:40:00.9693222Z fi 2024-06-26T07:40:00.9693709Z if ls test/**/*.log 1> /dev/null 2>&1; then 2024-06-26T07:40:00.9694315Z  zip -r "logs-${FILE_SUFFIX}.zip" test -i '*.log' 2024-06-26T07:40:00.9694815Z fi 2024-06-26T07:40:00.9702446Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:40:00.9702952Z env: 2024-06-26T07:40:00.9703247Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:40:00.9703702Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:40:00.9704443Z DOCKER_CONTAINER_ID: 2b79e741618d7986dd1aa63a74f0acea4dd87abeed793c8c159fc5b900d83932 2024-06-26T07:40:00.9705315Z FILE_SUFFIX: test-aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_26688916732 2024-06-26T07:40:00.9705936Z ##[endgroup] 2024-06-26T07:40:00.9751303Z adding: usage_log.txt (deflated 92%) 2024-06-26T07:40:00.9816696Z ##[group]Run # Remove any previous debugging artifacts if they exist 2024-06-26T07:40:00.9817781Z # Remove any previous debugging artifacts if they exist 2024-06-26T07:40:00.9818522Z rm -f debug-*.zip 2024-06-26T07:40:00.9818925Z if [ -d 'test/debug' ]; then 2024-06-26T07:40:00.9819439Z  zip -r "debug-${FILE_SUFFIX}.zip" test/debug 2024-06-26T07:40:00.9819925Z fi 2024-06-26T07:40:00.9826572Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:40:00.9827075Z env: 2024-06-26T07:40:00.9827358Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:40:00.9827819Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:40:00.9828569Z DOCKER_CONTAINER_ID: 2b79e741618d7986dd1aa63a74f0acea4dd87abeed793c8c159fc5b900d83932 2024-06-26T07:40:00.9829445Z FILE_SUFFIX: test-aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_26688916732 2024-06-26T07:40:00.9830070Z ##[endgroup] 2024-06-26T07:40:00.9903144Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-06-26T07:40:00.9903586Z with: 2024-06-26T07:40:00.9903886Z s3-bucket: gha-artifacts 2024-06-26T07:40:00.9904329Z s3-prefix: pytorch/pytorch/9673646806/1/artifact 2024-06-26T07:40:00.9904822Z retention-days: 14 2024-06-26T07:40:00.9905174Z if-no-files-found: warn 2024-06-26T07:40:00.9905543Z path: test-jsons-*.zip 2024-06-26T07:40:00.9905898Z name: artifact 2024-06-26T07:40:00.9906216Z region: us-east-1 2024-06-26T07:40:00.9906520Z env: 2024-06-26T07:40:00.9906814Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:40:00.9907271Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:40:00.9908020Z DOCKER_CONTAINER_ID: 2b79e741618d7986dd1aa63a74f0acea4dd87abeed793c8c159fc5b900d83932 2024-06-26T07:40:00.9908668Z ##[endgroup] 2024-06-26T07:40:01.2938072Z NOTE: s3-prefix specified, ignoring name parameter 2024-06-26T07:40:01.2938867Z With the provided path, there will be 1 file uploaded 2024-06-26T07:40:01.2939671Z Uploading to s3 prefix: pytorch/pytorch/9673646806/1/artifact 2024-06-26T07:40:01.2964585Z Starting upload of test-jsons-test-aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_26688916732.zip 2024-06-26T07:40:01.4360665Z Finished upload of test-jsons-test-aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_26688916732.zip 2024-06-26T07:40:01.4488404Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-06-26T07:40:01.4488854Z with: 2024-06-26T07:40:01.4489147Z s3-bucket: gha-artifacts 2024-06-26T07:40:01.4489580Z s3-prefix: pytorch/pytorch/9673646806/1/artifact 2024-06-26T07:40:01.4490056Z retention-days: 14 2024-06-26T07:40:01.4490403Z if-no-files-found: error 2024-06-26T07:40:01.4490775Z path: test-reports-*.zip 2024-06-26T07:40:01.4491134Z name: artifact 2024-06-26T07:40:01.4491438Z region: us-east-1 2024-06-26T07:40:01.4491748Z env: 2024-06-26T07:40:01.4492033Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:40:01.4492487Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:40:01.4493221Z DOCKER_CONTAINER_ID: 2b79e741618d7986dd1aa63a74f0acea4dd87abeed793c8c159fc5b900d83932 2024-06-26T07:40:01.4493862Z ##[endgroup] 2024-06-26T07:40:01.7600384Z NOTE: s3-prefix specified, ignoring name parameter 2024-06-26T07:40:01.7601676Z With the provided path, there will be 1 file uploaded 2024-06-26T07:40:01.7602372Z Uploading to s3 prefix: pytorch/pytorch/9673646806/1/artifact 2024-06-26T07:40:01.7626913Z Starting upload of test-reports-test-aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_26688916732.zip 2024-06-26T07:40:01.8495139Z Finished upload of test-reports-test-aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_26688916732.zip 2024-06-26T07:40:01.8624565Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-06-26T07:40:01.8625021Z with: 2024-06-26T07:40:01.8625314Z s3-bucket: gha-artifacts 2024-06-26T07:40:01.8625750Z s3-prefix: pytorch/pytorch/9673646806/1/artifact 2024-06-26T07:40:01.8626227Z retention-days: 14 2024-06-26T07:40:01.8626568Z if-no-files-found: ignore 2024-06-26T07:40:01.8626933Z path: logs-*.zip 2024-06-26T07:40:01.8627258Z name: artifact 2024-06-26T07:40:01.8627570Z region: us-east-1 2024-06-26T07:40:01.8627870Z env: 2024-06-26T07:40:01.8628158Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:40:01.8628629Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:40:01.8629382Z DOCKER_CONTAINER_ID: 2b79e741618d7986dd1aa63a74f0acea4dd87abeed793c8c159fc5b900d83932 2024-06-26T07:40:01.8630024Z ##[endgroup] 2024-06-26T07:40:02.1609177Z NOTE: s3-prefix specified, ignoring name parameter 2024-06-26T07:40:02.1609857Z With the provided path, there will be 1 file uploaded 2024-06-26T07:40:02.1610530Z Uploading to s3 prefix: pytorch/pytorch/9673646806/1/artifact 2024-06-26T07:40:02.1636099Z Starting upload of logs-test-aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_26688916732.zip 2024-06-26T07:40:02.2711147Z Finished upload of logs-test-aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_26688916732.zip 2024-06-26T07:40:02.2843161Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-06-26T07:40:02.2843612Z with: 2024-06-26T07:40:02.2843913Z s3-bucket: gha-artifacts 2024-06-26T07:40:02.2844363Z s3-prefix: pytorch/pytorch/9673646806/1/artifact 2024-06-26T07:40:02.2844849Z retention-days: 14 2024-06-26T07:40:02.2845212Z if-no-files-found: ignore 2024-06-26T07:40:02.2845603Z path: debug-*.zip 2024-06-26T07:40:02.2845936Z name: artifact 2024-06-26T07:40:02.2846253Z region: us-east-1 2024-06-26T07:40:02.2846564Z env: 2024-06-26T07:40:02.2846855Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:40:02.2847370Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:40:02.2848107Z DOCKER_CONTAINER_ID: 2b79e741618d7986dd1aa63a74f0acea4dd87abeed793c8c159fc5b900d83932 2024-06-26T07:40:02.2848771Z ##[endgroup] 2024-06-26T07:40:02.5800861Z No files were found with the provided path: debug-*.zip. No artifacts will be uploaded. 2024-06-26T07:40:02.5932067Z ##[group]Run # shellcheck disable=SC2156 2024-06-26T07:40:02.5932552Z # shellcheck disable=SC2156 2024-06-26T07:40:02.5933350Z find . -iname "core.[1-9]*" -exec docker exec "${DOCKER_CONTAINER_ID}" sh -c "gdb python {} -ex 'bt' -ex 'q'" \; 2024-06-26T07:40:02.5941500Z shell: /usr/bin/bash -e {0} 2024-06-26T07:40:02.5941873Z env: 2024-06-26T07:40:02.5942165Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:40:02.5942769Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:40:02.5943517Z DOCKER_CONTAINER_ID: 2b79e741618d7986dd1aa63a74f0acea4dd87abeed793c8c159fc5b900d83932 2024-06-26T07:40:02.5944168Z ##[endgroup] 2024-06-26T07:40:02.7545113Z ##[group]Run pytorch/test-infra/.github/actions/teardown-linux@main 2024-06-26T07:40:02.7545679Z with: 2024-06-26T07:40:02.7545951Z env: 2024-06-26T07:40:02.7546240Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:40:02.7546696Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:40:02.7547449Z DOCKER_CONTAINER_ID: 2b79e741618d7986dd1aa63a74f0acea4dd87abeed793c8c159fc5b900d83932 2024-06-26T07:40:02.7548112Z ##[endgroup] 2024-06-26T07:40:02.7567303Z ##[group]Run set -eou pipefail 2024-06-26T07:40:02.7567876Z set -eou pipefail 2024-06-26T07:40:02.7568347Z  2024-06-26T07:40:02.7568858Z echo "Holding runner for 2 hours until all ssh sessions have logged out" 2024-06-26T07:40:02.7569488Z for _ in $(seq 1440); do 2024-06-26T07:40:02.7569982Z  # Break if no ssh session exists anymore 2024-06-26T07:40:02.7570486Z  if [ "$(who)" = "" ]; then 2024-06-26T07:40:02.7570905Z  break 2024-06-26T07:40:02.7571261Z  fi 2024-06-26T07:40:02.7571571Z  echo "." 2024-06-26T07:40:02.7571908Z  sleep 5 2024-06-26T07:40:02.7572237Z done 2024-06-26T07:40:02.7579920Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:40:02.7580423Z env: 2024-06-26T07:40:02.7580711Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:40:02.7581169Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:40:02.7581904Z DOCKER_CONTAINER_ID: 2b79e741618d7986dd1aa63a74f0acea4dd87abeed793c8c159fc5b900d83932 2024-06-26T07:40:02.7582541Z ##[endgroup] 2024-06-26T07:40:02.7607907Z Holding runner for 2 hours until all ssh sessions have logged out 2024-06-26T07:40:02.7643095Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2024-06-26T07:40:02.7643874Z # ignore expansion of "docker ps -q" since it could be empty 2024-06-26T07:40:02.7644481Z # shellcheck disable=SC2046 2024-06-26T07:40:02.7644959Z docker stop $(docker ps -q) || true 2024-06-26T07:40:02.7645446Z # Prune all of the docker images 2024-06-26T07:40:02.7645911Z docker system prune -af 2024-06-26T07:40:02.7653005Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:40:02.7653507Z env: 2024-06-26T07:40:02.7653788Z GIT_DEFAULT_BRANCH: main 2024-06-26T07:40:02.7654246Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-06-26T07:40:02.7654991Z DOCKER_CONTAINER_ID: 2b79e741618d7986dd1aa63a74f0acea4dd87abeed793c8c159fc5b900d83932 2024-06-26T07:40:02.7655644Z ##[endgroup] 2024-06-26T07:40:03.0723222Z 2b79e741618d 2024-06-26T07:40:03.8006906Z Deleted Containers: 2024-06-26T07:40:03.8007505Z 2b79e741618d7986dd1aa63a74f0acea4dd87abeed793c8c159fc5b900d83932 2024-06-26T07:40:03.8009309Z 2024-06-26T07:40:08.7648568Z Deleted Images: 2024-06-26T07:40:08.7650640Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T07:40:08.7653497Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks@sha256:216c88a4f79ebfa71a5dcf4d9a946548184354a3ea1f677f4b1065d28705debb 2024-06-26T07:40:08.7655113Z deleted: sha256:0058b15e517a024817bccd921dc9af264c964f500b3cb9b3f4649a8ac22cc2dd 2024-06-26T07:40:08.7655971Z deleted: sha256:754ead7012f0b7691885a9660f02e80be6cee8c5665486fb995c1fb06adb6e92 2024-06-26T07:40:08.7656825Z deleted: sha256:fbe4496d8830e11be86d8f222522e7956f32f85bfc06b05ea53961f34a58af74 2024-06-26T07:40:08.7657981Z deleted: sha256:1c83814aa1a1a7e0cc998e3479bdab8e8766b975560cbf00690acf39ed899a80 2024-06-26T07:40:08.7658832Z deleted: sha256:e9ea8e61942c7f8ae4aab97b8d102b01d6bb4b6cf2a605808cd34130a17d8a0f 2024-06-26T07:40:08.7659916Z deleted: sha256:acc5fc32588cd95e082a6ce35e48d0f303ae8f96e3ab65c4e375b85e1f3c4a92 2024-06-26T07:40:08.7660766Z deleted: sha256:a93e53400904d29e4185d3be942ea34f19572ea438962788ae4e9b3d9bf4c498 2024-06-26T07:40:08.7661700Z deleted: sha256:c97092b88b5e4c77c68bbc4b51afab64e38719af1ff58013ec49a696cdd40a6e 2024-06-26T07:40:08.7662537Z deleted: sha256:b132889c90d67ffa53655846603e3fcc2372c23f04dbdbc54690a39d304eb89b 2024-06-26T07:40:08.7663361Z deleted: sha256:915d54081ed607710624abe3f2490114c745858831f4fc13396bd3b4b9a121bc 2024-06-26T07:40:08.7664185Z deleted: sha256:bfa8d446c498c87f535aef102695564de1b22c755e6c63944ae2f5073a2b31ec 2024-06-26T07:40:08.7665025Z deleted: sha256:e71460fb363c29e70bbe357d680aaa7ae694f094ef2f2713609158ad90611744 2024-06-26T07:40:08.7665856Z deleted: sha256:84079bb1b4ee1d0119ae3d3e701de460a1324912297c675425c9a36d30fcdb0f 2024-06-26T07:40:08.7666702Z deleted: sha256:d86ac3ca148d4758cb03b493fdd49109d8f1a2c7c85c4b755493c3c4529553e5 2024-06-26T07:40:08.7667555Z deleted: sha256:532b3ab97c44a673a0d5f62ee46fa6a83248a84de8877754a612355be56ed0a3 2024-06-26T07:40:08.7668393Z deleted: sha256:617e2a35f25ae24500c88c0c9b8475f0687fbcbed3d200013b4c99c6d8941aff 2024-06-26T07:40:08.7669239Z deleted: sha256:b88120bcd5a26a660c09c5df13176e0ef098fb2c8cdb57d74ab0796a3d1194d6 2024-06-26T07:40:08.7670073Z deleted: sha256:c016b2e7764735243205fb76fa9a273bb3dd4bf05532288e3a613ce022131ac3 2024-06-26T07:40:08.7671131Z deleted: sha256:bcaca462c390deddd2995de2d245a7495e7d2e1e94f0edad30a573c83d0588fd 2024-06-26T07:40:08.7672061Z deleted: sha256:9e260eba003d5c25d7b410e5c4c3093845d9e46611896840901c689d7fbf8ee6 2024-06-26T07:40:08.7672887Z deleted: sha256:3e62b86f8b911a9b59c62d55f063e71683ae6a01c22418db5d27930712adaad6 2024-06-26T07:40:08.7673716Z deleted: sha256:905920ccb1d88449b8dde686c34a4b2a8b6f59e78ac44916b189ea3593b9fbbb 2024-06-26T07:40:08.7674543Z deleted: sha256:961201237e03acd5061406238dd7a3c1343ac888d7583212cd0ab5ae1b4f0540 2024-06-26T07:40:08.7675375Z deleted: sha256:70047a2aac62159fa28fb4dbd4567ec2ffbab68fe046967e09acb0eb3e5cb9cb 2024-06-26T07:40:08.7676268Z deleted: sha256:1ec680ad781436ae65fa987f5fa1ed032ecd5c82a6e35eea6707de501f62c0f4 2024-06-26T07:40:08.7677126Z deleted: sha256:ef859623a50e85abf6e6c1dbd6188aa765a66cc7b2bd618a1cbe4825b7b2bd91 2024-06-26T07:40:08.7677994Z deleted: sha256:404ade5cacff59773b93ab438bfa64cd3a171d07f6f168bdc4a5d4bfa0b43526 2024-06-26T07:40:08.7678849Z deleted: sha256:5b27de6ee3d9f2f18217bf18dec725f7b4954c0e48c85d35752634c22d62209b 2024-06-26T07:40:08.7679692Z deleted: sha256:498e39c575b3fa069acaac7e46b91b4e54ae3a05f2ada5c4347091f346f25d4c 2024-06-26T07:40:08.7680514Z deleted: sha256:1405919d2694d65669b1f4c842282021afe89208ce86570e96464903733da2d0 2024-06-26T07:40:08.7681330Z deleted: sha256:d5b41e5d70896c0472fc3e6da0516a17d89cd6635dc75010ecddc31ce9690fad 2024-06-26T07:40:08.7682169Z deleted: sha256:18e9379b62b9d0bb40293d28a652eafaee66a499f66f0776bf14e37a513101b7 2024-06-26T07:40:08.7683010Z deleted: sha256:a781f80ed00ff2926a699fd01a309bb0b4fb7d5655eb652c205bb9c7f811035f 2024-06-26T07:40:08.7683845Z deleted: sha256:c0430973b7cf759075330ee29c79bfd1312c91e6033d9dd883b4b1c29743a171 2024-06-26T07:40:08.7684677Z deleted: sha256:e733b3d66efb9342e5a283376c0e1ddffa47a42fecc26e61ecaf0a3472885d97 2024-06-26T07:40:08.7685519Z deleted: sha256:8929c0b2047f74b84c82c39eff9077a92ae1a828cde00c9ab78fb3e0ed5e0283 2024-06-26T07:40:08.7686349Z deleted: sha256:f5b56155fb58a0a60fe6391d3581cf91610ed69d4f0a321257c19944da296a52 2024-06-26T07:40:08.7687174Z deleted: sha256:b54d2cb355238d1aa91e58df93064447b80f53706d1ca62823acc834f5ac54fe 2024-06-26T07:40:08.7687997Z deleted: sha256:e7311285af9eeddb51aa5629aa98386e89f1456ff32843b6aee6443247edf66c 2024-06-26T07:40:08.7688828Z deleted: sha256:67657ceec347da8dc8085d5731633efeac115ba677fa4b7c5966c4260f7abab0 2024-06-26T07:40:08.7689663Z deleted: sha256:b496e50409dbf414930fc9b4437aa0aa4ce27bc7840e050ae459aaffcf9aca86 2024-06-26T07:40:08.7690489Z deleted: sha256:8f5276170cc4a60d36ad7b964a502306b29546254cedcbcb101ea9123497d2c0 2024-06-26T07:40:08.7691383Z deleted: sha256:53d524d1564745e96a7e515462171b73184d9f1ff5454b32fcfbbca39d361467 2024-06-26T07:40:08.7692233Z deleted: sha256:2acbadb00d69b6aca575f04baba4ea26ae2b5c2d85f09945004ad93a78a8eb75 2024-06-26T07:40:08.7693168Z deleted: sha256:02665efeff878aeb603c1edb2e21cb700c171c025d64f5aae1b2b20b12f3964a 2024-06-26T07:40:08.7694021Z deleted: sha256:19bd23e9a51dfe883a8b8d2ff6d66ff1b3476b8912856406bb79b81762aa6d4b 2024-06-26T07:40:08.7694856Z deleted: sha256:73aa8637bf9299d6298dabd858480c274a62117388f2ca1d5e9eb15c6d1e4155 2024-06-26T07:40:08.7695685Z deleted: sha256:5f8968406305f348b1caebc0e035187d6e9965ace7b9d5f2f21114d37c9fe2e1 2024-06-26T07:40:08.7696514Z deleted: sha256:d827104914db0c503cf5c81f13e2456bf4efce42d4cf1f8d5d70838207278bee 2024-06-26T07:40:08.7697724Z deleted: sha256:867b219724f2f1aaf56f42e3e9f03a5d64bdca8a6a72407efd10328aeea5d510 2024-06-26T07:40:08.7698568Z deleted: sha256:b9ff2a7cceb9237b26bcb17728edf8a558eec5a76f63626e84f80541dfc0f1d4 2024-06-26T07:40:08.7699405Z deleted: sha256:be73f509106819007ce2b0f5a1301ac56ae583cb6c1fb69bee93efa0840368f1 2024-06-26T07:40:08.7700246Z deleted: sha256:2a11c07c915c3fdbb4e73096dea73ea950c970d50fe1a5764060bd62b7b7cf2c 2024-06-26T07:40:08.7701085Z deleted: sha256:5e9989622e2abc1c72f8184343507b45d75e4ff971edb68b96cbcd75ae484ff5 2024-06-26T07:40:08.7701923Z deleted: sha256:05ce642bd9cf5a9205bff107df28b1d6cef7d5f6ab3ea944d28c032ec61270df 2024-06-26T07:40:08.7702746Z deleted: sha256:017702617f6c07b73f2088678f4710b794cfe897a213a5cf122a0e2519eae0ac 2024-06-26T07:40:08.7703564Z deleted: sha256:44b3b37bb1ca39dc5cf356de41a23a5c12f605a1992813e408087fb2b0ad6d1c 2024-06-26T07:40:08.7704394Z deleted: sha256:8c387982e9f27db357a1d149dc149cabc0bd04668ad6956387a5072682dada67 2024-06-26T07:40:08.7705223Z deleted: sha256:10d415dca4e3fbb88a747b40317f3c6333c041ba8f73855f67fb9fe981fae5ee 2024-06-26T07:40:08.7706050Z deleted: sha256:6c65469bf0f53dcd625faefe363b8f3136c08388a6cf64d9158e8576e4ee89b1 2024-06-26T07:40:08.7706897Z deleted: sha256:027db5d8b76deeefbd8c34b485ab7ff14ed2a3e6800425c1ce0d77c2e9fdd4ab 2024-06-26T07:40:08.7707741Z deleted: sha256:24941234ad28cf5c8174d7cf18326c10b4e17f2c2137672ea0322df461597dd7 2024-06-26T07:40:08.7708578Z deleted: sha256:240ea2eebfa8519d6c2d88f4c99e66ce4e038d000f93ce8d03726c01d81180ef 2024-06-26T07:40:08.7709461Z deleted: sha256:09e823cb391a69f6a195e3ca8a41624b5f8b34eee14c6eb36277de814a91966e 2024-06-26T07:40:08.7710274Z deleted: sha256:730479d695169a6593bf0ac16b377491dce65175a6d158e012422367d04577fd 2024-06-26T07:40:08.7711150Z deleted: sha256:b0a30f9f7bd5459ff662453b9346a7ba8ea8db1191528345c1953eab4aa2f54e 2024-06-26T07:40:08.7711984Z deleted: sha256:75cefa87effaa3ad361c74642839923101f0f9982f814f3c9e2ed4ad52f2a008 2024-06-26T07:40:08.7712800Z deleted: sha256:6f97db87ba9512e615e871c6982000602982e1e5a5be334a56e7292251e84e00 2024-06-26T07:40:08.7713626Z deleted: sha256:35a033279d5c9bd6b862bfa9331d8fcbf98bbaf778a778fabc882384db9204f8 2024-06-26T07:40:08.7714458Z deleted: sha256:ab9b00c496073d62e69e032178858d3d6d4c4bab9e87065d3785c6da57351d00 2024-06-26T07:40:08.7715279Z deleted: sha256:7ed947299e109c2459de6e240d86f049c30f93f2380659ce441d8737b8cd065f 2024-06-26T07:40:08.7716105Z deleted: sha256:410d5a7f7a9a1cb4551c106b9cc728a9dcff598f9be231a351ce6a0a33f81e64 2024-06-26T07:40:08.7716936Z deleted: sha256:5f0021bb56efa14bb93978c01513e2a1187ba30e69bdb0546d0ef39b30873f88 2024-06-26T07:40:08.7717764Z deleted: sha256:c1601aa97eb84151c14da3aeea351201bd99144d36d66b397f6555d80245d86d 2024-06-26T07:40:08.7718606Z deleted: sha256:72af05a89be22accdc1ca5d66dcbbb33993a9ef5997f849df1d4ba4c48049f25 2024-06-26T07:40:08.7719453Z deleted: sha256:38b90c9663dcaa2bc57a4dd3008298e7ea93e9535fa42312b4dc4246e7491af9 2024-06-26T07:40:08.7720294Z deleted: sha256:bda61b6cefb3ec8eeb74fef1ca1c7f9a5845fe5e8f07b8123323e897425d5c29 2024-06-26T07:40:08.7721137Z deleted: sha256:5a18e1aa877074529a84cbddf19f8d5403787823378ceae6b72fb62f78d43037 2024-06-26T07:40:08.7721978Z deleted: sha256:6c3e7df31590f02f10cb71fc4eb27653e9b428df2e6e5421a455b062bd2e39f9 2024-06-26T07:40:08.7722470Z 2024-06-26T07:40:08.7722729Z Total reclaimed space: 36.29GB 2024-06-26T07:40:08.7800197Z Post job cleanup. 2024-06-26T07:40:08.7848972Z Post job cleanup. 2024-06-26T07:40:08.8656830Z [command]/usr/bin/git version 2024-06-26T07:40:08.8697164Z git version 2.40.1 2024-06-26T07:40:08.8736363Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/6a852d08-1466-47b1-a9ab-8d0ecfd1e325' before making global git config changes 2024-06-26T07:40:08.8737972Z Adding repository directory to the temporary git global config as a safe directory 2024-06-26T07:40:08.8742710Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-06-26T07:40:08.8774736Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2024-06-26T07:40:08.8797008Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2024-06-26T07:40:08.9011846Z Entering 'android/libs/fbjni' 2024-06-26T07:40:08.9048846Z Entering 'third_party/FP16' 2024-06-26T07:40:08.9085706Z Entering 'third_party/FXdiv' 2024-06-26T07:40:08.9120631Z Entering 'third_party/NNPACK' 2024-06-26T07:40:08.9157453Z Entering 'third_party/VulkanMemoryAllocator' 2024-06-26T07:40:08.9193424Z Entering 'third_party/XNNPACK' 2024-06-26T07:40:08.9241916Z Entering 'third_party/benchmark' 2024-06-26T07:40:08.9278583Z Entering 'third_party/cpp-httplib' 2024-06-26T07:40:08.9314309Z Entering 'third_party/cpuinfo' 2024-06-26T07:40:08.9348207Z Entering 'third_party/cudnn_frontend' 2024-06-26T07:40:08.9381969Z Entering 'third_party/cutlass' 2024-06-26T07:40:08.9423362Z Entering 'third_party/eigen' 2024-06-26T07:40:08.9457571Z Entering 'third_party/fbgemm' 2024-06-26T07:40:08.9494142Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-06-26T07:40:08.9529973Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T07:40:08.9565030Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-06-26T07:40:08.9605832Z Entering 'third_party/fbgemm/third_party/googletest' 2024-06-26T07:40:08.9640796Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T07:40:08.9675282Z Entering 'third_party/flatbuffers' 2024-06-26T07:40:08.9712482Z Entering 'third_party/fmt' 2024-06-26T07:40:08.9748225Z Entering 'third_party/foxi' 2024-06-26T07:40:08.9783763Z Entering 'third_party/gemmlowp/gemmlowp' 2024-06-26T07:40:08.9820713Z Entering 'third_party/gloo' 2024-06-26T07:40:08.9854058Z Entering 'third_party/googletest' 2024-06-26T07:40:08.9890227Z Entering 'third_party/ideep' 2024-06-26T07:40:08.9924925Z Entering 'third_party/ideep/mkl-dnn' 2024-06-26T07:40:08.9964758Z Entering 'third_party/ittapi' 2024-06-26T07:40:09.0002044Z Entering 'third_party/kineto' 2024-06-26T07:40:09.0035092Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T07:40:09.0069521Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T07:40:09.0104153Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T07:40:09.0137783Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T07:40:09.0172761Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T07:40:09.0206946Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T07:40:09.0242198Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T07:40:09.0275530Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T07:40:09.0310135Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T07:40:09.0342760Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T07:40:09.0376650Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T07:40:09.0410902Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T07:40:09.0448432Z Entering 'third_party/mimalloc' 2024-06-26T07:40:09.0484338Z Entering 'third_party/nccl/nccl' 2024-06-26T07:40:09.0519087Z Entering 'third_party/nlohmann' 2024-06-26T07:40:09.0553352Z Entering 'third_party/onnx' 2024-06-26T07:40:09.0598698Z Entering 'third_party/onnx/third_party/benchmark' 2024-06-26T07:40:09.0634430Z Entering 'third_party/onnx/third_party/pybind11' 2024-06-26T07:40:09.0672706Z Entering 'third_party/opentelemetry-cpp' 2024-06-26T07:40:09.0707755Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T07:40:09.0741758Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T07:40:09.0775091Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T07:40:09.0809779Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T07:40:09.0846361Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T07:40:09.0882340Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T07:40:09.0915415Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T07:40:09.0949278Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T07:40:09.0982933Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T07:40:09.1015738Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T07:40:09.1064584Z Entering 'third_party/pocketfft' 2024-06-26T07:40:09.1103735Z Entering 'third_party/protobuf' 2024-06-26T07:40:09.1138877Z Entering 'third_party/protobuf/third_party/benchmark' 2024-06-26T07:40:09.1173209Z Entering 'third_party/protobuf/third_party/googletest' 2024-06-26T07:40:09.1209199Z Entering 'third_party/psimd' 2024-06-26T07:40:09.1245788Z Entering 'third_party/pthreadpool' 2024-06-26T07:40:09.1281459Z Entering 'third_party/pybind11' 2024-06-26T07:40:09.1314740Z Entering 'third_party/python-peachpy' 2024-06-26T07:40:09.1350100Z Entering 'third_party/sleef' 2024-06-26T07:40:09.1382882Z Entering 'third_party/tensorpipe' 2024-06-26T07:40:09.1417810Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-06-26T07:40:09.1450386Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-06-26T07:40:09.1486066Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-06-26T07:40:09.1519291Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T07:40:09.1553404Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T07:40:09.1604149Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2024-06-26T07:40:09.1625718Z http.https://github.com/.extraheader 2024-06-26T07:40:09.1634860Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader 2024-06-26T07:40:09.1663064Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2024-06-26T07:40:09.1871270Z Entering 'android/libs/fbjni' 2024-06-26T07:40:09.1892511Z http.https://github.com/.extraheader 2024-06-26T07:40:09.1917714Z Entering 'third_party/FP16' 2024-06-26T07:40:09.1940302Z http.https://github.com/.extraheader 2024-06-26T07:40:09.1964952Z Entering 'third_party/FXdiv' 2024-06-26T07:40:09.1986666Z http.https://github.com/.extraheader 2024-06-26T07:40:09.2009106Z Entering 'third_party/NNPACK' 2024-06-26T07:40:09.2031507Z http.https://github.com/.extraheader 2024-06-26T07:40:09.2055648Z Entering 'third_party/VulkanMemoryAllocator' 2024-06-26T07:40:09.2077494Z http.https://github.com/.extraheader 2024-06-26T07:40:09.2102041Z Entering 'third_party/XNNPACK' 2024-06-26T07:40:09.2124539Z http.https://github.com/.extraheader 2024-06-26T07:40:09.2158985Z Entering 'third_party/benchmark' 2024-06-26T07:40:09.2181049Z http.https://github.com/.extraheader 2024-06-26T07:40:09.2206303Z Entering 'third_party/cpp-httplib' 2024-06-26T07:40:09.2227871Z http.https://github.com/.extraheader 2024-06-26T07:40:09.2249515Z Entering 'third_party/cpuinfo' 2024-06-26T07:40:09.2270862Z http.https://github.com/.extraheader 2024-06-26T07:40:09.2293360Z Entering 'third_party/cudnn_frontend' 2024-06-26T07:40:09.2316114Z http.https://github.com/.extraheader 2024-06-26T07:40:09.2337795Z Entering 'third_party/cutlass' 2024-06-26T07:40:09.2360165Z http.https://github.com/.extraheader 2024-06-26T07:40:09.2388397Z Entering 'third_party/eigen' 2024-06-26T07:40:09.2410487Z http.https://github.com/.extraheader 2024-06-26T07:40:09.2437777Z Entering 'third_party/fbgemm' 2024-06-26T07:40:09.2459408Z http.https://github.com/.extraheader 2024-06-26T07:40:09.2483418Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-06-26T07:40:09.2504187Z http.https://github.com/.extraheader 2024-06-26T07:40:09.2525977Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T07:40:09.2547646Z http.https://github.com/.extraheader 2024-06-26T07:40:09.2571061Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-06-26T07:40:09.2592588Z http.https://github.com/.extraheader 2024-06-26T07:40:09.2620564Z Entering 'third_party/fbgemm/third_party/googletest' 2024-06-26T07:40:09.2642365Z http.https://github.com/.extraheader 2024-06-26T07:40:09.2664919Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T07:40:09.2686044Z http.https://github.com/.extraheader 2024-06-26T07:40:09.2709730Z Entering 'third_party/flatbuffers' 2024-06-26T07:40:09.2732235Z http.https://github.com/.extraheader 2024-06-26T07:40:09.2759232Z Entering 'third_party/fmt' 2024-06-26T07:40:09.2781123Z http.https://github.com/.extraheader 2024-06-26T07:40:09.2804102Z Entering 'third_party/foxi' 2024-06-26T07:40:09.2825768Z http.https://github.com/.extraheader 2024-06-26T07:40:09.2848174Z Entering 'third_party/gemmlowp/gemmlowp' 2024-06-26T07:40:09.2870119Z http.https://github.com/.extraheader 2024-06-26T07:40:09.2893550Z Entering 'third_party/gloo' 2024-06-26T07:40:09.2917744Z http.https://github.com/.extraheader 2024-06-26T07:40:09.2941315Z Entering 'third_party/googletest' 2024-06-26T07:40:09.2963242Z http.https://github.com/.extraheader 2024-06-26T07:40:09.2987672Z Entering 'third_party/ideep' 2024-06-26T07:40:09.3008804Z http.https://github.com/.extraheader 2024-06-26T07:40:09.3030526Z Entering 'third_party/ideep/mkl-dnn' 2024-06-26T07:40:09.3050741Z http.https://github.com/.extraheader 2024-06-26T07:40:09.3078863Z Entering 'third_party/ittapi' 2024-06-26T07:40:09.3100919Z http.https://github.com/.extraheader 2024-06-26T07:40:09.3125064Z Entering 'third_party/kineto' 2024-06-26T07:40:09.3147181Z http.https://github.com/.extraheader 2024-06-26T07:40:09.3170091Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T07:40:09.3191747Z http.https://github.com/.extraheader 2024-06-26T07:40:09.3213577Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T07:40:09.3236945Z http.https://github.com/.extraheader 2024-06-26T07:40:09.3263579Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T07:40:09.3284401Z http.https://github.com/.extraheader 2024-06-26T07:40:09.3306356Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T07:40:09.3328220Z http.https://github.com/.extraheader 2024-06-26T07:40:09.3351444Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T07:40:09.3372943Z http.https://github.com/.extraheader 2024-06-26T07:40:09.3396746Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T07:40:09.3418338Z http.https://github.com/.extraheader 2024-06-26T07:40:09.3442223Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T07:40:09.3462615Z http.https://github.com/.extraheader 2024-06-26T07:40:09.3488684Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T07:40:09.3511306Z http.https://github.com/.extraheader 2024-06-26T07:40:09.3533398Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T07:40:09.3554861Z http.https://github.com/.extraheader 2024-06-26T07:40:09.3578559Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T07:40:09.3600036Z http.https://github.com/.extraheader 2024-06-26T07:40:09.3623963Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T07:40:09.3644324Z http.https://github.com/.extraheader 2024-06-26T07:40:09.3665862Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T07:40:09.3686834Z http.https://github.com/.extraheader 2024-06-26T07:40:09.3711239Z Entering 'third_party/mimalloc' 2024-06-26T07:40:09.3735854Z http.https://github.com/.extraheader 2024-06-26T07:40:09.3760837Z Entering 'third_party/nccl/nccl' 2024-06-26T07:40:09.3783407Z http.https://github.com/.extraheader 2024-06-26T07:40:09.3806266Z Entering 'third_party/nlohmann' 2024-06-26T07:40:09.3827848Z http.https://github.com/.extraheader 2024-06-26T07:40:09.3852504Z Entering 'third_party/onnx' 2024-06-26T07:40:09.3875047Z http.https://github.com/.extraheader 2024-06-26T07:40:09.3911183Z Entering 'third_party/onnx/third_party/benchmark' 2024-06-26T07:40:09.3933002Z http.https://github.com/.extraheader 2024-06-26T07:40:09.3957085Z Entering 'third_party/onnx/third_party/pybind11' 2024-06-26T07:40:09.3979813Z http.https://github.com/.extraheader 2024-06-26T07:40:09.4003672Z Entering 'third_party/opentelemetry-cpp' 2024-06-26T07:40:09.4026162Z http.https://github.com/.extraheader 2024-06-26T07:40:09.4051778Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T07:40:09.4072434Z http.https://github.com/.extraheader 2024-06-26T07:40:09.4095979Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T07:40:09.4117948Z http.https://github.com/.extraheader 2024-06-26T07:40:09.4142598Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T07:40:09.4164191Z http.https://github.com/.extraheader 2024-06-26T07:40:09.4187136Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T07:40:09.4208154Z http.https://github.com/.extraheader 2024-06-26T07:40:09.4234109Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T07:40:09.4254376Z http.https://github.com/.extraheader 2024-06-26T07:40:09.4277256Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T07:40:09.4298356Z http.https://github.com/.extraheader 2024-06-26T07:40:09.4321302Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T07:40:09.4342858Z http.https://github.com/.extraheader 2024-06-26T07:40:09.4366815Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T07:40:09.4388500Z http.https://github.com/.extraheader 2024-06-26T07:40:09.4413558Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T07:40:09.4435638Z http.https://github.com/.extraheader 2024-06-26T07:40:09.4461157Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T07:40:09.4482042Z http.https://github.com/.extraheader 2024-06-26T07:40:09.4520068Z Entering 'third_party/pocketfft' 2024-06-26T07:40:09.4542246Z http.https://github.com/.extraheader 2024-06-26T07:40:09.4565355Z Entering 'third_party/protobuf' 2024-06-26T07:40:09.4586624Z http.https://github.com/.extraheader 2024-06-26T07:40:09.4610112Z Entering 'third_party/protobuf/third_party/benchmark' 2024-06-26T07:40:09.4632322Z http.https://github.com/.extraheader 2024-06-26T07:40:09.4655863Z Entering 'third_party/protobuf/third_party/googletest' 2024-06-26T07:40:09.4677393Z http.https://github.com/.extraheader 2024-06-26T07:40:09.4701591Z Entering 'third_party/psimd' 2024-06-26T07:40:09.4724464Z http.https://github.com/.extraheader 2024-06-26T07:40:09.4748432Z Entering 'third_party/pthreadpool' 2024-06-26T07:40:09.4769361Z http.https://github.com/.extraheader 2024-06-26T07:40:09.4793900Z Entering 'third_party/pybind11' 2024-06-26T07:40:09.4814513Z http.https://github.com/.extraheader 2024-06-26T07:40:09.4839067Z Entering 'third_party/python-peachpy' 2024-06-26T07:40:09.4861030Z http.https://github.com/.extraheader 2024-06-26T07:40:09.4883503Z Entering 'third_party/sleef' 2024-06-26T07:40:09.4905915Z http.https://github.com/.extraheader 2024-06-26T07:40:09.4929722Z Entering 'third_party/tensorpipe' 2024-06-26T07:40:09.4951601Z http.https://github.com/.extraheader 2024-06-26T07:40:09.4975748Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-06-26T07:40:09.4998180Z http.https://github.com/.extraheader 2024-06-26T07:40:09.5023025Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-06-26T07:40:09.5044305Z http.https://github.com/.extraheader 2024-06-26T07:40:09.5066776Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-06-26T07:40:09.5087464Z http.https://github.com/.extraheader 2024-06-26T07:40:09.5110377Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T07:40:09.5131562Z http.https://github.com/.extraheader 2024-06-26T07:40:09.5155145Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T07:40:09.5175807Z http.https://github.com/.extraheader 2024-06-26T07:40:09.5273152Z A job completed hook has been configured by the self-hosted runner administrator 2024-06-26T07:40:09.5290395Z ##[group]Run '/home/ec2-user/runner-scripts/cleanup.sh' 2024-06-26T07:40:09.5297283Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T07:40:09.5297843Z ##[endgroup] 2024-06-26T07:40:10.3319380Z Cleaning up orphan processes