2024-08-20T22:05:05.9174660Z Current runner version: '2.319.1' 2024-08-20T22:05:05.9181076Z Runner name: 'i-067d93865e69cb17b' 2024-08-20T22:05:05.9181937Z Runner group name: 'Default' 2024-08-20T22:05:05.9182816Z Machine name: 'ip-10-0-69-159' 2024-08-20T22:05:05.9199466Z Testing runner upgrade compatibility 2024-08-20T22:05:06.0506015Z ##[group]GITHUB_TOKEN Permissions 2024-08-20T22:05:06.0508197Z Actions: read 2024-08-20T22:05:06.0508835Z Attestations: read 2024-08-20T22:05:06.0509382Z Checks: read 2024-08-20T22:05:06.0509839Z Contents: read 2024-08-20T22:05:06.0510414Z Deployments: read 2024-08-20T22:05:06.0510966Z Discussions: read 2024-08-20T22:05:06.0511476Z Issues: read 2024-08-20T22:05:06.0511981Z Metadata: read 2024-08-20T22:05:06.0512502Z Packages: read 2024-08-20T22:05:06.0513087Z Pages: read 2024-08-20T22:05:06.0513588Z PullRequests: read 2024-08-20T22:05:06.0514168Z RepositoryProjects: read 2024-08-20T22:05:06.0514764Z SecurityEvents: read 2024-08-20T22:05:06.0515377Z Statuses: read 2024-08-20T22:05:06.0516050Z ##[endgroup] 2024-08-20T22:05:06.0519505Z Secret source: Actions 2024-08-20T22:05:06.0520277Z Prepare workflow directory 2024-08-20T22:05:06.1906772Z Prepare all required actions 2024-08-20T22:05:06.2076171Z Getting action download info 2024-08-20T22:05:06.3592215Z Download action repository 'pytorch/test-infra@main' (SHA:0c3a2634aaa2f638c8f640e743f03d696ce1191f) 2024-08-20T22:05:06.8103549Z Download action repository 'pytorch/pytorch@main' (SHA:1ae5d5bb62141d7c9b1b0b66c66a462b4e10b1f2) 2024-08-20T22:05:10.8905272Z Download action repository 'aws-actions/configure-aws-credentials@v3' (SHA:50ac8dd1e1b10d09dac7b8727528b91bed831ac0) 2024-08-20T22:05:11.0863599Z Download action repository 'seemethere/upload-artifact-s3@v5' (SHA:baba72d0712b404f646cebe0730933554ebce96a) 2024-08-20T22:05:11.4433004Z Getting action download info 2024-08-20T22:05:11.5507616Z Download action repository 'malfet/checkout@silent-checkout' (SHA:e07af140b3ccefc05679e3755b9db68f4ee4589c) 2024-08-20T22:05:11.7600340Z Getting action download info 2024-08-20T22:05:11.8647144Z Download action repository 'nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482' (SHA:3e91a01664abd3c5cd539100d10d33b9c5b68482) 2024-08-20T22:05:12.0430359Z Uses: pytorch/pytorch/.github/workflows/_linux-test.yml@refs/tags/ciflow/inductor/133712 (40ec5f6ddd9787aca0449b24128343ff4c4a88b3) 2024-08-20T22:05:12.0432514Z ##[group] Inputs 2024-08-20T22:05:12.0432999Z build-environment: linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-08-20T22:05:12.0440248Z test-matrix: {"include": [{"config": "dynamo_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}]} 2024-08-20T22:05:12.0448294Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:05:12.0449493Z sync-tag: 2024-08-20T22:05:12.0450311Z timeout-minutes: 240 2024-08-20T22:05:12.0450640Z use-gha: 2024-08-20T22:05:12.0450921Z dashboard-tag: 2024-08-20T22:05:12.0451242Z s3-bucket: gha-artifacts 2024-08-20T22:05:12.0451586Z aws-role-to-assume: 2024-08-20T22:05:12.0451914Z ##[endgroup] 2024-08-20T22:05:12.0452907Z Complete job name: cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (aot_eager_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:05:12.1124382Z A job started hook has been configured by the self-hosted runner administrator 2024-08-20T22:05:12.1262323Z ##[group]Run '/home/ec2-user/runner-scripts/before_job.sh' 2024-08-20T22:05:12.1274165Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:05:12.1274707Z ##[endgroup] 2024-08-20T22:05:14.3375572Z Runner Type: linux.g5.4xlarge.nvidia.gpu 2024-08-20T22:05:14.3376089Z Instance Type: g5.4xlarge 2024-08-20T22:05:14.3376786Z AMI Name: al2023-ami-2023.5.20240701.0-kernel-6.1-x86_64 2024-08-20T22:05:14.3377339Z AMI ID: ami-06c68f701d8090592 2024-08-20T22:05:20.1439504Z ##[group]Run pytorch/test-infra/.github/actions/setup-ssh@main 2024-08-20T22:05:20.1440054Z with: 2024-08-20T22:05:20.1440946Z github-secret: *** 2024-08-20T22:05:20.1441905Z instructions: All testing is done inside the container, to start an interactive session run: docker exec -it $(docker container ps --format '{{.ID}}') bash 2024-08-20T22:05:20.1442914Z activate-with-label: false 2024-08-20T22:05:20.1443276Z label: with-ssh 2024-08-20T22:05:20.1443594Z remove-existing-keys: true 2024-08-20T22:05:20.1443948Z fail-silently: true 2024-08-20T22:05:20.1444260Z env: 2024-08-20T22:05:20.1444527Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:05:20.1444886Z ##[endgroup] 2024-08-20T22:05:20.2338759Z Please see https://github.com/pytorch/pytorch/wiki/Debugging-using-with-ssh-for-Github-Actions for more info. 2024-08-20T22:05:20.2341907Z ciflow reference detected, attempting to extract PR number 2024-08-20T22:05:20.5300927Z Grabbing public ssh keys from https://github.com/pytorch-bot[bot].keys 2024-08-20T22:05:20.6038849Z No SSH keys found for user pytorch-bot[bot] 2024-08-20T22:05:20.6039463Z Grabbing public ssh keys from https://github.com/XuehaiPan.keys 2024-08-20T22:05:20.6799068Z ~/.ssh/authorized_keys file found on node, removing ~/.ssh and starting fresh 2024-08-20T22:05:20.6813205Z Public keys pulled and installed to /home/ec2-user/.ssh/authorized_keys 2024-08-20T22:05:20.6836625Z Login using: ssh ec2-user@ec2-3-236-239-101.compute-1.amazonaws.com 2024-08-20T22:05:20.6837390Z All testing is done inside the container, to start an interactive session run: 2024-08-20T22:05:20.6838194Z docker exec -it $(docker container ps --format '{{.ID}}') bash 2024-08-20T22:05:20.6966044Z ##[group]Run pytorch/pytorch/.github/actions/checkout-pytorch@main 2024-08-20T22:05:20.6966586Z with: 2024-08-20T22:05:20.6966855Z submodules: recursive 2024-08-20T22:05:20.6967173Z fetch-depth: 0 2024-08-20T22:05:20.6967454Z env: 2024-08-20T22:05:20.6967717Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:05:20.6968043Z ##[endgroup] 2024-08-20T22:05:20.7156535Z ##[group]Run retry () { 2024-08-20T22:05:20.7156911Z retry () { 2024-08-20T22:05:20.7157427Z  $* || (sleep 1 && $*) || (sleep 2 && $*) || (sleep 4 && $*) || (sleep 8 && $*) 2024-08-20T22:05:20.7157978Z } 2024-08-20T22:05:20.7158278Z echo "${GITHUB_WORKSPACE}" 2024-08-20T22:05:20.7158694Z if [ -z "${NO_SUDO}" ]; then 2024-08-20T22:05:20.7159167Z  retry sudo rm -rf "${GITHUB_WORKSPACE}" 2024-08-20T22:05:20.7159624Z else 2024-08-20T22:05:20.7159964Z  retry rm -rf "${GITHUB_WORKSPACE}" 2024-08-20T22:05:20.7160639Z fi 2024-08-20T22:05:20.7161273Z mkdir "${GITHUB_WORKSPACE}" 2024-08-20T22:05:20.7171338Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:05:20.7171846Z env: 2024-08-20T22:05:20.7172122Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:05:20.7172458Z NO_SUDO: 2024-08-20T22:05:20.7172733Z ##[endgroup] 2024-08-20T22:05:20.7207816Z /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-20T22:05:26.5947414Z ##[group]Run malfet/checkout@silent-checkout 2024-08-20T22:05:26.5947843Z with: 2024-08-20T22:05:26.5948170Z ref: 40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:05:26.5948623Z fetch-depth: 0 2024-08-20T22:05:26.5948936Z submodules: recursive 2024-08-20T22:05:26.5949271Z quiet-checkout: true 2024-08-20T22:05:26.5949616Z repository: pytorch/pytorch 2024-08-20T22:05:26.5950089Z token: *** 2024-08-20T22:05:26.5950384Z ssh-strict: true 2024-08-20T22:05:26.5950700Z persist-credentials: true 2024-08-20T22:05:26.5951052Z clean: true 2024-08-20T22:05:26.5951378Z sparse-checkout-cone-mode: true 2024-08-20T22:05:26.5951793Z lfs: false 2024-08-20T22:05:26.5952119Z set-safe-directory: true 2024-08-20T22:05:26.5952461Z env: 2024-08-20T22:05:26.5952733Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:05:26.5953060Z ##[endgroup] 2024-08-20T22:05:26.6943410Z Syncing repository: pytorch/pytorch 2024-08-20T22:05:26.6944852Z ##[group]Getting Git version info 2024-08-20T22:05:26.6945575Z Working directory is '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2024-08-20T22:05:26.6946407Z [command]/usr/bin/git version 2024-08-20T22:05:26.6946770Z git version 2.40.1 2024-08-20T22:05:26.6955328Z ##[endgroup] 2024-08-20T22:05:26.6969409Z Copying '/home/ec2-user/.gitconfig' to '/home/ec2-user/actions-runner/_work/_temp/e21d2185-226e-42c2-8386-6dab879da7ec/.gitconfig' 2024-08-20T22:05:26.6978515Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/e21d2185-226e-42c2-8386-6dab879da7ec' before making global git config changes 2024-08-20T22:05:26.6979785Z Adding repository directory to the temporary git global config as a safe directory 2024-08-20T22:05:26.6983150Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-20T22:05:26.7040107Z Deleting the contents of '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2024-08-20T22:05:26.7044344Z ##[group]Initializing the repository 2024-08-20T22:05:26.7047352Z [command]/usr/bin/git init /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-20T22:05:26.7094075Z hint: Using 'master' as the name for the initial branch. This default branch name 2024-08-20T22:05:26.7095189Z hint: is subject to change. To configure the initial branch name to use in all 2024-08-20T22:05:26.7096036Z hint: of your new repositories, which will suppress this warning, call: 2024-08-20T22:05:26.7096612Z hint: 2024-08-20T22:05:26.7097091Z hint: git config --global init.defaultBranch 2024-08-20T22:05:26.7097555Z hint: 2024-08-20T22:05:26.7098450Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-08-20T22:05:26.7099530Z hint: 'development'. The just-created branch can be renamed via this command: 2024-08-20T22:05:26.7100238Z hint: 2024-08-20T22:05:26.7100559Z hint: git branch -m 2024-08-20T22:05:26.7101321Z Initialized empty Git repository in /home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/ 2024-08-20T22:05:26.7106951Z [command]/usr/bin/git remote add origin https://github.com/pytorch/pytorch 2024-08-20T22:05:26.7154832Z ##[endgroup] 2024-08-20T22:05:26.7156331Z ##[group]Disabling automatic garbage collection 2024-08-20T22:05:26.7157932Z [command]/usr/bin/git config --local gc.auto 0 2024-08-20T22:05:26.7199485Z ##[endgroup] 2024-08-20T22:05:26.7200140Z ##[group]Setting up auth 2024-08-20T22:05:26.7205352Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2024-08-20T22:05:26.7249184Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2024-08-20T22:05:26.7602557Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2024-08-20T22:05:26.7644447Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2024-08-20T22:05:26.7999293Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic *** 2024-08-20T22:05:26.8057895Z ##[endgroup] 2024-08-20T22:05:26.8058581Z ##[group]Fetching the repository 2024-08-20T22:05:26.8064773Z [command]/usr/bin/git -c protocol.version=2 fetch --prune --progress --no-recurse-submodules --quiet origin +refs/heads/*:refs/remotes/origin/* +refs/tags/*:refs/tags/* 2024-08-20T22:05:29.8094213Z remote: Enumerating objects: 1008452 2024-08-20T22:05:29.8095623Z remote: Enumerating objects: 1010208, done. 2024-08-20T22:05:29.8097794Z remote: Counting objects: 0% (1/1756) 2024-08-20T22:05:29.8099158Z remote: Counting objects: 1% (18/1756) 2024-08-20T22:05:29.8100405Z remote: Counting objects: 2% (36/1756) 2024-08-20T22:05:29.8101553Z remote: Counting objects: 3% (53/1756) 2024-08-20T22:05:29.8102726Z remote: Counting objects: 4% (71/1756) 2024-08-20T22:05:29.8103381Z remote: Counting objects: 5% (88/1756) 2024-08-20T22:05:29.8104044Z remote: Counting objects: 6% (106/1756) 2024-08-20T22:05:29.8104740Z remote: Counting objects: 7% (123/1756) 2024-08-20T22:05:29.8105390Z remote: Counting objects: 8% (141/1756) 2024-08-20T22:05:29.8106050Z remote: Counting objects: 9% (159/1756) 2024-08-20T22:05:29.8106697Z remote: Counting objects: 10% (176/1756) 2024-08-20T22:05:29.8107356Z remote: Counting objects: 11% (194/1756) 2024-08-20T22:05:29.8108004Z remote: Counting objects: 12% (211/1756) 2024-08-20T22:05:29.8108678Z remote: Counting objects: 13% (229/1756) 2024-08-20T22:05:29.8109332Z remote: Counting objects: 14% (246/1756) 2024-08-20T22:05:29.8109979Z remote: Counting objects: 15% (264/1756) 2024-08-20T22:05:29.8110610Z remote: Counting objects: 16% (281/1756) 2024-08-20T22:05:29.8111267Z remote: Counting objects: 17% (299/1756) 2024-08-20T22:05:29.8111909Z remote: Counting objects: 18% (317/1756) 2024-08-20T22:05:29.8112562Z remote: Counting objects: 19% (334/1756) 2024-08-20T22:05:29.8113047Z remote: Counting objects: 20% (352/1756) 2024-08-20T22:05:29.8114106Z remote: Counting objects: 21% (369/1756) 2024-08-20T22:05:29.8114610Z remote: Counting objects: 22% (387/1756) 2024-08-20T22:05:29.8115100Z remote: Counting objects: 23% (404/1756) 2024-08-20T22:05:29.8115583Z remote: Counting objects: 24% (422/1756) 2024-08-20T22:05:29.8116142Z remote: Counting objects: 25% (439/1756) 2024-08-20T22:05:29.8117016Z remote: Counting objects: 26% (457/1756) 2024-08-20T22:05:29.8117514Z remote: Counting objects: 27% (475/1756) 2024-08-20T22:05:29.8117999Z remote: Counting objects: 28% (492/1756) 2024-08-20T22:05:29.8118508Z remote: Counting objects: 29% (510/1756) 2024-08-20T22:05:29.8119003Z remote: Counting objects: 30% (527/1756) 2024-08-20T22:05:29.8119495Z remote: Counting objects: 31% (545/1756) 2024-08-20T22:05:29.8120026Z remote: Counting objects: 32% (562/1756) 2024-08-20T22:05:29.8120507Z remote: Counting objects: 33% (580/1756) 2024-08-20T22:05:29.8120997Z remote: Counting objects: 34% (598/1756) 2024-08-20T22:05:29.8121481Z remote: Counting objects: 35% (615/1756) 2024-08-20T22:05:29.8121969Z remote: Counting objects: 36% (633/1756) 2024-08-20T22:05:29.8122449Z remote: Counting objects: 37% (650/1756) 2024-08-20T22:05:29.8122945Z remote: Counting objects: 38% (668/1756) 2024-08-20T22:05:29.8123603Z remote: Counting objects: 39% (685/1756) 2024-08-20T22:05:29.8124114Z remote: Counting objects: 40% (703/1756) 2024-08-20T22:05:29.8124742Z remote: Counting objects: 41% (720/1756) 2024-08-20T22:05:29.8125236Z remote: Counting objects: 42% (738/1756) 2024-08-20T22:05:29.8125728Z remote: Counting objects: 43% (756/1756) 2024-08-20T22:05:29.8126218Z remote: Counting objects: 44% (773/1756) 2024-08-20T22:05:29.8126700Z remote: Counting objects: 45% (791/1756) 2024-08-20T22:05:29.8127185Z remote: Counting objects: 46% (808/1756) 2024-08-20T22:05:29.8127675Z remote: Counting objects: 47% (826/1756) 2024-08-20T22:05:29.8128159Z remote: Counting objects: 48% (843/1756) 2024-08-20T22:05:29.8128654Z remote: Counting objects: 49% (861/1756) 2024-08-20T22:05:29.8129142Z remote: Counting objects: 50% (878/1756) 2024-08-20T22:05:29.8129638Z remote: Counting objects: 51% (896/1756) 2024-08-20T22:05:29.8130134Z remote: Counting objects: 52% (914/1756) 2024-08-20T22:05:29.8130625Z remote: Counting objects: 53% (931/1756) 2024-08-20T22:05:29.8131115Z remote: Counting objects: 54% (949/1756) 2024-08-20T22:05:29.8131606Z remote: Counting objects: 55% (966/1756) 2024-08-20T22:05:29.8132087Z remote: Counting objects: 56% (984/1756) 2024-08-20T22:05:29.8132585Z remote: Counting objects: 57% (1001/1756) 2024-08-20T22:05:29.8133101Z remote: Counting objects: 58% (1019/1756) 2024-08-20T22:05:29.8133620Z remote: Counting objects: 59% (1037/1756) 2024-08-20T22:05:29.8134133Z remote: Counting objects: 60% (1054/1756) 2024-08-20T22:05:29.8134642Z remote: Counting objects: 61% (1072/1756) 2024-08-20T22:05:29.8135151Z remote: Counting objects: 62% (1089/1756) 2024-08-20T22:05:29.8135669Z remote: Counting objects: 63% (1107/1756) 2024-08-20T22:05:29.8136188Z remote: Counting objects: 64% (1124/1756) 2024-08-20T22:05:29.8136692Z remote: Counting objects: 65% (1142/1756) 2024-08-20T22:05:29.8137198Z remote: Counting objects: 66% (1159/1756) 2024-08-20T22:05:29.8137704Z remote: Counting objects: 67% (1177/1756) 2024-08-20T22:05:29.8138213Z remote: Counting objects: 68% (1195/1756) 2024-08-20T22:05:29.8138714Z remote: Counting objects: 69% (1212/1756) 2024-08-20T22:05:29.8139219Z remote: Counting objects: 70% (1230/1756) 2024-08-20T22:05:29.8139726Z remote: Counting objects: 71% (1247/1756) 2024-08-20T22:05:29.8140236Z remote: Counting objects: 72% (1265/1756) 2024-08-20T22:05:29.8140734Z remote: Counting objects: 73% (1282/1756) 2024-08-20T22:05:29.8141240Z remote: Counting objects: 74% (1300/1756) 2024-08-20T22:05:29.8141744Z remote: Counting objects: 75% (1317/1756) 2024-08-20T22:05:29.8142249Z remote: Counting objects: 76% (1335/1756) 2024-08-20T22:05:29.8142860Z remote: Counting objects: 77% (1353/1756) 2024-08-20T22:05:29.8143382Z remote: Counting objects: 78% (1370/1756) 2024-08-20T22:05:29.8143889Z remote: Counting objects: 79% (1388/1756) 2024-08-20T22:05:29.8144390Z remote: Counting objects: 80% (1405/1756) 2024-08-20T22:05:29.8144888Z remote: Counting objects: 81% (1423/1756) 2024-08-20T22:05:29.8145394Z remote: Counting objects: 82% (1440/1756) 2024-08-20T22:05:29.8145900Z remote: Counting objects: 83% (1458/1756) 2024-08-20T22:05:29.8146404Z remote: Counting objects: 84% (1476/1756) 2024-08-20T22:05:29.8146897Z remote: Counting objects: 85% (1493/1756) 2024-08-20T22:05:29.8147405Z remote: Counting objects: 86% (1511/1756) 2024-08-20T22:05:29.8147903Z remote: Counting objects: 87% (1528/1756) 2024-08-20T22:05:29.8148404Z remote: Counting objects: 88% (1546/1756) 2024-08-20T22:05:29.8148901Z remote: Counting objects: 89% (1563/1756) 2024-08-20T22:05:29.8149509Z remote: Counting objects: 90% (1581/1756) 2024-08-20T22:05:29.8150013Z remote: Counting objects: 91% (1598/1756) 2024-08-20T22:05:29.8150510Z remote: Counting objects: 92% (1616/1756) 2024-08-20T22:05:29.8151003Z remote: Counting objects: 93% (1634/1756) 2024-08-20T22:05:29.8151501Z remote: Counting objects: 94% (1651/1756) 2024-08-20T22:05:29.8151997Z remote: Counting objects: 95% (1669/1756) 2024-08-20T22:05:29.8152498Z remote: Counting objects: 96% (1686/1756) 2024-08-20T22:05:29.8153006Z remote: Counting objects: 97% (1704/1756) 2024-08-20T22:05:29.8153577Z remote: Counting objects: 98% (1721/1756) 2024-08-20T22:05:29.8154090Z remote: Counting objects: 99% (1739/1756) 2024-08-20T22:05:29.8154603Z remote: Counting objects: 100% (1756/1756) 2024-08-20T22:05:29.8155136Z remote: Counting objects: 100% (1756/1756), done. 2024-08-20T22:05:29.8246237Z remote: Compressing objects: 0% (1/837) 2024-08-20T22:05:29.8506773Z remote: Compressing objects: 1% (9/837) 2024-08-20T22:05:29.8844014Z remote: Compressing objects: 2% (17/837) 2024-08-20T22:05:29.9239563Z remote: Compressing objects: 3% (26/837) 2024-08-20T22:05:29.9938870Z remote: Compressing objects: 4% (34/837) 2024-08-20T22:05:30.0357967Z remote: Compressing objects: 5% (42/837) 2024-08-20T22:05:30.0920697Z remote: Compressing objects: 6% (51/837) 2024-08-20T22:05:30.1224317Z remote: Compressing objects: 7% (59/837) 2024-08-20T22:05:30.1611180Z remote: Compressing objects: 8% (67/837) 2024-08-20T22:05:30.1817312Z remote: Compressing objects: 9% (76/837) 2024-08-20T22:05:30.2067727Z remote: Compressing objects: 10% (84/837) 2024-08-20T22:05:30.2264216Z remote: Compressing objects: 11% (93/837) 2024-08-20T22:05:30.2438324Z remote: Compressing objects: 12% (101/837) 2024-08-20T22:05:30.2613482Z remote: Compressing objects: 13% (109/837) 2024-08-20T22:05:30.2732017Z remote: Compressing objects: 14% (118/837) 2024-08-20T22:05:30.2820900Z remote: Compressing objects: 15% (126/837) 2024-08-20T22:05:30.2908896Z remote: Compressing objects: 16% (134/837) 2024-08-20T22:05:30.2966059Z remote: Compressing objects: 17% (143/837) 2024-08-20T22:05:30.3014079Z remote: Compressing objects: 18% (151/837) 2024-08-20T22:05:30.3053753Z remote: Compressing objects: 19% (160/837) 2024-08-20T22:05:30.3084345Z remote: Compressing objects: 20% (168/837) 2024-08-20T22:05:30.3106926Z remote: Compressing objects: 21% (176/837) 2024-08-20T22:05:30.3109843Z remote: Compressing objects: 22% (185/837) 2024-08-20T22:05:30.3114090Z remote: Compressing objects: 23% (193/837) 2024-08-20T22:05:30.3118497Z remote: Compressing objects: 24% (201/837) 2024-08-20T22:05:30.3123166Z remote: Compressing objects: 25% (210/837) 2024-08-20T22:05:30.3130996Z remote: Compressing objects: 26% (218/837) 2024-08-20T22:05:30.3141559Z remote: Compressing objects: 27% (226/837) 2024-08-20T22:05:30.3159783Z remote: Compressing objects: 28% (235/837) 2024-08-20T22:05:30.3163717Z remote: Compressing objects: 29% (243/837) 2024-08-20T22:05:30.3175062Z remote: Compressing objects: 30% (252/837) 2024-08-20T22:05:30.3183995Z remote: Compressing objects: 31% (260/837) 2024-08-20T22:05:30.3191610Z remote: Compressing objects: 32% (268/837) 2024-08-20T22:05:30.3196513Z remote: Compressing objects: 33% (277/837) 2024-08-20T22:05:30.3200937Z remote: Compressing objects: 34% (285/837) 2024-08-20T22:05:30.3207899Z remote: Compressing objects: 35% (293/837) 2024-08-20T22:05:30.3214755Z remote: Compressing objects: 36% (302/837) 2024-08-20T22:05:30.3223402Z remote: Compressing objects: 37% (310/837) 2024-08-20T22:05:30.3228639Z remote: Compressing objects: 38% (319/837) 2024-08-20T22:05:30.3234483Z remote: Compressing objects: 39% (327/837) 2024-08-20T22:05:30.3239963Z remote: Compressing objects: 40% (335/837) 2024-08-20T22:05:30.3246334Z remote: Compressing objects: 41% (344/837) 2024-08-20T22:05:30.3253509Z remote: Compressing objects: 42% (352/837) 2024-08-20T22:05:30.3258428Z remote: Compressing objects: 43% (360/837) 2024-08-20T22:05:30.3265495Z remote: Compressing objects: 44% (369/837) 2024-08-20T22:05:30.3271171Z remote: Compressing objects: 45% (377/837) 2024-08-20T22:05:30.3274319Z remote: Compressing objects: 46% (386/837) 2024-08-20T22:05:30.3278785Z remote: Compressing objects: 47% (394/837) 2024-08-20T22:05:30.3283084Z remote: Compressing objects: 48% (402/837) 2024-08-20T22:05:30.3286055Z remote: Compressing objects: 49% (411/837) 2024-08-20T22:05:30.3289147Z remote: Compressing objects: 50% (419/837) 2024-08-20T22:05:30.3293326Z remote: Compressing objects: 51% (427/837) 2024-08-20T22:05:30.3295375Z remote: Compressing objects: 52% (436/837) 2024-08-20T22:05:30.3297180Z remote: Compressing objects: 53% (444/837) 2024-08-20T22:05:30.3300005Z remote: Compressing objects: 54% (452/837) 2024-08-20T22:05:30.3301112Z remote: Compressing objects: 55% (461/837) 2024-08-20T22:05:30.3302250Z remote: Compressing objects: 56% (469/837) 2024-08-20T22:05:30.3303907Z remote: Compressing objects: 57% (478/837) 2024-08-20T22:05:30.3304427Z remote: Compressing objects: 58% (486/837) 2024-08-20T22:05:30.3305096Z remote: Compressing objects: 59% (494/837) 2024-08-20T22:05:30.3305614Z remote: Compressing objects: 60% (503/837) 2024-08-20T22:05:30.3306440Z remote: Compressing objects: 61% (511/837) 2024-08-20T22:05:30.3306961Z remote: Compressing objects: 62% (519/837) 2024-08-20T22:05:30.3307468Z remote: Compressing objects: 63% (528/837) 2024-08-20T22:05:30.3313475Z remote: Compressing objects: 64% (536/837) 2024-08-20T22:05:30.3320309Z remote: Compressing objects: 65% (545/837) 2024-08-20T22:05:30.3325970Z remote: Compressing objects: 66% (553/837) 2024-08-20T22:05:30.3330316Z remote: Compressing objects: 67% (561/837) 2024-08-20T22:05:30.3335170Z remote: Compressing objects: 68% (570/837) 2024-08-20T22:05:30.3338499Z remote: Compressing objects: 69% (578/837) 2024-08-20T22:05:30.3343567Z remote: Compressing objects: 70% (586/837) 2024-08-20T22:05:30.3346455Z remote: Compressing objects: 71% (595/837) 2024-08-20T22:05:30.3349678Z remote: Compressing objects: 72% (603/837) 2024-08-20T22:05:30.3354031Z remote: Compressing objects: 73% (612/837) 2024-08-20T22:05:30.3356890Z remote: Compressing objects: 74% (620/837) 2024-08-20T22:05:30.3359492Z remote: Compressing objects: 75% (628/837) 2024-08-20T22:05:30.3362666Z remote: Compressing objects: 76% (637/837) 2024-08-20T22:05:30.3365923Z remote: Compressing objects: 77% (645/837) 2024-08-20T22:05:30.3368417Z remote: Compressing objects: 78% (653/837) 2024-08-20T22:05:30.3370279Z remote: Compressing objects: 79% (662/837) 2024-08-20T22:05:30.3372443Z remote: Compressing objects: 80% (670/837) 2024-08-20T22:05:30.3374289Z remote: Compressing objects: 81% (678/837) 2024-08-20T22:05:30.3376754Z remote: Compressing objects: 82% (687/837) 2024-08-20T22:05:30.3378479Z remote: Compressing objects: 83% (695/837) 2024-08-20T22:05:30.3380440Z remote: Compressing objects: 84% (704/837) 2024-08-20T22:05:30.3381558Z remote: Compressing objects: 85% (712/837) 2024-08-20T22:05:30.3383483Z remote: Compressing objects: 86% (720/837) 2024-08-20T22:05:30.3384987Z remote: Compressing objects: 87% (729/837) 2024-08-20T22:05:30.3387101Z remote: Compressing objects: 88% (737/837) 2024-08-20T22:05:30.3389415Z remote: Compressing objects: 89% (745/837) 2024-08-20T22:05:30.3391355Z remote: Compressing objects: 90% (754/837) 2024-08-20T22:05:30.3392547Z remote: Compressing objects: 91% (762/837) 2024-08-20T22:05:30.3393745Z remote: Compressing objects: 92% (771/837) 2024-08-20T22:05:30.3394263Z remote: Compressing objects: 93% (779/837) 2024-08-20T22:05:30.3395070Z remote: Compressing objects: 94% (787/837) 2024-08-20T22:05:30.3396407Z remote: Compressing objects: 95% (796/837) 2024-08-20T22:05:30.3397788Z remote: Compressing objects: 96% (804/837) 2024-08-20T22:05:30.3398904Z remote: Compressing objects: 97% (812/837) 2024-08-20T22:05:30.3400168Z remote: Compressing objects: 98% (821/837) 2024-08-20T22:05:30.3401745Z remote: Compressing objects: 99% (829/837) 2024-08-20T22:05:30.3402273Z remote: Compressing objects: 100% (837/837) 2024-08-20T22:05:30.3402835Z remote: Compressing objects: 100% (837/837), done. 2024-08-20T22:05:54.0797852Z remote: Total 1010208 (delta 1154), reused 1394 (delta 916), pack-reused 1008452 (from 1) 2024-08-20T22:06:15.8061788Z [command]/usr/bin/git rev-parse --verify --quiet 40ec5f6ddd9787aca0449b24128343ff4c4a88b3^{object} 2024-08-20T22:06:15.8099646Z 40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:06:15.8105341Z ##[endgroup] 2024-08-20T22:06:15.8110740Z ##[group]Determining the checkout info 2024-08-20T22:06:15.8111410Z ##[endgroup] 2024-08-20T22:06:15.8112062Z ##[group]Checking out the ref 2024-08-20T22:06:15.8112994Z [command]/usr/bin/git checkout --quiet --force 40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:06:17.5544377Z ##[endgroup] 2024-08-20T22:06:17.5544973Z ##[group]Setting up auth for fetching submodules 2024-08-20T22:06:17.5547779Z [command]/usr/bin/git config --global http.https://github.com/.extraheader AUTHORIZATION: basic *** 2024-08-20T22:06:17.5608091Z [command]/usr/bin/git config --global --unset-all url.https://github.com/.insteadOf 2024-08-20T22:06:17.5649455Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf git@github.com: 2024-08-20T22:06:17.5693050Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf org-21003710@github.com: 2024-08-20T22:06:17.5731712Z ##[endgroup] 2024-08-20T22:06:17.5732489Z ##[group]Fetching submodules 2024-08-20T22:06:17.5735572Z [command]/usr/bin/git submodule sync --recursive 2024-08-20T22:06:17.6118789Z [command]/usr/bin/git -c protocol.version=2 submodule update --init --force --recursive 2024-08-20T22:06:17.6487917Z Submodule 'android/libs/fbjni' (https://github.com/facebookincubator/fbjni.git) registered for path 'android/libs/fbjni' 2024-08-20T22:06:17.6489985Z Submodule 'third_party/NNPACK_deps/FP16' (https://github.com/Maratyszcza/FP16.git) registered for path 'third_party/FP16' 2024-08-20T22:06:17.6494130Z Submodule 'third_party/NNPACK_deps/FXdiv' (https://github.com/Maratyszcza/FXdiv.git) registered for path 'third_party/FXdiv' 2024-08-20T22:06:17.6498552Z Submodule 'third_party/NNPACK' (https://github.com/Maratyszcza/NNPACK.git) registered for path 'third_party/NNPACK' 2024-08-20T22:06:17.6503171Z Submodule 'third_party/VulkanMemoryAllocator' (https://github.com/GPUOpen-LibrariesAndSDKs/VulkanMemoryAllocator.git) registered for path 'third_party/VulkanMemoryAllocator' 2024-08-20T22:06:17.6507144Z Submodule 'third_party/XNNPACK' (https://github.com/google/XNNPACK.git) registered for path 'third_party/XNNPACK' 2024-08-20T22:06:17.6511788Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/benchmark' 2024-08-20T22:06:17.6516601Z Submodule 'third_party/cpp-httplib' (https://github.com/yhirose/cpp-httplib.git) registered for path 'third_party/cpp-httplib' 2024-08-20T22:06:17.6521335Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo.git) registered for path 'third_party/cpuinfo' 2024-08-20T22:06:17.6526352Z Submodule 'third_party/cudnn_frontend' (https://github.com/NVIDIA/cudnn-frontend.git) registered for path 'third_party/cudnn_frontend' 2024-08-20T22:06:17.6531161Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/cutlass' 2024-08-20T22:06:17.6536053Z Submodule 'third_party/eigen' (https://gitlab.com/libeigen/eigen.git) registered for path 'third_party/eigen' 2024-08-20T22:06:17.6540950Z Submodule 'third_party/fbgemm' (https://github.com/pytorch/fbgemm) registered for path 'third_party/fbgemm' 2024-08-20T22:06:17.6546137Z Submodule 'third_party/flatbuffers' (https://github.com/google/flatbuffers.git) registered for path 'third_party/flatbuffers' 2024-08-20T22:06:17.6551149Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/fmt' 2024-08-20T22:06:17.6556706Z Submodule 'third_party/gemmlowp/gemmlowp' (https://github.com/google/gemmlowp.git) registered for path 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:06:17.6566031Z Submodule 'third_party/gloo' (https://github.com/facebookincubator/gloo) registered for path 'third_party/gloo' 2024-08-20T22:06:17.6571352Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/googletest' 2024-08-20T22:06:17.6576602Z Submodule 'third_party/ideep' (https://github.com/intel/ideep) registered for path 'third_party/ideep' 2024-08-20T22:06:17.6582208Z Submodule 'third_party/ittapi' (https://github.com/intel/ittapi.git) registered for path 'third_party/ittapi' 2024-08-20T22:06:17.6587708Z Submodule 'third_party/kineto' (https://github.com/pytorch/kineto) registered for path 'third_party/kineto' 2024-08-20T22:06:17.6593364Z Submodule 'third_party/mimalloc' (https://github.com/microsoft/mimalloc.git) registered for path 'third_party/mimalloc' 2024-08-20T22:06:17.6599181Z Submodule 'third_party/nccl/nccl' (https://github.com/NVIDIA/nccl) registered for path 'third_party/nccl/nccl' 2024-08-20T22:06:17.6604841Z Submodule 'third_party/nlohmann' (https://github.com/nlohmann/json.git) registered for path 'third_party/nlohmann' 2024-08-20T22:06:17.6610499Z Submodule 'third_party/onnx' (https://github.com/onnx/onnx.git) registered for path 'third_party/onnx' 2024-08-20T22:06:17.6616826Z Submodule 'third_party/opentelemetry-cpp' (https://github.com/open-telemetry/opentelemetry-cpp.git) registered for path 'third_party/opentelemetry-cpp' 2024-08-20T22:06:17.6622615Z Submodule 'third_party/pocketfft' (https://github.com/mreineck/pocketfft) registered for path 'third_party/pocketfft' 2024-08-20T22:06:17.6628808Z Submodule 'third_party/protobuf' (https://github.com/protocolbuffers/protobuf.git) registered for path 'third_party/protobuf' 2024-08-20T22:06:17.6634963Z Submodule 'third_party/NNPACK_deps/psimd' (https://github.com/Maratyszcza/psimd.git) registered for path 'third_party/psimd' 2024-08-20T22:06:17.6641479Z Submodule 'third_party/NNPACK_deps/pthreadpool' (https://github.com/Maratyszcza/pthreadpool.git) registered for path 'third_party/pthreadpool' 2024-08-20T22:06:17.6647942Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/pybind11' 2024-08-20T22:06:17.6654191Z Submodule 'third_party/python-peachpy' (https://github.com/malfet/PeachPy.git) registered for path 'third_party/python-peachpy' 2024-08-20T22:06:17.6661073Z Submodule 'third_party/sleef' (https://github.com/shibatch/sleef) registered for path 'third_party/sleef' 2024-08-20T22:06:17.6671019Z Submodule 'third_party/tensorpipe' (https://github.com/pytorch/tensorpipe.git) registered for path 'third_party/tensorpipe' 2024-08-20T22:06:17.6706148Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/android/libs/fbjni'... 2024-08-20T22:06:18.0257050Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FP16'... 2024-08-20T22:06:18.2222399Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FXdiv'... 2024-08-20T22:06:18.4089051Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/NNPACK'... 2024-08-20T22:06:18.6408296Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/VulkanMemoryAllocator'... 2024-08-20T22:06:20.5928327Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/XNNPACK'... 2024-08-20T22:06:31.7062778Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/benchmark'... 2024-08-20T22:06:32.2120730Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpp-httplib'... 2024-08-20T22:06:32.6266541Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpuinfo'... 2024-08-20T22:06:33.2351151Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cudnn_frontend'... 2024-08-20T22:06:34.4473365Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cutlass'... 2024-08-20T22:06:36.4898603Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/eigen'... 2024-08-20T22:06:42.3162888Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm'... 2024-08-20T22:06:43.8490940Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/flatbuffers'... 2024-08-20T22:06:45.4725070Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fmt'... 2024-08-20T22:06:46.6491857Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gemmlowp/gemmlowp'... 2024-08-20T22:06:47.0587774Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gloo'... 2024-08-20T22:06:47.4283778Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/googletest'... 2024-08-20T22:06:48.4888498Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep'... 2024-08-20T22:06:48.8463212Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ittapi'... 2024-08-20T22:06:49.1023688Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto'... 2024-08-20T22:06:50.7569161Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/mimalloc'... 2024-08-20T22:06:51.5069837Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nccl/nccl'... 2024-08-20T22:06:52.1923190Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nlohmann'... 2024-08-20T22:06:58.3451640Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx'... 2024-08-20T22:07:00.3245330Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp'... 2024-08-20T22:07:04.5971475Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pocketfft'... 2024-08-20T22:07:04.8405849Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf'... 2024-08-20T22:07:14.0655066Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/psimd'... 2024-08-20T22:07:14.2763365Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pthreadpool'... 2024-08-20T22:07:14.4769563Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pybind11'... 2024-08-20T22:07:15.3980074Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/python-peachpy'... 2024-08-20T22:07:15.6899389Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/sleef'... 2024-08-20T22:07:16.3344966Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe'... 2024-08-20T22:07:16.7646154Z Submodule path 'android/libs/fbjni': checked out '7e1e1fe3858c63c251c637ae41a20de425dde96f' 2024-08-20T22:07:16.7791919Z Submodule path 'third_party/FP16': checked out '4dfe081cf6bcd15db339cf2680b9281b8451eeb3' 2024-08-20T22:07:16.7908508Z Submodule path 'third_party/FXdiv': checked out 'b408327ac2a15ec3e43352421954f5b1967701d1' 2024-08-20T22:07:16.8225875Z Submodule path 'third_party/NNPACK': checked out 'c07e3a0400713d546e0dea2d5466dd22ea389c73' 2024-08-20T22:07:16.8687389Z Submodule path 'third_party/VulkanMemoryAllocator': checked out 'a6bfc237255a6bac1513f7c1ebde6d8aed6b5191' 2024-08-20T22:07:18.0498958Z Submodule path 'third_party/XNNPACK': checked out 'fcbf55af6cf28a4627bcd1f703ab7ad843f0f3a2' 2024-08-20T22:07:18.0786426Z Submodule path 'third_party/benchmark': checked out '0d98dba29d66e93259db7daa53a9327df767a415' 2024-08-20T22:07:18.1318306Z Submodule path 'third_party/cpp-httplib': checked out '3b6597bba913d51161383657829b7e644e59c006' 2024-08-20T22:07:18.2448420Z Submodule path 'third_party/cpuinfo': checked out '3c8b1533ac03dd6531ab6e7b9245d488f13a82a5' 2024-08-20T22:07:18.2842229Z Submodule path 'third_party/cudnn_frontend': checked out '23511ba176243f27b3b275da1fb3814ea805a171' 2024-08-20T22:07:18.9085168Z Submodule path 'third_party/cutlass': checked out 'bbe579a9e3beb6ea6626d9227ec32d0dae119a49' 2024-08-20T22:07:19.1991522Z Submodule path 'third_party/eigen': checked out '3147391d946bb4b6c68edd901f2add6ac1f31f8c' 2024-08-20T22:07:19.2940795Z Submodule path 'third_party/fbgemm': checked out 'dbc3157bf256f1339b3fa1fef2be89ac4078be0e' 2024-08-20T22:07:19.2966295Z Submodule 'third_party/asmjit' (https://github.com/asmjit/asmjit.git) registered for path 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:07:19.2969117Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo) registered for path 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:07:19.2970630Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:07:19.2973764Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:07:19.2977456Z Submodule 'third_party/hipify_torch' (https://github.com/ROCmSoftwarePlatform/hipify_torch.git) registered for path 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:07:19.3008977Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/asmjit'... 2024-08-20T22:07:20.3569311Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cpuinfo'... 2024-08-20T22:07:20.9988791Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cutlass'... 2024-08-20T22:07:23.0361910Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/googletest'... 2024-08-20T22:07:24.0686723Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/hipify_torch'... 2024-08-20T22:07:24.4154618Z Submodule path 'third_party/fbgemm/third_party/asmjit': checked out 'd3fbf7c9bc7c1d1365a94a45614b91c5a3706b81' 2024-08-20T22:07:24.5269653Z Submodule path 'third_party/fbgemm/third_party/cpuinfo': checked out 'ed8b86a253800bafdb7b25c5c399f91bff9cb1f3' 2024-08-20T22:07:25.0366405Z Submodule path 'third_party/fbgemm/third_party/cutlass': checked out 'fc9ebc645b63f3a6bc80aaefde5c063fb72110d6' 2024-08-20T22:07:25.1071823Z Submodule path 'third_party/fbgemm/third_party/googletest': checked out 'cbf019de22c8dd37b2108da35b2748fd702d1796' 2024-08-20T22:07:25.1220359Z Submodule path 'third_party/fbgemm/third_party/hipify_torch': checked out '23f53b025b466d8ec3c45d52290d3442f7fbe6b1' 2024-08-20T22:07:25.2695217Z Submodule path 'third_party/flatbuffers': checked out '01834de25e4bf3975a9a00e816292b1ad0fe184b' 2024-08-20T22:07:25.3154731Z Submodule path 'third_party/fmt': checked out '0c9fce2ffefecfdce794e1859584e25877b7b592' 2024-08-20T22:07:25.3610829Z Submodule path 'third_party/gemmlowp/gemmlowp': checked out '3fb5c176c17c765a3492cd2f0321b0dab712f350' 2024-08-20T22:07:25.3938145Z Submodule path 'third_party/gloo': checked out '5354032ea08eadd7fc4456477f7f7c6308818509' 2024-08-20T22:07:25.4479331Z Submodule path 'third_party/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2024-08-20T22:07:25.4637804Z Submodule path 'third_party/ideep': checked out '55ca0191687aaf19aca5cdb7881c791e3bea442b' 2024-08-20T22:07:25.4657528Z Submodule 'mkl-dnn' (https://github.com/intel/mkl-dnn.git) registered for path 'third_party/ideep/mkl-dnn' 2024-08-20T22:07:25.4687683Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep/mkl-dnn'... 2024-08-20T22:07:38.7608583Z Submodule path 'third_party/ideep/mkl-dnn': checked out '1137e04ec0b5251ca2b4400a4fd3c667ce843d67' 2024-08-20T22:07:38.7830931Z Submodule path 'third_party/ittapi': checked out '5b8a7d7422611c3a0d799fb5fc5dd4abfae35b42' 2024-08-20T22:07:38.8838569Z Submodule path 'third_party/kineto': checked out 'd9753139d181b9ff42872465aac0e5d3018be415' 2024-08-20T22:07:38.8861023Z Submodule 'libkineto/third_party/dynolog' (https://github.com/facebookincubator/dynolog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:07:38.8864169Z Submodule 'libkineto/third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:07:38.8867632Z Submodule 'libkineto/third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:07:38.8900816Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog'... 2024-08-20T22:07:39.4212138Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/fmt'... 2024-08-20T22:07:40.6533587Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/googletest'... 2024-08-20T22:07:41.8003754Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog': checked out '7d04a0053a845370ae06ce317a22a48e9edcc74e' 2024-08-20T22:07:41.8025773Z Submodule 'third_party/DCGM' (https://github.com/NVIDIA/DCGM.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:07:41.8029248Z Submodule 'third_party/cpr' (https://github.com/libcpr/cpr.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:07:41.8032773Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:07:41.8036566Z Submodule 'third_party/gflags' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:07:41.8040399Z Submodule 'third_party/glog' (https://github.com/google/glog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:07:41.8044289Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:07:41.8048140Z Submodule 'third_party/json' (https://github.com/nlohmann/json.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:07:41.8052219Z Submodule 'third_party/pfs' (https://github.com/dtrugman/pfs.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:07:41.8084674Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'... 2024-08-20T22:07:42.6476985Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'... 2024-08-20T22:07:43.0298259Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'... 2024-08-20T22:07:44.2131933Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'... 2024-08-20T22:07:44.4932917Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/glog'... 2024-08-20T22:07:45.0316621Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'... 2024-08-20T22:07:46.0920172Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/json'... 2024-08-20T22:07:53.3299209Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'... 2024-08-20T22:07:53.7366860Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM': checked out 'ffde4e54bc7249a6039a5e6b45b395141e1217f9' 2024-08-20T22:07:53.7596451Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr': checked out '871ed52d350214a034f6ef8a3b8f51c5ce1bd400' 2024-08-20T22:07:53.8020972Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt': checked out 'cd4af11efc9c622896a3e4cb599fa28668ca3d05' 2024-08-20T22:07:53.8189492Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags': checked out 'e171aa2d15ed9eb17054558e0b3a6a413bb01067' 2024-08-20T22:07:53.8208810Z Submodule 'doc' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:07:53.8241562Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'... 2024-08-20T22:07:54.1788018Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc': checked out '8411df715cf522606e3b1aca386ddfc0b63d34b4' 2024-08-20T22:07:54.2008908Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog': checked out 'b33e3bad4c46c8a6345525fd822af355e5ef9446' 2024-08-20T22:07:54.2488498Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest': checked out '58d77fa8070e8cec2dc1ed015d66b454c8d78850' 2024-08-20T22:07:54.3682283Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json': checked out '4f8fba14066156b73f1189a2b8bd568bde5284c5' 2024-08-20T22:07:54.3886605Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs': checked out 'f68a2fa8ea36c783bdd760371411fcb495aa3150' 2024-08-20T22:07:54.4347571Z Submodule path 'third_party/kineto/libkineto/third_party/fmt': checked out '0041a40c1350ba702d475b9c4ad62da77caea164' 2024-08-20T22:07:54.5015302Z Submodule path 'third_party/kineto/libkineto/third_party/googletest': checked out '7aca84427f224eeed3144123d5230d5871e93347' 2024-08-20T22:07:54.5482208Z Submodule path 'third_party/mimalloc': checked out 'b66e3214d8a104669c2ec05ae91ebc26a8f5ab78' 2024-08-20T22:07:54.5783075Z Submodule path 'third_party/nccl/nccl': checked out 'ab2b89c4c339bd7f816fbc114a4b05d386b66290' 2024-08-20T22:07:54.7020676Z Submodule path 'third_party/nlohmann': checked out '87cda1d6646592ac5866dc703c8e1839046a6806' 2024-08-20T22:07:55.2152610Z Submodule path 'third_party/onnx': checked out '3bf92c03a9f27eba3bda1e5b9e63ea20ec213557' 2024-08-20T22:07:55.2193358Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/onnx/third_party/benchmark' 2024-08-20T22:07:55.2196815Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/onnx/third_party/pybind11' 2024-08-20T22:07:55.2230079Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx/third_party/benchmark'... 2024-08-20T22:07:55.6692830Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx/third_party/pybind11'... 2024-08-20T22:07:56.5787749Z Submodule path 'third_party/onnx/third_party/benchmark': checked out '2dd015dfef425c866d9a43f2c67d8b52d709acb6' 2024-08-20T22:07:56.6197386Z Submodule path 'third_party/onnx/third_party/pybind11': checked out '5b0a6fc2017fcc176545afe3e09c9f9885283242' 2024-08-20T22:07:56.7095378Z Submodule path 'third_party/opentelemetry-cpp': checked out 'a799f4aed9c94b765dcdaabaeab7d5e7e2310878' 2024-08-20T22:07:56.7118782Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark) registered for path 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:07:56.7122354Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:07:56.7125776Z Submodule 'third_party/ms-gsl' (https://github.com/microsoft/GSL) registered for path 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:07:56.7129308Z Submodule 'third_party/nlohmann-json' (https://github.com/nlohmann/json) registered for path 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:07:56.7133307Z Submodule 'third_party/opentelemetry-proto' (https://github.com/open-telemetry/opentelemetry-proto) registered for path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:07:56.7136914Z Submodule 'third_party/opentracing-cpp' (https://github.com/opentracing/opentracing-cpp.git) registered for path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:07:56.7140674Z Submodule 'third_party/prometheus-cpp' (https://github.com/jupp0r/prometheus-cpp) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:07:56.7144742Z Submodule 'tools/vcpkg' (https://github.com/Microsoft/vcpkg) registered for path 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:07:56.7176720Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/benchmark'... 2024-08-20T22:07:57.1408096Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/googletest'... 2024-08-20T22:07:58.1737360Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/ms-gsl'... 2024-08-20T22:07:58.4882622Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/nlohmann-json'... 2024-08-20T22:08:04.4885774Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentelemetry-proto'... 2024-08-20T22:08:04.7574368Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentracing-cpp'... 2024-08-20T22:08:04.9606631Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp'... 2024-08-20T22:08:05.2659871Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/tools/vcpkg'... 2024-08-20T22:08:12.1025132Z Submodule path 'third_party/opentelemetry-cpp/third_party/benchmark': checked out 'd572f4777349d43653b21d6c2fc63020ab326db2' 2024-08-20T22:08:12.1509610Z Submodule path 'third_party/opentelemetry-cpp/third_party/googletest': checked out 'b796f7d44681514f58a683a3a71ff17c94edb0c1' 2024-08-20T22:08:12.1707140Z Submodule path 'third_party/opentelemetry-cpp/third_party/ms-gsl': checked out '6f4529395c5b7c2d661812257cd6780c67e54afa' 2024-08-20T22:08:12.2952338Z Submodule path 'third_party/opentelemetry-cpp/third_party/nlohmann-json': checked out 'bc889afb4c5bf1c0d8ee29ef35eaaf4c8bef8a5d' 2024-08-20T22:08:12.3120587Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto': checked out '4ca4f0335c63cda7ab31ea7ed70d6553aee14dce' 2024-08-20T22:08:12.3309532Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp': checked out '06b57f48ded1fa3bdd3d4346f6ef29e40e08eaf5' 2024-08-20T22:08:12.3517997Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp': checked out 'c9ffcdda9086ffd9e1283ea7a0276d831f3c8a8d' 2024-08-20T22:08:12.3536984Z Submodule 'civetweb' (https://github.com/civetweb/civetweb.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:08:12.3540379Z Submodule 'googletest' (https://github.com/google/googletest.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:08:12.3570238Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'... 2024-08-20T22:08:14.2328362Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'... 2024-08-20T22:08:15.5197355Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb': checked out 'eefb26f82b233268fc98577d265352720d477ba4' 2024-08-20T22:08:15.5741173Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2024-08-20T22:08:16.2316903Z Submodule path 'third_party/opentelemetry-cpp/tools/vcpkg': checked out '8eb57355a4ffb410a2e94c07b4dca2dffbee8e50' 2024-08-20T22:08:16.2458804Z Submodule path 'third_party/pocketfft': checked out '9d3ab05a7fffbc71a492bc6a17be034e83e8f0fe' 2024-08-20T22:08:16.5653660Z Submodule path 'third_party/protobuf': checked out 'd1eca4e4b421cd2997495c4b4e65cea6be4e9b8a' 2024-08-20T22:08:16.5680634Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:08:16.5683771Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/protobuf/third_party/googletest' 2024-08-20T22:08:16.5715594Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/benchmark'... 2024-08-20T22:08:17.0129675Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/googletest'... 2024-08-20T22:08:18.0444696Z Submodule path 'third_party/protobuf/third_party/benchmark': checked out '5b7683f49e1e9223cf9927b24f6fd3d6bd82e3f8' 2024-08-20T22:08:18.1258350Z Submodule path 'third_party/protobuf/third_party/googletest': checked out '5ec7f0c4a113e2f18ac2c6cc7df51ad6afc24081' 2024-08-20T22:08:18.1375041Z Submodule path 'third_party/psimd': checked out '072586a71b55b7f8c584153d223e95687148a900' 2024-08-20T22:08:18.1524712Z Submodule path 'third_party/pthreadpool': checked out '4fe0e1e183925bf8cfa6aae24237e724a96479b8' 2024-08-20T22:08:18.1968563Z Submodule path 'third_party/pybind11': checked out '941f45bcb51457884fa1afd6e24a67377d70f75c' 2024-08-20T22:08:18.2316179Z Submodule path 'third_party/python-peachpy': checked out 'f45429b087dd7d5bc78bb40dc7cf06425c252d67' 2024-08-20T22:08:18.2796390Z Submodule path 'third_party/sleef': checked out '60e76d2bce17d278b439d9da17177c8f957a9e9b' 2024-08-20T22:08:18.3139909Z Submodule path 'third_party/tensorpipe': checked out '52791a2fd214b2a9dc5759d36725909c1daa7f2e' 2024-08-20T22:08:18.3162048Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:08:18.3165771Z Submodule 'third_party/libnop' (https://github.com/google/libnop.git) registered for path 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:08:18.3168939Z Submodule 'third_party/libuv' (https://github.com/libuv/libuv.git) registered for path 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:08:18.3173220Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:08:18.3205251Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/googletest'... 2024-08-20T22:08:19.3494542Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libnop'... 2024-08-20T22:08:19.6071173Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libuv'... 2024-08-20T22:08:20.7914664Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11'... 2024-08-20T22:08:21.7570978Z Submodule path 'third_party/tensorpipe/third_party/googletest': checked out 'aee0f9d9b5b87796ee8a0ab26b7587ec30e8858e' 2024-08-20T22:08:21.7765417Z Submodule path 'third_party/tensorpipe/third_party/libnop': checked out '910b55815be16109f04f4180e9adee14fb4ce281' 2024-08-20T22:08:21.8561619Z Submodule path 'third_party/tensorpipe/third_party/libuv': checked out '1dff88e5161cba5c59276d2070d2e304e4dcb242' 2024-08-20T22:08:21.8913348Z Submodule path 'third_party/tensorpipe/third_party/pybind11': checked out 'a23996fce38ff6ccfbcdc09f1e63f2c4be5ea2ef' 2024-08-20T22:08:21.8931976Z Submodule 'tools/clang' (https://github.com/wjakob/clang-cindex-python3) registered for path 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:08:21.8964197Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11/tools/clang'... 2024-08-20T22:08:22.0926010Z Submodule path 'third_party/tensorpipe/third_party/pybind11/tools/clang': checked out '6a00cbc4a9b8e68b71caf7f774b3f9c753ae84d5' 2024-08-20T22:08:22.0972312Z [command]/usr/bin/git submodule foreach --recursive git config --local gc.auto 0 2024-08-20T22:08:22.1338335Z Entering 'android/libs/fbjni' 2024-08-20T22:08:22.1391690Z Entering 'third_party/FP16' 2024-08-20T22:08:22.1443757Z Entering 'third_party/FXdiv' 2024-08-20T22:08:22.1495853Z Entering 'third_party/NNPACK' 2024-08-20T22:08:22.1547416Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T22:08:22.1600171Z Entering 'third_party/XNNPACK' 2024-08-20T22:08:22.1667436Z Entering 'third_party/benchmark' 2024-08-20T22:08:22.1719029Z Entering 'third_party/cpp-httplib' 2024-08-20T22:08:22.1770666Z Entering 'third_party/cpuinfo' 2024-08-20T22:08:22.1822290Z Entering 'third_party/cudnn_frontend' 2024-08-20T22:08:22.1874460Z Entering 'third_party/cutlass' 2024-08-20T22:08:22.1933766Z Entering 'third_party/eigen' 2024-08-20T22:08:22.1988673Z Entering 'third_party/fbgemm' 2024-08-20T22:08:22.2038600Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:08:22.2090995Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:08:22.2142580Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:08:22.2201718Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:08:22.2253823Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:08:22.2308963Z Entering 'third_party/flatbuffers' 2024-08-20T22:08:22.2363202Z Entering 'third_party/fmt' 2024-08-20T22:08:22.2414190Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:08:22.2470919Z Entering 'third_party/gloo' 2024-08-20T22:08:22.2522610Z Entering 'third_party/googletest' 2024-08-20T22:08:22.2575111Z Entering 'third_party/ideep' 2024-08-20T22:08:22.2624627Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T22:08:22.2688105Z Entering 'third_party/ittapi' 2024-08-20T22:08:22.2739378Z Entering 'third_party/kineto' 2024-08-20T22:08:22.2790573Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:08:22.2842107Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:08:22.2895939Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:08:22.2947151Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:08:22.2998117Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:08:22.3048057Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:08:22.3103646Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:08:22.3154538Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:08:22.3206417Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:08:22.3258197Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:08:22.3314612Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:08:22.3366494Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:08:22.3424027Z Entering 'third_party/mimalloc' 2024-08-20T22:08:22.3476792Z Entering 'third_party/nccl/nccl' 2024-08-20T22:08:22.3528676Z Entering 'third_party/nlohmann' 2024-08-20T22:08:22.3581231Z Entering 'third_party/onnx' 2024-08-20T22:08:22.3646999Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T22:08:22.3700632Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T22:08:22.3755931Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T22:08:22.3808851Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:08:22.3859773Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:08:22.3913389Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:08:22.3964490Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:08:22.4020818Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:08:22.4071867Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:08:22.4121917Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:08:22.4175886Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:08:22.4229671Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:08:22.4285719Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:08:22.4358703Z Entering 'third_party/pocketfft' 2024-08-20T22:08:22.4411695Z Entering 'third_party/protobuf' 2024-08-20T22:08:22.4465214Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:08:22.4519867Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T22:08:22.4574599Z Entering 'third_party/psimd' 2024-08-20T22:08:22.4625417Z Entering 'third_party/pthreadpool' 2024-08-20T22:08:22.4677019Z Entering 'third_party/pybind11' 2024-08-20T22:08:22.4728749Z Entering 'third_party/python-peachpy' 2024-08-20T22:08:22.4780920Z Entering 'third_party/sleef' 2024-08-20T22:08:22.4832397Z Entering 'third_party/tensorpipe' 2024-08-20T22:08:22.4884027Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:08:22.4934196Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:08:22.4989706Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:08:22.5040448Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:08:22.5090777Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:08:22.5168329Z ##[endgroup] 2024-08-20T22:08:22.5172828Z ##[group]Persisting credentials for submodules 2024-08-20T22:08:22.5174464Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'url\.https\:\/\/github\.com\/\.insteadOf' && git config --local --unset-all 'url.https://github.com/.insteadOf' || :" 2024-08-20T22:08:22.5539828Z Entering 'android/libs/fbjni' 2024-08-20T22:08:22.5608437Z Entering 'third_party/FP16' 2024-08-20T22:08:22.5675483Z Entering 'third_party/FXdiv' 2024-08-20T22:08:22.5742315Z Entering 'third_party/NNPACK' 2024-08-20T22:08:22.5810933Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T22:08:22.5879652Z Entering 'third_party/XNNPACK' 2024-08-20T22:08:22.5964920Z Entering 'third_party/benchmark' 2024-08-20T22:08:22.6032575Z Entering 'third_party/cpp-httplib' 2024-08-20T22:08:22.6099789Z Entering 'third_party/cpuinfo' 2024-08-20T22:08:22.6166685Z Entering 'third_party/cudnn_frontend' 2024-08-20T22:08:22.6233796Z Entering 'third_party/cutlass' 2024-08-20T22:08:22.6309802Z Entering 'third_party/eigen' 2024-08-20T22:08:22.6380422Z Entering 'third_party/fbgemm' 2024-08-20T22:08:22.6447538Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:08:22.6513428Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:08:22.6585923Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:08:22.6663661Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:08:22.6728942Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:08:22.6797928Z Entering 'third_party/flatbuffers' 2024-08-20T22:08:22.6868916Z Entering 'third_party/fmt' 2024-08-20T22:08:22.6937033Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:08:22.7007682Z Entering 'third_party/gloo' 2024-08-20T22:08:22.7076477Z Entering 'third_party/googletest' 2024-08-20T22:08:22.7143685Z Entering 'third_party/ideep' 2024-08-20T22:08:22.7209200Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T22:08:22.7284394Z Entering 'third_party/ittapi' 2024-08-20T22:08:22.7351632Z Entering 'third_party/kineto' 2024-08-20T22:08:22.7418719Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:08:22.7487202Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:08:22.7557274Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:08:22.7623380Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:08:22.7690682Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:08:22.7756514Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:08:22.7826918Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:08:22.7895468Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:08:22.7964554Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:08:22.8032280Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:08:22.8102539Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:08:22.8169188Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:08:22.8239251Z Entering 'third_party/mimalloc' 2024-08-20T22:08:22.8309816Z Entering 'third_party/nccl/nccl' 2024-08-20T22:08:22.8378529Z Entering 'third_party/nlohmann' 2024-08-20T22:08:22.8447935Z Entering 'third_party/onnx' 2024-08-20T22:08:22.8530038Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T22:08:22.8598856Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T22:08:22.8671050Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T22:08:22.8740663Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:08:22.8806117Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:08:22.8873652Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:08:22.8939443Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:08:22.9007673Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:08:22.9078640Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:08:22.9143692Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:08:22.9208328Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:08:22.9276327Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:08:22.9345472Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:08:22.9436021Z Entering 'third_party/pocketfft' 2024-08-20T22:08:22.9503738Z Entering 'third_party/protobuf' 2024-08-20T22:08:22.9573469Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:08:22.9640045Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T22:08:22.9710195Z Entering 'third_party/psimd' 2024-08-20T22:08:22.9779142Z Entering 'third_party/pthreadpool' 2024-08-20T22:08:22.9846365Z Entering 'third_party/pybind11' 2024-08-20T22:08:22.9914086Z Entering 'third_party/python-peachpy' 2024-08-20T22:08:22.9981957Z Entering 'third_party/sleef' 2024-08-20T22:08:23.0050142Z Entering 'third_party/tensorpipe' 2024-08-20T22:08:23.0118185Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:08:23.0187951Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:08:23.0258351Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:08:23.0325228Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:08:23.0389084Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:08:23.0482419Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local 'http.https://github.com/.extraheader' 'AUTHORIZATION: basic ***' && git config --local --show-origin --name-only --get-regexp remote.origin.url" 2024-08-20T22:08:23.0847941Z Entering 'android/libs/fbjni' 2024-08-20T22:08:23.0910111Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/android/libs/fbjni/config remote.origin.url 2024-08-20T22:08:23.0931514Z Entering 'third_party/FP16' 2024-08-20T22:08:23.0994458Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FP16/config remote.origin.url 2024-08-20T22:08:23.1015879Z Entering 'third_party/FXdiv' 2024-08-20T22:08:23.1078682Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FXdiv/config remote.origin.url 2024-08-20T22:08:23.1100883Z Entering 'third_party/NNPACK' 2024-08-20T22:08:23.1164965Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK/config remote.origin.url 2024-08-20T22:08:23.1185330Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T22:08:23.1246836Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/VulkanMemoryAllocator/config remote.origin.url 2024-08-20T22:08:23.1268631Z Entering 'third_party/XNNPACK' 2024-08-20T22:08:23.1330954Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/XNNPACK/config remote.origin.url 2024-08-20T22:08:23.1369008Z Entering 'third_party/benchmark' 2024-08-20T22:08:23.1432454Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/benchmark/config remote.origin.url 2024-08-20T22:08:23.1452822Z Entering 'third_party/cpp-httplib' 2024-08-20T22:08:23.1513643Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpp-httplib/config remote.origin.url 2024-08-20T22:08:23.1534434Z Entering 'third_party/cpuinfo' 2024-08-20T22:08:23.1597174Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpuinfo/config remote.origin.url 2024-08-20T22:08:23.1617931Z Entering 'third_party/cudnn_frontend' 2024-08-20T22:08:23.1678654Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cudnn_frontend/config remote.origin.url 2024-08-20T22:08:23.1699927Z Entering 'third_party/cutlass' 2024-08-20T22:08:23.1761367Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cutlass/config remote.origin.url 2024-08-20T22:08:23.1790045Z Entering 'third_party/eigen' 2024-08-20T22:08:23.1850136Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/eigen/config remote.origin.url 2024-08-20T22:08:23.1873516Z Entering 'third_party/fbgemm' 2024-08-20T22:08:23.1934145Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/config remote.origin.url 2024-08-20T22:08:23.1953754Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:08:23.2021282Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/asmjit/config remote.origin.url 2024-08-20T22:08:23.2041505Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:08:23.2103375Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cpuinfo/config remote.origin.url 2024-08-20T22:08:23.2123653Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:08:23.2184590Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cutlass/config remote.origin.url 2024-08-20T22:08:23.2213651Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:08:23.2275478Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/googletest/config remote.origin.url 2024-08-20T22:08:23.2295744Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:08:23.2362459Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/hipify_torch/config remote.origin.url 2024-08-20T22:08:23.2387647Z Entering 'third_party/flatbuffers' 2024-08-20T22:08:23.2450948Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/flatbuffers/config remote.origin.url 2024-08-20T22:08:23.2476268Z Entering 'third_party/fmt' 2024-08-20T22:08:23.2538752Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fmt/config remote.origin.url 2024-08-20T22:08:23.2559987Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:08:23.2623599Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gemmlowp/gemmlowp/config remote.origin.url 2024-08-20T22:08:23.2649506Z Entering 'third_party/gloo' 2024-08-20T22:08:23.2711645Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gloo/config remote.origin.url 2024-08-20T22:08:23.2734155Z Entering 'third_party/googletest' 2024-08-20T22:08:23.2795475Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/googletest/config remote.origin.url 2024-08-20T22:08:23.2818404Z Entering 'third_party/ideep' 2024-08-20T22:08:23.2880889Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/config remote.origin.url 2024-08-20T22:08:23.2899905Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T22:08:23.2960480Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/modules/mkl-dnn/config remote.origin.url 2024-08-20T22:08:23.2991371Z Entering 'third_party/ittapi' 2024-08-20T22:08:23.3055012Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ittapi/config remote.origin.url 2024-08-20T22:08:23.3078419Z Entering 'third_party/kineto' 2024-08-20T22:08:23.3142334Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/config remote.origin.url 2024-08-20T22:08:23.3161164Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:08:23.3224279Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/config remote.origin.url 2024-08-20T22:08:23.3244161Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:08:23.3308890Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/DCGM/config remote.origin.url 2024-08-20T22:08:23.3329300Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:08:23.3392774Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/cpr/config remote.origin.url 2024-08-20T22:08:23.3413856Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:08:23.3477300Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/fmt/config remote.origin.url 2024-08-20T22:08:23.3498750Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:08:23.3562407Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/config remote.origin.url 2024-08-20T22:08:23.3582939Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:08:23.3651257Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/modules/doc/config remote.origin.url 2024-08-20T22:08:23.3674784Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:08:23.3736193Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/glog/config remote.origin.url 2024-08-20T22:08:23.3757002Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:08:23.3818787Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/googletest/config remote.origin.url 2024-08-20T22:08:23.3841406Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:08:23.3905020Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/json/config remote.origin.url 2024-08-20T22:08:23.3927257Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:08:23.3994130Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/pfs/config remote.origin.url 2024-08-20T22:08:23.4018334Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:08:23.4080257Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/fmt/config remote.origin.url 2024-08-20T22:08:23.4100682Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:08:23.4162042Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/googletest/config remote.origin.url 2024-08-20T22:08:23.4185292Z Entering 'third_party/mimalloc' 2024-08-20T22:08:23.4246830Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/mimalloc/config remote.origin.url 2024-08-20T22:08:23.4268817Z Entering 'third_party/nccl/nccl' 2024-08-20T22:08:23.4330707Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nccl/nccl/config remote.origin.url 2024-08-20T22:08:23.4352015Z Entering 'third_party/nlohmann' 2024-08-20T22:08:23.4415763Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nlohmann/config remote.origin.url 2024-08-20T22:08:23.4438250Z Entering 'third_party/onnx' 2024-08-20T22:08:23.4502450Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/config remote.origin.url 2024-08-20T22:08:23.4537113Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T22:08:23.4599197Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/benchmark/config remote.origin.url 2024-08-20T22:08:23.4621126Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T22:08:23.4683488Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/pybind11/config remote.origin.url 2024-08-20T22:08:23.4709489Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T22:08:23.4773683Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/config remote.origin.url 2024-08-20T22:08:23.4795419Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:08:23.4861918Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/benchmark/config remote.origin.url 2024-08-20T22:08:23.4883462Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:08:23.4945227Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/googletest/config remote.origin.url 2024-08-20T22:08:23.4968086Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:08:23.5028633Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/ms-gsl/config remote.origin.url 2024-08-20T22:08:23.5048923Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:08:23.5114377Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/nlohmann-json/config remote.origin.url 2024-08-20T22:08:23.5136174Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:08:23.5197339Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentelemetry-proto/config remote.origin.url 2024-08-20T22:08:23.5218675Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:08:23.5280029Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentracing-cpp/config remote.origin.url 2024-08-20T22:08:23.5299829Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:08:23.5361558Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/config remote.origin.url 2024-08-20T22:08:23.5379978Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:08:23.5441793Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/civetweb/config remote.origin.url 2024-08-20T22:08:23.5464999Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:08:23.5526686Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/googletest/config remote.origin.url 2024-08-20T22:08:23.5550012Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:08:23.5612702Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/tools/vcpkg/config remote.origin.url 2024-08-20T22:08:23.5654256Z Entering 'third_party/pocketfft' 2024-08-20T22:08:23.5719422Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pocketfft/config remote.origin.url 2024-08-20T22:08:23.5740553Z Entering 'third_party/protobuf' 2024-08-20T22:08:23.5803198Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/config remote.origin.url 2024-08-20T22:08:23.5826704Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:08:23.5892736Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/benchmark/config remote.origin.url 2024-08-20T22:08:23.5912873Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T22:08:23.5977465Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/googletest/config remote.origin.url 2024-08-20T22:08:23.6001275Z Entering 'third_party/psimd' 2024-08-20T22:08:23.6065085Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/psimd/config remote.origin.url 2024-08-20T22:08:23.6086631Z Entering 'third_party/pthreadpool' 2024-08-20T22:08:23.6149659Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/pthreadpool/config remote.origin.url 2024-08-20T22:08:23.6170102Z Entering 'third_party/pybind11' 2024-08-20T22:08:23.6232155Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pybind11/config remote.origin.url 2024-08-20T22:08:23.6253833Z Entering 'third_party/python-peachpy' 2024-08-20T22:08:23.6318479Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/python-peachpy/config remote.origin.url 2024-08-20T22:08:23.6339879Z Entering 'third_party/sleef' 2024-08-20T22:08:23.6402681Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/sleef/config remote.origin.url 2024-08-20T22:08:23.6423651Z Entering 'third_party/tensorpipe' 2024-08-20T22:08:23.6488494Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/config remote.origin.url 2024-08-20T22:08:23.6508256Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:08:23.6574662Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/googletest/config remote.origin.url 2024-08-20T22:08:23.6594883Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:08:23.6661520Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libnop/config remote.origin.url 2024-08-20T22:08:23.6681043Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:08:23.6745068Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libuv/config remote.origin.url 2024-08-20T22:08:23.6767325Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:08:23.6834857Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/config remote.origin.url 2024-08-20T22:08:23.6854540Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:08:23.6918133Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/modules/tools/clang/config remote.origin.url 2024-08-20T22:08:23.7622445Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'git@github.com:' 2024-08-20T22:08:23.7994926Z Entering 'android/libs/fbjni' 2024-08-20T22:08:23.8048014Z Entering 'third_party/FP16' 2024-08-20T22:08:23.8101766Z Entering 'third_party/FXdiv' 2024-08-20T22:08:23.8154645Z Entering 'third_party/NNPACK' 2024-08-20T22:08:23.8209985Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T22:08:23.8263430Z Entering 'third_party/XNNPACK' 2024-08-20T22:08:23.8332745Z Entering 'third_party/benchmark' 2024-08-20T22:08:23.8386888Z Entering 'third_party/cpp-httplib' 2024-08-20T22:08:23.8440628Z Entering 'third_party/cpuinfo' 2024-08-20T22:08:23.8494383Z Entering 'third_party/cudnn_frontend' 2024-08-20T22:08:23.8547639Z Entering 'third_party/cutlass' 2024-08-20T22:08:23.8608680Z Entering 'third_party/eigen' 2024-08-20T22:08:23.8664007Z Entering 'third_party/fbgemm' 2024-08-20T22:08:23.8719667Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:08:23.8774723Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:08:23.8825504Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:08:23.8886968Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:08:23.8937966Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:08:23.8994103Z Entering 'third_party/flatbuffers' 2024-08-20T22:08:23.9050589Z Entering 'third_party/fmt' 2024-08-20T22:08:23.9104015Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:08:23.9156969Z Entering 'third_party/gloo' 2024-08-20T22:08:23.9210377Z Entering 'third_party/googletest' 2024-08-20T22:08:23.9263762Z Entering 'third_party/ideep' 2024-08-20T22:08:23.9314671Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T22:08:23.9381076Z Entering 'third_party/ittapi' 2024-08-20T22:08:23.9433803Z Entering 'third_party/kineto' 2024-08-20T22:08:23.9487688Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:08:23.9540161Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:08:23.9594789Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:08:23.9646303Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:08:23.9698690Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:08:23.9748223Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:08:23.9811164Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:08:23.9862545Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:08:23.9912954Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:08:23.9964612Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:08:24.0018693Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:08:24.0069569Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:08:24.0122164Z Entering 'third_party/mimalloc' 2024-08-20T22:08:24.0177264Z Entering 'third_party/nccl/nccl' 2024-08-20T22:08:24.0230859Z Entering 'third_party/nlohmann' 2024-08-20T22:08:24.0285728Z Entering 'third_party/onnx' 2024-08-20T22:08:24.0352344Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T22:08:24.0410734Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T22:08:24.0466855Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T22:08:24.0520172Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:08:24.0572814Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:08:24.0623080Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:08:24.0673578Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:08:24.0730045Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:08:24.0781773Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:08:24.0832447Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:08:24.0882145Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:08:24.0935032Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:08:24.0992112Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:08:24.1064285Z Entering 'third_party/pocketfft' 2024-08-20T22:08:24.1115367Z Entering 'third_party/protobuf' 2024-08-20T22:08:24.1169337Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:08:24.1219871Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T22:08:24.1274249Z Entering 'third_party/psimd' 2024-08-20T22:08:24.1326228Z Entering 'third_party/pthreadpool' 2024-08-20T22:08:24.1377610Z Entering 'third_party/pybind11' 2024-08-20T22:08:24.1428836Z Entering 'third_party/python-peachpy' 2024-08-20T22:08:24.1479921Z Entering 'third_party/sleef' 2024-08-20T22:08:24.1531729Z Entering 'third_party/tensorpipe' 2024-08-20T22:08:24.1582080Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:08:24.1632177Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:08:24.1682403Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:08:24.1732332Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:08:24.1785982Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:08:24.1863835Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'org-21003710@github.com:' 2024-08-20T22:08:24.2229460Z Entering 'android/libs/fbjni' 2024-08-20T22:08:24.2283537Z Entering 'third_party/FP16' 2024-08-20T22:08:24.2334193Z Entering 'third_party/FXdiv' 2024-08-20T22:08:24.2385832Z Entering 'third_party/NNPACK' 2024-08-20T22:08:24.2436897Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T22:08:24.2488371Z Entering 'third_party/XNNPACK' 2024-08-20T22:08:24.2556447Z Entering 'third_party/benchmark' 2024-08-20T22:08:24.2606919Z Entering 'third_party/cpp-httplib' 2024-08-20T22:08:24.2657975Z Entering 'third_party/cpuinfo' 2024-08-20T22:08:24.2711123Z Entering 'third_party/cudnn_frontend' 2024-08-20T22:08:24.2762587Z Entering 'third_party/cutlass' 2024-08-20T22:08:24.2823228Z Entering 'third_party/eigen' 2024-08-20T22:08:24.2875687Z Entering 'third_party/fbgemm' 2024-08-20T22:08:24.2927236Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:08:24.2978185Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:08:24.3028984Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:08:24.3087008Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:08:24.3136847Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:08:24.3191313Z Entering 'third_party/flatbuffers' 2024-08-20T22:08:24.3245933Z Entering 'third_party/fmt' 2024-08-20T22:08:24.3298536Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:08:24.3350739Z Entering 'third_party/gloo' 2024-08-20T22:08:24.3403485Z Entering 'third_party/googletest' 2024-08-20T22:08:24.3454616Z Entering 'third_party/ideep' 2024-08-20T22:08:24.3504782Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T22:08:24.3567843Z Entering 'third_party/ittapi' 2024-08-20T22:08:24.3618955Z Entering 'third_party/kineto' 2024-08-20T22:08:24.3669069Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:08:24.3718456Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:08:24.3770136Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:08:24.3820907Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:08:24.3872564Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:08:24.3921278Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:08:24.3977115Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:08:24.4028541Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:08:24.4078852Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:08:24.4131150Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:08:24.4186111Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:08:24.4240719Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:08:24.4295768Z Entering 'third_party/mimalloc' 2024-08-20T22:08:24.4348094Z Entering 'third_party/nccl/nccl' 2024-08-20T22:08:24.4401052Z Entering 'third_party/nlohmann' 2024-08-20T22:08:24.4453704Z Entering 'third_party/onnx' 2024-08-20T22:08:24.4521222Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T22:08:24.4573082Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T22:08:24.4629698Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T22:08:24.4682220Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:08:24.4731610Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:08:24.4782919Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:08:24.4833164Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:08:24.4884989Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:08:24.4934323Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:08:24.4987584Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:08:24.5040889Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:08:24.5094136Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:08:24.5148799Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:08:24.5231077Z Entering 'third_party/pocketfft' 2024-08-20T22:08:24.5283591Z Entering 'third_party/protobuf' 2024-08-20T22:08:24.5337288Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:08:24.5388923Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T22:08:24.5443578Z Entering 'third_party/psimd' 2024-08-20T22:08:24.5497458Z Entering 'third_party/pthreadpool' 2024-08-20T22:08:24.5551132Z Entering 'third_party/pybind11' 2024-08-20T22:08:24.5603111Z Entering 'third_party/python-peachpy' 2024-08-20T22:08:24.5654345Z Entering 'third_party/sleef' 2024-08-20T22:08:24.5706049Z Entering 'third_party/tensorpipe' 2024-08-20T22:08:24.5756490Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:08:24.5806894Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:08:24.5860635Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:08:24.5918448Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:08:24.5967148Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:08:24.6039849Z ##[endgroup] 2024-08-20T22:08:24.6090331Z [command]/usr/bin/git log -1 --format='%H' 2024-08-20T22:08:24.6129577Z '40ec5f6ddd9787aca0449b24128343ff4c4a88b3' 2024-08-20T22:08:24.6335608Z Prepare all required actions 2024-08-20T22:08:24.6336054Z Getting action download info 2024-08-20T22:08:24.7849901Z ##[group]Run ./.github/actions/setup-linux 2024-08-20T22:08:24.7850323Z env: 2024-08-20T22:08:24.7850599Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:24.7850939Z ##[endgroup] 2024-08-20T22:08:24.7910162Z ##[group]Run set -euo pipefail 2024-08-20T22:08:24.7910582Z set -euo pipefail 2024-08-20T22:08:24.7910967Z function get_ec2_metadata() { 2024-08-20T22:08:24.7911507Z  # Pulled from instance metadata endpoint for EC2 2024-08-20T22:08:24.7912507Z  # see https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/instancedata-data-retrieval.html 2024-08-20T22:08:24.7913272Z  category=$1 2024-08-20T22:08:24.7913799Z  # If it is GCP runner (runner name contains gcp), do not run this 2024-08-20T22:08:24.7914437Z  runner_name_str=i-067d93865e69cb17b 2024-08-20T22:08:24.7914930Z  if [[ -f /.inarc ]]; then 2024-08-20T22:08:24.7915454Z  echo "ARC Runner, no info on ec2 metadata" 2024-08-20T22:08:24.7916130Z  elif [[ $runner_name_str == *"gcp"* ]]; then 2024-08-20T22:08:24.7916832Z  echo "Runner is from Google Cloud Platform, No info on ec2 metadata" 2024-08-20T22:08:24.7917434Z  else 2024-08-20T22:08:24.7917923Z  curl -fsSL "http://169.254.169.254/latest/meta-data/${category}" 2024-08-20T22:08:24.7918493Z  fi 2024-08-20T22:08:24.7918776Z } 2024-08-20T22:08:24.7919131Z echo "ami-id: $(get_ec2_metadata ami-id)" 2024-08-20T22:08:24.7919721Z echo "instance-id: $(get_ec2_metadata instance-id)" 2024-08-20T22:08:24.7920375Z echo "instance-type: $(get_ec2_metadata instance-type)" 2024-08-20T22:08:24.7920940Z echo "system info $(uname -a)" 2024-08-20T22:08:24.7931046Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:08:24.7931534Z env: 2024-08-20T22:08:24.7931811Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:24.7932164Z ##[endgroup] 2024-08-20T22:08:24.8027211Z ami-id: ami-06c68f701d8090592 2024-08-20T22:08:24.8089408Z instance-id: i-067d93865e69cb17b 2024-08-20T22:08:24.8144671Z instance-type: g5.4xlarge 2024-08-20T22:08:24.8158480Z system info Linux ip-10-0-69-159.ec2.internal 6.1.94-99.176.amzn2023.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Jun 18 14:57:56 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux 2024-08-20T22:08:24.8182608Z ##[group]Run echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> $GITHUB_OUTPUT 2024-08-20T22:08:24.8183517Z echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> $GITHUB_OUTPUT 2024-08-20T22:08:24.8192679Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:08:24.8193180Z env: 2024-08-20T22:08:24.8193449Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:24.8193784Z ##[endgroup] 2024-08-20T22:08:24.8270812Z ##[group]Run if systemctl is-active --quiet docker; then 2024-08-20T22:08:24.8271416Z if systemctl is-active --quiet docker; then 2024-08-20T22:08:24.8271950Z  echo "Docker daemon is running..."; 2024-08-20T22:08:24.8272562Z else 2024-08-20T22:08:24.8273049Z  echo "Starting docker deamon..." && sudo systemctl start docker; 2024-08-20T22:08:24.8273625Z fi 2024-08-20T22:08:24.8282539Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:08:24.8283028Z env: 2024-08-20T22:08:24.8283296Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:24.8283633Z ##[endgroup] 2024-08-20T22:08:24.8376033Z Docker daemon is running... 2024-08-20T22:08:24.8426206Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2024-08-20T22:08:24.8426776Z with: 2024-08-20T22:08:24.8427049Z shell: bash 2024-08-20T22:08:24.8427352Z timeout_minutes: 5 2024-08-20T22:08:24.8427678Z max_attempts: 3 2024-08-20T22:08:24.8427997Z retry_wait_seconds: 30 2024-08-20T22:08:24.8431171Z command: AWS_ACCOUNT_ID=$(aws sts get-caller-identity|grep Account|cut -f4 -d\") aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \ --password-stdin "$AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com" # For LF Runners we need to make sure we also login to Meta's ECR docker registry too. META_AWS_ACCOUNT_ID=308535385114 if [ "$AWS_ACCOUNT_ID" != "$META_AWS_ACCOUNT_ID" ] ; then aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \ --password-stdin "$META_AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com" fi 2024-08-20T22:08:24.8434175Z polling_interval_seconds: 1 2024-08-20T22:08:24.8434541Z warning_on_retry: true 2024-08-20T22:08:24.8434900Z continue_on_error: false 2024-08-20T22:08:24.8435239Z env: 2024-08-20T22:08:24.8435522Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:24.8435952Z AWS_RETRY_MODE: standard 2024-08-20T22:08:24.8436308Z AWS_MAX_ATTEMPTS: 5 2024-08-20T22:08:24.8436650Z AWS_DEFAULT_REGION: us-east-1 2024-08-20T22:08:24.8437028Z ##[endgroup] 2024-08-20T22:08:26.1640898Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-08-20T22:08:26.1641981Z Configure a credential helper to remove this warning. See 2024-08-20T22:08:26.1643054Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-08-20T22:08:26.1643739Z 2024-08-20T22:08:26.1643901Z Login Succeeded 2024-08-20T22:08:26.8994241Z Command completed after 1 attempt(s). 2024-08-20T22:08:26.9054366Z ##[group]Run env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-08-20T22:08:26.9055086Z env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-08-20T22:08:26.9055733Z env | grep '^CI' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-08-20T22:08:26.9065530Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:08:26.9066014Z env: 2024-08-20T22:08:26.9066283Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:26.9066621Z ##[endgroup] 2024-08-20T22:08:26.9160855Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2024-08-20T22:08:26.9161618Z # ignore expansion of "docker ps -q" since it could be empty 2024-08-20T22:08:26.9162223Z # shellcheck disable=SC2046 2024-08-20T22:08:26.9162685Z docker stop $(docker ps -q) || true 2024-08-20T22:08:26.9163160Z # Prune all of the docker images 2024-08-20T22:08:26.9163615Z docker system prune -af 2024-08-20T22:08:26.9171935Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:08:26.9172432Z env: 2024-08-20T22:08:26.9172702Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:26.9173051Z ##[endgroup] 2024-08-20T22:08:26.9483002Z "docker stop" requires at least 1 argument. 2024-08-20T22:08:26.9483834Z See 'docker stop --help'. 2024-08-20T22:08:26.9484143Z 2024-08-20T22:08:26.9484438Z Usage: docker stop [OPTIONS] CONTAINER [CONTAINER...] 2024-08-20T22:08:26.9484915Z 2024-08-20T22:08:26.9486730Z Stop one or more running containers 2024-08-20T22:08:26.9662624Z Total reclaimed space: 0B 2024-08-20T22:08:26.9706823Z ##[group]Run set +e 2024-08-20T22:08:26.9707170Z set +e 2024-08-20T22:08:26.9707644Z set -x 2024-08-20T22:08:26.9707937Z  2024-08-20T22:08:26.9708244Z PT_DOMAIN=download.pytorch.org 2024-08-20T22:08:26.9709023Z # TODO: Flaky access to download.pytorch.org https://github.com/pytorch/pytorch/issues/100400, 2024-08-20T22:08:26.9710088Z # cleaning this up once the issue is fixed. There are more than one resolved IP here, the last 2024-08-20T22:08:26.9710826Z # one is returned at random 2024-08-20T22:08:26.9711363Z RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" | tail -n1) 2024-08-20T22:08:26.9711867Z  2024-08-20T22:08:26.9712177Z if [ -z "${RESOLVED_IP}" ]; then 2024-08-20T22:08:26.9712790Z  echo "Couldn't resolve ${PT_DOMAIN}, retrying with Google DNS..." 2024-08-20T22:08:26.9713728Z  RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" @8.8.8.8 | tail -n1) 2024-08-20T22:08:26.9714270Z  2024-08-20T22:08:26.9714584Z  if [ -z "${RESOLVED_IP}" ]; then 2024-08-20T22:08:26.9715137Z  echo "Couldn't resolve ${PT_DOMAIN}, exiting..." 2024-08-20T22:08:26.9715634Z  exit 1 2024-08-20T22:08:26.9716032Z  fi 2024-08-20T22:08:26.9716310Z fi 2024-08-20T22:08:26.9716579Z  2024-08-20T22:08:26.9716925Z if grep -r "${PT_DOMAIN}" /etc/hosts; then 2024-08-20T22:08:26.9717425Z  # Clean up any old records first 2024-08-20T22:08:26.9717918Z  sudo sed -i "/${PT_DOMAIN}/d" /etc/hosts 2024-08-20T22:08:26.9718363Z fi 2024-08-20T22:08:26.9718631Z  2024-08-20T22:08:26.9719049Z echo "${RESOLVED_IP} ${PT_DOMAIN}" | sudo tee -a /etc/hosts 2024-08-20T22:08:26.9719585Z cat /etc/hosts 2024-08-20T22:08:26.9728457Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:08:26.9728942Z env: 2024-08-20T22:08:26.9729217Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:26.9729553Z ##[endgroup] 2024-08-20T22:08:26.9759405Z + PT_DOMAIN=download.pytorch.org 2024-08-20T22:08:26.9766266Z ++ dig -4 +short download.pytorch.org 2024-08-20T22:08:26.9766736Z ++ tail -n1 2024-08-20T22:08:27.0056325Z + RESOLVED_IP=18.160.10.28 2024-08-20T22:08:27.0057145Z + '[' -z 18.160.10.28 ']' 2024-08-20T22:08:27.0057748Z + grep -r download.pytorch.org /etc/hosts 2024-08-20T22:08:27.0071569Z 108.138.64.97 download.pytorch.org 2024-08-20T22:08:27.0074116Z + sudo sed -i /download.pytorch.org/d /etc/hosts 2024-08-20T22:08:27.0962235Z + echo '18.160.10.28 download.pytorch.org' 2024-08-20T22:08:27.0963116Z + sudo tee -a /etc/hosts 2024-08-20T22:08:27.1289782Z 18.160.10.28 download.pytorch.org 2024-08-20T22:08:27.1311475Z + cat /etc/hosts 2024-08-20T22:08:27.1322991Z 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 2024-08-20T22:08:27.1335260Z ::1 localhost6 localhost6.localdomain6 2024-08-20T22:08:27.1336122Z 18.160.10.28 download.pytorch.org 2024-08-20T22:08:27.1494045Z ##[group]Run pytorch/test-infra/.github/actions/calculate-docker-image@main 2024-08-20T22:08:27.1494659Z with: 2024-08-20T22:08:27.1495783Z docker-image-name: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:27.1497025Z docker-build-dir: .ci/docker 2024-08-20T22:08:27.1497414Z working-directory: . 2024-08-20T22:08:27.1497886Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:27.1498414Z force-push: false 2024-08-20T22:08:27.1498722Z env: 2024-08-20T22:08:27.1499009Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:27.1499348Z ##[endgroup] 2024-08-20T22:08:27.1518331Z ##[group]Run set -ex 2024-08-20T22:08:27.1518689Z set -ex 2024-08-20T22:08:27.1518979Z  2024-08-20T22:08:27.1519539Z # If the docker build directory or the build script doesn't exist, the action will 2024-08-20T22:08:27.1520526Z # gracefully return the docker image name as it is. Pulling docker image in Linux 2024-08-20T22:08:27.1521506Z # job could then download the pre-built image as usual 2024-08-20T22:08:27.1522264Z if [[ ! -d "${DOCKER_BUILD_DIR}" ]] || [[ ! -f "${DOCKER_BUILD_DIR}/build.sh" ]]; then 2024-08-20T22:08:27.1522940Z  echo "skip=true" >> "${GITHUB_OUTPUT}" 2024-08-20T22:08:27.1523587Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2024-08-20T22:08:27.1524153Z  2024-08-20T22:08:27.1524677Z  echo "There is no Docker build script in ${REPO_NAME} repo, skipping..." 2024-08-20T22:08:27.1525318Z  exit 0 2024-08-20T22:08:27.1525626Z else 2024-08-20T22:08:27.1526021Z  echo "skip=false" >> "${GITHUB_OUTPUT}" 2024-08-20T22:08:27.1526509Z fi 2024-08-20T22:08:27.1526796Z  2024-08-20T22:08:27.1527278Z if [[ "${DOCKER_IMAGE_NAME}" == *"${DOCKER_REGISTRY}/${REPO_NAME}"* ]]; then 2024-08-20T22:08:27.1528121Z  # The docker image name already includes the ECR prefix and tag, so we can just 2024-08-20T22:08:27.1528920Z  # use it as it is, but first let's extract the tag 2024-08-20T22:08:27.1529624Z  DOCKER_TAG=$(echo "${DOCKER_IMAGE_NAME}" | awk -F '[:,]' '{print $2}') 2024-08-20T22:08:27.1530350Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-08-20T22:08:27.1531055Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2024-08-20T22:08:27.1531615Z else 2024-08-20T22:08:27.1532052Z  DOCKER_TAG=$(git rev-parse HEAD:"${DOCKER_BUILD_DIR}") 2024-08-20T22:08:27.1532725Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-08-20T22:08:27.1533629Z  echo "docker-image=${DOCKER_REGISTRY}/${REPO_NAME}/${DOCKER_IMAGE_NAME}:${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-08-20T22:08:27.1534384Z fi 2024-08-20T22:08:27.1543327Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:08:27.1543829Z env: 2024-08-20T22:08:27.1544117Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:27.1544471Z REPO_NAME: pytorch 2024-08-20T22:08:27.1545615Z DOCKER_IMAGE_NAME: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:27.1546877Z DOCKER_BUILD_DIR: .ci/docker 2024-08-20T22:08:27.1547389Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:27.1547897Z ##[endgroup] 2024-08-20T22:08:27.1577490Z + [[ ! -d .ci/docker ]] 2024-08-20T22:08:27.1577905Z + [[ ! -f .ci/docker/build.sh ]] 2024-08-20T22:08:27.1578273Z + echo skip=false 2024-08-20T22:08:27.1580290Z + [[ 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 == *\3\0\8\5\3\5\3\8\5\1\1\4\.\d\k\r\.\e\c\r\.\u\s\-\e\a\s\t\-\1\.\a\m\a\z\o\n\a\w\s\.\c\o\m\/\p\y\t\o\r\c\h* ]] 2024-08-20T22:08:27.1585737Z ++ echo 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:27.1587004Z ++ awk -F '[:,]' '{print $2}' 2024-08-20T22:08:27.1612191Z + DOCKER_TAG=f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:27.1612906Z + echo docker-tag=f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:27.1614370Z + echo docker-image=308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:27.1650606Z ##[group]Run set +e 2024-08-20T22:08:27.1651167Z set +e 2024-08-20T22:08:27.1651587Z set -x 2024-08-20T22:08:27.1652125Z  2024-08-20T22:08:27.1652459Z login() { 2024-08-20T22:08:27.1653260Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2024-08-20T22:08:27.1654129Z } 2024-08-20T22:08:27.1654527Z  2024-08-20T22:08:27.1655038Z retry () { 2024-08-20T22:08:27.1655581Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2024-08-20T22:08:27.1656196Z } 2024-08-20T22:08:27.1656530Z  2024-08-20T22:08:27.1657009Z retry login "${DOCKER_REGISTRY}" 2024-08-20T22:08:27.1657516Z  2024-08-20T22:08:27.1658165Z # Check if image already exists, if it does then skip building it 2024-08-20T22:08:27.1658996Z if docker manifest inspect "${DOCKER_IMAGE}"; then 2024-08-20T22:08:27.1659597Z  exit 0 2024-08-20T22:08:27.1659990Z fi 2024-08-20T22:08:27.1660766Z  2024-08-20T22:08:27.1661370Z # NB: This part requires a full checkout. Otherwise, the merge base will 2024-08-20T22:08:27.1662300Z # be empty. The default action would be to continue rebuild the image 2024-08-20T22:08:27.1663231Z if [[ "$BASE_REVISION" = "$(git rev-parse HEAD)" ]]; then 2024-08-20T22:08:27.1664008Z  # if we're on the base branch then use the parent commit 2024-08-20T22:08:27.1664694Z  MERGE_BASE=$(git rev-parse HEAD~) 2024-08-20T22:08:27.1665273Z else 2024-08-20T22:08:27.1665922Z  # otherwise we're on a PR, so use the most recent base commit 2024-08-20T22:08:27.1666796Z  MERGE_BASE=$(git merge-base HEAD "$BASE_REVISION") 2024-08-20T22:08:27.1667409Z fi 2024-08-20T22:08:27.1667783Z  2024-08-20T22:08:27.1668214Z if [[ -z "${MERGE_BASE}" ]]; then 2024-08-20T22:08:27.1668866Z  echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2024-08-20T22:08:27.1669384Z  2024-08-20T22:08:27.1670165Z  echo "Finding merge base only works with full checkout, please set fetch-depth to 0, continuing ..." 2024-08-20T22:08:27.1671080Z  exit 0 2024-08-20T22:08:27.1671501Z fi 2024-08-20T22:08:27.1671835Z  2024-08-20T22:08:27.1672429Z if ! git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}"; then 2024-08-20T22:08:27.1673592Z  echo "Directory '${DOCKER_BUILD_DIR}' not found in commit $MERGE_BASE, you should rebase onto a more recent commit" 2024-08-20T22:08:27.1674544Z  exit 1 2024-08-20T22:08:27.1674901Z fi 2024-08-20T22:08:27.1675293Z  2024-08-20T22:08:27.1676012Z PREVIOUS_DOCKER_TAG=$(git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}") 2024-08-20T22:08:27.1677085Z # If no image exists but the hash is the same as the previous hash then we should error out here 2024-08-20T22:08:27.1678048Z if [[ "${PREVIOUS_DOCKER_TAG}" == "${DOCKER_TAG}" ]]; then 2024-08-20T22:08:27.1679131Z  echo "WARNING: Something has gone wrong and the previous image isn't available for the merge-base of your branch" 2024-08-20T22:08:27.1680357Z  echo " Will re-build docker image to store in local cache, TTS may be longer" 2024-08-20T22:08:27.1681316Z fi 2024-08-20T22:08:27.1681792Z  2024-08-20T22:08:27.1682282Z echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2024-08-20T22:08:27.1691636Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:08:27.1692225Z env: 2024-08-20T22:08:27.1692589Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:27.1693085Z DOCKER_BUILD_DIR: .ci/docker 2024-08-20T22:08:27.1693646Z BASE_REVISION: 40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:08:27.1695044Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:27.1696512Z DOCKER_TAG: f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:27.1697176Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:27.1697808Z ##[endgroup] 2024-08-20T22:08:27.1728520Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:27.1729352Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:27.1731746Z + aws ecr get-login-password --region us-east-1 2024-08-20T22:08:27.1733083Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:27.7200355Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-08-20T22:08:27.7201488Z Configure a credential helper to remove this warning. See 2024-08-20T22:08:27.7202658Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-08-20T22:08:27.7203221Z 2024-08-20T22:08:27.7203420Z Login Succeeded 2024-08-20T22:08:27.7226023Z + docker manifest inspect 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:27.9211171Z { 2024-08-20T22:08:27.9211718Z "schemaVersion": 2, 2024-08-20T22:08:27.9212735Z "mediaType": "application/vnd.docker.distribution.manifest.v2+json", 2024-08-20T22:08:27.9214180Z "config": { 2024-08-20T22:08:27.9214842Z "mediaType": "application/vnd.docker.container.image.v1+json", 2024-08-20T22:08:27.9216213Z "size": 48711, 2024-08-20T22:08:27.9217218Z "digest": "sha256:8fef7805cec6e829013a3d62f158b75bdc2f02cdfe3428c032ea017b488473bb" 2024-08-20T22:08:27.9218540Z }, 2024-08-20T22:08:27.9218992Z "layers": [ 2024-08-20T22:08:27.9219825Z { 2024-08-20T22:08:27.9220416Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9221662Z "size": 28580681, 2024-08-20T22:08:27.9222406Z "digest": "sha256:7a2c559011895d255fce249c00396abff5ae7e0c0a92931d0ed493e71de78e3a" 2024-08-20T22:08:27.9223162Z }, 2024-08-20T22:08:27.9223519Z { 2024-08-20T22:08:27.9224651Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9225287Z "size": 7943451, 2024-08-20T22:08:27.9226273Z "digest": "sha256:224fe954d7252f10539d243d6c9688806f7d13ad775ed02e7f7c79077844510d" 2024-08-20T22:08:27.9227703Z }, 2024-08-20T22:08:27.9228105Z { 2024-08-20T22:08:27.9229605Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9233390Z "size": 55728572, 2024-08-20T22:08:27.9234659Z "digest": "sha256:75722010b82e31715876aeeed0b2cee414296f0124fdfa061ab845ba2a158450" 2024-08-20T22:08:27.9236006Z }, 2024-08-20T22:08:27.9236467Z { 2024-08-20T22:08:27.9237758Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9239400Z "size": 186, 2024-08-20T22:08:27.9240065Z "digest": "sha256:d527cbbb87e3016fd72a18a9b468c945ad0ca27c5770b39debd6ed704db3a195" 2024-08-20T22:08:27.9241521Z }, 2024-08-20T22:08:27.9244914Z { 2024-08-20T22:08:27.9245743Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9246693Z "size": 6886, 2024-08-20T22:08:27.9247418Z "digest": "sha256:b57676e46aee1a8c82e528d78e5a13e31142524eea31c8b213d69ddcb6f1fe80" 2024-08-20T22:08:27.9248215Z }, 2024-08-20T22:08:27.9256065Z { 2024-08-20T22:08:27.9256715Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9257379Z "size": 1329001756, 2024-08-20T22:08:27.9258169Z "digest": "sha256:a8c1e85b5e14cec7af70bf304cb4d4cee6a1d25eb8215b2cf4fdc33e5af5e108" 2024-08-20T22:08:27.9258917Z }, 2024-08-20T22:08:27.9259217Z { 2024-08-20T22:08:27.9259816Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9260741Z "size": 62501, 2024-08-20T22:08:27.9261296Z + exit 0 2024-08-20T22:08:27.9261955Z "digest": "sha256:a41a8d1c11c8d80fe4e82b0d05478f8d51176ff20b8350905fc1b25c93a51198" 2024-08-20T22:08:27.9262655Z }, 2024-08-20T22:08:27.9263052Z { 2024-08-20T22:08:27.9263584Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9264231Z "size": 1684, 2024-08-20T22:08:27.9264881Z "digest": "sha256:0c12278907551c2962927d27c115f6f7bf0df894318b8aea6ece3ef01ccd0a8a" 2024-08-20T22:08:27.9265641Z }, 2024-08-20T22:08:27.9265955Z { 2024-08-20T22:08:27.9266499Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9267384Z "size": 1523, 2024-08-20T22:08:27.9268053Z "digest": "sha256:d8d1234baab3ec9ccb8bb710fc6b8ff6c10896ba2e8d27a347583eca770f9ff1" 2024-08-20T22:08:27.9268738Z }, 2024-08-20T22:08:27.9269130Z { 2024-08-20T22:08:27.9269696Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9270394Z "size": 2528295403, 2024-08-20T22:08:27.9271017Z "digest": "sha256:7ed32bc8e4696fcdb2feef850781160597b2275ad756819c4add88236b0577d5" 2024-08-20T22:08:27.9271750Z }, 2024-08-20T22:08:27.9272143Z { 2024-08-20T22:08:27.9272628Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9273293Z "size": 86016, 2024-08-20T22:08:27.9273988Z "digest": "sha256:ec1e7978c1fe161ced1d98092a51e7c5953ca5fda5577f54df9dbda4afff1b2b" 2024-08-20T22:08:27.9274715Z }, 2024-08-20T22:08:27.9275011Z { 2024-08-20T22:08:27.9275593Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9276366Z "size": 1822, 2024-08-20T22:08:27.9277036Z "digest": "sha256:ac23c5fcc1ef310e9cd0d138b180281188e20a3e28c51cd14751622e3c7d92ea" 2024-08-20T22:08:27.9277765Z }, 2024-08-20T22:08:27.9278122Z { 2024-08-20T22:08:27.9278652Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9279311Z "size": 246761563, 2024-08-20T22:08:27.9280006Z "digest": "sha256:ca426ffc9d2bd051ad1ff5c4f02fd5d9be161e70953cc37882c815080c708f4d" 2024-08-20T22:08:27.9280719Z }, 2024-08-20T22:08:27.9281143Z { 2024-08-20T22:08:27.9281624Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9282273Z "size": 544, 2024-08-20T22:08:27.9282961Z "digest": "sha256:4373aa743caf6660c671295b837048c8350a2165f2336dc3b7b6c96462579e50" 2024-08-20T22:08:27.9283682Z }, 2024-08-20T22:08:27.9283989Z { 2024-08-20T22:08:27.9284591Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9285237Z "size": 1258, 2024-08-20T22:08:27.9285899Z "digest": "sha256:75b2abb16c685854c017d0cf75c626526c956734c656d9e78fdd4520317e9b3c" 2024-08-20T22:08:27.9286607Z }, 2024-08-20T22:08:27.9286948Z { 2024-08-20T22:08:27.9287494Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9288145Z "size": 484, 2024-08-20T22:08:27.9288762Z "digest": "sha256:ef1e3ef1e85f0124270b8506721219150e230184181f8207d64463bf5c67e656" 2024-08-20T22:08:27.9289477Z }, 2024-08-20T22:08:27.9289860Z { 2024-08-20T22:08:27.9290375Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9291039Z "size": 91711766, 2024-08-20T22:08:27.9291720Z "digest": "sha256:0bf61114d37b2d09065aa6852b1e78a32580a1ff011dd5d23f03b0f5c4e710af" 2024-08-20T22:08:27.9292434Z }, 2024-08-20T22:08:27.9292732Z { 2024-08-20T22:08:27.9293299Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9294297Z "size": 3390, 2024-08-20T22:08:27.9294905Z "digest": "sha256:2df849f72ba4258df10c9c45ace21a66d93b73196e78e96f12c13098822f60e2" 2024-08-20T22:08:27.9295679Z }, 2024-08-20T22:08:27.9296035Z { 2024-08-20T22:08:27.9296651Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9297299Z "size": 1909, 2024-08-20T22:08:27.9297941Z "digest": "sha256:34c47d63c5de27418739aa048b4dd781c3006d65691e9b903c95304d0509d89c" 2024-08-20T22:08:27.9298681Z }, 2024-08-20T22:08:27.9299044Z { 2024-08-20T22:08:27.9299528Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9300220Z "size": 701, 2024-08-20T22:08:27.9300869Z "digest": "sha256:1fef4bd19792cbf9d3aea12795089ad41164bb6d607c339b7484e1899825b1d2" 2024-08-20T22:08:27.9301572Z }, 2024-08-20T22:08:27.9301922Z { 2024-08-20T22:08:27.9302455Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9303094Z "size": 2864254879, 2024-08-20T22:08:27.9303786Z "digest": "sha256:6efb96fc87ea1bca54876d85331e5585e28f325a1d60ee1aef7811eabb74f933" 2024-08-20T22:08:27.9304633Z }, 2024-08-20T22:08:27.9304964Z { 2024-08-20T22:08:27.9305555Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9306156Z "size": 380, 2024-08-20T22:08:27.9306828Z "digest": "sha256:b119c4fc6c58d9e72744201ff4850b34184a94eb3566031b7d36e87ecce950a6" 2024-08-20T22:08:27.9307593Z }, 2024-08-20T22:08:27.9307925Z { 2024-08-20T22:08:27.9308428Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9309114Z "size": 12900, 2024-08-20T22:08:27.9309754Z "digest": "sha256:33b639226eeefa41d7bb26a8ecc20d271ceef45571dabfd80aaee3634926381b" 2024-08-20T22:08:27.9310499Z }, 2024-08-20T22:08:27.9310915Z { 2024-08-20T22:08:27.9311396Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9312056Z "size": 803, 2024-08-20T22:08:27.9312726Z "digest": "sha256:d3547bd43146930aa830d54562c98aa678e355cf5f84527e9717eb72fffe8ca3" 2024-08-20T22:08:27.9313458Z }, 2024-08-20T22:08:27.9313760Z { 2024-08-20T22:08:27.9314327Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9314986Z "size": 106, 2024-08-20T22:08:27.9315657Z "digest": "sha256:5645520256fa6d7f2270608eaed53849a131d03fbf4c5d4472c9cfde1a439e47" 2024-08-20T22:08:27.9316469Z }, 2024-08-20T22:08:27.9316824Z { 2024-08-20T22:08:27.9317444Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9318112Z "size": 503, 2024-08-20T22:08:27.9318692Z "digest": "sha256:829ed7d91e3818d0e11834c71551117c7aeec0a51d798e93d641faa0c02582cb" 2024-08-20T22:08:27.9319440Z }, 2024-08-20T22:08:27.9319804Z { 2024-08-20T22:08:27.9320281Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9320968Z "size": 121477267, 2024-08-20T22:08:27.9321629Z "digest": "sha256:385d0421d67c533d628985c453a186028a61f6ad4209ae519ec3d4ecea661d3e" 2024-08-20T22:08:27.9322320Z }, 2024-08-20T22:08:27.9322665Z { 2024-08-20T22:08:27.9323209Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9323841Z "size": 109, 2024-08-20T22:08:27.9324566Z "digest": "sha256:7cbfce999d76851e07dd71056a6d852629d789ccfd46be44cc405b451fb8bb58" 2024-08-20T22:08:27.9325227Z }, 2024-08-20T22:08:27.9325561Z { 2024-08-20T22:08:27.9326145Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9326744Z "size": 490, 2024-08-20T22:08:27.9327356Z "digest": "sha256:6658e558ebe496f0d628947534b0ea1e44808f84f2dfd8a9a704e8aa5329d791" 2024-08-20T22:08:27.9328116Z }, 2024-08-20T22:08:27.9328448Z { 2024-08-20T22:08:27.9328930Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9329632Z "size": 297, 2024-08-20T22:08:27.9330247Z "digest": "sha256:33444a5a7e01a3010fd1cc16b32a66892a08600d7f700747d23faf3c36624f3a" 2024-08-20T22:08:27.9331093Z }, 2024-08-20T22:08:27.9331449Z { 2024-08-20T22:08:27.9331974Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9332636Z "size": 103, 2024-08-20T22:08:27.9333315Z "digest": "sha256:7c47122f4e09b47e891b4ae9e499a35a4eb46faacae87d0e946615adda6e0706" 2024-08-20T22:08:27.9333992Z }, 2024-08-20T22:08:27.9334347Z { 2024-08-20T22:08:27.9334920Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9335523Z "size": 1473, 2024-08-20T22:08:27.9336185Z "digest": "sha256:1811ff4d3556ac255604f346d879528aff2aadd7652c2d39baf4fe6eaa60aec3" 2024-08-20T22:08:27.9336943Z }, 2024-08-20T22:08:27.9337322Z { 2024-08-20T22:08:27.9337803Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9338527Z "size": 594729516, 2024-08-20T22:08:27.9339181Z "digest": "sha256:7754ee068b33f760d9c320c26a1a3935247ace0c8c463a976105c1586a43fb1c" 2024-08-20T22:08:27.9339921Z }, 2024-08-20T22:08:27.9340228Z { 2024-08-20T22:08:27.9340771Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9341560Z "size": 164, 2024-08-20T22:08:27.9342164Z "digest": "sha256:0479fbac3361713c075bf788e778117917dcacdd1ff71ed79a789dd2016a1714" 2024-08-20T22:08:27.9342865Z }, 2024-08-20T22:08:27.9343246Z { 2024-08-20T22:08:27.9343813Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9344406Z "size": 564, 2024-08-20T22:08:27.9345065Z "digest": "sha256:f1d6874dee9c34d154278d2b6935d04447f07fa89d25d4a09398234040d8a7e8" 2024-08-20T22:08:27.9345783Z }, 2024-08-20T22:08:27.9346116Z { 2024-08-20T22:08:27.9346658Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9347293Z "size": 35874203, 2024-08-20T22:08:27.9347941Z "digest": "sha256:afc429e87b593a64f3e0a1be51e09e966ea1aa71e6e8a0bec4edc9f2f7bc1c05" 2024-08-20T22:08:27.9348795Z }, 2024-08-20T22:08:27.9349093Z { 2024-08-20T22:08:27.9349633Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9350325Z "size": 104, 2024-08-20T22:08:27.9350927Z "digest": "sha256:019620471c2592cd22437fe8ed1a94c784114cf7445c5c2ab36dd0bae727fc66" 2024-08-20T22:08:27.9351635Z }, 2024-08-20T22:08:27.9352037Z { 2024-08-20T22:08:27.9352557Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9353177Z "size": 425, 2024-08-20T22:08:27.9353877Z "digest": "sha256:27aeb1b2cd5e28d8f0e54fc1090baf88abc29ebf5fce088b493fcae99c9550d1" 2024-08-20T22:08:27.9354595Z }, 2024-08-20T22:08:27.9354961Z { 2024-08-20T22:08:27.9355501Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9356301Z "size": 20262183, 2024-08-20T22:08:27.9356945Z "digest": "sha256:829c0e19f4b7797e9120a86172fabfd710f9b3971ffd714a616931a3fadc7192" 2024-08-20T22:08:27.9357743Z }, 2024-08-20T22:08:27.9358067Z { 2024-08-20T22:08:27.9358593Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9359280Z "size": 438, 2024-08-20T22:08:27.9359901Z "digest": "sha256:560cd6122a3868e7e82e75eb103d182edf6512114d61ccdfae099af00cb16b4c" 2024-08-20T22:08:27.9360863Z }, 2024-08-20T22:08:27.9361274Z { 2024-08-20T22:08:27.9361823Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9362424Z "size": 701, 2024-08-20T22:08:27.9363134Z "digest": "sha256:1fef4bd19792cbf9d3aea12795089ad41164bb6d607c339b7484e1899825b1d2" 2024-08-20T22:08:27.9363836Z }, 2024-08-20T22:08:27.9364218Z { 2024-08-20T22:08:27.9364749Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9365389Z "size": 141, 2024-08-20T22:08:27.9366085Z "digest": "sha256:5a4eb19d72198a01f3babd4711c40fcf7c6e5cb9d5cfedc507b0061408d47097" 2024-08-20T22:08:27.9366795Z }, 2024-08-20T22:08:27.9367129Z { 2024-08-20T22:08:27.9367688Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9368511Z "size": 135, 2024-08-20T22:08:27.9369108Z "digest": "sha256:da6a838a66c72b5de9a5590c233779880ea901c1264940a1c618825d2501ffd1" 2024-08-20T22:08:27.9369882Z }, 2024-08-20T22:08:27.9370211Z { 2024-08-20T22:08:27.9370722Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9371428Z "size": 4838068375, 2024-08-20T22:08:27.9372076Z "digest": "sha256:cbb79a7053537bed2d80b77198ea552b985563b11d3f8616593c6ab575a3a090" 2024-08-20T22:08:27.9372796Z }, 2024-08-20T22:08:27.9373146Z { 2024-08-20T22:08:27.9373677Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9374328Z "size": 194, 2024-08-20T22:08:27.9375000Z "digest": "sha256:4d4fa6802ab3e6b36d8d4adb650046e9370c4a16a19876970559ef8a312ca855" 2024-08-20T22:08:27.9375663Z }, 2024-08-20T22:08:27.9376020Z { 2024-08-20T22:08:27.9376583Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9377221Z "size": 564, 2024-08-20T22:08:27.9377836Z "digest": "sha256:0f085d4fa279366fcd52d303b7ad8abddc5962a8872174b8109f3f5d5ca5f2cf" 2024-08-20T22:08:27.9378765Z }, 2024-08-20T22:08:27.9379118Z { 2024-08-20T22:08:27.9379635Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9380303Z "size": 43162921, 2024-08-20T22:08:27.9380966Z "digest": "sha256:4a0412373305517489d891a4749e6d2b80b4aeb7df3b8adca0ed0abb2f3e5300" 2024-08-20T22:08:27.9381657Z }, 2024-08-20T22:08:27.9382002Z { 2024-08-20T22:08:27.9382541Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9383175Z "size": 106, 2024-08-20T22:08:27.9383857Z "digest": "sha256:302c8c1779444e54919f83e91c6d5e1fdea653fc899be802b3a2a34d34d99d5d" 2024-08-20T22:08:27.9384519Z }, 2024-08-20T22:08:27.9384887Z { 2024-08-20T22:08:27.9385470Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9386102Z "size": 1380, 2024-08-20T22:08:27.9386742Z "digest": "sha256:02970347dff622ee45629bc28788716d00528464f71f88ec7b74ae5f44a486e2" 2024-08-20T22:08:27.9387498Z }, 2024-08-20T22:08:27.9387843Z { 2024-08-20T22:08:27.9388321Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9389031Z "size": 701, 2024-08-20T22:08:27.9389660Z "digest": "sha256:1fef4bd19792cbf9d3aea12795089ad41164bb6d607c339b7484e1899825b1d2" 2024-08-20T22:08:27.9390435Z }, 2024-08-20T22:08:27.9390741Z { 2024-08-20T22:08:27.9391295Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9392003Z "size": 139, 2024-08-20T22:08:27.9392616Z "digest": "sha256:916c5e8580164926a3aec87e88a5d1c2d02756e49fdeed4198e1e6304efa2fd3" 2024-08-20T22:08:27.9393271Z }, 2024-08-20T22:08:27.9393684Z { 2024-08-20T22:08:27.9394198Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9394857Z "size": 118, 2024-08-20T22:08:27.9395487Z "digest": "sha256:c42b3602a1fb4df5111224650f15adffb025979ae9c614807379ea84e189533b" 2024-08-20T22:08:27.9396255Z }, 2024-08-20T22:08:27.9396614Z { 2024-08-20T22:08:27.9397162Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9397799Z "size": 4324672728, 2024-08-20T22:08:27.9398520Z "digest": "sha256:11fad972ef6cb9d2dc236504b0ee5b6e5ea996e4576ece0ed3262fbb9ee2de60" 2024-08-20T22:08:27.9399282Z }, 2024-08-20T22:08:27.9399581Z { 2024-08-20T22:08:27.9400126Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9400821Z "size": 174, 2024-08-20T22:08:27.9401455Z "digest": "sha256:f957c16244819132b478272aaf24231699c4fcbd495c229a574f94daab8d6b86" 2024-08-20T22:08:27.9402102Z }, 2024-08-20T22:08:27.9402511Z { 2024-08-20T22:08:27.9403058Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9403660Z "size": 907, 2024-08-20T22:08:27.9404351Z "digest": "sha256:768c31dca016b80bbdc973c8ee818034bdbd17b7ea9bdadbf0ec45ea51005720" 2024-08-20T22:08:27.9405233Z }, 2024-08-20T22:08:27.9405570Z { 2024-08-20T22:08:27.9406102Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9406771Z "size": 701, 2024-08-20T22:08:27.9407404Z "digest": "sha256:1fef4bd19792cbf9d3aea12795089ad41164bb6d607c339b7484e1899825b1d2" 2024-08-20T22:08:27.9408189Z }, 2024-08-20T22:08:27.9408493Z { 2024-08-20T22:08:27.9409015Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9409714Z "size": 134, 2024-08-20T22:08:27.9410335Z "digest": "sha256:8c32d0ecebbe2054c96a3a5c1f3d6c8b87c2e826686b369e5242cd55d0f01c2d" 2024-08-20T22:08:27.9410992Z }, 2024-08-20T22:08:27.9411427Z { 2024-08-20T22:08:27.9411937Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9412530Z "size": 32, 2024-08-20T22:08:27.9413216Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-20T22:08:27.9413916Z }, 2024-08-20T22:08:27.9414325Z { 2024-08-20T22:08:27.9414803Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9415528Z "size": 158, 2024-08-20T22:08:27.9416281Z "digest": "sha256:78ee77eddef23f20afc78e2924f4467041cadb754634ee3df431c68211cf676d" 2024-08-20T22:08:27.9416978Z }, 2024-08-20T22:08:27.9417298Z { 2024-08-20T22:08:27.9417871Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9418544Z "size": 1841, 2024-08-20T22:08:27.9419147Z "digest": "sha256:37513e9b43d7123e7ddee09100f62a72b57af7b3833eaecd515e247e2f63e13f" 2024-08-20T22:08:27.9419906Z }, 2024-08-20T22:08:27.9420246Z { 2024-08-20T22:08:27.9420782Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9421440Z "size": 7529776, 2024-08-20T22:08:27.9422074Z "digest": "sha256:a7a5392e2bf6b73d9be292cc22a99ad4637636c15733beb7afbe6403b5ba21a8" 2024-08-20T22:08:27.9422802Z }, 2024-08-20T22:08:27.9423185Z { 2024-08-20T22:08:27.9423691Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9424329Z "size": 163, 2024-08-20T22:08:27.9425040Z "digest": "sha256:b10de02255c021b2366b85bf12ddf593aac89f88964201c455b71a145bc5ca2e" 2024-08-20T22:08:27.9425752Z }, 2024-08-20T22:08:27.9426050Z { 2024-08-20T22:08:27.9426667Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9427325Z "size": 7943, 2024-08-20T22:08:27.9427913Z "digest": "sha256:e56eeff2db93ffe5002a2bb764795b7333321c6802cc28bef0801a619fe6a07e" 2024-08-20T22:08:27.9428667Z }, 2024-08-20T22:08:27.9429019Z { 2024-08-20T22:08:27.9429530Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9430192Z "size": 8068, 2024-08-20T22:08:27.9430819Z "digest": "sha256:70ac3e38d0fd1f0f46ad710c3fc485fd01406606054e8cf84a63af1570bc9f3a" 2024-08-20T22:08:27.9431523Z }, 2024-08-20T22:08:27.9431966Z { 2024-08-20T22:08:27.9432451Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9433088Z "size": 302, 2024-08-20T22:08:27.9433776Z "digest": "sha256:eb09cbf3e4168749cc8605e3188ed35070f6037d13930e443c38d8941734488f" 2024-08-20T22:08:27.9434476Z }, 2024-08-20T22:08:27.9434767Z { 2024-08-20T22:08:27.9435351Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9436071Z "size": 7629638, 2024-08-20T22:08:27.9436680Z "digest": "sha256:ee1273153675e6543b58f5be50321abee5e91f7351701d5d501a6837eaf676ef" 2024-08-20T22:08:27.9437427Z }, 2024-08-20T22:08:27.9437761Z { 2024-08-20T22:08:27.9438378Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9438972Z "size": 108, 2024-08-20T22:08:27.9439598Z "digest": "sha256:e22979f9e0eedfa16f98eb4fa26f30a50c237f5ffd2f6e5b898f2b908058496d" 2024-08-20T22:08:27.9440386Z }, 2024-08-20T22:08:27.9440724Z { 2024-08-20T22:08:27.9441204Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9442036Z "size": 54145661, 2024-08-20T22:08:27.9442701Z "digest": "sha256:6c1f0aabce7c84f9b0b9ab3b96325778dba1c1465b7463c5b4c6be1cf52b74db" 2024-08-20T22:08:27.9443403Z }, 2024-08-20T22:08:27.9443788Z { 2024-08-20T22:08:27.9444302Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9444994Z "size": 473, 2024-08-20T22:08:27.9445631Z "digest": "sha256:7ebe49c3a23e71b289ce012b48dad35791a2f2aa7fcee2326a64d763b0d14df8" 2024-08-20T22:08:27.9446408Z }, 2024-08-20T22:08:27.9446735Z { 2024-08-20T22:08:27.9447287Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9447905Z "size": 1374858766, 2024-08-20T22:08:27.9448542Z "digest": "sha256:5d115b29b5d53e5418762bc41ae975dd245bcffc3d058b8902c58146d505cb37" 2024-08-20T22:08:27.9449286Z }, 2024-08-20T22:08:27.9449601Z { 2024-08-20T22:08:27.9450125Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9450805Z "size": 106, 2024-08-20T22:08:27.9451461Z "digest": "sha256:7f2d7a04fbe65bbe1e895138e0cfeeef53ad926c890bab8e7e132ad1e655e48f" 2024-08-20T22:08:27.9452258Z }, 2024-08-20T22:08:27.9452659Z { 2024-08-20T22:08:27.9453165Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9453793Z "size": 559, 2024-08-20T22:08:27.9454441Z "digest": "sha256:d79fd7d526989e554455eda7d459f2c88444030f61710101e52ec8c7a49b7b79" 2024-08-20T22:08:27.9455124Z }, 2024-08-20T22:08:27.9455477Z { 2024-08-20T22:08:27.9456039Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9456682Z "size": 46248488, 2024-08-20T22:08:27.9457330Z "digest": "sha256:9752d6fbbcab4e7403f26777c5b65911320de6389c81b833a47ba45c4f3354b4" 2024-08-20T22:08:27.9458072Z }, 2024-08-20T22:08:27.9458423Z { 2024-08-20T22:08:27.9458950Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9459626Z "size": 111, 2024-08-20T22:08:27.9460529Z "digest": "sha256:83808b2eff4d71ed46db7c29f66fe918f328405c25b314225dfad01b4868d1f4" 2024-08-20T22:08:27.9461215Z }, 2024-08-20T22:08:27.9461698Z { 2024-08-20T22:08:27.9462235Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9462914Z "size": 32, 2024-08-20T22:08:27.9463494Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-20T22:08:27.9464214Z }, 2024-08-20T22:08:27.9464598Z { 2024-08-20T22:08:27.9465188Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9465787Z "size": 32, 2024-08-20T22:08:27.9466480Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-20T22:08:27.9467205Z }, 2024-08-20T22:08:27.9467495Z { 2024-08-20T22:08:27.9468061Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9468706Z "size": 32, 2024-08-20T22:08:27.9469323Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-20T22:08:27.9470028Z }, 2024-08-20T22:08:27.9470386Z { 2024-08-20T22:08:27.9470899Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:27.9471603Z "size": 32, 2024-08-20T22:08:27.9472239Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-20T22:08:27.9472937Z } 2024-08-20T22:08:27.9473339Z ] 2024-08-20T22:08:27.9473632Z } 2024-08-20T22:08:27.9776219Z ##[group]Run tag=${ECR_DOCKER_IMAGE##*/} 2024-08-20T22:08:27.9776707Z tag=${ECR_DOCKER_IMAGE##*/} 2024-08-20T22:08:27.9777243Z echo "docker pull ghcr.io/pytorch/ci-image:${tag/:/-}" 2024-08-20T22:08:27.9786664Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:08:27.9787151Z env: 2024-08-20T22:08:27.9787423Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:27.9788570Z ECR_DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:27.9789730Z ##[endgroup] 2024-08-20T22:08:27.9822950Z docker pull ghcr.io/pytorch/ci-image:pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks-f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:27.9880953Z ##[group]Run pytorch/test-infra/.github/actions/pull-docker-image@main 2024-08-20T22:08:27.9881544Z with: 2024-08-20T22:08:27.9882620Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:27.9883940Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:27.9884601Z env: 2024-08-20T22:08:27.9884970Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:27.9885357Z ##[endgroup] 2024-08-20T22:08:27.9904636Z ##[group]Run set -x 2024-08-20T22:08:27.9904985Z set -x 2024-08-20T22:08:27.9905289Z set +e 2024-08-20T22:08:27.9905579Z  2024-08-20T22:08:27.9905846Z login() { 2024-08-20T22:08:27.9906511Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2024-08-20T22:08:27.9907586Z } 2024-08-20T22:08:27.9907956Z  2024-08-20T22:08:27.9908355Z retry () { 2024-08-20T22:08:27.9908773Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2024-08-20T22:08:27.9909209Z } 2024-08-20T22:08:27.9909484Z  2024-08-20T22:08:27.9909793Z retry login "${DOCKER_REGISTRY}" 2024-08-20T22:08:27.9910196Z  2024-08-20T22:08:27.9910459Z set -e 2024-08-20T22:08:27.9910921Z # ignore output since only exit code is used for conditional 2024-08-20T22:08:27.9911617Z # only pull docker image if it's not available locally 2024-08-20T22:08:27.9912375Z if ! docker inspect --type=image "${DOCKER_IMAGE}" >/dev/null 2>/dev/null; then 2024-08-20T22:08:27.9913065Z  retry docker pull "${DOCKER_IMAGE}" 2024-08-20T22:08:27.9913497Z fi 2024-08-20T22:08:27.9923071Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:08:27.9923564Z env: 2024-08-20T22:08:27.9923832Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:27.9924987Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:27.9926287Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:27.9926787Z ##[endgroup] 2024-08-20T22:08:27.9955572Z + set +e 2024-08-20T22:08:27.9956200Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:27.9956851Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:27.9959198Z + aws ecr get-login-password --region us-east-1 2024-08-20T22:08:27.9961016Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:28.5339851Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-08-20T22:08:28.5341567Z Configure a credential helper to remove this warning. See 2024-08-20T22:08:28.5343272Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-08-20T22:08:28.5344310Z 2024-08-20T22:08:28.5344558Z Login Succeeded 2024-08-20T22:08:28.5362785Z + set -e 2024-08-20T22:08:28.5364100Z + docker inspect --type=image 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:28.5524546Z + retry docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:28.5526710Z + docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:28.8006017Z f6d216893d65c7b8ae43df4daaf247db808378e9: Pulling from pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks 2024-08-20T22:08:28.8009755Z 7a2c55901189: Pulling fs layer 2024-08-20T22:08:28.8010384Z 224fe954d725: Pulling fs layer 2024-08-20T22:08:28.8011311Z 75722010b82e: Pulling fs layer 2024-08-20T22:08:28.8011860Z d527cbbb87e3: Pulling fs layer 2024-08-20T22:08:28.8012373Z b57676e46aee: Pulling fs layer 2024-08-20T22:08:28.8012800Z a8c1e85b5e14: Pulling fs layer 2024-08-20T22:08:28.8013299Z a41a8d1c11c8: Pulling fs layer 2024-08-20T22:08:28.8013801Z 0c1227890755: Pulling fs layer 2024-08-20T22:08:28.8014293Z d8d1234baab3: Pulling fs layer 2024-08-20T22:08:28.8014810Z 7ed32bc8e469: Pulling fs layer 2024-08-20T22:08:28.8015265Z d527cbbb87e3: Waiting 2024-08-20T22:08:28.8015697Z ec1e7978c1fe: Pulling fs layer 2024-08-20T22:08:28.8016178Z ac23c5fcc1ef: Pulling fs layer 2024-08-20T22:08:28.8016578Z a8c1e85b5e14: Waiting 2024-08-20T22:08:28.8017033Z ca426ffc9d2b: Pulling fs layer 2024-08-20T22:08:28.8017405Z 4373aa743caf: Pulling fs layer 2024-08-20T22:08:28.8017858Z b57676e46aee: Waiting 2024-08-20T22:08:28.8018285Z 75b2abb16c68: Pulling fs layer 2024-08-20T22:08:28.8019009Z ef1e3ef1e85f: Pulling fs layer 2024-08-20T22:08:28.8019504Z 0bf61114d37b: Pulling fs layer 2024-08-20T22:08:28.8019962Z 2df849f72ba4: Pulling fs layer 2024-08-20T22:08:28.8020325Z 34c47d63c5de: Pulling fs layer 2024-08-20T22:08:28.8020677Z a41a8d1c11c8: Waiting 2024-08-20T22:08:28.8020985Z 0c1227890755: Waiting 2024-08-20T22:08:28.8021307Z 1fef4bd19792: Pulling fs layer 2024-08-20T22:08:28.8021669Z 6efb96fc87ea: Pulling fs layer 2024-08-20T22:08:28.8022036Z b119c4fc6c58: Pulling fs layer 2024-08-20T22:08:28.8022385Z d8d1234baab3: Waiting 2024-08-20T22:08:28.8022694Z ec1e7978c1fe: Waiting 2024-08-20T22:08:28.8023009Z 33b639226eee: Pulling fs layer 2024-08-20T22:08:28.8023363Z ac23c5fcc1ef: Waiting 2024-08-20T22:08:28.8023688Z d3547bd43146: Pulling fs layer 2024-08-20T22:08:28.8024138Z 5645520256fa: Pulling fs layer 2024-08-20T22:08:28.8024603Z ca426ffc9d2b: Waiting 2024-08-20T22:08:28.8025023Z 829ed7d91e38: Pulling fs layer 2024-08-20T22:08:28.8025488Z 7ed32bc8e469: Waiting 2024-08-20T22:08:28.8025887Z 0bf61114d37b: Waiting 2024-08-20T22:08:28.8026293Z 6efb96fc87ea: Waiting 2024-08-20T22:08:28.8026636Z 1fef4bd19792: Waiting 2024-08-20T22:08:28.8026962Z 385d0421d67c: Pulling fs layer 2024-08-20T22:08:28.8027431Z b119c4fc6c58: Waiting 2024-08-20T22:08:28.8027837Z 5645520256fa: Waiting 2024-08-20T22:08:28.8028241Z ef1e3ef1e85f: Waiting 2024-08-20T22:08:28.8028545Z 2df849f72ba4: Waiting 2024-08-20T22:08:28.8028886Z 75b2abb16c68: Waiting 2024-08-20T22:08:28.8029336Z 7cbfce999d76: Pulling fs layer 2024-08-20T22:08:28.8029828Z 6658e558ebe4: Pulling fs layer 2024-08-20T22:08:28.8030303Z 33444a5a7e01: Pulling fs layer 2024-08-20T22:08:28.8030756Z 385d0421d67c: Waiting 2024-08-20T22:08:28.8031154Z 829ed7d91e38: Waiting 2024-08-20T22:08:28.8031548Z 6658e558ebe4: Waiting 2024-08-20T22:08:28.8031955Z 7c47122f4e09: Pulling fs layer 2024-08-20T22:08:28.8032430Z 1811ff4d3556: Pulling fs layer 2024-08-20T22:08:28.8032852Z 7754ee068b33: Pulling fs layer 2024-08-20T22:08:28.8033206Z 33444a5a7e01: Waiting 2024-08-20T22:08:28.8033512Z 7c47122f4e09: Waiting 2024-08-20T22:08:28.8033814Z 1811ff4d3556: Waiting 2024-08-20T22:08:28.8034122Z 33b639226eee: Waiting 2024-08-20T22:08:28.8034435Z 0479fbac3361: Pulling fs layer 2024-08-20T22:08:28.8034863Z 7754ee068b33: Waiting 2024-08-20T22:08:28.8035261Z f1d6874dee9c: Pulling fs layer 2024-08-20T22:08:28.8035778Z afc429e87b59: Pulling fs layer 2024-08-20T22:08:28.8036410Z 019620471c25: Pulling fs layer 2024-08-20T22:08:28.8036858Z afc429e87b59: Waiting 2024-08-20T22:08:28.8037282Z 27aeb1b2cd5e: Pulling fs layer 2024-08-20T22:08:28.8037735Z f1d6874dee9c: Waiting 2024-08-20T22:08:28.8038133Z 0479fbac3361: Waiting 2024-08-20T22:08:28.8038527Z 019620471c25: Waiting 2024-08-20T22:08:28.8038924Z 7cbfce999d76: Waiting 2024-08-20T22:08:28.8039343Z 829c0e19f4b7: Pulling fs layer 2024-08-20T22:08:28.8039696Z 27aeb1b2cd5e: Waiting 2024-08-20T22:08:28.8040077Z 829c0e19f4b7: Waiting 2024-08-20T22:08:28.8040451Z 560cd6122a38: Pulling fs layer 2024-08-20T22:08:28.8040972Z 5a4eb19d7219: Pulling fs layer 2024-08-20T22:08:28.8041441Z 560cd6122a38: Waiting 2024-08-20T22:08:28.8042058Z 5a4eb19d7219: Waiting 2024-08-20T22:08:28.8042480Z da6a838a66c7: Pulling fs layer 2024-08-20T22:08:28.8042962Z cbb79a705353: Pulling fs layer 2024-08-20T22:08:28.8043422Z da6a838a66c7: Waiting 2024-08-20T22:08:28.8043845Z 4d4fa6802ab3: Pulling fs layer 2024-08-20T22:08:28.8044334Z 0f085d4fa279: Pulling fs layer 2024-08-20T22:08:28.8044805Z 4a0412373305: Pulling fs layer 2024-08-20T22:08:28.8045272Z 302c8c177944: Pulling fs layer 2024-08-20T22:08:28.8045717Z 4d4fa6802ab3: Waiting 2024-08-20T22:08:28.8046121Z 02970347dff6: Pulling fs layer 2024-08-20T22:08:28.8046572Z 0f085d4fa279: Waiting 2024-08-20T22:08:28.8046977Z 4a0412373305: Waiting 2024-08-20T22:08:28.8047386Z 916c5e858016: Pulling fs layer 2024-08-20T22:08:28.8047842Z 02970347dff6: Waiting 2024-08-20T22:08:28.8048272Z c42b3602a1fb: Pulling fs layer 2024-08-20T22:08:28.8048723Z 916c5e858016: Waiting 2024-08-20T22:08:28.8049261Z 11fad972ef6c: Pulling fs layer 2024-08-20T22:08:28.8049732Z f957c1624481: Pulling fs layer 2024-08-20T22:08:28.8050232Z 768c31dca016: Pulling fs layer 2024-08-20T22:08:28.8050683Z 11fad972ef6c: Waiting 2024-08-20T22:08:28.8051092Z 8c32d0ecebbe: Pulling fs layer 2024-08-20T22:08:28.8051573Z 4f4fb700ef54: Pulling fs layer 2024-08-20T22:08:28.8052054Z 78ee77eddef2: Pulling fs layer 2024-08-20T22:08:28.8052528Z 37513e9b43d7: Pulling fs layer 2024-08-20T22:08:28.8052995Z a7a5392e2bf6: Pulling fs layer 2024-08-20T22:08:28.8053476Z b10de02255c0: Pulling fs layer 2024-08-20T22:08:28.8053955Z e56eeff2db93: Pulling fs layer 2024-08-20T22:08:28.8054425Z 70ac3e38d0fd: Pulling fs layer 2024-08-20T22:08:28.8054913Z eb09cbf3e416: Pulling fs layer 2024-08-20T22:08:28.8055389Z ee1273153675: Pulling fs layer 2024-08-20T22:08:28.8055855Z e22979f9e0ee: Pulling fs layer 2024-08-20T22:08:28.8056215Z 6c1f0aabce7c: Pulling fs layer 2024-08-20T22:08:28.8056581Z 7ebe49c3a23e: Pulling fs layer 2024-08-20T22:08:28.8056955Z 5d115b29b5d5: Pulling fs layer 2024-08-20T22:08:28.8057331Z 7f2d7a04fbe6: Pulling fs layer 2024-08-20T22:08:28.8057689Z d79fd7d52698: Pulling fs layer 2024-08-20T22:08:28.8058071Z 9752d6fbbcab: Pulling fs layer 2024-08-20T22:08:28.8058438Z 83808b2eff4d: Pulling fs layer 2024-08-20T22:08:28.8058781Z a7a5392e2bf6: Waiting 2024-08-20T22:08:28.8059090Z b10de02255c0: Waiting 2024-08-20T22:08:28.8059395Z eb09cbf3e416: Waiting 2024-08-20T22:08:28.8059702Z e22979f9e0ee: Waiting 2024-08-20T22:08:28.8060020Z e56eeff2db93: Waiting 2024-08-20T22:08:28.8060664Z 83808b2eff4d: Waiting 2024-08-20T22:08:28.8060973Z 37513e9b43d7: Waiting 2024-08-20T22:08:28.8061276Z 4f4fb700ef54: Waiting 2024-08-20T22:08:28.8061576Z 9752d6fbbcab: Waiting 2024-08-20T22:08:28.8061880Z 8c32d0ecebbe: Waiting 2024-08-20T22:08:28.8062189Z 6c1f0aabce7c: Waiting 2024-08-20T22:08:28.8062485Z ee1273153675: Waiting 2024-08-20T22:08:28.8062785Z 5d115b29b5d5: Waiting 2024-08-20T22:08:28.8063088Z 78ee77eddef2: Waiting 2024-08-20T22:08:28.8063390Z d79fd7d52698: Waiting 2024-08-20T22:08:28.8063697Z 7f2d7a04fbe6: Waiting 2024-08-20T22:08:28.8064003Z 7ebe49c3a23e: Waiting 2024-08-20T22:08:28.8064312Z 70ac3e38d0fd: Waiting 2024-08-20T22:08:29.0013649Z 224fe954d725: Verifying Checksum 2024-08-20T22:08:29.0014204Z 224fe954d725: Download complete 2024-08-20T22:08:29.0643642Z d527cbbb87e3: Verifying Checksum 2024-08-20T22:08:29.0644405Z d527cbbb87e3: Download complete 2024-08-20T22:08:29.1361609Z 7a2c55901189: Verifying Checksum 2024-08-20T22:08:29.1362158Z 7a2c55901189: Download complete 2024-08-20T22:08:29.1511788Z b57676e46aee: Verifying Checksum 2024-08-20T22:08:29.1512324Z b57676e46aee: Download complete 2024-08-20T22:08:29.2604495Z a41a8d1c11c8: Verifying Checksum 2024-08-20T22:08:29.2605095Z a41a8d1c11c8: Download complete 2024-08-20T22:08:29.3246725Z 0c1227890755: Download complete 2024-08-20T22:08:29.3907210Z d8d1234baab3: Verifying Checksum 2024-08-20T22:08:29.3907937Z d8d1234baab3: Download complete 2024-08-20T22:08:29.4116934Z 75722010b82e: Verifying Checksum 2024-08-20T22:08:29.4117634Z 75722010b82e: Download complete 2024-08-20T22:08:29.5089132Z ec1e7978c1fe: Download complete 2024-08-20T22:08:29.5827706Z ac23c5fcc1ef: Verifying Checksum 2024-08-20T22:08:29.5828207Z ac23c5fcc1ef: Download complete 2024-08-20T22:08:30.3110898Z 7a2c55901189: Pull complete 2024-08-20T22:08:30.6195871Z 224fe954d725: Pull complete 2024-08-20T22:08:31.5265220Z 75722010b82e: Pull complete 2024-08-20T22:08:31.5473368Z d527cbbb87e3: Pull complete 2024-08-20T22:08:31.5676515Z b57676e46aee: Pull complete 2024-08-20T22:08:32.1071587Z ca426ffc9d2b: Verifying Checksum 2024-08-20T22:08:32.1071998Z ca426ffc9d2b: Download complete 2024-08-20T22:08:32.1741725Z 4373aa743caf: Verifying Checksum 2024-08-20T22:08:32.1742317Z 4373aa743caf: Download complete 2024-08-20T22:08:32.2336473Z 75b2abb16c68: Verifying Checksum 2024-08-20T22:08:32.2337040Z 75b2abb16c68: Download complete 2024-08-20T22:08:32.3047541Z ef1e3ef1e85f: Verifying Checksum 2024-08-20T22:08:32.3048127Z ef1e3ef1e85f: Download complete 2024-08-20T22:08:33.2667790Z 0bf61114d37b: Verifying Checksum 2024-08-20T22:08:33.2668353Z 0bf61114d37b: Download complete 2024-08-20T22:08:33.3558209Z 2df849f72ba4: Download complete 2024-08-20T22:08:33.4216895Z 34c47d63c5de: Verifying Checksum 2024-08-20T22:08:33.4217442Z 34c47d63c5de: Download complete 2024-08-20T22:08:33.4995506Z 1fef4bd19792: Verifying Checksum 2024-08-20T22:08:33.4996172Z 1fef4bd19792: Download complete 2024-08-20T22:08:42.4726943Z a8c1e85b5e14: Verifying Checksum 2024-08-20T22:08:42.4727401Z a8c1e85b5e14: Download complete 2024-08-20T22:08:42.5773987Z b119c4fc6c58: Verifying Checksum 2024-08-20T22:08:42.5774460Z b119c4fc6c58: Download complete 2024-08-20T22:08:42.6740694Z 33b639226eee: Verifying Checksum 2024-08-20T22:08:42.6741150Z 33b639226eee: Download complete 2024-08-20T22:08:42.7485289Z d3547bd43146: Verifying Checksum 2024-08-20T22:08:42.7485867Z d3547bd43146: Download complete 2024-08-20T22:08:42.8690139Z 5645520256fa: Verifying Checksum 2024-08-20T22:08:42.8690699Z 5645520256fa: Download complete 2024-08-20T22:08:42.9393221Z 829ed7d91e38: Download complete 2024-08-20T22:08:44.2120313Z 385d0421d67c: Verifying Checksum 2024-08-20T22:08:44.2120909Z 385d0421d67c: Download complete 2024-08-20T22:08:44.2965296Z 7cbfce999d76: Download complete 2024-08-20T22:08:44.3671279Z 6658e558ebe4: Verifying Checksum 2024-08-20T22:08:44.3671736Z 6658e558ebe4: Download complete 2024-08-20T22:08:44.4440322Z 33444a5a7e01: Verifying Checksum 2024-08-20T22:08:44.4440772Z 33444a5a7e01: Download complete 2024-08-20T22:08:44.5289491Z 7c47122f4e09: Download complete 2024-08-20T22:08:44.6050236Z 1811ff4d3556: Verifying Checksum 2024-08-20T22:08:44.6050719Z 1811ff4d3556: Download complete 2024-08-20T22:08:50.6063389Z 7754ee068b33: Verifying Checksum 2024-08-20T22:08:50.6063985Z 7754ee068b33: Download complete 2024-08-20T22:08:50.6853779Z 0479fbac3361: Verifying Checksum 2024-08-20T22:08:50.6854390Z 0479fbac3361: Download complete 2024-08-20T22:08:50.7573954Z f1d6874dee9c: Verifying Checksum 2024-08-20T22:08:50.7574597Z f1d6874dee9c: Download complete 2024-08-20T22:08:51.1714005Z afc429e87b59: Verifying Checksum 2024-08-20T22:08:51.1714611Z afc429e87b59: Download complete 2024-08-20T22:08:51.2485239Z 019620471c25: Verifying Checksum 2024-08-20T22:08:51.2485809Z 019620471c25: Download complete 2024-08-20T22:08:51.3162004Z 27aeb1b2cd5e: Download complete 2024-08-20T22:08:51.5667906Z 829c0e19f4b7: Verifying Checksum 2024-08-20T22:08:51.5668504Z 829c0e19f4b7: Download complete 2024-08-20T22:08:51.6423702Z 560cd6122a38: Verifying Checksum 2024-08-20T22:08:51.6424297Z 560cd6122a38: Download complete 2024-08-20T22:08:51.7222003Z 5a4eb19d7219: Download complete 2024-08-20T22:08:51.8134868Z da6a838a66c7: Verifying Checksum 2024-08-20T22:08:51.8135463Z da6a838a66c7: Download complete 2024-08-20T22:08:54.7375794Z 7ed32bc8e469: Verifying Checksum 2024-08-20T22:08:54.7376447Z 7ed32bc8e469: Download complete 2024-08-20T22:08:54.8114682Z 4d4fa6802ab3: Download complete 2024-08-20T22:08:54.8778773Z 0f085d4fa279: Verifying Checksum 2024-08-20T22:08:54.8779430Z 0f085d4fa279: Download complete 2024-08-20T22:08:55.3653363Z 4a0412373305: Verifying Checksum 2024-08-20T22:08:55.3654652Z 4a0412373305: Download complete 2024-08-20T22:08:55.4323258Z 302c8c177944: Verifying Checksum 2024-08-20T22:08:55.4323861Z 302c8c177944: Download complete 2024-08-20T22:08:55.4998166Z 02970347dff6: Download complete 2024-08-20T22:08:55.5661045Z 916c5e858016: Verifying Checksum 2024-08-20T22:08:55.5661668Z 916c5e858016: Download complete 2024-08-20T22:08:55.6341061Z c42b3602a1fb: Verifying Checksum 2024-08-20T22:08:55.6341545Z c42b3602a1fb: Download complete 2024-08-20T22:08:55.8136354Z a8c1e85b5e14: Pull complete 2024-08-20T22:08:55.9557929Z a41a8d1c11c8: Pull complete 2024-08-20T22:08:56.0319406Z 0c1227890755: Pull complete 2024-08-20T22:08:56.0979252Z d8d1234baab3: Pull complete 2024-08-20T22:09:02.1892841Z 6efb96fc87ea: Verifying Checksum 2024-08-20T22:09:02.1893423Z 6efb96fc87ea: Download complete 2024-08-20T22:09:02.2623719Z f957c1624481: Verifying Checksum 2024-08-20T22:09:02.2624411Z f957c1624481: Download complete 2024-08-20T22:09:02.3385054Z 768c31dca016: Download complete 2024-08-20T22:09:02.4094646Z 8c32d0ecebbe: Verifying Checksum 2024-08-20T22:09:02.4095164Z 8c32d0ecebbe: Download complete 2024-08-20T22:09:02.4195227Z 4f4fb700ef54: Verifying Checksum 2024-08-20T22:09:02.4195678Z 4f4fb700ef54: Download complete 2024-08-20T22:09:02.4926078Z 78ee77eddef2: Verifying Checksum 2024-08-20T22:09:02.4926674Z 78ee77eddef2: Download complete 2024-08-20T22:09:02.5787047Z 37513e9b43d7: Verifying Checksum 2024-08-20T22:09:02.5787648Z 37513e9b43d7: Download complete 2024-08-20T22:09:02.7190621Z a7a5392e2bf6: Verifying Checksum 2024-08-20T22:09:02.7191091Z a7a5392e2bf6: Download complete 2024-08-20T22:09:02.8129194Z b10de02255c0: Verifying Checksum 2024-08-20T22:09:02.8129746Z b10de02255c0: Download complete 2024-08-20T22:09:02.8920532Z e56eeff2db93: Verifying Checksum 2024-08-20T22:09:02.8920993Z e56eeff2db93: Download complete 2024-08-20T22:09:02.9716890Z 70ac3e38d0fd: Download complete 2024-08-20T22:09:03.0368813Z eb09cbf3e416: Verifying Checksum 2024-08-20T22:09:03.0369416Z eb09cbf3e416: Download complete 2024-08-20T22:09:03.1779912Z ee1273153675: Verifying Checksum 2024-08-20T22:09:03.1780411Z ee1273153675: Download complete 2024-08-20T22:09:03.2686036Z e22979f9e0ee: Verifying Checksum 2024-08-20T22:09:03.2686496Z e22979f9e0ee: Download complete 2024-08-20T22:09:03.8620575Z 6c1f0aabce7c: Verifying Checksum 2024-08-20T22:09:03.8621151Z 6c1f0aabce7c: Download complete 2024-08-20T22:09:03.9315320Z 7ebe49c3a23e: Download complete 2024-08-20T22:09:30.8206877Z 5d115b29b5d5: Verifying Checksum 2024-08-20T22:09:30.8207437Z 5d115b29b5d5: Download complete 2024-08-20T22:09:30.8831252Z 7f2d7a04fbe6: Verifying Checksum 2024-08-20T22:09:30.8831808Z 7f2d7a04fbe6: Download complete 2024-08-20T22:09:30.9502749Z d79fd7d52698: Verifying Checksum 2024-08-20T22:09:30.9503305Z d79fd7d52698: Download complete 2024-08-20T22:09:32.3853775Z 9752d6fbbcab: Verifying Checksum 2024-08-20T22:09:32.3854357Z 9752d6fbbcab: Download complete 2024-08-20T22:09:32.4652963Z 83808b2eff4d: Verifying Checksum 2024-08-20T22:09:32.4653532Z 83808b2eff4d: Download complete 2024-08-20T22:10:11.0971970Z 11fad972ef6c: Verifying Checksum 2024-08-20T22:10:11.0972425Z 11fad972ef6c: Download complete 2024-08-20T22:10:11.7243514Z cbb79a705353: Verifying Checksum 2024-08-20T22:10:11.7243967Z cbb79a705353: Download complete 2024-08-20T22:10:26.7131694Z 7ed32bc8e469: Pull complete 2024-08-20T22:10:26.9027705Z ec1e7978c1fe: Pull complete 2024-08-20T22:10:27.0853273Z ac23c5fcc1ef: Pull complete 2024-08-20T22:10:35.6044045Z ca426ffc9d2b: Pull complete 2024-08-20T22:10:35.6554950Z 4373aa743caf: Pull complete 2024-08-20T22:10:35.7406222Z 75b2abb16c68: Pull complete 2024-08-20T22:10:35.7866398Z ef1e3ef1e85f: Pull complete 2024-08-20T22:10:38.3584964Z 0bf61114d37b: Pull complete 2024-08-20T22:10:38.4919174Z 2df849f72ba4: Pull complete 2024-08-20T22:10:38.5766267Z 34c47d63c5de: Pull complete 2024-08-20T22:10:38.6472390Z 1fef4bd19792: Pull complete 2024-08-20T22:11:36.7656222Z 6efb96fc87ea: Pull complete 2024-08-20T22:11:36.8726372Z b119c4fc6c58: Pull complete 2024-08-20T22:11:36.9745799Z 33b639226eee: Pull complete 2024-08-20T22:11:37.0577268Z d3547bd43146: Pull complete 2024-08-20T22:11:37.1573829Z 5645520256fa: Pull complete 2024-08-20T22:11:37.2236070Z 829ed7d91e38: Pull complete 2024-08-20T22:11:40.6606907Z 385d0421d67c: Pull complete 2024-08-20T22:11:40.8621003Z 7cbfce999d76: Pull complete 2024-08-20T22:11:41.0796339Z 6658e558ebe4: Pull complete 2024-08-20T22:11:41.2775051Z 33444a5a7e01: Pull complete 2024-08-20T22:11:41.4718436Z 7c47122f4e09: Pull complete 2024-08-20T22:11:41.6566886Z 1811ff4d3556: Pull complete 2024-08-20T22:11:52.2446986Z 7754ee068b33: Pull complete 2024-08-20T22:11:52.4119377Z 0479fbac3361: Pull complete 2024-08-20T22:11:52.6334202Z f1d6874dee9c: Pull complete 2024-08-20T22:11:53.5434739Z afc429e87b59: Pull complete 2024-08-20T22:11:53.6889400Z 019620471c25: Pull complete 2024-08-20T22:11:53.8750469Z 27aeb1b2cd5e: Pull complete 2024-08-20T22:11:54.3992391Z 829c0e19f4b7: Pull complete 2024-08-20T22:11:54.5803152Z 560cd6122a38: Pull complete 2024-08-20T22:11:54.8754949Z 5a4eb19d7219: Pull complete 2024-08-20T22:11:54.9993398Z da6a838a66c7: Pull complete 2024-08-20T22:12:33.7060749Z cbb79a705353: Pull complete 2024-08-20T22:12:33.9010315Z 4d4fa6802ab3: Pull complete 2024-08-20T22:12:34.0050558Z 0f085d4fa279: Pull complete 2024-08-20T22:12:36.3797756Z 4a0412373305: Pull complete 2024-08-20T22:12:36.3935852Z 302c8c177944: Pull complete 2024-08-20T22:12:36.4065490Z 02970347dff6: Pull complete 2024-08-20T22:12:36.4336358Z 916c5e858016: Pull complete 2024-08-20T22:12:36.4476135Z c42b3602a1fb: Pull complete 2024-08-20T22:13:58.7793605Z 11fad972ef6c: Pull complete 2024-08-20T22:13:58.9679942Z f957c1624481: Pull complete 2024-08-20T22:13:59.1639657Z 768c31dca016: Pull complete 2024-08-20T22:13:59.2781914Z 8c32d0ecebbe: Pull complete 2024-08-20T22:13:59.3191951Z 4f4fb700ef54: Pull complete 2024-08-20T22:13:59.4086861Z 78ee77eddef2: Pull complete 2024-08-20T22:13:59.6032461Z 37513e9b43d7: Pull complete 2024-08-20T22:14:00.1362153Z a7a5392e2bf6: Pull complete 2024-08-20T22:14:00.3390446Z b10de02255c0: Pull complete 2024-08-20T22:14:00.5345051Z e56eeff2db93: Pull complete 2024-08-20T22:14:00.7277353Z 70ac3e38d0fd: Pull complete 2024-08-20T22:14:00.9765726Z eb09cbf3e416: Pull complete 2024-08-20T22:14:02.4115468Z ee1273153675: Pull complete 2024-08-20T22:14:02.4627575Z e22979f9e0ee: Pull complete 2024-08-20T22:14:05.2440520Z 6c1f0aabce7c: Pull complete 2024-08-20T22:14:05.3433872Z 7ebe49c3a23e: Pull complete 2024-08-20T22:14:33.8574998Z 5d115b29b5d5: Pull complete 2024-08-20T22:14:34.0750940Z 7f2d7a04fbe6: Pull complete 2024-08-20T22:14:34.2785579Z d79fd7d52698: Pull complete 2024-08-20T22:14:35.1047590Z 9752d6fbbcab: Pull complete 2024-08-20T22:14:35.2940879Z 83808b2eff4d: Pull complete 2024-08-20T22:14:36.1825312Z Digest: sha256:3a95d3a177465127ef6cd3b50787d6a050367070fd9063dbb688fad07a96b402 2024-08-20T22:14:36.2427955Z Status: Downloaded newer image for 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:14:36.2506870Z 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:14:36.2623658Z ##[group]Run echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> "$GITHUB_OUTPUT" 2024-08-20T22:14:36.2624581Z echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> "$GITHUB_OUTPUT" 2024-08-20T22:14:36.2635941Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:14:36.2636522Z env: 2024-08-20T22:14:36.2636790Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:14:36.2637137Z ##[endgroup] 2024-08-20T22:14:36.2919049Z ##[group]Run pytorch/test-infra/.github/actions/setup-nvidia@main 2024-08-20T22:14:36.2919587Z with: 2024-08-20T22:14:36.2919861Z driver-version: 550.54.15 2024-08-20T22:14:36.2920205Z env: 2024-08-20T22:14:36.2920469Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:14:36.2920814Z ##[endgroup] 2024-08-20T22:14:36.3021048Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2024-08-20T22:14:36.3021654Z with: 2024-08-20T22:14:36.3021925Z timeout_minutes: 10 2024-08-20T22:14:36.3022238Z max_attempts: 3 2024-08-20T22:14:36.3056151Z command: # Is it disgusting to have a full shell script here in this github action? Sure # But is it the best way to make it so that this action relies on nothing else? Absolutely set -eou pipefail DISTRIBUTION=$(. /etc/os-release;echo $ID$VERSION_ID) DRIVER_FN="NVIDIA-Linux-x86_64-${DRIVER_VERSION}.run" install_nvidia_docker2_amzn2() { ( set -x # Needed for yum-config-manager sudo yum install -y yum-utils if [[ "${DISTRIBUTION}" == "amzn2023" ]] ; then YUM_REPO_URL="https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo" else # Amazon Linux 2 YUM_REPO_URL="https://nvidia.github.io/nvidia-docker/${DISTRIBUTION}/nvidia-docker.repo" fi sudo yum-config-manager --add-repo "${YUM_REPO_URL}" sudo yum install -y nvidia-docker2 sudo systemctl restart docker ) } install_nvidia_docker2_ubuntu20() { ( set -x # Install nvidia-driver package if not installed status="$(dpkg-query -W --showformat='${db:Status-Status}' nvidia-docker2 2>&1)" if [ ! $? = 0 ] || [ ! "$status" = installed ]; then sudo apt-get install -y nvidia-docker2 sudo systemctl restart docker fi ) } pre_install_nvidia_driver_amzn2() { ( # Purge any nvidia driver installed from RHEL repo sudo yum remove -y nvidia-driver-latest-dkms ) } install_nvidia_driver_common() { ( # Try to gather more information about the runner and its existing NVIDIA driver if any echo "Before installing NVIDIA driver" lspci lsmod modinfo nvidia || true HAS_NVIDIA_DRIVER=0 # Check if NVIDIA driver has already been installed if [ -x "$(command -v nvidia-smi)" ]; then set +e # The driver exists, check its version next. Also check only the first GPU if there are more than one of them # so that the same driver version is not print over multiple lines INSTALLED_DRIVER_VERSION=$(nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0) NVIDIA_SMI_STATUS=$? if [ "$NVIDIA_SMI_STATUS" -ne 0 ] && [ "$NVIDIA_SMI_STATUS" -ne 14 ]; then echo "Failed to get NVIDIA driver version ($INSTALLED_DRIVER_VERSION). Continuing" elif [ "$INSTALLED_DRIVER_VERSION" != "$DRIVER_VERSION" ]; then echo "NVIDIA driver ($INSTALLED_DRIVER_VERSION) has been installed, but we expect to have $DRIVER_VERSION instead. Continuing" else HAS_NVIDIA_DRIVER=1 echo "NVIDIA driver ($INSTALLED_DRIVER_VERSION) has already been installed. Skipping NVIDIA driver installation" fi set -e fi if [ "$HAS_NVIDIA_DRIVER" -eq 0 ]; then # CAUTION: this may need to be updated in future if [ "${DISTRIBUTION}" != ubuntu20.04 ]; then sudo yum groupinstall -y "Development Tools" # ensure our kernel install is the same as our underlying kernel, # groupinstall "Development Tools" has a habit of mismatching kernel headers sudo yum install -y "kernel-devel-uname-r == $(uname -r)" sudo modprobe backlight fi sudo curl -fsL -o /tmp/nvidia_driver "https://s3.amazonaws.com/ossci-linux/nvidia_driver/$DRIVER_FN" set +e sudo /bin/bash /tmp/nvidia_driver -s --no-drm NVIDIA_INSTALLATION_STATUS=$? RESET_GPU=0 if [ "$NVIDIA_INSTALLATION_STATUS" -ne 0 ]; then sudo cat /var/log/nvidia-installer.log # Fail to install NVIDIA driver, try to reset the GPU RESET_GPU=1 elif [ -x "$(command -v nvidia-smi)" ]; then # Check again if nvidia-smi works even if the driver installation completes successfully INSTALLED_DRIVER_VERSION=$(nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0) NVIDIA_SMI_STATUS=$? if [ "$NVIDIA_SMI_STATUS" -ne 0 ] && [ "$NVIDIA_SMI_STATUS" -ne 14 ]; then RESET_GPU=1 fi fi if [ "$RESET_GPU" -eq 1 ]; then NVIDIA_DEVICES=$(lspci -D | grep -i NVIDIA | cut -d' ' -f1) # The GPU can get stuck in a failure state if somehow the test crashs the GPU microcode. When this # happens, we'll try to reset all NVIDIA devices https://github.com/pytorch/pytorch/issues/88388 for PCI_ID in $NVIDIA_DEVICES; do DEVICE_ENABLED=$(cat /sys/bus/pci/devices/$PCI_ID/enable) echo "Reseting $PCI_ID (enabled state: $DEVICE_ENABLED)" # This requires sudo permission of course echo "1" | sudo tee /sys/bus/pci/devices/$PCI_ID/reset sleep 1 done fi sudo rm -fv /tmp/nvidia_driver set -e fi ) } post_install_nvidia_driver_common() { ( sudo modprobe nvidia || true echo "After installing NVIDIA driver" lspci lsmod modinfo nvidia || true ( set +e nvidia-smi # NB: Annoyingly, nvidia-smi command returns successfully with return code 0 even in # the case where the driver has already crashed as it still can get the driver version # and some basic information like the bus ID. However, the rest of the information # would be missing (ERR!), for example: # # +-----------------------------------------------------------------------------+ # | NVIDIA-SMI 525.89.02 Driver Version: 525.89.02 CUDA Version: 12.0 | # |-------------------------------+----------------------+----------------------+ # | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | # | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | # | | | MIG M. | # |===============================+======================+======================| # | 0 ERR! Off | 00000000:00:1E.0 Off | ERR! | # |ERR! ERR! ERR! ERR! / ERR! | 4184MiB / 23028MiB | ERR! Default | # | | | ERR! | # +-------------------------------+----------------------+----------------------+ # # +-----------------------------------------------------------------------------+ # | Processes: | # | GPU GI CI PID Type Process name GPU Memory | # | ID ID Usage | # |=============================================================================| # +-----------------------------------------------------------------------------+ # # This should be reported as a failure instead as it will guarantee to fail when # Docker tries to run with --gpus all # # So, the correct check here is to query one of the missing piece of info like # GPU name, so that the command can fail accordingly nvidia-smi --query-gpu=gpu_name --format=csv,noheader --id=0 NVIDIA_SMI_STATUS=$? # Allowable exit statuses for nvidia-smi, see: https://github.com/NVIDIA/gpu-operator/issues/285 if [ "$NVIDIA_SMI_STATUS" -eq 0 ] || [ "$NVIDIA_SMI_STATUS" -eq 14 ]; then echo "INFO: Ignoring allowed status ${NVIDIA_SMI_STATUS}" else echo "ERROR: nvidia-smi exited with unresolved status ${NVIDIA_SMI_STATUS}" exit ${NVIDIA_SMI_STATUS} fi set -e ) ) } install_nvidia_driver_amzn2() { ( set -x pre_install_nvidia_driver_amzn2 install_nvidia_driver_common post_install_nvidia_driver_common ) } install_nvidia_driver_ubuntu20() { ( set -x install_nvidia_driver_common post_install_nvidia_driver_common ) } echo "== Installing nvidia driver ${DRIVER_FN} ==" case "${DISTRIBUTION}" in amzn*) install_nvidia_driver_amzn2 ;; ubuntu20.04) install_nvidia_driver_ubuntu20 ;; *) echo "ERROR: Unknown distribution ${DISTRIBUTION}" exit 1 ;; esac # Install container toolkit based on distribution echo "== Installing nvidia container toolkit for ${DISTRIBUTION} ==" case "${DISTRIBUTION}" in amzn*) install_nvidia_docker2_amzn2 ;; ubuntu20.04) install_nvidia_docker2_ubuntu20 ;; *) echo "ERROR: Unknown distribution ${DISTRIBUTION}" exit 1 ;; esac echo "GPU_FLAG=--gpus all -e NVIDIA_DRIVER_CAPABILITIES=all" >> "${GITHUB_ENV}" # Fix https://github.com/NVIDIA/nvidia-docker/issues/1648 on runners with # more than one GPUs. This just needs to be run once. The command fails # on subsequent runs and complains that the mode is already on, but that's # ok sudo nvidia-persistenced || true # This should show persistence mode ON nvidia-smi 2024-08-20T22:14:36.3089725Z retry_wait_seconds: 10 2024-08-20T22:14:36.3090084Z polling_interval_seconds: 1 2024-08-20T22:14:36.3090446Z warning_on_retry: true 2024-08-20T22:14:36.3090786Z continue_on_error: false 2024-08-20T22:14:36.3091122Z env: 2024-08-20T22:14:36.3091386Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:14:36.3091755Z DRIVER_VERSION: 550.54.15 2024-08-20T22:14:36.3092122Z ##[endgroup] 2024-08-20T22:14:36.5783437Z == Installing nvidia driver NVIDIA-Linux-x86_64-550.54.15.run == 2024-08-20T22:14:36.5784037Z + pre_install_nvidia_driver_amzn2 2024-08-20T22:14:36.5784551Z + sudo yum remove -y nvidia-driver-latest-dkms 2024-08-20T22:14:38.3216348Z No match for argument: nvidia-driver-latest-dkms 2024-08-20T22:14:38.3217005Z No packages marked for removal. 2024-08-20T22:14:38.3670153Z Dependencies resolved. 2024-08-20T22:14:38.3681440Z Nothing to do. 2024-08-20T22:14:38.3681889Z Complete! 2024-08-20T22:14:38.4769543Z + install_nvidia_driver_common 2024-08-20T22:14:38.4772218Z + echo 'Before installing NVIDIA driver' 2024-08-20T22:14:38.4772889Z Before installing NVIDIA driver 2024-08-20T22:14:38.4773974Z + lspci 2024-08-20T22:14:38.4939872Z 00:00.0 Host bridge: Intel Corporation 440FX - 82441FX PMC [Natoma] 2024-08-20T22:14:38.4940779Z 00:01.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II] 2024-08-20T22:14:38.4942075Z 00:01.3 Non-VGA unclassified device: Intel Corporation 82371AB/EB/MB PIIX4 ACPI (rev 08) 2024-08-20T22:14:38.4943053Z 00:03.0 VGA compatible controller: Amazon.com, Inc. Device 1111 2024-08-20T22:14:38.4944126Z 00:04.0 Non-Volatile memory controller: Amazon.com, Inc. NVMe EBS Controller 2024-08-20T22:14:38.4945095Z 00:05.0 Ethernet controller: Amazon.com, Inc. Elastic Network Adapter (ENA) 2024-08-20T22:14:38.4945835Z 00:1e.0 3D controller: NVIDIA Corporation GA102GL [A10G] (rev a1) 2024-08-20T22:14:38.4946661Z 00:1f.0 Non-Volatile memory controller: Amazon.com, Inc. NVMe SSD Controller 2024-08-20T22:14:38.4947254Z + lsmod 2024-08-20T22:14:38.4989965Z Module Size Used by 2024-08-20T22:14:38.4990575Z xt_nat 16384 0 2024-08-20T22:14:38.4991065Z ib_core 454656 0 2024-08-20T22:14:38.4991541Z veth 36864 0 2024-08-20T22:14:38.4992059Z nvidia_modeset 1351680 0 2024-08-20T22:14:38.4992600Z video 65536 1 nvidia_modeset 2024-08-20T22:14:38.4993155Z wmi 36864 1 video 2024-08-20T22:14:38.4993619Z nvidia_uvm 4706304 0 2024-08-20T22:14:38.4994273Z nvidia 54071296 7 nvidia_uvm,nvidia_modeset 2024-08-20T22:14:38.4994820Z drm 602112 1 nvidia 2024-08-20T22:14:38.4995375Z drm_panel_orientation_quirks 28672 1 drm 2024-08-20T22:14:38.4996185Z backlight 24576 3 video,drm,nvidia_modeset 2024-08-20T22:14:38.4996797Z i2c_core 106496 2 nvidia,drm 2024-08-20T22:14:38.4997258Z xt_conntrack 16384 1 2024-08-20T22:14:38.4997763Z nft_chain_nat 16384 3 2024-08-20T22:14:38.4998272Z xt_MASQUERADE 20480 1 2024-08-20T22:14:38.4998779Z nf_nat 57344 3 xt_nat,nft_chain_nat,xt_MASQUERADE 2024-08-20T22:14:38.4999282Z nf_conntrack_netlink 57344 0 2024-08-20T22:14:38.5000111Z nf_conntrack 184320 5 xt_conntrack,nf_nat,xt_nat,nf_conntrack_netlink,xt_MASQUERADE 2024-08-20T22:14:38.5000777Z nf_defrag_ipv6 24576 1 nf_conntrack 2024-08-20T22:14:38.5001249Z nf_defrag_ipv4 16384 1 nf_conntrack 2024-08-20T22:14:38.5001763Z xfrm_user 57344 1 2024-08-20T22:14:38.5002160Z xfrm_algo 16384 1 xfrm_user 2024-08-20T22:14:38.5002636Z xt_addrtype 16384 2 2024-08-20T22:14:38.5003097Z nft_compat 20480 4 2024-08-20T22:14:38.5003547Z nf_tables 307200 57 nft_compat,nft_chain_nat 2024-08-20T22:14:38.5004170Z nfnetlink 20480 4 nft_compat,nf_conntrack_netlink,nf_tables 2024-08-20T22:14:38.5004712Z br_netfilter 36864 0 2024-08-20T22:14:38.5005126Z bridge 307200 1 br_netfilter 2024-08-20T22:14:38.5005580Z stp 16384 1 bridge 2024-08-20T22:14:38.5006010Z llc 16384 2 bridge,stp 2024-08-20T22:14:38.5006439Z overlay 167936 0 2024-08-20T22:14:38.5006817Z tls 114688 0 2024-08-20T22:14:38.5007179Z sunrpc 692224 1 2024-08-20T22:14:38.5007552Z nls_ascii 16384 1 2024-08-20T22:14:38.5007926Z nls_cp437 20480 1 2024-08-20T22:14:38.5008291Z vfat 24576 1 2024-08-20T22:14:38.5008656Z fat 86016 1 vfat 2024-08-20T22:14:38.5009049Z ena 167936 0 2024-08-20T22:14:38.5009421Z ghash_clmulni_intel 16384 0 2024-08-20T22:14:38.5009797Z ptp 36864 1 ena 2024-08-20T22:14:38.5010197Z pps_core 24576 1 ptp 2024-08-20T22:14:38.5010593Z aesni_intel 393216 0 2024-08-20T22:14:38.5010960Z i8042 45056 0 2024-08-20T22:14:38.5011367Z serio 28672 3 i8042 2024-08-20T22:14:38.5011807Z crypto_simd 16384 1 aesni_intel 2024-08-20T22:14:38.5012338Z cryptd 28672 2 crypto_simd,ghash_clmulni_intel 2024-08-20T22:14:38.5012840Z button 24576 0 2024-08-20T22:14:38.5013216Z sch_fq_codel 20480 17 2024-08-20T22:14:38.5013604Z dm_mod 188416 0 2024-08-20T22:14:38.5013968Z fuse 163840 1 2024-08-20T22:14:38.5014330Z configfs 57344 1 2024-08-20T22:14:38.5014715Z dax 45056 1 dm_mod 2024-08-20T22:14:38.5015113Z loop 36864 0 2024-08-20T22:14:38.5015483Z dmi_sysfs 20480 0 2024-08-20T22:14:38.5015855Z crc32_pclmul 16384 0 2024-08-20T22:14:38.5016313Z crc32c_intel 24576 0 2024-08-20T22:14:38.5016686Z efivarfs 24576 1 2024-08-20T22:14:38.5017051Z + modinfo nvidia 2024-08-20T22:14:38.5017774Z filename: /lib/modules/6.1.94-99.176.amzn2023.x86_64/kernel/drivers/video/nvidia.ko 2024-08-20T22:14:38.5018610Z alias: char-major-195-* 2024-08-20T22:14:38.5018999Z version: 550.54.15 2024-08-20T22:14:38.5019347Z supported: external 2024-08-20T22:14:38.5019681Z license: NVIDIA 2024-08-20T22:14:38.5020064Z firmware: nvidia/550.54.15/gsp_tu10x.bin 2024-08-20T22:14:38.5020551Z firmware: nvidia/550.54.15/gsp_ga10x.bin 2024-08-20T22:14:38.5021021Z srcversion: 833721318DA517F0C2FEC97 2024-08-20T22:14:38.5021476Z alias: pci:v000010DEd*sv*sd*bc06sc80i00* 2024-08-20T22:14:38.5021980Z alias: pci:v000010DEd*sv*sd*bc03sc02i00* 2024-08-20T22:14:38.5022470Z alias: pci:v000010DEd*sv*sd*bc03sc00i00* 2024-08-20T22:14:38.5022973Z depends: i2c-core,drm 2024-08-20T22:14:38.5023328Z retpoline: Y 2024-08-20T22:14:38.5023641Z name: nvidia 2024-08-20T22:14:38.5024255Z vermagic: 6.1.94-99.176.amzn2023.x86_64 SMP preempt mod_unload modversions 2024-08-20T22:14:38.5024955Z parm: NvSwitchRegDwords:NvSwitch regkey (charp) 2024-08-20T22:14:38.5025616Z parm: NvSwitchBlacklist:NvSwitchBlacklist=uuid[,uuid...] (charp) 2024-08-20T22:14:38.5026215Z parm: NVreg_ResmanDebugLevel:int 2024-08-20T22:14:38.5026659Z parm: NVreg_RmLogonRC:int 2024-08-20T22:14:38.5027209Z parm: NVreg_ModifyDeviceFiles:int 2024-08-20T22:14:38.5027665Z parm: NVreg_DeviceFileUID:int 2024-08-20T22:14:38.5028105Z parm: NVreg_DeviceFileGID:int 2024-08-20T22:14:38.5028546Z parm: NVreg_DeviceFileMode:int 2024-08-20T22:14:38.5029067Z parm: NVreg_InitializeSystemMemoryAllocations:int 2024-08-20T22:14:38.5029633Z parm: NVreg_UsePageAttributeTable:int 2024-08-20T22:14:38.5030119Z parm: NVreg_EnablePCIeGen3:int 2024-08-20T22:14:38.5030555Z parm: NVreg_EnableMSI:int 2024-08-20T22:14:38.5030965Z parm: NVreg_TCEBypassMode:int 2024-08-20T22:14:38.5031478Z parm: NVreg_EnableStreamMemOPs:int 2024-08-20T22:14:38.5032017Z parm: NVreg_RestrictProfilingToAdminUsers:int 2024-08-20T22:14:38.5032607Z parm: NVreg_PreserveVideoMemoryAllocations:int 2024-08-20T22:14:38.5033166Z parm: NVreg_EnableS0ixPowerManagement:int 2024-08-20T22:14:38.5033802Z parm: NVreg_S0ixPowerManagementVideoMemoryThreshold:int 2024-08-20T22:14:38.5034403Z parm: NVreg_DynamicPowerManagement:int 2024-08-20T22:14:38.5035018Z parm: NVreg_DynamicPowerManagementVideoMemoryThreshold:int 2024-08-20T22:14:38.5035610Z parm: NVreg_EnableGpuFirmware:int 2024-08-20T22:14:38.5036204Z parm: NVreg_EnableGpuFirmwareLogs:int 2024-08-20T22:14:38.5036744Z parm: NVreg_OpenRmEnableUnsupportedGpus:int 2024-08-20T22:14:38.5037291Z parm: NVreg_EnableUserNUMAManagement:int 2024-08-20T22:14:38.5037786Z parm: NVreg_MemoryPoolSize:int 2024-08-20T22:14:38.5038247Z parm: NVreg_KMallocHeapMaxSize:int 2024-08-20T22:14:38.5038732Z parm: NVreg_VMallocHeapMaxSize:int 2024-08-20T22:14:38.5039200Z parm: NVreg_IgnoreMMIOCheck:int 2024-08-20T22:14:38.5039655Z parm: NVreg_NvLinkDisable:int 2024-08-20T22:14:38.5040158Z parm: NVreg_EnablePCIERelaxedOrderingMode:int 2024-08-20T22:14:38.5040689Z parm: NVreg_RegisterPCIDriver:int 2024-08-20T22:14:38.5041170Z parm: NVreg_EnableResizableBar:int 2024-08-20T22:14:38.5041702Z parm: NVreg_EnableDbgBreakpoint:int 2024-08-20T22:14:38.5042201Z parm: NVreg_EnableNonblockingOpen:int 2024-08-20T22:14:38.5042700Z parm: NVreg_RegistryDwords:charp 2024-08-20T22:14:38.5043193Z parm: NVreg_RegistryDwordsPerDevice:charp 2024-08-20T22:14:38.5043674Z parm: NVreg_RmMsg:charp 2024-08-20T22:14:38.5044088Z parm: NVreg_GpuBlacklist:charp 2024-08-20T22:14:38.5044556Z parm: NVreg_TemporaryFilePath:charp 2024-08-20T22:14:38.5045017Z parm: NVreg_ExcludedGpus:charp 2024-08-20T22:14:38.5045474Z parm: NVreg_DmaRemapPeerMmio:int 2024-08-20T22:14:38.5046054Z parm: NVreg_RmNvlinkBandwidth:charp 2024-08-20T22:14:38.5046529Z parm: NVreg_ImexChannelCount:int 2024-08-20T22:14:38.5046983Z parm: rm_firmware_active:charp 2024-08-20T22:14:38.5047403Z + HAS_NVIDIA_DRIVER=0 2024-08-20T22:14:38.5047806Z ++ command -v nvidia-smi 2024-08-20T22:14:38.5048201Z + '[' -x /usr/bin/nvidia-smi ']' 2024-08-20T22:14:38.5048567Z + set +e 2024-08-20T22:14:38.5049073Z ++ nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0 2024-08-20T22:14:38.5304222Z + INSTALLED_DRIVER_VERSION=550.54.15 2024-08-20T22:14:38.5304648Z + NVIDIA_SMI_STATUS=0 2024-08-20T22:14:38.5305050Z + '[' 0 -ne 0 ']' 2024-08-20T22:14:38.5305418Z + '[' 550.54.15 '!=' 550.54.15 ']' 2024-08-20T22:14:38.5305793Z + HAS_NVIDIA_DRIVER=1 2024-08-20T22:14:38.5306519Z + echo 'NVIDIA driver (550.54.15) has already been installed. Skipping NVIDIA driver installation' 2024-08-20T22:14:38.5307228Z + set -e 2024-08-20T22:14:38.5307536Z + '[' 1 -eq 0 ']' 2024-08-20T22:14:38.5308119Z NVIDIA driver (550.54.15) has already been installed. Skipping NVIDIA driver installation 2024-08-20T22:14:38.5308802Z + post_install_nvidia_driver_common 2024-08-20T22:14:38.5311724Z + sudo modprobe nvidia 2024-08-20T22:14:38.6562923Z + echo 'After installing NVIDIA driver' 2024-08-20T22:14:38.6563359Z + lspci 2024-08-20T22:14:38.6563647Z After installing NVIDIA driver 2024-08-20T22:14:38.6670991Z 00:00.0 Host bridge: Intel Corporation 440FX - 82441FX PMC [Natoma] 2024-08-20T22:14:38.6671750Z 00:01.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II] 2024-08-20T22:14:38.6672693Z 00:01.3 Non-VGA unclassified device: Intel Corporation 82371AB/EB/MB PIIX4 ACPI (rev 08) 2024-08-20T22:14:38.6673495Z 00:03.0 VGA compatible controller: Amazon.com, Inc. Device 1111 2024-08-20T22:14:38.6674295Z 00:04.0 Non-Volatile memory controller: Amazon.com, Inc. NVMe EBS Controller 2024-08-20T22:14:38.6675090Z 00:05.0 Ethernet controller: Amazon.com, Inc. Elastic Network Adapter (ENA) 2024-08-20T22:14:38.6675831Z 00:1e.0 3D controller: NVIDIA Corporation GA102GL [A10G] (rev a1) 2024-08-20T22:14:38.6676730Z 00:1f.0 Non-Volatile memory controller: Amazon.com, Inc. NVMe SSD Controller 2024-08-20T22:14:38.6677318Z + lsmod 2024-08-20T22:14:38.6705708Z Module Size Used by 2024-08-20T22:14:38.6706138Z xt_nat 16384 0 2024-08-20T22:14:38.6706525Z ib_core 454656 0 2024-08-20T22:14:38.6707021Z veth 36864 0 2024-08-20T22:14:38.6707559Z nvidia_modeset 1351680 0 2024-08-20T22:14:38.6708098Z video 65536 1 nvidia_modeset 2024-08-20T22:14:38.6708600Z wmi 36864 1 video 2024-08-20T22:14:38.6709024Z nvidia_uvm 4706304 0 2024-08-20T22:14:38.6709631Z nvidia 54071296 7 nvidia_uvm,nvidia_modeset 2024-08-20T22:14:38.6710281Z drm 602112 1 nvidia 2024-08-20T22:14:38.6710852Z drm_panel_orientation_quirks 28672 1 drm 2024-08-20T22:14:38.6711575Z backlight 24576 3 video,drm,nvidia_modeset 2024-08-20T22:14:38.6712241Z i2c_core 106496 2 nvidia,drm 2024-08-20T22:14:38.6712672Z xt_conntrack 16384 1 2024-08-20T22:14:38.6713057Z nft_chain_nat 16384 3 2024-08-20T22:14:38.6713443Z xt_MASQUERADE 20480 1 2024-08-20T22:14:38.6713921Z nf_nat 57344 3 xt_nat,nft_chain_nat,xt_MASQUERADE 2024-08-20T22:14:38.6714439Z nf_conntrack_netlink 57344 0 2024-08-20T22:14:38.6715045Z nf_conntrack 184320 5 xt_conntrack,nf_nat,xt_nat,nf_conntrack_netlink,xt_MASQUERADE 2024-08-20T22:14:38.6715721Z nf_defrag_ipv6 24576 1 nf_conntrack 2024-08-20T22:14:38.6716310Z nf_defrag_ipv4 16384 1 nf_conntrack 2024-08-20T22:14:38.6716748Z xfrm_user 57344 1 2024-08-20T22:14:38.6717138Z xfrm_algo 16384 1 xfrm_user 2024-08-20T22:14:38.6717561Z xt_addrtype 16384 2 2024-08-20T22:14:38.6717955Z nft_compat 20480 4 2024-08-20T22:14:38.6718411Z nf_tables 307200 57 nft_compat,nft_chain_nat 2024-08-20T22:14:38.6720258Z nfnetlink 20480 4 nft_compat,nf_conntrack_netlink,nf_tables 2024-08-20T22:14:38.6720810Z br_netfilter 36864 0 2024-08-20T22:14:38.6721244Z bridge 307200 1 br_netfilter 2024-08-20T22:14:38.6721716Z stp 16384 1 bridge 2024-08-20T22:14:38.6722130Z llc 16384 2 bridge,stp 2024-08-20T22:14:38.6722546Z overlay 167936 0 2024-08-20T22:14:38.6722914Z tls 114688 0 2024-08-20T22:14:38.6723281Z sunrpc 692224 1 2024-08-20T22:14:38.6723642Z nls_ascii 16384 1 2024-08-20T22:14:38.6724012Z nls_cp437 20480 1 2024-08-20T22:14:38.6724382Z vfat 24576 1 2024-08-20T22:14:38.6724749Z fat 86016 1 vfat 2024-08-20T22:14:38.6725135Z ena 167936 0 2024-08-20T22:14:38.6725502Z ghash_clmulni_intel 16384 0 2024-08-20T22:14:38.6725882Z ptp 36864 1 ena 2024-08-20T22:14:38.6726293Z pps_core 24576 1 ptp 2024-08-20T22:14:38.6726683Z aesni_intel 393216 0 2024-08-20T22:14:38.6727050Z i8042 45056 0 2024-08-20T22:14:38.6727498Z serio 28672 3 i8042 2024-08-20T22:14:38.6728212Z crypto_simd 16384 1 aesni_intel 2024-08-20T22:14:38.6728898Z cryptd 28672 2 crypto_simd,ghash_clmulni_intel 2024-08-20T22:14:38.6729505Z button 24576 0 2024-08-20T22:14:38.6729888Z sch_fq_codel 20480 17 2024-08-20T22:14:38.6730368Z dm_mod 188416 0 2024-08-20T22:14:38.6730842Z fuse 163840 1 2024-08-20T22:14:38.6731323Z configfs 57344 1 2024-08-20T22:14:38.6731811Z dax 45056 1 dm_mod 2024-08-20T22:14:38.6732229Z loop 36864 0 2024-08-20T22:14:38.6732600Z dmi_sysfs 20480 0 2024-08-20T22:14:38.6732972Z crc32_pclmul 16384 0 2024-08-20T22:14:38.6733340Z crc32c_intel 24576 0 2024-08-20T22:14:38.6733718Z efivarfs 24576 1 2024-08-20T22:14:38.6734079Z + modinfo nvidia 2024-08-20T22:14:38.6734803Z filename: /lib/modules/6.1.94-99.176.amzn2023.x86_64/kernel/drivers/video/nvidia.ko 2024-08-20T22:14:38.6735519Z alias: char-major-195-* 2024-08-20T22:14:38.6735899Z version: 550.54.15 2024-08-20T22:14:38.6736247Z supported: external 2024-08-20T22:14:38.6736590Z license: NVIDIA 2024-08-20T22:14:38.6736963Z firmware: nvidia/550.54.15/gsp_tu10x.bin 2024-08-20T22:14:38.6737444Z firmware: nvidia/550.54.15/gsp_ga10x.bin 2024-08-20T22:14:38.6737904Z srcversion: 833721318DA517F0C2FEC97 2024-08-20T22:14:38.6738375Z alias: pci:v000010DEd*sv*sd*bc06sc80i00* 2024-08-20T22:14:38.6738864Z alias: pci:v000010DEd*sv*sd*bc03sc02i00* 2024-08-20T22:14:38.6739363Z alias: pci:v000010DEd*sv*sd*bc03sc00i00* 2024-08-20T22:14:38.6739867Z depends: i2c-core,drm 2024-08-20T22:14:38.6740229Z retpoline: Y 2024-08-20T22:14:38.6740539Z name: nvidia 2024-08-20T22:14:38.6741154Z vermagic: 6.1.94-99.176.amzn2023.x86_64 SMP preempt mod_unload modversions 2024-08-20T22:14:38.6741867Z parm: NvSwitchRegDwords:NvSwitch regkey (charp) 2024-08-20T22:14:38.6742522Z parm: NvSwitchBlacklist:NvSwitchBlacklist=uuid[,uuid...] (charp) 2024-08-20T22:14:38.6743110Z parm: NVreg_ResmanDebugLevel:int 2024-08-20T22:14:38.6743554Z parm: NVreg_RmLogonRC:int 2024-08-20T22:14:38.6743984Z parm: NVreg_ModifyDeviceFiles:int 2024-08-20T22:14:38.6744443Z parm: NVreg_DeviceFileUID:int 2024-08-20T22:14:38.6744870Z parm: NVreg_DeviceFileGID:int 2024-08-20T22:14:38.6745322Z parm: NVreg_DeviceFileMode:int 2024-08-20T22:14:38.6745854Z parm: NVreg_InitializeSystemMemoryAllocations:int 2024-08-20T22:14:38.6746428Z parm: NVreg_UsePageAttributeTable:int 2024-08-20T22:14:38.6746905Z parm: NVreg_EnablePCIeGen3:int 2024-08-20T22:14:38.6747467Z parm: NVreg_EnableMSI:int 2024-08-20T22:14:38.6747899Z parm: NVreg_TCEBypassMode:int 2024-08-20T22:14:38.6748351Z parm: NVreg_EnableStreamMemOPs:int 2024-08-20T22:14:38.6748885Z parm: NVreg_RestrictProfilingToAdminUsers:int 2024-08-20T22:14:38.6749479Z parm: NVreg_PreserveVideoMemoryAllocations:int 2024-08-20T22:14:38.6750038Z parm: NVreg_EnableS0ixPowerManagement:int 2024-08-20T22:14:38.6750634Z parm: NVreg_S0ixPowerManagementVideoMemoryThreshold:int 2024-08-20T22:14:38.6751244Z parm: NVreg_DynamicPowerManagement:int 2024-08-20T22:14:38.6751887Z parm: NVreg_DynamicPowerManagementVideoMemoryThreshold:int 2024-08-20T22:14:38.6752479Z parm: NVreg_EnableGpuFirmware:int 2024-08-20T22:14:38.6752962Z parm: NVreg_EnableGpuFirmwareLogs:int 2024-08-20T22:14:38.6753500Z parm: NVreg_OpenRmEnableUnsupportedGpus:int 2024-08-20T22:14:38.6754052Z parm: NVreg_EnableUserNUMAManagement:int 2024-08-20T22:14:38.6754559Z parm: NVreg_MemoryPoolSize:int 2024-08-20T22:14:38.6755019Z parm: NVreg_KMallocHeapMaxSize:int 2024-08-20T22:14:38.6755499Z parm: NVreg_VMallocHeapMaxSize:int 2024-08-20T22:14:38.6756154Z parm: NVreg_IgnoreMMIOCheck:int 2024-08-20T22:14:38.6756601Z parm: NVreg_NvLinkDisable:int 2024-08-20T22:14:38.6757113Z parm: NVreg_EnablePCIERelaxedOrderingMode:int 2024-08-20T22:14:38.6757641Z parm: NVreg_RegisterPCIDriver:int 2024-08-20T22:14:38.6758122Z parm: NVreg_EnableResizableBar:int 2024-08-20T22:14:38.6758605Z parm: NVreg_EnableDbgBreakpoint:int 2024-08-20T22:14:38.6759101Z parm: NVreg_EnableNonblockingOpen:int 2024-08-20T22:14:38.6759592Z parm: NVreg_RegistryDwords:charp 2024-08-20T22:14:38.6760089Z parm: NVreg_RegistryDwordsPerDevice:charp 2024-08-20T22:14:38.6760922Z parm: NVreg_RmMsg:charp 2024-08-20T22:14:38.6761367Z parm: NVreg_GpuBlacklist:charp 2024-08-20T22:14:38.6761853Z parm: NVreg_TemporaryFilePath:charp 2024-08-20T22:14:38.6762334Z parm: NVreg_ExcludedGpus:charp 2024-08-20T22:14:38.6762789Z parm: NVreg_DmaRemapPeerMmio:int 2024-08-20T22:14:38.6763272Z parm: NVreg_RmNvlinkBandwidth:charp 2024-08-20T22:14:38.6763753Z parm: NVreg_ImexChannelCount:int 2024-08-20T22:14:38.6764207Z parm: rm_firmware_active:charp 2024-08-20T22:14:38.6764602Z + set +e 2024-08-20T22:14:38.6764928Z + nvidia-smi 2024-08-20T22:14:38.6936206Z Tue Aug 20 22:14:38 2024 2024-08-20T22:14:38.6936828Z +-----------------------------------------------------------------------------------------+ 2024-08-20T22:14:38.6937645Z | NVIDIA-SMI 550.54.15 Driver Version: 550.54.15 CUDA Version: 12.4 | 2024-08-20T22:14:38.6938437Z |-----------------------------------------+------------------------+----------------------+ 2024-08-20T22:14:38.6939257Z | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | 2024-08-20T22:14:38.6940158Z | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | 2024-08-20T22:14:38.6940848Z | | | MIG M. | 2024-08-20T22:14:38.6941405Z |=========================================+========================+======================| 2024-08-20T22:14:38.7201712Z | 0 NVIDIA A10G On | 00000000:00:1E.0 Off | 0 | 2024-08-20T22:14:38.7202461Z | 0% 30C P8 23W / 300W | 0MiB / 23028MiB | 0% Default | 2024-08-20T22:14:38.7203104Z | | | N/A | 2024-08-20T22:14:38.7203800Z +-----------------------------------------+------------------------+----------------------+ 2024-08-20T22:14:38.7206068Z 2024-08-20T22:14:38.7206980Z +-----------------------------------------------------------------------------------------+ 2024-08-20T22:14:38.7207627Z | Processes: | 2024-08-20T22:14:38.7208341Z | GPU GI CI PID Type Process name GPU Memory | 2024-08-20T22:14:38.7209037Z | ID ID Usage | 2024-08-20T22:14:38.7209603Z |=========================================================================================| 2024-08-20T22:14:38.7213032Z | No running processes found | 2024-08-20T22:14:38.7213813Z +-----------------------------------------------------------------------------------------+ 2024-08-20T22:14:39.0279693Z + nvidia-smi --query-gpu=gpu_name --format=csv,noheader --id=0 2024-08-20T22:14:39.0469102Z NVIDIA A10G 2024-08-20T22:14:39.0533570Z + NVIDIA_SMI_STATUS=0 2024-08-20T22:14:39.0534196Z + '[' 0 -eq 0 ']' 2024-08-20T22:14:39.0534612Z + echo 'INFO: Ignoring allowed status 0' 2024-08-20T22:14:39.0535040Z + set -e 2024-08-20T22:14:39.0535336Z INFO: Ignoring allowed status 0 2024-08-20T22:14:39.0542317Z == Installing nvidia container toolkit for amzn2023 == 2024-08-20T22:14:39.0546892Z + sudo yum install -y yum-utils 2024-08-20T22:14:39.6726813Z Last metadata expiration check: 0:33:34 ago on Tue Aug 20 21:41:05 2024. 2024-08-20T22:14:39.6949850Z Package dnf-utils-4.3.0-13.amzn2023.0.4.noarch is already installed. 2024-08-20T22:14:39.7250655Z Dependencies resolved. 2024-08-20T22:14:39.7375257Z Nothing to do. 2024-08-20T22:14:39.7375669Z Complete! 2024-08-20T22:14:39.8031530Z + [[ amzn2023 == \a\m\z\n\2\0\2\3 ]] 2024-08-20T22:14:39.8032741Z + YUM_REPO_URL=https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo 2024-08-20T22:14:39.8034260Z + sudo yum-config-manager --add-repo https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo 2024-08-20T22:14:40.0595132Z Adding repo from: https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo 2024-08-20T22:14:40.1319961Z + sudo yum install -y nvidia-docker2 2024-08-20T22:14:40.6488433Z nvidia-container-toolkit 10 kB/s | 833 B 00:00 2024-08-20T22:14:40.6715573Z Package nvidia-docker2-2.14.0-1.noarch is already installed. 2024-08-20T22:14:40.7009854Z Dependencies resolved. 2024-08-20T22:14:40.7134044Z Nothing to do. 2024-08-20T22:14:40.7134501Z Complete! 2024-08-20T22:14:40.7994116Z + sudo systemctl restart docker 2024-08-20T22:15:26.9129600Z nvidia-persistenced failed to initialize. Check syslog for more details. 2024-08-20T22:15:26.9370185Z Tue Aug 20 22:15:26 2024 2024-08-20T22:15:26.9371098Z +-----------------------------------------------------------------------------------------+ 2024-08-20T22:15:26.9372103Z | NVIDIA-SMI 550.54.15 Driver Version: 550.54.15 CUDA Version: 12.4 | 2024-08-20T22:15:26.9373499Z |-----------------------------------------+------------------------+----------------------+ 2024-08-20T22:15:26.9374617Z | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | 2024-08-20T22:15:26.9375636Z | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | 2024-08-20T22:15:26.9376323Z | | | MIG M. | 2024-08-20T22:15:26.9376955Z |=========================================+========================+======================| 2024-08-20T22:15:26.9592729Z | 0 NVIDIA A10G On | 00000000:00:1E.0 Off | 0 | 2024-08-20T22:15:26.9593951Z | 0% 30C P8 23W / 300W | 0MiB / 23028MiB | 0% Default | 2024-08-20T22:15:26.9594630Z | | | N/A | 2024-08-20T22:15:26.9595768Z +-----------------------------------------+------------------------+----------------------+ 2024-08-20T22:15:26.9596541Z 2024-08-20T22:15:26.9597424Z +-----------------------------------------------------------------------------------------+ 2024-08-20T22:15:26.9598063Z | Processes: | 2024-08-20T22:15:26.9598772Z | GPU GI CI PID Type Process name GPU Memory | 2024-08-20T22:15:26.9599462Z | ID ID Usage | 2024-08-20T22:15:26.9600025Z |=========================================================================================| 2024-08-20T22:15:26.9602068Z | No running processes found | 2024-08-20T22:15:26.9603035Z +-----------------------------------------------------------------------------------------+ 2024-08-20T22:15:27.4198615Z Command completed after 1 attempt(s). 2024-08-20T22:15:27.4280464Z ##[group]Run python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84 2024-08-20T22:15:27.4281241Z python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84 2024-08-20T22:15:27.4282141Z python3 -m tools.stats.monitor > usage_log.txt 2>&1 & 2024-08-20T22:15:27.4282792Z echo "monitor-script-pid=${!}" >> "${GITHUB_OUTPUT}" 2024-08-20T22:15:27.4294618Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:15:27.4295118Z env: 2024-08-20T22:15:27.4295391Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:27.4295831Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:27.4296314Z ##[endgroup] 2024-08-20T22:15:27.7231647Z Defaulting to user installation because normal site-packages is not writeable 2024-08-20T22:15:27.7421180Z Requirement already satisfied: psutil==5.9.1 in /home/ec2-user/.local/lib/python3.9/site-packages (5.9.1) 2024-08-20T22:15:27.7425435Z Requirement already satisfied: nvidia-ml-py==11.525.84 in /home/ec2-user/.local/lib/python3.9/site-packages (11.525.84) 2024-08-20T22:15:27.8780862Z Prepare all required actions 2024-08-20T22:15:27.8781470Z Getting action download info 2024-08-20T22:15:27.9767632Z Download action repository 'seemethere/download-artifact-s3@v4' (SHA:1da556a7aa0a088e3153970611f6c432d58e80e6) 2024-08-20T22:15:28.1544089Z Download action repository 'actions/download-artifact@v3' (SHA:9bc31d5ccc31df68ecc42ccf4149144866c47d8a) 2024-08-20T22:15:28.3133558Z ##[group]Run ./.github/actions/download-build-artifacts 2024-08-20T22:15:28.3134116Z with: 2024-08-20T22:15:28.3134495Z name: linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-08-20T22:15:28.3135012Z s3-bucket: gha-artifacts 2024-08-20T22:15:28.3135391Z env: 2024-08-20T22:15:28.3135714Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:28.3136225Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:28.3136780Z ##[endgroup] 2024-08-20T22:15:28.3175851Z ##[group]Run seemethere/download-artifact-s3@v4 2024-08-20T22:15:28.3176367Z with: 2024-08-20T22:15:28.3176792Z name: linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-08-20T22:15:28.3177306Z s3-bucket: gha-artifacts 2024-08-20T22:15:28.3177733Z region: us-east-1 2024-08-20T22:15:28.3178081Z env: 2024-08-20T22:15:28.3178399Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:28.3178908Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:28.3179460Z ##[endgroup] 2024-08-20T22:15:28.8011405Z (node:240771) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2024-08-20T22:15:28.8012233Z 2024-08-20T22:15:28.8012497Z Please migrate your code to use AWS SDK for JavaScript (v3). 2024-08-20T22:15:28.8013224Z For more information, check the migration guide at https://a.co/7PzMCcy 2024-08-20T22:15:28.8014150Z (Use `node --trace-warnings ...` to show where the warning was created) 2024-08-20T22:15:28.8741737Z Found 1 objects with prefix pytorch/pytorch/10479310721/linux-focal-cuda12.1-py3.10-gcc9-sm86/ 2024-08-20T22:15:28.8742866Z Starting download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2024-08-20T22:15:36.4051587Z Finished download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2024-08-20T22:15:36.4059084Z Artifact download has finished successfully 2024-08-20T22:15:36.4408709Z ##[group]Run unzip -o artifacts.zip 2024-08-20T22:15:36.4409139Z unzip -o artifacts.zip 2024-08-20T22:15:36.4419830Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:15:36.4420320Z env: 2024-08-20T22:15:36.4420598Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:36.4421048Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:36.4421527Z ##[endgroup] 2024-08-20T22:15:36.4482011Z Archive: artifacts.zip 2024-08-20T22:15:36.4483085Z creating: dist/ 2024-08-20T22:15:38.5770376Z inflating: dist/torch-2.5.0a0+git40ec5f6-cp310-cp310-linux_x86_64.whl 2024-08-20T22:15:38.5771059Z creating: build/custom_test_artifacts/ 2024-08-20T22:15:38.5771653Z creating: build/custom_test_artifacts/custom-op-build/ 2024-08-20T22:15:38.5772393Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/ 2024-08-20T22:15:38.5773525Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/pkgRedirects/ 2024-08-20T22:15:38.5779785Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeConfigureLog.yaml 2024-08-20T22:15:38.5780736Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/ 2024-08-20T22:15:38.5781769Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-08-20T22:15:38.5782773Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-08-20T22:15:38.5783755Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-08-20T22:15:38.5784852Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-08-20T22:15:38.5786415Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-08-20T22:15:38.5787428Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-08-20T22:15:38.5788437Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-08-20T22:15:38.5789991Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-08-20T22:15:38.5791693Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-08-20T22:15:38.5793833Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-08-20T22:15:38.5794987Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-08-20T22:15:38.5796440Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-08-20T22:15:38.5797899Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-08-20T22:15:38.5798941Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/ 2024-08-20T22:15:38.5799951Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/ 2024-08-20T22:15:38.5839745Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2024-08-20T22:15:38.5880675Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2024-08-20T22:15:38.5883583Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2024-08-20T22:15:38.5926572Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2024-08-20T22:15:38.5928015Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2024-08-20T22:15:38.5929471Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2024-08-20T22:15:38.5930969Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2024-08-20T22:15:38.5932402Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2024-08-20T22:15:38.5933805Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2024-08-20T22:15:38.5935223Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2024-08-20T22:15:38.5936666Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2024-08-20T22:15:38.5938052Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2024-08-20T22:15:38.5939515Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2024-08-20T22:15:38.5940763Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c 2024-08-20T22:15:38.5941999Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin 2024-08-20T22:15:38.5943235Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2024-08-20T22:15:38.5944437Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o 2024-08-20T22:15:38.5945655Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu 2024-08-20T22:15:38.6002168Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out 2024-08-20T22:15:38.6063796Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin 2024-08-20T22:15:38.6066507Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake 2024-08-20T22:15:38.6067641Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeScratch/ 2024-08-20T22:15:38.6068607Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeTmp/ 2024-08-20T22:15:38.6069594Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/cmake.check_cache 2024-08-20T22:15:38.6070598Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/ 2024-08-20T22:15:38.6071776Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.ts 2024-08-20T22:15:38.6073016Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.make 2024-08-20T22:15:38.6074137Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/depend.make 2024-08-20T22:15:38.6075189Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/link.txt 2024-08-20T22:15:38.6076368Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/cmake_clean.cmake 2024-08-20T22:15:38.6077460Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/build.make 2024-08-20T22:15:38.6078551Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/DependInfo.cmake 2024-08-20T22:15:38.6079635Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/flags.make 2024-08-20T22:15:38.6080708Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/progress.make 2024-08-20T22:15:38.6094613Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o.d 2024-08-20T22:15:38.6237853Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o 2024-08-20T22:15:38.6238975Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/ 2024-08-20T22:15:38.6240251Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.ts 2024-08-20T22:15:38.6241640Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.make 2024-08-20T22:15:38.6242857Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/depend.make 2024-08-20T22:15:38.6244074Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/link.txt 2024-08-20T22:15:38.6245310Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/cmake_clean.cmake 2024-08-20T22:15:38.6246569Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/build.make 2024-08-20T22:15:38.6247733Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/DependInfo.cmake 2024-08-20T22:15:38.6249075Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/flags.make 2024-08-20T22:15:38.6250219Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/progress.make 2024-08-20T22:15:38.6267803Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o.d 2024-08-20T22:15:38.6352714Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o 2024-08-20T22:15:38.6355923Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-08-20T22:15:38.6357911Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/TargetDirectories.txt 2024-08-20T22:15:38.6359091Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/progress.marks 2024-08-20T22:15:38.6360649Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile2 2024-08-20T22:15:38.6361897Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile.cmake 2024-08-20T22:15:38.6363080Z inflating: build/custom_test_artifacts/custom-op-build/detect_cuda_version.cc 2024-08-20T22:15:38.6363948Z inflating: build/custom_test_artifacts/custom-op-build/CMakeCache.txt 2024-08-20T22:15:38.6364733Z inflating: build/custom_test_artifacts/custom-op-build/Makefile 2024-08-20T22:15:38.6365543Z inflating: build/custom_test_artifacts/custom-op-build/cmake_install.cmake 2024-08-20T22:15:38.6482552Z inflating: build/custom_test_artifacts/custom-op-build/libcustom_ops.so 2024-08-20T22:15:38.6546594Z inflating: build/custom_test_artifacts/custom-op-build/test_custom_ops 2024-08-20T22:15:38.6547594Z creating: build/custom_test_artifacts/jit-hook-build/ 2024-08-20T22:15:38.6548295Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/ 2024-08-20T22:15:38.6549116Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/pkgRedirects/ 2024-08-20T22:15:38.6554340Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeConfigureLog.yaml 2024-08-20T22:15:38.6555583Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/ 2024-08-20T22:15:38.6556838Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-08-20T22:15:38.6557863Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-08-20T22:15:38.6559079Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-08-20T22:15:38.6560566Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-08-20T22:15:38.6562076Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-08-20T22:15:38.6563096Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-08-20T22:15:38.6564246Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-08-20T22:15:38.6565658Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-08-20T22:15:38.6567096Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-08-20T22:15:38.6568610Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-08-20T22:15:38.6569860Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-08-20T22:15:38.6571355Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-08-20T22:15:38.6572932Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-08-20T22:15:38.6574068Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/ 2024-08-20T22:15:38.6575260Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/ 2024-08-20T22:15:38.6613935Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2024-08-20T22:15:38.6653582Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2024-08-20T22:15:38.6655170Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2024-08-20T22:15:38.6700774Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2024-08-20T22:15:38.6702691Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2024-08-20T22:15:38.6704821Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2024-08-20T22:15:38.6706843Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2024-08-20T22:15:38.6708582Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2024-08-20T22:15:38.6710459Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2024-08-20T22:15:38.6712287Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2024-08-20T22:15:38.6714088Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2024-08-20T22:15:38.6715757Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2024-08-20T22:15:38.6717141Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2024-08-20T22:15:38.6718385Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c 2024-08-20T22:15:38.6719594Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin 2024-08-20T22:15:38.6720819Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2024-08-20T22:15:38.6722006Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o 2024-08-20T22:15:38.6723218Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu 2024-08-20T22:15:38.6776003Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out 2024-08-20T22:15:38.6837454Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin 2024-08-20T22:15:38.6839049Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake 2024-08-20T22:15:38.6840368Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeScratch/ 2024-08-20T22:15:38.6841514Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeTmp/ 2024-08-20T22:15:38.6842719Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/cmake.check_cache 2024-08-20T22:15:38.6843958Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/ 2024-08-20T22:15:38.6845412Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.ts 2024-08-20T22:15:38.6847067Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.make 2024-08-20T22:15:38.6848361Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/depend.make 2024-08-20T22:15:38.6849443Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/link.txt 2024-08-20T22:15:38.6850750Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/cmake_clean.cmake 2024-08-20T22:15:38.6851878Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/build.make 2024-08-20T22:15:38.6853001Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/DependInfo.cmake 2024-08-20T22:15:38.6854126Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/flags.make 2024-08-20T22:15:38.6855242Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/progress.make 2024-08-20T22:15:38.6869212Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o.d 2024-08-20T22:15:38.6933508Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o 2024-08-20T22:15:38.6935118Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-08-20T22:15:38.6936535Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/TargetDirectories.txt 2024-08-20T22:15:38.6937768Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/progress.marks 2024-08-20T22:15:38.6938913Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile2 2024-08-20T22:15:38.6939809Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile.cmake 2024-08-20T22:15:38.6940722Z inflating: build/custom_test_artifacts/jit-hook-build/detect_cuda_version.cc 2024-08-20T22:15:38.6941875Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeCache.txt 2024-08-20T22:15:38.6942931Z inflating: build/custom_test_artifacts/jit-hook-build/Makefile 2024-08-20T22:15:38.6943958Z inflating: build/custom_test_artifacts/jit-hook-build/cmake_install.cmake 2024-08-20T22:15:38.6993657Z inflating: build/custom_test_artifacts/jit-hook-build/test_jit_hooks 2024-08-20T22:15:38.6994674Z creating: build/custom_test_artifacts/custom-backend-build/ 2024-08-20T22:15:38.6995462Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/ 2024-08-20T22:15:38.6996433Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/pkgRedirects/ 2024-08-20T22:15:38.7002605Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeConfigureLog.yaml 2024-08-20T22:15:38.7003931Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/ 2024-08-20T22:15:38.7005151Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-08-20T22:15:38.7006266Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-08-20T22:15:38.7007671Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-08-20T22:15:38.7009051Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-08-20T22:15:38.7010458Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-08-20T22:15:38.7011518Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-08-20T22:15:38.7012852Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-08-20T22:15:38.7014250Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-08-20T22:15:38.7015776Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-08-20T22:15:38.7017295Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-08-20T22:15:38.7018665Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-08-20T22:15:38.7020454Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-08-20T22:15:38.7021952Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-08-20T22:15:38.7023061Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/ 2024-08-20T22:15:38.7024124Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/ 2024-08-20T22:15:38.7062559Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2024-08-20T22:15:38.7101996Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2024-08-20T22:15:38.7103890Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2024-08-20T22:15:38.7148778Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2024-08-20T22:15:38.7150764Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2024-08-20T22:15:38.7152772Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2024-08-20T22:15:38.7154855Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2024-08-20T22:15:38.7156861Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2024-08-20T22:15:38.7158844Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2024-08-20T22:15:38.7161005Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2024-08-20T22:15:38.7162795Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2024-08-20T22:15:38.7164484Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2024-08-20T22:15:38.7165839Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2024-08-20T22:15:38.7167153Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c 2024-08-20T22:15:38.7168432Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin 2024-08-20T22:15:38.7169729Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2024-08-20T22:15:38.7170990Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o 2024-08-20T22:15:38.7172269Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu 2024-08-20T22:15:38.7223861Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out 2024-08-20T22:15:38.7284365Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin 2024-08-20T22:15:38.7286053Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake 2024-08-20T22:15:38.7287458Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeScratch/ 2024-08-20T22:15:38.7288697Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeTmp/ 2024-08-20T22:15:38.7290006Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/cmake.check_cache 2024-08-20T22:15:38.7291565Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/ 2024-08-20T22:15:38.7293107Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.ts 2024-08-20T22:15:38.7294812Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.make 2024-08-20T22:15:38.7296135Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/depend.make 2024-08-20T22:15:38.7297283Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/link.txt 2024-08-20T22:15:38.7298480Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/cmake_clean.cmake 2024-08-20T22:15:38.7300167Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/build.make 2024-08-20T22:15:38.7301394Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/DependInfo.cmake 2024-08-20T22:15:38.7302586Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/flags.make 2024-08-20T22:15:38.7303761Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/progress.make 2024-08-20T22:15:38.7305010Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o.d 2024-08-20T22:15:38.7425903Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o 2024-08-20T22:15:38.7427768Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/ 2024-08-20T22:15:38.7430964Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.ts 2024-08-20T22:15:38.7434477Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.make 2024-08-20T22:15:38.7437218Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/depend.make 2024-08-20T22:15:38.7438440Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/link.txt 2024-08-20T22:15:38.7439693Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/cmake_clean.cmake 2024-08-20T22:15:38.7440948Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/build.make 2024-08-20T22:15:38.7442216Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/DependInfo.cmake 2024-08-20T22:15:38.7443475Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/flags.make 2024-08-20T22:15:38.7444721Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/progress.make 2024-08-20T22:15:38.7455421Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o.d 2024-08-20T22:15:38.7512433Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o 2024-08-20T22:15:38.7515916Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-08-20T22:15:38.7517952Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/TargetDirectories.txt 2024-08-20T22:15:38.7519176Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/progress.marks 2024-08-20T22:15:38.7520469Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile2 2024-08-20T22:15:38.7521688Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile.cmake 2024-08-20T22:15:38.7522648Z inflating: build/custom_test_artifacts/custom-backend-build/detect_cuda_version.cc 2024-08-20T22:15:38.7523733Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeCache.txt 2024-08-20T22:15:38.7524567Z inflating: build/custom_test_artifacts/custom-backend-build/Makefile 2024-08-20T22:15:38.7525428Z inflating: build/custom_test_artifacts/custom-backend-build/cmake_install.cmake 2024-08-20T22:15:38.7626189Z inflating: build/custom_test_artifacts/custom-backend-build/libcustom_backend.so 2024-08-20T22:15:38.7668302Z inflating: build/custom_test_artifacts/custom-backend-build/test_custom_backend 2024-08-20T22:15:38.7669080Z creating: build/lib/ 2024-08-20T22:15:38.7757291Z inflating: build/lib/libprotobuf-lite.a 2024-08-20T22:15:38.8212965Z inflating: build/lib/libprotobuf.a 2024-08-20T22:15:38.8222743Z inflating: build/lib/libpthreadpool.a 2024-08-20T22:15:38.8231054Z inflating: build/lib/libcpuinfo.a 2024-08-20T22:15:38.8239316Z inflating: build/lib/libcpuinfo_internals.a 2024-08-20T22:15:38.8239977Z inflating: build/lib/libclog.a 2024-08-20T22:15:38.8258551Z inflating: build/lib/libnnpack.a 2024-08-20T22:15:38.8261448Z inflating: build/lib/libnnpack_reference_layers.a 2024-08-20T22:15:38.8326337Z inflating: build/lib/libgtest.a 2024-08-20T22:15:38.8401449Z inflating: build/lib/libbenchmark.a 2024-08-20T22:15:38.8465706Z inflating: build/lib/libasmjit.a 2024-08-20T22:15:38.8473229Z inflating: build/lib/libittnotify.a 2024-08-20T22:15:38.8501300Z inflating: build/lib/libtensorpipe_uv.a 2024-08-20T22:15:38.8628444Z inflating: build/lib/libgloo.a 2024-08-20T22:15:38.8649090Z inflating: build/lib/libfmt.a 2024-08-20T22:15:38.8744295Z inflating: build/lib/libc10.so 2024-08-20T22:15:38.8746135Z inflating: build/lib/libcaffe2_nvrtc.so 2024-08-20T22:15:38.8747570Z inflating: build/lib/libtorch_global_deps.so 2024-08-20T22:15:38.9251001Z inflating: build/lib/libprotoc.a 2024-08-20T22:15:38.9270470Z inflating: build/lib/libpytorch_qnnpack.a 2024-08-20T22:15:38.9288710Z inflating: build/lib/libgmock.a 2024-08-20T22:15:38.9289297Z inflating: build/lib/libgtest_main.a 2024-08-20T22:15:38.9290207Z inflating: build/lib/libbenchmark_main.a 2024-08-20T22:15:38.9680227Z inflating: build/lib/libgloo_cuda.a 2024-08-20T22:15:39.9867780Z inflating: build/lib/libdnnl.a 2024-08-20T22:15:40.0447509Z inflating: build/lib/libtensorpipe.a 2024-08-20T22:15:40.0505828Z inflating: build/lib/libc10_cuda.so 2024-08-20T22:15:40.0507040Z inflating: build/lib/libgmock_main.a 2024-08-20T22:15:40.1767916Z inflating: build/lib/libfbgemm.a 2024-08-20T22:15:40.2024685Z inflating: build/lib/libtensorpipe_cuda.a 2024-08-20T22:15:40.2532095Z inflating: build/lib/libkineto.a 2024-08-20T22:15:40.2717279Z inflating: build/lib/libXNNPACK.a 2024-08-20T22:15:40.2759379Z inflating: build/lib/libonnx_proto.a 2024-08-20T22:15:40.3452765Z inflating: build/lib/libonnx.a 2024-08-20T22:15:42.7966853Z inflating: build/lib/libtorch_cpu.so 2024-08-20T22:15:42.7971009Z inflating: build/lib/libunbox_lib.a 2024-08-20T22:15:42.7975299Z inflating: build/lib/libshm.so 2024-08-20T22:15:44.8684996Z inflating: build/lib/libtorch_cuda.so 2024-08-20T22:15:44.8685860Z inflating: build/lib/libtorch.so 2024-08-20T22:15:44.8688857Z inflating: build/lib/libc10d_cuda_test.so 2024-08-20T22:15:45.6903759Z inflating: build/lib/libtorch_cuda_linalg.so 2024-08-20T22:15:45.8907938Z inflating: build/lib/libtorch_python.so 2024-08-20T22:15:45.8979957Z inflating: build/lib/libtorchbind_test.so 2024-08-20T22:15:45.9000685Z inflating: build/lib/libjitbackend_test.so 2024-08-20T22:15:45.9026186Z inflating: build/lib/libbackend_with_compiler.so 2024-08-20T22:15:45.9052416Z inflating: build/lib/libaoti_custom_ops.so 2024-08-20T22:15:45.9087429Z inflating: build/lib/libnnapi_backend.so 2024-08-20T22:15:45.9088055Z creating: build/bin/ 2024-08-20T22:15:45.9138528Z inflating: build/bin/c10_CompileTimeFunctionPointer_test 2024-08-20T22:15:45.9190288Z inflating: build/bin/c10_DeviceGuard_test 2024-08-20T22:15:45.9241561Z inflating: build/bin/c10_Device_test 2024-08-20T22:15:45.9301770Z inflating: build/bin/c10_DispatchKeySet_test 2024-08-20T22:15:45.9354674Z inflating: build/bin/c10_Scalar_test 2024-08-20T22:15:45.9404246Z inflating: build/bin/c10_StreamGuard_test 2024-08-20T22:15:45.9456107Z inflating: build/bin/c10_SymInt_test 2024-08-20T22:15:45.9511519Z inflating: build/bin/c10_InlineDeviceGuard_test 2024-08-20T22:15:45.9567765Z inflating: build/bin/c10_InlineStreamGuard_test 2024-08-20T22:15:45.9624496Z inflating: build/bin/c10_SizesAndStrides_test 2024-08-20T22:15:45.9696040Z inflating: build/bin/c10_cow_test 2024-08-20T22:15:45.9749460Z inflating: build/bin/c10_Bitset_test 2024-08-20T22:15:45.9799140Z inflating: build/bin/c10_ConstexprCrc_test 2024-08-20T22:15:45.9849360Z inflating: build/bin/c10_DeadlockDetection_test 2024-08-20T22:15:45.9900728Z inflating: build/bin/c10_Half_test 2024-08-20T22:15:45.9957331Z inflating: build/bin/c10_LeftRight_test 2024-08-20T22:15:46.0012795Z inflating: build/bin/c10_Metaprogramming_test 2024-08-20T22:15:46.0063406Z inflating: build/bin/c10_Synchronized_test 2024-08-20T22:15:46.0121753Z inflating: build/bin/c10_ThreadLocal_test 2024-08-20T22:15:46.0174029Z inflating: build/bin/c10_TypeIndex_test 2024-08-20T22:15:46.0226263Z inflating: build/bin/c10_TypeList_test 2024-08-20T22:15:46.0275391Z inflating: build/bin/c10_TypeTraits_test 2024-08-20T22:15:46.0328080Z inflating: build/bin/c10_accumulate_test 2024-08-20T22:15:46.0384468Z inflating: build/bin/c10_bfloat16_test 2024-08-20T22:15:46.0434476Z inflating: build/bin/c10_bit_cast_test 2024-08-20T22:15:46.0491750Z inflating: build/bin/c10_complex_math_test 2024-08-20T22:15:46.0548651Z inflating: build/bin/c10_complex_test 2024-08-20T22:15:46.0601783Z inflating: build/bin/c10_exception_test 2024-08-20T22:15:46.0652469Z inflating: build/bin/c10_flags_test 2024-08-20T22:15:46.0702965Z inflating: build/bin/c10_generic_math_test 2024-08-20T22:15:46.0868765Z inflating: build/bin/c10_intrusive_ptr_test 2024-08-20T22:15:46.0919759Z inflating: build/bin/c10_irange_test 2024-08-20T22:15:46.0974132Z inflating: build/bin/c10_lazy_test 2024-08-20T22:15:46.1032041Z inflating: build/bin/c10_logging_test 2024-08-20T22:15:46.1108338Z inflating: build/bin/c10_optional_test 2024-08-20T22:15:46.1170438Z inflating: build/bin/c10_ordered_preserving_dict_test 2024-08-20T22:15:46.1224738Z inflating: build/bin/c10_registry_test 2024-08-20T22:15:46.1377564Z inflating: build/bin/c10_small_vector_test 2024-08-20T22:15:46.1430074Z inflating: build/bin/c10_ssize_test 2024-08-20T22:15:46.1482537Z inflating: build/bin/c10_string_util_test 2024-08-20T22:15:46.1533557Z inflating: build/bin/c10_tempfile_test 2024-08-20T22:15:46.1592855Z inflating: build/bin/c10_string_view_test 2024-08-20T22:15:46.1642543Z inflating: build/bin/c10_intrusive_ptr_benchmark 2024-08-20T22:15:46.1698599Z inflating: build/bin/c10_typeid_test 2024-08-20T22:15:46.2147565Z inflating: build/bin/protoc-3.13.0.0 2024-08-20T22:15:46.2596430Z inflating: build/bin/protoc 2024-08-20T22:15:46.2649757Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_1_var_test 2024-08-20T22:15:46.2703399Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_catches_stream 2024-08-20T22:15:46.2757054Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_catches_thread_and_block_and_device 2024-08-20T22:15:46.2809808Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_from_2_processes 2024-08-20T22:15:46.2863201Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_blocks_and_threads 2024-08-20T22:15:46.2916478Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_multiple_blocks 2024-08-20T22:15:46.2966036Z inflating: build/bin/c10_cuda_CUDATest 2024-08-20T22:15:46.3019380Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_same_block 2024-08-20T22:15:46.3352219Z inflating: build/bin/vec_test_all_types_DEFAULT 2024-08-20T22:15:46.3698131Z inflating: build/bin/vec_test_all_types_AVX512 2024-08-20T22:15:46.4059773Z inflating: build/bin/vec_test_all_types_AVX2 2024-08-20T22:15:46.4112979Z inflating: build/bin/BackoffTest 2024-08-20T22:15:46.4167046Z inflating: build/bin/FileStoreTest 2024-08-20T22:15:46.4223355Z inflating: build/bin/TCPStoreTest 2024-08-20T22:15:46.4277407Z inflating: build/bin/HashStoreTest 2024-08-20T22:15:46.4291309Z inflating: build/bin/ProcessGroupMPITest 2024-08-20T22:15:46.4345369Z inflating: build/bin/test_edge_op_registration 2024-08-20T22:15:46.4349752Z inflating: build/bin/torch_shm_manager 2024-08-20T22:15:46.4352820Z inflating: build/bin/example_allreduce 2024-08-20T22:15:46.4408960Z inflating: build/bin/test_dist_autograd 2024-08-20T22:15:46.4478044Z inflating: build/bin/test_cpp_rpc 2024-08-20T22:15:46.4481046Z inflating: build/bin/parallel_benchmark 2024-08-20T22:15:46.4548379Z inflating: build/bin/test_mobile_nnc 2024-08-20T22:15:46.4558102Z inflating: build/bin/aot_model_compiler_test 2024-08-20T22:15:46.4905528Z inflating: build/bin/test_lazy 2024-08-20T22:15:46.6092372Z inflating: build/bin/test_api 2024-08-20T22:15:46.6166925Z inflating: build/bin/Dict_test 2024-08-20T22:15:46.6219364Z inflating: build/bin/Dimname_test 2024-08-20T22:15:46.6285088Z inflating: build/bin/MaybeOwned_test 2024-08-20T22:15:46.6342759Z inflating: build/bin/NamedTensor_test 2024-08-20T22:15:46.6402286Z inflating: build/bin/apply_utils_test 2024-08-20T22:15:46.6462461Z inflating: build/bin/atest 2024-08-20T22:15:46.6525409Z inflating: build/bin/basic 2024-08-20T22:15:46.6580912Z inflating: build/bin/broadcast_test 2024-08-20T22:15:46.6632686Z inflating: build/bin/cpu_allocator_test 2024-08-20T22:15:46.6690794Z inflating: build/bin/cpu_generator_test 2024-08-20T22:15:46.6744324Z inflating: build/bin/cpu_profiling_allocator_test 2024-08-20T22:15:46.6838205Z inflating: build/bin/cpu_rng_test 2024-08-20T22:15:46.6888999Z inflating: build/bin/dispatch_key_set_test 2024-08-20T22:15:46.6940033Z inflating: build/bin/dlconvertor_test 2024-08-20T22:15:46.6998626Z inflating: build/bin/extension_backend_test 2024-08-20T22:15:46.7053353Z inflating: build/bin/half_test 2024-08-20T22:15:46.7150303Z inflating: build/bin/ivalue_test 2024-08-20T22:15:46.7200187Z inflating: build/bin/lazy_tensor_test 2024-08-20T22:15:46.7255640Z inflating: build/bin/math_kernel_test 2024-08-20T22:15:46.7311125Z inflating: build/bin/memory_format_test 2024-08-20T22:15:46.7364163Z inflating: build/bin/memory_overlapping_test 2024-08-20T22:15:46.7417704Z inflating: build/bin/mobile_memory_cleanup 2024-08-20T22:15:46.7474102Z inflating: build/bin/native_test 2024-08-20T22:15:46.7525132Z inflating: build/bin/operator_name_test 2024-08-20T22:15:46.7577149Z inflating: build/bin/operators_test 2024-08-20T22:15:46.7629448Z inflating: build/bin/packedtensoraccessor_test 2024-08-20T22:15:46.7697053Z inflating: build/bin/pow_test 2024-08-20T22:15:46.7755153Z inflating: build/bin/quantized_test 2024-08-20T22:15:46.7808946Z inflating: build/bin/reduce_ops_test 2024-08-20T22:15:46.7861447Z inflating: build/bin/reportMemoryUsage_test 2024-08-20T22:15:46.7917829Z inflating: build/bin/scalar_tensor_test 2024-08-20T22:15:46.7977022Z inflating: build/bin/scalar_test 2024-08-20T22:15:46.8030050Z inflating: build/bin/StorageUtils_test 2024-08-20T22:15:46.8082534Z inflating: build/bin/stride_properties_test 2024-08-20T22:15:46.8161992Z inflating: build/bin/tensor_iterator_test 2024-08-20T22:15:46.8216405Z inflating: build/bin/test_parallel 2024-08-20T22:15:46.8219555Z inflating: build/bin/thread_init_test 2024-08-20T22:15:46.8275937Z inflating: build/bin/type_ptr_test 2024-08-20T22:15:46.8336376Z inflating: build/bin/type_test 2024-08-20T22:15:46.8390572Z inflating: build/bin/undefined_tensor_test 2024-08-20T22:15:46.8391903Z inflating: build/bin/verify_api_visibility 2024-08-20T22:15:46.8462135Z inflating: build/bin/legacy_vmap_test 2024-08-20T22:15:46.8513476Z inflating: build/bin/weakref_test 2024-08-20T22:15:46.8565699Z inflating: build/bin/wrapdim_test 2024-08-20T22:15:46.8617612Z inflating: build/bin/xla_tensor_test 2024-08-20T22:15:46.8678524Z inflating: build/bin/IListRef_test 2024-08-20T22:15:46.8786158Z inflating: build/bin/List_test 2024-08-20T22:15:46.8852770Z inflating: build/bin/KernelFunction_test 2024-08-20T22:15:46.8976075Z inflating: build/bin/kernel_function_legacy_test 2024-08-20T22:15:46.9073635Z inflating: build/bin/kernel_function_test 2024-08-20T22:15:46.9203219Z inflating: build/bin/kernel_lambda_legacy_test 2024-08-20T22:15:46.9307474Z inflating: build/bin/kernel_lambda_test 2024-08-20T22:15:46.9369127Z inflating: build/bin/kernel_stackbased_test 2024-08-20T22:15:46.9467646Z inflating: build/bin/make_boxed_from_unboxed_functor_test 2024-08-20T22:15:46.9518875Z inflating: build/bin/CppSignature_test 2024-08-20T22:15:46.9568496Z inflating: build/bin/op_allowlist_test 2024-08-20T22:15:46.9624639Z inflating: build/bin/backend_fallback_test 2024-08-20T22:15:46.9929213Z inflating: build/bin/op_registration_test 2024-08-20T22:15:46.9993317Z inflating: build/bin/inline_container_test 2024-08-20T22:15:47.0046636Z inflating: build/bin/cuda_apply_test 2024-08-20T22:15:47.0099599Z inflating: build/bin/cuda_allocator_test 2024-08-20T22:15:47.0161133Z inflating: build/bin/cuda_atomic_ops_test 2024-08-20T22:15:47.0215692Z inflating: build/bin/cuda_caching_host_allocator_test 2024-08-20T22:15:47.0286263Z inflating: build/bin/cuda_complex_math_test 2024-08-20T22:15:47.0345816Z inflating: build/bin/cuda_complex_test 2024-08-20T22:15:47.0396571Z inflating: build/bin/cuda_device_test 2024-08-20T22:15:47.0453834Z inflating: build/bin/cuda_cub_test 2024-08-20T22:15:47.0505508Z inflating: build/bin/cuda_dlconvertor_test 2024-08-20T22:15:47.0570445Z inflating: build/bin/cuda_distributions_test 2024-08-20T22:15:47.0627445Z inflating: build/bin/cuda_generator_test 2024-08-20T22:15:47.0677724Z inflating: build/bin/cuda_half_test 2024-08-20T22:15:47.0729310Z inflating: build/bin/cuda_integer_divider_test 2024-08-20T22:15:47.0779189Z inflating: build/bin/cuda_optional_test 2024-08-20T22:15:47.0831151Z inflating: build/bin/cuda_packedtensoraccessor_test 2024-08-20T22:15:47.0884637Z inflating: build/bin/cuda_reportMemoryUsage_test 2024-08-20T22:15:47.0934938Z inflating: build/bin/cuda_allocatorTraceTracker_test 2024-08-20T22:15:47.0996992Z inflating: build/bin/cuda_stream_test 2024-08-20T22:15:47.1046932Z inflating: build/bin/cuda_cudnn_test 2024-08-20T22:15:47.1098672Z inflating: build/bin/cuda_vectorized_test 2024-08-20T22:15:47.1113163Z inflating: build/bin/tutorial_tensorexpr 2024-08-20T22:15:47.1180248Z inflating: build/bin/ProcessGroupGlooTest 2024-08-20T22:15:47.1237418Z inflating: build/bin/ProcessGroupGlooAsyncTest 2024-08-20T22:15:47.1303806Z inflating: build/bin/ProcessGroupNCCLTest 2024-08-20T22:15:47.1367300Z inflating: build/bin/ProcessGroupNCCLErrorsTest 2024-08-20T22:15:47.2198983Z inflating: build/bin/test_tensorexpr 2024-08-20T22:15:47.2784837Z inflating: build/bin/test_jit 2024-08-20T22:15:47.2785694Z creating: .additional_ci_files/ 2024-08-20T22:15:47.2845984Z inflating: .additional_ci_files/test-times.json 2024-08-20T22:15:47.3087062Z inflating: .additional_ci_files/test-class-times.json 2024-08-20T22:15:47.3147593Z ##[group]Run rm artifacts.zip 2024-08-20T22:15:47.3147981Z rm artifacts.zip 2024-08-20T22:15:47.3158060Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:15:47.3158550Z env: 2024-08-20T22:15:47.3158825Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:47.3159455Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:47.3159934Z ##[endgroup] 2024-08-20T22:15:47.4338567Z ##[group]Run df -H 2024-08-20T22:15:47.4338884Z df -H 2024-08-20T22:15:47.4347652Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:15:47.4348143Z env: 2024-08-20T22:15:47.4348422Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:47.4348872Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:47.4349353Z ##[endgroup] 2024-08-20T22:15:47.4419528Z Filesystem Size Used Avail Use% Mounted on 2024-08-20T22:15:47.4420215Z devtmpfs 4.2M 0 4.2M 0% /dev 2024-08-20T22:15:47.4420692Z tmpfs 34G 0 34G 0% /dev/shm 2024-08-20T22:15:47.4421159Z tmpfs 14G 553k 14G 1% /run 2024-08-20T22:15:47.4421603Z /dev/nvme0n1p1 161G 76G 86G 48% / 2024-08-20T22:15:47.4422282Z tmpfs 34G 963k 34G 1% /tmp 2024-08-20T22:15:47.4422770Z /dev/nvme0n1p128 11M 1.4M 9.2M 13% /boot/efi 2024-08-20T22:15:47.4423284Z tmpfs 6.7G 0 6.7G 0% /run/user/0 2024-08-20T22:15:47.4464113Z Prepare all required actions 2024-08-20T22:15:47.4464547Z Getting action download info 2024-08-20T22:15:47.5733943Z ##[group]Run ./.github/actions/download-td-artifacts 2024-08-20T22:15:47.5734393Z with: 2024-08-20T22:15:47.5734645Z env: 2024-08-20T22:15:47.5734915Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:47.5735349Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:47.5735828Z ##[endgroup] 2024-08-20T22:15:47.6101419Z ##[group]Run seemethere/download-artifact-s3@v4 2024-08-20T22:15:47.6101860Z with: 2024-08-20T22:15:47.6102118Z name: td_results 2024-08-20T22:15:47.6102421Z s3-bucket: gha-artifacts 2024-08-20T22:15:47.6102765Z region: us-east-1 2024-08-20T22:15:47.6103055Z env: 2024-08-20T22:15:47.6103325Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:47.6103763Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:47.6104253Z ##[endgroup] 2024-08-20T22:15:48.0965804Z (node:240791) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2024-08-20T22:15:48.0966730Z 2024-08-20T22:15:48.0967002Z Please migrate your code to use AWS SDK for JavaScript (v3). 2024-08-20T22:15:48.0967729Z For more information, check the migration guide at https://a.co/7PzMCcy 2024-08-20T22:15:48.0968607Z (Use `node --trace-warnings ...` to show where the warning was created) 2024-08-20T22:15:48.1697684Z Found 0 objects with prefix pytorch/pytorch/10479310721/td_results/ 2024-08-20T22:15:48.1705326Z Artifact download has finished successfully 2024-08-20T22:15:48.2046979Z ##[group]Run mkdir -p .additional_ci_files 2024-08-20T22:15:48.2047466Z mkdir -p .additional_ci_files 2024-08-20T22:15:48.2048032Z mv td_results.json .additional_ci_files/td_results.json 2024-08-20T22:15:48.2057101Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:15:48.2057593Z env: 2024-08-20T22:15:48.2057889Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:48.2058357Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:48.2058840Z ##[endgroup] 2024-08-20T22:15:48.2169582Z mv: cannot stat 'td_results.json': No such file or directory 2024-08-20T22:15:48.2182609Z ##[error]Process completed with exit code 1. 2024-08-20T22:15:48.2275432Z ##[group]Run .github/scripts/parse_ref.py 2024-08-20T22:15:48.2275899Z .github/scripts/parse_ref.py 2024-08-20T22:15:48.2284214Z shell: /usr/bin/bash -e {0} 2024-08-20T22:15:48.2284557Z env: 2024-08-20T22:15:48.2284831Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:48.2285282Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:48.2285752Z ##[endgroup] 2024-08-20T22:15:48.2588836Z Prepare all required actions 2024-08-20T22:15:48.2627534Z ##[group]Run ./.github/actions/get-workflow-job-id 2024-08-20T22:15:48.2627987Z with: 2024-08-20T22:15:48.2628542Z github-token: *** 2024-08-20T22:15:48.2628846Z env: 2024-08-20T22:15:48.2629385Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:48.2629836Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:48.2630314Z ##[endgroup] 2024-08-20T22:15:48.2718616Z ##[group]Run set -eux 2024-08-20T22:15:48.2718952Z set -eux 2024-08-20T22:15:48.2719572Z python3 .github/scripts/get_workflow_job_id.py "${GITHUB_RUN_ID}" "${RUNNER_NAME}" 2024-08-20T22:15:48.2728760Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:15:48.2729246Z env: 2024-08-20T22:15:48.2729522Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:48.2729968Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:48.2730605Z GITHUB_TOKEN: *** 2024-08-20T22:15:48.2730911Z ##[endgroup] 2024-08-20T22:15:48.2758694Z + python3 .github/scripts/get_workflow_job_id.py 10479310721 i-067d93865e69cb17b 2024-08-20T22:15:49.1604091Z setting job-id=29026299696 2024-08-20T22:15:49.1606630Z setting job-name=cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (aot_eager_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:15:49.1825162Z Prepare all required actions 2024-08-20T22:15:49.1825606Z Getting action download info 2024-08-20T22:15:49.3183282Z ##[group]Run ./.github/actions/filter-test-configs 2024-08-20T22:15:49.3183742Z with: 2024-08-20T22:15:49.3184195Z github-token: *** 2024-08-20T22:15:49.3190836Z test-matrix: {"include": [{"config": "dynamo_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}]} 2024-08-20T22:15:49.3198320Z job-name: cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (aot_eager_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:15:49.3199187Z env: 2024-08-20T22:15:49.3199508Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:49.3199960Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:49.3200447Z ##[endgroup] 2024-08-20T22:15:49.3242719Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2024-08-20T22:15:49.3243272Z with: 2024-08-20T22:15:49.3243538Z shell: bash 2024-08-20T22:15:49.3243835Z timeout_minutes: 10 2024-08-20T22:15:49.3244151Z max_attempts: 5 2024-08-20T22:15:49.3244464Z retry_wait_seconds: 30 2024-08-20T22:15:49.3245576Z command: set -eux # PyYAML 6.0 doesn't work with MacOS x86 anymore # This must run on Python-3.7 (AmazonLinux2) so can't use request=3.32.2 python3 -m pip install requests==2.27.1 pyyaml==6.0.1 2024-08-20T22:15:49.3246745Z polling_interval_seconds: 1 2024-08-20T22:15:49.3247112Z warning_on_retry: true 2024-08-20T22:15:49.3247636Z continue_on_error: false 2024-08-20T22:15:49.3247980Z env: 2024-08-20T22:15:49.3248255Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:49.3248697Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:49.3249395Z GITHUB_TOKEN: *** 2024-08-20T22:15:49.3249714Z ##[endgroup] 2024-08-20T22:15:49.5627136Z + python3 -m pip install requests==2.27.1 pyyaml==6.0.1 2024-08-20T22:15:50.1440905Z Collecting requests==2.27.1 2024-08-20T22:15:50.1818235Z Downloading requests-2.27.1-py2.py3-none-any.whl.metadata (5.0 kB) 2024-08-20T22:15:50.2277850Z Collecting pyyaml==6.0.1 2024-08-20T22:15:50.2316792Z Downloading PyYAML-6.0.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (2.1 kB) 2024-08-20T22:15:50.2779268Z Collecting urllib3<1.27,>=1.21.1 (from requests==2.27.1) 2024-08-20T22:15:50.2817854Z Downloading urllib3-1.26.19-py2.py3-none-any.whl.metadata (49 kB) 2024-08-20T22:15:50.2988929Z Requirement already satisfied: certifi>=2017.4.17 in /home/ec2-user/miniconda/lib/python3.12/site-packages (from requests==2.27.1) (2024.7.4) 2024-08-20T22:15:50.3664974Z Collecting charset-normalizer~=2.0.0 (from requests==2.27.1) 2024-08-20T22:15:50.3704566Z Downloading charset_normalizer-2.0.12-py3-none-any.whl.metadata (11 kB) 2024-08-20T22:15:50.3761976Z Requirement already satisfied: idna<4,>=2.5 in /home/ec2-user/miniconda/lib/python3.12/site-packages (from requests==2.27.1) (3.7) 2024-08-20T22:15:50.3845808Z Downloading requests-2.27.1-py2.py3-none-any.whl (63 kB) 2024-08-20T22:15:50.3968509Z Downloading PyYAML-6.0.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (724 kB) 2024-08-20T22:15:50.4327276Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 725.0/725.0 kB 20.6 MB/s eta 0:00:00 2024-08-20T22:15:50.4365370Z Downloading charset_normalizer-2.0.12-py3-none-any.whl (39 kB) 2024-08-20T22:15:50.4445069Z Downloading urllib3-1.26.19-py2.py3-none-any.whl (143 kB) 2024-08-20T22:15:50.5171276Z Installing collected packages: urllib3, pyyaml, charset-normalizer, requests 2024-08-20T22:15:50.5171985Z Attempting uninstall: urllib3 2024-08-20T22:15:50.5193718Z Found existing installation: urllib3 2.2.2 2024-08-20T22:15:50.5237448Z Uninstalling urllib3-2.2.2: 2024-08-20T22:15:50.5246521Z Successfully uninstalled urllib3-2.2.2 2024-08-20T22:15:50.6392877Z Attempting uninstall: charset-normalizer 2024-08-20T22:15:50.6427846Z Found existing installation: charset-normalizer 3.3.2 2024-08-20T22:15:50.6460424Z Uninstalling charset-normalizer-3.3.2: 2024-08-20T22:15:50.6478587Z Successfully uninstalled charset-normalizer-3.3.2 2024-08-20T22:15:50.6730296Z Attempting uninstall: requests 2024-08-20T22:15:50.6757210Z Found existing installation: requests 2.32.3 2024-08-20T22:15:50.6788280Z Uninstalling requests-2.32.3: 2024-08-20T22:15:50.6793677Z Successfully uninstalled requests-2.32.3 2024-08-20T22:15:50.7157509Z ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 2024-08-20T22:15:50.7160112Z conda 24.7.1 requires requests<3,>=2.28.0, but you have requests 2.27.1 which is incompatible. 2024-08-20T22:15:50.7161362Z Successfully installed charset-normalizer-2.0.12 pyyaml-6.0.1 requests-2.27.1 urllib3-1.26.19 2024-08-20T22:15:51.3795293Z Command completed after 1 attempt(s). 2024-08-20T22:15:51.3858501Z ##[group]Run set -x 2024-08-20T22:15:51.3858823Z set -x 2024-08-20T22:15:51.3859112Z  2024-08-20T22:15:51.3859651Z # Use relative path here as this could be checked out anywhere, not necessarily 2024-08-20T22:15:51.3860661Z # in runner workspace 2024-08-20T22:15:51.3861184Z python3 "${GITHUB_ACTION_PATH}/../../scripts/parse_ref.py" 2024-08-20T22:15:51.3871757Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:15:51.3872249Z env: 2024-08-20T22:15:51.3872519Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:51.3872971Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:51.3873640Z ##[endgroup] 2024-08-20T22:15:51.3905364Z + python3 /home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/filter-test-configs/../../scripts/parse_ref.py 2024-08-20T22:15:51.4147605Z ##[group]Run echo "Workflow: ${GITHUB_WORKFLOW}" 2024-08-20T22:15:51.4148146Z echo "Workflow: ${GITHUB_WORKFLOW}" 2024-08-20T22:15:51.4148608Z echo "Job name: ${JOB_NAME}" 2024-08-20T22:15:51.4149001Z  2024-08-20T22:15:51.4149533Z # Use relative path here as this could be checked out anywhere, not necessarily 2024-08-20T22:15:51.4150209Z # in runner workspace 2024-08-20T22:15:51.4150784Z python3 "${GITHUB_ACTION_PATH}/../../scripts/filter_test_configs.py" \ 2024-08-20T22:15:51.4151423Z  --workflow "${GITHUB_WORKFLOW}" \ 2024-08-20T22:15:51.4151868Z  --job-name "${JOB_NAME}" \ 2024-08-20T22:15:51.4158966Z  --test-matrix "{"include": [{"config": "dynamo_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}]}" \ 2024-08-20T22:15:51.4166867Z  --selected-test-configs "" \ 2024-08-20T22:15:51.4167323Z  --pr-number "${PR_NUMBER}" \ 2024-08-20T22:15:51.4167741Z  --tag "${TAG}" \ 2024-08-20T22:15:51.4168133Z  --event-name "${EVENT_NAME}" \ 2024-08-20T22:15:51.4168573Z  --schedule "${SCHEDULE}" \ 2024-08-20T22:15:51.4168997Z  --branch "${HEAD_BRANCH}" 2024-08-20T22:15:51.4178042Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:15:51.4178543Z env: 2024-08-20T22:15:51.4178816Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:51.4179277Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:51.4180028Z GITHUB_TOKEN: *** 2024-08-20T22:15:51.4180816Z JOB_NAME: cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (aot_eager_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:15:51.4181670Z PR_NUMBER: 2024-08-20T22:15:51.4181974Z TAG: ciflow/inductor/133712 2024-08-20T22:15:51.4182326Z EVENT_NAME: push 2024-08-20T22:15:51.4182625Z SCHEDULE: 2024-08-20T22:15:51.4182895Z HEAD_BRANCH: 2024-08-20T22:15:51.4183187Z ##[endgroup] 2024-08-20T22:15:51.4214014Z Workflow: inductor-periodic 2024-08-20T22:15:51.4215039Z Job name: cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (aot_eager_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:15:51.6728276Z INFO:root:Found no test-config label on the PR, so all test configs are included 2024-08-20T22:15:51.8245621Z ##[group]Run echo "Filtered matrix:" 2024-08-20T22:15:51.8246089Z echo "Filtered matrix:" 2024-08-20T22:15:51.8253089Z echo "{"include": [{"config": "dynamo_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}]}" 2024-08-20T22:15:51.8260465Z  2024-08-20T22:15:51.8260745Z echo 2024-08-20T22:15:51.8261126Z echo "Is the current job unstable? False" 2024-08-20T22:15:51.8261576Z  2024-08-20T22:15:51.8261848Z echo 2024-08-20T22:15:51.8262224Z echo "Is keep-going label set? False" 2024-08-20T22:15:51.8262658Z  2024-08-20T22:15:51.8262931Z echo 2024-08-20T22:15:51.8263245Z echo "Renabled issues? " 2024-08-20T22:15:51.8272268Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:15:51.8272764Z env: 2024-08-20T22:15:51.8273050Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:51.8273510Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:51.8273997Z ##[endgroup] 2024-08-20T22:15:51.8304545Z Filtered matrix: 2024-08-20T22:15:51.8312104Z {include: [{config: dynamo_eager_torchbench, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamo_eager_torchbench, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamo_eager_huggingface, shard: 1, num_shards: 1, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamo_eager_timm, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamo_eager_timm, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: aot_eager_torchbench, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: aot_eager_torchbench, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: aot_eager_huggingface, shard: 1, num_shards: 1, runner: linux.g5.4xlarge.nvidia.gpu}, {config: aot_eager_timm, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: aot_eager_timm, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_aot_eager_torchbench, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_aot_eager_torchbench, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_aot_eager_huggingface, shard: 1, num_shards: 1, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_aot_eager_timm, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_aot_eager_timm, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}]} 2024-08-20T22:15:51.8319189Z 2024-08-20T22:15:51.8319358Z Is the current job unstable? False 2024-08-20T22:15:51.8319642Z 2024-08-20T22:15:51.8320047Z Is keep-going label set? False 2024-08-20T22:15:51.8320307Z 2024-08-20T22:15:51.8320429Z Renabled issues? 2024-08-20T22:15:51.8365818Z ##[group]Run echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2024-08-20T22:15:51.8366518Z echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2024-08-20T22:15:51.8375455Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:15:51.8375949Z env: 2024-08-20T22:15:51.8376235Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:51.8376688Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:51.8377183Z JOB_TIMEOUT: 240 2024-08-20T22:15:51.8377485Z ##[endgroup] 2024-08-20T22:15:51.8464575Z ##[group]Run set -x 2024-08-20T22:15:51.8464980Z set -x 2024-08-20T22:15:51.8465276Z  2024-08-20T22:15:51.8465628Z if [[ $TEST_CONFIG == 'multigpu' ]]; then 2024-08-20T22:15:51.8466186Z  TEST_COMMAND=.ci/pytorch/multigpu-test.sh 2024-08-20T22:15:51.8466747Z elif [[ $BUILD_ENVIRONMENT == *onnx* ]]; then 2024-08-20T22:15:51.8467260Z  TEST_COMMAND=.ci/onnx/test.sh 2024-08-20T22:15:51.8467671Z else 2024-08-20T22:15:51.8468011Z  TEST_COMMAND=.ci/pytorch/test.sh 2024-08-20T22:15:51.8468442Z fi 2024-08-20T22:15:51.8468718Z  2024-08-20T22:15:51.8469183Z # detached container should get cleaned up by teardown_ec2_linux 2024-08-20T22:15:51.8469941Z # TODO: Stop building test binaries as part of the build phase 2024-08-20T22:15:51.8470632Z # Used for GPU_FLAG since that doesn't play nice 2024-08-20T22:15:51.8471221Z # shellcheck disable=SC2086,SC2090 2024-08-20T22:15:51.8471678Z container_name=$(docker run \ 2024-08-20T22:15:51.8472096Z  ${GPU_FLAG:-} \ 2024-08-20T22:15:51.8472472Z  -e BUILD_ENVIRONMENT \ 2024-08-20T22:15:51.8472882Z  -e PR_NUMBER \ 2024-08-20T22:15:51.8473238Z  -e GITHUB_ACTIONS \ 2024-08-20T22:15:51.8473631Z  -e GITHUB_REPOSITORY \ 2024-08-20T22:15:51.8474042Z  -e GITHUB_WORKFLOW \ 2024-08-20T22:15:51.8474428Z  -e GITHUB_JOB \ 2024-08-20T22:15:51.8474784Z  -e GITHUB_RUN_ID \ 2024-08-20T22:15:51.8475171Z  -e GITHUB_RUN_NUMBER \ 2024-08-20T22:15:51.8475583Z  -e GITHUB_RUN_ATTEMPT \ 2024-08-20T22:15:51.8475979Z  -e JOB_ID \ 2024-08-20T22:15:51.8476384Z  -e JOB_NAME \ 2024-08-20T22:15:51.8476727Z  -e BASE_SHA \ 2024-08-20T22:15:51.8477069Z  -e BRANCH \ 2024-08-20T22:15:51.8477394Z  -e SHA1 \ 2024-08-20T22:15:51.8477735Z  -e AWS_DEFAULT_REGION \ 2024-08-20T22:15:51.8478138Z  -e IN_WHEEL_TEST \ 2024-08-20T22:15:51.8478513Z  -e SHARD_NUMBER \ 2024-08-20T22:15:51.8478877Z  -e TEST_CONFIG \ 2024-08-20T22:15:51.8479250Z  -e NUM_TEST_SHARDS \ 2024-08-20T22:15:51.8479654Z  -e REENABLED_ISSUES \ 2024-08-20T22:15:51.8480066Z  -e CONTINUE_THROUGH_ERROR \ 2024-08-20T22:15:51.8480489Z  -e VERBOSE_TEST_LOGS \ 2024-08-20T22:15:51.8480892Z  -e TEST_SHOWLOCALS \ 2024-08-20T22:15:51.8481281Z  -e NO_TEST_TIMEOUT \ 2024-08-20T22:15:51.8481656Z  -e NO_TD \ 2024-08-20T22:15:51.8481996Z  -e TD_DISTRIBUTED \ 2024-08-20T22:15:51.8482384Z  -e PR_LABELS \ 2024-08-20T22:15:51.8482793Z  -e MAX_JOBS="$(nproc --ignore=2)" \ 2024-08-20T22:15:51.8483252Z  -e SCCACHE_BUCKET \ 2024-08-20T22:15:51.8483654Z  -e SCCACHE_S3_KEY_PREFIX \ 2024-08-20T22:15:51.8484068Z  -e XLA_CUDA \ 2024-08-20T22:15:51.8484484Z  -e XLA_CLANG_CACHE_S3_BUCKET_NAME \ 2024-08-20T22:15:51.8484993Z  -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK \ 2024-08-20T22:15:51.8485525Z  -e PYTORCH_TEST_RERUN_DISABLED_TESTS \ 2024-08-20T22:15:51.8486231Z  -e SKIP_SCCACHE_INITIALIZATION=1 \ 2024-08-20T22:15:51.8486701Z  -e HUGGING_FACE_HUB_TOKEN \ 2024-08-20T22:15:51.8487148Z  -e SCRIBE_GRAPHQL_ACCESS_TOKEN \ 2024-08-20T22:15:51.8487588Z  -e DASHBOARD_TAG \ 2024-08-20T22:15:51.8488068Z  --env-file="/tmp/github_env_${GITHUB_RUN_ID}" \ 2024-08-20T22:15:51.8488624Z  --security-opt seccomp=unconfined \ 2024-08-20T22:15:51.8489084Z  --cap-add=SYS_PTRACE \ 2024-08-20T22:15:51.8489483Z  --ipc=host \ 2024-08-20T22:15:51.8489849Z  --shm-size="${SHM_SIZE}" \ 2024-08-20T22:15:51.8490292Z  --tty \ 2024-08-20T22:15:51.8490605Z  --detach \ 2024-08-20T22:15:51.8491091Z  --name="${container_name}" \ 2024-08-20T22:15:51.8491516Z  --user jenkins \ 2024-08-20T22:15:51.8492002Z  -v "${GITHUB_WORKSPACE}:/var/lib/jenkins/workspace" \ 2024-08-20T22:15:51.8492557Z  -w /var/lib/jenkins/workspace \ 2024-08-20T22:15:51.8493003Z  "${DOCKER_IMAGE}" 2024-08-20T22:15:51.8493364Z ) 2024-08-20T22:15:51.8493775Z # Propagate download.pytorch.org IP to container 2024-08-20T22:15:51.8494684Z grep download.pytorch.org /etc/hosts | docker exec -i "${container_name}" sudo bash -c "/bin/cat >> /etc/hosts" 2024-08-20T22:15:51.8495653Z echo "DOCKER_CONTAINER_ID=${container_name}" >> "${GITHUB_ENV}" 2024-08-20T22:15:51.8496563Z docker exec -t "${container_name}" sh -c "pip install $(echo dist/*.whl)[opt-einsum] && ${TEST_COMMAND}" 2024-08-20T22:15:51.8505560Z shell: /usr/bin/bash -e {0} 2024-08-20T22:15:51.8505909Z env: 2024-08-20T22:15:51.8506188Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:51.8506654Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:51.8507257Z BUILD_ENVIRONMENT: linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-08-20T22:15:51.8507765Z PR_NUMBER: 2024-08-20T22:15:51.8508093Z GITHUB_REPOSITORY: pytorch/pytorch 2024-08-20T22:15:51.8508533Z GITHUB_WORKFLOW: inductor-periodic 2024-08-20T22:15:51.8508930Z GITHUB_JOB: test 2024-08-20T22:15:51.8509253Z GITHUB_RUN_ID: 10479310721 2024-08-20T22:15:51.8509628Z GITHUB_RUN_NUMBER: 54565 2024-08-20T22:15:51.8509977Z GITHUB_RUN_ATTEMPT: 1 2024-08-20T22:15:51.8510314Z JOB_ID: 29026299696 2024-08-20T22:15:51.8511117Z JOB_NAME: cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (aot_eager_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:15:51.8511974Z BRANCH: 2024-08-20T22:15:51.8512305Z SHA1: 40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:15:51.8512826Z BASE_SHA: 40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:15:51.8513301Z TEST_CONFIG: aot_eager_timm 2024-08-20T22:15:51.8513671Z SHARD_NUMBER: 2 2024-08-20T22:15:51.8513969Z NUM_TEST_SHARDS: 2 2024-08-20T22:15:51.8514291Z REENABLED_ISSUES: 2024-08-20T22:15:51.8514623Z CONTINUE_THROUGH_ERROR: False 2024-08-20T22:15:51.8515008Z VERBOSE_TEST_LOGS: False 2024-08-20T22:15:51.8515360Z TEST_SHOWLOCALS: False 2024-08-20T22:15:51.8515704Z NO_TEST_TIMEOUT: False 2024-08-20T22:15:51.8516041Z NO_TD: False 2024-08-20T22:15:51.8516424Z TD_DISTRIBUTED: False 2024-08-20T22:15:51.8516831Z SCCACHE_BUCKET: ossci-compiler-cache-circleci-v2 2024-08-20T22:15:51.8517345Z SCCACHE_S3_KEY_PREFIX: inductor-periodic 2024-08-20T22:15:51.8517768Z SHM_SIZE: 2g 2024-08-20T22:15:51.8518865Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:15:51.8520038Z XLA_CUDA: 2024-08-20T22:15:51.8520529Z XLA_CLANG_CACHE_S3_BUCKET_NAME: ossci-compiler-clang-cache-circleci-xla 2024-08-20T22:15:51.8521145Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK: 0 2024-08-20T22:15:51.8521587Z PYTORCH_TEST_RERUN_DISABLED_TESTS: 0 2024-08-20T22:15:51.8521988Z DASHBOARD_TAG: 2024-08-20T22:15:51.8522507Z HUGGING_FACE_HUB_TOKEN: *** 2024-08-20T22:15:51.8523016Z SCRIBE_GRAPHQL_ACCESS_TOKEN: 2024-08-20T22:15:51.8523392Z ##[endgroup] 2024-08-20T22:15:51.8552592Z + [[ aot_eager_timm == \m\u\l\t\i\g\p\u ]] 2024-08-20T22:15:51.8553311Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *onnx* ]] 2024-08-20T22:15:51.8553829Z + TEST_COMMAND=.ci/pytorch/test.sh 2024-08-20T22:15:51.8562320Z +++ nproc --ignore=2 2024-08-20T22:15:51.8586500Z ++ docker run --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all -e BUILD_ENVIRONMENT -e PR_NUMBER -e GITHUB_ACTIONS -e GITHUB_REPOSITORY -e GITHUB_WORKFLOW -e GITHUB_JOB -e GITHUB_RUN_ID -e GITHUB_RUN_NUMBER -e GITHUB_RUN_ATTEMPT -e JOB_ID -e JOB_NAME -e BASE_SHA -e BRANCH -e SHA1 -e AWS_DEFAULT_REGION -e IN_WHEEL_TEST -e SHARD_NUMBER -e TEST_CONFIG -e NUM_TEST_SHARDS -e REENABLED_ISSUES -e CONTINUE_THROUGH_ERROR -e VERBOSE_TEST_LOGS -e TEST_SHOWLOCALS -e NO_TEST_TIMEOUT -e NO_TD -e TD_DISTRIBUTED -e PR_LABELS -e MAX_JOBS=14 -e SCCACHE_BUCKET -e SCCACHE_S3_KEY_PREFIX -e XLA_CUDA -e XLA_CLANG_CACHE_S3_BUCKET_NAME -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK -e PYTORCH_TEST_RERUN_DISABLED_TESTS -e SKIP_SCCACHE_INITIALIZATION=1 -e HUGGING_FACE_HUB_TOKEN -e SCRIBE_GRAPHQL_ACCESS_TOKEN -e DASHBOARD_TAG --env-file=/tmp/github_env_10479310721 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --ipc=host --shm-size=2g --tty --detach --name= --user jenkins -v /home/ec2-user/actions-runner/_work/pytorch/pytorch:/var/lib/jenkins/workspace -w /var/lib/jenkins/workspace 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:15:55.9456254Z + container_name=a2ae227989a46a75f7e1cd17319896826cd63671228555255f05d11fdea4a10a 2024-08-20T22:15:55.9462185Z + grep download.pytorch.org /etc/hosts 2024-08-20T22:15:55.9463921Z + docker exec -i a2ae227989a46a75f7e1cd17319896826cd63671228555255f05d11fdea4a10a sudo bash -c '/bin/cat >> /etc/hosts' 2024-08-20T22:15:56.0578197Z + echo DOCKER_CONTAINER_ID=a2ae227989a46a75f7e1cd17319896826cd63671228555255f05d11fdea4a10a 2024-08-20T22:15:56.0582283Z ++ echo dist/torch-2.5.0a0+git40ec5f6-cp310-cp310-linux_x86_64.whl 2024-08-20T22:15:56.0585330Z + docker exec -t a2ae227989a46a75f7e1cd17319896826cd63671228555255f05d11fdea4a10a sh -c 'pip install dist/torch-2.5.0a0+git40ec5f6-cp310-cp310-linux_x86_64.whl[opt-einsum] && .ci/pytorch/test.sh' 2024-08-20T22:15:56.4620153Z Processing ./dist/torch-2.5.0a0+git40ec5f6-cp310-cp310-linux_x86_64.whl (from torch==2.5.0a0+git40ec5f6) 2024-08-20T22:15:56.7852187Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (3.13.1) 2024-08-20T22:15:56.7854720Z Requirement already satisfied: typing-extensions>=4.8.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (4.12.2) 2024-08-20T22:15:56.7858215Z Requirement already satisfied: networkx in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (2.8.8) 2024-08-20T22:15:56.7862151Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (3.1.4) 2024-08-20T22:15:56.7865730Z Requirement already satisfied: fsspec in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (2024.6.1) 2024-08-20T22:15:56.7871256Z Requirement already satisfied: sympy==1.13.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (1.13.1) 2024-08-20T22:15:56.7888239Z Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from sympy==1.13.1->torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (1.3.0) 2024-08-20T22:15:56.7902079Z Requirement already satisfied: opt-einsum>=3.3 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (3.3.0) 2024-08-20T22:15:56.7919952Z Requirement already satisfied: numpy>=1.7 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from opt-einsum>=3.3->torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (1.22.4) 2024-08-20T22:15:56.8310510Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from jinja2->torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (2.1.5) 2024-08-20T22:15:57.4066172Z Installing collected packages: torch 2024-08-20T22:16:07.4802409Z ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 2024-08-20T22:16:07.4804142Z timm 1.0.9.dev0 requires torchvision, which is not installed. 2024-08-20T22:16:07.4804849Z Successfully installed torch-2.5.0a0+git40ec5f6 2024-08-20T22:16:07.5629377Z + export TERM=vt100 2024-08-20T22:16:07.5629714Z + TERM=vt100 2024-08-20T22:16:07.5632148Z ++ dirname .ci/pytorch/test.sh 2024-08-20T22:16:07.5648516Z + source .ci/pytorch/common.sh 2024-08-20T22:16:07.5651610Z +++ dirname .ci/pytorch/common.sh 2024-08-20T22:16:07.5661484Z ++ source .ci/pytorch/common_utils.sh 2024-08-20T22:16:07.5663276Z +++ declare -f -t trap_add 2024-08-20T22:16:07.5669250Z ++ set -ex 2024-08-20T22:16:07.5669812Z ++ [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *rocm* ]] 2024-08-20T22:16:07.5670329Z ++ BUILD_TEST_LIBTORCH=0 2024-08-20T22:16:07.5670841Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *rocm* ]] 2024-08-20T22:16:07.5675133Z ++ stat -c %u /var/lib/jenkins/workspace 2024-08-20T22:16:07.5725903Z + WORKSPACE_ORIGINAL_OWNER_ID=1000 2024-08-20T22:16:07.5726353Z + trap_add cleanup_workspace EXIT 2024-08-20T22:16:07.5726834Z + trap_add_cmd=cleanup_workspace 2024-08-20T22:16:07.5727206Z + shift 2024-08-20T22:16:07.5728447Z + for trap_add_name in "$@" 2024-08-20T22:16:07.5735822Z +++ trap -p EXIT 2024-08-20T22:16:07.5738886Z ++ eval 'extract_trap_cmd ' 2024-08-20T22:16:07.5739400Z +++ extract_trap_cmd 2024-08-20T22:16:07.5739931Z +++ printf '%s\n' '' 2024-08-20T22:16:07.5740351Z ++ printf '%s\n' cleanup_workspace 2024-08-20T22:16:07.5742889Z + trap -- ' 2024-08-20T22:16:07.5743229Z cleanup_workspace' EXIT 2024-08-20T22:16:07.5743695Z + sudo chown -R jenkins /var/lib/jenkins/workspace 2024-08-20T22:16:08.2998555Z + git config --global --add safe.directory /var/lib/jenkins/workspace 2024-08-20T22:16:08.3022492Z + echo 'Environment variables:' 2024-08-20T22:16:08.3022900Z Environment variables: 2024-08-20T22:16:08.3023217Z + env 2024-08-20T22:16:08.3297436Z INSTALLED_DB=yes 2024-08-20T22:16:08.3298206Z NV_LIBCUBLAS_VERSION=12.1.3.1-1 2024-08-20T22:16:08.3298616Z NVIDIA_VISIBLE_DEVICES=all 2024-08-20T22:16:08.3299085Z NV_NVML_DEV_VERSION=12.1.105-1 2024-08-20T22:16:08.3299825Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-20T22:16:08.3300510Z CONTINUE_THROUGH_ERROR=False 2024-08-20T22:16:08.3301163Z NV_LIBNCCL_DEV_PACKAGE=libnccl-dev=2.17.1-1+cuda12.1 2024-08-20T22:16:08.3301873Z NV_LIBNCCL_DEV_PACKAGE_VERSION=2.17.1-1 2024-08-20T22:16:08.3302670Z BUILD_ENVIRONMENT=linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-08-20T22:16:08.3303353Z HOSTNAME=a2ae227989a4 2024-08-20T22:16:08.3304362Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_61903d32-b970-4964-a0eb-2eedc82240da 2024-08-20T22:16:08.3305229Z GITHUB_ACTION=__self 2024-08-20T22:16:08.3305576Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2024-08-20T22:16:08.3310297Z NVIDIA_REQUIRE_CUDA=cuda>=12.1 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 brand=tesla,driver>=525,driver<526 brand=unknown,driver>=525,driver<526 brand=nvidia,driver>=525,driver<526 brand=nvidiartx,driver>=525,driver<526 brand=geforce,driver>=525,driver<526 brand=geforcertx,driver>=525,driver<526 brand=quadro,driver>=525,driver<526 brand=quadrortx,driver>=525,driver<526 brand=titan,driver>=525,driver<526 brand=titanrtx,driver>=525,driver<526 2024-08-20T22:16:08.3314642Z NV_LIBCUBLAS_DEV_PACKAGE=libcublas-dev-12-1=12.1.3.1-1 2024-08-20T22:16:08.3315156Z NV_NVTX_VERSION=12.1.105-1 2024-08-20T22:16:08.3315509Z GITHUB_RUN_NUMBER=54565 2024-08-20T22:16:08.3315851Z TEST_CONFIG=aot_eager_timm 2024-08-20T22:16:08.3316321Z GITHUB_REPOSITORY_OWNER_ID=21003710 2024-08-20T22:16:08.3316805Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2024-08-20T22:16:08.3317271Z NV_CUDA_CUDART_DEV_VERSION=12.1.105-1 2024-08-20T22:16:08.3317717Z NV_LIBCUSPARSE_VERSION=12.1.0.106-1 2024-08-20T22:16:08.3318289Z SCRIBE_GRAPHQL_ACCESS_TOKEN= 2024-08-20T22:16:08.3318697Z NV_LIBNPP_VERSION=12.1.0.40-1 2024-08-20T22:16:08.3319148Z GITHUB_TRIGGERING_ACTOR=pytorch-bot[bot] 2024-08-20T22:16:08.3319632Z CMAKE_CUDA_COMPILER_LAUNCHER=/opt/cache/bin/sccache 2024-08-20T22:16:08.3320177Z GITHUB_REF_TYPE=tag 2024-08-20T22:16:08.3320501Z TORCH_CUDA_ARCH_LIST=Maxwell 2024-08-20T22:16:08.3320882Z NCCL_VERSION=2.17.1-1 2024-08-20T22:16:08.3321273Z BASE_SHA=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:16:08.3321714Z XLA_CUDA= 2024-08-20T22:16:08.3322219Z HUGGING_FACE_HUB_TOKEN=*** 2024-08-20T22:16:08.3324465Z *** 2024-08-20T22:16:08.3324758Z CARGO_NET_GIT_FETCH_WITH_CLI=true 2024-08-20T22:16:08.3325151Z GITHUB_REPOSITORY_ID=65600975 2024-08-20T22:16:08.3325504Z GITHUB_ACTIONS=true 2024-08-20T22:16:08.3325825Z NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:16:08.3326338Z NV_NVPROF_DEV_PACKAGE=cuda-nvprof-12-1=12.1.105-1 2024-08-20T22:16:08.3326868Z NV_LIBNPP_PACKAGE=libnpp-12-1=12.1.0.40-1 2024-08-20T22:16:08.3327346Z SHA1=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:16:08.3327856Z NV_LIBNCCL_DEV_PACKAGE_NAME=libnccl-dev 2024-08-20T22:16:08.3328332Z GITHUB_SHA=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:16:08.3329254Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/inductor-periodic.yml@refs/tags/ciflow/inductor/133712 2024-08-20T22:16:08.3330013Z UCC_HOME=/usr 2024-08-20T22:16:08.3330347Z NV_LIBCUBLAS_DEV_VERSION=12.1.3.1-1 2024-08-20T22:16:08.3330735Z VERBOSE_TEST_LOGS=False 2024-08-20T22:16:08.3331064Z NVIDIA_PRODUCT_NAME=CUDA 2024-08-20T22:16:08.3331517Z NV_LIBCUBLAS_DEV_PACKAGE_NAME=libcublas-dev-12-1 2024-08-20T22:16:08.3332007Z GITHUB_REF=refs/tags/ciflow/inductor/133712 2024-08-20T22:16:08.3332464Z NV_CUDA_CUDART_VERSION=12.1.105-1 2024-08-20T22:16:08.3332827Z SHARD_NUMBER=2 2024-08-20T22:16:08.3333128Z GITHUB_REF_PROTECTED=false 2024-08-20T22:16:08.3333467Z HOME=/var/lib/jenkins 2024-08-20T22:16:08.3333813Z GITHUB_API_URL=https://api.github.com 2024-08-20T22:16:08.3334244Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2024-08-20T22:16:08.3334712Z UCX_COMMIT=7bb2722ff2187a0cad557ae4a6afa090569f83fb 2024-08-20T22:16:08.3335260Z SCCACHE_S3_KEY_PREFIX=inductor-periodic 2024-08-20T22:16:08.3335661Z CUDA_VERSION=12.1.1 2024-08-20T22:16:08.3336076Z NV_LIBCUBLAS_PACKAGE=libcublas-12-1=12.1.3.1-1 2024-08-20T22:16:08.3336511Z NUM_TEST_SHARDS=2 2024-08-20T22:16:08.3336801Z UCX_HOME=/usr 2024-08-20T22:16:08.3337306Z NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE=cuda-nsight-compute-12-1=12.1.1-1 2024-08-20T22:16:08.3338373Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_61903d32-b970-4964-a0eb-2eedc82240da 2024-08-20T22:16:08.3339750Z JOB_NAME=cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (aot_eager_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:16:08.3341141Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_61903d32-b970-4964-a0eb-2eedc82240da 2024-08-20T22:16:08.3342240Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2024-08-20T22:16:08.3342889Z GITHUB_EVENT_NAME=push 2024-08-20T22:16:08.3343216Z DASHBOARD_TAG= 2024-08-20T22:16:08.3343510Z GITHUB_RUN_ID=10479310721 2024-08-20T22:16:08.3343964Z NV_LIBNPP_DEV_PACKAGE=libnpp-dev-12-1=12.1.0.40-1 2024-08-20T22:16:08.3344619Z NV_LIBCUBLAS_PACKAGE_NAME=libcublas-12-1 2024-08-20T22:16:08.3345606Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_61903d32-b970-4964-a0eb-2eedc82240da 2024-08-20T22:16:08.3346504Z GITHUB_ACTOR=pytorch-bot[bot] 2024-08-20T22:16:08.3346899Z NV_LIBNPP_DEV_VERSION=12.1.0.40-1 2024-08-20T22:16:08.3347269Z PR_NUMBER= 2024-08-20T22:16:08.3347547Z GITHUB_RUN_ATTEMPT=1 2024-08-20T22:16:08.3347868Z ANACONDA_PYTHON_VERSION=3.10 2024-08-20T22:16:08.3348301Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2024-08-20T22:16:08.3348751Z TERM=vt100 2024-08-20T22:16:08.3349077Z NV_LIBCUSPARSE_DEV_VERSION=12.1.0.106-1 2024-08-20T22:16:08.3349472Z INSTALLED_VISION=yes 2024-08-20T22:16:08.3349775Z BRANCH= 2024-08-20T22:16:08.3350154Z OPENSSL_ROOT_DIR=/opt/openssl 2024-08-20T22:16:08.3350550Z LIBRARY_PATH=/usr/local/cuda/lib64/stubs 2024-08-20T22:16:08.3350963Z CUDA_PATH=/usr/local/cuda 2024-08-20T22:16:08.3351715Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2024-08-20T22:16:08.3352467Z GITHUB_SERVER_URL=https://github.com 2024-08-20T22:16:08.3353006Z UCC_COMMIT=20eae37090a4ce1b32bcce6144ccad0b49943e0b 2024-08-20T22:16:08.3353492Z REENABLED_ISSUES= 2024-08-20T22:16:08.3353802Z SHLVL=1 2024-08-20T22:16:08.3354102Z MAX_JOBS=14 2024-08-20T22:16:08.3354410Z NV_CUDA_LIB_VERSION=12.1.1-1 2024-08-20T22:16:08.3354760Z NVARCH=x86_64 2024-08-20T22:16:08.3355056Z GITHUB_ACTOR_ID=54816060 2024-08-20T22:16:08.3355508Z GITHUB_WORKFLOW_SHA=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:16:08.3356030Z GITHUB_REF_NAME=ciflow/inductor/133712 2024-08-20T22:16:08.3356625Z NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-1 2024-08-20T22:16:08.3357293Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2024-08-20T22:16:08.3357860Z GITHUB_JOB=test 2024-08-20T22:16:08.3358254Z NV_LIBNCCL_PACKAGE=libnccl2=2.17.1-1+cuda12.1 2024-08-20T22:16:08.3358807Z LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64 2024-08-20T22:16:08.3359316Z NO_TEST_TIMEOUT=False 2024-08-20T22:16:08.3359637Z TD_DISTRIBUTED=False 2024-08-20T22:16:08.3360011Z NV_CUDA_NSIGHT_COMPUTE_VERSION=12.1.1-1 2024-08-20T22:16:08.3362796Z GITHUB_REPOSITORY=pytorch/pytorch 2024-08-20T22:16:08.3363232Z NV_NVPROF_VERSION=12.1.105-1 2024-08-20T22:16:08.3363615Z GITHUB_RETENTION_DAYS=90 2024-08-20T22:16:08.3364040Z OPENSSL_DIR=/opt/openssl 2024-08-20T22:16:08.3364465Z GITHUB_ACTION_REPOSITORY= 2024-08-20T22:16:08.3365772Z PATH=/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-08-20T22:16:08.3366915Z GITHUB_BASE_REF= 2024-08-20T22:16:08.3367237Z NV_LIBNCCL_PACKAGE_NAME=libnccl2 2024-08-20T22:16:08.3367610Z CI=true 2024-08-20T22:16:08.3367927Z NV_LIBNCCL_PACKAGE_VERSION=2.17.1-1 2024-08-20T22:16:08.3368332Z GITHUB_REPOSITORY_OWNER=pytorch 2024-08-20T22:16:08.3368700Z JOB_ID=29026299696 2024-08-20T22:16:08.3369012Z INSTALLED_PROTOBUF=yes 2024-08-20T22:16:08.3369336Z GITHUB_HEAD_REF= 2024-08-20T22:16:08.3369634Z GITHUB_ACTION_REF= 2024-08-20T22:16:08.3370068Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2024-08-20T22:16:08.3370534Z TEST_SHOWLOCALS=False 2024-08-20T22:16:08.3370921Z GITHUB_WORKFLOW=inductor-periodic 2024-08-20T22:16:08.3371326Z DEBIAN_FRONTEND=noninteractive 2024-08-20T22:16:08.3372234Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_61903d32-b970-4964-a0eb-2eedc82240da 2024-08-20T22:16:08.3373053Z NO_TD=False 2024-08-20T22:16:08.3373351Z SKIP_SCCACHE_INITIALIZATION=1 2024-08-20T22:16:08.3373797Z _=/usr/bin/env 2024-08-20T22:16:08.3374396Z ++ python -c 'import site; print(site.getsitepackages()[0])' 2024-08-20T22:16:08.3533058Z + TORCH_INSTALL_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch 2024-08-20T22:16:08.3534226Z + TORCH_BIN_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/bin 2024-08-20T22:16:08.3535179Z + TORCH_LIB_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/lib 2024-08-20T22:16:08.3536300Z + TORCH_TEST_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/test 2024-08-20T22:16:08.3536906Z + BUILD_DIR=build 2024-08-20T22:16:08.3537219Z + BUILD_RENAMED_DIR=build_renamed 2024-08-20T22:16:08.3537603Z + BUILD_BIN_DIR=build/bin 2024-08-20T22:16:08.3537936Z + SHARD_NUMBER=2 2024-08-20T22:16:08.3538226Z + NUM_TEST_SHARDS=2 2024-08-20T22:16:08.3538552Z + export VALGRIND=ON 2024-08-20T22:16:08.3538865Z + VALGRIND=ON 2024-08-20T22:16:08.3539410Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *clang9* ]] 2024-08-20T22:16:08.3539894Z + [[ 0 == \1 ]] 2024-08-20T22:16:08.3540184Z + [[ False == \1 ]] 2024-08-20T22:16:08.3540657Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *bazel* ]] 2024-08-20T22:16:08.3541387Z ++ realpath build/custom_test_artifacts 2024-08-20T22:16:08.3810619Z + CUSTOM_TEST_ARTIFACT_BUILD_DIR=/var/lib/jenkins/workspace/build/custom_test_artifacts 2024-08-20T22:16:08.3811445Z + [[ -n '' ]] 2024-08-20T22:16:08.3811810Z + echo 'Environment variables' 2024-08-20T22:16:08.3812185Z Environment variables 2024-08-20T22:16:08.3812495Z + env 2024-08-20T22:16:08.3821509Z INSTALLED_DB=yes 2024-08-20T22:16:08.3821939Z NV_LIBCUBLAS_VERSION=12.1.3.1-1 2024-08-20T22:16:08.3822407Z NVIDIA_VISIBLE_DEVICES=all 2024-08-20T22:16:08.3822926Z NV_NVML_DEV_VERSION=12.1.105-1 2024-08-20T22:16:08.3823683Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-20T22:16:08.3824424Z CONTINUE_THROUGH_ERROR=False 2024-08-20T22:16:08.3825083Z NV_LIBNCCL_DEV_PACKAGE=libnccl-dev=2.17.1-1+cuda12.1 2024-08-20T22:16:08.3825764Z NV_LIBNCCL_DEV_PACKAGE_VERSION=2.17.1-1 2024-08-20T22:16:08.3826526Z BUILD_ENVIRONMENT=linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-08-20T22:16:08.3827169Z HOSTNAME=a2ae227989a4 2024-08-20T22:16:08.3828286Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_61903d32-b970-4964-a0eb-2eedc82240da 2024-08-20T22:16:08.3829292Z GITHUB_ACTION=__self 2024-08-20T22:16:08.3829644Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2024-08-20T22:16:08.3833447Z NVIDIA_REQUIRE_CUDA=cuda>=12.1 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 brand=tesla,driver>=525,driver<526 brand=unknown,driver>=525,driver<526 brand=nvidia,driver>=525,driver<526 brand=nvidiartx,driver>=525,driver<526 brand=geforce,driver>=525,driver<526 brand=geforcertx,driver>=525,driver<526 brand=quadro,driver>=525,driver<526 brand=quadrortx,driver>=525,driver<526 brand=titan,driver>=525,driver<526 brand=titanrtx,driver>=525,driver<526 2024-08-20T22:16:08.3837494Z NV_LIBCUBLAS_DEV_PACKAGE=libcublas-dev-12-1=12.1.3.1-1 2024-08-20T22:16:08.3838007Z NV_NVTX_VERSION=12.1.105-1 2024-08-20T22:16:08.3838351Z GITHUB_RUN_NUMBER=54565 2024-08-20T22:16:08.3838687Z TEST_CONFIG=aot_eager_timm 2024-08-20T22:16:08.3839050Z GITHUB_REPOSITORY_OWNER_ID=21003710 2024-08-20T22:16:08.3839569Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2024-08-20T22:16:08.3840033Z NV_CUDA_CUDART_DEV_VERSION=12.1.105-1 2024-08-20T22:16:08.3840469Z NV_LIBCUSPARSE_VERSION=12.1.0.106-1 2024-08-20T22:16:08.3840876Z SCRIBE_GRAPHQL_ACCESS_TOKEN= 2024-08-20T22:16:08.3841273Z NV_LIBNPP_VERSION=12.1.0.40-1 2024-08-20T22:16:08.3841726Z GITHUB_TRIGGERING_ACTOR=pytorch-bot[bot] 2024-08-20T22:16:08.3842213Z CMAKE_CUDA_COMPILER_LAUNCHER=/opt/cache/bin/sccache 2024-08-20T22:16:08.3842677Z GITHUB_REF_TYPE=tag 2024-08-20T22:16:08.3843003Z TORCH_CUDA_ARCH_LIST=Maxwell 2024-08-20T22:16:08.3843383Z NCCL_VERSION=2.17.1-1 2024-08-20T22:16:08.3843767Z BASE_SHA=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:16:08.3844214Z XLA_CUDA= 2024-08-20T22:16:08.3844696Z HUGGING_FACE_HUB_TOKEN=*** 2024-08-20T22:16:08.3845089Z *** 2024-08-20T22:16:08.3845358Z CARGO_NET_GIT_FETCH_WITH_CLI=true 2024-08-20T22:16:08.3846099Z GITHUB_REPOSITORY_ID=65600975 2024-08-20T22:16:08.3846513Z GITHUB_ACTIONS=true 2024-08-20T22:16:08.3846843Z NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:16:08.3847344Z NV_NVPROF_DEV_PACKAGE=cuda-nvprof-12-1=12.1.105-1 2024-08-20T22:16:08.3847883Z NV_LIBNPP_PACKAGE=libnpp-12-1=12.1.0.40-1 2024-08-20T22:16:08.3848349Z SHA1=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:16:08.3848860Z NV_LIBNCCL_DEV_PACKAGE_NAME=libnccl-dev 2024-08-20T22:16:08.3849334Z GITHUB_SHA=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:16:08.3850265Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/inductor-periodic.yml@refs/tags/ciflow/inductor/133712 2024-08-20T22:16:08.3851021Z UCC_HOME=/usr 2024-08-20T22:16:08.3851356Z NV_LIBCUBLAS_DEV_VERSION=12.1.3.1-1 2024-08-20T22:16:08.3851889Z VERBOSE_TEST_LOGS=False 2024-08-20T22:16:08.3852231Z NVIDIA_PRODUCT_NAME=CUDA 2024-08-20T22:16:08.3852691Z NV_LIBCUBLAS_DEV_PACKAGE_NAME=libcublas-dev-12-1 2024-08-20T22:16:08.3853178Z GITHUB_REF=refs/tags/ciflow/inductor/133712 2024-08-20T22:16:08.3853657Z NV_CUDA_CUDART_VERSION=12.1.105-1 2024-08-20T22:16:08.3854102Z SHARD_NUMBER=2 2024-08-20T22:16:08.3854550Z GITHUB_REF_PROTECTED=false 2024-08-20T22:16:08.3854951Z HOME=/var/lib/jenkins 2024-08-20T22:16:08.3855314Z GITHUB_API_URL=https://api.github.com 2024-08-20T22:16:08.3855746Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2024-08-20T22:16:08.3856220Z UCX_COMMIT=7bb2722ff2187a0cad557ae4a6afa090569f83fb 2024-08-20T22:16:08.3856777Z SCCACHE_S3_KEY_PREFIX=inductor-periodic 2024-08-20T22:16:08.3857197Z CUDA_VERSION=12.1.1 2024-08-20T22:16:08.3857618Z NV_LIBCUBLAS_PACKAGE=libcublas-12-1=12.1.3.1-1 2024-08-20T22:16:08.3858048Z NUM_TEST_SHARDS=2 2024-08-20T22:16:08.3858348Z UCX_HOME=/usr 2024-08-20T22:16:08.3858870Z NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE=cuda-nsight-compute-12-1=12.1.1-1 2024-08-20T22:16:08.3859957Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_61903d32-b970-4964-a0eb-2eedc82240da 2024-08-20T22:16:08.3861689Z JOB_NAME=cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (aot_eager_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:16:08.3863063Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_61903d32-b970-4964-a0eb-2eedc82240da 2024-08-20T22:16:08.3864175Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2024-08-20T22:16:08.3864831Z GITHUB_EVENT_NAME=push 2024-08-20T22:16:08.3865155Z DASHBOARD_TAG= 2024-08-20T22:16:08.3865448Z GITHUB_RUN_ID=10479310721 2024-08-20T22:16:08.3865911Z NV_LIBNPP_DEV_PACKAGE=libnpp-dev-12-1=12.1.0.40-1 2024-08-20T22:16:08.3866455Z NV_LIBCUBLAS_PACKAGE_NAME=libcublas-12-1 2024-08-20T22:16:08.3867445Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_61903d32-b970-4964-a0eb-2eedc82240da 2024-08-20T22:16:08.3868350Z GITHUB_ACTOR=pytorch-bot[bot] 2024-08-20T22:16:08.3868755Z NV_LIBNPP_DEV_VERSION=12.1.0.40-1 2024-08-20T22:16:08.3869125Z PR_NUMBER= 2024-08-20T22:16:08.3869410Z GITHUB_RUN_ATTEMPT=1 2024-08-20T22:16:08.3869721Z VALGRIND=ON 2024-08-20T22:16:08.3870020Z ANACONDA_PYTHON_VERSION=3.10 2024-08-20T22:16:08.3870455Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2024-08-20T22:16:08.3870901Z TERM=vt100 2024-08-20T22:16:08.3871238Z NV_LIBCUSPARSE_DEV_VERSION=12.1.0.106-1 2024-08-20T22:16:08.3871649Z INSTALLED_VISION=yes 2024-08-20T22:16:08.3871953Z BRANCH= 2024-08-20T22:16:08.3872237Z OPENSSL_ROOT_DIR=/opt/openssl 2024-08-20T22:16:08.3872640Z LIBRARY_PATH=/usr/local/cuda/lib64/stubs 2024-08-20T22:16:08.3873062Z CUDA_PATH=/usr/local/cuda 2024-08-20T22:16:08.3873806Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2024-08-20T22:16:08.3874580Z GITHUB_SERVER_URL=https://github.com 2024-08-20T22:16:08.3875091Z UCC_COMMIT=20eae37090a4ce1b32bcce6144ccad0b49943e0b 2024-08-20T22:16:08.3875554Z REENABLED_ISSUES= 2024-08-20T22:16:08.3875843Z SHLVL=1 2024-08-20T22:16:08.3876188Z MAX_JOBS=14 2024-08-20T22:16:08.3876525Z NV_CUDA_LIB_VERSION=12.1.1-1 2024-08-20T22:16:08.3877026Z NVARCH=x86_64 2024-08-20T22:16:08.3877321Z GITHUB_ACTOR_ID=54816060 2024-08-20T22:16:08.3877774Z GITHUB_WORKFLOW_SHA=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:16:08.3878299Z GITHUB_REF_NAME=ciflow/inductor/133712 2024-08-20T22:16:08.3878781Z NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-1 2024-08-20T22:16:08.3879445Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2024-08-20T22:16:08.3880006Z GITHUB_JOB=test 2024-08-20T22:16:08.3880400Z NV_LIBNCCL_PACKAGE=libnccl2=2.17.1-1+cuda12.1 2024-08-20T22:16:08.3880943Z LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64 2024-08-20T22:16:08.3881454Z NO_TEST_TIMEOUT=False 2024-08-20T22:16:08.3881776Z TD_DISTRIBUTED=False 2024-08-20T22:16:08.3882290Z NV_CUDA_NSIGHT_COMPUTE_VERSION=12.1.1-1 2024-08-20T22:16:08.3882722Z GITHUB_REPOSITORY=pytorch/pytorch 2024-08-20T22:16:08.3883143Z NV_NVPROF_VERSION=12.1.105-1 2024-08-20T22:16:08.3883510Z GITHUB_RETENTION_DAYS=90 2024-08-20T22:16:08.3883854Z OPENSSL_DIR=/opt/openssl 2024-08-20T22:16:08.3884202Z GITHUB_ACTION_REPOSITORY= 2024-08-20T22:16:08.3885239Z PATH=/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-08-20T22:16:08.3886298Z GITHUB_BASE_REF= 2024-08-20T22:16:08.3886616Z NV_LIBNCCL_PACKAGE_NAME=libnccl2 2024-08-20T22:16:08.3886982Z CI=true 2024-08-20T22:16:08.3887297Z NV_LIBNCCL_PACKAGE_VERSION=2.17.1-1 2024-08-20T22:16:08.3887703Z GITHUB_REPOSITORY_OWNER=pytorch 2024-08-20T22:16:08.3888064Z JOB_ID=29026299696 2024-08-20T22:16:08.3888379Z INSTALLED_PROTOBUF=yes 2024-08-20T22:16:08.3888706Z GITHUB_HEAD_REF= 2024-08-20T22:16:08.3889001Z GITHUB_ACTION_REF= 2024-08-20T22:16:08.3889450Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2024-08-20T22:16:08.3889920Z TEST_SHOWLOCALS=False 2024-08-20T22:16:08.3890313Z GITHUB_WORKFLOW=inductor-periodic 2024-08-20T22:16:08.3890708Z DEBIAN_FRONTEND=noninteractive 2024-08-20T22:16:08.3891611Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_61903d32-b970-4964-a0eb-2eedc82240da 2024-08-20T22:16:08.3892417Z NO_TD=False 2024-08-20T22:16:08.3892713Z SKIP_SCCACHE_INITIALIZATION=1 2024-08-20T22:16:08.3893068Z _=/usr/bin/env 2024-08-20T22:16:08.3893410Z + echo 'Testing pytorch' 2024-08-20T22:16:08.3893753Z Testing pytorch 2024-08-20T22:16:08.3894077Z + export LANG=C.UTF-8 2024-08-20T22:16:08.3894416Z + LANG=C.UTF-8 2024-08-20T22:16:08.4946068Z + PR_NUMBER= 2024-08-20T22:16:08.4946481Z + [[ aot_eager_timm == \d\e\f\a\u\l\t ]] 2024-08-20T22:16:08.4947097Z + [[ aot_eager_timm == \d\i\s\t\r\i\b\u\t\e\d ]] 2024-08-20T22:16:08.4947566Z + [[ aot_eager_timm == \s\l\o\w ]] 2024-08-20T22:16:08.4948236Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *slow-gradcheck* ]] 2024-08-20T22:16:08.4948947Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *cuda* ]] 2024-08-20T22:16:08.4949488Z + export PYTORCH_TESTING_DEVICE_ONLY_FOR=cuda 2024-08-20T22:16:08.4949949Z + PYTORCH_TESTING_DEVICE_ONLY_FOR=cuda 2024-08-20T22:16:08.4950383Z + [[ aot_eager_timm == *crossref* ]] 2024-08-20T22:16:08.4950939Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *rocm* ]] 2024-08-20T22:16:08.4951567Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *xpu* ]] 2024-08-20T22:16:08.4952219Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *-bazel-* ]] 2024-08-20T22:16:08.4952777Z + pip_install --user ninja==1.10.2 2024-08-20T22:16:08.4953306Z + pip install --progress-bar off --user ninja==1.10.2 2024-08-20T22:16:09.2393381Z Collecting ninja==1.10.2 2024-08-20T22:16:09.2574101Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl.metadata (5.0 kB) 2024-08-20T22:16:09.3179487Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl (108 kB) 2024-08-20T22:16:09.9191740Z Installing collected packages: ninja 2024-08-20T22:16:09.9270940Z  WARNING: The script ninja is installed in '/var/lib/jenkins/.local/bin' which is not on PATH. 2024-08-20T22:16:09.9272215Z Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. 2024-08-20T22:16:09.9857696Z Successfully installed ninja-1.10.2 2024-08-20T22:16:10.0643734Z + export PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-08-20T22:16:10.0646087Z + PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-08-20T22:16:10.0647801Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *aarch64* ]] 2024-08-20T22:16:10.0648329Z + install_tlparse 2024-08-20T22:16:10.0649183Z + pip_install --user tlparse==0.3.25 2024-08-20T22:16:10.0649846Z + pip install --progress-bar off --user tlparse==0.3.25 2024-08-20T22:16:10.4717987Z Collecting tlparse==0.3.25 2024-08-20T22:16:10.4923518Z Downloading tlparse-0.3.25-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (1.7 kB) 2024-08-20T22:16:10.5454128Z Downloading tlparse-0.3.25-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.2 MB) 2024-08-20T22:16:11.2072194Z Installing collected packages: tlparse 2024-08-20T22:16:11.2845233Z Successfully installed tlparse-0.3.25 2024-08-20T22:16:11.3635001Z ++ python -m site --user-base 2024-08-20T22:16:11.3881122Z + PATH=/var/lib/jenkins/.local/bin:/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-08-20T22:16:11.3883101Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *asan* ]] 2024-08-20T22:16:11.3883933Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *-debug* ]] 2024-08-20T22:16:11.3884610Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *-bazel-* ]] 2024-08-20T22:16:11.3885696Z + echo 'We are not in debug mode: linux-focal-cuda12.1-py3.10-gcc9-sm86. Expect the assertion to pass' 2024-08-20T22:16:11.3886917Z We are not in debug mode: linux-focal-cuda12.1-py3.10-gcc9-sm86. Expect the assertion to pass 2024-08-20T22:16:11.3887742Z + cd test 2024-08-20T22:16:11.3888310Z + python -c 'import torch; torch._C._crash_if_debug_asserts_fail(424242)' 2024-08-20T22:16:13.7196337Z + [[ aot_eager_timm == \n\o\g\p\u\_\N\O\_\A\V\X\2 ]] 2024-08-20T22:16:13.7196897Z + [[ aot_eager_timm == \n\o\g\p\u\_\A\V\X\5\1\2 ]] 2024-08-20T22:16:13.7201883Z + DYNAMO_BENCHMARK_FLAGS=() 2024-08-20T22:16:13.7202443Z + [[ aot_eager_timm == *pr_time_benchmarks* ]] 2024-08-20T22:16:13.7203059Z + [[ aot_eager_timm == *dynamo_eager* ]] 2024-08-20T22:16:13.7203534Z + [[ aot_eager_timm == *aot_eager* ]] 2024-08-20T22:16:13.7204272Z + DYNAMO_BENCHMARK_FLAGS+=(--backend aot_eager) 2024-08-20T22:16:13.7204735Z + [[ aot_eager_timm == *dynamic* ]] 2024-08-20T22:16:13.7205136Z + [[ aot_eager_timm == *cpu* ]] 2024-08-20T22:16:13.7205586Z + DYNAMO_BENCHMARK_FLAGS+=(--device cuda) 2024-08-20T22:16:13.7238589Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *libtorch* ]] 2024-08-20T22:16:13.7239470Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *-bazel-* ]] 2024-08-20T22:16:13.7242392Z + cd test 2024-08-20T22:16:13.7243025Z + python -c 'import torch; print(torch.__config__.show())' 2024-08-20T22:16:15.1943458Z PyTorch built with: 2024-08-20T22:16:15.1944236Z - GCC 9.4 2024-08-20T22:16:15.1944650Z - C++ Version: 201703 2024-08-20T22:16:15.1945518Z - Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications 2024-08-20T22:16:15.1946655Z - Intel(R) MKL-DNN v3.4.2 (Git Hash 1137e04ec0b5251ca2b4400a4fd3c667ce843d67) 2024-08-20T22:16:15.1947324Z - OpenMP 201511 (a.k.a. OpenMP 4.5) 2024-08-20T22:16:15.1947861Z - LAPACK is enabled (usually provided by MKL) 2024-08-20T22:16:15.1948349Z - NNPACK is enabled 2024-08-20T22:16:15.1948731Z - CPU capability usage: AVX2 2024-08-20T22:16:15.1949133Z - CUDA Runtime 12.1 2024-08-20T22:16:15.1949660Z - NVCC architecture flags: -gencode;arch=compute_86,code=sm_86 2024-08-20T22:16:15.1950673Z - CuDNN 90.1 (built against CUDA 12.4) 2024-08-20T22:16:15.1951123Z - Magma 2.6.1 2024-08-20T22:16:15.1958351Z - Build settings: BLAS_INFO=mkl, BUILD_TYPE=Release, CUDA_VERSION=12.1, CUDNN_VERSION=9.1.0, CXX_COMPILER=/opt/cache/bin/c++, CXX_FLAGS= -D_GLIBCXX_USE_CXX11_ABI=1 -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOROCTRACER -DLIBKINETO_NOXPUPTI=ON -DUSE_FBGEMM -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -O2 -fPIC -Wall -Wextra -Werror=return-type -Werror=non-virtual-dtor -Werror=bool-operation -Wnarrowing -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-unused-parameter -Wno-strict-overflow -Wno-strict-aliasing -Wno-stringop-overflow -Wsuggest-override -Wno-psabi -Wno-error=old-style-cast -Wno-missing-braces -fdiagnostics-color=always -faligned-new -Werror -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Wno-stringop-overflow, FORCE_FALLBACK_CUDA_MPI=1, LAPACK_INFO=mkl, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, PERF_WITH_AVX512=1, TORCH_VERSION=2.5.0, USE_CUDA=ON, USE_CUDNN=ON, USE_CUSPARSELT=ON, USE_EXCEPTION_PTR=1, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_GLOO=ON, USE_MKL=ON, USE_MKLDNN=ON, USE_MPI=ON, USE_NCCL=ON, USE_NNPACK=ON, USE_OPENMP=ON, USE_ROCM=OFF, USE_ROCM_KERNEL_ASSERT=OFF, 2024-08-20T22:16:15.1965034Z 2024-08-20T22:16:15.5126426Z + cd test 2024-08-20T22:16:15.5127188Z + python -c 'import torch; print(torch.__config__.parallel_info())' 2024-08-20T22:16:16.8641177Z ATen/Parallel: 2024-08-20T22:16:16.8641639Z at::get_num_threads() : 8 2024-08-20T22:16:16.8642143Z at::get_num_interop_threads() : 16 2024-08-20T22:16:16.8642709Z OpenMP 201511 (a.k.a. OpenMP 4.5) 2024-08-20T22:16:16.8643213Z omp_get_max_threads() : 8 2024-08-20T22:16:16.8644391Z Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications 2024-08-20T22:16:16.8645216Z mkl_get_max_threads() : 8 2024-08-20T22:16:16.8645840Z Intel(R) MKL-DNN v3.4.2 (Git Hash 1137e04ec0b5251ca2b4400a4fd3c667ce843d67) 2024-08-20T22:16:16.8646476Z std::thread::hardware_concurrency() : 16 2024-08-20T22:16:16.8646894Z Environment variables: 2024-08-20T22:16:16.8647243Z OMP_NUM_THREADS : [not set] 2024-08-20T22:16:16.8647610Z MKL_NUM_THREADS : [not set] 2024-08-20T22:16:16.8647979Z ATen parallel backend: OpenMP 2024-08-20T22:16:16.8648236Z 2024-08-20T22:16:17.1430630Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *aarch64* ]] 2024-08-20T22:16:17.1431272Z + [[ aot_eager_timm == *backward* ]] 2024-08-20T22:16:17.1431692Z + [[ aot_eager_timm == *xla* ]] 2024-08-20T22:16:17.1432111Z + [[ aot_eager_timm == *executorch* ]] 2024-08-20T22:16:17.1432592Z + [[ aot_eager_timm == \j\i\t\_\l\e\g\a\c\y ]] 2024-08-20T22:16:17.1433212Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *libtorch* ]] 2024-08-20T22:16:17.1433739Z + [[ aot_eager_timm == distributed ]] 2024-08-20T22:16:17.1434213Z + [[ aot_eager_timm == *inductor_distributed* ]] 2024-08-20T22:16:17.1434748Z + [[ aot_eager_timm == *inductor-halide* ]] 2024-08-20T22:16:17.1435467Z + [[ aot_eager_timm == *inductor-micro-benchmark* ]] 2024-08-20T22:16:17.1435992Z + [[ aot_eager_timm == *huggingface* ]] 2024-08-20T22:16:17.1436531Z + [[ aot_eager_timm == *timm* ]] 2024-08-20T22:16:17.1436907Z + install_torchvision 2024-08-20T22:16:17.1437230Z + local orig_preload 2024-08-20T22:16:17.1437542Z + local commit 2024-08-20T22:16:17.1437848Z ++ get_pinned_commit vision 2024-08-20T22:16:17.1438241Z ++ cat .github/ci_commit_pins/vision.txt 2024-08-20T22:16:17.1463168Z + commit=d23a6e1664d20707c11781299611436e1f0c104f 2024-08-20T22:16:17.1463617Z + orig_preload= 2024-08-20T22:16:17.1463979Z + '[' -n '' ']' 2024-08-20T22:16:17.1464823Z + pip_install --no-use-pep517 --user git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2024-08-20T22:16:17.1466274Z + pip install --progress-bar off --no-use-pep517 --user git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2024-08-20T22:16:17.4794888Z Collecting git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2024-08-20T22:16:17.4799853Z Cloning https://github.com/pytorch/vision.git (to revision d23a6e1664d20707c11781299611436e1f0c104f) to /tmp/pip-req-build-rj4p_a62 2024-08-20T22:16:17.4831963Z Running command git clone --filter=blob:none --quiet https://github.com/pytorch/vision.git /tmp/pip-req-build-rj4p_a62 2024-08-20T22:16:19.1121335Z Running command git rev-parse -q --verify 'sha^d23a6e1664d20707c11781299611436e1f0c104f' 2024-08-20T22:16:19.1148052Z Running command git fetch -q https://github.com/pytorch/vision.git d23a6e1664d20707c11781299611436e1f0c104f 2024-08-20T22:16:20.4424270Z Running command git checkout -q d23a6e1664d20707c11781299611436e1f0c104f 2024-08-20T22:16:20.7389672Z Resolved https://github.com/pytorch/vision.git to commit d23a6e1664d20707c11781299611436e1f0c104f 2024-08-20T22:16:23.2147607Z Preparing metadata (setup.py) ... [?25l- \ done 2024-08-20T22:16:23.2181754Z [?25hRequirement already satisfied: numpy in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (1.22.4) 2024-08-20T22:16:23.2185439Z Requirement already satisfied: torch in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (2.5.0a0+git40ec5f6) 2024-08-20T22:16:23.2190414Z Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (10.3.0) 2024-08-20T22:16:23.2267066Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (3.13.1) 2024-08-20T22:16:23.2271120Z Requirement already satisfied: typing-extensions>=4.8.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (4.12.2) 2024-08-20T22:16:23.2273535Z Requirement already satisfied: networkx in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (2.8.8) 2024-08-20T22:16:23.2276661Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (3.1.4) 2024-08-20T22:16:23.2280347Z Requirement already satisfied: fsspec in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (2024.6.1) 2024-08-20T22:16:23.2285198Z Requirement already satisfied: sympy==1.13.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (1.13.1) 2024-08-20T22:16:23.2298751Z Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from sympy==1.13.1->torch->torchvision==0.19.0a0+d23a6e1) (1.3.0) 2024-08-20T22:16:23.2771636Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from jinja2->torch->torchvision==0.19.0a0+d23a6e1) (2.1.5) 2024-08-20T22:16:23.2834671Z Building wheels for collected packages: torchvision 2024-08-20T22:17:40.8007083Z Building wheel for torchvision (setup.py) ... [?25l- \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / done 2024-08-20T22:17:40.8008947Z [?25h Created wheel for torchvision: filename=torchvision-0.19.0a0+d23a6e1-cp310-cp310-linux_x86_64.whl size=2116339 sha256=aa7b6543d28833f8d5c864945e3d30df1201181c2286adde4a2fb2b8f9cf1683 2024-08-20T22:17:40.8010584Z Stored in directory: /var/lib/jenkins/.cache/pip/wheels/0e/56/35/02931e71eb23fd2b85591c7ec05b733ca7c8b328a2fd151f96 2024-08-20T22:17:40.8011454Z Successfully built torchvision 2024-08-20T22:17:41.2745248Z Installing collected packages: torchvision 2024-08-20T22:17:41.6880230Z Successfully installed torchvision-0.19.0a0+d23a6e1 2024-08-20T22:17:41.8284385Z + '[' -n '' ']' 2024-08-20T22:17:41.8284821Z + id=1 2024-08-20T22:17:41.8285771Z + test_dynamo_benchmark timm_models 1 2024-08-20T22:17:41.8288614Z ++ pwd 2024-08-20T22:17:41.8292231Z + TEST_REPORTS_DIR=/var/lib/jenkins/workspace/test/test-reports 2024-08-20T22:17:41.8292956Z + local suite=timm_models 2024-08-20T22:17:41.8293402Z + shift 2024-08-20T22:17:41.8293687Z + local shard_id=1 2024-08-20T22:17:41.8294009Z + shift 2024-08-20T22:17:41.8298810Z + [[ aot_eager_timm == *perf_compare* ]] 2024-08-20T22:17:41.8299413Z + [[ aot_eager_timm == *perf* ]] 2024-08-20T22:17:41.8299815Z + [[ aot_eager_timm == *cpu* ]] 2024-08-20T22:17:41.8300281Z + [[ aot_eager_timm == *aot_inductor* ]] 2024-08-20T22:17:41.8301273Z + test_single_dynamo_benchmark inference timm_models 1 --inference --bfloat16 2024-08-20T22:17:41.8301916Z ++ pwd 2024-08-20T22:17:41.8303445Z + TEST_REPORTS_DIR=/var/lib/jenkins/workspace/test/test-reports 2024-08-20T22:17:41.8304141Z + mkdir -p /var/lib/jenkins/workspace/test/test-reports 2024-08-20T22:17:41.8352626Z + local name=inference 2024-08-20T22:17:41.8353109Z + shift 2024-08-20T22:17:41.8353490Z + local suite=timm_models 2024-08-20T22:17:41.8353922Z + shift 2024-08-20T22:17:41.8354274Z + local shard_id=1 2024-08-20T22:17:41.8354661Z + shift 2024-08-20T22:17:41.8355008Z + partition_flags=() 2024-08-20T22:17:41.8355448Z + local partition_flags 2024-08-20T22:17:41.8356119Z + [[ -n 2 ]] 2024-08-20T22:17:41.8356503Z + [[ -n 1 ]] 2024-08-20T22:17:41.8357098Z + partition_flags=(--total-partitions "$NUM_TEST_SHARDS" --partition-id "$shard_id") 2024-08-20T22:17:41.8357803Z + [[ aot_eager_timm == *perf_compare* ]] 2024-08-20T22:17:41.8358246Z + [[ aot_eager_timm == *perf* ]] 2024-08-20T22:17:41.8358647Z + [[ aot_eager_timm == *aot_inductor* ]] 2024-08-20T22:17:41.8359066Z + [[ aot_eager_timm == *_avx2* ]] 2024-08-20T22:17:41.8359471Z + [[ aot_eager_timm == *_avx512* ]] 2024-08-20T22:17:41.8361502Z + python benchmarks/dynamo/timm_models.py --ci --accuracy --timing --explain --backend aot_eager --device cuda --inference --bfloat16 --total-partitions 2 --partition-id 1 --output /var/lib/jenkins/workspace/test/test-reports/inference_timm_models.csv 2024-08-20T22:17:49.4234949Z 2024-08-20T22:17:49.6215569Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:17:49.6215904Z 2024-08-20T22:17:49.6900426Z model.safetensors: 0% 0.00/29.6M [00:00 will be ignored 2024-08-20T22:30:25.6491102Z pass 2024-08-20T22:30:25.6539973Z TIMING: entire_frame_compile:29.75627 backend_compile:14.7855 total_wall_time:29.75627 2024-08-20T22:30:25.6542870Z STATS: call_* op count: 700 | FakeTensorMode.__torch_dispatch__:35748 | FakeTensor.__torch_dispatch__:3080 | ProxyTorchDispatchMode.__torch_dispatch__:12852 2024-08-20T22:30:25.6544007Z Dynamo produced 4 graphs covering 700 ops with 7 graph breaks (5 unique) 2024-08-20T22:30:30.3569579Z 2024-08-20T22:30:31.1848974Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:30:31.1849477Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:30:31.1854148Z cuda train mobilenetv2_100 2024-08-20T22:30:45.6636563Z W0820 22:30:45.662000 4861 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T22:31:02.0743148Z pass 2024-08-20T22:31:02.0821488Z TIMING: entire_frame_compile:29.76148 backend_compile:14.64784 total_wall_time:29.76148 2024-08-20T22:31:02.0823924Z STATS: call_* op count: 699 | FakeTensorMode.__torch_dispatch__:35426 | FakeTensor.__torch_dispatch__:3062 | ProxyTorchDispatchMode.__torch_dispatch__:12588 2024-08-20T22:31:02.0826185Z Dynamo produced 3 graphs covering 699 ops with 7 graph breaks (5 unique) 2024-08-20T22:31:06.7194634Z 2024-08-20T22:31:07.6144226Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:31:07.6144699Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:31:07.6145146Z cuda train mobilenetv3_large_100 2024-08-20T22:31:22.8718704Z W0820 22:31:22.871000 4957 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T22:31:41.0206045Z pass 2024-08-20T22:31:41.0270948Z TIMING: entire_frame_compile:32.28088 backend_compile:15.79163 total_wall_time:32.28088 2024-08-20T22:31:41.0273639Z STATS: call_* op count: 775 | FakeTensorMode.__torch_dispatch__:38052 | FakeTensor.__torch_dispatch__:3430 | ProxyTorchDispatchMode.__torch_dispatch__:14152 2024-08-20T22:31:41.0275163Z Dynamo produced 3 graphs covering 775 ops with 7 graph breaks (5 unique) 2024-08-20T22:31:45.7073395Z 2024-08-20T22:31:46.6107189Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:31:46.6107677Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:31:46.6109546Z cuda train mobilevit_s 2024-08-20T22:32:04.5947044Z pass 2024-08-20T22:32:04.6218283Z TIMING: entire_frame_compile:16.24008 backend_compile:8.04479 total_wall_time:16.24008 2024-08-20T22:32:04.6219841Z STATS: call_* op count: 363 | FakeTensorMode.__torch_dispatch__:28520 | FakeTensor.__torch_dispatch__:186 | ProxyTorchDispatchMode.__torch_dispatch__:10817 2024-08-20T22:32:04.6221624Z Dynamo produced 3 graphs covering 363 ops with 6 graph breaks (5 unique) 2024-08-20T22:32:09.1923047Z 2024-08-20T22:32:10.4180600Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:32:10.4181175Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:32:10.4185187Z cuda train nfnet_l0 2024-08-20T22:32:28.8359383Z W0820 22:32:28.835000 5149 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T22:32:56.0684799Z pass 2024-08-20T22:32:56.1029337Z TIMING: entire_frame_compile:43.1267 backend_compile:21.36633 total_wall_time:43.1267 2024-08-20T22:32:56.1032603Z STATS: call_* op count: 1205 | FakeTensorMode.__torch_dispatch__:48963 | FakeTensor.__torch_dispatch__:4182 | ProxyTorchDispatchMode.__torch_dispatch__:21252 2024-08-20T22:32:56.1033773Z Dynamo produced 3 graphs covering 1205 ops with 7 graph breaks (5 unique) 2024-08-20T22:33:01.0620886Z 2024-08-20T22:33:02.1495665Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:33:02.1496157Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:33:02.1500460Z cuda train pit_b_224 2024-08-20T22:33:15.6693057Z pass 2024-08-20T22:33:15.7222652Z TIMING: entire_frame_compile:9.74164 backend_compile:5.3498 total_wall_time:9.74164 2024-08-20T22:33:15.7223865Z STATS: call_* op count: 310 | FakeTensorMode.__torch_dispatch__:19759 | FakeTensor.__torch_dispatch__:178 | ProxyTorchDispatchMode.__torch_dispatch__:8724 2024-08-20T22:33:15.7224974Z Dynamo produced 2 graphs covering 310 ops with 6 graph breaks (5 unique) 2024-08-20T22:33:20.0031568Z 2024-08-20T22:33:21.8031179Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:33:21.8031659Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:33:21.8032101Z cuda train pnasnet5large 2024-08-20T22:34:34.6239769Z pass 2024-08-20T22:34:34.7988125Z TIMING: entire_frame_compile:63.07222 backend_compile:26.56126 total_wall_time:63.07222 2024-08-20T22:34:34.7992364Z STATS: call_* op count: 1161 | FakeTensorMode.__torch_dispatch__:95780 | FakeTensor.__torch_dispatch__:36 | ProxyTorchDispatchMode.__torch_dispatch__:30261 2024-08-20T22:34:34.7994928Z Dynamo produced 2 graphs covering 1161 ops with 5 graph breaks (4 unique) 2024-08-20T22:34:40.2214534Z 2024-08-20T22:34:41.6181838Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:34:41.6182555Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:34:41.6183248Z cuda train poolformer_m36 2024-08-20T22:35:06.0403310Z pass 2024-08-20T22:35:06.1029313Z TIMING: entire_frame_compile:20.65309 backend_compile:9.8505 total_wall_time:20.65309 2024-08-20T22:35:06.1031494Z STATS: call_* op count: 554 | FakeTensorMode.__torch_dispatch__:33270 | ProxyTorchDispatchMode.__torch_dispatch__:13481 | FakeTensor.__torch_dispatch__:22 2024-08-20T22:35:06.1033444Z Dynamo produced 2 graphs covering 554 ops with 6 graph breaks (5 unique) 2024-08-20T22:35:10.6207297Z 2024-08-20T22:35:11.4639932Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:35:11.4640799Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:35:11.4641688Z cuda train regnety_002 2024-08-20T22:35:27.5440861Z pass 2024-08-20T22:35:27.5477609Z TIMING: entire_frame_compile:15.14479 backend_compile:7.02581 total_wall_time:15.14479 2024-08-20T22:35:27.5479397Z STATS: call_* op count: 271 | FakeTensorMode.__torch_dispatch__:22558 | FakeTensor.__torch_dispatch__:34 | ProxyTorchDispatchMode.__torch_dispatch__:7367 2024-08-20T22:35:27.5480660Z Dynamo produced 2 graphs covering 271 ops with 6 graph breaks (5 unique) 2024-08-20T22:35:31.9982264Z 2024-08-20T22:35:33.1097669Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:35:33.1098256Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:35:33.1101395Z cuda train repvgg_a2 2024-08-20T22:35:50.2398140Z W0820 22:35:50.238000 5628 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T22:36:06.9555337Z pass 2024-08-20T22:36:06.9825722Z TIMING: entire_frame_compile:31.30501 backend_compile:15.55585 total_wall_time:31.30501 2024-08-20T22:36:06.9828561Z STATS: call_* op count: 756 | FakeTensorMode.__torch_dispatch__:38445 | FakeTensor.__torch_dispatch__:3142 | ProxyTorchDispatchMode.__torch_dispatch__:13620 2024-08-20T22:36:06.9829718Z Dynamo produced 3 graphs covering 756 ops with 7 graph breaks (5 unique) 2024-08-20T22:36:11.6526360Z 2024-08-20T22:36:13.1406009Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:36:13.1406492Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:36:13.1406924Z cuda train res2net101_26w_4s 2024-08-20T22:37:01.1191645Z pass 2024-08-20T22:37:01.1580973Z TIMING: entire_frame_compile:43.56348 backend_compile:20.8708 total_wall_time:43.56348 2024-08-20T22:37:01.1583974Z STATS: call_* op count: 977 | FakeTensorMode.__torch_dispatch__:75348 | FakeTensor.__torch_dispatch__:46 | ProxyTorchDispatchMode.__torch_dispatch__:21353 2024-08-20T22:37:01.1585292Z Dynamo produced 2 graphs covering 977 ops with 6 graph breaks (5 unique) 2024-08-20T22:37:06.3332303Z 2024-08-20T22:37:07.5693963Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:37:07.5694566Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:37:07.5697306Z cuda train res2net50_14w_8s 2024-08-20T22:37:49.4334729Z pass 2024-08-20T22:37:49.4559230Z TIMING: entire_frame_compile:38.86488 backend_compile:19.25782 total_wall_time:38.86488 2024-08-20T22:37:49.4560636Z STATS: call_* op count: 852 | FakeTensorMode.__torch_dispatch__:68801 | FakeTensor.__torch_dispatch__:48 | ProxyTorchDispatchMode.__torch_dispatch__:18803 2024-08-20T22:37:49.4561756Z Dynamo produced 2 graphs covering 852 ops with 6 graph breaks (5 unique) 2024-08-20T22:37:54.5222718Z 2024-08-20T22:37:55.6185657Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:37:55.6186719Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:37:55.6187445Z cuda train res2next50 2024-08-20T22:38:20.4457272Z pass 2024-08-20T22:38:20.4704736Z TIMING: entire_frame_compile:22.45965 backend_compile:10.91792 total_wall_time:22.45965 2024-08-20T22:38:20.4706070Z STATS: call_* op count: 484 | FakeTensorMode.__torch_dispatch__:37846 | FakeTensor.__torch_dispatch__:38 | ProxyTorchDispatchMode.__torch_dispatch__:10643 2024-08-20T22:38:20.4707184Z Dynamo produced 2 graphs covering 484 ops with 6 graph breaks (5 unique) 2024-08-20T22:38:25.0924256Z 2024-08-20T22:38:25.7849744Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:38:25.7850217Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:38:25.7850645Z cuda train resmlp_12_224 2024-08-20T22:38:34.2658226Z pass 2024-08-20T22:38:34.2788936Z TIMING: entire_frame_compile:7.20307 backend_compile:3.83365 total_wall_time:7.20307 2024-08-20T22:38:34.2790149Z STATS: call_* op count: 179 | FakeTensorMode.__torch_dispatch__:12748 | ProxyTorchDispatchMode.__torch_dispatch__:6468 | FakeTensor.__torch_dispatch__:22 2024-08-20T22:38:34.2791277Z Dynamo produced 2 graphs covering 179 ops with 6 graph breaks (5 unique) 2024-08-20T22:38:38.5220118Z 2024-08-20T22:38:40.1446890Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:38:40.1447547Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:38:40.1448040Z cuda train resnest101e 2024-08-20T22:39:27.1555288Z pass 2024-08-20T22:39:27.2133841Z TIMING: entire_frame_compile:41.0977 backend_compile:19.53635 total_wall_time:41.0977 2024-08-20T22:39:27.2135144Z STATS: call_* op count: 1028 | FakeTensorMode.__torch_dispatch__:70770 | FakeTensor.__torch_dispatch__:38 | ProxyTorchDispatchMode.__torch_dispatch__:23525 2024-08-20T22:39:27.2136260Z Dynamo produced 2 graphs covering 1028 ops with 6 graph breaks (5 unique) 2024-08-20T22:39:32.3822520Z 2024-08-20T22:39:33.4660010Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:39:33.4660974Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:39:33.4661645Z cuda train rexnet_100 2024-08-20T22:39:54.3315260Z W0820 22:39:54.330000 6203 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T22:40:17.8599057Z pass 2024-08-20T22:40:17.8768418Z TIMING: entire_frame_compile:42.87316 backend_compile:21.07888 total_wall_time:42.87316 2024-08-20T22:40:17.8770785Z STATS: call_* op count: 1034 | FakeTensorMode.__torch_dispatch__:51850 | FakeTensor.__torch_dispatch__:4634 | ProxyTorchDispatchMode.__torch_dispatch__:19554 2024-08-20T22:40:17.8772400Z Dynamo produced 3 graphs covering 1034 ops with 7 graph breaks (5 unique) 2024-08-20T22:40:22.8551336Z 2024-08-20T22:40:23.9398468Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:40:23.9399210Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:40:23.9399799Z cuda train sebotnet33ts_256 2024-08-20T22:40:40.5614228Z pass 2024-08-20T22:40:40.5807717Z TIMING: entire_frame_compile:14.66648 backend_compile:7.24778 total_wall_time:14.66648 2024-08-20T22:40:40.5808932Z STATS: call_* op count: 372 | FakeTensorMode.__torch_dispatch__:24507 | FakeTensor.__torch_dispatch__:76 | ProxyTorchDispatchMode.__torch_dispatch__:8767 2024-08-20T22:40:40.5810061Z Dynamo produced 3 graphs covering 372 ops with 6 graph breaks (5 unique) 2024-08-20T22:40:45.0605908Z 2024-08-20T22:40:46.2604753Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:40:46.2605360Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:40:46.2607913Z cuda train selecsls42b 2024-08-20T22:40:58.5581496Z pass 2024-08-20T22:40:58.5855687Z TIMING: entire_frame_compile:10.7807 backend_compile:5.16704 total_wall_time:10.7807 2024-08-20T22:40:58.5858402Z STATS: call_* op count: 178 | FakeTensorMode.__torch_dispatch__:17044 | FakeTensor.__torch_dispatch__:48 | ProxyTorchDispatchMode.__torch_dispatch__:4891 2024-08-20T22:40:58.5861200Z Dynamo produced 2 graphs covering 178 ops with 6 graph breaks (5 unique) 2024-08-20T22:41:02.8383994Z 2024-08-20T22:41:03.7236528Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:41:03.7237123Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:41:03.7237586Z cuda train spnasnet_100 2024-08-20T22:41:21.2473031Z W0820 22:41:21.246000 6491 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T22:41:41.4112201Z pass 2024-08-20T22:41:41.4172217Z TIMING: entire_frame_compile:36.40551 backend_compile:18.12592 total_wall_time:36.40551 2024-08-20T22:41:41.4176932Z STATS: call_* op count: 855 | FakeTensorMode.__torch_dispatch__:43750 | FakeTensor.__torch_dispatch__:3738 | ProxyTorchDispatchMode.__torch_dispatch__:15761 2024-08-20T22:41:41.4178703Z Dynamo produced 3 graphs covering 855 ops with 7 graph breaks (5 unique) 2024-08-20T22:41:46.2126926Z 2024-08-20T22:41:48.0907553Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:41:48.0908436Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:41:48.0909311Z cuda train swin_base_patch4_window7_224 2024-08-20T22:42:18.5427802Z W0820 22:42:18.541000 6587 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T22:42:48.1094305Z pass 2024-08-20T22:42:48.1887523Z TIMING: entire_frame_compile:54.13939 backend_compile:29.48456 total_wall_time:54.13939 2024-08-20T22:42:48.1888726Z STATS: call_* op count: 2446 | FakeTensorMode.__torch_dispatch__:87495 | FakeTensor.__torch_dispatch__:6094 | ProxyTorchDispatchMode.__torch_dispatch__:39943 2024-08-20T22:42:48.1892536Z Dynamo produced 3 graphs covering 2446 ops with 7 graph breaks (5 unique) 2024-08-20T22:42:53.4123001Z 2024-08-20T22:42:56.6450213Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:42:56.6450822Z loading model: 0it [00:03, ?it/s] 2024-08-20T22:42:56.6451354Z cuda train swsl_resnext101_32x16d 2024-08-20T22:43:33.5447784Z pass 2024-08-20T22:43:33.7016709Z TIMING: entire_frame_compile:25.90497 backend_compile:11.92717 total_wall_time:25.90497 2024-08-20T22:43:33.7019788Z STATS: call_* op count: 453 | FakeTensorMode.__torch_dispatch__:41611 | FakeTensor.__torch_dispatch__:36 | ProxyTorchDispatchMode.__torch_dispatch__:11922 2024-08-20T22:43:33.7021202Z Dynamo produced 2 graphs covering 453 ops with 6 graph breaks (5 unique) 2024-08-20T22:43:38.3438398Z 2024-08-20T22:43:39.2796781Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:43:39.2797259Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:43:39.2797727Z cuda train tf_efficientnet_b0 2024-08-20T22:43:57.5684671Z pass 2024-08-20T22:43:57.5805542Z TIMING: entire_frame_compile:17.15167 backend_compile:8.15608 total_wall_time:17.15167 2024-08-20T22:43:57.5806973Z STATS: call_* op count: 297 | FakeTensorMode.__torch_dispatch__:26501 | FakeTensor.__torch_dispatch__:92 | ProxyTorchDispatchMode.__torch_dispatch__:9286 2024-08-20T22:43:57.5808993Z Dynamo produced 2 graphs covering 297 ops with 6 graph breaks (5 unique) 2024-08-20T22:44:02.0706089Z 2024-08-20T22:44:03.1037391Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:44:03.1038516Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:44:03.1039524Z cuda train tf_mixnet_l 2024-08-20T22:44:30.4440233Z pass 2024-08-20T22:44:30.4616544Z TIMING: entire_frame_compile:25.75202 backend_compile:11.63667 total_wall_time:25.75202 2024-08-20T22:44:30.4620532Z STATS: call_* op count: 598 | FakeTensorMode.__torch_dispatch__:39168 | FakeTensor.__torch_dispatch__:86 | ProxyTorchDispatchMode.__torch_dispatch__:13503 2024-08-20T22:44:30.4621796Z Dynamo produced 2 graphs covering 598 ops with 6 graph breaks (5 unique) 2024-08-20T22:44:35.0711606Z 2024-08-20T22:44:36.0563732Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:44:36.0564193Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:44:36.0566943Z cuda train tinynet_a 2024-08-20T22:44:57.3612820Z E0820 22:44:57.360000 6971 torch/_dynamo/utils.py:1688] RMSE (res-fp64): 0.00408, (ref-fp64): 0.00019 and shape=torch.Size([32]). res.dtype: torch.float32, multiplier: 3.000000, tol: 0.010000, use_larger_multiplier_for_smaller_tensor: 0 2024-08-20T22:44:57.3614495Z E0820 22:44:57.360000 6971 torch/_dynamo/utils.py:1580] Accuracy failed for key name bn1.weight.grad 2024-08-20T22:44:57.3651307Z fail_accuracy 2024-08-20T22:44:57.3757357Z TIMING: entire_frame_compile:20.19462 backend_compile:9.2233 total_wall_time:20.19462 2024-08-20T22:44:57.3758743Z STATS: call_* op count: 346 | FakeTensorMode.__torch_dispatch__:31114 | FakeTensor.__torch_dispatch__:92 | ProxyTorchDispatchMode.__torch_dispatch__:10942 2024-08-20T22:44:57.3759865Z Dynamo produced 2 graphs covering 346 ops with 6 graph breaks (5 unique) 2024-08-20T22:45:01.8678514Z 2024-08-20T22:45:02.8404025Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:45:02.8404731Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:45:02.8405380Z cuda train tnt_s_patch16_224 2024-08-20T22:45:26.7167618Z W0820 22:45:26.715000 7067 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T22:45:57.9572503Z pass 2024-08-20T22:45:57.9853302Z TIMING: entire_frame_compile:51.51832 backend_compile:28.56434 total_wall_time:51.51832 2024-08-20T22:45:57.9854535Z STATS: call_* op count: 1849 | FakeTensorMode.__torch_dispatch__:81714 | FakeTensor.__torch_dispatch__:6558 | ProxyTorchDispatchMode.__torch_dispatch__:38370 2024-08-20T22:45:57.9855658Z Dynamo produced 3 graphs covering 1849 ops with 7 graph breaks (5 unique) 2024-08-20T22:46:03.1512891Z 2024-08-20T22:46:04.5007536Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:46:04.5008012Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:46:04.5010425Z cuda train twins_pcpvt_base 2024-08-20T22:46:34.6271789Z W0820 22:46:34.626000 7163 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T22:47:21.9642202Z pass 2024-08-20T22:47:22.0018273Z TIMING: entire_frame_compile:72.80632 backend_compile:39.20069 total_wall_time:72.80632 2024-08-20T22:47:22.0021098Z STATS: call_* op count: 2432 | FakeTensorMode.__torch_dispatch__:104862 | FakeTensor.__torch_dispatch__:9888 | ProxyTorchDispatchMode.__torch_dispatch__:48600 2024-08-20T22:47:22.0022666Z Dynamo produced 3 graphs covering 2432 ops with 7 graph breaks (5 unique) 2024-08-20T22:47:27.5955807Z 2024-08-20T22:47:28.8113795Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:47:28.8116485Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:47:28.8117237Z cuda train visformer_small 2024-08-20T22:47:41.9368115Z W0820 22:47:41.935000 7258 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T22:47:56.0467800Z pass 2024-08-20T22:47:56.0811014Z TIMING: entire_frame_compile:24.82255 backend_compile:12.00048 total_wall_time:24.82255 2024-08-20T22:47:56.0815010Z STATS: call_* op count: 703 | FakeTensorMode.__torch_dispatch__:30522 | FakeTensor.__torch_dispatch__:2300 | ProxyTorchDispatchMode.__torch_dispatch__:12063 2024-08-20T22:47:56.0816175Z Dynamo produced 3 graphs covering 703 ops with 7 graph breaks (5 unique) 2024-08-20T22:48:00.6396865Z 2024-08-20T22:48:02.2026335Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:48:02.2026822Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:48:02.2030012Z cuda train vit_base_patch16_224 2024-08-20T22:48:14.9284183Z W0820 22:48:14.927000 7354 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T22:48:28.4496975Z pass 2024-08-20T22:48:28.5391629Z TIMING: entire_frame_compile:21.28938 backend_compile:11.73937 total_wall_time:21.28938 2024-08-20T22:48:28.5393798Z STATS: call_* op count: 740 | FakeTensorMode.__torch_dispatch__:30856 | FakeTensor.__torch_dispatch__:2952 | ProxyTorchDispatchMode.__torch_dispatch__:14361 2024-08-20T22:48:28.5394939Z Dynamo produced 3 graphs covering 740 ops with 7 graph breaks (5 unique) 2024-08-20T22:48:32.9939317Z 2024-08-20T22:48:34.1887984Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:48:34.1888454Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:48:34.1888891Z cuda train volo_d1_224 2024-08-20T22:48:51.3504006Z W0820 22:48:51.349000 7450 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T22:49:14.0922754Z pass 2024-08-20T22:49:14.1119870Z TIMING: entire_frame_compile:36.59565 backend_compile:20.10046 total_wall_time:36.59565 2024-08-20T22:49:14.1123707Z STATS: call_* op count: 1282 | FakeTensorMode.__torch_dispatch__:55304 | FakeTensor.__torch_dispatch__:4944 | ProxyTorchDispatchMode.__torch_dispatch__:25433 2024-08-20T22:49:14.1125987Z Dynamo produced 3 graphs covering 1282 ops with 7 graph breaks (5 unique) 2024-08-20T22:49:18.9439812Z 2024-08-20T22:49:22.3952946Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:49:22.3953375Z loading model: 0it [00:03, ?it/s] 2024-08-20T22:49:22.3960985Z cuda train xcit_large_24_p8_224 2024-08-20T22:49:26.7212126Z WARNING:common:fp64 golden ref were not generated for xcit_large_24_p8_224. Setting accuracy check to cosine 2024-08-20T22:50:05.6276392Z W0820 22:50:05.626000 7546 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T22:51:03.8809732Z pass_due_to_skip 2024-08-20T22:51:04.1474619Z TIMING: entire_frame_compile:92.02457 backend_compile:50.12888 total_wall_time:92.02457 2024-08-20T22:51:04.1476457Z STATS: call_* op count: 3042 | FakeTensorMode.__torch_dispatch__:136443 | FakeTensor.__torch_dispatch__:11714 | ProxyTorchDispatchMode.__torch_dispatch__:63704 2024-08-20T22:51:04.1478040Z Dynamo produced 3 graphs covering 3042 ops with 7 graph breaks (5 unique) 2024-08-20T22:51:07.1542564Z accuracy pass_rate=93.55% 2024-08-20T22:51:07.1546128Z calls_captured gmean=691.18x mean=887.871x 2024-08-20T22:51:07.1548674Z unique_graphs gmean=2.49x mean=2.548x 2024-08-20T22:51:07.1552120Z graph_breaks gmean=6.39x mean=6.419x 2024-08-20T22:51:07.1556064Z unique_graph_breaks gmean=4.96x mean=4.968x 2024-08-20T22:51:07.1560101Z autograd_captures gmean=0.00x mean=0.000x 2024-08-20T22:51:07.1565088Z autograd_compiles gmean=0.00x mean=0.000x 2024-08-20T22:51:07.1568939Z cudagraph_skips gmean=0.00x mean=0.000x 2024-08-20T22:51:07.8034537Z + python benchmarks/dynamo/check_accuracy.py --actual /var/lib/jenkins/workspace/test/test-reports/training_timm_models.csv --expected benchmarks/dynamo/ci_expected_accuracy/aot_eager_timm_training.csv 2024-08-20T22:51:08.0668243Z mixnet_l PASS 2024-08-20T22:51:08.0672570Z mnasnet_100 PASS 2024-08-20T22:51:08.0677361Z mobilenetv2_100 PASS 2024-08-20T22:51:08.0682226Z mobilenetv3_large_100 PASS 2024-08-20T22:51:08.0686780Z mobilevit_s PASS 2024-08-20T22:51:08.0691444Z nfnet_l0 PASS 2024-08-20T22:51:08.0695887Z pit_b_224 PASS 2024-08-20T22:51:08.0700473Z pnasnet5large PASS 2024-08-20T22:51:08.0705148Z poolformer_m36 PASS 2024-08-20T22:51:08.0709941Z regnety_002 PASS 2024-08-20T22:51:08.0714208Z repvgg_a2 PASS 2024-08-20T22:51:08.0718960Z res2net101_26w_4s PASS 2024-08-20T22:51:08.0723375Z res2net50_14w_8s PASS 2024-08-20T22:51:08.0728106Z res2next50 PASS 2024-08-20T22:51:08.0732694Z resmlp_12_224 PASS 2024-08-20T22:51:08.0737192Z resnest101e PASS 2024-08-20T22:51:08.0741749Z rexnet_100 PASS 2024-08-20T22:51:08.0746270Z sebotnet33ts_256 PASS 2024-08-20T22:51:08.0750748Z selecsls42b PASS 2024-08-20T22:51:08.0755218Z spnasnet_100 PASS 2024-08-20T22:51:08.0760083Z swin_base_patch4_window7_224 PASS 2024-08-20T22:51:08.0765024Z swsl_resnext101_32x16d PASS 2024-08-20T22:51:08.0769533Z tf_efficientnet_b0 PASS 2024-08-20T22:51:08.0773871Z tf_mixnet_l PASS 2024-08-20T22:51:08.0778443Z tinynet_a XFAIL 2024-08-20T22:51:08.0782935Z tnt_s_patch16_224 PASS 2024-08-20T22:51:08.0787464Z twins_pcpvt_base PASS 2024-08-20T22:51:08.0791912Z visformer_small PASS 2024-08-20T22:51:08.0796629Z vit_base_patch16_224 PASS 2024-08-20T22:51:08.0801161Z volo_d1_224 PASS 2024-08-20T22:51:08.0805703Z xcit_large_24_p8_224 XFAIL 2024-08-20T22:51:08.1242201Z + python benchmarks/dynamo/check_graph_breaks.py --actual /var/lib/jenkins/workspace/test/test-reports/training_timm_models.csv --expected benchmarks/dynamo/ci_expected_accuracy/aot_eager_timm_training.csv 2024-08-20T22:51:08.3875082Z mixnet_l PASS 2024-08-20T22:51:08.3879186Z mnasnet_100 PASS 2024-08-20T22:51:08.3883954Z mobilenetv2_100 PASS 2024-08-20T22:51:08.3888480Z mobilenetv3_large_100 PASS 2024-08-20T22:51:08.3893060Z mobilevit_s PASS 2024-08-20T22:51:08.3897617Z nfnet_l0 PASS 2024-08-20T22:51:08.3902034Z pit_b_224 PASS 2024-08-20T22:51:08.3906578Z pnasnet5large PASS 2024-08-20T22:51:08.3911099Z poolformer_m36 PASS 2024-08-20T22:51:08.3915527Z regnety_002 PASS 2024-08-20T22:51:08.3920476Z repvgg_a2 PASS 2024-08-20T22:51:08.3924882Z res2net101_26w_4s PASS 2024-08-20T22:51:08.3929361Z res2net50_14w_8s PASS 2024-08-20T22:51:08.3933992Z res2next50 PASS 2024-08-20T22:51:08.3938424Z resmlp_12_224 PASS 2024-08-20T22:51:08.3942981Z resnest101e PASS 2024-08-20T22:51:08.3947443Z rexnet_100 PASS 2024-08-20T22:51:08.3952024Z sebotnet33ts_256 PASS 2024-08-20T22:51:08.3956645Z selecsls42b PASS 2024-08-20T22:51:08.3961674Z spnasnet_100 PASS 2024-08-20T22:51:08.3966096Z swin_base_patch4_window7_224 PASS 2024-08-20T22:51:08.3970553Z swsl_resnext101_32x16d PASS 2024-08-20T22:51:08.3975158Z tf_efficientnet_b0 PASS 2024-08-20T22:51:08.3979656Z tf_mixnet_l PASS 2024-08-20T22:51:08.3984279Z tinynet_a PASS 2024-08-20T22:51:08.3988705Z tnt_s_patch16_224 PASS 2024-08-20T22:51:08.3993186Z twins_pcpvt_base PASS 2024-08-20T22:51:08.3997904Z visformer_small PASS 2024-08-20T22:51:08.4002313Z vit_base_patch16_224 PASS 2024-08-20T22:51:08.4006927Z volo_d1_224 PASS 2024-08-20T22:51:08.4011374Z xcit_large_24_p8_224 PASS 2024-08-20T22:51:08.4449014Z + cleanup_workspace 2024-08-20T22:51:08.4450004Z + echo 'sudo may print the following warning message that can be ignored. The chown command will still run.' 2024-08-20T22:51:08.4451362Z sudo may print the following warning message that can be ignored. The chown command will still run. 2024-08-20T22:51:08.4452474Z + echo ' sudo: setrlimit(RLIMIT_STACK): Operation not permitted' 2024-08-20T22:51:08.4453338Z sudo: setrlimit(RLIMIT_STACK): Operation not permitted 2024-08-20T22:51:08.4454164Z + echo 'For more details refer to https://github.com/sudo-project/sudo/issues/42' 2024-08-20T22:51:08.4455249Z For more details refer to https://github.com/sudo-project/sudo/issues/42 2024-08-20T22:51:08.4456075Z + sudo chown -R 1000 /var/lib/jenkins/workspace 2024-08-20T22:51:09.4225933Z ##[group]Run cat test/**/*_toprint.log || true 2024-08-20T22:51:09.4226437Z cat test/**/*_toprint.log || true 2024-08-20T22:51:09.4240542Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:51:09.4241049Z env: 2024-08-20T22:51:09.4241326Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:51:09.4241771Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:51:09.4242486Z DOCKER_CONTAINER_ID: a2ae227989a46a75f7e1cd17319896826cd63671228555255f05d11fdea4a10a 2024-08-20T22:51:09.4243116Z ##[endgroup] 2024-08-20T22:51:09.4336040Z cat: 'test/**/*_toprint.log': No such file or directory 2024-08-20T22:51:09.4368975Z ##[group]Run kill "$MONITOR_SCRIPT_PID" 2024-08-20T22:51:09.4369436Z kill "$MONITOR_SCRIPT_PID" 2024-08-20T22:51:09.4377600Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:51:09.4378107Z env: 2024-08-20T22:51:09.4378376Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:51:09.4378828Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:51:09.4379549Z DOCKER_CONTAINER_ID: a2ae227989a46a75f7e1cd17319896826cd63671228555255f05d11fdea4a10a 2024-08-20T22:51:09.4380205Z MONITOR_SCRIPT_PID: 240753 2024-08-20T22:51:09.4380558Z ##[endgroup] 2024-08-20T22:51:09.4579185Z Prepare all required actions 2024-08-20T22:51:09.4579630Z Getting action download info 2024-08-20T22:51:09.6743938Z Download action repository 'actions/upload-artifact@v3' (SHA:a8a3f3ad30e3422c9c7b888a15615d19a852ae32) 2024-08-20T22:51:09.8354929Z ##[group]Run ./.github/actions/upload-test-artifacts 2024-08-20T22:51:09.8355392Z with: 2024-08-20T22:51:09.8355984Z file-suffix: test-aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_29026299696 2024-08-20T22:51:09.8356935Z s3-bucket: gha-artifacts 2024-08-20T22:51:09.8357273Z env: 2024-08-20T22:51:09.8357538Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:51:09.8357985Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:51:09.8358701Z DOCKER_CONTAINER_ID: a2ae227989a46a75f7e1cd17319896826cd63671228555255f05d11fdea4a10a 2024-08-20T22:51:09.8359328Z ##[endgroup] 2024-08-20T22:51:09.8386129Z ##[group]Run # Remove any previous test jsons if they exist 2024-08-20T22:51:09.8386773Z # Remove any previous test jsons if they exist 2024-08-20T22:51:09.8387273Z rm -f test-jsons-*.zip 2024-08-20T22:51:09.8387791Z zip -r "test-jsons-${FILE_SUFFIX}.zip" test -i '*.json' 2024-08-20T22:51:09.8398048Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:51:09.8398549Z env: 2024-08-20T22:51:09.8398819Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:51:09.8399271Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:51:09.8400005Z DOCKER_CONTAINER_ID: a2ae227989a46a75f7e1cd17319896826cd63671228555255f05d11fdea4a10a 2024-08-20T22:51:09.8400860Z FILE_SUFFIX: test-aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_29026299696 2024-08-20T22:51:09.8401462Z ##[endgroup] 2024-08-20T22:51:09.8689326Z adding: test/allowlist_for_publicAPI.json (deflated 79%) 2024-08-20T22:51:09.8718489Z adding: test/benchmark_utils/callgrind_artifacts.json (deflated 92%) 2024-08-20T22:51:09.8719401Z adding: test/minioptest_failures_dict.json (deflated 70%) 2024-08-20T22:51:09.8725683Z adding: test/profiler/profiler_utils_mock_events.json (deflated 87%) 2024-08-20T22:51:09.8731328Z adding: test/slow_tests.json (deflated 82%) 2024-08-20T22:51:09.8764483Z ##[group]Run # Remove any previous test reports if they exist 2024-08-20T22:51:09.8765118Z # Remove any previous test reports if they exist 2024-08-20T22:51:09.8765633Z rm -f test-reports-*.zip 2024-08-20T22:51:09.8766219Z zip -r "test-reports-${FILE_SUFFIX}.zip" test -i '*.xml' -i '*.csv' 2024-08-20T22:51:09.8775321Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:51:09.8775814Z env: 2024-08-20T22:51:09.8776082Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:51:09.8776532Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:51:09.8777251Z DOCKER_CONTAINER_ID: a2ae227989a46a75f7e1cd17319896826cd63671228555255f05d11fdea4a10a 2024-08-20T22:51:09.8778097Z FILE_SUFFIX: test-aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_29026299696 2024-08-20T22:51:09.8778694Z ##[endgroup] 2024-08-20T22:51:09.9041677Z adding: test/test-reports/inference_timm_models.csv (deflated 69%) 2024-08-20T22:51:09.9042499Z adding: test/test-reports/training_timm_models.csv (deflated 66%) 2024-08-20T22:51:09.9046536Z adding: test/test-reports/training_timm_model_graph_breaks.csv (deflated 97%) 2024-08-20T22:51:09.9047485Z adding: test/test-reports/training_timm_model_graph_break_deduped.csv (deflated 74%) 2024-08-20T22:51:09.9080072Z ##[group]Run # Remove any previous usage logs if they exist 2024-08-20T22:51:09.9080692Z # Remove any previous usage logs if they exist 2024-08-20T22:51:09.9081188Z rm -f logs-*.zip 2024-08-20T22:51:09.9081854Z # this workflow is also run in bazel build test, but we dont generate usage reports for it 2024-08-20T22:51:09.9082646Z # so check to see if the file exists first 2024-08-20T22:51:09.9083139Z if [ -f 'usage_log.txt' ]; then 2024-08-20T22:51:09.9083662Z  zip "logs-${FILE_SUFFIX}.zip" 'usage_log.txt' 2024-08-20T22:51:09.9084336Z fi 2024-08-20T22:51:09.9084706Z if ls test/**/*.log 1> /dev/null 2>&1; then 2024-08-20T22:51:09.9085274Z  zip -r "logs-${FILE_SUFFIX}.zip" test -i '*.log' 2024-08-20T22:51:09.9085768Z fi 2024-08-20T22:51:09.9094437Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:51:09.9094935Z env: 2024-08-20T22:51:09.9095382Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:51:09.9095837Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:51:09.9096600Z DOCKER_CONTAINER_ID: a2ae227989a46a75f7e1cd17319896826cd63671228555255f05d11fdea4a10a 2024-08-20T22:51:09.9097470Z FILE_SUFFIX: test-aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_29026299696 2024-08-20T22:51:09.9098075Z ##[endgroup] 2024-08-20T22:51:09.9166524Z adding: usage_log.txt (deflated 92%) 2024-08-20T22:51:09.9258050Z ##[group]Run # Remove any previous debugging artifacts if they exist 2024-08-20T22:51:09.9258761Z # Remove any previous debugging artifacts if they exist 2024-08-20T22:51:09.9259306Z rm -f debug-*.zip 2024-08-20T22:51:09.9259689Z if [ -d 'test/debug' ]; then 2024-08-20T22:51:09.9260481Z  zip -r "debug-${FILE_SUFFIX}.zip" test/debug 2024-08-20T22:51:09.9260958Z fi 2024-08-20T22:51:09.9269259Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:51:09.9269755Z env: 2024-08-20T22:51:09.9270037Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:51:09.9270477Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:51:09.9271200Z DOCKER_CONTAINER_ID: a2ae227989a46a75f7e1cd17319896826cd63671228555255f05d11fdea4a10a 2024-08-20T22:51:09.9272046Z FILE_SUFFIX: test-aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_29026299696 2024-08-20T22:51:09.9272648Z ##[endgroup] 2024-08-20T22:51:09.9367045Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-08-20T22:51:09.9367481Z with: 2024-08-20T22:51:09.9367759Z s3-bucket: gha-artifacts 2024-08-20T22:51:09.9368195Z s3-prefix: pytorch/pytorch/10479310721/1/artifact 2024-08-20T22:51:09.9368665Z retention-days: 14 2024-08-20T22:51:09.9368990Z if-no-files-found: warn 2024-08-20T22:51:09.9369344Z path: test-jsons-*.zip 2024-08-20T22:51:09.9369681Z name: artifact 2024-08-20T22:51:09.9369971Z region: us-east-1 2024-08-20T22:51:09.9370268Z env: 2024-08-20T22:51:09.9370542Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:51:09.9371000Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:51:09.9371716Z DOCKER_CONTAINER_ID: a2ae227989a46a75f7e1cd17319896826cd63671228555255f05d11fdea4a10a 2024-08-20T22:51:09.9372347Z ##[endgroup] 2024-08-20T22:51:10.2922727Z NOTE: s3-prefix specified, ignoring name parameter 2024-08-20T22:51:10.2923466Z With the provided path, there will be 1 file uploaded 2024-08-20T22:51:10.2924275Z Uploading to s3 prefix: pytorch/pytorch/10479310721/1/artifact 2024-08-20T22:51:10.2982195Z Starting upload of test-jsons-test-aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_29026299696.zip 2024-08-20T22:51:10.4540475Z Finished upload of test-jsons-test-aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_29026299696.zip 2024-08-20T22:51:10.4826571Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-08-20T22:51:10.4827020Z with: 2024-08-20T22:51:10.4827310Z s3-bucket: gha-artifacts 2024-08-20T22:51:10.4827748Z s3-prefix: pytorch/pytorch/10479310721/1/artifact 2024-08-20T22:51:10.4828210Z retention-days: 14 2024-08-20T22:51:10.4828560Z if-no-files-found: error 2024-08-20T22:51:10.4828924Z path: test-reports-*.zip 2024-08-20T22:51:10.4829274Z name: artifact 2024-08-20T22:51:10.4829572Z region: us-east-1 2024-08-20T22:51:10.4829873Z env: 2024-08-20T22:51:10.4830150Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:51:10.4830610Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:51:10.4831326Z DOCKER_CONTAINER_ID: a2ae227989a46a75f7e1cd17319896826cd63671228555255f05d11fdea4a10a 2024-08-20T22:51:10.4831960Z ##[endgroup] 2024-08-20T22:51:10.8418279Z NOTE: s3-prefix specified, ignoring name parameter 2024-08-20T22:51:10.8418962Z With the provided path, there will be 1 file uploaded 2024-08-20T22:51:10.8419583Z Uploading to s3 prefix: pytorch/pytorch/10479310721/1/artifact 2024-08-20T22:51:10.8475096Z Starting upload of test-reports-test-aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_29026299696.zip 2024-08-20T22:51:10.9413835Z Finished upload of test-reports-test-aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_29026299696.zip 2024-08-20T22:51:10.9703741Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-08-20T22:51:10.9704177Z with: 2024-08-20T22:51:10.9704452Z s3-bucket: gha-artifacts 2024-08-20T22:51:10.9704883Z s3-prefix: pytorch/pytorch/10479310721/1/artifact 2024-08-20T22:51:10.9705348Z retention-days: 14 2024-08-20T22:51:10.9705674Z if-no-files-found: ignore 2024-08-20T22:51:10.9706025Z path: logs-*.zip 2024-08-20T22:51:10.9706330Z name: artifact 2024-08-20T22:51:10.9706621Z region: us-east-1 2024-08-20T22:51:10.9706916Z env: 2024-08-20T22:51:10.9707203Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:51:10.9707655Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:51:10.9708365Z DOCKER_CONTAINER_ID: a2ae227989a46a75f7e1cd17319896826cd63671228555255f05d11fdea4a10a 2024-08-20T22:51:10.9708994Z ##[endgroup] 2024-08-20T22:51:11.3262490Z NOTE: s3-prefix specified, ignoring name parameter 2024-08-20T22:51:11.3263153Z With the provided path, there will be 1 file uploaded 2024-08-20T22:51:11.3263825Z Uploading to s3 prefix: pytorch/pytorch/10479310721/1/artifact 2024-08-20T22:51:11.3318771Z Starting upload of logs-test-aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_29026299696.zip 2024-08-20T22:51:11.4289266Z Finished upload of logs-test-aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_29026299696.zip 2024-08-20T22:51:11.4576630Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-08-20T22:51:11.4577064Z with: 2024-08-20T22:51:11.4577344Z s3-bucket: gha-artifacts 2024-08-20T22:51:11.4577775Z s3-prefix: pytorch/pytorch/10479310721/1/artifact 2024-08-20T22:51:11.4578261Z retention-days: 14 2024-08-20T22:51:11.4578590Z if-no-files-found: ignore 2024-08-20T22:51:11.4578951Z path: debug-*.zip 2024-08-20T22:51:11.4579264Z name: artifact 2024-08-20T22:51:11.4579558Z region: us-east-1 2024-08-20T22:51:11.4579858Z env: 2024-08-20T22:51:11.4580133Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:51:11.4580589Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:51:11.4581324Z DOCKER_CONTAINER_ID: a2ae227989a46a75f7e1cd17319896826cd63671228555255f05d11fdea4a10a 2024-08-20T22:51:11.4581959Z ##[endgroup] 2024-08-20T22:51:11.8091686Z No files were found with the provided path: debug-*.zip. No artifacts will be uploaded. 2024-08-20T22:51:11.8378989Z ##[group]Run # shellcheck disable=SC2156 2024-08-20T22:51:11.8379464Z # shellcheck disable=SC2156 2024-08-20T22:51:11.8380246Z find . -iname "core.[1-9]*" -exec docker exec "${DOCKER_CONTAINER_ID}" sh -c "gdb python {} -ex 'bt' -ex 'q'" \; 2024-08-20T22:51:11.8390119Z shell: /usr/bin/bash -e {0} 2024-08-20T22:51:11.8390482Z env: 2024-08-20T22:51:11.8390767Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:51:11.8391225Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:51:11.8391942Z DOCKER_CONTAINER_ID: a2ae227989a46a75f7e1cd17319896826cd63671228555255f05d11fdea4a10a 2024-08-20T22:51:11.8392573Z ##[endgroup] 2024-08-20T22:51:12.1013772Z ##[group]Run pytorch/test-infra/.github/actions/teardown-linux@main 2024-08-20T22:51:12.1014338Z with: 2024-08-20T22:51:12.1014597Z env: 2024-08-20T22:51:12.1014860Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:51:12.1015295Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:51:12.1016009Z DOCKER_CONTAINER_ID: a2ae227989a46a75f7e1cd17319896826cd63671228555255f05d11fdea4a10a 2024-08-20T22:51:12.1016624Z ##[endgroup] 2024-08-20T22:51:12.1035671Z ##[group]Run set -eou pipefail 2024-08-20T22:51:12.1036130Z set -eou pipefail 2024-08-20T22:51:12.1036477Z  2024-08-20T22:51:12.1037030Z echo "Holding runner for 2 hours until all ssh sessions have logged out" 2024-08-20T22:51:12.1037660Z for _ in $(seq 1440); do 2024-08-20T22:51:12.1038131Z  # Break if no ssh session exists anymore 2024-08-20T22:51:12.1038630Z  if [ "$(who)" = "" ]; then 2024-08-20T22:51:12.1039042Z  break 2024-08-20T22:51:12.1039384Z  fi 2024-08-20T22:51:12.1039678Z  echo "." 2024-08-20T22:51:12.1040184Z  sleep 5 2024-08-20T22:51:12.1040506Z done 2024-08-20T22:51:12.1049349Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:51:12.1049838Z env: 2024-08-20T22:51:12.1050110Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:51:12.1050554Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:51:12.1051269Z DOCKER_CONTAINER_ID: a2ae227989a46a75f7e1cd17319896826cd63671228555255f05d11fdea4a10a 2024-08-20T22:51:12.1051889Z ##[endgroup] 2024-08-20T22:51:12.1080833Z Holding runner for 2 hours until all ssh sessions have logged out 2024-08-20T22:51:12.1146575Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2024-08-20T22:51:12.1147336Z # ignore expansion of "docker ps -q" since it could be empty 2024-08-20T22:51:12.1147932Z # shellcheck disable=SC2046 2024-08-20T22:51:12.1148409Z docker stop $(docker ps -q) || true 2024-08-20T22:51:12.1148884Z # Prune all of the docker images 2024-08-20T22:51:12.1149342Z docker system prune -af 2024-08-20T22:51:12.1157542Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:51:12.1158044Z env: 2024-08-20T22:51:12.1158321Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:51:12.1158775Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:51:12.1159500Z DOCKER_CONTAINER_ID: a2ae227989a46a75f7e1cd17319896826cd63671228555255f05d11fdea4a10a 2024-08-20T22:51:12.1160417Z ##[endgroup] 2024-08-20T22:51:12.6021528Z a2ae227989a4 2024-08-20T22:51:14.0414973Z Deleted Containers: 2024-08-20T22:51:14.0415974Z a2ae227989a46a75f7e1cd17319896826cd63671228555255f05d11fdea4a10a 2024-08-20T22:51:14.0416798Z 2024-08-20T22:51:23.5478990Z Deleted Images: 2024-08-20T22:51:23.5481073Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:51:23.5483408Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks@sha256:3a95d3a177465127ef6cd3b50787d6a050367070fd9063dbb688fad07a96b402 2024-08-20T22:51:23.5484962Z deleted: sha256:8fef7805cec6e829013a3d62f158b75bdc2f02cdfe3428c032ea017b488473bb 2024-08-20T22:51:23.5485823Z deleted: sha256:c2ce10014dd98f6abbfbf2265f9780a8204c2a7a27463e61ee565573a23d141d 2024-08-20T22:51:23.5486676Z deleted: sha256:ae249c0e6e6013bd6ffea2ca0b0160c015c9ebf7c03070bc2f983a9ff2415bf5 2024-08-20T22:51:23.5487513Z deleted: sha256:8a73883c1067c0e29ff128f553518682b47ed9707d2f35e7d5138e2caf029d61 2024-08-20T22:51:23.5488320Z deleted: sha256:9c040db729fa084584aaf5573082408a2196bc64e5952270c79dc610ed4680b6 2024-08-20T22:51:23.5489131Z deleted: sha256:17311eeeb8b71b16699880c0f646e185107496c4d41da5d23370603768ec030c 2024-08-20T22:51:23.5489975Z deleted: sha256:07cc10bece8501b1c8035d4385ad9e9867dd6e92fa32218a4dcb3e42af7e0411 2024-08-20T22:51:23.5491193Z deleted: sha256:f3e32d05099d1a3115a4722bc2e94a48752c3e965446773673808252671bb967 2024-08-20T22:51:23.5492035Z deleted: sha256:be7c3f41475e3e72ffe3ac2f92ab2f4cf49d5496b2aae738942ac3bb687d742c 2024-08-20T22:51:23.5492881Z deleted: sha256:4fcac490be825129b468cf458089f1fcf8fd56afc44ef4ab27c2eff41ab1ac90 2024-08-20T22:51:23.5493705Z deleted: sha256:31c66d80a2a4792897f267d363c0cf84fb821c5d4a275ab1636f778fd0284c08 2024-08-20T22:51:23.5494510Z deleted: sha256:8a8bcb6085e7e438e5533e8a5613e2ae5888543853568d023af3e2623a1593a9 2024-08-20T22:51:23.5495323Z deleted: sha256:2f6cb60029c79d11567b738f5bdbfb9cb1838cc0f194c4a5e6ae685178d2ed34 2024-08-20T22:51:23.5496134Z deleted: sha256:e546391804d3313f558e1ac16e93cb29a417a92e4eccaf0d4bd12af3bbcf39e3 2024-08-20T22:51:23.5496946Z deleted: sha256:1623b2aa16f2bdc6b572f6799498d9a92fa8114d07c440599b17aea72e22f8b1 2024-08-20T22:51:23.5497768Z deleted: sha256:c0386ca58b7cb7afee015b7e58d2f70525eaf73d6da2cc63868b20e14b1f9497 2024-08-20T22:51:23.5498594Z deleted: sha256:dcbf534ff289186e246531925fed90f72516eb3d63663bad234d611cdc025d62 2024-08-20T22:51:23.5499651Z deleted: sha256:0bab537af579f56c9cd51c7073fd53635fffb424b363236e0de38a7dd0e60ae8 2024-08-20T22:51:23.5500506Z deleted: sha256:d85a852ae1ee027e2fc17240ed68b87957b0a6d210c9119752d8979a0dcd55cf 2024-08-20T22:51:23.5501308Z deleted: sha256:f3821d761b555362e44cf9a1447d8fd2d95b37d54aea67c7519cd9e5db0c4d7e 2024-08-20T22:51:23.5502124Z deleted: sha256:c05e84a545db5dfcb0847c73d2b0f4749fa67aabce05705632ff7f76c84d4688 2024-08-20T22:51:23.5502945Z deleted: sha256:27054eae7ca67b2bd5ca0fd3f4488bf5c5f78e95487d8c45616f3d753d48a8b5 2024-08-20T22:51:23.5503753Z deleted: sha256:9804139f6ae97796aaa993fe4b89ea0cf111eb4d30a79f4c87c339c2e1e04fa0 2024-08-20T22:51:23.5504563Z deleted: sha256:ad6ae2fc594aaa359ff4e287323836570454eb24dd162930655e414d1d77c6dd 2024-08-20T22:51:23.5505475Z deleted: sha256:9cfbb36e328af52a248853a46aab88e266c09e2b44a03e0a42194a031b9b9453 2024-08-20T22:51:23.5506384Z deleted: sha256:a8a842bd7f37b8d50b6d12d6f95f46bbba57953db466fcbde9ba522625f024ef 2024-08-20T22:51:23.5507204Z deleted: sha256:da9738654b3c86f89ebeed2560f1bae093f1219f1eff90b0394b7f211ecabd04 2024-08-20T22:51:23.5508040Z deleted: sha256:cc683bf0cb245394e0f568984b2dd4fce1b6a3a7fe7c44734bae1aa1caaa3251 2024-08-20T22:51:23.5508860Z deleted: sha256:965f220e71c7d1ec19aaf41b1529ab287beb9d86eb8482c4c14094485ab34475 2024-08-20T22:51:23.5509687Z deleted: sha256:da32ecec41a73ce7dd29464f90c7951510a18cd378753659a78cd7fabd10dc36 2024-08-20T22:51:23.5510542Z deleted: sha256:d828d187cee9ad48dbc3702fb61d359619dd8a1ed582878680b51686bf117e5a 2024-08-20T22:51:23.5511355Z deleted: sha256:712111f4b12ff8e2787597d5fdcb043bd0824e55ddd97f262ef550506ca195f0 2024-08-20T22:51:23.5512159Z deleted: sha256:a064eea405958ad14dc6c794e5df9fd1d4515424272801ec559d45a59317309a 2024-08-20T22:51:23.5512978Z deleted: sha256:e124382d136bd5e9a8b409ca79c1f1ef76458deaf444b1b2060d3fa99dbeb506 2024-08-20T22:51:23.5513797Z deleted: sha256:6e10fe757cc190a1b31b47010f4f7610e02cb1b4b438f190dcd301aa4fe2278e 2024-08-20T22:51:23.5514604Z deleted: sha256:4cea352e10f46ca4729f96ac6c4600fc53d4c36e7658c2e0f19f4f309cd4a2a7 2024-08-20T22:51:23.5515419Z deleted: sha256:518bba00fe1d0933053066d21cac0235c9fb485abbc41557ec184b293095c924 2024-08-20T22:51:23.5516364Z deleted: sha256:a64f9ca42e9f27ff2690c15a5c84312e6efaccad45668d9b496cb542165cfb5a 2024-08-20T22:51:23.5517189Z deleted: sha256:096ea0fa14a6c420658f5276b8a8f5d264c0de7e18161ceda2cfc2f4a92cd9bf 2024-08-20T22:51:23.5518001Z deleted: sha256:6f91c94ce6e3f8034c91c66ee25c66a3d85dba9d813b749bd6d2000942a99edc 2024-08-20T22:51:23.5518829Z deleted: sha256:8f8d255eeae546cead8f9a94d237fa57a99940c0f5d51bc29a9d41c7df9cffd9 2024-08-20T22:51:23.5519725Z deleted: sha256:fe05276f4a49f91eef56bfbc3da87cfff5eb116a827fa2d30efe42ce1c134b40 2024-08-20T22:51:23.5520594Z deleted: sha256:5f83cd75d0669c813d4f58978c92e14305cd8f6a07eb9a60665a583460fa7b59 2024-08-20T22:51:23.5521393Z deleted: sha256:8f7ab6366169d39d8953129f650f1927d2fb1328b3f11e2fd9076adb5f46b93a 2024-08-20T22:51:23.5522338Z deleted: sha256:4146cfd5dba0f5308954749f98596b14a1d8f6d23bd93f7ad86c6c3d72239328 2024-08-20T22:51:23.5523180Z deleted: sha256:c6d83cb9ccc606ff63bb3c4d5a5e1ff1450c619b5aae494303a94ae25971cca0 2024-08-20T22:51:23.5524003Z deleted: sha256:71e037e0a3e0963c4565534a7387c082afcb04475d3ac629acf7a0ab2f49fadc 2024-08-20T22:51:23.5524798Z deleted: sha256:4b31135c564686bdaf23262b901237880aea635655721cc7e8c95dc42b05e06d 2024-08-20T22:51:23.5525602Z deleted: sha256:d09bd5c2f35cedcb846543941ee64ce1f684b52e4285696c93b3fb2032da8579 2024-08-20T22:51:23.5526434Z deleted: sha256:4de7fb7d4fc22212aae5fc1ceb637526916d0cced240d7c93d5edd6b0ea28013 2024-08-20T22:51:23.5527258Z deleted: sha256:69890e3e82746e10aff2f1084f11afb4b95a4a6c26b30f64b7001bc0a5fe32bf 2024-08-20T22:51:23.5528064Z deleted: sha256:0156df53b3224e645336ea52b4bb816f1e8d8c9b591748cd645e5e5649fa507b 2024-08-20T22:51:23.5528865Z deleted: sha256:0664624cb9cc4a386f31bf49919a8d8a11d9fea428d05585d9e6228f754bc7cd 2024-08-20T22:51:23.5529686Z deleted: sha256:8c2ddd5fa535c768c058a23f5cc4b6c64cdd71bb7458491282aabc7f7bb94d69 2024-08-20T22:51:23.5530596Z deleted: sha256:8dd03dbe0e1c5f47dd333074dff4bd00415f2f63727a65bf17866774e2ebbd0d 2024-08-20T22:51:23.5531405Z deleted: sha256:3c56b63e094bd18fad9da7a541d537210bca3b730c590d3641213259f6908d6f 2024-08-20T22:51:23.5532210Z deleted: sha256:51484fef07bd1266d4d6ff3d767751172660fc4cc6a1ffe883523a63c985e31e 2024-08-20T22:51:23.5533287Z deleted: sha256:03e83c94023982ab7dd8dc65a6df2024e342f1b760c91ec7a680ee45824869c7 2024-08-20T22:51:23.5534092Z deleted: sha256:58440ab3e8175b5de94a76485c8689a6dc186015475ebf4b386ebba309c5da34 2024-08-20T22:51:23.5534900Z deleted: sha256:9a980f3383e8aa511f0ef68982cb6dfc53b38d1ac8c3d673cb3ba3d45158c91e 2024-08-20T22:51:23.5535730Z deleted: sha256:cb0269c9cf1c47b6c4188ca7be4db261b5d3fc4b4a5153629e222dba7b1f9f98 2024-08-20T22:51:23.5536560Z deleted: sha256:41f1ba870cdffc05e0bf8d87b640fb9d4c153d7f4f3b775f37f94e9f3d584aad 2024-08-20T22:51:23.5537382Z deleted: sha256:7b502ab352f48e8b6eb5e6824a29f308952a5ee7c7d987562e1df7e47639d7f1 2024-08-20T22:51:23.5538196Z deleted: sha256:6ba5217e18738660e6ca8b7a7ec88845e70b0fd781301520bf46c71d99df3144 2024-08-20T22:51:23.5539017Z deleted: sha256:dd5a1c233594780163726bdbbf5de00f7b6b8dca1dace8a001340714c54baedb 2024-08-20T22:51:23.5539858Z deleted: sha256:c27f0db27da73e01f67f6cb78d10f355e350d829479ba4351d82055bb29f6597 2024-08-20T22:51:23.5540693Z deleted: sha256:4e3ce3c854f35c08be3dd95e0d6e718512a885e4614291d7d8b7cd23f48b7dd8 2024-08-20T22:51:23.5541519Z deleted: sha256:c2d6fb088bbec16e60cf0ad74b016f7287c92e659ec2db01271bc309b4dc6d83 2024-08-20T22:51:23.5542346Z deleted: sha256:35a033279d5c9bd6b862bfa9331d8fcbf98bbaf778a778fabc882384db9204f8 2024-08-20T22:51:23.5543160Z deleted: sha256:ab9b00c496073d62e69e032178858d3d6d4c4bab9e87065d3785c6da57351d00 2024-08-20T22:51:23.5543957Z deleted: sha256:7ed947299e109c2459de6e240d86f049c30f93f2380659ce441d8737b8cd065f 2024-08-20T22:51:23.5544762Z deleted: sha256:410d5a7f7a9a1cb4551c106b9cc728a9dcff598f9be231a351ce6a0a33f81e64 2024-08-20T22:51:23.5545591Z deleted: sha256:5f0021bb56efa14bb93978c01513e2a1187ba30e69bdb0546d0ef39b30873f88 2024-08-20T22:51:23.5546405Z deleted: sha256:c1601aa97eb84151c14da3aeea351201bd99144d36d66b397f6555d80245d86d 2024-08-20T22:51:23.5547223Z deleted: sha256:72af05a89be22accdc1ca5d66dcbbb33993a9ef5997f849df1d4ba4c48049f25 2024-08-20T22:51:23.5548049Z deleted: sha256:38b90c9663dcaa2bc57a4dd3008298e7ea93e9535fa42312b4dc4246e7491af9 2024-08-20T22:51:23.5548881Z deleted: sha256:bda61b6cefb3ec8eeb74fef1ca1c7f9a5845fe5e8f07b8123323e897425d5c29 2024-08-20T22:51:23.5549713Z deleted: sha256:5a18e1aa877074529a84cbddf19f8d5403787823378ceae6b72fb62f78d43037 2024-08-20T22:51:23.5550563Z deleted: sha256:6c3e7df31590f02f10cb71fc4eb27653e9b428df2e6e5421a455b062bd2e39f9 2024-08-20T22:51:23.5551057Z 2024-08-20T22:51:23.5551201Z Total reclaimed space: 44.86GB 2024-08-20T22:51:23.5620181Z Post job cleanup. 2024-08-20T22:51:23.5695754Z Post job cleanup. 2024-08-20T22:51:23.6580012Z [command]/usr/bin/git version 2024-08-20T22:51:23.6630112Z git version 2.40.1 2024-08-20T22:51:23.6661212Z Copying '/home/ec2-user/.gitconfig' to '/home/ec2-user/actions-runner/_work/_temp/1770420c-0a20-4f1e-9bdf-7f3b540d4fc6/.gitconfig' 2024-08-20T22:51:23.6672844Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/1770420c-0a20-4f1e-9bdf-7f3b540d4fc6' before making global git config changes 2024-08-20T22:51:23.6674074Z Adding repository directory to the temporary git global config as a safe directory 2024-08-20T22:51:23.6677209Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-20T22:51:23.6730600Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2024-08-20T22:51:23.6776216Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2024-08-20T22:51:23.7157164Z Entering 'android/libs/fbjni' 2024-08-20T22:51:23.7229258Z Entering 'third_party/FP16' 2024-08-20T22:51:23.7298856Z Entering 'third_party/FXdiv' 2024-08-20T22:51:23.7367383Z Entering 'third_party/NNPACK' 2024-08-20T22:51:23.7436168Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T22:51:23.7505099Z Entering 'third_party/XNNPACK' 2024-08-20T22:51:23.7589456Z Entering 'third_party/benchmark' 2024-08-20T22:51:23.7657442Z Entering 'third_party/cpp-httplib' 2024-08-20T22:51:23.7725684Z Entering 'third_party/cpuinfo' 2024-08-20T22:51:23.7793621Z Entering 'third_party/cudnn_frontend' 2024-08-20T22:51:23.7861019Z Entering 'third_party/cutlass' 2024-08-20T22:51:23.7937101Z Entering 'third_party/eigen' 2024-08-20T22:51:23.8007206Z Entering 'third_party/fbgemm' 2024-08-20T22:51:23.8074107Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:51:23.8141855Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:51:23.8209392Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:51:23.8283497Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:51:23.8349859Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:51:23.8419080Z Entering 'third_party/flatbuffers' 2024-08-20T22:51:23.8490139Z Entering 'third_party/fmt' 2024-08-20T22:51:23.8557282Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:51:23.8626425Z Entering 'third_party/gloo' 2024-08-20T22:51:23.8696929Z Entering 'third_party/googletest' 2024-08-20T22:51:23.8764800Z Entering 'third_party/ideep' 2024-08-20T22:51:23.8829531Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T22:51:23.8905481Z Entering 'third_party/ittapi' 2024-08-20T22:51:23.8972581Z Entering 'third_party/kineto' 2024-08-20T22:51:23.9041528Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:51:23.9107952Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:51:23.9177470Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:51:23.9244455Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:51:23.9312241Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:51:23.9384092Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:51:23.9455653Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:51:23.9523693Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:51:23.9590858Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:51:23.9658253Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:51:23.9728629Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:51:23.9795526Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:51:23.9867778Z Entering 'third_party/mimalloc' 2024-08-20T22:51:23.9935387Z Entering 'third_party/nccl/nccl' 2024-08-20T22:51:24.0005276Z Entering 'third_party/nlohmann' 2024-08-20T22:51:24.0075048Z Entering 'third_party/onnx' 2024-08-20T22:51:24.0155990Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T22:51:24.0226094Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T22:51:24.0298307Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T22:51:24.0366662Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:51:24.0434463Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:51:24.0503075Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:51:24.0570067Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:51:24.0637463Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:51:24.0705039Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:51:24.0772580Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:51:24.0837369Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:51:24.0907061Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:51:24.0978459Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:51:24.1067472Z Entering 'third_party/pocketfft' 2024-08-20T22:51:24.1138898Z Entering 'third_party/protobuf' 2024-08-20T22:51:24.1209967Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:51:24.1278020Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T22:51:24.1349916Z Entering 'third_party/psimd' 2024-08-20T22:51:24.1417765Z Entering 'third_party/pthreadpool' 2024-08-20T22:51:24.1486001Z Entering 'third_party/pybind11' 2024-08-20T22:51:24.1554131Z Entering 'third_party/python-peachpy' 2024-08-20T22:51:24.1622463Z Entering 'third_party/sleef' 2024-08-20T22:51:24.1690608Z Entering 'third_party/tensorpipe' 2024-08-20T22:51:24.1756330Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:51:24.1825361Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:51:24.1891440Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:51:24.1957972Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:51:24.2024767Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:51:24.2119481Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2024-08-20T22:51:24.2155315Z http.https://github.com/.extraheader 2024-08-20T22:51:24.2165609Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader 2024-08-20T22:51:24.2211857Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2024-08-20T22:51:24.2585666Z Entering 'android/libs/fbjni' 2024-08-20T22:51:24.2628627Z http.https://github.com/.extraheader 2024-08-20T22:51:24.2674848Z Entering 'third_party/FP16' 2024-08-20T22:51:24.2718989Z http.https://github.com/.extraheader 2024-08-20T22:51:24.2763971Z Entering 'third_party/FXdiv' 2024-08-20T22:51:24.2808161Z http.https://github.com/.extraheader 2024-08-20T22:51:24.2851748Z Entering 'third_party/NNPACK' 2024-08-20T22:51:24.2896304Z http.https://github.com/.extraheader 2024-08-20T22:51:24.2940107Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T22:51:24.2984511Z http.https://github.com/.extraheader 2024-08-20T22:51:24.3029934Z Entering 'third_party/XNNPACK' 2024-08-20T22:51:24.3074617Z http.https://github.com/.extraheader 2024-08-20T22:51:24.3135935Z Entering 'third_party/benchmark' 2024-08-20T22:51:24.3180723Z http.https://github.com/.extraheader 2024-08-20T22:51:24.3224778Z Entering 'third_party/cpp-httplib' 2024-08-20T22:51:24.3269958Z http.https://github.com/.extraheader 2024-08-20T22:51:24.3314034Z Entering 'third_party/cpuinfo' 2024-08-20T22:51:24.3359366Z http.https://github.com/.extraheader 2024-08-20T22:51:24.3404130Z Entering 'third_party/cudnn_frontend' 2024-08-20T22:51:24.3448103Z http.https://github.com/.extraheader 2024-08-20T22:51:24.3492523Z Entering 'third_party/cutlass' 2024-08-20T22:51:24.3536211Z http.https://github.com/.extraheader 2024-08-20T22:51:24.3586892Z Entering 'third_party/eigen' 2024-08-20T22:51:24.3630230Z http.https://github.com/.extraheader 2024-08-20T22:51:24.3679407Z Entering 'third_party/fbgemm' 2024-08-20T22:51:24.3722309Z http.https://github.com/.extraheader 2024-08-20T22:51:24.3766175Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:51:24.3812283Z http.https://github.com/.extraheader 2024-08-20T22:51:24.3854435Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:51:24.3900052Z http.https://github.com/.extraheader 2024-08-20T22:51:24.3946682Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:51:24.3991374Z http.https://github.com/.extraheader 2024-08-20T22:51:24.4040878Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:51:24.4087413Z http.https://github.com/.extraheader 2024-08-20T22:51:24.4130339Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:51:24.4175250Z http.https://github.com/.extraheader 2024-08-20T22:51:24.4220707Z Entering 'third_party/flatbuffers' 2024-08-20T22:51:24.4265478Z http.https://github.com/.extraheader 2024-08-20T22:51:24.4310185Z Entering 'third_party/fmt' 2024-08-20T22:51:24.4353456Z http.https://github.com/.extraheader 2024-08-20T22:51:24.4396824Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:51:24.4440146Z http.https://github.com/.extraheader 2024-08-20T22:51:24.4482609Z Entering 'third_party/gloo' 2024-08-20T22:51:24.4527159Z http.https://github.com/.extraheader 2024-08-20T22:51:24.4569633Z Entering 'third_party/googletest' 2024-08-20T22:51:24.4613542Z http.https://github.com/.extraheader 2024-08-20T22:51:24.4655755Z Entering 'third_party/ideep' 2024-08-20T22:51:24.4698490Z http.https://github.com/.extraheader 2024-08-20T22:51:24.4738837Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T22:51:24.4780497Z http.https://github.com/.extraheader 2024-08-20T22:51:24.4831162Z Entering 'third_party/ittapi' 2024-08-20T22:51:24.4875058Z http.https://github.com/.extraheader 2024-08-20T22:51:24.4916930Z Entering 'third_party/kineto' 2024-08-20T22:51:24.4959519Z http.https://github.com/.extraheader 2024-08-20T22:51:24.5000964Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:51:24.5043107Z http.https://github.com/.extraheader 2024-08-20T22:51:24.5084715Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:51:24.5126695Z http.https://github.com/.extraheader 2024-08-20T22:51:24.5171714Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:51:24.5213906Z http.https://github.com/.extraheader 2024-08-20T22:51:24.5262654Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:51:24.5306349Z http.https://github.com/.extraheader 2024-08-20T22:51:24.5349986Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:51:24.5393721Z http.https://github.com/.extraheader 2024-08-20T22:51:24.5436822Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:51:24.5482055Z http.https://github.com/.extraheader 2024-08-20T22:51:24.5530501Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:51:24.5573631Z http.https://github.com/.extraheader 2024-08-20T22:51:24.5617518Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:51:24.5659606Z http.https://github.com/.extraheader 2024-08-20T22:51:24.5704522Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:51:24.5747163Z http.https://github.com/.extraheader 2024-08-20T22:51:24.5793019Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:51:24.5834929Z http.https://github.com/.extraheader 2024-08-20T22:51:24.5882239Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:51:24.5925032Z http.https://github.com/.extraheader 2024-08-20T22:51:24.5968492Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:51:24.6011314Z http.https://github.com/.extraheader 2024-08-20T22:51:24.6057915Z Entering 'third_party/mimalloc' 2024-08-20T22:51:24.6102686Z http.https://github.com/.extraheader 2024-08-20T22:51:24.6147261Z Entering 'third_party/nccl/nccl' 2024-08-20T22:51:24.6190987Z http.https://github.com/.extraheader 2024-08-20T22:51:24.6235393Z Entering 'third_party/nlohmann' 2024-08-20T22:51:24.6279434Z http.https://github.com/.extraheader 2024-08-20T22:51:24.6326176Z Entering 'third_party/onnx' 2024-08-20T22:51:24.6370324Z http.https://github.com/.extraheader 2024-08-20T22:51:24.6428131Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T22:51:24.6471336Z http.https://github.com/.extraheader 2024-08-20T22:51:24.6515021Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T22:51:24.6561061Z http.https://github.com/.extraheader 2024-08-20T22:51:24.6611628Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T22:51:24.6655366Z http.https://github.com/.extraheader 2024-08-20T22:51:24.6701942Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:51:24.6748138Z http.https://github.com/.extraheader 2024-08-20T22:51:24.6796263Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:51:24.6838561Z http.https://github.com/.extraheader 2024-08-20T22:51:24.6881868Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:51:24.6928957Z http.https://github.com/.extraheader 2024-08-20T22:51:24.6972382Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:51:24.7015062Z http.https://github.com/.extraheader 2024-08-20T22:51:24.7059895Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:51:24.7104200Z http.https://github.com/.extraheader 2024-08-20T22:51:24.7146613Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:51:24.7191621Z http.https://github.com/.extraheader 2024-08-20T22:51:24.7235611Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:51:24.7282240Z http.https://github.com/.extraheader 2024-08-20T22:51:24.7325900Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:51:24.7369367Z http.https://github.com/.extraheader 2024-08-20T22:51:24.7415272Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:51:24.7458114Z http.https://github.com/.extraheader 2024-08-20T22:51:24.7506625Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:51:24.7548683Z http.https://github.com/.extraheader 2024-08-20T22:51:24.7613900Z Entering 'third_party/pocketfft' 2024-08-20T22:51:24.7658184Z http.https://github.com/.extraheader 2024-08-20T22:51:24.7701944Z Entering 'third_party/protobuf' 2024-08-20T22:51:24.7745175Z http.https://github.com/.extraheader 2024-08-20T22:51:24.7792999Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:51:24.7835426Z http.https://github.com/.extraheader 2024-08-20T22:51:24.7883707Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T22:51:24.7927349Z http.https://github.com/.extraheader 2024-08-20T22:51:24.7975615Z Entering 'third_party/psimd' 2024-08-20T22:51:24.8019761Z http.https://github.com/.extraheader 2024-08-20T22:51:24.8064097Z Entering 'third_party/pthreadpool' 2024-08-20T22:51:24.8108207Z http.https://github.com/.extraheader 2024-08-20T22:51:24.8151474Z Entering 'third_party/pybind11' 2024-08-20T22:51:24.8198851Z http.https://github.com/.extraheader 2024-08-20T22:51:24.8243994Z Entering 'third_party/python-peachpy' 2024-08-20T22:51:24.8288869Z http.https://github.com/.extraheader 2024-08-20T22:51:24.8333828Z Entering 'third_party/sleef' 2024-08-20T22:51:24.8378185Z http.https://github.com/.extraheader 2024-08-20T22:51:24.8421381Z Entering 'third_party/tensorpipe' 2024-08-20T22:51:24.8466948Z http.https://github.com/.extraheader 2024-08-20T22:51:24.8509310Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:51:24.8551873Z http.https://github.com/.extraheader 2024-08-20T22:51:24.8595423Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:51:24.8637373Z http.https://github.com/.extraheader 2024-08-20T22:51:24.8680975Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:51:24.8725123Z http.https://github.com/.extraheader 2024-08-20T22:51:24.8768598Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:51:24.8811235Z http.https://github.com/.extraheader 2024-08-20T22:51:24.8852446Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:51:24.8896725Z http.https://github.com/.extraheader 2024-08-20T22:51:24.9060395Z A job completed hook has been configured by the self-hosted runner administrator 2024-08-20T22:51:24.9080853Z ##[group]Run '/home/ec2-user/runner-scripts/after_job.sh' 2024-08-20T22:51:24.9088957Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:51:24.9089670Z ##[endgroup] 2024-08-20T22:51:32.3037586Z Cleaning up orphan processes