2024-08-20T22:05:10.9914924Z Current runner version: '2.319.1' 2024-08-20T22:05:10.9921109Z Runner name: 'i-0a5ee6a6662a7d0e6' 2024-08-20T22:05:10.9921977Z Runner group name: 'Default' 2024-08-20T22:05:10.9922847Z Machine name: 'ip-10-0-40-180' 2024-08-20T22:05:10.9939450Z Testing runner upgrade compatibility 2024-08-20T22:05:11.1484969Z ##[group]GITHUB_TOKEN Permissions 2024-08-20T22:05:11.1487096Z Actions: read 2024-08-20T22:05:11.1487630Z Attestations: read 2024-08-20T22:05:11.1488228Z Checks: read 2024-08-20T22:05:11.1488724Z Contents: read 2024-08-20T22:05:11.1489340Z Deployments: read 2024-08-20T22:05:11.1489920Z Discussions: read 2024-08-20T22:05:11.1490397Z Issues: read 2024-08-20T22:05:11.1490912Z Metadata: read 2024-08-20T22:05:11.1491478Z Packages: read 2024-08-20T22:05:11.1491989Z Pages: read 2024-08-20T22:05:11.1492501Z PullRequests: read 2024-08-20T22:05:11.1493133Z RepositoryProjects: read 2024-08-20T22:05:11.1493734Z SecurityEvents: read 2024-08-20T22:05:11.1494262Z Statuses: read 2024-08-20T22:05:11.1495020Z ##[endgroup] 2024-08-20T22:05:11.1498381Z Secret source: Actions 2024-08-20T22:05:11.1499313Z Prepare workflow directory 2024-08-20T22:05:11.6704110Z Prepare all required actions 2024-08-20T22:05:11.6875972Z Getting action download info 2024-08-20T22:05:11.8615372Z Download action repository 'pytorch/test-infra@main' (SHA:0c3a2634aaa2f638c8f640e743f03d696ce1191f) 2024-08-20T22:05:12.4442245Z Download action repository 'pytorch/pytorch@main' (SHA:1ae5d5bb62141d7c9b1b0b66c66a462b4e10b1f2) 2024-08-20T22:05:16.5074782Z Download action repository 'aws-actions/configure-aws-credentials@v3' (SHA:50ac8dd1e1b10d09dac7b8727528b91bed831ac0) 2024-08-20T22:05:16.6833894Z Download action repository 'seemethere/upload-artifact-s3@v5' (SHA:baba72d0712b404f646cebe0730933554ebce96a) 2024-08-20T22:05:16.9306167Z Getting action download info 2024-08-20T22:05:17.0460939Z Download action repository 'malfet/checkout@silent-checkout' (SHA:e07af140b3ccefc05679e3755b9db68f4ee4589c) 2024-08-20T22:05:17.2329428Z Getting action download info 2024-08-20T22:05:17.3355605Z Download action repository 'nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482' (SHA:3e91a01664abd3c5cd539100d10d33b9c5b68482) 2024-08-20T22:05:17.4674396Z Uses: pytorch/pytorch/.github/workflows/_linux-test.yml@refs/tags/ciflow/inductor/133712 (40ec5f6ddd9787aca0449b24128343ff4c4a88b3) 2024-08-20T22:05:17.4676533Z ##[group] Inputs 2024-08-20T22:05:17.4677001Z build-environment: linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-08-20T22:05:17.4683951Z test-matrix: {"include": [{"config": "dynamo_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}]} 2024-08-20T22:05:17.4691595Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:05:17.4692746Z sync-tag: 2024-08-20T22:05:17.4693595Z timeout-minutes: 240 2024-08-20T22:05:17.4693923Z use-gha: 2024-08-20T22:05:17.4694209Z dashboard-tag: 2024-08-20T22:05:17.4694524Z s3-bucket: gha-artifacts 2024-08-20T22:05:17.4694872Z aws-role-to-assume: 2024-08-20T22:05:17.4695200Z ##[endgroup] 2024-08-20T22:05:17.4696202Z Complete job name: cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (dynamo_eager_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:05:17.5362060Z A job started hook has been configured by the self-hosted runner administrator 2024-08-20T22:05:17.5500877Z ##[group]Run '/home/ec2-user/runner-scripts/before_job.sh' 2024-08-20T22:05:17.5512526Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:05:17.5513060Z ##[endgroup] 2024-08-20T22:05:20.0564857Z Runner Type: linux.g5.4xlarge.nvidia.gpu 2024-08-20T22:05:20.0565383Z Instance Type: g5.4xlarge 2024-08-20T22:05:20.0566111Z AMI Name: al2023-ami-2023.5.20240701.0-kernel-6.1-x86_64 2024-08-20T22:05:20.0566676Z AMI ID: ami-06c68f701d8090592 2024-08-20T22:05:25.9138189Z ##[group]Run pytorch/test-infra/.github/actions/setup-ssh@main 2024-08-20T22:05:25.9138756Z with: 2024-08-20T22:05:25.9139407Z github-secret: *** 2024-08-20T22:05:25.9140314Z instructions: All testing is done inside the container, to start an interactive session run: docker exec -it $(docker container ps --format '{{.ID}}') bash 2024-08-20T22:05:25.9141506Z activate-with-label: false 2024-08-20T22:05:25.9141864Z label: with-ssh 2024-08-20T22:05:25.9142181Z remove-existing-keys: true 2024-08-20T22:05:25.9142541Z fail-silently: true 2024-08-20T22:05:25.9142843Z env: 2024-08-20T22:05:25.9143112Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:05:25.9143462Z ##[endgroup] 2024-08-20T22:05:26.0042074Z Please see https://github.com/pytorch/pytorch/wiki/Debugging-using-with-ssh-for-Github-Actions for more info. 2024-08-20T22:05:26.0045140Z ciflow reference detected, attempting to extract PR number 2024-08-20T22:05:26.2678931Z Grabbing public ssh keys from https://github.com/pytorch-bot[bot].keys 2024-08-20T22:05:26.3514557Z No SSH keys found for user pytorch-bot[bot] 2024-08-20T22:05:26.3515169Z Grabbing public ssh keys from https://github.com/XuehaiPan.keys 2024-08-20T22:05:26.4171215Z ~/.ssh/authorized_keys file found on node, removing ~/.ssh and starting fresh 2024-08-20T22:05:26.4190062Z Public keys pulled and installed to /home/ec2-user/.ssh/authorized_keys 2024-08-20T22:05:26.4216350Z Login using: ssh ec2-user@ec2-52-207-176-69.compute-1.amazonaws.com 2024-08-20T22:05:26.4217112Z All testing is done inside the container, to start an interactive session run: 2024-08-20T22:05:26.4217902Z docker exec -it $(docker container ps --format '{{.ID}}') bash 2024-08-20T22:05:26.4350746Z ##[group]Run pytorch/pytorch/.github/actions/checkout-pytorch@main 2024-08-20T22:05:26.4351300Z with: 2024-08-20T22:05:26.4351583Z submodules: recursive 2024-08-20T22:05:26.4351913Z fetch-depth: 0 2024-08-20T22:05:26.4352210Z env: 2024-08-20T22:05:26.4352483Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:05:26.4352819Z ##[endgroup] 2024-08-20T22:05:26.4542151Z ##[group]Run retry () { 2024-08-20T22:05:26.4542545Z retry () { 2024-08-20T22:05:26.4543064Z  $* || (sleep 1 && $*) || (sleep 2 && $*) || (sleep 4 && $*) || (sleep 8 && $*) 2024-08-20T22:05:26.4543615Z } 2024-08-20T22:05:26.4543923Z echo "${GITHUB_WORKSPACE}" 2024-08-20T22:05:26.4544347Z if [ -z "${NO_SUDO}" ]; then 2024-08-20T22:05:26.4544825Z  retry sudo rm -rf "${GITHUB_WORKSPACE}" 2024-08-20T22:05:26.4545278Z else 2024-08-20T22:05:26.4545622Z  retry rm -rf "${GITHUB_WORKSPACE}" 2024-08-20T22:05:26.4546048Z fi 2024-08-20T22:05:26.4546630Z mkdir "${GITHUB_WORKSPACE}" 2024-08-20T22:05:26.4556664Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:05:26.4557163Z env: 2024-08-20T22:05:26.4557437Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:05:26.4557773Z NO_SUDO: 2024-08-20T22:05:26.4558047Z ##[endgroup] 2024-08-20T22:05:26.4588712Z /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-20T22:05:31.2841501Z ##[group]Run malfet/checkout@silent-checkout 2024-08-20T22:05:31.2841942Z with: 2024-08-20T22:05:31.2842272Z ref: 40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:05:31.2842712Z fetch-depth: 0 2024-08-20T22:05:31.2843026Z submodules: recursive 2024-08-20T22:05:31.2843362Z quiet-checkout: true 2024-08-20T22:05:31.2843713Z repository: pytorch/pytorch 2024-08-20T22:05:31.2844194Z token: *** 2024-08-20T22:05:31.2844489Z ssh-strict: true 2024-08-20T22:05:31.2844807Z persist-credentials: true 2024-08-20T22:05:31.2845161Z clean: true 2024-08-20T22:05:31.2845494Z sparse-checkout-cone-mode: true 2024-08-20T22:05:31.2845892Z lfs: false 2024-08-20T22:05:31.2846186Z set-safe-directory: true 2024-08-20T22:05:31.2846525Z env: 2024-08-20T22:05:31.2846797Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:05:31.2847129Z ##[endgroup] 2024-08-20T22:05:31.3823905Z Syncing repository: pytorch/pytorch 2024-08-20T22:05:31.3825381Z ##[group]Getting Git version info 2024-08-20T22:05:31.3826100Z Working directory is '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2024-08-20T22:05:31.3826928Z [command]/usr/bin/git version 2024-08-20T22:05:31.3827287Z git version 2.40.1 2024-08-20T22:05:31.3828703Z ##[endgroup] 2024-08-20T22:05:31.3842379Z Copying '/home/ec2-user/.gitconfig' to '/home/ec2-user/actions-runner/_work/_temp/73dacc29-d5cc-46d1-8208-d68e3a44da4f/.gitconfig' 2024-08-20T22:05:31.3849485Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/73dacc29-d5cc-46d1-8208-d68e3a44da4f' before making global git config changes 2024-08-20T22:05:31.3850702Z Adding repository directory to the temporary git global config as a safe directory 2024-08-20T22:05:31.3853859Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-20T22:05:31.3908777Z Deleting the contents of '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2024-08-20T22:05:31.3912494Z ##[group]Initializing the repository 2024-08-20T22:05:31.3915460Z [command]/usr/bin/git init /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-20T22:05:31.3963387Z hint: Using 'master' as the name for the initial branch. This default branch name 2024-08-20T22:05:31.3964268Z hint: is subject to change. To configure the initial branch name to use in all 2024-08-20T22:05:31.3965080Z hint: of your new repositories, which will suppress this warning, call: 2024-08-20T22:05:31.3965653Z hint: 2024-08-20T22:05:31.3966121Z hint: git config --global init.defaultBranch 2024-08-20T22:05:31.3966591Z hint: 2024-08-20T22:05:31.3967469Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-08-20T22:05:31.3968374Z hint: 'development'. The just-created branch can be renamed via this command: 2024-08-20T22:05:31.3968954Z hint: 2024-08-20T22:05:31.3969284Z hint: git branch -m 2024-08-20T22:05:31.3970036Z Initialized empty Git repository in /home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/ 2024-08-20T22:05:31.3976657Z [command]/usr/bin/git remote add origin https://github.com/pytorch/pytorch 2024-08-20T22:05:31.4021189Z ##[endgroup] 2024-08-20T22:05:31.4022047Z ##[group]Disabling automatic garbage collection 2024-08-20T22:05:31.4024875Z [command]/usr/bin/git config --local gc.auto 0 2024-08-20T22:05:31.4071112Z ##[endgroup] 2024-08-20T22:05:31.4071890Z ##[group]Setting up auth 2024-08-20T22:05:31.4077858Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2024-08-20T22:05:31.4122367Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2024-08-20T22:05:31.4488519Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2024-08-20T22:05:31.4533101Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2024-08-20T22:05:31.4891736Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic *** 2024-08-20T22:05:31.4958249Z ##[endgroup] 2024-08-20T22:05:31.4959067Z ##[group]Fetching the repository 2024-08-20T22:05:31.4965805Z [command]/usr/bin/git -c protocol.version=2 fetch --prune --progress --no-recurse-submodules --quiet origin +refs/heads/*:refs/remotes/origin/* +refs/tags/*:refs/tags/* 2024-08-20T22:05:34.2933935Z remote: Enumerating objects: 1008518 2024-08-20T22:05:34.2934680Z remote: Enumerating objects: 1010208, done. 2024-08-20T22:05:34.2936046Z remote: Counting objects: 0% (1/1690) 2024-08-20T22:05:34.2936736Z remote: Counting objects: 1% (17/1690) 2024-08-20T22:05:34.2937492Z remote: Counting objects: 2% (34/1690) 2024-08-20T22:05:34.2938298Z remote: Counting objects: 3% (51/1690) 2024-08-20T22:05:34.2939043Z remote: Counting objects: 4% (68/1690) 2024-08-20T22:05:34.2939707Z remote: Counting objects: 5% (85/1690) 2024-08-20T22:05:34.2940366Z remote: Counting objects: 6% (102/1690) 2024-08-20T22:05:34.2941282Z remote: Counting objects: 7% (119/1690) 2024-08-20T22:05:34.2941869Z remote: Counting objects: 8% (136/1690) 2024-08-20T22:05:34.2942474Z remote: Counting objects: 9% (153/1690) 2024-08-20T22:05:34.2943145Z remote: Counting objects: 10% (169/1690) 2024-08-20T22:05:34.2943784Z remote: Counting objects: 11% (186/1690) 2024-08-20T22:05:34.2944405Z remote: Counting objects: 12% (203/1690) 2024-08-20T22:05:34.2945022Z remote: Counting objects: 13% (220/1690) 2024-08-20T22:05:34.2945520Z remote: Counting objects: 14% (237/1690) 2024-08-20T22:05:34.2946009Z remote: Counting objects: 15% (254/1690) 2024-08-20T22:05:34.2946575Z remote: Counting objects: 16% (271/1690) 2024-08-20T22:05:34.2947233Z remote: Counting objects: 17% (288/1690) 2024-08-20T22:05:34.2947812Z remote: Counting objects: 18% (305/1690) 2024-08-20T22:05:34.2948298Z remote: Counting objects: 19% (322/1690) 2024-08-20T22:05:34.2948804Z remote: Counting objects: 20% (338/1690) 2024-08-20T22:05:34.2949315Z remote: Counting objects: 21% (355/1690) 2024-08-20T22:05:34.2949803Z remote: Counting objects: 22% (372/1690) 2024-08-20T22:05:34.2950287Z remote: Counting objects: 23% (389/1690) 2024-08-20T22:05:34.2950766Z remote: Counting objects: 24% (406/1690) 2024-08-20T22:05:34.2951251Z remote: Counting objects: 25% (423/1690) 2024-08-20T22:05:34.2952298Z remote: Counting objects: 26% (440/1690) 2024-08-20T22:05:34.2952941Z remote: Counting objects: 27% (457/1690) 2024-08-20T22:05:34.2953725Z remote: Counting objects: 28% (474/1690) 2024-08-20T22:05:34.2954263Z remote: Counting objects: 29% (491/1690) 2024-08-20T22:05:34.2954904Z remote: Counting objects: 30% (507/1690) 2024-08-20T22:05:34.2955468Z remote: Counting objects: 31% (524/1690) 2024-08-20T22:05:34.2955952Z remote: Counting objects: 32% (541/1690) 2024-08-20T22:05:34.2956431Z remote: Counting objects: 33% (558/1690) 2024-08-20T22:05:34.2956916Z remote: Counting objects: 34% (575/1690) 2024-08-20T22:05:34.2957399Z remote: Counting objects: 35% (592/1690) 2024-08-20T22:05:34.2957882Z remote: Counting objects: 36% (609/1690) 2024-08-20T22:05:34.2958358Z remote: Counting objects: 37% (626/1690) 2024-08-20T22:05:34.2958847Z remote: Counting objects: 38% (643/1690) 2024-08-20T22:05:34.2959519Z remote: Counting objects: 39% (660/1690) 2024-08-20T22:05:34.2960001Z remote: Counting objects: 40% (676/1690) 2024-08-20T22:05:34.2960476Z remote: Counting objects: 41% (693/1690) 2024-08-20T22:05:34.2960962Z remote: Counting objects: 42% (710/1690) 2024-08-20T22:05:34.2961447Z remote: Counting objects: 43% (727/1690) 2024-08-20T22:05:34.2961924Z remote: Counting objects: 44% (744/1690) 2024-08-20T22:05:34.2962404Z remote: Counting objects: 45% (761/1690) 2024-08-20T22:05:34.2962889Z remote: Counting objects: 46% (778/1690) 2024-08-20T22:05:34.2963376Z remote: Counting objects: 47% (795/1690) 2024-08-20T22:05:34.2963855Z remote: Counting objects: 48% (812/1690) 2024-08-20T22:05:34.2964337Z remote: Counting objects: 49% (829/1690) 2024-08-20T22:05:34.2964822Z remote: Counting objects: 50% (845/1690) 2024-08-20T22:05:34.2965311Z remote: Counting objects: 51% (862/1690) 2024-08-20T22:05:34.2965797Z remote: Counting objects: 52% (879/1690) 2024-08-20T22:05:34.2966283Z remote: Counting objects: 53% (896/1690) 2024-08-20T22:05:34.2966770Z remote: Counting objects: 54% (913/1690) 2024-08-20T22:05:34.2967251Z remote: Counting objects: 55% (930/1690) 2024-08-20T22:05:34.2967727Z remote: Counting objects: 56% (947/1690) 2024-08-20T22:05:34.2968212Z remote: Counting objects: 57% (964/1690) 2024-08-20T22:05:34.2968749Z remote: Counting objects: 58% (981/1690) 2024-08-20T22:05:34.2969238Z remote: Counting objects: 59% (998/1690) 2024-08-20T22:05:34.2969725Z remote: Counting objects: 60% (1014/1690) 2024-08-20T22:05:34.2970235Z remote: Counting objects: 61% (1031/1690) 2024-08-20T22:05:34.2970742Z remote: Counting objects: 62% (1048/1690) 2024-08-20T22:05:34.2971256Z remote: Counting objects: 63% (1065/1690) 2024-08-20T22:05:34.2971766Z remote: Counting objects: 64% (1082/1690) 2024-08-20T22:05:34.2972294Z remote: Counting objects: 65% (1099/1690) 2024-08-20T22:05:34.2972795Z remote: Counting objects: 66% (1116/1690) 2024-08-20T22:05:34.2973294Z remote: Counting objects: 67% (1133/1690) 2024-08-20T22:05:34.2973792Z remote: Counting objects: 68% (1150/1690) 2024-08-20T22:05:34.2974292Z remote: Counting objects: 69% (1167/1690) 2024-08-20T22:05:34.2974787Z remote: Counting objects: 70% (1183/1690) 2024-08-20T22:05:34.2975287Z remote: Counting objects: 71% (1200/1690) 2024-08-20T22:05:34.2975788Z remote: Counting objects: 72% (1217/1690) 2024-08-20T22:05:34.2976288Z remote: Counting objects: 73% (1234/1690) 2024-08-20T22:05:34.2976780Z remote: Counting objects: 74% (1251/1690) 2024-08-20T22:05:34.2977278Z remote: Counting objects: 75% (1268/1690) 2024-08-20T22:05:34.2977776Z remote: Counting objects: 76% (1285/1690) 2024-08-20T22:05:34.2978378Z remote: Counting objects: 77% (1302/1690) 2024-08-20T22:05:34.2978877Z remote: Counting objects: 78% (1319/1690) 2024-08-20T22:05:34.2979379Z remote: Counting objects: 79% (1336/1690) 2024-08-20T22:05:34.2979880Z remote: Counting objects: 80% (1352/1690) 2024-08-20T22:05:34.2980379Z remote: Counting objects: 81% (1369/1690) 2024-08-20T22:05:34.2980871Z remote: Counting objects: 82% (1386/1690) 2024-08-20T22:05:34.2981374Z remote: Counting objects: 83% (1403/1690) 2024-08-20T22:05:34.2981869Z remote: Counting objects: 84% (1420/1690) 2024-08-20T22:05:34.2982367Z remote: Counting objects: 85% (1437/1690) 2024-08-20T22:05:34.2982857Z remote: Counting objects: 86% (1454/1690) 2024-08-20T22:05:34.2983352Z remote: Counting objects: 87% (1471/1690) 2024-08-20T22:05:34.2983850Z remote: Counting objects: 88% (1488/1690) 2024-08-20T22:05:34.2984346Z remote: Counting objects: 89% (1505/1690) 2024-08-20T22:05:34.2984941Z remote: Counting objects: 90% (1521/1690) 2024-08-20T22:05:34.2985437Z remote: Counting objects: 91% (1538/1690) 2024-08-20T22:05:34.2985933Z remote: Counting objects: 92% (1555/1690) 2024-08-20T22:05:34.2986425Z remote: Counting objects: 93% (1572/1690) 2024-08-20T22:05:34.2986923Z remote: Counting objects: 94% (1589/1690) 2024-08-20T22:05:34.2987417Z remote: Counting objects: 95% (1606/1690) 2024-08-20T22:05:34.2987913Z remote: Counting objects: 96% (1623/1690) 2024-08-20T22:05:34.2988404Z remote: Counting objects: 97% (1640/1690) 2024-08-20T22:05:34.2988904Z remote: Counting objects: 98% (1657/1690) 2024-08-20T22:05:34.2989403Z remote: Counting objects: 99% (1674/1690) 2024-08-20T22:05:34.2989901Z remote: Counting objects: 100% (1690/1690) 2024-08-20T22:05:34.2990436Z remote: Counting objects: 100% (1690/1690), done. 2024-08-20T22:05:34.3072329Z remote: Compressing objects: 0% (1/875) 2024-08-20T22:05:34.3392613Z remote: Compressing objects: 1% (9/875) 2024-08-20T22:05:34.3662335Z remote: Compressing objects: 2% (18/875) 2024-08-20T22:05:34.4124110Z remote: Compressing objects: 3% (27/875) 2024-08-20T22:05:34.4805245Z remote: Compressing objects: 4% (35/875) 2024-08-20T22:05:34.5351150Z remote: Compressing objects: 5% (44/875) 2024-08-20T22:05:34.5787922Z remote: Compressing objects: 6% (53/875) 2024-08-20T22:05:34.6214341Z remote: Compressing objects: 7% (62/875) 2024-08-20T22:05:34.6640086Z remote: Compressing objects: 8% (70/875) 2024-08-20T22:05:34.6940251Z remote: Compressing objects: 9% (79/875) 2024-08-20T22:05:34.7168835Z remote: Compressing objects: 10% (88/875) 2024-08-20T22:05:34.7451682Z remote: Compressing objects: 11% (97/875) 2024-08-20T22:05:34.7665573Z remote: Compressing objects: 12% (105/875) 2024-08-20T22:05:34.7858980Z remote: Compressing objects: 13% (114/875) 2024-08-20T22:05:34.8010839Z remote: Compressing objects: 14% (123/875) 2024-08-20T22:05:34.8142955Z remote: Compressing objects: 15% (132/875) 2024-08-20T22:05:34.8232746Z remote: Compressing objects: 16% (140/875) 2024-08-20T22:05:34.8335859Z remote: Compressing objects: 17% (149/875) 2024-08-20T22:05:34.8405464Z remote: Compressing objects: 18% (158/875) 2024-08-20T22:05:34.8463333Z remote: Compressing objects: 19% (167/875) 2024-08-20T22:05:34.8510700Z remote: Compressing objects: 20% (175/875) 2024-08-20T22:05:34.8542464Z remote: Compressing objects: 21% (184/875) 2024-08-20T22:05:34.8561020Z remote: Compressing objects: 22% (193/875) 2024-08-20T22:05:34.8564446Z remote: Compressing objects: 23% (202/875) 2024-08-20T22:05:34.8573976Z remote: Compressing objects: 24% (210/875) 2024-08-20T22:05:34.8583721Z remote: Compressing objects: 25% (219/875) 2024-08-20T22:05:34.8591203Z remote: Compressing objects: 26% (228/875) 2024-08-20T22:05:34.8600725Z remote: Compressing objects: 27% (237/875) 2024-08-20T22:05:34.8626365Z remote: Compressing objects: 28% (245/875) 2024-08-20T22:05:34.8644591Z remote: Compressing objects: 29% (254/875) 2024-08-20T22:05:34.8659634Z remote: Compressing objects: 30% (263/875) 2024-08-20T22:05:34.8664468Z remote: Compressing objects: 31% (272/875) 2024-08-20T22:05:34.8677717Z remote: Compressing objects: 32% (280/875) 2024-08-20T22:05:34.8683865Z remote: Compressing objects: 33% (289/875) 2024-08-20T22:05:34.8691027Z remote: Compressing objects: 34% (298/875) 2024-08-20T22:05:34.8697051Z remote: Compressing objects: 35% (307/875) 2024-08-20T22:05:34.8707097Z remote: Compressing objects: 36% (315/875) 2024-08-20T22:05:34.8715706Z remote: Compressing objects: 37% (324/875) 2024-08-20T22:05:34.8721733Z remote: Compressing objects: 38% (333/875) 2024-08-20T22:05:34.8726298Z remote: Compressing objects: 39% (342/875) 2024-08-20T22:05:34.8732726Z remote: Compressing objects: 40% (350/875) 2024-08-20T22:05:34.8741772Z remote: Compressing objects: 41% (359/875) 2024-08-20T22:05:34.8747258Z remote: Compressing objects: 42% (368/875) 2024-08-20T22:05:34.8752937Z remote: Compressing objects: 43% (377/875) 2024-08-20T22:05:34.8761941Z remote: Compressing objects: 44% (385/875) 2024-08-20T22:05:34.8767695Z remote: Compressing objects: 45% (394/875) 2024-08-20T22:05:34.8771963Z remote: Compressing objects: 46% (403/875) 2024-08-20T22:05:34.8774980Z remote: Compressing objects: 47% (412/875) 2024-08-20T22:05:34.8779354Z remote: Compressing objects: 48% (420/875) 2024-08-20T22:05:34.8782562Z remote: Compressing objects: 49% (429/875) 2024-08-20T22:05:34.8785174Z remote: Compressing objects: 50% (438/875) 2024-08-20T22:05:34.8789193Z remote: Compressing objects: 51% (447/875) 2024-08-20T22:05:34.8791781Z remote: Compressing objects: 52% (455/875) 2024-08-20T22:05:34.8795511Z remote: Compressing objects: 53% (464/875) 2024-08-20T22:05:34.8798216Z remote: Compressing objects: 54% (473/875) 2024-08-20T22:05:34.8800210Z remote: Compressing objects: 55% (482/875) 2024-08-20T22:05:34.8801897Z remote: Compressing objects: 56% (490/875) 2024-08-20T22:05:34.8802901Z remote: Compressing objects: 57% (499/875) 2024-08-20T22:05:34.8803750Z remote: Compressing objects: 58% (508/875) 2024-08-20T22:05:34.8804721Z remote: Compressing objects: 59% (517/875) 2024-08-20T22:05:34.8805793Z remote: Compressing objects: 60% (525/875) 2024-08-20T22:05:34.8806442Z remote: Compressing objects: 61% (534/875) 2024-08-20T22:05:34.8807215Z remote: Compressing objects: 62% (543/875) 2024-08-20T22:05:34.8807751Z remote: Compressing objects: 63% (552/875) 2024-08-20T22:05:34.8812656Z remote: Compressing objects: 64% (560/875) 2024-08-20T22:05:34.8819611Z remote: Compressing objects: 65% (569/875) 2024-08-20T22:05:34.8826346Z remote: Compressing objects: 66% (578/875) 2024-08-20T22:05:34.8830283Z remote: Compressing objects: 67% (587/875) 2024-08-20T22:05:34.8834665Z remote: Compressing objects: 68% (595/875) 2024-08-20T22:05:34.8839735Z remote: Compressing objects: 69% (604/875) 2024-08-20T22:05:34.8844217Z remote: Compressing objects: 70% (613/875) 2024-08-20T22:05:34.8847503Z remote: Compressing objects: 71% (622/875) 2024-08-20T22:05:34.8851803Z remote: Compressing objects: 72% (630/875) 2024-08-20T22:05:34.8856580Z remote: Compressing objects: 73% (639/875) 2024-08-20T22:05:34.8860569Z remote: Compressing objects: 74% (648/875) 2024-08-20T22:05:34.8864084Z remote: Compressing objects: 75% (657/875) 2024-08-20T22:05:34.8867951Z remote: Compressing objects: 76% (665/875) 2024-08-20T22:05:34.8871797Z remote: Compressing objects: 77% (674/875) 2024-08-20T22:05:34.8874211Z remote: Compressing objects: 78% (683/875) 2024-08-20T22:05:34.8877074Z remote: Compressing objects: 79% (692/875) 2024-08-20T22:05:34.8879410Z remote: Compressing objects: 80% (700/875) 2024-08-20T22:05:34.8882528Z remote: Compressing objects: 81% (709/875) 2024-08-20T22:05:34.8885684Z remote: Compressing objects: 82% (718/875) 2024-08-20T22:05:34.8887391Z remote: Compressing objects: 83% (727/875) 2024-08-20T22:05:34.8890476Z remote: Compressing objects: 84% (735/875) 2024-08-20T22:05:34.8892928Z remote: Compressing objects: 85% (744/875) 2024-08-20T22:05:34.8895790Z remote: Compressing objects: 86% (753/875) 2024-08-20T22:05:34.8898044Z remote: Compressing objects: 87% (762/875) 2024-08-20T22:05:34.8901596Z remote: Compressing objects: 88% (770/875) 2024-08-20T22:05:34.8904593Z remote: Compressing objects: 89% (779/875) 2024-08-20T22:05:34.8906680Z remote: Compressing objects: 90% (788/875) 2024-08-20T22:05:34.8908122Z remote: Compressing objects: 91% (797/875) 2024-08-20T22:05:34.8911083Z remote: Compressing objects: 92% (805/875) 2024-08-20T22:05:34.8911759Z remote: Compressing objects: 93% (814/875) 2024-08-20T22:05:34.8912783Z remote: Compressing objects: 94% (823/875) 2024-08-20T22:05:34.8914434Z remote: Compressing objects: 95% (832/875) 2024-08-20T22:05:34.8915803Z remote: Compressing objects: 96% (840/875) 2024-08-20T22:05:34.8916949Z remote: Compressing objects: 97% (849/875) 2024-08-20T22:05:34.8918481Z remote: Compressing objects: 98% (858/875) 2024-08-20T22:05:34.8920047Z remote: Compressing objects: 99% (867/875) 2024-08-20T22:05:34.8920738Z remote: Compressing objects: 100% (875/875) 2024-08-20T22:05:34.8921293Z remote: Compressing objects: 100% (875/875), done. 2024-08-20T22:05:56.6535221Z remote: Total 1010208 (delta 1086), reused 1298 (delta 812), pack-reused 1008518 (from 1) 2024-08-20T22:06:18.9897847Z [command]/usr/bin/git rev-parse --verify --quiet 40ec5f6ddd9787aca0449b24128343ff4c4a88b3^{object} 2024-08-20T22:06:18.9934147Z 40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:06:18.9941092Z ##[endgroup] 2024-08-20T22:06:18.9943066Z ##[group]Determining the checkout info 2024-08-20T22:06:18.9943713Z ##[endgroup] 2024-08-20T22:06:18.9944228Z ##[group]Checking out the ref 2024-08-20T22:06:18.9945658Z [command]/usr/bin/git checkout --quiet --force 40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:06:20.7168341Z ##[endgroup] 2024-08-20T22:06:20.7168958Z ##[group]Setting up auth for fetching submodules 2024-08-20T22:06:20.7173627Z [command]/usr/bin/git config --global http.https://github.com/.extraheader AUTHORIZATION: basic *** 2024-08-20T22:06:20.7237111Z [command]/usr/bin/git config --global --unset-all url.https://github.com/.insteadOf 2024-08-20T22:06:20.7278630Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf git@github.com: 2024-08-20T22:06:20.7319419Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf org-21003710@github.com: 2024-08-20T22:06:20.7361285Z ##[endgroup] 2024-08-20T22:06:20.7361858Z ##[group]Fetching submodules 2024-08-20T22:06:20.7364912Z [command]/usr/bin/git submodule sync --recursive 2024-08-20T22:06:20.7749440Z [command]/usr/bin/git -c protocol.version=2 submodule update --init --force --recursive 2024-08-20T22:06:20.8117896Z Submodule 'android/libs/fbjni' (https://github.com/facebookincubator/fbjni.git) registered for path 'android/libs/fbjni' 2024-08-20T22:06:20.8120744Z Submodule 'third_party/NNPACK_deps/FP16' (https://github.com/Maratyszcza/FP16.git) registered for path 'third_party/FP16' 2024-08-20T22:06:20.8122849Z Submodule 'third_party/NNPACK_deps/FXdiv' (https://github.com/Maratyszcza/FXdiv.git) registered for path 'third_party/FXdiv' 2024-08-20T22:06:20.8124934Z Submodule 'third_party/NNPACK' (https://github.com/Maratyszcza/NNPACK.git) registered for path 'third_party/NNPACK' 2024-08-20T22:06:20.8128734Z Submodule 'third_party/VulkanMemoryAllocator' (https://github.com/GPUOpen-LibrariesAndSDKs/VulkanMemoryAllocator.git) registered for path 'third_party/VulkanMemoryAllocator' 2024-08-20T22:06:20.8131783Z Submodule 'third_party/XNNPACK' (https://github.com/google/XNNPACK.git) registered for path 'third_party/XNNPACK' 2024-08-20T22:06:20.8135407Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/benchmark' 2024-08-20T22:06:20.8139250Z Submodule 'third_party/cpp-httplib' (https://github.com/yhirose/cpp-httplib.git) registered for path 'third_party/cpp-httplib' 2024-08-20T22:06:20.8144126Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo.git) registered for path 'third_party/cpuinfo' 2024-08-20T22:06:20.8147983Z Submodule 'third_party/cudnn_frontend' (https://github.com/NVIDIA/cudnn-frontend.git) registered for path 'third_party/cudnn_frontend' 2024-08-20T22:06:20.8151865Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/cutlass' 2024-08-20T22:06:20.8156033Z Submodule 'third_party/eigen' (https://gitlab.com/libeigen/eigen.git) registered for path 'third_party/eigen' 2024-08-20T22:06:20.8159857Z Submodule 'third_party/fbgemm' (https://github.com/pytorch/fbgemm) registered for path 'third_party/fbgemm' 2024-08-20T22:06:20.8164203Z Submodule 'third_party/flatbuffers' (https://github.com/google/flatbuffers.git) registered for path 'third_party/flatbuffers' 2024-08-20T22:06:20.8168150Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/fmt' 2024-08-20T22:06:20.8172636Z Submodule 'third_party/gemmlowp/gemmlowp' (https://github.com/google/gemmlowp.git) registered for path 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:06:20.8180834Z Submodule 'third_party/gloo' (https://github.com/facebookincubator/gloo) registered for path 'third_party/gloo' 2024-08-20T22:06:20.8185243Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/googletest' 2024-08-20T22:06:20.8189440Z Submodule 'third_party/ideep' (https://github.com/intel/ideep) registered for path 'third_party/ideep' 2024-08-20T22:06:20.8194145Z Submodule 'third_party/ittapi' (https://github.com/intel/ittapi.git) registered for path 'third_party/ittapi' 2024-08-20T22:06:20.8198686Z Submodule 'third_party/kineto' (https://github.com/pytorch/kineto) registered for path 'third_party/kineto' 2024-08-20T22:06:20.8203396Z Submodule 'third_party/mimalloc' (https://github.com/microsoft/mimalloc.git) registered for path 'third_party/mimalloc' 2024-08-20T22:06:20.8208398Z Submodule 'third_party/nccl/nccl' (https://github.com/NVIDIA/nccl) registered for path 'third_party/nccl/nccl' 2024-08-20T22:06:20.8212918Z Submodule 'third_party/nlohmann' (https://github.com/nlohmann/json.git) registered for path 'third_party/nlohmann' 2024-08-20T22:06:20.8217603Z Submodule 'third_party/onnx' (https://github.com/onnx/onnx.git) registered for path 'third_party/onnx' 2024-08-20T22:06:20.8222797Z Submodule 'third_party/opentelemetry-cpp' (https://github.com/open-telemetry/opentelemetry-cpp.git) registered for path 'third_party/opentelemetry-cpp' 2024-08-20T22:06:20.8227507Z Submodule 'third_party/pocketfft' (https://github.com/mreineck/pocketfft) registered for path 'third_party/pocketfft' 2024-08-20T22:06:20.8232670Z Submodule 'third_party/protobuf' (https://github.com/protocolbuffers/protobuf.git) registered for path 'third_party/protobuf' 2024-08-20T22:06:20.8237859Z Submodule 'third_party/NNPACK_deps/psimd' (https://github.com/Maratyszcza/psimd.git) registered for path 'third_party/psimd' 2024-08-20T22:06:20.8243759Z Submodule 'third_party/NNPACK_deps/pthreadpool' (https://github.com/Maratyszcza/pthreadpool.git) registered for path 'third_party/pthreadpool' 2024-08-20T22:06:20.8249050Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/pybind11' 2024-08-20T22:06:20.8254280Z Submodule 'third_party/python-peachpy' (https://github.com/malfet/PeachPy.git) registered for path 'third_party/python-peachpy' 2024-08-20T22:06:20.8259581Z Submodule 'third_party/sleef' (https://github.com/shibatch/sleef) registered for path 'third_party/sleef' 2024-08-20T22:06:20.8268819Z Submodule 'third_party/tensorpipe' (https://github.com/pytorch/tensorpipe.git) registered for path 'third_party/tensorpipe' 2024-08-20T22:06:20.8302832Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/android/libs/fbjni'... 2024-08-20T22:06:21.1223249Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FP16'... 2024-08-20T22:06:21.3068121Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FXdiv'... 2024-08-20T22:06:21.5017638Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/NNPACK'... 2024-08-20T22:06:21.7632808Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/VulkanMemoryAllocator'... 2024-08-20T22:06:23.6643345Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/XNNPACK'... 2024-08-20T22:06:35.1765906Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/benchmark'... 2024-08-20T22:06:35.5998170Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpp-httplib'... 2024-08-20T22:06:36.0084247Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpuinfo'... 2024-08-20T22:06:36.6456633Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cudnn_frontend'... 2024-08-20T22:06:37.8899542Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cutlass'... 2024-08-20T22:06:39.9367415Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/eigen'... 2024-08-20T22:06:45.8887605Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm'... 2024-08-20T22:06:47.3027223Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/flatbuffers'... 2024-08-20T22:06:49.0787369Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fmt'... 2024-08-20T22:06:50.3907428Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gemmlowp/gemmlowp'... 2024-08-20T22:06:50.8030455Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gloo'... 2024-08-20T22:06:51.1262365Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/googletest'... 2024-08-20T22:06:52.3050525Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep'... 2024-08-20T22:06:52.6906194Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ittapi'... 2024-08-20T22:06:52.9429975Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto'... 2024-08-20T22:06:54.5248884Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/mimalloc'... 2024-08-20T22:06:55.2068818Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nccl/nccl'... 2024-08-20T22:06:55.8494233Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nlohmann'... 2024-08-20T22:07:01.7844078Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx'... 2024-08-20T22:07:03.6959679Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp'... 2024-08-20T22:07:07.9631588Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pocketfft'... 2024-08-20T22:07:08.1901182Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf'... 2024-08-20T22:07:17.5253720Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/psimd'... 2024-08-20T22:07:17.6926891Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pthreadpool'... 2024-08-20T22:07:17.8832411Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pybind11'... 2024-08-20T22:07:18.8027946Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/python-peachpy'... 2024-08-20T22:07:19.1167843Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/sleef'... 2024-08-20T22:07:19.7687474Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe'... 2024-08-20T22:07:20.2144774Z Submodule path 'android/libs/fbjni': checked out '7e1e1fe3858c63c251c637ae41a20de425dde96f' 2024-08-20T22:07:20.2294701Z Submodule path 'third_party/FP16': checked out '4dfe081cf6bcd15db339cf2680b9281b8451eeb3' 2024-08-20T22:07:20.2416088Z Submodule path 'third_party/FXdiv': checked out 'b408327ac2a15ec3e43352421954f5b1967701d1' 2024-08-20T22:07:20.2738997Z Submodule path 'third_party/NNPACK': checked out 'c07e3a0400713d546e0dea2d5466dd22ea389c73' 2024-08-20T22:07:20.3182877Z Submodule path 'third_party/VulkanMemoryAllocator': checked out 'a6bfc237255a6bac1513f7c1ebde6d8aed6b5191' 2024-08-20T22:07:21.5034201Z Submodule path 'third_party/XNNPACK': checked out 'fcbf55af6cf28a4627bcd1f703ab7ad843f0f3a2' 2024-08-20T22:07:21.5324396Z Submodule path 'third_party/benchmark': checked out '0d98dba29d66e93259db7daa53a9327df767a415' 2024-08-20T22:07:21.5860531Z Submodule path 'third_party/cpp-httplib': checked out '3b6597bba913d51161383657829b7e644e59c006' 2024-08-20T22:07:21.6998626Z Submodule path 'third_party/cpuinfo': checked out '3c8b1533ac03dd6531ab6e7b9245d488f13a82a5' 2024-08-20T22:07:21.7405780Z Submodule path 'third_party/cudnn_frontend': checked out '23511ba176243f27b3b275da1fb3814ea805a171' 2024-08-20T22:07:22.3690209Z Submodule path 'third_party/cutlass': checked out 'bbe579a9e3beb6ea6626d9227ec32d0dae119a49' 2024-08-20T22:07:22.6589513Z Submodule path 'third_party/eigen': checked out '3147391d946bb4b6c68edd901f2add6ac1f31f8c' 2024-08-20T22:07:22.7541701Z Submodule path 'third_party/fbgemm': checked out 'dbc3157bf256f1339b3fa1fef2be89ac4078be0e' 2024-08-20T22:07:22.7560928Z Submodule 'third_party/asmjit' (https://github.com/asmjit/asmjit.git) registered for path 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:07:22.7564288Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo) registered for path 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:07:22.7567699Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:07:22.7571414Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:07:22.7574928Z Submodule 'third_party/hipify_torch' (https://github.com/ROCmSoftwarePlatform/hipify_torch.git) registered for path 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:07:22.7607336Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/asmjit'... 2024-08-20T22:07:23.8607692Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cpuinfo'... 2024-08-20T22:07:24.4481062Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cutlass'... 2024-08-20T22:07:26.6233135Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/googletest'... 2024-08-20T22:07:27.6360096Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/hipify_torch'... 2024-08-20T22:07:27.9816363Z Submodule path 'third_party/fbgemm/third_party/asmjit': checked out 'd3fbf7c9bc7c1d1365a94a45614b91c5a3706b81' 2024-08-20T22:07:28.0934779Z Submodule path 'third_party/fbgemm/third_party/cpuinfo': checked out 'ed8b86a253800bafdb7b25c5c399f91bff9cb1f3' 2024-08-20T22:07:28.6059896Z Submodule path 'third_party/fbgemm/third_party/cutlass': checked out 'fc9ebc645b63f3a6bc80aaefde5c063fb72110d6' 2024-08-20T22:07:28.6772997Z Submodule path 'third_party/fbgemm/third_party/googletest': checked out 'cbf019de22c8dd37b2108da35b2748fd702d1796' 2024-08-20T22:07:28.6923227Z Submodule path 'third_party/fbgemm/third_party/hipify_torch': checked out '23f53b025b466d8ec3c45d52290d3442f7fbe6b1' 2024-08-20T22:07:28.8413348Z Submodule path 'third_party/flatbuffers': checked out '01834de25e4bf3975a9a00e816292b1ad0fe184b' 2024-08-20T22:07:28.8878984Z Submodule path 'third_party/fmt': checked out '0c9fce2ffefecfdce794e1859584e25877b7b592' 2024-08-20T22:07:28.9340960Z Submodule path 'third_party/gemmlowp/gemmlowp': checked out '3fb5c176c17c765a3492cd2f0321b0dab712f350' 2024-08-20T22:07:28.9670656Z Submodule path 'third_party/gloo': checked out '5354032ea08eadd7fc4456477f7f7c6308818509' 2024-08-20T22:07:29.0212212Z Submodule path 'third_party/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2024-08-20T22:07:29.0377898Z Submodule path 'third_party/ideep': checked out '55ca0191687aaf19aca5cdb7881c791e3bea442b' 2024-08-20T22:07:29.0397849Z Submodule 'mkl-dnn' (https://github.com/intel/mkl-dnn.git) registered for path 'third_party/ideep/mkl-dnn' 2024-08-20T22:07:29.0427446Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep/mkl-dnn'... 2024-08-20T22:07:42.4364855Z Submodule path 'third_party/ideep/mkl-dnn': checked out '1137e04ec0b5251ca2b4400a4fd3c667ce843d67' 2024-08-20T22:07:42.4590890Z Submodule path 'third_party/ittapi': checked out '5b8a7d7422611c3a0d799fb5fc5dd4abfae35b42' 2024-08-20T22:07:42.5604340Z Submodule path 'third_party/kineto': checked out 'd9753139d181b9ff42872465aac0e5d3018be415' 2024-08-20T22:07:42.5623655Z Submodule 'libkineto/third_party/dynolog' (https://github.com/facebookincubator/dynolog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:07:42.5626859Z Submodule 'libkineto/third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:07:42.5630487Z Submodule 'libkineto/third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:07:42.5664094Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog'... 2024-08-20T22:07:43.1236705Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/fmt'... 2024-08-20T22:07:44.3733748Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/googletest'... 2024-08-20T22:07:45.5264673Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog': checked out '7d04a0053a845370ae06ce317a22a48e9edcc74e' 2024-08-20T22:07:45.5286869Z Submodule 'third_party/DCGM' (https://github.com/NVIDIA/DCGM.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:07:45.5290374Z Submodule 'third_party/cpr' (https://github.com/libcpr/cpr.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:07:45.5293985Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:07:45.5297870Z Submodule 'third_party/gflags' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:07:45.5301658Z Submodule 'third_party/glog' (https://github.com/google/glog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:07:45.5305588Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:07:45.5309440Z Submodule 'third_party/json' (https://github.com/nlohmann/json.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:07:45.5313713Z Submodule 'third_party/pfs' (https://github.com/dtrugman/pfs.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:07:45.5345984Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'... 2024-08-20T22:07:46.4339684Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'... 2024-08-20T22:07:46.7988782Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'... 2024-08-20T22:07:48.0576842Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'... 2024-08-20T22:07:48.3490381Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/glog'... 2024-08-20T22:07:48.8872983Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'... 2024-08-20T22:07:49.9405620Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/json'... 2024-08-20T22:07:57.1195338Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'... 2024-08-20T22:07:57.5597327Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM': checked out 'ffde4e54bc7249a6039a5e6b45b395141e1217f9' 2024-08-20T22:07:57.5835029Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr': checked out '871ed52d350214a034f6ef8a3b8f51c5ce1bd400' 2024-08-20T22:07:57.6266512Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt': checked out 'cd4af11efc9c622896a3e4cb599fa28668ca3d05' 2024-08-20T22:07:57.6434527Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags': checked out 'e171aa2d15ed9eb17054558e0b3a6a413bb01067' 2024-08-20T22:07:57.6456472Z Submodule 'doc' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:07:57.6489381Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'... 2024-08-20T22:07:57.9508061Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc': checked out '8411df715cf522606e3b1aca386ddfc0b63d34b4' 2024-08-20T22:07:57.9738905Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog': checked out 'b33e3bad4c46c8a6345525fd822af355e5ef9446' 2024-08-20T22:07:58.0218906Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest': checked out '58d77fa8070e8cec2dc1ed015d66b454c8d78850' 2024-08-20T22:07:58.1466961Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json': checked out '4f8fba14066156b73f1189a2b8bd568bde5284c5' 2024-08-20T22:07:58.1667148Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs': checked out 'f68a2fa8ea36c783bdd760371411fcb495aa3150' 2024-08-20T22:07:58.2122071Z Submodule path 'third_party/kineto/libkineto/third_party/fmt': checked out '0041a40c1350ba702d475b9c4ad62da77caea164' 2024-08-20T22:07:58.2792316Z Submodule path 'third_party/kineto/libkineto/third_party/googletest': checked out '7aca84427f224eeed3144123d5230d5871e93347' 2024-08-20T22:07:58.3263136Z Submodule path 'third_party/mimalloc': checked out 'b66e3214d8a104669c2ec05ae91ebc26a8f5ab78' 2024-08-20T22:07:58.3566098Z Submodule path 'third_party/nccl/nccl': checked out 'ab2b89c4c339bd7f816fbc114a4b05d386b66290' 2024-08-20T22:07:58.4812238Z Submodule path 'third_party/nlohmann': checked out '87cda1d6646592ac5866dc703c8e1839046a6806' 2024-08-20T22:07:58.9840929Z Submodule path 'third_party/onnx': checked out '3bf92c03a9f27eba3bda1e5b9e63ea20ec213557' 2024-08-20T22:07:58.9876329Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/onnx/third_party/benchmark' 2024-08-20T22:07:58.9879556Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/onnx/third_party/pybind11' 2024-08-20T22:07:58.9912167Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx/third_party/benchmark'... 2024-08-20T22:07:59.4484566Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx/third_party/pybind11'... 2024-08-20T22:08:00.3556645Z Submodule path 'third_party/onnx/third_party/benchmark': checked out '2dd015dfef425c866d9a43f2c67d8b52d709acb6' 2024-08-20T22:08:00.3975380Z Submodule path 'third_party/onnx/third_party/pybind11': checked out '5b0a6fc2017fcc176545afe3e09c9f9885283242' 2024-08-20T22:08:00.4870765Z Submodule path 'third_party/opentelemetry-cpp': checked out 'a799f4aed9c94b765dcdaabaeab7d5e7e2310878' 2024-08-20T22:08:00.4896640Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark) registered for path 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:08:00.4899939Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:08:00.4903480Z Submodule 'third_party/ms-gsl' (https://github.com/microsoft/GSL) registered for path 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:08:00.4907116Z Submodule 'third_party/nlohmann-json' (https://github.com/nlohmann/json) registered for path 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:08:00.4910889Z Submodule 'third_party/opentelemetry-proto' (https://github.com/open-telemetry/opentelemetry-proto) registered for path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:08:00.4914867Z Submodule 'third_party/opentracing-cpp' (https://github.com/opentracing/opentracing-cpp.git) registered for path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:08:00.4918587Z Submodule 'third_party/prometheus-cpp' (https://github.com/jupp0r/prometheus-cpp) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:08:00.4922276Z Submodule 'tools/vcpkg' (https://github.com/Microsoft/vcpkg) registered for path 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:08:00.4955132Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/benchmark'... 2024-08-20T22:08:00.9197258Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/googletest'... 2024-08-20T22:08:01.9545099Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/ms-gsl'... 2024-08-20T22:08:02.2659859Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/nlohmann-json'... 2024-08-20T22:08:08.1708639Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentelemetry-proto'... 2024-08-20T22:08:08.4465900Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentracing-cpp'... 2024-08-20T22:08:08.6495793Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp'... 2024-08-20T22:08:08.9426892Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/tools/vcpkg'... 2024-08-20T22:08:15.6193935Z Submodule path 'third_party/opentelemetry-cpp/third_party/benchmark': checked out 'd572f4777349d43653b21d6c2fc63020ab326db2' 2024-08-20T22:08:15.6658785Z Submodule path 'third_party/opentelemetry-cpp/third_party/googletest': checked out 'b796f7d44681514f58a683a3a71ff17c94edb0c1' 2024-08-20T22:08:15.6848223Z Submodule path 'third_party/opentelemetry-cpp/third_party/ms-gsl': checked out '6f4529395c5b7c2d661812257cd6780c67e54afa' 2024-08-20T22:08:15.8063544Z Submodule path 'third_party/opentelemetry-cpp/third_party/nlohmann-json': checked out 'bc889afb4c5bf1c0d8ee29ef35eaaf4c8bef8a5d' 2024-08-20T22:08:15.8227563Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto': checked out '4ca4f0335c63cda7ab31ea7ed70d6553aee14dce' 2024-08-20T22:08:15.8409460Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp': checked out '06b57f48ded1fa3bdd3d4346f6ef29e40e08eaf5' 2024-08-20T22:08:15.8608523Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp': checked out 'c9ffcdda9086ffd9e1283ea7a0276d831f3c8a8d' 2024-08-20T22:08:15.8628179Z Submodule 'civetweb' (https://github.com/civetweb/civetweb.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:08:15.8632322Z Submodule 'googletest' (https://github.com/google/googletest.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:08:15.8665083Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'... 2024-08-20T22:08:17.7065286Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'... 2024-08-20T22:08:19.0605272Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb': checked out 'eefb26f82b233268fc98577d265352720d477ba4' 2024-08-20T22:08:19.1135337Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2024-08-20T22:08:19.7650979Z Submodule path 'third_party/opentelemetry-cpp/tools/vcpkg': checked out '8eb57355a4ffb410a2e94c07b4dca2dffbee8e50' 2024-08-20T22:08:19.7798884Z Submodule path 'third_party/pocketfft': checked out '9d3ab05a7fffbc71a492bc6a17be034e83e8f0fe' 2024-08-20T22:08:20.1013296Z Submodule path 'third_party/protobuf': checked out 'd1eca4e4b421cd2997495c4b4e65cea6be4e9b8a' 2024-08-20T22:08:20.1041119Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:08:20.1046339Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/protobuf/third_party/googletest' 2024-08-20T22:08:20.1076494Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/benchmark'... 2024-08-20T22:08:20.5608959Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/googletest'... 2024-08-20T22:08:21.6324310Z Submodule path 'third_party/protobuf/third_party/benchmark': checked out '5b7683f49e1e9223cf9927b24f6fd3d6bd82e3f8' 2024-08-20T22:08:21.7145583Z Submodule path 'third_party/protobuf/third_party/googletest': checked out '5ec7f0c4a113e2f18ac2c6cc7df51ad6afc24081' 2024-08-20T22:08:21.7263185Z Submodule path 'third_party/psimd': checked out '072586a71b55b7f8c584153d223e95687148a900' 2024-08-20T22:08:21.7422026Z Submodule path 'third_party/pthreadpool': checked out '4fe0e1e183925bf8cfa6aae24237e724a96479b8' 2024-08-20T22:08:21.7870836Z Submodule path 'third_party/pybind11': checked out '941f45bcb51457884fa1afd6e24a67377d70f75c' 2024-08-20T22:08:21.8219299Z Submodule path 'third_party/python-peachpy': checked out 'f45429b087dd7d5bc78bb40dc7cf06425c252d67' 2024-08-20T22:08:21.8716567Z Submodule path 'third_party/sleef': checked out '60e76d2bce17d278b439d9da17177c8f957a9e9b' 2024-08-20T22:08:21.9051673Z Submodule path 'third_party/tensorpipe': checked out '52791a2fd214b2a9dc5759d36725909c1daa7f2e' 2024-08-20T22:08:21.9071237Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:08:21.9074897Z Submodule 'third_party/libnop' (https://github.com/google/libnop.git) registered for path 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:08:21.9078080Z Submodule 'third_party/libuv' (https://github.com/libuv/libuv.git) registered for path 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:08:21.9081794Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:08:21.9113231Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/googletest'... 2024-08-20T22:08:22.9426912Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libnop'... 2024-08-20T22:08:23.1714992Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libuv'... 2024-08-20T22:08:24.3636535Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11'... 2024-08-20T22:08:25.3398169Z Submodule path 'third_party/tensorpipe/third_party/googletest': checked out 'aee0f9d9b5b87796ee8a0ab26b7587ec30e8858e' 2024-08-20T22:08:25.3596279Z Submodule path 'third_party/tensorpipe/third_party/libnop': checked out '910b55815be16109f04f4180e9adee14fb4ce281' 2024-08-20T22:08:25.4395918Z Submodule path 'third_party/tensorpipe/third_party/libuv': checked out '1dff88e5161cba5c59276d2070d2e304e4dcb242' 2024-08-20T22:08:25.4742199Z Submodule path 'third_party/tensorpipe/third_party/pybind11': checked out 'a23996fce38ff6ccfbcdc09f1e63f2c4be5ea2ef' 2024-08-20T22:08:25.4763610Z Submodule 'tools/clang' (https://github.com/wjakob/clang-cindex-python3) registered for path 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:08:25.4794551Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11/tools/clang'... 2024-08-20T22:08:25.6737575Z Submodule path 'third_party/tensorpipe/third_party/pybind11/tools/clang': checked out '6a00cbc4a9b8e68b71caf7f774b3f9c753ae84d5' 2024-08-20T22:08:25.6784798Z [command]/usr/bin/git submodule foreach --recursive git config --local gc.auto 0 2024-08-20T22:08:25.7156869Z Entering 'android/libs/fbjni' 2024-08-20T22:08:25.7210132Z Entering 'third_party/FP16' 2024-08-20T22:08:25.7263353Z Entering 'third_party/FXdiv' 2024-08-20T22:08:25.7315949Z Entering 'third_party/NNPACK' 2024-08-20T22:08:25.7369318Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T22:08:25.7421540Z Entering 'third_party/XNNPACK' 2024-08-20T22:08:25.7492189Z Entering 'third_party/benchmark' 2024-08-20T22:08:25.7545094Z Entering 'third_party/cpp-httplib' 2024-08-20T22:08:25.7598809Z Entering 'third_party/cpuinfo' 2024-08-20T22:08:25.7654447Z Entering 'third_party/cudnn_frontend' 2024-08-20T22:08:25.7707617Z Entering 'third_party/cutlass' 2024-08-20T22:08:25.7770729Z Entering 'third_party/eigen' 2024-08-20T22:08:25.7826211Z Entering 'third_party/fbgemm' 2024-08-20T22:08:25.7883037Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:08:25.7933780Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:08:25.7985853Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:08:25.8042770Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:08:25.8093273Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:08:25.8146605Z Entering 'third_party/flatbuffers' 2024-08-20T22:08:25.8201225Z Entering 'third_party/fmt' 2024-08-20T22:08:25.8259989Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:08:25.8312519Z Entering 'third_party/gloo' 2024-08-20T22:08:25.8363960Z Entering 'third_party/googletest' 2024-08-20T22:08:25.8415453Z Entering 'third_party/ideep' 2024-08-20T22:08:25.8465700Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T22:08:25.8524566Z Entering 'third_party/ittapi' 2024-08-20T22:08:25.8576638Z Entering 'third_party/kineto' 2024-08-20T22:08:25.8629329Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:08:25.8680557Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:08:25.8733189Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:08:25.8783623Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:08:25.8833713Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:08:25.8882310Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:08:25.8938687Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:08:25.8988986Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:08:25.9038999Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:08:25.9090151Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:08:25.9145721Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:08:25.9195412Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:08:25.9249722Z Entering 'third_party/mimalloc' 2024-08-20T22:08:25.9301572Z Entering 'third_party/nccl/nccl' 2024-08-20T22:08:25.9356928Z Entering 'third_party/nlohmann' 2024-08-20T22:08:25.9409661Z Entering 'third_party/onnx' 2024-08-20T22:08:25.9476411Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T22:08:25.9528588Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T22:08:25.9585421Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T22:08:25.9639520Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:08:25.9691338Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:08:25.9747508Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:08:25.9801479Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:08:25.9853838Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:08:25.9904280Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:08:25.9956202Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:08:26.0005717Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:08:26.0059600Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:08:26.0113985Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:08:26.0187881Z Entering 'third_party/pocketfft' 2024-08-20T22:08:26.0239705Z Entering 'third_party/protobuf' 2024-08-20T22:08:26.0293689Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:08:26.0344944Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T22:08:26.0399764Z Entering 'third_party/psimd' 2024-08-20T22:08:26.0451810Z Entering 'third_party/pthreadpool' 2024-08-20T22:08:26.0503532Z Entering 'third_party/pybind11' 2024-08-20T22:08:26.0555178Z Entering 'third_party/python-peachpy' 2024-08-20T22:08:26.0606215Z Entering 'third_party/sleef' 2024-08-20T22:08:26.0657837Z Entering 'third_party/tensorpipe' 2024-08-20T22:08:26.0708035Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:08:26.0763300Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:08:26.0813714Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:08:26.0865266Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:08:26.0913527Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:08:26.0993305Z ##[endgroup] 2024-08-20T22:08:26.0996991Z ##[group]Persisting credentials for submodules 2024-08-20T22:08:26.0998811Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'url\.https\:\/\/github\.com\/\.insteadOf' && git config --local --unset-all 'url.https://github.com/.insteadOf' || :" 2024-08-20T22:08:26.1369767Z Entering 'android/libs/fbjni' 2024-08-20T22:08:26.1436937Z Entering 'third_party/FP16' 2024-08-20T22:08:26.1505767Z Entering 'third_party/FXdiv' 2024-08-20T22:08:26.1572841Z Entering 'third_party/NNPACK' 2024-08-20T22:08:26.1641213Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T22:08:26.1711262Z Entering 'third_party/XNNPACK' 2024-08-20T22:08:26.1795068Z Entering 'third_party/benchmark' 2024-08-20T22:08:26.1864522Z Entering 'third_party/cpp-httplib' 2024-08-20T22:08:26.1933046Z Entering 'third_party/cpuinfo' 2024-08-20T22:08:26.2003202Z Entering 'third_party/cudnn_frontend' 2024-08-20T22:08:26.2070534Z Entering 'third_party/cutlass' 2024-08-20T22:08:26.2145392Z Entering 'third_party/eigen' 2024-08-20T22:08:26.2214614Z Entering 'third_party/fbgemm' 2024-08-20T22:08:26.2282380Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:08:26.2350967Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:08:26.2418577Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:08:26.2491867Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:08:26.2558579Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:08:26.2628051Z Entering 'third_party/flatbuffers' 2024-08-20T22:08:26.2698523Z Entering 'third_party/fmt' 2024-08-20T22:08:26.2770359Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:08:26.2837634Z Entering 'third_party/gloo' 2024-08-20T22:08:26.2905201Z Entering 'third_party/googletest' 2024-08-20T22:08:26.2978598Z Entering 'third_party/ideep' 2024-08-20T22:08:26.3045025Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T22:08:26.3120473Z Entering 'third_party/ittapi' 2024-08-20T22:08:26.3187892Z Entering 'third_party/kineto' 2024-08-20T22:08:26.3253516Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:08:26.3318089Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:08:26.3388693Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:08:26.3456636Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:08:26.3523351Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:08:26.3589954Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:08:26.3660064Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:08:26.3727224Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:08:26.3795503Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:08:26.3864184Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:08:26.3933647Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:08:26.4001225Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:08:26.4070384Z Entering 'third_party/mimalloc' 2024-08-20T22:08:26.4140878Z Entering 'third_party/nccl/nccl' 2024-08-20T22:08:26.4208864Z Entering 'third_party/nlohmann' 2024-08-20T22:08:26.4277926Z Entering 'third_party/onnx' 2024-08-20T22:08:26.4357873Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T22:08:26.4424970Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T22:08:26.4497931Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T22:08:26.4568214Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:08:26.4634906Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:08:26.4700575Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:08:26.4766582Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:08:26.4833554Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:08:26.4900225Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:08:26.4969771Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:08:26.5034986Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:08:26.5102991Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:08:26.5173796Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:08:26.5262727Z Entering 'third_party/pocketfft' 2024-08-20T22:08:26.5329007Z Entering 'third_party/protobuf' 2024-08-20T22:08:26.5398105Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:08:26.5466785Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T22:08:26.5537696Z Entering 'third_party/psimd' 2024-08-20T22:08:26.5610641Z Entering 'third_party/pthreadpool' 2024-08-20T22:08:26.5680822Z Entering 'third_party/pybind11' 2024-08-20T22:08:26.5752533Z Entering 'third_party/python-peachpy' 2024-08-20T22:08:26.5820135Z Entering 'third_party/sleef' 2024-08-20T22:08:26.5889428Z Entering 'third_party/tensorpipe' 2024-08-20T22:08:26.5956014Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:08:26.6022293Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:08:26.6087344Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:08:26.6152794Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:08:26.6216411Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:08:26.6308663Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local 'http.https://github.com/.extraheader' 'AUTHORIZATION: basic ***' && git config --local --show-origin --name-only --get-regexp remote.origin.url" 2024-08-20T22:08:26.6677864Z Entering 'android/libs/fbjni' 2024-08-20T22:08:26.6741845Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/android/libs/fbjni/config remote.origin.url 2024-08-20T22:08:26.6763913Z Entering 'third_party/FP16' 2024-08-20T22:08:26.6827090Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FP16/config remote.origin.url 2024-08-20T22:08:26.6849186Z Entering 'third_party/FXdiv' 2024-08-20T22:08:26.6914359Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FXdiv/config remote.origin.url 2024-08-20T22:08:26.6935081Z Entering 'third_party/NNPACK' 2024-08-20T22:08:26.6998227Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK/config remote.origin.url 2024-08-20T22:08:26.7020019Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T22:08:26.7082215Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/VulkanMemoryAllocator/config remote.origin.url 2024-08-20T22:08:26.7103502Z Entering 'third_party/XNNPACK' 2024-08-20T22:08:26.7165819Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/XNNPACK/config remote.origin.url 2024-08-20T22:08:26.7202588Z Entering 'third_party/benchmark' 2024-08-20T22:08:26.7264484Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/benchmark/config remote.origin.url 2024-08-20T22:08:26.7286081Z Entering 'third_party/cpp-httplib' 2024-08-20T22:08:26.7348987Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpp-httplib/config remote.origin.url 2024-08-20T22:08:26.7370550Z Entering 'third_party/cpuinfo' 2024-08-20T22:08:26.7431959Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpuinfo/config remote.origin.url 2024-08-20T22:08:26.7454097Z Entering 'third_party/cudnn_frontend' 2024-08-20T22:08:26.7515339Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cudnn_frontend/config remote.origin.url 2024-08-20T22:08:26.7536862Z Entering 'third_party/cutlass' 2024-08-20T22:08:26.7599646Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cutlass/config remote.origin.url 2024-08-20T22:08:26.7627945Z Entering 'third_party/eigen' 2024-08-20T22:08:26.7691794Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/eigen/config remote.origin.url 2024-08-20T22:08:26.7715564Z Entering 'third_party/fbgemm' 2024-08-20T22:08:26.7778202Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/config remote.origin.url 2024-08-20T22:08:26.7798185Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:08:26.7858934Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/asmjit/config remote.origin.url 2024-08-20T22:08:26.7879136Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:08:26.7942180Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cpuinfo/config remote.origin.url 2024-08-20T22:08:26.7964180Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:08:26.8026942Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cutlass/config remote.origin.url 2024-08-20T22:08:26.8053328Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:08:26.8114445Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/googletest/config remote.origin.url 2024-08-20T22:08:26.8134589Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:08:26.8196087Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/hipify_torch/config remote.origin.url 2024-08-20T22:08:26.8219428Z Entering 'third_party/flatbuffers' 2024-08-20T22:08:26.8281424Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/flatbuffers/config remote.origin.url 2024-08-20T22:08:26.8305270Z Entering 'third_party/fmt' 2024-08-20T22:08:26.8369053Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fmt/config remote.origin.url 2024-08-20T22:08:26.8389663Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:08:26.8452886Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gemmlowp/gemmlowp/config remote.origin.url 2024-08-20T22:08:26.8475670Z Entering 'third_party/gloo' 2024-08-20T22:08:26.8536932Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gloo/config remote.origin.url 2024-08-20T22:08:26.8559405Z Entering 'third_party/googletest' 2024-08-20T22:08:26.8622531Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/googletest/config remote.origin.url 2024-08-20T22:08:26.8646370Z Entering 'third_party/ideep' 2024-08-20T22:08:26.8709519Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/config remote.origin.url 2024-08-20T22:08:26.8729168Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T22:08:26.8791348Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/modules/mkl-dnn/config remote.origin.url 2024-08-20T22:08:26.8820299Z Entering 'third_party/ittapi' 2024-08-20T22:08:26.8883747Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ittapi/config remote.origin.url 2024-08-20T22:08:26.8905256Z Entering 'third_party/kineto' 2024-08-20T22:08:26.8969143Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/config remote.origin.url 2024-08-20T22:08:26.8989591Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:08:26.9060285Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/config remote.origin.url 2024-08-20T22:08:26.9079381Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:08:26.9140889Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/DCGM/config remote.origin.url 2024-08-20T22:08:26.9162178Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:08:26.9223283Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/cpr/config remote.origin.url 2024-08-20T22:08:26.9243953Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:08:26.9306899Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/fmt/config remote.origin.url 2024-08-20T22:08:26.9327020Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:08:26.9390400Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/config remote.origin.url 2024-08-20T22:08:26.9408960Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:08:26.9474285Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/modules/doc/config remote.origin.url 2024-08-20T22:08:26.9497258Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:08:26.9559743Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/glog/config remote.origin.url 2024-08-20T22:08:26.9579723Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:08:26.9643024Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/googletest/config remote.origin.url 2024-08-20T22:08:26.9666852Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:08:26.9728641Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/json/config remote.origin.url 2024-08-20T22:08:26.9750085Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:08:26.9812228Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/pfs/config remote.origin.url 2024-08-20T22:08:26.9835001Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:08:26.9896713Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/fmt/config remote.origin.url 2024-08-20T22:08:26.9916755Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:08:26.9977393Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/googletest/config remote.origin.url 2024-08-20T22:08:27.0000487Z Entering 'third_party/mimalloc' 2024-08-20T22:08:27.0065219Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/mimalloc/config remote.origin.url 2024-08-20T22:08:27.0089185Z Entering 'third_party/nccl/nccl' 2024-08-20T22:08:27.0152667Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nccl/nccl/config remote.origin.url 2024-08-20T22:08:27.0175013Z Entering 'third_party/nlohmann' 2024-08-20T22:08:27.0237626Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nlohmann/config remote.origin.url 2024-08-20T22:08:27.0260965Z Entering 'third_party/onnx' 2024-08-20T22:08:27.0325228Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/config remote.origin.url 2024-08-20T22:08:27.0359944Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T22:08:27.0421672Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/benchmark/config remote.origin.url 2024-08-20T22:08:27.0442514Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T22:08:27.0505053Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/pybind11/config remote.origin.url 2024-08-20T22:08:27.0531964Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T22:08:27.0598929Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/config remote.origin.url 2024-08-20T22:08:27.0620949Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:08:27.0682817Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/benchmark/config remote.origin.url 2024-08-20T22:08:27.0703159Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:08:27.0764061Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/googletest/config remote.origin.url 2024-08-20T22:08:27.0784035Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:08:27.0845897Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/ms-gsl/config remote.origin.url 2024-08-20T22:08:27.0865736Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:08:27.0925653Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/nlohmann-json/config remote.origin.url 2024-08-20T22:08:27.0949399Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:08:27.1010297Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentelemetry-proto/config remote.origin.url 2024-08-20T22:08:27.1029255Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:08:27.1097904Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentracing-cpp/config remote.origin.url 2024-08-20T22:08:27.1121300Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:08:27.1182771Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/config remote.origin.url 2024-08-20T22:08:27.1201008Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:08:27.1263957Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/civetweb/config remote.origin.url 2024-08-20T22:08:27.1287517Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:08:27.1348320Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/googletest/config remote.origin.url 2024-08-20T22:08:27.1371041Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:08:27.1432072Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/tools/vcpkg/config remote.origin.url 2024-08-20T22:08:27.1474572Z Entering 'third_party/pocketfft' 2024-08-20T22:08:27.1537864Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pocketfft/config remote.origin.url 2024-08-20T22:08:27.1560706Z Entering 'third_party/protobuf' 2024-08-20T22:08:27.1624427Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/config remote.origin.url 2024-08-20T22:08:27.1648751Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:08:27.1709767Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/benchmark/config remote.origin.url 2024-08-20T22:08:27.1730985Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T22:08:27.1792357Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/googletest/config remote.origin.url 2024-08-20T22:08:27.1815850Z Entering 'third_party/psimd' 2024-08-20T22:08:27.1878257Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/psimd/config remote.origin.url 2024-08-20T22:08:27.1900374Z Entering 'third_party/pthreadpool' 2024-08-20T22:08:27.1963573Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/pthreadpool/config remote.origin.url 2024-08-20T22:08:27.1985533Z Entering 'third_party/pybind11' 2024-08-20T22:08:27.2047582Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pybind11/config remote.origin.url 2024-08-20T22:08:27.2069809Z Entering 'third_party/python-peachpy' 2024-08-20T22:08:27.2131484Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/python-peachpy/config remote.origin.url 2024-08-20T22:08:27.2153793Z Entering 'third_party/sleef' 2024-08-20T22:08:27.2215068Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/sleef/config remote.origin.url 2024-08-20T22:08:27.2237014Z Entering 'third_party/tensorpipe' 2024-08-20T22:08:27.2303740Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/config remote.origin.url 2024-08-20T22:08:27.2324131Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:08:27.2386011Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/googletest/config remote.origin.url 2024-08-20T22:08:27.2407283Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:08:27.2469043Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libnop/config remote.origin.url 2024-08-20T22:08:27.2488901Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:08:27.2550537Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libuv/config remote.origin.url 2024-08-20T22:08:27.2570915Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:08:27.2632556Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/config remote.origin.url 2024-08-20T22:08:27.2653104Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:08:27.2715448Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/modules/tools/clang/config remote.origin.url 2024-08-20T22:08:27.3507747Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'git@github.com:' 2024-08-20T22:08:27.3872838Z Entering 'android/libs/fbjni' 2024-08-20T22:08:27.3924015Z Entering 'third_party/FP16' 2024-08-20T22:08:27.3976899Z Entering 'third_party/FXdiv' 2024-08-20T22:08:27.4033488Z Entering 'third_party/NNPACK' 2024-08-20T22:08:27.4085282Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T22:08:27.4137392Z Entering 'third_party/XNNPACK' 2024-08-20T22:08:27.4205594Z Entering 'third_party/benchmark' 2024-08-20T22:08:27.4257859Z Entering 'third_party/cpp-httplib' 2024-08-20T22:08:27.4310190Z Entering 'third_party/cpuinfo' 2024-08-20T22:08:27.4368303Z Entering 'third_party/cudnn_frontend' 2024-08-20T22:08:27.4419979Z Entering 'third_party/cutlass' 2024-08-20T22:08:27.4479444Z Entering 'third_party/eigen' 2024-08-20T22:08:27.4533210Z Entering 'third_party/fbgemm' 2024-08-20T22:08:27.4584591Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:08:27.4634356Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:08:27.4684444Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:08:27.4741095Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:08:27.4794187Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:08:27.4847396Z Entering 'third_party/flatbuffers' 2024-08-20T22:08:27.4901652Z Entering 'third_party/fmt' 2024-08-20T22:08:27.4956130Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:08:27.5007734Z Entering 'third_party/gloo' 2024-08-20T22:08:27.5058719Z Entering 'third_party/googletest' 2024-08-20T22:08:27.5110610Z Entering 'third_party/ideep' 2024-08-20T22:08:27.5162162Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T22:08:27.5221682Z Entering 'third_party/ittapi' 2024-08-20T22:08:27.5276489Z Entering 'third_party/kineto' 2024-08-20T22:08:27.5329191Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:08:27.5380222Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:08:27.5432954Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:08:27.5485131Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:08:27.5536100Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:08:27.5586175Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:08:27.5642314Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:08:27.5693930Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:08:27.5745347Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:08:27.5798538Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:08:27.5853524Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:08:27.5903829Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:08:27.5957580Z Entering 'third_party/mimalloc' 2024-08-20T22:08:27.6009093Z Entering 'third_party/nccl/nccl' 2024-08-20T22:08:27.6062274Z Entering 'third_party/nlohmann' 2024-08-20T22:08:27.6115185Z Entering 'third_party/onnx' 2024-08-20T22:08:27.6182910Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T22:08:27.6235278Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T22:08:27.6293156Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T22:08:27.6348620Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:08:27.6399749Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:08:27.6453132Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:08:27.6502968Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:08:27.6556696Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:08:27.6605977Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:08:27.6658848Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:08:27.6707709Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:08:27.6760867Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:08:27.6814773Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:08:27.6887147Z Entering 'third_party/pocketfft' 2024-08-20T22:08:27.6938834Z Entering 'third_party/protobuf' 2024-08-20T22:08:27.6997690Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:08:27.7048720Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T22:08:27.7103969Z Entering 'third_party/psimd' 2024-08-20T22:08:27.7161246Z Entering 'third_party/pthreadpool' 2024-08-20T22:08:27.7213461Z Entering 'third_party/pybind11' 2024-08-20T22:08:27.7265818Z Entering 'third_party/python-peachpy' 2024-08-20T22:08:27.7317856Z Entering 'third_party/sleef' 2024-08-20T22:08:27.7371947Z Entering 'third_party/tensorpipe' 2024-08-20T22:08:27.7424121Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:08:27.7475133Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:08:27.7524906Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:08:27.7575756Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:08:27.7624072Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:08:27.7700302Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'org-21003710@github.com:' 2024-08-20T22:08:27.8063665Z Entering 'android/libs/fbjni' 2024-08-20T22:08:27.8115007Z Entering 'third_party/FP16' 2024-08-20T22:08:27.8167758Z Entering 'third_party/FXdiv' 2024-08-20T22:08:27.8219720Z Entering 'third_party/NNPACK' 2024-08-20T22:08:27.8272712Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T22:08:27.8324959Z Entering 'third_party/XNNPACK' 2024-08-20T22:08:27.8393453Z Entering 'third_party/benchmark' 2024-08-20T22:08:27.8446564Z Entering 'third_party/cpp-httplib' 2024-08-20T22:08:27.8497755Z Entering 'third_party/cpuinfo' 2024-08-20T22:08:27.8549878Z Entering 'third_party/cudnn_frontend' 2024-08-20T22:08:27.8603040Z Entering 'third_party/cutlass' 2024-08-20T22:08:27.8661825Z Entering 'third_party/eigen' 2024-08-20T22:08:27.8715336Z Entering 'third_party/fbgemm' 2024-08-20T22:08:27.8766725Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:08:27.8817991Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:08:27.8870133Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:08:27.8930329Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:08:27.8981839Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:08:27.9034369Z Entering 'third_party/flatbuffers' 2024-08-20T22:08:27.9089639Z Entering 'third_party/fmt' 2024-08-20T22:08:27.9143004Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:08:27.9197091Z Entering 'third_party/gloo' 2024-08-20T22:08:27.9249918Z Entering 'third_party/googletest' 2024-08-20T22:08:27.9302459Z Entering 'third_party/ideep' 2024-08-20T22:08:27.9353602Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T22:08:27.9411974Z Entering 'third_party/ittapi' 2024-08-20T22:08:27.9463914Z Entering 'third_party/kineto' 2024-08-20T22:08:27.9514824Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:08:27.9567763Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:08:27.9622134Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:08:27.9674794Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:08:27.9726601Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:08:27.9778611Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:08:27.9833425Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:08:27.9884951Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:08:27.9936089Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:08:27.9988620Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:08:28.0044528Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:08:28.0095300Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:08:28.0149205Z Entering 'third_party/mimalloc' 2024-08-20T22:08:28.0201143Z Entering 'third_party/nccl/nccl' 2024-08-20T22:08:28.0255282Z Entering 'third_party/nlohmann' 2024-08-20T22:08:28.0307668Z Entering 'third_party/onnx' 2024-08-20T22:08:28.0373361Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T22:08:28.0424832Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T22:08:28.0486640Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T22:08:28.0539180Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:08:28.0590421Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:08:28.0642718Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:08:28.0693911Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:08:28.0747119Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:08:28.0797333Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:08:28.0849590Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:08:28.0900633Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:08:28.0952461Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:08:28.1006145Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:08:28.1078347Z Entering 'third_party/pocketfft' 2024-08-20T22:08:28.1130609Z Entering 'third_party/protobuf' 2024-08-20T22:08:28.1185986Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:08:28.1236478Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T22:08:28.1291626Z Entering 'third_party/psimd' 2024-08-20T22:08:28.1346051Z Entering 'third_party/pthreadpool' 2024-08-20T22:08:28.1399209Z Entering 'third_party/pybind11' 2024-08-20T22:08:28.1452022Z Entering 'third_party/python-peachpy' 2024-08-20T22:08:28.1504392Z Entering 'third_party/sleef' 2024-08-20T22:08:28.1556940Z Entering 'third_party/tensorpipe' 2024-08-20T22:08:28.1610672Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:08:28.1660578Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:08:28.1710213Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:08:28.1761404Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:08:28.1810581Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:08:28.1885505Z ##[endgroup] 2024-08-20T22:08:28.1936538Z [command]/usr/bin/git log -1 --format='%H' 2024-08-20T22:08:28.1974928Z '40ec5f6ddd9787aca0449b24128343ff4c4a88b3' 2024-08-20T22:08:28.2186728Z Prepare all required actions 2024-08-20T22:08:28.2187169Z Getting action download info 2024-08-20T22:08:28.3887668Z ##[group]Run ./.github/actions/setup-linux 2024-08-20T22:08:28.3888093Z env: 2024-08-20T22:08:28.3888369Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:28.3888701Z ##[endgroup] 2024-08-20T22:08:28.3948201Z ##[group]Run set -euo pipefail 2024-08-20T22:08:28.3948620Z set -euo pipefail 2024-08-20T22:08:28.3949009Z function get_ec2_metadata() { 2024-08-20T22:08:28.3949538Z  # Pulled from instance metadata endpoint for EC2 2024-08-20T22:08:28.3950399Z  # see https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/instancedata-data-retrieval.html 2024-08-20T22:08:28.3951142Z  category=$1 2024-08-20T22:08:28.3951660Z  # If it is GCP runner (runner name contains gcp), do not run this 2024-08-20T22:08:28.3952287Z  runner_name_str=i-0a5ee6a6662a7d0e6 2024-08-20T22:08:28.3952773Z  if [[ -f /.inarc ]]; then 2024-08-20T22:08:28.3953346Z  echo "ARC Runner, no info on ec2 metadata" 2024-08-20T22:08:28.3953909Z  elif [[ $runner_name_str == *"gcp"* ]]; then 2024-08-20T22:08:28.3954595Z  echo "Runner is from Google Cloud Platform, No info on ec2 metadata" 2024-08-20T22:08:28.3955189Z  else 2024-08-20T22:08:28.3955665Z  curl -fsSL "http://169.254.169.254/latest/meta-data/${category}" 2024-08-20T22:08:28.3956227Z  fi 2024-08-20T22:08:28.3956512Z } 2024-08-20T22:08:28.3956865Z echo "ami-id: $(get_ec2_metadata ami-id)" 2024-08-20T22:08:28.3957448Z echo "instance-id: $(get_ec2_metadata instance-id)" 2024-08-20T22:08:28.3958133Z echo "instance-type: $(get_ec2_metadata instance-type)" 2024-08-20T22:08:28.3958687Z echo "system info $(uname -a)" 2024-08-20T22:08:28.3969752Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:08:28.3970229Z env: 2024-08-20T22:08:28.3970504Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:28.3970838Z ##[endgroup] 2024-08-20T22:08:28.4076065Z ami-id: ami-06c68f701d8090592 2024-08-20T22:08:28.4131568Z instance-id: i-0a5ee6a6662a7d0e6 2024-08-20T22:08:28.4187004Z instance-type: g5.4xlarge 2024-08-20T22:08:28.4200486Z system info Linux ip-10-0-40-180.ec2.internal 6.1.94-99.176.amzn2023.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Jun 18 14:57:56 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux 2024-08-20T22:08:28.4223898Z ##[group]Run echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> $GITHUB_OUTPUT 2024-08-20T22:08:28.4224786Z echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> $GITHUB_OUTPUT 2024-08-20T22:08:28.4233917Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:08:28.4234401Z env: 2024-08-20T22:08:28.4234678Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:28.4235018Z ##[endgroup] 2024-08-20T22:08:28.4311129Z ##[group]Run if systemctl is-active --quiet docker; then 2024-08-20T22:08:28.4311726Z if systemctl is-active --quiet docker; then 2024-08-20T22:08:28.4312253Z  echo "Docker daemon is running..."; 2024-08-20T22:08:28.4312861Z else 2024-08-20T22:08:28.4313424Z  echo "Starting docker deamon..." && sudo systemctl start docker; 2024-08-20T22:08:28.4313996Z fi 2024-08-20T22:08:28.4322113Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:08:28.4322601Z env: 2024-08-20T22:08:28.4322876Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:28.4323215Z ##[endgroup] 2024-08-20T22:08:28.4409347Z Docker daemon is running... 2024-08-20T22:08:28.4458155Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2024-08-20T22:08:28.4458708Z with: 2024-08-20T22:08:28.4458970Z shell: bash 2024-08-20T22:08:28.4459257Z timeout_minutes: 5 2024-08-20T22:08:28.4459576Z max_attempts: 3 2024-08-20T22:08:28.4459885Z retry_wait_seconds: 30 2024-08-20T22:08:28.4462939Z command: AWS_ACCOUNT_ID=$(aws sts get-caller-identity|grep Account|cut -f4 -d\") aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \ --password-stdin "$AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com" # For LF Runners we need to make sure we also login to Meta's ECR docker registry too. META_AWS_ACCOUNT_ID=308535385114 if [ "$AWS_ACCOUNT_ID" != "$META_AWS_ACCOUNT_ID" ] ; then aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \ --password-stdin "$META_AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com" fi 2024-08-20T22:08:28.4465856Z polling_interval_seconds: 1 2024-08-20T22:08:28.4466216Z warning_on_retry: true 2024-08-20T22:08:28.4466563Z continue_on_error: false 2024-08-20T22:08:28.4466897Z env: 2024-08-20T22:08:28.4467165Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:28.4467509Z AWS_RETRY_MODE: standard 2024-08-20T22:08:28.4467853Z AWS_MAX_ATTEMPTS: 5 2024-08-20T22:08:28.4468188Z AWS_DEFAULT_REGION: us-east-1 2024-08-20T22:08:28.4468560Z ##[endgroup] 2024-08-20T22:08:29.8055126Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-08-20T22:08:29.8056044Z Configure a credential helper to remove this warning. See 2024-08-20T22:08:29.8056892Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-08-20T22:08:29.8057409Z 2024-08-20T22:08:29.8057536Z Login Succeeded 2024-08-20T22:08:30.5047742Z Command completed after 1 attempt(s). 2024-08-20T22:08:30.5111061Z ##[group]Run env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-08-20T22:08:30.5111764Z env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-08-20T22:08:30.5112408Z env | grep '^CI' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-08-20T22:08:30.5121567Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:08:30.5122053Z env: 2024-08-20T22:08:30.5122329Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:30.5122672Z ##[endgroup] 2024-08-20T22:08:30.5218673Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2024-08-20T22:08:30.5219418Z # ignore expansion of "docker ps -q" since it could be empty 2024-08-20T22:08:30.5220012Z # shellcheck disable=SC2046 2024-08-20T22:08:30.5220464Z docker stop $(docker ps -q) || true 2024-08-20T22:08:30.5220932Z # Prune all of the docker images 2024-08-20T22:08:30.5222708Z docker system prune -af 2024-08-20T22:08:30.5231118Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:08:30.5231607Z env: 2024-08-20T22:08:30.5231880Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:30.5232219Z ##[endgroup] 2024-08-20T22:08:30.5545024Z "docker stop" requires at least 1 argument. 2024-08-20T22:08:30.5545907Z See 'docker stop --help'. 2024-08-20T22:08:30.5546150Z 2024-08-20T22:08:30.5546374Z Usage: docker stop [OPTIONS] CONTAINER [CONTAINER...] 2024-08-20T22:08:30.5546743Z 2024-08-20T22:08:30.5546902Z Stop one or more running containers 2024-08-20T22:08:30.5725365Z Total reclaimed space: 0B 2024-08-20T22:08:30.5770403Z ##[group]Run set +e 2024-08-20T22:08:30.5770754Z set +e 2024-08-20T22:08:30.5771246Z set -x 2024-08-20T22:08:30.5771538Z  2024-08-20T22:08:30.5771853Z PT_DOMAIN=download.pytorch.org 2024-08-20T22:08:30.5772621Z # TODO: Flaky access to download.pytorch.org https://github.com/pytorch/pytorch/issues/100400, 2024-08-20T22:08:30.5773674Z # cleaning this up once the issue is fixed. There are more than one resolved IP here, the last 2024-08-20T22:08:30.5774409Z # one is returned at random 2024-08-20T22:08:30.5774944Z RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" | tail -n1) 2024-08-20T22:08:30.5775443Z  2024-08-20T22:08:30.5775759Z if [ -z "${RESOLVED_IP}" ]; then 2024-08-20T22:08:30.5776368Z  echo "Couldn't resolve ${PT_DOMAIN}, retrying with Google DNS..." 2024-08-20T22:08:30.5777312Z  RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" @8.8.8.8 | tail -n1) 2024-08-20T22:08:30.5777858Z  2024-08-20T22:08:30.5778183Z  if [ -z "${RESOLVED_IP}" ]; then 2024-08-20T22:08:30.5778737Z  echo "Couldn't resolve ${PT_DOMAIN}, exiting..." 2024-08-20T22:08:30.5779237Z  exit 1 2024-08-20T22:08:30.5779540Z  fi 2024-08-20T22:08:30.5779825Z fi 2024-08-20T22:08:30.5780101Z  2024-08-20T22:08:30.5780456Z if grep -r "${PT_DOMAIN}" /etc/hosts; then 2024-08-20T22:08:30.5780960Z  # Clean up any old records first 2024-08-20T22:08:30.5781461Z  sudo sed -i "/${PT_DOMAIN}/d" /etc/hosts 2024-08-20T22:08:30.5781906Z fi 2024-08-20T22:08:30.5782177Z  2024-08-20T22:08:30.5782603Z echo "${RESOLVED_IP} ${PT_DOMAIN}" | sudo tee -a /etc/hosts 2024-08-20T22:08:30.5783135Z cat /etc/hosts 2024-08-20T22:08:30.5792238Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:08:30.5792737Z env: 2024-08-20T22:08:30.5793022Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:30.5793470Z ##[endgroup] 2024-08-20T22:08:30.5821222Z + PT_DOMAIN=download.pytorch.org 2024-08-20T22:08:30.5827795Z ++ dig -4 +short download.pytorch.org 2024-08-20T22:08:30.5828467Z ++ tail -n1 2024-08-20T22:08:30.6080854Z + RESOLVED_IP=18.160.10.36 2024-08-20T22:08:30.6081532Z + '[' -z 18.160.10.36 ']' 2024-08-20T22:08:30.6082068Z + grep -r download.pytorch.org /etc/hosts 2024-08-20T22:08:30.6095484Z 108.138.64.97 download.pytorch.org 2024-08-20T22:08:30.6097625Z + sudo sed -i /download.pytorch.org/d /etc/hosts 2024-08-20T22:08:30.7843082Z + echo '18.160.10.36 download.pytorch.org' 2024-08-20T22:08:30.7843715Z + sudo tee -a /etc/hosts 2024-08-20T22:08:30.8164172Z 18.160.10.36 download.pytorch.org 2024-08-20T22:08:30.8185070Z + cat /etc/hosts 2024-08-20T22:08:30.8196376Z 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 2024-08-20T22:08:30.8209078Z ::1 localhost6 localhost6.localdomain6 2024-08-20T22:08:30.8209771Z 18.160.10.36 download.pytorch.org 2024-08-20T22:08:30.8359629Z ##[group]Run pytorch/test-infra/.github/actions/calculate-docker-image@main 2024-08-20T22:08:30.8360233Z with: 2024-08-20T22:08:30.8361305Z docker-image-name: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:30.8362503Z docker-build-dir: .ci/docker 2024-08-20T22:08:30.8362879Z working-directory: . 2024-08-20T22:08:30.8363335Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:30.8363845Z force-push: false 2024-08-20T22:08:30.8364146Z env: 2024-08-20T22:08:30.8364414Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:30.8364742Z ##[endgroup] 2024-08-20T22:08:30.8383362Z ##[group]Run set -ex 2024-08-20T22:08:30.8383715Z set -ex 2024-08-20T22:08:30.8384000Z  2024-08-20T22:08:30.8384550Z # If the docker build directory or the build script doesn't exist, the action will 2024-08-20T22:08:30.8385502Z # gracefully return the docker image name as it is. Pulling docker image in Linux 2024-08-20T22:08:30.8386455Z # job could then download the pre-built image as usual 2024-08-20T22:08:30.8387185Z if [[ ! -d "${DOCKER_BUILD_DIR}" ]] || [[ ! -f "${DOCKER_BUILD_DIR}/build.sh" ]]; then 2024-08-20T22:08:30.8387846Z  echo "skip=true" >> "${GITHUB_OUTPUT}" 2024-08-20T22:08:30.8388520Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2024-08-20T22:08:30.8389069Z  2024-08-20T22:08:30.8389568Z  echo "There is no Docker build script in ${REPO_NAME} repo, skipping..." 2024-08-20T22:08:30.8390195Z  exit 0 2024-08-20T22:08:30.8390497Z else 2024-08-20T22:08:30.8390861Z  echo "skip=false" >> "${GITHUB_OUTPUT}" 2024-08-20T22:08:30.8391313Z fi 2024-08-20T22:08:30.8391593Z  2024-08-20T22:08:30.8392059Z if [[ "${DOCKER_IMAGE_NAME}" == *"${DOCKER_REGISTRY}/${REPO_NAME}"* ]]; then 2024-08-20T22:08:30.8392892Z  # The docker image name already includes the ECR prefix and tag, so we can just 2024-08-20T22:08:30.8393761Z  # use it as it is, but first let's extract the tag 2024-08-20T22:08:30.8394457Z  DOCKER_TAG=$(echo "${DOCKER_IMAGE_NAME}" | awk -F '[:,]' '{print $2}') 2024-08-20T22:08:30.8395175Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-08-20T22:08:30.8395870Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2024-08-20T22:08:30.8396418Z else 2024-08-20T22:08:30.8396855Z  DOCKER_TAG=$(git rev-parse HEAD:"${DOCKER_BUILD_DIR}") 2024-08-20T22:08:30.8397507Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-08-20T22:08:30.8398386Z  echo "docker-image=${DOCKER_REGISTRY}/${REPO_NAME}/${DOCKER_IMAGE_NAME}:${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-08-20T22:08:30.8399116Z fi 2024-08-20T22:08:30.8407858Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:08:30.8408349Z env: 2024-08-20T22:08:30.8408632Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:30.8408976Z REPO_NAME: pytorch 2024-08-20T22:08:30.8410093Z DOCKER_IMAGE_NAME: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:30.8411271Z DOCKER_BUILD_DIR: .ci/docker 2024-08-20T22:08:30.8411761Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:30.8412261Z ##[endgroup] 2024-08-20T22:08:30.8446155Z + [[ ! -d .ci/docker ]] 2024-08-20T22:08:30.8446717Z + [[ ! -f .ci/docker/build.sh ]] 2024-08-20T22:08:30.8447204Z + echo skip=false 2024-08-20T22:08:30.8449282Z + [[ 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 == *\3\0\8\5\3\5\3\8\5\1\1\4\.\d\k\r\.\e\c\r\.\u\s\-\e\a\s\t\-\1\.\a\m\a\z\o\n\a\w\s\.\c\o\m\/\p\y\t\o\r\c\h* ]] 2024-08-20T22:08:30.8453913Z ++ echo 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:30.8455440Z ++ awk -F '[:,]' '{print $2}' 2024-08-20T22:08:30.8479636Z + DOCKER_TAG=f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:30.8480521Z + echo docker-tag=f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:30.8482421Z + echo docker-image=308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:30.8515261Z ##[group]Run set +e 2024-08-20T22:08:30.8515712Z set +e 2024-08-20T22:08:30.8516130Z set -x 2024-08-20T22:08:30.8516570Z  2024-08-20T22:08:30.8516964Z login() { 2024-08-20T22:08:30.8517674Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2024-08-20T22:08:30.8518518Z } 2024-08-20T22:08:30.8518908Z  2024-08-20T22:08:30.8519482Z retry () { 2024-08-20T22:08:30.8519933Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2024-08-20T22:08:30.8520494Z } 2024-08-20T22:08:30.8520923Z  2024-08-20T22:08:30.8521353Z retry login "${DOCKER_REGISTRY}" 2024-08-20T22:08:30.8521827Z  2024-08-20T22:08:30.8522438Z # Check if image already exists, if it does then skip building it 2024-08-20T22:08:30.8523271Z if docker manifest inspect "${DOCKER_IMAGE}"; then 2024-08-20T22:08:30.8523862Z  exit 0 2024-08-20T22:08:30.8524265Z fi 2024-08-20T22:08:30.8524667Z  2024-08-20T22:08:30.8525255Z # NB: This part requires a full checkout. Otherwise, the merge base will 2024-08-20T22:08:30.8526175Z # be empty. The default action would be to continue rebuild the image 2024-08-20T22:08:30.8527025Z if [[ "$BASE_REVISION" = "$(git rev-parse HEAD)" ]]; then 2024-08-20T22:08:30.8527784Z  # if we're on the base branch then use the parent commit 2024-08-20T22:08:30.8528539Z  MERGE_BASE=$(git rev-parse HEAD~) 2024-08-20T22:08:30.8529116Z else 2024-08-20T22:08:30.8529648Z  # otherwise we're on a PR, so use the most recent base commit 2024-08-20T22:08:30.8530492Z  MERGE_BASE=$(git merge-base HEAD "$BASE_REVISION") 2024-08-20T22:08:30.8531090Z fi 2024-08-20T22:08:30.8531487Z  2024-08-20T22:08:30.8531914Z if [[ -z "${MERGE_BASE}" ]]; then 2024-08-20T22:08:30.8532512Z  echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2024-08-20T22:08:30.8533078Z  2024-08-20T22:08:30.8533858Z  echo "Finding merge base only works with full checkout, please set fetch-depth to 0, continuing ..." 2024-08-20T22:08:30.8534662Z  exit 0 2024-08-20T22:08:30.8535075Z fi 2024-08-20T22:08:30.8535493Z  2024-08-20T22:08:30.8535984Z if ! git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}"; then 2024-08-20T22:08:30.8537051Z  echo "Directory '${DOCKER_BUILD_DIR}' not found in commit $MERGE_BASE, you should rebase onto a more recent commit" 2024-08-20T22:08:30.8537972Z  exit 1 2024-08-20T22:08:30.8538391Z fi 2024-08-20T22:08:30.8538725Z  2024-08-20T22:08:30.8539353Z PREVIOUS_DOCKER_TAG=$(git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}") 2024-08-20T22:08:30.8540403Z # If no image exists but the hash is the same as the previous hash then we should error out here 2024-08-20T22:08:30.8541676Z if [[ "${PREVIOUS_DOCKER_TAG}" == "${DOCKER_TAG}" ]]; then 2024-08-20T22:08:30.8542719Z  echo "WARNING: Something has gone wrong and the previous image isn't available for the merge-base of your branch" 2024-08-20T22:08:30.8543872Z  echo " Will re-build docker image to store in local cache, TTS may be longer" 2024-08-20T22:08:30.8544823Z fi 2024-08-20T22:08:30.8545230Z  2024-08-20T22:08:30.8545683Z echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2024-08-20T22:08:30.8554323Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:08:30.8554906Z env: 2024-08-20T22:08:30.8555347Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:30.8555826Z DOCKER_BUILD_DIR: .ci/docker 2024-08-20T22:08:30.8556349Z BASE_REVISION: 40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:08:30.8557765Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:30.8559083Z DOCKER_TAG: f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:30.8559775Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:30.8560413Z ##[endgroup] 2024-08-20T22:08:30.8594294Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:30.8595052Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:30.8597014Z + aws ecr get-login-password --region us-east-1 2024-08-20T22:08:30.8598979Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:31.3938188Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-08-20T22:08:31.3939622Z Configure a credential helper to remove this warning. See 2024-08-20T22:08:31.3941120Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-08-20T22:08:31.3941670Z 2024-08-20T22:08:31.3941830Z Login Succeeded 2024-08-20T22:08:31.3967674Z + docker manifest inspect 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:31.6099269Z { 2024-08-20T22:08:31.6100033Z "schemaVersion": 2, 2024-08-20T22:08:31.6100922Z "mediaType": "application/vnd.docker.distribution.manifest.v2+json", 2024-08-20T22:08:31.6101892Z "config": { 2024-08-20T22:08:31.6102552Z "mediaType": "application/vnd.docker.container.image.v1+json", 2024-08-20T22:08:31.6103210Z "size": 48711, 2024-08-20T22:08:31.6104766Z "digest": "sha256:8fef7805cec6e829013a3d62f158b75bdc2f02cdfe3428c032ea017b488473bb" 2024-08-20T22:08:31.6106366Z }, 2024-08-20T22:08:31.6106864Z "layers": [ 2024-08-20T22:08:31.6107883Z { 2024-08-20T22:08:31.6108769Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6110362Z "size": 28580681, 2024-08-20T22:08:31.6111094Z "digest": "sha256:7a2c559011895d255fce249c00396abff5ae7e0c0a92931d0ed493e71de78e3a" 2024-08-20T22:08:31.6112357Z }, 2024-08-20T22:08:31.6113100Z { 2024-08-20T22:08:31.6114203Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6115343Z "size": 7943451, 2024-08-20T22:08:31.6116380Z "digest": "sha256:224fe954d7252f10539d243d6c9688806f7d13ad775ed02e7f7c79077844510d" 2024-08-20T22:08:31.6117571Z }, 2024-08-20T22:08:31.6118160Z { 2024-08-20T22:08:31.6119071Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6120309Z "size": 55728572, 2024-08-20T22:08:31.6121220Z "digest": "sha256:75722010b82e31715876aeeed0b2cee414296f0124fdfa061ab845ba2a158450" 2024-08-20T22:08:31.6122241Z }, 2024-08-20T22:08:31.6122892Z { 2024-08-20T22:08:31.6123686Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6124618Z "size": 186, 2024-08-20T22:08:31.6125718Z "digest": "sha256:d527cbbb87e3016fd72a18a9b468c945ad0ca27c5770b39debd6ed704db3a195" 2024-08-20T22:08:31.6126810Z }, 2024-08-20T22:08:31.6127306Z { 2024-08-20T22:08:31.6128297Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6129337Z "size": 6886, 2024-08-20T22:08:31.6130340Z "digest": "sha256:b57676e46aee1a8c82e528d78e5a13e31142524eea31c8b213d69ddcb6f1fe80" 2024-08-20T22:08:31.6131496Z }, 2024-08-20T22:08:31.6132445Z { 2024-08-20T22:08:31.6133436Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6134533Z "size": 1329001756, 2024-08-20T22:08:31.6135430Z "digest": "sha256:a8c1e85b5e14cec7af70bf304cb4d4cee6a1d25eb8215b2cf4fdc33e5af5e108" 2024-08-20T22:08:31.6136630Z }, 2024-08-20T22:08:31.6137103Z { 2024-08-20T22:08:31.6137904Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6138980Z "size": 62501, 2024-08-20T22:08:31.6139885Z "digest": "sha256:a41a8d1c11c8d80fe4e82b0d05478f8d51176ff20b8350905fc1b25c93a51198" 2024-08-20T22:08:31.6141332Z }, 2024-08-20T22:08:31.6141899Z { 2024-08-20T22:08:31.6142600Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6143551Z "size": 1684, 2024-08-20T22:08:31.6144508Z "digest": "sha256:0c12278907551c2962927d27c115f6f7bf0df894318b8aea6ece3ef01ccd0a8a" 2024-08-20T22:08:31.6145527Z }, 2024-08-20T22:08:31.6146027Z { 2024-08-20T22:08:31.6146862Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6148118Z "size": 1523, 2024-08-20T22:08:31.6148998Z "digest": "sha256:d8d1234baab3ec9ccb8bb710fc6b8ff6c10896ba2e8d27a347583eca770f9ff1" 2024-08-20T22:08:31.6150169Z }, 2024-08-20T22:08:31.6150678Z { 2024-08-20T22:08:31.6151525Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6152488Z "size": 2528295403, 2024-08-20T22:08:31.6153590Z "digest": "sha256:7ed32bc8e4696fcdb2feef850781160597b2275ad756819c4add88236b0577d5" 2024-08-20T22:08:31.6155027Z + exit 0 2024-08-20T22:08:31.6155563Z }, 2024-08-20T22:08:31.6155986Z { 2024-08-20T22:08:31.6156887Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6157867Z "size": 86016, 2024-08-20T22:08:31.6158775Z "digest": "sha256:ec1e7978c1fe161ced1d98092a51e7c5953ca5fda5577f54df9dbda4afff1b2b" 2024-08-20T22:08:31.6160023Z }, 2024-08-20T22:08:31.6160489Z { 2024-08-20T22:08:31.6161269Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6162301Z "size": 1822, 2024-08-20T22:08:31.6163317Z "digest": "sha256:ac23c5fcc1ef310e9cd0d138b180281188e20a3e28c51cd14751622e3c7d92ea" 2024-08-20T22:08:31.6164254Z }, 2024-08-20T22:08:31.6164713Z { 2024-08-20T22:08:31.6165205Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6165883Z "size": 246761563, 2024-08-20T22:08:31.6166604Z "digest": "sha256:ca426ffc9d2bd051ad1ff5c4f02fd5d9be161e70953cc37882c815080c708f4d" 2024-08-20T22:08:31.6167311Z }, 2024-08-20T22:08:31.6167625Z { 2024-08-20T22:08:31.6168187Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6168840Z "size": 544, 2024-08-20T22:08:31.6169470Z "digest": "sha256:4373aa743caf6660c671295b837048c8350a2165f2336dc3b7b6c96462579e50" 2024-08-20T22:08:31.6170203Z }, 2024-08-20T22:08:31.6170537Z { 2024-08-20T22:08:31.6171131Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6171739Z "size": 1258, 2024-08-20T22:08:31.6172384Z "digest": "sha256:75b2abb16c685854c017d0cf75c626526c956734c656d9e78fdd4520317e9b3c" 2024-08-20T22:08:31.6173113Z }, 2024-08-20T22:08:31.6173443Z { 2024-08-20T22:08:31.6173943Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6174623Z "size": 484, 2024-08-20T22:08:31.6175236Z "digest": "sha256:ef1e3ef1e85f0124270b8506721219150e230184181f8207d64463bf5c67e656" 2024-08-20T22:08:31.6175898Z }, 2024-08-20T22:08:31.6176442Z { 2024-08-20T22:08:31.6176999Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6177719Z "size": 91711766, 2024-08-20T22:08:31.6178478Z "digest": "sha256:0bf61114d37b2d09065aa6852b1e78a32580a1ff011dd5d23f03b0f5c4e710af" 2024-08-20T22:08:31.6179345Z }, 2024-08-20T22:08:31.6179822Z { 2024-08-20T22:08:31.6180324Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6181247Z "size": 3390, 2024-08-20T22:08:31.6181908Z "digest": "sha256:2df849f72ba4258df10c9c45ace21a66d93b73196e78e96f12c13098822f60e2" 2024-08-20T22:08:31.6182630Z }, 2024-08-20T22:08:31.6182933Z { 2024-08-20T22:08:31.6183517Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6184171Z "size": 1909, 2024-08-20T22:08:31.6184788Z "digest": "sha256:34c47d63c5de27418739aa048b4dd781c3006d65691e9b903c95304d0509d89c" 2024-08-20T22:08:31.6185494Z }, 2024-08-20T22:08:31.6185851Z { 2024-08-20T22:08:31.6186372Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6187075Z "size": 701, 2024-08-20T22:08:31.6187665Z "digest": "sha256:1fef4bd19792cbf9d3aea12795089ad41164bb6d607c339b7484e1899825b1d2" 2024-08-20T22:08:31.6188356Z }, 2024-08-20T22:08:31.6188762Z { 2024-08-20T22:08:31.6189279Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6189881Z "size": 2864254879, 2024-08-20T22:08:31.6190623Z "digest": "sha256:6efb96fc87ea1bca54876d85331e5585e28f325a1d60ee1aef7811eabb74f933" 2024-08-20T22:08:31.6191408Z }, 2024-08-20T22:08:31.6191706Z { 2024-08-20T22:08:31.6192314Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6192947Z "size": 380, 2024-08-20T22:08:31.6193826Z "digest": "sha256:b119c4fc6c58d9e72744201ff4850b34184a94eb3566031b7d36e87ecce950a6" 2024-08-20T22:08:31.6194479Z }, 2024-08-20T22:08:31.6194813Z { 2024-08-20T22:08:31.6195396Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6196031Z "size": 12900, 2024-08-20T22:08:31.6196632Z "digest": "sha256:33b639226eeefa41d7bb26a8ecc20d271ceef45571dabfd80aaee3634926381b" 2024-08-20T22:08:31.6197404Z }, 2024-08-20T22:08:31.6197740Z { 2024-08-20T22:08:31.6198218Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6198916Z "size": 803, 2024-08-20T22:08:31.6199536Z "digest": "sha256:d3547bd43146930aa830d54562c98aa678e355cf5f84527e9717eb72fffe8ca3" 2024-08-20T22:08:31.6200252Z }, 2024-08-20T22:08:31.6200599Z { 2024-08-20T22:08:31.6201121Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6201774Z "size": 106, 2024-08-20T22:08:31.6202441Z "digest": "sha256:5645520256fa6d7f2270608eaed53849a131d03fbf4c5d4472c9cfde1a439e47" 2024-08-20T22:08:31.6203093Z }, 2024-08-20T22:08:31.6203451Z { 2024-08-20T22:08:31.6204016Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6204672Z "size": 503, 2024-08-20T22:08:31.6205251Z "digest": "sha256:829ed7d91e3818d0e11834c71551117c7aeec0a51d798e93d641faa0c02582cb" 2024-08-20T22:08:31.6206010Z }, 2024-08-20T22:08:31.6206365Z { 2024-08-20T22:08:31.6206842Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6207524Z "size": 121477267, 2024-08-20T22:08:31.6208187Z "digest": "sha256:385d0421d67c533d628985c453a186028a61f6ad4209ae519ec3d4ecea661d3e" 2024-08-20T22:08:31.6208871Z }, 2024-08-20T22:08:31.6209212Z { 2024-08-20T22:08:31.6209755Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6210384Z "size": 109, 2024-08-20T22:08:31.6211077Z "digest": "sha256:7cbfce999d76851e07dd71056a6d852629d789ccfd46be44cc405b451fb8bb58" 2024-08-20T22:08:31.6211737Z }, 2024-08-20T22:08:31.6212076Z { 2024-08-20T22:08:31.6212660Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6213256Z "size": 490, 2024-08-20T22:08:31.6213867Z "digest": "sha256:6658e558ebe496f0d628947534b0ea1e44808f84f2dfd8a9a704e8aa5329d791" 2024-08-20T22:08:31.6214622Z }, 2024-08-20T22:08:31.6214955Z { 2024-08-20T22:08:31.6215438Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6216133Z "size": 297, 2024-08-20T22:08:31.6216743Z "digest": "sha256:33444a5a7e01a3010fd1cc16b32a66892a08600d7f700747d23faf3c36624f3a" 2024-08-20T22:08:31.6217587Z }, 2024-08-20T22:08:31.6217885Z { 2024-08-20T22:08:31.6218394Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6219130Z "size": 103, 2024-08-20T22:08:31.6219773Z "digest": "sha256:7c47122f4e09b47e891b4ae9e499a35a4eb46faacae87d0e946615adda6e0706" 2024-08-20T22:08:31.6220424Z }, 2024-08-20T22:08:31.6220818Z { 2024-08-20T22:08:31.6221325Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6221935Z "size": 1473, 2024-08-20T22:08:31.6222615Z "digest": "sha256:1811ff4d3556ac255604f346d879528aff2aadd7652c2d39baf4fe6eaa60aec3" 2024-08-20T22:08:31.6223299Z }, 2024-08-20T22:08:31.6223648Z { 2024-08-20T22:08:31.6224175Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6224801Z "size": 594729516, 2024-08-20T22:08:31.6225452Z "digest": "sha256:7754ee068b33f760d9c320c26a1a3935247ace0c8c463a976105c1586a43fb1c" 2024-08-20T22:08:31.6226174Z }, 2024-08-20T22:08:31.6226474Z { 2024-08-20T22:08:31.6227004Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6227784Z "size": 164, 2024-08-20T22:08:31.6228387Z "digest": "sha256:0479fbac3361713c075bf788e778117917dcacdd1ff71ed79a789dd2016a1714" 2024-08-20T22:08:31.6229100Z }, 2024-08-20T22:08:31.6229501Z { 2024-08-20T22:08:31.6230035Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6230629Z "size": 564, 2024-08-20T22:08:31.6231304Z "digest": "sha256:f1d6874dee9c34d154278d2b6935d04447f07fa89d25d4a09398234040d8a7e8" 2024-08-20T22:08:31.6231988Z }, 2024-08-20T22:08:31.6232316Z { 2024-08-20T22:08:31.6232856Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6233616Z "size": 35874203, 2024-08-20T22:08:31.6234257Z "digest": "sha256:afc429e87b593a64f3e0a1be51e09e966ea1aa71e6e8a0bec4edc9f2f7bc1c05" 2024-08-20T22:08:31.6235019Z }, 2024-08-20T22:08:31.6235311Z { 2024-08-20T22:08:31.6235822Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6236524Z "size": 104, 2024-08-20T22:08:31.6237093Z "digest": "sha256:019620471c2592cd22437fe8ed1a94c784114cf7445c5c2ab36dd0bae727fc66" 2024-08-20T22:08:31.6237790Z }, 2024-08-20T22:08:31.6238172Z { 2024-08-20T22:08:31.6238695Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6239311Z "size": 425, 2024-08-20T22:08:31.6239989Z "digest": "sha256:27aeb1b2cd5e28d8f0e54fc1090baf88abc29ebf5fce088b493fcae99c9550d1" 2024-08-20T22:08:31.6241046Z }, 2024-08-20T22:08:31.6241472Z { 2024-08-20T22:08:31.6241955Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6242581Z "size": 20262183, 2024-08-20T22:08:31.6243283Z "digest": "sha256:829c0e19f4b7797e9120a86172fabfd710f9b3971ffd714a616931a3fadc7192" 2024-08-20T22:08:31.6243960Z }, 2024-08-20T22:08:31.6244278Z { 2024-08-20T22:08:31.6244915Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6245546Z "size": 438, 2024-08-20T22:08:31.6246157Z "digest": "sha256:560cd6122a3868e7e82e75eb103d182edf6512114d61ccdfae099af00cb16b4c" 2024-08-20T22:08:31.6246900Z }, 2024-08-20T22:08:31.6247247Z { 2024-08-20T22:08:31.6247762Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6248444Z "size": 701, 2024-08-20T22:08:31.6249141Z "digest": "sha256:1fef4bd19792cbf9d3aea12795089ad41164bb6d607c339b7484e1899825b1d2" 2024-08-20T22:08:31.6249837Z }, 2024-08-20T22:08:31.6250208Z { 2024-08-20T22:08:31.6250708Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6251335Z "size": 141, 2024-08-20T22:08:31.6252027Z "digest": "sha256:5a4eb19d72198a01f3babd4711c40fcf7c6e5cb9d5cfedc507b0061408d47097" 2024-08-20T22:08:31.6252750Z }, 2024-08-20T22:08:31.6253077Z { 2024-08-20T22:08:31.6253621Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6254415Z "size": 135, 2024-08-20T22:08:31.6255030Z "digest": "sha256:da6a838a66c72b5de9a5590c233779880ea901c1264940a1c618825d2501ffd1" 2024-08-20T22:08:31.6255792Z }, 2024-08-20T22:08:31.6256083Z { 2024-08-20T22:08:31.6256618Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6257297Z "size": 4838068375, 2024-08-20T22:08:31.6257934Z "digest": "sha256:cbb79a7053537bed2d80b77198ea552b985563b11d3f8616593c6ab575a3a090" 2024-08-20T22:08:31.6258652Z }, 2024-08-20T22:08:31.6259027Z { 2024-08-20T22:08:31.6259539Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6260148Z "size": 194, 2024-08-20T22:08:31.6260815Z "digest": "sha256:4d4fa6802ab3e6b36d8d4adb650046e9370c4a16a19876970559ef8a312ca855" 2024-08-20T22:08:31.6261504Z }, 2024-08-20T22:08:31.6261902Z { 2024-08-20T22:08:31.6262382Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6263037Z "size": 564, 2024-08-20T22:08:31.6263731Z "digest": "sha256:0f085d4fa279366fcd52d303b7ad8abddc5962a8872174b8109f3f5d5ca5f2cf" 2024-08-20T22:08:31.6264538Z }, 2024-08-20T22:08:31.6264885Z { 2024-08-20T22:08:31.6265457Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6266133Z "size": 43162921, 2024-08-20T22:08:31.6266770Z "digest": "sha256:4a0412373305517489d891a4749e6d2b80b4aeb7df3b8adca0ed0abb2f3e5300" 2024-08-20T22:08:31.6267474Z }, 2024-08-20T22:08:31.6267838Z { 2024-08-20T22:08:31.6268360Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6269041Z "size": 106, 2024-08-20T22:08:31.6269695Z "digest": "sha256:302c8c1779444e54919f83e91c6d5e1fdea653fc899be802b3a2a34d34d99d5d" 2024-08-20T22:08:31.6270388Z }, 2024-08-20T22:08:31.6270776Z { 2024-08-20T22:08:31.6271287Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6271963Z "size": 1380, 2024-08-20T22:08:31.6272653Z "digest": "sha256:02970347dff622ee45629bc28788716d00528464f71f88ec7b74ae5f44a486e2" 2024-08-20T22:08:31.6273425Z }, 2024-08-20T22:08:31.6273731Z { 2024-08-20T22:08:31.6274319Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6274959Z "size": 701, 2024-08-20T22:08:31.6275545Z "digest": "sha256:1fef4bd19792cbf9d3aea12795089ad41164bb6d607c339b7484e1899825b1d2" 2024-08-20T22:08:31.6276308Z }, 2024-08-20T22:08:31.6276646Z { 2024-08-20T22:08:31.6277164Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6277832Z "size": 139, 2024-08-20T22:08:31.6278485Z "digest": "sha256:916c5e8580164926a3aec87e88a5d1c2d02756e49fdeed4198e1e6304efa2fd3" 2024-08-20T22:08:31.6279245Z }, 2024-08-20T22:08:31.6279632Z { 2024-08-20T22:08:31.6280115Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6280770Z "size": 118, 2024-08-20T22:08:31.6281438Z "digest": "sha256:c42b3602a1fb4df5111224650f15adffb025979ae9c614807379ea84e189533b" 2024-08-20T22:08:31.6282129Z }, 2024-08-20T22:08:31.6282451Z { 2024-08-20T22:08:31.6283021Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6283658Z "size": 4324672728, 2024-08-20T22:08:31.6284303Z "digest": "sha256:11fad972ef6cb9d2dc236504b0ee5b6e5ea996e4576ece0ed3262fbb9ee2de60" 2024-08-20T22:08:31.6285074Z }, 2024-08-20T22:08:31.6285467Z { 2024-08-20T22:08:31.6286033Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6286630Z "size": 174, 2024-08-20T22:08:31.6287263Z "digest": "sha256:f957c16244819132b478272aaf24231699c4fcbd495c229a574f94daab8d6b86" 2024-08-20T22:08:31.6287992Z }, 2024-08-20T22:08:31.6288329Z { 2024-08-20T22:08:31.6288831Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6289514Z "size": 907, 2024-08-20T22:08:31.6290153Z "digest": "sha256:768c31dca016b80bbdc973c8ee818034bdbd17b7ea9bdadbf0ec45ea51005720" 2024-08-20T22:08:31.6290983Z }, 2024-08-20T22:08:31.6291334Z { 2024-08-20T22:08:31.6291899Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6292543Z "size": 701, 2024-08-20T22:08:31.6293200Z "digest": "sha256:1fef4bd19792cbf9d3aea12795089ad41164bb6d607c339b7484e1899825b1d2" 2024-08-20T22:08:31.6293923Z }, 2024-08-20T22:08:31.6294263Z { 2024-08-20T22:08:31.6294849Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6295447Z "size": 134, 2024-08-20T22:08:31.6296078Z "digest": "sha256:8c32d0ecebbe2054c96a3a5c1f3d6c8b87c2e826686b369e5242cd55d0f01c2d" 2024-08-20T22:08:31.6296862Z }, 2024-08-20T22:08:31.6297198Z { 2024-08-20T22:08:31.6297680Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6298382Z "size": 32, 2024-08-20T22:08:31.6299043Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-20T22:08:31.6299711Z }, 2024-08-20T22:08:31.6300134Z { 2024-08-20T22:08:31.6300653Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6301404Z "size": 158, 2024-08-20T22:08:31.6302050Z "digest": "sha256:78ee77eddef23f20afc78e2924f4467041cadb754634ee3df431c68211cf676d" 2024-08-20T22:08:31.6302752Z }, 2024-08-20T22:08:31.6303128Z { 2024-08-20T22:08:31.6303710Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6304314Z "size": 1841, 2024-08-20T22:08:31.6304973Z "digest": "sha256:37513e9b43d7123e7ddee09100f62a72b57af7b3833eaecd515e247e2f63e13f" 2024-08-20T22:08:31.6305766Z }, 2024-08-20T22:08:31.6306075Z { 2024-08-20T22:08:31.6306621Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6307321Z "size": 7529776, 2024-08-20T22:08:31.6307993Z "digest": "sha256:a7a5392e2bf6b73d9be292cc22a99ad4637636c15733beb7afbe6403b5ba21a8" 2024-08-20T22:08:31.6308663Z }, 2024-08-20T22:08:31.6309073Z { 2024-08-20T22:08:31.6309671Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6310364Z "size": 163, 2024-08-20T22:08:31.6310967Z "digest": "sha256:b10de02255c021b2366b85bf12ddf593aac89f88964201c455b71a145bc5ca2e" 2024-08-20T22:08:31.6311683Z }, 2024-08-20T22:08:31.6312105Z { 2024-08-20T22:08:31.6312651Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6313328Z "size": 7943, 2024-08-20T22:08:31.6314022Z "digest": "sha256:e56eeff2db93ffe5002a2bb764795b7333321c6802cc28bef0801a619fe6a07e" 2024-08-20T22:08:31.6314755Z }, 2024-08-20T22:08:31.6315061Z { 2024-08-20T22:08:31.6315630Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6316291Z "size": 8068, 2024-08-20T22:08:31.6316928Z "digest": "sha256:70ac3e38d0fd1f0f46ad710c3fc485fd01406606054e8cf84a63af1570bc9f3a" 2024-08-20T22:08:31.6317639Z }, 2024-08-20T22:08:31.6317997Z { 2024-08-20T22:08:31.6318528Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6319327Z "size": 302, 2024-08-20T22:08:31.6319909Z "digest": "sha256:eb09cbf3e4168749cc8605e3188ed35070f6037d13930e443c38d8941734488f" 2024-08-20T22:08:31.6320612Z }, 2024-08-20T22:08:31.6321038Z { 2024-08-20T22:08:31.6321521Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6322161Z "size": 7629638, 2024-08-20T22:08:31.6322873Z "digest": "sha256:ee1273153675e6543b58f5be50321abee5e91f7351701d5d501a6837eaf676ef" 2024-08-20T22:08:31.6323559Z }, 2024-08-20T22:08:31.6323860Z { 2024-08-20T22:08:31.6324447Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6325086Z "size": 108, 2024-08-20T22:08:31.6325786Z "digest": "sha256:e22979f9e0eedfa16f98eb4fa26f30a50c237f5ffd2f6e5b898f2b908058496d" 2024-08-20T22:08:31.6326505Z }, 2024-08-20T22:08:31.6326846Z { 2024-08-20T22:08:31.6327391Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6328180Z "size": 54145661, 2024-08-20T22:08:31.6328855Z "digest": "sha256:6c1f0aabce7c84f9b0b9ab3b96325778dba1c1465b7463c5b4c6be1cf52b74db" 2024-08-20T22:08:31.6329585Z }, 2024-08-20T22:08:31.6329979Z { 2024-08-20T22:08:31.6330485Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6331119Z "size": 473, 2024-08-20T22:08:31.6331790Z "digest": "sha256:7ebe49c3a23e71b289ce012b48dad35791a2f2aa7fcee2326a64d763b0d14df8" 2024-08-20T22:08:31.6332550Z }, 2024-08-20T22:08:31.6332848Z { 2024-08-20T22:08:31.6333413Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6334074Z "size": 1374858766, 2024-08-20T22:08:31.6334775Z "digest": "sha256:5d115b29b5d53e5418762bc41ae975dd245bcffc3d058b8902c58146d505cb37" 2024-08-20T22:08:31.6335433Z }, 2024-08-20T22:08:31.6335790Z { 2024-08-20T22:08:31.6336364Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6336981Z "size": 106, 2024-08-20T22:08:31.6337627Z "digest": "sha256:7f2d7a04fbe65bbe1e895138e0cfeeef53ad926c890bab8e7e132ad1e655e48f" 2024-08-20T22:08:31.6338487Z }, 2024-08-20T22:08:31.6338850Z { 2024-08-20T22:08:31.6339369Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6340079Z "size": 559, 2024-08-20T22:08:31.6340923Z "digest": "sha256:d79fd7d526989e554455eda7d459f2c88444030f61710101e52ec8c7a49b7b79" 2024-08-20T22:08:31.6341652Z }, 2024-08-20T22:08:31.6342062Z { 2024-08-20T22:08:31.6342586Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6343222Z "size": 46248488, 2024-08-20T22:08:31.6343937Z "digest": "sha256:9752d6fbbcab4e7403f26777c5b65911320de6389c81b833a47ba45c4f3354b4" 2024-08-20T22:08:31.6344786Z }, 2024-08-20T22:08:31.6345121Z { 2024-08-20T22:08:31.6345718Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6346362Z "size": 111, 2024-08-20T22:08:31.6347048Z "digest": "sha256:83808b2eff4d71ed46db7c29f66fe918f328405c25b314225dfad01b4868d1f4" 2024-08-20T22:08:31.6347794Z }, 2024-08-20T22:08:31.6348137Z { 2024-08-20T22:08:31.6348648Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6349365Z "size": 32, 2024-08-20T22:08:31.6350038Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-20T22:08:31.6350876Z }, 2024-08-20T22:08:31.6351281Z { 2024-08-20T22:08:31.6351824Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6352484Z "size": 32, 2024-08-20T22:08:31.6353307Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-20T22:08:31.6354031Z }, 2024-08-20T22:08:31.6354328Z { 2024-08-20T22:08:31.6354903Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6355557Z "size": 32, 2024-08-20T22:08:31.6356153Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-20T22:08:31.6356907Z }, 2024-08-20T22:08:31.6357273Z { 2024-08-20T22:08:31.6357814Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:31.6358515Z "size": 32, 2024-08-20T22:08:31.6359154Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-20T22:08:31.6359856Z } 2024-08-20T22:08:31.6360301Z ] 2024-08-20T22:08:31.6360598Z } 2024-08-20T22:08:31.6663527Z ##[group]Run tag=${ECR_DOCKER_IMAGE##*/} 2024-08-20T22:08:31.6664023Z tag=${ECR_DOCKER_IMAGE##*/} 2024-08-20T22:08:31.6664555Z echo "docker pull ghcr.io/pytorch/ci-image:${tag/:/-}" 2024-08-20T22:08:31.6673894Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:08:31.6674384Z env: 2024-08-20T22:08:31.6674660Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:31.6675792Z ECR_DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:31.6676944Z ##[endgroup] 2024-08-20T22:08:31.6708207Z docker pull ghcr.io/pytorch/ci-image:pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks-f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:31.6759103Z ##[group]Run pytorch/test-infra/.github/actions/pull-docker-image@main 2024-08-20T22:08:31.6759684Z with: 2024-08-20T22:08:31.6760742Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:31.6762028Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:31.6762550Z env: 2024-08-20T22:08:31.6762832Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:31.6763186Z ##[endgroup] 2024-08-20T22:08:31.6780601Z ##[group]Run set -x 2024-08-20T22:08:31.6780945Z set -x 2024-08-20T22:08:31.6781253Z set +e 2024-08-20T22:08:31.6781550Z  2024-08-20T22:08:31.6781825Z login() { 2024-08-20T22:08:31.6782474Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2024-08-20T22:08:31.6783341Z } 2024-08-20T22:08:31.6783623Z  2024-08-20T22:08:31.6783927Z retry () { 2024-08-20T22:08:31.6784321Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2024-08-20T22:08:31.6784762Z } 2024-08-20T22:08:31.6785041Z  2024-08-20T22:08:31.6785361Z retry login "${DOCKER_REGISTRY}" 2024-08-20T22:08:31.6785770Z  2024-08-20T22:08:31.6786049Z set -e 2024-08-20T22:08:31.6786521Z # ignore output since only exit code is used for conditional 2024-08-20T22:08:31.6787214Z # only pull docker image if it's not available locally 2024-08-20T22:08:31.6787967Z if ! docker inspect --type=image "${DOCKER_IMAGE}" >/dev/null 2>/dev/null; then 2024-08-20T22:08:31.6788656Z  retry docker pull "${DOCKER_IMAGE}" 2024-08-20T22:08:31.6789096Z fi 2024-08-20T22:08:31.6797279Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:08:31.6797780Z env: 2024-08-20T22:08:31.6798065Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:31.6799212Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:31.6800514Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:31.6801028Z ##[endgroup] 2024-08-20T22:08:31.6833075Z + set +e 2024-08-20T22:08:31.6833671Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:31.6834298Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:31.6837068Z + aws ecr get-login-password --region us-east-1 2024-08-20T22:08:31.6838560Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:32.2246254Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-08-20T22:08:32.2247209Z Configure a credential helper to remove this warning. See 2024-08-20T22:08:32.2248149Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-08-20T22:08:32.2248671Z 2024-08-20T22:08:32.2248819Z Login Succeeded 2024-08-20T22:08:32.2268988Z + set -e 2024-08-20T22:08:32.2270350Z + docker inspect --type=image 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:32.2433747Z + retry docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:32.2435869Z + docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:32.3776434Z f6d216893d65c7b8ae43df4daaf247db808378e9: Pulling from pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks 2024-08-20T22:08:32.3779049Z 7a2c55901189: Pulling fs layer 2024-08-20T22:08:32.3779576Z 224fe954d725: Pulling fs layer 2024-08-20T22:08:32.3780431Z 75722010b82e: Pulling fs layer 2024-08-20T22:08:32.3780959Z d527cbbb87e3: Pulling fs layer 2024-08-20T22:08:32.3781473Z b57676e46aee: Pulling fs layer 2024-08-20T22:08:32.3781969Z a8c1e85b5e14: Pulling fs layer 2024-08-20T22:08:32.3782561Z a41a8d1c11c8: Pulling fs layer 2024-08-20T22:08:32.3783039Z 0c1227890755: Pulling fs layer 2024-08-20T22:08:32.3783536Z d8d1234baab3: Pulling fs layer 2024-08-20T22:08:32.3784025Z 7ed32bc8e469: Pulling fs layer 2024-08-20T22:08:32.3784499Z ec1e7978c1fe: Pulling fs layer 2024-08-20T22:08:32.3784996Z ac23c5fcc1ef: Pulling fs layer 2024-08-20T22:08:32.3785549Z ca426ffc9d2b: Pulling fs layer 2024-08-20T22:08:32.3786030Z 4373aa743caf: Pulling fs layer 2024-08-20T22:08:32.3786506Z 75b2abb16c68: Pulling fs layer 2024-08-20T22:08:32.3786974Z ef1e3ef1e85f: Pulling fs layer 2024-08-20T22:08:32.3787457Z 0bf61114d37b: Pulling fs layer 2024-08-20T22:08:32.3788162Z 2df849f72ba4: Pulling fs layer 2024-08-20T22:08:32.3788685Z 34c47d63c5de: Pulling fs layer 2024-08-20T22:08:32.3789176Z 1fef4bd19792: Pulling fs layer 2024-08-20T22:08:32.3789668Z 6efb96fc87ea: Pulling fs layer 2024-08-20T22:08:32.3790152Z b119c4fc6c58: Pulling fs layer 2024-08-20T22:08:32.3790634Z 33b639226eee: Pulling fs layer 2024-08-20T22:08:32.3791214Z d3547bd43146: Pulling fs layer 2024-08-20T22:08:32.3791689Z 5645520256fa: Pulling fs layer 2024-08-20T22:08:32.3792170Z 829ed7d91e38: Pulling fs layer 2024-08-20T22:08:32.3792634Z 385d0421d67c: Pulling fs layer 2024-08-20T22:08:32.3793014Z 7cbfce999d76: Pulling fs layer 2024-08-20T22:08:32.3793492Z 6658e558ebe4: Pulling fs layer 2024-08-20T22:08:32.3793868Z 33444a5a7e01: Pulling fs layer 2024-08-20T22:08:32.3794237Z 7c47122f4e09: Pulling fs layer 2024-08-20T22:08:32.3794952Z 1811ff4d3556: Pulling fs layer 2024-08-20T22:08:32.3795341Z 7754ee068b33: Pulling fs layer 2024-08-20T22:08:32.3795719Z 0479fbac3361: Pulling fs layer 2024-08-20T22:08:32.3796101Z f1d6874dee9c: Pulling fs layer 2024-08-20T22:08:32.3796484Z afc429e87b59: Pulling fs layer 2024-08-20T22:08:32.3796868Z 019620471c25: Pulling fs layer 2024-08-20T22:08:32.3797238Z 27aeb1b2cd5e: Pulling fs layer 2024-08-20T22:08:32.3797626Z 829c0e19f4b7: Pulling fs layer 2024-08-20T22:08:32.3798002Z 560cd6122a38: Pulling fs layer 2024-08-20T22:08:32.3798368Z ac23c5fcc1ef: Waiting 2024-08-20T22:08:32.3798705Z 5a4eb19d7219: Pulling fs layer 2024-08-20T22:08:32.3799082Z da6a838a66c7: Pulling fs layer 2024-08-20T22:08:32.3799459Z cbb79a705353: Pulling fs layer 2024-08-20T22:08:32.3799819Z 0c1227890755: Waiting 2024-08-20T22:08:32.3800151Z 4d4fa6802ab3: Pulling fs layer 2024-08-20T22:08:32.3800527Z 0f085d4fa279: Pulling fs layer 2024-08-20T22:08:32.3800900Z 4a0412373305: Pulling fs layer 2024-08-20T22:08:32.3801253Z ec1e7978c1fe: Waiting 2024-08-20T22:08:32.3801592Z 302c8c177944: Pulling fs layer 2024-08-20T22:08:32.3801966Z 02970347dff6: Pulling fs layer 2024-08-20T22:08:32.3802329Z ca426ffc9d2b: Waiting 2024-08-20T22:08:32.3802666Z 916c5e858016: Pulling fs layer 2024-08-20T22:08:32.3803038Z c42b3602a1fb: Pulling fs layer 2024-08-20T22:08:32.3803421Z 11fad972ef6c: Pulling fs layer 2024-08-20T22:08:32.3803778Z a41a8d1c11c8: Waiting 2024-08-20T22:08:32.3804112Z f957c1624481: Pulling fs layer 2024-08-20T22:08:32.3804539Z 4373aa743caf: Waiting 2024-08-20T22:08:32.3804877Z 768c31dca016: Pulling fs layer 2024-08-20T22:08:32.3805239Z 7ed32bc8e469: Waiting 2024-08-20T22:08:32.3805564Z 75b2abb16c68: Waiting 2024-08-20T22:08:32.3805940Z a8c1e85b5e14: Waiting 2024-08-20T22:08:32.3806262Z b57676e46aee: Waiting 2024-08-20T22:08:32.3806707Z 8c32d0ecebbe: Pulling fs layer 2024-08-20T22:08:32.3807092Z 4f4fb700ef54: Pulling fs layer 2024-08-20T22:08:32.3807476Z 78ee77eddef2: Pulling fs layer 2024-08-20T22:08:32.3807846Z 37513e9b43d7: Pulling fs layer 2024-08-20T22:08:32.3808210Z d527cbbb87e3: Waiting 2024-08-20T22:08:32.3808548Z a7a5392e2bf6: Pulling fs layer 2024-08-20T22:08:32.3808927Z b10de02255c0: Pulling fs layer 2024-08-20T22:08:32.3809288Z 33444a5a7e01: Waiting 2024-08-20T22:08:32.3809605Z 1811ff4d3556: Waiting 2024-08-20T22:08:32.3810088Z e56eeff2db93: Pulling fs layer 2024-08-20T22:08:32.3810788Z 7754ee068b33: Waiting 2024-08-20T22:08:32.3811100Z 0479fbac3361: Waiting 2024-08-20T22:08:32.3811436Z 70ac3e38d0fd: Pulling fs layer 2024-08-20T22:08:32.3811809Z 7cbfce999d76: Waiting 2024-08-20T22:08:32.3812146Z eb09cbf3e416: Pulling fs layer 2024-08-20T22:08:32.3812519Z ef1e3ef1e85f: Waiting 2024-08-20T22:08:32.3812883Z f1d6874dee9c: Waiting 2024-08-20T22:08:32.3813221Z ee1273153675: Pulling fs layer 2024-08-20T22:08:32.3813593Z e22979f9e0ee: Pulling fs layer 2024-08-20T22:08:32.3813980Z 6c1f0aabce7c: Pulling fs layer 2024-08-20T22:08:32.3814361Z 7ebe49c3a23e: Pulling fs layer 2024-08-20T22:08:32.3814743Z 5d115b29b5d5: Pulling fs layer 2024-08-20T22:08:32.3815114Z 7f2d7a04fbe6: Pulling fs layer 2024-08-20T22:08:32.3815499Z d79fd7d52698: Pulling fs layer 2024-08-20T22:08:32.3815881Z 9752d6fbbcab: Pulling fs layer 2024-08-20T22:08:32.3816467Z 83808b2eff4d: Pulling fs layer 2024-08-20T22:08:32.3816869Z d3547bd43146: Waiting 2024-08-20T22:08:32.3817201Z 829ed7d91e38: Waiting 2024-08-20T22:08:32.3817567Z 5645520256fa: Waiting 2024-08-20T22:08:32.3817878Z 4f4fb700ef54: Waiting 2024-08-20T22:08:32.3818202Z afc429e87b59: Waiting 2024-08-20T22:08:32.3818525Z 78ee77eddef2: Waiting 2024-08-20T22:08:32.3818849Z 37513e9b43d7: Waiting 2024-08-20T22:08:32.3819165Z 1fef4bd19792: Waiting 2024-08-20T22:08:32.3819485Z a7a5392e2bf6: Waiting 2024-08-20T22:08:32.3819809Z 7f2d7a04fbe6: Waiting 2024-08-20T22:08:32.3820133Z 34c47d63c5de: Waiting 2024-08-20T22:08:32.3820447Z 2df849f72ba4: Waiting 2024-08-20T22:08:32.3820767Z 6efb96fc87ea: Waiting 2024-08-20T22:08:32.3821284Z b10de02255c0: Waiting 2024-08-20T22:08:32.3821600Z 33b639226eee: Waiting 2024-08-20T22:08:32.3821919Z e22979f9e0ee: Waiting 2024-08-20T22:08:32.3822296Z b119c4fc6c58: Waiting 2024-08-20T22:08:32.3822721Z 385d0421d67c: Waiting 2024-08-20T22:08:32.3823121Z ee1273153675: Waiting 2024-08-20T22:08:32.3823546Z 9752d6fbbcab: Waiting 2024-08-20T22:08:32.3823980Z 70ac3e38d0fd: Waiting 2024-08-20T22:08:32.3824552Z 302c8c177944: Waiting 2024-08-20T22:08:32.3824970Z 83808b2eff4d: Waiting 2024-08-20T22:08:32.3825391Z 02970347dff6: Waiting 2024-08-20T22:08:32.3825816Z 27aeb1b2cd5e: Waiting 2024-08-20T22:08:32.3826240Z 7ebe49c3a23e: Waiting 2024-08-20T22:08:32.3826671Z d8d1234baab3: Waiting 2024-08-20T22:08:32.3827220Z 5d115b29b5d5: Waiting 2024-08-20T22:08:32.3827870Z c42b3602a1fb: Waiting 2024-08-20T22:08:32.3828304Z 560cd6122a38: Waiting 2024-08-20T22:08:32.3828729Z da6a838a66c7: Waiting 2024-08-20T22:08:32.3829164Z 768c31dca016: Waiting 2024-08-20T22:08:32.3829602Z 8c32d0ecebbe: Waiting 2024-08-20T22:08:32.3830126Z 916c5e858016: Waiting 2024-08-20T22:08:32.3830562Z 4d4fa6802ab3: Waiting 2024-08-20T22:08:32.3830999Z cbb79a705353: Waiting 2024-08-20T22:08:32.3831573Z 11fad972ef6c: Waiting 2024-08-20T22:08:32.3832075Z 4a0412373305: Waiting 2024-08-20T22:08:32.3832513Z 0f085d4fa279: Waiting 2024-08-20T22:08:32.3832967Z eb09cbf3e416: Waiting 2024-08-20T22:08:32.3833625Z 5a4eb19d7219: Waiting 2024-08-20T22:08:32.3834076Z f957c1624481: Waiting 2024-08-20T22:08:32.3834510Z 829c0e19f4b7: Waiting 2024-08-20T22:08:32.5130891Z 224fe954d725: Verifying Checksum 2024-08-20T22:08:32.5131455Z 224fe954d725: Download complete 2024-08-20T22:08:32.5996904Z d527cbbb87e3: Download complete 2024-08-20T22:08:32.6713236Z b57676e46aee: Download complete 2024-08-20T22:08:32.7155114Z 7a2c55901189: Verifying Checksum 2024-08-20T22:08:32.7155663Z 7a2c55901189: Download complete 2024-08-20T22:08:32.7939931Z a41a8d1c11c8: Download complete 2024-08-20T22:08:32.8632813Z 0c1227890755: Verifying Checksum 2024-08-20T22:08:32.8633536Z 0c1227890755: Download complete 2024-08-20T22:08:32.9224322Z d8d1234baab3: Download complete 2024-08-20T22:08:32.9951180Z 75722010b82e: Verifying Checksum 2024-08-20T22:08:32.9951769Z 75722010b82e: Download complete 2024-08-20T22:08:33.0624683Z ec1e7978c1fe: Download complete 2024-08-20T22:08:33.1454943Z ac23c5fcc1ef: Verifying Checksum 2024-08-20T22:08:33.1455541Z ac23c5fcc1ef: Download complete 2024-08-20T22:08:33.8849740Z 7a2c55901189: Pull complete 2024-08-20T22:08:34.1967985Z 224fe954d725: Pull complete 2024-08-20T22:08:35.1162535Z 75722010b82e: Pull complete 2024-08-20T22:08:35.1333112Z d527cbbb87e3: Pull complete 2024-08-20T22:08:35.1514419Z b57676e46aee: Pull complete 2024-08-20T22:08:35.6639179Z ca426ffc9d2b: Verifying Checksum 2024-08-20T22:08:35.6639753Z ca426ffc9d2b: Download complete 2024-08-20T22:08:35.7338862Z 4373aa743caf: Verifying Checksum 2024-08-20T22:08:35.7339351Z 4373aa743caf: Download complete 2024-08-20T22:08:35.8354056Z 75b2abb16c68: Download complete 2024-08-20T22:08:35.9224400Z ef1e3ef1e85f: Verifying Checksum 2024-08-20T22:08:35.9224852Z ef1e3ef1e85f: Download complete 2024-08-20T22:08:36.8860644Z 0bf61114d37b: Verifying Checksum 2024-08-20T22:08:36.8861177Z 0bf61114d37b: Download complete 2024-08-20T22:08:36.9569850Z 2df849f72ba4: Download complete 2024-08-20T22:08:37.0213310Z 34c47d63c5de: Verifying Checksum 2024-08-20T22:08:37.0213736Z 34c47d63c5de: Download complete 2024-08-20T22:08:37.0965723Z 1fef4bd19792: Verifying Checksum 2024-08-20T22:08:37.0966223Z 1fef4bd19792: Download complete 2024-08-20T22:08:46.0027767Z a8c1e85b5e14: Verifying Checksum 2024-08-20T22:08:46.0028349Z a8c1e85b5e14: Download complete 2024-08-20T22:08:46.1075976Z b119c4fc6c58: Verifying Checksum 2024-08-20T22:08:46.1076635Z b119c4fc6c58: Download complete 2024-08-20T22:08:46.1878436Z 33b639226eee: Download complete 2024-08-20T22:08:46.2705864Z d3547bd43146: Verifying Checksum 2024-08-20T22:08:46.2706505Z d3547bd43146: Download complete 2024-08-20T22:08:46.3414951Z 5645520256fa: Verifying Checksum 2024-08-20T22:08:46.3415416Z 5645520256fa: Download complete 2024-08-20T22:08:46.4174456Z 829ed7d91e38: Verifying Checksum 2024-08-20T22:08:46.4174991Z 829ed7d91e38: Download complete 2024-08-20T22:08:47.6860494Z 385d0421d67c: Verifying Checksum 2024-08-20T22:08:47.6860996Z 385d0421d67c: Download complete 2024-08-20T22:08:47.7521970Z 7cbfce999d76: Verifying Checksum 2024-08-20T22:08:47.7522563Z 7cbfce999d76: Download complete 2024-08-20T22:08:47.8221667Z 6658e558ebe4: Verifying Checksum 2024-08-20T22:08:47.8222270Z 6658e558ebe4: Download complete 2024-08-20T22:08:47.8949584Z 33444a5a7e01: Verifying Checksum 2024-08-20T22:08:47.9810808Z 7c47122f4e09: Verifying Checksum 2024-08-20T22:08:47.9811408Z 7c47122f4e09: Download complete 2024-08-20T22:08:48.0412822Z 1811ff4d3556: Download complete 2024-08-20T22:08:54.0488560Z 7754ee068b33: Verifying Checksum 2024-08-20T22:08:54.0489078Z 7754ee068b33: Download complete 2024-08-20T22:08:54.1193668Z 0479fbac3361: Verifying Checksum 2024-08-20T22:08:54.1194224Z 0479fbac3361: Download complete 2024-08-20T22:08:54.2089375Z f1d6874dee9c: Verifying Checksum 2024-08-20T22:08:54.2090007Z f1d6874dee9c: Download complete 2024-08-20T22:08:54.6263394Z afc429e87b59: Verifying Checksum 2024-08-20T22:08:54.6263881Z afc429e87b59: Download complete 2024-08-20T22:08:54.6924621Z 019620471c25: Download complete 2024-08-20T22:08:54.7670418Z 27aeb1b2cd5e: Verifying Checksum 2024-08-20T22:08:54.7671026Z 27aeb1b2cd5e: Download complete 2024-08-20T22:08:55.0222433Z 829c0e19f4b7: Verifying Checksum 2024-08-20T22:08:55.0223057Z 829c0e19f4b7: Download complete 2024-08-20T22:08:55.1013209Z 560cd6122a38: Verifying Checksum 2024-08-20T22:08:55.1013795Z 560cd6122a38: Download complete 2024-08-20T22:08:55.1801848Z 5a4eb19d7219: Download complete 2024-08-20T22:08:55.2926777Z da6a838a66c7: Verifying Checksum 2024-08-20T22:08:55.2927397Z da6a838a66c7: Download complete 2024-08-20T22:08:58.2661034Z 7ed32bc8e469: Download complete 2024-08-20T22:08:58.3423312Z 4d4fa6802ab3: Verifying Checksum 2024-08-20T22:08:58.3424392Z 4d4fa6802ab3: Download complete 2024-08-20T22:08:58.4258104Z 0f085d4fa279: Verifying Checksum 2024-08-20T22:08:58.4258712Z 0f085d4fa279: Download complete 2024-08-20T22:08:58.9160610Z 4a0412373305: Verifying Checksum 2024-08-20T22:08:58.9161130Z 4a0412373305: Download complete 2024-08-20T22:08:58.9905908Z 302c8c177944: Verifying Checksum 2024-08-20T22:08:58.9906401Z 302c8c177944: Download complete 2024-08-20T22:08:59.0727363Z 02970347dff6: Download complete 2024-08-20T22:08:59.1453206Z 916c5e858016: Download complete 2024-08-20T22:08:59.2120711Z c42b3602a1fb: Download complete 2024-08-20T22:08:59.2998269Z a8c1e85b5e14: Pull complete 2024-08-20T22:08:59.4258152Z a41a8d1c11c8: Pull complete 2024-08-20T22:08:59.4963855Z 0c1227890755: Pull complete 2024-08-20T22:08:59.5865265Z d8d1234baab3: Pull complete 2024-08-20T22:09:05.7979601Z 6efb96fc87ea: Verifying Checksum 2024-08-20T22:09:05.7980077Z 6efb96fc87ea: Download complete 2024-08-20T22:09:05.8747044Z f957c1624481: Verifying Checksum 2024-08-20T22:09:05.8747510Z f957c1624481: Download complete 2024-08-20T22:09:05.9665160Z 768c31dca016: Verifying Checksum 2024-08-20T22:09:05.9665615Z 768c31dca016: Download complete 2024-08-20T22:09:06.0395228Z 8c32d0ecebbe: Verifying Checksum 2024-08-20T22:09:06.0395868Z 8c32d0ecebbe: Download complete 2024-08-20T22:09:06.0501615Z 4f4fb700ef54: Verifying Checksum 2024-08-20T22:09:06.0502201Z 4f4fb700ef54: Download complete 2024-08-20T22:09:06.1204198Z 78ee77eddef2: Verifying Checksum 2024-08-20T22:09:06.1204766Z 78ee77eddef2: Download complete 2024-08-20T22:09:06.1825538Z 37513e9b43d7: Download complete 2024-08-20T22:09:06.3159534Z a7a5392e2bf6: Verifying Checksum 2024-08-20T22:09:06.3160002Z a7a5392e2bf6: Download complete 2024-08-20T22:09:06.3949573Z b10de02255c0: Download complete 2024-08-20T22:09:06.4645028Z e56eeff2db93: Download complete 2024-08-20T22:09:06.5406402Z 70ac3e38d0fd: Verifying Checksum 2024-08-20T22:09:06.5406875Z 70ac3e38d0fd: Download complete 2024-08-20T22:09:06.6197870Z eb09cbf3e416: Download complete 2024-08-20T22:09:06.7512350Z ee1273153675: Verifying Checksum 2024-08-20T22:09:06.7512817Z ee1273153675: Download complete 2024-08-20T22:09:06.8214480Z e22979f9e0ee: Verifying Checksum 2024-08-20T22:09:06.8214952Z e22979f9e0ee: Download complete 2024-08-20T22:09:07.4230280Z 6c1f0aabce7c: Verifying Checksum 2024-08-20T22:09:07.4230776Z 6c1f0aabce7c: Download complete 2024-08-20T22:09:07.4992129Z 7ebe49c3a23e: Download complete 2024-08-20T22:09:35.0852690Z 5d115b29b5d5: Verifying Checksum 2024-08-20T22:09:35.0855106Z 5d115b29b5d5: Download complete 2024-08-20T22:09:35.1614999Z 7f2d7a04fbe6: Download complete 2024-08-20T22:09:35.2386809Z d79fd7d52698: Verifying Checksum 2024-08-20T22:09:35.2387417Z d79fd7d52698: Download complete 2024-08-20T22:09:36.5497778Z 9752d6fbbcab: Verifying Checksum 2024-08-20T22:09:36.5498234Z 9752d6fbbcab: Download complete 2024-08-20T22:09:36.6282229Z 83808b2eff4d: Verifying Checksum 2024-08-20T22:09:36.6282711Z 83808b2eff4d: Download complete 2024-08-20T22:10:14.5510870Z cbb79a705353: Verifying Checksum 2024-08-20T22:10:14.5511451Z cbb79a705353: Download complete 2024-08-20T22:10:15.1864185Z 11fad972ef6c: Verifying Checksum 2024-08-20T22:10:15.1864780Z 11fad972ef6c: Download complete 2024-08-20T22:10:30.4952268Z 7ed32bc8e469: Pull complete 2024-08-20T22:10:30.7255304Z ec1e7978c1fe: Pull complete 2024-08-20T22:10:30.9391484Z ac23c5fcc1ef: Pull complete 2024-08-20T22:10:39.4640056Z ca426ffc9d2b: Pull complete 2024-08-20T22:10:39.7041144Z 4373aa743caf: Pull complete 2024-08-20T22:10:39.9291689Z 75b2abb16c68: Pull complete 2024-08-20T22:10:40.1527710Z ef1e3ef1e85f: Pull complete 2024-08-20T22:10:42.7559432Z 0bf61114d37b: Pull complete 2024-08-20T22:10:42.8981294Z 2df849f72ba4: Pull complete 2024-08-20T22:10:43.0693528Z 34c47d63c5de: Pull complete 2024-08-20T22:10:43.3026870Z 1fef4bd19792: Pull complete 2024-08-20T22:11:41.3994037Z 6efb96fc87ea: Pull complete 2024-08-20T22:11:41.5513368Z b119c4fc6c58: Pull complete 2024-08-20T22:11:41.7320142Z 33b639226eee: Pull complete 2024-08-20T22:11:41.8867098Z d3547bd43146: Pull complete 2024-08-20T22:11:42.0407527Z 5645520256fa: Pull complete 2024-08-20T22:11:42.1701595Z 829ed7d91e38: Pull complete 2024-08-20T22:11:45.6702831Z 385d0421d67c: Pull complete 2024-08-20T22:11:45.8990393Z 7cbfce999d76: Pull complete 2024-08-20T22:11:46.1321353Z 6658e558ebe4: Pull complete 2024-08-20T22:11:46.3441903Z 33444a5a7e01: Pull complete 2024-08-20T22:11:46.5108182Z 7c47122f4e09: Pull complete 2024-08-20T22:11:46.7087580Z 1811ff4d3556: Pull complete 2024-08-20T22:11:57.4862955Z 7754ee068b33: Pull complete 2024-08-20T22:11:57.6302207Z 0479fbac3361: Pull complete 2024-08-20T22:11:57.7181519Z f1d6874dee9c: Pull complete 2024-08-20T22:11:58.6918668Z afc429e87b59: Pull complete 2024-08-20T22:11:58.8856167Z 019620471c25: Pull complete 2024-08-20T22:11:59.1066988Z 27aeb1b2cd5e: Pull complete 2024-08-20T22:11:59.5874350Z 829c0e19f4b7: Pull complete 2024-08-20T22:11:59.7839571Z 560cd6122a38: Pull complete 2024-08-20T22:12:00.1323728Z 5a4eb19d7219: Pull complete 2024-08-20T22:12:00.3178585Z da6a838a66c7: Pull complete 2024-08-20T22:12:39.0144506Z cbb79a705353: Pull complete 2024-08-20T22:12:39.2256211Z 4d4fa6802ab3: Pull complete 2024-08-20T22:12:39.4398178Z 0f085d4fa279: Pull complete 2024-08-20T22:12:41.8849040Z 4a0412373305: Pull complete 2024-08-20T22:12:41.9083783Z 302c8c177944: Pull complete 2024-08-20T22:12:41.9312338Z 02970347dff6: Pull complete 2024-08-20T22:12:41.9716164Z 916c5e858016: Pull complete 2024-08-20T22:12:42.0005211Z c42b3602a1fb: Pull complete 2024-08-20T22:14:03.9414407Z 11fad972ef6c: Pull complete 2024-08-20T22:14:04.1631145Z f957c1624481: Pull complete 2024-08-20T22:14:04.3921930Z 768c31dca016: Pull complete 2024-08-20T22:14:04.7134280Z 8c32d0ecebbe: Pull complete 2024-08-20T22:14:04.9071726Z 4f4fb700ef54: Pull complete 2024-08-20T22:14:05.1329877Z 78ee77eddef2: Pull complete 2024-08-20T22:14:05.3496625Z 37513e9b43d7: Pull complete 2024-08-20T22:14:05.7404510Z a7a5392e2bf6: Pull complete 2024-08-20T22:14:05.9590667Z b10de02255c0: Pull complete 2024-08-20T22:14:06.1831096Z e56eeff2db93: Pull complete 2024-08-20T22:14:06.4158526Z 70ac3e38d0fd: Pull complete 2024-08-20T22:14:06.6457852Z eb09cbf3e416: Pull complete 2024-08-20T22:14:08.0859460Z ee1273153675: Pull complete 2024-08-20T22:14:08.3089490Z e22979f9e0ee: Pull complete 2024-08-20T22:14:10.4983740Z 6c1f0aabce7c: Pull complete 2024-08-20T22:14:10.7245005Z 7ebe49c3a23e: Pull complete 2024-08-20T22:14:24.0193654Z 5d115b29b5d5: Pull complete 2024-08-20T22:14:24.2193532Z 7f2d7a04fbe6: Pull complete 2024-08-20T22:14:24.4222811Z d79fd7d52698: Pull complete 2024-08-20T22:14:25.2812443Z 9752d6fbbcab: Pull complete 2024-08-20T22:14:25.4801693Z 83808b2eff4d: Pull complete 2024-08-20T22:14:26.3939821Z Digest: sha256:3a95d3a177465127ef6cd3b50787d6a050367070fd9063dbb688fad07a96b402 2024-08-20T22:14:26.4411508Z Status: Downloaded newer image for 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:14:26.4696953Z 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:14:26.4797340Z ##[group]Run echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> "$GITHUB_OUTPUT" 2024-08-20T22:14:26.4798253Z echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> "$GITHUB_OUTPUT" 2024-08-20T22:14:26.4809913Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:14:26.4810396Z env: 2024-08-20T22:14:26.4810671Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:14:26.4811011Z ##[endgroup] 2024-08-20T22:14:26.5025562Z ##[group]Run pytorch/test-infra/.github/actions/setup-nvidia@main 2024-08-20T22:14:26.5026104Z with: 2024-08-20T22:14:26.5026386Z driver-version: 550.54.15 2024-08-20T22:14:26.5026718Z env: 2024-08-20T22:14:26.5026987Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:14:26.5027328Z ##[endgroup] 2024-08-20T22:14:26.5088016Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2024-08-20T22:14:26.5088573Z with: 2024-08-20T22:14:26.5088858Z timeout_minutes: 10 2024-08-20T22:14:26.5089180Z max_attempts: 3 2024-08-20T22:14:26.5121144Z command: # Is it disgusting to have a full shell script here in this github action? Sure # But is it the best way to make it so that this action relies on nothing else? Absolutely set -eou pipefail DISTRIBUTION=$(. /etc/os-release;echo $ID$VERSION_ID) DRIVER_FN="NVIDIA-Linux-x86_64-${DRIVER_VERSION}.run" install_nvidia_docker2_amzn2() { ( set -x # Needed for yum-config-manager sudo yum install -y yum-utils if [[ "${DISTRIBUTION}" == "amzn2023" ]] ; then YUM_REPO_URL="https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo" else # Amazon Linux 2 YUM_REPO_URL="https://nvidia.github.io/nvidia-docker/${DISTRIBUTION}/nvidia-docker.repo" fi sudo yum-config-manager --add-repo "${YUM_REPO_URL}" sudo yum install -y nvidia-docker2 sudo systemctl restart docker ) } install_nvidia_docker2_ubuntu20() { ( set -x # Install nvidia-driver package if not installed status="$(dpkg-query -W --showformat='${db:Status-Status}' nvidia-docker2 2>&1)" if [ ! $? = 0 ] || [ ! "$status" = installed ]; then sudo apt-get install -y nvidia-docker2 sudo systemctl restart docker fi ) } pre_install_nvidia_driver_amzn2() { ( # Purge any nvidia driver installed from RHEL repo sudo yum remove -y nvidia-driver-latest-dkms ) } install_nvidia_driver_common() { ( # Try to gather more information about the runner and its existing NVIDIA driver if any echo "Before installing NVIDIA driver" lspci lsmod modinfo nvidia || true HAS_NVIDIA_DRIVER=0 # Check if NVIDIA driver has already been installed if [ -x "$(command -v nvidia-smi)" ]; then set +e # The driver exists, check its version next. Also check only the first GPU if there are more than one of them # so that the same driver version is not print over multiple lines INSTALLED_DRIVER_VERSION=$(nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0) NVIDIA_SMI_STATUS=$? if [ "$NVIDIA_SMI_STATUS" -ne 0 ] && [ "$NVIDIA_SMI_STATUS" -ne 14 ]; then echo "Failed to get NVIDIA driver version ($INSTALLED_DRIVER_VERSION). Continuing" elif [ "$INSTALLED_DRIVER_VERSION" != "$DRIVER_VERSION" ]; then echo "NVIDIA driver ($INSTALLED_DRIVER_VERSION) has been installed, but we expect to have $DRIVER_VERSION instead. Continuing" else HAS_NVIDIA_DRIVER=1 echo "NVIDIA driver ($INSTALLED_DRIVER_VERSION) has already been installed. Skipping NVIDIA driver installation" fi set -e fi if [ "$HAS_NVIDIA_DRIVER" -eq 0 ]; then # CAUTION: this may need to be updated in future if [ "${DISTRIBUTION}" != ubuntu20.04 ]; then sudo yum groupinstall -y "Development Tools" # ensure our kernel install is the same as our underlying kernel, # groupinstall "Development Tools" has a habit of mismatching kernel headers sudo yum install -y "kernel-devel-uname-r == $(uname -r)" sudo modprobe backlight fi sudo curl -fsL -o /tmp/nvidia_driver "https://s3.amazonaws.com/ossci-linux/nvidia_driver/$DRIVER_FN" set +e sudo /bin/bash /tmp/nvidia_driver -s --no-drm NVIDIA_INSTALLATION_STATUS=$? RESET_GPU=0 if [ "$NVIDIA_INSTALLATION_STATUS" -ne 0 ]; then sudo cat /var/log/nvidia-installer.log # Fail to install NVIDIA driver, try to reset the GPU RESET_GPU=1 elif [ -x "$(command -v nvidia-smi)" ]; then # Check again if nvidia-smi works even if the driver installation completes successfully INSTALLED_DRIVER_VERSION=$(nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0) NVIDIA_SMI_STATUS=$? if [ "$NVIDIA_SMI_STATUS" -ne 0 ] && [ "$NVIDIA_SMI_STATUS" -ne 14 ]; then RESET_GPU=1 fi fi if [ "$RESET_GPU" -eq 1 ]; then NVIDIA_DEVICES=$(lspci -D | grep -i NVIDIA | cut -d' ' -f1) # The GPU can get stuck in a failure state if somehow the test crashs the GPU microcode. When this # happens, we'll try to reset all NVIDIA devices https://github.com/pytorch/pytorch/issues/88388 for PCI_ID in $NVIDIA_DEVICES; do DEVICE_ENABLED=$(cat /sys/bus/pci/devices/$PCI_ID/enable) echo "Reseting $PCI_ID (enabled state: $DEVICE_ENABLED)" # This requires sudo permission of course echo "1" | sudo tee /sys/bus/pci/devices/$PCI_ID/reset sleep 1 done fi sudo rm -fv /tmp/nvidia_driver set -e fi ) } post_install_nvidia_driver_common() { ( sudo modprobe nvidia || true echo "After installing NVIDIA driver" lspci lsmod modinfo nvidia || true ( set +e nvidia-smi # NB: Annoyingly, nvidia-smi command returns successfully with return code 0 even in # the case where the driver has already crashed as it still can get the driver version # and some basic information like the bus ID. However, the rest of the information # would be missing (ERR!), for example: # # +-----------------------------------------------------------------------------+ # | NVIDIA-SMI 525.89.02 Driver Version: 525.89.02 CUDA Version: 12.0 | # |-------------------------------+----------------------+----------------------+ # | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | # | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | # | | | MIG M. | # |===============================+======================+======================| # | 0 ERR! Off | 00000000:00:1E.0 Off | ERR! | # |ERR! ERR! ERR! ERR! / ERR! | 4184MiB / 23028MiB | ERR! Default | # | | | ERR! | # +-------------------------------+----------------------+----------------------+ # # +-----------------------------------------------------------------------------+ # | Processes: | # | GPU GI CI PID Type Process name GPU Memory | # | ID ID Usage | # |=============================================================================| # +-----------------------------------------------------------------------------+ # # This should be reported as a failure instead as it will guarantee to fail when # Docker tries to run with --gpus all # # So, the correct check here is to query one of the missing piece of info like # GPU name, so that the command can fail accordingly nvidia-smi --query-gpu=gpu_name --format=csv,noheader --id=0 NVIDIA_SMI_STATUS=$? # Allowable exit statuses for nvidia-smi, see: https://github.com/NVIDIA/gpu-operator/issues/285 if [ "$NVIDIA_SMI_STATUS" -eq 0 ] || [ "$NVIDIA_SMI_STATUS" -eq 14 ]; then echo "INFO: Ignoring allowed status ${NVIDIA_SMI_STATUS}" else echo "ERROR: nvidia-smi exited with unresolved status ${NVIDIA_SMI_STATUS}" exit ${NVIDIA_SMI_STATUS} fi set -e ) ) } install_nvidia_driver_amzn2() { ( set -x pre_install_nvidia_driver_amzn2 install_nvidia_driver_common post_install_nvidia_driver_common ) } install_nvidia_driver_ubuntu20() { ( set -x install_nvidia_driver_common post_install_nvidia_driver_common ) } echo "== Installing nvidia driver ${DRIVER_FN} ==" case "${DISTRIBUTION}" in amzn*) install_nvidia_driver_amzn2 ;; ubuntu20.04) install_nvidia_driver_ubuntu20 ;; *) echo "ERROR: Unknown distribution ${DISTRIBUTION}" exit 1 ;; esac # Install container toolkit based on distribution echo "== Installing nvidia container toolkit for ${DISTRIBUTION} ==" case "${DISTRIBUTION}" in amzn*) install_nvidia_docker2_amzn2 ;; ubuntu20.04) install_nvidia_docker2_ubuntu20 ;; *) echo "ERROR: Unknown distribution ${DISTRIBUTION}" exit 1 ;; esac echo "GPU_FLAG=--gpus all -e NVIDIA_DRIVER_CAPABILITIES=all" >> "${GITHUB_ENV}" # Fix https://github.com/NVIDIA/nvidia-docker/issues/1648 on runners with # more than one GPUs. This just needs to be run once. The command fails # on subsequent runs and complains that the mode is already on, but that's # ok sudo nvidia-persistenced || true # This should show persistence mode ON nvidia-smi 2024-08-20T22:14:26.5153982Z retry_wait_seconds: 10 2024-08-20T22:14:26.5154347Z polling_interval_seconds: 1 2024-08-20T22:14:26.5154715Z warning_on_retry: true 2024-08-20T22:14:26.5155064Z continue_on_error: false 2024-08-20T22:14:26.5155395Z env: 2024-08-20T22:14:26.5155670Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:14:26.5156031Z DRIVER_VERSION: 550.54.15 2024-08-20T22:14:26.5156373Z ##[endgroup] 2024-08-20T22:14:26.7627517Z == Installing nvidia driver NVIDIA-Linux-x86_64-550.54.15.run == 2024-08-20T22:14:26.7628120Z + pre_install_nvidia_driver_amzn2 2024-08-20T22:14:26.7628643Z + sudo yum remove -y nvidia-driver-latest-dkms 2024-08-20T22:14:27.6687548Z No match for argument: nvidia-driver-latest-dkms 2024-08-20T22:14:27.6688135Z No packages marked for removal. 2024-08-20T22:14:27.6752491Z Dependencies resolved. 2024-08-20T22:14:27.6763768Z Nothing to do. 2024-08-20T22:14:27.6764571Z Complete! 2024-08-20T22:14:27.7537080Z + install_nvidia_driver_common 2024-08-20T22:14:27.7543162Z + echo 'Before installing NVIDIA driver' 2024-08-20T22:14:27.7543596Z + lspci 2024-08-20T22:14:27.7543907Z Before installing NVIDIA driver 2024-08-20T22:14:27.7653635Z 00:00.0 Host bridge: Intel Corporation 440FX - 82441FX PMC [Natoma] 2024-08-20T22:14:27.7654394Z 00:01.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II] 2024-08-20T22:14:27.7655319Z 00:01.3 Non-VGA unclassified device: Intel Corporation 82371AB/EB/MB PIIX4 ACPI (rev 08) 2024-08-20T22:14:27.7656252Z 00:03.0 VGA compatible controller: Amazon.com, Inc. Device 1111 2024-08-20T22:14:27.7657291Z 00:04.0 Non-Volatile memory controller: Amazon.com, Inc. NVMe EBS Controller 2024-08-20T22:14:27.7658083Z 00:05.0 Ethernet controller: Amazon.com, Inc. Elastic Network Adapter (ENA) 2024-08-20T22:14:27.7658835Z 00:1e.0 3D controller: NVIDIA Corporation GA102GL [A10G] (rev a1) 2024-08-20T22:14:27.7659631Z 00:1f.0 Non-Volatile memory controller: Amazon.com, Inc. NVMe SSD Controller 2024-08-20T22:14:27.7660218Z + lsmod 2024-08-20T22:14:27.7700523Z Module Size Used by 2024-08-20T22:14:27.7700953Z ib_core 454656 0 2024-08-20T22:14:27.7701462Z xt_nat 16384 0 2024-08-20T22:14:27.7701843Z veth 36864 0 2024-08-20T22:14:27.7702219Z nvidia_modeset 1351680 0 2024-08-20T22:14:27.7702643Z video 65536 1 nvidia_modeset 2024-08-20T22:14:27.7703078Z wmi 36864 1 video 2024-08-20T22:14:27.7703494Z nvidia_uvm 4706304 0 2024-08-20T22:14:27.7704001Z nvidia 54071296 7 nvidia_uvm,nvidia_modeset 2024-08-20T22:14:27.7704493Z drm 602112 1 nvidia 2024-08-20T22:14:27.7704935Z drm_panel_orientation_quirks 28672 1 drm 2024-08-20T22:14:27.7705469Z backlight 24576 3 video,drm,nvidia_modeset 2024-08-20T22:14:27.7705994Z i2c_core 106496 2 nvidia,drm 2024-08-20T22:14:27.7706478Z xt_conntrack 16384 1 2024-08-20T22:14:27.7706867Z nft_chain_nat 16384 3 2024-08-20T22:14:27.7707304Z xt_MASQUERADE 20480 1 2024-08-20T22:14:27.7707935Z nf_nat 57344 3 xt_nat,nft_chain_nat,xt_MASQUERADE 2024-08-20T22:14:27.7708605Z nf_conntrack_netlink 57344 0 2024-08-20T22:14:27.7709253Z nf_conntrack 184320 5 xt_conntrack,nf_nat,xt_nat,nf_conntrack_netlink,xt_MASQUERADE 2024-08-20T22:14:27.7709921Z nf_defrag_ipv6 24576 1 nf_conntrack 2024-08-20T22:14:27.7710392Z nf_defrag_ipv4 16384 1 nf_conntrack 2024-08-20T22:14:27.7710831Z xfrm_user 57344 1 2024-08-20T22:14:27.7711223Z xfrm_algo 16384 1 xfrm_user 2024-08-20T22:14:27.7711643Z xt_addrtype 16384 2 2024-08-20T22:14:27.7712024Z nft_compat 20480 4 2024-08-20T22:14:27.7712690Z nf_tables 307200 57 nft_compat,nft_chain_nat 2024-08-20T22:14:27.7713428Z nfnetlink 20480 4 nft_compat,nf_conntrack_netlink,nf_tables 2024-08-20T22:14:27.7714024Z br_netfilter 36864 0 2024-08-20T22:14:27.7714441Z bridge 307200 1 br_netfilter 2024-08-20T22:14:27.7714879Z stp 16384 1 bridge 2024-08-20T22:14:27.7715316Z llc 16384 2 bridge,stp 2024-08-20T22:14:27.7715736Z overlay 167936 0 2024-08-20T22:14:27.7716110Z tls 114688 0 2024-08-20T22:14:27.7716471Z nls_ascii 16384 1 2024-08-20T22:14:27.7716845Z nls_cp437 20480 1 2024-08-20T22:14:27.7717221Z vfat 24576 1 2024-08-20T22:14:27.7717592Z fat 86016 1 vfat 2024-08-20T22:14:27.7717979Z sunrpc 692224 1 2024-08-20T22:14:27.7718347Z ena 167936 0 2024-08-20T22:14:27.7718721Z ptp 36864 1 ena 2024-08-20T22:14:27.7719242Z pps_core 24576 1 ptp 2024-08-20T22:14:27.7719762Z ghash_clmulni_intel 16384 0 2024-08-20T22:14:27.7720271Z aesni_intel 393216 0 2024-08-20T22:14:27.7720695Z i8042 45056 0 2024-08-20T22:14:27.7721176Z serio 28672 3 i8042 2024-08-20T22:14:27.7721726Z crypto_simd 16384 1 aesni_intel 2024-08-20T22:14:27.7722250Z cryptd 28672 2 crypto_simd,ghash_clmulni_intel 2024-08-20T22:14:27.7722747Z button 24576 0 2024-08-20T22:14:27.7723122Z sch_fq_codel 20480 17 2024-08-20T22:14:27.7723555Z dm_mod 188416 0 2024-08-20T22:14:27.7723924Z fuse 163840 1 2024-08-20T22:14:27.7724285Z configfs 57344 1 2024-08-20T22:14:27.7724666Z dax 45056 1 dm_mod 2024-08-20T22:14:27.7725066Z loop 36864 0 2024-08-20T22:14:27.7725432Z dmi_sysfs 20480 0 2024-08-20T22:14:27.7725795Z crc32_pclmul 16384 0 2024-08-20T22:14:27.7726179Z crc32c_intel 24576 0 2024-08-20T22:14:27.7726550Z efivarfs 24576 1 2024-08-20T22:14:27.7726913Z + modinfo nvidia 2024-08-20T22:14:27.7727619Z filename: /lib/modules/6.1.94-99.176.amzn2023.x86_64/kernel/drivers/video/nvidia.ko 2024-08-20T22:14:27.7728627Z alias: char-major-195-* 2024-08-20T22:14:27.7729029Z version: 550.54.15 2024-08-20T22:14:27.7729378Z supported: external 2024-08-20T22:14:27.7729711Z license: NVIDIA 2024-08-20T22:14:27.7730095Z firmware: nvidia/550.54.15/gsp_tu10x.bin 2024-08-20T22:14:27.7730575Z firmware: nvidia/550.54.15/gsp_ga10x.bin 2024-08-20T22:14:27.7731035Z srcversion: 833721318DA517F0C2FEC97 2024-08-20T22:14:27.7731496Z alias: pci:v000010DEd*sv*sd*bc06sc80i00* 2024-08-20T22:14:27.7731996Z alias: pci:v000010DEd*sv*sd*bc03sc02i00* 2024-08-20T22:14:27.7732483Z alias: pci:v000010DEd*sv*sd*bc03sc00i00* 2024-08-20T22:14:27.7732991Z depends: i2c-core,drm 2024-08-20T22:14:27.7733349Z retpoline: Y 2024-08-20T22:14:27.7733659Z name: nvidia 2024-08-20T22:14:27.7734267Z vermagic: 6.1.94-99.176.amzn2023.x86_64 SMP preempt mod_unload modversions 2024-08-20T22:14:27.7734964Z parm: NvSwitchRegDwords:NvSwitch regkey (charp) 2024-08-20T22:14:27.7735597Z parm: NvSwitchBlacklist:NvSwitchBlacklist=uuid[,uuid...] (charp) 2024-08-20T22:14:27.7736190Z parm: NVreg_ResmanDebugLevel:int 2024-08-20T22:14:27.7736631Z parm: NVreg_RmLogonRC:int 2024-08-20T22:14:27.7737061Z parm: NVreg_ModifyDeviceFiles:int 2024-08-20T22:14:27.7737518Z parm: NVreg_DeviceFileUID:int 2024-08-20T22:14:27.7737952Z parm: NVreg_DeviceFileGID:int 2024-08-20T22:14:27.7738398Z parm: NVreg_DeviceFileMode:int 2024-08-20T22:14:27.7738914Z parm: NVreg_InitializeSystemMemoryAllocations:int 2024-08-20T22:14:27.7739473Z parm: NVreg_UsePageAttributeTable:int 2024-08-20T22:14:27.7740045Z parm: NVreg_EnablePCIeGen3:int 2024-08-20T22:14:27.7740476Z parm: NVreg_EnableMSI:int 2024-08-20T22:14:27.7741258Z parm: NVreg_TCEBypassMode:int 2024-08-20T22:14:27.7741714Z parm: NVreg_EnableStreamMemOPs:int 2024-08-20T22:14:27.7742249Z parm: NVreg_RestrictProfilingToAdminUsers:int 2024-08-20T22:14:27.7742827Z parm: NVreg_PreserveVideoMemoryAllocations:int 2024-08-20T22:14:27.7743402Z parm: NVreg_EnableS0ixPowerManagement:int 2024-08-20T22:14:27.7744009Z parm: NVreg_S0ixPowerManagementVideoMemoryThreshold:int 2024-08-20T22:14:27.7744601Z parm: NVreg_DynamicPowerManagement:int 2024-08-20T22:14:27.7745209Z parm: NVreg_DynamicPowerManagementVideoMemoryThreshold:int 2024-08-20T22:14:27.7745797Z parm: NVreg_EnableGpuFirmware:int 2024-08-20T22:14:27.7746286Z parm: NVreg_EnableGpuFirmwareLogs:int 2024-08-20T22:14:27.7746842Z parm: NVreg_OpenRmEnableUnsupportedGpus:int 2024-08-20T22:14:27.7747432Z parm: NVreg_EnableUserNUMAManagement:int 2024-08-20T22:14:27.7747919Z parm: NVreg_MemoryPoolSize:int 2024-08-20T22:14:27.7748383Z parm: NVreg_KMallocHeapMaxSize:int 2024-08-20T22:14:27.7748864Z parm: NVreg_VMallocHeapMaxSize:int 2024-08-20T22:14:27.7749338Z parm: NVreg_IgnoreMMIOCheck:int 2024-08-20T22:14:27.7749778Z parm: NVreg_NvLinkDisable:int 2024-08-20T22:14:27.7750276Z parm: NVreg_EnablePCIERelaxedOrderingMode:int 2024-08-20T22:14:27.7750797Z parm: NVreg_RegisterPCIDriver:int 2024-08-20T22:14:27.7751278Z parm: NVreg_EnableResizableBar:int 2024-08-20T22:14:27.7751755Z parm: NVreg_EnableDbgBreakpoint:int 2024-08-20T22:14:27.7752250Z parm: NVreg_EnableNonblockingOpen:int 2024-08-20T22:14:27.7752735Z parm: NVreg_RegistryDwords:charp 2024-08-20T22:14:27.7753329Z parm: NVreg_RegistryDwordsPerDevice:charp 2024-08-20T22:14:27.7753803Z parm: NVreg_RmMsg:charp 2024-08-20T22:14:27.7754221Z parm: NVreg_GpuBlacklist:charp 2024-08-20T22:14:27.7754689Z parm: NVreg_TemporaryFilePath:charp 2024-08-20T22:14:27.7755150Z parm: NVreg_ExcludedGpus:charp 2024-08-20T22:14:27.7755607Z parm: NVreg_DmaRemapPeerMmio:int 2024-08-20T22:14:27.7756253Z parm: NVreg_RmNvlinkBandwidth:charp 2024-08-20T22:14:27.7756734Z parm: NVreg_ImexChannelCount:int 2024-08-20T22:14:27.7757178Z parm: rm_firmware_active:charp 2024-08-20T22:14:27.7757593Z + HAS_NVIDIA_DRIVER=0 2024-08-20T22:14:27.7758000Z ++ command -v nvidia-smi 2024-08-20T22:14:27.7758404Z + '[' -x /usr/bin/nvidia-smi ']' 2024-08-20T22:14:27.7758764Z + set +e 2024-08-20T22:14:27.7759274Z ++ nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0 2024-08-20T22:14:27.8078750Z + INSTALLED_DRIVER_VERSION=550.54.15 2024-08-20T22:14:27.8079179Z + NVIDIA_SMI_STATUS=0 2024-08-20T22:14:27.8079581Z + '[' 0 -ne 0 ']' 2024-08-20T22:14:27.8079949Z + '[' 550.54.15 '!=' 550.54.15 ']' 2024-08-20T22:14:27.8080333Z + HAS_NVIDIA_DRIVER=1 2024-08-20T22:14:27.8081055Z + echo 'NVIDIA driver (550.54.15) has already been installed. Skipping NVIDIA driver installation' 2024-08-20T22:14:27.8081748Z + set -e 2024-08-20T22:14:27.8082055Z + '[' 1 -eq 0 ']' 2024-08-20T22:14:27.8082629Z NVIDIA driver (550.54.15) has already been installed. Skipping NVIDIA driver installation 2024-08-20T22:14:27.8083308Z + post_install_nvidia_driver_common 2024-08-20T22:14:27.8085410Z + sudo modprobe nvidia 2024-08-20T22:14:27.9437224Z + echo 'After installing NVIDIA driver' 2024-08-20T22:14:27.9437832Z + lspci 2024-08-20T22:14:27.9438246Z After installing NVIDIA driver 2024-08-20T22:14:27.9545606Z 00:00.0 Host bridge: Intel Corporation 440FX - 82441FX PMC [Natoma] 2024-08-20T22:14:27.9546468Z 00:01.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II] 2024-08-20T22:14:27.9547472Z 00:01.3 Non-VGA unclassified device: Intel Corporation 82371AB/EB/MB PIIX4 ACPI (rev 08) 2024-08-20T22:14:27.9548269Z 00:03.0 VGA compatible controller: Amazon.com, Inc. Device 1111 2024-08-20T22:14:27.9549352Z 00:04.0 Non-Volatile memory controller: Amazon.com, Inc. NVMe EBS Controller 2024-08-20T22:14:27.9550119Z 00:05.0 Ethernet controller: Amazon.com, Inc. Elastic Network Adapter (ENA) 2024-08-20T22:14:27.9550850Z 00:1e.0 3D controller: NVIDIA Corporation GA102GL [A10G] (rev a1) 2024-08-20T22:14:27.9551648Z 00:1f.0 Non-Volatile memory controller: Amazon.com, Inc. NVMe SSD Controller 2024-08-20T22:14:27.9552238Z + lsmod 2024-08-20T22:14:27.9581788Z Module Size Used by 2024-08-20T22:14:27.9582236Z ib_core 454656 0 2024-08-20T22:14:27.9582735Z xt_nat 16384 0 2024-08-20T22:14:27.9583112Z veth 36864 0 2024-08-20T22:14:27.9583678Z nvidia_modeset 1351680 0 2024-08-20T22:14:27.9584223Z video 65536 1 nvidia_modeset 2024-08-20T22:14:27.9584763Z wmi 36864 1 video 2024-08-20T22:14:27.9585163Z nvidia_uvm 4706304 0 2024-08-20T22:14:27.9585615Z nvidia 54071296 7 nvidia_uvm,nvidia_modeset 2024-08-20T22:14:27.9586094Z drm 602112 1 nvidia 2024-08-20T22:14:27.9586535Z drm_panel_orientation_quirks 28672 1 drm 2024-08-20T22:14:27.9587060Z backlight 24576 3 video,drm,nvidia_modeset 2024-08-20T22:14:27.9587566Z i2c_core 106496 2 nvidia,drm 2024-08-20T22:14:27.9587989Z xt_conntrack 16384 1 2024-08-20T22:14:27.9588368Z nft_chain_nat 16384 3 2024-08-20T22:14:27.9588750Z xt_MASQUERADE 20480 1 2024-08-20T22:14:27.9589216Z nf_nat 57344 3 xt_nat,nft_chain_nat,xt_MASQUERADE 2024-08-20T22:14:27.9589728Z nf_conntrack_netlink 57344 0 2024-08-20T22:14:27.9590343Z nf_conntrack 184320 5 xt_conntrack,nf_nat,xt_nat,nf_conntrack_netlink,xt_MASQUERADE 2024-08-20T22:14:27.9591009Z nf_defrag_ipv6 24576 1 nf_conntrack 2024-08-20T22:14:27.9591465Z nf_defrag_ipv4 16384 1 nf_conntrack 2024-08-20T22:14:27.9591901Z xfrm_user 57344 1 2024-08-20T22:14:27.9592301Z xfrm_algo 16384 1 xfrm_user 2024-08-20T22:14:27.9592719Z xt_addrtype 16384 2 2024-08-20T22:14:27.9593085Z nft_compat 20480 4 2024-08-20T22:14:27.9593671Z nf_tables 307200 57 nft_compat,nft_chain_nat 2024-08-20T22:14:27.9594520Z nfnetlink 20480 4 nft_compat,nf_conntrack_netlink,nf_tables 2024-08-20T22:14:27.9595062Z br_netfilter 36864 0 2024-08-20T22:14:27.9595471Z bridge 307200 1 br_netfilter 2024-08-20T22:14:27.9595908Z stp 16384 1 bridge 2024-08-20T22:14:27.9596326Z llc 16384 2 bridge,stp 2024-08-20T22:14:27.9596733Z overlay 167936 0 2024-08-20T22:14:27.9597098Z tls 114688 0 2024-08-20T22:14:27.9597462Z nls_ascii 16384 1 2024-08-20T22:14:27.9597830Z nls_cp437 20480 1 2024-08-20T22:14:27.9598186Z vfat 24576 1 2024-08-20T22:14:27.9598562Z fat 86016 1 vfat 2024-08-20T22:14:27.9598955Z sunrpc 692224 1 2024-08-20T22:14:27.9599317Z ena 167936 0 2024-08-20T22:14:27.9599684Z ptp 36864 1 ena 2024-08-20T22:14:27.9600080Z pps_core 24576 1 ptp 2024-08-20T22:14:27.9600483Z ghash_clmulni_intel 16384 0 2024-08-20T22:14:27.9600943Z aesni_intel 393216 0 2024-08-20T22:14:27.9601435Z i8042 45056 0 2024-08-20T22:14:27.9601921Z serio 28672 3 i8042 2024-08-20T22:14:27.9602466Z crypto_simd 16384 1 aesni_intel 2024-08-20T22:14:27.9603211Z cryptd 28672 2 crypto_simd,ghash_clmulni_intel 2024-08-20T22:14:27.9603871Z button 24576 0 2024-08-20T22:14:27.9604357Z sch_fq_codel 20480 17 2024-08-20T22:14:27.9604746Z dm_mod 188416 0 2024-08-20T22:14:27.9605105Z fuse 163840 1 2024-08-20T22:14:27.9605551Z configfs 57344 1 2024-08-20T22:14:27.9606076Z dax 45056 1 dm_mod 2024-08-20T22:14:27.9606473Z loop 36864 0 2024-08-20T22:14:27.9606834Z dmi_sysfs 20480 0 2024-08-20T22:14:27.9607204Z crc32_pclmul 16384 0 2024-08-20T22:14:27.9607571Z crc32c_intel 24576 0 2024-08-20T22:14:27.9607941Z efivarfs 24576 1 2024-08-20T22:14:27.9608291Z + modinfo nvidia 2024-08-20T22:14:27.9608954Z filename: /lib/modules/6.1.94-99.176.amzn2023.x86_64/kernel/drivers/video/nvidia.ko 2024-08-20T22:14:27.9609649Z alias: char-major-195-* 2024-08-20T22:14:27.9610024Z version: 550.54.15 2024-08-20T22:14:27.9610370Z supported: external 2024-08-20T22:14:27.9610710Z license: NVIDIA 2024-08-20T22:14:27.9611082Z firmware: nvidia/550.54.15/gsp_tu10x.bin 2024-08-20T22:14:27.9611550Z firmware: nvidia/550.54.15/gsp_ga10x.bin 2024-08-20T22:14:27.9612006Z srcversion: 833721318DA517F0C2FEC97 2024-08-20T22:14:27.9612468Z alias: pci:v000010DEd*sv*sd*bc06sc80i00* 2024-08-20T22:14:27.9612970Z alias: pci:v000010DEd*sv*sd*bc03sc02i00* 2024-08-20T22:14:27.9613502Z alias: pci:v000010DEd*sv*sd*bc03sc00i00* 2024-08-20T22:14:27.9613995Z depends: i2c-core,drm 2024-08-20T22:14:27.9614354Z retpoline: Y 2024-08-20T22:14:27.9614663Z name: nvidia 2024-08-20T22:14:27.9615254Z vermagic: 6.1.94-99.176.amzn2023.x86_64 SMP preempt mod_unload modversions 2024-08-20T22:14:27.9615944Z parm: NvSwitchRegDwords:NvSwitch regkey (charp) 2024-08-20T22:14:27.9616579Z parm: NvSwitchBlacklist:NvSwitchBlacklist=uuid[,uuid...] (charp) 2024-08-20T22:14:27.9617165Z parm: NVreg_ResmanDebugLevel:int 2024-08-20T22:14:27.9617593Z parm: NVreg_RmLogonRC:int 2024-08-20T22:14:27.9618024Z parm: NVreg_ModifyDeviceFiles:int 2024-08-20T22:14:27.9618477Z parm: NVreg_DeviceFileUID:int 2024-08-20T22:14:27.9618904Z parm: NVreg_DeviceFileGID:int 2024-08-20T22:14:27.9619340Z parm: NVreg_DeviceFileMode:int 2024-08-20T22:14:27.9619864Z parm: NVreg_InitializeSystemMemoryAllocations:int 2024-08-20T22:14:27.9620420Z parm: NVreg_UsePageAttributeTable:int 2024-08-20T22:14:27.9620888Z parm: NVreg_EnablePCIeGen3:int 2024-08-20T22:14:27.9621423Z parm: NVreg_EnableMSI:int 2024-08-20T22:14:27.9621841Z parm: NVreg_TCEBypassMode:int 2024-08-20T22:14:27.9622298Z parm: NVreg_EnableStreamMemOPs:int 2024-08-20T22:14:27.9622819Z parm: NVreg_RestrictProfilingToAdminUsers:int 2024-08-20T22:14:27.9623395Z parm: NVreg_PreserveVideoMemoryAllocations:int 2024-08-20T22:14:27.9624005Z parm: NVreg_EnableS0ixPowerManagement:int 2024-08-20T22:14:27.9624619Z parm: NVreg_S0ixPowerManagementVideoMemoryThreshold:int 2024-08-20T22:14:27.9625205Z parm: NVreg_DynamicPowerManagement:int 2024-08-20T22:14:27.9625840Z parm: NVreg_DynamicPowerManagementVideoMemoryThreshold:int 2024-08-20T22:14:27.9626435Z parm: NVreg_EnableGpuFirmware:int 2024-08-20T22:14:27.9626920Z parm: NVreg_EnableGpuFirmwareLogs:int 2024-08-20T22:14:27.9627438Z parm: NVreg_OpenRmEnableUnsupportedGpus:int 2024-08-20T22:14:27.9627983Z parm: NVreg_EnableUserNUMAManagement:int 2024-08-20T22:14:27.9628489Z parm: NVreg_MemoryPoolSize:int 2024-08-20T22:14:27.9628947Z parm: NVreg_KMallocHeapMaxSize:int 2024-08-20T22:14:27.9629415Z parm: NVreg_VMallocHeapMaxSize:int 2024-08-20T22:14:27.9629877Z parm: NVreg_IgnoreMMIOCheck:int 2024-08-20T22:14:27.9630321Z parm: NVreg_NvLinkDisable:int 2024-08-20T22:14:27.9630821Z parm: NVreg_EnablePCIERelaxedOrderingMode:int 2024-08-20T22:14:27.9631332Z parm: NVreg_RegisterPCIDriver:int 2024-08-20T22:14:27.9631802Z parm: NVreg_EnableResizableBar:int 2024-08-20T22:14:27.9632284Z parm: NVreg_EnableDbgBreakpoint:int 2024-08-20T22:14:27.9632777Z parm: NVreg_EnableNonblockingOpen:int 2024-08-20T22:14:27.9633503Z parm: NVreg_RegistryDwords:charp 2024-08-20T22:14:27.9634046Z parm: NVreg_RegistryDwordsPerDevice:charp 2024-08-20T22:14:27.9634522Z parm: NVreg_RmMsg:charp 2024-08-20T22:14:27.9634930Z parm: NVreg_GpuBlacklist:charp 2024-08-20T22:14:27.9635391Z parm: NVreg_TemporaryFilePath:charp 2024-08-20T22:14:27.9635860Z parm: NVreg_ExcludedGpus:charp 2024-08-20T22:14:27.9636313Z parm: NVreg_DmaRemapPeerMmio:int 2024-08-20T22:14:27.9636776Z parm: NVreg_RmNvlinkBandwidth:charp 2024-08-20T22:14:27.9637245Z parm: NVreg_ImexChannelCount:int 2024-08-20T22:14:27.9637697Z parm: rm_firmware_active:charp 2024-08-20T22:14:27.9638097Z + set +e 2024-08-20T22:14:27.9638401Z + nvidia-smi 2024-08-20T22:14:27.9814578Z Tue Aug 20 22:14:27 2024 2024-08-20T22:14:27.9815215Z +-----------------------------------------------------------------------------------------+ 2024-08-20T22:14:27.9816174Z | NVIDIA-SMI 550.54.15 Driver Version: 550.54.15 CUDA Version: 12.4 | 2024-08-20T22:14:27.9816957Z |-----------------------------------------+------------------------+----------------------+ 2024-08-20T22:14:27.9817753Z | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | 2024-08-20T22:14:27.9818638Z | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | 2024-08-20T22:14:27.9819320Z | | | MIG M. | 2024-08-20T22:14:27.9819864Z |=========================================+========================+======================| 2024-08-20T22:14:28.0033568Z | 0 NVIDIA A10G On | 00000000:00:1E.0 Off | 0 | 2024-08-20T22:14:28.0034295Z | 0% 29C P8 22W / 300W | 0MiB / 23028MiB | 0% Default | 2024-08-20T22:14:28.0034928Z | | | N/A | 2024-08-20T22:14:28.0035626Z +-----------------------------------------+------------------------+----------------------+ 2024-08-20T22:14:28.0038694Z 2024-08-20T22:14:28.0039587Z +-----------------------------------------------------------------------------------------+ 2024-08-20T22:14:28.0040226Z | Processes: | 2024-08-20T22:14:28.0041214Z | GPU GI CI PID Type Process name GPU Memory | 2024-08-20T22:14:28.0041903Z | ID ID Usage | 2024-08-20T22:14:28.0042460Z |=========================================================================================| 2024-08-20T22:14:28.0046922Z | No running processes found | 2024-08-20T22:14:28.0047728Z +-----------------------------------------------------------------------------------------+ 2024-08-20T22:14:28.2937540Z + nvidia-smi --query-gpu=gpu_name --format=csv,noheader --id=0 2024-08-20T22:14:28.3127891Z NVIDIA A10G 2024-08-20T22:14:28.3191672Z + NVIDIA_SMI_STATUS=0 2024-08-20T22:14:28.3192258Z + '[' 0 -eq 0 ']' 2024-08-20T22:14:28.3192686Z + echo 'INFO: Ignoring allowed status 0' 2024-08-20T22:14:28.3193129Z + set -e 2024-08-20T22:14:28.3193528Z INFO: Ignoring allowed status 0 2024-08-20T22:14:28.3201955Z == Installing nvidia container toolkit for amzn2023 == 2024-08-20T22:14:28.3205902Z + sudo yum install -y yum-utils 2024-08-20T22:14:28.8446241Z Last metadata expiration check: 0:32:04 ago on Tue Aug 20 21:42:24 2024. 2024-08-20T22:14:28.8668838Z Package dnf-utils-4.3.0-13.amzn2023.0.4.noarch is already installed. 2024-08-20T22:14:28.8977460Z Dependencies resolved. 2024-08-20T22:14:28.9104442Z Nothing to do. 2024-08-20T22:14:28.9105242Z Complete! 2024-08-20T22:14:29.0024571Z + [[ amzn2023 == \a\m\z\n\2\0\2\3 ]] 2024-08-20T22:14:29.0026101Z + YUM_REPO_URL=https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo 2024-08-20T22:14:29.0027414Z + sudo yum-config-manager --add-repo https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo 2024-08-20T22:14:29.2793348Z Adding repo from: https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo 2024-08-20T22:14:29.3499063Z + sudo yum install -y nvidia-docker2 2024-08-20T22:14:29.8607562Z nvidia-container-toolkit 11 kB/s | 833 B 00:00 2024-08-20T22:14:29.8829679Z Package nvidia-docker2-2.14.0-1.noarch is already installed. 2024-08-20T22:14:29.9130604Z Dependencies resolved. 2024-08-20T22:14:29.9255481Z Nothing to do. 2024-08-20T22:14:29.9255888Z Complete! 2024-08-20T22:14:30.0258213Z + sudo systemctl restart docker 2024-08-20T22:15:28.4419365Z nvidia-persistenced failed to initialize. Check syslog for more details. 2024-08-20T22:15:28.4655803Z Tue Aug 20 22:15:28 2024 2024-08-20T22:15:28.4656742Z +-----------------------------------------------------------------------------------------+ 2024-08-20T22:15:28.4657690Z | NVIDIA-SMI 550.54.15 Driver Version: 550.54.15 CUDA Version: 12.4 | 2024-08-20T22:15:28.4658771Z |-----------------------------------------+------------------------+----------------------+ 2024-08-20T22:15:28.4659622Z | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | 2024-08-20T22:15:28.4660504Z | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | 2024-08-20T22:15:28.4661196Z | | | MIG M. | 2024-08-20T22:15:28.4661788Z |=========================================+========================+======================| 2024-08-20T22:15:28.4864698Z | 0 NVIDIA A10G On | 00000000:00:1E.0 Off | 0 | 2024-08-20T22:15:28.4865662Z | 0% 29C P8 22W / 300W | 0MiB / 23028MiB | 0% Default | 2024-08-20T22:15:28.4866311Z | | | N/A | 2024-08-20T22:15:28.4867453Z +-----------------------------------------+------------------------+----------------------+ 2024-08-20T22:15:28.4869834Z 2024-08-20T22:15:28.4870783Z +-----------------------------------------------------------------------------------------+ 2024-08-20T22:15:28.4871543Z | Processes: | 2024-08-20T22:15:28.4872254Z | GPU GI CI PID Type Process name GPU Memory | 2024-08-20T22:15:28.4872940Z | ID ID Usage | 2024-08-20T22:15:28.4873594Z |=========================================================================================| 2024-08-20T22:15:28.4876853Z | No running processes found | 2024-08-20T22:15:28.4877837Z +-----------------------------------------------------------------------------------------+ 2024-08-20T22:15:29.6386926Z Command completed after 1 attempt(s). 2024-08-20T22:15:29.6473955Z ##[group]Run python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84 2024-08-20T22:15:29.6474722Z python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84 2024-08-20T22:15:29.6475410Z python3 -m tools.stats.monitor > usage_log.txt 2>&1 & 2024-08-20T22:15:29.6476053Z echo "monitor-script-pid=${!}" >> "${GITHUB_OUTPUT}" 2024-08-20T22:15:29.6489375Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:15:29.6489873Z env: 2024-08-20T22:15:29.6490160Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:29.6490603Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:29.6491289Z ##[endgroup] 2024-08-20T22:15:29.9037204Z Defaulting to user installation because normal site-packages is not writeable 2024-08-20T22:15:29.9229300Z Requirement already satisfied: psutil==5.9.1 in /home/ec2-user/.local/lib/python3.9/site-packages (5.9.1) 2024-08-20T22:15:29.9233612Z Requirement already satisfied: nvidia-ml-py==11.525.84 in /home/ec2-user/.local/lib/python3.9/site-packages (11.525.84) 2024-08-20T22:15:30.0443292Z Prepare all required actions 2024-08-20T22:15:30.0443806Z Getting action download info 2024-08-20T22:15:30.1525556Z Download action repository 'seemethere/download-artifact-s3@v4' (SHA:1da556a7aa0a088e3153970611f6c432d58e80e6) 2024-08-20T22:15:30.3373096Z Download action repository 'actions/download-artifact@v3' (SHA:9bc31d5ccc31df68ecc42ccf4149144866c47d8a) 2024-08-20T22:15:30.4755220Z ##[group]Run ./.github/actions/download-build-artifacts 2024-08-20T22:15:30.4755694Z with: 2024-08-20T22:15:30.4756031Z name: linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-08-20T22:15:30.4756495Z s3-bucket: gha-artifacts 2024-08-20T22:15:30.4756835Z env: 2024-08-20T22:15:30.4757104Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:30.4757552Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:30.4758027Z ##[endgroup] 2024-08-20T22:15:30.4792856Z ##[group]Run seemethere/download-artifact-s3@v4 2024-08-20T22:15:30.4793387Z with: 2024-08-20T22:15:30.4793764Z name: linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-08-20T22:15:30.4794216Z s3-bucket: gha-artifacts 2024-08-20T22:15:30.4794559Z region: us-east-1 2024-08-20T22:15:30.4794855Z env: 2024-08-20T22:15:30.4795125Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:30.4795562Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:30.4796034Z ##[endgroup] 2024-08-20T22:15:30.9580965Z (node:347428) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2024-08-20T22:15:30.9582325Z 2024-08-20T22:15:30.9582661Z Please migrate your code to use AWS SDK for JavaScript (v3). 2024-08-20T22:15:30.9583444Z For more information, check the migration guide at https://a.co/7PzMCcy 2024-08-20T22:15:30.9584308Z (Use `node --trace-warnings ...` to show where the warning was created) 2024-08-20T22:15:31.0290616Z Found 1 objects with prefix pytorch/pytorch/10479310721/linux-focal-cuda12.1-py3.10-gcc9-sm86/ 2024-08-20T22:15:31.0291723Z Starting download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2024-08-20T22:15:38.5556589Z Finished download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2024-08-20T22:15:38.5562886Z Artifact download has finished successfully 2024-08-20T22:15:38.5926196Z ##[group]Run unzip -o artifacts.zip 2024-08-20T22:15:38.5926639Z unzip -o artifacts.zip 2024-08-20T22:15:38.5937025Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:15:38.5937527Z env: 2024-08-20T22:15:38.5937817Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:38.5938276Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:38.5938773Z ##[endgroup] 2024-08-20T22:15:38.5985583Z Archive: artifacts.zip 2024-08-20T22:15:38.5987436Z creating: dist/ 2024-08-20T22:15:40.7386907Z inflating: dist/torch-2.5.0a0+git40ec5f6-cp310-cp310-linux_x86_64.whl 2024-08-20T22:15:40.7387581Z creating: build/custom_test_artifacts/ 2024-08-20T22:15:40.7388176Z creating: build/custom_test_artifacts/custom-op-build/ 2024-08-20T22:15:40.7388925Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/ 2024-08-20T22:15:40.7389743Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/pkgRedirects/ 2024-08-20T22:15:40.7395954Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeConfigureLog.yaml 2024-08-20T22:15:40.7396883Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/ 2024-08-20T22:15:40.7397821Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-08-20T22:15:40.7398920Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-08-20T22:15:40.7400137Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-08-20T22:15:40.7401235Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-08-20T22:15:40.7402736Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-08-20T22:15:40.7403740Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-08-20T22:15:40.7404722Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-08-20T22:15:40.7406036Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-08-20T22:15:40.7407780Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-08-20T22:15:40.7409681Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-08-20T22:15:40.7410814Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-08-20T22:15:40.7412399Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-08-20T22:15:40.7413896Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-08-20T22:15:40.7414928Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/ 2024-08-20T22:15:40.7416027Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/ 2024-08-20T22:15:40.7456225Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2024-08-20T22:15:40.7495896Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2024-08-20T22:15:40.7497334Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2024-08-20T22:15:40.7543502Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2024-08-20T22:15:40.7544904Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2024-08-20T22:15:40.7546323Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2024-08-20T22:15:40.7547780Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2024-08-20T22:15:40.7549178Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2024-08-20T22:15:40.7550550Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2024-08-20T22:15:40.7551927Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2024-08-20T22:15:40.7553392Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2024-08-20T22:15:40.7554738Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2024-08-20T22:15:40.7556010Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2024-08-20T22:15:40.7557235Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c 2024-08-20T22:15:40.7558439Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin 2024-08-20T22:15:40.7559659Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2024-08-20T22:15:40.7561010Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o 2024-08-20T22:15:40.7562215Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu 2024-08-20T22:15:40.7619978Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out 2024-08-20T22:15:40.7680437Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin 2024-08-20T22:15:40.7681618Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake 2024-08-20T22:15:40.7682605Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeScratch/ 2024-08-20T22:15:40.7683468Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeTmp/ 2024-08-20T22:15:40.7684368Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/cmake.check_cache 2024-08-20T22:15:40.7685288Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/ 2024-08-20T22:15:40.7686313Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.ts 2024-08-20T22:15:40.7687460Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.make 2024-08-20T22:15:40.7688557Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/depend.make 2024-08-20T22:15:40.7689589Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/link.txt 2024-08-20T22:15:40.7690649Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/cmake_clean.cmake 2024-08-20T22:15:40.7691722Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/build.make 2024-08-20T22:15:40.7692798Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/DependInfo.cmake 2024-08-20T22:15:40.7693872Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/flags.make 2024-08-20T22:15:40.7694940Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/progress.make 2024-08-20T22:15:40.7712483Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o.d 2024-08-20T22:15:40.7856476Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o 2024-08-20T22:15:40.7857461Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/ 2024-08-20T22:15:40.7858543Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.ts 2024-08-20T22:15:40.7859737Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.make 2024-08-20T22:15:40.7860873Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/depend.make 2024-08-20T22:15:40.7861954Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/link.txt 2024-08-20T22:15:40.7863060Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/cmake_clean.cmake 2024-08-20T22:15:40.7864184Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/build.make 2024-08-20T22:15:40.7865308Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/DependInfo.cmake 2024-08-20T22:15:40.7866422Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/flags.make 2024-08-20T22:15:40.7867527Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/progress.make 2024-08-20T22:15:40.7886252Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o.d 2024-08-20T22:15:40.7970253Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o 2024-08-20T22:15:40.7971615Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-08-20T22:15:40.7972676Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/TargetDirectories.txt 2024-08-20T22:15:40.7973893Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/progress.marks 2024-08-20T22:15:40.7974828Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile2 2024-08-20T22:15:40.7975871Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile.cmake 2024-08-20T22:15:40.7976772Z inflating: build/custom_test_artifacts/custom-op-build/detect_cuda_version.cc 2024-08-20T22:15:40.7978665Z inflating: build/custom_test_artifacts/custom-op-build/CMakeCache.txt 2024-08-20T22:15:40.7979569Z inflating: build/custom_test_artifacts/custom-op-build/Makefile 2024-08-20T22:15:40.7980490Z inflating: build/custom_test_artifacts/custom-op-build/cmake_install.cmake 2024-08-20T22:15:40.8100741Z inflating: build/custom_test_artifacts/custom-op-build/libcustom_ops.so 2024-08-20T22:15:40.8165455Z inflating: build/custom_test_artifacts/custom-op-build/test_custom_ops 2024-08-20T22:15:40.8166179Z creating: build/custom_test_artifacts/jit-hook-build/ 2024-08-20T22:15:40.8166875Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/ 2024-08-20T22:15:40.8167684Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/pkgRedirects/ 2024-08-20T22:15:40.8174220Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeConfigureLog.yaml 2024-08-20T22:15:40.8175126Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/ 2024-08-20T22:15:40.8176043Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-08-20T22:15:40.8177020Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-08-20T22:15:40.8177977Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-08-20T22:15:40.8179046Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-08-20T22:15:40.8180436Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-08-20T22:15:40.8181428Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-08-20T22:15:40.8182401Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-08-20T22:15:40.8184074Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-08-20T22:15:40.8185769Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-08-20T22:15:40.8187694Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-08-20T22:15:40.8188821Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-08-20T22:15:40.8190370Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-08-20T22:15:40.8191721Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-08-20T22:15:40.8192742Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/ 2024-08-20T22:15:40.8193792Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/ 2024-08-20T22:15:40.8233612Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2024-08-20T22:15:40.8273585Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2024-08-20T22:15:40.8275010Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2024-08-20T22:15:40.8320266Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2024-08-20T22:15:40.8321654Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2024-08-20T22:15:40.8323195Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2024-08-20T22:15:40.8324648Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2024-08-20T22:15:40.8326044Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2024-08-20T22:15:40.8327399Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2024-08-20T22:15:40.8328772Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2024-08-20T22:15:40.8330125Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2024-08-20T22:15:40.8331462Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2024-08-20T22:15:40.8332723Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2024-08-20T22:15:40.8333936Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c 2024-08-20T22:15:40.8335138Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin 2024-08-20T22:15:40.8336340Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2024-08-20T22:15:40.8337523Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o 2024-08-20T22:15:40.8338713Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu 2024-08-20T22:15:40.8396501Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out 2024-08-20T22:15:40.8457442Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin 2024-08-20T22:15:40.8458601Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake 2024-08-20T22:15:40.8459571Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeScratch/ 2024-08-20T22:15:40.8460419Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeTmp/ 2024-08-20T22:15:40.8461294Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/cmake.check_cache 2024-08-20T22:15:40.8462232Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/ 2024-08-20T22:15:40.8463281Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.ts 2024-08-20T22:15:40.8464453Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.make 2024-08-20T22:15:40.8465583Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/depend.make 2024-08-20T22:15:40.8466646Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/link.txt 2024-08-20T22:15:40.8467741Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/cmake_clean.cmake 2024-08-20T22:15:40.8468823Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/build.make 2024-08-20T22:15:40.8469924Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/DependInfo.cmake 2024-08-20T22:15:40.8471182Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/flags.make 2024-08-20T22:15:40.8472265Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/progress.make 2024-08-20T22:15:40.8489938Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o.d 2024-08-20T22:15:40.8554706Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o 2024-08-20T22:15:40.8556787Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-08-20T22:15:40.8558880Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/TargetDirectories.txt 2024-08-20T22:15:40.8560778Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/progress.marks 2024-08-20T22:15:40.8562536Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile2 2024-08-20T22:15:40.8564269Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile.cmake 2024-08-20T22:15:40.8565523Z inflating: build/custom_test_artifacts/jit-hook-build/detect_cuda_version.cc 2024-08-20T22:15:40.8566353Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeCache.txt 2024-08-20T22:15:40.8567112Z inflating: build/custom_test_artifacts/jit-hook-build/Makefile 2024-08-20T22:15:40.8567896Z inflating: build/custom_test_artifacts/jit-hook-build/cmake_install.cmake 2024-08-20T22:15:40.8614336Z inflating: build/custom_test_artifacts/jit-hook-build/test_jit_hooks 2024-08-20T22:15:40.8615092Z creating: build/custom_test_artifacts/custom-backend-build/ 2024-08-20T22:15:40.8615845Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/ 2024-08-20T22:15:40.8616710Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/pkgRedirects/ 2024-08-20T22:15:40.8623147Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeConfigureLog.yaml 2024-08-20T22:15:40.8624130Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/ 2024-08-20T22:15:40.8625118Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-08-20T22:15:40.8626157Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-08-20T22:15:40.8627175Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-08-20T22:15:40.8628324Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-08-20T22:15:40.8629610Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-08-20T22:15:40.8630663Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-08-20T22:15:40.8631703Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-08-20T22:15:40.8633392Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-08-20T22:15:40.8635239Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-08-20T22:15:40.8637255Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-08-20T22:15:40.8638448Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-08-20T22:15:40.8640034Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-08-20T22:15:40.8641824Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-08-20T22:15:40.8642903Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/ 2024-08-20T22:15:40.8643956Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/ 2024-08-20T22:15:40.8683869Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2024-08-20T22:15:40.8723269Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2024-08-20T22:15:40.8724913Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2024-08-20T22:15:40.8771231Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2024-08-20T22:15:40.8772686Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2024-08-20T22:15:40.8774165Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2024-08-20T22:15:40.8775688Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2024-08-20T22:15:40.8777139Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2024-08-20T22:15:40.8778581Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2024-08-20T22:15:40.8780016Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2024-08-20T22:15:40.8781451Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2024-08-20T22:15:40.8782847Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2024-08-20T22:15:40.8784181Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2024-08-20T22:15:40.8785468Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c 2024-08-20T22:15:40.8786721Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin 2024-08-20T22:15:40.8787996Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2024-08-20T22:15:40.8789232Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o 2024-08-20T22:15:40.8790489Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu 2024-08-20T22:15:40.8851083Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out 2024-08-20T22:15:40.8911554Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin 2024-08-20T22:15:40.8912776Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake 2024-08-20T22:15:40.8913899Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeScratch/ 2024-08-20T22:15:40.8914811Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeTmp/ 2024-08-20T22:15:40.8915765Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/cmake.check_cache 2024-08-20T22:15:40.8916768Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/ 2024-08-20T22:15:40.8917875Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.ts 2024-08-20T22:15:40.8919115Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.make 2024-08-20T22:15:40.8920313Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/depend.make 2024-08-20T22:15:40.8921611Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/link.txt 2024-08-20T22:15:40.8922775Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/cmake_clean.cmake 2024-08-20T22:15:40.8924057Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/build.make 2024-08-20T22:15:40.8925241Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/DependInfo.cmake 2024-08-20T22:15:40.8926413Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/flags.make 2024-08-20T22:15:40.8927574Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/progress.make 2024-08-20T22:15:40.8930378Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o.d 2024-08-20T22:15:40.9058174Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o 2024-08-20T22:15:40.9060456Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/ 2024-08-20T22:15:40.9062788Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.ts 2024-08-20T22:15:40.9065242Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.make 2024-08-20T22:15:40.9066498Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/depend.make 2024-08-20T22:15:40.9067675Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/link.txt 2024-08-20T22:15:40.9068896Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/cmake_clean.cmake 2024-08-20T22:15:40.9070119Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/build.make 2024-08-20T22:15:40.9071345Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/DependInfo.cmake 2024-08-20T22:15:40.9072564Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/flags.make 2024-08-20T22:15:40.9073915Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/progress.make 2024-08-20T22:15:40.9090643Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o.d 2024-08-20T22:15:40.9147791Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o 2024-08-20T22:15:40.9150632Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-08-20T22:15:40.9152403Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/TargetDirectories.txt 2024-08-20T22:15:40.9154072Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/progress.marks 2024-08-20T22:15:40.9155490Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile2 2024-08-20T22:15:40.9156833Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile.cmake 2024-08-20T22:15:40.9158284Z inflating: build/custom_test_artifacts/custom-backend-build/detect_cuda_version.cc 2024-08-20T22:15:40.9160613Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeCache.txt 2024-08-20T22:15:40.9162036Z inflating: build/custom_test_artifacts/custom-backend-build/Makefile 2024-08-20T22:15:40.9163537Z inflating: build/custom_test_artifacts/custom-backend-build/cmake_install.cmake 2024-08-20T22:15:40.9268885Z inflating: build/custom_test_artifacts/custom-backend-build/libcustom_backend.so 2024-08-20T22:15:40.9312418Z inflating: build/custom_test_artifacts/custom-backend-build/test_custom_backend 2024-08-20T22:15:40.9313696Z creating: build/lib/ 2024-08-20T22:15:40.9402616Z inflating: build/lib/libprotobuf-lite.a 2024-08-20T22:15:40.9859786Z inflating: build/lib/libprotobuf.a 2024-08-20T22:15:40.9870794Z inflating: build/lib/libpthreadpool.a 2024-08-20T22:15:40.9879700Z inflating: build/lib/libcpuinfo.a 2024-08-20T22:15:40.9888394Z inflating: build/lib/libcpuinfo_internals.a 2024-08-20T22:15:40.9889329Z inflating: build/lib/libclog.a 2024-08-20T22:15:40.9908250Z inflating: build/lib/libnnpack.a 2024-08-20T22:15:40.9911392Z inflating: build/lib/libnnpack_reference_layers.a 2024-08-20T22:15:40.9977825Z inflating: build/lib/libgtest.a 2024-08-20T22:15:41.0053762Z inflating: build/lib/libbenchmark.a 2024-08-20T22:15:41.0118186Z inflating: build/lib/libasmjit.a 2024-08-20T22:15:41.0126396Z inflating: build/lib/libittnotify.a 2024-08-20T22:15:41.0156675Z inflating: build/lib/libtensorpipe_uv.a 2024-08-20T22:15:41.0285038Z inflating: build/lib/libgloo.a 2024-08-20T22:15:41.0306294Z inflating: build/lib/libfmt.a 2024-08-20T22:15:41.0402582Z inflating: build/lib/libc10.so 2024-08-20T22:15:41.0404731Z inflating: build/lib/libcaffe2_nvrtc.so 2024-08-20T22:15:41.0406383Z inflating: build/lib/libtorch_global_deps.so 2024-08-20T22:15:41.0912319Z inflating: build/lib/libprotoc.a 2024-08-20T22:15:41.0932208Z inflating: build/lib/libpytorch_qnnpack.a 2024-08-20T22:15:41.0951257Z inflating: build/lib/libgmock.a 2024-08-20T22:15:41.0952065Z inflating: build/lib/libgtest_main.a 2024-08-20T22:15:41.0953437Z inflating: build/lib/libbenchmark_main.a 2024-08-20T22:15:41.1345355Z inflating: build/lib/libgloo_cuda.a 2024-08-20T22:15:42.1565977Z inflating: build/lib/libdnnl.a 2024-08-20T22:15:42.2141518Z inflating: build/lib/libtensorpipe.a 2024-08-20T22:15:42.2199383Z inflating: build/lib/libc10_cuda.so 2024-08-20T22:15:42.2200220Z inflating: build/lib/libgmock_main.a 2024-08-20T22:15:42.3469304Z inflating: build/lib/libfbgemm.a 2024-08-20T22:15:42.3726062Z inflating: build/lib/libtensorpipe_cuda.a 2024-08-20T22:15:42.4242866Z inflating: build/lib/libkineto.a 2024-08-20T22:15:42.4429888Z inflating: build/lib/libXNNPACK.a 2024-08-20T22:15:42.4473159Z inflating: build/lib/libonnx_proto.a 2024-08-20T22:15:42.5168879Z inflating: build/lib/libonnx.a 2024-08-20T22:15:44.9734525Z inflating: build/lib/libtorch_cpu.so 2024-08-20T22:15:44.9739897Z inflating: build/lib/libunbox_lib.a 2024-08-20T22:15:44.9745090Z inflating: build/lib/libshm.so 2024-08-20T22:15:47.0461656Z inflating: build/lib/libtorch_cuda.so 2024-08-20T22:15:47.0462603Z inflating: build/lib/libtorch.so 2024-08-20T22:15:47.0465721Z inflating: build/lib/libc10d_cuda_test.so 2024-08-20T22:15:47.8678034Z inflating: build/lib/libtorch_cuda_linalg.so 2024-08-20T22:15:48.0682054Z inflating: build/lib/libtorch_python.so 2024-08-20T22:15:48.0754928Z inflating: build/lib/libtorchbind_test.so 2024-08-20T22:15:48.0775858Z inflating: build/lib/libjitbackend_test.so 2024-08-20T22:15:48.0801582Z inflating: build/lib/libbackend_with_compiler.so 2024-08-20T22:15:48.0828203Z inflating: build/lib/libaoti_custom_ops.so 2024-08-20T22:15:48.0863261Z inflating: build/lib/libnnapi_backend.so 2024-08-20T22:15:48.0863738Z creating: build/bin/ 2024-08-20T22:15:48.0914474Z inflating: build/bin/c10_CompileTimeFunctionPointer_test 2024-08-20T22:15:48.0967417Z inflating: build/bin/c10_DeviceGuard_test 2024-08-20T22:15:48.1018739Z inflating: build/bin/c10_Device_test 2024-08-20T22:15:48.1078880Z inflating: build/bin/c10_DispatchKeySet_test 2024-08-20T22:15:48.1132590Z inflating: build/bin/c10_Scalar_test 2024-08-20T22:15:48.1182374Z inflating: build/bin/c10_StreamGuard_test 2024-08-20T22:15:48.1234301Z inflating: build/bin/c10_SymInt_test 2024-08-20T22:15:48.1289294Z inflating: build/bin/c10_InlineDeviceGuard_test 2024-08-20T22:15:48.1345800Z inflating: build/bin/c10_InlineStreamGuard_test 2024-08-20T22:15:48.1402900Z inflating: build/bin/c10_SizesAndStrides_test 2024-08-20T22:15:48.1474794Z inflating: build/bin/c10_cow_test 2024-08-20T22:15:48.1528372Z inflating: build/bin/c10_Bitset_test 2024-08-20T22:15:48.1578744Z inflating: build/bin/c10_ConstexprCrc_test 2024-08-20T22:15:48.1629123Z inflating: build/bin/c10_DeadlockDetection_test 2024-08-20T22:15:48.1680413Z inflating: build/bin/c10_Half_test 2024-08-20T22:15:48.1736764Z inflating: build/bin/c10_LeftRight_test 2024-08-20T22:15:48.1792702Z inflating: build/bin/c10_Metaprogramming_test 2024-08-20T22:15:48.1843357Z inflating: build/bin/c10_Synchronized_test 2024-08-20T22:15:48.1899891Z inflating: build/bin/c10_ThreadLocal_test 2024-08-20T22:15:48.1951562Z inflating: build/bin/c10_TypeIndex_test 2024-08-20T22:15:48.2004897Z inflating: build/bin/c10_TypeList_test 2024-08-20T22:15:48.2055359Z inflating: build/bin/c10_TypeTraits_test 2024-08-20T22:15:48.2107592Z inflating: build/bin/c10_accumulate_test 2024-08-20T22:15:48.2163709Z inflating: build/bin/c10_bfloat16_test 2024-08-20T22:15:48.2214707Z inflating: build/bin/c10_bit_cast_test 2024-08-20T22:15:48.2271776Z inflating: build/bin/c10_complex_math_test 2024-08-20T22:15:48.2327964Z inflating: build/bin/c10_complex_test 2024-08-20T22:15:48.2381442Z inflating: build/bin/c10_exception_test 2024-08-20T22:15:48.2432171Z inflating: build/bin/c10_flags_test 2024-08-20T22:15:48.2482992Z inflating: build/bin/c10_generic_math_test 2024-08-20T22:15:48.2648542Z inflating: build/bin/c10_intrusive_ptr_test 2024-08-20T22:15:48.2700745Z inflating: build/bin/c10_irange_test 2024-08-20T22:15:48.2754358Z inflating: build/bin/c10_lazy_test 2024-08-20T22:15:48.2811945Z inflating: build/bin/c10_logging_test 2024-08-20T22:15:48.2887885Z inflating: build/bin/c10_optional_test 2024-08-20T22:15:48.2950784Z inflating: build/bin/c10_ordered_preserving_dict_test 2024-08-20T22:15:48.3007796Z inflating: build/bin/c10_registry_test 2024-08-20T22:15:48.3160145Z inflating: build/bin/c10_small_vector_test 2024-08-20T22:15:48.3212079Z inflating: build/bin/c10_ssize_test 2024-08-20T22:15:48.3264643Z inflating: build/bin/c10_string_util_test 2024-08-20T22:15:48.3317282Z inflating: build/bin/c10_tempfile_test 2024-08-20T22:15:48.3376740Z inflating: build/bin/c10_string_view_test 2024-08-20T22:15:48.3425612Z inflating: build/bin/c10_intrusive_ptr_benchmark 2024-08-20T22:15:48.3482561Z inflating: build/bin/c10_typeid_test 2024-08-20T22:15:48.3931827Z inflating: build/bin/protoc-3.13.0.0 2024-08-20T22:15:48.4382742Z inflating: build/bin/protoc 2024-08-20T22:15:48.4438090Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_1_var_test 2024-08-20T22:15:48.4491905Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_catches_stream 2024-08-20T22:15:48.4545899Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_catches_thread_and_block_and_device 2024-08-20T22:15:48.4597948Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_from_2_processes 2024-08-20T22:15:48.4651469Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_blocks_and_threads 2024-08-20T22:15:48.4705373Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_multiple_blocks 2024-08-20T22:15:48.4754512Z inflating: build/bin/c10_cuda_CUDATest 2024-08-20T22:15:48.4807721Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_same_block 2024-08-20T22:15:48.5141012Z inflating: build/bin/vec_test_all_types_DEFAULT 2024-08-20T22:15:48.5489551Z inflating: build/bin/vec_test_all_types_AVX512 2024-08-20T22:15:48.5850239Z inflating: build/bin/vec_test_all_types_AVX2 2024-08-20T22:15:48.5902868Z inflating: build/bin/BackoffTest 2024-08-20T22:15:48.5956797Z inflating: build/bin/FileStoreTest 2024-08-20T22:15:48.6012739Z inflating: build/bin/TCPStoreTest 2024-08-20T22:15:48.6067007Z inflating: build/bin/HashStoreTest 2024-08-20T22:15:48.6081051Z inflating: build/bin/ProcessGroupMPITest 2024-08-20T22:15:48.6135322Z inflating: build/bin/test_edge_op_registration 2024-08-20T22:15:48.6139592Z inflating: build/bin/torch_shm_manager 2024-08-20T22:15:48.6142960Z inflating: build/bin/example_allreduce 2024-08-20T22:15:48.6200659Z inflating: build/bin/test_dist_autograd 2024-08-20T22:15:48.6270785Z inflating: build/bin/test_cpp_rpc 2024-08-20T22:15:48.6273441Z inflating: build/bin/parallel_benchmark 2024-08-20T22:15:48.6340901Z inflating: build/bin/test_mobile_nnc 2024-08-20T22:15:48.6350241Z inflating: build/bin/aot_model_compiler_test 2024-08-20T22:15:48.6699214Z inflating: build/bin/test_lazy 2024-08-20T22:15:48.7890072Z inflating: build/bin/test_api 2024-08-20T22:15:48.7964392Z inflating: build/bin/Dict_test 2024-08-20T22:15:48.8017075Z inflating: build/bin/Dimname_test 2024-08-20T22:15:48.8082476Z inflating: build/bin/MaybeOwned_test 2024-08-20T22:15:48.8140277Z inflating: build/bin/NamedTensor_test 2024-08-20T22:15:48.8200305Z inflating: build/bin/apply_utils_test 2024-08-20T22:15:48.8259908Z inflating: build/bin/atest 2024-08-20T22:15:48.8323715Z inflating: build/bin/basic 2024-08-20T22:15:48.8379143Z inflating: build/bin/broadcast_test 2024-08-20T22:15:48.8430100Z inflating: build/bin/cpu_allocator_test 2024-08-20T22:15:48.8489275Z inflating: build/bin/cpu_generator_test 2024-08-20T22:15:48.8544262Z inflating: build/bin/cpu_profiling_allocator_test 2024-08-20T22:15:48.8638206Z inflating: build/bin/cpu_rng_test 2024-08-20T22:15:48.8688958Z inflating: build/bin/dispatch_key_set_test 2024-08-20T22:15:48.8742506Z inflating: build/bin/dlconvertor_test 2024-08-20T22:15:48.8800694Z inflating: build/bin/extension_backend_test 2024-08-20T22:15:48.8856399Z inflating: build/bin/half_test 2024-08-20T22:15:48.8952994Z inflating: build/bin/ivalue_test 2024-08-20T22:15:48.9003068Z inflating: build/bin/lazy_tensor_test 2024-08-20T22:15:48.9058028Z inflating: build/bin/math_kernel_test 2024-08-20T22:15:48.9112592Z inflating: build/bin/memory_format_test 2024-08-20T22:15:48.9166443Z inflating: build/bin/memory_overlapping_test 2024-08-20T22:15:48.9220370Z inflating: build/bin/mobile_memory_cleanup 2024-08-20T22:15:48.9276850Z inflating: build/bin/native_test 2024-08-20T22:15:48.9329409Z inflating: build/bin/operator_name_test 2024-08-20T22:15:48.9382293Z inflating: build/bin/operators_test 2024-08-20T22:15:48.9434538Z inflating: build/bin/packedtensoraccessor_test 2024-08-20T22:15:48.9502387Z inflating: build/bin/pow_test 2024-08-20T22:15:48.9559704Z inflating: build/bin/quantized_test 2024-08-20T22:15:48.9610134Z inflating: build/bin/reduce_ops_test 2024-08-20T22:15:48.9662128Z inflating: build/bin/reportMemoryUsage_test 2024-08-20T22:15:48.9720202Z inflating: build/bin/scalar_tensor_test 2024-08-20T22:15:48.9780511Z inflating: build/bin/scalar_test 2024-08-20T22:15:48.9832778Z inflating: build/bin/StorageUtils_test 2024-08-20T22:15:48.9886019Z inflating: build/bin/stride_properties_test 2024-08-20T22:15:48.9965587Z inflating: build/bin/tensor_iterator_test 2024-08-20T22:15:49.0020183Z inflating: build/bin/test_parallel 2024-08-20T22:15:49.0023282Z inflating: build/bin/thread_init_test 2024-08-20T22:15:49.0079775Z inflating: build/bin/type_ptr_test 2024-08-20T22:15:49.0141377Z inflating: build/bin/type_test 2024-08-20T22:15:49.0193124Z inflating: build/bin/undefined_tensor_test 2024-08-20T22:15:49.0194924Z inflating: build/bin/verify_api_visibility 2024-08-20T22:15:49.0264967Z inflating: build/bin/legacy_vmap_test 2024-08-20T22:15:49.0317325Z inflating: build/bin/weakref_test 2024-08-20T22:15:49.0368917Z inflating: build/bin/wrapdim_test 2024-08-20T22:15:49.0422117Z inflating: build/bin/xla_tensor_test 2024-08-20T22:15:49.0482737Z inflating: build/bin/IListRef_test 2024-08-20T22:15:49.0589827Z inflating: build/bin/List_test 2024-08-20T22:15:49.0656819Z inflating: build/bin/KernelFunction_test 2024-08-20T22:15:49.0781434Z inflating: build/bin/kernel_function_legacy_test 2024-08-20T22:15:49.0878472Z inflating: build/bin/kernel_function_test 2024-08-20T22:15:49.1008769Z inflating: build/bin/kernel_lambda_legacy_test 2024-08-20T22:15:49.1113301Z inflating: build/bin/kernel_lambda_test 2024-08-20T22:15:49.1175100Z inflating: build/bin/kernel_stackbased_test 2024-08-20T22:15:49.1275899Z inflating: build/bin/make_boxed_from_unboxed_functor_test 2024-08-20T22:15:49.1326773Z inflating: build/bin/CppSignature_test 2024-08-20T22:15:49.1376609Z inflating: build/bin/op_allowlist_test 2024-08-20T22:15:49.1432485Z inflating: build/bin/backend_fallback_test 2024-08-20T22:15:49.1737204Z inflating: build/bin/op_registration_test 2024-08-20T22:15:49.1804126Z inflating: build/bin/inline_container_test 2024-08-20T22:15:49.1857499Z inflating: build/bin/cuda_apply_test 2024-08-20T22:15:49.1909861Z inflating: build/bin/cuda_allocator_test 2024-08-20T22:15:49.1969973Z inflating: build/bin/cuda_atomic_ops_test 2024-08-20T22:15:49.2024451Z inflating: build/bin/cuda_caching_host_allocator_test 2024-08-20T22:15:49.2095358Z inflating: build/bin/cuda_complex_math_test 2024-08-20T22:15:49.2155176Z inflating: build/bin/cuda_complex_test 2024-08-20T22:15:49.2205240Z inflating: build/bin/cuda_device_test 2024-08-20T22:15:49.2262969Z inflating: build/bin/cuda_cub_test 2024-08-20T22:15:49.2314395Z inflating: build/bin/cuda_dlconvertor_test 2024-08-20T22:15:49.2379928Z inflating: build/bin/cuda_distributions_test 2024-08-20T22:15:49.2437553Z inflating: build/bin/cuda_generator_test 2024-08-20T22:15:49.2487375Z inflating: build/bin/cuda_half_test 2024-08-20T22:15:49.2538989Z inflating: build/bin/cuda_integer_divider_test 2024-08-20T22:15:49.2588841Z inflating: build/bin/cuda_optional_test 2024-08-20T22:15:49.2641182Z inflating: build/bin/cuda_packedtensoraccessor_test 2024-08-20T22:15:49.2694046Z inflating: build/bin/cuda_reportMemoryUsage_test 2024-08-20T22:15:49.2744937Z inflating: build/bin/cuda_allocatorTraceTracker_test 2024-08-20T22:15:49.2806154Z inflating: build/bin/cuda_stream_test 2024-08-20T22:15:49.2857468Z inflating: build/bin/cuda_cudnn_test 2024-08-20T22:15:49.2909798Z inflating: build/bin/cuda_vectorized_test 2024-08-20T22:15:49.2924567Z inflating: build/bin/tutorial_tensorexpr 2024-08-20T22:15:49.2990654Z inflating: build/bin/ProcessGroupGlooTest 2024-08-20T22:15:49.3048875Z inflating: build/bin/ProcessGroupGlooAsyncTest 2024-08-20T22:15:49.3112880Z inflating: build/bin/ProcessGroupNCCLTest 2024-08-20T22:15:49.3176301Z inflating: build/bin/ProcessGroupNCCLErrorsTest 2024-08-20T22:15:49.4009910Z inflating: build/bin/test_tensorexpr 2024-08-20T22:15:49.4593608Z inflating: build/bin/test_jit 2024-08-20T22:15:49.4594054Z creating: .additional_ci_files/ 2024-08-20T22:15:49.4654823Z inflating: .additional_ci_files/test-times.json 2024-08-20T22:15:49.4896122Z inflating: .additional_ci_files/test-class-times.json 2024-08-20T22:15:49.4936088Z ##[group]Run rm artifacts.zip 2024-08-20T22:15:49.4936488Z rm artifacts.zip 2024-08-20T22:15:49.4946778Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:15:49.4947266Z env: 2024-08-20T22:15:49.4947543Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:49.4947991Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:49.4948464Z ##[endgroup] 2024-08-20T22:15:49.6058173Z ##[group]Run df -H 2024-08-20T22:15:49.6058495Z df -H 2024-08-20T22:15:49.6067476Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:15:49.6067966Z env: 2024-08-20T22:15:49.6068239Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:49.6068679Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:49.6069330Z ##[endgroup] 2024-08-20T22:15:49.6116976Z Filesystem Size Used Avail Use% Mounted on 2024-08-20T22:15:49.6117539Z devtmpfs 4.2M 0 4.2M 0% /dev 2024-08-20T22:15:49.6118245Z tmpfs 34G 0 34G 0% /dev/shm 2024-08-20T22:15:49.6118858Z tmpfs 14G 553k 14G 1% /run 2024-08-20T22:15:49.6119457Z /dev/nvme0n1p1 161G 84G 78G 52% / 2024-08-20T22:15:49.6120312Z tmpfs 34G 1.7M 34G 1% /tmp 2024-08-20T22:15:49.6120974Z /dev/nvme0n1p128 11M 1.4M 9.2M 13% /boot/efi 2024-08-20T22:15:49.6121485Z tmpfs 6.7G 0 6.7G 0% /run/user/0 2024-08-20T22:15:49.6163367Z Prepare all required actions 2024-08-20T22:15:49.6163802Z Getting action download info 2024-08-20T22:15:49.7424163Z ##[group]Run ./.github/actions/download-td-artifacts 2024-08-20T22:15:49.7424616Z with: 2024-08-20T22:15:49.7424873Z env: 2024-08-20T22:15:49.7425148Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:49.7425585Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:49.7426077Z ##[endgroup] 2024-08-20T22:15:49.7459615Z ##[group]Run seemethere/download-artifact-s3@v4 2024-08-20T22:15:49.7460047Z with: 2024-08-20T22:15:49.7460306Z name: td_results 2024-08-20T22:15:49.7460620Z s3-bucket: gha-artifacts 2024-08-20T22:15:49.7460958Z region: us-east-1 2024-08-20T22:15:49.7461254Z env: 2024-08-20T22:15:49.7461516Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:49.7461956Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:49.7462426Z ##[endgroup] 2024-08-20T22:15:50.2231494Z (node:347449) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2024-08-20T22:15:50.2232197Z 2024-08-20T22:15:50.2232467Z Please migrate your code to use AWS SDK for JavaScript (v3). 2024-08-20T22:15:50.2233183Z For more information, check the migration guide at https://a.co/7PzMCcy 2024-08-20T22:15:50.2234160Z (Use `node --trace-warnings ...` to show where the warning was created) 2024-08-20T22:15:50.2791670Z Found 0 objects with prefix pytorch/pytorch/10479310721/td_results/ 2024-08-20T22:15:50.2797996Z Artifact download has finished successfully 2024-08-20T22:15:50.3118873Z ##[group]Run mkdir -p .additional_ci_files 2024-08-20T22:15:50.3119363Z mkdir -p .additional_ci_files 2024-08-20T22:15:50.3119925Z mv td_results.json .additional_ci_files/td_results.json 2024-08-20T22:15:50.3130936Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:15:50.3131432Z env: 2024-08-20T22:15:50.3131713Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:50.3132178Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:50.3132666Z ##[endgroup] 2024-08-20T22:15:50.3189622Z mv: cannot stat 'td_results.json': No such file or directory 2024-08-20T22:15:50.3202732Z ##[error]Process completed with exit code 1. 2024-08-20T22:15:50.3237258Z ##[group]Run .github/scripts/parse_ref.py 2024-08-20T22:15:50.3237736Z .github/scripts/parse_ref.py 2024-08-20T22:15:50.3246991Z shell: /usr/bin/bash -e {0} 2024-08-20T22:15:50.3247338Z env: 2024-08-20T22:15:50.3247609Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:50.3248052Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:50.3248519Z ##[endgroup] 2024-08-20T22:15:50.3535066Z Prepare all required actions 2024-08-20T22:15:50.3575617Z ##[group]Run ./.github/actions/get-workflow-job-id 2024-08-20T22:15:50.3576062Z with: 2024-08-20T22:15:50.3576596Z github-token: *** 2024-08-20T22:15:50.3576904Z env: 2024-08-20T22:15:50.3577171Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:50.3577617Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:50.3578124Z ##[endgroup] 2024-08-20T22:15:50.3594763Z ##[group]Run set -eux 2024-08-20T22:15:50.3595098Z set -eux 2024-08-20T22:15:50.3595673Z python3 .github/scripts/get_workflow_job_id.py "${GITHUB_RUN_ID}" "${RUNNER_NAME}" 2024-08-20T22:15:50.3604284Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:15:50.3604993Z env: 2024-08-20T22:15:50.3605270Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:50.3605721Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:50.3606352Z GITHUB_TOKEN: *** 2024-08-20T22:15:50.3606661Z ##[endgroup] 2024-08-20T22:15:50.3635147Z + python3 .github/scripts/get_workflow_job_id.py 10479310721 i-0a5ee6a6662a7d0e6 2024-08-20T22:15:50.9369254Z setting job-id=29026298662 2024-08-20T22:15:50.9370282Z setting job-name=cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (dynamo_eager_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:15:50.9590145Z Prepare all required actions 2024-08-20T22:15:50.9590590Z Getting action download info 2024-08-20T22:15:51.1039819Z ##[group]Run ./.github/actions/filter-test-configs 2024-08-20T22:15:51.1040271Z with: 2024-08-20T22:15:51.1040929Z github-token: *** 2024-08-20T22:15:51.1047393Z test-matrix: {"include": [{"config": "dynamo_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}]} 2024-08-20T22:15:51.1054729Z job-name: cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (dynamo_eager_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:15:51.1055589Z env: 2024-08-20T22:15:51.1055860Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:51.1056312Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:51.1056788Z ##[endgroup] 2024-08-20T22:15:51.1098725Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2024-08-20T22:15:51.1099264Z with: 2024-08-20T22:15:51.1099531Z shell: bash 2024-08-20T22:15:51.1099833Z timeout_minutes: 10 2024-08-20T22:15:51.1100147Z max_attempts: 5 2024-08-20T22:15:51.1100460Z retry_wait_seconds: 30 2024-08-20T22:15:51.1101554Z command: set -eux # PyYAML 6.0 doesn't work with MacOS x86 anymore # This must run on Python-3.7 (AmazonLinux2) so can't use request=3.32.2 python3 -m pip install requests==2.27.1 pyyaml==6.0.1 2024-08-20T22:15:51.1102696Z polling_interval_seconds: 1 2024-08-20T22:15:51.1103064Z warning_on_retry: true 2024-08-20T22:15:51.1103406Z continue_on_error: false 2024-08-20T22:15:51.1103742Z env: 2024-08-20T22:15:51.1104014Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:51.1104446Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:51.1105074Z GITHUB_TOKEN: *** 2024-08-20T22:15:51.1105383Z ##[endgroup] 2024-08-20T22:15:51.3530793Z + python3 -m pip install requests==2.27.1 pyyaml==6.0.1 2024-08-20T22:15:51.6462024Z Requirement already satisfied: requests==2.27.1 in /home/ec2-user/miniconda/lib/python3.12/site-packages (2.27.1) 2024-08-20T22:15:51.6463764Z Requirement already satisfied: pyyaml==6.0.1 in /home/ec2-user/miniconda/lib/python3.12/site-packages (6.0.1) 2024-08-20T22:15:51.6486710Z Requirement already satisfied: urllib3<1.27,>=1.21.1 in /home/ec2-user/miniconda/lib/python3.12/site-packages (from requests==2.27.1) (1.26.19) 2024-08-20T22:15:51.6490082Z Requirement already satisfied: certifi>=2017.4.17 in /home/ec2-user/miniconda/lib/python3.12/site-packages (from requests==2.27.1) (2024.7.4) 2024-08-20T22:15:51.6495373Z Requirement already satisfied: charset-normalizer~=2.0.0 in /home/ec2-user/miniconda/lib/python3.12/site-packages (from requests==2.27.1) (2.0.12) 2024-08-20T22:15:51.6499846Z Requirement already satisfied: idna<4,>=2.5 in /home/ec2-user/miniconda/lib/python3.12/site-packages (from requests==2.27.1) (3.7) 2024-08-20T22:15:52.1640907Z Command completed after 1 attempt(s). 2024-08-20T22:15:52.1701541Z ##[group]Run set -x 2024-08-20T22:15:52.1701904Z set -x 2024-08-20T22:15:52.1702213Z  2024-08-20T22:15:52.1702756Z # Use relative path here as this could be checked out anywhere, not necessarily 2024-08-20T22:15:52.1703422Z # in runner workspace 2024-08-20T22:15:52.1703942Z python3 "${GITHUB_ACTION_PATH}/../../scripts/parse_ref.py" 2024-08-20T22:15:52.1713891Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:15:52.1714388Z env: 2024-08-20T22:15:52.1714663Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:52.1715114Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:52.1715611Z ##[endgroup] 2024-08-20T22:15:52.1746511Z + python3 /home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/filter-test-configs/../../scripts/parse_ref.py 2024-08-20T22:15:52.1985914Z ##[group]Run echo "Workflow: ${GITHUB_WORKFLOW}" 2024-08-20T22:15:52.1986460Z echo "Workflow: ${GITHUB_WORKFLOW}" 2024-08-20T22:15:52.1986926Z echo "Job name: ${JOB_NAME}" 2024-08-20T22:15:52.1987325Z  2024-08-20T22:15:52.1987881Z # Use relative path here as this could be checked out anywhere, not necessarily 2024-08-20T22:15:52.1988583Z # in runner workspace 2024-08-20T22:15:52.1989179Z python3 "${GITHUB_ACTION_PATH}/../../scripts/filter_test_configs.py" \ 2024-08-20T22:15:52.1989817Z  --workflow "${GITHUB_WORKFLOW}" \ 2024-08-20T22:15:52.1990271Z  --job-name "${JOB_NAME}" \ 2024-08-20T22:15:52.1996964Z  --test-matrix "{"include": [{"config": "dynamo_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}]}" \ 2024-08-20T22:15:52.2003978Z  --selected-test-configs "" \ 2024-08-20T22:15:52.2004439Z  --pr-number "${PR_NUMBER}" \ 2024-08-20T22:15:52.2004863Z  --tag "${TAG}" \ 2024-08-20T22:15:52.2005260Z  --event-name "${EVENT_NAME}" \ 2024-08-20T22:15:52.2005703Z  --schedule "${SCHEDULE}" \ 2024-08-20T22:15:52.2006135Z  --branch "${HEAD_BRANCH}" 2024-08-20T22:15:52.2015235Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:15:52.2015741Z env: 2024-08-20T22:15:52.2016022Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:52.2016479Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:52.2017155Z GITHUB_TOKEN: *** 2024-08-20T22:15:52.2017965Z JOB_NAME: cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (dynamo_eager_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:15:52.2018879Z PR_NUMBER: 2024-08-20T22:15:52.2019206Z TAG: ciflow/inductor/133712 2024-08-20T22:15:52.2019579Z EVENT_NAME: push 2024-08-20T22:15:52.2019899Z SCHEDULE: 2024-08-20T22:15:52.2020190Z HEAD_BRANCH: 2024-08-20T22:15:52.2020495Z ##[endgroup] 2024-08-20T22:15:52.2050634Z Workflow: inductor-periodic 2024-08-20T22:15:52.2051626Z Job name: cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (dynamo_eager_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:15:52.4407111Z INFO:root:Found no test-config label on the PR, so all test configs are included 2024-08-20T22:15:52.6081447Z ##[group]Run echo "Filtered matrix:" 2024-08-20T22:15:52.6081896Z echo "Filtered matrix:" 2024-08-20T22:15:52.6088396Z echo "{"include": [{"config": "dynamo_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}]}" 2024-08-20T22:15:52.6095154Z  2024-08-20T22:15:52.6095430Z echo 2024-08-20T22:15:52.6095853Z echo "Is the current job unstable? False" 2024-08-20T22:15:52.6096384Z  2024-08-20T22:15:52.6096662Z echo 2024-08-20T22:15:52.6097026Z echo "Is keep-going label set? False" 2024-08-20T22:15:52.6097457Z  2024-08-20T22:15:52.6097732Z echo 2024-08-20T22:15:52.6098049Z echo "Renabled issues? " 2024-08-20T22:15:52.6106960Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:15:52.6107445Z env: 2024-08-20T22:15:52.6107725Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:52.6108176Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:52.6108836Z ##[endgroup] 2024-08-20T22:15:52.6138227Z Filtered matrix: 2024-08-20T22:15:52.6146478Z {include: [{config: dynamo_eager_torchbench, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamo_eager_torchbench, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamo_eager_huggingface, shard: 1, num_shards: 1, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamo_eager_timm, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamo_eager_timm, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: aot_eager_torchbench, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: aot_eager_torchbench, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: aot_eager_huggingface, shard: 1, num_shards: 1, runner: linux.g5.4xlarge.nvidia.gpu}, {config: aot_eager_timm, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: aot_eager_timm, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_aot_eager_torchbench, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_aot_eager_torchbench, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_aot_eager_huggingface, shard: 1, num_shards: 1, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_aot_eager_timm, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_aot_eager_timm, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}]} 2024-08-20T22:15:52.6152971Z 2024-08-20T22:15:52.6153125Z Is the current job unstable? False 2024-08-20T22:15:52.6153517Z 2024-08-20T22:15:52.6153890Z Is keep-going label set? False 2024-08-20T22:15:52.6154146Z 2024-08-20T22:15:52.6154280Z Renabled issues? 2024-08-20T22:15:52.6197297Z ##[group]Run echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2024-08-20T22:15:52.6198000Z echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2024-08-20T22:15:52.6206251Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:15:52.6206743Z env: 2024-08-20T22:15:52.6207034Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:52.6207495Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:52.6207988Z JOB_TIMEOUT: 240 2024-08-20T22:15:52.6208297Z ##[endgroup] 2024-08-20T22:15:52.6296392Z ##[group]Run set -x 2024-08-20T22:15:52.6296798Z set -x 2024-08-20T22:15:52.6297096Z  2024-08-20T22:15:52.6297448Z if [[ $TEST_CONFIG == 'multigpu' ]]; then 2024-08-20T22:15:52.6297977Z  TEST_COMMAND=.ci/pytorch/multigpu-test.sh 2024-08-20T22:15:52.6298529Z elif [[ $BUILD_ENVIRONMENT == *onnx* ]]; then 2024-08-20T22:15:52.6299078Z  TEST_COMMAND=.ci/onnx/test.sh 2024-08-20T22:15:52.6299488Z else 2024-08-20T22:15:52.6299821Z  TEST_COMMAND=.ci/pytorch/test.sh 2024-08-20T22:15:52.6300234Z fi 2024-08-20T22:15:52.6300508Z  2024-08-20T22:15:52.6300982Z # detached container should get cleaned up by teardown_ec2_linux 2024-08-20T22:15:52.6301712Z # TODO: Stop building test binaries as part of the build phase 2024-08-20T22:15:52.6302373Z # Used for GPU_FLAG since that doesn't play nice 2024-08-20T22:15:52.6302945Z # shellcheck disable=SC2086,SC2090 2024-08-20T22:15:52.6303395Z container_name=$(docker run \ 2024-08-20T22:15:52.6303806Z  ${GPU_FLAG:-} \ 2024-08-20T22:15:52.6304171Z  -e BUILD_ENVIRONMENT \ 2024-08-20T22:15:52.6304561Z  -e PR_NUMBER \ 2024-08-20T22:15:52.6304910Z  -e GITHUB_ACTIONS \ 2024-08-20T22:15:52.6305297Z  -e GITHUB_REPOSITORY \ 2024-08-20T22:15:52.6305700Z  -e GITHUB_WORKFLOW \ 2024-08-20T22:15:52.6306084Z  -e GITHUB_JOB \ 2024-08-20T22:15:52.6306435Z  -e GITHUB_RUN_ID \ 2024-08-20T22:15:52.6306813Z  -e GITHUB_RUN_NUMBER \ 2024-08-20T22:15:52.6307214Z  -e GITHUB_RUN_ATTEMPT \ 2024-08-20T22:15:52.6307781Z  -e JOB_ID \ 2024-08-20T22:15:52.6308110Z  -e JOB_NAME \ 2024-08-20T22:15:52.6308453Z  -e BASE_SHA \ 2024-08-20T22:15:52.6308817Z  -e BRANCH \ 2024-08-20T22:15:52.6309166Z  -e SHA1 \ 2024-08-20T22:15:52.6309509Z  -e AWS_DEFAULT_REGION \ 2024-08-20T22:15:52.6309906Z  -e IN_WHEEL_TEST \ 2024-08-20T22:15:52.6310275Z  -e SHARD_NUMBER \ 2024-08-20T22:15:52.6310632Z  -e TEST_CONFIG \ 2024-08-20T22:15:52.6311001Z  -e NUM_TEST_SHARDS \ 2024-08-20T22:15:52.6311385Z  -e REENABLED_ISSUES \ 2024-08-20T22:15:52.6311789Z  -e CONTINUE_THROUGH_ERROR \ 2024-08-20T22:15:52.6312200Z  -e VERBOSE_TEST_LOGS \ 2024-08-20T22:15:52.6312595Z  -e TEST_SHOWLOCALS \ 2024-08-20T22:15:52.6312979Z  -e NO_TEST_TIMEOUT \ 2024-08-20T22:15:52.6313484Z  -e NO_TD \ 2024-08-20T22:15:52.6313816Z  -e TD_DISTRIBUTED \ 2024-08-20T22:15:52.6314197Z  -e PR_LABELS \ 2024-08-20T22:15:52.6314605Z  -e MAX_JOBS="$(nproc --ignore=2)" \ 2024-08-20T22:15:52.6315048Z  -e SCCACHE_BUCKET \ 2024-08-20T22:15:52.6315437Z  -e SCCACHE_S3_KEY_PREFIX \ 2024-08-20T22:15:52.6315840Z  -e XLA_CUDA \ 2024-08-20T22:15:52.6316239Z  -e XLA_CLANG_CACHE_S3_BUCKET_NAME \ 2024-08-20T22:15:52.6316733Z  -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK \ 2024-08-20T22:15:52.6317243Z  -e PYTORCH_TEST_RERUN_DISABLED_TESTS \ 2024-08-20T22:15:52.6317756Z  -e SKIP_SCCACHE_INITIALIZATION=1 \ 2024-08-20T22:15:52.6318217Z  -e HUGGING_FACE_HUB_TOKEN \ 2024-08-20T22:15:52.6318656Z  -e SCRIBE_GRAPHQL_ACCESS_TOKEN \ 2024-08-20T22:15:52.6319089Z  -e DASHBOARD_TAG \ 2024-08-20T22:15:52.6319557Z  --env-file="/tmp/github_env_${GITHUB_RUN_ID}" \ 2024-08-20T22:15:52.6320098Z  --security-opt seccomp=unconfined \ 2024-08-20T22:15:52.6320556Z  --cap-add=SYS_PTRACE \ 2024-08-20T22:15:52.6320940Z  --ipc=host \ 2024-08-20T22:15:52.6321291Z  --shm-size="${SHM_SIZE}" \ 2024-08-20T22:15:52.6321681Z  --tty \ 2024-08-20T22:15:52.6321984Z  --detach \ 2024-08-20T22:15:52.6322468Z  --name="${container_name}" \ 2024-08-20T22:15:52.6322882Z  --user jenkins \ 2024-08-20T22:15:52.6323356Z  -v "${GITHUB_WORKSPACE}:/var/lib/jenkins/workspace" \ 2024-08-20T22:15:52.6323898Z  -w /var/lib/jenkins/workspace \ 2024-08-20T22:15:52.6324331Z  "${DOCKER_IMAGE}" 2024-08-20T22:15:52.6324676Z ) 2024-08-20T22:15:52.6325074Z # Propagate download.pytorch.org IP to container 2024-08-20T22:15:52.6325967Z grep download.pytorch.org /etc/hosts | docker exec -i "${container_name}" sudo bash -c "/bin/cat >> /etc/hosts" 2024-08-20T22:15:52.6326905Z echo "DOCKER_CONTAINER_ID=${container_name}" >> "${GITHUB_ENV}" 2024-08-20T22:15:52.6327800Z docker exec -t "${container_name}" sh -c "pip install $(echo dist/*.whl)[opt-einsum] && ${TEST_COMMAND}" 2024-08-20T22:15:52.6336889Z shell: /usr/bin/bash -e {0} 2024-08-20T22:15:52.6337233Z env: 2024-08-20T22:15:52.6337508Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:52.6337964Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:52.6338563Z BUILD_ENVIRONMENT: linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-08-20T22:15:52.6339057Z PR_NUMBER: 2024-08-20T22:15:52.6339384Z GITHUB_REPOSITORY: pytorch/pytorch 2024-08-20T22:15:52.6339813Z GITHUB_WORKFLOW: inductor-periodic 2024-08-20T22:15:52.6340215Z GITHUB_JOB: test 2024-08-20T22:15:52.6340525Z GITHUB_RUN_ID: 10479310721 2024-08-20T22:15:52.6341180Z GITHUB_RUN_NUMBER: 54565 2024-08-20T22:15:52.6341533Z GITHUB_RUN_ATTEMPT: 1 2024-08-20T22:15:52.6341863Z JOB_ID: 29026298662 2024-08-20T22:15:52.6342653Z JOB_NAME: cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (dynamo_eager_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:15:52.6343665Z BRANCH: 2024-08-20T22:15:52.6344004Z SHA1: 40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:15:52.6344520Z BASE_SHA: 40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:15:52.6344987Z TEST_CONFIG: dynamo_eager_timm 2024-08-20T22:15:52.6345364Z SHARD_NUMBER: 2 2024-08-20T22:15:52.6345674Z NUM_TEST_SHARDS: 2 2024-08-20T22:15:52.6345996Z REENABLED_ISSUES: 2024-08-20T22:15:52.6346326Z CONTINUE_THROUGH_ERROR: False 2024-08-20T22:15:52.6346711Z VERBOSE_TEST_LOGS: False 2024-08-20T22:15:52.6347068Z TEST_SHOWLOCALS: False 2024-08-20T22:15:52.6347405Z NO_TEST_TIMEOUT: False 2024-08-20T22:15:52.6347736Z NO_TD: False 2024-08-20T22:15:52.6348035Z TD_DISTRIBUTED: False 2024-08-20T22:15:52.6348454Z SCCACHE_BUCKET: ossci-compiler-cache-circleci-v2 2024-08-20T22:15:52.6348956Z SCCACHE_S3_KEY_PREFIX: inductor-periodic 2024-08-20T22:15:52.6349376Z SHM_SIZE: 2g 2024-08-20T22:15:52.6350448Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:15:52.6351596Z XLA_CUDA: 2024-08-20T22:15:52.6352066Z XLA_CLANG_CACHE_S3_BUCKET_NAME: ossci-compiler-clang-cache-circleci-xla 2024-08-20T22:15:52.6352674Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK: 0 2024-08-20T22:15:52.6353116Z PYTORCH_TEST_RERUN_DISABLED_TESTS: 0 2024-08-20T22:15:52.6353583Z DASHBOARD_TAG: 2024-08-20T22:15:52.6354099Z HUGGING_FACE_HUB_TOKEN: *** 2024-08-20T22:15:52.6354470Z SCRIBE_GRAPHQL_ACCESS_TOKEN: 2024-08-20T22:15:52.6354844Z ##[endgroup] 2024-08-20T22:15:52.6385456Z + [[ dynamo_eager_timm == \m\u\l\t\i\g\p\u ]] 2024-08-20T22:15:52.6386279Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *onnx* ]] 2024-08-20T22:15:52.6386793Z + TEST_COMMAND=.ci/pytorch/test.sh 2024-08-20T22:15:52.6394774Z +++ nproc --ignore=2 2024-08-20T22:15:52.6413356Z ++ docker run --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all -e BUILD_ENVIRONMENT -e PR_NUMBER -e GITHUB_ACTIONS -e GITHUB_REPOSITORY -e GITHUB_WORKFLOW -e GITHUB_JOB -e GITHUB_RUN_ID -e GITHUB_RUN_NUMBER -e GITHUB_RUN_ATTEMPT -e JOB_ID -e JOB_NAME -e BASE_SHA -e BRANCH -e SHA1 -e AWS_DEFAULT_REGION -e IN_WHEEL_TEST -e SHARD_NUMBER -e TEST_CONFIG -e NUM_TEST_SHARDS -e REENABLED_ISSUES -e CONTINUE_THROUGH_ERROR -e VERBOSE_TEST_LOGS -e TEST_SHOWLOCALS -e NO_TEST_TIMEOUT -e NO_TD -e TD_DISTRIBUTED -e PR_LABELS -e MAX_JOBS=14 -e SCCACHE_BUCKET -e SCCACHE_S3_KEY_PREFIX -e XLA_CUDA -e XLA_CLANG_CACHE_S3_BUCKET_NAME -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK -e PYTORCH_TEST_RERUN_DISABLED_TESTS -e SKIP_SCCACHE_INITIALIZATION=1 -e HUGGING_FACE_HUB_TOKEN -e SCRIBE_GRAPHQL_ACCESS_TOKEN -e DASHBOARD_TAG --env-file=/tmp/github_env_10479310721 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --ipc=host --shm-size=2g --tty --detach --name= --user jenkins -v /home/ec2-user/actions-runner/_work/pytorch/pytorch:/var/lib/jenkins/workspace -w /var/lib/jenkins/workspace 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:16:04.0774989Z + container_name=768314b6a62fac9424a7bd24ada8625de3b4767f59ae33124fb6f2af07dc16eb 2024-08-20T22:16:04.0776905Z + grep download.pytorch.org /etc/hosts 2024-08-20T22:16:04.0780101Z + docker exec -i 768314b6a62fac9424a7bd24ada8625de3b4767f59ae33124fb6f2af07dc16eb sudo bash -c '/bin/cat >> /etc/hosts' 2024-08-20T22:16:04.2114696Z + echo DOCKER_CONTAINER_ID=768314b6a62fac9424a7bd24ada8625de3b4767f59ae33124fb6f2af07dc16eb 2024-08-20T22:16:04.2119309Z ++ echo dist/torch-2.5.0a0+git40ec5f6-cp310-cp310-linux_x86_64.whl 2024-08-20T22:16:04.2122520Z + docker exec -t 768314b6a62fac9424a7bd24ada8625de3b4767f59ae33124fb6f2af07dc16eb sh -c 'pip install dist/torch-2.5.0a0+git40ec5f6-cp310-cp310-linux_x86_64.whl[opt-einsum] && .ci/pytorch/test.sh' 2024-08-20T22:16:04.6113514Z Processing ./dist/torch-2.5.0a0+git40ec5f6-cp310-cp310-linux_x86_64.whl (from torch==2.5.0a0+git40ec5f6) 2024-08-20T22:16:04.9387612Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (3.13.1) 2024-08-20T22:16:04.9391329Z Requirement already satisfied: typing-extensions>=4.8.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (4.12.2) 2024-08-20T22:16:04.9394130Z Requirement already satisfied: networkx in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (2.8.8) 2024-08-20T22:16:04.9396529Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (3.1.4) 2024-08-20T22:16:04.9400153Z Requirement already satisfied: fsspec in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (2024.6.1) 2024-08-20T22:16:04.9405334Z Requirement already satisfied: sympy==1.13.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (1.13.1) 2024-08-20T22:16:04.9421769Z Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from sympy==1.13.1->torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (1.3.0) 2024-08-20T22:16:04.9435140Z Requirement already satisfied: opt-einsum>=3.3 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (3.3.0) 2024-08-20T22:16:04.9453010Z Requirement already satisfied: numpy>=1.7 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from opt-einsum>=3.3->torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (1.22.4) 2024-08-20T22:16:04.9842255Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from jinja2->torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (2.1.5) 2024-08-20T22:16:05.5634788Z Installing collected packages: torch 2024-08-20T22:16:15.3902894Z ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 2024-08-20T22:16:15.3904705Z timm 1.0.9.dev0 requires torchvision, which is not installed. 2024-08-20T22:16:15.3905890Z Successfully installed torch-2.5.0a0+git40ec5f6 2024-08-20T22:16:15.4737288Z + export TERM=vt100 2024-08-20T22:16:15.4737636Z + TERM=vt100 2024-08-20T22:16:15.4741079Z ++ dirname .ci/pytorch/test.sh 2024-08-20T22:16:15.4752119Z + source .ci/pytorch/common.sh 2024-08-20T22:16:15.4756386Z +++ dirname .ci/pytorch/common.sh 2024-08-20T22:16:15.4766206Z ++ source .ci/pytorch/common_utils.sh 2024-08-20T22:16:15.4767810Z +++ declare -f -t trap_add 2024-08-20T22:16:15.4773500Z ++ set -ex 2024-08-20T22:16:15.4773973Z ++ [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *rocm* ]] 2024-08-20T22:16:15.4774474Z ++ BUILD_TEST_LIBTORCH=0 2024-08-20T22:16:15.4778734Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *rocm* ]] 2024-08-20T22:16:15.4779360Z ++ stat -c %u /var/lib/jenkins/workspace 2024-08-20T22:16:15.4798161Z + WORKSPACE_ORIGINAL_OWNER_ID=1000 2024-08-20T22:16:15.4798792Z + trap_add cleanup_workspace EXIT 2024-08-20T22:16:15.4799240Z + trap_add_cmd=cleanup_workspace 2024-08-20T22:16:15.4799642Z + shift 2024-08-20T22:16:15.4799920Z + for trap_add_name in "$@" 2024-08-20T22:16:15.4806849Z +++ trap -p EXIT 2024-08-20T22:16:15.4810254Z ++ eval 'extract_trap_cmd ' 2024-08-20T22:16:15.4810640Z +++ extract_trap_cmd 2024-08-20T22:16:15.4810995Z +++ printf '%s\n' '' 2024-08-20T22:16:15.4811386Z ++ printf '%s\n' cleanup_workspace 2024-08-20T22:16:15.4813856Z + trap -- ' 2024-08-20T22:16:15.4814190Z cleanup_workspace' EXIT 2024-08-20T22:16:15.4814660Z + sudo chown -R jenkins /var/lib/jenkins/workspace 2024-08-20T22:16:16.1971679Z + git config --global --add safe.directory /var/lib/jenkins/workspace 2024-08-20T22:16:16.1994795Z + echo 'Environment variables:' 2024-08-20T22:16:16.1995605Z Environment variables: 2024-08-20T22:16:16.1995933Z + env 2024-08-20T22:16:16.2006315Z INSTALLED_DB=yes 2024-08-20T22:16:16.2007876Z NV_LIBCUBLAS_VERSION=12.1.3.1-1 2024-08-20T22:16:16.2008505Z NVIDIA_VISIBLE_DEVICES=all 2024-08-20T22:16:16.2008973Z NV_NVML_DEV_VERSION=12.1.105-1 2024-08-20T22:16:16.2009757Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-20T22:16:16.2010337Z CONTINUE_THROUGH_ERROR=False 2024-08-20T22:16:16.2010853Z NV_LIBNCCL_DEV_PACKAGE=libnccl-dev=2.17.1-1+cuda12.1 2024-08-20T22:16:16.2011413Z NV_LIBNCCL_DEV_PACKAGE_VERSION=2.17.1-1 2024-08-20T22:16:16.2012028Z BUILD_ENVIRONMENT=linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-08-20T22:16:16.2012605Z HOSTNAME=768314b6a62f 2024-08-20T22:16:16.2013548Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_c3f0cef5-d2e8-48be-8fb8-eb8f62f5ede5 2024-08-20T22:16:16.2014420Z GITHUB_ACTION=__self 2024-08-20T22:16:16.2014791Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2024-08-20T22:16:16.2019018Z NVIDIA_REQUIRE_CUDA=cuda>=12.1 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 brand=tesla,driver>=525,driver<526 brand=unknown,driver>=525,driver<526 brand=nvidia,driver>=525,driver<526 brand=nvidiartx,driver>=525,driver<526 brand=geforce,driver>=525,driver<526 brand=geforcertx,driver>=525,driver<526 brand=quadro,driver>=525,driver<526 brand=quadrortx,driver>=525,driver<526 brand=titan,driver>=525,driver<526 brand=titanrtx,driver>=525,driver<526 2024-08-20T22:16:16.2022920Z NV_LIBCUBLAS_DEV_PACKAGE=libcublas-dev-12-1=12.1.3.1-1 2024-08-20T22:16:16.2023425Z NV_NVTX_VERSION=12.1.105-1 2024-08-20T22:16:16.2023775Z GITHUB_RUN_NUMBER=54565 2024-08-20T22:16:16.2024130Z TEST_CONFIG=dynamo_eager_timm 2024-08-20T22:16:16.2024592Z GITHUB_REPOSITORY_OWNER_ID=21003710 2024-08-20T22:16:16.2025066Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2024-08-20T22:16:16.2025533Z NV_CUDA_CUDART_DEV_VERSION=12.1.105-1 2024-08-20T22:16:16.2025982Z NV_LIBCUSPARSE_VERSION=12.1.0.106-1 2024-08-20T22:16:16.2026684Z SCRIBE_GRAPHQL_ACCESS_TOKEN= 2024-08-20T22:16:16.2027092Z NV_LIBNPP_VERSION=12.1.0.40-1 2024-08-20T22:16:16.2027543Z GITHUB_TRIGGERING_ACTOR=pytorch-bot[bot] 2024-08-20T22:16:16.2028038Z CMAKE_CUDA_COMPILER_LAUNCHER=/opt/cache/bin/sccache 2024-08-20T22:16:16.2028496Z GITHUB_REF_TYPE=tag 2024-08-20T22:16:16.2028815Z TORCH_CUDA_ARCH_LIST=Maxwell 2024-08-20T22:16:16.2029193Z NCCL_VERSION=2.17.1-1 2024-08-20T22:16:16.2029582Z BASE_SHA=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:16:16.2030012Z XLA_CUDA= 2024-08-20T22:16:16.2030527Z HUGGING_FACE_HUB_TOKEN=*** 2024-08-20T22:16:16.2032833Z *** 2024-08-20T22:16:16.2033150Z CARGO_NET_GIT_FETCH_WITH_CLI=true 2024-08-20T22:16:16.2033695Z GITHUB_REPOSITORY_ID=65600975 2024-08-20T22:16:16.2034058Z GITHUB_ACTIONS=true 2024-08-20T22:16:16.2034390Z NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:16:16.2034907Z NV_NVPROF_DEV_PACKAGE=cuda-nvprof-12-1=12.1.105-1 2024-08-20T22:16:16.2035437Z NV_LIBNPP_PACKAGE=libnpp-12-1=12.1.0.40-1 2024-08-20T22:16:16.2035918Z SHA1=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:16:16.2036481Z NV_LIBNCCL_DEV_PACKAGE_NAME=libnccl-dev 2024-08-20T22:16:16.2036961Z GITHUB_SHA=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:16:16.2037878Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/inductor-periodic.yml@refs/tags/ciflow/inductor/133712 2024-08-20T22:16:16.2038628Z UCC_HOME=/usr 2024-08-20T22:16:16.2038969Z NV_LIBCUBLAS_DEV_VERSION=12.1.3.1-1 2024-08-20T22:16:16.2039370Z VERBOSE_TEST_LOGS=False 2024-08-20T22:16:16.2039710Z NVIDIA_PRODUCT_NAME=CUDA 2024-08-20T22:16:16.2040173Z NV_LIBCUBLAS_DEV_PACKAGE_NAME=libcublas-dev-12-1 2024-08-20T22:16:16.2040985Z GITHUB_REF=refs/tags/ciflow/inductor/133712 2024-08-20T22:16:16.2041848Z NV_CUDA_CUDART_VERSION=12.1.105-1 2024-08-20T22:16:16.2042224Z SHARD_NUMBER=2 2024-08-20T22:16:16.2042539Z GITHUB_REF_PROTECTED=false 2024-08-20T22:16:16.2042895Z HOME=/var/lib/jenkins 2024-08-20T22:16:16.2043253Z GITHUB_API_URL=https://api.github.com 2024-08-20T22:16:16.2043692Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2024-08-20T22:16:16.2044161Z UCX_COMMIT=7bb2722ff2187a0cad557ae4a6afa090569f83fb 2024-08-20T22:16:16.2044715Z SCCACHE_S3_KEY_PREFIX=inductor-periodic 2024-08-20T22:16:16.2045123Z CUDA_VERSION=12.1.1 2024-08-20T22:16:16.2045550Z NV_LIBCUBLAS_PACKAGE=libcublas-12-1=12.1.3.1-1 2024-08-20T22:16:16.2045988Z NUM_TEST_SHARDS=2 2024-08-20T22:16:16.2046339Z UCX_HOME=/usr 2024-08-20T22:16:16.2046853Z NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE=cuda-nsight-compute-12-1=12.1.1-1 2024-08-20T22:16:16.2047921Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_c3f0cef5-d2e8-48be-8fb8-eb8f62f5ede5 2024-08-20T22:16:16.2049310Z JOB_NAME=cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (dynamo_eager_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:16:16.2050673Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_c3f0cef5-d2e8-48be-8fb8-eb8f62f5ede5 2024-08-20T22:16:16.2051781Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2024-08-20T22:16:16.2052431Z GITHUB_EVENT_NAME=push 2024-08-20T22:16:16.2052765Z DASHBOARD_TAG= 2024-08-20T22:16:16.2053071Z GITHUB_RUN_ID=10479310721 2024-08-20T22:16:16.2053529Z NV_LIBNPP_DEV_PACKAGE=libnpp-dev-12-1=12.1.0.40-1 2024-08-20T22:16:16.2054067Z NV_LIBCUBLAS_PACKAGE_NAME=libcublas-12-1 2024-08-20T22:16:16.2055064Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_c3f0cef5-d2e8-48be-8fb8-eb8f62f5ede5 2024-08-20T22:16:16.2056020Z GITHUB_ACTOR=pytorch-bot[bot] 2024-08-20T22:16:16.2056423Z NV_LIBNPP_DEV_VERSION=12.1.0.40-1 2024-08-20T22:16:16.2056797Z PR_NUMBER= 2024-08-20T22:16:16.2057086Z GITHUB_RUN_ATTEMPT=1 2024-08-20T22:16:16.2057422Z ANACONDA_PYTHON_VERSION=3.10 2024-08-20T22:16:16.2057860Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2024-08-20T22:16:16.2058311Z TERM=vt100 2024-08-20T22:16:16.2058649Z NV_LIBCUSPARSE_DEV_VERSION=12.1.0.106-1 2024-08-20T22:16:16.2059058Z INSTALLED_VISION=yes 2024-08-20T22:16:16.2059373Z BRANCH= 2024-08-20T22:16:16.2059808Z OPENSSL_ROOT_DIR=/opt/openssl 2024-08-20T22:16:16.2060215Z LIBRARY_PATH=/usr/local/cuda/lib64/stubs 2024-08-20T22:16:16.2060634Z CUDA_PATH=/usr/local/cuda 2024-08-20T22:16:16.2061397Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2024-08-20T22:16:16.2062141Z GITHUB_SERVER_URL=https://github.com 2024-08-20T22:16:16.2062622Z UCC_COMMIT=20eae37090a4ce1b32bcce6144ccad0b49943e0b 2024-08-20T22:16:16.2063082Z REENABLED_ISSUES= 2024-08-20T22:16:16.2063381Z SHLVL=1 2024-08-20T22:16:16.2063644Z MAX_JOBS=14 2024-08-20T22:16:16.2063954Z NV_CUDA_LIB_VERSION=12.1.1-1 2024-08-20T22:16:16.2064308Z NVARCH=x86_64 2024-08-20T22:16:16.2064612Z GITHUB_ACTOR_ID=54816060 2024-08-20T22:16:16.2065067Z GITHUB_WORKFLOW_SHA=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:16:16.2065591Z GITHUB_REF_NAME=ciflow/inductor/133712 2024-08-20T22:16:16.2066082Z NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-1 2024-08-20T22:16:16.2066752Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2024-08-20T22:16:16.2067317Z GITHUB_JOB=test 2024-08-20T22:16:16.2067711Z NV_LIBNCCL_PACKAGE=libnccl2=2.17.1-1+cuda12.1 2024-08-20T22:16:16.2068263Z LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64 2024-08-20T22:16:16.2068771Z NO_TEST_TIMEOUT=False 2024-08-20T22:16:16.2069090Z TD_DISTRIBUTED=False 2024-08-20T22:16:16.2069471Z NV_CUDA_NSIGHT_COMPUTE_VERSION=12.1.1-1 2024-08-20T22:16:16.2069903Z GITHUB_REPOSITORY=pytorch/pytorch 2024-08-20T22:16:16.2070323Z NV_NVPROF_VERSION=12.1.105-1 2024-08-20T22:16:16.2070681Z GITHUB_RETENTION_DAYS=90 2024-08-20T22:16:16.2071094Z OPENSSL_DIR=/opt/openssl 2024-08-20T22:16:16.2071570Z GITHUB_ACTION_REPOSITORY= 2024-08-20T22:16:16.2072600Z PATH=/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-08-20T22:16:16.2073802Z GITHUB_BASE_REF= 2024-08-20T22:16:16.2074129Z NV_LIBNCCL_PACKAGE_NAME=libnccl2 2024-08-20T22:16:16.2074505Z CI=true 2024-08-20T22:16:16.2074837Z NV_LIBNCCL_PACKAGE_VERSION=2.17.1-1 2024-08-20T22:16:16.2075242Z GITHUB_REPOSITORY_OWNER=pytorch 2024-08-20T22:16:16.2075615Z JOB_ID=29026298662 2024-08-20T22:16:16.2075927Z INSTALLED_PROTOBUF=yes 2024-08-20T22:16:16.2076249Z GITHUB_HEAD_REF= 2024-08-20T22:16:16.2076552Z GITHUB_ACTION_REF= 2024-08-20T22:16:16.2076988Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2024-08-20T22:16:16.2077447Z TEST_SHOWLOCALS=False 2024-08-20T22:16:16.2077832Z GITHUB_WORKFLOW=inductor-periodic 2024-08-20T22:16:16.2078234Z DEBIAN_FRONTEND=noninteractive 2024-08-20T22:16:16.2079138Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_c3f0cef5-d2e8-48be-8fb8-eb8f62f5ede5 2024-08-20T22:16:16.2079945Z NO_TD=False 2024-08-20T22:16:16.2080244Z SKIP_SCCACHE_INITIALIZATION=1 2024-08-20T22:16:16.2080608Z _=/usr/bin/env 2024-08-20T22:16:16.2081089Z ++ python -c 'import site; print(site.getsitepackages()[0])' 2024-08-20T22:16:16.2245855Z + TORCH_INSTALL_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch 2024-08-20T22:16:16.2247048Z + TORCH_BIN_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/bin 2024-08-20T22:16:16.2248077Z + TORCH_LIB_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/lib 2024-08-20T22:16:16.2248942Z + TORCH_TEST_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/test 2024-08-20T22:16:16.2249533Z + BUILD_DIR=build 2024-08-20T22:16:16.2249852Z + BUILD_RENAMED_DIR=build_renamed 2024-08-20T22:16:16.2250247Z + BUILD_BIN_DIR=build/bin 2024-08-20T22:16:16.2250590Z + SHARD_NUMBER=2 2024-08-20T22:16:16.2250888Z + NUM_TEST_SHARDS=2 2024-08-20T22:16:16.2251217Z + export VALGRIND=ON 2024-08-20T22:16:16.2251535Z + VALGRIND=ON 2024-08-20T22:16:16.2252025Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *clang9* ]] 2024-08-20T22:16:16.2252633Z + [[ 0 == \1 ]] 2024-08-20T22:16:16.2253039Z + [[ False == \1 ]] 2024-08-20T22:16:16.2253770Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *bazel* ]] 2024-08-20T22:16:16.2254874Z ++ realpath build/custom_test_artifacts 2024-08-20T22:16:16.2265780Z + CUSTOM_TEST_ARTIFACT_BUILD_DIR=/var/lib/jenkins/workspace/build/custom_test_artifacts 2024-08-20T22:16:16.2266698Z + [[ -n '' ]] 2024-08-20T22:16:16.2267203Z + echo 'Environment variables' 2024-08-20T22:16:16.2267695Z Environment variables 2024-08-20T22:16:16.2268095Z + env 2024-08-20T22:16:16.2275154Z INSTALLED_DB=yes 2024-08-20T22:16:16.2275562Z NV_LIBCUBLAS_VERSION=12.1.3.1-1 2024-08-20T22:16:16.2275989Z NVIDIA_VISIBLE_DEVICES=all 2024-08-20T22:16:16.2276519Z NV_NVML_DEV_VERSION=12.1.105-1 2024-08-20T22:16:16.2277204Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-20T22:16:16.2277862Z CONTINUE_THROUGH_ERROR=False 2024-08-20T22:16:16.2278451Z NV_LIBNCCL_DEV_PACKAGE=libnccl-dev=2.17.1-1+cuda12.1 2024-08-20T22:16:16.2279059Z NV_LIBNCCL_DEV_PACKAGE_VERSION=2.17.1-1 2024-08-20T22:16:16.2279714Z BUILD_ENVIRONMENT=linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-08-20T22:16:16.2280252Z HOSTNAME=768314b6a62f 2024-08-20T22:16:16.2281194Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_c3f0cef5-d2e8-48be-8fb8-eb8f62f5ede5 2024-08-20T22:16:16.2282062Z GITHUB_ACTION=__self 2024-08-20T22:16:16.2282492Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2024-08-20T22:16:16.2286447Z NVIDIA_REQUIRE_CUDA=cuda>=12.1 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 brand=tesla,driver>=525,driver<526 brand=unknown,driver>=525,driver<526 brand=nvidia,driver>=525,driver<526 brand=nvidiartx,driver>=525,driver<526 brand=geforce,driver>=525,driver<526 brand=geforcertx,driver>=525,driver<526 brand=quadro,driver>=525,driver<526 brand=quadrortx,driver>=525,driver<526 brand=titan,driver>=525,driver<526 brand=titanrtx,driver>=525,driver<526 2024-08-20T22:16:16.2290721Z NV_LIBCUBLAS_DEV_PACKAGE=libcublas-dev-12-1=12.1.3.1-1 2024-08-20T22:16:16.2291272Z NV_NVTX_VERSION=12.1.105-1 2024-08-20T22:16:16.2291661Z GITHUB_RUN_NUMBER=54565 2024-08-20T22:16:16.2292006Z TEST_CONFIG=dynamo_eager_timm 2024-08-20T22:16:16.2292398Z GITHUB_REPOSITORY_OWNER_ID=21003710 2024-08-20T22:16:16.2292879Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2024-08-20T22:16:16.2293336Z NV_CUDA_CUDART_DEV_VERSION=12.1.105-1 2024-08-20T22:16:16.2293771Z NV_LIBCUSPARSE_VERSION=12.1.0.106-1 2024-08-20T22:16:16.2294225Z SCRIBE_GRAPHQL_ACCESS_TOKEN= 2024-08-20T22:16:16.2294640Z NV_LIBNPP_VERSION=12.1.0.40-1 2024-08-20T22:16:16.2295118Z GITHUB_TRIGGERING_ACTOR=pytorch-bot[bot] 2024-08-20T22:16:16.2295661Z CMAKE_CUDA_COMPILER_LAUNCHER=/opt/cache/bin/sccache 2024-08-20T22:16:16.2296126Z GITHUB_REF_TYPE=tag 2024-08-20T22:16:16.2296447Z TORCH_CUDA_ARCH_LIST=Maxwell 2024-08-20T22:16:16.2296828Z NCCL_VERSION=2.17.1-1 2024-08-20T22:16:16.2297227Z BASE_SHA=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:16:16.2297662Z XLA_CUDA= 2024-08-20T22:16:16.2298163Z HUGGING_FACE_HUB_TOKEN=*** 2024-08-20T22:16:16.2298553Z *** 2024-08-20T22:16:16.2298843Z CARGO_NET_GIT_FETCH_WITH_CLI=true 2024-08-20T22:16:16.2299301Z GITHUB_REPOSITORY_ID=65600975 2024-08-20T22:16:16.2299680Z GITHUB_ACTIONS=true 2024-08-20T22:16:16.2300028Z NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:16:16.2300549Z NV_NVPROF_DEV_PACKAGE=cuda-nvprof-12-1=12.1.105-1 2024-08-20T22:16:16.2301127Z NV_LIBNPP_PACKAGE=libnpp-12-1=12.1.0.40-1 2024-08-20T22:16:16.2301626Z SHA1=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:16:16.2302208Z NV_LIBNCCL_DEV_PACKAGE_NAME=libnccl-dev 2024-08-20T22:16:16.2302736Z GITHUB_SHA=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:16:16.2303665Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/inductor-periodic.yml@refs/tags/ciflow/inductor/133712 2024-08-20T22:16:16.2304413Z UCC_HOME=/usr 2024-08-20T22:16:16.2304870Z NV_LIBCUBLAS_DEV_VERSION=12.1.3.1-1 2024-08-20T22:16:16.2305278Z VERBOSE_TEST_LOGS=False 2024-08-20T22:16:16.2305624Z NVIDIA_PRODUCT_NAME=CUDA 2024-08-20T22:16:16.2306087Z NV_LIBCUBLAS_DEV_PACKAGE_NAME=libcublas-dev-12-1 2024-08-20T22:16:16.2306570Z GITHUB_REF=refs/tags/ciflow/inductor/133712 2024-08-20T22:16:16.2307037Z NV_CUDA_CUDART_VERSION=12.1.105-1 2024-08-20T22:16:16.2307410Z SHARD_NUMBER=2 2024-08-20T22:16:16.2307717Z GITHUB_REF_PROTECTED=false 2024-08-20T22:16:16.2308058Z HOME=/var/lib/jenkins 2024-08-20T22:16:16.2308421Z GITHUB_API_URL=https://api.github.com 2024-08-20T22:16:16.2308854Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2024-08-20T22:16:16.2309314Z UCX_COMMIT=7bb2722ff2187a0cad557ae4a6afa090569f83fb 2024-08-20T22:16:16.2309876Z SCCACHE_S3_KEY_PREFIX=inductor-periodic 2024-08-20T22:16:16.2310288Z CUDA_VERSION=12.1.1 2024-08-20T22:16:16.2310711Z NV_LIBCUBLAS_PACKAGE=libcublas-12-1=12.1.3.1-1 2024-08-20T22:16:16.2311137Z NUM_TEST_SHARDS=2 2024-08-20T22:16:16.2311436Z UCX_HOME=/usr 2024-08-20T22:16:16.2312019Z NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE=cuda-nsight-compute-12-1=12.1.1-1 2024-08-20T22:16:16.2313100Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_c3f0cef5-d2e8-48be-8fb8-eb8f62f5ede5 2024-08-20T22:16:16.2314631Z JOB_NAME=cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (dynamo_eager_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:16:16.2316077Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_c3f0cef5-d2e8-48be-8fb8-eb8f62f5ede5 2024-08-20T22:16:16.2317217Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2024-08-20T22:16:16.2317860Z GITHUB_EVENT_NAME=push 2024-08-20T22:16:16.2318298Z DASHBOARD_TAG= 2024-08-20T22:16:16.2318602Z GITHUB_RUN_ID=10479310721 2024-08-20T22:16:16.2319070Z NV_LIBNPP_DEV_PACKAGE=libnpp-dev-12-1=12.1.0.40-1 2024-08-20T22:16:16.2319610Z NV_LIBCUBLAS_PACKAGE_NAME=libcublas-12-1 2024-08-20T22:16:16.2320605Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_c3f0cef5-d2e8-48be-8fb8-eb8f62f5ede5 2024-08-20T22:16:16.2321515Z GITHUB_ACTOR=pytorch-bot[bot] 2024-08-20T22:16:16.2321929Z NV_LIBNPP_DEV_VERSION=12.1.0.40-1 2024-08-20T22:16:16.2322308Z PR_NUMBER= 2024-08-20T22:16:16.2322584Z GITHUB_RUN_ATTEMPT=1 2024-08-20T22:16:16.2322902Z VALGRIND=ON 2024-08-20T22:16:16.2323200Z ANACONDA_PYTHON_VERSION=3.10 2024-08-20T22:16:16.2323644Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2024-08-20T22:16:16.2324092Z TERM=vt100 2024-08-20T22:16:16.2324429Z NV_LIBCUSPARSE_DEV_VERSION=12.1.0.106-1 2024-08-20T22:16:16.2324841Z INSTALLED_VISION=yes 2024-08-20T22:16:16.2325146Z BRANCH= 2024-08-20T22:16:16.2325429Z OPENSSL_ROOT_DIR=/opt/openssl 2024-08-20T22:16:16.2325837Z LIBRARY_PATH=/usr/local/cuda/lib64/stubs 2024-08-20T22:16:16.2326255Z CUDA_PATH=/usr/local/cuda 2024-08-20T22:16:16.2327005Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2024-08-20T22:16:16.2327748Z GITHUB_SERVER_URL=https://github.com 2024-08-20T22:16:16.2328229Z UCC_COMMIT=20eae37090a4ce1b32bcce6144ccad0b49943e0b 2024-08-20T22:16:16.2328693Z REENABLED_ISSUES= 2024-08-20T22:16:16.2328982Z SHLVL=1 2024-08-20T22:16:16.2329242Z MAX_JOBS=14 2024-08-20T22:16:16.2329563Z NV_CUDA_LIB_VERSION=12.1.1-1 2024-08-20T22:16:16.2329908Z NVARCH=x86_64 2024-08-20T22:16:16.2330202Z GITHUB_ACTOR_ID=54816060 2024-08-20T22:16:16.2330653Z GITHUB_WORKFLOW_SHA=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:16:16.2331197Z GITHUB_REF_NAME=ciflow/inductor/133712 2024-08-20T22:16:16.2331677Z NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-1 2024-08-20T22:16:16.2332340Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2024-08-20T22:16:16.2332910Z GITHUB_JOB=test 2024-08-20T22:16:16.2333313Z NV_LIBNCCL_PACKAGE=libnccl2=2.17.1-1+cuda12.1 2024-08-20T22:16:16.2333855Z LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64 2024-08-20T22:16:16.2334362Z NO_TEST_TIMEOUT=False 2024-08-20T22:16:16.2334688Z TD_DISTRIBUTED=False 2024-08-20T22:16:16.2335166Z NV_CUDA_NSIGHT_COMPUTE_VERSION=12.1.1-1 2024-08-20T22:16:16.2335602Z GITHUB_REPOSITORY=pytorch/pytorch 2024-08-20T22:16:16.2336034Z NV_NVPROF_VERSION=12.1.105-1 2024-08-20T22:16:16.2336450Z GITHUB_RETENTION_DAYS=90 2024-08-20T22:16:16.2336795Z OPENSSL_DIR=/opt/openssl 2024-08-20T22:16:16.2337148Z GITHUB_ACTION_REPOSITORY= 2024-08-20T22:16:16.2338180Z PATH=/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-08-20T22:16:16.2339233Z GITHUB_BASE_REF= 2024-08-20T22:16:16.2339552Z NV_LIBNCCL_PACKAGE_NAME=libnccl2 2024-08-20T22:16:16.2339921Z CI=true 2024-08-20T22:16:16.2340243Z NV_LIBNCCL_PACKAGE_VERSION=2.17.1-1 2024-08-20T22:16:16.2341026Z GITHUB_REPOSITORY_OWNER=pytorch 2024-08-20T22:16:16.2341398Z JOB_ID=29026298662 2024-08-20T22:16:16.2341710Z INSTALLED_PROTOBUF=yes 2024-08-20T22:16:16.2342078Z GITHUB_HEAD_REF= 2024-08-20T22:16:16.2342418Z GITHUB_ACTION_REF= 2024-08-20T22:16:16.2342881Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2024-08-20T22:16:16.2343342Z TEST_SHOWLOCALS=False 2024-08-20T22:16:16.2343731Z GITHUB_WORKFLOW=inductor-periodic 2024-08-20T22:16:16.2344128Z DEBIAN_FRONTEND=noninteractive 2024-08-20T22:16:16.2345029Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_c3f0cef5-d2e8-48be-8fb8-eb8f62f5ede5 2024-08-20T22:16:16.2345828Z NO_TD=False 2024-08-20T22:16:16.2346158Z SKIP_SCCACHE_INITIALIZATION=1 2024-08-20T22:16:16.2346535Z _=/usr/bin/env 2024-08-20T22:16:16.2346878Z + echo 'Testing pytorch' 2024-08-20T22:16:16.2347221Z Testing pytorch 2024-08-20T22:16:16.2347545Z + export LANG=C.UTF-8 2024-08-20T22:16:16.2348053Z + LANG=C.UTF-8 2024-08-20T22:16:16.2348343Z + PR_NUMBER= 2024-08-20T22:16:16.2348669Z + [[ dynamo_eager_timm == \d\e\f\a\u\l\t ]] 2024-08-20T22:16:16.2349149Z + [[ dynamo_eager_timm == \d\i\s\t\r\i\b\u\t\e\d ]] 2024-08-20T22:16:16.2349627Z + [[ dynamo_eager_timm == \s\l\o\w ]] 2024-08-20T22:16:16.2350247Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *slow-gradcheck* ]] 2024-08-20T22:16:16.2350947Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *cuda* ]] 2024-08-20T22:16:16.2351483Z + export PYTORCH_TESTING_DEVICE_ONLY_FOR=cuda 2024-08-20T22:16:16.2351949Z + PYTORCH_TESTING_DEVICE_ONLY_FOR=cuda 2024-08-20T22:16:16.2352384Z + [[ dynamo_eager_timm == *crossref* ]] 2024-08-20T22:16:16.2352951Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *rocm* ]] 2024-08-20T22:16:16.2353682Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *xpu* ]] 2024-08-20T22:16:16.2354391Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *-bazel-* ]] 2024-08-20T22:16:16.2354956Z + pip_install --user ninja==1.10.2 2024-08-20T22:16:16.2355499Z + pip install --progress-bar off --user ninja==1.10.2 2024-08-20T22:16:17.3916633Z Collecting ninja==1.10.2 2024-08-20T22:16:17.4099936Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl.metadata (5.0 kB) 2024-08-20T22:16:17.4534051Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl (108 kB) 2024-08-20T22:16:18.0950460Z Installing collected packages: ninja 2024-08-20T22:16:18.1028145Z  WARNING: The script ninja is installed in '/var/lib/jenkins/.local/bin' which is not on PATH. 2024-08-20T22:16:18.1029405Z Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. 2024-08-20T22:16:18.1350277Z Successfully installed ninja-1.10.2 2024-08-20T22:16:18.2146859Z + export PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-08-20T22:16:18.2149465Z + PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-08-20T22:16:18.2150952Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *aarch64* ]] 2024-08-20T22:16:18.2151836Z + install_tlparse 2024-08-20T22:16:18.2152240Z + pip_install --user tlparse==0.3.25 2024-08-20T22:16:18.2152792Z + pip install --progress-bar off --user tlparse==0.3.25 2024-08-20T22:16:18.6208496Z Collecting tlparse==0.3.25 2024-08-20T22:16:18.6376744Z Downloading tlparse-0.3.25-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (1.7 kB) 2024-08-20T22:16:18.6698918Z Downloading tlparse-0.3.25-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.2 MB) 2024-08-20T22:16:19.3131527Z Installing collected packages: tlparse 2024-08-20T22:16:19.3700613Z Successfully installed tlparse-0.3.25 2024-08-20T22:16:19.4501113Z ++ python -m site --user-base 2024-08-20T22:16:19.4746804Z + PATH=/var/lib/jenkins/.local/bin:/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-08-20T22:16:19.4748500Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *asan* ]] 2024-08-20T22:16:19.4749173Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *-debug* ]] 2024-08-20T22:16:19.4749988Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *-bazel-* ]] 2024-08-20T22:16:19.4751114Z + echo 'We are not in debug mode: linux-focal-cuda12.1-py3.10-gcc9-sm86. Expect the assertion to pass' 2024-08-20T22:16:19.4752250Z We are not in debug mode: linux-focal-cuda12.1-py3.10-gcc9-sm86. Expect the assertion to pass 2024-08-20T22:16:19.4752940Z + cd test 2024-08-20T22:16:19.4753723Z + python -c 'import torch; torch._C._crash_if_debug_asserts_fail(424242)' 2024-08-20T22:16:21.1373793Z + [[ dynamo_eager_timm == \n\o\g\p\u\_\N\O\_\A\V\X\2 ]] 2024-08-20T22:16:21.1374408Z + [[ dynamo_eager_timm == \n\o\g\p\u\_\A\V\X\5\1\2 ]] 2024-08-20T22:16:21.1377681Z + DYNAMO_BENCHMARK_FLAGS=() 2024-08-20T22:16:21.1378399Z + [[ dynamo_eager_timm == *pr_time_benchmarks* ]] 2024-08-20T22:16:21.1379043Z + [[ dynamo_eager_timm == *dynamo_eager* ]] 2024-08-20T22:16:21.1379834Z + DYNAMO_BENCHMARK_FLAGS+=(--backend eager) 2024-08-20T22:16:21.1380308Z + [[ dynamo_eager_timm == *dynamic* ]] 2024-08-20T22:16:21.1380729Z + [[ dynamo_eager_timm == *cpu* ]] 2024-08-20T22:16:21.1381205Z + DYNAMO_BENCHMARK_FLAGS+=(--device cuda) 2024-08-20T22:16:21.1409916Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *libtorch* ]] 2024-08-20T22:16:21.1410804Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *-bazel-* ]] 2024-08-20T22:16:21.1412746Z + cd test 2024-08-20T22:16:21.1413764Z + python -c 'import torch; print(torch.__config__.show())' 2024-08-20T22:16:22.6122397Z PyTorch built with: 2024-08-20T22:16:22.6123551Z - GCC 9.4 2024-08-20T22:16:22.6124426Z - C++ Version: 201703 2024-08-20T22:16:22.6126108Z - Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications 2024-08-20T22:16:22.6127902Z - Intel(R) MKL-DNN v3.4.2 (Git Hash 1137e04ec0b5251ca2b4400a4fd3c667ce843d67) 2024-08-20T22:16:22.6128559Z - OpenMP 201511 (a.k.a. OpenMP 4.5) 2024-08-20T22:16:22.6129084Z - LAPACK is enabled (usually provided by MKL) 2024-08-20T22:16:22.6129571Z - NNPACK is enabled 2024-08-20T22:16:22.6129953Z - CPU capability usage: AVX2 2024-08-20T22:16:22.6130369Z - CUDA Runtime 12.1 2024-08-20T22:16:22.6130897Z - NVCC architecture flags: -gencode;arch=compute_86,code=sm_86 2024-08-20T22:16:22.6131505Z - CuDNN 90.1 (built against CUDA 12.4) 2024-08-20T22:16:22.6131944Z - Magma 2.6.1 2024-08-20T22:16:22.6138921Z - Build settings: BLAS_INFO=mkl, BUILD_TYPE=Release, CUDA_VERSION=12.1, CUDNN_VERSION=9.1.0, CXX_COMPILER=/opt/cache/bin/c++, CXX_FLAGS= -D_GLIBCXX_USE_CXX11_ABI=1 -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOROCTRACER -DLIBKINETO_NOXPUPTI=ON -DUSE_FBGEMM -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -O2 -fPIC -Wall -Wextra -Werror=return-type -Werror=non-virtual-dtor -Werror=bool-operation -Wnarrowing -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-unused-parameter -Wno-strict-overflow -Wno-strict-aliasing -Wno-stringop-overflow -Wsuggest-override -Wno-psabi -Wno-error=old-style-cast -Wno-missing-braces -fdiagnostics-color=always -faligned-new -Werror -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Wno-stringop-overflow, FORCE_FALLBACK_CUDA_MPI=1, LAPACK_INFO=mkl, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, PERF_WITH_AVX512=1, TORCH_VERSION=2.5.0, USE_CUDA=ON, USE_CUDNN=ON, USE_CUSPARSELT=ON, USE_EXCEPTION_PTR=1, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_GLOO=ON, USE_MKL=ON, USE_MKLDNN=ON, USE_MPI=ON, USE_NCCL=ON, USE_NNPACK=ON, USE_OPENMP=ON, USE_ROCM=OFF, USE_ROCM_KERNEL_ASSERT=OFF, 2024-08-20T22:16:22.6145287Z 2024-08-20T22:16:22.9372559Z + cd test 2024-08-20T22:16:22.9373455Z + python -c 'import torch; print(torch.__config__.parallel_info())' 2024-08-20T22:16:24.2896949Z ATen/Parallel: 2024-08-20T22:16:24.2897447Z at::get_num_threads() : 8 2024-08-20T22:16:24.2897954Z at::get_num_interop_threads() : 16 2024-08-20T22:16:24.2898549Z OpenMP 201511 (a.k.a. OpenMP 4.5) 2024-08-20T22:16:24.2898948Z omp_get_max_threads() : 8 2024-08-20T22:16:24.2899862Z Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications 2024-08-20T22:16:24.2900649Z mkl_get_max_threads() : 8 2024-08-20T22:16:24.2901260Z Intel(R) MKL-DNN v3.4.2 (Git Hash 1137e04ec0b5251ca2b4400a4fd3c667ce843d67) 2024-08-20T22:16:24.2901891Z std::thread::hardware_concurrency() : 16 2024-08-20T22:16:24.2902311Z Environment variables: 2024-08-20T22:16:24.2902649Z OMP_NUM_THREADS : [not set] 2024-08-20T22:16:24.2903015Z MKL_NUM_THREADS : [not set] 2024-08-20T22:16:24.2903384Z ATen parallel backend: OpenMP 2024-08-20T22:16:24.2903884Z 2024-08-20T22:16:24.5707794Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *aarch64* ]] 2024-08-20T22:16:24.5708538Z + [[ dynamo_eager_timm == *backward* ]] 2024-08-20T22:16:24.5708987Z + [[ dynamo_eager_timm == *xla* ]] 2024-08-20T22:16:24.5709405Z + [[ dynamo_eager_timm == *executorch* ]] 2024-08-20T22:16:24.5709883Z + [[ dynamo_eager_timm == \j\i\t\_\l\e\g\a\c\y ]] 2024-08-20T22:16:24.5710524Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *libtorch* ]] 2024-08-20T22:16:24.5711050Z + [[ dynamo_eager_timm == distributed ]] 2024-08-20T22:16:24.5711533Z + [[ dynamo_eager_timm == *inductor_distributed* ]] 2024-08-20T22:16:24.5712172Z + [[ dynamo_eager_timm == *inductor-halide* ]] 2024-08-20T22:16:24.5712772Z + [[ dynamo_eager_timm == *inductor-micro-benchmark* ]] 2024-08-20T22:16:24.5713544Z + [[ dynamo_eager_timm == *huggingface* ]] 2024-08-20T22:16:24.5713998Z + [[ dynamo_eager_timm == *timm* ]] 2024-08-20T22:16:24.5714395Z + install_torchvision 2024-08-20T22:16:24.5714716Z + local orig_preload 2024-08-20T22:16:24.5715048Z + local commit 2024-08-20T22:16:24.5715357Z ++ get_pinned_commit vision 2024-08-20T22:16:24.5715738Z ++ cat .github/ci_commit_pins/vision.txt 2024-08-20T22:16:24.5731125Z + commit=d23a6e1664d20707c11781299611436e1f0c104f 2024-08-20T22:16:24.5731653Z + orig_preload= 2024-08-20T22:16:24.5732026Z + '[' -n '' ']' 2024-08-20T22:16:24.5732855Z + pip_install --no-use-pep517 --user git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2024-08-20T22:16:24.5734256Z + pip install --progress-bar off --no-use-pep517 --user git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2024-08-20T22:16:24.9078129Z Collecting git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2024-08-20T22:16:24.9082648Z Cloning https://github.com/pytorch/vision.git (to revision d23a6e1664d20707c11781299611436e1f0c104f) to /tmp/pip-req-build-6p9dgpah 2024-08-20T22:16:24.9112835Z Running command git clone --filter=blob:none --quiet https://github.com/pytorch/vision.git /tmp/pip-req-build-6p9dgpah 2024-08-20T22:16:26.3817237Z Running command git rev-parse -q --verify 'sha^d23a6e1664d20707c11781299611436e1f0c104f' 2024-08-20T22:16:26.3845547Z Running command git fetch -q https://github.com/pytorch/vision.git d23a6e1664d20707c11781299611436e1f0c104f 2024-08-20T22:16:27.7100724Z Running command git checkout -q d23a6e1664d20707c11781299611436e1f0c104f 2024-08-20T22:16:28.0014329Z Resolved https://github.com/pytorch/vision.git to commit d23a6e1664d20707c11781299611436e1f0c104f 2024-08-20T22:16:30.4928160Z Preparing metadata (setup.py) ... [?25l- \ done 2024-08-20T22:16:30.4961763Z [?25hRequirement already satisfied: numpy in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (1.22.4) 2024-08-20T22:16:30.4965539Z Requirement already satisfied: torch in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (2.5.0a0+git40ec5f6) 2024-08-20T22:16:30.4969553Z Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (10.3.0) 2024-08-20T22:16:30.5039256Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (3.13.1) 2024-08-20T22:16:30.5043633Z Requirement already satisfied: typing-extensions>=4.8.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (4.12.2) 2024-08-20T22:16:30.5047390Z Requirement already satisfied: networkx in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (2.8.8) 2024-08-20T22:16:30.5049983Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (3.1.4) 2024-08-20T22:16:30.5052804Z Requirement already satisfied: fsspec in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (2024.6.1) 2024-08-20T22:16:30.5057914Z Requirement already satisfied: sympy==1.13.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (1.13.1) 2024-08-20T22:16:30.5071566Z Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from sympy==1.13.1->torch->torchvision==0.19.0a0+d23a6e1) (1.3.0) 2024-08-20T22:16:30.5547104Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from jinja2->torch->torchvision==0.19.0a0+d23a6e1) (2.1.5) 2024-08-20T22:16:30.5609870Z Building wheels for collected packages: torchvision 2024-08-20T22:17:47.9351109Z Building wheel for torchvision (setup.py) ... [?25l- \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ done 2024-08-20T22:17:47.9385558Z [?25h Created wheel for torchvision: filename=torchvision-0.19.0a0+d23a6e1-cp310-cp310-linux_x86_64.whl size=2115797 sha256=4fb3c6e21b071005b112921cbdd6aed6dca19b912e43b5ec255967513b1e4949 2024-08-20T22:17:47.9388822Z Stored in directory: /var/lib/jenkins/.cache/pip/wheels/0e/56/35/02931e71eb23fd2b85591c7ec05b733ca7c8b328a2fd151f96 2024-08-20T22:17:47.9421769Z Successfully built torchvision 2024-08-20T22:17:48.4300068Z Installing collected packages: torchvision 2024-08-20T22:17:48.8441061Z Successfully installed torchvision-0.19.0a0+d23a6e1 2024-08-20T22:17:48.9867778Z + '[' -n '' ']' 2024-08-20T22:17:48.9868196Z + id=1 2024-08-20T22:17:48.9868589Z + test_dynamo_benchmark timm_models 1 2024-08-20T22:17:48.9872801Z ++ pwd 2024-08-20T22:17:48.9874678Z + TEST_REPORTS_DIR=/var/lib/jenkins/workspace/test/test-reports 2024-08-20T22:17:48.9875218Z + local suite=timm_models 2024-08-20T22:17:48.9876977Z + shift 2024-08-20T22:17:48.9877455Z + local shard_id=1 2024-08-20T22:17:48.9877803Z + shift 2024-08-20T22:17:48.9878134Z + [[ dynamo_eager_timm == *perf_compare* ]] 2024-08-20T22:17:48.9878618Z + [[ dynamo_eager_timm == *perf* ]] 2024-08-20T22:17:48.9879032Z + [[ dynamo_eager_timm == *cpu* ]] 2024-08-20T22:17:48.9879565Z + [[ dynamo_eager_timm == *aot_inductor* ]] 2024-08-20T22:17:48.9880331Z + test_single_dynamo_benchmark inference timm_models 1 --inference --bfloat16 2024-08-20T22:17:48.9881332Z ++ pwd 2024-08-20T22:17:48.9881823Z + TEST_REPORTS_DIR=/var/lib/jenkins/workspace/test/test-reports 2024-08-20T22:17:48.9882497Z + mkdir -p /var/lib/jenkins/workspace/test/test-reports 2024-08-20T22:17:48.9936821Z + local name=inference 2024-08-20T22:17:48.9937155Z + shift 2024-08-20T22:17:48.9937494Z + local suite=timm_models 2024-08-20T22:17:48.9937860Z + shift 2024-08-20T22:17:48.9938118Z + local shard_id=1 2024-08-20T22:17:48.9938419Z + shift 2024-08-20T22:17:48.9939837Z + partition_flags=() 2024-08-20T22:17:48.9940204Z + local partition_flags 2024-08-20T22:17:48.9941072Z + [[ -n 2 ]] 2024-08-20T22:17:48.9941407Z + [[ -n 1 ]] 2024-08-20T22:17:48.9941998Z + partition_flags=(--total-partitions "$NUM_TEST_SHARDS" --partition-id "$shard_id") 2024-08-20T22:17:48.9942718Z + [[ dynamo_eager_timm == *perf_compare* ]] 2024-08-20T22:17:48.9943224Z + [[ dynamo_eager_timm == *perf* ]] 2024-08-20T22:17:48.9943699Z + [[ dynamo_eager_timm == *aot_inductor* ]] 2024-08-20T22:17:48.9944149Z + [[ dynamo_eager_timm == *_avx2* ]] 2024-08-20T22:17:48.9944563Z + [[ dynamo_eager_timm == *_avx512* ]] 2024-08-20T22:17:48.9946137Z + python benchmarks/dynamo/timm_models.py --ci --accuracy --timing --explain --backend eager --device cuda --inference --bfloat16 --total-partitions 2 --partition-id 1 --output /var/lib/jenkins/workspace/test/test-reports/inference_timm_models.csv 2024-08-20T22:17:55.5566607Z 2024-08-20T22:17:55.7098354Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:17:55.7098836Z 2024-08-20T22:17:55.7945027Z model.safetensors: 0% 0.00/29.6M [00:00 will be ignored 2024-08-20T22:26:23.6763202Z pass 2024-08-20T22:26:23.6810640Z TIMING: entire_frame_compile:15.08175 backend_compile:0.00218 total_wall_time:15.08175 2024-08-20T22:26:23.6811679Z STATS: call_* op count: 700 | FakeTensorMode.__torch_dispatch__:5376 | FakeTensor.__torch_dispatch__:2900 2024-08-20T22:26:23.6812568Z Dynamo produced 4 graphs covering 700 ops with 7 graph breaks (5 unique) 2024-08-20T22:26:27.9618565Z 2024-08-20T22:26:28.8017822Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:26:28.8018291Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:26:28.8018780Z cuda train mobilenetv2_100 2024-08-20T22:26:36.9540080Z W0820 22:26:36.953000 3098 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T22:26:44.8209509Z pass 2024-08-20T22:26:44.8285793Z TIMING: entire_frame_compile:15.15782 backend_compile:0.00212 total_wall_time:15.15782 2024-08-20T22:26:44.8286960Z STATS: call_* op count: 699 | FakeTensorMode.__torch_dispatch__:5416 | FakeTensor.__torch_dispatch__:2914 2024-08-20T22:26:44.8289587Z Dynamo produced 3 graphs covering 699 ops with 7 graph breaks (5 unique) 2024-08-20T22:26:49.1075564Z 2024-08-20T22:26:50.0041915Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:26:50.0042389Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:26:50.0042832Z cuda train mobilenetv3_large_100 2024-08-20T22:26:58.4775536Z W0820 22:26:58.476000 3141 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T22:27:07.5171486Z pass 2024-08-20T22:27:07.5227796Z TIMING: entire_frame_compile:16.62755 backend_compile:0.00235 total_wall_time:16.62755 2024-08-20T22:27:07.5230997Z STATS: call_* op count: 775 | FakeTensorMode.__torch_dispatch__:5551 | FakeTensor.__torch_dispatch__:3202 2024-08-20T22:27:07.5232058Z Dynamo produced 3 graphs covering 775 ops with 7 graph breaks (5 unique) 2024-08-20T22:27:11.7973133Z 2024-08-20T22:27:12.6945292Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:27:12.6945811Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:27:12.6946886Z cuda train mobilevit_s 2024-08-20T22:27:22.6418810Z pass 2024-08-20T22:27:22.6662909Z TIMING: entire_frame_compile:8.36789 backend_compile:0.00091 total_wall_time:8.36789 2024-08-20T22:27:22.6664094Z STATS: call_* op count: 363 | FakeTensorMode.__torch_dispatch__:7219 | FakeTensor.__torch_dispatch__:126 2024-08-20T22:27:22.6665061Z Dynamo produced 3 graphs covering 363 ops with 6 graph breaks (5 unique) 2024-08-20T22:27:26.7945755Z 2024-08-20T22:27:28.0289733Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:27:28.0290334Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:27:28.0292329Z cuda train nfnet_l0 2024-08-20T22:27:38.2538918Z W0820 22:27:38.253000 3227 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T22:27:51.9677679Z pass 2024-08-20T22:27:51.9925588Z TIMING: entire_frame_compile:21.7489 backend_compile:0.00267 total_wall_time:21.7489 2024-08-20T22:27:51.9928983Z STATS: call_* op count: 1205 | FakeTensorMode.__torch_dispatch__:6843 | FakeTensor.__torch_dispatch__:4018 2024-08-20T22:27:51.9929933Z Dynamo produced 3 graphs covering 1205 ops with 7 graph breaks (5 unique) 2024-08-20T22:27:56.4029965Z 2024-08-20T22:27:57.4696294Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:27:57.4696795Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:27:57.4697224Z cuda train pit_b_224 2024-08-20T22:28:05.7284623Z pass 2024-08-20T22:28:05.7799024Z TIMING: entire_frame_compile:4.54714 backend_compile:0.00044 total_wall_time:4.54714 2024-08-20T22:28:05.7800051Z STATS: call_* op count: 310 | FakeTensorMode.__torch_dispatch__:5142 | FakeTensor.__torch_dispatch__:98 2024-08-20T22:28:05.7801010Z Dynamo produced 2 graphs covering 310 ops with 6 graph breaks (5 unique) 2024-08-20T22:28:09.8441443Z 2024-08-20T22:28:11.5902662Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:28:11.5903544Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:28:11.5904437Z cuda train pnasnet5large 2024-08-20T22:28:57.3188651Z pass 2024-08-20T22:28:57.5219139Z TIMING: entire_frame_compile:36.25858 backend_compile:0.00317 total_wall_time:36.25858 2024-08-20T22:28:57.5222631Z STATS: call_* op count: 1161 | FakeTensorMode.__torch_dispatch__:23500 | FakeTensor.__torch_dispatch__:32 2024-08-20T22:28:57.5224049Z Dynamo produced 2 graphs covering 1161 ops with 5 graph breaks (4 unique) 2024-08-20T22:29:02.0270584Z 2024-08-20T22:29:03.4135572Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:29:03.4136037Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:29:03.4142341Z cuda train poolformer_m36 2024-08-20T22:29:18.1206436Z pass 2024-08-20T22:29:18.1777282Z TIMING: entire_frame_compile:11.06542 backend_compile:0.00087 total_wall_time:11.06542 2024-08-20T22:29:18.1778273Z STATS: call_* op count: 554 | FakeTensorMode.__torch_dispatch__:6180 | FakeTensor.__torch_dispatch__:20 2024-08-20T22:29:18.1779179Z Dynamo produced 2 graphs covering 554 ops with 6 graph breaks (5 unique) 2024-08-20T22:29:22.2998329Z 2024-08-20T22:29:23.1482295Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:29:23.1482763Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:29:23.1483206Z cuda train regnety_002 2024-08-20T22:29:32.2494499Z pass 2024-08-20T22:29:32.2531859Z TIMING: entire_frame_compile:8.29789 backend_compile:0.00071 total_wall_time:8.29789 2024-08-20T22:29:32.2532815Z STATS: call_* op count: 271 | FakeTensorMode.__torch_dispatch__:5538 | FakeTensor.__torch_dispatch__:30 2024-08-20T22:29:32.2533706Z Dynamo produced 2 graphs covering 271 ops with 6 graph breaks (5 unique) 2024-08-20T22:29:36.3431913Z 2024-08-20T22:29:37.4939876Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:29:37.4940333Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:29:37.4941010Z cuda train repvgg_a2 2024-08-20T22:29:47.8693871Z W0820 22:29:47.868000 3442 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T22:29:55.7374088Z pass 2024-08-20T22:29:55.7519938Z TIMING: entire_frame_compile:15.9831 backend_compile:0.00236 total_wall_time:15.9831 2024-08-20T22:29:55.7521167Z STATS: call_* op count: 756 | FakeTensorMode.__torch_dispatch__:5827 | FakeTensor.__torch_dispatch__:3054 2024-08-20T22:29:55.7522102Z Dynamo produced 3 graphs covering 756 ops with 7 graph breaks (5 unique) 2024-08-20T22:29:59.9892297Z 2024-08-20T22:30:01.4857174Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:30:01.4857674Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:30:01.4858120Z cuda train res2net101_26w_4s 2024-08-20T22:30:28.7250498Z pass 2024-08-20T22:30:28.7641895Z TIMING: entire_frame_compile:23.07648 backend_compile:0.00216 total_wall_time:23.07648 2024-08-20T22:30:28.7643120Z STATS: call_* op count: 977 | FakeTensorMode.__torch_dispatch__:18704 | FakeTensor.__torch_dispatch__:42 2024-08-20T22:30:28.7644120Z Dynamo produced 2 graphs covering 977 ops with 6 graph breaks (5 unique) 2024-08-20T22:30:33.1156711Z 2024-08-20T22:30:34.3579543Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:30:34.3580019Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:30:34.3580461Z cuda train res2net50_14w_8s 2024-08-20T22:30:57.0605318Z pass 2024-08-20T22:30:57.0825695Z TIMING: entire_frame_compile:19.9143 backend_compile:0.00183 total_wall_time:19.9143 2024-08-20T22:30:57.0826645Z STATS: call_* op count: 852 | FakeTensorMode.__torch_dispatch__:16492 | FakeTensor.__torch_dispatch__:44 2024-08-20T22:30:57.0829816Z Dynamo produced 2 graphs covering 852 ops with 6 graph breaks (5 unique) 2024-08-20T22:31:01.3858631Z 2024-08-20T22:31:02.5013625Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:31:02.5014195Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:31:02.5014735Z cuda train res2next50 2024-08-20T22:31:16.1750674Z pass 2024-08-20T22:31:16.2008924Z TIMING: entire_frame_compile:11.47652 backend_compile:0.00111 total_wall_time:11.47652 2024-08-20T22:31:16.2009990Z STATS: call_* op count: 484 | FakeTensorMode.__torch_dispatch__:9438 | FakeTensor.__torch_dispatch__:34 2024-08-20T22:31:16.2010914Z Dynamo produced 2 graphs covering 484 ops with 6 graph breaks (5 unique) 2024-08-20T22:31:20.3879896Z 2024-08-20T22:31:21.0736673Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:31:21.0737648Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:31:21.0738108Z cuda train resmlp_12_224 2024-08-20T22:31:25.6924560Z pass 2024-08-20T22:31:25.7044231Z TIMING: entire_frame_compile:3.39964 backend_compile:0.00038 total_wall_time:3.39964 2024-08-20T22:31:25.7045193Z STATS: call_* op count: 179 | FakeTensorMode.__torch_dispatch__:3126 | FakeTensor.__torch_dispatch__:20 2024-08-20T22:31:25.7046076Z Dynamo produced 2 graphs covering 179 ops with 6 graph breaks (5 unique) 2024-08-20T22:31:29.7239427Z 2024-08-20T22:31:31.3016522Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:31:31.3016996Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:31:31.3017444Z cuda train resnest101e 2024-08-20T22:31:58.6682095Z pass 2024-08-20T22:31:58.7264901Z TIMING: entire_frame_compile:21.73575 backend_compile:0.00201 total_wall_time:21.73575 2024-08-20T22:31:58.7265859Z STATS: call_* op count: 1028 | FakeTensorMode.__torch_dispatch__:17866 | FakeTensor.__torch_dispatch__:34 2024-08-20T22:31:58.7271826Z Dynamo produced 2 graphs covering 1028 ops with 6 graph breaks (5 unique) 2024-08-20T22:32:03.0854676Z 2024-08-20T22:32:04.1680045Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:32:04.1680517Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:32:04.1680966Z cuda train rexnet_100 2024-08-20T22:32:15.7157409Z W0820 22:32:15.714000 3700 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T22:32:27.1607223Z pass 2024-08-20T22:32:27.1732182Z TIMING: entire_frame_compile:21.82578 backend_compile:0.00308 total_wall_time:21.82578 2024-08-20T22:32:27.1733596Z STATS: call_* op count: 1034 | FakeTensorMode.__torch_dispatch__:7788 | FakeTensor.__torch_dispatch__:4230 2024-08-20T22:32:27.1735376Z Dynamo produced 3 graphs covering 1034 ops with 7 graph breaks (5 unique) 2024-08-20T22:32:31.6294701Z 2024-08-20T22:32:32.7323301Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:32:32.7323795Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:32:32.7324241Z cuda train sebotnet33ts_256 2024-08-20T22:32:42.0172582Z pass 2024-08-20T22:32:42.0372093Z TIMING: entire_frame_compile:7.45805 backend_compile:0.00068 total_wall_time:7.45805 2024-08-20T22:32:42.0373157Z STATS: call_* op count: 372 | FakeTensorMode.__torch_dispatch__:6400 | FakeTensor.__torch_dispatch__:70 2024-08-20T22:32:42.0374049Z Dynamo produced 3 graphs covering 372 ops with 6 graph breaks (5 unique) 2024-08-20T22:32:46.1624103Z 2024-08-20T22:32:47.3546815Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:32:47.3547538Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:32:47.3548184Z cuda train selecsls42b 2024-08-20T22:32:54.3872663Z pass 2024-08-20T22:32:54.4150762Z TIMING: entire_frame_compile:5.60677 backend_compile:0.00055 total_wall_time:5.60677 2024-08-20T22:32:54.4151759Z STATS: call_* op count: 178 | FakeTensorMode.__torch_dispatch__:4298 | FakeTensor.__torch_dispatch__:44 2024-08-20T22:32:54.4152664Z Dynamo produced 2 graphs covering 178 ops with 6 graph breaks (5 unique) 2024-08-20T22:32:58.4985183Z 2024-08-20T22:32:59.3516114Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:32:59.3516577Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:32:59.3517016Z cuda train spnasnet_100 2024-08-20T22:33:09.2709677Z W0820 22:33:09.270000 3829 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T22:33:18.8746026Z pass 2024-08-20T22:33:18.8804553Z TIMING: entire_frame_compile:18.51954 backend_compile:0.00261 total_wall_time:18.51954 2024-08-20T22:33:18.8805519Z STATS: call_* op count: 855 | FakeTensorMode.__torch_dispatch__:6554 | FakeTensor.__torch_dispatch__:3548 2024-08-20T22:33:18.8809934Z Dynamo produced 3 graphs covering 855 ops with 7 graph breaks (5 unique) 2024-08-20T22:33:23.2203186Z 2024-08-20T22:33:25.1201070Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:33:25.1201974Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:33:25.1204045Z cuda train swin_base_patch4_window7_224 2024-08-20T22:33:41.9892574Z W0820 22:33:41.988000 3872 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T22:33:55.2921480Z pass 2024-08-20T22:33:55.3600042Z TIMING: entire_frame_compile:24.78865 backend_compile:0.00438 total_wall_time:24.78865 2024-08-20T22:33:55.3601025Z STATS: call_* op count: 2446 | FakeTensorMode.__torch_dispatch__:15269 | FakeTensor.__torch_dispatch__:5944 2024-08-20T22:33:55.3601934Z Dynamo produced 3 graphs covering 2446 ops with 7 graph breaks (5 unique) 2024-08-20T22:33:59.8747805Z 2024-08-20T22:34:03.0876529Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:34:03.0877003Z loading model: 0it [00:03, ?it/s] 2024-08-20T22:34:03.0877462Z cuda train swsl_resnext101_32x16d 2024-08-20T22:34:27.7668580Z pass 2024-08-20T22:34:27.9278365Z TIMING: entire_frame_compile:13.80911 backend_compile:0.00127 total_wall_time:13.80911 2024-08-20T22:34:27.9279372Z STATS: call_* op count: 453 | FakeTensorMode.__torch_dispatch__:10528 | FakeTensor.__torch_dispatch__:32 2024-08-20T22:34:27.9280279Z Dynamo produced 2 graphs covering 453 ops with 6 graph breaks (5 unique) 2024-08-20T22:34:32.1425842Z 2024-08-20T22:34:33.0754278Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:34:33.0754743Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:34:33.0755178Z cuda train tf_efficientnet_b0 2024-08-20T22:34:43.2921626Z pass 2024-08-20T22:34:43.3026823Z TIMING: entire_frame_compile:9.22291 backend_compile:0.00078 total_wall_time:9.22291 2024-08-20T22:34:43.3028680Z STATS: call_* op count: 297 | FakeTensorMode.__torch_dispatch__:6403 | FakeTensor.__torch_dispatch__:88 2024-08-20T22:34:43.3030982Z Dynamo produced 2 graphs covering 297 ops with 6 graph breaks (5 unique) 2024-08-20T22:34:47.4144861Z 2024-08-20T22:34:48.4426529Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:34:48.4427081Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:34:48.4427534Z cuda train tf_mixnet_l 2024-08-20T22:35:03.9348400Z pass 2024-08-20T22:35:03.9529239Z TIMING: entire_frame_compile:14.10335 backend_compile:0.00107 total_wall_time:14.10335 2024-08-20T22:35:03.9530195Z STATS: call_* op count: 598 | FakeTensorMode.__torch_dispatch__:9741 | FakeTensor.__torch_dispatch__:82 2024-08-20T22:35:03.9531080Z Dynamo produced 2 graphs covering 598 ops with 6 graph breaks (5 unique) 2024-08-20T22:35:08.1325016Z 2024-08-20T22:35:09.1038568Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:35:09.1039039Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:35:09.1041205Z cuda train tinynet_a 2024-08-20T22:35:20.8059846Z pass 2024-08-20T22:35:20.8158542Z TIMING: entire_frame_compile:10.65148 backend_compile:0.00092 total_wall_time:10.65148 2024-08-20T22:35:20.8159715Z STATS: call_* op count: 346 | FakeTensorMode.__torch_dispatch__:7497 | FakeTensor.__torch_dispatch__:88 2024-08-20T22:35:20.8160621Z Dynamo produced 2 graphs covering 346 ops with 6 graph breaks (5 unique) 2024-08-20T22:35:24.9875099Z 2024-08-20T22:35:25.9581153Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:35:25.9581624Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:35:25.9582074Z cuda train tnt_s_patch16_224 2024-08-20T22:35:37.7590130Z W0820 22:35:37.758000 4087 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T22:35:52.2059282Z pass 2024-08-20T22:35:52.2324197Z TIMING: entire_frame_compile:23.13689 backend_compile:0.00443 total_wall_time:23.13689 2024-08-20T22:35:52.2325180Z STATS: call_* op count: 1849 | FakeTensorMode.__torch_dispatch__:12347 | FakeTensor.__torch_dispatch__:6410 2024-08-20T22:35:52.2326107Z Dynamo produced 3 graphs covering 1849 ops with 7 graph breaks (5 unique) 2024-08-20T22:35:56.6968546Z 2024-08-20T22:35:58.0718689Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:35:58.0719160Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:35:58.0720070Z cuda train twins_pcpvt_base 2024-08-20T22:36:14.1505153Z W0820 22:36:14.149000 4130 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T22:36:35.7426961Z pass 2024-08-20T22:36:35.7803980Z TIMING: entire_frame_compile:33.61808 backend_compile:0.00694 total_wall_time:33.61808 2024-08-20T22:36:35.7805020Z STATS: call_* op count: 2432 | FakeTensorMode.__torch_dispatch__:14253 | FakeTensor.__torch_dispatch__:9556 2024-08-20T22:36:35.7805932Z Dynamo produced 3 graphs covering 2432 ops with 7 graph breaks (5 unique) 2024-08-20T22:36:40.5641329Z 2024-08-20T22:36:41.7826272Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:36:41.7827024Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:36:41.7827629Z cuda train visformer_small 2024-08-20T22:36:49.6313095Z W0820 22:36:49.630000 4173 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T22:36:56.4194510Z pass 2024-08-20T22:36:56.4419259Z TIMING: entire_frame_compile:12.44254 backend_compile:0.00159 total_wall_time:12.44254 2024-08-20T22:36:56.4420227Z STATS: call_* op count: 703 | FakeTensorMode.__torch_dispatch__:5099 | FakeTensor.__torch_dispatch__:2206 2024-08-20T22:36:56.4421165Z Dynamo produced 3 graphs covering 703 ops with 7 graph breaks (5 unique) 2024-08-20T22:37:00.6418203Z 2024-08-20T22:37:02.1662799Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:37:02.1663502Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:37:02.1664186Z cuda train vit_base_patch16_224 2024-08-20T22:37:10.3789980Z W0820 22:37:10.378000 4216 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T22:37:16.6334400Z pass 2024-08-20T22:37:16.6912609Z TIMING: entire_frame_compile:9.69114 backend_compile:0.00175 total_wall_time:9.69114 2024-08-20T22:37:16.6913842Z STATS: call_* op count: 740 | FakeTensorMode.__torch_dispatch__:4132 | FakeTensor.__torch_dispatch__:2828 2024-08-20T22:37:16.6914732Z Dynamo produced 3 graphs covering 740 ops with 7 graph breaks (5 unique) 2024-08-20T22:37:20.9109877Z 2024-08-20T22:37:22.1083784Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:37:22.1084255Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:37:22.1084693Z cuda train volo_d1_224 2024-08-20T22:37:31.3888994Z W0820 22:37:31.388000 4259 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T22:37:41.8470448Z pass 2024-08-20T22:37:41.8632894Z TIMING: entire_frame_compile:16.82104 backend_compile:0.00306 total_wall_time:16.82104 2024-08-20T22:37:41.8634044Z STATS: call_* op count: 1282 | FakeTensorMode.__torch_dispatch__:8027 | FakeTensor.__torch_dispatch__:4696 2024-08-20T22:37:41.8634946Z Dynamo produced 3 graphs covering 1282 ops with 7 graph breaks (5 unique) 2024-08-20T22:37:46.1843371Z 2024-08-20T22:37:49.6241425Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:37:49.6241894Z loading model: 0it [00:03, ?it/s] 2024-08-20T22:37:49.6242321Z cuda train xcit_large_24_p8_224 2024-08-20T22:37:53.9336313Z WARNING:common:fp64 golden ref were not generated for xcit_large_24_p8_224. Setting accuracy check to cosine 2024-08-20T22:38:13.4578222Z W0820 22:38:13.457000 4302 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T22:38:40.0820550Z pass_due_to_skip 2024-08-20T22:38:40.3327774Z TIMING: entire_frame_compile:42.36619 backend_compile:0.00904 total_wall_time:42.36619 2024-08-20T22:38:40.3328794Z STATS: call_* op count: 3042 | FakeTensorMode.__torch_dispatch__:18528 | FakeTensor.__torch_dispatch__:11486 2024-08-20T22:38:40.3332282Z Dynamo produced 3 graphs covering 3042 ops with 7 graph breaks (5 unique) 2024-08-20T22:38:42.2025672Z accuracy pass_rate=96.77% 2024-08-20T22:38:42.2029393Z calls_captured gmean=691.18x mean=887.871x 2024-08-20T22:38:42.2033650Z unique_graphs gmean=2.49x mean=2.548x 2024-08-20T22:38:42.2036940Z graph_breaks gmean=6.39x mean=6.419x 2024-08-20T22:38:42.2040923Z unique_graph_breaks gmean=4.96x mean=4.968x 2024-08-20T22:38:42.2045052Z autograd_captures gmean=0.00x mean=0.000x 2024-08-20T22:38:42.2048586Z autograd_compiles gmean=0.00x mean=0.000x 2024-08-20T22:38:42.2052241Z cudagraph_skips gmean=0.00x mean=0.000x 2024-08-20T22:38:42.8658570Z + python benchmarks/dynamo/check_accuracy.py --actual /var/lib/jenkins/workspace/test/test-reports/training_timm_models.csv --expected benchmarks/dynamo/ci_expected_accuracy/dynamo_eager_timm_training.csv 2024-08-20T22:38:43.1306464Z mixnet_l PASS 2024-08-20T22:38:43.1310142Z mnasnet_100 PASS 2024-08-20T22:38:43.1315711Z mobilenetv2_100 PASS 2024-08-20T22:38:43.1320847Z mobilenetv3_large_100 PASS 2024-08-20T22:38:43.1325741Z mobilevit_s PASS 2024-08-20T22:38:43.1330772Z nfnet_l0 PASS 2024-08-20T22:38:43.1335792Z pit_b_224 PASS 2024-08-20T22:38:43.1340966Z pnasnet5large PASS 2024-08-20T22:38:43.1346592Z poolformer_m36 PASS 2024-08-20T22:38:43.1351333Z regnety_002 PASS 2024-08-20T22:38:43.1356494Z repvgg_a2 PASS 2024-08-20T22:38:43.1361443Z res2net101_26w_4s PASS 2024-08-20T22:38:43.1366483Z res2net50_14w_8s PASS 2024-08-20T22:38:43.1371526Z res2next50 PASS 2024-08-20T22:38:43.1376844Z resmlp_12_224 PASS 2024-08-20T22:38:43.1381573Z resnest101e PASS 2024-08-20T22:38:43.1386640Z rexnet_100 PASS 2024-08-20T22:38:43.1391637Z sebotnet33ts_256 PASS 2024-08-20T22:38:43.1397017Z selecsls42b PASS 2024-08-20T22:38:43.1401961Z spnasnet_100 PASS 2024-08-20T22:38:43.1406933Z swin_base_patch4_window7_224 PASS 2024-08-20T22:38:43.1411956Z swsl_resnext101_32x16d PASS 2024-08-20T22:38:43.1416980Z tf_efficientnet_b0 PASS 2024-08-20T22:38:43.1422084Z tf_mixnet_l PASS 2024-08-20T22:38:43.1427212Z tinynet_a PASS 2024-08-20T22:38:43.1432426Z tnt_s_patch16_224 PASS 2024-08-20T22:38:43.1437701Z twins_pcpvt_base PASS 2024-08-20T22:38:43.1443251Z visformer_small PASS 2024-08-20T22:38:43.1448360Z vit_base_patch16_224 PASS 2024-08-20T22:38:43.1453443Z volo_d1_224 PASS 2024-08-20T22:38:43.1458526Z xcit_large_24_p8_224 XFAIL 2024-08-20T22:38:43.1918547Z + python benchmarks/dynamo/check_graph_breaks.py --actual /var/lib/jenkins/workspace/test/test-reports/training_timm_models.csv --expected benchmarks/dynamo/ci_expected_accuracy/dynamo_eager_timm_training.csv 2024-08-20T22:38:43.4565440Z mixnet_l PASS 2024-08-20T22:38:43.4569212Z mnasnet_100 PASS 2024-08-20T22:38:43.4574377Z mobilenetv2_100 PASS 2024-08-20T22:38:43.4579451Z mobilenetv3_large_100 PASS 2024-08-20T22:38:43.4584793Z mobilevit_s PASS 2024-08-20T22:38:43.4589825Z nfnet_l0 PASS 2024-08-20T22:38:43.4595087Z pit_b_224 PASS 2024-08-20T22:38:43.4600078Z pnasnet5large PASS 2024-08-20T22:38:43.4605192Z poolformer_m36 PASS 2024-08-20T22:38:43.4610123Z regnety_002 PASS 2024-08-20T22:38:43.4615036Z repvgg_a2 PASS 2024-08-20T22:38:43.4620172Z res2net101_26w_4s PASS 2024-08-20T22:38:43.4625222Z res2net50_14w_8s PASS 2024-08-20T22:38:43.4630270Z res2next50 PASS 2024-08-20T22:38:43.4635692Z resmlp_12_224 PASS 2024-08-20T22:38:43.4640847Z resnest101e PASS 2024-08-20T22:38:43.4646143Z rexnet_100 PASS 2024-08-20T22:38:43.4651234Z sebotnet33ts_256 PASS 2024-08-20T22:38:43.4656279Z selecsls42b PASS 2024-08-20T22:38:43.4661262Z spnasnet_100 PASS 2024-08-20T22:38:43.4666288Z swin_base_patch4_window7_224 PASS 2024-08-20T22:38:43.4671271Z swsl_resnext101_32x16d PASS 2024-08-20T22:38:43.4676622Z tf_efficientnet_b0 PASS 2024-08-20T22:38:43.4681627Z tf_mixnet_l PASS 2024-08-20T22:38:43.4686723Z tinynet_a PASS 2024-08-20T22:38:43.4691885Z tnt_s_patch16_224 PASS 2024-08-20T22:38:43.4696732Z twins_pcpvt_base PASS 2024-08-20T22:38:43.4701814Z visformer_small PASS 2024-08-20T22:38:43.4706860Z vit_base_patch16_224 PASS 2024-08-20T22:38:43.4711957Z volo_d1_224 PASS 2024-08-20T22:38:43.4717227Z xcit_large_24_p8_224 PASS 2024-08-20T22:38:43.5158241Z + cleanup_workspace 2024-08-20T22:38:43.5159222Z + echo 'sudo may print the following warning message that can be ignored. The chown command will still run.' 2024-08-20T22:38:43.5160311Z sudo may print the following warning message that can be ignored. The chown command will still run. 2024-08-20T22:38:43.5161233Z + echo ' sudo: setrlimit(RLIMIT_STACK): Operation not permitted' 2024-08-20T22:38:43.5162693Z sudo: setrlimit(RLIMIT_STACK): Operation not permitted 2024-08-20T22:38:43.5163667Z + echo 'For more details refer to https://github.com/sudo-project/sudo/issues/42' 2024-08-20T22:38:43.5164751Z For more details refer to https://github.com/sudo-project/sudo/issues/42 2024-08-20T22:38:43.5165434Z + sudo chown -R 1000 /var/lib/jenkins/workspace 2024-08-20T22:38:44.2346780Z ##[group]Run cat test/**/*_toprint.log || true 2024-08-20T22:38:44.2347297Z cat test/**/*_toprint.log || true 2024-08-20T22:38:44.2361605Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:38:44.2362104Z env: 2024-08-20T22:38:44.2362414Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:38:44.2362861Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:38:44.2363590Z DOCKER_CONTAINER_ID: 768314b6a62fac9424a7bd24ada8625de3b4767f59ae33124fb6f2af07dc16eb 2024-08-20T22:38:44.2364213Z ##[endgroup] 2024-08-20T22:38:44.2457811Z cat: 'test/**/*_toprint.log': No such file or directory 2024-08-20T22:38:44.2491047Z ##[group]Run kill "$MONITOR_SCRIPT_PID" 2024-08-20T22:38:44.2491527Z kill "$MONITOR_SCRIPT_PID" 2024-08-20T22:38:44.2500418Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:38:44.2500919Z env: 2024-08-20T22:38:44.2501195Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:38:44.2501644Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:38:44.2502377Z DOCKER_CONTAINER_ID: 768314b6a62fac9424a7bd24ada8625de3b4767f59ae33124fb6f2af07dc16eb 2024-08-20T22:38:44.2503025Z MONITOR_SCRIPT_PID: 347416 2024-08-20T22:38:44.2503378Z ##[endgroup] 2024-08-20T22:38:44.2703083Z Prepare all required actions 2024-08-20T22:38:44.2703561Z Getting action download info 2024-08-20T22:38:44.4795201Z Download action repository 'actions/upload-artifact@v3' (SHA:a8a3f3ad30e3422c9c7b888a15615d19a852ae32) 2024-08-20T22:38:44.6438233Z ##[group]Run ./.github/actions/upload-test-artifacts 2024-08-20T22:38:44.6438699Z with: 2024-08-20T22:38:44.6439212Z file-suffix: test-dynamo_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_29026298662 2024-08-20T22:38:44.6439846Z s3-bucket: gha-artifacts 2024-08-20T22:38:44.6440203Z env: 2024-08-20T22:38:44.6440472Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:38:44.6441255Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:38:44.6441978Z DOCKER_CONTAINER_ID: 768314b6a62fac9424a7bd24ada8625de3b4767f59ae33124fb6f2af07dc16eb 2024-08-20T22:38:44.6442613Z ##[endgroup] 2024-08-20T22:38:44.6468972Z ##[group]Run # Remove any previous test jsons if they exist 2024-08-20T22:38:44.6469614Z # Remove any previous test jsons if they exist 2024-08-20T22:38:44.6470107Z rm -f test-jsons-*.zip 2024-08-20T22:38:44.6470623Z zip -r "test-jsons-${FILE_SUFFIX}.zip" test -i '*.json' 2024-08-20T22:38:44.6479986Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:38:44.6480475Z env: 2024-08-20T22:38:44.6480742Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:38:44.6481188Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:38:44.6481908Z DOCKER_CONTAINER_ID: 768314b6a62fac9424a7bd24ada8625de3b4767f59ae33124fb6f2af07dc16eb 2024-08-20T22:38:44.6482775Z FILE_SUFFIX: test-dynamo_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_29026298662 2024-08-20T22:38:44.6483427Z ##[endgroup] 2024-08-20T22:38:44.6762842Z adding: test/allowlist_for_publicAPI.json (deflated 79%) 2024-08-20T22:38:44.6792525Z adding: test/benchmark_utils/callgrind_artifacts.json (deflated 92%) 2024-08-20T22:38:44.6793210Z adding: test/minioptest_failures_dict.json (deflated 70%) 2024-08-20T22:38:44.6799261Z adding: test/profiler/profiler_utils_mock_events.json (deflated 87%) 2024-08-20T22:38:44.6804908Z adding: test/slow_tests.json (deflated 82%) 2024-08-20T22:38:44.6839195Z ##[group]Run # Remove any previous test reports if they exist 2024-08-20T22:38:44.6839829Z # Remove any previous test reports if they exist 2024-08-20T22:38:44.6840349Z rm -f test-reports-*.zip 2024-08-20T22:38:44.6841289Z zip -r "test-reports-${FILE_SUFFIX}.zip" test -i '*.xml' -i '*.csv' 2024-08-20T22:38:44.6850375Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:38:44.6851017Z env: 2024-08-20T22:38:44.6851298Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:38:44.6851743Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:38:44.6852465Z DOCKER_CONTAINER_ID: 768314b6a62fac9424a7bd24ada8625de3b4767f59ae33124fb6f2af07dc16eb 2024-08-20T22:38:44.6853317Z FILE_SUFFIX: test-dynamo_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_29026298662 2024-08-20T22:38:44.6853932Z ##[endgroup] 2024-08-20T22:38:44.7118907Z adding: test/test-reports/inference_timm_models.csv (deflated 69%) 2024-08-20T22:38:44.7120494Z adding: test/test-reports/training_timm_models.csv (deflated 66%) 2024-08-20T22:38:44.7123003Z adding: test/test-reports/training_timm_model_graph_breaks.csv (deflated 97%) 2024-08-20T22:38:44.7123913Z adding: test/test-reports/training_timm_model_graph_break_deduped.csv (deflated 74%) 2024-08-20T22:38:44.7156909Z ##[group]Run # Remove any previous usage logs if they exist 2024-08-20T22:38:44.7157540Z # Remove any previous usage logs if they exist 2024-08-20T22:38:44.7158027Z rm -f logs-*.zip 2024-08-20T22:38:44.7158681Z # this workflow is also run in bazel build test, but we dont generate usage reports for it 2024-08-20T22:38:44.7159449Z # so check to see if the file exists first 2024-08-20T22:38:44.7159950Z if [ -f 'usage_log.txt' ]; then 2024-08-20T22:38:44.7160661Z  zip "logs-${FILE_SUFFIX}.zip" 'usage_log.txt' 2024-08-20T22:38:44.7161144Z fi 2024-08-20T22:38:44.7161504Z if ls test/**/*.log 1> /dev/null 2>&1; then 2024-08-20T22:38:44.7162069Z  zip -r "logs-${FILE_SUFFIX}.zip" test -i '*.log' 2024-08-20T22:38:44.7162549Z fi 2024-08-20T22:38:44.7171102Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:38:44.7171591Z env: 2024-08-20T22:38:44.7171874Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:38:44.7172316Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:38:44.7173051Z DOCKER_CONTAINER_ID: 768314b6a62fac9424a7bd24ada8625de3b4767f59ae33124fb6f2af07dc16eb 2024-08-20T22:38:44.7173957Z FILE_SUFFIX: test-dynamo_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_29026298662 2024-08-20T22:38:44.7174568Z ##[endgroup] 2024-08-20T22:38:44.7238215Z adding: usage_log.txt (deflated 92%) 2024-08-20T22:38:44.7328613Z ##[group]Run # Remove any previous debugging artifacts if they exist 2024-08-20T22:38:44.7329345Z # Remove any previous debugging artifacts if they exist 2024-08-20T22:38:44.7329896Z rm -f debug-*.zip 2024-08-20T22:38:44.7330283Z if [ -d 'test/debug' ]; then 2024-08-20T22:38:44.7330780Z  zip -r "debug-${FILE_SUFFIX}.zip" test/debug 2024-08-20T22:38:44.7331254Z fi 2024-08-20T22:38:44.7339966Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:38:44.7340462Z env: 2024-08-20T22:38:44.7341041Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:38:44.7341495Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:38:44.7342236Z DOCKER_CONTAINER_ID: 768314b6a62fac9424a7bd24ada8625de3b4767f59ae33124fb6f2af07dc16eb 2024-08-20T22:38:44.7343146Z FILE_SUFFIX: test-dynamo_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_29026298662 2024-08-20T22:38:44.7343757Z ##[endgroup] 2024-08-20T22:38:44.7438084Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-08-20T22:38:44.7438524Z with: 2024-08-20T22:38:44.7438798Z s3-bucket: gha-artifacts 2024-08-20T22:38:44.7439254Z s3-prefix: pytorch/pytorch/10479310721/1/artifact 2024-08-20T22:38:44.7439728Z retention-days: 14 2024-08-20T22:38:44.7440070Z if-no-files-found: warn 2024-08-20T22:38:44.7440421Z path: test-jsons-*.zip 2024-08-20T22:38:44.7441063Z name: artifact 2024-08-20T22:38:44.7441366Z region: us-east-1 2024-08-20T22:38:44.7441664Z env: 2024-08-20T22:38:44.7441933Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:38:44.7442379Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:38:44.7443157Z DOCKER_CONTAINER_ID: 768314b6a62fac9424a7bd24ada8625de3b4767f59ae33124fb6f2af07dc16eb 2024-08-20T22:38:44.7443999Z ##[endgroup] 2024-08-20T22:38:45.1050721Z NOTE: s3-prefix specified, ignoring name parameter 2024-08-20T22:38:45.1051500Z With the provided path, there will be 1 file uploaded 2024-08-20T22:38:45.1052205Z Uploading to s3 prefix: pytorch/pytorch/10479310721/1/artifact 2024-08-20T22:38:45.1108619Z Starting upload of test-jsons-test-dynamo_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_29026298662.zip 2024-08-20T22:38:45.2417319Z Finished upload of test-jsons-test-dynamo_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_29026298662.zip 2024-08-20T22:38:45.2701120Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-08-20T22:38:45.2701554Z with: 2024-08-20T22:38:45.2701836Z s3-bucket: gha-artifacts 2024-08-20T22:38:45.2702268Z s3-prefix: pytorch/pytorch/10479310721/1/artifact 2024-08-20T22:38:45.2702786Z retention-days: 14 2024-08-20T22:38:45.2703117Z if-no-files-found: error 2024-08-20T22:38:45.2703486Z path: test-reports-*.zip 2024-08-20T22:38:45.2703849Z name: artifact 2024-08-20T22:38:45.2704150Z region: us-east-1 2024-08-20T22:38:45.2704451Z env: 2024-08-20T22:38:45.2704731Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:38:45.2705190Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:38:45.2705913Z DOCKER_CONTAINER_ID: 768314b6a62fac9424a7bd24ada8625de3b4767f59ae33124fb6f2af07dc16eb 2024-08-20T22:38:45.2706548Z ##[endgroup] 2024-08-20T22:38:45.6250609Z NOTE: s3-prefix specified, ignoring name parameter 2024-08-20T22:38:45.6251234Z With the provided path, there will be 1 file uploaded 2024-08-20T22:38:45.6251847Z Uploading to s3 prefix: pytorch/pytorch/10479310721/1/artifact 2024-08-20T22:38:45.6306893Z Starting upload of test-reports-test-dynamo_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_29026298662.zip 2024-08-20T22:38:45.7165624Z Finished upload of test-reports-test-dynamo_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_29026298662.zip 2024-08-20T22:38:45.7448602Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-08-20T22:38:45.7449049Z with: 2024-08-20T22:38:45.7449333Z s3-bucket: gha-artifacts 2024-08-20T22:38:45.7449766Z s3-prefix: pytorch/pytorch/10479310721/1/artifact 2024-08-20T22:38:45.7450226Z retention-days: 14 2024-08-20T22:38:45.7450564Z if-no-files-found: ignore 2024-08-20T22:38:45.7450921Z path: logs-*.zip 2024-08-20T22:38:45.7451227Z name: artifact 2024-08-20T22:38:45.7451525Z region: us-east-1 2024-08-20T22:38:45.7451827Z env: 2024-08-20T22:38:45.7452120Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:38:45.7452566Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:38:45.7453331Z DOCKER_CONTAINER_ID: 768314b6a62fac9424a7bd24ada8625de3b4767f59ae33124fb6f2af07dc16eb 2024-08-20T22:38:45.7453959Z ##[endgroup] 2024-08-20T22:38:46.1062783Z NOTE: s3-prefix specified, ignoring name parameter 2024-08-20T22:38:46.1063818Z With the provided path, there will be 1 file uploaded 2024-08-20T22:38:46.1065269Z Uploading to s3 prefix: pytorch/pytorch/10479310721/1/artifact 2024-08-20T22:38:46.1119857Z Starting upload of logs-test-dynamo_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_29026298662.zip 2024-08-20T22:38:46.2275107Z Finished upload of logs-test-dynamo_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_29026298662.zip 2024-08-20T22:38:46.2560952Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-08-20T22:38:46.2561377Z with: 2024-08-20T22:38:46.2561659Z s3-bucket: gha-artifacts 2024-08-20T22:38:46.2562104Z s3-prefix: pytorch/pytorch/10479310721/1/artifact 2024-08-20T22:38:46.2562561Z retention-days: 14 2024-08-20T22:38:46.2562893Z if-no-files-found: ignore 2024-08-20T22:38:46.2563249Z path: debug-*.zip 2024-08-20T22:38:46.2563596Z name: artifact 2024-08-20T22:38:46.2563898Z region: us-east-1 2024-08-20T22:38:46.2564196Z env: 2024-08-20T22:38:46.2564463Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:38:46.2564903Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:38:46.2565617Z DOCKER_CONTAINER_ID: 768314b6a62fac9424a7bd24ada8625de3b4767f59ae33124fb6f2af07dc16eb 2024-08-20T22:38:46.2566429Z ##[endgroup] 2024-08-20T22:38:46.6038216Z No files were found with the provided path: debug-*.zip. No artifacts will be uploaded. 2024-08-20T22:38:46.6324555Z ##[group]Run # shellcheck disable=SC2156 2024-08-20T22:38:46.6325043Z # shellcheck disable=SC2156 2024-08-20T22:38:46.6325833Z find . -iname "core.[1-9]*" -exec docker exec "${DOCKER_CONTAINER_ID}" sh -c "gdb python {} -ex 'bt' -ex 'q'" \; 2024-08-20T22:38:46.6335184Z shell: /usr/bin/bash -e {0} 2024-08-20T22:38:46.6335531Z env: 2024-08-20T22:38:46.6335819Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:38:46.6336272Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:38:46.6336996Z DOCKER_CONTAINER_ID: 768314b6a62fac9424a7bd24ada8625de3b4767f59ae33124fb6f2af07dc16eb 2024-08-20T22:38:46.6337623Z ##[endgroup] 2024-08-20T22:38:46.8877761Z ##[group]Run pytorch/test-infra/.github/actions/teardown-linux@main 2024-08-20T22:38:46.8878314Z with: 2024-08-20T22:38:46.8878581Z env: 2024-08-20T22:38:46.8878852Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:38:46.8879294Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:38:46.8880011Z DOCKER_CONTAINER_ID: 768314b6a62fac9424a7bd24ada8625de3b4767f59ae33124fb6f2af07dc16eb 2024-08-20T22:38:46.8880632Z ##[endgroup] 2024-08-20T22:38:46.8899998Z ##[group]Run set -eou pipefail 2024-08-20T22:38:46.8900399Z set -eou pipefail 2024-08-20T22:38:46.8900745Z  2024-08-20T22:38:46.8901248Z echo "Holding runner for 2 hours until all ssh sessions have logged out" 2024-08-20T22:38:46.8901869Z for _ in $(seq 1440); do 2024-08-20T22:38:46.8902335Z  # Break if no ssh session exists anymore 2024-08-20T22:38:46.8902829Z  if [ "$(who)" = "" ]; then 2024-08-20T22:38:46.8903281Z  break 2024-08-20T22:38:46.8903618Z  fi 2024-08-20T22:38:46.8903912Z  echo "." 2024-08-20T22:38:46.8904238Z  sleep 5 2024-08-20T22:38:46.8904563Z done 2024-08-20T22:38:46.8913598Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:38:46.8914077Z env: 2024-08-20T22:38:46.8914349Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:38:46.8914794Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:38:46.8915508Z DOCKER_CONTAINER_ID: 768314b6a62fac9424a7bd24ada8625de3b4767f59ae33124fb6f2af07dc16eb 2024-08-20T22:38:46.8916129Z ##[endgroup] 2024-08-20T22:38:46.8945685Z Holding runner for 2 hours until all ssh sessions have logged out 2024-08-20T22:38:46.9003403Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2024-08-20T22:38:46.9004153Z # ignore expansion of "docker ps -q" since it could be empty 2024-08-20T22:38:46.9004735Z # shellcheck disable=SC2046 2024-08-20T22:38:46.9005204Z docker stop $(docker ps -q) || true 2024-08-20T22:38:46.9005674Z # Prune all of the docker images 2024-08-20T22:38:46.9006121Z docker system prune -af 2024-08-20T22:38:46.9015013Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:38:46.9015507Z env: 2024-08-20T22:38:46.9015781Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:38:46.9016234Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:38:46.9016957Z DOCKER_CONTAINER_ID: 768314b6a62fac9424a7bd24ada8625de3b4767f59ae33124fb6f2af07dc16eb 2024-08-20T22:38:46.9017589Z ##[endgroup] 2024-08-20T22:38:47.4927185Z 768314b6a62f 2024-08-20T22:38:48.9624416Z Deleted Containers: 2024-08-20T22:38:48.9625107Z 768314b6a62fac9424a7bd24ada8625de3b4767f59ae33124fb6f2af07dc16eb 2024-08-20T22:38:48.9625655Z 2024-08-20T22:38:59.6677011Z Deleted Images: 2024-08-20T22:38:59.6678966Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:38:59.6681760Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks@sha256:3a95d3a177465127ef6cd3b50787d6a050367070fd9063dbb688fad07a96b402 2024-08-20T22:38:59.6683808Z deleted: sha256:8fef7805cec6e829013a3d62f158b75bdc2f02cdfe3428c032ea017b488473bb 2024-08-20T22:38:59.6684642Z deleted: sha256:c2ce10014dd98f6abbfbf2265f9780a8204c2a7a27463e61ee565573a23d141d 2024-08-20T22:38:59.6685472Z deleted: sha256:ae249c0e6e6013bd6ffea2ca0b0160c015c9ebf7c03070bc2f983a9ff2415bf5 2024-08-20T22:38:59.6686283Z deleted: sha256:8a73883c1067c0e29ff128f553518682b47ed9707d2f35e7d5138e2caf029d61 2024-08-20T22:38:59.6687078Z deleted: sha256:9c040db729fa084584aaf5573082408a2196bc64e5952270c79dc610ed4680b6 2024-08-20T22:38:59.6687877Z deleted: sha256:17311eeeb8b71b16699880c0f646e185107496c4d41da5d23370603768ec030c 2024-08-20T22:38:59.6688678Z deleted: sha256:07cc10bece8501b1c8035d4385ad9e9867dd6e92fa32218a4dcb3e42af7e0411 2024-08-20T22:38:59.6689694Z deleted: sha256:f3e32d05099d1a3115a4722bc2e94a48752c3e965446773673808252671bb967 2024-08-20T22:38:59.6690514Z deleted: sha256:be7c3f41475e3e72ffe3ac2f92ab2f4cf49d5496b2aae738942ac3bb687d742c 2024-08-20T22:38:59.6691358Z deleted: sha256:4fcac490be825129b468cf458089f1fcf8fd56afc44ef4ab27c2eff41ab1ac90 2024-08-20T22:38:59.6692178Z deleted: sha256:31c66d80a2a4792897f267d363c0cf84fb821c5d4a275ab1636f778fd0284c08 2024-08-20T22:38:59.6692973Z deleted: sha256:8a8bcb6085e7e438e5533e8a5613e2ae5888543853568d023af3e2623a1593a9 2024-08-20T22:38:59.6693789Z deleted: sha256:2f6cb60029c79d11567b738f5bdbfb9cb1838cc0f194c4a5e6ae685178d2ed34 2024-08-20T22:38:59.6694636Z deleted: sha256:e546391804d3313f558e1ac16e93cb29a417a92e4eccaf0d4bd12af3bbcf39e3 2024-08-20T22:38:59.6695440Z deleted: sha256:1623b2aa16f2bdc6b572f6799498d9a92fa8114d07c440599b17aea72e22f8b1 2024-08-20T22:38:59.6696257Z deleted: sha256:c0386ca58b7cb7afee015b7e58d2f70525eaf73d6da2cc63868b20e14b1f9497 2024-08-20T22:38:59.6697074Z deleted: sha256:dcbf534ff289186e246531925fed90f72516eb3d63663bad234d611cdc025d62 2024-08-20T22:38:59.6697887Z deleted: sha256:0bab537af579f56c9cd51c7073fd53635fffb424b363236e0de38a7dd0e60ae8 2024-08-20T22:38:59.6698710Z deleted: sha256:d85a852ae1ee027e2fc17240ed68b87957b0a6d210c9119752d8979a0dcd55cf 2024-08-20T22:38:59.6699518Z deleted: sha256:f3821d761b555362e44cf9a1447d8fd2d95b37d54aea67c7519cd9e5db0c4d7e 2024-08-20T22:38:59.6700560Z deleted: sha256:c05e84a545db5dfcb0847c73d2b0f4749fa67aabce05705632ff7f76c84d4688 2024-08-20T22:38:59.6701531Z deleted: sha256:27054eae7ca67b2bd5ca0fd3f4488bf5c5f78e95487d8c45616f3d753d48a8b5 2024-08-20T22:38:59.6702342Z deleted: sha256:9804139f6ae97796aaa993fe4b89ea0cf111eb4d30a79f4c87c339c2e1e04fa0 2024-08-20T22:38:59.6703145Z deleted: sha256:ad6ae2fc594aaa359ff4e287323836570454eb24dd162930655e414d1d77c6dd 2024-08-20T22:38:59.6703951Z deleted: sha256:9cfbb36e328af52a248853a46aab88e266c09e2b44a03e0a42194a031b9b9453 2024-08-20T22:38:59.6704772Z deleted: sha256:a8a842bd7f37b8d50b6d12d6f95f46bbba57953db466fcbde9ba522625f024ef 2024-08-20T22:38:59.6705595Z deleted: sha256:da9738654b3c86f89ebeed2560f1bae093f1219f1eff90b0394b7f211ecabd04 2024-08-20T22:38:59.6706423Z deleted: sha256:cc683bf0cb245394e0f568984b2dd4fce1b6a3a7fe7c44734bae1aa1caaa3251 2024-08-20T22:38:59.6707238Z deleted: sha256:965f220e71c7d1ec19aaf41b1529ab287beb9d86eb8482c4c14094485ab34475 2024-08-20T22:38:59.6708047Z deleted: sha256:da32ecec41a73ce7dd29464f90c7951510a18cd378753659a78cd7fabd10dc36 2024-08-20T22:38:59.6708855Z deleted: sha256:d828d187cee9ad48dbc3702fb61d359619dd8a1ed582878680b51686bf117e5a 2024-08-20T22:38:59.6709659Z deleted: sha256:712111f4b12ff8e2787597d5fdcb043bd0824e55ddd97f262ef550506ca195f0 2024-08-20T22:38:59.6710459Z deleted: sha256:a064eea405958ad14dc6c794e5df9fd1d4515424272801ec559d45a59317309a 2024-08-20T22:38:59.6711257Z deleted: sha256:e124382d136bd5e9a8b409ca79c1f1ef76458deaf444b1b2060d3fa99dbeb506 2024-08-20T22:38:59.6712067Z deleted: sha256:6e10fe757cc190a1b31b47010f4f7610e02cb1b4b438f190dcd301aa4fe2278e 2024-08-20T22:38:59.6712874Z deleted: sha256:4cea352e10f46ca4729f96ac6c4600fc53d4c36e7658c2e0f19f4f309cd4a2a7 2024-08-20T22:38:59.6713788Z deleted: sha256:518bba00fe1d0933053066d21cac0235c9fb485abbc41557ec184b293095c924 2024-08-20T22:38:59.6714713Z deleted: sha256:a64f9ca42e9f27ff2690c15a5c84312e6efaccad45668d9b496cb542165cfb5a 2024-08-20T22:38:59.6715535Z deleted: sha256:096ea0fa14a6c420658f5276b8a8f5d264c0de7e18161ceda2cfc2f4a92cd9bf 2024-08-20T22:38:59.6716346Z deleted: sha256:6f91c94ce6e3f8034c91c66ee25c66a3d85dba9d813b749bd6d2000942a99edc 2024-08-20T22:38:59.6717211Z deleted: sha256:8f8d255eeae546cead8f9a94d237fa57a99940c0f5d51bc29a9d41c7df9cffd9 2024-08-20T22:38:59.6718039Z deleted: sha256:fe05276f4a49f91eef56bfbc3da87cfff5eb116a827fa2d30efe42ce1c134b40 2024-08-20T22:38:59.6718840Z deleted: sha256:5f83cd75d0669c813d4f58978c92e14305cd8f6a07eb9a60665a583460fa7b59 2024-08-20T22:38:59.6719635Z deleted: sha256:8f7ab6366169d39d8953129f650f1927d2fb1328b3f11e2fd9076adb5f46b93a 2024-08-20T22:38:59.6720551Z deleted: sha256:4146cfd5dba0f5308954749f98596b14a1d8f6d23bd93f7ad86c6c3d72239328 2024-08-20T22:38:59.6721381Z deleted: sha256:c6d83cb9ccc606ff63bb3c4d5a5e1ff1450c619b5aae494303a94ae25971cca0 2024-08-20T22:38:59.6722198Z deleted: sha256:71e037e0a3e0963c4565534a7387c082afcb04475d3ac629acf7a0ab2f49fadc 2024-08-20T22:38:59.6722987Z deleted: sha256:4b31135c564686bdaf23262b901237880aea635655721cc7e8c95dc42b05e06d 2024-08-20T22:38:59.6723785Z deleted: sha256:d09bd5c2f35cedcb846543941ee64ce1f684b52e4285696c93b3fb2032da8579 2024-08-20T22:38:59.6724603Z deleted: sha256:4de7fb7d4fc22212aae5fc1ceb637526916d0cced240d7c93d5edd6b0ea28013 2024-08-20T22:38:59.6725406Z deleted: sha256:69890e3e82746e10aff2f1084f11afb4b95a4a6c26b30f64b7001bc0a5fe32bf 2024-08-20T22:38:59.6726594Z deleted: sha256:0156df53b3224e645336ea52b4bb816f1e8d8c9b591748cd645e5e5649fa507b 2024-08-20T22:38:59.6727580Z deleted: sha256:0664624cb9cc4a386f31bf49919a8d8a11d9fea428d05585d9e6228f754bc7cd 2024-08-20T22:38:59.6728400Z deleted: sha256:8c2ddd5fa535c768c058a23f5cc4b6c64cdd71bb7458491282aabc7f7bb94d69 2024-08-20T22:38:59.6729207Z deleted: sha256:8dd03dbe0e1c5f47dd333074dff4bd00415f2f63727a65bf17866774e2ebbd0d 2024-08-20T22:38:59.6730020Z deleted: sha256:3c56b63e094bd18fad9da7a541d537210bca3b730c590d3641213259f6908d6f 2024-08-20T22:38:59.6730825Z deleted: sha256:51484fef07bd1266d4d6ff3d767751172660fc4cc6a1ffe883523a63c985e31e 2024-08-20T22:38:59.6731635Z deleted: sha256:03e83c94023982ab7dd8dc65a6df2024e342f1b760c91ec7a680ee45824869c7 2024-08-20T22:38:59.6732437Z deleted: sha256:58440ab3e8175b5de94a76485c8689a6dc186015475ebf4b386ebba309c5da34 2024-08-20T22:38:59.6733230Z deleted: sha256:9a980f3383e8aa511f0ef68982cb6dfc53b38d1ac8c3d673cb3ba3d45158c91e 2024-08-20T22:38:59.6734048Z deleted: sha256:cb0269c9cf1c47b6c4188ca7be4db261b5d3fc4b4a5153629e222dba7b1f9f98 2024-08-20T22:38:59.6734872Z deleted: sha256:41f1ba870cdffc05e0bf8d87b640fb9d4c153d7f4f3b775f37f94e9f3d584aad 2024-08-20T22:38:59.6735688Z deleted: sha256:7b502ab352f48e8b6eb5e6824a29f308952a5ee7c7d987562e1df7e47639d7f1 2024-08-20T22:38:59.6736486Z deleted: sha256:6ba5217e18738660e6ca8b7a7ec88845e70b0fd781301520bf46c71d99df3144 2024-08-20T22:38:59.6737297Z deleted: sha256:dd5a1c233594780163726bdbbf5de00f7b6b8dca1dace8a001340714c54baedb 2024-08-20T22:38:59.6738118Z deleted: sha256:c27f0db27da73e01f67f6cb78d10f355e350d829479ba4351d82055bb29f6597 2024-08-20T22:38:59.6738934Z deleted: sha256:4e3ce3c854f35c08be3dd95e0d6e718512a885e4614291d7d8b7cd23f48b7dd8 2024-08-20T22:38:59.6739749Z deleted: sha256:c2d6fb088bbec16e60cf0ad74b016f7287c92e659ec2db01271bc309b4dc6d83 2024-08-20T22:38:59.6740830Z deleted: sha256:35a033279d5c9bd6b862bfa9331d8fcbf98bbaf778a778fabc882384db9204f8 2024-08-20T22:38:59.6741672Z deleted: sha256:ab9b00c496073d62e69e032178858d3d6d4c4bab9e87065d3785c6da57351d00 2024-08-20T22:38:59.6742462Z deleted: sha256:7ed947299e109c2459de6e240d86f049c30f93f2380659ce441d8737b8cd065f 2024-08-20T22:38:59.6743257Z deleted: sha256:410d5a7f7a9a1cb4551c106b9cc728a9dcff598f9be231a351ce6a0a33f81e64 2024-08-20T22:38:59.6744068Z deleted: sha256:5f0021bb56efa14bb93978c01513e2a1187ba30e69bdb0546d0ef39b30873f88 2024-08-20T22:38:59.6744875Z deleted: sha256:c1601aa97eb84151c14da3aeea351201bd99144d36d66b397f6555d80245d86d 2024-08-20T22:38:59.6745866Z deleted: sha256:72af05a89be22accdc1ca5d66dcbbb33993a9ef5997f849df1d4ba4c48049f25 2024-08-20T22:38:59.6746681Z deleted: sha256:38b90c9663dcaa2bc57a4dd3008298e7ea93e9535fa42312b4dc4246e7491af9 2024-08-20T22:38:59.6747562Z deleted: sha256:bda61b6cefb3ec8eeb74fef1ca1c7f9a5845fe5e8f07b8123323e897425d5c29 2024-08-20T22:38:59.6748381Z deleted: sha256:5a18e1aa877074529a84cbddf19f8d5403787823378ceae6b72fb62f78d43037 2024-08-20T22:38:59.6749185Z deleted: sha256:6c3e7df31590f02f10cb71fc4eb27653e9b428df2e6e5421a455b062bd2e39f9 2024-08-20T22:38:59.6749664Z 2024-08-20T22:38:59.6749820Z Total reclaimed space: 44.86GB 2024-08-20T22:38:59.6817239Z Post job cleanup. 2024-08-20T22:38:59.6867742Z Post job cleanup. 2024-08-20T22:38:59.7745027Z [command]/usr/bin/git version 2024-08-20T22:38:59.7790564Z git version 2.40.1 2024-08-20T22:38:59.7821742Z Copying '/home/ec2-user/.gitconfig' to '/home/ec2-user/actions-runner/_work/_temp/f3ddf556-85e8-4473-a2a6-83371eae424c/.gitconfig' 2024-08-20T22:38:59.7832679Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/f3ddf556-85e8-4473-a2a6-83371eae424c' before making global git config changes 2024-08-20T22:38:59.7834035Z Adding repository directory to the temporary git global config as a safe directory 2024-08-20T22:38:59.7837512Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-20T22:38:59.7898535Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2024-08-20T22:38:59.7937524Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2024-08-20T22:38:59.8301128Z Entering 'android/libs/fbjni' 2024-08-20T22:38:59.8369494Z Entering 'third_party/FP16' 2024-08-20T22:38:59.8441969Z Entering 'third_party/FXdiv' 2024-08-20T22:38:59.8511070Z Entering 'third_party/NNPACK' 2024-08-20T22:38:59.8582006Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T22:38:59.8653161Z Entering 'third_party/XNNPACK' 2024-08-20T22:38:59.8738920Z Entering 'third_party/benchmark' 2024-08-20T22:38:59.8809689Z Entering 'third_party/cpp-httplib' 2024-08-20T22:38:59.8879646Z Entering 'third_party/cpuinfo' 2024-08-20T22:38:59.8950609Z Entering 'third_party/cudnn_frontend' 2024-08-20T22:38:59.9019390Z Entering 'third_party/cutlass' 2024-08-20T22:38:59.9097383Z Entering 'third_party/eigen' 2024-08-20T22:38:59.9169121Z Entering 'third_party/fbgemm' 2024-08-20T22:38:59.9237711Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:38:59.9304817Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:38:59.9371262Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:38:59.9446098Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:38:59.9512263Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:38:59.9582514Z Entering 'third_party/flatbuffers' 2024-08-20T22:38:59.9655068Z Entering 'third_party/fmt' 2024-08-20T22:38:59.9722819Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:38:59.9791878Z Entering 'third_party/gloo' 2024-08-20T22:38:59.9861289Z Entering 'third_party/googletest' 2024-08-20T22:38:59.9930739Z Entering 'third_party/ideep' 2024-08-20T22:38:59.9997590Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T22:39:00.0077685Z Entering 'third_party/ittapi' 2024-08-20T22:39:00.0151142Z Entering 'third_party/kineto' 2024-08-20T22:39:00.0218783Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:39:00.0288390Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:39:00.0357234Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:39:00.0424934Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:39:00.0492865Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:39:00.0561825Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:39:00.0634640Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:39:00.0701566Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:39:00.0768968Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:39:00.0836776Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:39:00.0906783Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:39:00.0973382Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:39:00.1044829Z Entering 'third_party/mimalloc' 2024-08-20T22:39:00.1113922Z Entering 'third_party/nccl/nccl' 2024-08-20T22:39:00.1183384Z Entering 'third_party/nlohmann' 2024-08-20T22:39:00.1254206Z Entering 'third_party/onnx' 2024-08-20T22:39:00.1336401Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T22:39:00.1403957Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T22:39:00.1476969Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T22:39:00.1546981Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:39:00.1615089Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:39:00.1683845Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:39:00.1750180Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:39:00.1822505Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:39:00.1888794Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:39:00.1955522Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:39:00.2019440Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:39:00.2089067Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:39:00.2157413Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:39:00.2246519Z Entering 'third_party/pocketfft' 2024-08-20T22:39:00.2315241Z Entering 'third_party/protobuf' 2024-08-20T22:39:00.2389875Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:39:00.2457548Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T22:39:00.2527807Z Entering 'third_party/psimd' 2024-08-20T22:39:00.2597796Z Entering 'third_party/pthreadpool' 2024-08-20T22:39:00.2666923Z Entering 'third_party/pybind11' 2024-08-20T22:39:00.2738811Z Entering 'third_party/python-peachpy' 2024-08-20T22:39:00.2808330Z Entering 'third_party/sleef' 2024-08-20T22:39:00.2877587Z Entering 'third_party/tensorpipe' 2024-08-20T22:39:00.2945317Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:39:00.3011050Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:39:00.3076911Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:39:00.3143046Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:39:00.3206233Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:39:00.3302838Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2024-08-20T22:39:00.3338715Z http.https://github.com/.extraheader 2024-08-20T22:39:00.3348862Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader 2024-08-20T22:39:00.3397432Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2024-08-20T22:39:00.3767425Z Entering 'android/libs/fbjni' 2024-08-20T22:39:00.3809576Z http.https://github.com/.extraheader 2024-08-20T22:39:00.3855379Z Entering 'third_party/FP16' 2024-08-20T22:39:00.3898677Z http.https://github.com/.extraheader 2024-08-20T22:39:00.3943084Z Entering 'third_party/FXdiv' 2024-08-20T22:39:00.3987042Z http.https://github.com/.extraheader 2024-08-20T22:39:00.4034011Z Entering 'third_party/NNPACK' 2024-08-20T22:39:00.4078923Z http.https://github.com/.extraheader 2024-08-20T22:39:00.4123475Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T22:39:00.4167953Z http.https://github.com/.extraheader 2024-08-20T22:39:00.4212689Z Entering 'third_party/XNNPACK' 2024-08-20T22:39:00.4256566Z http.https://github.com/.extraheader 2024-08-20T22:39:00.4317358Z Entering 'third_party/benchmark' 2024-08-20T22:39:00.4361921Z http.https://github.com/.extraheader 2024-08-20T22:39:00.4406683Z Entering 'third_party/cpp-httplib' 2024-08-20T22:39:00.4451446Z http.https://github.com/.extraheader 2024-08-20T22:39:00.4495731Z Entering 'third_party/cpuinfo' 2024-08-20T22:39:00.4539931Z http.https://github.com/.extraheader 2024-08-20T22:39:00.4584666Z Entering 'third_party/cudnn_frontend' 2024-08-20T22:39:00.4628293Z http.https://github.com/.extraheader 2024-08-20T22:39:00.4673350Z Entering 'third_party/cutlass' 2024-08-20T22:39:00.4717822Z http.https://github.com/.extraheader 2024-08-20T22:39:00.4772441Z Entering 'third_party/eigen' 2024-08-20T22:39:00.4816960Z http.https://github.com/.extraheader 2024-08-20T22:39:00.4867622Z Entering 'third_party/fbgemm' 2024-08-20T22:39:00.4911559Z http.https://github.com/.extraheader 2024-08-20T22:39:00.4955776Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:39:00.4999441Z http.https://github.com/.extraheader 2024-08-20T22:39:00.5041872Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:39:00.5088643Z http.https://github.com/.extraheader 2024-08-20T22:39:00.5131726Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:39:00.5175048Z http.https://github.com/.extraheader 2024-08-20T22:39:00.5224378Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:39:00.5268265Z http.https://github.com/.extraheader 2024-08-20T22:39:00.5311121Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:39:00.5354202Z http.https://github.com/.extraheader 2024-08-20T22:39:00.5399525Z Entering 'third_party/flatbuffers' 2024-08-20T22:39:00.5443988Z http.https://github.com/.extraheader 2024-08-20T22:39:00.5490556Z Entering 'third_party/fmt' 2024-08-20T22:39:00.5533203Z http.https://github.com/.extraheader 2024-08-20T22:39:00.5577540Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:39:00.5621247Z http.https://github.com/.extraheader 2024-08-20T22:39:00.5665962Z Entering 'third_party/gloo' 2024-08-20T22:39:00.5710308Z http.https://github.com/.extraheader 2024-08-20T22:39:00.5755309Z Entering 'third_party/googletest' 2024-08-20T22:39:00.5799542Z http.https://github.com/.extraheader 2024-08-20T22:39:00.5843942Z Entering 'third_party/ideep' 2024-08-20T22:39:00.5888476Z http.https://github.com/.extraheader 2024-08-20T22:39:00.5930731Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T22:39:00.5974560Z http.https://github.com/.extraheader 2024-08-20T22:39:00.6025210Z Entering 'third_party/ittapi' 2024-08-20T22:39:00.6071414Z http.https://github.com/.extraheader 2024-08-20T22:39:00.6115125Z Entering 'third_party/kineto' 2024-08-20T22:39:00.6160097Z http.https://github.com/.extraheader 2024-08-20T22:39:00.6203191Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:39:00.6246678Z http.https://github.com/.extraheader 2024-08-20T22:39:00.6289992Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:39:00.6333453Z http.https://github.com/.extraheader 2024-08-20T22:39:00.6380664Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:39:00.6423042Z http.https://github.com/.extraheader 2024-08-20T22:39:00.6469290Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:39:00.6512870Z http.https://github.com/.extraheader 2024-08-20T22:39:00.6558749Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:39:00.6601482Z http.https://github.com/.extraheader 2024-08-20T22:39:00.6645158Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:39:00.6689238Z http.https://github.com/.extraheader 2024-08-20T22:39:00.6738193Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:39:00.6780955Z http.https://github.com/.extraheader 2024-08-20T22:39:00.6825424Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:39:00.6868482Z http.https://github.com/.extraheader 2024-08-20T22:39:00.6913290Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:39:00.6956293Z http.https://github.com/.extraheader 2024-08-20T22:39:00.7002543Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:39:00.7044825Z http.https://github.com/.extraheader 2024-08-20T22:39:00.7093601Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:39:00.7138018Z http.https://github.com/.extraheader 2024-08-20T22:39:00.7182205Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:39:00.7224965Z http.https://github.com/.extraheader 2024-08-20T22:39:00.7274380Z Entering 'third_party/mimalloc' 2024-08-20T22:39:00.7319720Z http.https://github.com/.extraheader 2024-08-20T22:39:00.7365403Z Entering 'third_party/nccl/nccl' 2024-08-20T22:39:00.7409075Z http.https://github.com/.extraheader 2024-08-20T22:39:00.7453013Z Entering 'third_party/nlohmann' 2024-08-20T22:39:00.7496498Z http.https://github.com/.extraheader 2024-08-20T22:39:00.7541815Z Entering 'third_party/onnx' 2024-08-20T22:39:00.7586845Z http.https://github.com/.extraheader 2024-08-20T22:39:00.7645571Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T22:39:00.7688551Z http.https://github.com/.extraheader 2024-08-20T22:39:00.7732081Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T22:39:00.7775809Z http.https://github.com/.extraheader 2024-08-20T22:39:00.7824930Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T22:39:00.7869871Z http.https://github.com/.extraheader 2024-08-20T22:39:00.7915217Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:39:00.7958249Z http.https://github.com/.extraheader 2024-08-20T22:39:00.8001652Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:39:00.8045268Z http.https://github.com/.extraheader 2024-08-20T22:39:00.8087917Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:39:00.8130442Z http.https://github.com/.extraheader 2024-08-20T22:39:00.8175210Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:39:00.8217930Z http.https://github.com/.extraheader 2024-08-20T22:39:00.8265932Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:39:00.8308365Z http.https://github.com/.extraheader 2024-08-20T22:39:00.8353042Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:39:00.8396061Z http.https://github.com/.extraheader 2024-08-20T22:39:00.8438837Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:39:00.8487073Z http.https://github.com/.extraheader 2024-08-20T22:39:00.8529167Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:39:00.8572691Z http.https://github.com/.extraheader 2024-08-20T22:39:00.8617997Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:39:00.8661859Z http.https://github.com/.extraheader 2024-08-20T22:39:00.8708619Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:39:00.8751669Z http.https://github.com/.extraheader 2024-08-20T22:39:00.8817495Z Entering 'third_party/pocketfft' 2024-08-20T22:39:00.8882185Z http.https://github.com/.extraheader 2024-08-20T22:39:00.8906748Z Entering 'third_party/protobuf' 2024-08-20T22:39:00.8951338Z http.https://github.com/.extraheader 2024-08-20T22:39:00.8998443Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:39:00.9041559Z http.https://github.com/.extraheader 2024-08-20T22:39:00.9086236Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T22:39:00.9128820Z http.https://github.com/.extraheader 2024-08-20T22:39:00.9177432Z Entering 'third_party/psimd' 2024-08-20T22:39:00.9221293Z http.https://github.com/.extraheader 2024-08-20T22:39:00.9265595Z Entering 'third_party/pthreadpool' 2024-08-20T22:39:00.9309256Z http.https://github.com/.extraheader 2024-08-20T22:39:00.9354868Z Entering 'third_party/pybind11' 2024-08-20T22:39:00.9398710Z http.https://github.com/.extraheader 2024-08-20T22:39:00.9442824Z Entering 'third_party/python-peachpy' 2024-08-20T22:39:00.9486623Z http.https://github.com/.extraheader 2024-08-20T22:39:00.9531082Z Entering 'third_party/sleef' 2024-08-20T22:39:00.9575056Z http.https://github.com/.extraheader 2024-08-20T22:39:00.9619062Z Entering 'third_party/tensorpipe' 2024-08-20T22:39:00.9663996Z http.https://github.com/.extraheader 2024-08-20T22:39:00.9706837Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:39:00.9756641Z http.https://github.com/.extraheader 2024-08-20T22:39:00.9799947Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:39:00.9842657Z http.https://github.com/.extraheader 2024-08-20T22:39:00.9885756Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:39:00.9927921Z http.https://github.com/.extraheader 2024-08-20T22:39:00.9972234Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:39:01.0015099Z http.https://github.com/.extraheader 2024-08-20T22:39:01.0057503Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:39:01.0101160Z http.https://github.com/.extraheader 2024-08-20T22:39:01.0268814Z A job completed hook has been configured by the self-hosted runner administrator 2024-08-20T22:39:01.0291354Z ##[group]Run '/home/ec2-user/runner-scripts/after_job.sh' 2024-08-20T22:39:01.0299432Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:39:01.0299944Z ##[endgroup] 2024-08-20T22:39:08.6362588Z Cleaning up orphan processes