2024-08-20T22:10:10.0314483Z Current runner version: '2.319.1' 2024-08-20T22:10:10.0320898Z Runner name: 'i-0743dc4f7ebf3bb79' 2024-08-20T22:10:10.0321813Z Runner group name: 'Default' 2024-08-20T22:10:10.0322701Z Machine name: 'ip-10-0-77-165' 2024-08-20T22:10:10.0339292Z Testing runner upgrade compatibility 2024-08-20T22:10:10.1696381Z ##[group]GITHUB_TOKEN Permissions 2024-08-20T22:10:10.1698515Z Actions: read 2024-08-20T22:10:10.1699172Z Attestations: read 2024-08-20T22:10:10.1699704Z Checks: read 2024-08-20T22:10:10.1700164Z Contents: read 2024-08-20T22:10:10.1700755Z Deployments: read 2024-08-20T22:10:10.1701288Z Discussions: read 2024-08-20T22:10:10.1701817Z Issues: read 2024-08-20T22:10:10.1702342Z Metadata: read 2024-08-20T22:10:10.1702851Z Packages: read 2024-08-20T22:10:10.1703373Z Pages: read 2024-08-20T22:10:10.1703880Z PullRequests: read 2024-08-20T22:10:10.1704514Z RepositoryProjects: read 2024-08-20T22:10:10.1705135Z SecurityEvents: read 2024-08-20T22:10:10.1705727Z Statuses: read 2024-08-20T22:10:10.1706408Z ##[endgroup] 2024-08-20T22:10:10.1709703Z Secret source: Actions 2024-08-20T22:10:10.1710519Z Prepare workflow directory 2024-08-20T22:10:10.6894034Z Prepare all required actions 2024-08-20T22:10:10.7066255Z Getting action download info 2024-08-20T22:10:10.9118390Z Download action repository 'pytorch/test-infra@main' (SHA:0c3a2634aaa2f638c8f640e743f03d696ce1191f) 2024-08-20T22:10:11.4310151Z Download action repository 'pytorch/pytorch@main' (SHA:1ae5d5bb62141d7c9b1b0b66c66a462b4e10b1f2) 2024-08-20T22:10:15.4737755Z Download action repository 'aws-actions/configure-aws-credentials@v3' (SHA:50ac8dd1e1b10d09dac7b8727528b91bed831ac0) 2024-08-20T22:10:15.6517716Z Download action repository 'seemethere/upload-artifact-s3@v5' (SHA:baba72d0712b404f646cebe0730933554ebce96a) 2024-08-20T22:10:15.9839413Z Getting action download info 2024-08-20T22:10:16.1229020Z Download action repository 'malfet/checkout@silent-checkout' (SHA:e07af140b3ccefc05679e3755b9db68f4ee4589c) 2024-08-20T22:10:16.3332936Z Getting action download info 2024-08-20T22:10:16.4496222Z Download action repository 'nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482' (SHA:3e91a01664abd3c5cd539100d10d33b9c5b68482) 2024-08-20T22:10:16.6073843Z Uses: pytorch/pytorch/.github/workflows/_linux-test.yml@refs/tags/ciflow/inductor/133712 (40ec5f6ddd9787aca0449b24128343ff4c4a88b3) 2024-08-20T22:10:16.6076017Z ##[group] Inputs 2024-08-20T22:10:16.6076509Z build-environment: linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-08-20T22:10:16.6086084Z test-matrix: {"include": [{"config": "inductor", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_distributed", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.g5.12xlarge.nvidia.gpu"}, {"config": "inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_timm", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_timm", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_timm", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_timm", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_timm", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_timm", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_cpp_wrapper_abi_compatible", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}]} 2024-08-20T22:10:16.6096406Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:10:16.6097615Z sync-tag: 2024-08-20T22:10:16.6098459Z timeout-minutes: 240 2024-08-20T22:10:16.6098812Z use-gha: 2024-08-20T22:10:16.6099111Z dashboard-tag: 2024-08-20T22:10:16.6099446Z s3-bucket: gha-artifacts 2024-08-20T22:10:16.6099827Z aws-role-to-assume: 2024-08-20T22:10:16.6100182Z ##[endgroup] 2024-08-20T22:10:16.6101073Z Complete job name: cuda12.1-py3.10-gcc9-sm86 / test (aot_inductor_timm, 2, 2, amz2023.linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:10:16.6762825Z A job started hook has been configured by the self-hosted runner administrator 2024-08-20T22:10:16.6900231Z ##[group]Run '/home/ec2-user/runner-scripts/before_job.sh' 2024-08-20T22:10:16.6912018Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:10:16.6912549Z ##[endgroup] 2024-08-20T22:10:18.5319101Z Runner Type: amz2023.linux.g5.4xlarge.nvidia.gpu 2024-08-20T22:10:18.5319643Z Instance Type: g5.4xlarge 2024-08-20T22:10:18.5320367Z AMI Name: al2023-ami-2023.5.20240701.0-kernel-6.1-x86_64 2024-08-20T22:10:18.5320936Z AMI ID: ami-06c68f701d8090592 2024-08-20T22:10:24.3085926Z ##[group]Run pytorch/test-infra/.github/actions/setup-ssh@main 2024-08-20T22:10:24.3086504Z with: 2024-08-20T22:10:24.3087195Z github-secret: *** 2024-08-20T22:10:24.3088121Z instructions: All testing is done inside the container, to start an interactive session run: docker exec -it $(docker container ps --format '{{.ID}}') bash 2024-08-20T22:10:24.3089097Z activate-with-label: false 2024-08-20T22:10:24.3089462Z label: with-ssh 2024-08-20T22:10:24.3089782Z remove-existing-keys: true 2024-08-20T22:10:24.3090150Z fail-silently: true 2024-08-20T22:10:24.3090459Z env: 2024-08-20T22:10:24.3090729Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:10:24.3091067Z ##[endgroup] 2024-08-20T22:10:24.3979521Z Please see https://github.com/pytorch/pytorch/wiki/Debugging-using-with-ssh-for-Github-Actions for more info. 2024-08-20T22:10:24.3982254Z ciflow reference detected, attempting to extract PR number 2024-08-20T22:10:24.7092368Z Grabbing public ssh keys from https://github.com/pytorch-bot[bot].keys 2024-08-20T22:10:24.7733855Z No SSH keys found for user pytorch-bot[bot] 2024-08-20T22:10:24.7734479Z Grabbing public ssh keys from https://github.com/XuehaiPan.keys 2024-08-20T22:10:24.8373937Z ~/.ssh/authorized_keys file found on node, removing ~/.ssh and starting fresh 2024-08-20T22:10:24.8388973Z Public keys pulled and installed to /home/ec2-user/.ssh/authorized_keys 2024-08-20T22:10:24.8413496Z Login using: ssh ec2-user@ec2-3-227-252-208.compute-1.amazonaws.com 2024-08-20T22:10:24.8414280Z All testing is done inside the container, to start an interactive session run: 2024-08-20T22:10:24.8415088Z docker exec -it $(docker container ps --format '{{.ID}}') bash 2024-08-20T22:10:24.8547162Z ##[group]Run pytorch/pytorch/.github/actions/checkout-pytorch@main 2024-08-20T22:10:24.8547712Z with: 2024-08-20T22:10:24.8547989Z submodules: recursive 2024-08-20T22:10:24.8548313Z fetch-depth: 0 2024-08-20T22:10:24.8548600Z env: 2024-08-20T22:10:24.8548870Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:10:24.8549198Z ##[endgroup] 2024-08-20T22:10:24.8746908Z ##[group]Run retry () { 2024-08-20T22:10:24.8747297Z retry () { 2024-08-20T22:10:24.8748041Z  $* || (sleep 1 && $*) || (sleep 2 && $*) || (sleep 4 && $*) || (sleep 8 && $*) 2024-08-20T22:10:24.8748605Z } 2024-08-20T22:10:24.8748905Z echo "${GITHUB_WORKSPACE}" 2024-08-20T22:10:24.8749323Z if [ -z "${NO_SUDO}" ]; then 2024-08-20T22:10:24.8749801Z  retry sudo rm -rf "${GITHUB_WORKSPACE}" 2024-08-20T22:10:24.8750253Z else 2024-08-20T22:10:24.8750589Z  retry rm -rf "${GITHUB_WORKSPACE}" 2024-08-20T22:10:24.8751013Z fi 2024-08-20T22:10:24.8751360Z mkdir "${GITHUB_WORKSPACE}" 2024-08-20T22:10:24.8762850Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:10:24.8763367Z env: 2024-08-20T22:10:24.8763653Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:10:24.8763995Z NO_SUDO: 2024-08-20T22:10:24.8764271Z ##[endgroup] 2024-08-20T22:10:24.8795777Z /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-20T22:10:29.4573416Z ##[group]Run malfet/checkout@silent-checkout 2024-08-20T22:10:29.4573857Z with: 2024-08-20T22:10:29.4574181Z ref: 40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:10:29.4574619Z fetch-depth: 0 2024-08-20T22:10:29.4574924Z submodules: recursive 2024-08-20T22:10:29.4575252Z quiet-checkout: true 2024-08-20T22:10:29.4575600Z repository: pytorch/pytorch 2024-08-20T22:10:29.4576076Z token: *** 2024-08-20T22:10:29.4576361Z ssh-strict: true 2024-08-20T22:10:29.4576675Z persist-credentials: true 2024-08-20T22:10:29.4577022Z clean: true 2024-08-20T22:10:29.4577346Z sparse-checkout-cone-mode: true 2024-08-20T22:10:29.4577723Z lfs: false 2024-08-20T22:10:29.4578011Z set-safe-directory: true 2024-08-20T22:10:29.4578341Z env: 2024-08-20T22:10:29.4578605Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:10:29.4578928Z ##[endgroup] 2024-08-20T22:10:29.5545568Z Syncing repository: pytorch/pytorch 2024-08-20T22:10:29.5547542Z ##[group]Getting Git version info 2024-08-20T22:10:29.5548282Z Working directory is '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2024-08-20T22:10:29.5549157Z [command]/usr/bin/git version 2024-08-20T22:10:29.5549523Z git version 2.40.1 2024-08-20T22:10:29.5552098Z ##[endgroup] 2024-08-20T22:10:29.5567001Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/d63a5339-fbca-4121-8993-8ef6d3d0387d' before making global git config changes 2024-08-20T22:10:29.5568265Z Adding repository directory to the temporary git global config as a safe directory 2024-08-20T22:10:29.5571659Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-20T22:10:29.5622116Z Deleting the contents of '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2024-08-20T22:10:29.5626039Z ##[group]Initializing the repository 2024-08-20T22:10:29.5628958Z [command]/usr/bin/git init /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-20T22:10:29.5675246Z hint: Using 'master' as the name for the initial branch. This default branch name 2024-08-20T22:10:29.5676359Z hint: is subject to change. To configure the initial branch name to use in all 2024-08-20T22:10:29.5677365Z hint: of your new repositories, which will suppress this warning, call: 2024-08-20T22:10:29.5678047Z hint: 2024-08-20T22:10:29.5678819Z hint: git config --global init.defaultBranch 2024-08-20T22:10:29.5679299Z hint: 2024-08-20T22:10:29.5679825Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-08-20T22:10:29.5680684Z hint: 'development'. The just-created branch can be renamed via this command: 2024-08-20T22:10:29.5681595Z hint: 2024-08-20T22:10:29.5681929Z hint: git branch -m 2024-08-20T22:10:29.5682687Z Initialized empty Git repository in /home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/ 2024-08-20T22:10:29.5688228Z [command]/usr/bin/git remote add origin https://github.com/pytorch/pytorch 2024-08-20T22:10:29.5731447Z ##[endgroup] 2024-08-20T22:10:29.5732079Z ##[group]Disabling automatic garbage collection 2024-08-20T22:10:29.5734891Z [command]/usr/bin/git config --local gc.auto 0 2024-08-20T22:10:29.5776961Z ##[endgroup] 2024-08-20T22:10:29.5777500Z ##[group]Setting up auth 2024-08-20T22:10:29.5782389Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2024-08-20T22:10:29.5824991Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2024-08-20T22:10:29.6173522Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2024-08-20T22:10:29.6215041Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2024-08-20T22:10:29.6571787Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic *** 2024-08-20T22:10:29.6627077Z ##[endgroup] 2024-08-20T22:10:29.6627637Z ##[group]Fetching the repository 2024-08-20T22:10:29.6633600Z [command]/usr/bin/git -c protocol.version=2 fetch --prune --progress --no-recurse-submodules --quiet origin +refs/heads/*:refs/remotes/origin/* +refs/tags/*:refs/tags/* 2024-08-20T22:10:32.3485311Z remote: Enumerating objects: 1008452 2024-08-20T22:10:32.3486147Z remote: Enumerating objects: 1010229, done. 2024-08-20T22:10:32.3487171Z remote: Counting objects: 0% (1/1777) 2024-08-20T22:10:32.3487912Z remote: Counting objects: 1% (18/1777) 2024-08-20T22:10:32.3488672Z remote: Counting objects: 2% (36/1777) 2024-08-20T22:10:32.3489309Z remote: Counting objects: 3% (54/1777) 2024-08-20T22:10:32.3490054Z remote: Counting objects: 4% (72/1777) 2024-08-20T22:10:32.3490803Z remote: Counting objects: 5% (89/1777) 2024-08-20T22:10:32.3491557Z remote: Counting objects: 6% (107/1777) 2024-08-20T22:10:32.3492301Z remote: Counting objects: 7% (125/1777) 2024-08-20T22:10:32.3492957Z remote: Counting objects: 8% (143/1777) 2024-08-20T22:10:32.3493715Z remote: Counting objects: 9% (160/1777) 2024-08-20T22:10:32.3494486Z remote: Counting objects: 10% (178/1777) 2024-08-20T22:10:32.3495238Z remote: Counting objects: 11% (196/1777) 2024-08-20T22:10:32.3495881Z remote: Counting objects: 12% (214/1777) 2024-08-20T22:10:32.3496619Z remote: Counting objects: 13% (232/1777) 2024-08-20T22:10:32.3497248Z remote: Counting objects: 14% (249/1777) 2024-08-20T22:10:32.3498041Z remote: Counting objects: 15% (267/1777) 2024-08-20T22:10:32.3498696Z remote: Counting objects: 16% (285/1777) 2024-08-20T22:10:32.3499436Z remote: Counting objects: 17% (303/1777) 2024-08-20T22:10:32.3500090Z remote: Counting objects: 18% (320/1777) 2024-08-20T22:10:32.3500753Z remote: Counting objects: 19% (338/1777) 2024-08-20T22:10:32.3501471Z remote: Counting objects: 20% (356/1777) 2024-08-20T22:10:32.3501986Z remote: Counting objects: 21% (374/1777) 2024-08-20T22:10:32.3502679Z remote: Counting objects: 22% (391/1777) 2024-08-20T22:10:32.3503242Z remote: Counting objects: 23% (409/1777) 2024-08-20T22:10:32.3503922Z remote: Counting objects: 24% (427/1777) 2024-08-20T22:10:32.3504684Z remote: Counting objects: 25% (445/1777) 2024-08-20T22:10:32.3505447Z remote: Counting objects: 26% (463/1777) 2024-08-20T22:10:32.3506180Z remote: Counting objects: 27% (480/1777) 2024-08-20T22:10:32.3507200Z remote: Counting objects: 28% (498/1777) 2024-08-20T22:10:32.3507946Z remote: Counting objects: 29% (516/1777) 2024-08-20T22:10:32.3508476Z remote: Counting objects: 30% (534/1777) 2024-08-20T22:10:32.3509059Z remote: Counting objects: 31% (551/1777) 2024-08-20T22:10:32.3509557Z remote: Counting objects: 32% (569/1777) 2024-08-20T22:10:32.3510121Z remote: Counting objects: 33% (587/1777) 2024-08-20T22:10:32.3510930Z remote: Counting objects: 34% (605/1777) 2024-08-20T22:10:32.3511434Z remote: Counting objects: 35% (622/1777) 2024-08-20T22:10:32.3511932Z remote: Counting objects: 36% (640/1777) 2024-08-20T22:10:32.3512426Z remote: Counting objects: 37% (658/1777) 2024-08-20T22:10:32.3512917Z remote: Counting objects: 38% (676/1777) 2024-08-20T22:10:32.3513414Z remote: Counting objects: 39% (694/1777) 2024-08-20T22:10:32.3513911Z remote: Counting objects: 40% (711/1777) 2024-08-20T22:10:32.3514417Z remote: Counting objects: 41% (729/1777) 2024-08-20T22:10:32.3514906Z remote: Counting objects: 42% (747/1777) 2024-08-20T22:10:32.3515410Z remote: Counting objects: 43% (765/1777) 2024-08-20T22:10:32.3515910Z remote: Counting objects: 44% (782/1777) 2024-08-20T22:10:32.3516410Z remote: Counting objects: 45% (800/1777) 2024-08-20T22:10:32.3516900Z remote: Counting objects: 46% (818/1777) 2024-08-20T22:10:32.3517407Z remote: Counting objects: 47% (836/1777) 2024-08-20T22:10:32.3517996Z remote: Counting objects: 48% (853/1777) 2024-08-20T22:10:32.3518492Z remote: Counting objects: 49% (871/1777) 2024-08-20T22:10:32.3518983Z remote: Counting objects: 50% (889/1777) 2024-08-20T22:10:32.3519478Z remote: Counting objects: 51% (907/1777) 2024-08-20T22:10:32.3519983Z remote: Counting objects: 52% (925/1777) 2024-08-20T22:10:32.3520479Z remote: Counting objects: 53% (942/1777) 2024-08-20T22:10:32.3521001Z remote: Counting objects: 54% (960/1777) 2024-08-20T22:10:32.3521495Z remote: Counting objects: 55% (978/1777) 2024-08-20T22:10:32.3521989Z remote: Counting objects: 56% (996/1777) 2024-08-20T22:10:32.3522496Z remote: Counting objects: 57% (1013/1777) 2024-08-20T22:10:32.3523011Z remote: Counting objects: 58% (1031/1777) 2024-08-20T22:10:32.3523535Z remote: Counting objects: 59% (1049/1777) 2024-08-20T22:10:32.3524066Z remote: Counting objects: 60% (1067/1777) 2024-08-20T22:10:32.3524586Z remote: Counting objects: 61% (1084/1777) 2024-08-20T22:10:32.3525097Z remote: Counting objects: 62% (1102/1777) 2024-08-20T22:10:32.3525631Z remote: Counting objects: 63% (1120/1777) 2024-08-20T22:10:32.3526150Z remote: Counting objects: 64% (1138/1777) 2024-08-20T22:10:32.3526667Z remote: Counting objects: 65% (1156/1777) 2024-08-20T22:10:32.3527190Z remote: Counting objects: 66% (1173/1777) 2024-08-20T22:10:32.3527697Z remote: Counting objects: 67% (1191/1777) 2024-08-20T22:10:32.3528211Z remote: Counting objects: 68% (1209/1777) 2024-08-20T22:10:32.3528721Z remote: Counting objects: 69% (1227/1777) 2024-08-20T22:10:32.3529237Z remote: Counting objects: 70% (1244/1777) 2024-08-20T22:10:32.3529745Z remote: Counting objects: 71% (1262/1777) 2024-08-20T22:10:32.3530257Z remote: Counting objects: 72% (1280/1777) 2024-08-20T22:10:32.3530780Z remote: Counting objects: 73% (1298/1777) 2024-08-20T22:10:32.3531292Z remote: Counting objects: 74% (1315/1777) 2024-08-20T22:10:32.3531797Z remote: Counting objects: 75% (1333/1777) 2024-08-20T22:10:32.3532315Z remote: Counting objects: 76% (1351/1777) 2024-08-20T22:10:32.3532830Z remote: Counting objects: 77% (1369/1777) 2024-08-20T22:10:32.3533343Z remote: Counting objects: 78% (1387/1777) 2024-08-20T22:10:32.3533961Z remote: Counting objects: 79% (1404/1777) 2024-08-20T22:10:32.3534473Z remote: Counting objects: 80% (1422/1777) 2024-08-20T22:10:32.3534990Z remote: Counting objects: 81% (1440/1777) 2024-08-20T22:10:32.3535501Z remote: Counting objects: 82% (1458/1777) 2024-08-20T22:10:32.3536007Z remote: Counting objects: 83% (1475/1777) 2024-08-20T22:10:32.3536518Z remote: Counting objects: 84% (1493/1777) 2024-08-20T22:10:32.3537038Z remote: Counting objects: 85% (1511/1777) 2024-08-20T22:10:32.3537648Z remote: Counting objects: 86% (1529/1777) 2024-08-20T22:10:32.3538155Z remote: Counting objects: 87% (1546/1777) 2024-08-20T22:10:32.3538667Z remote: Counting objects: 88% (1564/1777) 2024-08-20T22:10:32.3539178Z remote: Counting objects: 89% (1582/1777) 2024-08-20T22:10:32.3539688Z remote: Counting objects: 90% (1600/1777) 2024-08-20T22:10:32.3540192Z remote: Counting objects: 91% (1618/1777) 2024-08-20T22:10:32.3540712Z remote: Counting objects: 92% (1635/1777) 2024-08-20T22:10:32.3541222Z remote: Counting objects: 93% (1653/1777) 2024-08-20T22:10:32.3541741Z remote: Counting objects: 94% (1671/1777) 2024-08-20T22:10:32.3542244Z remote: Counting objects: 95% (1689/1777) 2024-08-20T22:10:32.3542757Z remote: Counting objects: 96% (1706/1777) 2024-08-20T22:10:32.3543279Z remote: Counting objects: 97% (1724/1777) 2024-08-20T22:10:32.3543807Z remote: Counting objects: 98% (1742/1777) 2024-08-20T22:10:32.3544312Z remote: Counting objects: 99% (1760/1777) 2024-08-20T22:10:32.3544828Z remote: Counting objects: 100% (1777/1777) 2024-08-20T22:10:32.3545387Z remote: Counting objects: 100% (1777/1777), done. 2024-08-20T22:10:32.3641361Z remote: Compressing objects: 0% (1/846) 2024-08-20T22:10:32.3911761Z remote: Compressing objects: 1% (9/846) 2024-08-20T22:10:32.4205135Z remote: Compressing objects: 2% (17/846) 2024-08-20T22:10:32.4549496Z remote: Compressing objects: 3% (26/846) 2024-08-20T22:10:32.5257200Z remote: Compressing objects: 4% (34/846) 2024-08-20T22:10:32.5787300Z remote: Compressing objects: 5% (43/846) 2024-08-20T22:10:32.6300225Z remote: Compressing objects: 6% (51/846) 2024-08-20T22:10:32.6685650Z remote: Compressing objects: 7% (60/846) 2024-08-20T22:10:32.7081416Z remote: Compressing objects: 8% (68/846) 2024-08-20T22:10:32.7297443Z remote: Compressing objects: 9% (77/846) 2024-08-20T22:10:32.7561105Z remote: Compressing objects: 10% (85/846) 2024-08-20T22:10:32.7755273Z remote: Compressing objects: 11% (94/846) 2024-08-20T22:10:32.7946619Z remote: Compressing objects: 12% (102/846) 2024-08-20T22:10:32.8108485Z remote: Compressing objects: 13% (110/846) 2024-08-20T22:10:32.8225378Z remote: Compressing objects: 14% (119/846) 2024-08-20T22:10:32.8329267Z remote: Compressing objects: 15% (127/846) 2024-08-20T22:10:32.8402233Z remote: Compressing objects: 16% (136/846) 2024-08-20T22:10:32.8473565Z remote: Compressing objects: 17% (144/846) 2024-08-20T22:10:32.8517325Z remote: Compressing objects: 18% (153/846) 2024-08-20T22:10:32.8568148Z remote: Compressing objects: 19% (161/846) 2024-08-20T22:10:32.8607158Z remote: Compressing objects: 20% (170/846) 2024-08-20T22:10:32.8634143Z remote: Compressing objects: 21% (178/846) 2024-08-20T22:10:32.8639205Z remote: Compressing objects: 22% (187/846) 2024-08-20T22:10:32.8646530Z remote: Compressing objects: 23% (195/846) 2024-08-20T22:10:32.8654565Z remote: Compressing objects: 24% (204/846) 2024-08-20T22:10:32.8661138Z remote: Compressing objects: 25% (212/846) 2024-08-20T22:10:32.8674294Z remote: Compressing objects: 26% (220/846) 2024-08-20T22:10:32.8677997Z remote: Compressing objects: 27% (229/846) 2024-08-20T22:10:32.8703876Z remote: Compressing objects: 28% (237/846) 2024-08-20T22:10:32.8720174Z remote: Compressing objects: 29% (246/846) 2024-08-20T22:10:32.8735723Z remote: Compressing objects: 30% (254/846) 2024-08-20T22:10:32.8750296Z remote: Compressing objects: 31% (263/846) 2024-08-20T22:10:32.8757250Z remote: Compressing objects: 32% (271/846) 2024-08-20T22:10:32.8768630Z remote: Compressing objects: 33% (280/846) 2024-08-20T22:10:32.8775564Z remote: Compressing objects: 34% (288/846) 2024-08-20T22:10:32.8782948Z remote: Compressing objects: 35% (297/846) 2024-08-20T22:10:32.8793005Z remote: Compressing objects: 36% (305/846) 2024-08-20T22:10:32.8802404Z remote: Compressing objects: 37% (314/846) 2024-08-20T22:10:32.8810545Z remote: Compressing objects: 38% (322/846) 2024-08-20T22:10:32.8820062Z remote: Compressing objects: 39% (330/846) 2024-08-20T22:10:32.8826581Z remote: Compressing objects: 40% (339/846) 2024-08-20T22:10:32.8834745Z remote: Compressing objects: 41% (347/846) 2024-08-20T22:10:32.8846919Z remote: Compressing objects: 42% (356/846) 2024-08-20T22:10:32.8852147Z remote: Compressing objects: 43% (364/846) 2024-08-20T22:10:32.8860506Z remote: Compressing objects: 44% (373/846) 2024-08-20T22:10:32.8871253Z remote: Compressing objects: 45% (381/846) 2024-08-20T22:10:32.8873553Z remote: Compressing objects: 46% (390/846) 2024-08-20T22:10:32.8877014Z remote: Compressing objects: 47% (398/846) 2024-08-20T22:10:32.8881238Z remote: Compressing objects: 48% (407/846) 2024-08-20T22:10:32.8885167Z remote: Compressing objects: 49% (415/846) 2024-08-20T22:10:32.8888996Z remote: Compressing objects: 50% (423/846) 2024-08-20T22:10:32.8892698Z remote: Compressing objects: 51% (432/846) 2024-08-20T22:10:32.8896200Z remote: Compressing objects: 52% (440/846) 2024-08-20T22:10:32.8898636Z remote: Compressing objects: 53% (449/846) 2024-08-20T22:10:32.8901209Z remote: Compressing objects: 54% (457/846) 2024-08-20T22:10:32.8903740Z remote: Compressing objects: 55% (466/846) 2024-08-20T22:10:32.8906399Z remote: Compressing objects: 56% (474/846) 2024-08-20T22:10:32.8906943Z remote: Compressing objects: 57% (483/846) 2024-08-20T22:10:32.8909088Z remote: Compressing objects: 58% (491/846) 2024-08-20T22:10:32.8909688Z remote: Compressing objects: 59% (500/846) 2024-08-20T22:10:32.8910280Z remote: Compressing objects: 60% (508/846) 2024-08-20T22:10:32.8911013Z remote: Compressing objects: 61% (517/846) 2024-08-20T22:10:32.8911643Z remote: Compressing objects: 62% (525/846) 2024-08-20T22:10:32.8912167Z remote: Compressing objects: 63% (533/846) 2024-08-20T22:10:32.8916588Z remote: Compressing objects: 64% (542/846) 2024-08-20T22:10:32.8924753Z remote: Compressing objects: 65% (550/846) 2024-08-20T22:10:32.8931422Z remote: Compressing objects: 66% (559/846) 2024-08-20T22:10:32.8936885Z remote: Compressing objects: 67% (567/846) 2024-08-20T22:10:32.8942469Z remote: Compressing objects: 68% (576/846) 2024-08-20T22:10:32.8948596Z remote: Compressing objects: 69% (584/846) 2024-08-20T22:10:32.8952962Z remote: Compressing objects: 70% (593/846) 2024-08-20T22:10:32.8957652Z remote: Compressing objects: 71% (601/846) 2024-08-20T22:10:32.8961203Z remote: Compressing objects: 72% (610/846) 2024-08-20T22:10:32.8966197Z remote: Compressing objects: 73% (618/846) 2024-08-20T22:10:32.8970050Z remote: Compressing objects: 74% (627/846) 2024-08-20T22:10:32.8973675Z remote: Compressing objects: 75% (635/846) 2024-08-20T22:10:32.8977563Z remote: Compressing objects: 76% (643/846) 2024-08-20T22:10:32.8981057Z remote: Compressing objects: 77% (652/846) 2024-08-20T22:10:32.8983730Z remote: Compressing objects: 78% (660/846) 2024-08-20T22:10:32.8986437Z remote: Compressing objects: 79% (669/846) 2024-08-20T22:10:32.8989486Z remote: Compressing objects: 80% (677/846) 2024-08-20T22:10:32.8992070Z remote: Compressing objects: 81% (686/846) 2024-08-20T22:10:32.8994949Z remote: Compressing objects: 82% (694/846) 2024-08-20T22:10:32.8997563Z remote: Compressing objects: 83% (703/846) 2024-08-20T22:10:32.9000034Z remote: Compressing objects: 84% (711/846) 2024-08-20T22:10:32.9002669Z remote: Compressing objects: 85% (720/846) 2024-08-20T22:10:32.9005085Z remote: Compressing objects: 86% (728/846) 2024-08-20T22:10:32.9007739Z remote: Compressing objects: 87% (737/846) 2024-08-20T22:10:32.9010124Z remote: Compressing objects: 88% (745/846) 2024-08-20T22:10:32.9012803Z remote: Compressing objects: 89% (753/846) 2024-08-20T22:10:32.9015479Z remote: Compressing objects: 90% (762/846) 2024-08-20T22:10:32.9018282Z remote: Compressing objects: 91% (770/846) 2024-08-20T22:10:32.9018853Z remote: Compressing objects: 92% (779/846) 2024-08-20T22:10:32.9020732Z remote: Compressing objects: 93% (787/846) 2024-08-20T22:10:32.9021296Z remote: Compressing objects: 94% (796/846) 2024-08-20T22:10:32.9022979Z remote: Compressing objects: 95% (804/846) 2024-08-20T22:10:32.9025370Z remote: Compressing objects: 96% (813/846) 2024-08-20T22:10:32.9028071Z remote: Compressing objects: 97% (821/846) 2024-08-20T22:10:32.9028613Z remote: Compressing objects: 98% (830/846) 2024-08-20T22:10:32.9030917Z remote: Compressing objects: 99% (838/846) 2024-08-20T22:10:32.9031437Z remote: Compressing objects: 100% (846/846) 2024-08-20T22:10:32.9031998Z remote: Compressing objects: 100% (846/846), done. 2024-08-20T22:10:56.1800250Z remote: Total 1010229 (delta 1169), reused 1411 (delta 928), pack-reused 1008452 (from 1) 2024-08-20T22:11:18.0480660Z [command]/usr/bin/git rev-parse --verify --quiet 40ec5f6ddd9787aca0449b24128343ff4c4a88b3^{object} 2024-08-20T22:11:18.0517907Z 40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:11:18.0523229Z ##[endgroup] 2024-08-20T22:11:18.0525652Z ##[group]Determining the checkout info 2024-08-20T22:11:18.0526324Z ##[endgroup] 2024-08-20T22:11:18.0526843Z ##[group]Checking out the ref 2024-08-20T22:11:18.0527907Z [command]/usr/bin/git checkout --quiet --force 40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:11:19.7282739Z ##[endgroup] 2024-08-20T22:11:19.7283592Z ##[group]Setting up auth for fetching submodules 2024-08-20T22:11:19.7288225Z [command]/usr/bin/git config --global http.https://github.com/.extraheader AUTHORIZATION: basic *** 2024-08-20T22:11:19.7346995Z [command]/usr/bin/git config --global --unset-all url.https://github.com/.insteadOf 2024-08-20T22:11:19.7388490Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf git@github.com: 2024-08-20T22:11:19.7430359Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf org-21003710@github.com: 2024-08-20T22:11:19.7468553Z ##[endgroup] 2024-08-20T22:11:19.7471653Z ##[group]Fetching submodules 2024-08-20T22:11:19.7472552Z [command]/usr/bin/git submodule sync --recursive 2024-08-20T22:11:19.7849301Z [command]/usr/bin/git -c protocol.version=2 submodule update --init --force --recursive 2024-08-20T22:11:19.8211077Z Submodule 'android/libs/fbjni' (https://github.com/facebookincubator/fbjni.git) registered for path 'android/libs/fbjni' 2024-08-20T22:11:19.8212871Z Submodule 'third_party/NNPACK_deps/FP16' (https://github.com/Maratyszcza/FP16.git) registered for path 'third_party/FP16' 2024-08-20T22:11:19.8216431Z Submodule 'third_party/NNPACK_deps/FXdiv' (https://github.com/Maratyszcza/FXdiv.git) registered for path 'third_party/FXdiv' 2024-08-20T22:11:19.8219939Z Submodule 'third_party/NNPACK' (https://github.com/Maratyszcza/NNPACK.git) registered for path 'third_party/NNPACK' 2024-08-20T22:11:19.8224122Z Submodule 'third_party/VulkanMemoryAllocator' (https://github.com/GPUOpen-LibrariesAndSDKs/VulkanMemoryAllocator.git) registered for path 'third_party/VulkanMemoryAllocator' 2024-08-20T22:11:19.8227131Z Submodule 'third_party/XNNPACK' (https://github.com/google/XNNPACK.git) registered for path 'third_party/XNNPACK' 2024-08-20T22:11:19.8230809Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/benchmark' 2024-08-20T22:11:19.8234684Z Submodule 'third_party/cpp-httplib' (https://github.com/yhirose/cpp-httplib.git) registered for path 'third_party/cpp-httplib' 2024-08-20T22:11:19.8238514Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo.git) registered for path 'third_party/cpuinfo' 2024-08-20T22:11:19.8242742Z Submodule 'third_party/cudnn_frontend' (https://github.com/NVIDIA/cudnn-frontend.git) registered for path 'third_party/cudnn_frontend' 2024-08-20T22:11:19.8247016Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/cutlass' 2024-08-20T22:11:19.8251116Z Submodule 'third_party/eigen' (https://gitlab.com/libeigen/eigen.git) registered for path 'third_party/eigen' 2024-08-20T22:11:19.8255174Z Submodule 'third_party/fbgemm' (https://github.com/pytorch/fbgemm) registered for path 'third_party/fbgemm' 2024-08-20T22:11:19.8259553Z Submodule 'third_party/flatbuffers' (https://github.com/google/flatbuffers.git) registered for path 'third_party/flatbuffers' 2024-08-20T22:11:19.8264333Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/fmt' 2024-08-20T22:11:19.8270094Z Submodule 'third_party/gemmlowp/gemmlowp' (https://github.com/google/gemmlowp.git) registered for path 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:11:19.8277904Z Submodule 'third_party/gloo' (https://github.com/facebookincubator/gloo) registered for path 'third_party/gloo' 2024-08-20T22:11:19.8282737Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/googletest' 2024-08-20T22:11:19.8287142Z Submodule 'third_party/ideep' (https://github.com/intel/ideep) registered for path 'third_party/ideep' 2024-08-20T22:11:19.8291979Z Submodule 'third_party/ittapi' (https://github.com/intel/ittapi.git) registered for path 'third_party/ittapi' 2024-08-20T22:11:19.8296784Z Submodule 'third_party/kineto' (https://github.com/pytorch/kineto) registered for path 'third_party/kineto' 2024-08-20T22:11:19.8301723Z Submodule 'third_party/mimalloc' (https://github.com/microsoft/mimalloc.git) registered for path 'third_party/mimalloc' 2024-08-20T22:11:19.8306629Z Submodule 'third_party/nccl/nccl' (https://github.com/NVIDIA/nccl) registered for path 'third_party/nccl/nccl' 2024-08-20T22:11:19.8311645Z Submodule 'third_party/nlohmann' (https://github.com/nlohmann/json.git) registered for path 'third_party/nlohmann' 2024-08-20T22:11:19.8316658Z Submodule 'third_party/onnx' (https://github.com/onnx/onnx.git) registered for path 'third_party/onnx' 2024-08-20T22:11:19.8322359Z Submodule 'third_party/opentelemetry-cpp' (https://github.com/open-telemetry/opentelemetry-cpp.git) registered for path 'third_party/opentelemetry-cpp' 2024-08-20T22:11:19.8327389Z Submodule 'third_party/pocketfft' (https://github.com/mreineck/pocketfft) registered for path 'third_party/pocketfft' 2024-08-20T22:11:19.8332871Z Submodule 'third_party/protobuf' (https://github.com/protocolbuffers/protobuf.git) registered for path 'third_party/protobuf' 2024-08-20T22:11:19.8338326Z Submodule 'third_party/NNPACK_deps/psimd' (https://github.com/Maratyszcza/psimd.git) registered for path 'third_party/psimd' 2024-08-20T22:11:19.8343900Z Submodule 'third_party/NNPACK_deps/pthreadpool' (https://github.com/Maratyszcza/pthreadpool.git) registered for path 'third_party/pthreadpool' 2024-08-20T22:11:19.8349811Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/pybind11' 2024-08-20T22:11:19.8355530Z Submodule 'third_party/python-peachpy' (https://github.com/malfet/PeachPy.git) registered for path 'third_party/python-peachpy' 2024-08-20T22:11:19.8361116Z Submodule 'third_party/sleef' (https://github.com/shibatch/sleef) registered for path 'third_party/sleef' 2024-08-20T22:11:19.8370281Z Submodule 'third_party/tensorpipe' (https://github.com/pytorch/tensorpipe.git) registered for path 'third_party/tensorpipe' 2024-08-20T22:11:19.8404735Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/android/libs/fbjni'... 2024-08-20T22:11:20.1270120Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FP16'... 2024-08-20T22:11:20.3115632Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FXdiv'... 2024-08-20T22:11:20.5257986Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/NNPACK'... 2024-08-20T22:11:20.7756211Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/VulkanMemoryAllocator'... 2024-08-20T22:11:22.6452123Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/XNNPACK'... 2024-08-20T22:11:33.7272645Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/benchmark'... 2024-08-20T22:11:34.1427371Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpp-httplib'... 2024-08-20T22:11:34.5555192Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpuinfo'... 2024-08-20T22:11:35.1770016Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cudnn_frontend'... 2024-08-20T22:11:36.3848158Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cutlass'... 2024-08-20T22:11:38.4944253Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/eigen'... 2024-08-20T22:11:44.2791556Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm'... 2024-08-20T22:11:45.8256371Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/flatbuffers'... 2024-08-20T22:11:47.5975655Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fmt'... 2024-08-20T22:11:48.8871372Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gemmlowp/gemmlowp'... 2024-08-20T22:11:49.3548321Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gloo'... 2024-08-20T22:11:49.6782004Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/googletest'... 2024-08-20T22:11:50.7933323Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep'... 2024-08-20T22:11:51.2093818Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ittapi'... 2024-08-20T22:11:51.5216225Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto'... 2024-08-20T22:11:53.1086340Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/mimalloc'... 2024-08-20T22:11:53.7839159Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nccl/nccl'... 2024-08-20T22:11:54.4545028Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nlohmann'... 2024-08-20T22:12:00.4615517Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx'... 2024-08-20T22:12:02.4503974Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp'... 2024-08-20T22:12:06.6621876Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pocketfft'... 2024-08-20T22:12:06.9213338Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf'... 2024-08-20T22:12:15.7515011Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/psimd'... 2024-08-20T22:12:15.9485767Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pthreadpool'... 2024-08-20T22:12:16.1330905Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pybind11'... 2024-08-20T22:12:17.0642348Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/python-peachpy'... 2024-08-20T22:12:17.3720901Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/sleef'... 2024-08-20T22:12:17.9693217Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe'... 2024-08-20T22:12:18.3996413Z Submodule path 'android/libs/fbjni': checked out '7e1e1fe3858c63c251c637ae41a20de425dde96f' 2024-08-20T22:12:18.4147263Z Submodule path 'third_party/FP16': checked out '4dfe081cf6bcd15db339cf2680b9281b8451eeb3' 2024-08-20T22:12:18.4265690Z Submodule path 'third_party/FXdiv': checked out 'b408327ac2a15ec3e43352421954f5b1967701d1' 2024-08-20T22:12:18.4570207Z Submodule path 'third_party/NNPACK': checked out 'c07e3a0400713d546e0dea2d5466dd22ea389c73' 2024-08-20T22:12:18.5028105Z Submodule path 'third_party/VulkanMemoryAllocator': checked out 'a6bfc237255a6bac1513f7c1ebde6d8aed6b5191' 2024-08-20T22:12:19.6747850Z Submodule path 'third_party/XNNPACK': checked out 'fcbf55af6cf28a4627bcd1f703ab7ad843f0f3a2' 2024-08-20T22:12:19.7038576Z Submodule path 'third_party/benchmark': checked out '0d98dba29d66e93259db7daa53a9327df767a415' 2024-08-20T22:12:19.7568546Z Submodule path 'third_party/cpp-httplib': checked out '3b6597bba913d51161383657829b7e644e59c006' 2024-08-20T22:12:19.8696805Z Submodule path 'third_party/cpuinfo': checked out '3c8b1533ac03dd6531ab6e7b9245d488f13a82a5' 2024-08-20T22:12:19.9098204Z Submodule path 'third_party/cudnn_frontend': checked out '23511ba176243f27b3b275da1fb3814ea805a171' 2024-08-20T22:12:20.5303478Z Submodule path 'third_party/cutlass': checked out 'bbe579a9e3beb6ea6626d9227ec32d0dae119a49' 2024-08-20T22:12:20.8167604Z Submodule path 'third_party/eigen': checked out '3147391d946bb4b6c68edd901f2add6ac1f31f8c' 2024-08-20T22:12:20.9113282Z Submodule path 'third_party/fbgemm': checked out 'dbc3157bf256f1339b3fa1fef2be89ac4078be0e' 2024-08-20T22:12:20.9137937Z Submodule 'third_party/asmjit' (https://github.com/asmjit/asmjit.git) registered for path 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:12:20.9141039Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo) registered for path 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:12:20.9144435Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:12:20.9148057Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:12:20.9151887Z Submodule 'third_party/hipify_torch' (https://github.com/ROCmSoftwarePlatform/hipify_torch.git) registered for path 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:12:20.9183218Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/asmjit'... 2024-08-20T22:12:21.8901903Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cpuinfo'... 2024-08-20T22:12:22.5248974Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cutlass'... 2024-08-20T22:12:24.5861461Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/googletest'... 2024-08-20T22:12:25.6120723Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/hipify_torch'... 2024-08-20T22:12:25.9484652Z Submodule path 'third_party/fbgemm/third_party/asmjit': checked out 'd3fbf7c9bc7c1d1365a94a45614b91c5a3706b81' 2024-08-20T22:12:26.0591986Z Submodule path 'third_party/fbgemm/third_party/cpuinfo': checked out 'ed8b86a253800bafdb7b25c5c399f91bff9cb1f3' 2024-08-20T22:12:26.5651232Z Submodule path 'third_party/fbgemm/third_party/cutlass': checked out 'fc9ebc645b63f3a6bc80aaefde5c063fb72110d6' 2024-08-20T22:12:26.6354614Z Submodule path 'third_party/fbgemm/third_party/googletest': checked out 'cbf019de22c8dd37b2108da35b2748fd702d1796' 2024-08-20T22:12:26.6503895Z Submodule path 'third_party/fbgemm/third_party/hipify_torch': checked out '23f53b025b466d8ec3c45d52290d3442f7fbe6b1' 2024-08-20T22:12:26.8019070Z Submodule path 'third_party/flatbuffers': checked out '01834de25e4bf3975a9a00e816292b1ad0fe184b' 2024-08-20T22:12:26.8478862Z Submodule path 'third_party/fmt': checked out '0c9fce2ffefecfdce794e1859584e25877b7b592' 2024-08-20T22:12:26.8940978Z Submodule path 'third_party/gemmlowp/gemmlowp': checked out '3fb5c176c17c765a3492cd2f0321b0dab712f350' 2024-08-20T22:12:26.9269045Z Submodule path 'third_party/gloo': checked out '5354032ea08eadd7fc4456477f7f7c6308818509' 2024-08-20T22:12:26.9801585Z Submodule path 'third_party/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2024-08-20T22:12:26.9958973Z Submodule path 'third_party/ideep': checked out '55ca0191687aaf19aca5cdb7881c791e3bea442b' 2024-08-20T22:12:26.9978690Z Submodule 'mkl-dnn' (https://github.com/intel/mkl-dnn.git) registered for path 'third_party/ideep/mkl-dnn' 2024-08-20T22:12:27.0008471Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep/mkl-dnn'... 2024-08-20T22:12:40.1356919Z Submodule path 'third_party/ideep/mkl-dnn': checked out '1137e04ec0b5251ca2b4400a4fd3c667ce843d67' 2024-08-20T22:12:40.1578048Z Submodule path 'third_party/ittapi': checked out '5b8a7d7422611c3a0d799fb5fc5dd4abfae35b42' 2024-08-20T22:12:40.2558667Z Submodule path 'third_party/kineto': checked out 'd9753139d181b9ff42872465aac0e5d3018be415' 2024-08-20T22:12:40.2579893Z Submodule 'libkineto/third_party/dynolog' (https://github.com/facebookincubator/dynolog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:12:40.2583343Z Submodule 'libkineto/third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:12:40.2586731Z Submodule 'libkineto/third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:12:40.2619130Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog'... 2024-08-20T22:12:40.8059670Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/fmt'... 2024-08-20T22:12:41.9789800Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/googletest'... 2024-08-20T22:12:43.1187714Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog': checked out '7d04a0053a845370ae06ce317a22a48e9edcc74e' 2024-08-20T22:12:43.1207772Z Submodule 'third_party/DCGM' (https://github.com/NVIDIA/DCGM.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:12:43.1211141Z Submodule 'third_party/cpr' (https://github.com/libcpr/cpr.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:12:43.1214698Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:12:43.1218332Z Submodule 'third_party/gflags' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:12:43.1222013Z Submodule 'third_party/glog' (https://github.com/google/glog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:12:43.1225857Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:12:43.1229583Z Submodule 'third_party/json' (https://github.com/nlohmann/json.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:12:43.1233810Z Submodule 'third_party/pfs' (https://github.com/dtrugman/pfs.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:12:43.1266822Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'... 2024-08-20T22:12:43.9478772Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'... 2024-08-20T22:12:44.2991640Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'... 2024-08-20T22:12:45.5272483Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'... 2024-08-20T22:12:45.8093310Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/glog'... 2024-08-20T22:12:46.3388406Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'... 2024-08-20T22:12:47.4144304Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/json'... 2024-08-20T22:12:54.9202071Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'... 2024-08-20T22:12:55.3877503Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM': checked out 'ffde4e54bc7249a6039a5e6b45b395141e1217f9' 2024-08-20T22:12:55.4114092Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr': checked out '871ed52d350214a034f6ef8a3b8f51c5ce1bd400' 2024-08-20T22:12:55.4551682Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt': checked out 'cd4af11efc9c622896a3e4cb599fa28668ca3d05' 2024-08-20T22:12:55.4726119Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags': checked out 'e171aa2d15ed9eb17054558e0b3a6a413bb01067' 2024-08-20T22:12:55.4745909Z Submodule 'doc' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:12:55.4775673Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'... 2024-08-20T22:12:55.9025904Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc': checked out '8411df715cf522606e3b1aca386ddfc0b63d34b4' 2024-08-20T22:12:55.9253643Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog': checked out 'b33e3bad4c46c8a6345525fd822af355e5ef9446' 2024-08-20T22:12:55.9738436Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest': checked out '58d77fa8070e8cec2dc1ed015d66b454c8d78850' 2024-08-20T22:12:56.0956557Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json': checked out '4f8fba14066156b73f1189a2b8bd568bde5284c5' 2024-08-20T22:12:56.1162645Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs': checked out 'f68a2fa8ea36c783bdd760371411fcb495aa3150' 2024-08-20T22:12:56.1617696Z Submodule path 'third_party/kineto/libkineto/third_party/fmt': checked out '0041a40c1350ba702d475b9c4ad62da77caea164' 2024-08-20T22:12:56.2281590Z Submodule path 'third_party/kineto/libkineto/third_party/googletest': checked out '7aca84427f224eeed3144123d5230d5871e93347' 2024-08-20T22:12:56.2751387Z Submodule path 'third_party/mimalloc': checked out 'b66e3214d8a104669c2ec05ae91ebc26a8f5ab78' 2024-08-20T22:12:56.3058204Z Submodule path 'third_party/nccl/nccl': checked out 'ab2b89c4c339bd7f816fbc114a4b05d386b66290' 2024-08-20T22:12:56.4318650Z Submodule path 'third_party/nlohmann': checked out '87cda1d6646592ac5866dc703c8e1839046a6806' 2024-08-20T22:12:56.9605356Z Submodule path 'third_party/onnx': checked out '3bf92c03a9f27eba3bda1e5b9e63ea20ec213557' 2024-08-20T22:12:56.9641527Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/onnx/third_party/benchmark' 2024-08-20T22:12:56.9644623Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/onnx/third_party/pybind11' 2024-08-20T22:12:56.9678300Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx/third_party/benchmark'... 2024-08-20T22:12:57.5461114Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx/third_party/pybind11'... 2024-08-20T22:12:58.5970873Z Submodule path 'third_party/onnx/third_party/benchmark': checked out '2dd015dfef425c866d9a43f2c67d8b52d709acb6' 2024-08-20T22:12:58.6389417Z Submodule path 'third_party/onnx/third_party/pybind11': checked out '5b0a6fc2017fcc176545afe3e09c9f9885283242' 2024-08-20T22:12:58.7293124Z Submodule path 'third_party/opentelemetry-cpp': checked out 'a799f4aed9c94b765dcdaabaeab7d5e7e2310878' 2024-08-20T22:12:58.7311979Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark) registered for path 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:12:58.7315338Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:12:58.7318719Z Submodule 'third_party/ms-gsl' (https://github.com/microsoft/GSL) registered for path 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:12:58.7322491Z Submodule 'third_party/nlohmann-json' (https://github.com/nlohmann/json) registered for path 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:12:58.7326215Z Submodule 'third_party/opentelemetry-proto' (https://github.com/open-telemetry/opentelemetry-proto) registered for path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:12:58.7329795Z Submodule 'third_party/opentracing-cpp' (https://github.com/opentracing/opentracing-cpp.git) registered for path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:12:58.7333525Z Submodule 'third_party/prometheus-cpp' (https://github.com/jupp0r/prometheus-cpp) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:12:58.7337123Z Submodule 'tools/vcpkg' (https://github.com/Microsoft/vcpkg) registered for path 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:12:58.7369956Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/benchmark'... 2024-08-20T22:12:59.1574800Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/googletest'... 2024-08-20T22:13:00.1935531Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/ms-gsl'... 2024-08-20T22:13:00.5228955Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/nlohmann-json'... 2024-08-20T22:13:06.4803062Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentelemetry-proto'... 2024-08-20T22:13:06.8003095Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentracing-cpp'... 2024-08-20T22:13:07.0311833Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp'... 2024-08-20T22:13:07.3327612Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/tools/vcpkg'... 2024-08-20T22:13:14.1380561Z Submodule path 'third_party/opentelemetry-cpp/third_party/benchmark': checked out 'd572f4777349d43653b21d6c2fc63020ab326db2' 2024-08-20T22:13:14.1847461Z Submodule path 'third_party/opentelemetry-cpp/third_party/googletest': checked out 'b796f7d44681514f58a683a3a71ff17c94edb0c1' 2024-08-20T22:13:14.2038639Z Submodule path 'third_party/opentelemetry-cpp/third_party/ms-gsl': checked out '6f4529395c5b7c2d661812257cd6780c67e54afa' 2024-08-20T22:13:14.3239897Z Submodule path 'third_party/opentelemetry-cpp/third_party/nlohmann-json': checked out 'bc889afb4c5bf1c0d8ee29ef35eaaf4c8bef8a5d' 2024-08-20T22:13:14.3398422Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto': checked out '4ca4f0335c63cda7ab31ea7ed70d6553aee14dce' 2024-08-20T22:13:14.3585412Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp': checked out '06b57f48ded1fa3bdd3d4346f6ef29e40e08eaf5' 2024-08-20T22:13:14.3784755Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp': checked out 'c9ffcdda9086ffd9e1283ea7a0276d831f3c8a8d' 2024-08-20T22:13:14.3802496Z Submodule 'civetweb' (https://github.com/civetweb/civetweb.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:13:14.3805797Z Submodule 'googletest' (https://github.com/google/googletest.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:13:14.3841342Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'... 2024-08-20T22:13:16.2594854Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'... 2024-08-20T22:13:17.6082072Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb': checked out 'eefb26f82b233268fc98577d265352720d477ba4' 2024-08-20T22:13:17.6617508Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2024-08-20T22:13:18.3343530Z Submodule path 'third_party/opentelemetry-cpp/tools/vcpkg': checked out '8eb57355a4ffb410a2e94c07b4dca2dffbee8e50' 2024-08-20T22:13:18.3485489Z Submodule path 'third_party/pocketfft': checked out '9d3ab05a7fffbc71a492bc6a17be034e83e8f0fe' 2024-08-20T22:13:18.6647009Z Submodule path 'third_party/protobuf': checked out 'd1eca4e4b421cd2997495c4b4e65cea6be4e9b8a' 2024-08-20T22:13:18.6671033Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:13:18.6674368Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/protobuf/third_party/googletest' 2024-08-20T22:13:18.6707035Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/benchmark'... 2024-08-20T22:13:19.1190345Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/googletest'... 2024-08-20T22:13:20.1704676Z Submodule path 'third_party/protobuf/third_party/benchmark': checked out '5b7683f49e1e9223cf9927b24f6fd3d6bd82e3f8' 2024-08-20T22:13:20.2523042Z Submodule path 'third_party/protobuf/third_party/googletest': checked out '5ec7f0c4a113e2f18ac2c6cc7df51ad6afc24081' 2024-08-20T22:13:20.2646649Z Submodule path 'third_party/psimd': checked out '072586a71b55b7f8c584153d223e95687148a900' 2024-08-20T22:13:20.2802344Z Submodule path 'third_party/pthreadpool': checked out '4fe0e1e183925bf8cfa6aae24237e724a96479b8' 2024-08-20T22:13:20.3256949Z Submodule path 'third_party/pybind11': checked out '941f45bcb51457884fa1afd6e24a67377d70f75c' 2024-08-20T22:13:20.3599721Z Submodule path 'third_party/python-peachpy': checked out 'f45429b087dd7d5bc78bb40dc7cf06425c252d67' 2024-08-20T22:13:20.4088555Z Submodule path 'third_party/sleef': checked out '60e76d2bce17d278b439d9da17177c8f957a9e9b' 2024-08-20T22:13:20.4429364Z Submodule path 'third_party/tensorpipe': checked out '52791a2fd214b2a9dc5759d36725909c1daa7f2e' 2024-08-20T22:13:20.4449955Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:13:20.4453178Z Submodule 'third_party/libnop' (https://github.com/google/libnop.git) registered for path 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:13:20.4456947Z Submodule 'third_party/libuv' (https://github.com/libuv/libuv.git) registered for path 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:13:20.4460331Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:13:20.4495951Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/googletest'... 2024-08-20T22:13:21.4768420Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libnop'... 2024-08-20T22:13:21.7344851Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libuv'... 2024-08-20T22:13:22.8765406Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11'... 2024-08-20T22:13:23.8588618Z Submodule path 'third_party/tensorpipe/third_party/googletest': checked out 'aee0f9d9b5b87796ee8a0ab26b7587ec30e8858e' 2024-08-20T22:13:23.8778220Z Submodule path 'third_party/tensorpipe/third_party/libnop': checked out '910b55815be16109f04f4180e9adee14fb4ce281' 2024-08-20T22:13:23.9548830Z Submodule path 'third_party/tensorpipe/third_party/libuv': checked out '1dff88e5161cba5c59276d2070d2e304e4dcb242' 2024-08-20T22:13:23.9896847Z Submodule path 'third_party/tensorpipe/third_party/pybind11': checked out 'a23996fce38ff6ccfbcdc09f1e63f2c4be5ea2ef' 2024-08-20T22:13:23.9916624Z Submodule 'tools/clang' (https://github.com/wjakob/clang-cindex-python3) registered for path 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:13:23.9947549Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11/tools/clang'... 2024-08-20T22:13:24.2267837Z Submodule path 'third_party/tensorpipe/third_party/pybind11/tools/clang': checked out '6a00cbc4a9b8e68b71caf7f774b3f9c753ae84d5' 2024-08-20T22:13:24.2315659Z [command]/usr/bin/git submodule foreach --recursive git config --local gc.auto 0 2024-08-20T22:13:24.2679219Z Entering 'android/libs/fbjni' 2024-08-20T22:13:24.2734656Z Entering 'third_party/FP16' 2024-08-20T22:13:24.2787921Z Entering 'third_party/FXdiv' 2024-08-20T22:13:24.2839240Z Entering 'third_party/NNPACK' 2024-08-20T22:13:24.2893201Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T22:13:24.2944792Z Entering 'third_party/XNNPACK' 2024-08-20T22:13:24.3013142Z Entering 'third_party/benchmark' 2024-08-20T22:13:24.3065481Z Entering 'third_party/cpp-httplib' 2024-08-20T22:13:24.3116146Z Entering 'third_party/cpuinfo' 2024-08-20T22:13:24.3168575Z Entering 'third_party/cudnn_frontend' 2024-08-20T22:13:24.3219108Z Entering 'third_party/cutlass' 2024-08-20T22:13:24.3277556Z Entering 'third_party/eigen' 2024-08-20T22:13:24.3330116Z Entering 'third_party/fbgemm' 2024-08-20T22:13:24.3381503Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:13:24.3431382Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:13:24.3486306Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:13:24.3543865Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:13:24.3594718Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:13:24.3646673Z Entering 'third_party/flatbuffers' 2024-08-20T22:13:24.3704102Z Entering 'third_party/fmt' 2024-08-20T22:13:24.3756779Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:13:24.3808745Z Entering 'third_party/gloo' 2024-08-20T22:13:24.3860982Z Entering 'third_party/googletest' 2024-08-20T22:13:24.3913084Z Entering 'third_party/ideep' 2024-08-20T22:13:24.3963736Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T22:13:24.4023765Z Entering 'third_party/ittapi' 2024-08-20T22:13:24.4075751Z Entering 'third_party/kineto' 2024-08-20T22:13:24.4126719Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:13:24.4176477Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:13:24.4228655Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:13:24.4280467Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:13:24.4329708Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:13:24.4378515Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:13:24.4434214Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:13:24.4485174Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:13:24.4534463Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:13:24.4585455Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:13:24.4637776Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:13:24.4693316Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:13:24.4746327Z Entering 'third_party/mimalloc' 2024-08-20T22:13:24.4798889Z Entering 'third_party/nccl/nccl' 2024-08-20T22:13:24.4852576Z Entering 'third_party/nlohmann' 2024-08-20T22:13:24.4905623Z Entering 'third_party/onnx' 2024-08-20T22:13:24.4971621Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T22:13:24.5022383Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T22:13:24.5081981Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T22:13:24.5134402Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:13:24.5184794Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:13:24.5233237Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:13:24.5284335Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:13:24.5335207Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:13:24.5391838Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:13:24.5440906Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:13:24.5489400Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:13:24.5541614Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:13:24.5595150Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:13:24.5668895Z Entering 'third_party/pocketfft' 2024-08-20T22:13:24.5720810Z Entering 'third_party/protobuf' 2024-08-20T22:13:24.5774540Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:13:24.5824312Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T22:13:24.5881281Z Entering 'third_party/psimd' 2024-08-20T22:13:24.5932849Z Entering 'third_party/pthreadpool' 2024-08-20T22:13:24.5984258Z Entering 'third_party/pybind11' 2024-08-20T22:13:24.6036247Z Entering 'third_party/python-peachpy' 2024-08-20T22:13:24.6090627Z Entering 'third_party/sleef' 2024-08-20T22:13:24.6142578Z Entering 'third_party/tensorpipe' 2024-08-20T22:13:24.6193584Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:13:24.6245184Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:13:24.6295113Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:13:24.6345311Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:13:24.6393915Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:13:24.6471302Z ##[endgroup] 2024-08-20T22:13:24.6473990Z ##[group]Persisting credentials for submodules 2024-08-20T22:13:24.6476068Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'url\.https\:\/\/github\.com\/\.insteadOf' && git config --local --unset-all 'url.https://github.com/.insteadOf' || :" 2024-08-20T22:13:24.6836878Z Entering 'android/libs/fbjni' 2024-08-20T22:13:24.6905309Z Entering 'third_party/FP16' 2024-08-20T22:13:24.6972003Z Entering 'third_party/FXdiv' 2024-08-20T22:13:24.7038341Z Entering 'third_party/NNPACK' 2024-08-20T22:13:24.7111278Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T22:13:24.7177980Z Entering 'third_party/XNNPACK' 2024-08-20T22:13:24.7267254Z Entering 'third_party/benchmark' 2024-08-20T22:13:24.7333841Z Entering 'third_party/cpp-httplib' 2024-08-20T22:13:24.7402639Z Entering 'third_party/cpuinfo' 2024-08-20T22:13:24.7471394Z Entering 'third_party/cudnn_frontend' 2024-08-20T22:13:24.7538002Z Entering 'third_party/cutlass' 2024-08-20T22:13:24.7612652Z Entering 'third_party/eigen' 2024-08-20T22:13:24.7683177Z Entering 'third_party/fbgemm' 2024-08-20T22:13:24.7748801Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:13:24.7821004Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:13:24.7887413Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:13:24.7960560Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:13:24.8026634Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:13:24.8095648Z Entering 'third_party/flatbuffers' 2024-08-20T22:13:24.8165071Z Entering 'third_party/fmt' 2024-08-20T22:13:24.8231999Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:13:24.8299447Z Entering 'third_party/gloo' 2024-08-20T22:13:24.8373573Z Entering 'third_party/googletest' 2024-08-20T22:13:24.8443799Z Entering 'third_party/ideep' 2024-08-20T22:13:24.8508565Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T22:13:24.8589035Z Entering 'third_party/ittapi' 2024-08-20T22:13:24.8656365Z Entering 'third_party/kineto' 2024-08-20T22:13:24.8721389Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:13:24.8787311Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:13:24.8860437Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:13:24.8926518Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:13:24.8993746Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:13:24.9057683Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:13:24.9129028Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:13:24.9202112Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:13:24.9269337Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:13:24.9337175Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:13:24.9412214Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:13:24.9479044Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:13:24.9548518Z Entering 'third_party/mimalloc' 2024-08-20T22:13:24.9616295Z Entering 'third_party/nccl/nccl' 2024-08-20T22:13:24.9683904Z Entering 'third_party/nlohmann' 2024-08-20T22:13:24.9754816Z Entering 'third_party/onnx' 2024-08-20T22:13:24.9836101Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T22:13:24.9905270Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T22:13:24.9978024Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T22:13:25.0050550Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:13:25.0119157Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:13:25.0185065Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:13:25.0252767Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:13:25.0318340Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:13:25.0383572Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:13:25.0448755Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:13:25.0511833Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:13:25.0581194Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:13:25.0650217Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:13:25.0737123Z Entering 'third_party/pocketfft' 2024-08-20T22:13:25.0804888Z Entering 'third_party/protobuf' 2024-08-20T22:13:25.0875817Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:13:25.0941952Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T22:13:25.1011641Z Entering 'third_party/psimd' 2024-08-20T22:13:25.1078712Z Entering 'third_party/pthreadpool' 2024-08-20T22:13:25.1151060Z Entering 'third_party/pybind11' 2024-08-20T22:13:25.1217619Z Entering 'third_party/python-peachpy' 2024-08-20T22:13:25.1284195Z Entering 'third_party/sleef' 2024-08-20T22:13:25.1353331Z Entering 'third_party/tensorpipe' 2024-08-20T22:13:25.1418319Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:13:25.1484294Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:13:25.1552671Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:13:25.1621486Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:13:25.1685838Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:13:25.1776445Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local 'http.https://github.com/.extraheader' 'AUTHORIZATION: basic ***' && git config --local --show-origin --name-only --get-regexp remote.origin.url" 2024-08-20T22:13:25.2140111Z Entering 'android/libs/fbjni' 2024-08-20T22:13:25.2206381Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/android/libs/fbjni/config remote.origin.url 2024-08-20T22:13:25.2227932Z Entering 'third_party/FP16' 2024-08-20T22:13:25.2290994Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FP16/config remote.origin.url 2024-08-20T22:13:25.2312363Z Entering 'third_party/FXdiv' 2024-08-20T22:13:25.2375350Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FXdiv/config remote.origin.url 2024-08-20T22:13:25.2396662Z Entering 'third_party/NNPACK' 2024-08-20T22:13:25.2459572Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK/config remote.origin.url 2024-08-20T22:13:25.2481748Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T22:13:25.2549697Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/VulkanMemoryAllocator/config remote.origin.url 2024-08-20T22:13:25.2572336Z Entering 'third_party/XNNPACK' 2024-08-20T22:13:25.2633939Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/XNNPACK/config remote.origin.url 2024-08-20T22:13:25.2671590Z Entering 'third_party/benchmark' 2024-08-20T22:13:25.2733241Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/benchmark/config remote.origin.url 2024-08-20T22:13:25.2755551Z Entering 'third_party/cpp-httplib' 2024-08-20T22:13:25.2818299Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpp-httplib/config remote.origin.url 2024-08-20T22:13:25.2840763Z Entering 'third_party/cpuinfo' 2024-08-20T22:13:25.2903109Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpuinfo/config remote.origin.url 2024-08-20T22:13:25.2925426Z Entering 'third_party/cudnn_frontend' 2024-08-20T22:13:25.2987603Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cudnn_frontend/config remote.origin.url 2024-08-20T22:13:25.3009903Z Entering 'third_party/cutlass' 2024-08-20T22:13:25.3072241Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cutlass/config remote.origin.url 2024-08-20T22:13:25.3101132Z Entering 'third_party/eigen' 2024-08-20T22:13:25.3162402Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/eigen/config remote.origin.url 2024-08-20T22:13:25.3185870Z Entering 'third_party/fbgemm' 2024-08-20T22:13:25.3247974Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/config remote.origin.url 2024-08-20T22:13:25.3267909Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:13:25.3338048Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/asmjit/config remote.origin.url 2024-08-20T22:13:25.3359423Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:13:25.3424274Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cpuinfo/config remote.origin.url 2024-08-20T22:13:25.3444661Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:13:25.3507522Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cutlass/config remote.origin.url 2024-08-20T22:13:25.3539276Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:13:25.3601571Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/googletest/config remote.origin.url 2024-08-20T22:13:25.3624467Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:13:25.3685937Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/hipify_torch/config remote.origin.url 2024-08-20T22:13:25.3709323Z Entering 'third_party/flatbuffers' 2024-08-20T22:13:25.3773219Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/flatbuffers/config remote.origin.url 2024-08-20T22:13:25.3797639Z Entering 'third_party/fmt' 2024-08-20T22:13:25.3860040Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fmt/config remote.origin.url 2024-08-20T22:13:25.3881764Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:13:25.3942562Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gemmlowp/gemmlowp/config remote.origin.url 2024-08-20T22:13:25.3964507Z Entering 'third_party/gloo' 2024-08-20T22:13:25.4026151Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gloo/config remote.origin.url 2024-08-20T22:13:25.4046971Z Entering 'third_party/googletest' 2024-08-20T22:13:25.4109221Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/googletest/config remote.origin.url 2024-08-20T22:13:25.4131997Z Entering 'third_party/ideep' 2024-08-20T22:13:25.4194112Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/config remote.origin.url 2024-08-20T22:13:25.4213213Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T22:13:25.4278111Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/modules/mkl-dnn/config remote.origin.url 2024-08-20T22:13:25.4311696Z Entering 'third_party/ittapi' 2024-08-20T22:13:25.4373014Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ittapi/config remote.origin.url 2024-08-20T22:13:25.4394085Z Entering 'third_party/kineto' 2024-08-20T22:13:25.4457969Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/config remote.origin.url 2024-08-20T22:13:25.4478014Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:13:25.4542416Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/config remote.origin.url 2024-08-20T22:13:25.4560882Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:13:25.4623252Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/DCGM/config remote.origin.url 2024-08-20T22:13:25.4645228Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:13:25.4706790Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/cpr/config remote.origin.url 2024-08-20T22:13:25.4727418Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:13:25.4790274Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/fmt/config remote.origin.url 2024-08-20T22:13:25.4811314Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:13:25.4874534Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/config remote.origin.url 2024-08-20T22:13:25.4893022Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:13:25.4957646Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/modules/doc/config remote.origin.url 2024-08-20T22:13:25.4980863Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:13:25.5043210Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/glog/config remote.origin.url 2024-08-20T22:13:25.5063812Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:13:25.5127419Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/googletest/config remote.origin.url 2024-08-20T22:13:25.5146723Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:13:25.5218309Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/json/config remote.origin.url 2024-08-20T22:13:25.5240873Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:13:25.5307333Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/pfs/config remote.origin.url 2024-08-20T22:13:25.5332189Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:13:25.5394638Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/fmt/config remote.origin.url 2024-08-20T22:13:25.5415657Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:13:25.5477471Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/googletest/config remote.origin.url 2024-08-20T22:13:25.5502751Z Entering 'third_party/mimalloc' 2024-08-20T22:13:25.5565983Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/mimalloc/config remote.origin.url 2024-08-20T22:13:25.5587469Z Entering 'third_party/nccl/nccl' 2024-08-20T22:13:25.5648708Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nccl/nccl/config remote.origin.url 2024-08-20T22:13:25.5670201Z Entering 'third_party/nlohmann' 2024-08-20T22:13:25.5730677Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nlohmann/config remote.origin.url 2024-08-20T22:13:25.5754115Z Entering 'third_party/onnx' 2024-08-20T22:13:25.5816064Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/config remote.origin.url 2024-08-20T22:13:25.5851228Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T22:13:25.5916891Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/benchmark/config remote.origin.url 2024-08-20T22:13:25.5938224Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T22:13:25.5999699Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/pybind11/config remote.origin.url 2024-08-20T22:13:25.6025675Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T22:13:25.6088448Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/config remote.origin.url 2024-08-20T22:13:25.6109854Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:13:25.6179648Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/benchmark/config remote.origin.url 2024-08-20T22:13:25.6198827Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:13:25.6259345Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/googletest/config remote.origin.url 2024-08-20T22:13:25.6279395Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:13:25.6340510Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/ms-gsl/config remote.origin.url 2024-08-20T22:13:25.6360736Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:13:25.6423282Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/nlohmann-json/config remote.origin.url 2024-08-20T22:13:25.6446629Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:13:25.6506465Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentelemetry-proto/config remote.origin.url 2024-08-20T22:13:25.6525996Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:13:25.6587539Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentracing-cpp/config remote.origin.url 2024-08-20T22:13:25.6606873Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:13:25.6668318Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/config remote.origin.url 2024-08-20T22:13:25.6686073Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:13:25.6750714Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/civetweb/config remote.origin.url 2024-08-20T22:13:25.6772404Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:13:25.6832484Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/googletest/config remote.origin.url 2024-08-20T22:13:25.6854930Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:13:25.6915698Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/tools/vcpkg/config remote.origin.url 2024-08-20T22:13:25.6959195Z Entering 'third_party/pocketfft' 2024-08-20T22:13:25.7022934Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pocketfft/config remote.origin.url 2024-08-20T22:13:25.7043132Z Entering 'third_party/protobuf' 2024-08-20T22:13:25.7107211Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/config remote.origin.url 2024-08-20T22:13:25.7130365Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:13:25.7191833Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/benchmark/config remote.origin.url 2024-08-20T22:13:25.7211420Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T22:13:25.7271869Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/googletest/config remote.origin.url 2024-08-20T22:13:25.7294855Z Entering 'third_party/psimd' 2024-08-20T22:13:25.7358043Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/psimd/config remote.origin.url 2024-08-20T22:13:25.7380035Z Entering 'third_party/pthreadpool' 2024-08-20T22:13:25.7441161Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/pthreadpool/config remote.origin.url 2024-08-20T22:13:25.7462780Z Entering 'third_party/pybind11' 2024-08-20T22:13:25.7524246Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pybind11/config remote.origin.url 2024-08-20T22:13:25.7544377Z Entering 'third_party/python-peachpy' 2024-08-20T22:13:25.7606115Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/python-peachpy/config remote.origin.url 2024-08-20T22:13:25.7626018Z Entering 'third_party/sleef' 2024-08-20T22:13:25.7688180Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/sleef/config remote.origin.url 2024-08-20T22:13:25.7709172Z Entering 'third_party/tensorpipe' 2024-08-20T22:13:25.7770680Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/config remote.origin.url 2024-08-20T22:13:25.7790239Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:13:25.7856991Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/googletest/config remote.origin.url 2024-08-20T22:13:25.7876425Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:13:25.7936766Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libnop/config remote.origin.url 2024-08-20T22:13:25.7965352Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:13:25.8025426Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libuv/config remote.origin.url 2024-08-20T22:13:25.8045279Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:13:25.8105927Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/config remote.origin.url 2024-08-20T22:13:25.8123912Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:13:25.8186071Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/modules/tools/clang/config remote.origin.url 2024-08-20T22:13:25.8958158Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'git@github.com:' 2024-08-20T22:13:25.9319474Z Entering 'android/libs/fbjni' 2024-08-20T22:13:25.9374554Z Entering 'third_party/FP16' 2024-08-20T22:13:25.9426675Z Entering 'third_party/FXdiv' 2024-08-20T22:13:25.9478757Z Entering 'third_party/NNPACK' 2024-08-20T22:13:25.9530654Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T22:13:25.9582220Z Entering 'third_party/XNNPACK' 2024-08-20T22:13:25.9648408Z Entering 'third_party/benchmark' 2024-08-20T22:13:25.9699470Z Entering 'third_party/cpp-httplib' 2024-08-20T22:13:25.9750154Z Entering 'third_party/cpuinfo' 2024-08-20T22:13:25.9801384Z Entering 'third_party/cudnn_frontend' 2024-08-20T22:13:25.9853156Z Entering 'third_party/cutlass' 2024-08-20T22:13:25.9911865Z Entering 'third_party/eigen' 2024-08-20T22:13:25.9965717Z Entering 'third_party/fbgemm' 2024-08-20T22:13:26.0016910Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:13:26.0068054Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:13:26.0117719Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:13:26.0174673Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:13:26.0224859Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:13:26.0276235Z Entering 'third_party/flatbuffers' 2024-08-20T22:13:26.0330692Z Entering 'third_party/fmt' 2024-08-20T22:13:26.0383075Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:13:26.0434890Z Entering 'third_party/gloo' 2024-08-20T22:13:26.0487932Z Entering 'third_party/googletest' 2024-08-20T22:13:26.0540005Z Entering 'third_party/ideep' 2024-08-20T22:13:26.0589759Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T22:13:26.0648476Z Entering 'third_party/ittapi' 2024-08-20T22:13:26.0701672Z Entering 'third_party/kineto' 2024-08-20T22:13:26.0752995Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:13:26.0802173Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:13:26.0854781Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:13:26.0904454Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:13:26.0955487Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:13:26.1002902Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:13:26.1057771Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:13:26.1109288Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:13:26.1160583Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:13:26.1212563Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:13:26.1268147Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:13:26.1323335Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:13:26.1380665Z Entering 'third_party/mimalloc' 2024-08-20T22:13:26.1434577Z Entering 'third_party/nccl/nccl' 2024-08-20T22:13:26.1486938Z Entering 'third_party/nlohmann' 2024-08-20T22:13:26.1540331Z Entering 'third_party/onnx' 2024-08-20T22:13:26.1606715Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T22:13:26.1657148Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T22:13:26.1714819Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T22:13:26.1769503Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:13:26.1819735Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:13:26.1870894Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:13:26.1925858Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:13:26.1977775Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:13:26.2027798Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:13:26.2077876Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:13:26.2131348Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:13:26.2184471Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:13:26.2237299Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:13:26.2311501Z Entering 'third_party/pocketfft' 2024-08-20T22:13:26.2362814Z Entering 'third_party/protobuf' 2024-08-20T22:13:26.2415125Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:13:26.2465236Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T22:13:26.2518972Z Entering 'third_party/psimd' 2024-08-20T22:13:26.2571752Z Entering 'third_party/pthreadpool' 2024-08-20T22:13:26.2622492Z Entering 'third_party/pybind11' 2024-08-20T22:13:26.2673649Z Entering 'third_party/python-peachpy' 2024-08-20T22:13:26.2724348Z Entering 'third_party/sleef' 2024-08-20T22:13:26.2776219Z Entering 'third_party/tensorpipe' 2024-08-20T22:13:26.2826397Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:13:26.2876436Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:13:26.2926736Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:13:26.2980586Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:13:26.3028908Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:13:26.3106389Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'org-21003710@github.com:' 2024-08-20T22:13:26.3466760Z Entering 'android/libs/fbjni' 2024-08-20T22:13:26.3518565Z Entering 'third_party/FP16' 2024-08-20T22:13:26.3570222Z Entering 'third_party/FXdiv' 2024-08-20T22:13:26.3621649Z Entering 'third_party/NNPACK' 2024-08-20T22:13:26.3674479Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T22:13:26.3725557Z Entering 'third_party/XNNPACK' 2024-08-20T22:13:26.3795994Z Entering 'third_party/benchmark' 2024-08-20T22:13:26.3849408Z Entering 'third_party/cpp-httplib' 2024-08-20T22:13:26.3900455Z Entering 'third_party/cpuinfo' 2024-08-20T22:13:26.3953489Z Entering 'third_party/cudnn_frontend' 2024-08-20T22:13:26.4004478Z Entering 'third_party/cutlass' 2024-08-20T22:13:26.4066186Z Entering 'third_party/eigen' 2024-08-20T22:13:26.4119899Z Entering 'third_party/fbgemm' 2024-08-20T22:13:26.4171262Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:13:26.4222004Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:13:26.4276523Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:13:26.4338035Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:13:26.4389641Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:13:26.4449780Z Entering 'third_party/flatbuffers' 2024-08-20T22:13:26.4504867Z Entering 'third_party/fmt' 2024-08-20T22:13:26.4557763Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:13:26.4610554Z Entering 'third_party/gloo' 2024-08-20T22:13:26.4662312Z Entering 'third_party/googletest' 2024-08-20T22:13:26.4714526Z Entering 'third_party/ideep' 2024-08-20T22:13:26.4764457Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T22:13:26.4823220Z Entering 'third_party/ittapi' 2024-08-20T22:13:26.4878985Z Entering 'third_party/kineto' 2024-08-20T22:13:26.4930229Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:13:26.4981451Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:13:26.5034322Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:13:26.5084286Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:13:26.5135298Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:13:26.5185192Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:13:26.5239618Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:13:26.5290578Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:13:26.5342443Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:13:26.5393150Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:13:26.5446479Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:13:26.5497403Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:13:26.5551696Z Entering 'third_party/mimalloc' 2024-08-20T22:13:26.5604794Z Entering 'third_party/nccl/nccl' 2024-08-20T22:13:26.5657731Z Entering 'third_party/nlohmann' 2024-08-20T22:13:26.5711441Z Entering 'third_party/onnx' 2024-08-20T22:13:26.5781546Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T22:13:26.5836098Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T22:13:26.5892439Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T22:13:26.5945028Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:13:26.5995116Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:13:26.6045235Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:13:26.6096992Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:13:26.6148749Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:13:26.6203375Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:13:26.6256149Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:13:26.6304491Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:13:26.6358164Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:13:26.6408705Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:13:26.6480158Z Entering 'third_party/pocketfft' 2024-08-20T22:13:26.6532544Z Entering 'third_party/protobuf' 2024-08-20T22:13:26.6586208Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:13:26.6636713Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T22:13:26.6691898Z Entering 'third_party/psimd' 2024-08-20T22:13:26.6743890Z Entering 'third_party/pthreadpool' 2024-08-20T22:13:26.6796526Z Entering 'third_party/pybind11' 2024-08-20T22:13:26.6850474Z Entering 'third_party/python-peachpy' 2024-08-20T22:13:26.6902646Z Entering 'third_party/sleef' 2024-08-20T22:13:26.6955680Z Entering 'third_party/tensorpipe' 2024-08-20T22:13:26.7007065Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:13:26.7061832Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:13:26.7112773Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:13:26.7166089Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:13:26.7213854Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:13:26.7288887Z ##[endgroup] 2024-08-20T22:13:26.7340653Z [command]/usr/bin/git log -1 --format='%H' 2024-08-20T22:13:26.7383167Z '40ec5f6ddd9787aca0449b24128343ff4c4a88b3' 2024-08-20T22:13:26.7593906Z Prepare all required actions 2024-08-20T22:13:26.7594345Z Getting action download info 2024-08-20T22:13:26.9062356Z ##[group]Run ./.github/actions/setup-linux 2024-08-20T22:13:26.9062788Z env: 2024-08-20T22:13:26.9063060Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:13:26.9063397Z ##[endgroup] 2024-08-20T22:13:26.9121732Z ##[group]Run set -euo pipefail 2024-08-20T22:13:26.9122160Z set -euo pipefail 2024-08-20T22:13:26.9122557Z function get_ec2_metadata() { 2024-08-20T22:13:26.9123098Z  # Pulled from instance metadata endpoint for EC2 2024-08-20T22:13:26.9123997Z  # see https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/instancedata-data-retrieval.html 2024-08-20T22:13:26.9124760Z  category=$1 2024-08-20T22:13:26.9125306Z  # If it is GCP runner (runner name contains gcp), do not run this 2024-08-20T22:13:26.9125952Z  runner_name_str=i-0743dc4f7ebf3bb79 2024-08-20T22:13:26.9126443Z  if [[ -f /.inarc ]]; then 2024-08-20T22:13:26.9126941Z  echo "ARC Runner, no info on ec2 metadata" 2024-08-20T22:13:26.9127513Z  elif [[ $runner_name_str == *"gcp"* ]]; then 2024-08-20T22:13:26.9128200Z  echo "Runner is from Google Cloud Platform, No info on ec2 metadata" 2024-08-20T22:13:26.9128801Z  else 2024-08-20T22:13:26.9129292Z  curl -fsSL "http://169.254.169.254/latest/meta-data/${category}" 2024-08-20T22:13:26.9129866Z  fi 2024-08-20T22:13:26.9130157Z } 2024-08-20T22:13:26.9130513Z echo "ami-id: $(get_ec2_metadata ami-id)" 2024-08-20T22:13:26.9131101Z echo "instance-id: $(get_ec2_metadata instance-id)" 2024-08-20T22:13:26.9131759Z echo "instance-type: $(get_ec2_metadata instance-type)" 2024-08-20T22:13:26.9132335Z echo "system info $(uname -a)" 2024-08-20T22:13:26.9142679Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:13:26.9143168Z env: 2024-08-20T22:13:26.9143449Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:13:26.9143789Z ##[endgroup] 2024-08-20T22:13:26.9242266Z ami-id: ami-06c68f701d8090592 2024-08-20T22:13:26.9305677Z instance-id: i-0743dc4f7ebf3bb79 2024-08-20T22:13:26.9363579Z instance-type: g5.4xlarge 2024-08-20T22:13:26.9377350Z system info Linux ip-10-0-77-165.ec2.internal 6.1.94-99.176.amzn2023.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Jun 18 14:57:56 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux 2024-08-20T22:13:26.9400386Z ##[group]Run echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> $GITHUB_OUTPUT 2024-08-20T22:13:26.9401286Z echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> $GITHUB_OUTPUT 2024-08-20T22:13:26.9410206Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:13:26.9410871Z env: 2024-08-20T22:13:26.9411144Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:13:26.9411482Z ##[endgroup] 2024-08-20T22:13:26.9484988Z ##[group]Run if systemctl is-active --quiet docker; then 2024-08-20T22:13:26.9485587Z if systemctl is-active --quiet docker; then 2024-08-20T22:13:26.9486121Z  echo "Docker daemon is running..."; 2024-08-20T22:13:26.9486565Z else 2024-08-20T22:13:26.9487046Z  echo "Starting docker deamon..." && sudo systemctl start docker; 2024-08-20T22:13:26.9487618Z fi 2024-08-20T22:13:26.9495712Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:13:26.9496198Z env: 2024-08-20T22:13:26.9496470Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:13:26.9496812Z ##[endgroup] 2024-08-20T22:13:26.9579630Z Docker daemon is running... 2024-08-20T22:13:26.9628446Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2024-08-20T22:13:26.9629007Z with: 2024-08-20T22:13:26.9629292Z shell: bash 2024-08-20T22:13:26.9629579Z timeout_minutes: 5 2024-08-20T22:13:26.9629897Z max_attempts: 3 2024-08-20T22:13:26.9630206Z retry_wait_seconds: 30 2024-08-20T22:13:26.9633358Z command: AWS_ACCOUNT_ID=$(aws sts get-caller-identity|grep Account|cut -f4 -d\") aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \ --password-stdin "$AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com" # For LF Runners we need to make sure we also login to Meta's ECR docker registry too. META_AWS_ACCOUNT_ID=308535385114 if [ "$AWS_ACCOUNT_ID" != "$META_AWS_ACCOUNT_ID" ] ; then aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \ --password-stdin "$META_AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com" fi 2024-08-20T22:13:26.9636438Z polling_interval_seconds: 1 2024-08-20T22:13:26.9636833Z warning_on_retry: true 2024-08-20T22:13:26.9637191Z continue_on_error: false 2024-08-20T22:13:26.9637540Z env: 2024-08-20T22:13:26.9637826Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:13:26.9638193Z AWS_RETRY_MODE: standard 2024-08-20T22:13:26.9638668Z AWS_MAX_ATTEMPTS: 5 2024-08-20T22:13:26.9639009Z AWS_DEFAULT_REGION: us-east-1 2024-08-20T22:13:26.9639391Z ##[endgroup] 2024-08-20T22:13:28.1241203Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-08-20T22:13:28.1242032Z Configure a credential helper to remove this warning. See 2024-08-20T22:13:28.1243682Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-08-20T22:13:28.1244217Z 2024-08-20T22:13:28.1244345Z Login Succeeded 2024-08-20T22:13:29.0196212Z Command completed after 1 attempt(s). 2024-08-20T22:13:29.0262649Z ##[group]Run env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-08-20T22:13:29.0263349Z env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-08-20T22:13:29.0263987Z env | grep '^CI' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-08-20T22:13:29.0274320Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:13:29.0274810Z env: 2024-08-20T22:13:29.0275086Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:13:29.0275430Z ##[endgroup] 2024-08-20T22:13:29.0374239Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2024-08-20T22:13:29.0375012Z # ignore expansion of "docker ps -q" since it could be empty 2024-08-20T22:13:29.0375608Z # shellcheck disable=SC2046 2024-08-20T22:13:29.0376069Z docker stop $(docker ps -q) || true 2024-08-20T22:13:29.0376545Z # Prune all of the docker images 2024-08-20T22:13:29.0376995Z docker system prune -af 2024-08-20T22:13:29.0385540Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:13:29.0386024Z env: 2024-08-20T22:13:29.0386296Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:13:29.0386638Z ##[endgroup] 2024-08-20T22:13:29.0704959Z "docker stop" requires at least 1 argument. 2024-08-20T22:13:29.0705810Z See 'docker stop --help'. 2024-08-20T22:13:29.0706333Z 2024-08-20T22:13:29.0706558Z Usage: docker stop [OPTIONS] CONTAINER [CONTAINER...] 2024-08-20T22:13:29.0706935Z 2024-08-20T22:13:29.0707090Z Stop one or more running containers 2024-08-20T22:13:29.0901710Z Total reclaimed space: 0B 2024-08-20T22:13:29.0951811Z ##[group]Run set +e 2024-08-20T22:13:29.0952163Z set +e 2024-08-20T22:13:29.0952463Z set -x 2024-08-20T22:13:29.0952757Z  2024-08-20T22:13:29.0953072Z PT_DOMAIN=download.pytorch.org 2024-08-20T22:13:29.0953862Z # TODO: Flaky access to download.pytorch.org https://github.com/pytorch/pytorch/issues/100400, 2024-08-20T22:13:29.0954944Z # cleaning this up once the issue is fixed. There are more than one resolved IP here, the last 2024-08-20T22:13:29.0955687Z # one is returned at random 2024-08-20T22:13:29.0956225Z RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" | tail -n1) 2024-08-20T22:13:29.0956729Z  2024-08-20T22:13:29.0957058Z if [ -z "${RESOLVED_IP}" ]; then 2024-08-20T22:13:29.0957677Z  echo "Couldn't resolve ${PT_DOMAIN}, retrying with Google DNS..." 2024-08-20T22:13:29.0958779Z  RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" @8.8.8.8 | tail -n1) 2024-08-20T22:13:29.0959338Z  2024-08-20T22:13:29.0959661Z  if [ -z "${RESOLVED_IP}" ]; then 2024-08-20T22:13:29.0960206Z  echo "Couldn't resolve ${PT_DOMAIN}, exiting..." 2024-08-20T22:13:29.0960714Z  exit 1 2024-08-20T22:13:29.0961015Z  fi 2024-08-20T22:13:29.0961299Z fi 2024-08-20T22:13:29.0961572Z  2024-08-20T22:13:29.0961940Z if grep -r "${PT_DOMAIN}" /etc/hosts; then 2024-08-20T22:13:29.0962516Z  # Clean up any old records first 2024-08-20T22:13:29.0963019Z  sudo sed -i "/${PT_DOMAIN}/d" /etc/hosts 2024-08-20T22:13:29.0963464Z fi 2024-08-20T22:13:29.0963729Z  2024-08-20T22:13:29.0964154Z echo "${RESOLVED_IP} ${PT_DOMAIN}" | sudo tee -a /etc/hosts 2024-08-20T22:13:29.0964696Z cat /etc/hosts 2024-08-20T22:13:29.0973880Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:13:29.0974369Z env: 2024-08-20T22:13:29.0974655Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:13:29.0975028Z ##[endgroup] 2024-08-20T22:13:29.1004058Z + PT_DOMAIN=download.pytorch.org 2024-08-20T22:13:29.1009876Z ++ dig -4 +short download.pytorch.org 2024-08-20T22:13:29.1011462Z ++ tail -n1 2024-08-20T22:13:29.1282140Z + RESOLVED_IP=18.160.10.28 2024-08-20T22:13:29.1282620Z + '[' -z 18.160.10.28 ']' 2024-08-20T22:13:29.1283147Z + grep -r download.pytorch.org /etc/hosts 2024-08-20T22:13:29.1298005Z + sudo sed -i /download.pytorch.org/d /etc/hosts 2024-08-20T22:13:29.1298557Z 18.165.98.58 download.pytorch.org 2024-08-20T22:13:29.2561807Z + echo '18.160.10.28 download.pytorch.org' 2024-08-20T22:13:29.2562495Z + sudo tee -a /etc/hosts 2024-08-20T22:13:29.2889616Z 18.160.10.28 download.pytorch.org 2024-08-20T22:13:29.2911281Z + cat /etc/hosts 2024-08-20T22:13:29.2921185Z 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 2024-08-20T22:13:29.2933441Z ::1 localhost6 localhost6.localdomain6 2024-08-20T22:13:29.2934187Z 18.160.10.28 download.pytorch.org 2024-08-20T22:13:29.3089276Z ##[group]Run pytorch/test-infra/.github/actions/calculate-docker-image@main 2024-08-20T22:13:29.3089870Z with: 2024-08-20T22:13:29.3090969Z docker-image-name: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:13:29.3092192Z docker-build-dir: .ci/docker 2024-08-20T22:13:29.3092570Z working-directory: . 2024-08-20T22:13:29.3093032Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:13:29.3093552Z force-push: false 2024-08-20T22:13:29.3093854Z env: 2024-08-20T22:13:29.3094130Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:13:29.3094465Z ##[endgroup] 2024-08-20T22:13:29.3114657Z ##[group]Run set -ex 2024-08-20T22:13:29.3115021Z set -ex 2024-08-20T22:13:29.3115312Z  2024-08-20T22:13:29.3115871Z # If the docker build directory or the build script doesn't exist, the action will 2024-08-20T22:13:29.3116846Z # gracefully return the docker image name as it is. Pulling docker image in Linux 2024-08-20T22:13:29.3117645Z # job could then download the pre-built image as usual 2024-08-20T22:13:29.3118388Z if [[ ! -d "${DOCKER_BUILD_DIR}" ]] || [[ ! -f "${DOCKER_BUILD_DIR}/build.sh" ]]; then 2024-08-20T22:13:29.3119166Z  echo "skip=true" >> "${GITHUB_OUTPUT}" 2024-08-20T22:13:29.3119803Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2024-08-20T22:13:29.3120361Z  2024-08-20T22:13:29.3120868Z  echo "There is no Docker build script in ${REPO_NAME} repo, skipping..." 2024-08-20T22:13:29.3121493Z  exit 0 2024-08-20T22:13:29.3121805Z else 2024-08-20T22:13:29.3122169Z  echo "skip=false" >> "${GITHUB_OUTPUT}" 2024-08-20T22:13:29.3122625Z fi 2024-08-20T22:13:29.3122907Z  2024-08-20T22:13:29.3123381Z if [[ "${DOCKER_IMAGE_NAME}" == *"${DOCKER_REGISTRY}/${REPO_NAME}"* ]]; then 2024-08-20T22:13:29.3124227Z  # The docker image name already includes the ECR prefix and tag, so we can just 2024-08-20T22:13:29.3125019Z  # use it as it is, but first let's extract the tag 2024-08-20T22:13:29.3125732Z  DOCKER_TAG=$(echo "${DOCKER_IMAGE_NAME}" | awk -F '[:,]' '{print $2}') 2024-08-20T22:13:29.3126454Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-08-20T22:13:29.3127154Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2024-08-20T22:13:29.3127709Z else 2024-08-20T22:13:29.3128151Z  DOCKER_TAG=$(git rev-parse HEAD:"${DOCKER_BUILD_DIR}") 2024-08-20T22:13:29.3128823Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-08-20T22:13:29.3129724Z  echo "docker-image=${DOCKER_REGISTRY}/${REPO_NAME}/${DOCKER_IMAGE_NAME}:${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-08-20T22:13:29.3130467Z fi 2024-08-20T22:13:29.3140964Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:13:29.3141450Z env: 2024-08-20T22:13:29.3141724Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:13:29.3142078Z REPO_NAME: pytorch 2024-08-20T22:13:29.3143215Z DOCKER_IMAGE_NAME: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:13:29.3144416Z DOCKER_BUILD_DIR: .ci/docker 2024-08-20T22:13:29.3144905Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:13:29.3145416Z ##[endgroup] 2024-08-20T22:13:29.3173985Z + [[ ! -d .ci/docker ]] 2024-08-20T22:13:29.3174477Z + [[ ! -f .ci/docker/build.sh ]] 2024-08-20T22:13:29.3174855Z + echo skip=false 2024-08-20T22:13:29.3176970Z + [[ 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 == *\3\0\8\5\3\5\3\8\5\1\1\4\.\d\k\r\.\e\c\r\.\u\s\-\e\a\s\t\-\1\.\a\m\a\z\o\n\a\w\s\.\c\o\m\/\p\y\t\o\r\c\h* ]] 2024-08-20T22:13:29.3182183Z ++ echo 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:13:29.3183468Z ++ awk -F '[:,]' '{print $2}' 2024-08-20T22:13:29.3211296Z + DOCKER_TAG=f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:13:29.3212007Z + echo docker-tag=f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:13:29.3213496Z + echo docker-image=308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:13:29.3250078Z ##[group]Run set +e 2024-08-20T22:13:29.3250845Z set +e 2024-08-20T22:13:29.3251229Z set -x 2024-08-20T22:13:29.3251658Z  2024-08-20T22:13:29.3252045Z login() { 2024-08-20T22:13:29.3252804Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2024-08-20T22:13:29.3253624Z } 2024-08-20T22:13:29.3254016Z  2024-08-20T22:13:29.3254381Z retry () { 2024-08-20T22:13:29.3254939Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2024-08-20T22:13:29.3255440Z } 2024-08-20T22:13:29.3255805Z  2024-08-20T22:13:29.3256289Z retry login "${DOCKER_REGISTRY}" 2024-08-20T22:13:29.3256800Z  2024-08-20T22:13:29.3257334Z # Check if image already exists, if it does then skip building it 2024-08-20T22:13:29.3258211Z if docker manifest inspect "${DOCKER_IMAGE}"; then 2024-08-20T22:13:29.3258811Z  exit 0 2024-08-20T22:13:29.3259210Z fi 2024-08-20T22:13:29.3259628Z  2024-08-20T22:13:29.3260225Z # NB: This part requires a full checkout. Otherwise, the merge base will 2024-08-20T22:13:29.3261171Z # be empty. The default action would be to continue rebuild the image 2024-08-20T22:13:29.3262064Z if [[ "$BASE_REVISION" = "$(git rev-parse HEAD)" ]]; then 2024-08-20T22:13:29.3262805Z  # if we're on the base branch then use the parent commit 2024-08-20T22:13:29.3263514Z  MERGE_BASE=$(git rev-parse HEAD~) 2024-08-20T22:13:29.3264105Z else 2024-08-20T22:13:29.3264669Z  # otherwise we're on a PR, so use the most recent base commit 2024-08-20T22:13:29.3265440Z  MERGE_BASE=$(git merge-base HEAD "$BASE_REVISION") 2024-08-20T22:13:29.3266093Z fi 2024-08-20T22:13:29.3266472Z  2024-08-20T22:13:29.3266953Z if [[ -z "${MERGE_BASE}" ]]; then 2024-08-20T22:13:29.3267519Z  echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2024-08-20T22:13:29.3268099Z  2024-08-20T22:13:29.3268903Z  echo "Finding merge base only works with full checkout, please set fetch-depth to 0, continuing ..." 2024-08-20T22:13:29.3269757Z  exit 0 2024-08-20T22:13:29.3270137Z fi 2024-08-20T22:13:29.3270561Z  2024-08-20T22:13:29.3271096Z if ! git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}"; then 2024-08-20T22:13:29.3272189Z  echo "Directory '${DOCKER_BUILD_DIR}' not found in commit $MERGE_BASE, you should rebase onto a more recent commit" 2024-08-20T22:13:29.3273104Z  exit 1 2024-08-20T22:13:29.3273498Z fi 2024-08-20T22:13:29.3273889Z  2024-08-20T22:13:29.3274527Z PREVIOUS_DOCKER_TAG=$(git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}") 2024-08-20T22:13:29.3275565Z # If no image exists but the hash is the same as the previous hash then we should error out here 2024-08-20T22:13:29.3276534Z if [[ "${PREVIOUS_DOCKER_TAG}" == "${DOCKER_TAG}" ]]; then 2024-08-20T22:13:29.3277661Z  echo "WARNING: Something has gone wrong and the previous image isn't available for the merge-base of your branch" 2024-08-20T22:13:29.3278971Z  echo " Will re-build docker image to store in local cache, TTS may be longer" 2024-08-20T22:13:29.3279854Z fi 2024-08-20T22:13:29.3280323Z  2024-08-20T22:13:29.3280800Z echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2024-08-20T22:13:29.3290094Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:13:29.3290649Z env: 2024-08-20T22:13:29.3291018Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:13:29.3291551Z DOCKER_BUILD_DIR: .ci/docker 2024-08-20T22:13:29.3292106Z BASE_REVISION: 40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:13:29.3293444Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:13:29.3294872Z DOCKER_TAG: f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:13:29.3295655Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:13:29.3296334Z ##[endgroup] 2024-08-20T22:13:29.3326574Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:13:29.3327415Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:13:29.3329680Z + aws ecr get-login-password --region us-east-1 2024-08-20T22:13:29.3330748Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:13:29.8660129Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-08-20T22:13:29.8661184Z Configure a credential helper to remove this warning. See 2024-08-20T22:13:29.8662417Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-08-20T22:13:29.8663223Z 2024-08-20T22:13:29.8663447Z Login Succeeded 2024-08-20T22:13:29.8686014Z + docker manifest inspect 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:13:30.1131851Z { 2024-08-20T22:13:30.1132676Z "schemaVersion": 2, 2024-08-20T22:13:30.1133555Z "mediaType": "application/vnd.docker.distribution.manifest.v2+json", 2024-08-20T22:13:30.1135109Z "config": { 2024-08-20T22:13:30.1135818Z "mediaType": "application/vnd.docker.container.image.v1+json", 2024-08-20T22:13:30.1136836Z "size": 48711, 2024-08-20T22:13:30.1138631Z "digest": "sha256:8fef7805cec6e829013a3d62f158b75bdc2f02cdfe3428c032ea017b488473bb" 2024-08-20T22:13:30.1139543Z }, 2024-08-20T22:13:30.1140262Z "layers": [ 2024-08-20T22:13:30.1140766Z { 2024-08-20T22:13:30.1141825Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1142671Z "size": 28580681, 2024-08-20T22:13:30.1143544Z "digest": "sha256:7a2c559011895d255fce249c00396abff5ae7e0c0a92931d0ed493e71de78e3a" 2024-08-20T22:13:30.1144671Z }, 2024-08-20T22:13:30.1145033Z { 2024-08-20T22:13:30.1145567Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1146694Z "size": 7943451, 2024-08-20T22:13:30.1147484Z "digest": "sha256:224fe954d7252f10539d243d6c9688806f7d13ad775ed02e7f7c79077844510d" 2024-08-20T22:13:30.1148727Z }, 2024-08-20T22:13:30.1149180Z { 2024-08-20T22:13:30.1149888Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1151467Z "size": 55728572, 2024-08-20T22:13:30.1152775Z "digest": "sha256:75722010b82e31715876aeeed0b2cee414296f0124fdfa061ab845ba2a158450" 2024-08-20T22:13:30.1153704Z }, 2024-08-20T22:13:30.1155128Z { 2024-08-20T22:13:30.1155926Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1156902Z "size": 186, 2024-08-20T22:13:30.1157727Z "digest": "sha256:d527cbbb87e3016fd72a18a9b468c945ad0ca27c5770b39debd6ed704db3a195" 2024-08-20T22:13:30.1158830Z }, 2024-08-20T22:13:30.1159307Z { 2024-08-20T22:13:30.1160079Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1160952Z "size": 6886, 2024-08-20T22:13:30.1161695Z "digest": "sha256:b57676e46aee1a8c82e528d78e5a13e31142524eea31c8b213d69ddcb6f1fe80" 2024-08-20T22:13:30.1162550Z }, 2024-08-20T22:13:30.1163262Z { 2024-08-20T22:13:30.1163806Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1164471Z "size": 1329001756, 2024-08-20T22:13:30.1165177Z "digest": "sha256:a8c1e85b5e14cec7af70bf304cb4d4cee6a1d25eb8215b2cf4fdc33e5af5e108" 2024-08-20T22:13:30.1165946Z }, 2024-08-20T22:13:30.1166278Z { 2024-08-20T22:13:30.1166832Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1167545Z "size": 62501, 2024-08-20T22:13:30.1168205Z "digest": "sha256:a41a8d1c11c8d80fe4e82b0d05478f8d51176ff20b8350905fc1b25c93a51198" 2024-08-20T22:13:30.1168870Z }, 2024-08-20T22:13:30.1169255Z { 2024-08-20T22:13:30.1169877Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1170803Z "size": 1684, 2024-08-20T22:13:30.1171429Z "digest": "sha256:0c12278907551c2962927d27c115f6f7bf0df894318b8aea6ece3ef01ccd0a8a" 2024-08-20T22:13:30.1172136Z }, 2024-08-20T22:13:30.1172529Z { 2024-08-20T22:13:30.1173089Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1173702Z "size": 1523, 2024-08-20T22:13:30.1174400Z "digest": "sha256:d8d1234baab3ec9ccb8bb710fc6b8ff6c10896ba2e8d27a347583eca770f9ff1" 2024-08-20T22:13:30.1175153Z }, 2024-08-20T22:13:30.1175456Z { 2024-08-20T22:13:30.1176023Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1176768Z "size": 2528295403, 2024-08-20T22:13:30.1177426Z "digest": "sha256:7ed32bc8e4696fcdb2feef850781160597b2275ad756819c4add88236b0577d5" 2024-08-20T22:13:30.1178174Z }, 2024-08-20T22:13:30.1178524Z { 2024-08-20T22:13:30.1179047Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1179767Z "size": 86016, 2024-08-20T22:13:30.1180382Z "digest": "sha256:ec1e7978c1fe161ced1d98092a51e7c5953ca5fda5577f54df9dbda4afff1b2b" 2024-08-20T22:13:30.1181107Z }, 2024-08-20T22:13:30.1181521Z { 2024-08-20T22:13:30.1182018Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1182672Z "size": 1822, 2024-08-20T22:13:30.1183477Z "digest": "sha256:ac23c5fcc1ef310e9cd0d138b180281188e20a3e28c51cd14751622e3c7d92ea" 2024-08-20T22:13:30.1184194Z }, 2024-08-20T22:13:30.1184518Z { 2024-08-20T22:13:30.1185118Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1185782Z "size": 246761563, 2024-08-20T22:13:30.1186467Z "digest": "sha256:ca426ffc9d2bd051ad1ff5c4f02fd5d9be161e70953cc37882c815080c708f4d" 2024-08-20T22:13:30.1187216Z }, 2024-08-20T22:13:30.1187556Z { 2024-08-20T22:13:30.1188097Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1188789Z "size": 544, 2024-08-20T22:13:30.1189388Z "digest": "sha256:4373aa743caf6660c671295b837048c8350a2165f2336dc3b7b6c96462579e50" 2024-08-20T22:13:30.1190116Z }, 2024-08-20T22:13:30.1190580Z { 2024-08-20T22:13:30.1191085Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1191743Z "size": 1258, 2024-08-20T22:13:30.1192427Z "digest": "sha256:75b2abb16c685854c017d0cf75c626526c956734c656d9e78fdd4520317e9b3c" 2024-08-20T22:13:30.1193146Z }, 2024-08-20T22:13:30.1193444Z { 2024-08-20T22:13:30.1194018Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1194695Z "size": 484, 2024-08-20T22:13:30.1195362Z "digest": "sha256:ef1e3ef1e85f0124270b8506721219150e230184181f8207d64463bf5c67e656" 2024-08-20T22:13:30.1196014Z }, 2024-08-20T22:13:30.1196372Z { 2024-08-20T22:13:30.1197014Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1197644Z "size": 91711766, 2024-08-20T22:13:30.1198288Z "digest": "sha256:0bf61114d37b2d09065aa6852b1e78a32580a1ff011dd5d23f03b0f5c4e710af" 2024-08-20T22:13:30.1199157Z }, 2024-08-20T22:13:30.1199523Z { 2024-08-20T22:13:30.1200011Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1200762Z "size": 3390, 2024-08-20T22:13:30.1201521Z "digest": "sha256:2df849f72ba4258df10c9c45ace21a66d93b73196e78e96f12c13098822f60e2" 2024-08-20T22:13:30.1202223Z }, 2024-08-20T22:13:30.1202612Z { 2024-08-20T22:13:30.1203130Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1203855Z "size": 1909, 2024-08-20T22:13:30.1204567Z "digest": "sha256:34c47d63c5de27418739aa048b4dd781c3006d65691e9b903c95304d0509d89c" 2024-08-20T22:13:30.1205221Z }, 2024-08-20T22:13:30.1205555Z { 2024-08-20T22:13:30.1206145Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1206750Z "size": 701, 2024-08-20T22:13:30.1207405Z "digest": "sha256:1fef4bd19792cbf9d3aea12795089ad41164bb6d607c339b7484e1899825b1d2" 2024-08-20T22:13:30.1208261Z }, 2024-08-20T22:13:30.1208599Z { 2024-08-20T22:13:30.1209103Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1209800Z "size": 2864254879, 2024-08-20T22:13:30.1210462Z + exit 0 2024-08-20T22:13:30.1211127Z "digest": "sha256:6efb96fc87ea1bca54876d85331e5585e28f325a1d60ee1aef7811eabb74f933" 2024-08-20T22:13:30.1211807Z }, 2024-08-20T22:13:30.1212172Z { 2024-08-20T22:13:30.1212742Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1213409Z "size": 380, 2024-08-20T22:13:30.1214002Z "digest": "sha256:b119c4fc6c58d9e72744201ff4850b34184a94eb3566031b7d36e87ecce950a6" 2024-08-20T22:13:30.1214768Z }, 2024-08-20T22:13:30.1215124Z { 2024-08-20T22:13:30.1215603Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1216300Z "size": 12900, 2024-08-20T22:13:30.1216964Z "digest": "sha256:33b639226eeefa41d7bb26a8ecc20d271ceef45571dabfd80aaee3634926381b" 2024-08-20T22:13:30.1217770Z }, 2024-08-20T22:13:30.1218159Z { 2024-08-20T22:13:30.1218698Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1219297Z "size": 803, 2024-08-20T22:13:30.1220011Z "digest": "sha256:d3547bd43146930aa830d54562c98aa678e355cf5f84527e9717eb72fffe8ca3" 2024-08-20T22:13:30.1220711Z }, 2024-08-20T22:13:30.1221044Z { 2024-08-20T22:13:30.1221610Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1222252Z "size": 106, 2024-08-20T22:13:30.1222872Z "digest": "sha256:5645520256fa6d7f2270608eaed53849a131d03fbf4c5d4472c9cfde1a439e47" 2024-08-20T22:13:30.1223648Z }, 2024-08-20T22:13:30.1224025Z { 2024-08-20T22:13:30.1224542Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1225256Z "size": 503, 2024-08-20T22:13:30.1225847Z "digest": "sha256:829ed7d91e3818d0e11834c71551117c7aeec0a51d798e93d641faa0c02582cb" 2024-08-20T22:13:30.1226581Z }, 2024-08-20T22:13:30.1226978Z { 2024-08-20T22:13:30.1227503Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1228133Z "size": 121477267, 2024-08-20T22:13:30.1228833Z "digest": "sha256:385d0421d67c533d628985c453a186028a61f6ad4209ae519ec3d4ecea661d3e" 2024-08-20T22:13:30.1229533Z }, 2024-08-20T22:13:30.1229944Z { 2024-08-20T22:13:30.1230425Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1231155Z "size": 109, 2024-08-20T22:13:30.1231890Z "digest": "sha256:7cbfce999d76851e07dd71056a6d852629d789ccfd46be44cc405b451fb8bb58" 2024-08-20T22:13:30.1232555Z }, 2024-08-20T22:13:30.1232908Z { 2024-08-20T22:13:30.1233468Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1234106Z "size": 490, 2024-08-20T22:13:30.1234710Z "digest": "sha256:6658e558ebe496f0d628947534b0ea1e44808f84f2dfd8a9a704e8aa5329d791" 2024-08-20T22:13:30.1235455Z }, 2024-08-20T22:13:30.1235794Z { 2024-08-20T22:13:30.1236329Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1236977Z "size": 297, 2024-08-20T22:13:30.1237671Z "digest": "sha256:33444a5a7e01a3010fd1cc16b32a66892a08600d7f700747d23faf3c36624f3a" 2024-08-20T22:13:30.1238570Z }, 2024-08-20T22:13:30.1238935Z { 2024-08-20T22:13:30.1239479Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1240122Z "size": 103, 2024-08-20T22:13:30.1240870Z "digest": "sha256:7c47122f4e09b47e891b4ae9e499a35a4eb46faacae87d0e946615adda6e0706" 2024-08-20T22:13:30.1241563Z }, 2024-08-20T22:13:30.1241898Z { 2024-08-20T22:13:30.1242493Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1243136Z "size": 1473, 2024-08-20T22:13:30.1243730Z "digest": "sha256:1811ff4d3556ac255604f346d879528aff2aadd7652c2d39baf4fe6eaa60aec3" 2024-08-20T22:13:30.1244584Z }, 2024-08-20T22:13:30.1244914Z { 2024-08-20T22:13:30.1245566Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1246582Z "size": 594729516, 2024-08-20T22:13:30.1247244Z "digest": "sha256:7754ee068b33f760d9c320c26a1a3935247ace0c8c463a976105c1586a43fb1c" 2024-08-20T22:13:30.1247962Z }, 2024-08-20T22:13:30.1248332Z { 2024-08-20T22:13:30.1248882Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1249593Z "size": 164, 2024-08-20T22:13:30.1250338Z "digest": "sha256:0479fbac3361713c075bf788e778117917dcacdd1ff71ed79a789dd2016a1714" 2024-08-20T22:13:30.1251082Z }, 2024-08-20T22:13:30.1251442Z { 2024-08-20T22:13:30.1252114Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1252820Z "size": 564, 2024-08-20T22:13:30.1253448Z "digest": "sha256:f1d6874dee9c34d154278d2b6935d04447f07fa89d25d4a09398234040d8a7e8" 2024-08-20T22:13:30.1254253Z }, 2024-08-20T22:13:30.1254617Z { 2024-08-20T22:13:30.1255131Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1255832Z "size": 35874203, 2024-08-20T22:13:30.1256516Z "digest": "sha256:afc429e87b593a64f3e0a1be51e09e966ea1aa71e6e8a0bec4edc9f2f7bc1c05" 2024-08-20T22:13:30.1257285Z }, 2024-08-20T22:13:30.1257579Z { 2024-08-20T22:13:30.1258125Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1258891Z "size": 104, 2024-08-20T22:13:30.1259528Z "digest": "sha256:019620471c2592cd22437fe8ed1a94c784114cf7445c5c2ab36dd0bae727fc66" 2024-08-20T22:13:30.1260191Z }, 2024-08-20T22:13:30.1260579Z { 2024-08-20T22:13:30.1261118Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1261759Z "size": 425, 2024-08-20T22:13:30.1262429Z "digest": "sha256:27aeb1b2cd5e28d8f0e54fc1090baf88abc29ebf5fce088b493fcae99c9550d1" 2024-08-20T22:13:30.1263180Z }, 2024-08-20T22:13:30.1263516Z { 2024-08-20T22:13:30.1264057Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1264728Z "size": 20262183, 2024-08-20T22:13:30.1265370Z "digest": "sha256:829c0e19f4b7797e9120a86172fabfd710f9b3971ffd714a616931a3fadc7192" 2024-08-20T22:13:30.1266222Z }, 2024-08-20T22:13:30.1266524Z { 2024-08-20T22:13:30.1267048Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1267831Z "size": 438, 2024-08-20T22:13:30.1268463Z "digest": "sha256:560cd6122a3868e7e82e75eb103d182edf6512114d61ccdfae099af00cb16b4c" 2024-08-20T22:13:30.1269126Z }, 2024-08-20T22:13:30.1269533Z { 2024-08-20T22:13:30.1270047Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1270656Z "size": 701, 2024-08-20T22:13:30.1271370Z "digest": "sha256:1fef4bd19792cbf9d3aea12795089ad41164bb6d607c339b7484e1899825b1d2" 2024-08-20T22:13:30.1272074Z }, 2024-08-20T22:13:30.1272501Z { 2024-08-20T22:13:30.1273027Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1273661Z "size": 141, 2024-08-20T22:13:30.1274320Z "digest": "sha256:5a4eb19d72198a01f3babd4711c40fcf7c6e5cb9d5cfedc507b0061408d47097" 2024-08-20T22:13:30.1275081Z }, 2024-08-20T22:13:30.1275377Z { 2024-08-20T22:13:30.1275913Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1276760Z "size": 135, 2024-08-20T22:13:30.1277424Z "digest": "sha256:da6a838a66c72b5de9a5590c233779880ea901c1264940a1c618825d2501ffd1" 2024-08-20T22:13:30.1278083Z }, 2024-08-20T22:13:30.1278530Z { 2024-08-20T22:13:30.1279149Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1279751Z "size": 4838068375, 2024-08-20T22:13:30.1280454Z "digest": "sha256:cbb79a7053537bed2d80b77198ea552b985563b11d3f8616593c6ab575a3a090" 2024-08-20T22:13:30.1281175Z }, 2024-08-20T22:13:30.1281562Z { 2024-08-20T22:13:30.1282064Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1282706Z "size": 194, 2024-08-20T22:13:30.1283382Z "digest": "sha256:4d4fa6802ab3e6b36d8d4adb650046e9370c4a16a19876970559ef8a312ca855" 2024-08-20T22:13:30.1284236Z }, 2024-08-20T22:13:30.1284531Z { 2024-08-20T22:13:30.1285119Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1285827Z "size": 564, 2024-08-20T22:13:30.1286461Z "digest": "sha256:0f085d4fa279366fcd52d303b7ad8abddc5962a8872174b8109f3f5d5ca5f2cf" 2024-08-20T22:13:30.1287201Z }, 2024-08-20T22:13:30.1287532Z { 2024-08-20T22:13:30.1288043Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1288734Z "size": 43162921, 2024-08-20T22:13:30.1289383Z "digest": "sha256:4a0412373305517489d891a4749e6d2b80b4aeb7df3b8adca0ed0abb2f3e5300" 2024-08-20T22:13:30.1290084Z }, 2024-08-20T22:13:30.1290524Z { 2024-08-20T22:13:30.1291029Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1291692Z "size": 106, 2024-08-20T22:13:30.1292362Z "digest": "sha256:302c8c1779444e54919f83e91c6d5e1fdea653fc899be802b3a2a34d34d99d5d" 2024-08-20T22:13:30.1293138Z }, 2024-08-20T22:13:30.1293455Z { 2024-08-20T22:13:30.1294015Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1294650Z "size": 1380, 2024-08-20T22:13:30.1295257Z "digest": "sha256:02970347dff622ee45629bc28788716d00528464f71f88ec7b74ae5f44a486e2" 2024-08-20T22:13:30.1295994Z }, 2024-08-20T22:13:30.1296322Z { 2024-08-20T22:13:30.1296860Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1297514Z "size": 701, 2024-08-20T22:13:30.1298168Z "digest": "sha256:1fef4bd19792cbf9d3aea12795089ad41164bb6d607c339b7484e1899825b1d2" 2024-08-20T22:13:30.1298875Z }, 2024-08-20T22:13:30.1299329Z { 2024-08-20T22:13:30.1299837Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1300476Z "size": 139, 2024-08-20T22:13:30.1301147Z "digest": "sha256:916c5e8580164926a3aec87e88a5d1c2d02756e49fdeed4198e1e6304efa2fd3" 2024-08-20T22:13:30.1301880Z }, 2024-08-20T22:13:30.1302182Z { 2024-08-20T22:13:30.1302748Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1303406Z "size": 118, 2024-08-20T22:13:30.1304000Z "digest": "sha256:c42b3602a1fb4df5111224650f15adffb025979ae9c614807379ea84e189533b" 2024-08-20T22:13:30.1304780Z }, 2024-08-20T22:13:30.1305118Z { 2024-08-20T22:13:30.1305702Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1306418Z "size": 4324672728, 2024-08-20T22:13:30.1307089Z "digest": "sha256:11fad972ef6cb9d2dc236504b0ee5b6e5ea996e4576ece0ed3262fbb9ee2de60" 2024-08-20T22:13:30.1307863Z }, 2024-08-20T22:13:30.1308235Z { 2024-08-20T22:13:30.1308727Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1309436Z "size": 174, 2024-08-20T22:13:30.1310090Z "digest": "sha256:f957c16244819132b478272aaf24231699c4fcbd495c229a574f94daab8d6b86" 2024-08-20T22:13:30.1310758Z }, 2024-08-20T22:13:30.1311222Z { 2024-08-20T22:13:30.1311747Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1312398Z "size": 907, 2024-08-20T22:13:30.1313172Z "digest": "sha256:768c31dca016b80bbdc973c8ee818034bdbd17b7ea9bdadbf0ec45ea51005720" 2024-08-20T22:13:30.1314005Z }, 2024-08-20T22:13:30.1314380Z { 2024-08-20T22:13:30.1314995Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1315655Z "size": 701, 2024-08-20T22:13:30.1316357Z "digest": "sha256:1fef4bd19792cbf9d3aea12795089ad41164bb6d607c339b7484e1899825b1d2" 2024-08-20T22:13:30.1317175Z }, 2024-08-20T22:13:30.1317477Z { 2024-08-20T22:13:30.1318054Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1318862Z "size": 134, 2024-08-20T22:13:30.1319506Z "digest": "sha256:8c32d0ecebbe2054c96a3a5c1f3d6c8b87c2e826686b369e5242cd55d0f01c2d" 2024-08-20T22:13:30.1320209Z }, 2024-08-20T22:13:30.1320665Z { 2024-08-20T22:13:30.1321216Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1321963Z "size": 32, 2024-08-20T22:13:30.1322619Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-20T22:13:30.1323352Z }, 2024-08-20T22:13:30.1323696Z { 2024-08-20T22:13:30.1324291Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1324900Z "size": 158, 2024-08-20T22:13:30.1325532Z "digest": "sha256:78ee77eddef23f20afc78e2924f4467041cadb754634ee3df431c68211cf676d" 2024-08-20T22:13:30.1326309Z }, 2024-08-20T22:13:30.1326607Z { 2024-08-20T22:13:30.1327205Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1327932Z "size": 1841, 2024-08-20T22:13:30.1328563Z "digest": "sha256:37513e9b43d7123e7ddee09100f62a72b57af7b3833eaecd515e247e2f63e13f" 2024-08-20T22:13:30.1329231Z }, 2024-08-20T22:13:30.1329643Z { 2024-08-20T22:13:30.1330168Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1330899Z "size": 7529776, 2024-08-20T22:13:30.1331510Z "digest": "sha256:a7a5392e2bf6b73d9be292cc22a99ad4637636c15733beb7afbe6403b5ba21a8" 2024-08-20T22:13:30.1332219Z }, 2024-08-20T22:13:30.1332636Z { 2024-08-20T22:13:30.1333124Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1333843Z "size": 163, 2024-08-20T22:13:30.1334554Z "digest": "sha256:b10de02255c021b2366b85bf12ddf593aac89f88964201c455b71a145bc5ca2e" 2024-08-20T22:13:30.1335261Z }, 2024-08-20T22:13:30.1335568Z { 2024-08-20T22:13:30.1336176Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1336831Z "size": 7943, 2024-08-20T22:13:30.1337500Z "digest": "sha256:e56eeff2db93ffe5002a2bb764795b7333321c6802cc28bef0801a619fe6a07e" 2024-08-20T22:13:30.1338241Z }, 2024-08-20T22:13:30.1338579Z { 2024-08-20T22:13:30.1339121Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1339833Z "size": 8068, 2024-08-20T22:13:30.1340445Z "digest": "sha256:70ac3e38d0fd1f0f46ad710c3fc485fd01406606054e8cf84a63af1570bc9f3a" 2024-08-20T22:13:30.1341310Z }, 2024-08-20T22:13:30.1341701Z { 2024-08-20T22:13:30.1342195Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1342868Z "size": 302, 2024-08-20T22:13:30.1343542Z "digest": "sha256:eb09cbf3e4168749cc8605e3188ed35070f6037d13930e443c38d8941734488f" 2024-08-20T22:13:30.1344271Z }, 2024-08-20T22:13:30.1344576Z { 2024-08-20T22:13:30.1345148Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1345818Z "size": 7629638, 2024-08-20T22:13:30.1346695Z "digest": "sha256:ee1273153675e6543b58f5be50321abee5e91f7351701d5d501a6837eaf676ef" 2024-08-20T22:13:30.1347427Z }, 2024-08-20T22:13:30.1347860Z { 2024-08-20T22:13:30.1348379Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1349083Z "size": 108, 2024-08-20T22:13:30.1349716Z "digest": "sha256:e22979f9e0eedfa16f98eb4fa26f30a50c237f5ffd2f6e5b898f2b908058496d" 2024-08-20T22:13:30.1350427Z }, 2024-08-20T22:13:30.1350825Z { 2024-08-20T22:13:30.1351304Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1352095Z "size": 54145661, 2024-08-20T22:13:30.1352836Z "digest": "sha256:6c1f0aabce7c84f9b0b9ab3b96325778dba1c1465b7463c5b4c6be1cf52b74db" 2024-08-20T22:13:30.1353551Z }, 2024-08-20T22:13:30.1353859Z { 2024-08-20T22:13:30.1354529Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1355169Z "size": 473, 2024-08-20T22:13:30.1355879Z "digest": "sha256:7ebe49c3a23e71b289ce012b48dad35791a2f2aa7fcee2326a64d763b0d14df8" 2024-08-20T22:13:30.1356553Z }, 2024-08-20T22:13:30.1356883Z { 2024-08-20T22:13:30.1357483Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1358103Z "size": 1374858766, 2024-08-20T22:13:30.1358842Z "digest": "sha256:5d115b29b5d53e5418762bc41ae975dd245bcffc3d058b8902c58146d505cb37" 2024-08-20T22:13:30.1359764Z }, 2024-08-20T22:13:30.1360124Z { 2024-08-20T22:13:30.1360655Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1361342Z "size": 106, 2024-08-20T22:13:30.1362071Z "digest": "sha256:7f2d7a04fbe65bbe1e895138e0cfeeef53ad926c890bab8e7e132ad1e655e48f" 2024-08-20T22:13:30.1362813Z }, 2024-08-20T22:13:30.1363162Z { 2024-08-20T22:13:30.1363687Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1364341Z "size": 559, 2024-08-20T22:13:30.1365009Z "digest": "sha256:d79fd7d526989e554455eda7d459f2c88444030f61710101e52ec8c7a49b7b79" 2024-08-20T22:13:30.1365670Z }, 2024-08-20T22:13:30.1366020Z { 2024-08-20T22:13:30.1366591Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1367218Z "size": 46248488, 2024-08-20T22:13:30.1367859Z "digest": "sha256:9752d6fbbcab4e7403f26777c5b65911320de6389c81b833a47ba45c4f3354b4" 2024-08-20T22:13:30.1368700Z }, 2024-08-20T22:13:30.1369070Z { 2024-08-20T22:13:30.1369568Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1370257Z "size": 111, 2024-08-20T22:13:30.1370911Z "digest": "sha256:83808b2eff4d71ed46db7c29f66fe918f328405c25b314225dfad01b4868d1f4" 2024-08-20T22:13:30.1371606Z }, 2024-08-20T22:13:30.1372039Z { 2024-08-20T22:13:30.1372564Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1373232Z "size": 32, 2024-08-20T22:13:30.1373888Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-20T22:13:30.1374565Z }, 2024-08-20T22:13:30.1375033Z { 2024-08-20T22:13:30.1375577Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1376182Z "size": 32, 2024-08-20T22:13:30.1376887Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-20T22:13:30.1377606Z }, 2024-08-20T22:13:30.1377944Z { 2024-08-20T22:13:30.1378510Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1379158Z "size": 32, 2024-08-20T22:13:30.1379797Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-20T22:13:30.1380577Z }, 2024-08-20T22:13:30.1380896Z { 2024-08-20T22:13:30.1381455Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:30.1382237Z "size": 32, 2024-08-20T22:13:30.1382828Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-20T22:13:30.1383561Z } 2024-08-20T22:13:30.1383994Z ] 2024-08-20T22:13:30.1384330Z } 2024-08-20T22:13:30.1690509Z ##[group]Run tag=${ECR_DOCKER_IMAGE##*/} 2024-08-20T22:13:30.1691007Z tag=${ECR_DOCKER_IMAGE##*/} 2024-08-20T22:13:30.1691590Z echo "docker pull ghcr.io/pytorch/ci-image:${tag/:/-}" 2024-08-20T22:13:30.1700959Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:13:30.1701471Z env: 2024-08-20T22:13:30.1701750Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:13:30.1702913Z ECR_DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:13:30.1704094Z ##[endgroup] 2024-08-20T22:13:30.1735861Z docker pull ghcr.io/pytorch/ci-image:pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks-f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:13:30.1787262Z ##[group]Run pytorch/test-infra/.github/actions/pull-docker-image@main 2024-08-20T22:13:30.1787838Z with: 2024-08-20T22:13:30.1788914Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:13:30.1790229Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:13:30.1790745Z env: 2024-08-20T22:13:30.1791184Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:13:30.1791548Z ##[endgroup] 2024-08-20T22:13:30.1808819Z ##[group]Run set -x 2024-08-20T22:13:30.1809159Z set -x 2024-08-20T22:13:30.1809455Z set +e 2024-08-20T22:13:30.1809743Z  2024-08-20T22:13:30.1810011Z login() { 2024-08-20T22:13:30.1810660Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2024-08-20T22:13:30.1811369Z } 2024-08-20T22:13:30.1811641Z  2024-08-20T22:13:30.1811937Z retry () { 2024-08-20T22:13:30.1812324Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2024-08-20T22:13:30.1812761Z } 2024-08-20T22:13:30.1813033Z  2024-08-20T22:13:30.1813345Z retry login "${DOCKER_REGISTRY}" 2024-08-20T22:13:30.1813747Z  2024-08-20T22:13:30.1814017Z set -e 2024-08-20T22:13:30.1814483Z # ignore output since only exit code is used for conditional 2024-08-20T22:13:30.1815181Z # only pull docker image if it's not available locally 2024-08-20T22:13:30.1815930Z if ! docker inspect --type=image "${DOCKER_IMAGE}" >/dev/null 2>/dev/null; then 2024-08-20T22:13:30.1816618Z  retry docker pull "${DOCKER_IMAGE}" 2024-08-20T22:13:30.1817057Z fi 2024-08-20T22:13:30.1825057Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:13:30.1825546Z env: 2024-08-20T22:13:30.1825821Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:13:30.1826972Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:13:30.1828277Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:13:30.1828789Z ##[endgroup] 2024-08-20T22:13:30.1856488Z + set +e 2024-08-20T22:13:30.1857344Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:13:30.1858007Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:13:30.1861006Z + aws ecr get-login-password --region us-east-1 2024-08-20T22:13:30.1861805Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:13:30.7219972Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-08-20T22:13:30.7221264Z Configure a credential helper to remove this warning. See 2024-08-20T22:13:30.7222122Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-08-20T22:13:30.7222655Z 2024-08-20T22:13:30.7222774Z Login Succeeded 2024-08-20T22:13:30.7242454Z + set -e 2024-08-20T22:13:30.7243778Z + docker inspect --type=image 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:13:30.7410368Z + retry docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:13:30.7412546Z + docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:13:30.9933837Z f6d216893d65c7b8ae43df4daaf247db808378e9: Pulling from pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks 2024-08-20T22:13:30.9936204Z 7a2c55901189: Pulling fs layer 2024-08-20T22:13:30.9936728Z 224fe954d725: Pulling fs layer 2024-08-20T22:13:30.9937609Z 75722010b82e: Pulling fs layer 2024-08-20T22:13:30.9938157Z d527cbbb87e3: Pulling fs layer 2024-08-20T22:13:30.9938679Z b57676e46aee: Pulling fs layer 2024-08-20T22:13:30.9939209Z a8c1e85b5e14: Pulling fs layer 2024-08-20T22:13:30.9939756Z a41a8d1c11c8: Pulling fs layer 2024-08-20T22:13:30.9940290Z 0c1227890755: Pulling fs layer 2024-08-20T22:13:30.9940814Z d8d1234baab3: Pulling fs layer 2024-08-20T22:13:30.9941348Z 7ed32bc8e469: Pulling fs layer 2024-08-20T22:13:30.9941888Z ec1e7978c1fe: Pulling fs layer 2024-08-20T22:13:30.9942647Z ac23c5fcc1ef: Pulling fs layer 2024-08-20T22:13:30.9943123Z ca426ffc9d2b: Pulling fs layer 2024-08-20T22:13:30.9943495Z 4373aa743caf: Pulling fs layer 2024-08-20T22:13:30.9943871Z 75b2abb16c68: Pulling fs layer 2024-08-20T22:13:30.9944253Z ef1e3ef1e85f: Pulling fs layer 2024-08-20T22:13:30.9944629Z 0bf61114d37b: Pulling fs layer 2024-08-20T22:13:30.9945000Z 2df849f72ba4: Pulling fs layer 2024-08-20T22:13:30.9945376Z 34c47d63c5de: Pulling fs layer 2024-08-20T22:13:30.9945760Z 1fef4bd19792: Pulling fs layer 2024-08-20T22:13:30.9946472Z 6efb96fc87ea: Pulling fs layer 2024-08-20T22:13:30.9946896Z b119c4fc6c58: Pulling fs layer 2024-08-20T22:13:30.9947268Z 33b639226eee: Pulling fs layer 2024-08-20T22:13:30.9947640Z d3547bd43146: Pulling fs layer 2024-08-20T22:13:30.9948000Z 5645520256fa: Pulling fs layer 2024-08-20T22:13:30.9948364Z 829ed7d91e38: Pulling fs layer 2024-08-20T22:13:30.9948722Z a41a8d1c11c8: Waiting 2024-08-20T22:13:30.9949053Z 385d0421d67c: Pulling fs layer 2024-08-20T22:13:30.9949426Z 7cbfce999d76: Pulling fs layer 2024-08-20T22:13:30.9949782Z 7ed32bc8e469: Waiting 2024-08-20T22:13:30.9950108Z 6658e558ebe4: Pulling fs layer 2024-08-20T22:13:30.9950467Z 33444a5a7e01: Pulling fs layer 2024-08-20T22:13:30.9950817Z ec1e7978c1fe: Waiting 2024-08-20T22:13:30.9951145Z 7c47122f4e09: Pulling fs layer 2024-08-20T22:13:30.9951509Z 1811ff4d3556: Pulling fs layer 2024-08-20T22:13:30.9951871Z 7754ee068b33: Pulling fs layer 2024-08-20T22:13:30.9952286Z 0479fbac3361: Pulling fs layer 2024-08-20T22:13:30.9952720Z f1d6874dee9c: Pulling fs layer 2024-08-20T22:13:30.9953223Z afc429e87b59: Pulling fs layer 2024-08-20T22:13:30.9953726Z 019620471c25: Pulling fs layer 2024-08-20T22:13:30.9954232Z 0c1227890755: Waiting 2024-08-20T22:13:30.9954697Z 27aeb1b2cd5e: Pulling fs layer 2024-08-20T22:13:30.9955164Z 829c0e19f4b7: Pulling fs layer 2024-08-20T22:13:30.9955531Z 560cd6122a38: Pulling fs layer 2024-08-20T22:13:30.9955896Z 5a4eb19d7219: Pulling fs layer 2024-08-20T22:13:30.9956270Z da6a838a66c7: Pulling fs layer 2024-08-20T22:13:30.9956631Z cbb79a705353: Pulling fs layer 2024-08-20T22:13:30.9957050Z 4d4fa6802ab3: Pulling fs layer 2024-08-20T22:13:30.9957457Z 0f085d4fa279: Pulling fs layer 2024-08-20T22:13:30.9957821Z 4a0412373305: Pulling fs layer 2024-08-20T22:13:30.9958175Z 302c8c177944: Pulling fs layer 2024-08-20T22:13:30.9958619Z 02970347dff6: Pulling fs layer 2024-08-20T22:13:30.9958972Z d527cbbb87e3: Waiting 2024-08-20T22:13:30.9959293Z 916c5e858016: Pulling fs layer 2024-08-20T22:13:30.9959661Z c42b3602a1fb: Pulling fs layer 2024-08-20T22:13:30.9960026Z 11fad972ef6c: Pulling fs layer 2024-08-20T22:13:30.9960381Z ac23c5fcc1ef: Waiting 2024-08-20T22:13:30.9960704Z f957c1624481: Pulling fs layer 2024-08-20T22:13:30.9961065Z 768c31dca016: Pulling fs layer 2024-08-20T22:13:30.9961414Z 5645520256fa: Waiting 2024-08-20T22:13:30.9961716Z 33b639226eee: Waiting 2024-08-20T22:13:30.9962050Z 8c32d0ecebbe: Pulling fs layer 2024-08-20T22:13:30.9962498Z 4f4fb700ef54: Pulling fs layer 2024-08-20T22:13:30.9963000Z 829ed7d91e38: Waiting 2024-08-20T22:13:30.9963451Z 78ee77eddef2: Pulling fs layer 2024-08-20T22:13:30.9963862Z 37513e9b43d7: Pulling fs layer 2024-08-20T22:13:30.9964299Z a7a5392e2bf6: Pulling fs layer 2024-08-20T22:13:30.9964816Z b57676e46aee: Waiting 2024-08-20T22:13:30.9965263Z b10de02255c0: Pulling fs layer 2024-08-20T22:13:30.9965786Z e56eeff2db93: Pulling fs layer 2024-08-20T22:13:30.9966304Z 385d0421d67c: Waiting 2024-08-20T22:13:30.9966759Z 70ac3e38d0fd: Pulling fs layer 2024-08-20T22:13:30.9967355Z eb09cbf3e416: Pulling fs layer 2024-08-20T22:13:30.9967717Z 33444a5a7e01: Waiting 2024-08-20T22:13:30.9968043Z ee1273153675: Pulling fs layer 2024-08-20T22:13:30.9968405Z e22979f9e0ee: Pulling fs layer 2024-08-20T22:13:30.9968779Z 6c1f0aabce7c: Pulling fs layer 2024-08-20T22:13:30.9969151Z 7ebe49c3a23e: Pulling fs layer 2024-08-20T22:13:30.9969527Z 5d115b29b5d5: Pulling fs layer 2024-08-20T22:13:30.9969889Z 7f2d7a04fbe6: Pulling fs layer 2024-08-20T22:13:30.9970261Z d79fd7d52698: Pulling fs layer 2024-08-20T22:13:30.9970743Z ca426ffc9d2b: Waiting 2024-08-20T22:13:30.9971071Z 9752d6fbbcab: Pulling fs layer 2024-08-20T22:13:30.9971443Z 83808b2eff4d: Pulling fs layer 2024-08-20T22:13:30.9971800Z 7cbfce999d76: Waiting 2024-08-20T22:13:30.9972113Z 37513e9b43d7: Waiting 2024-08-20T22:13:30.9972419Z 4373aa743caf: Waiting 2024-08-20T22:13:30.9972729Z 1811ff4d3556: Waiting 2024-08-20T22:13:30.9973044Z 70ac3e38d0fd: Waiting 2024-08-20T22:13:30.9973360Z eb09cbf3e416: Waiting 2024-08-20T22:13:30.9973679Z 75b2abb16c68: Waiting 2024-08-20T22:13:30.9973990Z ef1e3ef1e85f: Waiting 2024-08-20T22:13:30.9974304Z 5d115b29b5d5: Waiting 2024-08-20T22:13:30.9974612Z 0bf61114d37b: Waiting 2024-08-20T22:13:30.9974930Z 7f2d7a04fbe6: Waiting 2024-08-20T22:13:30.9975350Z 2df849f72ba4: Waiting 2024-08-20T22:13:30.9975782Z 8c32d0ecebbe: Waiting 2024-08-20T22:13:30.9976197Z 6658e558ebe4: Waiting 2024-08-20T22:13:30.9976614Z 4f4fb700ef54: Waiting 2024-08-20T22:13:30.9977037Z e22979f9e0ee: Waiting 2024-08-20T22:13:30.9977479Z 78ee77eddef2: Waiting 2024-08-20T22:13:30.9977916Z 4d4fa6802ab3: Waiting 2024-08-20T22:13:30.9978343Z 0f085d4fa279: Waiting 2024-08-20T22:13:30.9978767Z 4a0412373305: Waiting 2024-08-20T22:13:30.9979182Z 7754ee068b33: Waiting 2024-08-20T22:13:30.9979600Z 302c8c177944: Waiting 2024-08-20T22:13:30.9980035Z ee1273153675: Waiting 2024-08-20T22:13:30.9980465Z 02970347dff6: Waiting 2024-08-20T22:13:30.9980909Z 0479fbac3361: Waiting 2024-08-20T22:13:30.9981356Z 6c1f0aabce7c: Waiting 2024-08-20T22:13:30.9981800Z 6efb96fc87ea: Waiting 2024-08-20T22:13:30.9982231Z f1d6874dee9c: Waiting 2024-08-20T22:13:30.9982670Z 7ebe49c3a23e: Waiting 2024-08-20T22:13:30.9983108Z 9752d6fbbcab: Waiting 2024-08-20T22:13:30.9983541Z afc429e87b59: Waiting 2024-08-20T22:13:30.9983972Z d79fd7d52698: Waiting 2024-08-20T22:13:30.9984414Z 916c5e858016: Waiting 2024-08-20T22:13:30.9984880Z c42b3602a1fb: Waiting 2024-08-20T22:13:30.9985327Z 83808b2eff4d: Waiting 2024-08-20T22:13:30.9985765Z 34c47d63c5de: Waiting 2024-08-20T22:13:30.9986204Z 1fef4bd19792: Waiting 2024-08-20T22:13:30.9986628Z 7c47122f4e09: Waiting 2024-08-20T22:13:30.9987054Z a8c1e85b5e14: Waiting 2024-08-20T22:13:30.9987488Z e56eeff2db93: Waiting 2024-08-20T22:13:30.9987918Z 768c31dca016: Waiting 2024-08-20T22:13:30.9988356Z 5a4eb19d7219: Waiting 2024-08-20T22:13:30.9988796Z da6a838a66c7: Waiting 2024-08-20T22:13:30.9989236Z a7a5392e2bf6: Waiting 2024-08-20T22:13:30.9989684Z b10de02255c0: Waiting 2024-08-20T22:13:30.9990116Z cbb79a705353: Waiting 2024-08-20T22:13:30.9990550Z 019620471c25: Waiting 2024-08-20T22:13:30.9990978Z 27aeb1b2cd5e: Waiting 2024-08-20T22:13:30.9991410Z 11fad972ef6c: Waiting 2024-08-20T22:13:30.9991832Z f957c1624481: Waiting 2024-08-20T22:13:31.1391851Z 224fe954d725: Verifying Checksum 2024-08-20T22:13:31.1392303Z 224fe954d725: Download complete 2024-08-20T22:13:31.2189978Z d527cbbb87e3: Verifying Checksum 2024-08-20T22:13:31.2190424Z d527cbbb87e3: Download complete 2024-08-20T22:13:31.2970941Z b57676e46aee: Verifying Checksum 2024-08-20T22:13:31.2971400Z b57676e46aee: Download complete 2024-08-20T22:13:31.3299447Z 7a2c55901189: Download complete 2024-08-20T22:13:31.4065505Z a41a8d1c11c8: Verifying Checksum 2024-08-20T22:13:31.4066090Z a41a8d1c11c8: Download complete 2024-08-20T22:13:31.4773786Z 0c1227890755: Download complete 2024-08-20T22:13:31.5552075Z d8d1234baab3: Verifying Checksum 2024-08-20T22:13:31.5552682Z d8d1234baab3: Download complete 2024-08-20T22:13:31.6028217Z 75722010b82e: Verifying Checksum 2024-08-20T22:13:31.6028796Z 75722010b82e: Download complete 2024-08-20T22:13:31.6751965Z ec1e7978c1fe: Download complete 2024-08-20T22:13:31.7348783Z ac23c5fcc1ef: Verifying Checksum 2024-08-20T22:13:31.7349402Z ac23c5fcc1ef: Download complete 2024-08-20T22:13:32.5043770Z 7a2c55901189: Pull complete 2024-08-20T22:13:32.8178177Z 224fe954d725: Pull complete 2024-08-20T22:13:33.7295007Z 75722010b82e: Pull complete 2024-08-20T22:13:33.7492811Z d527cbbb87e3: Pull complete 2024-08-20T22:13:33.7716363Z b57676e46aee: Pull complete 2024-08-20T22:13:34.2557236Z ca426ffc9d2b: Verifying Checksum 2024-08-20T22:13:34.2557846Z ca426ffc9d2b: Download complete 2024-08-20T22:13:34.3331851Z 4373aa743caf: Download complete 2024-08-20T22:13:34.4067280Z 75b2abb16c68: Verifying Checksum 2024-08-20T22:13:34.4067715Z 75b2abb16c68: Download complete 2024-08-20T22:13:34.4853120Z ef1e3ef1e85f: Download complete 2024-08-20T22:13:35.4540832Z 0bf61114d37b: Verifying Checksum 2024-08-20T22:13:35.4541292Z 0bf61114d37b: Download complete 2024-08-20T22:13:35.5235381Z 2df849f72ba4: Download complete 2024-08-20T22:13:35.5947223Z 34c47d63c5de: Verifying Checksum 2024-08-20T22:13:35.5947910Z 34c47d63c5de: Download complete 2024-08-20T22:13:35.6768590Z 1fef4bd19792: Verifying Checksum 2024-08-20T22:13:35.6769160Z 1fef4bd19792: Download complete 2024-08-20T22:13:44.6440361Z a8c1e85b5e14: Verifying Checksum 2024-08-20T22:13:44.6440836Z a8c1e85b5e14: Download complete 2024-08-20T22:13:44.7230691Z b119c4fc6c58: Download complete 2024-08-20T22:13:44.7935125Z 33b639226eee: Download complete 2024-08-20T22:13:44.8654198Z d3547bd43146: Download complete 2024-08-20T22:13:44.9381427Z 5645520256fa: Download complete 2024-08-20T22:13:45.0148618Z 829ed7d91e38: Download complete 2024-08-20T22:13:46.2762025Z 385d0421d67c: Download complete 2024-08-20T22:13:46.3415134Z 7cbfce999d76: Verifying Checksum 2024-08-20T22:13:46.3416256Z 7cbfce999d76: Download complete 2024-08-20T22:13:46.4245276Z 6658e558ebe4: Verifying Checksum 2024-08-20T22:13:46.4245792Z 6658e558ebe4: Download complete 2024-08-20T22:13:46.5001854Z 33444a5a7e01: Download complete 2024-08-20T22:13:46.5696859Z 7c47122f4e09: Verifying Checksum 2024-08-20T22:13:46.5697455Z 7c47122f4e09: Download complete 2024-08-20T22:13:46.6444400Z 1811ff4d3556: Download complete 2024-08-20T22:13:52.6845651Z 7754ee068b33: Verifying Checksum 2024-08-20T22:13:52.6846566Z 7754ee068b33: Download complete 2024-08-20T22:13:52.7496788Z 0479fbac3361: Verifying Checksum 2024-08-20T22:13:52.7497397Z 0479fbac3361: Download complete 2024-08-20T22:13:52.8236115Z f1d6874dee9c: Verifying Checksum 2024-08-20T22:13:52.8236784Z f1d6874dee9c: Download complete 2024-08-20T22:13:53.2374102Z afc429e87b59: Verifying Checksum 2024-08-20T22:13:53.2374643Z afc429e87b59: Download complete 2024-08-20T22:13:53.3111599Z 019620471c25: Verifying Checksum 2024-08-20T22:13:53.3112075Z 019620471c25: Download complete 2024-08-20T22:13:53.3762304Z 27aeb1b2cd5e: Verifying Checksum 2024-08-20T22:13:53.3762769Z 27aeb1b2cd5e: Download complete 2024-08-20T22:13:53.6277056Z 829c0e19f4b7: Verifying Checksum 2024-08-20T22:13:53.6277564Z 829c0e19f4b7: Download complete 2024-08-20T22:13:53.6929911Z 560cd6122a38: Verifying Checksum 2024-08-20T22:13:53.6930343Z 560cd6122a38: Download complete 2024-08-20T22:13:53.7637420Z 5a4eb19d7219: Download complete 2024-08-20T22:13:53.8341293Z da6a838a66c7: Verifying Checksum 2024-08-20T22:13:53.8341963Z da6a838a66c7: Download complete 2024-08-20T22:13:56.8805372Z 7ed32bc8e469: Verifying Checksum 2024-08-20T22:13:56.8805942Z 7ed32bc8e469: Download complete 2024-08-20T22:13:56.9540875Z 4d4fa6802ab3: Download complete 2024-08-20T22:13:57.0348214Z 0f085d4fa279: Verifying Checksum 2024-08-20T22:13:57.0348862Z 0f085d4fa279: Download complete 2024-08-20T22:13:57.5262964Z 4a0412373305: Verifying Checksum 2024-08-20T22:13:57.5263522Z 4a0412373305: Download complete 2024-08-20T22:13:57.5604342Z a8c1e85b5e14: Pull complete 2024-08-20T22:13:57.6357721Z 302c8c177944: Verifying Checksum 2024-08-20T22:13:57.6358399Z 302c8c177944: Download complete 2024-08-20T22:13:57.7126594Z 02970347dff6: Verifying Checksum 2024-08-20T22:13:57.7471773Z 02970347dff6: Download complete 2024-08-20T22:13:57.7472229Z a41a8d1c11c8: Pull complete 2024-08-20T22:13:57.7930706Z 916c5e858016: Verifying Checksum 2024-08-20T22:13:57.7931339Z 916c5e858016: Download complete 2024-08-20T22:13:57.8770058Z c42b3602a1fb: Verifying Checksum 2024-08-20T22:13:57.8770641Z c42b3602a1fb: Download complete 2024-08-20T22:13:57.9219257Z 0c1227890755: Pull complete 2024-08-20T22:13:58.1017881Z d8d1234baab3: Pull complete 2024-08-20T22:14:04.3722028Z 6efb96fc87ea: Verifying Checksum 2024-08-20T22:14:04.3722511Z 6efb96fc87ea: Download complete 2024-08-20T22:14:04.4339138Z f957c1624481: Verifying Checksum 2024-08-20T22:14:04.4339677Z f957c1624481: Download complete 2024-08-20T22:14:04.5025354Z 768c31dca016: Verifying Checksum 2024-08-20T22:14:04.5025810Z 768c31dca016: Download complete 2024-08-20T22:14:04.5771537Z 8c32d0ecebbe: Verifying Checksum 2024-08-20T22:14:04.5772078Z 8c32d0ecebbe: Download complete 2024-08-20T22:14:04.5859330Z 4f4fb700ef54: Verifying Checksum 2024-08-20T22:14:04.5859952Z 4f4fb700ef54: Download complete 2024-08-20T22:14:04.6559385Z 78ee77eddef2: Download complete 2024-08-20T22:14:04.7254728Z 37513e9b43d7: Verifying Checksum 2024-08-20T22:14:04.7255178Z 37513e9b43d7: Download complete 2024-08-20T22:14:04.8534896Z a7a5392e2bf6: Verifying Checksum 2024-08-20T22:14:04.8535444Z a7a5392e2bf6: Download complete 2024-08-20T22:14:04.9280205Z b10de02255c0: Download complete 2024-08-20T22:14:05.0131434Z e56eeff2db93: Verifying Checksum 2024-08-20T22:14:05.0132044Z e56eeff2db93: Download complete 2024-08-20T22:14:05.0808232Z 70ac3e38d0fd: Download complete 2024-08-20T22:14:05.1510592Z eb09cbf3e416: Verifying Checksum 2024-08-20T22:14:05.1511151Z eb09cbf3e416: Download complete 2024-08-20T22:14:05.2837437Z ee1273153675: Verifying Checksum 2024-08-20T22:14:05.2838026Z ee1273153675: Download complete 2024-08-20T22:14:05.3668731Z e22979f9e0ee: Download complete 2024-08-20T22:14:05.9678925Z 6c1f0aabce7c: Verifying Checksum 2024-08-20T22:14:05.9679479Z 6c1f0aabce7c: Download complete 2024-08-20T22:14:06.0525294Z 7ebe49c3a23e: Download complete 2024-08-20T22:14:32.0507227Z 5d115b29b5d5: Verifying Checksum 2024-08-20T22:14:32.0507688Z 5d115b29b5d5: Download complete 2024-08-20T22:14:32.1317809Z 7f2d7a04fbe6: Download complete 2024-08-20T22:14:32.2008945Z d79fd7d52698: Verifying Checksum 2024-08-20T22:14:32.2009502Z d79fd7d52698: Download complete 2024-08-20T22:14:33.4472139Z 9752d6fbbcab: Verifying Checksum 2024-08-20T22:14:33.4472605Z 9752d6fbbcab: Download complete 2024-08-20T22:14:33.5252601Z 83808b2eff4d: Verifying Checksum 2024-08-20T22:14:33.5253074Z 83808b2eff4d: Download complete 2024-08-20T22:15:11.3188498Z 11fad972ef6c: Download complete 2024-08-20T22:15:13.6276308Z cbb79a705353: Verifying Checksum 2024-08-20T22:15:13.6281414Z cbb79a705353: Download complete 2024-08-20T22:15:28.3434922Z 7ed32bc8e469: Pull complete 2024-08-20T22:15:28.5805488Z ec1e7978c1fe: Pull complete 2024-08-20T22:15:28.8036858Z ac23c5fcc1ef: Pull complete 2024-08-20T22:15:37.4191649Z ca426ffc9d2b: Pull complete 2024-08-20T22:15:37.6363754Z 4373aa743caf: Pull complete 2024-08-20T22:15:37.8598279Z 75b2abb16c68: Pull complete 2024-08-20T22:15:38.0889519Z ef1e3ef1e85f: Pull complete 2024-08-20T22:15:40.6669594Z 0bf61114d37b: Pull complete 2024-08-20T22:15:40.8418586Z 2df849f72ba4: Pull complete 2024-08-20T22:15:41.0344770Z 34c47d63c5de: Pull complete 2024-08-20T22:15:41.0898632Z 1fef4bd19792: Pull complete 2024-08-20T22:16:39.5165088Z 6efb96fc87ea: Pull complete 2024-08-20T22:16:39.7474646Z b119c4fc6c58: Pull complete 2024-08-20T22:16:39.9799114Z 33b639226eee: Pull complete 2024-08-20T22:16:40.2150052Z d3547bd43146: Pull complete 2024-08-20T22:16:40.3665427Z 5645520256fa: Pull complete 2024-08-20T22:16:40.5819959Z 829ed7d91e38: Pull complete 2024-08-20T22:16:44.0393163Z 385d0421d67c: Pull complete 2024-08-20T22:16:44.2601385Z 7cbfce999d76: Pull complete 2024-08-20T22:16:44.4814787Z 6658e558ebe4: Pull complete 2024-08-20T22:16:44.7112707Z 33444a5a7e01: Pull complete 2024-08-20T22:16:44.9404102Z 7c47122f4e09: Pull complete 2024-08-20T22:16:45.1668612Z 1811ff4d3556: Pull complete 2024-08-20T22:16:55.6501893Z 7754ee068b33: Pull complete 2024-08-20T22:16:55.8299005Z 0479fbac3361: Pull complete 2024-08-20T22:16:56.0492271Z f1d6874dee9c: Pull complete 2024-08-20T22:16:57.0521791Z afc429e87b59: Pull complete 2024-08-20T22:16:57.2698966Z 019620471c25: Pull complete 2024-08-20T22:16:57.4792715Z 27aeb1b2cd5e: Pull complete 2024-08-20T22:16:57.9791685Z 829c0e19f4b7: Pull complete 2024-08-20T22:16:58.1960748Z 560cd6122a38: Pull complete 2024-08-20T22:16:58.5665155Z 5a4eb19d7219: Pull complete 2024-08-20T22:16:58.7467690Z da6a838a66c7: Pull complete 2024-08-20T22:17:37.5459773Z cbb79a705353: Pull complete 2024-08-20T22:17:37.7708124Z 4d4fa6802ab3: Pull complete 2024-08-20T22:17:38.0118604Z 0f085d4fa279: Pull complete 2024-08-20T22:17:40.4233710Z 4a0412373305: Pull complete 2024-08-20T22:17:40.4366735Z 302c8c177944: Pull complete 2024-08-20T22:17:40.4498913Z 02970347dff6: Pull complete 2024-08-20T22:17:40.4770013Z 916c5e858016: Pull complete 2024-08-20T22:17:40.4905175Z c42b3602a1fb: Pull complete 2024-08-20T22:19:02.0688780Z 11fad972ef6c: Pull complete 2024-08-20T22:19:02.2267049Z f957c1624481: Pull complete 2024-08-20T22:19:02.3703196Z 768c31dca016: Pull complete 2024-08-20T22:19:02.6483315Z 8c32d0ecebbe: Pull complete 2024-08-20T22:19:02.7995348Z 4f4fb700ef54: Pull complete 2024-08-20T22:19:03.0447000Z 78ee77eddef2: Pull complete 2024-08-20T22:19:03.2661267Z 37513e9b43d7: Pull complete 2024-08-20T22:19:03.6477818Z a7a5392e2bf6: Pull complete 2024-08-20T22:19:03.8809092Z b10de02255c0: Pull complete 2024-08-20T22:19:04.0683721Z e56eeff2db93: Pull complete 2024-08-20T22:19:04.3059146Z 70ac3e38d0fd: Pull complete 2024-08-20T22:19:04.5406425Z eb09cbf3e416: Pull complete 2024-08-20T22:19:05.9443308Z ee1273153675: Pull complete 2024-08-20T22:19:06.0847089Z e22979f9e0ee: Pull complete 2024-08-20T22:19:08.2471404Z 6c1f0aabce7c: Pull complete 2024-08-20T22:19:08.4804084Z 7ebe49c3a23e: Pull complete 2024-08-20T22:19:21.6888236Z 5d115b29b5d5: Pull complete 2024-08-20T22:19:21.8709652Z 7f2d7a04fbe6: Pull complete 2024-08-20T22:19:21.9635523Z d79fd7d52698: Pull complete 2024-08-20T22:19:22.8083233Z 9752d6fbbcab: Pull complete 2024-08-20T22:19:23.0073354Z 83808b2eff4d: Pull complete 2024-08-20T22:19:23.9051378Z Digest: sha256:3a95d3a177465127ef6cd3b50787d6a050367070fd9063dbb688fad07a96b402 2024-08-20T22:19:23.9438341Z Status: Downloaded newer image for 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:19:23.9706187Z 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:19:23.9802682Z ##[group]Run echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> "$GITHUB_OUTPUT" 2024-08-20T22:19:23.9803602Z echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> "$GITHUB_OUTPUT" 2024-08-20T22:19:23.9814548Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:19:23.9815044Z env: 2024-08-20T22:19:23.9815325Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:19:23.9815673Z ##[endgroup] 2024-08-20T22:19:24.0001304Z ##[group]Run pytorch/test-infra/.github/actions/setup-nvidia@main 2024-08-20T22:19:24.0001847Z with: 2024-08-20T22:19:24.0002122Z driver-version: 550.54.15 2024-08-20T22:19:24.0002451Z env: 2024-08-20T22:19:24.0002718Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:19:24.0003070Z ##[endgroup] 2024-08-20T22:19:24.0107768Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2024-08-20T22:19:24.0108330Z with: 2024-08-20T22:19:24.0108602Z timeout_minutes: 10 2024-08-20T22:19:24.0108928Z max_attempts: 3 2024-08-20T22:19:24.0141624Z command: # Is it disgusting to have a full shell script here in this github action? Sure # But is it the best way to make it so that this action relies on nothing else? Absolutely set -eou pipefail DISTRIBUTION=$(. /etc/os-release;echo $ID$VERSION_ID) DRIVER_FN="NVIDIA-Linux-x86_64-${DRIVER_VERSION}.run" install_nvidia_docker2_amzn2() { ( set -x # Needed for yum-config-manager sudo yum install -y yum-utils if [[ "${DISTRIBUTION}" == "amzn2023" ]] ; then YUM_REPO_URL="https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo" else # Amazon Linux 2 YUM_REPO_URL="https://nvidia.github.io/nvidia-docker/${DISTRIBUTION}/nvidia-docker.repo" fi sudo yum-config-manager --add-repo "${YUM_REPO_URL}" sudo yum install -y nvidia-docker2 sudo systemctl restart docker ) } install_nvidia_docker2_ubuntu20() { ( set -x # Install nvidia-driver package if not installed status="$(dpkg-query -W --showformat='${db:Status-Status}' nvidia-docker2 2>&1)" if [ ! $? = 0 ] || [ ! "$status" = installed ]; then sudo apt-get install -y nvidia-docker2 sudo systemctl restart docker fi ) } pre_install_nvidia_driver_amzn2() { ( # Purge any nvidia driver installed from RHEL repo sudo yum remove -y nvidia-driver-latest-dkms ) } install_nvidia_driver_common() { ( # Try to gather more information about the runner and its existing NVIDIA driver if any echo "Before installing NVIDIA driver" lspci lsmod modinfo nvidia || true HAS_NVIDIA_DRIVER=0 # Check if NVIDIA driver has already been installed if [ -x "$(command -v nvidia-smi)" ]; then set +e # The driver exists, check its version next. Also check only the first GPU if there are more than one of them # so that the same driver version is not print over multiple lines INSTALLED_DRIVER_VERSION=$(nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0) NVIDIA_SMI_STATUS=$? if [ "$NVIDIA_SMI_STATUS" -ne 0 ] && [ "$NVIDIA_SMI_STATUS" -ne 14 ]; then echo "Failed to get NVIDIA driver version ($INSTALLED_DRIVER_VERSION). Continuing" elif [ "$INSTALLED_DRIVER_VERSION" != "$DRIVER_VERSION" ]; then echo "NVIDIA driver ($INSTALLED_DRIVER_VERSION) has been installed, but we expect to have $DRIVER_VERSION instead. Continuing" else HAS_NVIDIA_DRIVER=1 echo "NVIDIA driver ($INSTALLED_DRIVER_VERSION) has already been installed. Skipping NVIDIA driver installation" fi set -e fi if [ "$HAS_NVIDIA_DRIVER" -eq 0 ]; then # CAUTION: this may need to be updated in future if [ "${DISTRIBUTION}" != ubuntu20.04 ]; then sudo yum groupinstall -y "Development Tools" # ensure our kernel install is the same as our underlying kernel, # groupinstall "Development Tools" has a habit of mismatching kernel headers sudo yum install -y "kernel-devel-uname-r == $(uname -r)" sudo modprobe backlight fi sudo curl -fsL -o /tmp/nvidia_driver "https://s3.amazonaws.com/ossci-linux/nvidia_driver/$DRIVER_FN" set +e sudo /bin/bash /tmp/nvidia_driver -s --no-drm NVIDIA_INSTALLATION_STATUS=$? RESET_GPU=0 if [ "$NVIDIA_INSTALLATION_STATUS" -ne 0 ]; then sudo cat /var/log/nvidia-installer.log # Fail to install NVIDIA driver, try to reset the GPU RESET_GPU=1 elif [ -x "$(command -v nvidia-smi)" ]; then # Check again if nvidia-smi works even if the driver installation completes successfully INSTALLED_DRIVER_VERSION=$(nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0) NVIDIA_SMI_STATUS=$? if [ "$NVIDIA_SMI_STATUS" -ne 0 ] && [ "$NVIDIA_SMI_STATUS" -ne 14 ]; then RESET_GPU=1 fi fi if [ "$RESET_GPU" -eq 1 ]; then NVIDIA_DEVICES=$(lspci -D | grep -i NVIDIA | cut -d' ' -f1) # The GPU can get stuck in a failure state if somehow the test crashs the GPU microcode. When this # happens, we'll try to reset all NVIDIA devices https://github.com/pytorch/pytorch/issues/88388 for PCI_ID in $NVIDIA_DEVICES; do DEVICE_ENABLED=$(cat /sys/bus/pci/devices/$PCI_ID/enable) echo "Reseting $PCI_ID (enabled state: $DEVICE_ENABLED)" # This requires sudo permission of course echo "1" | sudo tee /sys/bus/pci/devices/$PCI_ID/reset sleep 1 done fi sudo rm -fv /tmp/nvidia_driver set -e fi ) } post_install_nvidia_driver_common() { ( sudo modprobe nvidia || true echo "After installing NVIDIA driver" lspci lsmod modinfo nvidia || true ( set +e nvidia-smi # NB: Annoyingly, nvidia-smi command returns successfully with return code 0 even in # the case where the driver has already crashed as it still can get the driver version # and some basic information like the bus ID. However, the rest of the information # would be missing (ERR!), for example: # # +-----------------------------------------------------------------------------+ # | NVIDIA-SMI 525.89.02 Driver Version: 525.89.02 CUDA Version: 12.0 | # |-------------------------------+----------------------+----------------------+ # | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | # | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | # | | | MIG M. | # |===============================+======================+======================| # | 0 ERR! Off | 00000000:00:1E.0 Off | ERR! | # |ERR! ERR! ERR! ERR! / ERR! | 4184MiB / 23028MiB | ERR! Default | # | | | ERR! | # +-------------------------------+----------------------+----------------------+ # # +-----------------------------------------------------------------------------+ # | Processes: | # | GPU GI CI PID Type Process name GPU Memory | # | ID ID Usage | # |=============================================================================| # +-----------------------------------------------------------------------------+ # # This should be reported as a failure instead as it will guarantee to fail when # Docker tries to run with --gpus all # # So, the correct check here is to query one of the missing piece of info like # GPU name, so that the command can fail accordingly nvidia-smi --query-gpu=gpu_name --format=csv,noheader --id=0 NVIDIA_SMI_STATUS=$? # Allowable exit statuses for nvidia-smi, see: https://github.com/NVIDIA/gpu-operator/issues/285 if [ "$NVIDIA_SMI_STATUS" -eq 0 ] || [ "$NVIDIA_SMI_STATUS" -eq 14 ]; then echo "INFO: Ignoring allowed status ${NVIDIA_SMI_STATUS}" else echo "ERROR: nvidia-smi exited with unresolved status ${NVIDIA_SMI_STATUS}" exit ${NVIDIA_SMI_STATUS} fi set -e ) ) } install_nvidia_driver_amzn2() { ( set -x pre_install_nvidia_driver_amzn2 install_nvidia_driver_common post_install_nvidia_driver_common ) } install_nvidia_driver_ubuntu20() { ( set -x install_nvidia_driver_common post_install_nvidia_driver_common ) } echo "== Installing nvidia driver ${DRIVER_FN} ==" case "${DISTRIBUTION}" in amzn*) install_nvidia_driver_amzn2 ;; ubuntu20.04) install_nvidia_driver_ubuntu20 ;; *) echo "ERROR: Unknown distribution ${DISTRIBUTION}" exit 1 ;; esac # Install container toolkit based on distribution echo "== Installing nvidia container toolkit for ${DISTRIBUTION} ==" case "${DISTRIBUTION}" in amzn*) install_nvidia_docker2_amzn2 ;; ubuntu20.04) install_nvidia_docker2_ubuntu20 ;; *) echo "ERROR: Unknown distribution ${DISTRIBUTION}" exit 1 ;; esac echo "GPU_FLAG=--gpus all -e NVIDIA_DRIVER_CAPABILITIES=all" >> "${GITHUB_ENV}" # Fix https://github.com/NVIDIA/nvidia-docker/issues/1648 on runners with # more than one GPUs. This just needs to be run once. The command fails # on subsequent runs and complains that the mode is already on, but that's # ok sudo nvidia-persistenced || true # This should show persistence mode ON nvidia-smi 2024-08-20T22:19:24.0175335Z retry_wait_seconds: 10 2024-08-20T22:19:24.0175704Z polling_interval_seconds: 1 2024-08-20T22:19:24.0176076Z warning_on_retry: true 2024-08-20T22:19:24.0176425Z continue_on_error: false 2024-08-20T22:19:24.0176757Z env: 2024-08-20T22:19:24.0177031Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:19:24.0177377Z DRIVER_VERSION: 550.54.15 2024-08-20T22:19:24.0177724Z ##[endgroup] 2024-08-20T22:19:24.0988407Z == Installing nvidia driver NVIDIA-Linux-x86_64-550.54.15.run == 2024-08-20T22:19:24.0988998Z + pre_install_nvidia_driver_amzn2 2024-08-20T22:19:24.0990871Z + sudo yum remove -y nvidia-driver-latest-dkms 2024-08-20T22:19:24.4428743Z No match for argument: nvidia-driver-latest-dkms 2024-08-20T22:19:24.4429260Z No packages marked for removal. 2024-08-20T22:19:24.4492467Z Dependencies resolved. 2024-08-20T22:19:24.4502298Z Nothing to do. 2024-08-20T22:19:24.4502697Z Complete! 2024-08-20T22:19:24.5367078Z + install_nvidia_driver_common 2024-08-20T22:19:24.5372191Z + echo 'Before installing NVIDIA driver' 2024-08-20T22:19:24.5372660Z Before installing NVIDIA driver 2024-08-20T22:19:24.5373743Z + lspci 2024-08-20T22:19:24.5485188Z 00:00.0 Host bridge: Intel Corporation 440FX - 82441FX PMC [Natoma] 2024-08-20T22:19:24.5486002Z 00:01.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II] 2024-08-20T22:19:24.5486997Z 00:01.3 Non-VGA unclassified device: Intel Corporation 82371AB/EB/MB PIIX4 ACPI (rev 08) 2024-08-20T22:19:24.5487801Z 00:03.0 VGA compatible controller: Amazon.com, Inc. Device 1111 2024-08-20T22:19:24.5488626Z 00:04.0 Non-Volatile memory controller: Amazon.com, Inc. NVMe EBS Controller 2024-08-20T22:19:24.5489419Z 00:05.0 Ethernet controller: Amazon.com, Inc. Elastic Network Adapter (ENA) 2024-08-20T22:19:24.5490155Z 00:1e.0 3D controller: NVIDIA Corporation GA102GL [A10G] (rev a1) 2024-08-20T22:19:24.5490962Z 00:1f.0 Non-Volatile memory controller: Amazon.com, Inc. NVMe SSD Controller 2024-08-20T22:19:24.5491541Z + lsmod 2024-08-20T22:19:24.5533175Z Module Size Used by 2024-08-20T22:19:24.5533646Z veth 36864 0 2024-08-20T22:19:24.5534093Z nvidia_modeset 1351680 0 2024-08-20T22:19:24.5534509Z video 65536 1 nvidia_modeset 2024-08-20T22:19:24.5534950Z wmi 36864 1 video 2024-08-20T22:19:24.5535353Z nvidia_uvm 4706304 0 2024-08-20T22:19:24.5535931Z nvidia 54071296 7 nvidia_uvm,nvidia_modeset 2024-08-20T22:19:24.5536689Z drm 602112 1 nvidia 2024-08-20T22:19:24.5537129Z drm_panel_orientation_quirks 28672 1 drm 2024-08-20T22:19:24.5537654Z backlight 24576 3 video,drm,nvidia_modeset 2024-08-20T22:19:24.5538224Z i2c_core 106496 2 nvidia,drm 2024-08-20T22:19:24.5538773Z xt_conntrack 16384 1 2024-08-20T22:19:24.5539269Z nft_chain_nat 16384 3 2024-08-20T22:19:24.5539655Z xt_MASQUERADE 20480 1 2024-08-20T22:19:24.5540102Z nf_nat 57344 2 nft_chain_nat,xt_MASQUERADE 2024-08-20T22:19:24.5540642Z nf_conntrack_netlink 57344 0 2024-08-20T22:19:24.5541217Z nf_conntrack 184320 4 xt_conntrack,nf_nat,nf_conntrack_netlink,xt_MASQUERADE 2024-08-20T22:19:24.5541864Z nf_defrag_ipv6 24576 1 nf_conntrack 2024-08-20T22:19:24.5542328Z nf_defrag_ipv4 16384 1 nf_conntrack 2024-08-20T22:19:24.5542935Z xfrm_user 57344 1 2024-08-20T22:19:24.5543332Z xfrm_algo 16384 1 xfrm_user 2024-08-20T22:19:24.5543750Z xt_addrtype 16384 2 2024-08-20T22:19:24.5544127Z nft_compat 20480 4 2024-08-20T22:19:24.5544605Z nf_tables 307200 57 nft_compat,nft_chain_nat 2024-08-20T22:19:24.5545240Z nfnetlink 20480 4 nft_compat,nf_conntrack_netlink,nf_tables 2024-08-20T22:19:24.5545780Z br_netfilter 36864 0 2024-08-20T22:19:24.5546478Z bridge 307200 1 br_netfilter 2024-08-20T22:19:24.5546930Z stp 16384 1 bridge 2024-08-20T22:19:24.5547349Z llc 16384 2 bridge,stp 2024-08-20T22:19:24.5547772Z overlay 167936 0 2024-08-20T22:19:24.5548133Z tls 114688 0 2024-08-20T22:19:24.5548500Z nls_ascii 16384 1 2024-08-20T22:19:24.5548866Z nls_cp437 20480 1 2024-08-20T22:19:24.5549233Z vfat 24576 1 2024-08-20T22:19:24.5549593Z fat 86016 1 vfat 2024-08-20T22:19:24.5549985Z sunrpc 692224 1 2024-08-20T22:19:24.5550346Z ena 167936 0 2024-08-20T22:19:24.5550714Z ghash_clmulni_intel 16384 0 2024-08-20T22:19:24.5551219Z ptp 36864 1 ena 2024-08-20T22:19:24.5551613Z pps_core 24576 1 ptp 2024-08-20T22:19:24.5552007Z aesni_intel 393216 0 2024-08-20T22:19:24.5552366Z i8042 45056 0 2024-08-20T22:19:24.5552732Z serio 28672 3 i8042 2024-08-20T22:19:24.5553153Z crypto_simd 16384 1 aesni_intel 2024-08-20T22:19:24.5553675Z cryptd 28672 2 crypto_simd,ghash_clmulni_intel 2024-08-20T22:19:24.5554186Z button 24576 0 2024-08-20T22:19:24.5554679Z sch_fq_codel 20480 17 2024-08-20T22:19:24.5555179Z dm_mod 188416 0 2024-08-20T22:19:24.5555667Z fuse 163840 1 2024-08-20T22:19:24.5556148Z configfs 57344 1 2024-08-20T22:19:24.5556572Z dax 45056 1 dm_mod 2024-08-20T22:19:24.5556974Z loop 36864 0 2024-08-20T22:19:24.5557338Z dmi_sysfs 20480 0 2024-08-20T22:19:24.5557716Z crc32_pclmul 16384 0 2024-08-20T22:19:24.5558088Z crc32c_intel 24576 0 2024-08-20T22:19:24.5558566Z efivarfs 24576 1 2024-08-20T22:19:24.5558918Z + modinfo nvidia 2024-08-20T22:19:24.5559630Z filename: /lib/modules/6.1.94-99.176.amzn2023.x86_64/kernel/drivers/video/nvidia.ko 2024-08-20T22:19:24.5560351Z alias: char-major-195-* 2024-08-20T22:19:24.5560743Z version: 550.54.15 2024-08-20T22:19:24.5561259Z supported: external 2024-08-20T22:19:24.5561616Z license: NVIDIA 2024-08-20T22:19:24.5562003Z firmware: nvidia/550.54.15/gsp_tu10x.bin 2024-08-20T22:19:24.5562496Z firmware: nvidia/550.54.15/gsp_ga10x.bin 2024-08-20T22:19:24.5562955Z srcversion: 833721318DA517F0C2FEC97 2024-08-20T22:19:24.5563435Z alias: pci:v000010DEd*sv*sd*bc06sc80i00* 2024-08-20T22:19:24.5563944Z alias: pci:v000010DEd*sv*sd*bc03sc02i00* 2024-08-20T22:19:24.5564445Z alias: pci:v000010DEd*sv*sd*bc03sc00i00* 2024-08-20T22:19:24.5564944Z depends: i2c-core,drm 2024-08-20T22:19:24.5565314Z retpoline: Y 2024-08-20T22:19:24.5565625Z name: nvidia 2024-08-20T22:19:24.5566248Z vermagic: 6.1.94-99.176.amzn2023.x86_64 SMP preempt mod_unload modversions 2024-08-20T22:19:24.5566951Z parm: NvSwitchRegDwords:NvSwitch regkey (charp) 2024-08-20T22:19:24.5567598Z parm: NvSwitchBlacklist:NvSwitchBlacklist=uuid[,uuid...] (charp) 2024-08-20T22:19:24.5568206Z parm: NVreg_ResmanDebugLevel:int 2024-08-20T22:19:24.5568649Z parm: NVreg_RmLogonRC:int 2024-08-20T22:19:24.5569077Z parm: NVreg_ModifyDeviceFiles:int 2024-08-20T22:19:24.5569533Z parm: NVreg_DeviceFileUID:int 2024-08-20T22:19:24.5569969Z parm: NVreg_DeviceFileGID:int 2024-08-20T22:19:24.5570564Z parm: NVreg_DeviceFileMode:int 2024-08-20T22:19:24.5571095Z parm: NVreg_InitializeSystemMemoryAllocations:int 2024-08-20T22:19:24.5571655Z parm: NVreg_UsePageAttributeTable:int 2024-08-20T22:19:24.5572137Z parm: NVreg_EnablePCIeGen3:int 2024-08-20T22:19:24.5572565Z parm: NVreg_EnableMSI:int 2024-08-20T22:19:24.5572980Z parm: NVreg_TCEBypassMode:int 2024-08-20T22:19:24.5573437Z parm: NVreg_EnableStreamMemOPs:int 2024-08-20T22:19:24.5573966Z parm: NVreg_RestrictProfilingToAdminUsers:int 2024-08-20T22:19:24.5574543Z parm: NVreg_PreserveVideoMemoryAllocations:int 2024-08-20T22:19:24.5575110Z parm: NVreg_EnableS0ixPowerManagement:int 2024-08-20T22:19:24.5575729Z parm: NVreg_S0ixPowerManagementVideoMemoryThreshold:int 2024-08-20T22:19:24.5576323Z parm: NVreg_DynamicPowerManagement:int 2024-08-20T22:19:24.5576925Z parm: NVreg_DynamicPowerManagementVideoMemoryThreshold:int 2024-08-20T22:19:24.5577527Z parm: NVreg_EnableGpuFirmware:int 2024-08-20T22:19:24.5578018Z parm: NVreg_EnableGpuFirmwareLogs:int 2024-08-20T22:19:24.5578556Z parm: NVreg_OpenRmEnableUnsupportedGpus:int 2024-08-20T22:19:24.5579094Z parm: NVreg_EnableUserNUMAManagement:int 2024-08-20T22:19:24.5579589Z parm: NVreg_MemoryPoolSize:int 2024-08-20T22:19:24.5580051Z parm: NVreg_KMallocHeapMaxSize:int 2024-08-20T22:19:24.5580536Z parm: NVreg_VMallocHeapMaxSize:int 2024-08-20T22:19:24.5581002Z parm: NVreg_IgnoreMMIOCheck:int 2024-08-20T22:19:24.5581449Z parm: NVreg_NvLinkDisable:int 2024-08-20T22:19:24.5581962Z parm: NVreg_EnablePCIERelaxedOrderingMode:int 2024-08-20T22:19:24.5582489Z parm: NVreg_RegisterPCIDriver:int 2024-08-20T22:19:24.5582966Z parm: NVreg_EnableResizableBar:int 2024-08-20T22:19:24.5583453Z parm: NVreg_EnableDbgBreakpoint:int 2024-08-20T22:19:24.5583957Z parm: NVreg_EnableNonblockingOpen:int 2024-08-20T22:19:24.5584434Z parm: NVreg_RegistryDwords:charp 2024-08-20T22:19:24.5584931Z parm: NVreg_RegistryDwordsPerDevice:charp 2024-08-20T22:19:24.5585408Z parm: NVreg_RmMsg:charp 2024-08-20T22:19:24.5585819Z parm: NVreg_GpuBlacklist:charp 2024-08-20T22:19:24.5586279Z parm: NVreg_TemporaryFilePath:charp 2024-08-20T22:19:24.5586750Z parm: NVreg_ExcludedGpus:charp 2024-08-20T22:19:24.5587204Z parm: NVreg_DmaRemapPeerMmio:int 2024-08-20T22:19:24.5587683Z parm: NVreg_RmNvlinkBandwidth:charp 2024-08-20T22:19:24.5588152Z parm: NVreg_ImexChannelCount:int 2024-08-20T22:19:24.5588708Z parm: rm_firmware_active:charp 2024-08-20T22:19:24.5589119Z + HAS_NVIDIA_DRIVER=0 2024-08-20T22:19:24.5589510Z ++ command -v nvidia-smi 2024-08-20T22:19:24.5589903Z + '[' -x /usr/bin/nvidia-smi ']' 2024-08-20T22:19:24.5590271Z + set +e 2024-08-20T22:19:24.5590785Z ++ nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0 2024-08-20T22:19:24.5860002Z + INSTALLED_DRIVER_VERSION=550.54.15 2024-08-20T22:19:24.5860447Z + NVIDIA_SMI_STATUS=0 2024-08-20T22:19:24.5861282Z + '[' 0 -ne 0 ']' 2024-08-20T22:19:24.5861798Z + '[' 550.54.15 '!=' 550.54.15 ']' 2024-08-20T22:19:24.5862192Z + HAS_NVIDIA_DRIVER=1 2024-08-20T22:19:24.5862930Z + echo 'NVIDIA driver (550.54.15) has already been installed. Skipping NVIDIA driver installation' 2024-08-20T22:19:24.5863640Z + set -e 2024-08-20T22:19:24.5863946Z + '[' 1 -eq 0 ']' 2024-08-20T22:19:24.5864515Z NVIDIA driver (550.54.15) has already been installed. Skipping NVIDIA driver installation 2024-08-20T22:19:24.5865195Z + post_install_nvidia_driver_common 2024-08-20T22:19:24.5867700Z + sudo modprobe nvidia 2024-08-20T22:19:24.7146790Z + echo 'After installing NVIDIA driver' 2024-08-20T22:19:24.7147381Z + lspci 2024-08-20T22:19:24.7147749Z After installing NVIDIA driver 2024-08-20T22:19:24.7254270Z 00:00.0 Host bridge: Intel Corporation 440FX - 82441FX PMC [Natoma] 2024-08-20T22:19:24.7255598Z 00:01.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II] 2024-08-20T22:19:24.7256618Z 00:01.3 Non-VGA unclassified device: Intel Corporation 82371AB/EB/MB PIIX4 ACPI (rev 08) 2024-08-20T22:19:24.7257608Z 00:03.0 VGA compatible controller: Amazon.com, Inc. Device 1111 2024-08-20T22:19:24.7258558Z 00:04.0 Non-Volatile memory controller: Amazon.com, Inc. NVMe EBS Controller 2024-08-20T22:19:24.7259473Z 00:05.0 Ethernet controller: Amazon.com, Inc. Elastic Network Adapter (ENA) 2024-08-20T22:19:24.7260549Z 00:1e.0 3D controller: NVIDIA Corporation GA102GL [A10G] (rev a1) 2024-08-20T22:19:24.7261741Z 00:1f.0 Non-Volatile memory controller: Amazon.com, Inc. NVMe SSD Controller 2024-08-20T22:19:24.7262584Z + lsmod 2024-08-20T22:19:24.7288746Z Module Size Used by 2024-08-20T22:19:24.7289301Z veth 36864 0 2024-08-20T22:19:24.7289823Z nvidia_modeset 1351680 0 2024-08-20T22:19:24.7290397Z video 65536 1 nvidia_modeset 2024-08-20T22:19:24.7291024Z wmi 36864 1 video 2024-08-20T22:19:24.7291455Z nvidia_uvm 4706304 0 2024-08-20T22:19:24.7291921Z nvidia 54071296 7 nvidia_uvm,nvidia_modeset 2024-08-20T22:19:24.7292414Z drm 602112 1 nvidia 2024-08-20T22:19:24.7292867Z drm_panel_orientation_quirks 28672 1 drm 2024-08-20T22:19:24.7293399Z backlight 24576 3 video,drm,nvidia_modeset 2024-08-20T22:19:24.7293922Z i2c_core 106496 2 nvidia,drm 2024-08-20T22:19:24.7294359Z xt_conntrack 16384 1 2024-08-20T22:19:24.7294748Z nft_chain_nat 16384 3 2024-08-20T22:19:24.7295129Z xt_MASQUERADE 20480 1 2024-08-20T22:19:24.7295597Z nf_nat 57344 2 nft_chain_nat,xt_MASQUERADE 2024-08-20T22:19:24.7296099Z nf_conntrack_netlink 57344 0 2024-08-20T22:19:24.7296690Z nf_conntrack 184320 4 xt_conntrack,nf_nat,nf_conntrack_netlink,xt_MASQUERADE 2024-08-20T22:19:24.7297338Z nf_defrag_ipv6 24576 1 nf_conntrack 2024-08-20T22:19:24.7297817Z nf_defrag_ipv4 16384 1 nf_conntrack 2024-08-20T22:19:24.7298261Z xfrm_user 57344 1 2024-08-20T22:19:24.7298661Z xfrm_algo 16384 1 xfrm_user 2024-08-20T22:19:24.7299093Z xt_addrtype 16384 2 2024-08-20T22:19:24.7299485Z nft_compat 20480 4 2024-08-20T22:19:24.7299950Z nf_tables 307200 57 nft_compat,nft_chain_nat 2024-08-20T22:19:24.7300563Z nfnetlink 20480 4 nft_compat,nf_conntrack_netlink,nf_tables 2024-08-20T22:19:24.7301119Z br_netfilter 36864 0 2024-08-20T22:19:24.7301538Z bridge 307200 1 br_netfilter 2024-08-20T22:19:24.7302204Z stp 16384 1 bridge 2024-08-20T22:19:24.7302638Z llc 16384 2 bridge,stp 2024-08-20T22:19:24.7303070Z overlay 167936 0 2024-08-20T22:19:24.7303446Z tls 114688 0 2024-08-20T22:19:24.7303825Z nls_ascii 16384 1 2024-08-20T22:19:24.7304199Z nls_cp437 20480 1 2024-08-20T22:19:24.7304574Z vfat 24576 1 2024-08-20T22:19:24.7305009Z fat 86016 1 vfat 2024-08-20T22:19:24.7305403Z sunrpc 692224 1 2024-08-20T22:19:24.7305777Z ena 167936 0 2024-08-20T22:19:24.7306158Z ghash_clmulni_intel 16384 0 2024-08-20T22:19:24.7306551Z ptp 36864 1 ena 2024-08-20T22:19:24.7306951Z pps_core 24576 1 ptp 2024-08-20T22:19:24.7307356Z aesni_intel 393216 0 2024-08-20T22:19:24.7307730Z i8042 45056 0 2024-08-20T22:19:24.7308108Z serio 28672 3 i8042 2024-08-20T22:19:24.7308538Z crypto_simd 16384 1 aesni_intel 2024-08-20T22:19:24.7309240Z cryptd 28672 2 crypto_simd,ghash_clmulni_intel 2024-08-20T22:19:24.7309896Z button 24576 0 2024-08-20T22:19:24.7310387Z sch_fq_codel 20480 17 2024-08-20T22:19:24.7310873Z dm_mod 188416 0 2024-08-20T22:19:24.7311478Z fuse 163840 1 2024-08-20T22:19:24.7311861Z configfs 57344 1 2024-08-20T22:19:24.7312248Z dax 45056 1 dm_mod 2024-08-20T22:19:24.7312659Z loop 36864 0 2024-08-20T22:19:24.7313037Z dmi_sysfs 20480 0 2024-08-20T22:19:24.7313420Z crc32_pclmul 16384 0 2024-08-20T22:19:24.7313793Z crc32c_intel 24576 0 2024-08-20T22:19:24.7314179Z efivarfs 24576 1 2024-08-20T22:19:24.7314576Z + modinfo nvidia 2024-08-20T22:19:24.7315338Z filename: /lib/modules/6.1.94-99.176.amzn2023.x86_64/kernel/drivers/video/nvidia.ko 2024-08-20T22:19:24.7316039Z alias: char-major-195-* 2024-08-20T22:19:24.7316437Z version: 550.54.15 2024-08-20T22:19:24.7316797Z supported: external 2024-08-20T22:19:24.7317146Z license: NVIDIA 2024-08-20T22:19:24.7317528Z firmware: nvidia/550.54.15/gsp_tu10x.bin 2024-08-20T22:19:24.7318026Z firmware: nvidia/550.54.15/gsp_ga10x.bin 2024-08-20T22:19:24.7318621Z srcversion: 833721318DA517F0C2FEC97 2024-08-20T22:19:24.7319100Z alias: pci:v000010DEd*sv*sd*bc06sc80i00* 2024-08-20T22:19:24.7319607Z alias: pci:v000010DEd*sv*sd*bc03sc02i00* 2024-08-20T22:19:24.7320114Z alias: pci:v000010DEd*sv*sd*bc03sc00i00* 2024-08-20T22:19:24.7320620Z depends: i2c-core,drm 2024-08-20T22:19:24.7320991Z retpoline: Y 2024-08-20T22:19:24.7321304Z name: nvidia 2024-08-20T22:19:24.7321929Z vermagic: 6.1.94-99.176.amzn2023.x86_64 SMP preempt mod_unload modversions 2024-08-20T22:19:24.7322648Z parm: NvSwitchRegDwords:NvSwitch regkey (charp) 2024-08-20T22:19:24.7323308Z parm: NvSwitchBlacklist:NvSwitchBlacklist=uuid[,uuid...] (charp) 2024-08-20T22:19:24.7323918Z parm: NVreg_ResmanDebugLevel:int 2024-08-20T22:19:24.7324376Z parm: NVreg_RmLogonRC:int 2024-08-20T22:19:24.7324826Z parm: NVreg_ModifyDeviceFiles:int 2024-08-20T22:19:24.7325292Z parm: NVreg_DeviceFileUID:int 2024-08-20T22:19:24.7325737Z parm: NVreg_DeviceFileGID:int 2024-08-20T22:19:24.7326187Z parm: NVreg_DeviceFileMode:int 2024-08-20T22:19:24.7326724Z parm: NVreg_InitializeSystemMemoryAllocations:int 2024-08-20T22:19:24.7327291Z parm: NVreg_UsePageAttributeTable:int 2024-08-20T22:19:24.7327792Z parm: NVreg_EnablePCIeGen3:int 2024-08-20T22:19:24.7328238Z parm: NVreg_EnableMSI:int 2024-08-20T22:19:24.7328669Z parm: NVreg_TCEBypassMode:int 2024-08-20T22:19:24.7329137Z parm: NVreg_EnableStreamMemOPs:int 2024-08-20T22:19:24.7329680Z parm: NVreg_RestrictProfilingToAdminUsers:int 2024-08-20T22:19:24.7330392Z parm: NVreg_PreserveVideoMemoryAllocations:int 2024-08-20T22:19:24.7330974Z parm: NVreg_EnableS0ixPowerManagement:int 2024-08-20T22:19:24.7331593Z parm: NVreg_S0ixPowerManagementVideoMemoryThreshold:int 2024-08-20T22:19:24.7332205Z parm: NVreg_DynamicPowerManagement:int 2024-08-20T22:19:24.7332835Z parm: NVreg_DynamicPowerManagementVideoMemoryThreshold:int 2024-08-20T22:19:24.7333442Z parm: NVreg_EnableGpuFirmware:int 2024-08-20T22:19:24.7333938Z parm: NVreg_EnableGpuFirmwareLogs:int 2024-08-20T22:19:24.7334484Z parm: NVreg_OpenRmEnableUnsupportedGpus:int 2024-08-20T22:19:24.7335095Z parm: NVreg_EnableUserNUMAManagement:int 2024-08-20T22:19:24.7335603Z parm: NVreg_MemoryPoolSize:int 2024-08-20T22:19:24.7336085Z parm: NVreg_KMallocHeapMaxSize:int 2024-08-20T22:19:24.7336585Z parm: NVreg_VMallocHeapMaxSize:int 2024-08-20T22:19:24.7337071Z parm: NVreg_IgnoreMMIOCheck:int 2024-08-20T22:19:24.7337534Z parm: NVreg_NvLinkDisable:int 2024-08-20T22:19:24.7338046Z parm: NVreg_EnablePCIERelaxedOrderingMode:int 2024-08-20T22:19:24.7338583Z parm: NVreg_RegisterPCIDriver:int 2024-08-20T22:19:24.7339071Z parm: NVreg_EnableResizableBar:int 2024-08-20T22:19:24.7339653Z parm: NVreg_EnableDbgBreakpoint:int 2024-08-20T22:19:24.7340162Z parm: NVreg_EnableNonblockingOpen:int 2024-08-20T22:19:24.7340655Z parm: NVreg_RegistryDwords:charp 2024-08-20T22:19:24.7341164Z parm: NVreg_RegistryDwordsPerDevice:charp 2024-08-20T22:19:24.7341648Z parm: NVreg_RmMsg:charp 2024-08-20T22:19:24.7342072Z parm: NVreg_GpuBlacklist:charp 2024-08-20T22:19:24.7342552Z parm: NVreg_TemporaryFilePath:charp 2024-08-20T22:19:24.7343029Z parm: NVreg_ExcludedGpus:charp 2024-08-20T22:19:24.7343489Z parm: NVreg_DmaRemapPeerMmio:int 2024-08-20T22:19:24.7343976Z parm: NVreg_RmNvlinkBandwidth:charp 2024-08-20T22:19:24.7344467Z parm: NVreg_ImexChannelCount:int 2024-08-20T22:19:24.7344927Z parm: rm_firmware_active:charp 2024-08-20T22:19:24.7345344Z + set +e 2024-08-20T22:19:24.7345661Z + nvidia-smi 2024-08-20T22:19:24.7523894Z Tue Aug 20 22:19:24 2024 2024-08-20T22:19:24.7524707Z +-----------------------------------------------------------------------------------------+ 2024-08-20T22:19:24.7525821Z | NVIDIA-SMI 550.54.15 Driver Version: 550.54.15 CUDA Version: 12.4 | 2024-08-20T22:19:24.7526641Z |-----------------------------------------+------------------------+----------------------+ 2024-08-20T22:19:24.7527438Z | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | 2024-08-20T22:19:24.7528349Z | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | 2024-08-20T22:19:24.7529051Z | | | MIG M. | 2024-08-20T22:19:24.7529614Z |=========================================+========================+======================| 2024-08-20T22:19:24.7755843Z | 0 NVIDIA A10G On | 00000000:00:1E.0 Off | 0 | 2024-08-20T22:19:24.7756804Z | 0% 26C P8 15W / 300W | 0MiB / 23028MiB | 0% Default | 2024-08-20T22:19:24.7757466Z | | | N/A | 2024-08-20T22:19:24.7758166Z +-----------------------------------------+------------------------+----------------------+ 2024-08-20T22:19:24.7760971Z 2024-08-20T22:19:24.7761900Z +-----------------------------------------------------------------------------------------+ 2024-08-20T22:19:24.7762676Z | Processes: | 2024-08-20T22:19:24.7763579Z | GPU GI CI PID Type Process name GPU Memory | 2024-08-20T22:19:24.7764283Z | ID ID Usage | 2024-08-20T22:19:24.7764848Z |=========================================================================================| 2024-08-20T22:19:24.7766359Z | No running processes found | 2024-08-20T22:19:24.7767361Z +-----------------------------------------------------------------------------------------+ 2024-08-20T22:19:25.0600522Z + nvidia-smi --query-gpu=gpu_name --format=csv,noheader --id=0 2024-08-20T22:19:25.0789452Z NVIDIA A10G 2024-08-20T22:19:25.0852986Z + NVIDIA_SMI_STATUS=0 2024-08-20T22:19:25.0853536Z + '[' 0 -eq 0 ']' 2024-08-20T22:19:25.0854085Z + echo 'INFO: Ignoring allowed status 0' 2024-08-20T22:19:25.0854522Z + set -e 2024-08-20T22:19:25.0854808Z INFO: Ignoring allowed status 0 2024-08-20T22:19:25.0863659Z == Installing nvidia container toolkit for amzn2023 == 2024-08-20T22:19:25.0867460Z + sudo yum install -y yum-utils 2024-08-20T22:19:25.5320493Z Last metadata expiration check: 1:38:19 ago on Tue Aug 20 20:41:06 2024. 2024-08-20T22:19:25.5540175Z Package dnf-utils-4.3.0-13.amzn2023.0.4.noarch is already installed. 2024-08-20T22:19:25.5842595Z Dependencies resolved. 2024-08-20T22:19:25.5966377Z Nothing to do. 2024-08-20T22:19:25.5966688Z Complete! 2024-08-20T22:19:25.6827641Z + [[ amzn2023 == \a\m\z\n\2\0\2\3 ]] 2024-08-20T22:19:25.6828954Z + YUM_REPO_URL=https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo 2024-08-20T22:19:25.6830539Z + sudo yum-config-manager --add-repo https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo 2024-08-20T22:19:25.9513927Z Adding repo from: https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo 2024-08-20T22:19:26.0285718Z + sudo yum install -y nvidia-docker2 2024-08-20T22:19:26.5048802Z nvidia-container-toolkit 10 kB/s | 833 B 00:00 2024-08-20T22:19:26.5268772Z Package nvidia-docker2-2.14.0-1.noarch is already installed. 2024-08-20T22:19:26.5566550Z Dependencies resolved. 2024-08-20T22:19:26.5692382Z Nothing to do. 2024-08-20T22:19:26.5692705Z Complete! 2024-08-20T22:19:26.6774218Z + sudo systemctl restart docker 2024-08-20T22:20:26.3720767Z nvidia-persistenced failed to initialize. Check syslog for more details. 2024-08-20T22:20:26.3949596Z Tue Aug 20 22:20:26 2024 2024-08-20T22:20:26.3950422Z +-----------------------------------------------------------------------------------------+ 2024-08-20T22:20:26.3951275Z | NVIDIA-SMI 550.54.15 Driver Version: 550.54.15 CUDA Version: 12.4 | 2024-08-20T22:20:26.3952080Z |-----------------------------------------+------------------------+----------------------+ 2024-08-20T22:20:26.3952893Z | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | 2024-08-20T22:20:26.3953827Z | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | 2024-08-20T22:20:26.3954515Z | | | MIG M. | 2024-08-20T22:20:26.3955068Z |=========================================+========================+======================| 2024-08-20T22:20:26.4167229Z | 0 NVIDIA A10G On | 00000000:00:1E.0 Off | 0 | 2024-08-20T22:20:26.4168001Z | 0% 26C P8 15W / 300W | 0MiB / 23028MiB | 0% Default | 2024-08-20T22:20:26.4168640Z | | | N/A | 2024-08-20T22:20:26.4169443Z +-----------------------------------------+------------------------+----------------------+ 2024-08-20T22:20:26.4171980Z 2024-08-20T22:20:26.4172679Z +-----------------------------------------------------------------------------------------+ 2024-08-20T22:20:26.4173720Z | Processes: | 2024-08-20T22:20:26.4174427Z | GPU GI CI PID Type Process name GPU Memory | 2024-08-20T22:20:26.4175115Z | ID ID Usage | 2024-08-20T22:20:26.4175696Z |=========================================================================================| 2024-08-20T22:20:26.4177490Z | No running processes found | 2024-08-20T22:20:26.4178272Z +-----------------------------------------------------------------------------------------+ 2024-08-20T22:20:27.1409993Z Command completed after 1 attempt(s). 2024-08-20T22:20:27.1492098Z ##[group]Run python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84 2024-08-20T22:20:27.1492867Z python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84 2024-08-20T22:20:27.1493553Z python3 -m tools.stats.monitor > usage_log.txt 2>&1 & 2024-08-20T22:20:27.1494207Z echo "monitor-script-pid=${!}" >> "${GITHUB_OUTPUT}" 2024-08-20T22:20:27.1508671Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:20:27.1509188Z env: 2024-08-20T22:20:27.1509649Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:20:27.1510108Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:20:27.1510588Z ##[endgroup] 2024-08-20T22:20:27.3976260Z Defaulting to user installation because normal site-packages is not writeable 2024-08-20T22:20:27.4161634Z Requirement already satisfied: psutil==5.9.1 in /home/ec2-user/.local/lib/python3.9/site-packages (5.9.1) 2024-08-20T22:20:27.4166741Z Requirement already satisfied: nvidia-ml-py==11.525.84 in /home/ec2-user/.local/lib/python3.9/site-packages (11.525.84) 2024-08-20T22:20:27.5406622Z Prepare all required actions 2024-08-20T22:20:27.5407197Z Getting action download info 2024-08-20T22:20:27.7644235Z Download action repository 'seemethere/download-artifact-s3@v4' (SHA:1da556a7aa0a088e3153970611f6c432d58e80e6) 2024-08-20T22:20:27.9962796Z Download action repository 'actions/download-artifact@v3' (SHA:9bc31d5ccc31df68ecc42ccf4149144866c47d8a) 2024-08-20T22:20:28.1409072Z ##[group]Run ./.github/actions/download-build-artifacts 2024-08-20T22:20:28.1409572Z with: 2024-08-20T22:20:28.1409905Z name: linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-08-20T22:20:28.1410361Z s3-bucket: gha-artifacts 2024-08-20T22:20:28.1410699Z env: 2024-08-20T22:20:28.1410972Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:20:28.1411414Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:20:28.1411891Z ##[endgroup] 2024-08-20T22:20:28.1448163Z ##[group]Run seemethere/download-artifact-s3@v4 2024-08-20T22:20:28.1448614Z with: 2024-08-20T22:20:28.1448994Z name: linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-08-20T22:20:28.1449451Z s3-bucket: gha-artifacts 2024-08-20T22:20:28.1449816Z region: us-east-1 2024-08-20T22:20:28.1450117Z env: 2024-08-20T22:20:28.1450389Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:20:28.1450844Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:20:28.1451329Z ##[endgroup] 2024-08-20T22:20:28.6420064Z (node:102543) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2024-08-20T22:20:28.6420771Z 2024-08-20T22:20:28.6421033Z Please migrate your code to use AWS SDK for JavaScript (v3). 2024-08-20T22:20:28.6421811Z For more information, check the migration guide at https://a.co/7PzMCcy 2024-08-20T22:20:28.6422691Z (Use `node --trace-warnings ...` to show where the warning was created) 2024-08-20T22:20:28.7224993Z Found 1 objects with prefix pytorch/pytorch/10479310725/linux-focal-cuda12.1-py3.10-gcc9-sm86/ 2024-08-20T22:20:28.7227148Z Starting download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2024-08-20T22:20:36.2484096Z Finished download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2024-08-20T22:20:36.2489542Z Artifact download has finished successfully 2024-08-20T22:20:36.2846476Z ##[group]Run unzip -o artifacts.zip 2024-08-20T22:20:36.2846940Z unzip -o artifacts.zip 2024-08-20T22:20:36.2855872Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:20:36.2856386Z env: 2024-08-20T22:20:36.2856657Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:20:36.2857108Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:20:36.2857595Z ##[endgroup] 2024-08-20T22:20:36.2910694Z Archive: artifacts.zip 2024-08-20T22:20:36.2913031Z creating: dist/ 2024-08-20T22:20:38.4379587Z inflating: dist/torch-2.5.0a0+git40ec5f6-cp310-cp310-linux_x86_64.whl 2024-08-20T22:20:38.4380990Z creating: build/custom_test_artifacts/ 2024-08-20T22:20:38.4382180Z creating: build/custom_test_artifacts/custom-op-build/ 2024-08-20T22:20:38.4383617Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/ 2024-08-20T22:20:38.4384746Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/pkgRedirects/ 2024-08-20T22:20:38.4387634Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeConfigureLog.yaml 2024-08-20T22:20:38.4388584Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/ 2024-08-20T22:20:38.4389797Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-08-20T22:20:38.4390796Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-08-20T22:20:38.4391773Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-08-20T22:20:38.4392991Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-08-20T22:20:38.4394597Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-08-20T22:20:38.4395771Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-08-20T22:20:38.4396786Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-08-20T22:20:38.4398323Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-08-20T22:20:38.4399936Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-08-20T22:20:38.4401767Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-08-20T22:20:38.4403113Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-08-20T22:20:38.4404612Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-08-20T22:20:38.4406103Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-08-20T22:20:38.4407187Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/ 2024-08-20T22:20:38.4408299Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/ 2024-08-20T22:20:38.4448353Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2024-08-20T22:20:38.4488119Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2024-08-20T22:20:38.4489576Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2024-08-20T22:20:38.4535362Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2024-08-20T22:20:38.4536799Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2024-08-20T22:20:38.4538250Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2024-08-20T22:20:38.4539728Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2024-08-20T22:20:38.4541143Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2024-08-20T22:20:38.4542557Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2024-08-20T22:20:38.4543960Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2024-08-20T22:20:38.4545508Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2024-08-20T22:20:38.4547210Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2024-08-20T22:20:38.4548499Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2024-08-20T22:20:38.4549744Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c 2024-08-20T22:20:38.4550970Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin 2024-08-20T22:20:38.4552417Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2024-08-20T22:20:38.4553617Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o 2024-08-20T22:20:38.4554827Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu 2024-08-20T22:20:38.4612265Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out 2024-08-20T22:20:38.4673022Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin 2024-08-20T22:20:38.4674342Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake 2024-08-20T22:20:38.4675347Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeScratch/ 2024-08-20T22:20:38.4676216Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeTmp/ 2024-08-20T22:20:38.4677122Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/cmake.check_cache 2024-08-20T22:20:38.4678052Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/ 2024-08-20T22:20:38.4679184Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.ts 2024-08-20T22:20:38.4680342Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.make 2024-08-20T22:20:38.4681450Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/depend.make 2024-08-20T22:20:38.4682478Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/link.txt 2024-08-20T22:20:38.4683554Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/cmake_clean.cmake 2024-08-20T22:20:38.4684681Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/build.make 2024-08-20T22:20:38.4685758Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/DependInfo.cmake 2024-08-20T22:20:38.4686834Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/flags.make 2024-08-20T22:20:38.4687889Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/progress.make 2024-08-20T22:20:38.4706223Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o.d 2024-08-20T22:20:38.4850880Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o 2024-08-20T22:20:38.4852859Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/ 2024-08-20T22:20:38.4854881Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.ts 2024-08-20T22:20:38.4856083Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.make 2024-08-20T22:20:38.4857259Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/depend.make 2024-08-20T22:20:38.4858346Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/link.txt 2024-08-20T22:20:38.4859470Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/cmake_clean.cmake 2024-08-20T22:20:38.4860609Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/build.make 2024-08-20T22:20:38.4861741Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/DependInfo.cmake 2024-08-20T22:20:38.4862878Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/flags.make 2024-08-20T22:20:38.4864003Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/progress.make 2024-08-20T22:20:38.4879926Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o.d 2024-08-20T22:20:38.4964323Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o 2024-08-20T22:20:38.4965550Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-08-20T22:20:38.4966639Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/TargetDirectories.txt 2024-08-20T22:20:38.4967765Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/progress.marks 2024-08-20T22:20:38.4968688Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile2 2024-08-20T22:20:38.4969593Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile.cmake 2024-08-20T22:20:38.4970495Z inflating: build/custom_test_artifacts/custom-op-build/detect_cuda_version.cc 2024-08-20T22:20:38.4972929Z inflating: build/custom_test_artifacts/custom-op-build/CMakeCache.txt 2024-08-20T22:20:38.4973876Z inflating: build/custom_test_artifacts/custom-op-build/Makefile 2024-08-20T22:20:38.4974878Z inflating: build/custom_test_artifacts/custom-op-build/cmake_install.cmake 2024-08-20T22:20:38.5096714Z inflating: build/custom_test_artifacts/custom-op-build/libcustom_ops.so 2024-08-20T22:20:38.5159490Z inflating: build/custom_test_artifacts/custom-op-build/test_custom_ops 2024-08-20T22:20:38.5160232Z creating: build/custom_test_artifacts/jit-hook-build/ 2024-08-20T22:20:38.5160936Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/ 2024-08-20T22:20:38.5161751Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/pkgRedirects/ 2024-08-20T22:20:38.5168232Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeConfigureLog.yaml 2024-08-20T22:20:38.5169151Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/ 2024-08-20T22:20:38.5170079Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-08-20T22:20:38.5171061Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-08-20T22:20:38.5172019Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-08-20T22:20:38.5173223Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-08-20T22:20:38.5174706Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-08-20T22:20:38.5175705Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-08-20T22:20:38.5176692Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-08-20T22:20:38.5178311Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-08-20T22:20:38.5179975Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-08-20T22:20:38.5182141Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-08-20T22:20:38.5183276Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-08-20T22:20:38.5184666Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-08-20T22:20:38.5185990Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-08-20T22:20:38.5187025Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/ 2024-08-20T22:20:38.5188013Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/ 2024-08-20T22:20:38.5228497Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2024-08-20T22:20:38.5269202Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2024-08-20T22:20:38.5270830Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2024-08-20T22:20:38.5317642Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2024-08-20T22:20:38.5319509Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2024-08-20T22:20:38.5321437Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2024-08-20T22:20:38.5323167Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2024-08-20T22:20:38.5324835Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2024-08-20T22:20:38.5326442Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2024-08-20T22:20:38.5328021Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2024-08-20T22:20:38.5329672Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2024-08-20T22:20:38.5331205Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2024-08-20T22:20:38.5332634Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2024-08-20T22:20:38.5333880Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c 2024-08-20T22:20:38.5335147Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin 2024-08-20T22:20:38.5336376Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2024-08-20T22:20:38.5337560Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o 2024-08-20T22:20:38.5338762Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu 2024-08-20T22:20:38.5394568Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out 2024-08-20T22:20:38.5455353Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin 2024-08-20T22:20:38.5456740Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake 2024-08-20T22:20:38.5457995Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeScratch/ 2024-08-20T22:20:38.5459017Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeTmp/ 2024-08-20T22:20:38.5459929Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/cmake.check_cache 2024-08-20T22:20:38.5460861Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/ 2024-08-20T22:20:38.5461919Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.ts 2024-08-20T22:20:38.5463106Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.make 2024-08-20T22:20:38.5466309Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/depend.make 2024-08-20T22:20:38.5467431Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/link.txt 2024-08-20T22:20:38.5468539Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/cmake_clean.cmake 2024-08-20T22:20:38.5469784Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/build.make 2024-08-20T22:20:38.5471107Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/DependInfo.cmake 2024-08-20T22:20:38.5472212Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/flags.make 2024-08-20T22:20:38.5473427Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/progress.make 2024-08-20T22:20:38.5495092Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o.d 2024-08-20T22:20:38.5560201Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o 2024-08-20T22:20:38.5561538Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-08-20T22:20:38.5562958Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/TargetDirectories.txt 2024-08-20T22:20:38.5564018Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/progress.marks 2024-08-20T22:20:38.5565012Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile2 2024-08-20T22:20:38.5566466Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile.cmake 2024-08-20T22:20:38.5567553Z inflating: build/custom_test_artifacts/jit-hook-build/detect_cuda_version.cc 2024-08-20T22:20:38.5570721Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeCache.txt 2024-08-20T22:20:38.5571646Z inflating: build/custom_test_artifacts/jit-hook-build/Makefile 2024-08-20T22:20:38.5572747Z inflating: build/custom_test_artifacts/jit-hook-build/cmake_install.cmake 2024-08-20T22:20:38.5623129Z inflating: build/custom_test_artifacts/jit-hook-build/test_jit_hooks 2024-08-20T22:20:38.5623903Z creating: build/custom_test_artifacts/custom-backend-build/ 2024-08-20T22:20:38.5624664Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/ 2024-08-20T22:20:38.5625553Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/pkgRedirects/ 2024-08-20T22:20:38.5632472Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeConfigureLog.yaml 2024-08-20T22:20:38.5633457Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/ 2024-08-20T22:20:38.5634464Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-08-20T22:20:38.5635514Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-08-20T22:20:38.5636542Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-08-20T22:20:38.5638071Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-08-20T22:20:38.5640416Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-08-20T22:20:38.5641496Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-08-20T22:20:38.5642549Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-08-20T22:20:38.5644445Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-08-20T22:20:38.5646939Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-08-20T22:20:38.5648830Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-08-20T22:20:38.5650379Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-08-20T22:20:38.5652184Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-08-20T22:20:38.5653754Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-08-20T22:20:38.5654875Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/ 2024-08-20T22:20:38.5656135Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/ 2024-08-20T22:20:38.5696476Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2024-08-20T22:20:38.5736243Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2024-08-20T22:20:38.5737934Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2024-08-20T22:20:38.5784401Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2024-08-20T22:20:38.5785882Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2024-08-20T22:20:38.5787389Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2024-08-20T22:20:38.5788932Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2024-08-20T22:20:38.5790411Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2024-08-20T22:20:38.5791871Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2024-08-20T22:20:38.5793334Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2024-08-20T22:20:38.5794781Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2024-08-20T22:20:38.5796201Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2024-08-20T22:20:38.5797551Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2024-08-20T22:20:38.5798973Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c 2024-08-20T22:20:38.5800254Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin 2024-08-20T22:20:38.5801541Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2024-08-20T22:20:38.5802797Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o 2024-08-20T22:20:38.5804074Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu 2024-08-20T22:20:38.5863858Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out 2024-08-20T22:20:38.5924547Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin 2024-08-20T22:20:38.5925803Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake 2024-08-20T22:20:38.5926854Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeScratch/ 2024-08-20T22:20:38.5927787Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeTmp/ 2024-08-20T22:20:38.5928769Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/cmake.check_cache 2024-08-20T22:20:38.5929783Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/ 2024-08-20T22:20:38.5931007Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.ts 2024-08-20T22:20:38.5932279Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.make 2024-08-20T22:20:38.5933685Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/depend.make 2024-08-20T22:20:38.5934835Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/link.txt 2024-08-20T22:20:38.5936012Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/cmake_clean.cmake 2024-08-20T22:20:38.5937332Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/build.make 2024-08-20T22:20:38.5938525Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/DependInfo.cmake 2024-08-20T22:20:38.5939704Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/flags.make 2024-08-20T22:20:38.5940875Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/progress.make 2024-08-20T22:20:38.5943600Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o.d 2024-08-20T22:20:38.6070186Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o 2024-08-20T22:20:38.6071352Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/ 2024-08-20T22:20:38.6072540Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.ts 2024-08-20T22:20:38.6073857Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.make 2024-08-20T22:20:38.6075169Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/depend.make 2024-08-20T22:20:38.6076367Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/link.txt 2024-08-20T22:20:38.6077593Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/cmake_clean.cmake 2024-08-20T22:20:38.6078925Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/build.make 2024-08-20T22:20:38.6080169Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/DependInfo.cmake 2024-08-20T22:20:38.6081410Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/flags.make 2024-08-20T22:20:38.6082634Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/progress.make 2024-08-20T22:20:38.6102444Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o.d 2024-08-20T22:20:38.6158535Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o 2024-08-20T22:20:38.6159837Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-08-20T22:20:38.6160993Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/TargetDirectories.txt 2024-08-20T22:20:38.6162035Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/progress.marks 2024-08-20T22:20:38.6162999Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile2 2024-08-20T22:20:38.6164689Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile.cmake 2024-08-20T22:20:38.6165912Z inflating: build/custom_test_artifacts/custom-backend-build/detect_cuda_version.cc 2024-08-20T22:20:38.6168860Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeCache.txt 2024-08-20T22:20:38.6170113Z inflating: build/custom_test_artifacts/custom-backend-build/Makefile 2024-08-20T22:20:38.6171206Z inflating: build/custom_test_artifacts/custom-backend-build/cmake_install.cmake 2024-08-20T22:20:38.6274856Z inflating: build/custom_test_artifacts/custom-backend-build/libcustom_backend.so 2024-08-20T22:20:38.6318079Z inflating: build/custom_test_artifacts/custom-backend-build/test_custom_backend 2024-08-20T22:20:38.6318756Z creating: build/lib/ 2024-08-20T22:20:38.6408051Z inflating: build/lib/libprotobuf-lite.a 2024-08-20T22:20:38.6866492Z inflating: build/lib/libprotobuf.a 2024-08-20T22:20:38.6875849Z inflating: build/lib/libpthreadpool.a 2024-08-20T22:20:38.6884455Z inflating: build/lib/libcpuinfo.a 2024-08-20T22:20:38.6893020Z inflating: build/lib/libcpuinfo_internals.a 2024-08-20T22:20:38.6893973Z inflating: build/lib/libclog.a 2024-08-20T22:20:38.6912635Z inflating: build/lib/libnnpack.a 2024-08-20T22:20:38.6915633Z inflating: build/lib/libnnpack_reference_layers.a 2024-08-20T22:20:38.6981710Z inflating: build/lib/libgtest.a 2024-08-20T22:20:38.7057272Z inflating: build/lib/libbenchmark.a 2024-08-20T22:20:38.7121240Z inflating: build/lib/libasmjit.a 2024-08-20T22:20:38.7129191Z inflating: build/lib/libittnotify.a 2024-08-20T22:20:38.7157836Z inflating: build/lib/libtensorpipe_uv.a 2024-08-20T22:20:38.7285215Z inflating: build/lib/libgloo.a 2024-08-20T22:20:38.7306115Z inflating: build/lib/libfmt.a 2024-08-20T22:20:38.7401434Z inflating: build/lib/libc10.so 2024-08-20T22:20:38.7403440Z inflating: build/lib/libcaffe2_nvrtc.so 2024-08-20T22:20:38.7405224Z inflating: build/lib/libtorch_global_deps.so 2024-08-20T22:20:38.7424819Z inflating: build/lib/libpytorch_qnnpack.a 2024-08-20T22:20:38.7928553Z inflating: build/lib/libprotoc.a 2024-08-20T22:20:38.7947001Z inflating: build/lib/libgmock.a 2024-08-20T22:20:38.7947994Z inflating: build/lib/libgtest_main.a 2024-08-20T22:20:38.7949111Z inflating: build/lib/libbenchmark_main.a 2024-08-20T22:20:38.8338409Z inflating: build/lib/libgloo_cuda.a 2024-08-20T22:20:39.8508872Z inflating: build/lib/libdnnl.a 2024-08-20T22:20:39.9083148Z inflating: build/lib/libtensorpipe.a 2024-08-20T22:20:39.9139898Z inflating: build/lib/libc10_cuda.so 2024-08-20T22:20:39.9140603Z inflating: build/lib/libgmock_main.a 2024-08-20T22:20:40.0398311Z inflating: build/lib/libfbgemm.a 2024-08-20T22:20:40.0654141Z inflating: build/lib/libtensorpipe_cuda.a 2024-08-20T22:20:40.1160891Z inflating: build/lib/libkineto.a 2024-08-20T22:20:40.1344695Z inflating: build/lib/libXNNPACK.a 2024-08-20T22:20:40.1388181Z inflating: build/lib/libonnx_proto.a 2024-08-20T22:20:40.2080477Z inflating: build/lib/libonnx.a 2024-08-20T22:20:42.6521952Z inflating: build/lib/libtorch_cpu.so 2024-08-20T22:20:42.6526985Z inflating: build/lib/libunbox_lib.a 2024-08-20T22:20:42.6531647Z inflating: build/lib/libshm.so 2024-08-20T22:20:44.7177705Z inflating: build/lib/libtorch_cuda.so 2024-08-20T22:20:44.7179379Z inflating: build/lib/libtorch.so 2024-08-20T22:20:44.7182210Z inflating: build/lib/libc10d_cuda_test.so 2024-08-20T22:20:45.5370557Z inflating: build/lib/libtorch_cuda_linalg.so 2024-08-20T22:20:45.7364096Z inflating: build/lib/libtorch_python.so 2024-08-20T22:20:45.7436648Z inflating: build/lib/libtorchbind_test.so 2024-08-20T22:20:45.7457829Z inflating: build/lib/libjitbackend_test.so 2024-08-20T22:20:45.7484359Z inflating: build/lib/libaoti_custom_ops.so 2024-08-20T22:20:45.7510673Z inflating: build/lib/libbackend_with_compiler.so 2024-08-20T22:20:45.7545751Z inflating: build/lib/libnnapi_backend.so 2024-08-20T22:20:45.7546951Z creating: build/bin/ 2024-08-20T22:20:45.7596749Z inflating: build/bin/c10_CompileTimeFunctionPointer_test 2024-08-20T22:20:45.7649159Z inflating: build/bin/c10_DeviceGuard_test 2024-08-20T22:20:45.7700653Z inflating: build/bin/c10_Device_test 2024-08-20T22:20:45.7760668Z inflating: build/bin/c10_DispatchKeySet_test 2024-08-20T22:20:45.7814201Z inflating: build/bin/c10_Scalar_test 2024-08-20T22:20:45.7863717Z inflating: build/bin/c10_StreamGuard_test 2024-08-20T22:20:45.7916670Z inflating: build/bin/c10_SymInt_test 2024-08-20T22:20:45.7971383Z inflating: build/bin/c10_InlineDeviceGuard_test 2024-08-20T22:20:45.8027652Z inflating: build/bin/c10_InlineStreamGuard_test 2024-08-20T22:20:45.8084640Z inflating: build/bin/c10_SizesAndStrides_test 2024-08-20T22:20:45.8156433Z inflating: build/bin/c10_cow_test 2024-08-20T22:20:45.8209764Z inflating: build/bin/c10_Bitset_test 2024-08-20T22:20:45.8259289Z inflating: build/bin/c10_ConstexprCrc_test 2024-08-20T22:20:45.8309830Z inflating: build/bin/c10_DeadlockDetection_test 2024-08-20T22:20:45.8361190Z inflating: build/bin/c10_Half_test 2024-08-20T22:20:45.8418273Z inflating: build/bin/c10_LeftRight_test 2024-08-20T22:20:45.8473657Z inflating: build/bin/c10_Metaprogramming_test 2024-08-20T22:20:45.8524833Z inflating: build/bin/c10_Synchronized_test 2024-08-20T22:20:45.8580683Z inflating: build/bin/c10_ThreadLocal_test 2024-08-20T22:20:45.8632703Z inflating: build/bin/c10_TypeIndex_test 2024-08-20T22:20:45.8684667Z inflating: build/bin/c10_TypeList_test 2024-08-20T22:20:45.8734002Z inflating: build/bin/c10_TypeTraits_test 2024-08-20T22:20:45.8786804Z inflating: build/bin/c10_accumulate_test 2024-08-20T22:20:45.8842255Z inflating: build/bin/c10_bfloat16_test 2024-08-20T22:20:45.8893369Z inflating: build/bin/c10_bit_cast_test 2024-08-20T22:20:45.8950571Z inflating: build/bin/c10_complex_math_test 2024-08-20T22:20:45.9007095Z inflating: build/bin/c10_complex_test 2024-08-20T22:20:45.9060294Z inflating: build/bin/c10_exception_test 2024-08-20T22:20:45.9111243Z inflating: build/bin/c10_flags_test 2024-08-20T22:20:45.9162088Z inflating: build/bin/c10_generic_math_test 2024-08-20T22:20:45.9327534Z inflating: build/bin/c10_intrusive_ptr_test 2024-08-20T22:20:45.9379524Z inflating: build/bin/c10_irange_test 2024-08-20T22:20:45.9433212Z inflating: build/bin/c10_lazy_test 2024-08-20T22:20:45.9491127Z inflating: build/bin/c10_logging_test 2024-08-20T22:20:45.9553999Z inflating: build/bin/c10_ordered_preserving_dict_test 2024-08-20T22:20:45.9629928Z inflating: build/bin/c10_optional_test 2024-08-20T22:20:45.9781923Z inflating: build/bin/c10_small_vector_test 2024-08-20T22:20:45.9836429Z inflating: build/bin/c10_registry_test 2024-08-20T22:20:45.9888611Z inflating: build/bin/c10_ssize_test 2024-08-20T22:20:45.9941316Z inflating: build/bin/c10_string_util_test 2024-08-20T22:20:45.9992085Z inflating: build/bin/c10_tempfile_test 2024-08-20T22:20:46.0051843Z inflating: build/bin/c10_string_view_test 2024-08-20T22:20:46.0100659Z inflating: build/bin/c10_intrusive_ptr_benchmark 2024-08-20T22:20:46.0157576Z inflating: build/bin/c10_typeid_test 2024-08-20T22:20:46.0604828Z inflating: build/bin/protoc-3.13.0.0 2024-08-20T22:20:46.1051578Z inflating: build/bin/protoc 2024-08-20T22:20:46.1104734Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_1_var_test 2024-08-20T22:20:46.1158480Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_catches_stream 2024-08-20T22:20:46.1211862Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_catches_thread_and_block_and_device 2024-08-20T22:20:46.1264431Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_from_2_processes 2024-08-20T22:20:46.1317764Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_blocks_and_threads 2024-08-20T22:20:46.1371158Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_multiple_blocks 2024-08-20T22:20:46.1420839Z inflating: build/bin/c10_cuda_CUDATest 2024-08-20T22:20:46.1474303Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_same_block 2024-08-20T22:20:46.1806190Z inflating: build/bin/vec_test_all_types_DEFAULT 2024-08-20T22:20:46.2151796Z inflating: build/bin/vec_test_all_types_AVX512 2024-08-20T22:20:46.2511643Z inflating: build/bin/vec_test_all_types_AVX2 2024-08-20T22:20:46.2565085Z inflating: build/bin/BackoffTest 2024-08-20T22:20:46.2618657Z inflating: build/bin/FileStoreTest 2024-08-20T22:20:46.2675516Z inflating: build/bin/TCPStoreTest 2024-08-20T22:20:46.2728911Z inflating: build/bin/HashStoreTest 2024-08-20T22:20:46.2742863Z inflating: build/bin/ProcessGroupMPITest 2024-08-20T22:20:46.2797407Z inflating: build/bin/test_edge_op_registration 2024-08-20T22:20:46.2802148Z inflating: build/bin/torch_shm_manager 2024-08-20T22:20:46.2805474Z inflating: build/bin/example_allreduce 2024-08-20T22:20:46.2861323Z inflating: build/bin/test_dist_autograd 2024-08-20T22:20:46.2930526Z inflating: build/bin/test_cpp_rpc 2024-08-20T22:20:46.2933515Z inflating: build/bin/parallel_benchmark 2024-08-20T22:20:46.3001232Z inflating: build/bin/test_mobile_nnc 2024-08-20T22:20:46.3010642Z inflating: build/bin/aot_model_compiler_test 2024-08-20T22:20:46.3358389Z inflating: build/bin/test_lazy 2024-08-20T22:20:46.4541790Z inflating: build/bin/test_api 2024-08-20T22:20:46.4616655Z inflating: build/bin/Dict_test 2024-08-20T22:20:46.4669986Z inflating: build/bin/Dimname_test 2024-08-20T22:20:46.4734856Z inflating: build/bin/MaybeOwned_test 2024-08-20T22:20:46.4792914Z inflating: build/bin/NamedTensor_test 2024-08-20T22:20:46.4852665Z inflating: build/bin/apply_utils_test 2024-08-20T22:20:46.4912607Z inflating: build/bin/atest 2024-08-20T22:20:46.4976093Z inflating: build/bin/basic 2024-08-20T22:20:46.5031757Z inflating: build/bin/broadcast_test 2024-08-20T22:20:46.5082809Z inflating: build/bin/cpu_allocator_test 2024-08-20T22:20:46.5141450Z inflating: build/bin/cpu_generator_test 2024-08-20T22:20:46.5196343Z inflating: build/bin/cpu_profiling_allocator_test 2024-08-20T22:20:46.5289741Z inflating: build/bin/cpu_rng_test 2024-08-20T22:20:46.5340559Z inflating: build/bin/dispatch_key_set_test 2024-08-20T22:20:46.5392017Z inflating: build/bin/dlconvertor_test 2024-08-20T22:20:46.5450471Z inflating: build/bin/extension_backend_test 2024-08-20T22:20:46.5506479Z inflating: build/bin/half_test 2024-08-20T22:20:46.5602635Z inflating: build/bin/ivalue_test 2024-08-20T22:20:46.5652946Z inflating: build/bin/lazy_tensor_test 2024-08-20T22:20:46.5707809Z inflating: build/bin/math_kernel_test 2024-08-20T22:20:46.5762774Z inflating: build/bin/memory_format_test 2024-08-20T22:20:46.5816518Z inflating: build/bin/memory_overlapping_test 2024-08-20T22:20:46.5870757Z inflating: build/bin/mobile_memory_cleanup 2024-08-20T22:20:46.5926992Z inflating: build/bin/native_test 2024-08-20T22:20:46.5978283Z inflating: build/bin/operator_name_test 2024-08-20T22:20:46.6030421Z inflating: build/bin/operators_test 2024-08-20T22:20:46.6083602Z inflating: build/bin/packedtensoraccessor_test 2024-08-20T22:20:46.6151639Z inflating: build/bin/pow_test 2024-08-20T22:20:46.6208877Z inflating: build/bin/quantized_test 2024-08-20T22:20:46.6259671Z inflating: build/bin/reduce_ops_test 2024-08-20T22:20:46.6311363Z inflating: build/bin/reportMemoryUsage_test 2024-08-20T22:20:46.6368533Z inflating: build/bin/scalar_tensor_test 2024-08-20T22:20:46.6428161Z inflating: build/bin/scalar_test 2024-08-20T22:20:46.6480757Z inflating: build/bin/StorageUtils_test 2024-08-20T22:20:46.6533428Z inflating: build/bin/stride_properties_test 2024-08-20T22:20:46.6612975Z inflating: build/bin/tensor_iterator_test 2024-08-20T22:20:46.6667926Z inflating: build/bin/test_parallel 2024-08-20T22:20:46.6671837Z inflating: build/bin/thread_init_test 2024-08-20T22:20:46.6728483Z inflating: build/bin/type_ptr_test 2024-08-20T22:20:46.6789359Z inflating: build/bin/type_test 2024-08-20T22:20:46.6841590Z inflating: build/bin/undefined_tensor_test 2024-08-20T22:20:46.6843642Z inflating: build/bin/verify_api_visibility 2024-08-20T22:20:46.6914272Z inflating: build/bin/legacy_vmap_test 2024-08-20T22:20:46.6966517Z inflating: build/bin/weakref_test 2024-08-20T22:20:46.7019151Z inflating: build/bin/wrapdim_test 2024-08-20T22:20:46.7071342Z inflating: build/bin/xla_tensor_test 2024-08-20T22:20:46.7131925Z inflating: build/bin/IListRef_test 2024-08-20T22:20:46.7238971Z inflating: build/bin/List_test 2024-08-20T22:20:46.7306689Z inflating: build/bin/KernelFunction_test 2024-08-20T22:20:46.7429006Z inflating: build/bin/kernel_function_legacy_test 2024-08-20T22:20:46.7526571Z inflating: build/bin/kernel_function_test 2024-08-20T22:20:46.7655871Z inflating: build/bin/kernel_lambda_legacy_test 2024-08-20T22:20:46.7760252Z inflating: build/bin/kernel_lambda_test 2024-08-20T22:20:46.7822495Z inflating: build/bin/kernel_stackbased_test 2024-08-20T22:20:46.7919770Z inflating: build/bin/make_boxed_from_unboxed_functor_test 2024-08-20T22:20:46.7971201Z inflating: build/bin/CppSignature_test 2024-08-20T22:20:46.8027895Z inflating: build/bin/backend_fallback_test 2024-08-20T22:20:46.8077083Z inflating: build/bin/op_allowlist_test 2024-08-20T22:20:46.8381156Z inflating: build/bin/op_registration_test 2024-08-20T22:20:46.8444721Z inflating: build/bin/inline_container_test 2024-08-20T22:20:46.8498345Z inflating: build/bin/cuda_apply_test 2024-08-20T22:20:46.8551519Z inflating: build/bin/cuda_allocator_test 2024-08-20T22:20:46.8610602Z inflating: build/bin/cuda_atomic_ops_test 2024-08-20T22:20:46.8666714Z inflating: build/bin/cuda_caching_host_allocator_test 2024-08-20T22:20:46.8737337Z inflating: build/bin/cuda_complex_math_test 2024-08-20T22:20:46.8797269Z inflating: build/bin/cuda_complex_test 2024-08-20T22:20:46.8847825Z inflating: build/bin/cuda_device_test 2024-08-20T22:20:46.8905888Z inflating: build/bin/cuda_cub_test 2024-08-20T22:20:46.8957162Z inflating: build/bin/cuda_dlconvertor_test 2024-08-20T22:20:46.9023368Z inflating: build/bin/cuda_distributions_test 2024-08-20T22:20:46.9080697Z inflating: build/bin/cuda_generator_test 2024-08-20T22:20:46.9130323Z inflating: build/bin/cuda_half_test 2024-08-20T22:20:46.9183146Z inflating: build/bin/cuda_integer_divider_test 2024-08-20T22:20:46.9232345Z inflating: build/bin/cuda_optional_test 2024-08-20T22:20:46.9284967Z inflating: build/bin/cuda_packedtensoraccessor_test 2024-08-20T22:20:46.9338626Z inflating: build/bin/cuda_reportMemoryUsage_test 2024-08-20T22:20:46.9388820Z inflating: build/bin/cuda_allocatorTraceTracker_test 2024-08-20T22:20:46.9450279Z inflating: build/bin/cuda_stream_test 2024-08-20T22:20:46.9500531Z inflating: build/bin/cuda_cudnn_test 2024-08-20T22:20:46.9552971Z inflating: build/bin/cuda_vectorized_test 2024-08-20T22:20:46.9568005Z inflating: build/bin/tutorial_tensorexpr 2024-08-20T22:20:46.9633740Z inflating: build/bin/ProcessGroupGlooTest 2024-08-20T22:20:46.9692073Z inflating: build/bin/ProcessGroupGlooAsyncTest 2024-08-20T22:20:46.9756476Z inflating: build/bin/ProcessGroupNCCLTest 2024-08-20T22:20:46.9819196Z inflating: build/bin/ProcessGroupNCCLErrorsTest 2024-08-20T22:20:47.0649300Z inflating: build/bin/test_tensorexpr 2024-08-20T22:20:47.1231808Z inflating: build/bin/test_jit 2024-08-20T22:20:47.1232250Z creating: .additional_ci_files/ 2024-08-20T22:20:47.1294341Z inflating: .additional_ci_files/test-times.json 2024-08-20T22:20:47.1534459Z inflating: .additional_ci_files/test-class-times.json 2024-08-20T22:20:47.1582790Z ##[group]Run rm artifacts.zip 2024-08-20T22:20:47.1583334Z rm artifacts.zip 2024-08-20T22:20:47.1595016Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:20:47.1595752Z env: 2024-08-20T22:20:47.1596131Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:20:47.1596784Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:20:47.1597505Z ##[endgroup] 2024-08-20T22:20:47.2694243Z ##[group]Run df -H 2024-08-20T22:20:47.2694563Z df -H 2024-08-20T22:20:47.2703510Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:20:47.2704007Z env: 2024-08-20T22:20:47.2704467Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:20:47.2704930Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:20:47.2705411Z ##[endgroup] 2024-08-20T22:20:47.2753982Z Filesystem Size Used Avail Use% Mounted on 2024-08-20T22:20:47.2754570Z devtmpfs 4.2M 0 4.2M 0% /dev 2024-08-20T22:20:47.2755207Z tmpfs 34G 0 34G 0% /dev/shm 2024-08-20T22:20:47.2755803Z tmpfs 14G 553k 14G 1% /run 2024-08-20T22:20:47.2756267Z /dev/nvme0n1p1 161G 53G 109G 33% / 2024-08-20T22:20:47.2757293Z tmpfs 34G 8.2k 34G 1% /tmp 2024-08-20T22:20:47.2758001Z /dev/nvme0n1p128 11M 1.4M 9.2M 13% /boot/efi 2024-08-20T22:20:47.2758692Z tmpfs 6.7G 0 6.7G 0% /run/user/0 2024-08-20T22:20:47.2797202Z Prepare all required actions 2024-08-20T22:20:47.2797644Z Getting action download info 2024-08-20T22:20:47.3982732Z ##[group]Run ./.github/actions/download-td-artifacts 2024-08-20T22:20:47.3983191Z with: 2024-08-20T22:20:47.3983455Z env: 2024-08-20T22:20:47.3983734Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:20:47.3984180Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:20:47.3984664Z ##[endgroup] 2024-08-20T22:20:47.4017463Z ##[group]Run seemethere/download-artifact-s3@v4 2024-08-20T22:20:47.4017904Z with: 2024-08-20T22:20:47.4018164Z name: td_results 2024-08-20T22:20:47.4018478Z s3-bucket: gha-artifacts 2024-08-20T22:20:47.4018822Z region: us-east-1 2024-08-20T22:20:47.4019117Z env: 2024-08-20T22:20:47.4019380Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:20:47.4019827Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:20:47.4020309Z ##[endgroup] 2024-08-20T22:20:47.8843329Z (node:102563) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2024-08-20T22:20:47.8844107Z 2024-08-20T22:20:47.8844369Z Please migrate your code to use AWS SDK for JavaScript (v3). 2024-08-20T22:20:47.8845078Z For more information, check the migration guide at https://a.co/7PzMCcy 2024-08-20T22:20:47.8845957Z (Use `node --trace-warnings ...` to show where the warning was created) 2024-08-20T22:20:47.9397766Z Found 0 objects with prefix pytorch/pytorch/10479310725/td_results/ 2024-08-20T22:20:47.9403815Z Artifact download has finished successfully 2024-08-20T22:20:47.9728175Z ##[group]Run mkdir -p .additional_ci_files 2024-08-20T22:20:47.9728664Z mkdir -p .additional_ci_files 2024-08-20T22:20:47.9729230Z mv td_results.json .additional_ci_files/td_results.json 2024-08-20T22:20:47.9739270Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:20:47.9739766Z env: 2024-08-20T22:20:47.9740045Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:20:47.9740520Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:20:47.9741002Z ##[endgroup] 2024-08-20T22:20:47.9797426Z mv: cannot stat 'td_results.json': No such file or directory 2024-08-20T22:20:47.9810282Z ##[error]Process completed with exit code 1. 2024-08-20T22:20:47.9844870Z ##[group]Run .github/scripts/parse_ref.py 2024-08-20T22:20:47.9845349Z .github/scripts/parse_ref.py 2024-08-20T22:20:47.9854580Z shell: /usr/bin/bash -e {0} 2024-08-20T22:20:47.9854931Z env: 2024-08-20T22:20:47.9855205Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:20:47.9855655Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:20:47.9856133Z ##[endgroup] 2024-08-20T22:20:48.0137678Z Prepare all required actions 2024-08-20T22:20:48.0177068Z ##[group]Run ./.github/actions/get-workflow-job-id 2024-08-20T22:20:48.0177524Z with: 2024-08-20T22:20:48.0178079Z github-token: *** 2024-08-20T22:20:48.0178380Z env: 2024-08-20T22:20:48.0178659Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:20:48.0179117Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:20:48.0179604Z ##[endgroup] 2024-08-20T22:20:48.0196406Z ##[group]Run set -eux 2024-08-20T22:20:48.0196752Z set -eux 2024-08-20T22:20:48.0197366Z python3 .github/scripts/get_workflow_job_id.py "${GITHUB_RUN_ID}" "${RUNNER_NAME}" 2024-08-20T22:20:48.0206697Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:20:48.0207188Z env: 2024-08-20T22:20:48.0207463Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:20:48.0207911Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:20:48.0208546Z GITHUB_TOKEN: *** 2024-08-20T22:20:48.0208852Z ##[endgroup] 2024-08-20T22:20:48.0240321Z + python3 .github/scripts/get_workflow_job_id.py 10479310725 i-0743dc4f7ebf3bb79 2024-08-20T22:20:49.6294938Z setting job-id=29026530319 2024-08-20T22:20:49.6295811Z setting job-name=cuda12.1-py3.10-gcc9-sm86 / test (aot_inductor_timm, 2, 2, amz2023.linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:20:49.6513443Z Prepare all required actions 2024-08-20T22:20:49.6513887Z Getting action download info 2024-08-20T22:20:49.7695190Z ##[group]Run ./.github/actions/filter-test-configs 2024-08-20T22:20:49.7695646Z with: 2024-08-20T22:20:49.7696099Z github-token: *** 2024-08-20T22:20:49.7704988Z test-matrix: {"include": [{"config": "inductor", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_distributed", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.g5.12xlarge.nvidia.gpu"}, {"config": "inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_timm", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_timm", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_timm", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_timm", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_timm", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_timm", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_cpp_wrapper_abi_compatible", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}]} 2024-08-20T22:20:49.7714617Z job-name: cuda12.1-py3.10-gcc9-sm86 / test (aot_inductor_timm, 2, 2, amz2023.linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:20:49.7715353Z env: 2024-08-20T22:20:49.7715632Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:20:49.7716079Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:20:49.7716558Z ##[endgroup] 2024-08-20T22:20:49.7758943Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2024-08-20T22:20:49.7759494Z with: 2024-08-20T22:20:49.7759760Z shell: bash 2024-08-20T22:20:49.7760063Z timeout_minutes: 10 2024-08-20T22:20:49.7760382Z max_attempts: 5 2024-08-20T22:20:49.7760693Z retry_wait_seconds: 30 2024-08-20T22:20:49.7761819Z command: set -eux # PyYAML 6.0 doesn't work with MacOS x86 anymore # This must run on Python-3.7 (AmazonLinux2) so can't use request=3.32.2 python3 -m pip install requests==2.27.1 pyyaml==6.0.1 2024-08-20T22:20:49.7763182Z polling_interval_seconds: 1 2024-08-20T22:20:49.7763549Z warning_on_retry: true 2024-08-20T22:20:49.7763891Z continue_on_error: false 2024-08-20T22:20:49.7764229Z env: 2024-08-20T22:20:49.7764498Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:20:49.7764937Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:20:49.7765580Z GITHUB_TOKEN: *** 2024-08-20T22:20:49.7765894Z ##[endgroup] 2024-08-20T22:20:49.8523440Z + python3 -m pip install requests==2.27.1 pyyaml==6.0.1 2024-08-20T22:20:50.0903884Z Defaulting to user installation because normal site-packages is not writeable 2024-08-20T22:20:50.1084981Z Requirement already satisfied: requests==2.27.1 in /home/ec2-user/.local/lib/python3.9/site-packages (2.27.1) 2024-08-20T22:20:50.1087511Z Requirement already satisfied: pyyaml==6.0.1 in /home/ec2-user/.local/lib/python3.9/site-packages (6.0.1) 2024-08-20T22:20:50.1198164Z Requirement already satisfied: urllib3<1.27,>=1.21.1 in /usr/lib/python3.9/site-packages (from requests==2.27.1) (1.25.10) 2024-08-20T22:20:50.1207990Z Requirement already satisfied: idna<4,>=2.5 in /usr/lib/python3.9/site-packages (from requests==2.27.1) (2.10) 2024-08-20T22:20:50.1216512Z Requirement already satisfied: charset-normalizer~=2.0.0 in /home/ec2-user/.local/lib/python3.9/site-packages (from requests==2.27.1) (2.0.12) 2024-08-20T22:20:50.1221735Z Requirement already satisfied: certifi>=2017.4.17 in /home/ec2-user/.local/lib/python3.9/site-packages (from requests==2.27.1) (2024.7.4) 2024-08-20T22:20:50.8312207Z Command completed after 1 attempt(s). 2024-08-20T22:20:50.8374219Z ##[group]Run set -x 2024-08-20T22:20:50.8374550Z set -x 2024-08-20T22:20:50.8374860Z  2024-08-20T22:20:50.8375403Z # Use relative path here as this could be checked out anywhere, not necessarily 2024-08-20T22:20:50.8376082Z # in runner workspace 2024-08-20T22:20:50.8376606Z python3 "${GITHUB_ACTION_PATH}/../../scripts/parse_ref.py" 2024-08-20T22:20:50.8385794Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:20:50.8386294Z env: 2024-08-20T22:20:50.8386573Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:20:50.8387031Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:20:50.8387513Z ##[endgroup] 2024-08-20T22:20:50.8417876Z + python3 /home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/filter-test-configs/../../scripts/parse_ref.py 2024-08-20T22:20:50.8660898Z ##[group]Run echo "Workflow: ${GITHUB_WORKFLOW}" 2024-08-20T22:20:50.8661444Z echo "Workflow: ${GITHUB_WORKFLOW}" 2024-08-20T22:20:50.8661919Z echo "Job name: ${JOB_NAME}" 2024-08-20T22:20:50.8662335Z  2024-08-20T22:20:50.8662884Z # Use relative path here as this could be checked out anywhere, not necessarily 2024-08-20T22:20:50.8663562Z # in runner workspace 2024-08-20T22:20:50.8664140Z python3 "${GITHUB_ACTION_PATH}/../../scripts/filter_test_configs.py" \ 2024-08-20T22:20:50.8664787Z  --workflow "${GITHUB_WORKFLOW}" \ 2024-08-20T22:20:50.8665240Z  --job-name "${JOB_NAME}" \ 2024-08-20T22:20:50.8674554Z  --test-matrix "{"include": [{"config": "inductor", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_distributed", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.g5.12xlarge.nvidia.gpu"}, {"config": "inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_timm", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_timm", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_timm", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_timm", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_timm", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_timm", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_cpp_wrapper_abi_compatible", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}]}" \ 2024-08-20T22:20:50.8684231Z  --selected-test-configs "" \ 2024-08-20T22:20:50.8684688Z  --pr-number "${PR_NUMBER}" \ 2024-08-20T22:20:50.8685106Z  --tag "${TAG}" \ 2024-08-20T22:20:50.8685498Z  --event-name "${EVENT_NAME}" \ 2024-08-20T22:20:50.8685935Z  --schedule "${SCHEDULE}" \ 2024-08-20T22:20:50.8686366Z  --branch "${HEAD_BRANCH}" 2024-08-20T22:20:50.8695252Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:20:50.8695750Z env: 2024-08-20T22:20:50.8696031Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:20:50.8696490Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:20:50.8697186Z GITHUB_TOKEN: *** 2024-08-20T22:20:50.8697867Z JOB_NAME: cuda12.1-py3.10-gcc9-sm86 / test (aot_inductor_timm, 2, 2, amz2023.linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:20:50.8698606Z PR_NUMBER: 2024-08-20T22:20:50.8698910Z TAG: ciflow/inductor/133712 2024-08-20T22:20:50.8699272Z EVENT_NAME: push 2024-08-20T22:20:50.8699577Z SCHEDULE: 2024-08-20T22:20:50.8699856Z HEAD_BRANCH: 2024-08-20T22:20:50.8700148Z ##[endgroup] 2024-08-20T22:20:50.8730214Z Workflow: inductor 2024-08-20T22:20:50.8731180Z Job name: cuda12.1-py3.10-gcc9-sm86 / test (aot_inductor_timm, 2, 2, amz2023.linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:20:51.1385404Z INFO:root:Found no test-config label on the PR, so all test configs are included 2024-08-20T22:20:51.2747222Z ##[group]Run echo "Filtered matrix:" 2024-08-20T22:20:51.2747709Z echo "Filtered matrix:" 2024-08-20T22:20:51.2756878Z echo "{"include": [{"config": "inductor", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_distributed", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.g5.12xlarge.nvidia.gpu"}, {"config": "inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_timm", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_timm", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_timm", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_timm", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_timm", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_timm", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_cpp_wrapper_abi_compatible", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}]}" 2024-08-20T22:20:51.2766357Z  2024-08-20T22:20:51.2766629Z echo 2024-08-20T22:20:51.2767003Z echo "Is the current job unstable? False" 2024-08-20T22:20:51.2767449Z  2024-08-20T22:20:51.2767722Z echo 2024-08-20T22:20:51.2768077Z echo "Is keep-going label set? False" 2024-08-20T22:20:51.2768510Z  2024-08-20T22:20:51.2768770Z echo 2024-08-20T22:20:51.2769083Z echo "Renabled issues? " 2024-08-20T22:20:51.2778111Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:20:51.2778603Z env: 2024-08-20T22:20:51.2778883Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:20:51.2779348Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:20:51.2779828Z ##[endgroup] 2024-08-20T22:20:51.2808725Z Filtered matrix: 2024-08-20T22:20:51.2819984Z {include: [{config: inductor, shard: 1, num_shards: 2, runner: amz2023.linux.g5.4xlarge.nvidia.gpu}, {config: inductor, shard: 2, num_shards: 2, runner: amz2023.linux.g5.4xlarge.nvidia.gpu}, {config: inductor_distributed, shard: 1, num_shards: 1, runner: amz2023.linux.g5.12xlarge.nvidia.gpu}, {config: inductor_huggingface, shard: 1, num_shards: 1, runner: amz2023.linux.g5.4xlarge.nvidia.gpu}, {config: inductor_timm, shard: 1, num_shards: 2, runner: amz2023.linux.g5.4xlarge.nvidia.gpu}, {config: inductor_timm, shard: 2, num_shards: 2, runner: amz2023.linux.g5.4xlarge.nvidia.gpu}, {config: inductor_torchbench, shard: 1, num_shards: 2, runner: amz2023.linux.g5.4xlarge.nvidia.gpu}, {config: inductor_torchbench, shard: 2, num_shards: 2, runner: amz2023.linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_inductor_huggingface, shard: 1, num_shards: 1, runner: amz2023.linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_inductor_timm, shard: 1, num_shards: 2, runner: amz2023.linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_inductor_timm, shard: 2, num_shards: 2, runner: amz2023.linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_inductor_torchbench, shard: 1, num_shards: 2, runner: amz2023.linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_inductor_torchbench, shard: 2, num_shards: 2, runner: amz2023.linux.g5.4xlarge.nvidia.gpu}, {config: aot_inductor_huggingface, shard: 1, num_shards: 1, runner: amz2023.linux.g5.4xlarge.nvidia.gpu}, {config: aot_inductor_timm, shard: 1, num_shards: 2, runner: amz2023.linux.g5.4xlarge.nvidia.gpu}, {config: aot_inductor_timm, shard: 2, num_shards: 2, runner: amz2023.linux.g5.4xlarge.nvidia.gpu}, {config: aot_inductor_torchbench, shard: 1, num_shards: 2, runner: amz2023.linux.g5.4xlarge.nvidia.gpu}, {config: aot_inductor_torchbench, shard: 2, num_shards: 2, runner: amz2023.linux.g5.4xlarge.nvidia.gpu}, {config: inductor_cpp_wrapper_abi_compatible, shard: 1, num_shards: 1, runner: amz2023.linux.g5.4xlarge.nvidia.gpu}]} 2024-08-20T22:20:51.2829012Z 2024-08-20T22:20:51.2829176Z Is the current job unstable? False 2024-08-20T22:20:51.2829455Z 2024-08-20T22:20:51.2829818Z Is keep-going label set? False 2024-08-20T22:20:51.2830203Z 2024-08-20T22:20:51.2830328Z Renabled issues? 2024-08-20T22:20:51.2873279Z ##[group]Run echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2024-08-20T22:20:51.2873983Z echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2024-08-20T22:20:51.2882263Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:20:51.2882755Z env: 2024-08-20T22:20:51.2883033Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:20:51.2883484Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:20:51.2883972Z JOB_TIMEOUT: 240 2024-08-20T22:20:51.2884271Z ##[endgroup] 2024-08-20T22:20:51.2965832Z ##[group]Run set -x 2024-08-20T22:20:51.2966226Z set -x 2024-08-20T22:20:51.2966524Z  2024-08-20T22:20:51.2966867Z if [[ $TEST_CONFIG == 'multigpu' ]]; then 2024-08-20T22:20:51.2967396Z  TEST_COMMAND=.ci/pytorch/multigpu-test.sh 2024-08-20T22:20:51.2967949Z elif [[ $BUILD_ENVIRONMENT == *onnx* ]]; then 2024-08-20T22:20:51.2968448Z  TEST_COMMAND=.ci/onnx/test.sh 2024-08-20T22:20:51.2968867Z else 2024-08-20T22:20:51.2969195Z  TEST_COMMAND=.ci/pytorch/test.sh 2024-08-20T22:20:51.2969608Z fi 2024-08-20T22:20:51.2969878Z  2024-08-20T22:20:51.2970340Z # detached container should get cleaned up by teardown_ec2_linux 2024-08-20T22:20:51.2971077Z # TODO: Stop building test binaries as part of the build phase 2024-08-20T22:20:51.2971740Z # Used for GPU_FLAG since that doesn't play nice 2024-08-20T22:20:51.2972316Z # shellcheck disable=SC2086,SC2090 2024-08-20T22:20:51.2972763Z container_name=$(docker run \ 2024-08-20T22:20:51.2973174Z  ${GPU_FLAG:-} \ 2024-08-20T22:20:51.2973543Z  -e BUILD_ENVIRONMENT \ 2024-08-20T22:20:51.2973938Z  -e PR_NUMBER \ 2024-08-20T22:20:51.2974287Z  -e GITHUB_ACTIONS \ 2024-08-20T22:20:51.2974669Z  -e GITHUB_REPOSITORY \ 2024-08-20T22:20:51.2975066Z  -e GITHUB_WORKFLOW \ 2024-08-20T22:20:51.2975447Z  -e GITHUB_JOB \ 2024-08-20T22:20:51.2975794Z  -e GITHUB_RUN_ID \ 2024-08-20T22:20:51.2976169Z  -e GITHUB_RUN_NUMBER \ 2024-08-20T22:20:51.2976565Z  -e GITHUB_RUN_ATTEMPT \ 2024-08-20T22:20:51.2976952Z  -e JOB_ID \ 2024-08-20T22:20:51.2977279Z  -e JOB_NAME \ 2024-08-20T22:20:51.2977621Z  -e BASE_SHA \ 2024-08-20T22:20:51.2977962Z  -e BRANCH \ 2024-08-20T22:20:51.2978281Z  -e SHA1 \ 2024-08-20T22:20:51.2978621Z  -e AWS_DEFAULT_REGION \ 2024-08-20T22:20:51.2979017Z  -e IN_WHEEL_TEST \ 2024-08-20T22:20:51.2979389Z  -e SHARD_NUMBER \ 2024-08-20T22:20:51.2979743Z  -e TEST_CONFIG \ 2024-08-20T22:20:51.2980108Z  -e NUM_TEST_SHARDS \ 2024-08-20T22:20:51.2980491Z  -e REENABLED_ISSUES \ 2024-08-20T22:20:51.2980896Z  -e CONTINUE_THROUGH_ERROR \ 2024-08-20T22:20:51.2981313Z  -e VERBOSE_TEST_LOGS \ 2024-08-20T22:20:51.2981705Z  -e TEST_SHOWLOCALS \ 2024-08-20T22:20:51.2982087Z  -e NO_TEST_TIMEOUT \ 2024-08-20T22:20:51.2982453Z  -e NO_TD \ 2024-08-20T22:20:51.2982781Z  -e TD_DISTRIBUTED \ 2024-08-20T22:20:51.2983154Z  -e PR_LABELS \ 2024-08-20T22:20:51.2983552Z  -e MAX_JOBS="$(nproc --ignore=2)" \ 2024-08-20T22:20:51.2983992Z  -e SCCACHE_BUCKET \ 2024-08-20T22:20:51.2984385Z  -e SCCACHE_S3_KEY_PREFIX \ 2024-08-20T22:20:51.2984785Z  -e XLA_CUDA \ 2024-08-20T22:20:51.2985180Z  -e XLA_CLANG_CACHE_S3_BUCKET_NAME \ 2024-08-20T22:20:51.2985675Z  -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK \ 2024-08-20T22:20:51.2986193Z  -e PYTORCH_TEST_RERUN_DISABLED_TESTS \ 2024-08-20T22:20:51.2986700Z  -e SKIP_SCCACHE_INITIALIZATION=1 \ 2024-08-20T22:20:51.2987158Z  -e HUGGING_FACE_HUB_TOKEN \ 2024-08-20T22:20:51.2987595Z  -e SCRIBE_GRAPHQL_ACCESS_TOKEN \ 2024-08-20T22:20:51.2988216Z  -e DASHBOARD_TAG \ 2024-08-20T22:20:51.2988734Z  --env-file="/tmp/github_env_${GITHUB_RUN_ID}" \ 2024-08-20T22:20:51.2989280Z  --security-opt seccomp=unconfined \ 2024-08-20T22:20:51.2989730Z  --cap-add=SYS_PTRACE \ 2024-08-20T22:20:51.2990115Z  --ipc=host \ 2024-08-20T22:20:51.2990467Z  --shm-size="${SHM_SIZE}" \ 2024-08-20T22:20:51.2990854Z  --tty \ 2024-08-20T22:20:51.2991155Z  --detach \ 2024-08-20T22:20:51.2991627Z  --name="${container_name}" \ 2024-08-20T22:20:51.2992044Z  --user jenkins \ 2024-08-20T22:20:51.2992518Z  -v "${GITHUB_WORKSPACE}:/var/lib/jenkins/workspace" \ 2024-08-20T22:20:51.2993062Z  -w /var/lib/jenkins/workspace \ 2024-08-20T22:20:51.2993491Z  "${DOCKER_IMAGE}" 2024-08-20T22:20:51.2993837Z ) 2024-08-20T22:20:51.2994234Z # Propagate download.pytorch.org IP to container 2024-08-20T22:20:51.2995146Z grep download.pytorch.org /etc/hosts | docker exec -i "${container_name}" sudo bash -c "/bin/cat >> /etc/hosts" 2024-08-20T22:20:51.2996102Z echo "DOCKER_CONTAINER_ID=${container_name}" >> "${GITHUB_ENV}" 2024-08-20T22:20:51.2997005Z docker exec -t "${container_name}" sh -c "pip install $(echo dist/*.whl)[opt-einsum] && ${TEST_COMMAND}" 2024-08-20T22:20:51.3006254Z shell: /usr/bin/bash -e {0} 2024-08-20T22:20:51.3006599Z env: 2024-08-20T22:20:51.3006872Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:20:51.3007324Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:20:51.3007920Z BUILD_ENVIRONMENT: linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-08-20T22:20:51.3008412Z PR_NUMBER: 2024-08-20T22:20:51.3008728Z GITHUB_REPOSITORY: pytorch/pytorch 2024-08-20T22:20:51.3009139Z GITHUB_WORKFLOW: inductor 2024-08-20T22:20:51.3009486Z GITHUB_JOB: test 2024-08-20T22:20:51.3009791Z GITHUB_RUN_ID: 10479310725 2024-08-20T22:20:51.3010157Z GITHUB_RUN_NUMBER: 88082 2024-08-20T22:20:51.3010502Z GITHUB_RUN_ATTEMPT: 1 2024-08-20T22:20:51.3010833Z JOB_ID: 29026530319 2024-08-20T22:20:51.3011500Z JOB_NAME: cuda12.1-py3.10-gcc9-sm86 / test (aot_inductor_timm, 2, 2, amz2023.linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:20:51.3012230Z BRANCH: 2024-08-20T22:20:51.3012563Z SHA1: 40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:20:51.3013087Z BASE_SHA: 40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:20:51.3013561Z TEST_CONFIG: aot_inductor_timm 2024-08-20T22:20:51.3013930Z SHARD_NUMBER: 2 2024-08-20T22:20:51.3014238Z NUM_TEST_SHARDS: 2 2024-08-20T22:20:51.3014561Z REENABLED_ISSUES: 2024-08-20T22:20:51.3014888Z CONTINUE_THROUGH_ERROR: False 2024-08-20T22:20:51.3015271Z VERBOSE_TEST_LOGS: False 2024-08-20T22:20:51.3015623Z TEST_SHOWLOCALS: False 2024-08-20T22:20:51.3015958Z NO_TEST_TIMEOUT: False 2024-08-20T22:20:51.3016287Z NO_TD: False 2024-08-20T22:20:51.3016585Z TD_DISTRIBUTED: False 2024-08-20T22:20:51.3017001Z SCCACHE_BUCKET: ossci-compiler-cache-circleci-v2 2024-08-20T22:20:51.3017483Z SCCACHE_S3_KEY_PREFIX: inductor 2024-08-20T22:20:51.3017860Z SHM_SIZE: 2g 2024-08-20T22:20:51.3018956Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:20:51.3020126Z XLA_CUDA: 2024-08-20T22:20:51.3020591Z XLA_CLANG_CACHE_S3_BUCKET_NAME: ossci-compiler-clang-cache-circleci-xla 2024-08-20T22:20:51.3021198Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK: 0 2024-08-20T22:20:51.3021638Z PYTORCH_TEST_RERUN_DISABLED_TESTS: 0 2024-08-20T22:20:51.3022047Z DASHBOARD_TAG: 2024-08-20T22:20:51.3022551Z HUGGING_FACE_HUB_TOKEN: *** 2024-08-20T22:20:51.3022921Z SCRIBE_GRAPHQL_ACCESS_TOKEN: 2024-08-20T22:20:51.3023293Z ##[endgroup] 2024-08-20T22:20:51.3053263Z + [[ aot_inductor_timm == \m\u\l\t\i\g\p\u ]] 2024-08-20T22:20:51.3054030Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *onnx* ]] 2024-08-20T22:20:51.3054752Z + TEST_COMMAND=.ci/pytorch/test.sh 2024-08-20T22:20:51.3062758Z +++ nproc --ignore=2 2024-08-20T22:20:51.3080840Z ++ docker run --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all -e BUILD_ENVIRONMENT -e PR_NUMBER -e GITHUB_ACTIONS -e GITHUB_REPOSITORY -e GITHUB_WORKFLOW -e GITHUB_JOB -e GITHUB_RUN_ID -e GITHUB_RUN_NUMBER -e GITHUB_RUN_ATTEMPT -e JOB_ID -e JOB_NAME -e BASE_SHA -e BRANCH -e SHA1 -e AWS_DEFAULT_REGION -e IN_WHEEL_TEST -e SHARD_NUMBER -e TEST_CONFIG -e NUM_TEST_SHARDS -e REENABLED_ISSUES -e CONTINUE_THROUGH_ERROR -e VERBOSE_TEST_LOGS -e TEST_SHOWLOCALS -e NO_TEST_TIMEOUT -e NO_TD -e TD_DISTRIBUTED -e PR_LABELS -e MAX_JOBS=14 -e SCCACHE_BUCKET -e SCCACHE_S3_KEY_PREFIX -e XLA_CUDA -e XLA_CLANG_CACHE_S3_BUCKET_NAME -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK -e PYTORCH_TEST_RERUN_DISABLED_TESTS -e SKIP_SCCACHE_INITIALIZATION=1 -e HUGGING_FACE_HUB_TOKEN -e SCRIBE_GRAPHQL_ACCESS_TOKEN -e DASHBOARD_TAG --env-file=/tmp/github_env_10479310725 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --ipc=host --shm-size=2g --tty --detach --name= --user jenkins -v /home/ec2-user/actions-runner/_work/pytorch/pytorch:/var/lib/jenkins/workspace -w /var/lib/jenkins/workspace 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:21:02.6433614Z + container_name=f01dd8f201efb155f69d5d60003111fed3eca9f968be8324fd6f52952d51c493 2024-08-20T22:21:02.6436531Z + grep download.pytorch.org /etc/hosts 2024-08-20T22:21:02.6438319Z + docker exec -i f01dd8f201efb155f69d5d60003111fed3eca9f968be8324fd6f52952d51c493 sudo bash -c '/bin/cat >> /etc/hosts' 2024-08-20T22:21:02.8015973Z + echo DOCKER_CONTAINER_ID=f01dd8f201efb155f69d5d60003111fed3eca9f968be8324fd6f52952d51c493 2024-08-20T22:21:02.8020749Z ++ echo dist/torch-2.5.0a0+git40ec5f6-cp310-cp310-linux_x86_64.whl 2024-08-20T22:21:02.8023974Z + docker exec -t f01dd8f201efb155f69d5d60003111fed3eca9f968be8324fd6f52952d51c493 sh -c 'pip install dist/torch-2.5.0a0+git40ec5f6-cp310-cp310-linux_x86_64.whl[opt-einsum] && .ci/pytorch/test.sh' 2024-08-20T22:21:03.2020685Z Processing ./dist/torch-2.5.0a0+git40ec5f6-cp310-cp310-linux_x86_64.whl (from torch==2.5.0a0+git40ec5f6) 2024-08-20T22:21:03.5279215Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (3.13.1) 2024-08-20T22:21:03.5282626Z Requirement already satisfied: typing-extensions>=4.8.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (4.12.2) 2024-08-20T22:21:03.5284533Z Requirement already satisfied: networkx in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (2.8.8) 2024-08-20T22:21:03.5287938Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (3.1.4) 2024-08-20T22:21:03.5291276Z Requirement already satisfied: fsspec in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (2024.6.1) 2024-08-20T22:21:03.5296634Z Requirement already satisfied: sympy==1.13.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (1.13.1) 2024-08-20T22:21:03.5313207Z Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from sympy==1.13.1->torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (1.3.0) 2024-08-20T22:21:03.5327042Z Requirement already satisfied: opt-einsum>=3.3 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (3.3.0) 2024-08-20T22:21:03.5344431Z Requirement already satisfied: numpy>=1.7 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from opt-einsum>=3.3->torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (1.22.4) 2024-08-20T22:21:03.5735178Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from jinja2->torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (2.1.5) 2024-08-20T22:21:04.1570522Z Installing collected packages: torch 2024-08-20T22:21:14.2017846Z ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 2024-08-20T22:21:14.2019234Z timm 1.0.9.dev0 requires torchvision, which is not installed. 2024-08-20T22:21:14.2020284Z Successfully installed torch-2.5.0a0+git40ec5f6 2024-08-20T22:21:14.2871084Z + export TERM=vt100 2024-08-20T22:21:14.2872172Z + TERM=vt100 2024-08-20T22:21:14.2874739Z ++ dirname .ci/pytorch/test.sh 2024-08-20T22:21:14.2885575Z + source .ci/pytorch/common.sh 2024-08-20T22:21:14.2888736Z +++ dirname .ci/pytorch/common.sh 2024-08-20T22:21:14.2898191Z ++ source .ci/pytorch/common_utils.sh 2024-08-20T22:21:14.2899787Z +++ declare -f -t trap_add 2024-08-20T22:21:14.2907169Z ++ set -ex 2024-08-20T22:21:14.2908009Z ++ [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *rocm* ]] 2024-08-20T22:21:14.2908603Z ++ BUILD_TEST_LIBTORCH=0 2024-08-20T22:21:14.2909223Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *rocm* ]] 2024-08-20T22:21:14.2911725Z ++ stat -c %u /var/lib/jenkins/workspace 2024-08-20T22:21:14.2932429Z + WORKSPACE_ORIGINAL_OWNER_ID=1000 2024-08-20T22:21:14.2932876Z + trap_add cleanup_workspace EXIT 2024-08-20T22:21:14.2933290Z + trap_add_cmd=cleanup_workspace 2024-08-20T22:21:14.2933667Z + shift 2024-08-20T22:21:14.2933958Z + for trap_add_name in "$@" 2024-08-20T22:21:14.2942029Z +++ trap -p EXIT 2024-08-20T22:21:14.2945151Z ++ eval 'extract_trap_cmd ' 2024-08-20T22:21:14.2945553Z +++ extract_trap_cmd 2024-08-20T22:21:14.2945921Z +++ printf '%s\n' '' 2024-08-20T22:21:14.2946570Z ++ printf '%s\n' cleanup_workspace 2024-08-20T22:21:14.2948936Z + trap -- ' 2024-08-20T22:21:14.2949274Z cleanup_workspace' EXIT 2024-08-20T22:21:14.2949765Z + sudo chown -R jenkins /var/lib/jenkins/workspace 2024-08-20T22:21:15.0050774Z + git config --global --add safe.directory /var/lib/jenkins/workspace 2024-08-20T22:21:15.0073673Z + echo 'Environment variables:' 2024-08-20T22:21:15.0074084Z Environment variables: 2024-08-20T22:21:15.0074417Z + env 2024-08-20T22:21:15.0085122Z INSTALLED_DB=yes 2024-08-20T22:21:15.0085883Z NV_LIBCUBLAS_VERSION=12.1.3.1-1 2024-08-20T22:21:15.0086430Z NVIDIA_VISIBLE_DEVICES=all 2024-08-20T22:21:15.0086987Z NV_NVML_DEV_VERSION=12.1.105-1 2024-08-20T22:21:15.0087873Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-20T22:21:15.0088476Z CONTINUE_THROUGH_ERROR=False 2024-08-20T22:21:15.0089059Z NV_LIBNCCL_DEV_PACKAGE=libnccl-dev=2.17.1-1+cuda12.1 2024-08-20T22:21:15.0089582Z NV_LIBNCCL_DEV_PACKAGE_VERSION=2.17.1-1 2024-08-20T22:21:15.0090155Z BUILD_ENVIRONMENT=linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-08-20T22:21:15.0090658Z HOSTNAME=f01dd8f201ef 2024-08-20T22:21:15.0091699Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_938f7c34-02b8-4d9c-b5aa-8baf5e7228da 2024-08-20T22:21:15.0092849Z GITHUB_ACTION=__self 2024-08-20T22:21:15.0093300Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2024-08-20T22:21:15.0097618Z NVIDIA_REQUIRE_CUDA=cuda>=12.1 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 brand=tesla,driver>=525,driver<526 brand=unknown,driver>=525,driver<526 brand=nvidia,driver>=525,driver<526 brand=nvidiartx,driver>=525,driver<526 brand=geforce,driver>=525,driver<526 brand=geforcertx,driver>=525,driver<526 brand=quadro,driver>=525,driver<526 brand=quadrortx,driver>=525,driver<526 brand=titan,driver>=525,driver<526 brand=titanrtx,driver>=525,driver<526 2024-08-20T22:21:15.0101834Z NV_LIBCUBLAS_DEV_PACKAGE=libcublas-dev-12-1=12.1.3.1-1 2024-08-20T22:21:15.0102351Z NV_NVTX_VERSION=12.1.105-1 2024-08-20T22:21:15.0102701Z GITHUB_RUN_NUMBER=88082 2024-08-20T22:21:15.0103042Z TEST_CONFIG=aot_inductor_timm 2024-08-20T22:21:15.0103423Z GITHUB_REPOSITORY_OWNER_ID=21003710 2024-08-20T22:21:15.0103896Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2024-08-20T22:21:15.0104357Z NV_CUDA_CUDART_DEV_VERSION=12.1.105-1 2024-08-20T22:21:15.0104802Z NV_LIBCUSPARSE_VERSION=12.1.0.106-1 2024-08-20T22:21:15.0105203Z SCRIBE_GRAPHQL_ACCESS_TOKEN= 2024-08-20T22:21:15.0105747Z NV_LIBNPP_VERSION=12.1.0.40-1 2024-08-20T22:21:15.0106196Z GITHUB_TRIGGERING_ACTOR=pytorch-bot[bot] 2024-08-20T22:21:15.0106694Z CMAKE_CUDA_COMPILER_LAUNCHER=/opt/cache/bin/sccache 2024-08-20T22:21:15.0107154Z GITHUB_REF_TYPE=tag 2024-08-20T22:21:15.0107475Z TORCH_CUDA_ARCH_LIST=Maxwell 2024-08-20T22:21:15.0107844Z NCCL_VERSION=2.17.1-1 2024-08-20T22:21:15.0108232Z BASE_SHA=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:21:15.0108685Z XLA_CUDA= 2024-08-20T22:21:15.0109185Z HUGGING_FACE_HUB_TOKEN=*** 2024-08-20T22:21:15.0111603Z *** 2024-08-20T22:21:15.0111904Z CARGO_NET_GIT_FETCH_WITH_CLI=true 2024-08-20T22:21:15.0112304Z GITHUB_REPOSITORY_ID=65600975 2024-08-20T22:21:15.0112665Z GITHUB_ACTIONS=true 2024-08-20T22:21:15.0112987Z NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:21:15.0113509Z NV_NVPROF_DEV_PACKAGE=cuda-nvprof-12-1=12.1.105-1 2024-08-20T22:21:15.0114074Z NV_LIBNPP_PACKAGE=libnpp-12-1=12.1.0.40-1 2024-08-20T22:21:15.0114556Z SHA1=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:21:15.0115076Z NV_LIBNCCL_DEV_PACKAGE_NAME=libnccl-dev 2024-08-20T22:21:15.0115554Z GITHUB_SHA=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:21:15.0116338Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/inductor.yml@refs/tags/ciflow/inductor/133712 2024-08-20T22:21:15.0117047Z UCC_HOME=/usr 2024-08-20T22:21:15.0117395Z NV_LIBCUBLAS_DEV_VERSION=12.1.3.1-1 2024-08-20T22:21:15.0117794Z VERBOSE_TEST_LOGS=False 2024-08-20T22:21:15.0118141Z NVIDIA_PRODUCT_NAME=CUDA 2024-08-20T22:21:15.0118686Z NV_LIBCUBLAS_DEV_PACKAGE_NAME=libcublas-dev-12-1 2024-08-20T22:21:15.0119187Z GITHUB_REF=refs/tags/ciflow/inductor/133712 2024-08-20T22:21:15.0119656Z NV_CUDA_CUDART_VERSION=12.1.105-1 2024-08-20T22:21:15.0120029Z SHARD_NUMBER=2 2024-08-20T22:21:15.0120345Z GITHUB_REF_PROTECTED=false 2024-08-20T22:21:15.0120691Z HOME=/var/lib/jenkins 2024-08-20T22:21:15.0121051Z GITHUB_API_URL=https://api.github.com 2024-08-20T22:21:15.0121477Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2024-08-20T22:21:15.0121953Z UCX_COMMIT=7bb2722ff2187a0cad557ae4a6afa090569f83fb 2024-08-20T22:21:15.0122431Z SCCACHE_S3_KEY_PREFIX=inductor 2024-08-20T22:21:15.0122791Z CUDA_VERSION=12.1.1 2024-08-20T22:21:15.0123213Z NV_LIBCUBLAS_PACKAGE=libcublas-12-1=12.1.3.1-1 2024-08-20T22:21:15.0123645Z NUM_TEST_SHARDS=2 2024-08-20T22:21:15.0123940Z UCX_HOME=/usr 2024-08-20T22:21:15.0124460Z NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE=cuda-nsight-compute-12-1=12.1.1-1 2024-08-20T22:21:15.0125534Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_938f7c34-02b8-4d9c-b5aa-8baf5e7228da 2024-08-20T22:21:15.0126789Z JOB_NAME=cuda12.1-py3.10-gcc9-sm86 / test (aot_inductor_timm, 2, 2, amz2023.linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:21:15.0128017Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_938f7c34-02b8-4d9c-b5aa-8baf5e7228da 2024-08-20T22:21:15.0129127Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2024-08-20T22:21:15.0129771Z GITHUB_EVENT_NAME=push 2024-08-20T22:21:15.0130104Z DASHBOARD_TAG= 2024-08-20T22:21:15.0130403Z GITHUB_RUN_ID=10479310725 2024-08-20T22:21:15.0130868Z NV_LIBNPP_DEV_PACKAGE=libnpp-dev-12-1=12.1.0.40-1 2024-08-20T22:21:15.0131399Z NV_LIBCUBLAS_PACKAGE_NAME=libcublas-12-1 2024-08-20T22:21:15.0132407Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_938f7c34-02b8-4d9c-b5aa-8baf5e7228da 2024-08-20T22:21:15.0133441Z GITHUB_ACTOR=pytorch-bot[bot] 2024-08-20T22:21:15.0133848Z NV_LIBNPP_DEV_VERSION=12.1.0.40-1 2024-08-20T22:21:15.0134213Z PR_NUMBER= 2024-08-20T22:21:15.0134499Z GITHUB_RUN_ATTEMPT=1 2024-08-20T22:21:15.0134834Z ANACONDA_PYTHON_VERSION=3.10 2024-08-20T22:21:15.0135270Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2024-08-20T22:21:15.0135781Z TERM=vt100 2024-08-20T22:21:15.0136141Z NV_LIBCUSPARSE_DEV_VERSION=12.1.0.106-1 2024-08-20T22:21:15.0136550Z INSTALLED_VISION=yes 2024-08-20T22:21:15.0136858Z BRANCH= 2024-08-20T22:21:15.0137136Z OPENSSL_ROOT_DIR=/opt/openssl 2024-08-20T22:21:15.0137631Z LIBRARY_PATH=/usr/local/cuda/lib64/stubs 2024-08-20T22:21:15.0138056Z CUDA_PATH=/usr/local/cuda 2024-08-20T22:21:15.0138809Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2024-08-20T22:21:15.0139559Z GITHUB_SERVER_URL=https://github.com 2024-08-20T22:21:15.0140049Z UCC_COMMIT=20eae37090a4ce1b32bcce6144ccad0b49943e0b 2024-08-20T22:21:15.0140513Z REENABLED_ISSUES= 2024-08-20T22:21:15.0140815Z SHLVL=1 2024-08-20T22:21:15.0141073Z MAX_JOBS=14 2024-08-20T22:21:15.0141388Z NV_CUDA_LIB_VERSION=12.1.1-1 2024-08-20T22:21:15.0141736Z NVARCH=x86_64 2024-08-20T22:21:15.0142035Z GITHUB_ACTOR_ID=54816060 2024-08-20T22:21:15.0142491Z GITHUB_WORKFLOW_SHA=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:21:15.0143024Z GITHUB_REF_NAME=ciflow/inductor/133712 2024-08-20T22:21:15.0143511Z NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-1 2024-08-20T22:21:15.0144228Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2024-08-20T22:21:15.0144800Z GITHUB_JOB=test 2024-08-20T22:21:15.0145200Z NV_LIBNCCL_PACKAGE=libnccl2=2.17.1-1+cuda12.1 2024-08-20T22:21:15.0145739Z LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64 2024-08-20T22:21:15.0146552Z NO_TEST_TIMEOUT=False 2024-08-20T22:21:15.0146884Z TD_DISTRIBUTED=False 2024-08-20T22:21:15.0147270Z NV_CUDA_NSIGHT_COMPUTE_VERSION=12.1.1-1 2024-08-20T22:21:15.0147705Z GITHUB_REPOSITORY=pytorch/pytorch 2024-08-20T22:21:15.0148134Z NV_NVPROF_VERSION=12.1.105-1 2024-08-20T22:21:15.0148492Z GITHUB_RETENTION_DAYS=90 2024-08-20T22:21:15.0148830Z OPENSSL_DIR=/opt/openssl 2024-08-20T22:21:15.0149176Z GITHUB_ACTION_REPOSITORY= 2024-08-20T22:21:15.0150219Z PATH=/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-08-20T22:21:15.0151289Z GITHUB_BASE_REF= 2024-08-20T22:21:15.0151607Z NV_LIBNCCL_PACKAGE_NAME=libnccl2 2024-08-20T22:21:15.0151969Z CI=true 2024-08-20T22:21:15.0152287Z NV_LIBNCCL_PACKAGE_VERSION=2.17.1-1 2024-08-20T22:21:15.0152707Z GITHUB_REPOSITORY_OWNER=pytorch 2024-08-20T22:21:15.0153074Z JOB_ID=29026530319 2024-08-20T22:21:15.0153385Z INSTALLED_PROTOBUF=yes 2024-08-20T22:21:15.0153710Z GITHUB_HEAD_REF= 2024-08-20T22:21:15.0154005Z GITHUB_ACTION_REF= 2024-08-20T22:21:15.0154439Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2024-08-20T22:21:15.0154903Z TEST_SHOWLOCALS=False 2024-08-20T22:21:15.0155239Z GITHUB_WORKFLOW=inductor 2024-08-20T22:21:15.0155593Z DEBIAN_FRONTEND=noninteractive 2024-08-20T22:21:15.0156501Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_938f7c34-02b8-4d9c-b5aa-8baf5e7228da 2024-08-20T22:21:15.0157314Z NO_TD=False 2024-08-20T22:21:15.0157613Z SKIP_SCCACHE_INITIALIZATION=1 2024-08-20T22:21:15.0157967Z _=/usr/bin/env 2024-08-20T22:21:15.0158569Z ++ python -c 'import site; print(site.getsitepackages()[0])' 2024-08-20T22:21:15.0319869Z + TORCH_INSTALL_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch 2024-08-20T22:21:15.0321181Z + TORCH_BIN_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/bin 2024-08-20T22:21:15.0322297Z + TORCH_LIB_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/lib 2024-08-20T22:21:15.0323305Z + TORCH_TEST_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/test 2024-08-20T22:21:15.0323986Z + BUILD_DIR=build 2024-08-20T22:21:15.0324319Z + BUILD_RENAMED_DIR=build_renamed 2024-08-20T22:21:15.0325046Z + BUILD_BIN_DIR=build/bin 2024-08-20T22:21:15.0325387Z + SHARD_NUMBER=2 2024-08-20T22:21:15.0325757Z + NUM_TEST_SHARDS=2 2024-08-20T22:21:15.0326077Z + export VALGRIND=ON 2024-08-20T22:21:15.0326433Z + VALGRIND=ON 2024-08-20T22:21:15.0326979Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *clang9* ]] 2024-08-20T22:21:15.0327642Z + [[ 0 == \1 ]] 2024-08-20T22:21:15.0327983Z + [[ False == \1 ]] 2024-08-20T22:21:15.0328489Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *bazel* ]] 2024-08-20T22:21:15.0329068Z ++ realpath build/custom_test_artifacts 2024-08-20T22:21:15.0340380Z + CUSTOM_TEST_ARTIFACT_BUILD_DIR=/var/lib/jenkins/workspace/build/custom_test_artifacts 2024-08-20T22:21:15.0341099Z + [[ -n '' ]] 2024-08-20T22:21:15.0341464Z + echo 'Environment variables' 2024-08-20T22:21:15.0341853Z Environment variables 2024-08-20T22:21:15.0342175Z + env 2024-08-20T22:21:15.0351199Z INSTALLED_DB=yes 2024-08-20T22:21:15.0352003Z NV_LIBCUBLAS_VERSION=12.1.3.1-1 2024-08-20T22:21:15.0352572Z NVIDIA_VISIBLE_DEVICES=all 2024-08-20T22:21:15.0353116Z NV_NVML_DEV_VERSION=12.1.105-1 2024-08-20T22:21:15.0353928Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-20T22:21:15.0354692Z CONTINUE_THROUGH_ERROR=False 2024-08-20T22:21:15.0355367Z NV_LIBNCCL_DEV_PACKAGE=libnccl-dev=2.17.1-1+cuda12.1 2024-08-20T22:21:15.0356070Z NV_LIBNCCL_DEV_PACKAGE_VERSION=2.17.1-1 2024-08-20T22:21:15.0356827Z BUILD_ENVIRONMENT=linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-08-20T22:21:15.0357461Z HOSTNAME=f01dd8f201ef 2024-08-20T22:21:15.0358613Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_938f7c34-02b8-4d9c-b5aa-8baf5e7228da 2024-08-20T22:21:15.0359422Z GITHUB_ACTION=__self 2024-08-20T22:21:15.0359765Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2024-08-20T22:21:15.0364089Z NVIDIA_REQUIRE_CUDA=cuda>=12.1 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 brand=tesla,driver>=525,driver<526 brand=unknown,driver>=525,driver<526 brand=nvidia,driver>=525,driver<526 brand=nvidiartx,driver>=525,driver<526 brand=geforce,driver>=525,driver<526 brand=geforcertx,driver>=525,driver<526 brand=quadro,driver>=525,driver<526 brand=quadrortx,driver>=525,driver<526 brand=titan,driver>=525,driver<526 brand=titanrtx,driver>=525,driver<526 2024-08-20T22:21:15.0368336Z NV_LIBCUBLAS_DEV_PACKAGE=libcublas-dev-12-1=12.1.3.1-1 2024-08-20T22:21:15.0368841Z NV_NVTX_VERSION=12.1.105-1 2024-08-20T22:21:15.0369196Z GITHUB_RUN_NUMBER=88082 2024-08-20T22:21:15.0369537Z TEST_CONFIG=aot_inductor_timm 2024-08-20T22:21:15.0369974Z GITHUB_REPOSITORY_OWNER_ID=21003710 2024-08-20T22:21:15.0370438Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2024-08-20T22:21:15.0370900Z NV_CUDA_CUDART_DEV_VERSION=12.1.105-1 2024-08-20T22:21:15.0371376Z NV_LIBCUSPARSE_VERSION=12.1.0.106-1 2024-08-20T22:21:15.0371810Z SCRIBE_GRAPHQL_ACCESS_TOKEN= 2024-08-20T22:21:15.0372206Z NV_LIBNPP_VERSION=12.1.0.40-1 2024-08-20T22:21:15.0372647Z GITHUB_TRIGGERING_ACTOR=pytorch-bot[bot] 2024-08-20T22:21:15.0373130Z CMAKE_CUDA_COMPILER_LAUNCHER=/opt/cache/bin/sccache 2024-08-20T22:21:15.0373578Z GITHUB_REF_TYPE=tag 2024-08-20T22:21:15.0373896Z TORCH_CUDA_ARCH_LIST=Maxwell 2024-08-20T22:21:15.0374265Z NCCL_VERSION=2.17.1-1 2024-08-20T22:21:15.0374649Z BASE_SHA=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:21:15.0375087Z XLA_CUDA= 2024-08-20T22:21:15.0375592Z HUGGING_FACE_HUB_TOKEN=*** 2024-08-20T22:21:15.0375990Z *** 2024-08-20T22:21:15.0376270Z CARGO_NET_GIT_FETCH_WITH_CLI=true 2024-08-20T22:21:15.0376654Z GITHUB_REPOSITORY_ID=65600975 2024-08-20T22:21:15.0377015Z GITHUB_ACTIONS=true 2024-08-20T22:21:15.0377341Z NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:21:15.0377840Z NV_NVPROF_DEV_PACKAGE=cuda-nvprof-12-1=12.1.105-1 2024-08-20T22:21:15.0378638Z NV_LIBNPP_PACKAGE=libnpp-12-1=12.1.0.40-1 2024-08-20T22:21:15.0379106Z SHA1=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:21:15.0379613Z NV_LIBNCCL_DEV_PACKAGE_NAME=libnccl-dev 2024-08-20T22:21:15.0380092Z GITHUB_SHA=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:21:15.0380871Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/inductor.yml@refs/tags/ciflow/inductor/133712 2024-08-20T22:21:15.0381580Z UCC_HOME=/usr 2024-08-20T22:21:15.0381912Z NV_LIBCUBLAS_DEV_VERSION=12.1.3.1-1 2024-08-20T22:21:15.0382306Z VERBOSE_TEST_LOGS=False 2024-08-20T22:21:15.0382791Z NVIDIA_PRODUCT_NAME=CUDA 2024-08-20T22:21:15.0383267Z NV_LIBCUBLAS_DEV_PACKAGE_NAME=libcublas-dev-12-1 2024-08-20T22:21:15.0383761Z GITHUB_REF=refs/tags/ciflow/inductor/133712 2024-08-20T22:21:15.0384275Z NV_CUDA_CUDART_VERSION=12.1.105-1 2024-08-20T22:21:15.0384643Z SHARD_NUMBER=2 2024-08-20T22:21:15.0384948Z GITHUB_REF_PROTECTED=false 2024-08-20T22:21:15.0385294Z HOME=/var/lib/jenkins 2024-08-20T22:21:15.0385648Z GITHUB_API_URL=https://api.github.com 2024-08-20T22:21:15.0386093Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2024-08-20T22:21:15.0386566Z UCX_COMMIT=7bb2722ff2187a0cad557ae4a6afa090569f83fb 2024-08-20T22:21:15.0387040Z SCCACHE_S3_KEY_PREFIX=inductor 2024-08-20T22:21:15.0387400Z CUDA_VERSION=12.1.1 2024-08-20T22:21:15.0387821Z NV_LIBCUBLAS_PACKAGE=libcublas-12-1=12.1.3.1-1 2024-08-20T22:21:15.0388261Z NUM_TEST_SHARDS=2 2024-08-20T22:21:15.0388561Z UCX_HOME=/usr 2024-08-20T22:21:15.0389104Z NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE=cuda-nsight-compute-12-1=12.1.1-1 2024-08-20T22:21:15.0390230Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_938f7c34-02b8-4d9c-b5aa-8baf5e7228da 2024-08-20T22:21:15.0391481Z JOB_NAME=cuda12.1-py3.10-gcc9-sm86 / test (aot_inductor_timm, 2, 2, amz2023.linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:21:15.0392713Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_938f7c34-02b8-4d9c-b5aa-8baf5e7228da 2024-08-20T22:21:15.0393819Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2024-08-20T22:21:15.0394470Z GITHUB_EVENT_NAME=push 2024-08-20T22:21:15.0394795Z DASHBOARD_TAG= 2024-08-20T22:21:15.0395094Z GITHUB_RUN_ID=10479310725 2024-08-20T22:21:15.0395548Z NV_LIBNPP_DEV_PACKAGE=libnpp-dev-12-1=12.1.0.40-1 2024-08-20T22:21:15.0396091Z NV_LIBCUBLAS_PACKAGE_NAME=libcublas-12-1 2024-08-20T22:21:15.0397088Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_938f7c34-02b8-4d9c-b5aa-8baf5e7228da 2024-08-20T22:21:15.0397992Z GITHUB_ACTOR=pytorch-bot[bot] 2024-08-20T22:21:15.0398497Z NV_LIBNPP_DEV_VERSION=12.1.0.40-1 2024-08-20T22:21:15.0398871Z PR_NUMBER= 2024-08-20T22:21:15.0399151Z GITHUB_RUN_ATTEMPT=1 2024-08-20T22:21:15.0399457Z VALGRIND=ON 2024-08-20T22:21:15.0399750Z ANACONDA_PYTHON_VERSION=3.10 2024-08-20T22:21:15.0400181Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2024-08-20T22:21:15.0400648Z TERM=vt100 2024-08-20T22:21:15.0400976Z NV_LIBCUSPARSE_DEV_VERSION=12.1.0.106-1 2024-08-20T22:21:15.0401398Z INSTALLED_VISION=yes 2024-08-20T22:21:15.0401705Z BRANCH= 2024-08-20T22:21:15.0401981Z OPENSSL_ROOT_DIR=/opt/openssl 2024-08-20T22:21:15.0402375Z LIBRARY_PATH=/usr/local/cuda/lib64/stubs 2024-08-20T22:21:15.0402792Z CUDA_PATH=/usr/local/cuda 2024-08-20T22:21:15.0403545Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2024-08-20T22:21:15.0404279Z GITHUB_SERVER_URL=https://github.com 2024-08-20T22:21:15.0404760Z UCC_COMMIT=20eae37090a4ce1b32bcce6144ccad0b49943e0b 2024-08-20T22:21:15.0405231Z REENABLED_ISSUES= 2024-08-20T22:21:15.0405521Z SHLVL=1 2024-08-20T22:21:15.0405774Z MAX_JOBS=14 2024-08-20T22:21:15.0406086Z NV_CUDA_LIB_VERSION=12.1.1-1 2024-08-20T22:21:15.0406432Z NVARCH=x86_64 2024-08-20T22:21:15.0406724Z GITHUB_ACTOR_ID=54816060 2024-08-20T22:21:15.0407168Z GITHUB_WORKFLOW_SHA=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:21:15.0407697Z GITHUB_REF_NAME=ciflow/inductor/133712 2024-08-20T22:21:15.0408302Z NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-1 2024-08-20T22:21:15.0408950Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2024-08-20T22:21:15.0409514Z GITHUB_JOB=test 2024-08-20T22:21:15.0409919Z NV_LIBNCCL_PACKAGE=libnccl2=2.17.1-1+cuda12.1 2024-08-20T22:21:15.0410467Z LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64 2024-08-20T22:21:15.0410965Z NO_TEST_TIMEOUT=False 2024-08-20T22:21:15.0411287Z TD_DISTRIBUTED=False 2024-08-20T22:21:15.0411660Z NV_CUDA_NSIGHT_COMPUTE_VERSION=12.1.1-1 2024-08-20T22:21:15.0412088Z GITHUB_REPOSITORY=pytorch/pytorch 2024-08-20T22:21:15.0412590Z NV_NVPROF_VERSION=12.1.105-1 2024-08-20T22:21:15.0412953Z GITHUB_RETENTION_DAYS=90 2024-08-20T22:21:15.0413295Z OPENSSL_DIR=/opt/openssl 2024-08-20T22:21:15.0413633Z GITHUB_ACTION_REPOSITORY= 2024-08-20T22:21:15.0414664Z PATH=/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-08-20T22:21:15.0415735Z GITHUB_BASE_REF= 2024-08-20T22:21:15.0416056Z NV_LIBNCCL_PACKAGE_NAME=libnccl2 2024-08-20T22:21:15.0416411Z CI=true 2024-08-20T22:21:15.0416733Z NV_LIBNCCL_PACKAGE_VERSION=2.17.1-1 2024-08-20T22:21:15.0417142Z GITHUB_REPOSITORY_OWNER=pytorch 2024-08-20T22:21:15.0417507Z JOB_ID=29026530319 2024-08-20T22:21:15.0417811Z INSTALLED_PROTOBUF=yes 2024-08-20T22:21:15.0418135Z GITHUB_HEAD_REF= 2024-08-20T22:21:15.0418431Z GITHUB_ACTION_REF= 2024-08-20T22:21:15.0418862Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2024-08-20T22:21:15.0419315Z TEST_SHOWLOCALS=False 2024-08-20T22:21:15.0419657Z GITHUB_WORKFLOW=inductor 2024-08-20T22:21:15.0420015Z DEBIAN_FRONTEND=noninteractive 2024-08-20T22:21:15.0420915Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_938f7c34-02b8-4d9c-b5aa-8baf5e7228da 2024-08-20T22:21:15.0421725Z NO_TD=False 2024-08-20T22:21:15.0422024Z SKIP_SCCACHE_INITIALIZATION=1 2024-08-20T22:21:15.0422380Z _=/usr/bin/env 2024-08-20T22:21:15.0422714Z + echo 'Testing pytorch' 2024-08-20T22:21:15.0423056Z Testing pytorch 2024-08-20T22:21:15.0423380Z + export LANG=C.UTF-8 2024-08-20T22:21:15.0423716Z + LANG=C.UTF-8 2024-08-20T22:21:15.0423994Z + PR_NUMBER= 2024-08-20T22:21:15.0424326Z + [[ aot_inductor_timm == \d\e\f\a\u\l\t ]] 2024-08-20T22:21:15.0424813Z + [[ aot_inductor_timm == \d\i\s\t\r\i\b\u\t\e\d ]] 2024-08-20T22:21:15.0425276Z + [[ aot_inductor_timm == \s\l\o\w ]] 2024-08-20T22:21:15.0425896Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *slow-gradcheck* ]] 2024-08-20T22:21:15.0426600Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *cuda* ]] 2024-08-20T22:21:15.0427139Z + export PYTORCH_TESTING_DEVICE_ONLY_FOR=cuda 2024-08-20T22:21:15.0427602Z + PYTORCH_TESTING_DEVICE_ONLY_FOR=cuda 2024-08-20T22:21:15.0428039Z + [[ aot_inductor_timm == *crossref* ]] 2024-08-20T22:21:15.0428598Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *rocm* ]] 2024-08-20T22:21:15.0429229Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *xpu* ]] 2024-08-20T22:21:15.0429867Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *-bazel-* ]] 2024-08-20T22:21:15.0430427Z + pip_install --user ninja==1.10.2 2024-08-20T22:21:15.0431020Z + pip install --progress-bar off --user ninja==1.10.2 2024-08-20T22:21:16.2164276Z Collecting ninja==1.10.2 2024-08-20T22:21:16.2348936Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl.metadata (5.0 kB) 2024-08-20T22:21:16.2934560Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl (108 kB) 2024-08-20T22:21:16.9083284Z Installing collected packages: ninja 2024-08-20T22:21:16.9163164Z  WARNING: The script ninja is installed in '/var/lib/jenkins/.local/bin' which is not on PATH. 2024-08-20T22:21:16.9164438Z Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. 2024-08-20T22:21:16.9692378Z Successfully installed ninja-1.10.2 2024-08-20T22:21:17.0516019Z + export PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-08-20T22:21:17.0518634Z + PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-08-20T22:21:17.0520203Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *aarch64* ]] 2024-08-20T22:21:17.0520705Z + install_tlparse 2024-08-20T22:21:17.0521094Z + pip_install --user tlparse==0.3.25 2024-08-20T22:21:17.0521829Z + pip install --progress-bar off --user tlparse==0.3.25 2024-08-20T22:21:17.4965091Z Collecting tlparse==0.3.25 2024-08-20T22:21:17.5147950Z Downloading tlparse-0.3.25-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (1.7 kB) 2024-08-20T22:21:17.5797289Z Downloading tlparse-0.3.25-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.2 MB) 2024-08-20T22:21:18.2622004Z Installing collected packages: tlparse 2024-08-20T22:21:18.2950479Z Successfully installed tlparse-0.3.25 2024-08-20T22:21:18.3749376Z ++ python -m site --user-base 2024-08-20T22:21:18.3990603Z + PATH=/var/lib/jenkins/.local/bin:/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-08-20T22:21:18.3992845Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *asan* ]] 2024-08-20T22:21:18.3993658Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *-debug* ]] 2024-08-20T22:21:18.3994593Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *-bazel-* ]] 2024-08-20T22:21:18.3995735Z + echo 'We are not in debug mode: linux-focal-cuda12.1-py3.10-gcc9-sm86. Expect the assertion to pass' 2024-08-20T22:21:18.3996889Z We are not in debug mode: linux-focal-cuda12.1-py3.10-gcc9-sm86. Expect the assertion to pass 2024-08-20T22:21:18.3997593Z + cd test 2024-08-20T22:21:18.3998160Z + python -c 'import torch; torch._C._crash_if_debug_asserts_fail(424242)' 2024-08-20T22:21:20.0161624Z + [[ aot_inductor_timm == \n\o\g\p\u\_\N\O\_\A\V\X\2 ]] 2024-08-20T22:21:20.0162213Z + [[ aot_inductor_timm == \n\o\g\p\u\_\A\V\X\5\1\2 ]] 2024-08-20T22:21:20.0165309Z + DYNAMO_BENCHMARK_FLAGS=() 2024-08-20T22:21:20.0165931Z + [[ aot_inductor_timm == *pr_time_benchmarks* ]] 2024-08-20T22:21:20.0166512Z + [[ aot_inductor_timm == *dynamo_eager* ]] 2024-08-20T22:21:20.0166976Z + [[ aot_inductor_timm == *aot_eager* ]] 2024-08-20T22:21:20.0167421Z + [[ aot_inductor_timm == *aot_inductor* ]] 2024-08-20T22:21:20.0168162Z + DYNAMO_BENCHMARK_FLAGS+=(--export-aot-inductor) 2024-08-20T22:21:20.0168674Z + [[ aot_inductor_timm == *dynamic* ]] 2024-08-20T22:21:20.0169100Z + [[ aot_inductor_timm == *cpu* ]] 2024-08-20T22:21:20.0169575Z + DYNAMO_BENCHMARK_FLAGS+=(--device cuda) 2024-08-20T22:21:20.0197679Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *libtorch* ]] 2024-08-20T22:21:20.0198490Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *-bazel-* ]] 2024-08-20T22:21:20.0200830Z + cd test 2024-08-20T22:21:20.0201561Z + python -c 'import torch; print(torch.__config__.show())' 2024-08-20T22:21:21.4767953Z PyTorch built with: 2024-08-20T22:21:21.4768682Z - GCC 9.4 2024-08-20T22:21:21.4769032Z - C++ Version: 201703 2024-08-20T22:21:21.4769878Z - Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications 2024-08-20T22:21:21.4770969Z - Intel(R) MKL-DNN v3.4.2 (Git Hash 1137e04ec0b5251ca2b4400a4fd3c667ce843d67) 2024-08-20T22:21:21.4771639Z - OpenMP 201511 (a.k.a. OpenMP 4.5) 2024-08-20T22:21:21.4772192Z - LAPACK is enabled (usually provided by MKL) 2024-08-20T22:21:21.4772672Z - NNPACK is enabled 2024-08-20T22:21:21.4773055Z - CPU capability usage: AVX2 2024-08-20T22:21:21.4773467Z - CUDA Runtime 12.1 2024-08-20T22:21:21.4773984Z - NVCC architecture flags: -gencode;arch=compute_86,code=sm_86 2024-08-20T22:21:21.4774583Z - CuDNN 90.1 (built against CUDA 12.4) 2024-08-20T22:21:21.4775027Z - Magma 2.6.1 2024-08-20T22:21:21.4782418Z - Build settings: BLAS_INFO=mkl, BUILD_TYPE=Release, CUDA_VERSION=12.1, CUDNN_VERSION=9.1.0, CXX_COMPILER=/opt/cache/bin/c++, CXX_FLAGS= -D_GLIBCXX_USE_CXX11_ABI=1 -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOROCTRACER -DLIBKINETO_NOXPUPTI=ON -DUSE_FBGEMM -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -O2 -fPIC -Wall -Wextra -Werror=return-type -Werror=non-virtual-dtor -Werror=bool-operation -Wnarrowing -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-unused-parameter -Wno-strict-overflow -Wno-strict-aliasing -Wno-stringop-overflow -Wsuggest-override -Wno-psabi -Wno-error=old-style-cast -Wno-missing-braces -fdiagnostics-color=always -faligned-new -Werror -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Wno-stringop-overflow, FORCE_FALLBACK_CUDA_MPI=1, LAPACK_INFO=mkl, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, PERF_WITH_AVX512=1, TORCH_VERSION=2.5.0, USE_CUDA=ON, USE_CUDNN=ON, USE_CUSPARSELT=ON, USE_EXCEPTION_PTR=1, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_GLOO=ON, USE_MKL=ON, USE_MKLDNN=ON, USE_MPI=ON, USE_NCCL=ON, USE_NNPACK=ON, USE_OPENMP=ON, USE_ROCM=OFF, USE_ROCM_KERNEL_ASSERT=OFF, 2024-08-20T22:21:21.4788753Z 2024-08-20T22:21:21.7957845Z + cd test 2024-08-20T22:21:21.7958564Z + python -c 'import torch; print(torch.__config__.parallel_info())' 2024-08-20T22:21:23.1312721Z ATen/Parallel: 2024-08-20T22:21:23.1313230Z at::get_num_threads() : 8 2024-08-20T22:21:23.1313728Z at::get_num_interop_threads() : 16 2024-08-20T22:21:23.1314312Z OpenMP 201511 (a.k.a. OpenMP 4.5) 2024-08-20T22:21:23.1314707Z omp_get_max_threads() : 8 2024-08-20T22:21:23.1315765Z Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications 2024-08-20T22:21:23.1316563Z mkl_get_max_threads() : 8 2024-08-20T22:21:23.1317190Z Intel(R) MKL-DNN v3.4.2 (Git Hash 1137e04ec0b5251ca2b4400a4fd3c667ce843d67) 2024-08-20T22:21:23.1317813Z std::thread::hardware_concurrency() : 16 2024-08-20T22:21:23.1318352Z Environment variables: 2024-08-20T22:21:23.1318698Z OMP_NUM_THREADS : [not set] 2024-08-20T22:21:23.1319066Z MKL_NUM_THREADS : [not set] 2024-08-20T22:21:23.1319434Z ATen parallel backend: OpenMP 2024-08-20T22:21:23.1319690Z 2024-08-20T22:21:23.4083561Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *aarch64* ]] 2024-08-20T22:21:23.4084324Z + [[ aot_inductor_timm == *backward* ]] 2024-08-20T22:21:23.4084874Z + [[ aot_inductor_timm == *xla* ]] 2024-08-20T22:21:23.4085351Z + [[ aot_inductor_timm == *executorch* ]] 2024-08-20T22:21:23.4086012Z + [[ aot_inductor_timm == \j\i\t\_\l\e\g\a\c\y ]] 2024-08-20T22:21:23.4086889Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *libtorch* ]] 2024-08-20T22:21:23.4087574Z + [[ aot_inductor_timm == distributed ]] 2024-08-20T22:21:23.4088228Z + [[ aot_inductor_timm == *inductor_distributed* ]] 2024-08-20T22:21:23.4088998Z + [[ aot_inductor_timm == *inductor-halide* ]] 2024-08-20T22:21:23.4089613Z + [[ aot_inductor_timm == *inductor-micro-benchmark* ]] 2024-08-20T22:21:23.4090144Z + [[ aot_inductor_timm == *huggingface* ]] 2024-08-20T22:21:23.4090579Z + [[ aot_inductor_timm == *timm* ]] 2024-08-20T22:21:23.4090974Z + install_torchvision 2024-08-20T22:21:23.4091293Z + local orig_preload 2024-08-20T22:21:23.4091608Z + local commit 2024-08-20T22:21:23.4091918Z ++ get_pinned_commit vision 2024-08-20T22:21:23.4092302Z ++ cat .github/ci_commit_pins/vision.txt 2024-08-20T22:21:23.4106025Z + commit=d23a6e1664d20707c11781299611436e1f0c104f 2024-08-20T22:21:23.4106473Z + orig_preload= 2024-08-20T22:21:23.4106840Z + '[' -n '' ']' 2024-08-20T22:21:23.4107671Z + pip_install --no-use-pep517 --user git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2024-08-20T22:21:23.4109089Z + pip install --progress-bar off --no-use-pep517 --user git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2024-08-20T22:21:23.7445603Z Collecting git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2024-08-20T22:21:23.7450671Z Cloning https://github.com/pytorch/vision.git (to revision d23a6e1664d20707c11781299611436e1f0c104f) to /tmp/pip-req-build-82gfafq0 2024-08-20T22:21:23.7481040Z Running command git clone --filter=blob:none --quiet https://github.com/pytorch/vision.git /tmp/pip-req-build-82gfafq0 2024-08-20T22:21:25.2606317Z Running command git rev-parse -q --verify 'sha^d23a6e1664d20707c11781299611436e1f0c104f' 2024-08-20T22:21:25.2635404Z Running command git fetch -q https://github.com/pytorch/vision.git d23a6e1664d20707c11781299611436e1f0c104f 2024-08-20T22:21:26.5932577Z Running command git checkout -q d23a6e1664d20707c11781299611436e1f0c104f 2024-08-20T22:21:26.9101069Z Resolved https://github.com/pytorch/vision.git to commit d23a6e1664d20707c11781299611436e1f0c104f 2024-08-20T22:21:29.3603915Z Preparing metadata (setup.py) ... [?25l- \ done 2024-08-20T22:21:29.3637835Z [?25hRequirement already satisfied: numpy in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (1.22.4) 2024-08-20T22:21:29.3641667Z Requirement already satisfied: torch in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (2.5.0a0+git40ec5f6) 2024-08-20T22:21:29.3647930Z Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (10.3.0) 2024-08-20T22:21:29.3719978Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (3.13.1) 2024-08-20T22:21:29.3725239Z Requirement already satisfied: typing-extensions>=4.8.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (4.12.2) 2024-08-20T22:21:29.3728108Z Requirement already satisfied: networkx in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (2.8.8) 2024-08-20T22:21:29.3731772Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (3.1.4) 2024-08-20T22:21:29.3736048Z Requirement already satisfied: fsspec in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (2024.6.1) 2024-08-20T22:21:29.3742625Z Requirement already satisfied: sympy==1.13.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (1.13.1) 2024-08-20T22:21:29.3759339Z Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from sympy==1.13.1->torch->torchvision==0.19.0a0+d23a6e1) (1.3.0) 2024-08-20T22:21:29.4242865Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from jinja2->torch->torchvision==0.19.0a0+d23a6e1) (2.1.5) 2024-08-20T22:21:29.4307257Z Building wheels for collected packages: torchvision 2024-08-20T22:22:46.6659054Z Building wheel for torchvision (setup.py) ... [?25l- \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ done 2024-08-20T22:22:46.6691949Z [?25h Created wheel for torchvision: filename=torchvision-0.19.0a0+d23a6e1-cp310-cp310-linux_x86_64.whl size=2116263 sha256=ae640d883cf671c7d6c94f3d76028a2c917ec0c7f76a78c4f6e496645d55a7a3 2024-08-20T22:22:46.6693593Z Stored in directory: /var/lib/jenkins/.cache/pip/wheels/0e/56/35/02931e71eb23fd2b85591c7ec05b733ca7c8b328a2fd151f96 2024-08-20T22:22:46.6727776Z Successfully built torchvision 2024-08-20T22:22:47.1641870Z Installing collected packages: torchvision 2024-08-20T22:22:47.5784271Z Successfully installed torchvision-0.19.0a0+d23a6e1 2024-08-20T22:22:47.7209026Z + '[' -n '' ']' 2024-08-20T22:22:47.7209373Z + id=1 2024-08-20T22:22:47.7209679Z + test_dynamo_benchmark timm_models 1 2024-08-20T22:22:47.7211887Z ++ pwd 2024-08-20T22:22:47.7216036Z + TEST_REPORTS_DIR=/var/lib/jenkins/workspace/test/test-reports 2024-08-20T22:22:47.7217945Z + local suite=timm_models 2024-08-20T22:22:47.7218279Z + shift 2024-08-20T22:22:47.7218547Z + local shard_id=1 2024-08-20T22:22:47.7218842Z + shift 2024-08-20T22:22:47.7219151Z + [[ aot_inductor_timm == *perf_compare* ]] 2024-08-20T22:22:47.7219685Z + [[ aot_inductor_timm == *perf* ]] 2024-08-20T22:22:47.7220180Z + [[ aot_inductor_timm == *cpu* ]] 2024-08-20T22:22:47.7220730Z + [[ aot_inductor_timm == *aot_inductor* ]] 2024-08-20T22:22:47.7221542Z + test_single_dynamo_benchmark inference timm_models 1 --inference --bfloat16 2024-08-20T22:22:47.7222507Z ++ pwd 2024-08-20T22:22:47.7224622Z + TEST_REPORTS_DIR=/var/lib/jenkins/workspace/test/test-reports 2024-08-20T22:22:47.7225351Z + mkdir -p /var/lib/jenkins/workspace/test/test-reports 2024-08-20T22:22:47.7250520Z + local name=inference 2024-08-20T22:22:47.7251002Z + shift 2024-08-20T22:22:47.7251369Z + local suite=timm_models 2024-08-20T22:22:47.7251702Z + shift 2024-08-20T22:22:47.7251982Z + local shard_id=1 2024-08-20T22:22:47.7252338Z + shift 2024-08-20T22:22:47.7254417Z + partition_flags=() 2024-08-20T22:22:47.7254912Z + local partition_flags 2024-08-20T22:22:47.7255424Z + [[ -n 2 ]] 2024-08-20T22:22:47.7255775Z + [[ -n 1 ]] 2024-08-20T22:22:47.7256433Z + partition_flags=(--total-partitions "$NUM_TEST_SHARDS" --partition-id "$shard_id") 2024-08-20T22:22:47.7257121Z + [[ aot_inductor_timm == *perf_compare* ]] 2024-08-20T22:22:47.7257563Z + [[ aot_inductor_timm == *perf* ]] 2024-08-20T22:22:47.7257996Z + [[ aot_inductor_timm == *aot_inductor* ]] 2024-08-20T22:22:47.7258479Z + [[ aot_inductor_timm != *cpu_aot_inductor* ]] 2024-08-20T22:22:47.7259078Z + export TORCHINDUCTOR_ABI_COMPATIBLE=1 2024-08-20T22:22:47.7259504Z + TORCHINDUCTOR_ABI_COMPATIBLE=1 2024-08-20T22:22:47.7259903Z + [[ aot_inductor_timm == *_avx2* ]] 2024-08-20T22:22:47.7260317Z + [[ aot_inductor_timm == *_avx512* ]] 2024-08-20T22:22:47.7261974Z + python benchmarks/dynamo/timm_models.py --ci --accuracy --timing --explain --export-aot-inductor --device cuda --inference --bfloat16 --total-partitions 2 --partition-id 1 --output /var/lib/jenkins/workspace/test/test-reports/inference_timm_models.csv 2024-08-20T22:22:54.1102573Z 2024-08-20T22:22:54.2586327Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:22:54.2586659Z 2024-08-20T22:22:54.3421277Z model.safetensors: 0% 0.00/29.6M [00:00 /dev/null 2>&1; then 2024-08-20T22:50:07.5598115Z  zip -r "logs-${FILE_SUFFIX}.zip" test -i '*.log' 2024-08-20T22:50:07.5598757Z fi 2024-08-20T22:50:07.5607616Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:50:07.5608120Z env: 2024-08-20T22:50:07.5608388Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:50:07.5608842Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:50:07.5609581Z DOCKER_CONTAINER_ID: f01dd8f201efb155f69d5d60003111fed3eca9f968be8324fd6f52952d51c493 2024-08-20T22:50:07.5610500Z FILE_SUFFIX: test-aot_inductor_timm-2-2-amz2023.linux.g5.4xlarge.nvidia.gpu_29026530319 2024-08-20T22:50:07.5611163Z ##[endgroup] 2024-08-20T22:50:07.5676717Z adding: usage_log.txt (deflated 92%) 2024-08-20T22:50:07.5765232Z ##[group]Run # Remove any previous debugging artifacts if they exist 2024-08-20T22:50:07.5765948Z # Remove any previous debugging artifacts if they exist 2024-08-20T22:50:07.5766505Z rm -f debug-*.zip 2024-08-20T22:50:07.5766884Z if [ -d 'test/debug' ]; then 2024-08-20T22:50:07.5767380Z  zip -r "debug-${FILE_SUFFIX}.zip" test/debug 2024-08-20T22:50:07.5767860Z fi 2024-08-20T22:50:07.5775934Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:50:07.5776437Z env: 2024-08-20T22:50:07.5776710Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:50:07.5777164Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:50:07.5777910Z DOCKER_CONTAINER_ID: f01dd8f201efb155f69d5d60003111fed3eca9f968be8324fd6f52952d51c493 2024-08-20T22:50:07.5778833Z FILE_SUFFIX: test-aot_inductor_timm-2-2-amz2023.linux.g5.4xlarge.nvidia.gpu_29026530319 2024-08-20T22:50:07.5779492Z ##[endgroup] 2024-08-20T22:50:07.5872460Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-08-20T22:50:07.5872898Z with: 2024-08-20T22:50:07.5873182Z s3-bucket: gha-artifacts 2024-08-20T22:50:07.5873801Z s3-prefix: pytorch/pytorch/10479310725/1/artifact 2024-08-20T22:50:07.5874275Z retention-days: 14 2024-08-20T22:50:07.5874602Z if-no-files-found: warn 2024-08-20T22:50:07.5874956Z path: test-jsons-*.zip 2024-08-20T22:50:07.5875295Z name: artifact 2024-08-20T22:50:07.5875597Z region: us-east-1 2024-08-20T22:50:07.5875894Z env: 2024-08-20T22:50:07.5876164Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:50:07.5876608Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:50:07.5877339Z DOCKER_CONTAINER_ID: f01dd8f201efb155f69d5d60003111fed3eca9f968be8324fd6f52952d51c493 2024-08-20T22:50:07.5877984Z ##[endgroup] 2024-08-20T22:50:07.9385489Z NOTE: s3-prefix specified, ignoring name parameter 2024-08-20T22:50:07.9386174Z With the provided path, there will be 1 file uploaded 2024-08-20T22:50:07.9386797Z Uploading to s3 prefix: pytorch/pytorch/10479310725/1/artifact 2024-08-20T22:50:07.9444611Z Starting upload of test-jsons-test-aot_inductor_timm-2-2-amz2023.linux.g5.4xlarge.nvidia.gpu_29026530319.zip 2024-08-20T22:50:08.0566050Z Finished upload of test-jsons-test-aot_inductor_timm-2-2-amz2023.linux.g5.4xlarge.nvidia.gpu_29026530319.zip 2024-08-20T22:50:08.0845903Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-08-20T22:50:08.0846691Z with: 2024-08-20T22:50:08.0847008Z s3-bucket: gha-artifacts 2024-08-20T22:50:08.0847443Z s3-prefix: pytorch/pytorch/10479310725/1/artifact 2024-08-20T22:50:08.0847903Z retention-days: 14 2024-08-20T22:50:08.0848239Z if-no-files-found: error 2024-08-20T22:50:08.0848605Z path: test-reports-*.zip 2024-08-20T22:50:08.0848954Z name: artifact 2024-08-20T22:50:08.0849244Z region: us-east-1 2024-08-20T22:50:08.0849544Z env: 2024-08-20T22:50:08.0849813Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:50:08.0850266Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:50:08.0850995Z DOCKER_CONTAINER_ID: f01dd8f201efb155f69d5d60003111fed3eca9f968be8324fd6f52952d51c493 2024-08-20T22:50:08.0851634Z ##[endgroup] 2024-08-20T22:50:08.4360933Z NOTE: s3-prefix specified, ignoring name parameter 2024-08-20T22:50:08.4361594Z With the provided path, there will be 1 file uploaded 2024-08-20T22:50:08.4362208Z Uploading to s3 prefix: pytorch/pytorch/10479310725/1/artifact 2024-08-20T22:50:08.4418181Z Starting upload of test-reports-test-aot_inductor_timm-2-2-amz2023.linux.g5.4xlarge.nvidia.gpu_29026530319.zip 2024-08-20T22:50:08.5307858Z Finished upload of test-reports-test-aot_inductor_timm-2-2-amz2023.linux.g5.4xlarge.nvidia.gpu_29026530319.zip 2024-08-20T22:50:08.5586236Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-08-20T22:50:08.5586685Z with: 2024-08-20T22:50:08.5586968Z s3-bucket: gha-artifacts 2024-08-20T22:50:08.5587405Z s3-prefix: pytorch/pytorch/10479310725/1/artifact 2024-08-20T22:50:08.5587882Z retention-days: 14 2024-08-20T22:50:08.5588223Z if-no-files-found: ignore 2024-08-20T22:50:08.5588577Z path: logs-*.zip 2024-08-20T22:50:08.5588890Z name: artifact 2024-08-20T22:50:08.5589196Z region: us-east-1 2024-08-20T22:50:08.5589519Z env: 2024-08-20T22:50:08.5589793Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:50:08.5590247Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:50:08.5590987Z DOCKER_CONTAINER_ID: f01dd8f201efb155f69d5d60003111fed3eca9f968be8324fd6f52952d51c493 2024-08-20T22:50:08.5591639Z ##[endgroup] 2024-08-20T22:50:08.9124289Z NOTE: s3-prefix specified, ignoring name parameter 2024-08-20T22:50:08.9124893Z With the provided path, there will be 1 file uploaded 2024-08-20T22:50:08.9125504Z Uploading to s3 prefix: pytorch/pytorch/10479310725/1/artifact 2024-08-20T22:50:08.9181083Z Starting upload of logs-test-aot_inductor_timm-2-2-amz2023.linux.g5.4xlarge.nvidia.gpu_29026530319.zip 2024-08-20T22:50:09.0326350Z Finished upload of logs-test-aot_inductor_timm-2-2-amz2023.linux.g5.4xlarge.nvidia.gpu_29026530319.zip 2024-08-20T22:50:09.0604769Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-08-20T22:50:09.0605220Z with: 2024-08-20T22:50:09.0605501Z s3-bucket: gha-artifacts 2024-08-20T22:50:09.0606124Z s3-prefix: pytorch/pytorch/10479310725/1/artifact 2024-08-20T22:50:09.0606600Z retention-days: 14 2024-08-20T22:50:09.0606940Z if-no-files-found: ignore 2024-08-20T22:50:09.0607293Z path: debug-*.zip 2024-08-20T22:50:09.0607612Z name: artifact 2024-08-20T22:50:09.0607934Z region: us-east-1 2024-08-20T22:50:09.0608229Z env: 2024-08-20T22:50:09.0608504Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:50:09.0608959Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:50:09.0609701Z DOCKER_CONTAINER_ID: f01dd8f201efb155f69d5d60003111fed3eca9f968be8324fd6f52952d51c493 2024-08-20T22:50:09.0610346Z ##[endgroup] 2024-08-20T22:50:09.4068997Z No files were found with the provided path: debug-*.zip. No artifacts will be uploaded. 2024-08-20T22:50:09.4347598Z ##[group]Run # shellcheck disable=SC2156 2024-08-20T22:50:09.4348097Z # shellcheck disable=SC2156 2024-08-20T22:50:09.4348897Z find . -iname "core.[1-9]*" -exec docker exec "${DOCKER_CONTAINER_ID}" sh -c "gdb python {} -ex 'bt' -ex 'q'" \; 2024-08-20T22:50:09.4358177Z shell: /usr/bin/bash -e {0} 2024-08-20T22:50:09.4358602Z env: 2024-08-20T22:50:09.4358882Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:50:09.4359335Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:50:09.4360066Z DOCKER_CONTAINER_ID: f01dd8f201efb155f69d5d60003111fed3eca9f968be8324fd6f52952d51c493 2024-08-20T22:50:09.4360713Z ##[endgroup] 2024-08-20T22:50:09.6982671Z ##[group]Run pytorch/test-infra/.github/actions/teardown-linux@main 2024-08-20T22:50:09.6983226Z with: 2024-08-20T22:50:09.6983472Z env: 2024-08-20T22:50:09.6983746Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:50:09.6984199Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:50:09.6984925Z DOCKER_CONTAINER_ID: f01dd8f201efb155f69d5d60003111fed3eca9f968be8324fd6f52952d51c493 2024-08-20T22:50:09.6985562Z ##[endgroup] 2024-08-20T22:50:09.7004796Z ##[group]Run set -eou pipefail 2024-08-20T22:50:09.7005198Z set -eou pipefail 2024-08-20T22:50:09.7005559Z  2024-08-20T22:50:09.7006068Z echo "Holding runner for 2 hours until all ssh sessions have logged out" 2024-08-20T22:50:09.7006710Z for _ in $(seq 1440); do 2024-08-20T22:50:09.7007178Z  # Break if no ssh session exists anymore 2024-08-20T22:50:09.7007680Z  if [ "$(who)" = "" ]; then 2024-08-20T22:50:09.7008091Z  break 2024-08-20T22:50:09.7008432Z  fi 2024-08-20T22:50:09.7008732Z  echo "." 2024-08-20T22:50:09.7009053Z  sleep 5 2024-08-20T22:50:09.7009374Z done 2024-08-20T22:50:09.7018205Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:50:09.7018700Z env: 2024-08-20T22:50:09.7018982Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:50:09.7019441Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:50:09.7020189Z DOCKER_CONTAINER_ID: f01dd8f201efb155f69d5d60003111fed3eca9f968be8324fd6f52952d51c493 2024-08-20T22:50:09.7020836Z ##[endgroup] 2024-08-20T22:50:09.7050848Z Holding runner for 2 hours until all ssh sessions have logged out 2024-08-20T22:50:09.7117169Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2024-08-20T22:50:09.7117925Z # ignore expansion of "docker ps -q" since it could be empty 2024-08-20T22:50:09.7118638Z # shellcheck disable=SC2046 2024-08-20T22:50:09.7119109Z docker stop $(docker ps -q) || true 2024-08-20T22:50:09.7119584Z # Prune all of the docker images 2024-08-20T22:50:09.7120037Z docker system prune -af 2024-08-20T22:50:09.7128135Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:50:09.7128640Z env: 2024-08-20T22:50:09.7128914Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:50:09.7129372Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:50:09.7130110Z DOCKER_CONTAINER_ID: f01dd8f201efb155f69d5d60003111fed3eca9f968be8324fd6f52952d51c493 2024-08-20T22:50:09.7130754Z ##[endgroup] 2024-08-20T22:50:10.2185990Z f01dd8f201ef 2024-08-20T22:50:11.6091896Z Deleted Containers: 2024-08-20T22:50:11.6092532Z f01dd8f201efb155f69d5d60003111fed3eca9f968be8324fd6f52952d51c493 2024-08-20T22:50:11.6092990Z 2024-08-20T22:50:22.3344468Z Deleted Images: 2024-08-20T22:50:22.3346544Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:50:22.3349109Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks@sha256:3a95d3a177465127ef6cd3b50787d6a050367070fd9063dbb688fad07a96b402 2024-08-20T22:50:22.3350787Z deleted: sha256:8fef7805cec6e829013a3d62f158b75bdc2f02cdfe3428c032ea017b488473bb 2024-08-20T22:50:22.3351723Z deleted: sha256:c2ce10014dd98f6abbfbf2265f9780a8204c2a7a27463e61ee565573a23d141d 2024-08-20T22:50:22.3352724Z deleted: sha256:ae249c0e6e6013bd6ffea2ca0b0160c015c9ebf7c03070bc2f983a9ff2415bf5 2024-08-20T22:50:22.3353642Z deleted: sha256:8a73883c1067c0e29ff128f553518682b47ed9707d2f35e7d5138e2caf029d61 2024-08-20T22:50:22.3354528Z deleted: sha256:9c040db729fa084584aaf5573082408a2196bc64e5952270c79dc610ed4680b6 2024-08-20T22:50:22.3355453Z deleted: sha256:17311eeeb8b71b16699880c0f646e185107496c4d41da5d23370603768ec030c 2024-08-20T22:50:22.3356342Z deleted: sha256:07cc10bece8501b1c8035d4385ad9e9867dd6e92fa32218a4dcb3e42af7e0411 2024-08-20T22:50:22.3357607Z deleted: sha256:f3e32d05099d1a3115a4722bc2e94a48752c3e965446773673808252671bb967 2024-08-20T22:50:22.3358643Z deleted: sha256:be7c3f41475e3e72ffe3ac2f92ab2f4cf49d5496b2aae738942ac3bb687d742c 2024-08-20T22:50:22.3359577Z deleted: sha256:4fcac490be825129b468cf458089f1fcf8fd56afc44ef4ab27c2eff41ab1ac90 2024-08-20T22:50:22.3360481Z deleted: sha256:31c66d80a2a4792897f267d363c0cf84fb821c5d4a275ab1636f778fd0284c08 2024-08-20T22:50:22.3361359Z deleted: sha256:8a8bcb6085e7e438e5533e8a5613e2ae5888543853568d023af3e2623a1593a9 2024-08-20T22:50:22.3362245Z deleted: sha256:2f6cb60029c79d11567b738f5bdbfb9cb1838cc0f194c4a5e6ae685178d2ed34 2024-08-20T22:50:22.3363150Z deleted: sha256:e546391804d3313f558e1ac16e93cb29a417a92e4eccaf0d4bd12af3bbcf39e3 2024-08-20T22:50:22.3364037Z deleted: sha256:1623b2aa16f2bdc6b572f6799498d9a92fa8114d07c440599b17aea72e22f8b1 2024-08-20T22:50:22.3364933Z deleted: sha256:c0386ca58b7cb7afee015b7e58d2f70525eaf73d6da2cc63868b20e14b1f9497 2024-08-20T22:50:22.3365823Z deleted: sha256:dcbf534ff289186e246531925fed90f72516eb3d63663bad234d611cdc025d62 2024-08-20T22:50:22.3366705Z deleted: sha256:0bab537af579f56c9cd51c7073fd53635fffb424b363236e0de38a7dd0e60ae8 2024-08-20T22:50:22.3367597Z deleted: sha256:d85a852ae1ee027e2fc17240ed68b87957b0a6d210c9119752d8979a0dcd55cf 2024-08-20T22:50:22.3368478Z deleted: sha256:f3821d761b555362e44cf9a1447d8fd2d95b37d54aea67c7519cd9e5db0c4d7e 2024-08-20T22:50:22.3369366Z deleted: sha256:c05e84a545db5dfcb0847c73d2b0f4749fa67aabce05705632ff7f76c84d4688 2024-08-20T22:50:22.3370272Z deleted: sha256:27054eae7ca67b2bd5ca0fd3f4488bf5c5f78e95487d8c45616f3d753d48a8b5 2024-08-20T22:50:22.3371181Z deleted: sha256:9804139f6ae97796aaa993fe4b89ea0cf111eb4d30a79f4c87c339c2e1e04fa0 2024-08-20T22:50:22.3372070Z deleted: sha256:ad6ae2fc594aaa359ff4e287323836570454eb24dd162930655e414d1d77c6dd 2024-08-20T22:50:22.3372945Z deleted: sha256:9cfbb36e328af52a248853a46aab88e266c09e2b44a03e0a42194a031b9b9453 2024-08-20T22:50:22.3373858Z deleted: sha256:a8a842bd7f37b8d50b6d12d6f95f46bbba57953db466fcbde9ba522625f024ef 2024-08-20T22:50:22.3374692Z deleted: sha256:da9738654b3c86f89ebeed2560f1bae093f1219f1eff90b0394b7f211ecabd04 2024-08-20T22:50:22.3375523Z deleted: sha256:cc683bf0cb245394e0f568984b2dd4fce1b6a3a7fe7c44734bae1aa1caaa3251 2024-08-20T22:50:22.3376346Z deleted: sha256:965f220e71c7d1ec19aaf41b1529ab287beb9d86eb8482c4c14094485ab34475 2024-08-20T22:50:22.3377160Z deleted: sha256:da32ecec41a73ce7dd29464f90c7951510a18cd378753659a78cd7fabd10dc36 2024-08-20T22:50:22.3377984Z deleted: sha256:d828d187cee9ad48dbc3702fb61d359619dd8a1ed582878680b51686bf117e5a 2024-08-20T22:50:22.3379115Z deleted: sha256:712111f4b12ff8e2787597d5fdcb043bd0824e55ddd97f262ef550506ca195f0 2024-08-20T22:50:22.3379931Z deleted: sha256:a064eea405958ad14dc6c794e5df9fd1d4515424272801ec559d45a59317309a 2024-08-20T22:50:22.3380742Z deleted: sha256:e124382d136bd5e9a8b409ca79c1f1ef76458deaf444b1b2060d3fa99dbeb506 2024-08-20T22:50:22.3381579Z deleted: sha256:6e10fe757cc190a1b31b47010f4f7610e02cb1b4b438f190dcd301aa4fe2278e 2024-08-20T22:50:22.3382406Z deleted: sha256:4cea352e10f46ca4729f96ac6c4600fc53d4c36e7658c2e0f19f4f309cd4a2a7 2024-08-20T22:50:22.3383233Z deleted: sha256:518bba00fe1d0933053066d21cac0235c9fb485abbc41557ec184b293095c924 2024-08-20T22:50:22.3384056Z deleted: sha256:a64f9ca42e9f27ff2690c15a5c84312e6efaccad45668d9b496cb542165cfb5a 2024-08-20T22:50:22.3384889Z deleted: sha256:096ea0fa14a6c420658f5276b8a8f5d264c0de7e18161ceda2cfc2f4a92cd9bf 2024-08-20T22:50:22.3385718Z deleted: sha256:6f91c94ce6e3f8034c91c66ee25c66a3d85dba9d813b749bd6d2000942a99edc 2024-08-20T22:50:22.3386550Z deleted: sha256:8f8d255eeae546cead8f9a94d237fa57a99940c0f5d51bc29a9d41c7df9cffd9 2024-08-20T22:50:22.3387447Z deleted: sha256:fe05276f4a49f91eef56bfbc3da87cfff5eb116a827fa2d30efe42ce1c134b40 2024-08-20T22:50:22.3388273Z deleted: sha256:5f83cd75d0669c813d4f58978c92e14305cd8f6a07eb9a60665a583460fa7b59 2024-08-20T22:50:22.3389081Z deleted: sha256:8f7ab6366169d39d8953129f650f1927d2fb1328b3f11e2fd9076adb5f46b93a 2024-08-20T22:50:22.3390029Z deleted: sha256:4146cfd5dba0f5308954749f98596b14a1d8f6d23bd93f7ad86c6c3d72239328 2024-08-20T22:50:22.3390875Z deleted: sha256:c6d83cb9ccc606ff63bb3c4d5a5e1ff1450c619b5aae494303a94ae25971cca0 2024-08-20T22:50:22.3391706Z deleted: sha256:71e037e0a3e0963c4565534a7387c082afcb04475d3ac629acf7a0ab2f49fadc 2024-08-20T22:50:22.3392514Z deleted: sha256:4b31135c564686bdaf23262b901237880aea635655721cc7e8c95dc42b05e06d 2024-08-20T22:50:22.3393332Z deleted: sha256:d09bd5c2f35cedcb846543941ee64ce1f684b52e4285696c93b3fb2032da8579 2024-08-20T22:50:22.3394263Z deleted: sha256:4de7fb7d4fc22212aae5fc1ceb637526916d0cced240d7c93d5edd6b0ea28013 2024-08-20T22:50:22.3395226Z deleted: sha256:69890e3e82746e10aff2f1084f11afb4b95a4a6c26b30f64b7001bc0a5fe32bf 2024-08-20T22:50:22.3396044Z deleted: sha256:0156df53b3224e645336ea52b4bb816f1e8d8c9b591748cd645e5e5649fa507b 2024-08-20T22:50:22.3396861Z deleted: sha256:0664624cb9cc4a386f31bf49919a8d8a11d9fea428d05585d9e6228f754bc7cd 2024-08-20T22:50:22.3397760Z deleted: sha256:8c2ddd5fa535c768c058a23f5cc4b6c64cdd71bb7458491282aabc7f7bb94d69 2024-08-20T22:50:22.3398796Z deleted: sha256:8dd03dbe0e1c5f47dd333074dff4bd00415f2f63727a65bf17866774e2ebbd0d 2024-08-20T22:50:22.3399634Z deleted: sha256:3c56b63e094bd18fad9da7a541d537210bca3b730c590d3641213259f6908d6f 2024-08-20T22:50:22.3400455Z deleted: sha256:51484fef07bd1266d4d6ff3d767751172660fc4cc6a1ffe883523a63c985e31e 2024-08-20T22:50:22.3401272Z deleted: sha256:03e83c94023982ab7dd8dc65a6df2024e342f1b760c91ec7a680ee45824869c7 2024-08-20T22:50:22.3402088Z deleted: sha256:58440ab3e8175b5de94a76485c8689a6dc186015475ebf4b386ebba309c5da34 2024-08-20T22:50:22.3402907Z deleted: sha256:9a980f3383e8aa511f0ef68982cb6dfc53b38d1ac8c3d673cb3ba3d45158c91e 2024-08-20T22:50:22.3403741Z deleted: sha256:cb0269c9cf1c47b6c4188ca7be4db261b5d3fc4b4a5153629e222dba7b1f9f98 2024-08-20T22:50:22.3404576Z deleted: sha256:41f1ba870cdffc05e0bf8d87b640fb9d4c153d7f4f3b775f37f94e9f3d584aad 2024-08-20T22:50:22.3405456Z deleted: sha256:7b502ab352f48e8b6eb5e6824a29f308952a5ee7c7d987562e1df7e47639d7f1 2024-08-20T22:50:22.3406263Z deleted: sha256:6ba5217e18738660e6ca8b7a7ec88845e70b0fd781301520bf46c71d99df3144 2024-08-20T22:50:22.3407086Z deleted: sha256:dd5a1c233594780163726bdbbf5de00f7b6b8dca1dace8a001340714c54baedb 2024-08-20T22:50:22.3407915Z deleted: sha256:c27f0db27da73e01f67f6cb78d10f355e350d829479ba4351d82055bb29f6597 2024-08-20T22:50:22.3408739Z deleted: sha256:4e3ce3c854f35c08be3dd95e0d6e718512a885e4614291d7d8b7cd23f48b7dd8 2024-08-20T22:50:22.3409560Z deleted: sha256:c2d6fb088bbec16e60cf0ad74b016f7287c92e659ec2db01271bc309b4dc6d83 2024-08-20T22:50:22.3410389Z deleted: sha256:35a033279d5c9bd6b862bfa9331d8fcbf98bbaf778a778fabc882384db9204f8 2024-08-20T22:50:22.3411321Z deleted: sha256:ab9b00c496073d62e69e032178858d3d6d4c4bab9e87065d3785c6da57351d00 2024-08-20T22:50:22.3412131Z deleted: sha256:7ed947299e109c2459de6e240d86f049c30f93f2380659ce441d8737b8cd065f 2024-08-20T22:50:22.3412938Z deleted: sha256:410d5a7f7a9a1cb4551c106b9cc728a9dcff598f9be231a351ce6a0a33f81e64 2024-08-20T22:50:22.3413766Z deleted: sha256:5f0021bb56efa14bb93978c01513e2a1187ba30e69bdb0546d0ef39b30873f88 2024-08-20T22:50:22.3414585Z deleted: sha256:c1601aa97eb84151c14da3aeea351201bd99144d36d66b397f6555d80245d86d 2024-08-20T22:50:22.3415421Z deleted: sha256:72af05a89be22accdc1ca5d66dcbbb33993a9ef5997f849df1d4ba4c48049f25 2024-08-20T22:50:22.3416251Z deleted: sha256:38b90c9663dcaa2bc57a4dd3008298e7ea93e9535fa42312b4dc4246e7491af9 2024-08-20T22:50:22.3417093Z deleted: sha256:bda61b6cefb3ec8eeb74fef1ca1c7f9a5845fe5e8f07b8123323e897425d5c29 2024-08-20T22:50:22.3417929Z deleted: sha256:5a18e1aa877074529a84cbddf19f8d5403787823378ceae6b72fb62f78d43037 2024-08-20T22:50:22.3418759Z deleted: sha256:6c3e7df31590f02f10cb71fc4eb27653e9b428df2e6e5421a455b062bd2e39f9 2024-08-20T22:50:22.3419248Z 2024-08-20T22:50:22.3419411Z Total reclaimed space: 44.86GB 2024-08-20T22:50:22.3550505Z Post job cleanup. 2024-08-20T22:50:22.3602965Z Post job cleanup. 2024-08-20T22:50:22.4473977Z [command]/usr/bin/git version 2024-08-20T22:50:22.4521846Z git version 2.40.1 2024-08-20T22:50:22.4560412Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/0621d7dd-121a-4ea9-bcbb-0b4cdd327bb6' before making global git config changes 2024-08-20T22:50:22.4561670Z Adding repository directory to the temporary git global config as a safe directory 2024-08-20T22:50:22.4565519Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-20T22:50:22.4615394Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2024-08-20T22:50:22.4661024Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2024-08-20T22:50:22.5046090Z Entering 'android/libs/fbjni' 2024-08-20T22:50:22.5114493Z Entering 'third_party/FP16' 2024-08-20T22:50:22.5183843Z Entering 'third_party/FXdiv' 2024-08-20T22:50:22.5252663Z Entering 'third_party/NNPACK' 2024-08-20T22:50:22.5320774Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T22:50:22.5389420Z Entering 'third_party/XNNPACK' 2024-08-20T22:50:22.5474010Z Entering 'third_party/benchmark' 2024-08-20T22:50:22.5547999Z Entering 'third_party/cpp-httplib' 2024-08-20T22:50:22.5619707Z Entering 'third_party/cpuinfo' 2024-08-20T22:50:22.5688716Z Entering 'third_party/cudnn_frontend' 2024-08-20T22:50:22.5756691Z Entering 'third_party/cutlass' 2024-08-20T22:50:22.5831863Z Entering 'third_party/eigen' 2024-08-20T22:50:22.5903442Z Entering 'third_party/fbgemm' 2024-08-20T22:50:22.5977446Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:50:22.6047613Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:50:22.6118389Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:50:22.6191606Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:50:22.6260472Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:50:22.6329105Z Entering 'third_party/flatbuffers' 2024-08-20T22:50:22.6401417Z Entering 'third_party/fmt' 2024-08-20T22:50:22.6470623Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:50:22.6539560Z Entering 'third_party/gloo' 2024-08-20T22:50:22.6609467Z Entering 'third_party/googletest' 2024-08-20T22:50:22.6678393Z Entering 'third_party/ideep' 2024-08-20T22:50:22.6743595Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T22:50:22.6823796Z Entering 'third_party/ittapi' 2024-08-20T22:50:22.6893942Z Entering 'third_party/kineto' 2024-08-20T22:50:22.6963440Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:50:22.7028160Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:50:22.7099263Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:50:22.7165463Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:50:22.7231955Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:50:22.7297429Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:50:22.7368224Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:50:22.7434562Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:50:22.7507865Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:50:22.7574951Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:50:22.7644884Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:50:22.7710867Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:50:22.7783210Z Entering 'third_party/mimalloc' 2024-08-20T22:50:22.7852550Z Entering 'third_party/nccl/nccl' 2024-08-20T22:50:22.7922822Z Entering 'third_party/nlohmann' 2024-08-20T22:50:22.7994145Z Entering 'third_party/onnx' 2024-08-20T22:50:22.8077454Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T22:50:22.8149010Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T22:50:22.8225989Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T22:50:22.8295791Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:50:22.8367493Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:50:22.8432972Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:50:22.8502645Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:50:22.8571541Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:50:22.8638299Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:50:22.8703886Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:50:22.8768874Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:50:22.8837524Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:50:22.8908634Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:50:22.9000392Z Entering 'third_party/pocketfft' 2024-08-20T22:50:22.9072014Z Entering 'third_party/protobuf' 2024-08-20T22:50:22.9142952Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:50:22.9215536Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T22:50:22.9289717Z Entering 'third_party/psimd' 2024-08-20T22:50:22.9359592Z Entering 'third_party/pthreadpool' 2024-08-20T22:50:22.9429602Z Entering 'third_party/pybind11' 2024-08-20T22:50:22.9498353Z Entering 'third_party/python-peachpy' 2024-08-20T22:50:22.9566975Z Entering 'third_party/sleef' 2024-08-20T22:50:22.9635086Z Entering 'third_party/tensorpipe' 2024-08-20T22:50:22.9702108Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:50:22.9768386Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:50:22.9834710Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:50:22.9905398Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:50:22.9973468Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:50:23.0068049Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2024-08-20T22:50:23.0104117Z http.https://github.com/.extraheader 2024-08-20T22:50:23.0113977Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader 2024-08-20T22:50:23.0161278Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2024-08-20T22:50:23.0528347Z Entering 'android/libs/fbjni' 2024-08-20T22:50:23.0572442Z http.https://github.com/.extraheader 2024-08-20T22:50:23.0615706Z Entering 'third_party/FP16' 2024-08-20T22:50:23.0663195Z http.https://github.com/.extraheader 2024-08-20T22:50:23.0705810Z Entering 'third_party/FXdiv' 2024-08-20T22:50:23.0754353Z http.https://github.com/.extraheader 2024-08-20T22:50:23.0800700Z Entering 'third_party/NNPACK' 2024-08-20T22:50:23.0843809Z http.https://github.com/.extraheader 2024-08-20T22:50:23.0887867Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T22:50:23.0935273Z http.https://github.com/.extraheader 2024-08-20T22:50:23.0979669Z Entering 'third_party/XNNPACK' 2024-08-20T22:50:23.1025379Z http.https://github.com/.extraheader 2024-08-20T22:50:23.1085211Z Entering 'third_party/benchmark' 2024-08-20T22:50:23.1128518Z http.https://github.com/.extraheader 2024-08-20T22:50:23.1171612Z Entering 'third_party/cpp-httplib' 2024-08-20T22:50:23.1214605Z http.https://github.com/.extraheader 2024-08-20T22:50:23.1261216Z Entering 'third_party/cpuinfo' 2024-08-20T22:50:23.1304147Z http.https://github.com/.extraheader 2024-08-20T22:50:23.1353930Z Entering 'third_party/cudnn_frontend' 2024-08-20T22:50:23.1396679Z http.https://github.com/.extraheader 2024-08-20T22:50:23.1440733Z Entering 'third_party/cutlass' 2024-08-20T22:50:23.1483951Z http.https://github.com/.extraheader 2024-08-20T22:50:23.1533971Z Entering 'third_party/eigen' 2024-08-20T22:50:23.1577773Z http.https://github.com/.extraheader 2024-08-20T22:50:23.1622794Z Entering 'third_party/fbgemm' 2024-08-20T22:50:23.1666561Z http.https://github.com/.extraheader 2024-08-20T22:50:23.1709193Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:50:23.1753142Z http.https://github.com/.extraheader 2024-08-20T22:50:23.1797907Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:50:23.1839918Z http.https://github.com/.extraheader 2024-08-20T22:50:23.1883613Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:50:23.1926176Z http.https://github.com/.extraheader 2024-08-20T22:50:23.1977110Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:50:23.2018336Z http.https://github.com/.extraheader 2024-08-20T22:50:23.2061378Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:50:23.2103222Z http.https://github.com/.extraheader 2024-08-20T22:50:23.2148781Z Entering 'third_party/flatbuffers' 2024-08-20T22:50:23.2191937Z http.https://github.com/.extraheader 2024-08-20T22:50:23.2237295Z Entering 'third_party/fmt' 2024-08-20T22:50:23.2284635Z http.https://github.com/.extraheader 2024-08-20T22:50:23.2328509Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:50:23.2372673Z http.https://github.com/.extraheader 2024-08-20T22:50:23.2415014Z Entering 'third_party/gloo' 2024-08-20T22:50:23.2463864Z http.https://github.com/.extraheader 2024-08-20T22:50:23.2506541Z Entering 'third_party/googletest' 2024-08-20T22:50:23.2554893Z http.https://github.com/.extraheader 2024-08-20T22:50:23.2598287Z Entering 'third_party/ideep' 2024-08-20T22:50:23.2641893Z http.https://github.com/.extraheader 2024-08-20T22:50:23.2684441Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T22:50:23.2726469Z http.https://github.com/.extraheader 2024-08-20T22:50:23.2778887Z Entering 'third_party/ittapi' 2024-08-20T22:50:23.2821415Z http.https://github.com/.extraheader 2024-08-20T22:50:23.2863556Z Entering 'third_party/kineto' 2024-08-20T22:50:23.2907085Z http.https://github.com/.extraheader 2024-08-20T22:50:23.2954071Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:50:23.2996950Z http.https://github.com/.extraheader 2024-08-20T22:50:23.3042059Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:50:23.3085560Z http.https://github.com/.extraheader 2024-08-20T22:50:23.3130258Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:50:23.3173511Z http.https://github.com/.extraheader 2024-08-20T22:50:23.3216913Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:50:23.3264578Z http.https://github.com/.extraheader 2024-08-20T22:50:23.3308789Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:50:23.3358095Z http.https://github.com/.extraheader 2024-08-20T22:50:23.3400026Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:50:23.3443941Z http.https://github.com/.extraheader 2024-08-20T22:50:23.3492281Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:50:23.3535168Z http.https://github.com/.extraheader 2024-08-20T22:50:23.3585748Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:50:23.3633174Z http.https://github.com/.extraheader 2024-08-20T22:50:23.3678189Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:50:23.3724529Z http.https://github.com/.extraheader 2024-08-20T22:50:23.3770079Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:50:23.3813901Z http.https://github.com/.extraheader 2024-08-20T22:50:23.3865417Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:50:23.3907998Z http.https://github.com/.extraheader 2024-08-20T22:50:23.3953000Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:50:23.3995180Z http.https://github.com/.extraheader 2024-08-20T22:50:23.4040894Z Entering 'third_party/mimalloc' 2024-08-20T22:50:23.4084415Z http.https://github.com/.extraheader 2024-08-20T22:50:23.4128608Z Entering 'third_party/nccl/nccl' 2024-08-20T22:50:23.4171949Z http.https://github.com/.extraheader 2024-08-20T22:50:23.4215655Z Entering 'third_party/nlohmann' 2024-08-20T22:50:23.4264006Z http.https://github.com/.extraheader 2024-08-20T22:50:23.4309556Z Entering 'third_party/onnx' 2024-08-20T22:50:23.4353399Z http.https://github.com/.extraheader 2024-08-20T22:50:23.4409481Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T22:50:23.4452765Z http.https://github.com/.extraheader 2024-08-20T22:50:23.4496240Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T22:50:23.4538633Z http.https://github.com/.extraheader 2024-08-20T22:50:23.4587014Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T22:50:23.4633943Z http.https://github.com/.extraheader 2024-08-20T22:50:23.4678716Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:50:23.4721035Z http.https://github.com/.extraheader 2024-08-20T22:50:23.4764669Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:50:23.4807076Z http.https://github.com/.extraheader 2024-08-20T22:50:23.4850757Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:50:23.4892963Z http.https://github.com/.extraheader 2024-08-20T22:50:23.4935682Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:50:23.4977543Z http.https://github.com/.extraheader 2024-08-20T22:50:23.5022248Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:50:23.5065213Z http.https://github.com/.extraheader 2024-08-20T22:50:23.5112056Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:50:23.5154911Z http.https://github.com/.extraheader 2024-08-20T22:50:23.5197903Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:50:23.5245242Z http.https://github.com/.extraheader 2024-08-20T22:50:23.5286923Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:50:23.5330168Z http.https://github.com/.extraheader 2024-08-20T22:50:23.5378366Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:50:23.5420892Z http.https://github.com/.extraheader 2024-08-20T22:50:23.5468108Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:50:23.5511193Z http.https://github.com/.extraheader 2024-08-20T22:50:23.5577704Z Entering 'third_party/pocketfft' 2024-08-20T22:50:23.5620943Z http.https://github.com/.extraheader 2024-08-20T22:50:23.5663513Z Entering 'third_party/protobuf' 2024-08-20T22:50:23.5706678Z http.https://github.com/.extraheader 2024-08-20T22:50:23.5751535Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:50:23.5794275Z http.https://github.com/.extraheader 2024-08-20T22:50:23.5843033Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T22:50:23.5886038Z http.https://github.com/.extraheader 2024-08-20T22:50:23.5933139Z Entering 'third_party/psimd' 2024-08-20T22:50:23.5977570Z http.https://github.com/.extraheader 2024-08-20T22:50:23.6020923Z Entering 'third_party/pthreadpool' 2024-08-20T22:50:23.6063772Z http.https://github.com/.extraheader 2024-08-20T22:50:23.6107693Z Entering 'third_party/pybind11' 2024-08-20T22:50:23.6151371Z http.https://github.com/.extraheader 2024-08-20T22:50:23.6194826Z Entering 'third_party/python-peachpy' 2024-08-20T22:50:23.6242703Z http.https://github.com/.extraheader 2024-08-20T22:50:23.6285912Z Entering 'third_party/sleef' 2024-08-20T22:50:23.6329015Z http.https://github.com/.extraheader 2024-08-20T22:50:23.6372185Z Entering 'third_party/tensorpipe' 2024-08-20T22:50:23.6415342Z http.https://github.com/.extraheader 2024-08-20T22:50:23.6464006Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:50:23.6506301Z http.https://github.com/.extraheader 2024-08-20T22:50:23.6552352Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:50:23.6594281Z http.https://github.com/.extraheader 2024-08-20T22:50:23.6637187Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:50:23.6683943Z http.https://github.com/.extraheader 2024-08-20T22:50:23.6728065Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:50:23.6771388Z http.https://github.com/.extraheader 2024-08-20T22:50:23.6813791Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:50:23.6857439Z http.https://github.com/.extraheader 2024-08-20T22:50:23.7016296Z A job completed hook has been configured by the self-hosted runner administrator 2024-08-20T22:50:23.7038410Z ##[group]Run '/home/ec2-user/runner-scripts/after_job.sh' 2024-08-20T22:50:23.7046949Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:50:23.7047469Z ##[endgroup] 2024-08-20T22:50:30.5713087Z Cleaning up orphan processes