2024-08-20T22:10:15.2697798Z Current runner version: '2.319.1' 2024-08-20T22:10:15.2704131Z Runner name: 'i-005bdc4da2a364029' 2024-08-20T22:10:15.2704897Z Runner group name: 'Default' 2024-08-20T22:10:15.2705772Z Machine name: 'ip-10-0-67-221' 2024-08-20T22:10:15.2722628Z Testing runner upgrade compatibility 2024-08-20T22:10:15.4083449Z ##[group]GITHUB_TOKEN Permissions 2024-08-20T22:10:15.4085742Z Actions: read 2024-08-20T22:10:15.4086351Z Attestations: read 2024-08-20T22:10:15.4086842Z Checks: read 2024-08-20T22:10:15.4087407Z Contents: read 2024-08-20T22:10:15.4088043Z Deployments: read 2024-08-20T22:10:15.4088585Z Discussions: read 2024-08-20T22:10:15.4089126Z Issues: read 2024-08-20T22:10:15.4089648Z Metadata: read 2024-08-20T22:10:15.4090165Z Packages: read 2024-08-20T22:10:15.4090709Z Pages: read 2024-08-20T22:10:15.4091273Z PullRequests: read 2024-08-20T22:10:15.4091835Z RepositoryProjects: read 2024-08-20T22:10:15.4092620Z SecurityEvents: read 2024-08-20T22:10:15.4093134Z Statuses: read 2024-08-20T22:10:15.4093879Z ##[endgroup] 2024-08-20T22:10:15.4097095Z Secret source: Actions 2024-08-20T22:10:15.4097972Z Prepare workflow directory 2024-08-20T22:10:15.9265111Z Prepare all required actions 2024-08-20T22:10:15.9440651Z Getting action download info 2024-08-20T22:10:16.1458912Z Download action repository 'pytorch/test-infra@main' (SHA:0c3a2634aaa2f638c8f640e743f03d696ce1191f) 2024-08-20T22:10:16.6979188Z Download action repository 'pytorch/pytorch@main' (SHA:1ae5d5bb62141d7c9b1b0b66c66a462b4e10b1f2) 2024-08-20T22:10:20.7681149Z Download action repository 'aws-actions/configure-aws-credentials@v3' (SHA:50ac8dd1e1b10d09dac7b8727528b91bed831ac0) 2024-08-20T22:10:21.0073518Z Download action repository 'seemethere/upload-artifact-s3@v5' (SHA:baba72d0712b404f646cebe0730933554ebce96a) 2024-08-20T22:10:21.3099295Z Getting action download info 2024-08-20T22:10:21.4043549Z Download action repository 'malfet/checkout@silent-checkout' (SHA:e07af140b3ccefc05679e3755b9db68f4ee4589c) 2024-08-20T22:10:21.6647739Z Getting action download info 2024-08-20T22:10:21.7587095Z Download action repository 'nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482' (SHA:3e91a01664abd3c5cd539100d10d33b9c5b68482) 2024-08-20T22:10:21.9311331Z Uses: pytorch/pytorch/.github/workflows/_linux-test.yml@refs/tags/ciflow/inductor/133712 (40ec5f6ddd9787aca0449b24128343ff4c4a88b3) 2024-08-20T22:10:21.9313736Z ##[group] Inputs 2024-08-20T22:10:21.9314217Z build-environment: linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-08-20T22:10:21.9323975Z test-matrix: {"include": [{"config": "inductor", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_distributed", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.g5.12xlarge.nvidia.gpu"}, {"config": "inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_timm", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_timm", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_timm", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_timm", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_timm", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_timm", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_cpp_wrapper_abi_compatible", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}]} 2024-08-20T22:10:21.9334869Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:10:21.9336078Z sync-tag: 2024-08-20T22:10:21.9336959Z timeout-minutes: 240 2024-08-20T22:10:21.9337311Z use-gha: 2024-08-20T22:10:21.9337626Z dashboard-tag: 2024-08-20T22:10:21.9337971Z s3-bucket: gha-artifacts 2024-08-20T22:10:21.9338351Z aws-role-to-assume: 2024-08-20T22:10:21.9338709Z ##[endgroup] 2024-08-20T22:10:21.9339606Z Complete job name: cuda12.1-py3.10-gcc9-sm86 / test (aot_inductor_timm, 1, 2, amz2023.linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:10:22.0018481Z A job started hook has been configured by the self-hosted runner administrator 2024-08-20T22:10:22.0161618Z ##[group]Run '/home/ec2-user/runner-scripts/before_job.sh' 2024-08-20T22:10:22.0173576Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:10:22.0174119Z ##[endgroup] 2024-08-20T22:10:23.8243192Z Runner Type: amz2023.linux.g5.4xlarge.nvidia.gpu 2024-08-20T22:10:23.8243744Z Instance Type: g5.4xlarge 2024-08-20T22:10:23.8244479Z AMI Name: al2023-ami-2023.5.20240701.0-kernel-6.1-x86_64 2024-08-20T22:10:23.8245060Z AMI ID: ami-06c68f701d8090592 2024-08-20T22:10:29.6555631Z ##[group]Run pytorch/test-infra/.github/actions/setup-ssh@main 2024-08-20T22:10:29.6556214Z with: 2024-08-20T22:10:29.6556903Z github-secret: *** 2024-08-20T22:10:29.6557835Z instructions: All testing is done inside the container, to start an interactive session run: docker exec -it $(docker container ps --format '{{.ID}}') bash 2024-08-20T22:10:29.6558827Z activate-with-label: false 2024-08-20T22:10:29.6559201Z label: with-ssh 2024-08-20T22:10:29.6559537Z remove-existing-keys: true 2024-08-20T22:10:29.6559915Z fail-silently: true 2024-08-20T22:10:29.6560238Z env: 2024-08-20T22:10:29.6560521Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:10:29.6560868Z ##[endgroup] 2024-08-20T22:10:29.7470889Z Please see https://github.com/pytorch/pytorch/wiki/Debugging-using-with-ssh-for-Github-Actions for more info. 2024-08-20T22:10:29.7473862Z ciflow reference detected, attempting to extract PR number 2024-08-20T22:10:30.0369732Z Grabbing public ssh keys from https://github.com/pytorch-bot[bot].keys 2024-08-20T22:10:30.0976970Z No SSH keys found for user pytorch-bot[bot] 2024-08-20T22:10:30.0977608Z Grabbing public ssh keys from https://github.com/XuehaiPan.keys 2024-08-20T22:10:30.1933624Z ~/.ssh/authorized_keys file found on node, removing ~/.ssh and starting fresh 2024-08-20T22:10:30.1948646Z Public keys pulled and installed to /home/ec2-user/.ssh/authorized_keys 2024-08-20T22:10:30.1974741Z Login using: ssh ec2-user@ec2-3-236-238-188.compute-1.amazonaws.com 2024-08-20T22:10:30.1975550Z All testing is done inside the container, to start an interactive session run: 2024-08-20T22:10:30.1976379Z docker exec -it $(docker container ps --format '{{.ID}}') bash 2024-08-20T22:10:30.2108924Z ##[group]Run pytorch/pytorch/.github/actions/checkout-pytorch@main 2024-08-20T22:10:30.2109484Z with: 2024-08-20T22:10:30.2109776Z submodules: recursive 2024-08-20T22:10:30.2110114Z fetch-depth: 0 2024-08-20T22:10:30.2110410Z env: 2024-08-20T22:10:30.2110691Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:10:30.2111034Z ##[endgroup] 2024-08-20T22:10:30.2302255Z ##[group]Run retry () { 2024-08-20T22:10:30.2302647Z retry () { 2024-08-20T22:10:30.2303379Z  $* || (sleep 1 && $*) || (sleep 2 && $*) || (sleep 4 && $*) || (sleep 8 && $*) 2024-08-20T22:10:30.2303935Z } 2024-08-20T22:10:30.2304241Z echo "${GITHUB_WORKSPACE}" 2024-08-20T22:10:30.2304664Z if [ -z "${NO_SUDO}" ]; then 2024-08-20T22:10:30.2305149Z  retry sudo rm -rf "${GITHUB_WORKSPACE}" 2024-08-20T22:10:30.2305611Z else 2024-08-20T22:10:30.2305951Z  retry rm -rf "${GITHUB_WORKSPACE}" 2024-08-20T22:10:30.2306386Z fi 2024-08-20T22:10:30.2306729Z mkdir "${GITHUB_WORKSPACE}" 2024-08-20T22:10:30.2317319Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:10:30.2317841Z env: 2024-08-20T22:10:30.2318127Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:10:30.2318480Z NO_SUDO: 2024-08-20T22:10:30.2318766Z ##[endgroup] 2024-08-20T22:10:30.2350827Z /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-20T22:10:36.0995474Z ##[group]Run malfet/checkout@silent-checkout 2024-08-20T22:10:36.0995967Z with: 2024-08-20T22:10:36.0996305Z ref: 40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:10:36.0996752Z fetch-depth: 0 2024-08-20T22:10:36.0997064Z submodules: recursive 2024-08-20T22:10:36.0997396Z quiet-checkout: true 2024-08-20T22:10:36.0997748Z repository: pytorch/pytorch 2024-08-20T22:10:36.0998226Z token: *** 2024-08-20T22:10:36.0998515Z ssh-strict: true 2024-08-20T22:10:36.0998838Z persist-credentials: true 2024-08-20T22:10:36.0999194Z clean: true 2024-08-20T22:10:36.0999531Z sparse-checkout-cone-mode: true 2024-08-20T22:10:36.0999917Z lfs: false 2024-08-20T22:10:36.1000210Z set-safe-directory: true 2024-08-20T22:10:36.1000545Z env: 2024-08-20T22:10:36.1000814Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:10:36.1001149Z ##[endgroup] 2024-08-20T22:10:36.1978313Z Syncing repository: pytorch/pytorch 2024-08-20T22:10:36.1979784Z ##[group]Getting Git version info 2024-08-20T22:10:36.1980527Z Working directory is '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2024-08-20T22:10:36.1981402Z [command]/usr/bin/git version 2024-08-20T22:10:36.1981774Z git version 2.40.1 2024-08-20T22:10:36.1984952Z ##[endgroup] 2024-08-20T22:10:36.2001506Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/ad812442-428a-4eda-8601-b6696ee97e5f' before making global git config changes 2024-08-20T22:10:36.2002764Z Adding repository directory to the temporary git global config as a safe directory 2024-08-20T22:10:36.2003934Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-20T22:10:36.2056917Z Deleting the contents of '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2024-08-20T22:10:36.2060708Z ##[group]Initializing the repository 2024-08-20T22:10:36.2063571Z [command]/usr/bin/git init /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-20T22:10:36.2108855Z hint: Using 'master' as the name for the initial branch. This default branch name 2024-08-20T22:10:36.2109756Z hint: is subject to change. To configure the initial branch name to use in all 2024-08-20T22:10:36.2110603Z hint: of your new repositories, which will suppress this warning, call: 2024-08-20T22:10:36.2111169Z hint: 2024-08-20T22:10:36.2111648Z hint: git config --global init.defaultBranch 2024-08-20T22:10:36.2112130Z hint: 2024-08-20T22:10:36.2112667Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-08-20T22:10:36.2113526Z hint: 'development'. The just-created branch can be renamed via this command: 2024-08-20T22:10:36.2114432Z hint: 2024-08-20T22:10:36.2114773Z hint: git branch -m 2024-08-20T22:10:36.2115529Z Initialized empty Git repository in /home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/ 2024-08-20T22:10:36.2122264Z [command]/usr/bin/git remote add origin https://github.com/pytorch/pytorch 2024-08-20T22:10:36.2184702Z ##[endgroup] 2024-08-20T22:10:36.2185414Z ##[group]Disabling automatic garbage collection 2024-08-20T22:10:36.2188297Z [command]/usr/bin/git config --local gc.auto 0 2024-08-20T22:10:36.2236389Z ##[endgroup] 2024-08-20T22:10:36.2236906Z ##[group]Setting up auth 2024-08-20T22:10:36.2242795Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2024-08-20T22:10:36.2287246Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2024-08-20T22:10:36.2640977Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2024-08-20T22:10:36.2683550Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2024-08-20T22:10:36.3039438Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic *** 2024-08-20T22:10:36.3098727Z ##[endgroup] 2024-08-20T22:10:36.3099339Z ##[group]Fetching the repository 2024-08-20T22:10:36.3105255Z [command]/usr/bin/git -c protocol.version=2 fetch --prune --progress --no-recurse-submodules --quiet origin +refs/heads/*:refs/remotes/origin/* +refs/tags/*:refs/tags/* 2024-08-20T22:10:38.8260612Z remote: Enumerating objects: 1008452 2024-08-20T22:10:38.8261658Z remote: Enumerating objects: 1010229, done. 2024-08-20T22:10:38.8262672Z remote: Counting objects: 0% (1/1777) 2024-08-20T22:10:38.8263634Z remote: Counting objects: 1% (18/1777) 2024-08-20T22:10:38.8264607Z remote: Counting objects: 2% (36/1777) 2024-08-20T22:10:38.8265542Z remote: Counting objects: 3% (54/1777) 2024-08-20T22:10:38.8266599Z remote: Counting objects: 4% (72/1777) 2024-08-20T22:10:38.8267440Z remote: Counting objects: 5% (89/1777) 2024-08-20T22:10:38.8268092Z remote: Counting objects: 6% (107/1777) 2024-08-20T22:10:38.8268624Z remote: Counting objects: 7% (125/1777) 2024-08-20T22:10:38.8269155Z remote: Counting objects: 8% (143/1777) 2024-08-20T22:10:38.8269657Z remote: Counting objects: 9% (160/1777) 2024-08-20T22:10:38.8270174Z remote: Counting objects: 10% (178/1777) 2024-08-20T22:10:38.8270688Z remote: Counting objects: 11% (196/1777) 2024-08-20T22:10:38.8271232Z remote: Counting objects: 12% (214/1777) 2024-08-20T22:10:38.8271733Z remote: Counting objects: 13% (232/1777) 2024-08-20T22:10:38.8272243Z remote: Counting objects: 14% (249/1777) 2024-08-20T22:10:38.8272768Z remote: Counting objects: 15% (267/1777) 2024-08-20T22:10:38.8273282Z remote: Counting objects: 16% (285/1777) 2024-08-20T22:10:38.8273788Z remote: Counting objects: 17% (303/1777) 2024-08-20T22:10:38.8274308Z remote: Counting objects: 18% (320/1777) 2024-08-20T22:10:38.8274822Z remote: Counting objects: 19% (338/1777) 2024-08-20T22:10:38.8275338Z remote: Counting objects: 20% (356/1777) 2024-08-20T22:10:38.8275848Z remote: Counting objects: 21% (374/1777) 2024-08-20T22:10:38.8276370Z remote: Counting objects: 22% (391/1777) 2024-08-20T22:10:38.8276883Z remote: Counting objects: 23% (409/1777) 2024-08-20T22:10:38.8277399Z remote: Counting objects: 24% (427/1777) 2024-08-20T22:10:38.8277903Z remote: Counting objects: 25% (445/1777) 2024-08-20T22:10:38.8278417Z remote: Counting objects: 26% (463/1777) 2024-08-20T22:10:38.8278928Z remote: Counting objects: 27% (480/1777) 2024-08-20T22:10:38.8279733Z remote: Counting objects: 28% (498/1777) 2024-08-20T22:10:38.8280243Z remote: Counting objects: 29% (516/1777) 2024-08-20T22:10:38.8280758Z remote: Counting objects: 30% (534/1777) 2024-08-20T22:10:38.8281271Z remote: Counting objects: 31% (551/1777) 2024-08-20T22:10:38.8281785Z remote: Counting objects: 32% (569/1777) 2024-08-20T22:10:38.8282290Z remote: Counting objects: 33% (587/1777) 2024-08-20T22:10:38.8282953Z remote: Counting objects: 34% (605/1777) 2024-08-20T22:10:38.8283467Z remote: Counting objects: 35% (622/1777) 2024-08-20T22:10:38.8283986Z remote: Counting objects: 36% (640/1777) 2024-08-20T22:10:38.8284488Z remote: Counting objects: 37% (658/1777) 2024-08-20T22:10:38.8285004Z remote: Counting objects: 38% (676/1777) 2024-08-20T22:10:38.8285519Z remote: Counting objects: 39% (694/1777) 2024-08-20T22:10:38.8286037Z remote: Counting objects: 40% (711/1777) 2024-08-20T22:10:38.8286552Z remote: Counting objects: 41% (729/1777) 2024-08-20T22:10:38.8287069Z remote: Counting objects: 42% (747/1777) 2024-08-20T22:10:38.8287578Z remote: Counting objects: 43% (765/1777) 2024-08-20T22:10:38.8288088Z remote: Counting objects: 44% (782/1777) 2024-08-20T22:10:38.8288597Z remote: Counting objects: 45% (800/1777) 2024-08-20T22:10:38.8289112Z remote: Counting objects: 46% (818/1777) 2024-08-20T22:10:38.8289636Z remote: Counting objects: 47% (836/1777) 2024-08-20T22:10:38.8290153Z remote: Counting objects: 48% (853/1777) 2024-08-20T22:10:38.8290658Z remote: Counting objects: 49% (871/1777) 2024-08-20T22:10:38.8291177Z remote: Counting objects: 50% (889/1777) 2024-08-20T22:10:38.8291694Z remote: Counting objects: 51% (907/1777) 2024-08-20T22:10:38.8292300Z remote: Counting objects: 52% (925/1777) 2024-08-20T22:10:38.8292832Z remote: Counting objects: 53% (942/1777) 2024-08-20T22:10:38.8293349Z remote: Counting objects: 54% (960/1777) 2024-08-20T22:10:38.8293863Z remote: Counting objects: 55% (978/1777) 2024-08-20T22:10:38.8294378Z remote: Counting objects: 56% (996/1777) 2024-08-20T22:10:38.8294890Z remote: Counting objects: 57% (1013/1777) 2024-08-20T22:10:38.8295427Z remote: Counting objects: 58% (1031/1777) 2024-08-20T22:10:38.8295958Z remote: Counting objects: 59% (1049/1777) 2024-08-20T22:10:38.8296543Z remote: Counting objects: 60% (1067/1777) 2024-08-20T22:10:38.8297063Z remote: Counting objects: 61% (1084/1777) 2024-08-20T22:10:38.8297582Z remote: Counting objects: 62% (1102/1777) 2024-08-20T22:10:38.8298116Z remote: Counting objects: 63% (1120/1777) 2024-08-20T22:10:38.8298637Z remote: Counting objects: 64% (1138/1777) 2024-08-20T22:10:38.8299153Z remote: Counting objects: 65% (1156/1777) 2024-08-20T22:10:38.8299669Z remote: Counting objects: 66% (1173/1777) 2024-08-20T22:10:38.8300186Z remote: Counting objects: 67% (1191/1777) 2024-08-20T22:10:38.8300711Z remote: Counting objects: 68% (1209/1777) 2024-08-20T22:10:38.8301231Z remote: Counting objects: 69% (1227/1777) 2024-08-20T22:10:38.8301740Z remote: Counting objects: 70% (1244/1777) 2024-08-20T22:10:38.8302254Z remote: Counting objects: 71% (1262/1777) 2024-08-20T22:10:38.8302774Z remote: Counting objects: 72% (1280/1777) 2024-08-20T22:10:38.8303295Z remote: Counting objects: 73% (1298/1777) 2024-08-20T22:10:38.8303803Z remote: Counting objects: 74% (1315/1777) 2024-08-20T22:10:38.8304324Z remote: Counting objects: 75% (1333/1777) 2024-08-20T22:10:38.8304841Z remote: Counting objects: 76% (1351/1777) 2024-08-20T22:10:38.8305354Z remote: Counting objects: 77% (1369/1777) 2024-08-20T22:10:38.8305870Z remote: Counting objects: 78% (1387/1777) 2024-08-20T22:10:38.8306509Z remote: Counting objects: 79% (1404/1777) 2024-08-20T22:10:38.8307056Z remote: Counting objects: 80% (1422/1777) 2024-08-20T22:10:38.8307571Z remote: Counting objects: 81% (1440/1777) 2024-08-20T22:10:38.8308077Z remote: Counting objects: 82% (1458/1777) 2024-08-20T22:10:38.8308591Z remote: Counting objects: 83% (1475/1777) 2024-08-20T22:10:38.8309115Z remote: Counting objects: 84% (1493/1777) 2024-08-20T22:10:38.8309629Z remote: Counting objects: 85% (1511/1777) 2024-08-20T22:10:38.8310223Z remote: Counting objects: 86% (1529/1777) 2024-08-20T22:10:38.8310739Z remote: Counting objects: 87% (1546/1777) 2024-08-20T22:10:38.8311249Z remote: Counting objects: 88% (1564/1777) 2024-08-20T22:10:38.8311769Z remote: Counting objects: 89% (1582/1777) 2024-08-20T22:10:38.8312272Z remote: Counting objects: 90% (1600/1777) 2024-08-20T22:10:38.8312784Z remote: Counting objects: 91% (1618/1777) 2024-08-20T22:10:38.8313309Z remote: Counting objects: 92% (1635/1777) 2024-08-20T22:10:38.8313824Z remote: Counting objects: 93% (1653/1777) 2024-08-20T22:10:38.8314329Z remote: Counting objects: 94% (1671/1777) 2024-08-20T22:10:38.8314841Z remote: Counting objects: 95% (1689/1777) 2024-08-20T22:10:38.8315358Z remote: Counting objects: 96% (1706/1777) 2024-08-20T22:10:38.8315874Z remote: Counting objects: 97% (1724/1777) 2024-08-20T22:10:38.8316383Z remote: Counting objects: 98% (1742/1777) 2024-08-20T22:10:38.8316897Z remote: Counting objects: 99% (1760/1777) 2024-08-20T22:10:38.8317410Z remote: Counting objects: 100% (1777/1777) 2024-08-20T22:10:38.8317964Z remote: Counting objects: 100% (1777/1777), done. 2024-08-20T22:10:38.8414300Z remote: Compressing objects: 0% (1/846) 2024-08-20T22:10:38.8687348Z remote: Compressing objects: 1% (9/846) 2024-08-20T22:10:38.8998561Z remote: Compressing objects: 2% (17/846) 2024-08-20T22:10:38.9333931Z remote: Compressing objects: 3% (26/846) 2024-08-20T22:10:39.0033334Z remote: Compressing objects: 4% (34/846) 2024-08-20T22:10:39.0582506Z remote: Compressing objects: 5% (43/846) 2024-08-20T22:10:39.1083552Z remote: Compressing objects: 6% (51/846) 2024-08-20T22:10:39.1483747Z remote: Compressing objects: 7% (60/846) 2024-08-20T22:10:39.1874401Z remote: Compressing objects: 8% (68/846) 2024-08-20T22:10:39.2084479Z remote: Compressing objects: 9% (77/846) 2024-08-20T22:10:39.2338932Z remote: Compressing objects: 10% (85/846) 2024-08-20T22:10:39.2522995Z remote: Compressing objects: 11% (94/846) 2024-08-20T22:10:39.2710184Z remote: Compressing objects: 12% (102/846) 2024-08-20T22:10:39.2871899Z remote: Compressing objects: 13% (110/846) 2024-08-20T22:10:39.2981737Z remote: Compressing objects: 14% (119/846) 2024-08-20T22:10:39.3083358Z remote: Compressing objects: 15% (127/846) 2024-08-20T22:10:39.3156506Z remote: Compressing objects: 16% (136/846) 2024-08-20T22:10:39.3228312Z remote: Compressing objects: 17% (144/846) 2024-08-20T22:10:39.3270024Z remote: Compressing objects: 18% (153/846) 2024-08-20T22:10:39.3318669Z remote: Compressing objects: 19% (161/846) 2024-08-20T22:10:39.3348772Z remote: Compressing objects: 20% (170/846) 2024-08-20T22:10:39.3369568Z remote: Compressing objects: 21% (178/846) 2024-08-20T22:10:39.3372826Z remote: Compressing objects: 22% (187/846) 2024-08-20T22:10:39.3377014Z remote: Compressing objects: 23% (195/846) 2024-08-20T22:10:39.3382363Z remote: Compressing objects: 24% (204/846) 2024-08-20T22:10:39.3385843Z remote: Compressing objects: 25% (212/846) 2024-08-20T22:10:39.3394191Z remote: Compressing objects: 26% (220/846) 2024-08-20T22:10:39.3398120Z remote: Compressing objects: 27% (229/846) 2024-08-20T22:10:39.3414355Z remote: Compressing objects: 28% (237/846) 2024-08-20T22:10:39.3424977Z remote: Compressing objects: 29% (246/846) 2024-08-20T22:10:39.3437225Z remote: Compressing objects: 30% (254/846) 2024-08-20T22:10:39.3447954Z remote: Compressing objects: 31% (263/846) 2024-08-20T22:10:39.3451770Z remote: Compressing objects: 32% (271/846) 2024-08-20T22:10:39.3460597Z remote: Compressing objects: 33% (280/846) 2024-08-20T22:10:39.3464873Z remote: Compressing objects: 34% (288/846) 2024-08-20T22:10:39.3470175Z remote: Compressing objects: 35% (297/846) 2024-08-20T22:10:39.3477597Z remote: Compressing objects: 36% (305/846) 2024-08-20T22:10:39.3485063Z remote: Compressing objects: 37% (314/846) 2024-08-20T22:10:39.3491118Z remote: Compressing objects: 38% (322/846) 2024-08-20T22:10:39.3497887Z remote: Compressing objects: 39% (330/846) 2024-08-20T22:10:39.3502210Z remote: Compressing objects: 40% (339/846) 2024-08-20T22:10:39.3508047Z remote: Compressing objects: 41% (347/846) 2024-08-20T22:10:39.3517589Z remote: Compressing objects: 42% (356/846) 2024-08-20T22:10:39.3521082Z remote: Compressing objects: 43% (364/846) 2024-08-20T22:10:39.3527423Z remote: Compressing objects: 44% (373/846) 2024-08-20T22:10:39.3533093Z remote: Compressing objects: 45% (381/846) 2024-08-20T22:10:39.3537393Z remote: Compressing objects: 46% (390/846) 2024-08-20T22:10:39.3540473Z remote: Compressing objects: 47% (398/846) 2024-08-20T22:10:39.3543534Z remote: Compressing objects: 48% (407/846) 2024-08-20T22:10:39.3546443Z remote: Compressing objects: 49% (415/846) 2024-08-20T22:10:39.3549128Z remote: Compressing objects: 50% (423/846) 2024-08-20T22:10:39.3551883Z remote: Compressing objects: 51% (432/846) 2024-08-20T22:10:39.3554301Z remote: Compressing objects: 52% (440/846) 2024-08-20T22:10:39.3556786Z remote: Compressing objects: 53% (449/846) 2024-08-20T22:10:39.3559256Z remote: Compressing objects: 54% (457/846) 2024-08-20T22:10:39.3559802Z remote: Compressing objects: 55% (466/846) 2024-08-20T22:10:39.3561981Z remote: Compressing objects: 56% (474/846) 2024-08-20T22:10:39.3562521Z remote: Compressing objects: 57% (483/846) 2024-08-20T22:10:39.3563058Z remote: Compressing objects: 58% (491/846) 2024-08-20T22:10:39.3563599Z remote: Compressing objects: 59% (500/846) 2024-08-20T22:10:39.3564491Z remote: Compressing objects: 60% (508/846) 2024-08-20T22:10:39.3565035Z remote: Compressing objects: 61% (517/846) 2024-08-20T22:10:39.3565580Z remote: Compressing objects: 62% (525/846) 2024-08-20T22:10:39.3566118Z remote: Compressing objects: 63% (533/846) 2024-08-20T22:10:39.3568217Z remote: Compressing objects: 64% (542/846) 2024-08-20T22:10:39.3574515Z remote: Compressing objects: 65% (550/846) 2024-08-20T22:10:39.3579816Z remote: Compressing objects: 66% (559/846) 2024-08-20T22:10:39.3584635Z remote: Compressing objects: 67% (567/846) 2024-08-20T22:10:39.3588520Z remote: Compressing objects: 68% (576/846) 2024-08-20T22:10:39.3592729Z remote: Compressing objects: 69% (584/846) 2024-08-20T22:10:39.3596387Z remote: Compressing objects: 70% (593/846) 2024-08-20T22:10:39.3599754Z remote: Compressing objects: 71% (601/846) 2024-08-20T22:10:39.3602755Z remote: Compressing objects: 72% (610/846) 2024-08-20T22:10:39.3606262Z remote: Compressing objects: 73% (618/846) 2024-08-20T22:10:39.3611037Z remote: Compressing objects: 74% (627/846) 2024-08-20T22:10:39.3613590Z remote: Compressing objects: 75% (635/846) 2024-08-20T22:10:39.3616029Z remote: Compressing objects: 76% (643/846) 2024-08-20T22:10:39.3618748Z remote: Compressing objects: 77% (652/846) 2024-08-20T22:10:39.3619311Z remote: Compressing objects: 78% (660/846) 2024-08-20T22:10:39.3621396Z remote: Compressing objects: 79% (669/846) 2024-08-20T22:10:39.3623742Z remote: Compressing objects: 80% (677/846) 2024-08-20T22:10:39.3626249Z remote: Compressing objects: 81% (686/846) 2024-08-20T22:10:39.3628862Z remote: Compressing objects: 82% (694/846) 2024-08-20T22:10:39.3629434Z remote: Compressing objects: 83% (703/846) 2024-08-20T22:10:39.3631623Z remote: Compressing objects: 84% (711/846) 2024-08-20T22:10:39.3632353Z remote: Compressing objects: 85% (720/846) 2024-08-20T22:10:39.3634226Z remote: Compressing objects: 86% (728/846) 2024-08-20T22:10:39.3636696Z remote: Compressing objects: 87% (737/846) 2024-08-20T22:10:39.3637260Z remote: Compressing objects: 88% (745/846) 2024-08-20T22:10:39.3639259Z remote: Compressing objects: 89% (753/846) 2024-08-20T22:10:39.3641856Z remote: Compressing objects: 90% (762/846) 2024-08-20T22:10:39.3642428Z remote: Compressing objects: 91% (770/846) 2024-08-20T22:10:39.3644705Z remote: Compressing objects: 92% (779/846) 2024-08-20T22:10:39.3645259Z remote: Compressing objects: 93% (787/846) 2024-08-20T22:10:39.3645808Z remote: Compressing objects: 94% (796/846) 2024-08-20T22:10:39.3646955Z remote: Compressing objects: 95% (804/846) 2024-08-20T22:10:39.3647495Z remote: Compressing objects: 96% (813/846) 2024-08-20T22:10:39.3649438Z remote: Compressing objects: 97% (821/846) 2024-08-20T22:10:39.3649991Z remote: Compressing objects: 98% (830/846) 2024-08-20T22:10:39.3652033Z remote: Compressing objects: 99% (838/846) 2024-08-20T22:10:39.3652580Z remote: Compressing objects: 100% (846/846) 2024-08-20T22:10:39.3653154Z remote: Compressing objects: 100% (846/846), done. 2024-08-20T22:11:02.9688221Z remote: Total 1010229 (delta 1169), reused 1411 (delta 928), pack-reused 1008452 (from 1) 2024-08-20T22:11:24.7200172Z [command]/usr/bin/git rev-parse --verify --quiet 40ec5f6ddd9787aca0449b24128343ff4c4a88b3^{object} 2024-08-20T22:11:24.7236151Z 40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:11:24.7242083Z ##[endgroup] 2024-08-20T22:11:24.7248734Z ##[group]Determining the checkout info 2024-08-20T22:11:24.7249566Z ##[endgroup] 2024-08-20T22:11:24.7250194Z ##[group]Checking out the ref 2024-08-20T22:11:24.7251203Z [command]/usr/bin/git checkout --quiet --force 40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:11:26.4644915Z ##[endgroup] 2024-08-20T22:11:26.4645718Z ##[group]Setting up auth for fetching submodules 2024-08-20T22:11:26.4650681Z [command]/usr/bin/git config --global http.https://github.com/.extraheader AUTHORIZATION: basic *** 2024-08-20T22:11:26.4713223Z [command]/usr/bin/git config --global --unset-all url.https://github.com/.insteadOf 2024-08-20T22:11:26.4756384Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf git@github.com: 2024-08-20T22:11:26.4798823Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf org-21003710@github.com: 2024-08-20T22:11:26.4838368Z ##[endgroup] 2024-08-20T22:11:26.4839152Z ##[group]Fetching submodules 2024-08-20T22:11:26.4842885Z [command]/usr/bin/git submodule sync --recursive 2024-08-20T22:11:26.5228095Z [command]/usr/bin/git -c protocol.version=2 submodule update --init --force --recursive 2024-08-20T22:11:26.5593641Z Submodule 'android/libs/fbjni' (https://github.com/facebookincubator/fbjni.git) registered for path 'android/libs/fbjni' 2024-08-20T22:11:26.5595474Z Submodule 'third_party/NNPACK_deps/FP16' (https://github.com/Maratyszcza/FP16.git) registered for path 'third_party/FP16' 2024-08-20T22:11:26.5598595Z Submodule 'third_party/NNPACK_deps/FXdiv' (https://github.com/Maratyszcza/FXdiv.git) registered for path 'third_party/FXdiv' 2024-08-20T22:11:26.5601754Z Submodule 'third_party/NNPACK' (https://github.com/Maratyszcza/NNPACK.git) registered for path 'third_party/NNPACK' 2024-08-20T22:11:26.5605564Z Submodule 'third_party/VulkanMemoryAllocator' (https://github.com/GPUOpen-LibrariesAndSDKs/VulkanMemoryAllocator.git) registered for path 'third_party/VulkanMemoryAllocator' 2024-08-20T22:11:26.5608170Z Submodule 'third_party/XNNPACK' (https://github.com/google/XNNPACK.git) registered for path 'third_party/XNNPACK' 2024-08-20T22:11:26.5611784Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/benchmark' 2024-08-20T22:11:26.5615543Z Submodule 'third_party/cpp-httplib' (https://github.com/yhirose/cpp-httplib.git) registered for path 'third_party/cpp-httplib' 2024-08-20T22:11:26.5619132Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo.git) registered for path 'third_party/cpuinfo' 2024-08-20T22:11:26.5622911Z Submodule 'third_party/cudnn_frontend' (https://github.com/NVIDIA/cudnn-frontend.git) registered for path 'third_party/cudnn_frontend' 2024-08-20T22:11:26.5626483Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/cutlass' 2024-08-20T22:11:26.5630515Z Submodule 'third_party/eigen' (https://gitlab.com/libeigen/eigen.git) registered for path 'third_party/eigen' 2024-08-20T22:11:26.5634618Z Submodule 'third_party/fbgemm' (https://github.com/pytorch/fbgemm) registered for path 'third_party/fbgemm' 2024-08-20T22:11:26.5638626Z Submodule 'third_party/flatbuffers' (https://github.com/google/flatbuffers.git) registered for path 'third_party/flatbuffers' 2024-08-20T22:11:26.5642464Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/fmt' 2024-08-20T22:11:26.5648078Z Submodule 'third_party/gemmlowp/gemmlowp' (https://github.com/google/gemmlowp.git) registered for path 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:11:26.5655478Z Submodule 'third_party/gloo' (https://github.com/facebookincubator/gloo) registered for path 'third_party/gloo' 2024-08-20T22:11:26.5659801Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/googletest' 2024-08-20T22:11:26.5663919Z Submodule 'third_party/ideep' (https://github.com/intel/ideep) registered for path 'third_party/ideep' 2024-08-20T22:11:26.5668516Z Submodule 'third_party/ittapi' (https://github.com/intel/ittapi.git) registered for path 'third_party/ittapi' 2024-08-20T22:11:26.5672986Z Submodule 'third_party/kineto' (https://github.com/pytorch/kineto) registered for path 'third_party/kineto' 2024-08-20T22:11:26.5677750Z Submodule 'third_party/mimalloc' (https://github.com/microsoft/mimalloc.git) registered for path 'third_party/mimalloc' 2024-08-20T22:11:26.5681964Z Submodule 'third_party/nccl/nccl' (https://github.com/NVIDIA/nccl) registered for path 'third_party/nccl/nccl' 2024-08-20T22:11:26.5686515Z Submodule 'third_party/nlohmann' (https://github.com/nlohmann/json.git) registered for path 'third_party/nlohmann' 2024-08-20T22:11:26.5691062Z Submodule 'third_party/onnx' (https://github.com/onnx/onnx.git) registered for path 'third_party/onnx' 2024-08-20T22:11:26.5696369Z Submodule 'third_party/opentelemetry-cpp' (https://github.com/open-telemetry/opentelemetry-cpp.git) registered for path 'third_party/opentelemetry-cpp' 2024-08-20T22:11:26.5700955Z Submodule 'third_party/pocketfft' (https://github.com/mreineck/pocketfft) registered for path 'third_party/pocketfft' 2024-08-20T22:11:26.5705893Z Submodule 'third_party/protobuf' (https://github.com/protocolbuffers/protobuf.git) registered for path 'third_party/protobuf' 2024-08-20T22:11:26.5710816Z Submodule 'third_party/NNPACK_deps/psimd' (https://github.com/Maratyszcza/psimd.git) registered for path 'third_party/psimd' 2024-08-20T22:11:26.5715954Z Submodule 'third_party/NNPACK_deps/pthreadpool' (https://github.com/Maratyszcza/pthreadpool.git) registered for path 'third_party/pthreadpool' 2024-08-20T22:11:26.5720823Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/pybind11' 2024-08-20T22:11:26.5726279Z Submodule 'third_party/python-peachpy' (https://github.com/malfet/PeachPy.git) registered for path 'third_party/python-peachpy' 2024-08-20T22:11:26.5731446Z Submodule 'third_party/sleef' (https://github.com/shibatch/sleef) registered for path 'third_party/sleef' 2024-08-20T22:11:26.5740481Z Submodule 'third_party/tensorpipe' (https://github.com/pytorch/tensorpipe.git) registered for path 'third_party/tensorpipe' 2024-08-20T22:11:26.5774358Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/android/libs/fbjni'... 2024-08-20T22:11:26.8459876Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FP16'... 2024-08-20T22:11:27.0216078Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FXdiv'... 2024-08-20T22:11:27.2007310Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/NNPACK'... 2024-08-20T22:11:27.4741622Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/VulkanMemoryAllocator'... 2024-08-20T22:11:29.3154807Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/XNNPACK'... 2024-08-20T22:11:40.6419630Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/benchmark'... 2024-08-20T22:11:41.0450262Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpp-httplib'... 2024-08-20T22:11:41.4594742Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpuinfo'... 2024-08-20T22:11:42.0988789Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cudnn_frontend'... 2024-08-20T22:11:43.2769933Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cutlass'... 2024-08-20T22:11:45.3989860Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/eigen'... 2024-08-20T22:11:51.4198783Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm'... 2024-08-20T22:11:52.8578429Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/flatbuffers'... 2024-08-20T22:11:54.5234916Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fmt'... 2024-08-20T22:11:55.7026496Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gemmlowp/gemmlowp'... 2024-08-20T22:11:56.1230470Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gloo'... 2024-08-20T22:11:56.4562180Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/googletest'... 2024-08-20T22:11:57.5864025Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep'... 2024-08-20T22:11:57.9501778Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ittapi'... 2024-08-20T22:11:58.2039933Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto'... 2024-08-20T22:11:59.8705435Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/mimalloc'... 2024-08-20T22:12:00.6434793Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nccl/nccl'... 2024-08-20T22:12:01.4101296Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nlohmann'... 2024-08-20T22:12:07.5178981Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx'... 2024-08-20T22:12:09.4633126Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp'... 2024-08-20T22:12:13.7099242Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pocketfft'... 2024-08-20T22:12:14.0036980Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf'... 2024-08-20T22:12:23.0662155Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/psimd'... 2024-08-20T22:12:23.2313884Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pthreadpool'... 2024-08-20T22:12:23.4296518Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pybind11'... 2024-08-20T22:12:24.3264949Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/python-peachpy'... 2024-08-20T22:12:24.6213324Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/sleef'... 2024-08-20T22:12:25.2621654Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe'... 2024-08-20T22:12:25.7144882Z Submodule path 'android/libs/fbjni': checked out '7e1e1fe3858c63c251c637ae41a20de425dde96f' 2024-08-20T22:12:25.7295713Z Submodule path 'third_party/FP16': checked out '4dfe081cf6bcd15db339cf2680b9281b8451eeb3' 2024-08-20T22:12:25.7414637Z Submodule path 'third_party/FXdiv': checked out 'b408327ac2a15ec3e43352421954f5b1967701d1' 2024-08-20T22:12:25.7733951Z Submodule path 'third_party/NNPACK': checked out 'c07e3a0400713d546e0dea2d5466dd22ea389c73' 2024-08-20T22:12:25.8193335Z Submodule path 'third_party/VulkanMemoryAllocator': checked out 'a6bfc237255a6bac1513f7c1ebde6d8aed6b5191' 2024-08-20T22:12:26.9988739Z Submodule path 'third_party/XNNPACK': checked out 'fcbf55af6cf28a4627bcd1f703ab7ad843f0f3a2' 2024-08-20T22:12:27.0280743Z Submodule path 'third_party/benchmark': checked out '0d98dba29d66e93259db7daa53a9327df767a415' 2024-08-20T22:12:27.0811724Z Submodule path 'third_party/cpp-httplib': checked out '3b6597bba913d51161383657829b7e644e59c006' 2024-08-20T22:12:27.1946843Z Submodule path 'third_party/cpuinfo': checked out '3c8b1533ac03dd6531ab6e7b9245d488f13a82a5' 2024-08-20T22:12:27.2351150Z Submodule path 'third_party/cudnn_frontend': checked out '23511ba176243f27b3b275da1fb3814ea805a171' 2024-08-20T22:12:27.8590484Z Submodule path 'third_party/cutlass': checked out 'bbe579a9e3beb6ea6626d9227ec32d0dae119a49' 2024-08-20T22:12:28.1471758Z Submodule path 'third_party/eigen': checked out '3147391d946bb4b6c68edd901f2add6ac1f31f8c' 2024-08-20T22:12:28.2420745Z Submodule path 'third_party/fbgemm': checked out 'dbc3157bf256f1339b3fa1fef2be89ac4078be0e' 2024-08-20T22:12:28.2440833Z Submodule 'third_party/asmjit' (https://github.com/asmjit/asmjit.git) registered for path 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:12:28.2444082Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo) registered for path 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:12:28.2447522Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:12:28.2451143Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:12:28.2454950Z Submodule 'third_party/hipify_torch' (https://github.com/ROCmSoftwarePlatform/hipify_torch.git) registered for path 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:12:28.2486416Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/asmjit'... 2024-08-20T22:12:29.2104140Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cpuinfo'... 2024-08-20T22:12:29.8207857Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cutlass'... 2024-08-20T22:12:31.9285579Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/googletest'... 2024-08-20T22:12:32.9757296Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/hipify_torch'... 2024-08-20T22:12:33.3662610Z Submodule path 'third_party/fbgemm/third_party/asmjit': checked out 'd3fbf7c9bc7c1d1365a94a45614b91c5a3706b81' 2024-08-20T22:12:33.4768573Z Submodule path 'third_party/fbgemm/third_party/cpuinfo': checked out 'ed8b86a253800bafdb7b25c5c399f91bff9cb1f3' 2024-08-20T22:12:33.9711421Z Submodule path 'third_party/fbgemm/third_party/cutlass': checked out 'fc9ebc645b63f3a6bc80aaefde5c063fb72110d6' 2024-08-20T22:12:34.0411004Z Submodule path 'third_party/fbgemm/third_party/googletest': checked out 'cbf019de22c8dd37b2108da35b2748fd702d1796' 2024-08-20T22:12:34.0561730Z Submodule path 'third_party/fbgemm/third_party/hipify_torch': checked out '23f53b025b466d8ec3c45d52290d3442f7fbe6b1' 2024-08-20T22:12:34.2086155Z Submodule path 'third_party/flatbuffers': checked out '01834de25e4bf3975a9a00e816292b1ad0fe184b' 2024-08-20T22:12:34.2546265Z Submodule path 'third_party/fmt': checked out '0c9fce2ffefecfdce794e1859584e25877b7b592' 2024-08-20T22:12:34.3005569Z Submodule path 'third_party/gemmlowp/gemmlowp': checked out '3fb5c176c17c765a3492cd2f0321b0dab712f350' 2024-08-20T22:12:34.3336872Z Submodule path 'third_party/gloo': checked out '5354032ea08eadd7fc4456477f7f7c6308818509' 2024-08-20T22:12:34.3874776Z Submodule path 'third_party/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2024-08-20T22:12:34.4035779Z Submodule path 'third_party/ideep': checked out '55ca0191687aaf19aca5cdb7881c791e3bea442b' 2024-08-20T22:12:34.4055306Z Submodule 'mkl-dnn' (https://github.com/intel/mkl-dnn.git) registered for path 'third_party/ideep/mkl-dnn' 2024-08-20T22:12:34.4084492Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep/mkl-dnn'... 2024-08-20T22:12:47.6591146Z Submodule path 'third_party/ideep/mkl-dnn': checked out '1137e04ec0b5251ca2b4400a4fd3c667ce843d67' 2024-08-20T22:12:47.6810248Z Submodule path 'third_party/ittapi': checked out '5b8a7d7422611c3a0d799fb5fc5dd4abfae35b42' 2024-08-20T22:12:47.7817656Z Submodule path 'third_party/kineto': checked out 'd9753139d181b9ff42872465aac0e5d3018be415' 2024-08-20T22:12:47.7837062Z Submodule 'libkineto/third_party/dynolog' (https://github.com/facebookincubator/dynolog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:12:47.7840223Z Submodule 'libkineto/third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:12:47.7843795Z Submodule 'libkineto/third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:12:47.7875957Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog'... 2024-08-20T22:12:48.3287511Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/fmt'... 2024-08-20T22:12:49.5328852Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/googletest'... 2024-08-20T22:12:50.6871363Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog': checked out '7d04a0053a845370ae06ce317a22a48e9edcc74e' 2024-08-20T22:12:50.6893029Z Submodule 'third_party/DCGM' (https://github.com/NVIDIA/DCGM.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:12:50.6896143Z Submodule 'third_party/cpr' (https://github.com/libcpr/cpr.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:12:50.6899693Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:12:50.6903381Z Submodule 'third_party/gflags' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:12:50.6907407Z Submodule 'third_party/glog' (https://github.com/google/glog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:12:50.6911307Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:12:50.6915093Z Submodule 'third_party/json' (https://github.com/nlohmann/json.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:12:50.6918929Z Submodule 'third_party/pfs' (https://github.com/dtrugman/pfs.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:12:50.6951395Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'... 2024-08-20T22:12:51.5450576Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'... 2024-08-20T22:12:51.9480302Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'... 2024-08-20T22:12:53.0994092Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'... 2024-08-20T22:12:53.3818257Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/glog'... 2024-08-20T22:12:53.9321012Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'... 2024-08-20T22:12:54.9784547Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/json'... 2024-08-20T22:13:01.2256170Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'... 2024-08-20T22:13:01.7135895Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM': checked out 'ffde4e54bc7249a6039a5e6b45b395141e1217f9' 2024-08-20T22:13:01.7362326Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr': checked out '871ed52d350214a034f6ef8a3b8f51c5ce1bd400' 2024-08-20T22:13:01.7784587Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt': checked out 'cd4af11efc9c622896a3e4cb599fa28668ca3d05' 2024-08-20T22:13:01.7948540Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags': checked out 'e171aa2d15ed9eb17054558e0b3a6a413bb01067' 2024-08-20T22:13:01.7967784Z Submodule 'doc' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:13:01.8002924Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'... 2024-08-20T22:13:02.1084815Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc': checked out '8411df715cf522606e3b1aca386ddfc0b63d34b4' 2024-08-20T22:13:02.1310765Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog': checked out 'b33e3bad4c46c8a6345525fd822af355e5ef9446' 2024-08-20T22:13:02.1791382Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest': checked out '58d77fa8070e8cec2dc1ed015d66b454c8d78850' 2024-08-20T22:13:02.3013394Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json': checked out '4f8fba14066156b73f1189a2b8bd568bde5284c5' 2024-08-20T22:13:02.3217811Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs': checked out 'f68a2fa8ea36c783bdd760371411fcb495aa3150' 2024-08-20T22:13:02.3672654Z Submodule path 'third_party/kineto/libkineto/third_party/fmt': checked out '0041a40c1350ba702d475b9c4ad62da77caea164' 2024-08-20T22:13:02.4337484Z Submodule path 'third_party/kineto/libkineto/third_party/googletest': checked out '7aca84427f224eeed3144123d5230d5871e93347' 2024-08-20T22:13:02.4785979Z Submodule path 'third_party/mimalloc': checked out 'b66e3214d8a104669c2ec05ae91ebc26a8f5ab78' 2024-08-20T22:13:02.5092035Z Submodule path 'third_party/nccl/nccl': checked out 'ab2b89c4c339bd7f816fbc114a4b05d386b66290' 2024-08-20T22:13:02.6345279Z Submodule path 'third_party/nlohmann': checked out '87cda1d6646592ac5866dc703c8e1839046a6806' 2024-08-20T22:13:03.1479007Z Submodule path 'third_party/onnx': checked out '3bf92c03a9f27eba3bda1e5b9e63ea20ec213557' 2024-08-20T22:13:03.1517816Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/onnx/third_party/benchmark' 2024-08-20T22:13:03.1520997Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/onnx/third_party/pybind11' 2024-08-20T22:13:03.1553251Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx/third_party/benchmark'... 2024-08-20T22:13:03.5850296Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx/third_party/pybind11'... 2024-08-20T22:13:04.5201123Z Submodule path 'third_party/onnx/third_party/benchmark': checked out '2dd015dfef425c866d9a43f2c67d8b52d709acb6' 2024-08-20T22:13:04.5626655Z Submodule path 'third_party/onnx/third_party/pybind11': checked out '5b0a6fc2017fcc176545afe3e09c9f9885283242' 2024-08-20T22:13:04.6547960Z Submodule path 'third_party/opentelemetry-cpp': checked out 'a799f4aed9c94b765dcdaabaeab7d5e7e2310878' 2024-08-20T22:13:04.6569055Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark) registered for path 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:13:04.6571632Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:13:04.6575462Z Submodule 'third_party/ms-gsl' (https://github.com/microsoft/GSL) registered for path 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:13:04.6578824Z Submodule 'third_party/nlohmann-json' (https://github.com/nlohmann/json) registered for path 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:13:04.6582836Z Submodule 'third_party/opentelemetry-proto' (https://github.com/open-telemetry/opentelemetry-proto) registered for path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:13:04.6586329Z Submodule 'third_party/opentracing-cpp' (https://github.com/opentracing/opentracing-cpp.git) registered for path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:13:04.6590487Z Submodule 'third_party/prometheus-cpp' (https://github.com/jupp0r/prometheus-cpp) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:13:04.6593686Z Submodule 'tools/vcpkg' (https://github.com/Microsoft/vcpkg) registered for path 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:13:04.6625963Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/benchmark'... 2024-08-20T22:13:05.0999374Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/googletest'... 2024-08-20T22:13:06.1672929Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/ms-gsl'... 2024-08-20T22:13:06.4612974Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/nlohmann-json'... 2024-08-20T22:13:12.4805003Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentelemetry-proto'... 2024-08-20T22:13:12.8012329Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentracing-cpp'... 2024-08-20T22:13:12.9896215Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp'... 2024-08-20T22:13:13.3069608Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/tools/vcpkg'... 2024-08-20T22:13:20.0058582Z Submodule path 'third_party/opentelemetry-cpp/third_party/benchmark': checked out 'd572f4777349d43653b21d6c2fc63020ab326db2' 2024-08-20T22:13:20.0535788Z Submodule path 'third_party/opentelemetry-cpp/third_party/googletest': checked out 'b796f7d44681514f58a683a3a71ff17c94edb0c1' 2024-08-20T22:13:20.0724871Z Submodule path 'third_party/opentelemetry-cpp/third_party/ms-gsl': checked out '6f4529395c5b7c2d661812257cd6780c67e54afa' 2024-08-20T22:13:20.1962779Z Submodule path 'third_party/opentelemetry-cpp/third_party/nlohmann-json': checked out 'bc889afb4c5bf1c0d8ee29ef35eaaf4c8bef8a5d' 2024-08-20T22:13:20.2123586Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto': checked out '4ca4f0335c63cda7ab31ea7ed70d6553aee14dce' 2024-08-20T22:13:20.2307013Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp': checked out '06b57f48ded1fa3bdd3d4346f6ef29e40e08eaf5' 2024-08-20T22:13:20.2516966Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp': checked out 'c9ffcdda9086ffd9e1283ea7a0276d831f3c8a8d' 2024-08-20T22:13:20.2536250Z Submodule 'civetweb' (https://github.com/civetweb/civetweb.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:13:20.2539272Z Submodule 'googletest' (https://github.com/google/googletest.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:13:20.2568908Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'... 2024-08-20T22:13:22.1525817Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'... 2024-08-20T22:13:23.4739267Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb': checked out 'eefb26f82b233268fc98577d265352720d477ba4' 2024-08-20T22:13:23.5278772Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2024-08-20T22:13:24.2022394Z Submodule path 'third_party/opentelemetry-cpp/tools/vcpkg': checked out '8eb57355a4ffb410a2e94c07b4dca2dffbee8e50' 2024-08-20T22:13:24.2172853Z Submodule path 'third_party/pocketfft': checked out '9d3ab05a7fffbc71a492bc6a17be034e83e8f0fe' 2024-08-20T22:13:24.5342267Z Submodule path 'third_party/protobuf': checked out 'd1eca4e4b421cd2997495c4b4e65cea6be4e9b8a' 2024-08-20T22:13:24.5364945Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:13:24.5368074Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/protobuf/third_party/googletest' 2024-08-20T22:13:24.5405903Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/benchmark'... 2024-08-20T22:13:24.9616991Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/googletest'... 2024-08-20T22:13:26.0470414Z Submodule path 'third_party/protobuf/third_party/benchmark': checked out '5b7683f49e1e9223cf9927b24f6fd3d6bd82e3f8' 2024-08-20T22:13:26.1289096Z Submodule path 'third_party/protobuf/third_party/googletest': checked out '5ec7f0c4a113e2f18ac2c6cc7df51ad6afc24081' 2024-08-20T22:13:26.1410159Z Submodule path 'third_party/psimd': checked out '072586a71b55b7f8c584153d223e95687148a900' 2024-08-20T22:13:26.1569687Z Submodule path 'third_party/pthreadpool': checked out '4fe0e1e183925bf8cfa6aae24237e724a96479b8' 2024-08-20T22:13:26.2018089Z Submodule path 'third_party/pybind11': checked out '941f45bcb51457884fa1afd6e24a67377d70f75c' 2024-08-20T22:13:26.2365591Z Submodule path 'third_party/python-peachpy': checked out 'f45429b087dd7d5bc78bb40dc7cf06425c252d67' 2024-08-20T22:13:26.2855542Z Submodule path 'third_party/sleef': checked out '60e76d2bce17d278b439d9da17177c8f957a9e9b' 2024-08-20T22:13:26.3201680Z Submodule path 'third_party/tensorpipe': checked out '52791a2fd214b2a9dc5759d36725909c1daa7f2e' 2024-08-20T22:13:26.3221319Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:13:26.3224478Z Submodule 'third_party/libnop' (https://github.com/google/libnop.git) registered for path 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:13:26.3228147Z Submodule 'third_party/libuv' (https://github.com/libuv/libuv.git) registered for path 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:13:26.3231994Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:13:26.3263468Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/googletest'... 2024-08-20T22:13:27.4206199Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libnop'... 2024-08-20T22:13:27.6374726Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libuv'... 2024-08-20T22:13:28.8681629Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11'... 2024-08-20T22:13:29.8228878Z Submodule path 'third_party/tensorpipe/third_party/googletest': checked out 'aee0f9d9b5b87796ee8a0ab26b7587ec30e8858e' 2024-08-20T22:13:29.8420907Z Submodule path 'third_party/tensorpipe/third_party/libnop': checked out '910b55815be16109f04f4180e9adee14fb4ce281' 2024-08-20T22:13:29.9205472Z Submodule path 'third_party/tensorpipe/third_party/libuv': checked out '1dff88e5161cba5c59276d2070d2e304e4dcb242' 2024-08-20T22:13:29.9593528Z Submodule path 'third_party/tensorpipe/third_party/pybind11': checked out 'a23996fce38ff6ccfbcdc09f1e63f2c4be5ea2ef' 2024-08-20T22:13:29.9610877Z Submodule 'tools/clang' (https://github.com/wjakob/clang-cindex-python3) registered for path 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:13:29.9642527Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11/tools/clang'... 2024-08-20T22:13:30.1587631Z Submodule path 'third_party/tensorpipe/third_party/pybind11/tools/clang': checked out '6a00cbc4a9b8e68b71caf7f774b3f9c753ae84d5' 2024-08-20T22:13:30.1635571Z [command]/usr/bin/git submodule foreach --recursive git config --local gc.auto 0 2024-08-20T22:13:30.2002685Z Entering 'android/libs/fbjni' 2024-08-20T22:13:30.2055330Z Entering 'third_party/FP16' 2024-08-20T22:13:30.2105314Z Entering 'third_party/FXdiv' 2024-08-20T22:13:30.2155998Z Entering 'third_party/NNPACK' 2024-08-20T22:13:30.2206810Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T22:13:30.2258401Z Entering 'third_party/XNNPACK' 2024-08-20T22:13:30.2325409Z Entering 'third_party/benchmark' 2024-08-20T22:13:30.2375668Z Entering 'third_party/cpp-httplib' 2024-08-20T22:13:30.2424928Z Entering 'third_party/cpuinfo' 2024-08-20T22:13:30.2475827Z Entering 'third_party/cudnn_frontend' 2024-08-20T22:13:30.2526169Z Entering 'third_party/cutlass' 2024-08-20T22:13:30.2583258Z Entering 'third_party/eigen' 2024-08-20T22:13:30.2636068Z Entering 'third_party/fbgemm' 2024-08-20T22:13:30.2685422Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:13:30.2742904Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:13:30.2792877Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:13:30.2855533Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:13:30.2905017Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:13:30.2959682Z Entering 'third_party/flatbuffers' 2024-08-20T22:13:30.3012988Z Entering 'third_party/fmt' 2024-08-20T22:13:30.3064843Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:13:30.3116424Z Entering 'third_party/gloo' 2024-08-20T22:13:30.3167635Z Entering 'third_party/googletest' 2024-08-20T22:13:30.3218788Z Entering 'third_party/ideep' 2024-08-20T22:13:30.3268599Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T22:13:30.3329062Z Entering 'third_party/ittapi' 2024-08-20T22:13:30.3382176Z Entering 'third_party/kineto' 2024-08-20T22:13:30.3431841Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:13:30.3481319Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:13:30.3533065Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:13:30.3583506Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:13:30.3639392Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:13:30.3689165Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:13:30.3745603Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:13:30.3796218Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:13:30.3847573Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:13:30.3899662Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:13:30.3955786Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:13:30.4009271Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:13:30.4063528Z Entering 'third_party/mimalloc' 2024-08-20T22:13:30.4114859Z Entering 'third_party/nccl/nccl' 2024-08-20T22:13:30.4166853Z Entering 'third_party/nlohmann' 2024-08-20T22:13:30.4218924Z Entering 'third_party/onnx' 2024-08-20T22:13:30.4286648Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T22:13:30.4337919Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T22:13:30.4393694Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T22:13:30.4446720Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:13:30.4497551Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:13:30.4551777Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:13:30.4606440Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:13:30.4663631Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:13:30.4711944Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:13:30.4762976Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:13:30.4817442Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:13:30.4870638Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:13:30.4924809Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:13:30.5004948Z Entering 'third_party/pocketfft' 2024-08-20T22:13:30.5062210Z Entering 'third_party/protobuf' 2024-08-20T22:13:30.5115292Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:13:30.5165742Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T22:13:30.5221159Z Entering 'third_party/psimd' 2024-08-20T22:13:30.5272040Z Entering 'third_party/pthreadpool' 2024-08-20T22:13:30.5323203Z Entering 'third_party/pybind11' 2024-08-20T22:13:30.5374913Z Entering 'third_party/python-peachpy' 2024-08-20T22:13:30.5425591Z Entering 'third_party/sleef' 2024-08-20T22:13:30.5478466Z Entering 'third_party/tensorpipe' 2024-08-20T22:13:30.5529355Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:13:30.5580352Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:13:30.5634611Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:13:30.5684850Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:13:30.5734172Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:13:30.5810949Z ##[endgroup] 2024-08-20T22:13:30.5811807Z ##[group]Persisting credentials for submodules 2024-08-20T22:13:30.5814781Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'url\.https\:\/\/github\.com\/\.insteadOf' && git config --local --unset-all 'url.https://github.com/.insteadOf' || :" 2024-08-20T22:13:30.6177566Z Entering 'android/libs/fbjni' 2024-08-20T22:13:30.6250295Z Entering 'third_party/FP16' 2024-08-20T22:13:30.6316988Z Entering 'third_party/FXdiv' 2024-08-20T22:13:30.6385325Z Entering 'third_party/NNPACK' 2024-08-20T22:13:30.6453827Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T22:13:30.6525311Z Entering 'third_party/XNNPACK' 2024-08-20T22:13:30.6612995Z Entering 'third_party/benchmark' 2024-08-20T22:13:30.6680903Z Entering 'third_party/cpp-httplib' 2024-08-20T22:13:30.6756020Z Entering 'third_party/cpuinfo' 2024-08-20T22:13:30.6824761Z Entering 'third_party/cudnn_frontend' 2024-08-20T22:13:30.6892370Z Entering 'third_party/cutlass' 2024-08-20T22:13:30.6972346Z Entering 'third_party/eigen' 2024-08-20T22:13:30.7051293Z Entering 'third_party/fbgemm' 2024-08-20T22:13:30.7116992Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:13:30.7184682Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:13:30.7251367Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:13:30.7323104Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:13:30.7389014Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:13:30.7458233Z Entering 'third_party/flatbuffers' 2024-08-20T22:13:30.7531494Z Entering 'third_party/fmt' 2024-08-20T22:13:30.7603693Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:13:30.7672116Z Entering 'third_party/gloo' 2024-08-20T22:13:30.7748351Z Entering 'third_party/googletest' 2024-08-20T22:13:30.7815524Z Entering 'third_party/ideep' 2024-08-20T22:13:30.7880600Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T22:13:30.7958791Z Entering 'third_party/ittapi' 2024-08-20T22:13:30.8024804Z Entering 'third_party/kineto' 2024-08-20T22:13:30.8091132Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:13:30.8157149Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:13:30.8225953Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:13:30.8294439Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:13:30.8361521Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:13:30.8425723Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:13:30.8497370Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:13:30.8565465Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:13:30.8637515Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:13:30.8706668Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:13:30.8779217Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:13:30.8847331Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:13:30.8917239Z Entering 'third_party/mimalloc' 2024-08-20T22:13:30.8986902Z Entering 'third_party/nccl/nccl' 2024-08-20T22:13:30.9055861Z Entering 'third_party/nlohmann' 2024-08-20T22:13:30.9123472Z Entering 'third_party/onnx' 2024-08-20T22:13:30.9205050Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T22:13:30.9272794Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T22:13:30.9346347Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T22:13:30.9414332Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:13:30.9481581Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:13:30.9548802Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:13:30.9614452Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:13:30.9680726Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:13:30.9746455Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:13:30.9811723Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:13:30.9877024Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:13:30.9947682Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:13:31.0019866Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:13:31.0107221Z Entering 'third_party/pocketfft' 2024-08-20T22:13:31.0174631Z Entering 'third_party/protobuf' 2024-08-20T22:13:31.0243490Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:13:31.0308649Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T22:13:31.0381063Z Entering 'third_party/psimd' 2024-08-20T22:13:31.0448766Z Entering 'third_party/pthreadpool' 2024-08-20T22:13:31.0518267Z Entering 'third_party/pybind11' 2024-08-20T22:13:31.0587785Z Entering 'third_party/python-peachpy' 2024-08-20T22:13:31.0656040Z Entering 'third_party/sleef' 2024-08-20T22:13:31.0724923Z Entering 'third_party/tensorpipe' 2024-08-20T22:13:31.0791800Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:13:31.0857946Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:13:31.0922862Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:13:31.0988730Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:13:31.1052526Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:13:31.1145956Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local 'http.https://github.com/.extraheader' 'AUTHORIZATION: basic ***' && git config --local --show-origin --name-only --get-regexp remote.origin.url" 2024-08-20T22:13:31.1516308Z Entering 'android/libs/fbjni' 2024-08-20T22:13:31.1581183Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/android/libs/fbjni/config remote.origin.url 2024-08-20T22:13:31.1603075Z Entering 'third_party/FP16' 2024-08-20T22:13:31.1671165Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FP16/config remote.origin.url 2024-08-20T22:13:31.1693003Z Entering 'third_party/FXdiv' 2024-08-20T22:13:31.1756987Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FXdiv/config remote.origin.url 2024-08-20T22:13:31.1778652Z Entering 'third_party/NNPACK' 2024-08-20T22:13:31.1841290Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK/config remote.origin.url 2024-08-20T22:13:31.1863385Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T22:13:31.1927048Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/VulkanMemoryAllocator/config remote.origin.url 2024-08-20T22:13:31.1947838Z Entering 'third_party/XNNPACK' 2024-08-20T22:13:31.2011155Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/XNNPACK/config remote.origin.url 2024-08-20T22:13:31.2050330Z Entering 'third_party/benchmark' 2024-08-20T22:13:31.2113522Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/benchmark/config remote.origin.url 2024-08-20T22:13:31.2137584Z Entering 'third_party/cpp-httplib' 2024-08-20T22:13:31.2199289Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpp-httplib/config remote.origin.url 2024-08-20T22:13:31.2220849Z Entering 'third_party/cpuinfo' 2024-08-20T22:13:31.2283893Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpuinfo/config remote.origin.url 2024-08-20T22:13:31.2306121Z Entering 'third_party/cudnn_frontend' 2024-08-20T22:13:31.2369718Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cudnn_frontend/config remote.origin.url 2024-08-20T22:13:31.2391050Z Entering 'third_party/cutlass' 2024-08-20T22:13:31.2454161Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cutlass/config remote.origin.url 2024-08-20T22:13:31.2484469Z Entering 'third_party/eigen' 2024-08-20T22:13:31.2550053Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/eigen/config remote.origin.url 2024-08-20T22:13:31.2575290Z Entering 'third_party/fbgemm' 2024-08-20T22:13:31.2638690Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/config remote.origin.url 2024-08-20T22:13:31.2658753Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:13:31.2720997Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/asmjit/config remote.origin.url 2024-08-20T22:13:31.2742981Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:13:31.2804023Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cpuinfo/config remote.origin.url 2024-08-20T22:13:31.2824602Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:13:31.2886419Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cutlass/config remote.origin.url 2024-08-20T22:13:31.2912785Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:13:31.2974103Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/googletest/config remote.origin.url 2024-08-20T22:13:31.2994498Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:13:31.3056238Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/hipify_torch/config remote.origin.url 2024-08-20T22:13:31.3080869Z Entering 'third_party/flatbuffers' 2024-08-20T22:13:31.3143573Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/flatbuffers/config remote.origin.url 2024-08-20T22:13:31.3168889Z Entering 'third_party/fmt' 2024-08-20T22:13:31.3230029Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fmt/config remote.origin.url 2024-08-20T22:13:31.3251735Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:13:31.3312984Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gemmlowp/gemmlowp/config remote.origin.url 2024-08-20T22:13:31.3334963Z Entering 'third_party/gloo' 2024-08-20T22:13:31.3396621Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gloo/config remote.origin.url 2024-08-20T22:13:31.3418505Z Entering 'third_party/googletest' 2024-08-20T22:13:31.3481857Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/googletest/config remote.origin.url 2024-08-20T22:13:31.3502570Z Entering 'third_party/ideep' 2024-08-20T22:13:31.3565577Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/config remote.origin.url 2024-08-20T22:13:31.3583140Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T22:13:31.3649240Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/modules/mkl-dnn/config remote.origin.url 2024-08-20T22:13:31.3677962Z Entering 'third_party/ittapi' 2024-08-20T22:13:31.3738992Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ittapi/config remote.origin.url 2024-08-20T22:13:31.3759973Z Entering 'third_party/kineto' 2024-08-20T22:13:31.3821647Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/config remote.origin.url 2024-08-20T22:13:31.3841934Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:13:31.3905108Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/config remote.origin.url 2024-08-20T22:13:31.3923255Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:13:31.3987553Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/DCGM/config remote.origin.url 2024-08-20T22:13:31.4009366Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:13:31.4073051Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/cpr/config remote.origin.url 2024-08-20T22:13:31.4097845Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:13:31.4161401Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/fmt/config remote.origin.url 2024-08-20T22:13:31.4186552Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:13:31.4249794Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/config remote.origin.url 2024-08-20T22:13:31.4268003Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:13:31.4331761Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/modules/doc/config remote.origin.url 2024-08-20T22:13:31.4359280Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:13:31.4422935Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/glog/config remote.origin.url 2024-08-20T22:13:31.4443747Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:13:31.4506065Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/googletest/config remote.origin.url 2024-08-20T22:13:31.4526547Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:13:31.4593348Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/json/config remote.origin.url 2024-08-20T22:13:31.4620023Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:13:31.4683543Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/pfs/config remote.origin.url 2024-08-20T22:13:31.4706569Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:13:31.4768307Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/fmt/config remote.origin.url 2024-08-20T22:13:31.4790127Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:13:31.4851306Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/googletest/config remote.origin.url 2024-08-20T22:13:31.4874211Z Entering 'third_party/mimalloc' 2024-08-20T22:13:31.4938136Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/mimalloc/config remote.origin.url 2024-08-20T22:13:31.4958294Z Entering 'third_party/nccl/nccl' 2024-08-20T22:13:31.5020026Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nccl/nccl/config remote.origin.url 2024-08-20T22:13:31.5042016Z Entering 'third_party/nlohmann' 2024-08-20T22:13:31.5103813Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nlohmann/config remote.origin.url 2024-08-20T22:13:31.5125782Z Entering 'third_party/onnx' 2024-08-20T22:13:31.5188233Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/config remote.origin.url 2024-08-20T22:13:31.5223044Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T22:13:31.5285208Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/benchmark/config remote.origin.url 2024-08-20T22:13:31.5307919Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T22:13:31.5374436Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/pybind11/config remote.origin.url 2024-08-20T22:13:31.5398508Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T22:13:31.5462972Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/config remote.origin.url 2024-08-20T22:13:31.5484654Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:13:31.5550839Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/benchmark/config remote.origin.url 2024-08-20T22:13:31.5570475Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:13:31.5631503Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/googletest/config remote.origin.url 2024-08-20T22:13:31.5653872Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:13:31.5714971Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/ms-gsl/config remote.origin.url 2024-08-20T22:13:31.5735432Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:13:31.5799332Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/nlohmann-json/config remote.origin.url 2024-08-20T22:13:31.5820772Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:13:31.5881973Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentelemetry-proto/config remote.origin.url 2024-08-20T22:13:31.5902380Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:13:31.5964242Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentracing-cpp/config remote.origin.url 2024-08-20T22:13:31.5983846Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:13:31.6045536Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/config remote.origin.url 2024-08-20T22:13:31.6063226Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:13:31.6124578Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/civetweb/config remote.origin.url 2024-08-20T22:13:31.6150210Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:13:31.6212186Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/googletest/config remote.origin.url 2024-08-20T22:13:31.6234781Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:13:31.6296712Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/tools/vcpkg/config remote.origin.url 2024-08-20T22:13:31.6337485Z Entering 'third_party/pocketfft' 2024-08-20T22:13:31.6400387Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pocketfft/config remote.origin.url 2024-08-20T22:13:31.6421669Z Entering 'third_party/protobuf' 2024-08-20T22:13:31.6485070Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/config remote.origin.url 2024-08-20T22:13:31.6507948Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:13:31.6572457Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/benchmark/config remote.origin.url 2024-08-20T22:13:31.6596000Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T22:13:31.6657291Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/googletest/config remote.origin.url 2024-08-20T22:13:31.6681087Z Entering 'third_party/psimd' 2024-08-20T22:13:31.6744929Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/psimd/config remote.origin.url 2024-08-20T22:13:31.6766020Z Entering 'third_party/pthreadpool' 2024-08-20T22:13:31.6828898Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/pthreadpool/config remote.origin.url 2024-08-20T22:13:31.6850783Z Entering 'third_party/pybind11' 2024-08-20T22:13:31.6912585Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pybind11/config remote.origin.url 2024-08-20T22:13:31.6935101Z Entering 'third_party/python-peachpy' 2024-08-20T22:13:31.6996915Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/python-peachpy/config remote.origin.url 2024-08-20T22:13:31.7018297Z Entering 'third_party/sleef' 2024-08-20T22:13:31.7081700Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/sleef/config remote.origin.url 2024-08-20T22:13:31.7103234Z Entering 'third_party/tensorpipe' 2024-08-20T22:13:31.7166054Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/config remote.origin.url 2024-08-20T22:13:31.7186065Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:13:31.7246789Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/googletest/config remote.origin.url 2024-08-20T22:13:31.7266707Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:13:31.7328039Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libnop/config remote.origin.url 2024-08-20T22:13:31.7348994Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:13:31.7409432Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libuv/config remote.origin.url 2024-08-20T22:13:31.7430072Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:13:31.7490795Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/config remote.origin.url 2024-08-20T22:13:31.7508614Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:13:31.7570834Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/modules/tools/clang/config remote.origin.url 2024-08-20T22:13:31.8384705Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'git@github.com:' 2024-08-20T22:13:31.8756438Z Entering 'android/libs/fbjni' 2024-08-20T22:13:31.8807021Z Entering 'third_party/FP16' 2024-08-20T22:13:31.8861810Z Entering 'third_party/FXdiv' 2024-08-20T22:13:31.8912953Z Entering 'third_party/NNPACK' 2024-08-20T22:13:31.8964853Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T22:13:31.9015977Z Entering 'third_party/XNNPACK' 2024-08-20T22:13:31.9083040Z Entering 'third_party/benchmark' 2024-08-20T22:13:31.9136408Z Entering 'third_party/cpp-httplib' 2024-08-20T22:13:31.9188572Z Entering 'third_party/cpuinfo' 2024-08-20T22:13:31.9241576Z Entering 'third_party/cudnn_frontend' 2024-08-20T22:13:31.9292782Z Entering 'third_party/cutlass' 2024-08-20T22:13:31.9351447Z Entering 'third_party/eigen' 2024-08-20T22:13:31.9406539Z Entering 'third_party/fbgemm' 2024-08-20T22:13:31.9456635Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:13:31.9507283Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:13:31.9559763Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:13:31.9618016Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:13:31.9670248Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:13:31.9724504Z Entering 'third_party/flatbuffers' 2024-08-20T22:13:31.9782558Z Entering 'third_party/fmt' 2024-08-20T22:13:31.9837555Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:13:31.9891022Z Entering 'third_party/gloo' 2024-08-20T22:13:31.9944806Z Entering 'third_party/googletest' 2024-08-20T22:13:31.9997206Z Entering 'third_party/ideep' 2024-08-20T22:13:32.0048319Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T22:13:32.0107264Z Entering 'third_party/ittapi' 2024-08-20T22:13:32.0160291Z Entering 'third_party/kineto' 2024-08-20T22:13:32.0211875Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:13:32.0268337Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:13:32.0321555Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:13:32.0372978Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:13:32.0424487Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:13:32.0474440Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:13:32.0530528Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:13:32.0580720Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:13:32.0630896Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:13:32.0682823Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:13:32.0736212Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:13:32.0787283Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:13:32.0841291Z Entering 'third_party/mimalloc' 2024-08-20T22:13:32.0896152Z Entering 'third_party/nccl/nccl' 2024-08-20T22:13:32.0949862Z Entering 'third_party/nlohmann' 2024-08-20T22:13:32.1003347Z Entering 'third_party/onnx' 2024-08-20T22:13:32.1076561Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T22:13:32.1132012Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T22:13:32.1193070Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T22:13:32.1251689Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:13:32.1302490Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:13:32.1354247Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:13:32.1406083Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:13:32.1459090Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:13:32.1509555Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:13:32.1560108Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:13:32.1609567Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:13:32.1662565Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:13:32.1721778Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:13:32.1794655Z Entering 'third_party/pocketfft' 2024-08-20T22:13:32.1848044Z Entering 'third_party/protobuf' 2024-08-20T22:13:32.1903890Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:13:32.1958723Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T22:13:32.2014454Z Entering 'third_party/psimd' 2024-08-20T22:13:32.2068264Z Entering 'third_party/pthreadpool' 2024-08-20T22:13:32.2120587Z Entering 'third_party/pybind11' 2024-08-20T22:13:32.2174720Z Entering 'third_party/python-peachpy' 2024-08-20T22:13:32.2227336Z Entering 'third_party/sleef' 2024-08-20T22:13:32.2281940Z Entering 'third_party/tensorpipe' 2024-08-20T22:13:32.2339166Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:13:32.2396131Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:13:32.2447501Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:13:32.2497857Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:13:32.2548021Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:13:32.2624758Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'org-21003710@github.com:' 2024-08-20T22:13:32.2989666Z Entering 'android/libs/fbjni' 2024-08-20T22:13:32.3043183Z Entering 'third_party/FP16' 2024-08-20T22:13:32.3096725Z Entering 'third_party/FXdiv' 2024-08-20T22:13:32.3148418Z Entering 'third_party/NNPACK' 2024-08-20T22:13:32.3200492Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T22:13:32.3254190Z Entering 'third_party/XNNPACK' 2024-08-20T22:13:32.3327416Z Entering 'third_party/benchmark' 2024-08-20T22:13:32.3380637Z Entering 'third_party/cpp-httplib' 2024-08-20T22:13:32.3434943Z Entering 'third_party/cpuinfo' 2024-08-20T22:13:32.3491351Z Entering 'third_party/cudnn_frontend' 2024-08-20T22:13:32.3544786Z Entering 'third_party/cutlass' 2024-08-20T22:13:32.3607060Z Entering 'third_party/eigen' 2024-08-20T22:13:32.3666085Z Entering 'third_party/fbgemm' 2024-08-20T22:13:32.3719486Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:13:32.3773478Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:13:32.3823328Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:13:32.3881864Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:13:32.3932113Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:13:32.3985170Z Entering 'third_party/flatbuffers' 2024-08-20T22:13:32.4042053Z Entering 'third_party/fmt' 2024-08-20T22:13:32.4092287Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:13:32.4148115Z Entering 'third_party/gloo' 2024-08-20T22:13:32.4199702Z Entering 'third_party/googletest' 2024-08-20T22:13:32.4252401Z Entering 'third_party/ideep' 2024-08-20T22:13:32.4302003Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T22:13:32.4363462Z Entering 'third_party/ittapi' 2024-08-20T22:13:32.4415271Z Entering 'third_party/kineto' 2024-08-20T22:13:32.4467008Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:13:32.4517323Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:13:32.4572199Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:13:32.4629392Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:13:32.4682064Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:13:32.4731888Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:13:32.4787813Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:13:32.4840605Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:13:32.4896434Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:13:32.4953853Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:13:32.5012867Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:13:32.5063829Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:13:32.5117556Z Entering 'third_party/mimalloc' 2024-08-20T22:13:32.5174052Z Entering 'third_party/nccl/nccl' 2024-08-20T22:13:32.5228783Z Entering 'third_party/nlohmann' 2024-08-20T22:13:32.5282313Z Entering 'third_party/onnx' 2024-08-20T22:13:32.5351715Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T22:13:32.5407335Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T22:13:32.5462910Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T22:13:32.5518561Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:13:32.5569512Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:13:32.5617951Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:13:32.5667965Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:13:32.5718217Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:13:32.5767585Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:13:32.5815486Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:13:32.5863268Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:13:32.5915139Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:13:32.5974287Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:13:32.6044881Z Entering 'third_party/pocketfft' 2024-08-20T22:13:32.6096684Z Entering 'third_party/protobuf' 2024-08-20T22:13:32.6150415Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:13:32.6199473Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T22:13:32.6253065Z Entering 'third_party/psimd' 2024-08-20T22:13:32.6307194Z Entering 'third_party/pthreadpool' 2024-08-20T22:13:32.6359586Z Entering 'third_party/pybind11' 2024-08-20T22:13:32.6411703Z Entering 'third_party/python-peachpy' 2024-08-20T22:13:32.6466282Z Entering 'third_party/sleef' 2024-08-20T22:13:32.6518662Z Entering 'third_party/tensorpipe' 2024-08-20T22:13:32.6569805Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:13:32.6619959Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:13:32.6670044Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:13:32.6719782Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:13:32.6768368Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:13:32.6842163Z ##[endgroup] 2024-08-20T22:13:32.6891054Z [command]/usr/bin/git log -1 --format='%H' 2024-08-20T22:13:32.6929216Z '40ec5f6ddd9787aca0449b24128343ff4c4a88b3' 2024-08-20T22:13:32.7135657Z Prepare all required actions 2024-08-20T22:13:32.7136114Z Getting action download info 2024-08-20T22:13:32.8738342Z ##[group]Run ./.github/actions/setup-linux 2024-08-20T22:13:32.8738765Z env: 2024-08-20T22:13:32.8739049Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:13:32.8739384Z ##[endgroup] 2024-08-20T22:13:32.8801024Z ##[group]Run set -euo pipefail 2024-08-20T22:13:32.8801566Z set -euo pipefail 2024-08-20T22:13:32.8801969Z function get_ec2_metadata() { 2024-08-20T22:13:32.8802650Z  # Pulled from instance metadata endpoint for EC2 2024-08-20T22:13:32.8803631Z  # see https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/instancedata-data-retrieval.html 2024-08-20T22:13:32.8804395Z  category=$1 2024-08-20T22:13:32.8804950Z  # If it is GCP runner (runner name contains gcp), do not run this 2024-08-20T22:13:32.8805601Z  runner_name_str=i-005bdc4da2a364029 2024-08-20T22:13:32.8806103Z  if [[ -f /.inarc ]]; then 2024-08-20T22:13:32.8806608Z  echo "ARC Runner, no info on ec2 metadata" 2024-08-20T22:13:32.8807198Z  elif [[ $runner_name_str == *"gcp"* ]]; then 2024-08-20T22:13:32.8807890Z  echo "Runner is from Google Cloud Platform, No info on ec2 metadata" 2024-08-20T22:13:32.8808495Z  else 2024-08-20T22:13:32.8808990Z  curl -fsSL "http://169.254.169.254/latest/meta-data/${category}" 2024-08-20T22:13:32.8809596Z  fi 2024-08-20T22:13:32.8809890Z } 2024-08-20T22:13:32.8810253Z echo "ami-id: $(get_ec2_metadata ami-id)" 2024-08-20T22:13:32.8810861Z echo "instance-id: $(get_ec2_metadata instance-id)" 2024-08-20T22:13:32.8811531Z echo "instance-type: $(get_ec2_metadata instance-type)" 2024-08-20T22:13:32.8812209Z echo "system info $(uname -a)" 2024-08-20T22:13:32.8821514Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:13:32.8821999Z env: 2024-08-20T22:13:32.8822278Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:13:32.8822625Z ##[endgroup] 2024-08-20T22:13:32.8922712Z ami-id: ami-06c68f701d8090592 2024-08-20T22:13:32.8979406Z instance-id: i-005bdc4da2a364029 2024-08-20T22:13:32.9036423Z instance-type: g5.4xlarge 2024-08-20T22:13:32.9051533Z system info Linux ip-10-0-67-221.ec2.internal 6.1.94-99.176.amzn2023.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Jun 18 14:57:56 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux 2024-08-20T22:13:32.9074460Z ##[group]Run echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> $GITHUB_OUTPUT 2024-08-20T22:13:32.9075382Z echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> $GITHUB_OUTPUT 2024-08-20T22:13:32.9084725Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:13:32.9085398Z env: 2024-08-20T22:13:32.9085680Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:13:32.9086038Z ##[endgroup] 2024-08-20T22:13:32.9164906Z ##[group]Run if systemctl is-active --quiet docker; then 2024-08-20T22:13:32.9165526Z if systemctl is-active --quiet docker; then 2024-08-20T22:13:32.9166070Z  echo "Docker daemon is running..."; 2024-08-20T22:13:32.9166529Z else 2024-08-20T22:13:32.9167022Z  echo "Starting docker deamon..." && sudo systemctl start docker; 2024-08-20T22:13:32.9167608Z fi 2024-08-20T22:13:32.9176610Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:13:32.9177095Z env: 2024-08-20T22:13:32.9177367Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:13:32.9177714Z ##[endgroup] 2024-08-20T22:13:32.9262990Z Docker daemon is running... 2024-08-20T22:13:32.9311112Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2024-08-20T22:13:32.9311689Z with: 2024-08-20T22:13:32.9311972Z shell: bash 2024-08-20T22:13:32.9312265Z timeout_minutes: 5 2024-08-20T22:13:32.9312588Z max_attempts: 3 2024-08-20T22:13:32.9312907Z retry_wait_seconds: 30 2024-08-20T22:13:32.9316028Z command: AWS_ACCOUNT_ID=$(aws sts get-caller-identity|grep Account|cut -f4 -d\") aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \ --password-stdin "$AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com" # For LF Runners we need to make sure we also login to Meta's ECR docker registry too. META_AWS_ACCOUNT_ID=308535385114 if [ "$AWS_ACCOUNT_ID" != "$META_AWS_ACCOUNT_ID" ] ; then aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \ --password-stdin "$META_AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com" fi 2024-08-20T22:13:32.9319069Z polling_interval_seconds: 1 2024-08-20T22:13:32.9319452Z warning_on_retry: true 2024-08-20T22:13:32.9319798Z continue_on_error: false 2024-08-20T22:13:32.9320136Z env: 2024-08-20T22:13:32.9320414Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:13:32.9320776Z AWS_RETRY_MODE: standard 2024-08-20T22:13:32.9321125Z AWS_MAX_ATTEMPTS: 5 2024-08-20T22:13:32.9321467Z AWS_DEFAULT_REGION: us-east-1 2024-08-20T22:13:32.9321852Z ##[endgroup] 2024-08-20T22:13:34.1020737Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-08-20T22:13:34.1021599Z Configure a credential helper to remove this warning. See 2024-08-20T22:13:34.1022461Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-08-20T22:13:34.1022994Z 2024-08-20T22:13:34.1023117Z Login Succeeded 2024-08-20T22:13:34.9886943Z Command completed after 1 attempt(s). 2024-08-20T22:13:34.9951205Z ##[group]Run env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-08-20T22:13:34.9951934Z env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-08-20T22:13:34.9952595Z env | grep '^CI' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-08-20T22:13:34.9962656Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:13:34.9963165Z env: 2024-08-20T22:13:34.9963442Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:13:34.9963803Z ##[endgroup] 2024-08-20T22:13:35.0060968Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2024-08-20T22:13:35.0061742Z # ignore expansion of "docker ps -q" since it could be empty 2024-08-20T22:13:35.0062329Z # shellcheck disable=SC2046 2024-08-20T22:13:35.0062789Z docker stop $(docker ps -q) || true 2024-08-20T22:13:35.0063258Z # Prune all of the docker images 2024-08-20T22:13:35.0063745Z docker system prune -af 2024-08-20T22:13:35.0072851Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:13:35.0073348Z env: 2024-08-20T22:13:35.0073617Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:13:35.0073957Z ##[endgroup] 2024-08-20T22:13:35.0385505Z "docker stop" requires at least 1 argument. 2024-08-20T22:13:35.0386253Z See 'docker stop --help'. 2024-08-20T22:13:35.0386870Z 2024-08-20T22:13:35.0387101Z Usage: docker stop [OPTIONS] CONTAINER [CONTAINER...] 2024-08-20T22:13:35.0387498Z 2024-08-20T22:13:35.0389337Z Stop one or more running containers 2024-08-20T22:13:35.0571914Z Total reclaimed space: 0B 2024-08-20T22:13:35.0615456Z ##[group]Run set +e 2024-08-20T22:13:35.0615822Z set +e 2024-08-20T22:13:35.0616135Z set -x 2024-08-20T22:13:35.0616434Z  2024-08-20T22:13:35.0616758Z PT_DOMAIN=download.pytorch.org 2024-08-20T22:13:35.0617566Z # TODO: Flaky access to download.pytorch.org https://github.com/pytorch/pytorch/issues/100400, 2024-08-20T22:13:35.0618662Z # cleaning this up once the issue is fixed. There are more than one resolved IP here, the last 2024-08-20T22:13:35.0619433Z # one is returned at random 2024-08-20T22:13:35.0619994Z RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" | tail -n1) 2024-08-20T22:13:35.0620509Z  2024-08-20T22:13:35.0620851Z if [ -z "${RESOLVED_IP}" ]; then 2024-08-20T22:13:35.0621485Z  echo "Couldn't resolve ${PT_DOMAIN}, retrying with Google DNS..." 2024-08-20T22:13:35.0622463Z  RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" @8.8.8.8 | tail -n1) 2024-08-20T22:13:35.0623026Z  2024-08-20T22:13:35.0623360Z  if [ -z "${RESOLVED_IP}" ]; then 2024-08-20T22:13:35.0623926Z  echo "Couldn't resolve ${PT_DOMAIN}, exiting..." 2024-08-20T22:13:35.0624447Z  exit 1 2024-08-20T22:13:35.0624757Z  fi 2024-08-20T22:13:35.0625056Z fi 2024-08-20T22:13:35.0625335Z  2024-08-20T22:13:35.0625710Z if grep -r "${PT_DOMAIN}" /etc/hosts; then 2024-08-20T22:13:35.0626239Z  # Clean up any old records first 2024-08-20T22:13:35.0626759Z  sudo sed -i "/${PT_DOMAIN}/d" /etc/hosts 2024-08-20T22:13:35.0627225Z fi 2024-08-20T22:13:35.0627506Z  2024-08-20T22:13:35.0627954Z echo "${RESOLVED_IP} ${PT_DOMAIN}" | sudo tee -a /etc/hosts 2024-08-20T22:13:35.0628524Z cat /etc/hosts 2024-08-20T22:13:35.0638043Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:13:35.0638541Z env: 2024-08-20T22:13:35.0638844Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:13:35.0639204Z ##[endgroup] 2024-08-20T22:13:35.0669018Z + PT_DOMAIN=download.pytorch.org 2024-08-20T22:13:35.0675778Z ++ dig -4 +short download.pytorch.org 2024-08-20T22:13:35.0676257Z ++ tail -n1 2024-08-20T22:13:35.0833071Z + RESOLVED_IP=18.160.10.76 2024-08-20T22:13:35.0833599Z + '[' -z 18.160.10.76 ']' 2024-08-20T22:13:35.0834086Z + grep -r download.pytorch.org /etc/hosts 2024-08-20T22:13:35.0846984Z 18.165.98.47 download.pytorch.org 2024-08-20T22:13:35.0849179Z + sudo sed -i /download.pytorch.org/d /etc/hosts 2024-08-20T22:13:35.1924323Z + echo '18.160.10.76 download.pytorch.org' 2024-08-20T22:13:35.1924861Z + sudo tee -a /etc/hosts 2024-08-20T22:13:35.2246672Z 18.160.10.76 download.pytorch.org 2024-08-20T22:13:35.2269059Z + cat /etc/hosts 2024-08-20T22:13:35.2279676Z 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 2024-08-20T22:13:35.2292922Z ::1 localhost6 localhost6.localdomain6 2024-08-20T22:13:35.2293625Z 18.160.10.76 download.pytorch.org 2024-08-20T22:13:35.2449720Z ##[group]Run pytorch/test-infra/.github/actions/calculate-docker-image@main 2024-08-20T22:13:35.2450323Z with: 2024-08-20T22:13:35.2451432Z docker-image-name: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:13:35.2452759Z docker-build-dir: .ci/docker 2024-08-20T22:13:35.2453146Z working-directory: . 2024-08-20T22:13:35.2453616Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:13:35.2454142Z force-push: false 2024-08-20T22:13:35.2454455Z env: 2024-08-20T22:13:35.2454733Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:13:35.2455070Z ##[endgroup] 2024-08-20T22:13:35.2475565Z ##[group]Run set -ex 2024-08-20T22:13:35.2475939Z set -ex 2024-08-20T22:13:35.2476247Z  2024-08-20T22:13:35.2476823Z # If the docker build directory or the build script doesn't exist, the action will 2024-08-20T22:13:35.2477815Z # gracefully return the docker image name as it is. Pulling docker image in Linux 2024-08-20T22:13:35.2478622Z # job could then download the pre-built image as usual 2024-08-20T22:13:35.2479381Z if [[ ! -d "${DOCKER_BUILD_DIR}" ]] || [[ ! -f "${DOCKER_BUILD_DIR}/build.sh" ]]; then 2024-08-20T22:13:35.2480064Z  echo "skip=true" >> "${GITHUB_OUTPUT}" 2024-08-20T22:13:35.2480713Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2024-08-20T22:13:35.2481295Z  2024-08-20T22:13:35.2481817Z  echo "There is no Docker build script in ${REPO_NAME} repo, skipping..." 2024-08-20T22:13:35.2482453Z  exit 0 2024-08-20T22:13:35.2482774Z else 2024-08-20T22:13:35.2483153Z  echo "skip=false" >> "${GITHUB_OUTPUT}" 2024-08-20T22:13:35.2483617Z fi 2024-08-20T22:13:35.2483958Z  2024-08-20T22:13:35.2484446Z if [[ "${DOCKER_IMAGE_NAME}" == *"${DOCKER_REGISTRY}/${REPO_NAME}"* ]]; then 2024-08-20T22:13:35.2485305Z  # The docker image name already includes the ECR prefix and tag, so we can just 2024-08-20T22:13:35.2486111Z  # use it as it is, but first let's extract the tag 2024-08-20T22:13:35.2486829Z  DOCKER_TAG=$(echo "${DOCKER_IMAGE_NAME}" | awk -F '[:,]' '{print $2}') 2024-08-20T22:13:35.2487567Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-08-20T22:13:35.2488284Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2024-08-20T22:13:35.2488852Z else 2024-08-20T22:13:35.2489300Z  DOCKER_TAG=$(git rev-parse HEAD:"${DOCKER_BUILD_DIR}") 2024-08-20T22:13:35.2489978Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-08-20T22:13:35.2490899Z  echo "docker-image=${DOCKER_REGISTRY}/${REPO_NAME}/${DOCKER_IMAGE_NAME}:${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-08-20T22:13:35.2491727Z fi 2024-08-20T22:13:35.2502022Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:13:35.2502531Z env: 2024-08-20T22:13:35.2502809Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:13:35.2503168Z REPO_NAME: pytorch 2024-08-20T22:13:35.2504313Z DOCKER_IMAGE_NAME: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:13:35.2505534Z DOCKER_BUILD_DIR: .ci/docker 2024-08-20T22:13:35.2506037Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:13:35.2506551Z ##[endgroup] 2024-08-20T22:13:35.2537412Z + [[ ! -d .ci/docker ]] 2024-08-20T22:13:35.2537931Z + [[ ! -f .ci/docker/build.sh ]] 2024-08-20T22:13:35.2538413Z + echo skip=false 2024-08-20T22:13:35.2540572Z + [[ 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 == *\3\0\8\5\3\5\3\8\5\1\1\4\.\d\k\r\.\e\c\r\.\u\s\-\e\a\s\t\-\1\.\a\m\a\z\o\n\a\w\s\.\c\o\m\/\p\y\t\o\r\c\h* ]] 2024-08-20T22:13:35.2545121Z ++ echo 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:13:35.2546746Z ++ awk -F '[:,]' '{print $2}' 2024-08-20T22:13:35.2579771Z + DOCKER_TAG=f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:13:35.2580908Z + echo docker-tag=f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:13:35.2582855Z + echo docker-image=308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:13:35.2616013Z ##[group]Run set +e 2024-08-20T22:13:35.2616666Z set +e 2024-08-20T22:13:35.2617125Z set -x 2024-08-20T22:13:35.2617487Z  2024-08-20T22:13:35.2617893Z login() { 2024-08-20T22:13:35.2618715Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2024-08-20T22:13:35.2619556Z } 2024-08-20T22:13:35.2620006Z  2024-08-20T22:13:35.2620383Z retry () { 2024-08-20T22:13:35.2620848Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2024-08-20T22:13:35.2621475Z } 2024-08-20T22:13:35.2621851Z  2024-08-20T22:13:35.2622295Z retry login "${DOCKER_REGISTRY}" 2024-08-20T22:13:35.2622830Z  2024-08-20T22:13:35.2623409Z # Check if image already exists, if it does then skip building it 2024-08-20T22:13:35.2624241Z if docker manifest inspect "${DOCKER_IMAGE}"; then 2024-08-20T22:13:35.2624895Z  exit 0 2024-08-20T22:13:35.2625257Z fi 2024-08-20T22:13:35.2625656Z  2024-08-20T22:13:35.2626313Z # NB: This part requires a full checkout. Otherwise, the merge base will 2024-08-20T22:13:35.2627258Z # be empty. The default action would be to continue rebuild the image 2024-08-20T22:13:35.2628068Z if [[ "$BASE_REVISION" = "$(git rev-parse HEAD)" ]]; then 2024-08-20T22:13:35.2628906Z  # if we're on the base branch then use the parent commit 2024-08-20T22:13:35.2631130Z  MERGE_BASE=$(git rev-parse HEAD~) 2024-08-20T22:13:35.2631680Z else 2024-08-20T22:13:35.2632290Z  # otherwise we're on a PR, so use the most recent base commit 2024-08-20T22:13:35.2633107Z  MERGE_BASE=$(git merge-base HEAD "$BASE_REVISION") 2024-08-20T22:13:35.2633767Z fi 2024-08-20T22:13:35.2634241Z  2024-08-20T22:13:35.2634630Z if [[ -z "${MERGE_BASE}" ]]; then 2024-08-20T22:13:35.2635243Z  echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2024-08-20T22:13:35.2635878Z  2024-08-20T22:13:35.2636636Z  echo "Finding merge base only works with full checkout, please set fetch-depth to 0, continuing ..." 2024-08-20T22:13:35.2637463Z  exit 0 2024-08-20T22:13:35.2637937Z fi 2024-08-20T22:13:35.2638314Z  2024-08-20T22:13:35.2638916Z if ! git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}"; then 2024-08-20T22:13:35.2639979Z  echo "Directory '${DOCKER_BUILD_DIR}' not found in commit $MERGE_BASE, you should rebase onto a more recent commit" 2024-08-20T22:13:35.2640889Z  exit 1 2024-08-20T22:13:35.2641362Z fi 2024-08-20T22:13:35.2641740Z  2024-08-20T22:13:35.2642292Z PREVIOUS_DOCKER_TAG=$(git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}") 2024-08-20T22:13:35.2643421Z # If no image exists but the hash is the same as the previous hash then we should error out here 2024-08-20T22:13:35.2644442Z if [[ "${PREVIOUS_DOCKER_TAG}" == "${DOCKER_TAG}" ]]; then 2024-08-20T22:13:35.2645531Z  echo "WARNING: Something has gone wrong and the previous image isn't available for the merge-base of your branch" 2024-08-20T22:13:35.2646798Z  echo " Will re-build docker image to store in local cache, TTS may be longer" 2024-08-20T22:13:35.2647682Z fi 2024-08-20T22:13:35.2648088Z  2024-08-20T22:13:35.2648595Z echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2024-08-20T22:13:35.2657237Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:13:35.2657863Z env: 2024-08-20T22:13:35.2658230Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:13:35.2658709Z DOCKER_BUILD_DIR: .ci/docker 2024-08-20T22:13:35.2659294Z BASE_REVISION: 40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:13:35.2660687Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:13:35.2662038Z DOCKER_TAG: f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:13:35.2662930Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:13:35.2663553Z ##[endgroup] 2024-08-20T22:13:35.2693421Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:13:35.2694478Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:13:35.2696823Z + aws ecr get-login-password --region us-east-1 2024-08-20T22:13:35.2698272Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:13:35.8165717Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-08-20T22:13:35.8166880Z Configure a credential helper to remove this warning. See 2024-08-20T22:13:35.8168024Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-08-20T22:13:35.8168818Z 2024-08-20T22:13:35.8168979Z Login Succeeded 2024-08-20T22:13:35.8194793Z + docker manifest inspect 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:13:36.0417645Z { 2024-08-20T22:13:36.0418876Z "schemaVersion": 2, 2024-08-20T22:13:36.0419709Z "mediaType": "application/vnd.docker.distribution.manifest.v2+json", 2024-08-20T22:13:36.0421120Z "config": { 2024-08-20T22:13:36.0422070Z "mediaType": "application/vnd.docker.container.image.v1+json", 2024-08-20T22:13:36.0423046Z "size": 48711, 2024-08-20T22:13:36.0423848Z "digest": "sha256:8fef7805cec6e829013a3d62f158b75bdc2f02cdfe3428c032ea017b488473bb" 2024-08-20T22:13:36.0424790Z }, 2024-08-20T22:13:36.0425354Z "layers": [ 2024-08-20T22:13:36.0425846Z { 2024-08-20T22:13:36.0426494Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0427675Z "size": 28580681, 2024-08-20T22:13:36.0428627Z "digest": "sha256:7a2c559011895d255fce249c00396abff5ae7e0c0a92931d0ed493e71de78e3a" 2024-08-20T22:13:36.0429967Z }, 2024-08-20T22:13:36.0430528Z { 2024-08-20T22:13:36.0431245Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0432190Z "size": 7943451, 2024-08-20T22:13:36.0432988Z "digest": "sha256:224fe954d7252f10539d243d6c9688806f7d13ad775ed02e7f7c79077844510d" 2024-08-20T22:13:36.0433942Z }, 2024-08-20T22:13:36.0434355Z { 2024-08-20T22:13:36.0435020Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0435943Z "size": 55728572, 2024-08-20T22:13:36.0436755Z "digest": "sha256:75722010b82e31715876aeeed0b2cee414296f0124fdfa061ab845ba2a158450" 2024-08-20T22:13:36.0437616Z }, 2024-08-20T22:13:36.0438133Z { 2024-08-20T22:13:36.0438781Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0439703Z "size": 186, 2024-08-20T22:13:36.0441034Z "digest": "sha256:d527cbbb87e3016fd72a18a9b468c945ad0ca27c5770b39debd6ed704db3a195" 2024-08-20T22:13:36.0441974Z }, 2024-08-20T22:13:36.0442396Z { 2024-08-20T22:13:36.0443136Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0443991Z "size": 6886, 2024-08-20T22:13:36.0444836Z "digest": "sha256:b57676e46aee1a8c82e528d78e5a13e31142524eea31c8b213d69ddcb6f1fe80" 2024-08-20T22:13:36.0445867Z }, 2024-08-20T22:13:36.0446550Z { 2024-08-20T22:13:36.0447529Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0448438Z "size": 1329001756, 2024-08-20T22:13:36.0449285Z "digest": "sha256:a8c1e85b5e14cec7af70bf304cb4d4cee6a1d25eb8215b2cf4fdc33e5af5e108" 2024-08-20T22:13:36.0450007Z }, 2024-08-20T22:13:36.0450424Z { 2024-08-20T22:13:36.0450977Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0451781Z "size": 62501, 2024-08-20T22:13:36.0452407Z "digest": "sha256:a41a8d1c11c8d80fe4e82b0d05478f8d51176ff20b8350905fc1b25c93a51198" 2024-08-20T22:13:36.0453178Z }, 2024-08-20T22:13:36.0453610Z { 2024-08-20T22:13:36.0454112Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0455380Z "size": 1684, 2024-08-20T22:13:36.0456023Z "digest": "sha256:0c12278907551c2962927d27c115f6f7bf0df894318b8aea6ece3ef01ccd0a8a" 2024-08-20T22:13:36.0456790Z }, 2024-08-20T22:13:36.0457156Z { 2024-08-20T22:13:36.0457700Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0458374Z "size": 1523, 2024-08-20T22:13:36.0459090Z "digest": "sha256:d8d1234baab3ec9ccb8bb710fc6b8ff6c10896ba2e8d27a347583eca770f9ff1" 2024-08-20T22:13:36.0459802Z }, 2024-08-20T22:13:36.0460153Z { 2024-08-20T22:13:36.0460736Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0461414Z "size": 2528295403, 2024-08-20T22:13:36.0462040Z "digest": "sha256:7ed32bc8e4696fcdb2feef850781160597b2275ad756819c4add88236b0577d5" 2024-08-20T22:13:36.0462812Z }, 2024-08-20T22:13:36.0463177Z { 2024-08-20T22:13:36.0463697Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0464468Z "size": 86016, 2024-08-20T22:13:36.0465139Z "digest": "sha256:ec1e7978c1fe161ced1d98092a51e7c5953ca5fda5577f54df9dbda4afff1b2b" 2024-08-20T22:13:36.0465919Z }, 2024-08-20T22:13:36.0466253Z { 2024-08-20T22:13:36.0466791Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0467500Z "size": 1822, 2024-08-20T22:13:36.0468177Z "digest": "sha256:ac23c5fcc1ef310e9cd0d138b180281188e20a3e28c51cd14751622e3c7d92ea" 2024-08-20T22:13:36.0468866Z }, 2024-08-20T22:13:36.0469274Z { 2024-08-20T22:13:36.0469835Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0470464Z "size": 246761563, 2024-08-20T22:13:36.0471229Z "digest": "sha256:ca426ffc9d2bd051ad1ff5c4f02fd5d9be161e70953cc37882c815080c708f4d" 2024-08-20T22:13:36.0471975Z }, 2024-08-20T22:13:36.0472323Z { 2024-08-20T22:13:36.0472890Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0473542Z "size": 544, 2024-08-20T22:13:36.0474231Z "digest": "sha256:4373aa743caf6660c671295b837048c8350a2165f2336dc3b7b6c96462579e50" 2024-08-20T22:13:36.0475009Z }, 2024-08-20T22:13:36.0475319Z { 2024-08-20T22:13:36.0475849Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0476586Z "size": 1258, 2024-08-20T22:13:36.0477235Z "digest": "sha256:75b2abb16c685854c017d0cf75c626526c956734c656d9e78fdd4520317e9b3c" 2024-08-20T22:13:36.0477944Z }, 2024-08-20T22:13:36.0478363Z { 2024-08-20T22:13:36.0478894Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0479520Z "size": 484, 2024-08-20T22:13:36.0480194Z "digest": "sha256:ef1e3ef1e85f0124270b8506721219150e230184181f8207d64463bf5c67e656" 2024-08-20T22:13:36.0480916Z }, 2024-08-20T22:13:36.0481298Z { 2024-08-20T22:13:36.0481845Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0482512Z "size": 91711766, 2024-08-20T22:13:36.0483204Z "digest": "sha256:0bf61114d37b2d09065aa6852b1e78a32580a1ff011dd5d23f03b0f5c4e710af" 2024-08-20T22:13:36.0484008Z }, 2024-08-20T22:13:36.0484354Z { 2024-08-20T22:13:36.0484953Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0485661Z "size": 3390, 2024-08-20T22:13:36.0487462Z "digest": "sha256:2df849f72ba4258df10c9c45ace21a66d93b73196e78e96f12c13098822f60e2" 2024-08-20T22:13:36.0488211Z }, 2024-08-20T22:13:36.0488630Z { 2024-08-20T22:13:36.0489199Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0489820Z "size": 1909, 2024-08-20T22:13:36.0490531Z "digest": "sha256:34c47d63c5de27418739aa048b4dd781c3006d65691e9b903c95304d0509d89c" 2024-08-20T22:13:36.0491253Z }, 2024-08-20T22:13:36.0491797Z { 2024-08-20T22:13:36.0492323Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0493003Z "size": 701, 2024-08-20T22:13:36.0493734Z "digest": "sha256:1fef4bd19792cbf9d3aea12795089ad41164bb6d607c339b7484e1899825b1d2" 2024-08-20T22:13:36.0494592Z }, 2024-08-20T22:13:36.0494910Z { 2024-08-20T22:13:36.0495524Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0496195Z "size": 2864254879, 2024-08-20T22:13:36.0496847Z "digest": "sha256:6efb96fc87ea1bca54876d85331e5585e28f325a1d60ee1aef7811eabb74f933" 2024-08-20T22:13:36.0497823Z }, 2024-08-20T22:13:36.0498179Z { 2024-08-20T22:13:36.0498721Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0499414Z "size": 380, 2024-08-20T22:13:36.0500081Z "digest": "sha256:b119c4fc6c58d9e72744201ff4850b34184a94eb3566031b7d36e87ecce950a6" 2024-08-20T22:13:36.0500818Z }, 2024-08-20T22:13:36.0501210Z { 2024-08-20T22:13:36.0501706Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0502388Z "size": 12900, 2024-08-20T22:13:36.0503096Z "digest": "sha256:33b639226eeefa41d7bb26a8ecc20d271ceef45571dabfd80aaee3634926381b" 2024-08-20T22:13:36.0503845Z }, 2024-08-20T22:13:36.0504180Z { 2024-08-20T22:13:36.0504765Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0505411Z "size": 803, 2024-08-20T22:13:36.0506162Z "digest": "sha256:d3547bd43146930aa830d54562c98aa678e355cf5f84527e9717eb72fffe8ca3" 2024-08-20T22:13:36.0506926Z }, 2024-08-20T22:13:36.0507317Z { 2024-08-20T22:13:36.0507845Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0508512Z "size": 106, 2024-08-20T22:13:36.0509172Z "digest": "sha256:5645520256fa6d7f2270608eaed53849a131d03fbf4c5d4472c9cfde1a439e47" 2024-08-20T22:13:36.0509880Z }, 2024-08-20T22:13:36.0510298Z { 2024-08-20T22:13:36.0510809Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0511461Z "size": 503, 2024-08-20T22:13:36.0512149Z "digest": "sha256:829ed7d91e3818d0e11834c71551117c7aeec0a51d798e93d641faa0c02582cb" 2024-08-20T22:13:36.0512939Z }, 2024-08-20T22:13:36.0513288Z { 2024-08-20T22:13:36.0513914Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0514555Z "size": 121477267, 2024-08-20T22:13:36.0515264Z "digest": "sha256:385d0421d67c533d628985c453a186028a61f6ad4209ae519ec3d4ecea661d3e" 2024-08-20T22:13:36.0516039Z }, 2024-08-20T22:13:36.0516374Z { 2024-08-20T22:13:36.0516938Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0517751Z "size": 109, 2024-08-20T22:13:36.0518388Z "digest": "sha256:7cbfce999d76851e07dd71056a6d852629d789ccfd46be44cc405b451fb8bb58" 2024-08-20T22:13:36.0519157Z }, 2024-08-20T22:13:36.0519493Z { 2024-08-20T22:13:36.0520157Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0520939Z "size": 490, 2024-08-20T22:13:36.0521652Z "digest": "sha256:6658e558ebe496f0d628947534b0ea1e44808f84f2dfd8a9a704e8aa5329d791" 2024-08-20T22:13:36.0522378Z }, 2024-08-20T22:13:36.0522804Z { 2024-08-20T22:13:36.0523375Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0524141Z "size": 297, 2024-08-20T22:13:36.0524817Z "digest": "sha256:33444a5a7e01a3010fd1cc16b32a66892a08600d7f700747d23faf3c36624f3a" 2024-08-20T22:13:36.0525663Z + exit 0 2024-08-20T22:13:36.0526119Z }, 2024-08-20T22:13:36.0526531Z { 2024-08-20T22:13:36.0527068Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0527779Z "size": 103, 2024-08-20T22:13:36.0528436Z "digest": "sha256:7c47122f4e09b47e891b4ae9e499a35a4eb46faacae87d0e946615adda6e0706" 2024-08-20T22:13:36.0529161Z }, 2024-08-20T22:13:36.0529514Z { 2024-08-20T22:13:36.0530418Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0531100Z "size": 1473, 2024-08-20T22:13:36.0531790Z "digest": "sha256:1811ff4d3556ac255604f346d879528aff2aadd7652c2d39baf4fe6eaa60aec3" 2024-08-20T22:13:36.0532562Z }, 2024-08-20T22:13:36.0532896Z { 2024-08-20T22:13:36.0533594Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0534341Z "size": 594729516, 2024-08-20T22:13:36.0535003Z "digest": "sha256:7754ee068b33f760d9c320c26a1a3935247ace0c8c463a976105c1586a43fb1c" 2024-08-20T22:13:36.0535712Z }, 2024-08-20T22:13:36.0536143Z { 2024-08-20T22:13:36.0536675Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0537295Z "size": 164, 2024-08-20T22:13:36.0538022Z "digest": "sha256:0479fbac3361713c075bf788e778117917dcacdd1ff71ed79a789dd2016a1714" 2024-08-20T22:13:36.0538739Z }, 2024-08-20T22:13:36.0539139Z { 2024-08-20T22:13:36.0539649Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0540299Z "size": 564, 2024-08-20T22:13:36.0541005Z "digest": "sha256:f1d6874dee9c34d154278d2b6935d04447f07fa89d25d4a09398234040d8a7e8" 2024-08-20T22:13:36.0541715Z }, 2024-08-20T22:13:36.0542057Z { 2024-08-20T22:13:36.0542656Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0543317Z "size": 35874203, 2024-08-20T22:13:36.0543985Z "digest": "sha256:afc429e87b593a64f3e0a1be51e09e966ea1aa71e6e8a0bec4edc9f2f7bc1c05" 2024-08-20T22:13:36.0544745Z }, 2024-08-20T22:13:36.0545102Z { 2024-08-20T22:13:36.0545641Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0546326Z "size": 104, 2024-08-20T22:13:36.0546959Z "digest": "sha256:019620471c2592cd22437fe8ed1a94c784114cf7445c5c2ab36dd0bae727fc66" 2024-08-20T22:13:36.0547693Z }, 2024-08-20T22:13:36.0548164Z { 2024-08-20T22:13:36.0548657Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0549362Z "size": 425, 2024-08-20T22:13:36.0550083Z "digest": "sha256:27aeb1b2cd5e28d8f0e54fc1090baf88abc29ebf5fce088b493fcae99c9550d1" 2024-08-20T22:13:36.0550854Z }, 2024-08-20T22:13:36.0551163Z { 2024-08-20T22:13:36.0551750Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0552423Z "size": 20262183, 2024-08-20T22:13:36.0553040Z "digest": "sha256:829c0e19f4b7797e9120a86172fabfd710f9b3971ffd714a616931a3fadc7192" 2024-08-20T22:13:36.0553787Z }, 2024-08-20T22:13:36.0554167Z { 2024-08-20T22:13:36.0554711Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0555385Z "size": 438, 2024-08-20T22:13:36.0556069Z "digest": "sha256:560cd6122a3868e7e82e75eb103d182edf6512114d61ccdfae099af00cb16b4c" 2024-08-20T22:13:36.0556773Z }, 2024-08-20T22:13:36.0557183Z { 2024-08-20T22:13:36.0557672Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0558317Z "size": 701, 2024-08-20T22:13:36.0559033Z "digest": "sha256:1fef4bd19792cbf9d3aea12795089ad41164bb6d607c339b7484e1899825b1d2" 2024-08-20T22:13:36.0559757Z }, 2024-08-20T22:13:36.0560067Z { 2024-08-20T22:13:36.0560674Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0561326Z "size": 141, 2024-08-20T22:13:36.0561946Z "digest": "sha256:5a4eb19d72198a01f3babd4711c40fcf7c6e5cb9d5cfedc507b0061408d47097" 2024-08-20T22:13:36.0562761Z }, 2024-08-20T22:13:36.0563145Z { 2024-08-20T22:13:36.0563752Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0564560Z "size": 135, 2024-08-20T22:13:36.0565238Z "digest": "sha256:da6a838a66c72b5de9a5590c233779880ea901c1264940a1c618825d2501ffd1" 2024-08-20T22:13:36.0566090Z }, 2024-08-20T22:13:36.0566434Z { 2024-08-20T22:13:36.0566959Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0567729Z "size": 4838068375, 2024-08-20T22:13:36.0568437Z "digest": "sha256:cbb79a7053537bed2d80b77198ea552b985563b11d3f8616593c6ab575a3a090" 2024-08-20T22:13:36.0569380Z }, 2024-08-20T22:13:36.0569751Z { 2024-08-20T22:13:36.0570315Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0570998Z "size": 194, 2024-08-20T22:13:36.0571701Z "digest": "sha256:4d4fa6802ab3e6b36d8d4adb650046e9370c4a16a19876970559ef8a312ca855" 2024-08-20T22:13:36.0572505Z }, 2024-08-20T22:13:36.0572866Z { 2024-08-20T22:13:36.0573439Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0574089Z "size": 564, 2024-08-20T22:13:36.0574779Z "digest": "sha256:0f085d4fa279366fcd52d303b7ad8abddc5962a8872174b8109f3f5d5ca5f2cf" 2024-08-20T22:13:36.0575550Z }, 2024-08-20T22:13:36.0575928Z { 2024-08-20T22:13:36.0576417Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0577144Z "size": 43162921, 2024-08-20T22:13:36.0577817Z "digest": "sha256:4a0412373305517489d891a4749e6d2b80b4aeb7df3b8adca0ed0abb2f3e5300" 2024-08-20T22:13:36.0578486Z }, 2024-08-20T22:13:36.0578883Z { 2024-08-20T22:13:36.0579427Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0580073Z "size": 106, 2024-08-20T22:13:36.0580736Z "digest": "sha256:302c8c1779444e54919f83e91c6d5e1fdea653fc899be802b3a2a34d34d99d5d" 2024-08-20T22:13:36.0581438Z }, 2024-08-20T22:13:36.0581787Z { 2024-08-20T22:13:36.0582395Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0583008Z "size": 1380, 2024-08-20T22:13:36.0583675Z "digest": "sha256:02970347dff622ee45629bc28788716d00528464f71f88ec7b74ae5f44a486e2" 2024-08-20T22:13:36.0584526Z }, 2024-08-20T22:13:36.0584841Z { 2024-08-20T22:13:36.0585366Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0586184Z "size": 701, 2024-08-20T22:13:36.0586869Z "digest": "sha256:1fef4bd19792cbf9d3aea12795089ad41164bb6d607c339b7484e1899825b1d2" 2024-08-20T22:13:36.0587623Z }, 2024-08-20T22:13:36.0587971Z { 2024-08-20T22:13:36.0588501Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0589225Z "size": 139, 2024-08-20T22:13:36.0589827Z "digest": "sha256:916c5e8580164926a3aec87e88a5d1c2d02756e49fdeed4198e1e6304efa2fd3" 2024-08-20T22:13:36.0590637Z }, 2024-08-20T22:13:36.0591081Z { 2024-08-20T22:13:36.0591623Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0592264Z "size": 118, 2024-08-20T22:13:36.0592964Z "digest": "sha256:c42b3602a1fb4df5111224650f15adffb025979ae9c614807379ea84e189533b" 2024-08-20T22:13:36.0593701Z }, 2024-08-20T22:13:36.0594116Z { 2024-08-20T22:13:36.0594708Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0595355Z "size": 4324672728, 2024-08-20T22:13:36.0596055Z "digest": "sha256:11fad972ef6cb9d2dc236504b0ee5b6e5ea996e4576ece0ed3262fbb9ee2de60" 2024-08-20T22:13:36.0596844Z }, 2024-08-20T22:13:36.0597213Z { 2024-08-20T22:13:36.0597789Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0598490Z "size": 174, 2024-08-20T22:13:36.0599100Z "digest": "sha256:f957c16244819132b478272aaf24231699c4fcbd495c229a574f94daab8d6b86" 2024-08-20T22:13:36.0599862Z }, 2024-08-20T22:13:36.0600275Z { 2024-08-20T22:13:36.0600827Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0601440Z "size": 907, 2024-08-20T22:13:36.0602145Z "digest": "sha256:768c31dca016b80bbdc973c8ee818034bdbd17b7ea9bdadbf0ec45ea51005720" 2024-08-20T22:13:36.0603062Z }, 2024-08-20T22:13:36.0603378Z { 2024-08-20T22:13:36.0604041Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0604794Z "size": 701, 2024-08-20T22:13:36.0605516Z "digest": "sha256:1fef4bd19792cbf9d3aea12795089ad41164bb6d607c339b7484e1899825b1d2" 2024-08-20T22:13:36.0606223Z }, 2024-08-20T22:13:36.0606578Z { 2024-08-20T22:13:36.0607192Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0607844Z "size": 134, 2024-08-20T22:13:36.0608448Z "digest": "sha256:8c32d0ecebbe2054c96a3a5c1f3d6c8b87c2e826686b369e5242cd55d0f01c2d" 2024-08-20T22:13:36.0609272Z }, 2024-08-20T22:13:36.0609617Z { 2024-08-20T22:13:36.0610139Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0611026Z "size": 32, 2024-08-20T22:13:36.0612053Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-20T22:13:36.0612920Z }, 2024-08-20T22:13:36.0613285Z { 2024-08-20T22:13:36.0613903Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0614603Z "size": 158, 2024-08-20T22:13:36.0615237Z "digest": "sha256:78ee77eddef23f20afc78e2924f4467041cadb754634ee3df431c68211cf676d" 2024-08-20T22:13:36.0616022Z }, 2024-08-20T22:13:36.0616348Z { 2024-08-20T22:13:36.0616881Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0617583Z "size": 1841, 2024-08-20T22:13:36.0618248Z "digest": "sha256:37513e9b43d7123e7ddee09100f62a72b57af7b3833eaecd515e247e2f63e13f" 2024-08-20T22:13:36.0618919Z }, 2024-08-20T22:13:36.0619383Z { 2024-08-20T22:13:36.0619899Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0620559Z "size": 7529776, 2024-08-20T22:13:36.0621265Z "digest": "sha256:a7a5392e2bf6b73d9be292cc22a99ad4637636c15733beb7afbe6403b5ba21a8" 2024-08-20T22:13:36.0621985Z }, 2024-08-20T22:13:36.0622342Z { 2024-08-20T22:13:36.0622932Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0623593Z "size": 163, 2024-08-20T22:13:36.0624230Z "digest": "sha256:b10de02255c021b2366b85bf12ddf593aac89f88964201c455b71a145bc5ca2e" 2024-08-20T22:13:36.0625015Z }, 2024-08-20T22:13:36.0625326Z { 2024-08-20T22:13:36.0625890Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0626655Z "size": 7943, 2024-08-20T22:13:36.0627310Z "digest": "sha256:e56eeff2db93ffe5002a2bb764795b7333321c6802cc28bef0801a619fe6a07e" 2024-08-20T22:13:36.0628012Z }, 2024-08-20T22:13:36.0628417Z { 2024-08-20T22:13:36.0628948Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0630003Z "size": 8068, 2024-08-20T22:13:36.0630633Z "digest": "sha256:70ac3e38d0fd1f0f46ad710c3fc485fd01406606054e8cf84a63af1570bc9f3a" 2024-08-20T22:13:36.0631352Z }, 2024-08-20T22:13:36.0631781Z { 2024-08-20T22:13:36.0632289Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0632963Z "size": 302, 2024-08-20T22:13:36.0633706Z "digest": "sha256:eb09cbf3e4168749cc8605e3188ed35070f6037d13930e443c38d8941734488f" 2024-08-20T22:13:36.0634426Z }, 2024-08-20T22:13:36.0634756Z { 2024-08-20T22:13:36.0635341Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0636000Z "size": 7629638, 2024-08-20T22:13:36.0636659Z "digest": "sha256:ee1273153675e6543b58f5be50321abee5e91f7351701d5d501a6837eaf676ef" 2024-08-20T22:13:36.0637402Z }, 2024-08-20T22:13:36.0637769Z { 2024-08-20T22:13:36.0638335Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0639015Z "size": 108, 2024-08-20T22:13:36.0639689Z "digest": "sha256:e22979f9e0eedfa16f98eb4fa26f30a50c237f5ffd2f6e5b898f2b908058496d" 2024-08-20T22:13:36.0640405Z }, 2024-08-20T22:13:36.0640852Z { 2024-08-20T22:13:36.0641377Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0642196Z "size": 54145661, 2024-08-20T22:13:36.0642956Z "digest": "sha256:6c1f0aabce7c84f9b0b9ab3b96325778dba1c1465b7463c5b4c6be1cf52b74db" 2024-08-20T22:13:36.0643686Z }, 2024-08-20T22:13:36.0644000Z { 2024-08-20T22:13:36.0644614Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0645282Z "size": 473, 2024-08-20T22:13:36.0645921Z "digest": "sha256:7ebe49c3a23e71b289ce012b48dad35791a2f2aa7fcee2326a64d763b0d14df8" 2024-08-20T22:13:36.0646667Z }, 2024-08-20T22:13:36.0647008Z { 2024-08-20T22:13:36.0647602Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0648293Z "size": 1374858766, 2024-08-20T22:13:36.0648955Z "digest": "sha256:5d115b29b5d53e5418762bc41ae975dd245bcffc3d058b8902c58146d505cb37" 2024-08-20T22:13:36.0649810Z }, 2024-08-20T22:13:36.0650202Z { 2024-08-20T22:13:36.0650692Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0651358Z "size": 106, 2024-08-20T22:13:36.0652167Z "digest": "sha256:7f2d7a04fbe65bbe1e895138e0cfeeef53ad926c890bab8e7e132ad1e655e48f" 2024-08-20T22:13:36.0652918Z }, 2024-08-20T22:13:36.0653226Z { 2024-08-20T22:13:36.0653809Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0654548Z "size": 559, 2024-08-20T22:13:36.0655140Z "digest": "sha256:d79fd7d526989e554455eda7d459f2c88444030f61710101e52ec8c7a49b7b79" 2024-08-20T22:13:36.0655904Z }, 2024-08-20T22:13:36.0656277Z { 2024-08-20T22:13:36.0656863Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0657477Z "size": 46248488, 2024-08-20T22:13:36.0658150Z "digest": "sha256:9752d6fbbcab4e7403f26777c5b65911320de6389c81b833a47ba45c4f3354b4" 2024-08-20T22:13:36.0658923Z }, 2024-08-20T22:13:36.0659284Z { 2024-08-20T22:13:36.0659776Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0660472Z "size": 111, 2024-08-20T22:13:36.0661204Z "digest": "sha256:83808b2eff4d71ed46db7c29f66fe918f328405c25b314225dfad01b4868d1f4" 2024-08-20T22:13:36.0661916Z }, 2024-08-20T22:13:36.0662272Z { 2024-08-20T22:13:36.0662820Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0663467Z "size": 32, 2024-08-20T22:13:36.0664149Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-20T22:13:36.0664911Z }, 2024-08-20T22:13:36.0665252Z { 2024-08-20T22:13:36.0665857Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0666457Z "size": 32, 2024-08-20T22:13:36.0667083Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-20T22:13:36.0667866Z }, 2024-08-20T22:13:36.0668277Z { 2024-08-20T22:13:36.0668766Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0669476Z "size": 32, 2024-08-20T22:13:36.0670116Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-20T22:13:36.0670791Z }, 2024-08-20T22:13:36.0671211Z { 2024-08-20T22:13:36.0671732Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:13:36.0672395Z "size": 32, 2024-08-20T22:13:36.0673043Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-20T22:13:36.0673756Z } 2024-08-20T22:13:36.0674162Z ] 2024-08-20T22:13:36.0674622Z } 2024-08-20T22:13:36.0981870Z ##[group]Run tag=${ECR_DOCKER_IMAGE##*/} 2024-08-20T22:13:36.0982382Z tag=${ECR_DOCKER_IMAGE##*/} 2024-08-20T22:13:36.0983066Z echo "docker pull ghcr.io/pytorch/ci-image:${tag/:/-}" 2024-08-20T22:13:36.0992372Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:13:36.0992891Z env: 2024-08-20T22:13:36.0993174Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:13:36.0994408Z ECR_DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:13:36.0995597Z ##[endgroup] 2024-08-20T22:13:36.1027462Z docker pull ghcr.io/pytorch/ci-image:pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks-f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:13:36.1079661Z ##[group]Run pytorch/test-infra/.github/actions/pull-docker-image@main 2024-08-20T22:13:36.1080248Z with: 2024-08-20T22:13:36.1081327Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:13:36.1082716Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:13:36.1083240Z env: 2024-08-20T22:13:36.1083733Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:13:36.1084182Z ##[endgroup] 2024-08-20T22:13:36.1102657Z ##[group]Run set -x 2024-08-20T22:13:36.1103004Z set -x 2024-08-20T22:13:36.1103314Z set +e 2024-08-20T22:13:36.1103618Z  2024-08-20T22:13:36.1103915Z login() { 2024-08-20T22:13:36.1104625Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2024-08-20T22:13:36.1105352Z } 2024-08-20T22:13:36.1105640Z  2024-08-20T22:13:36.1105951Z retry () { 2024-08-20T22:13:36.1106352Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2024-08-20T22:13:36.1106804Z } 2024-08-20T22:13:36.1107083Z  2024-08-20T22:13:36.1107403Z retry login "${DOCKER_REGISTRY}" 2024-08-20T22:13:36.1107818Z  2024-08-20T22:13:36.1108095Z set -e 2024-08-20T22:13:36.1108572Z # ignore output since only exit code is used for conditional 2024-08-20T22:13:36.1109287Z # only pull docker image if it's not available locally 2024-08-20T22:13:36.1110059Z if ! docker inspect --type=image "${DOCKER_IMAGE}" >/dev/null 2>/dev/null; then 2024-08-20T22:13:36.1110774Z  retry docker pull "${DOCKER_IMAGE}" 2024-08-20T22:13:36.1111228Z fi 2024-08-20T22:13:36.1119323Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:13:36.1119828Z env: 2024-08-20T22:13:36.1120108Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:13:36.1121263Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:13:36.1122572Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:13:36.1123094Z ##[endgroup] 2024-08-20T22:13:36.1150690Z + set +e 2024-08-20T22:13:36.1151613Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:13:36.1152297Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:13:36.1154909Z + aws ecr get-login-password --region us-east-1 2024-08-20T22:13:36.1155715Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:13:36.6581372Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-08-20T22:13:36.6582290Z Configure a credential helper to remove this warning. See 2024-08-20T22:13:36.6583297Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-08-20T22:13:36.6583897Z 2024-08-20T22:13:36.6584027Z Login Succeeded 2024-08-20T22:13:36.6602841Z + set -e 2024-08-20T22:13:36.6604176Z + docker inspect --type=image 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:13:36.6766082Z + retry docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:13:36.6768280Z + docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:13:36.9417357Z f6d216893d65c7b8ae43df4daaf247db808378e9: Pulling from pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks 2024-08-20T22:13:36.9422074Z 7a2c55901189: Pulling fs layer 2024-08-20T22:13:36.9422696Z 224fe954d725: Pulling fs layer 2024-08-20T22:13:36.9423639Z 75722010b82e: Pulling fs layer 2024-08-20T22:13:36.9424215Z d527cbbb87e3: Pulling fs layer 2024-08-20T22:13:36.9424744Z b57676e46aee: Pulling fs layer 2024-08-20T22:13:36.9425270Z a8c1e85b5e14: Pulling fs layer 2024-08-20T22:13:36.9425670Z a41a8d1c11c8: Pulling fs layer 2024-08-20T22:13:36.9426039Z 0c1227890755: Pulling fs layer 2024-08-20T22:13:36.9426534Z d8d1234baab3: Pulling fs layer 2024-08-20T22:13:36.9427105Z 7ed32bc8e469: Pulling fs layer 2024-08-20T22:13:36.9427637Z ec1e7978c1fe: Pulling fs layer 2024-08-20T22:13:36.9428462Z ac23c5fcc1ef: Pulling fs layer 2024-08-20T22:13:36.9428992Z ca426ffc9d2b: Pulling fs layer 2024-08-20T22:13:36.9429714Z 4373aa743caf: Pulling fs layer 2024-08-20T22:13:36.9430270Z 75b2abb16c68: Pulling fs layer 2024-08-20T22:13:36.9430775Z d527cbbb87e3: Waiting 2024-08-20T22:13:36.9431238Z ef1e3ef1e85f: Pulling fs layer 2024-08-20T22:13:36.9431749Z 0bf61114d37b: Pulling fs layer 2024-08-20T22:13:36.9432420Z 2df849f72ba4: Pulling fs layer 2024-08-20T22:13:36.9432922Z 34c47d63c5de: Pulling fs layer 2024-08-20T22:13:36.9433399Z 7ed32bc8e469: Waiting 2024-08-20T22:13:36.9433869Z 1fef4bd19792: Pulling fs layer 2024-08-20T22:13:36.9434367Z 0c1227890755: Waiting 2024-08-20T22:13:36.9434815Z 6efb96fc87ea: Pulling fs layer 2024-08-20T22:13:36.9435444Z b119c4fc6c58: Pulling fs layer 2024-08-20T22:13:36.9435973Z 33b639226eee: Pulling fs layer 2024-08-20T22:13:36.9436480Z d3547bd43146: Pulling fs layer 2024-08-20T22:13:36.9437018Z ac23c5fcc1ef: Waiting 2024-08-20T22:13:36.9437359Z ca426ffc9d2b: Waiting 2024-08-20T22:13:36.9437701Z 5645520256fa: Pulling fs layer 2024-08-20T22:13:36.9438072Z 829ed7d91e38: Pulling fs layer 2024-08-20T22:13:36.9438449Z 385d0421d67c: Pulling fs layer 2024-08-20T22:13:36.9438806Z 4373aa743caf: Waiting 2024-08-20T22:13:36.9439127Z 34c47d63c5de: Waiting 2024-08-20T22:13:36.9439455Z 7cbfce999d76: Pulling fs layer 2024-08-20T22:13:36.9439827Z a41a8d1c11c8: Waiting 2024-08-20T22:13:36.9440148Z d8d1234baab3: Waiting 2024-08-20T22:13:36.9440481Z 6658e558ebe4: Pulling fs layer 2024-08-20T22:13:36.9440850Z 33444a5a7e01: Pulling fs layer 2024-08-20T22:13:36.9441209Z 33b639226eee: Waiting 2024-08-20T22:13:36.9441539Z 7c47122f4e09: Pulling fs layer 2024-08-20T22:13:36.9441892Z d3547bd43146: Waiting 2024-08-20T22:13:36.9442213Z 0bf61114d37b: Waiting 2024-08-20T22:13:36.9442539Z b119c4fc6c58: Waiting 2024-08-20T22:13:36.9442851Z 5645520256fa: Waiting 2024-08-20T22:13:36.9443177Z 75b2abb16c68: Waiting 2024-08-20T22:13:36.9443497Z ef1e3ef1e85f: Waiting 2024-08-20T22:13:36.9443820Z 2df849f72ba4: Waiting 2024-08-20T22:13:36.9444130Z 829ed7d91e38: Waiting 2024-08-20T22:13:36.9444540Z 1811ff4d3556: Pulling fs layer 2024-08-20T22:13:36.9444904Z 7cbfce999d76: Waiting 2024-08-20T22:13:36.9445239Z 7754ee068b33: Pulling fs layer 2024-08-20T22:13:36.9445612Z 0479fbac3361: Pulling fs layer 2024-08-20T22:13:36.9445979Z f1d6874dee9c: Pulling fs layer 2024-08-20T22:13:36.9446360Z afc429e87b59: Pulling fs layer 2024-08-20T22:13:36.9446716Z 7c47122f4e09: Waiting 2024-08-20T22:13:36.9447039Z 019620471c25: Pulling fs layer 2024-08-20T22:13:36.9447411Z 27aeb1b2cd5e: Pulling fs layer 2024-08-20T22:13:36.9447851Z 829c0e19f4b7: Pulling fs layer 2024-08-20T22:13:36.9448213Z 0479fbac3361: Waiting 2024-08-20T22:13:36.9448576Z 560cd6122a38: Pulling fs layer 2024-08-20T22:13:36.9448942Z a8c1e85b5e14: Waiting 2024-08-20T22:13:36.9449316Z 5a4eb19d7219: Pulling fs layer 2024-08-20T22:13:36.9449701Z da6a838a66c7: Pulling fs layer 2024-08-20T22:13:36.9450074Z cbb79a705353: Pulling fs layer 2024-08-20T22:13:36.9450462Z 4d4fa6802ab3: Pulling fs layer 2024-08-20T22:13:36.9450840Z 27aeb1b2cd5e: Waiting 2024-08-20T22:13:36.9451159Z 6efb96fc87ea: Waiting 2024-08-20T22:13:36.9451511Z 0f085d4fa279: Pulling fs layer 2024-08-20T22:13:36.9451966Z 829c0e19f4b7: Waiting 2024-08-20T22:13:36.9452288Z 560cd6122a38: Waiting 2024-08-20T22:13:36.9452609Z 4a0412373305: Pulling fs layer 2024-08-20T22:13:36.9452984Z 302c8c177944: Pulling fs layer 2024-08-20T22:13:36.9453353Z 02970347dff6: Pulling fs layer 2024-08-20T22:13:36.9453926Z 5a4eb19d7219: Waiting 2024-08-20T22:13:36.9454248Z 33444a5a7e01: Waiting 2024-08-20T22:13:36.9454576Z 916c5e858016: Pulling fs layer 2024-08-20T22:13:36.9454936Z da6a838a66c7: Waiting 2024-08-20T22:13:36.9455261Z c42b3602a1fb: Pulling fs layer 2024-08-20T22:13:36.9455641Z 11fad972ef6c: Pulling fs layer 2024-08-20T22:13:36.9456000Z 0f085d4fa279: Waiting 2024-08-20T22:13:36.9456329Z f957c1624481: Pulling fs layer 2024-08-20T22:13:36.9456681Z 302c8c177944: Waiting 2024-08-20T22:13:36.9457175Z 4a0412373305: Waiting 2024-08-20T22:13:36.9457489Z cbb79a705353: Waiting 2024-08-20T22:13:36.9457813Z 768c31dca016: Pulling fs layer 2024-08-20T22:13:36.9458172Z 1811ff4d3556: Waiting 2024-08-20T22:13:36.9458505Z 8c32d0ecebbe: Pulling fs layer 2024-08-20T22:13:36.9458872Z 02970347dff6: Waiting 2024-08-20T22:13:36.9459201Z 4f4fb700ef54: Pulling fs layer 2024-08-20T22:13:36.9459565Z afc429e87b59: Waiting 2024-08-20T22:13:36.9459893Z 11fad972ef6c: Waiting 2024-08-20T22:13:36.9460215Z 768c31dca016: Waiting 2024-08-20T22:13:36.9460552Z 78ee77eddef2: Pulling fs layer 2024-08-20T22:13:36.9460930Z 37513e9b43d7: Pulling fs layer 2024-08-20T22:13:36.9461301Z 8c32d0ecebbe: Waiting 2024-08-20T22:13:36.9461618Z 78ee77eddef2: Waiting 2024-08-20T22:13:36.9461937Z 7754ee068b33: Waiting 2024-08-20T22:13:36.9462253Z 37513e9b43d7: Waiting 2024-08-20T22:13:36.9462591Z a7a5392e2bf6: Pulling fs layer 2024-08-20T22:13:36.9462961Z b10de02255c0: Pulling fs layer 2024-08-20T22:13:36.9463340Z e56eeff2db93: Pulling fs layer 2024-08-20T22:13:36.9463726Z 70ac3e38d0fd: Pulling fs layer 2024-08-20T22:13:36.9464090Z f957c1624481: Waiting 2024-08-20T22:13:36.9464418Z eb09cbf3e416: Pulling fs layer 2024-08-20T22:13:36.9464778Z b10de02255c0: Waiting 2024-08-20T22:13:36.9465169Z 4d4fa6802ab3: Waiting 2024-08-20T22:13:36.9465497Z ee1273153675: Pulling fs layer 2024-08-20T22:13:36.9465883Z e22979f9e0ee: Pulling fs layer 2024-08-20T22:13:36.9466263Z 6c1f0aabce7c: Pulling fs layer 2024-08-20T22:13:36.9466649Z 7ebe49c3a23e: Pulling fs layer 2024-08-20T22:13:36.9467032Z 5d115b29b5d5: Pulling fs layer 2024-08-20T22:13:36.9467397Z eb09cbf3e416: Waiting 2024-08-20T22:13:36.9467727Z e22979f9e0ee: Waiting 2024-08-20T22:13:36.9468040Z 6c1f0aabce7c: Waiting 2024-08-20T22:13:36.9468379Z 7f2d7a04fbe6: Pulling fs layer 2024-08-20T22:13:36.9468742Z 7ebe49c3a23e: Waiting 2024-08-20T22:13:36.9469076Z d79fd7d52698: Pulling fs layer 2024-08-20T22:13:36.9469448Z 9752d6fbbcab: Pulling fs layer 2024-08-20T22:13:36.9469827Z 83808b2eff4d: Pulling fs layer 2024-08-20T22:13:36.9470198Z 9752d6fbbcab: Waiting 2024-08-20T22:13:36.9470523Z d79fd7d52698: Waiting 2024-08-20T22:13:36.9470837Z 83808b2eff4d: Waiting 2024-08-20T22:13:37.0763256Z 224fe954d725: Verifying Checksum 2024-08-20T22:13:37.0763728Z 224fe954d725: Download complete 2024-08-20T22:13:37.1518965Z d527cbbb87e3: Verifying Checksum 2024-08-20T22:13:37.1519397Z d527cbbb87e3: Download complete 2024-08-20T22:13:37.2185519Z b57676e46aee: Download complete 2024-08-20T22:13:37.2925419Z 7a2c55901189: Verifying Checksum 2024-08-20T22:13:37.2926308Z 7a2c55901189: Download complete 2024-08-20T22:13:37.3669039Z a41a8d1c11c8: Verifying Checksum 2024-08-20T22:13:37.3669587Z a41a8d1c11c8: Download complete 2024-08-20T22:13:37.4538842Z 0c1227890755: Download complete 2024-08-20T22:13:37.5293634Z d8d1234baab3: Verifying Checksum 2024-08-20T22:13:37.5294276Z d8d1234baab3: Download complete 2024-08-20T22:13:37.5484052Z 75722010b82e: Verifying Checksum 2024-08-20T22:13:37.5484539Z 75722010b82e: Download complete 2024-08-20T22:13:37.6181411Z ec1e7978c1fe: Download complete 2024-08-20T22:13:37.7060005Z ac23c5fcc1ef: Verifying Checksum 2024-08-20T22:13:37.7061592Z ac23c5fcc1ef: Download complete 2024-08-20T22:13:38.4631855Z 7a2c55901189: Pull complete 2024-08-20T22:13:38.7734658Z 224fe954d725: Pull complete 2024-08-20T22:13:39.6630364Z 75722010b82e: Pull complete 2024-08-20T22:13:39.6813796Z d527cbbb87e3: Pull complete 2024-08-20T22:13:39.7012423Z b57676e46aee: Pull complete 2024-08-20T22:13:40.2719285Z ca426ffc9d2b: Verifying Checksum 2024-08-20T22:13:40.2720033Z ca426ffc9d2b: Download complete 2024-08-20T22:13:40.3385501Z 4373aa743caf: Verifying Checksum 2024-08-20T22:13:40.3385954Z 4373aa743caf: Download complete 2024-08-20T22:13:40.4153012Z 75b2abb16c68: Verifying Checksum 2024-08-20T22:13:40.4153437Z 75b2abb16c68: Download complete 2024-08-20T22:13:40.5146155Z ef1e3ef1e85f: Verifying Checksum 2024-08-20T22:13:40.5146597Z ef1e3ef1e85f: Download complete 2024-08-20T22:13:41.4902517Z 0bf61114d37b: Verifying Checksum 2024-08-20T22:13:41.4903074Z 0bf61114d37b: Download complete 2024-08-20T22:13:41.5727827Z 2df849f72ba4: Verifying Checksum 2024-08-20T22:13:41.5728327Z 2df849f72ba4: Download complete 2024-08-20T22:13:41.6439332Z 34c47d63c5de: Verifying Checksum 2024-08-20T22:13:41.6440020Z 34c47d63c5de: Download complete 2024-08-20T22:13:41.7187034Z 1fef4bd19792: Verifying Checksum 2024-08-20T22:13:41.7187493Z 1fef4bd19792: Download complete 2024-08-20T22:13:50.5747298Z a8c1e85b5e14: Verifying Checksum 2024-08-20T22:13:50.5747790Z a8c1e85b5e14: Download complete 2024-08-20T22:13:50.6725248Z b119c4fc6c58: Verifying Checksum 2024-08-20T22:13:50.6726002Z b119c4fc6c58: Download complete 2024-08-20T22:13:50.7465084Z 33b639226eee: Download complete 2024-08-20T22:13:50.8187336Z d3547bd43146: Verifying Checksum 2024-08-20T22:13:50.8188041Z d3547bd43146: Download complete 2024-08-20T22:13:50.8910096Z 5645520256fa: Download complete 2024-08-20T22:13:50.9647726Z 829ed7d91e38: Verifying Checksum 2024-08-20T22:13:50.9649020Z 829ed7d91e38: Download complete 2024-08-20T22:13:52.2320674Z 385d0421d67c: Verifying Checksum 2024-08-20T22:13:52.2321154Z 385d0421d67c: Download complete 2024-08-20T22:13:52.2932897Z 7cbfce999d76: Verifying Checksum 2024-08-20T22:13:52.2933598Z 7cbfce999d76: Download complete 2024-08-20T22:13:52.3695344Z 6658e558ebe4: Verifying Checksum 2024-08-20T22:13:52.3695838Z 6658e558ebe4: Download complete 2024-08-20T22:13:52.4344277Z 33444a5a7e01: Download complete 2024-08-20T22:13:52.5054870Z 7c47122f4e09: Verifying Checksum 2024-08-20T22:13:52.5055326Z 7c47122f4e09: Download complete 2024-08-20T22:13:52.5771990Z 1811ff4d3556: Download complete 2024-08-20T22:13:58.5833286Z 7754ee068b33: Verifying Checksum 2024-08-20T22:13:58.5833750Z 7754ee068b33: Download complete 2024-08-20T22:13:58.6618710Z 0479fbac3361: Verifying Checksum 2024-08-20T22:13:58.6619182Z 0479fbac3361: Download complete 2024-08-20T22:13:58.7273620Z f1d6874dee9c: Verifying Checksum 2024-08-20T22:13:58.7274055Z f1d6874dee9c: Download complete 2024-08-20T22:13:59.1425550Z afc429e87b59: Verifying Checksum 2024-08-20T22:13:59.1426101Z afc429e87b59: Download complete 2024-08-20T22:13:59.2128346Z 019620471c25: Download complete 2024-08-20T22:13:59.2814985Z 27aeb1b2cd5e: Download complete 2024-08-20T22:13:59.5428898Z 829c0e19f4b7: Verifying Checksum 2024-08-20T22:13:59.5429358Z 829c0e19f4b7: Download complete 2024-08-20T22:13:59.6193308Z 560cd6122a38: Download complete 2024-08-20T22:13:59.7057150Z 5a4eb19d7219: Verifying Checksum 2024-08-20T22:13:59.7057642Z 5a4eb19d7219: Download complete 2024-08-20T22:13:59.7917495Z da6a838a66c7: Verifying Checksum 2024-08-20T22:13:59.7918072Z da6a838a66c7: Download complete 2024-08-20T22:14:02.8792156Z 7ed32bc8e469: Verifying Checksum 2024-08-20T22:14:02.8792654Z 7ed32bc8e469: Download complete 2024-08-20T22:14:02.9541045Z 4d4fa6802ab3: Verifying Checksum 2024-08-20T22:14:02.9541520Z 4d4fa6802ab3: Download complete 2024-08-20T22:14:03.0269125Z 0f085d4fa279: Verifying Checksum 2024-08-20T22:14:03.0269574Z 0f085d4fa279: Download complete 2024-08-20T22:14:03.5196958Z 4a0412373305: Verifying Checksum 2024-08-20T22:14:03.5197461Z 4a0412373305: Download complete 2024-08-20T22:14:03.5914394Z 302c8c177944: Verifying Checksum 2024-08-20T22:14:03.5915000Z 302c8c177944: Download complete 2024-08-20T22:14:03.6678488Z 02970347dff6: Verifying Checksum 2024-08-20T22:14:03.6678951Z 02970347dff6: Download complete 2024-08-20T22:14:03.6795518Z a8c1e85b5e14: Pull complete 2024-08-20T22:14:03.7454795Z 916c5e858016: Verifying Checksum 2024-08-20T22:14:03.7455294Z 916c5e858016: Download complete 2024-08-20T22:14:03.8160003Z c42b3602a1fb: Verifying Checksum 2024-08-20T22:14:03.8160484Z c42b3602a1fb: Download complete 2024-08-20T22:14:03.8366078Z a41a8d1c11c8: Pull complete 2024-08-20T22:14:03.9176827Z 0c1227890755: Pull complete 2024-08-20T22:14:04.0527867Z d8d1234baab3: Pull complete 2024-08-20T22:14:10.4186088Z 6efb96fc87ea: Verifying Checksum 2024-08-20T22:14:10.4186681Z 6efb96fc87ea: Download complete 2024-08-20T22:14:10.4961803Z f957c1624481: Verifying Checksum 2024-08-20T22:14:10.4962716Z f957c1624481: Download complete 2024-08-20T22:14:10.5660336Z 768c31dca016: Download complete 2024-08-20T22:14:10.6352527Z 8c32d0ecebbe: Verifying Checksum 2024-08-20T22:14:10.6353102Z 8c32d0ecebbe: Download complete 2024-08-20T22:14:10.6427683Z 4f4fb700ef54: Verifying Checksum 2024-08-20T22:14:10.6428223Z 4f4fb700ef54: Download complete 2024-08-20T22:14:10.7001706Z 78ee77eddef2: Verifying Checksum 2024-08-20T22:14:10.7002264Z 78ee77eddef2: Download complete 2024-08-20T22:14:10.7754319Z 37513e9b43d7: Download complete 2024-08-20T22:14:10.8973474Z a7a5392e2bf6: Verifying Checksum 2024-08-20T22:14:10.8974112Z a7a5392e2bf6: Download complete 2024-08-20T22:14:10.9741408Z b10de02255c0: Verifying Checksum 2024-08-20T22:14:10.9741904Z b10de02255c0: Download complete 2024-08-20T22:14:11.0431680Z e56eeff2db93: Download complete 2024-08-20T22:14:11.1199240Z 70ac3e38d0fd: Verifying Checksum 2024-08-20T22:14:11.1199698Z 70ac3e38d0fd: Download complete 2024-08-20T22:14:11.1977470Z eb09cbf3e416: Verifying Checksum 2024-08-20T22:14:11.1978108Z eb09cbf3e416: Download complete 2024-08-20T22:14:11.3275928Z ee1273153675: Verifying Checksum 2024-08-20T22:14:11.3276406Z ee1273153675: Download complete 2024-08-20T22:14:11.3886849Z e22979f9e0ee: Verifying Checksum 2024-08-20T22:14:11.3887318Z e22979f9e0ee: Download complete 2024-08-20T22:14:11.9833813Z 6c1f0aabce7c: Verifying Checksum 2024-08-20T22:14:11.9834431Z 6c1f0aabce7c: Download complete 2024-08-20T22:14:12.0543129Z 7ebe49c3a23e: Verifying Checksum 2024-08-20T22:14:12.0543639Z 7ebe49c3a23e: Download complete 2024-08-20T22:14:38.7991803Z 5d115b29b5d5: Verifying Checksum 2024-08-20T22:14:38.7994102Z 5d115b29b5d5: Download complete 2024-08-20T22:14:38.8827174Z 7f2d7a04fbe6: Verifying Checksum 2024-08-20T22:14:38.8829085Z 7f2d7a04fbe6: Download complete 2024-08-20T22:14:38.9504836Z d79fd7d52698: Download complete 2024-08-20T22:14:40.2377511Z 9752d6fbbcab: Verifying Checksum 2024-08-20T22:14:40.2377977Z 9752d6fbbcab: Download complete 2024-08-20T22:14:40.3153576Z 83808b2eff4d: Download complete 2024-08-20T22:15:19.0663152Z 11fad972ef6c: Verifying Checksum 2024-08-20T22:15:19.0665441Z 11fad972ef6c: Download complete 2024-08-20T22:15:19.5466191Z cbb79a705353: Verifying Checksum 2024-08-20T22:15:34.3136199Z 7ed32bc8e469: Pull complete 2024-08-20T22:15:34.5030654Z ec1e7978c1fe: Pull complete 2024-08-20T22:15:34.6976733Z ac23c5fcc1ef: Pull complete 2024-08-20T22:15:43.3470641Z ca426ffc9d2b: Pull complete 2024-08-20T22:15:43.5781295Z 4373aa743caf: Pull complete 2024-08-20T22:15:43.8202592Z 75b2abb16c68: Pull complete 2024-08-20T22:15:44.0475595Z ef1e3ef1e85f: Pull complete 2024-08-20T22:15:46.7868037Z 0bf61114d37b: Pull complete 2024-08-20T22:15:47.0082670Z 2df849f72ba4: Pull complete 2024-08-20T22:15:47.2269024Z 34c47d63c5de: Pull complete 2024-08-20T22:15:47.4552839Z 1fef4bd19792: Pull complete 2024-08-20T22:16:45.9717435Z 6efb96fc87ea: Pull complete 2024-08-20T22:16:46.1148374Z b119c4fc6c58: Pull complete 2024-08-20T22:16:46.2986815Z 33b639226eee: Pull complete 2024-08-20T22:16:46.5031348Z d3547bd43146: Pull complete 2024-08-20T22:16:46.6985071Z 5645520256fa: Pull complete 2024-08-20T22:16:46.9235523Z 829ed7d91e38: Pull complete 2024-08-20T22:16:50.3216156Z 385d0421d67c: Pull complete 2024-08-20T22:16:50.5392281Z 7cbfce999d76: Pull complete 2024-08-20T22:16:50.7590508Z 6658e558ebe4: Pull complete 2024-08-20T22:16:50.9252530Z 33444a5a7e01: Pull complete 2024-08-20T22:16:51.1043806Z 7c47122f4e09: Pull complete 2024-08-20T22:16:51.2750289Z 1811ff4d3556: Pull complete 2024-08-20T22:17:01.8000847Z 7754ee068b33: Pull complete 2024-08-20T22:17:02.0280200Z 0479fbac3361: Pull complete 2024-08-20T22:17:02.2401136Z f1d6874dee9c: Pull complete 2024-08-20T22:17:03.0984173Z afc429e87b59: Pull complete 2024-08-20T22:17:03.2310442Z 019620471c25: Pull complete 2024-08-20T22:17:03.4026085Z 27aeb1b2cd5e: Pull complete 2024-08-20T22:17:03.8232323Z 829c0e19f4b7: Pull complete 2024-08-20T22:17:03.9612064Z 560cd6122a38: Pull complete 2024-08-20T22:17:04.2013033Z 5a4eb19d7219: Pull complete 2024-08-20T22:17:04.3241901Z da6a838a66c7: Pull complete 2024-08-20T22:17:42.9106191Z cbb79a705353: Pull complete 2024-08-20T22:17:43.1441779Z 4d4fa6802ab3: Pull complete 2024-08-20T22:17:43.3785099Z 0f085d4fa279: Pull complete 2024-08-20T22:17:45.7889116Z 4a0412373305: Pull complete 2024-08-20T22:17:45.8020129Z 302c8c177944: Pull complete 2024-08-20T22:17:45.8150627Z 02970347dff6: Pull complete 2024-08-20T22:17:45.8420869Z 916c5e858016: Pull complete 2024-08-20T22:17:45.8552062Z c42b3602a1fb: Pull complete 2024-08-20T22:19:07.7986852Z 11fad972ef6c: Pull complete 2024-08-20T22:19:08.0274428Z f957c1624481: Pull complete 2024-08-20T22:19:08.2525747Z 768c31dca016: Pull complete 2024-08-20T22:19:08.6706339Z 8c32d0ecebbe: Pull complete 2024-08-20T22:19:08.9138600Z 4f4fb700ef54: Pull complete 2024-08-20T22:19:09.1488878Z 78ee77eddef2: Pull complete 2024-08-20T22:19:09.3839145Z 37513e9b43d7: Pull complete 2024-08-20T22:19:09.7680287Z a7a5392e2bf6: Pull complete 2024-08-20T22:19:10.0000066Z b10de02255c0: Pull complete 2024-08-20T22:19:10.2299204Z e56eeff2db93: Pull complete 2024-08-20T22:19:10.4680207Z 70ac3e38d0fd: Pull complete 2024-08-20T22:19:10.6463850Z eb09cbf3e416: Pull complete 2024-08-20T22:19:12.0846681Z ee1273153675: Pull complete 2024-08-20T22:19:12.3055891Z e22979f9e0ee: Pull complete 2024-08-20T22:19:14.5210420Z 6c1f0aabce7c: Pull complete 2024-08-20T22:19:14.7458592Z 7ebe49c3a23e: Pull complete 2024-08-20T22:19:28.1876117Z 5d115b29b5d5: Pull complete 2024-08-20T22:19:28.4237767Z 7f2d7a04fbe6: Pull complete 2024-08-20T22:19:28.6529968Z d79fd7d52698: Pull complete 2024-08-20T22:19:29.5773611Z 9752d6fbbcab: Pull complete 2024-08-20T22:19:29.8107015Z 83808b2eff4d: Pull complete 2024-08-20T22:19:30.7669077Z Digest: sha256:3a95d3a177465127ef6cd3b50787d6a050367070fd9063dbb688fad07a96b402 2024-08-20T22:19:30.8089779Z Status: Downloaded newer image for 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:19:30.8392570Z 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:19:30.8500346Z ##[group]Run echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> "$GITHUB_OUTPUT" 2024-08-20T22:19:30.8501304Z echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> "$GITHUB_OUTPUT" 2024-08-20T22:19:30.8512229Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:19:30.8512735Z env: 2024-08-20T22:19:30.8513016Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:19:30.8513372Z ##[endgroup] 2024-08-20T22:19:30.8711789Z ##[group]Run pytorch/test-infra/.github/actions/setup-nvidia@main 2024-08-20T22:19:30.8712343Z with: 2024-08-20T22:19:30.8712626Z driver-version: 550.54.15 2024-08-20T22:19:30.8712963Z env: 2024-08-20T22:19:30.8713245Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:19:30.8713588Z ##[endgroup] 2024-08-20T22:19:30.8776329Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2024-08-20T22:19:30.8776911Z with: 2024-08-20T22:19:30.8777197Z timeout_minutes: 10 2024-08-20T22:19:30.8777526Z max_attempts: 3 2024-08-20T22:19:30.8810401Z command: # Is it disgusting to have a full shell script here in this github action? Sure # But is it the best way to make it so that this action relies on nothing else? Absolutely set -eou pipefail DISTRIBUTION=$(. /etc/os-release;echo $ID$VERSION_ID) DRIVER_FN="NVIDIA-Linux-x86_64-${DRIVER_VERSION}.run" install_nvidia_docker2_amzn2() { ( set -x # Needed for yum-config-manager sudo yum install -y yum-utils if [[ "${DISTRIBUTION}" == "amzn2023" ]] ; then YUM_REPO_URL="https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo" else # Amazon Linux 2 YUM_REPO_URL="https://nvidia.github.io/nvidia-docker/${DISTRIBUTION}/nvidia-docker.repo" fi sudo yum-config-manager --add-repo "${YUM_REPO_URL}" sudo yum install -y nvidia-docker2 sudo systemctl restart docker ) } install_nvidia_docker2_ubuntu20() { ( set -x # Install nvidia-driver package if not installed status="$(dpkg-query -W --showformat='${db:Status-Status}' nvidia-docker2 2>&1)" if [ ! $? = 0 ] || [ ! "$status" = installed ]; then sudo apt-get install -y nvidia-docker2 sudo systemctl restart docker fi ) } pre_install_nvidia_driver_amzn2() { ( # Purge any nvidia driver installed from RHEL repo sudo yum remove -y nvidia-driver-latest-dkms ) } install_nvidia_driver_common() { ( # Try to gather more information about the runner and its existing NVIDIA driver if any echo "Before installing NVIDIA driver" lspci lsmod modinfo nvidia || true HAS_NVIDIA_DRIVER=0 # Check if NVIDIA driver has already been installed if [ -x "$(command -v nvidia-smi)" ]; then set +e # The driver exists, check its version next. Also check only the first GPU if there are more than one of them # so that the same driver version is not print over multiple lines INSTALLED_DRIVER_VERSION=$(nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0) NVIDIA_SMI_STATUS=$? if [ "$NVIDIA_SMI_STATUS" -ne 0 ] && [ "$NVIDIA_SMI_STATUS" -ne 14 ]; then echo "Failed to get NVIDIA driver version ($INSTALLED_DRIVER_VERSION). Continuing" elif [ "$INSTALLED_DRIVER_VERSION" != "$DRIVER_VERSION" ]; then echo "NVIDIA driver ($INSTALLED_DRIVER_VERSION) has been installed, but we expect to have $DRIVER_VERSION instead. Continuing" else HAS_NVIDIA_DRIVER=1 echo "NVIDIA driver ($INSTALLED_DRIVER_VERSION) has already been installed. Skipping NVIDIA driver installation" fi set -e fi if [ "$HAS_NVIDIA_DRIVER" -eq 0 ]; then # CAUTION: this may need to be updated in future if [ "${DISTRIBUTION}" != ubuntu20.04 ]; then sudo yum groupinstall -y "Development Tools" # ensure our kernel install is the same as our underlying kernel, # groupinstall "Development Tools" has a habit of mismatching kernel headers sudo yum install -y "kernel-devel-uname-r == $(uname -r)" sudo modprobe backlight fi sudo curl -fsL -o /tmp/nvidia_driver "https://s3.amazonaws.com/ossci-linux/nvidia_driver/$DRIVER_FN" set +e sudo /bin/bash /tmp/nvidia_driver -s --no-drm NVIDIA_INSTALLATION_STATUS=$? RESET_GPU=0 if [ "$NVIDIA_INSTALLATION_STATUS" -ne 0 ]; then sudo cat /var/log/nvidia-installer.log # Fail to install NVIDIA driver, try to reset the GPU RESET_GPU=1 elif [ -x "$(command -v nvidia-smi)" ]; then # Check again if nvidia-smi works even if the driver installation completes successfully INSTALLED_DRIVER_VERSION=$(nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0) NVIDIA_SMI_STATUS=$? if [ "$NVIDIA_SMI_STATUS" -ne 0 ] && [ "$NVIDIA_SMI_STATUS" -ne 14 ]; then RESET_GPU=1 fi fi if [ "$RESET_GPU" -eq 1 ]; then NVIDIA_DEVICES=$(lspci -D | grep -i NVIDIA | cut -d' ' -f1) # The GPU can get stuck in a failure state if somehow the test crashs the GPU microcode. When this # happens, we'll try to reset all NVIDIA devices https://github.com/pytorch/pytorch/issues/88388 for PCI_ID in $NVIDIA_DEVICES; do DEVICE_ENABLED=$(cat /sys/bus/pci/devices/$PCI_ID/enable) echo "Reseting $PCI_ID (enabled state: $DEVICE_ENABLED)" # This requires sudo permission of course echo "1" | sudo tee /sys/bus/pci/devices/$PCI_ID/reset sleep 1 done fi sudo rm -fv /tmp/nvidia_driver set -e fi ) } post_install_nvidia_driver_common() { ( sudo modprobe nvidia || true echo "After installing NVIDIA driver" lspci lsmod modinfo nvidia || true ( set +e nvidia-smi # NB: Annoyingly, nvidia-smi command returns successfully with return code 0 even in # the case where the driver has already crashed as it still can get the driver version # and some basic information like the bus ID. However, the rest of the information # would be missing (ERR!), for example: # # +-----------------------------------------------------------------------------+ # | NVIDIA-SMI 525.89.02 Driver Version: 525.89.02 CUDA Version: 12.0 | # |-------------------------------+----------------------+----------------------+ # | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | # | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | # | | | MIG M. | # |===============================+======================+======================| # | 0 ERR! Off | 00000000:00:1E.0 Off | ERR! | # |ERR! ERR! ERR! ERR! / ERR! | 4184MiB / 23028MiB | ERR! Default | # | | | ERR! | # +-------------------------------+----------------------+----------------------+ # # +-----------------------------------------------------------------------------+ # | Processes: | # | GPU GI CI PID Type Process name GPU Memory | # | ID ID Usage | # |=============================================================================| # +-----------------------------------------------------------------------------+ # # This should be reported as a failure instead as it will guarantee to fail when # Docker tries to run with --gpus all # # So, the correct check here is to query one of the missing piece of info like # GPU name, so that the command can fail accordingly nvidia-smi --query-gpu=gpu_name --format=csv,noheader --id=0 NVIDIA_SMI_STATUS=$? # Allowable exit statuses for nvidia-smi, see: https://github.com/NVIDIA/gpu-operator/issues/285 if [ "$NVIDIA_SMI_STATUS" -eq 0 ] || [ "$NVIDIA_SMI_STATUS" -eq 14 ]; then echo "INFO: Ignoring allowed status ${NVIDIA_SMI_STATUS}" else echo "ERROR: nvidia-smi exited with unresolved status ${NVIDIA_SMI_STATUS}" exit ${NVIDIA_SMI_STATUS} fi set -e ) ) } install_nvidia_driver_amzn2() { ( set -x pre_install_nvidia_driver_amzn2 install_nvidia_driver_common post_install_nvidia_driver_common ) } install_nvidia_driver_ubuntu20() { ( set -x install_nvidia_driver_common post_install_nvidia_driver_common ) } echo "== Installing nvidia driver ${DRIVER_FN} ==" case "${DISTRIBUTION}" in amzn*) install_nvidia_driver_amzn2 ;; ubuntu20.04) install_nvidia_driver_ubuntu20 ;; *) echo "ERROR: Unknown distribution ${DISTRIBUTION}" exit 1 ;; esac # Install container toolkit based on distribution echo "== Installing nvidia container toolkit for ${DISTRIBUTION} ==" case "${DISTRIBUTION}" in amzn*) install_nvidia_docker2_amzn2 ;; ubuntu20.04) install_nvidia_docker2_ubuntu20 ;; *) echo "ERROR: Unknown distribution ${DISTRIBUTION}" exit 1 ;; esac echo "GPU_FLAG=--gpus all -e NVIDIA_DRIVER_CAPABILITIES=all" >> "${GITHUB_ENV}" # Fix https://github.com/NVIDIA/nvidia-docker/issues/1648 on runners with # more than one GPUs. This just needs to be run once. The command fails # on subsequent runs and complains that the mode is already on, but that's # ok sudo nvidia-persistenced || true # This should show persistence mode ON nvidia-smi 2024-08-20T22:19:30.8845489Z retry_wait_seconds: 10 2024-08-20T22:19:30.8845863Z polling_interval_seconds: 1 2024-08-20T22:19:30.8846238Z warning_on_retry: true 2024-08-20T22:19:30.8846595Z continue_on_error: false 2024-08-20T22:19:30.8846943Z env: 2024-08-20T22:19:30.8847213Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:19:30.8847561Z DRIVER_VERSION: 550.54.15 2024-08-20T22:19:30.8847912Z ##[endgroup] 2024-08-20T22:19:30.9650691Z == Installing nvidia driver NVIDIA-Linux-x86_64-550.54.15.run == 2024-08-20T22:19:30.9651807Z + pre_install_nvidia_driver_amzn2 2024-08-20T22:19:30.9654010Z + sudo yum remove -y nvidia-driver-latest-dkms 2024-08-20T22:19:31.7003915Z No match for argument: nvidia-driver-latest-dkms 2024-08-20T22:19:31.7004821Z No packages marked for removal. 2024-08-20T22:19:31.7347817Z Dependencies resolved. 2024-08-20T22:19:31.7357605Z Nothing to do. 2024-08-20T22:19:31.7357912Z Complete! 2024-08-20T22:19:31.8159935Z + install_nvidia_driver_common 2024-08-20T22:19:31.8163370Z + echo 'Before installing NVIDIA driver' 2024-08-20T22:19:31.8163796Z + lspci 2024-08-20T22:19:31.8164094Z Before installing NVIDIA driver 2024-08-20T22:19:31.8275355Z 00:00.0 Host bridge: Intel Corporation 440FX - 82441FX PMC [Natoma] 2024-08-20T22:19:31.8276166Z 00:01.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II] 2024-08-20T22:19:31.8277107Z 00:01.3 Non-VGA unclassified device: Intel Corporation 82371AB/EB/MB PIIX4 ACPI (rev 08) 2024-08-20T22:19:31.8277926Z 00:03.0 VGA compatible controller: Amazon.com, Inc. Device 1111 2024-08-20T22:19:31.8278751Z 00:04.0 Non-Volatile memory controller: Amazon.com, Inc. NVMe EBS Controller 2024-08-20T22:19:31.8279547Z 00:05.0 Ethernet controller: Amazon.com, Inc. Elastic Network Adapter (ENA) 2024-08-20T22:19:31.8280294Z 00:1e.0 3D controller: NVIDIA Corporation GA102GL [A10G] (rev a1) 2024-08-20T22:19:31.8281308Z 00:1f.0 Non-Volatile memory controller: Amazon.com, Inc. NVMe SSD Controller 2024-08-20T22:19:31.8282085Z + lsmod 2024-08-20T22:19:31.8398661Z Module Size Used by 2024-08-20T22:19:31.8399848Z veth 36864 0 2024-08-20T22:19:31.8400708Z nvidia_modeset 1351680 0 2024-08-20T22:19:31.8401742Z video 65536 1 nvidia_modeset 2024-08-20T22:19:31.8402824Z wmi 36864 1 video 2024-08-20T22:19:31.8403752Z nvidia_uvm 4706304 0 2024-08-20T22:19:31.8404881Z nvidia 54071296 7 nvidia_uvm,nvidia_modeset 2024-08-20T22:19:31.8405571Z drm 602112 1 nvidia 2024-08-20T22:19:31.8406157Z drm_panel_orientation_quirks 28672 1 drm 2024-08-20T22:19:31.8406843Z backlight 24576 3 video,drm,nvidia_modeset 2024-08-20T22:19:31.8407518Z i2c_core 106496 2 nvidia,drm 2024-08-20T22:19:31.8408079Z xt_conntrack 16384 1 2024-08-20T22:19:31.8408565Z nft_chain_nat 16384 3 2024-08-20T22:19:31.8409063Z xt_MASQUERADE 20480 1 2024-08-20T22:19:31.8409641Z nf_nat 57344 2 nft_chain_nat,xt_MASQUERADE 2024-08-20T22:19:31.8410303Z nf_conntrack_netlink 57344 0 2024-08-20T22:19:31.8410988Z nf_conntrack 184320 4 xt_conntrack,nf_nat,nf_conntrack_netlink,xt_MASQUERADE 2024-08-20T22:19:31.8411900Z nf_defrag_ipv6 24576 1 nf_conntrack 2024-08-20T22:19:31.8412508Z nf_defrag_ipv4 16384 1 nf_conntrack 2024-08-20T22:19:31.8413076Z xfrm_user 57344 1 2024-08-20T22:19:31.8413533Z xfrm_algo 16384 1 xfrm_user 2024-08-20T22:19:31.8414178Z xt_addrtype 16384 2 2024-08-20T22:19:31.8414592Z nft_compat 20480 4 2024-08-20T22:19:31.8415090Z nf_tables 307200 57 nft_compat,nft_chain_nat 2024-08-20T22:19:31.8415949Z nfnetlink 20480 4 nft_compat,nf_conntrack_netlink,nf_tables 2024-08-20T22:19:31.8416753Z br_netfilter 36864 0 2024-08-20T22:19:31.8417356Z bridge 307200 1 br_netfilter 2024-08-20T22:19:31.8417922Z stp 16384 1 bridge 2024-08-20T22:19:31.8418481Z llc 16384 2 bridge,stp 2024-08-20T22:19:31.8419112Z overlay 167936 0 2024-08-20T22:19:31.8419600Z tls 114688 0 2024-08-20T22:19:31.8420084Z nls_ascii 16384 1 2024-08-20T22:19:31.8420462Z nls_cp437 20480 1 2024-08-20T22:19:31.8420822Z vfat 24576 1 2024-08-20T22:19:31.8421198Z fat 86016 1 vfat 2024-08-20T22:19:31.8421605Z sunrpc 692224 1 2024-08-20T22:19:31.8422076Z ena 167936 0 2024-08-20T22:19:31.8422617Z ghash_clmulni_intel 16384 0 2024-08-20T22:19:31.8423180Z ptp 36864 1 ena 2024-08-20T22:19:31.8423686Z pps_core 24576 1 ptp 2024-08-20T22:19:31.8424096Z aesni_intel 393216 0 2024-08-20T22:19:31.8424518Z i8042 45056 0 2024-08-20T22:19:31.8424927Z serio 28672 3 i8042 2024-08-20T22:19:31.8425555Z crypto_simd 16384 1 aesni_intel 2024-08-20T22:19:31.8426364Z cryptd 28672 2 crypto_simd,ghash_clmulni_intel 2024-08-20T22:19:31.8426913Z button 24576 0 2024-08-20T22:19:31.8427289Z sch_fq_codel 20480 17 2024-08-20T22:19:31.8427671Z dm_mod 188416 0 2024-08-20T22:19:31.8428041Z fuse 163840 1 2024-08-20T22:19:31.8428486Z configfs 57344 1 2024-08-20T22:19:31.8429042Z dax 45056 1 dm_mod 2024-08-20T22:19:31.8429458Z loop 36864 0 2024-08-20T22:19:31.8430124Z dmi_sysfs 20480 0 2024-08-20T22:19:31.8430499Z crc32_pclmul 16384 0 2024-08-20T22:19:31.8430874Z crc32c_intel 24576 0 2024-08-20T22:19:31.8431247Z efivarfs 24576 1 2024-08-20T22:19:31.8431609Z + modinfo nvidia 2024-08-20T22:19:31.8432310Z filename: /lib/modules/6.1.94-99.176.amzn2023.x86_64/kernel/drivers/video/nvidia.ko 2024-08-20T22:19:31.8433030Z alias: char-major-195-* 2024-08-20T22:19:31.8433418Z version: 550.54.15 2024-08-20T22:19:31.8433949Z supported: external 2024-08-20T22:19:31.8434306Z license: NVIDIA 2024-08-20T22:19:31.8434726Z firmware: nvidia/550.54.15/gsp_tu10x.bin 2024-08-20T22:19:31.8435231Z firmware: nvidia/550.54.15/gsp_ga10x.bin 2024-08-20T22:19:31.8435696Z srcversion: 833721318DA517F0C2FEC97 2024-08-20T22:19:31.8436170Z alias: pci:v000010DEd*sv*sd*bc06sc80i00* 2024-08-20T22:19:31.8436675Z alias: pci:v000010DEd*sv*sd*bc03sc02i00* 2024-08-20T22:19:31.8437177Z alias: pci:v000010DEd*sv*sd*bc03sc00i00* 2024-08-20T22:19:31.8437671Z depends: i2c-core,drm 2024-08-20T22:19:31.8438039Z retpoline: Y 2024-08-20T22:19:31.8438349Z name: nvidia 2024-08-20T22:19:31.8438971Z vermagic: 6.1.94-99.176.amzn2023.x86_64 SMP preempt mod_unload modversions 2024-08-20T22:19:31.8439682Z parm: NvSwitchRegDwords:NvSwitch regkey (charp) 2024-08-20T22:19:31.8440331Z parm: NvSwitchBlacklist:NvSwitchBlacklist=uuid[,uuid...] (charp) 2024-08-20T22:19:31.8440936Z parm: NVreg_ResmanDebugLevel:int 2024-08-20T22:19:31.8441383Z parm: NVreg_RmLogonRC:int 2024-08-20T22:19:31.8441815Z parm: NVreg_ModifyDeviceFiles:int 2024-08-20T22:19:31.8442275Z parm: NVreg_DeviceFileUID:int 2024-08-20T22:19:31.8442717Z parm: NVreg_DeviceFileGID:int 2024-08-20T22:19:31.8443158Z parm: NVreg_DeviceFileMode:int 2024-08-20T22:19:31.8443824Z parm: NVreg_InitializeSystemMemoryAllocations:int 2024-08-20T22:19:31.8444393Z parm: NVreg_UsePageAttributeTable:int 2024-08-20T22:19:31.8444878Z parm: NVreg_EnablePCIeGen3:int 2024-08-20T22:19:31.8445309Z parm: NVreg_EnableMSI:int 2024-08-20T22:19:31.8445730Z parm: NVreg_TCEBypassMode:int 2024-08-20T22:19:31.8446193Z parm: NVreg_EnableStreamMemOPs:int 2024-08-20T22:19:31.8446730Z parm: NVreg_RestrictProfilingToAdminUsers:int 2024-08-20T22:19:31.8447310Z parm: NVreg_PreserveVideoMemoryAllocations:int 2024-08-20T22:19:31.8447891Z parm: NVreg_EnableS0ixPowerManagement:int 2024-08-20T22:19:31.8448511Z parm: NVreg_S0ixPowerManagementVideoMemoryThreshold:int 2024-08-20T22:19:31.8449115Z parm: NVreg_DynamicPowerManagement:int 2024-08-20T22:19:31.8449725Z parm: NVreg_DynamicPowerManagementVideoMemoryThreshold:int 2024-08-20T22:19:31.8450329Z parm: NVreg_EnableGpuFirmware:int 2024-08-20T22:19:31.8450829Z parm: NVreg_EnableGpuFirmwareLogs:int 2024-08-20T22:19:31.8451368Z parm: NVreg_OpenRmEnableUnsupportedGpus:int 2024-08-20T22:19:31.8452000Z parm: NVreg_EnableUserNUMAManagement:int 2024-08-20T22:19:31.8452507Z parm: NVreg_MemoryPoolSize:int 2024-08-20T22:19:31.8452978Z parm: NVreg_KMallocHeapMaxSize:int 2024-08-20T22:19:31.8453465Z parm: NVreg_VMallocHeapMaxSize:int 2024-08-20T22:19:31.8453938Z parm: NVreg_IgnoreMMIOCheck:int 2024-08-20T22:19:31.8454389Z parm: NVreg_NvLinkDisable:int 2024-08-20T22:19:31.8454956Z parm: NVreg_EnablePCIERelaxedOrderingMode:int 2024-08-20T22:19:31.8455483Z parm: NVreg_RegisterPCIDriver:int 2024-08-20T22:19:31.8455967Z parm: NVreg_EnableResizableBar:int 2024-08-20T22:19:31.8456463Z parm: NVreg_EnableDbgBreakpoint:int 2024-08-20T22:19:31.8456969Z parm: NVreg_EnableNonblockingOpen:int 2024-08-20T22:19:31.8457454Z parm: NVreg_RegistryDwords:charp 2024-08-20T22:19:31.8457968Z parm: NVreg_RegistryDwordsPerDevice:charp 2024-08-20T22:19:31.8458453Z parm: NVreg_RmMsg:charp 2024-08-20T22:19:31.8458864Z parm: NVreg_GpuBlacklist:charp 2024-08-20T22:19:31.8459325Z parm: NVreg_TemporaryFilePath:charp 2024-08-20T22:19:31.8459803Z parm: NVreg_ExcludedGpus:charp 2024-08-20T22:19:31.8460258Z parm: NVreg_DmaRemapPeerMmio:int 2024-08-20T22:19:31.8460741Z parm: NVreg_RmNvlinkBandwidth:charp 2024-08-20T22:19:31.8461212Z parm: NVreg_ImexChannelCount:int 2024-08-20T22:19:31.8461776Z parm: rm_firmware_active:charp 2024-08-20T22:19:31.8462194Z + HAS_NVIDIA_DRIVER=0 2024-08-20T22:19:31.8462582Z ++ command -v nvidia-smi 2024-08-20T22:19:31.8462989Z + '[' -x /usr/bin/nvidia-smi ']' 2024-08-20T22:19:31.8463357Z + set +e 2024-08-20T22:19:31.8463871Z ++ nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0 2024-08-20T22:19:31.8722510Z + INSTALLED_DRIVER_VERSION=550.54.15 2024-08-20T22:19:31.8723125Z + NVIDIA_SMI_STATUS=0 2024-08-20T22:19:31.8723609Z + '[' 0 -ne 0 ']' 2024-08-20T22:19:31.8724022Z + '[' 550.54.15 '!=' 550.54.15 ']' 2024-08-20T22:19:31.8724398Z + HAS_NVIDIA_DRIVER=1 2024-08-20T22:19:31.8725160Z + echo 'NVIDIA driver (550.54.15) has already been installed. Skipping NVIDIA driver installation' 2024-08-20T22:19:31.8726229Z + set -e 2024-08-20T22:19:31.8726701Z + '[' 1 -eq 0 ']' 2024-08-20T22:19:31.8727380Z NVIDIA driver (550.54.15) has already been installed. Skipping NVIDIA driver installation 2024-08-20T22:19:31.8728084Z + post_install_nvidia_driver_common 2024-08-20T22:19:31.8729510Z + sudo modprobe nvidia 2024-08-20T22:19:32.0133624Z + echo 'After installing NVIDIA driver' 2024-08-20T22:19:32.0134106Z + lspci 2024-08-20T22:19:32.0134403Z After installing NVIDIA driver 2024-08-20T22:19:32.0239173Z 00:00.0 Host bridge: Intel Corporation 440FX - 82441FX PMC [Natoma] 2024-08-20T22:19:32.0240182Z 00:01.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II] 2024-08-20T22:19:32.0241904Z 00:01.3 Non-VGA unclassified device: Intel Corporation 82371AB/EB/MB PIIX4 ACPI (rev 08) 2024-08-20T22:19:32.0242858Z 00:03.0 VGA compatible controller: Amazon.com, Inc. Device 1111 2024-08-20T22:19:32.0243923Z 00:04.0 Non-Volatile memory controller: Amazon.com, Inc. NVMe EBS Controller 2024-08-20T22:19:32.0244734Z 00:05.0 Ethernet controller: Amazon.com, Inc. Elastic Network Adapter (ENA) 2024-08-20T22:19:32.0245550Z 00:1e.0 3D controller: NVIDIA Corporation GA102GL [A10G] (rev a1) 2024-08-20T22:19:32.0246445Z 00:1f.0 Non-Volatile memory controller: Amazon.com, Inc. NVMe SSD Controller 2024-08-20T22:19:32.0247048Z + lsmod 2024-08-20T22:19:32.0272320Z Module Size Used by 2024-08-20T22:19:32.0272889Z veth 36864 0 2024-08-20T22:19:32.0273385Z nvidia_modeset 1351680 0 2024-08-20T22:19:32.0273969Z video 65536 1 nvidia_modeset 2024-08-20T22:19:32.0274621Z wmi 36864 1 video 2024-08-20T22:19:32.0275144Z nvidia_uvm 4706304 0 2024-08-20T22:19:32.0275672Z nvidia 54071296 7 nvidia_uvm,nvidia_modeset 2024-08-20T22:19:32.0276169Z drm 602112 1 nvidia 2024-08-20T22:19:32.0276633Z drm_panel_orientation_quirks 28672 1 drm 2024-08-20T22:19:32.0277160Z backlight 24576 3 video,drm,nvidia_modeset 2024-08-20T22:19:32.0277678Z i2c_core 106496 2 nvidia,drm 2024-08-20T22:19:32.0278109Z xt_conntrack 16384 1 2024-08-20T22:19:32.0278497Z nft_chain_nat 16384 3 2024-08-20T22:19:32.0278883Z xt_MASQUERADE 20480 1 2024-08-20T22:19:32.0279369Z nf_nat 57344 2 nft_chain_nat,xt_MASQUERADE 2024-08-20T22:19:32.0279869Z nf_conntrack_netlink 57344 0 2024-08-20T22:19:32.0280458Z nf_conntrack 184320 4 xt_conntrack,nf_nat,nf_conntrack_netlink,xt_MASQUERADE 2024-08-20T22:19:32.0281106Z nf_defrag_ipv6 24576 1 nf_conntrack 2024-08-20T22:19:32.0281578Z nf_defrag_ipv4 16384 1 nf_conntrack 2024-08-20T22:19:32.0282030Z xfrm_user 57344 1 2024-08-20T22:19:32.0282438Z xfrm_algo 16384 1 xfrm_user 2024-08-20T22:19:32.0282863Z xt_addrtype 16384 2 2024-08-20T22:19:32.0283254Z nft_compat 20480 4 2024-08-20T22:19:32.0283718Z nf_tables 307200 57 nft_compat,nft_chain_nat 2024-08-20T22:19:32.0284338Z nfnetlink 20480 4 nft_compat,nf_conntrack_netlink,nf_tables 2024-08-20T22:19:32.0284936Z br_netfilter 36864 0 2024-08-20T22:19:32.0285356Z bridge 307200 1 br_netfilter 2024-08-20T22:19:32.0286023Z stp 16384 1 bridge 2024-08-20T22:19:32.0286457Z llc 16384 2 bridge,stp 2024-08-20T22:19:32.0286877Z overlay 167936 0 2024-08-20T22:19:32.0287252Z tls 114688 0 2024-08-20T22:19:32.0287631Z nls_ascii 16384 1 2024-08-20T22:19:32.0288027Z nls_cp437 20480 1 2024-08-20T22:19:32.0288538Z vfat 24576 1 2024-08-20T22:19:32.0289072Z fat 86016 1 vfat 2024-08-20T22:19:32.0289539Z sunrpc 692224 1 2024-08-20T22:19:32.0290031Z ena 167936 0 2024-08-20T22:19:32.0290447Z ghash_clmulni_intel 16384 0 2024-08-20T22:19:32.0290840Z ptp 36864 1 ena 2024-08-20T22:19:32.0291245Z pps_core 24576 1 ptp 2024-08-20T22:19:32.0291815Z aesni_intel 393216 0 2024-08-20T22:19:32.0292308Z i8042 45056 0 2024-08-20T22:19:32.0292791Z serio 28672 3 i8042 2024-08-20T22:19:32.0293358Z crypto_simd 16384 1 aesni_intel 2024-08-20T22:19:32.0294031Z cryptd 28672 2 crypto_simd,ghash_clmulni_intel 2024-08-20T22:19:32.0294593Z button 24576 0 2024-08-20T22:19:32.0295091Z sch_fq_codel 20480 17 2024-08-20T22:19:32.0295567Z dm_mod 188416 0 2024-08-20T22:19:32.0295937Z fuse 163840 1 2024-08-20T22:19:32.0296303Z configfs 57344 1 2024-08-20T22:19:32.0296832Z dax 45056 1 dm_mod 2024-08-20T22:19:32.0297226Z loop 36864 0 2024-08-20T22:19:32.0297595Z dmi_sysfs 20480 0 2024-08-20T22:19:32.0297968Z crc32_pclmul 16384 0 2024-08-20T22:19:32.0298339Z crc32c_intel 24576 0 2024-08-20T22:19:32.0298706Z efivarfs 24576 1 2024-08-20T22:19:32.0299070Z + modinfo nvidia 2024-08-20T22:19:32.0299778Z filename: /lib/modules/6.1.94-99.176.amzn2023.x86_64/kernel/drivers/video/nvidia.ko 2024-08-20T22:19:32.0300495Z alias: char-major-195-* 2024-08-20T22:19:32.0300881Z version: 550.54.15 2024-08-20T22:19:32.0301232Z supported: external 2024-08-20T22:19:32.0301572Z license: NVIDIA 2024-08-20T22:19:32.0301953Z firmware: nvidia/550.54.15/gsp_tu10x.bin 2024-08-20T22:19:32.0302434Z firmware: nvidia/550.54.15/gsp_ga10x.bin 2024-08-20T22:19:32.0302903Z srcversion: 833721318DA517F0C2FEC97 2024-08-20T22:19:32.0303389Z alias: pci:v000010DEd*sv*sd*bc06sc80i00* 2024-08-20T22:19:32.0303888Z alias: pci:v000010DEd*sv*sd*bc03sc02i00* 2024-08-20T22:19:32.0304384Z alias: pci:v000010DEd*sv*sd*bc03sc00i00* 2024-08-20T22:19:32.0304892Z depends: i2c-core,drm 2024-08-20T22:19:32.0305257Z retpoline: Y 2024-08-20T22:19:32.0305557Z name: nvidia 2024-08-20T22:19:32.0306168Z vermagic: 6.1.94-99.176.amzn2023.x86_64 SMP preempt mod_unload modversions 2024-08-20T22:19:32.0306872Z parm: NvSwitchRegDwords:NvSwitch regkey (charp) 2024-08-20T22:19:32.0307520Z parm: NvSwitchBlacklist:NvSwitchBlacklist=uuid[,uuid...] (charp) 2024-08-20T22:19:32.0308109Z parm: NVreg_ResmanDebugLevel:int 2024-08-20T22:19:32.0308551Z parm: NVreg_RmLogonRC:int 2024-08-20T22:19:32.0308990Z parm: NVreg_ModifyDeviceFiles:int 2024-08-20T22:19:32.0309444Z parm: NVreg_DeviceFileUID:int 2024-08-20T22:19:32.0309881Z parm: NVreg_DeviceFileGID:int 2024-08-20T22:19:32.0310329Z parm: NVreg_DeviceFileMode:int 2024-08-20T22:19:32.0310850Z parm: NVreg_InitializeSystemMemoryAllocations:int 2024-08-20T22:19:32.0311412Z parm: NVreg_UsePageAttributeTable:int 2024-08-20T22:19:32.0311884Z parm: NVreg_EnablePCIeGen3:int 2024-08-20T22:19:32.0312310Z parm: NVreg_EnableMSI:int 2024-08-20T22:19:32.0312723Z parm: NVreg_TCEBypassMode:int 2024-08-20T22:19:32.0313176Z parm: NVreg_EnableStreamMemOPs:int 2024-08-20T22:19:32.0313707Z parm: NVreg_RestrictProfilingToAdminUsers:int 2024-08-20T22:19:32.0314393Z parm: NVreg_PreserveVideoMemoryAllocations:int 2024-08-20T22:19:32.0315014Z parm: NVreg_EnableS0ixPowerManagement:int 2024-08-20T22:19:32.0315620Z parm: NVreg_S0ixPowerManagementVideoMemoryThreshold:int 2024-08-20T22:19:32.0316221Z parm: NVreg_DynamicPowerManagement:int 2024-08-20T22:19:32.0316838Z parm: NVreg_DynamicPowerManagementVideoMemoryThreshold:int 2024-08-20T22:19:32.0317437Z parm: NVreg_EnableGpuFirmware:int 2024-08-20T22:19:32.0317931Z parm: NVreg_EnableGpuFirmwareLogs:int 2024-08-20T22:19:32.0318465Z parm: NVreg_OpenRmEnableUnsupportedGpus:int 2024-08-20T22:19:32.0319012Z parm: NVreg_EnableUserNUMAManagement:int 2024-08-20T22:19:32.0319509Z parm: NVreg_MemoryPoolSize:int 2024-08-20T22:19:32.0319964Z parm: NVreg_KMallocHeapMaxSize:int 2024-08-20T22:19:32.0320447Z parm: NVreg_VMallocHeapMaxSize:int 2024-08-20T22:19:32.0320916Z parm: NVreg_IgnoreMMIOCheck:int 2024-08-20T22:19:32.0321371Z parm: NVreg_NvLinkDisable:int 2024-08-20T22:19:32.0321867Z parm: NVreg_EnablePCIERelaxedOrderingMode:int 2024-08-20T22:19:32.0322399Z parm: NVreg_RegisterPCIDriver:int 2024-08-20T22:19:32.0322876Z parm: NVreg_EnableResizableBar:int 2024-08-20T22:19:32.0323363Z parm: NVreg_EnableDbgBreakpoint:int 2024-08-20T22:19:32.0323852Z parm: NVreg_EnableNonblockingOpen:int 2024-08-20T22:19:32.0324430Z parm: NVreg_RegistryDwords:charp 2024-08-20T22:19:32.0324970Z parm: NVreg_RegistryDwordsPerDevice:charp 2024-08-20T22:19:32.0325463Z parm: NVreg_RmMsg:charp 2024-08-20T22:19:32.0325868Z parm: NVreg_GpuBlacklist:charp 2024-08-20T22:19:32.0326337Z parm: NVreg_TemporaryFilePath:charp 2024-08-20T22:19:32.0326809Z parm: NVreg_ExcludedGpus:charp 2024-08-20T22:19:32.0327256Z parm: NVreg_DmaRemapPeerMmio:int 2024-08-20T22:19:32.0327736Z parm: NVreg_RmNvlinkBandwidth:charp 2024-08-20T22:19:32.0328215Z parm: NVreg_ImexChannelCount:int 2024-08-20T22:19:32.0328669Z parm: rm_firmware_active:charp 2024-08-20T22:19:32.0329063Z + set +e 2024-08-20T22:19:32.0329383Z + nvidia-smi 2024-08-20T22:19:32.0502978Z Tue Aug 20 22:19:32 2024 2024-08-20T22:19:32.0503814Z +-----------------------------------------------------------------------------------------+ 2024-08-20T22:19:32.0504730Z | NVIDIA-SMI 550.54.15 Driver Version: 550.54.15 CUDA Version: 12.4 | 2024-08-20T22:19:32.0505531Z |-----------------------------------------+------------------------+----------------------+ 2024-08-20T22:19:32.0506344Z | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | 2024-08-20T22:19:32.0507246Z | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | 2024-08-20T22:19:32.0507959Z | | | MIG M. | 2024-08-20T22:19:32.0508514Z |=========================================+========================+======================| 2024-08-20T22:19:32.0717335Z | 0 NVIDIA A10G On | 00000000:00:1E.0 Off | 0 | 2024-08-20T22:19:32.0719136Z | 0% 25C P8 18W / 300W | 0MiB / 23028MiB | 0% Default | 2024-08-20T22:19:32.0720421Z | | | N/A | 2024-08-20T22:19:32.0722283Z +-----------------------------------------+------------------------+----------------------+ 2024-08-20T22:19:32.0723747Z 2024-08-20T22:19:32.0724893Z +-----------------------------------------------------------------------------------------+ 2024-08-20T22:19:32.0725542Z | Processes: | 2024-08-20T22:19:32.0726625Z | GPU GI CI PID Type Process name GPU Memory | 2024-08-20T22:19:32.0727415Z | ID ID Usage | 2024-08-20T22:19:32.0727997Z |=========================================================================================| 2024-08-20T22:19:32.0728660Z | No running processes found | 2024-08-20T22:19:32.0729460Z +-----------------------------------------------------------------------------------------+ 2024-08-20T22:19:32.3853610Z + nvidia-smi --query-gpu=gpu_name --format=csv,noheader --id=0 2024-08-20T22:19:32.4036048Z NVIDIA A10G 2024-08-20T22:19:32.4098619Z + NVIDIA_SMI_STATUS=0 2024-08-20T22:19:32.4099177Z + '[' 0 -eq 0 ']' 2024-08-20T22:19:32.4099688Z + echo 'INFO: Ignoring allowed status 0' 2024-08-20T22:19:32.4100157Z + set -e 2024-08-20T22:19:32.4100452Z INFO: Ignoring allowed status 0 2024-08-20T22:19:32.4109308Z == Installing nvidia container toolkit for amzn2023 == 2024-08-20T22:19:32.4113202Z + sudo yum install -y yum-utils 2024-08-20T22:19:32.8821239Z Last metadata expiration check: 1:37:45 ago on Tue Aug 20 20:41:47 2024. 2024-08-20T22:19:32.9042819Z Package dnf-utils-4.3.0-13.amzn2023.0.4.noarch is already installed. 2024-08-20T22:19:32.9347115Z Dependencies resolved. 2024-08-20T22:19:32.9470765Z Nothing to do. 2024-08-20T22:19:32.9471340Z Complete! 2024-08-20T22:19:33.0341858Z + [[ amzn2023 == \a\m\z\n\2\0\2\3 ]] 2024-08-20T22:19:33.0343207Z + YUM_REPO_URL=https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo 2024-08-20T22:19:33.0344998Z + sudo yum-config-manager --add-repo https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo 2024-08-20T22:19:33.3383385Z Adding repo from: https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo 2024-08-20T22:19:33.4119167Z + sudo yum install -y nvidia-docker2 2024-08-20T22:19:33.9598907Z nvidia-container-toolkit 9.9 kB/s | 833 B 00:00 2024-08-20T22:19:33.9820688Z Package nvidia-docker2-2.14.0-1.noarch is already installed. 2024-08-20T22:19:34.0120664Z Dependencies resolved. 2024-08-20T22:19:34.0245735Z Nothing to do. 2024-08-20T22:19:34.0246080Z Complete! 2024-08-20T22:19:34.1189905Z + sudo systemctl restart docker 2024-08-20T22:20:31.3399762Z nvidia-persistenced failed to initialize. Check syslog for more details. 2024-08-20T22:20:31.3636472Z Tue Aug 20 22:20:31 2024 2024-08-20T22:20:31.3638073Z +-----------------------------------------------------------------------------------------+ 2024-08-20T22:20:31.3639983Z | NVIDIA-SMI 550.54.15 Driver Version: 550.54.15 CUDA Version: 12.4 | 2024-08-20T22:20:31.3641688Z |-----------------------------------------+------------------------+----------------------+ 2024-08-20T22:20:31.3642707Z | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | 2024-08-20T22:20:31.3643652Z | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | 2024-08-20T22:20:31.3646651Z | | | MIG M. | 2024-08-20T22:20:31.3647235Z |=========================================+========================+======================| 2024-08-20T22:20:31.3834421Z | 0 NVIDIA A10G On | 00000000:00:1E.0 Off | 0 | 2024-08-20T22:20:31.3835182Z | 0% 25C P8 15W / 300W | 0MiB / 23028MiB | 0% Default | 2024-08-20T22:20:31.3835812Z | | | N/A | 2024-08-20T22:20:31.3836554Z +-----------------------------------------+------------------------+----------------------+ 2024-08-20T22:20:31.3839275Z 2024-08-20T22:20:31.3840036Z +-----------------------------------------------------------------------------------------+ 2024-08-20T22:20:31.3841246Z | Processes: | 2024-08-20T22:20:31.3841990Z | GPU GI CI PID Type Process name GPU Memory | 2024-08-20T22:20:31.3842687Z | ID ID Usage | 2024-08-20T22:20:31.3843261Z |=========================================================================================| 2024-08-20T22:20:31.3844614Z | No running processes found | 2024-08-20T22:20:31.3845408Z +-----------------------------------------------------------------------------------------+ 2024-08-20T22:20:32.0067613Z Command completed after 1 attempt(s). 2024-08-20T22:20:32.0149407Z ##[group]Run python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84 2024-08-20T22:20:32.0150184Z python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84 2024-08-20T22:20:32.0150876Z python3 -m tools.stats.monitor > usage_log.txt 2>&1 & 2024-08-20T22:20:32.0151525Z echo "monitor-script-pid=${!}" >> "${GITHUB_OUTPUT}" 2024-08-20T22:20:32.0164788Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:20:32.0165293Z env: 2024-08-20T22:20:32.0165572Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:20:32.0166031Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:20:32.0166706Z ##[endgroup] 2024-08-20T22:20:32.3394408Z Defaulting to user installation because normal site-packages is not writeable 2024-08-20T22:20:32.3587965Z Requirement already satisfied: psutil==5.9.1 in /home/ec2-user/.local/lib/python3.9/site-packages (5.9.1) 2024-08-20T22:20:32.3593502Z Requirement already satisfied: nvidia-ml-py==11.525.84 in /home/ec2-user/.local/lib/python3.9/site-packages (11.525.84) 2024-08-20T22:20:32.4820189Z Prepare all required actions 2024-08-20T22:20:32.4820697Z Getting action download info 2024-08-20T22:20:32.5939065Z Download action repository 'seemethere/download-artifact-s3@v4' (SHA:1da556a7aa0a088e3153970611f6c432d58e80e6) 2024-08-20T22:20:32.8326229Z Download action repository 'actions/download-artifact@v3' (SHA:9bc31d5ccc31df68ecc42ccf4149144866c47d8a) 2024-08-20T22:20:32.9901152Z ##[group]Run ./.github/actions/download-build-artifacts 2024-08-20T22:20:32.9901641Z with: 2024-08-20T22:20:32.9902030Z name: linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-08-20T22:20:32.9902495Z s3-bucket: gha-artifacts 2024-08-20T22:20:32.9902832Z env: 2024-08-20T22:20:32.9903104Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:20:32.9903554Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:20:32.9904030Z ##[endgroup] 2024-08-20T22:20:32.9939201Z ##[group]Run seemethere/download-artifact-s3@v4 2024-08-20T22:20:32.9939652Z with: 2024-08-20T22:20:32.9940016Z name: linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-08-20T22:20:32.9940478Z s3-bucket: gha-artifacts 2024-08-20T22:20:32.9940830Z region: us-east-1 2024-08-20T22:20:32.9941126Z env: 2024-08-20T22:20:32.9941389Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:20:32.9941837Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:20:32.9942316Z ##[endgroup] 2024-08-20T22:20:33.4861583Z (node:102272) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2024-08-20T22:20:33.4862313Z 2024-08-20T22:20:33.4862578Z Please migrate your code to use AWS SDK for JavaScript (v3). 2024-08-20T22:20:33.4863339Z For more information, check the migration guide at https://a.co/7PzMCcy 2024-08-20T22:20:33.4864259Z (Use `node --trace-warnings ...` to show where the warning was created) 2024-08-20T22:20:33.5601769Z Found 1 objects with prefix pytorch/pytorch/10479310725/linux-focal-cuda12.1-py3.10-gcc9-sm86/ 2024-08-20T22:20:33.5603234Z Starting download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2024-08-20T22:20:41.0917568Z Finished download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2024-08-20T22:20:41.0925107Z Artifact download has finished successfully 2024-08-20T22:20:41.1279536Z ##[group]Run unzip -o artifacts.zip 2024-08-20T22:20:41.1279972Z unzip -o artifacts.zip 2024-08-20T22:20:41.1289736Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:20:41.1290235Z env: 2024-08-20T22:20:41.1290511Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:20:41.1290954Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:20:41.1291529Z ##[endgroup] 2024-08-20T22:20:41.1337514Z Archive: artifacts.zip 2024-08-20T22:20:41.1338920Z creating: dist/ 2024-08-20T22:20:43.2773276Z inflating: dist/torch-2.5.0a0+git40ec5f6-cp310-cp310-linux_x86_64.whl 2024-08-20T22:20:43.2773954Z creating: build/custom_test_artifacts/ 2024-08-20T22:20:43.2774561Z creating: build/custom_test_artifacts/custom-op-build/ 2024-08-20T22:20:43.2775559Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/ 2024-08-20T22:20:43.2777252Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/pkgRedirects/ 2024-08-20T22:20:43.2783517Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeConfigureLog.yaml 2024-08-20T22:20:43.2785309Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/ 2024-08-20T22:20:43.2786286Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-08-20T22:20:43.2787550Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-08-20T22:20:43.2788549Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-08-20T22:20:43.2789679Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-08-20T22:20:43.2791006Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-08-20T22:20:43.2792042Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-08-20T22:20:43.2793074Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-08-20T22:20:43.2794441Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-08-20T22:20:43.2795692Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-08-20T22:20:43.2796861Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-08-20T22:20:43.2798049Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-08-20T22:20:43.2799391Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-08-20T22:20:43.2800715Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-08-20T22:20:43.2801782Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/ 2024-08-20T22:20:43.2802802Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/ 2024-08-20T22:20:43.2843052Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2024-08-20T22:20:43.2883121Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2024-08-20T22:20:43.2884614Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2024-08-20T22:20:43.2930093Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2024-08-20T22:20:43.2931610Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2024-08-20T22:20:43.2933085Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2024-08-20T22:20:43.2934584Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2024-08-20T22:20:43.2936077Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2024-08-20T22:20:43.2937513Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2024-08-20T22:20:43.2938937Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2024-08-20T22:20:43.2940333Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2024-08-20T22:20:43.2941721Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2024-08-20T22:20:43.2943027Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2024-08-20T22:20:43.2944291Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c 2024-08-20T22:20:43.2945542Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin 2024-08-20T22:20:43.2946799Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2024-08-20T22:20:43.2948200Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o 2024-08-20T22:20:43.2949445Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu 2024-08-20T22:20:43.3006415Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out 2024-08-20T22:20:43.3066772Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin 2024-08-20T22:20:43.3067986Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake 2024-08-20T22:20:43.3068993Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeScratch/ 2024-08-20T22:20:43.3069883Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeTmp/ 2024-08-20T22:20:43.3070802Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/cmake.check_cache 2024-08-20T22:20:43.3071757Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/ 2024-08-20T22:20:43.3073034Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.ts 2024-08-20T22:20:43.3074287Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.make 2024-08-20T22:20:43.3075415Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/depend.make 2024-08-20T22:20:43.3076465Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/link.txt 2024-08-20T22:20:43.3077566Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/cmake_clean.cmake 2024-08-20T22:20:43.3078660Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/build.make 2024-08-20T22:20:43.3079766Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/DependInfo.cmake 2024-08-20T22:20:43.3080870Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/flags.make 2024-08-20T22:20:43.3081956Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/progress.make 2024-08-20T22:20:43.3099335Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o.d 2024-08-20T22:20:43.3242913Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o 2024-08-20T22:20:43.3243948Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/ 2024-08-20T22:20:43.3245067Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.ts 2024-08-20T22:20:43.3246306Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.make 2024-08-20T22:20:43.3247487Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/depend.make 2024-08-20T22:20:43.3248612Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/link.txt 2024-08-20T22:20:43.3249779Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/cmake_clean.cmake 2024-08-20T22:20:43.3250954Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/build.make 2024-08-20T22:20:43.3252189Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/DependInfo.cmake 2024-08-20T22:20:43.3253341Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/flags.make 2024-08-20T22:20:43.3254492Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/progress.make 2024-08-20T22:20:43.3273026Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o.d 2024-08-20T22:20:43.3356426Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o 2024-08-20T22:20:43.3357654Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-08-20T22:20:43.3358748Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/TargetDirectories.txt 2024-08-20T22:20:43.3359925Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/progress.marks 2024-08-20T22:20:43.3360870Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile2 2024-08-20T22:20:43.3361796Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile.cmake 2024-08-20T22:20:43.3362723Z inflating: build/custom_test_artifacts/custom-op-build/detect_cuda_version.cc 2024-08-20T22:20:43.3365663Z inflating: build/custom_test_artifacts/custom-op-build/CMakeCache.txt 2024-08-20T22:20:43.3366712Z inflating: build/custom_test_artifacts/custom-op-build/Makefile 2024-08-20T22:20:43.3367621Z inflating: build/custom_test_artifacts/custom-op-build/cmake_install.cmake 2024-08-20T22:20:43.3487989Z inflating: build/custom_test_artifacts/custom-op-build/libcustom_ops.so 2024-08-20T22:20:43.3551118Z inflating: build/custom_test_artifacts/custom-op-build/test_custom_ops 2024-08-20T22:20:43.3551947Z creating: build/custom_test_artifacts/jit-hook-build/ 2024-08-20T22:20:43.3552679Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/ 2024-08-20T22:20:43.3553523Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/pkgRedirects/ 2024-08-20T22:20:43.3560651Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeConfigureLog.yaml 2024-08-20T22:20:43.3561599Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/ 2024-08-20T22:20:43.3562542Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-08-20T22:20:43.3563556Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-08-20T22:20:43.3564549Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-08-20T22:20:43.3565722Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-08-20T22:20:43.3566978Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-08-20T22:20:43.3568009Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-08-20T22:20:43.3569011Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-08-20T22:20:43.3570703Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-08-20T22:20:43.3572455Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-08-20T22:20:43.3574658Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-08-20T22:20:43.3575837Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-08-20T22:20:43.3577285Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-08-20T22:20:43.3578639Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-08-20T22:20:43.3579705Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/ 2024-08-20T22:20:43.3580724Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/ 2024-08-20T22:20:43.3620664Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2024-08-20T22:20:43.3661150Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2024-08-20T22:20:43.3662829Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2024-08-20T22:20:43.3708766Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2024-08-20T22:20:43.3710190Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2024-08-20T22:20:43.3711792Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2024-08-20T22:20:43.3713286Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2024-08-20T22:20:43.3714730Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2024-08-20T22:20:43.3716135Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2024-08-20T22:20:43.3717557Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2024-08-20T22:20:43.3718979Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2024-08-20T22:20:43.3720368Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2024-08-20T22:20:43.3721678Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2024-08-20T22:20:43.3722936Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c 2024-08-20T22:20:43.3724182Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin 2024-08-20T22:20:43.3725434Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2024-08-20T22:20:43.3726658Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o 2024-08-20T22:20:43.3727884Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu 2024-08-20T22:20:43.3783964Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out 2024-08-20T22:20:43.3844562Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin 2024-08-20T22:20:43.3845758Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake 2024-08-20T22:20:43.3846761Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeScratch/ 2024-08-20T22:20:43.3847634Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeTmp/ 2024-08-20T22:20:43.3848546Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/cmake.check_cache 2024-08-20T22:20:43.3849509Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/ 2024-08-20T22:20:43.3850588Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.ts 2024-08-20T22:20:43.3851860Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.make 2024-08-20T22:20:43.3853031Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/depend.make 2024-08-20T22:20:43.3854148Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/link.txt 2024-08-20T22:20:43.3855263Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/cmake_clean.cmake 2024-08-20T22:20:43.3856376Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/build.make 2024-08-20T22:20:43.3857509Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/DependInfo.cmake 2024-08-20T22:20:43.3858812Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/flags.make 2024-08-20T22:20:43.3859922Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/progress.make 2024-08-20T22:20:43.3876823Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o.d 2024-08-20T22:20:43.3941619Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o 2024-08-20T22:20:43.3942839Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-08-20T22:20:43.3943936Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/TargetDirectories.txt 2024-08-20T22:20:43.3944920Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/progress.marks 2024-08-20T22:20:43.3945848Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile2 2024-08-20T22:20:43.3946763Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile.cmake 2024-08-20T22:20:43.3947674Z inflating: build/custom_test_artifacts/jit-hook-build/detect_cuda_version.cc 2024-08-20T22:20:43.3949877Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeCache.txt 2024-08-20T22:20:43.3950789Z inflating: build/custom_test_artifacts/jit-hook-build/Makefile 2024-08-20T22:20:43.3951720Z inflating: build/custom_test_artifacts/jit-hook-build/cmake_install.cmake 2024-08-20T22:20:43.4002561Z inflating: build/custom_test_artifacts/jit-hook-build/test_jit_hooks 2024-08-20T22:20:43.4003346Z creating: build/custom_test_artifacts/custom-backend-build/ 2024-08-20T22:20:43.4004126Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/ 2024-08-20T22:20:43.4005039Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/pkgRedirects/ 2024-08-20T22:20:43.4012428Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeConfigureLog.yaml 2024-08-20T22:20:43.4014464Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/ 2024-08-20T22:20:43.4015968Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-08-20T22:20:43.4017052Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-08-20T22:20:43.4018112Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-08-20T22:20:43.4019287Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-08-20T22:20:43.4020477Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-08-20T22:20:43.4021556Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-08-20T22:20:43.4022633Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-08-20T22:20:43.4023871Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-08-20T22:20:43.4025113Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-08-20T22:20:43.4026347Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-08-20T22:20:43.4027580Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-08-20T22:20:43.4028822Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-08-20T22:20:43.4030324Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-08-20T22:20:43.4031440Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/ 2024-08-20T22:20:43.4032528Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/ 2024-08-20T22:20:43.4072205Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2024-08-20T22:20:43.4111839Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2024-08-20T22:20:43.4113546Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2024-08-20T22:20:43.4158917Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2024-08-20T22:20:43.4160426Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2024-08-20T22:20:43.4161966Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2024-08-20T22:20:43.4163548Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2024-08-20T22:20:43.4165055Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2024-08-20T22:20:43.4166582Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2024-08-20T22:20:43.4168069Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2024-08-20T22:20:43.4169541Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2024-08-20T22:20:43.4170971Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2024-08-20T22:20:43.4172390Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2024-08-20T22:20:43.4173734Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c 2024-08-20T22:20:43.4175040Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin 2024-08-20T22:20:43.4176375Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2024-08-20T22:20:43.4177655Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o 2024-08-20T22:20:43.4178961Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu 2024-08-20T22:20:43.4234032Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out 2024-08-20T22:20:43.4295694Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin 2024-08-20T22:20:43.4297180Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake 2024-08-20T22:20:43.4298395Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeScratch/ 2024-08-20T22:20:43.4299405Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeTmp/ 2024-08-20T22:20:43.4300395Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/cmake.check_cache 2024-08-20T22:20:43.4301456Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/ 2024-08-20T22:20:43.4302602Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.ts 2024-08-20T22:20:43.4303879Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.make 2024-08-20T22:20:43.4305110Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/depend.make 2024-08-20T22:20:43.4306488Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/link.txt 2024-08-20T22:20:43.4307688Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/cmake_clean.cmake 2024-08-20T22:20:43.4309030Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/build.make 2024-08-20T22:20:43.4310241Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/DependInfo.cmake 2024-08-20T22:20:43.4311442Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/flags.make 2024-08-20T22:20:43.4312635Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/progress.make 2024-08-20T22:20:43.4313912Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o.d 2024-08-20T22:20:43.4436795Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o 2024-08-20T22:20:43.4438007Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/ 2024-08-20T22:20:43.4439229Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.ts 2024-08-20T22:20:43.4440591Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.make 2024-08-20T22:20:43.4441883Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/depend.make 2024-08-20T22:20:43.4443105Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/link.txt 2024-08-20T22:20:43.4444379Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/cmake_clean.cmake 2024-08-20T22:20:43.4445710Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/build.make 2024-08-20T22:20:43.4446975Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/DependInfo.cmake 2024-08-20T22:20:43.4448231Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/flags.make 2024-08-20T22:20:43.4449473Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/progress.make 2024-08-20T22:20:43.4466003Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o.d 2024-08-20T22:20:43.4521492Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o 2024-08-20T22:20:43.4522819Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-08-20T22:20:43.4523991Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/TargetDirectories.txt 2024-08-20T22:20:43.4525055Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/progress.marks 2024-08-20T22:20:43.4526093Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile2 2024-08-20T22:20:43.4527082Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile.cmake 2024-08-20T22:20:43.4528080Z inflating: build/custom_test_artifacts/custom-backend-build/detect_cuda_version.cc 2024-08-20T22:20:43.4529509Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeCache.txt 2024-08-20T22:20:43.4530889Z inflating: build/custom_test_artifacts/custom-backend-build/Makefile 2024-08-20T22:20:43.4531939Z inflating: build/custom_test_artifacts/custom-backend-build/cmake_install.cmake 2024-08-20T22:20:43.4637480Z inflating: build/custom_test_artifacts/custom-backend-build/libcustom_backend.so 2024-08-20T22:20:43.4681591Z inflating: build/custom_test_artifacts/custom-backend-build/test_custom_backend 2024-08-20T22:20:43.4682248Z creating: build/lib/ 2024-08-20T22:20:43.4771484Z inflating: build/lib/libprotobuf-lite.a 2024-08-20T22:20:43.5228365Z inflating: build/lib/libprotobuf.a 2024-08-20T22:20:43.5238784Z inflating: build/lib/libpthreadpool.a 2024-08-20T22:20:43.5247051Z inflating: build/lib/libcpuinfo.a 2024-08-20T22:20:43.5255153Z inflating: build/lib/libcpuinfo_internals.a 2024-08-20T22:20:43.5255881Z inflating: build/lib/libclog.a 2024-08-20T22:20:43.5274258Z inflating: build/lib/libnnpack.a 2024-08-20T22:20:43.5276924Z inflating: build/lib/libnnpack_reference_layers.a 2024-08-20T22:20:43.5342478Z inflating: build/lib/libgtest.a 2024-08-20T22:20:43.5417561Z inflating: build/lib/libbenchmark.a 2024-08-20T22:20:43.5482848Z inflating: build/lib/libasmjit.a 2024-08-20T22:20:43.5489391Z inflating: build/lib/libittnotify.a 2024-08-20T22:20:43.5517491Z inflating: build/lib/libtensorpipe_uv.a 2024-08-20T22:20:43.5646722Z inflating: build/lib/libgloo.a 2024-08-20T22:20:43.5667286Z inflating: build/lib/libfmt.a 2024-08-20T22:20:43.5762739Z inflating: build/lib/libc10.so 2024-08-20T22:20:43.5764599Z inflating: build/lib/libcaffe2_nvrtc.so 2024-08-20T22:20:43.5766271Z inflating: build/lib/libtorch_global_deps.so 2024-08-20T22:20:43.5785734Z inflating: build/lib/libpytorch_qnnpack.a 2024-08-20T22:20:43.6291138Z inflating: build/lib/libprotoc.a 2024-08-20T22:20:43.6309348Z inflating: build/lib/libgmock.a 2024-08-20T22:20:43.6309804Z inflating: build/lib/libgtest_main.a 2024-08-20T22:20:43.6310516Z inflating: build/lib/libbenchmark_main.a 2024-08-20T22:20:43.6702209Z inflating: build/lib/libgloo_cuda.a 2024-08-20T22:20:44.6918647Z inflating: build/lib/libdnnl.a 2024-08-20T22:20:44.7494212Z inflating: build/lib/libtensorpipe.a 2024-08-20T22:20:44.7551681Z inflating: build/lib/libc10_cuda.so 2024-08-20T22:20:44.7553349Z inflating: build/lib/libgmock_main.a 2024-08-20T22:20:44.8814963Z inflating: build/lib/libfbgemm.a 2024-08-20T22:20:44.9071148Z inflating: build/lib/libtensorpipe_cuda.a 2024-08-20T22:20:44.9579942Z inflating: build/lib/libkineto.a 2024-08-20T22:20:44.9764868Z inflating: build/lib/libXNNPACK.a 2024-08-20T22:20:44.9807115Z inflating: build/lib/libonnx_proto.a 2024-08-20T22:20:45.0502681Z inflating: build/lib/libonnx.a 2024-08-20T22:20:47.5091912Z inflating: build/lib/libtorch_cpu.so 2024-08-20T22:20:47.5097012Z inflating: build/lib/libunbox_lib.a 2024-08-20T22:20:47.5101311Z inflating: build/lib/libshm.so 2024-08-20T22:20:49.5866673Z inflating: build/lib/libtorch_cuda.so 2024-08-20T22:20:49.5868660Z inflating: build/lib/libtorch.so 2024-08-20T22:20:49.5871650Z inflating: build/lib/libc10d_cuda_test.so 2024-08-20T22:20:50.4101277Z inflating: build/lib/libtorch_cuda_linalg.so 2024-08-20T22:20:50.6103488Z inflating: build/lib/libtorch_python.so 2024-08-20T22:20:50.6176402Z inflating: build/lib/libtorchbind_test.so 2024-08-20T22:20:50.6197080Z inflating: build/lib/libjitbackend_test.so 2024-08-20T22:20:50.6223448Z inflating: build/lib/libaoti_custom_ops.so 2024-08-20T22:20:50.6249339Z inflating: build/lib/libbackend_with_compiler.so 2024-08-20T22:20:50.6284118Z inflating: build/lib/libnnapi_backend.so 2024-08-20T22:20:50.6284583Z creating: build/bin/ 2024-08-20T22:20:50.6335615Z inflating: build/bin/c10_CompileTimeFunctionPointer_test 2024-08-20T22:20:50.6387473Z inflating: build/bin/c10_DeviceGuard_test 2024-08-20T22:20:50.6439069Z inflating: build/bin/c10_Device_test 2024-08-20T22:20:50.6498595Z inflating: build/bin/c10_DispatchKeySet_test 2024-08-20T22:20:50.6552489Z inflating: build/bin/c10_Scalar_test 2024-08-20T22:20:50.6602285Z inflating: build/bin/c10_StreamGuard_test 2024-08-20T22:20:50.6653712Z inflating: build/bin/c10_SymInt_test 2024-08-20T22:20:50.6708713Z inflating: build/bin/c10_InlineDeviceGuard_test 2024-08-20T22:20:50.6765029Z inflating: build/bin/c10_InlineStreamGuard_test 2024-08-20T22:20:50.6821890Z inflating: build/bin/c10_SizesAndStrides_test 2024-08-20T22:20:50.6893564Z inflating: build/bin/c10_cow_test 2024-08-20T22:20:50.6946908Z inflating: build/bin/c10_Bitset_test 2024-08-20T22:20:50.6996524Z inflating: build/bin/c10_ConstexprCrc_test 2024-08-20T22:20:50.7047065Z inflating: build/bin/c10_DeadlockDetection_test 2024-08-20T22:20:50.7097960Z inflating: build/bin/c10_Half_test 2024-08-20T22:20:50.7154603Z inflating: build/bin/c10_LeftRight_test 2024-08-20T22:20:50.7209965Z inflating: build/bin/c10_Metaprogramming_test 2024-08-20T22:20:50.7260669Z inflating: build/bin/c10_Synchronized_test 2024-08-20T22:20:50.7316585Z inflating: build/bin/c10_ThreadLocal_test 2024-08-20T22:20:50.7368565Z inflating: build/bin/c10_TypeIndex_test 2024-08-20T22:20:50.7420442Z inflating: build/bin/c10_TypeList_test 2024-08-20T22:20:50.7469981Z inflating: build/bin/c10_TypeTraits_test 2024-08-20T22:20:50.7521849Z inflating: build/bin/c10_accumulate_test 2024-08-20T22:20:50.7577950Z inflating: build/bin/c10_bfloat16_test 2024-08-20T22:20:50.7628897Z inflating: build/bin/c10_bit_cast_test 2024-08-20T22:20:50.7687183Z inflating: build/bin/c10_complex_math_test 2024-08-20T22:20:50.7745322Z inflating: build/bin/c10_complex_test 2024-08-20T22:20:50.7799321Z inflating: build/bin/c10_exception_test 2024-08-20T22:20:50.7850433Z inflating: build/bin/c10_flags_test 2024-08-20T22:20:50.7900987Z inflating: build/bin/c10_generic_math_test 2024-08-20T22:20:50.8067610Z inflating: build/bin/c10_intrusive_ptr_test 2024-08-20T22:20:50.8120728Z inflating: build/bin/c10_irange_test 2024-08-20T22:20:50.8175893Z inflating: build/bin/c10_lazy_test 2024-08-20T22:20:50.8234055Z inflating: build/bin/c10_logging_test 2024-08-20T22:20:50.8296434Z inflating: build/bin/c10_ordered_preserving_dict_test 2024-08-20T22:20:50.8371985Z inflating: build/bin/c10_optional_test 2024-08-20T22:20:50.8525726Z inflating: build/bin/c10_small_vector_test 2024-08-20T22:20:50.8579554Z inflating: build/bin/c10_registry_test 2024-08-20T22:20:50.8631560Z inflating: build/bin/c10_ssize_test 2024-08-20T22:20:50.8684813Z inflating: build/bin/c10_string_util_test 2024-08-20T22:20:50.8735141Z inflating: build/bin/c10_tempfile_test 2024-08-20T22:20:50.8794237Z inflating: build/bin/c10_string_view_test 2024-08-20T22:20:50.8843445Z inflating: build/bin/c10_intrusive_ptr_benchmark 2024-08-20T22:20:50.8899972Z inflating: build/bin/c10_typeid_test 2024-08-20T22:20:50.9349933Z inflating: build/bin/protoc-3.13.0.0 2024-08-20T22:20:50.9800339Z inflating: build/bin/protoc 2024-08-20T22:20:50.9853738Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_1_var_test 2024-08-20T22:20:50.9907179Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_catches_stream 2024-08-20T22:20:50.9960483Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_catches_thread_and_block_and_device 2024-08-20T22:20:51.0012848Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_from_2_processes 2024-08-20T22:20:51.0066348Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_blocks_and_threads 2024-08-20T22:20:51.0119358Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_multiple_blocks 2024-08-20T22:20:51.0169172Z inflating: build/bin/c10_cuda_CUDATest 2024-08-20T22:20:51.0222288Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_same_block 2024-08-20T22:20:51.0555536Z inflating: build/bin/vec_test_all_types_DEFAULT 2024-08-20T22:20:51.0901664Z inflating: build/bin/vec_test_all_types_AVX512 2024-08-20T22:20:51.1263902Z inflating: build/bin/vec_test_all_types_AVX2 2024-08-20T22:20:51.1316758Z inflating: build/bin/BackoffTest 2024-08-20T22:20:51.1373227Z inflating: build/bin/FileStoreTest 2024-08-20T22:20:51.1430144Z inflating: build/bin/TCPStoreTest 2024-08-20T22:20:51.1484838Z inflating: build/bin/HashStoreTest 2024-08-20T22:20:51.1498239Z inflating: build/bin/ProcessGroupMPITest 2024-08-20T22:20:51.1553110Z inflating: build/bin/test_edge_op_registration 2024-08-20T22:20:51.1557480Z inflating: build/bin/torch_shm_manager 2024-08-20T22:20:51.1560074Z inflating: build/bin/example_allreduce 2024-08-20T22:20:51.1615652Z inflating: build/bin/test_dist_autograd 2024-08-20T22:20:51.1685932Z inflating: build/bin/test_cpp_rpc 2024-08-20T22:20:51.1688727Z inflating: build/bin/parallel_benchmark 2024-08-20T22:20:51.1756879Z inflating: build/bin/test_mobile_nnc 2024-08-20T22:20:51.1765707Z inflating: build/bin/aot_model_compiler_test 2024-08-20T22:20:51.2115760Z inflating: build/bin/test_lazy 2024-08-20T22:20:51.3305969Z inflating: build/bin/test_api 2024-08-20T22:20:51.3380806Z inflating: build/bin/Dict_test 2024-08-20T22:20:51.3433532Z inflating: build/bin/Dimname_test 2024-08-20T22:20:51.3499248Z inflating: build/bin/MaybeOwned_test 2024-08-20T22:20:51.3556744Z inflating: build/bin/NamedTensor_test 2024-08-20T22:20:51.3616371Z inflating: build/bin/apply_utils_test 2024-08-20T22:20:51.3676918Z inflating: build/bin/atest 2024-08-20T22:20:51.3740946Z inflating: build/bin/basic 2024-08-20T22:20:51.3796333Z inflating: build/bin/broadcast_test 2024-08-20T22:20:51.3847655Z inflating: build/bin/cpu_allocator_test 2024-08-20T22:20:51.3906259Z inflating: build/bin/cpu_generator_test 2024-08-20T22:20:51.3960536Z inflating: build/bin/cpu_profiling_allocator_test 2024-08-20T22:20:51.4055396Z inflating: build/bin/cpu_rng_test 2024-08-20T22:20:51.4105745Z inflating: build/bin/dispatch_key_set_test 2024-08-20T22:20:51.4157310Z inflating: build/bin/dlconvertor_test 2024-08-20T22:20:51.4215933Z inflating: build/bin/extension_backend_test 2024-08-20T22:20:51.4272071Z inflating: build/bin/half_test 2024-08-20T22:20:51.4369954Z inflating: build/bin/ivalue_test 2024-08-20T22:20:51.4419986Z inflating: build/bin/lazy_tensor_test 2024-08-20T22:20:51.4475218Z inflating: build/bin/math_kernel_test 2024-08-20T22:20:51.4530630Z inflating: build/bin/memory_format_test 2024-08-20T22:20:51.4584110Z inflating: build/bin/memory_overlapping_test 2024-08-20T22:20:51.4637811Z inflating: build/bin/mobile_memory_cleanup 2024-08-20T22:20:51.4694305Z inflating: build/bin/native_test 2024-08-20T22:20:51.4745364Z inflating: build/bin/operator_name_test 2024-08-20T22:20:51.4797678Z inflating: build/bin/operators_test 2024-08-20T22:20:51.4849650Z inflating: build/bin/packedtensoraccessor_test 2024-08-20T22:20:51.4917673Z inflating: build/bin/pow_test 2024-08-20T22:20:51.4975407Z inflating: build/bin/quantized_test 2024-08-20T22:20:51.5026029Z inflating: build/bin/reduce_ops_test 2024-08-20T22:20:51.5078700Z inflating: build/bin/reportMemoryUsage_test 2024-08-20T22:20:51.5136918Z inflating: build/bin/scalar_tensor_test 2024-08-20T22:20:51.5196018Z inflating: build/bin/scalar_test 2024-08-20T22:20:51.5248431Z inflating: build/bin/StorageUtils_test 2024-08-20T22:20:51.5302396Z inflating: build/bin/stride_properties_test 2024-08-20T22:20:51.5382505Z inflating: build/bin/tensor_iterator_test 2024-08-20T22:20:51.5437333Z inflating: build/bin/test_parallel 2024-08-20T22:20:51.5440642Z inflating: build/bin/thread_init_test 2024-08-20T22:20:51.5497456Z inflating: build/bin/type_ptr_test 2024-08-20T22:20:51.5558234Z inflating: build/bin/type_test 2024-08-20T22:20:51.5610667Z inflating: build/bin/undefined_tensor_test 2024-08-20T22:20:51.5612505Z inflating: build/bin/verify_api_visibility 2024-08-20T22:20:51.5682993Z inflating: build/bin/legacy_vmap_test 2024-08-20T22:20:51.5735169Z inflating: build/bin/weakref_test 2024-08-20T22:20:51.5786987Z inflating: build/bin/wrapdim_test 2024-08-20T22:20:51.5839327Z inflating: build/bin/xla_tensor_test 2024-08-20T22:20:51.5899860Z inflating: build/bin/IListRef_test 2024-08-20T22:20:51.6007648Z inflating: build/bin/List_test 2024-08-20T22:20:51.6075136Z inflating: build/bin/KernelFunction_test 2024-08-20T22:20:51.6201362Z inflating: build/bin/kernel_function_legacy_test 2024-08-20T22:20:51.6298994Z inflating: build/bin/kernel_function_test 2024-08-20T22:20:51.6429172Z inflating: build/bin/kernel_lambda_legacy_test 2024-08-20T22:20:51.6534003Z inflating: build/bin/kernel_lambda_test 2024-08-20T22:20:51.6595954Z inflating: build/bin/kernel_stackbased_test 2024-08-20T22:20:51.6692768Z inflating: build/bin/make_boxed_from_unboxed_functor_test 2024-08-20T22:20:51.6744306Z inflating: build/bin/CppSignature_test 2024-08-20T22:20:51.6800610Z inflating: build/bin/backend_fallback_test 2024-08-20T22:20:51.6850063Z inflating: build/bin/op_allowlist_test 2024-08-20T22:20:51.7156790Z inflating: build/bin/op_registration_test 2024-08-20T22:20:51.7220705Z inflating: build/bin/inline_container_test 2024-08-20T22:20:51.7274155Z inflating: build/bin/cuda_apply_test 2024-08-20T22:20:51.7326093Z inflating: build/bin/cuda_allocator_test 2024-08-20T22:20:51.7385846Z inflating: build/bin/cuda_atomic_ops_test 2024-08-20T22:20:51.7441202Z inflating: build/bin/cuda_caching_host_allocator_test 2024-08-20T22:20:51.7511591Z inflating: build/bin/cuda_complex_math_test 2024-08-20T22:20:51.7571343Z inflating: build/bin/cuda_complex_test 2024-08-20T22:20:51.7621426Z inflating: build/bin/cuda_device_test 2024-08-20T22:20:51.7680014Z inflating: build/bin/cuda_cub_test 2024-08-20T22:20:51.7730900Z inflating: build/bin/cuda_dlconvertor_test 2024-08-20T22:20:51.7797508Z inflating: build/bin/cuda_distributions_test 2024-08-20T22:20:51.7854625Z inflating: build/bin/cuda_generator_test 2024-08-20T22:20:51.7904994Z inflating: build/bin/cuda_half_test 2024-08-20T22:20:51.7957049Z inflating: build/bin/cuda_integer_divider_test 2024-08-20T22:20:51.8007100Z inflating: build/bin/cuda_optional_test 2024-08-20T22:20:51.8059332Z inflating: build/bin/cuda_packedtensoraccessor_test 2024-08-20T22:20:51.8112469Z inflating: build/bin/cuda_reportMemoryUsage_test 2024-08-20T22:20:51.8163618Z inflating: build/bin/cuda_allocatorTraceTracker_test 2024-08-20T22:20:51.8225353Z inflating: build/bin/cuda_stream_test 2024-08-20T22:20:51.8275282Z inflating: build/bin/cuda_cudnn_test 2024-08-20T22:20:51.8328495Z inflating: build/bin/cuda_vectorized_test 2024-08-20T22:20:51.8343405Z inflating: build/bin/tutorial_tensorexpr 2024-08-20T22:20:51.8410258Z inflating: build/bin/ProcessGroupGlooTest 2024-08-20T22:20:51.8467733Z inflating: build/bin/ProcessGroupGlooAsyncTest 2024-08-20T22:20:51.8531991Z inflating: build/bin/ProcessGroupNCCLTest 2024-08-20T22:20:51.8595007Z inflating: build/bin/ProcessGroupNCCLErrorsTest 2024-08-20T22:20:51.9425447Z inflating: build/bin/test_tensorexpr 2024-08-20T22:20:52.0011663Z inflating: build/bin/test_jit 2024-08-20T22:20:52.0012307Z creating: .additional_ci_files/ 2024-08-20T22:20:52.0074685Z inflating: .additional_ci_files/test-times.json 2024-08-20T22:20:52.0314668Z inflating: .additional_ci_files/test-class-times.json 2024-08-20T22:20:52.0350774Z ##[group]Run rm artifacts.zip 2024-08-20T22:20:52.0351183Z rm artifacts.zip 2024-08-20T22:20:52.0360161Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:20:52.0360665Z env: 2024-08-20T22:20:52.0360937Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:20:52.0361390Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:20:52.0361881Z ##[endgroup] 2024-08-20T22:20:52.1471502Z ##[group]Run df -H 2024-08-20T22:20:52.1471824Z df -H 2024-08-20T22:20:52.1480842Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:20:52.1481341Z env: 2024-08-20T22:20:52.1481609Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:20:52.1482075Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:20:52.1482748Z ##[endgroup] 2024-08-20T22:20:52.1547884Z Filesystem Size Used Avail Use% Mounted on 2024-08-20T22:20:52.1548515Z devtmpfs 4.2M 0 4.2M 0% /dev 2024-08-20T22:20:52.1549132Z tmpfs 34G 0 34G 0% /dev/shm 2024-08-20T22:20:52.1549693Z tmpfs 14G 553k 14G 1% /run 2024-08-20T22:20:52.1550149Z /dev/nvme0n1p1 161G 53G 109G 33% / 2024-08-20T22:20:52.1550821Z tmpfs 34G 8.2k 34G 1% /tmp 2024-08-20T22:20:52.1551661Z /dev/nvme0n1p128 11M 1.4M 9.2M 13% /boot/efi 2024-08-20T22:20:52.1552404Z tmpfs 6.7G 0 6.7G 0% /run/user/0 2024-08-20T22:20:52.1592159Z Prepare all required actions 2024-08-20T22:20:52.1592616Z Getting action download info 2024-08-20T22:20:52.2751741Z ##[group]Run ./.github/actions/download-td-artifacts 2024-08-20T22:20:52.2752212Z with: 2024-08-20T22:20:52.2752475Z env: 2024-08-20T22:20:52.2752754Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:20:52.2753207Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:20:52.2753719Z ##[endgroup] 2024-08-20T22:20:52.2786854Z ##[group]Run seemethere/download-artifact-s3@v4 2024-08-20T22:20:52.2787304Z with: 2024-08-20T22:20:52.2787579Z name: td_results 2024-08-20T22:20:52.2787895Z s3-bucket: gha-artifacts 2024-08-20T22:20:52.2788257Z region: us-east-1 2024-08-20T22:20:52.2788563Z env: 2024-08-20T22:20:52.2788845Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:20:52.2789300Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:20:52.2789796Z ##[endgroup] 2024-08-20T22:20:52.7676083Z (node:102291) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2024-08-20T22:20:52.7676796Z 2024-08-20T22:20:52.7677066Z Please migrate your code to use AWS SDK for JavaScript (v3). 2024-08-20T22:20:52.7678277Z For more information, check the migration guide at https://a.co/7PzMCcy 2024-08-20T22:20:52.7680022Z (Use `node --trace-warnings ...` to show where the warning was created) 2024-08-20T22:20:52.8300056Z Found 0 objects with prefix pytorch/pytorch/10479310725/td_results/ 2024-08-20T22:20:52.8306436Z Artifact download has finished successfully 2024-08-20T22:20:52.8628054Z ##[group]Run mkdir -p .additional_ci_files 2024-08-20T22:20:52.8628549Z mkdir -p .additional_ci_files 2024-08-20T22:20:52.8629119Z mv td_results.json .additional_ci_files/td_results.json 2024-08-20T22:20:52.8640052Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:20:52.8640558Z env: 2024-08-20T22:20:52.8640830Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:20:52.8641300Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:20:52.8641785Z ##[endgroup] 2024-08-20T22:20:52.8711419Z mv: cannot stat 'td_results.json': No such file or directory 2024-08-20T22:20:52.8723760Z ##[error]Process completed with exit code 1. 2024-08-20T22:20:52.8759385Z ##[group]Run .github/scripts/parse_ref.py 2024-08-20T22:20:52.8759882Z .github/scripts/parse_ref.py 2024-08-20T22:20:52.8768796Z shell: /usr/bin/bash -e {0} 2024-08-20T22:20:52.8769149Z env: 2024-08-20T22:20:52.8769422Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:20:52.8769878Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:20:52.8770361Z ##[endgroup] 2024-08-20T22:20:52.9064866Z Prepare all required actions 2024-08-20T22:20:52.9103871Z ##[group]Run ./.github/actions/get-workflow-job-id 2024-08-20T22:20:52.9104340Z with: 2024-08-20T22:20:52.9104886Z github-token: *** 2024-08-20T22:20:52.9105208Z env: 2024-08-20T22:20:52.9105491Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:20:52.9105957Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:20:52.9106450Z ##[endgroup] 2024-08-20T22:20:52.9123815Z ##[group]Run set -eux 2024-08-20T22:20:52.9124203Z set -eux 2024-08-20T22:20:52.9124801Z python3 .github/scripts/get_workflow_job_id.py "${GITHUB_RUN_ID}" "${RUNNER_NAME}" 2024-08-20T22:20:52.9134501Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:20:52.9135222Z env: 2024-08-20T22:20:52.9135513Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:20:52.9135984Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:20:52.9136644Z GITHUB_TOKEN: *** 2024-08-20T22:20:52.9136968Z ##[endgroup] 2024-08-20T22:20:52.9165970Z + python3 .github/scripts/get_workflow_job_id.py 10479310725 i-005bdc4da2a364029 2024-08-20T22:20:54.6520936Z setting job-id=29026530123 2024-08-20T22:20:54.6521886Z setting job-name=cuda12.1-py3.10-gcc9-sm86 / test (aot_inductor_timm, 1, 2, amz2023.linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:20:54.6741987Z Prepare all required actions 2024-08-20T22:20:54.6742439Z Getting action download info 2024-08-20T22:20:54.8553618Z ##[group]Run ./.github/actions/filter-test-configs 2024-08-20T22:20:54.8554190Z with: 2024-08-20T22:20:54.8554706Z github-token: *** 2024-08-20T22:20:54.8564313Z test-matrix: {"include": [{"config": "inductor", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_distributed", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.g5.12xlarge.nvidia.gpu"}, {"config": "inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_timm", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_timm", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_timm", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_timm", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_timm", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_timm", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_cpp_wrapper_abi_compatible", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}]} 2024-08-20T22:20:54.8574293Z job-name: cuda12.1-py3.10-gcc9-sm86 / test (aot_inductor_timm, 1, 2, amz2023.linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:20:54.8575055Z env: 2024-08-20T22:20:54.8575358Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:20:54.8575816Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:20:54.8576320Z ##[endgroup] 2024-08-20T22:20:54.8619716Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2024-08-20T22:20:54.8620283Z with: 2024-08-20T22:20:54.8620565Z shell: bash 2024-08-20T22:20:54.8620884Z timeout_minutes: 10 2024-08-20T22:20:54.8621217Z max_attempts: 5 2024-08-20T22:20:54.8621545Z retry_wait_seconds: 30 2024-08-20T22:20:54.8622691Z command: set -eux # PyYAML 6.0 doesn't work with MacOS x86 anymore # This must run on Python-3.7 (AmazonLinux2) so can't use request=3.32.2 python3 -m pip install requests==2.27.1 pyyaml==6.0.1 2024-08-20T22:20:54.8623886Z polling_interval_seconds: 1 2024-08-20T22:20:54.8624457Z warning_on_retry: true 2024-08-20T22:20:54.8624812Z continue_on_error: false 2024-08-20T22:20:54.8625164Z env: 2024-08-20T22:20:54.8625451Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:20:54.8625903Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:20:54.8626560Z GITHUB_TOKEN: *** 2024-08-20T22:20:54.8626889Z ##[endgroup] 2024-08-20T22:20:54.9381292Z + python3 -m pip install requests==2.27.1 pyyaml==6.0.1 2024-08-20T22:20:55.1745325Z Defaulting to user installation because normal site-packages is not writeable 2024-08-20T22:20:55.1927839Z Requirement already satisfied: requests==2.27.1 in /home/ec2-user/.local/lib/python3.9/site-packages (2.27.1) 2024-08-20T22:20:55.1930904Z Requirement already satisfied: pyyaml==6.0.1 in /home/ec2-user/.local/lib/python3.9/site-packages (6.0.1) 2024-08-20T22:20:55.2050534Z Requirement already satisfied: idna<4,>=2.5 in /usr/lib/python3.9/site-packages (from requests==2.27.1) (2.10) 2024-08-20T22:20:55.2059472Z Requirement already satisfied: charset-normalizer~=2.0.0 in /home/ec2-user/.local/lib/python3.9/site-packages (from requests==2.27.1) (2.0.12) 2024-08-20T22:20:55.2062845Z Requirement already satisfied: certifi>=2017.4.17 in /home/ec2-user/.local/lib/python3.9/site-packages (from requests==2.27.1) (2024.7.4) 2024-08-20T22:20:55.2068107Z Requirement already satisfied: urllib3<1.27,>=1.21.1 in /usr/lib/python3.9/site-packages (from requests==2.27.1) (1.25.10) 2024-08-20T22:20:55.9168653Z Command completed after 1 attempt(s). 2024-08-20T22:20:55.9226730Z ##[group]Run set -x 2024-08-20T22:20:55.9227067Z set -x 2024-08-20T22:20:55.9227379Z  2024-08-20T22:20:55.9227929Z # Use relative path here as this could be checked out anywhere, not necessarily 2024-08-20T22:20:55.9228610Z # in runner workspace 2024-08-20T22:20:55.9229149Z python3 "${GITHUB_ACTION_PATH}/../../scripts/parse_ref.py" 2024-08-20T22:20:55.9239367Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:20:55.9239880Z env: 2024-08-20T22:20:55.9240150Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:20:55.9240601Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:20:55.9241083Z ##[endgroup] 2024-08-20T22:20:55.9272096Z + python3 /home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/filter-test-configs/../../scripts/parse_ref.py 2024-08-20T22:20:55.9513166Z ##[group]Run echo "Workflow: ${GITHUB_WORKFLOW}" 2024-08-20T22:20:55.9513717Z echo "Workflow: ${GITHUB_WORKFLOW}" 2024-08-20T22:20:55.9514190Z echo "Job name: ${JOB_NAME}" 2024-08-20T22:20:55.9514605Z  2024-08-20T22:20:55.9515154Z # Use relative path here as this could be checked out anywhere, not necessarily 2024-08-20T22:20:55.9515835Z # in runner workspace 2024-08-20T22:20:55.9516418Z python3 "${GITHUB_ACTION_PATH}/../../scripts/filter_test_configs.py" \ 2024-08-20T22:20:55.9517056Z  --workflow "${GITHUB_WORKFLOW}" \ 2024-08-20T22:20:55.9517518Z  --job-name "${JOB_NAME}" \ 2024-08-20T22:20:55.9526948Z  --test-matrix "{"include": [{"config": "inductor", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_distributed", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.g5.12xlarge.nvidia.gpu"}, {"config": "inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_timm", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_timm", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_timm", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_timm", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_timm", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_timm", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_cpp_wrapper_abi_compatible", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}]}" \ 2024-08-20T22:20:55.9537327Z  --selected-test-configs "" \ 2024-08-20T22:20:55.9537797Z  --pr-number "${PR_NUMBER}" \ 2024-08-20T22:20:55.9538238Z  --tag "${TAG}" \ 2024-08-20T22:20:55.9538700Z  --event-name "${EVENT_NAME}" \ 2024-08-20T22:20:55.9539149Z  --schedule "${SCHEDULE}" \ 2024-08-20T22:20:55.9539608Z  --branch "${HEAD_BRANCH}" 2024-08-20T22:20:55.9548620Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:20:55.9549135Z env: 2024-08-20T22:20:55.9549409Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:20:55.9549863Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:20:55.9550553Z GITHUB_TOKEN: *** 2024-08-20T22:20:55.9551229Z JOB_NAME: cuda12.1-py3.10-gcc9-sm86 / test (aot_inductor_timm, 1, 2, amz2023.linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:20:55.9551987Z PR_NUMBER: 2024-08-20T22:20:55.9552287Z TAG: ciflow/inductor/133712 2024-08-20T22:20:55.9552658Z EVENT_NAME: push 2024-08-20T22:20:55.9552967Z SCHEDULE: 2024-08-20T22:20:55.9553249Z HEAD_BRANCH: 2024-08-20T22:20:55.9553547Z ##[endgroup] 2024-08-20T22:20:55.9583005Z Workflow: inductor 2024-08-20T22:20:55.9583992Z Job name: cuda12.1-py3.10-gcc9-sm86 / test (aot_inductor_timm, 1, 2, amz2023.linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:20:56.2265489Z INFO:root:Found no test-config label on the PR, so all test configs are included 2024-08-20T22:20:56.3717045Z ##[group]Run echo "Filtered matrix:" 2024-08-20T22:20:56.3717506Z echo "Filtered matrix:" 2024-08-20T22:20:56.3726722Z echo "{"include": [{"config": "inductor", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_distributed", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.g5.12xlarge.nvidia.gpu"}, {"config": "inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_timm", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_timm", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_timm", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_timm", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_timm", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_timm", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_cpp_wrapper_abi_compatible", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.g5.4xlarge.nvidia.gpu"}]}" 2024-08-20T22:20:56.3736600Z  2024-08-20T22:20:56.3736873Z echo 2024-08-20T22:20:56.3737259Z echo "Is the current job unstable? False" 2024-08-20T22:20:56.3737711Z  2024-08-20T22:20:56.3737987Z echo 2024-08-20T22:20:56.3738353Z echo "Is keep-going label set? False" 2024-08-20T22:20:56.3738799Z  2024-08-20T22:20:56.3739064Z echo 2024-08-20T22:20:56.3739384Z echo "Renabled issues? " 2024-08-20T22:20:56.3748482Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:20:56.3748967Z env: 2024-08-20T22:20:56.3749241Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:20:56.3749695Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:20:56.3750174Z ##[endgroup] 2024-08-20T22:20:56.3781239Z Filtered matrix: 2024-08-20T22:20:56.3791825Z {include: [{config: inductor, shard: 1, num_shards: 2, runner: amz2023.linux.g5.4xlarge.nvidia.gpu}, {config: inductor, shard: 2, num_shards: 2, runner: amz2023.linux.g5.4xlarge.nvidia.gpu}, {config: inductor_distributed, shard: 1, num_shards: 1, runner: amz2023.linux.g5.12xlarge.nvidia.gpu}, {config: inductor_huggingface, shard: 1, num_shards: 1, runner: amz2023.linux.g5.4xlarge.nvidia.gpu}, {config: inductor_timm, shard: 1, num_shards: 2, runner: amz2023.linux.g5.4xlarge.nvidia.gpu}, {config: inductor_timm, shard: 2, num_shards: 2, runner: amz2023.linux.g5.4xlarge.nvidia.gpu}, {config: inductor_torchbench, shard: 1, num_shards: 2, runner: amz2023.linux.g5.4xlarge.nvidia.gpu}, {config: inductor_torchbench, shard: 2, num_shards: 2, runner: amz2023.linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_inductor_huggingface, shard: 1, num_shards: 1, runner: amz2023.linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_inductor_timm, shard: 1, num_shards: 2, runner: amz2023.linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_inductor_timm, shard: 2, num_shards: 2, runner: amz2023.linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_inductor_torchbench, shard: 1, num_shards: 2, runner: amz2023.linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_inductor_torchbench, shard: 2, num_shards: 2, runner: amz2023.linux.g5.4xlarge.nvidia.gpu}, {config: aot_inductor_huggingface, shard: 1, num_shards: 1, runner: amz2023.linux.g5.4xlarge.nvidia.gpu}, {config: aot_inductor_timm, shard: 1, num_shards: 2, runner: amz2023.linux.g5.4xlarge.nvidia.gpu}, {config: aot_inductor_timm, shard: 2, num_shards: 2, runner: amz2023.linux.g5.4xlarge.nvidia.gpu}, {config: aot_inductor_torchbench, shard: 1, num_shards: 2, runner: amz2023.linux.g5.4xlarge.nvidia.gpu}, {config: aot_inductor_torchbench, shard: 2, num_shards: 2, runner: amz2023.linux.g5.4xlarge.nvidia.gpu}, {config: inductor_cpp_wrapper_abi_compatible, shard: 1, num_shards: 1, runner: amz2023.linux.g5.4xlarge.nvidia.gpu}]} 2024-08-20T22:20:56.3801023Z 2024-08-20T22:20:56.3801185Z Is the current job unstable? False 2024-08-20T22:20:56.3801468Z 2024-08-20T22:20:56.3801828Z Is keep-going label set? False 2024-08-20T22:20:56.3802104Z 2024-08-20T22:20:56.3802230Z Renabled issues? 2024-08-20T22:20:56.3845871Z ##[group]Run echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2024-08-20T22:20:56.3846761Z echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2024-08-20T22:20:56.3855181Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:20:56.3855681Z env: 2024-08-20T22:20:56.3855977Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:20:56.3856445Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:20:56.3856936Z JOB_TIMEOUT: 240 2024-08-20T22:20:56.3857238Z ##[endgroup] 2024-08-20T22:20:56.3941986Z ##[group]Run set -x 2024-08-20T22:20:56.3942381Z set -x 2024-08-20T22:20:56.3942671Z  2024-08-20T22:20:56.3943021Z if [[ $TEST_CONFIG == 'multigpu' ]]; then 2024-08-20T22:20:56.3943555Z  TEST_COMMAND=.ci/pytorch/multigpu-test.sh 2024-08-20T22:20:56.3944115Z elif [[ $BUILD_ENVIRONMENT == *onnx* ]]; then 2024-08-20T22:20:56.3944621Z  TEST_COMMAND=.ci/onnx/test.sh 2024-08-20T22:20:56.3945026Z else 2024-08-20T22:20:56.3945360Z  TEST_COMMAND=.ci/pytorch/test.sh 2024-08-20T22:20:56.3945794Z fi 2024-08-20T22:20:56.3946066Z  2024-08-20T22:20:56.3946536Z # detached container should get cleaned up by teardown_ec2_linux 2024-08-20T22:20:56.3947294Z # TODO: Stop building test binaries as part of the build phase 2024-08-20T22:20:56.3947976Z # Used for GPU_FLAG since that doesn't play nice 2024-08-20T22:20:56.3948598Z # shellcheck disable=SC2086,SC2090 2024-08-20T22:20:56.3949069Z container_name=$(docker run \ 2024-08-20T22:20:56.3949485Z  ${GPU_FLAG:-} \ 2024-08-20T22:20:56.3949855Z  -e BUILD_ENVIRONMENT \ 2024-08-20T22:20:56.3950254Z  -e PR_NUMBER \ 2024-08-20T22:20:56.3950607Z  -e GITHUB_ACTIONS \ 2024-08-20T22:20:56.3951003Z  -e GITHUB_REPOSITORY \ 2024-08-20T22:20:56.3951409Z  -e GITHUB_WORKFLOW \ 2024-08-20T22:20:56.3951795Z  -e GITHUB_JOB \ 2024-08-20T22:20:56.3952146Z  -e GITHUB_RUN_ID \ 2024-08-20T22:20:56.3952533Z  -e GITHUB_RUN_NUMBER \ 2024-08-20T22:20:56.3952941Z  -e GITHUB_RUN_ATTEMPT \ 2024-08-20T22:20:56.3953342Z  -e JOB_ID \ 2024-08-20T22:20:56.3953676Z  -e JOB_NAME \ 2024-08-20T22:20:56.3954020Z  -e BASE_SHA \ 2024-08-20T22:20:56.3954368Z  -e BRANCH \ 2024-08-20T22:20:56.3954697Z  -e SHA1 \ 2024-08-20T22:20:56.3955044Z  -e AWS_DEFAULT_REGION \ 2024-08-20T22:20:56.3955444Z  -e IN_WHEEL_TEST \ 2024-08-20T22:20:56.3955830Z  -e SHARD_NUMBER \ 2024-08-20T22:20:56.3956193Z  -e TEST_CONFIG \ 2024-08-20T22:20:56.3956562Z  -e NUM_TEST_SHARDS \ 2024-08-20T22:20:56.3956964Z  -e REENABLED_ISSUES \ 2024-08-20T22:20:56.3957373Z  -e CONTINUE_THROUGH_ERROR \ 2024-08-20T22:20:56.3957796Z  -e VERBOSE_TEST_LOGS \ 2024-08-20T22:20:56.3958200Z  -e TEST_SHOWLOCALS \ 2024-08-20T22:20:56.3958619Z  -e NO_TEST_TIMEOUT \ 2024-08-20T22:20:56.3959021Z  -e NO_TD \ 2024-08-20T22:20:56.3959353Z  -e TD_DISTRIBUTED \ 2024-08-20T22:20:56.3959730Z  -e PR_LABELS \ 2024-08-20T22:20:56.3960139Z  -e MAX_JOBS="$(nproc --ignore=2)" \ 2024-08-20T22:20:56.3960598Z  -e SCCACHE_BUCKET \ 2024-08-20T22:20:56.3960998Z  -e SCCACHE_S3_KEY_PREFIX \ 2024-08-20T22:20:56.3961408Z  -e XLA_CUDA \ 2024-08-20T22:20:56.3961814Z  -e XLA_CLANG_CACHE_S3_BUCKET_NAME \ 2024-08-20T22:20:56.3962321Z  -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK \ 2024-08-20T22:20:56.3962852Z  -e PYTORCH_TEST_RERUN_DISABLED_TESTS \ 2024-08-20T22:20:56.3963371Z  -e SKIP_SCCACHE_INITIALIZATION=1 \ 2024-08-20T22:20:56.3963850Z  -e HUGGING_FACE_HUB_TOKEN \ 2024-08-20T22:20:56.3964302Z  -e SCRIBE_GRAPHQL_ACCESS_TOKEN \ 2024-08-20T22:20:56.3964746Z  -e DASHBOARD_TAG \ 2024-08-20T22:20:56.3965379Z  --env-file="/tmp/github_env_${GITHUB_RUN_ID}" \ 2024-08-20T22:20:56.3965940Z  --security-opt seccomp=unconfined \ 2024-08-20T22:20:56.3966403Z  --cap-add=SYS_PTRACE \ 2024-08-20T22:20:56.3966797Z  --ipc=host \ 2024-08-20T22:20:56.3967159Z  --shm-size="${SHM_SIZE}" \ 2024-08-20T22:20:56.3967556Z  --tty \ 2024-08-20T22:20:56.3967863Z  --detach \ 2024-08-20T22:20:56.3968351Z  --name="${container_name}" \ 2024-08-20T22:20:56.3968821Z  --user jenkins \ 2024-08-20T22:20:56.3969319Z  -v "${GITHUB_WORKSPACE}:/var/lib/jenkins/workspace" \ 2024-08-20T22:20:56.3969876Z  -w /var/lib/jenkins/workspace \ 2024-08-20T22:20:56.3970315Z  "${DOCKER_IMAGE}" 2024-08-20T22:20:56.3970664Z ) 2024-08-20T22:20:56.3971069Z # Propagate download.pytorch.org IP to container 2024-08-20T22:20:56.3972053Z grep download.pytorch.org /etc/hosts | docker exec -i "${container_name}" sudo bash -c "/bin/cat >> /etc/hosts" 2024-08-20T22:20:56.3973034Z echo "DOCKER_CONTAINER_ID=${container_name}" >> "${GITHUB_ENV}" 2024-08-20T22:20:56.3973958Z docker exec -t "${container_name}" sh -c "pip install $(echo dist/*.whl)[opt-einsum] && ${TEST_COMMAND}" 2024-08-20T22:20:56.3982318Z shell: /usr/bin/bash -e {0} 2024-08-20T22:20:56.3982660Z env: 2024-08-20T22:20:56.3982929Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:20:56.3983384Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:20:56.3983981Z BUILD_ENVIRONMENT: linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-08-20T22:20:56.3984475Z PR_NUMBER: 2024-08-20T22:20:56.3984801Z GITHUB_REPOSITORY: pytorch/pytorch 2024-08-20T22:20:56.3985213Z GITHUB_WORKFLOW: inductor 2024-08-20T22:20:56.3985558Z GITHUB_JOB: test 2024-08-20T22:20:56.3985865Z GITHUB_RUN_ID: 10479310725 2024-08-20T22:20:56.3986222Z GITHUB_RUN_NUMBER: 88082 2024-08-20T22:20:56.3986567Z GITHUB_RUN_ATTEMPT: 1 2024-08-20T22:20:56.3986898Z JOB_ID: 29026530123 2024-08-20T22:20:56.3987561Z JOB_NAME: cuda12.1-py3.10-gcc9-sm86 / test (aot_inductor_timm, 1, 2, amz2023.linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:20:56.3988294Z BRANCH: 2024-08-20T22:20:56.3988634Z SHA1: 40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:20:56.3989157Z BASE_SHA: 40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:20:56.3989628Z TEST_CONFIG: aot_inductor_timm 2024-08-20T22:20:56.3990008Z SHARD_NUMBER: 1 2024-08-20T22:20:56.3990314Z NUM_TEST_SHARDS: 2 2024-08-20T22:20:56.3990630Z REENABLED_ISSUES: 2024-08-20T22:20:56.3990955Z CONTINUE_THROUGH_ERROR: False 2024-08-20T22:20:56.3991337Z VERBOSE_TEST_LOGS: False 2024-08-20T22:20:56.3991699Z TEST_SHOWLOCALS: False 2024-08-20T22:20:56.3992031Z NO_TEST_TIMEOUT: False 2024-08-20T22:20:56.3992362Z NO_TD: False 2024-08-20T22:20:56.3992661Z TD_DISTRIBUTED: False 2024-08-20T22:20:56.3993076Z SCCACHE_BUCKET: ossci-compiler-cache-circleci-v2 2024-08-20T22:20:56.3993557Z SCCACHE_S3_KEY_PREFIX: inductor 2024-08-20T22:20:56.3993941Z SHM_SIZE: 2g 2024-08-20T22:20:56.3995027Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:20:56.3996184Z XLA_CUDA: 2024-08-20T22:20:56.3996653Z XLA_CLANG_CACHE_S3_BUCKET_NAME: ossci-compiler-clang-cache-circleci-xla 2024-08-20T22:20:56.3997260Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK: 0 2024-08-20T22:20:56.3997698Z PYTORCH_TEST_RERUN_DISABLED_TESTS: 0 2024-08-20T22:20:56.3998107Z DASHBOARD_TAG: 2024-08-20T22:20:56.3998642Z HUGGING_FACE_HUB_TOKEN: *** 2024-08-20T22:20:56.3999042Z SCRIBE_GRAPHQL_ACCESS_TOKEN: 2024-08-20T22:20:56.3999416Z ##[endgroup] 2024-08-20T22:20:56.4027034Z + [[ aot_inductor_timm == \m\u\l\t\i\g\p\u ]] 2024-08-20T22:20:56.4027785Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *onnx* ]] 2024-08-20T22:20:56.4028311Z + TEST_COMMAND=.ci/pytorch/test.sh 2024-08-20T22:20:56.4036392Z +++ nproc --ignore=2 2024-08-20T22:20:56.4055593Z ++ docker run --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all -e BUILD_ENVIRONMENT -e PR_NUMBER -e GITHUB_ACTIONS -e GITHUB_REPOSITORY -e GITHUB_WORKFLOW -e GITHUB_JOB -e GITHUB_RUN_ID -e GITHUB_RUN_NUMBER -e GITHUB_RUN_ATTEMPT -e JOB_ID -e JOB_NAME -e BASE_SHA -e BRANCH -e SHA1 -e AWS_DEFAULT_REGION -e IN_WHEEL_TEST -e SHARD_NUMBER -e TEST_CONFIG -e NUM_TEST_SHARDS -e REENABLED_ISSUES -e CONTINUE_THROUGH_ERROR -e VERBOSE_TEST_LOGS -e TEST_SHOWLOCALS -e NO_TEST_TIMEOUT -e NO_TD -e TD_DISTRIBUTED -e PR_LABELS -e MAX_JOBS=14 -e SCCACHE_BUCKET -e SCCACHE_S3_KEY_PREFIX -e XLA_CUDA -e XLA_CLANG_CACHE_S3_BUCKET_NAME -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK -e PYTORCH_TEST_RERUN_DISABLED_TESTS -e SKIP_SCCACHE_INITIALIZATION=1 -e HUGGING_FACE_HUB_TOKEN -e SCRIBE_GRAPHQL_ACCESS_TOKEN -e DASHBOARD_TAG --env-file=/tmp/github_env_10479310725 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --ipc=host --shm-size=2g --tty --detach --name= --user jenkins -v /home/ec2-user/actions-runner/_work/pytorch/pytorch:/var/lib/jenkins/workspace -w /var/lib/jenkins/workspace 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:21:07.8629300Z + container_name=3d143751037c82fb8ec22be7895042a7b3d28eeb9e9acadd73b1cae4487c9d2c 2024-08-20T22:21:07.8635547Z + grep download.pytorch.org /etc/hosts 2024-08-20T22:21:07.8638198Z + docker exec -i 3d143751037c82fb8ec22be7895042a7b3d28eeb9e9acadd73b1cae4487c9d2c sudo bash -c '/bin/cat >> /etc/hosts' 2024-08-20T22:21:08.0495131Z + echo DOCKER_CONTAINER_ID=3d143751037c82fb8ec22be7895042a7b3d28eeb9e9acadd73b1cae4487c9d2c 2024-08-20T22:21:08.0501845Z ++ echo dist/torch-2.5.0a0+git40ec5f6-cp310-cp310-linux_x86_64.whl 2024-08-20T22:21:08.0504976Z + docker exec -t 3d143751037c82fb8ec22be7895042a7b3d28eeb9e9acadd73b1cae4487c9d2c sh -c 'pip install dist/torch-2.5.0a0+git40ec5f6-cp310-cp310-linux_x86_64.whl[opt-einsum] && .ci/pytorch/test.sh' 2024-08-20T22:21:08.4599811Z Processing ./dist/torch-2.5.0a0+git40ec5f6-cp310-cp310-linux_x86_64.whl (from torch==2.5.0a0+git40ec5f6) 2024-08-20T22:21:08.7872646Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (3.13.1) 2024-08-20T22:21:08.7875865Z Requirement already satisfied: typing-extensions>=4.8.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (4.12.2) 2024-08-20T22:21:08.7878980Z Requirement already satisfied: networkx in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (2.8.8) 2024-08-20T22:21:08.7881976Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (3.1.4) 2024-08-20T22:21:08.7885874Z Requirement already satisfied: fsspec in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (2024.6.1) 2024-08-20T22:21:08.7892748Z Requirement already satisfied: sympy==1.13.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (1.13.1) 2024-08-20T22:21:08.7910699Z Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from sympy==1.13.1->torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (1.3.0) 2024-08-20T22:21:08.7925992Z Requirement already satisfied: opt-einsum>=3.3 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (3.3.0) 2024-08-20T22:21:08.7945903Z Requirement already satisfied: numpy>=1.7 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from opt-einsum>=3.3->torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (1.22.4) 2024-08-20T22:21:08.8340744Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from jinja2->torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (2.1.5) 2024-08-20T22:21:09.4154106Z Installing collected packages: torch 2024-08-20T22:21:19.2672449Z ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 2024-08-20T22:21:19.2673898Z timm 1.0.9.dev0 requires torchvision, which is not installed. 2024-08-20T22:21:19.2674958Z Successfully installed torch-2.5.0a0+git40ec5f6 2024-08-20T22:21:19.3488879Z + export TERM=vt100 2024-08-20T22:21:19.3489342Z + TERM=vt100 2024-08-20T22:21:19.3491218Z ++ dirname .ci/pytorch/test.sh 2024-08-20T22:21:19.3503519Z + source .ci/pytorch/common.sh 2024-08-20T22:21:19.3507602Z +++ dirname .ci/pytorch/common.sh 2024-08-20T22:21:19.3517486Z ++ source .ci/pytorch/common_utils.sh 2024-08-20T22:21:19.3519525Z +++ declare -f -t trap_add 2024-08-20T22:21:19.3525205Z ++ set -ex 2024-08-20T22:21:19.3525776Z ++ [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *rocm* ]] 2024-08-20T22:21:19.3526390Z ++ BUILD_TEST_LIBTORCH=0 2024-08-20T22:21:19.3526925Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *rocm* ]] 2024-08-20T22:21:19.3530189Z ++ stat -c %u /var/lib/jenkins/workspace 2024-08-20T22:21:19.3550297Z + WORKSPACE_ORIGINAL_OWNER_ID=1000 2024-08-20T22:21:19.3550768Z + trap_add cleanup_workspace EXIT 2024-08-20T22:21:19.3551182Z + trap_add_cmd=cleanup_workspace 2024-08-20T22:21:19.3556056Z + shift 2024-08-20T22:21:19.3556440Z + for trap_add_name in "$@" 2024-08-20T22:21:19.3559012Z +++ trap -p EXIT 2024-08-20T22:21:19.3561770Z ++ eval 'extract_trap_cmd ' 2024-08-20T22:21:19.3562212Z +++ extract_trap_cmd 2024-08-20T22:21:19.3562606Z +++ printf '%s\n' '' 2024-08-20T22:21:19.3563047Z ++ printf '%s\n' cleanup_workspace 2024-08-20T22:21:19.3566030Z + trap -- ' 2024-08-20T22:21:19.3566497Z cleanup_workspace' EXIT 2024-08-20T22:21:19.3567161Z + sudo chown -R jenkins /var/lib/jenkins/workspace 2024-08-20T22:21:20.0741843Z + git config --global --add safe.directory /var/lib/jenkins/workspace 2024-08-20T22:21:20.0764396Z + echo 'Environment variables:' 2024-08-20T22:21:20.0764944Z Environment variables: 2024-08-20T22:21:20.0765364Z + env 2024-08-20T22:21:20.0777053Z INSTALLED_DB=yes 2024-08-20T22:21:20.0777817Z NV_LIBCUBLAS_VERSION=12.1.3.1-1 2024-08-20T22:21:20.0778378Z NVIDIA_VISIBLE_DEVICES=all 2024-08-20T22:21:20.0778858Z NV_NVML_DEV_VERSION=12.1.105-1 2024-08-20T22:21:20.0779513Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-20T22:21:20.0780103Z CONTINUE_THROUGH_ERROR=False 2024-08-20T22:21:20.0780618Z NV_LIBNCCL_DEV_PACKAGE=libnccl-dev=2.17.1-1+cuda12.1 2024-08-20T22:21:20.0781144Z NV_LIBNCCL_DEV_PACKAGE_VERSION=2.17.1-1 2024-08-20T22:21:20.0781731Z BUILD_ENVIRONMENT=linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-08-20T22:21:20.0782236Z HOSTNAME=3d143751037c 2024-08-20T22:21:20.0783325Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_346f6232-5a79-42c1-97f4-298bc135688e 2024-08-20T22:21:20.0784430Z GITHUB_ACTION=__self 2024-08-20T22:21:20.0784882Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2024-08-20T22:21:20.0789357Z NVIDIA_REQUIRE_CUDA=cuda>=12.1 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 brand=tesla,driver>=525,driver<526 brand=unknown,driver>=525,driver<526 brand=nvidia,driver>=525,driver<526 brand=nvidiartx,driver>=525,driver<526 brand=geforce,driver>=525,driver<526 brand=geforcertx,driver>=525,driver<526 brand=quadro,driver>=525,driver<526 brand=quadrortx,driver>=525,driver<526 brand=titan,driver>=525,driver<526 brand=titanrtx,driver>=525,driver<526 2024-08-20T22:21:20.0793390Z NV_LIBCUBLAS_DEV_PACKAGE=libcublas-dev-12-1=12.1.3.1-1 2024-08-20T22:21:20.0793914Z NV_NVTX_VERSION=12.1.105-1 2024-08-20T22:21:20.0794537Z GITHUB_RUN_NUMBER=88082 2024-08-20T22:21:20.0794896Z TEST_CONFIG=aot_inductor_timm 2024-08-20T22:21:20.0795353Z GITHUB_REPOSITORY_OWNER_ID=21003710 2024-08-20T22:21:20.0795869Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2024-08-20T22:21:20.0796351Z NV_CUDA_CUDART_DEV_VERSION=12.1.105-1 2024-08-20T22:21:20.0796817Z NV_LIBCUSPARSE_VERSION=12.1.0.106-1 2024-08-20T22:21:20.0797234Z SCRIBE_GRAPHQL_ACCESS_TOKEN= 2024-08-20T22:21:20.0797786Z NV_LIBNPP_VERSION=12.1.0.40-1 2024-08-20T22:21:20.0798255Z GITHUB_TRIGGERING_ACTOR=pytorch-bot[bot] 2024-08-20T22:21:20.0798763Z CMAKE_CUDA_COMPILER_LAUNCHER=/opt/cache/bin/sccache 2024-08-20T22:21:20.0799230Z GITHUB_REF_TYPE=tag 2024-08-20T22:21:20.0799566Z TORCH_CUDA_ARCH_LIST=Maxwell 2024-08-20T22:21:20.0799953Z NCCL_VERSION=2.17.1-1 2024-08-20T22:21:20.0800360Z BASE_SHA=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:21:20.0800813Z XLA_CUDA= 2024-08-20T22:21:20.0801328Z HUGGING_FACE_HUB_TOKEN=*** 2024-08-20T22:21:20.0803471Z *** 2024-08-20T22:21:20.0803778Z CARGO_NET_GIT_FETCH_WITH_CLI=true 2024-08-20T22:21:20.0804183Z GITHUB_REPOSITORY_ID=65600975 2024-08-20T22:21:20.0804554Z GITHUB_ACTIONS=true 2024-08-20T22:21:20.0804900Z NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:21:20.0805479Z NV_NVPROF_DEV_PACKAGE=cuda-nvprof-12-1=12.1.105-1 2024-08-20T22:21:20.0806021Z NV_LIBNPP_PACKAGE=libnpp-12-1=12.1.0.40-1 2024-08-20T22:21:20.0806505Z SHA1=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:21:20.0807040Z NV_LIBNCCL_DEV_PACKAGE_NAME=libnccl-dev 2024-08-20T22:21:20.0807535Z GITHUB_SHA=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:21:20.0808331Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/inductor.yml@refs/tags/ciflow/inductor/133712 2024-08-20T22:21:20.0809227Z UCC_HOME=/usr 2024-08-20T22:21:20.0809568Z NV_LIBCUBLAS_DEV_VERSION=12.1.3.1-1 2024-08-20T22:21:20.0809968Z VERBOSE_TEST_LOGS=False 2024-08-20T22:21:20.0810303Z NVIDIA_PRODUCT_NAME=CUDA 2024-08-20T22:21:20.0810771Z NV_LIBCUBLAS_DEV_PACKAGE_NAME=libcublas-dev-12-1 2024-08-20T22:21:20.0811282Z GITHUB_REF=refs/tags/ciflow/inductor/133712 2024-08-20T22:21:20.0811841Z NV_CUDA_CUDART_VERSION=12.1.105-1 2024-08-20T22:21:20.0812225Z SHARD_NUMBER=1 2024-08-20T22:21:20.0812531Z GITHUB_REF_PROTECTED=false 2024-08-20T22:21:20.0812882Z HOME=/var/lib/jenkins 2024-08-20T22:21:20.0813239Z GITHUB_API_URL=https://api.github.com 2024-08-20T22:21:20.0813679Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2024-08-20T22:21:20.0814160Z UCX_COMMIT=7bb2722ff2187a0cad557ae4a6afa090569f83fb 2024-08-20T22:21:20.0814647Z SCCACHE_S3_KEY_PREFIX=inductor 2024-08-20T22:21:20.0815007Z CUDA_VERSION=12.1.1 2024-08-20T22:21:20.0815484Z NV_LIBCUBLAS_PACKAGE=libcublas-12-1=12.1.3.1-1 2024-08-20T22:21:20.0815922Z NUM_TEST_SHARDS=2 2024-08-20T22:21:20.0816213Z UCX_HOME=/usr 2024-08-20T22:21:20.0816737Z NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE=cuda-nsight-compute-12-1=12.1.1-1 2024-08-20T22:21:20.0817824Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_346f6232-5a79-42c1-97f4-298bc135688e 2024-08-20T22:21:20.0819104Z JOB_NAME=cuda12.1-py3.10-gcc9-sm86 / test (aot_inductor_timm, 1, 2, amz2023.linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:21:20.0820346Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_346f6232-5a79-42c1-97f4-298bc135688e 2024-08-20T22:21:20.0821461Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2024-08-20T22:21:20.0822123Z GITHUB_EVENT_NAME=push 2024-08-20T22:21:20.0822461Z DASHBOARD_TAG= 2024-08-20T22:21:20.0822765Z GITHUB_RUN_ID=10479310725 2024-08-20T22:21:20.0823221Z NV_LIBNPP_DEV_PACKAGE=libnpp-dev-12-1=12.1.0.40-1 2024-08-20T22:21:20.0823766Z NV_LIBCUBLAS_PACKAGE_NAME=libcublas-12-1 2024-08-20T22:21:20.0824766Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_346f6232-5a79-42c1-97f4-298bc135688e 2024-08-20T22:21:20.0825728Z GITHUB_ACTOR=pytorch-bot[bot] 2024-08-20T22:21:20.0826134Z NV_LIBNPP_DEV_VERSION=12.1.0.40-1 2024-08-20T22:21:20.0826628Z PR_NUMBER= 2024-08-20T22:21:20.0826909Z GITHUB_RUN_ATTEMPT=1 2024-08-20T22:21:20.0827244Z ANACONDA_PYTHON_VERSION=3.10 2024-08-20T22:21:20.0827696Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2024-08-20T22:21:20.0828164Z TERM=vt100 2024-08-20T22:21:20.0828509Z NV_LIBCUSPARSE_DEV_VERSION=12.1.0.106-1 2024-08-20T22:21:20.0828915Z INSTALLED_VISION=yes 2024-08-20T22:21:20.0829227Z BRANCH= 2024-08-20T22:21:20.0829512Z OPENSSL_ROOT_DIR=/opt/openssl 2024-08-20T22:21:20.0830412Z LIBRARY_PATH=/usr/local/cuda/lib64/stubs 2024-08-20T22:21:20.0830873Z CUDA_PATH=/usr/local/cuda 2024-08-20T22:21:20.0831682Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2024-08-20T22:21:20.0832449Z GITHUB_SERVER_URL=https://github.com 2024-08-20T22:21:20.0832936Z UCC_COMMIT=20eae37090a4ce1b32bcce6144ccad0b49943e0b 2024-08-20T22:21:20.0833421Z REENABLED_ISSUES= 2024-08-20T22:21:20.0833727Z SHLVL=1 2024-08-20T22:21:20.0834007Z MAX_JOBS=14 2024-08-20T22:21:20.0834329Z NV_CUDA_LIB_VERSION=12.1.1-1 2024-08-20T22:21:20.0834702Z NVARCH=x86_64 2024-08-20T22:21:20.0835013Z GITHUB_ACTOR_ID=54816060 2024-08-20T22:21:20.0835525Z GITHUB_WORKFLOW_SHA=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:21:20.0836070Z GITHUB_REF_NAME=ciflow/inductor/133712 2024-08-20T22:21:20.0836579Z NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-1 2024-08-20T22:21:20.0837255Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2024-08-20T22:21:20.0837840Z GITHUB_JOB=test 2024-08-20T22:21:20.0838261Z NV_LIBNCCL_PACKAGE=libnccl2=2.17.1-1+cuda12.1 2024-08-20T22:21:20.0838830Z LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64 2024-08-20T22:21:20.0839354Z NO_TEST_TIMEOUT=False 2024-08-20T22:21:20.0839689Z TD_DISTRIBUTED=False 2024-08-20T22:21:20.0840084Z NV_CUDA_NSIGHT_COMPUTE_VERSION=12.1.1-1 2024-08-20T22:21:20.0840529Z GITHUB_REPOSITORY=pytorch/pytorch 2024-08-20T22:21:20.0840957Z NV_NVPROF_VERSION=12.1.105-1 2024-08-20T22:21:20.0841324Z GITHUB_RETENTION_DAYS=90 2024-08-20T22:21:20.0841692Z OPENSSL_DIR=/opt/openssl 2024-08-20T22:21:20.0842052Z GITHUB_ACTION_REPOSITORY= 2024-08-20T22:21:20.0843113Z PATH=/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-08-20T22:21:20.0844204Z GITHUB_BASE_REF= 2024-08-20T22:21:20.0844547Z NV_LIBNCCL_PACKAGE_NAME=libnccl2 2024-08-20T22:21:20.0844927Z CI=true 2024-08-20T22:21:20.0845254Z NV_LIBNCCL_PACKAGE_VERSION=2.17.1-1 2024-08-20T22:21:20.0845680Z GITHUB_REPOSITORY_OWNER=pytorch 2024-08-20T22:21:20.0846064Z JOB_ID=29026530123 2024-08-20T22:21:20.0846391Z INSTALLED_PROTOBUF=yes 2024-08-20T22:21:20.0846731Z GITHUB_HEAD_REF= 2024-08-20T22:21:20.0847044Z GITHUB_ACTION_REF= 2024-08-20T22:21:20.0847493Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2024-08-20T22:21:20.0847962Z TEST_SHOWLOCALS=False 2024-08-20T22:21:20.0848311Z GITHUB_WORKFLOW=inductor 2024-08-20T22:21:20.0848679Z DEBIAN_FRONTEND=noninteractive 2024-08-20T22:21:20.0849611Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_346f6232-5a79-42c1-97f4-298bc135688e 2024-08-20T22:21:20.0850446Z NO_TD=False 2024-08-20T22:21:20.0850769Z SKIP_SCCACHE_INITIALIZATION=1 2024-08-20T22:21:20.0851141Z _=/usr/bin/env 2024-08-20T22:21:20.0851708Z ++ python -c 'import site; print(site.getsitepackages()[0])' 2024-08-20T22:21:20.1014311Z + TORCH_INSTALL_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch 2024-08-20T22:21:20.1015523Z + TORCH_BIN_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/bin 2024-08-20T22:21:20.1016506Z + TORCH_LIB_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/lib 2024-08-20T22:21:20.1017445Z + TORCH_TEST_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/test 2024-08-20T22:21:20.1018062Z + BUILD_DIR=build 2024-08-20T22:21:20.1018395Z + BUILD_RENAMED_DIR=build_renamed 2024-08-20T22:21:20.1018794Z + BUILD_BIN_DIR=build/bin 2024-08-20T22:21:20.1019142Z + SHARD_NUMBER=1 2024-08-20T22:21:20.1019635Z + NUM_TEST_SHARDS=2 2024-08-20T22:21:20.1019962Z + export VALGRIND=ON 2024-08-20T22:21:20.1020287Z + VALGRIND=ON 2024-08-20T22:21:20.1020913Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *clang9* ]] 2024-08-20T22:21:20.1021448Z + [[ 0 == \1 ]] 2024-08-20T22:21:20.1021746Z + [[ False == \1 ]] 2024-08-20T22:21:20.1022245Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *bazel* ]] 2024-08-20T22:21:20.1022771Z ++ realpath build/custom_test_artifacts 2024-08-20T22:21:20.1035265Z + CUSTOM_TEST_ARTIFACT_BUILD_DIR=/var/lib/jenkins/workspace/build/custom_test_artifacts 2024-08-20T22:21:20.1036015Z + [[ -n '' ]] 2024-08-20T22:21:20.1036381Z + echo 'Environment variables' 2024-08-20T22:21:20.1036767Z Environment variables 2024-08-20T22:21:20.1037086Z + env 2024-08-20T22:21:20.1045789Z INSTALLED_DB=yes 2024-08-20T22:21:20.1046270Z NV_LIBCUBLAS_VERSION=12.1.3.1-1 2024-08-20T22:21:20.1049205Z NVIDIA_VISIBLE_DEVICES=all 2024-08-20T22:21:20.1049968Z NV_NVML_DEV_VERSION=12.1.105-1 2024-08-20T22:21:20.1050810Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-20T22:21:20.1051811Z CONTINUE_THROUGH_ERROR=False 2024-08-20T22:21:20.1052496Z NV_LIBNCCL_DEV_PACKAGE=libnccl-dev=2.17.1-1+cuda12.1 2024-08-20T22:21:20.1053044Z NV_LIBNCCL_DEV_PACKAGE_VERSION=2.17.1-1 2024-08-20T22:21:20.1053716Z BUILD_ENVIRONMENT=linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-08-20T22:21:20.1054210Z HOSTNAME=3d143751037c 2024-08-20T22:21:20.1055076Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_346f6232-5a79-42c1-97f4-298bc135688e 2024-08-20T22:21:20.1055940Z GITHUB_ACTION=__self 2024-08-20T22:21:20.1056375Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2024-08-20T22:21:20.1061010Z NVIDIA_REQUIRE_CUDA=cuda>=12.1 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 brand=tesla,driver>=525,driver<526 brand=unknown,driver>=525,driver<526 brand=nvidia,driver>=525,driver<526 brand=nvidiartx,driver>=525,driver<526 brand=geforce,driver>=525,driver<526 brand=geforcertx,driver>=525,driver<526 brand=quadro,driver>=525,driver<526 brand=quadrortx,driver>=525,driver<526 brand=titan,driver>=525,driver<526 brand=titanrtx,driver>=525,driver<526 2024-08-20T22:21:20.1065123Z NV_LIBCUBLAS_DEV_PACKAGE=libcublas-dev-12-1=12.1.3.1-1 2024-08-20T22:21:20.1065694Z NV_NVTX_VERSION=12.1.105-1 2024-08-20T22:21:20.1066035Z GITHUB_RUN_NUMBER=88082 2024-08-20T22:21:20.1066384Z TEST_CONFIG=aot_inductor_timm 2024-08-20T22:21:20.1066771Z GITHUB_REPOSITORY_OWNER_ID=21003710 2024-08-20T22:21:20.1067254Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2024-08-20T22:21:20.1067713Z NV_CUDA_CUDART_DEV_VERSION=12.1.105-1 2024-08-20T22:21:20.1068158Z NV_LIBCUSPARSE_VERSION=12.1.0.106-1 2024-08-20T22:21:20.1068569Z SCRIBE_GRAPHQL_ACCESS_TOKEN= 2024-08-20T22:21:20.1068970Z NV_LIBNPP_VERSION=12.1.0.40-1 2024-08-20T22:21:20.1069412Z GITHUB_TRIGGERING_ACTOR=pytorch-bot[bot] 2024-08-20T22:21:20.1069901Z CMAKE_CUDA_COMPILER_LAUNCHER=/opt/cache/bin/sccache 2024-08-20T22:21:20.1070364Z GITHUB_REF_TYPE=tag 2024-08-20T22:21:20.1070683Z TORCH_CUDA_ARCH_LIST=Maxwell 2024-08-20T22:21:20.1071054Z NCCL_VERSION=2.17.1-1 2024-08-20T22:21:20.1071442Z BASE_SHA=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:21:20.1071890Z XLA_CUDA= 2024-08-20T22:21:20.1072394Z HUGGING_FACE_HUB_TOKEN=*** 2024-08-20T22:21:20.1072781Z *** 2024-08-20T22:21:20.1073062Z CARGO_NET_GIT_FETCH_WITH_CLI=true 2024-08-20T22:21:20.1073464Z GITHUB_REPOSITORY_ID=65600975 2024-08-20T22:21:20.1073826Z GITHUB_ACTIONS=true 2024-08-20T22:21:20.1074154Z NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:21:20.1074655Z NV_NVPROF_DEV_PACKAGE=cuda-nvprof-12-1=12.1.105-1 2024-08-20T22:21:20.1075222Z NV_LIBNPP_PACKAGE=libnpp-12-1=12.1.0.40-1 2024-08-20T22:21:20.1075715Z SHA1=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:21:20.1077710Z NV_LIBNCCL_DEV_PACKAGE_NAME=libnccl-dev 2024-08-20T22:21:20.1078203Z GITHUB_SHA=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:21:20.1079004Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/inductor.yml@refs/tags/ciflow/inductor/133712 2024-08-20T22:21:20.1079723Z UCC_HOME=/usr 2024-08-20T22:21:20.1080071Z NV_LIBCUBLAS_DEV_VERSION=12.1.3.1-1 2024-08-20T22:21:20.1080469Z VERBOSE_TEST_LOGS=False 2024-08-20T22:21:20.1080937Z NVIDIA_PRODUCT_NAME=CUDA 2024-08-20T22:21:20.1081399Z NV_LIBCUBLAS_DEV_PACKAGE_NAME=libcublas-dev-12-1 2024-08-20T22:21:20.1081898Z GITHUB_REF=refs/tags/ciflow/inductor/133712 2024-08-20T22:21:20.1082372Z NV_CUDA_CUDART_VERSION=12.1.105-1 2024-08-20T22:21:20.1082753Z SHARD_NUMBER=1 2024-08-20T22:21:20.1083052Z GITHUB_REF_PROTECTED=false 2024-08-20T22:21:20.1083405Z HOME=/var/lib/jenkins 2024-08-20T22:21:20.1083773Z GITHUB_API_URL=https://api.github.com 2024-08-20T22:21:20.1084204Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2024-08-20T22:21:20.1084683Z UCX_COMMIT=7bb2722ff2187a0cad557ae4a6afa090569f83fb 2024-08-20T22:21:20.1085197Z SCCACHE_S3_KEY_PREFIX=inductor 2024-08-20T22:21:20.1085588Z CUDA_VERSION=12.1.1 2024-08-20T22:21:20.1086005Z NV_LIBCUBLAS_PACKAGE=libcublas-12-1=12.1.3.1-1 2024-08-20T22:21:20.1086444Z NUM_TEST_SHARDS=2 2024-08-20T22:21:20.1086744Z UCX_HOME=/usr 2024-08-20T22:21:20.1087267Z NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE=cuda-nsight-compute-12-1=12.1.1-1 2024-08-20T22:21:20.1088358Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_346f6232-5a79-42c1-97f4-298bc135688e 2024-08-20T22:21:20.1089625Z JOB_NAME=cuda12.1-py3.10-gcc9-sm86 / test (aot_inductor_timm, 1, 2, amz2023.linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:21:20.1090871Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_346f6232-5a79-42c1-97f4-298bc135688e 2024-08-20T22:21:20.1092122Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2024-08-20T22:21:20.1092778Z GITHUB_EVENT_NAME=push 2024-08-20T22:21:20.1093113Z DASHBOARD_TAG= 2024-08-20T22:21:20.1093417Z GITHUB_RUN_ID=10479310725 2024-08-20T22:21:20.1093883Z NV_LIBNPP_DEV_PACKAGE=libnpp-dev-12-1=12.1.0.40-1 2024-08-20T22:21:20.1094423Z NV_LIBCUBLAS_PACKAGE_NAME=libcublas-12-1 2024-08-20T22:21:20.1095442Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_346f6232-5a79-42c1-97f4-298bc135688e 2024-08-20T22:21:20.1096366Z GITHUB_ACTOR=pytorch-bot[bot] 2024-08-20T22:21:20.1096787Z NV_LIBNPP_DEV_VERSION=12.1.0.40-1 2024-08-20T22:21:20.1097162Z PR_NUMBER= 2024-08-20T22:21:20.1097444Z GITHUB_RUN_ATTEMPT=1 2024-08-20T22:21:20.1097762Z VALGRIND=ON 2024-08-20T22:21:20.1098052Z ANACONDA_PYTHON_VERSION=3.10 2024-08-20T22:21:20.1098502Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2024-08-20T22:21:20.1098964Z TERM=vt100 2024-08-20T22:21:20.1099305Z NV_LIBCUSPARSE_DEV_VERSION=12.1.0.106-1 2024-08-20T22:21:20.1099716Z INSTALLED_VISION=yes 2024-08-20T22:21:20.1100035Z BRANCH= 2024-08-20T22:21:20.1100326Z OPENSSL_ROOT_DIR=/opt/openssl 2024-08-20T22:21:20.1100731Z LIBRARY_PATH=/usr/local/cuda/lib64/stubs 2024-08-20T22:21:20.1101155Z CUDA_PATH=/usr/local/cuda 2024-08-20T22:21:20.1101935Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2024-08-20T22:21:20.1102704Z GITHUB_SERVER_URL=https://github.com 2024-08-20T22:21:20.1103192Z UCC_COMMIT=20eae37090a4ce1b32bcce6144ccad0b49943e0b 2024-08-20T22:21:20.1103668Z REENABLED_ISSUES= 2024-08-20T22:21:20.1103966Z SHLVL=1 2024-08-20T22:21:20.1104226Z MAX_JOBS=14 2024-08-20T22:21:20.1104535Z NV_CUDA_LIB_VERSION=12.1.1-1 2024-08-20T22:21:20.1104887Z NVARCH=x86_64 2024-08-20T22:21:20.1105183Z GITHUB_ACTOR_ID=54816060 2024-08-20T22:21:20.1105644Z GITHUB_WORKFLOW_SHA=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:21:20.1106178Z GITHUB_REF_NAME=ciflow/inductor/133712 2024-08-20T22:21:20.1106679Z NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-1 2024-08-20T22:21:20.1107356Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2024-08-20T22:21:20.1108092Z GITHUB_JOB=test 2024-08-20T22:21:20.1108499Z NV_LIBNCCL_PACKAGE=libnccl2=2.17.1-1+cuda12.1 2024-08-20T22:21:20.1109060Z LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64 2024-08-20T22:21:20.1109577Z NO_TEST_TIMEOUT=False 2024-08-20T22:21:20.1109902Z TD_DISTRIBUTED=False 2024-08-20T22:21:20.1110283Z NV_CUDA_NSIGHT_COMPUTE_VERSION=12.1.1-1 2024-08-20T22:21:20.1110725Z GITHUB_REPOSITORY=pytorch/pytorch 2024-08-20T22:21:20.1111301Z NV_NVPROF_VERSION=12.1.105-1 2024-08-20T22:21:20.1111668Z GITHUB_RETENTION_DAYS=90 2024-08-20T22:21:20.1112020Z OPENSSL_DIR=/opt/openssl 2024-08-20T22:21:20.1112373Z GITHUB_ACTION_REPOSITORY= 2024-08-20T22:21:20.1113440Z PATH=/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-08-20T22:21:20.1114516Z GITHUB_BASE_REF= 2024-08-20T22:21:20.1114840Z NV_LIBNCCL_PACKAGE_NAME=libnccl2 2024-08-20T22:21:20.1115215Z CI=true 2024-08-20T22:21:20.1115538Z NV_LIBNCCL_PACKAGE_VERSION=2.17.1-1 2024-08-20T22:21:20.1115955Z GITHUB_REPOSITORY_OWNER=pytorch 2024-08-20T22:21:20.1116335Z JOB_ID=29026530123 2024-08-20T22:21:20.1116648Z INSTALLED_PROTOBUF=yes 2024-08-20T22:21:20.1116974Z GITHUB_HEAD_REF= 2024-08-20T22:21:20.1117276Z GITHUB_ACTION_REF= 2024-08-20T22:21:20.1117722Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2024-08-20T22:21:20.1118199Z TEST_SHOWLOCALS=False 2024-08-20T22:21:20.1118538Z GITHUB_WORKFLOW=inductor 2024-08-20T22:21:20.1118893Z DEBIAN_FRONTEND=noninteractive 2024-08-20T22:21:20.1119819Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_346f6232-5a79-42c1-97f4-298bc135688e 2024-08-20T22:21:20.1120652Z NO_TD=False 2024-08-20T22:21:20.1120954Z SKIP_SCCACHE_INITIALIZATION=1 2024-08-20T22:21:20.1121325Z _=/usr/bin/env 2024-08-20T22:21:20.1121695Z + echo 'Testing pytorch' 2024-08-20T22:21:20.1122037Z Testing pytorch 2024-08-20T22:21:20.1122368Z + export LANG=C.UTF-8 2024-08-20T22:21:20.1122716Z + LANG=C.UTF-8 2024-08-20T22:21:20.1123005Z + PR_NUMBER= 2024-08-20T22:21:20.1123327Z + [[ aot_inductor_timm == \d\e\f\a\u\l\t ]] 2024-08-20T22:21:20.1123828Z + [[ aot_inductor_timm == \d\i\s\t\r\i\b\u\t\e\d ]] 2024-08-20T22:21:20.1124313Z + [[ aot_inductor_timm == \s\l\o\w ]] 2024-08-20T22:21:20.1124948Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *slow-gradcheck* ]] 2024-08-20T22:21:20.1125702Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *cuda* ]] 2024-08-20T22:21:20.1126265Z + export PYTORCH_TESTING_DEVICE_ONLY_FOR=cuda 2024-08-20T22:21:20.1126741Z + PYTORCH_TESTING_DEVICE_ONLY_FOR=cuda 2024-08-20T22:21:20.1127180Z + [[ aot_inductor_timm == *crossref* ]] 2024-08-20T22:21:20.1127749Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *rocm* ]] 2024-08-20T22:21:20.1128397Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *xpu* ]] 2024-08-20T22:21:20.1129057Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *-bazel-* ]] 2024-08-20T22:21:20.1129906Z + pip_install --user ninja==1.10.2 2024-08-20T22:21:20.1130487Z + pip install --progress-bar off --user ninja==1.10.2 2024-08-20T22:21:21.3354032Z Collecting ninja==1.10.2 2024-08-20T22:21:21.3557138Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl.metadata (5.0 kB) 2024-08-20T22:21:21.4114473Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl (108 kB) 2024-08-20T22:21:22.0179453Z Installing collected packages: ninja 2024-08-20T22:21:22.0258406Z  WARNING: The script ninja is installed in '/var/lib/jenkins/.local/bin' which is not on PATH. 2024-08-20T22:21:22.0259708Z Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. 2024-08-20T22:21:22.0801791Z Successfully installed ninja-1.10.2 2024-08-20T22:21:22.1584084Z + export PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-08-20T22:21:22.1586663Z + PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-08-20T22:21:22.1588261Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *aarch64* ]] 2024-08-20T22:21:22.1588766Z + install_tlparse 2024-08-20T22:21:22.1589162Z + pip_install --user tlparse==0.3.25 2024-08-20T22:21:22.1589908Z + pip install --progress-bar off --user tlparse==0.3.25 2024-08-20T22:21:22.5893589Z Collecting tlparse==0.3.25 2024-08-20T22:21:22.6073058Z Downloading tlparse-0.3.25-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (1.7 kB) 2024-08-20T22:21:22.6619092Z Downloading tlparse-0.3.25-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.2 MB) 2024-08-20T22:21:23.3128184Z Installing collected packages: tlparse 2024-08-20T22:21:23.3465247Z Successfully installed tlparse-0.3.25 2024-08-20T22:21:23.4262236Z ++ python -m site --user-base 2024-08-20T22:21:23.4509309Z + PATH=/var/lib/jenkins/.local/bin:/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-08-20T22:21:23.4511135Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *asan* ]] 2024-08-20T22:21:23.4511905Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *-debug* ]] 2024-08-20T22:21:23.4512602Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *-bazel-* ]] 2024-08-20T22:21:23.4513561Z + echo 'We are not in debug mode: linux-focal-cuda12.1-py3.10-gcc9-sm86. Expect the assertion to pass' 2024-08-20T22:21:23.4514724Z We are not in debug mode: linux-focal-cuda12.1-py3.10-gcc9-sm86. Expect the assertion to pass 2024-08-20T22:21:23.4515426Z + cd test 2024-08-20T22:21:23.4515959Z + python -c 'import torch; torch._C._crash_if_debug_asserts_fail(424242)' 2024-08-20T22:21:25.0785524Z + [[ aot_inductor_timm == \n\o\g\p\u\_\N\O\_\A\V\X\2 ]] 2024-08-20T22:21:25.0786218Z + [[ aot_inductor_timm == \n\o\g\p\u\_\A\V\X\5\1\2 ]] 2024-08-20T22:21:25.0789392Z + DYNAMO_BENCHMARK_FLAGS=() 2024-08-20T22:21:25.0790143Z + [[ aot_inductor_timm == *pr_time_benchmarks* ]] 2024-08-20T22:21:25.0790789Z + [[ aot_inductor_timm == *dynamo_eager* ]] 2024-08-20T22:21:25.0791339Z + [[ aot_inductor_timm == *aot_eager* ]] 2024-08-20T22:21:25.0791793Z + [[ aot_inductor_timm == *aot_inductor* ]] 2024-08-20T22:21:25.0792533Z + DYNAMO_BENCHMARK_FLAGS+=(--export-aot-inductor) 2024-08-20T22:21:25.0793038Z + [[ aot_inductor_timm == *dynamic* ]] 2024-08-20T22:21:25.0793461Z + [[ aot_inductor_timm == *cpu* ]] 2024-08-20T22:21:25.0793933Z + DYNAMO_BENCHMARK_FLAGS+=(--device cuda) 2024-08-20T22:21:25.0823006Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *libtorch* ]] 2024-08-20T22:21:25.0823790Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *-bazel-* ]] 2024-08-20T22:21:25.0826384Z + cd test 2024-08-20T22:21:25.0826942Z + python -c 'import torch; print(torch.__config__.show())' 2024-08-20T22:21:26.5755158Z PyTorch built with: 2024-08-20T22:21:26.5756322Z - GCC 9.4 2024-08-20T22:21:26.5757114Z - C++ Version: 201703 2024-08-20T22:21:26.5758055Z - Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications 2024-08-20T22:21:26.5759226Z - Intel(R) MKL-DNN v3.4.2 (Git Hash 1137e04ec0b5251ca2b4400a4fd3c667ce843d67) 2024-08-20T22:21:26.5759993Z - OpenMP 201511 (a.k.a. OpenMP 4.5) 2024-08-20T22:21:26.5760596Z - LAPACK is enabled (usually provided by MKL) 2024-08-20T22:21:26.5761086Z - NNPACK is enabled 2024-08-20T22:21:26.5761539Z - CPU capability usage: AVX2 2024-08-20T22:21:26.5761964Z - CUDA Runtime 12.1 2024-08-20T22:21:26.5762559Z - NVCC architecture flags: -gencode;arch=compute_86,code=sm_86 2024-08-20T22:21:26.5763235Z - CuDNN 90.1 (built against CUDA 12.4) 2024-08-20T22:21:26.5763709Z - Magma 2.6.1 2024-08-20T22:21:26.5771422Z - Build settings: BLAS_INFO=mkl, BUILD_TYPE=Release, CUDA_VERSION=12.1, CUDNN_VERSION=9.1.0, CXX_COMPILER=/opt/cache/bin/c++, CXX_FLAGS= -D_GLIBCXX_USE_CXX11_ABI=1 -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOROCTRACER -DLIBKINETO_NOXPUPTI=ON -DUSE_FBGEMM -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -O2 -fPIC -Wall -Wextra -Werror=return-type -Werror=non-virtual-dtor -Werror=bool-operation -Wnarrowing -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-unused-parameter -Wno-strict-overflow -Wno-strict-aliasing -Wno-stringop-overflow -Wsuggest-override -Wno-psabi -Wno-error=old-style-cast -Wno-missing-braces -fdiagnostics-color=always -faligned-new -Werror -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Wno-stringop-overflow, FORCE_FALLBACK_CUDA_MPI=1, LAPACK_INFO=mkl, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, PERF_WITH_AVX512=1, TORCH_VERSION=2.5.0, USE_CUDA=ON, USE_CUDNN=ON, USE_CUSPARSELT=ON, USE_EXCEPTION_PTR=1, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_GLOO=ON, USE_MKL=ON, USE_MKLDNN=ON, USE_MPI=ON, USE_NCCL=ON, USE_NNPACK=ON, USE_OPENMP=ON, USE_ROCM=OFF, USE_ROCM_KERNEL_ASSERT=OFF, 2024-08-20T22:21:26.5778542Z 2024-08-20T22:21:26.9020357Z + cd test 2024-08-20T22:21:26.9021137Z + python -c 'import torch; print(torch.__config__.parallel_info())' 2024-08-20T22:21:28.2497780Z ATen/Parallel: 2024-08-20T22:21:28.2498317Z at::get_num_threads() : 8 2024-08-20T22:21:28.2498754Z at::get_num_interop_threads() : 16 2024-08-20T22:21:28.2499208Z OpenMP 201511 (a.k.a. OpenMP 4.5) 2024-08-20T22:21:28.2499606Z omp_get_max_threads() : 8 2024-08-20T22:21:28.2500653Z Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications 2024-08-20T22:21:28.2501458Z mkl_get_max_threads() : 8 2024-08-20T22:21:28.2502089Z Intel(R) MKL-DNN v3.4.2 (Git Hash 1137e04ec0b5251ca2b4400a4fd3c667ce843d67) 2024-08-20T22:21:28.2502727Z std::thread::hardware_concurrency() : 16 2024-08-20T22:21:28.2503150Z Environment variables: 2024-08-20T22:21:28.2503498Z OMP_NUM_THREADS : [not set] 2024-08-20T22:21:28.2503890Z MKL_NUM_THREADS : [not set] 2024-08-20T22:21:28.2504263Z ATen parallel backend: OpenMP 2024-08-20T22:21:28.2504514Z 2024-08-20T22:21:28.5296618Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *aarch64* ]] 2024-08-20T22:21:28.5297249Z + [[ aot_inductor_timm == *backward* ]] 2024-08-20T22:21:28.5297728Z + [[ aot_inductor_timm == *xla* ]] 2024-08-20T22:21:28.5298148Z + [[ aot_inductor_timm == *executorch* ]] 2024-08-20T22:21:28.5298630Z + [[ aot_inductor_timm == \j\i\t\_\l\e\g\a\c\y ]] 2024-08-20T22:21:28.5299272Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *libtorch* ]] 2024-08-20T22:21:28.5299802Z + [[ aot_inductor_timm == distributed ]] 2024-08-20T22:21:28.5300284Z + [[ aot_inductor_timm == *inductor_distributed* ]] 2024-08-20T22:21:28.5300847Z + [[ aot_inductor_timm == *inductor-halide* ]] 2024-08-20T22:21:28.5301426Z + [[ aot_inductor_timm == *inductor-micro-benchmark* ]] 2024-08-20T22:21:28.5301935Z + [[ aot_inductor_timm == *huggingface* ]] 2024-08-20T22:21:28.5302379Z + [[ aot_inductor_timm == *timm* ]] 2024-08-20T22:21:28.5302772Z + install_torchvision 2024-08-20T22:21:28.5303108Z + local orig_preload 2024-08-20T22:21:28.5303420Z + local commit 2024-08-20T22:21:28.5303726Z ++ get_pinned_commit vision 2024-08-20T22:21:28.5304110Z ++ cat .github/ci_commit_pins/vision.txt 2024-08-20T22:21:28.5320344Z + commit=d23a6e1664d20707c11781299611436e1f0c104f 2024-08-20T22:21:28.5320811Z + orig_preload= 2024-08-20T22:21:28.5321175Z + '[' -n '' ']' 2024-08-20T22:21:28.5322014Z + pip_install --no-use-pep517 --user git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2024-08-20T22:21:28.5323458Z + pip install --progress-bar off --no-use-pep517 --user git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2024-08-20T22:21:28.8694444Z Collecting git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2024-08-20T22:21:28.8698881Z Cloning https://github.com/pytorch/vision.git (to revision d23a6e1664d20707c11781299611436e1f0c104f) to /tmp/pip-req-build-qtr2hulx 2024-08-20T22:21:28.8729077Z Running command git clone --filter=blob:none --quiet https://github.com/pytorch/vision.git /tmp/pip-req-build-qtr2hulx 2024-08-20T22:21:30.3747826Z Running command git rev-parse -q --verify 'sha^d23a6e1664d20707c11781299611436e1f0c104f' 2024-08-20T22:21:30.3772581Z Running command git fetch -q https://github.com/pytorch/vision.git d23a6e1664d20707c11781299611436e1f0c104f 2024-08-20T22:21:31.7053302Z Running command git checkout -q d23a6e1664d20707c11781299611436e1f0c104f 2024-08-20T22:21:32.0010575Z Resolved https://github.com/pytorch/vision.git to commit d23a6e1664d20707c11781299611436e1f0c104f 2024-08-20T22:21:34.4746597Z Preparing metadata (setup.py) ... [?25l- \ done 2024-08-20T22:21:34.4779035Z [?25hRequirement already satisfied: numpy in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (1.22.4) 2024-08-20T22:21:34.4783146Z Requirement already satisfied: torch in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (2.5.0a0+git40ec5f6) 2024-08-20T22:21:34.4787737Z Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (10.3.0) 2024-08-20T22:21:34.4859729Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (3.13.1) 2024-08-20T22:21:34.4863323Z Requirement already satisfied: typing-extensions>=4.8.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (4.12.2) 2024-08-20T22:21:34.4866836Z Requirement already satisfied: networkx in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (2.8.8) 2024-08-20T22:21:34.4870093Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (3.1.4) 2024-08-20T22:21:34.4873569Z Requirement already satisfied: fsspec in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (2024.6.1) 2024-08-20T22:21:34.4878695Z Requirement already satisfied: sympy==1.13.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (1.13.1) 2024-08-20T22:21:34.4892961Z Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from sympy==1.13.1->torch->torchvision==0.19.0a0+d23a6e1) (1.3.0) 2024-08-20T22:21:34.5366577Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from jinja2->torch->torchvision==0.19.0a0+d23a6e1) (2.1.5) 2024-08-20T22:21:34.5429450Z Building wheels for collected packages: torchvision 2024-08-20T22:22:50.2433289Z Building wheel for torchvision (setup.py) ... [?25l- \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | done 2024-08-20T22:22:50.2465903Z [?25h Created wheel for torchvision: filename=torchvision-0.19.0a0+d23a6e1-cp310-cp310-linux_x86_64.whl size=2115948 sha256=758faa146e2289ed899694931efaaf05b8b9c72e135dc934dcaa814b9e5679f7 2024-08-20T22:22:50.2468782Z Stored in directory: /var/lib/jenkins/.cache/pip/wheels/0e/56/35/02931e71eb23fd2b85591c7ec05b733ca7c8b328a2fd151f96 2024-08-20T22:22:50.2505674Z Successfully built torchvision 2024-08-20T22:22:50.7318994Z Installing collected packages: torchvision 2024-08-20T22:22:51.1450207Z Successfully installed torchvision-0.19.0a0+d23a6e1 2024-08-20T22:22:51.2870939Z + '[' -n '' ']' 2024-08-20T22:22:51.2871311Z + id=0 2024-08-20T22:22:51.2871665Z + test_dynamo_benchmark timm_models 0 2024-08-20T22:22:51.2874017Z ++ pwd 2024-08-20T22:22:51.2877925Z + TEST_REPORTS_DIR=/var/lib/jenkins/workspace/test/test-reports 2024-08-20T22:22:51.2878599Z + local suite=timm_models 2024-08-20T22:22:51.2878939Z + shift 2024-08-20T22:22:51.2881517Z + local shard_id=0 2024-08-20T22:22:51.2881893Z + shift 2024-08-20T22:22:51.2883992Z + [[ aot_inductor_timm == *perf_compare* ]] 2024-08-20T22:22:51.2884650Z + [[ aot_inductor_timm == *perf* ]] 2024-08-20T22:22:51.2885192Z + [[ aot_inductor_timm == *cpu* ]] 2024-08-20T22:22:51.2885642Z + [[ aot_inductor_timm == *aot_inductor* ]] 2024-08-20T22:22:51.2886533Z + test_single_dynamo_benchmark inference timm_models 0 --inference --bfloat16 2024-08-20T22:22:51.2887525Z ++ pwd 2024-08-20T22:22:51.2888053Z + TEST_REPORTS_DIR=/var/lib/jenkins/workspace/test/test-reports 2024-08-20T22:22:51.2888742Z + mkdir -p /var/lib/jenkins/workspace/test/test-reports 2024-08-20T22:22:51.2911884Z + local name=inference 2024-08-20T22:22:51.2912234Z + shift 2024-08-20T22:22:51.2912512Z + local suite=timm_models 2024-08-20T22:22:51.2912859Z + shift 2024-08-20T22:22:51.2913130Z + local shard_id=0 2024-08-20T22:22:51.2913432Z + shift 2024-08-20T22:22:51.2913696Z + partition_flags=() 2024-08-20T22:22:51.2914027Z + local partition_flags 2024-08-20T22:22:51.2914454Z + [[ -n 2 ]] 2024-08-20T22:22:51.2914767Z + [[ -n 0 ]] 2024-08-20T22:22:51.2915357Z + partition_flags=(--total-partitions "$NUM_TEST_SHARDS" --partition-id "$shard_id") 2024-08-20T22:22:51.2916045Z + [[ aot_inductor_timm == *perf_compare* ]] 2024-08-20T22:22:51.2916504Z + [[ aot_inductor_timm == *perf* ]] 2024-08-20T22:22:51.2916939Z + [[ aot_inductor_timm == *aot_inductor* ]] 2024-08-20T22:22:51.2917423Z + [[ aot_inductor_timm != *cpu_aot_inductor* ]] 2024-08-20T22:22:51.2917918Z + export TORCHINDUCTOR_ABI_COMPATIBLE=1 2024-08-20T22:22:51.2918362Z + TORCHINDUCTOR_ABI_COMPATIBLE=1 2024-08-20T22:22:51.2918774Z + [[ aot_inductor_timm == *_avx2* ]] 2024-08-20T22:22:51.2919200Z + [[ aot_inductor_timm == *_avx512* ]] 2024-08-20T22:22:51.2920928Z + python benchmarks/dynamo/timm_models.py --ci --accuracy --timing --explain --export-aot-inductor --device cuda --inference --bfloat16 --total-partitions 2 --partition-id 0 --output /var/lib/jenkins/workspace/test/test-reports/inference_timm_models.csv 2024-08-20T22:22:57.7429960Z 2024-08-20T22:22:58.0621775Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:22:58.0622133Z 2024-08-20T22:22:58.1660764Z model.safetensors: 0% 0.00/95.5M [00:00 /dev/null 2>&1; then 2024-08-20T22:46:33.5376519Z  zip -r "logs-${FILE_SUFFIX}.zip" test -i '*.log' 2024-08-20T22:46:33.5377025Z fi 2024-08-20T22:46:33.5386028Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:46:33.5386540Z env: 2024-08-20T22:46:33.5386815Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:46:33.5387273Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:46:33.5388017Z DOCKER_CONTAINER_ID: 3d143751037c82fb8ec22be7895042a7b3d28eeb9e9acadd73b1cae4487c9d2c 2024-08-20T22:46:33.5388948Z FILE_SUFFIX: test-aot_inductor_timm-1-2-amz2023.linux.g5.4xlarge.nvidia.gpu_29026530123 2024-08-20T22:46:33.5389616Z ##[endgroup] 2024-08-20T22:46:33.5459301Z adding: usage_log.txt (deflated 92%) 2024-08-20T22:46:33.5547947Z ##[group]Run # Remove any previous debugging artifacts if they exist 2024-08-20T22:46:33.5548669Z # Remove any previous debugging artifacts if they exist 2024-08-20T22:46:33.5549221Z rm -f debug-*.zip 2024-08-20T22:46:33.5549606Z if [ -d 'test/debug' ]; then 2024-08-20T22:46:33.5550132Z  zip -r "debug-${FILE_SUFFIX}.zip" test/debug 2024-08-20T22:46:33.5550630Z fi 2024-08-20T22:46:33.5558680Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:46:33.5559189Z env: 2024-08-20T22:46:33.5559475Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:46:33.5559935Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:46:33.5560678Z DOCKER_CONTAINER_ID: 3d143751037c82fb8ec22be7895042a7b3d28eeb9e9acadd73b1cae4487c9d2c 2024-08-20T22:46:33.5561849Z FILE_SUFFIX: test-aot_inductor_timm-1-2-amz2023.linux.g5.4xlarge.nvidia.gpu_29026530123 2024-08-20T22:46:33.5562522Z ##[endgroup] 2024-08-20T22:46:33.5665238Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-08-20T22:46:33.5665684Z with: 2024-08-20T22:46:33.5665978Z s3-bucket: gha-artifacts 2024-08-20T22:46:33.5666427Z s3-prefix: pytorch/pytorch/10479310725/1/artifact 2024-08-20T22:46:33.5666922Z retention-days: 14 2024-08-20T22:46:33.5667265Z if-no-files-found: warn 2024-08-20T22:46:33.5667635Z path: test-jsons-*.zip 2024-08-20T22:46:33.5667993Z name: artifact 2024-08-20T22:46:33.5668310Z region: us-east-1 2024-08-20T22:46:33.5668626Z env: 2024-08-20T22:46:33.5668917Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:46:33.5669382Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:46:33.5670132Z DOCKER_CONTAINER_ID: 3d143751037c82fb8ec22be7895042a7b3d28eeb9e9acadd73b1cae4487c9d2c 2024-08-20T22:46:33.5670791Z ##[endgroup] 2024-08-20T22:46:33.9272993Z NOTE: s3-prefix specified, ignoring name parameter 2024-08-20T22:46:33.9273617Z With the provided path, there will be 1 file uploaded 2024-08-20T22:46:33.9274243Z Uploading to s3 prefix: pytorch/pytorch/10479310725/1/artifact 2024-08-20T22:46:33.9332197Z Starting upload of test-jsons-test-aot_inductor_timm-1-2-amz2023.linux.g5.4xlarge.nvidia.gpu_29026530123.zip 2024-08-20T22:46:34.0622172Z Finished upload of test-jsons-test-aot_inductor_timm-1-2-amz2023.linux.g5.4xlarge.nvidia.gpu_29026530123.zip 2024-08-20T22:46:34.0896052Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-08-20T22:46:34.0896506Z with: 2024-08-20T22:46:34.0896802Z s3-bucket: gha-artifacts 2024-08-20T22:46:34.0897245Z s3-prefix: pytorch/pytorch/10479310725/1/artifact 2024-08-20T22:46:34.0897732Z retention-days: 14 2024-08-20T22:46:34.0898079Z if-no-files-found: error 2024-08-20T22:46:34.0898449Z path: test-reports-*.zip 2024-08-20T22:46:34.0898809Z name: artifact 2024-08-20T22:46:34.0899122Z region: us-east-1 2024-08-20T22:46:34.0899431Z env: 2024-08-20T22:46:34.0899721Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:46:34.0900181Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:46:34.0900927Z DOCKER_CONTAINER_ID: 3d143751037c82fb8ec22be7895042a7b3d28eeb9e9acadd73b1cae4487c9d2c 2024-08-20T22:46:34.0901576Z ##[endgroup] 2024-08-20T22:46:34.4522760Z NOTE: s3-prefix specified, ignoring name parameter 2024-08-20T22:46:34.4523430Z With the provided path, there will be 1 file uploaded 2024-08-20T22:46:34.4524048Z Uploading to s3 prefix: pytorch/pytorch/10479310725/1/artifact 2024-08-20T22:46:34.4581720Z Starting upload of test-reports-test-aot_inductor_timm-1-2-amz2023.linux.g5.4xlarge.nvidia.gpu_29026530123.zip 2024-08-20T22:46:34.5543162Z Finished upload of test-reports-test-aot_inductor_timm-1-2-amz2023.linux.g5.4xlarge.nvidia.gpu_29026530123.zip 2024-08-20T22:46:34.5819218Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-08-20T22:46:34.5819667Z with: 2024-08-20T22:46:34.5819946Z s3-bucket: gha-artifacts 2024-08-20T22:46:34.5820405Z s3-prefix: pytorch/pytorch/10479310725/1/artifact 2024-08-20T22:46:34.5820882Z retention-days: 14 2024-08-20T22:46:34.5821231Z if-no-files-found: ignore 2024-08-20T22:46:34.5821593Z path: logs-*.zip 2024-08-20T22:46:34.5821907Z name: artifact 2024-08-20T22:46:34.5822225Z region: us-east-1 2024-08-20T22:46:34.5822526Z env: 2024-08-20T22:46:34.5822802Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:46:34.5823271Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:46:34.5824020Z DOCKER_CONTAINER_ID: 3d143751037c82fb8ec22be7895042a7b3d28eeb9e9acadd73b1cae4487c9d2c 2024-08-20T22:46:34.5824688Z ##[endgroup] 2024-08-20T22:46:34.9343619Z NOTE: s3-prefix specified, ignoring name parameter 2024-08-20T22:46:34.9344494Z With the provided path, there will be 1 file uploaded 2024-08-20T22:46:34.9345298Z Uploading to s3 prefix: pytorch/pytorch/10479310725/1/artifact 2024-08-20T22:46:34.9402610Z Starting upload of logs-test-aot_inductor_timm-1-2-amz2023.linux.g5.4xlarge.nvidia.gpu_29026530123.zip 2024-08-20T22:46:35.0875259Z Finished upload of logs-test-aot_inductor_timm-1-2-amz2023.linux.g5.4xlarge.nvidia.gpu_29026530123.zip 2024-08-20T22:46:35.1151283Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-08-20T22:46:35.1151791Z with: 2024-08-20T22:46:35.1152064Z s3-bucket: gha-artifacts 2024-08-20T22:46:35.1152512Z s3-prefix: pytorch/pytorch/10479310725/1/artifact 2024-08-20T22:46:35.1152994Z retention-days: 14 2024-08-20T22:46:35.1153336Z if-no-files-found: ignore 2024-08-20T22:46:35.1153696Z path: debug-*.zip 2024-08-20T22:46:35.1154018Z name: artifact 2024-08-20T22:46:35.1154340Z region: us-east-1 2024-08-20T22:46:35.1154634Z env: 2024-08-20T22:46:35.1154916Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:46:35.1155377Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:46:35.1156120Z DOCKER_CONTAINER_ID: 3d143751037c82fb8ec22be7895042a7b3d28eeb9e9acadd73b1cae4487c9d2c 2024-08-20T22:46:35.1156766Z ##[endgroup] 2024-08-20T22:46:35.4614352Z No files were found with the provided path: debug-*.zip. No artifacts will be uploaded. 2024-08-20T22:46:35.4887405Z ##[group]Run # shellcheck disable=SC2156 2024-08-20T22:46:35.4887895Z # shellcheck disable=SC2156 2024-08-20T22:46:35.4888700Z find . -iname "core.[1-9]*" -exec docker exec "${DOCKER_CONTAINER_ID}" sh -c "gdb python {} -ex 'bt' -ex 'q'" \; 2024-08-20T22:46:35.4898779Z shell: /usr/bin/bash -e {0} 2024-08-20T22:46:35.4899138Z env: 2024-08-20T22:46:35.4899417Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:46:35.4899881Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:46:35.4900626Z DOCKER_CONTAINER_ID: 3d143751037c82fb8ec22be7895042a7b3d28eeb9e9acadd73b1cae4487c9d2c 2024-08-20T22:46:35.4901301Z ##[endgroup] 2024-08-20T22:46:35.7564512Z ##[group]Run pytorch/test-infra/.github/actions/teardown-linux@main 2024-08-20T22:46:35.7565093Z with: 2024-08-20T22:46:35.7565352Z env: 2024-08-20T22:46:35.7565636Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:46:35.7566110Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:46:35.7566898Z DOCKER_CONTAINER_ID: 3d143751037c82fb8ec22be7895042a7b3d28eeb9e9acadd73b1cae4487c9d2c 2024-08-20T22:46:35.7567554Z ##[endgroup] 2024-08-20T22:46:35.7587182Z ##[group]Run set -eou pipefail 2024-08-20T22:46:35.7587603Z set -eou pipefail 2024-08-20T22:46:35.7587969Z  2024-08-20T22:46:35.7588507Z echo "Holding runner for 2 hours until all ssh sessions have logged out" 2024-08-20T22:46:35.7589169Z for _ in $(seq 1440); do 2024-08-20T22:46:35.7589656Z  # Break if no ssh session exists anymore 2024-08-20T22:46:35.7590186Z  if [ "$(who)" = "" ]; then 2024-08-20T22:46:35.7590626Z  break 2024-08-20T22:46:35.7590995Z  fi 2024-08-20T22:46:35.7591312Z  echo "." 2024-08-20T22:46:35.7591654Z  sleep 5 2024-08-20T22:46:35.7592022Z done 2024-08-20T22:46:35.7601070Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:46:35.7601578Z env: 2024-08-20T22:46:35.7601865Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:46:35.7602372Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:46:35.7603144Z DOCKER_CONTAINER_ID: 3d143751037c82fb8ec22be7895042a7b3d28eeb9e9acadd73b1cae4487c9d2c 2024-08-20T22:46:35.7603796Z ##[endgroup] 2024-08-20T22:46:35.7633771Z Holding runner for 2 hours until all ssh sessions have logged out 2024-08-20T22:46:35.7689208Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2024-08-20T22:46:35.7689970Z # ignore expansion of "docker ps -q" since it could be empty 2024-08-20T22:46:35.7690565Z # shellcheck disable=SC2046 2024-08-20T22:46:35.7691042Z docker stop $(docker ps -q) || true 2024-08-20T22:46:35.7691656Z # Prune all of the docker images 2024-08-20T22:46:35.7692115Z docker system prune -af 2024-08-20T22:46:35.7700281Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:46:35.7700953Z env: 2024-08-20T22:46:35.7701228Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:46:35.7701693Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:46:35.7702442Z DOCKER_CONTAINER_ID: 3d143751037c82fb8ec22be7895042a7b3d28eeb9e9acadd73b1cae4487c9d2c 2024-08-20T22:46:35.7703094Z ##[endgroup] 2024-08-20T22:46:36.2917633Z 3d143751037c 2024-08-20T22:46:37.7476414Z Deleted Containers: 2024-08-20T22:46:37.7477116Z 3d143751037c82fb8ec22be7895042a7b3d28eeb9e9acadd73b1cae4487c9d2c 2024-08-20T22:46:37.7477564Z 2024-08-20T22:46:48.7567729Z Deleted Images: 2024-08-20T22:46:48.7569402Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:46:48.7572333Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks@sha256:3a95d3a177465127ef6cd3b50787d6a050367070fd9063dbb688fad07a96b402 2024-08-20T22:46:48.7574226Z deleted: sha256:8fef7805cec6e829013a3d62f158b75bdc2f02cdfe3428c032ea017b488473bb 2024-08-20T22:46:48.7575081Z deleted: sha256:c2ce10014dd98f6abbfbf2265f9780a8204c2a7a27463e61ee565573a23d141d 2024-08-20T22:46:48.7575993Z deleted: sha256:ae249c0e6e6013bd6ffea2ca0b0160c015c9ebf7c03070bc2f983a9ff2415bf5 2024-08-20T22:46:48.7576834Z deleted: sha256:8a73883c1067c0e29ff128f553518682b47ed9707d2f35e7d5138e2caf029d61 2024-08-20T22:46:48.7577649Z deleted: sha256:9c040db729fa084584aaf5573082408a2196bc64e5952270c79dc610ed4680b6 2024-08-20T22:46:48.7578463Z deleted: sha256:17311eeeb8b71b16699880c0f646e185107496c4d41da5d23370603768ec030c 2024-08-20T22:46:48.7579281Z deleted: sha256:07cc10bece8501b1c8035d4385ad9e9867dd6e92fa32218a4dcb3e42af7e0411 2024-08-20T22:46:48.7580581Z deleted: sha256:f3e32d05099d1a3115a4722bc2e94a48752c3e965446773673808252671bb967 2024-08-20T22:46:48.7581405Z deleted: sha256:be7c3f41475e3e72ffe3ac2f92ab2f4cf49d5496b2aae738942ac3bb687d742c 2024-08-20T22:46:48.7582257Z deleted: sha256:4fcac490be825129b468cf458089f1fcf8fd56afc44ef4ab27c2eff41ab1ac90 2024-08-20T22:46:48.7583102Z deleted: sha256:31c66d80a2a4792897f267d363c0cf84fb821c5d4a275ab1636f778fd0284c08 2024-08-20T22:46:48.7583921Z deleted: sha256:8a8bcb6085e7e438e5533e8a5613e2ae5888543853568d023af3e2623a1593a9 2024-08-20T22:46:48.7584745Z deleted: sha256:2f6cb60029c79d11567b738f5bdbfb9cb1838cc0f194c4a5e6ae685178d2ed34 2024-08-20T22:46:48.7585629Z deleted: sha256:e546391804d3313f558e1ac16e93cb29a417a92e4eccaf0d4bd12af3bbcf39e3 2024-08-20T22:46:48.7586443Z deleted: sha256:1623b2aa16f2bdc6b572f6799498d9a92fa8114d07c440599b17aea72e22f8b1 2024-08-20T22:46:48.7587268Z deleted: sha256:c0386ca58b7cb7afee015b7e58d2f70525eaf73d6da2cc63868b20e14b1f9497 2024-08-20T22:46:48.7588097Z deleted: sha256:dcbf534ff289186e246531925fed90f72516eb3d63663bad234d611cdc025d62 2024-08-20T22:46:48.7589022Z deleted: sha256:0bab537af579f56c9cd51c7073fd53635fffb424b363236e0de38a7dd0e60ae8 2024-08-20T22:46:48.7589895Z deleted: sha256:d85a852ae1ee027e2fc17240ed68b87957b0a6d210c9119752d8979a0dcd55cf 2024-08-20T22:46:48.7590727Z deleted: sha256:f3821d761b555362e44cf9a1447d8fd2d95b37d54aea67c7519cd9e5db0c4d7e 2024-08-20T22:46:48.7591558Z deleted: sha256:c05e84a545db5dfcb0847c73d2b0f4749fa67aabce05705632ff7f76c84d4688 2024-08-20T22:46:48.7592394Z deleted: sha256:27054eae7ca67b2bd5ca0fd3f4488bf5c5f78e95487d8c45616f3d753d48a8b5 2024-08-20T22:46:48.7593229Z deleted: sha256:9804139f6ae97796aaa993fe4b89ea0cf111eb4d30a79f4c87c339c2e1e04fa0 2024-08-20T22:46:48.7594053Z deleted: sha256:ad6ae2fc594aaa359ff4e287323836570454eb24dd162930655e414d1d77c6dd 2024-08-20T22:46:48.7594878Z deleted: sha256:9cfbb36e328af52a248853a46aab88e266c09e2b44a03e0a42194a031b9b9453 2024-08-20T22:46:48.7595764Z deleted: sha256:a8a842bd7f37b8d50b6d12d6f95f46bbba57953db466fcbde9ba522625f024ef 2024-08-20T22:46:48.7596604Z deleted: sha256:da9738654b3c86f89ebeed2560f1bae093f1219f1eff90b0394b7f211ecabd04 2024-08-20T22:46:48.7597444Z deleted: sha256:cc683bf0cb245394e0f568984b2dd4fce1b6a3a7fe7c44734bae1aa1caaa3251 2024-08-20T22:46:48.7598485Z deleted: sha256:965f220e71c7d1ec19aaf41b1529ab287beb9d86eb8482c4c14094485ab34475 2024-08-20T22:46:48.7599312Z deleted: sha256:da32ecec41a73ce7dd29464f90c7951510a18cd378753659a78cd7fabd10dc36 2024-08-20T22:46:48.7600145Z deleted: sha256:d828d187cee9ad48dbc3702fb61d359619dd8a1ed582878680b51686bf117e5a 2024-08-20T22:46:48.7600970Z deleted: sha256:712111f4b12ff8e2787597d5fdcb043bd0824e55ddd97f262ef550506ca195f0 2024-08-20T22:46:48.7601793Z deleted: sha256:a064eea405958ad14dc6c794e5df9fd1d4515424272801ec559d45a59317309a 2024-08-20T22:46:48.7602609Z deleted: sha256:e124382d136bd5e9a8b409ca79c1f1ef76458deaf444b1b2060d3fa99dbeb506 2024-08-20T22:46:48.7603492Z deleted: sha256:6e10fe757cc190a1b31b47010f4f7610e02cb1b4b438f190dcd301aa4fe2278e 2024-08-20T22:46:48.7604329Z deleted: sha256:4cea352e10f46ca4729f96ac6c4600fc53d4c36e7658c2e0f19f4f309cd4a2a7 2024-08-20T22:46:48.7605165Z deleted: sha256:518bba00fe1d0933053066d21cac0235c9fb485abbc41557ec184b293095c924 2024-08-20T22:46:48.7605997Z deleted: sha256:a64f9ca42e9f27ff2690c15a5c84312e6efaccad45668d9b496cb542165cfb5a 2024-08-20T22:46:48.7606835Z deleted: sha256:096ea0fa14a6c420658f5276b8a8f5d264c0de7e18161ceda2cfc2f4a92cd9bf 2024-08-20T22:46:48.7607665Z deleted: sha256:6f91c94ce6e3f8034c91c66ee25c66a3d85dba9d813b749bd6d2000942a99edc 2024-08-20T22:46:48.7608500Z deleted: sha256:8f8d255eeae546cead8f9a94d237fa57a99940c0f5d51bc29a9d41c7df9cffd9 2024-08-20T22:46:48.7609346Z deleted: sha256:fe05276f4a49f91eef56bfbc3da87cfff5eb116a827fa2d30efe42ce1c134b40 2024-08-20T22:46:48.7610177Z deleted: sha256:5f83cd75d0669c813d4f58978c92e14305cd8f6a07eb9a60665a583460fa7b59 2024-08-20T22:46:48.7610999Z deleted: sha256:8f7ab6366169d39d8953129f650f1927d2fb1328b3f11e2fd9076adb5f46b93a 2024-08-20T22:46:48.7612046Z deleted: sha256:4146cfd5dba0f5308954749f98596b14a1d8f6d23bd93f7ad86c6c3d72239328 2024-08-20T22:46:48.7612892Z deleted: sha256:c6d83cb9ccc606ff63bb3c4d5a5e1ff1450c619b5aae494303a94ae25971cca0 2024-08-20T22:46:48.7613717Z deleted: sha256:71e037e0a3e0963c4565534a7387c082afcb04475d3ac629acf7a0ab2f49fadc 2024-08-20T22:46:48.7614529Z deleted: sha256:4b31135c564686bdaf23262b901237880aea635655721cc7e8c95dc42b05e06d 2024-08-20T22:46:48.7615397Z deleted: sha256:d09bd5c2f35cedcb846543941ee64ce1f684b52e4285696c93b3fb2032da8579 2024-08-20T22:46:48.7616393Z deleted: sha256:4de7fb7d4fc22212aae5fc1ceb637526916d0cced240d7c93d5edd6b0ea28013 2024-08-20T22:46:48.7617341Z deleted: sha256:69890e3e82746e10aff2f1084f11afb4b95a4a6c26b30f64b7001bc0a5fe32bf 2024-08-20T22:46:48.7618172Z deleted: sha256:0156df53b3224e645336ea52b4bb816f1e8d8c9b591748cd645e5e5649fa507b 2024-08-20T22:46:48.7619003Z deleted: sha256:0664624cb9cc4a386f31bf49919a8d8a11d9fea428d05585d9e6228f754bc7cd 2024-08-20T22:46:48.7619857Z deleted: sha256:8c2ddd5fa535c768c058a23f5cc4b6c64cdd71bb7458491282aabc7f7bb94d69 2024-08-20T22:46:48.7620703Z deleted: sha256:8dd03dbe0e1c5f47dd333074dff4bd00415f2f63727a65bf17866774e2ebbd0d 2024-08-20T22:46:48.7621545Z deleted: sha256:3c56b63e094bd18fad9da7a541d537210bca3b730c590d3641213259f6908d6f 2024-08-20T22:46:48.7622389Z deleted: sha256:51484fef07bd1266d4d6ff3d767751172660fc4cc6a1ffe883523a63c985e31e 2024-08-20T22:46:48.7623231Z deleted: sha256:03e83c94023982ab7dd8dc65a6df2024e342f1b760c91ec7a680ee45824869c7 2024-08-20T22:46:48.7624064Z deleted: sha256:58440ab3e8175b5de94a76485c8689a6dc186015475ebf4b386ebba309c5da34 2024-08-20T22:46:48.7624897Z deleted: sha256:9a980f3383e8aa511f0ef68982cb6dfc53b38d1ac8c3d673cb3ba3d45158c91e 2024-08-20T22:46:48.7625799Z deleted: sha256:cb0269c9cf1c47b6c4188ca7be4db261b5d3fc4b4a5153629e222dba7b1f9f98 2024-08-20T22:46:48.7626662Z deleted: sha256:41f1ba870cdffc05e0bf8d87b640fb9d4c153d7f4f3b775f37f94e9f3d584aad 2024-08-20T22:46:48.7627518Z deleted: sha256:7b502ab352f48e8b6eb5e6824a29f308952a5ee7c7d987562e1df7e47639d7f1 2024-08-20T22:46:48.7628348Z deleted: sha256:6ba5217e18738660e6ca8b7a7ec88845e70b0fd781301520bf46c71d99df3144 2024-08-20T22:46:48.7629181Z deleted: sha256:dd5a1c233594780163726bdbbf5de00f7b6b8dca1dace8a001340714c54baedb 2024-08-20T22:46:48.7630365Z deleted: sha256:c27f0db27da73e01f67f6cb78d10f355e350d829479ba4351d82055bb29f6597 2024-08-20T22:46:48.7631365Z deleted: sha256:4e3ce3c854f35c08be3dd95e0d6e718512a885e4614291d7d8b7cd23f48b7dd8 2024-08-20T22:46:48.7632195Z deleted: sha256:c2d6fb088bbec16e60cf0ad74b016f7287c92e659ec2db01271bc309b4dc6d83 2024-08-20T22:46:48.7633043Z deleted: sha256:35a033279d5c9bd6b862bfa9331d8fcbf98bbaf778a778fabc882384db9204f8 2024-08-20T22:46:48.7633886Z deleted: sha256:ab9b00c496073d62e69e032178858d3d6d4c4bab9e87065d3785c6da57351d00 2024-08-20T22:46:48.7634706Z deleted: sha256:7ed947299e109c2459de6e240d86f049c30f93f2380659ce441d8737b8cd065f 2024-08-20T22:46:48.7635539Z deleted: sha256:410d5a7f7a9a1cb4551c106b9cc728a9dcff598f9be231a351ce6a0a33f81e64 2024-08-20T22:46:48.7636386Z deleted: sha256:5f0021bb56efa14bb93978c01513e2a1187ba30e69bdb0546d0ef39b30873f88 2024-08-20T22:46:48.7637228Z deleted: sha256:c1601aa97eb84151c14da3aeea351201bd99144d36d66b397f6555d80245d86d 2024-08-20T22:46:48.7638080Z deleted: sha256:72af05a89be22accdc1ca5d66dcbbb33993a9ef5997f849df1d4ba4c48049f25 2024-08-20T22:46:48.7638926Z deleted: sha256:38b90c9663dcaa2bc57a4dd3008298e7ea93e9535fa42312b4dc4246e7491af9 2024-08-20T22:46:48.7639783Z deleted: sha256:bda61b6cefb3ec8eeb74fef1ca1c7f9a5845fe5e8f07b8123323e897425d5c29 2024-08-20T22:46:48.7640645Z deleted: sha256:5a18e1aa877074529a84cbddf19f8d5403787823378ceae6b72fb62f78d43037 2024-08-20T22:46:48.7641486Z deleted: sha256:6c3e7df31590f02f10cb71fc4eb27653e9b428df2e6e5421a455b062bd2e39f9 2024-08-20T22:46:48.7641981Z 2024-08-20T22:46:48.7642146Z Total reclaimed space: 44.92GB 2024-08-20T22:46:48.7708983Z Post job cleanup. 2024-08-20T22:46:48.7760183Z Post job cleanup. 2024-08-20T22:46:48.8649209Z [command]/usr/bin/git version 2024-08-20T22:46:48.8695419Z git version 2.40.1 2024-08-20T22:46:48.8733752Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/cecde5e0-f4a9-4250-94ca-b37b0ead9066' before making global git config changes 2024-08-20T22:46:48.8735029Z Adding repository directory to the temporary git global config as a safe directory 2024-08-20T22:46:48.8738950Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-20T22:46:48.8789018Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2024-08-20T22:46:48.8834198Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2024-08-20T22:46:48.9207094Z Entering 'android/libs/fbjni' 2024-08-20T22:46:48.9277069Z Entering 'third_party/FP16' 2024-08-20T22:46:48.9346533Z Entering 'third_party/FXdiv' 2024-08-20T22:46:48.9415287Z Entering 'third_party/NNPACK' 2024-08-20T22:46:48.9487133Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T22:46:48.9560522Z Entering 'third_party/XNNPACK' 2024-08-20T22:46:48.9646605Z Entering 'third_party/benchmark' 2024-08-20T22:46:48.9717208Z Entering 'third_party/cpp-httplib' 2024-08-20T22:46:48.9789407Z Entering 'third_party/cpuinfo' 2024-08-20T22:46:48.9862489Z Entering 'third_party/cudnn_frontend' 2024-08-20T22:46:48.9931869Z Entering 'third_party/cutlass' 2024-08-20T22:46:49.0008424Z Entering 'third_party/eigen' 2024-08-20T22:46:49.0080393Z Entering 'third_party/fbgemm' 2024-08-20T22:46:49.0151766Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:46:49.0217556Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:46:49.0284102Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:46:49.0364049Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:46:49.0435546Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:46:49.0503961Z Entering 'third_party/flatbuffers' 2024-08-20T22:46:49.0579918Z Entering 'third_party/fmt' 2024-08-20T22:46:49.0650730Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:46:49.0718500Z Entering 'third_party/gloo' 2024-08-20T22:46:49.0789269Z Entering 'third_party/googletest' 2024-08-20T22:46:49.0858772Z Entering 'third_party/ideep' 2024-08-20T22:46:49.0924975Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T22:46:49.1005427Z Entering 'third_party/ittapi' 2024-08-20T22:46:49.1076615Z Entering 'third_party/kineto' 2024-08-20T22:46:49.1148072Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:46:49.1213645Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:46:49.1282957Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:46:49.1353292Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:46:49.1423420Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:46:49.1489368Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:46:49.1560387Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:46:49.1627774Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:46:49.1695207Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:46:49.1764413Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:46:49.1835460Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:46:49.1903563Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:46:49.1975069Z Entering 'third_party/mimalloc' 2024-08-20T22:46:49.2045332Z Entering 'third_party/nccl/nccl' 2024-08-20T22:46:49.2115077Z Entering 'third_party/nlohmann' 2024-08-20T22:46:49.2186981Z Entering 'third_party/onnx' 2024-08-20T22:46:49.2271210Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T22:46:49.2340359Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T22:46:49.2415054Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T22:46:49.2487053Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:46:49.2552821Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:46:49.2619262Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:46:49.2686350Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:46:49.2755058Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:46:49.2821883Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:46:49.2889495Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:46:49.2954544Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:46:49.3023167Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:46:49.3095166Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:46:49.3190217Z Entering 'third_party/pocketfft' 2024-08-20T22:46:49.3259852Z Entering 'third_party/protobuf' 2024-08-20T22:46:49.3332016Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:46:49.3399611Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T22:46:49.3472258Z Entering 'third_party/psimd' 2024-08-20T22:46:49.3542354Z Entering 'third_party/pthreadpool' 2024-08-20T22:46:49.3612450Z Entering 'third_party/pybind11' 2024-08-20T22:46:49.3682710Z Entering 'third_party/python-peachpy' 2024-08-20T22:46:49.3752460Z Entering 'third_party/sleef' 2024-08-20T22:46:49.3822303Z Entering 'third_party/tensorpipe' 2024-08-20T22:46:49.3891095Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:46:49.3957672Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:46:49.4022267Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:46:49.4089577Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:46:49.4154739Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:46:49.4258518Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2024-08-20T22:46:49.4295237Z http.https://github.com/.extraheader 2024-08-20T22:46:49.4304822Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader 2024-08-20T22:46:49.4351822Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2024-08-20T22:46:49.4715595Z Entering 'android/libs/fbjni' 2024-08-20T22:46:49.4762588Z http.https://github.com/.extraheader 2024-08-20T22:46:49.4806663Z Entering 'third_party/FP16' 2024-08-20T22:46:49.4851708Z http.https://github.com/.extraheader 2024-08-20T22:46:49.4895602Z Entering 'third_party/FXdiv' 2024-08-20T22:46:49.4940337Z http.https://github.com/.extraheader 2024-08-20T22:46:49.4983776Z Entering 'third_party/NNPACK' 2024-08-20T22:46:49.5027915Z http.https://github.com/.extraheader 2024-08-20T22:46:49.5071855Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T22:46:49.5114942Z http.https://github.com/.extraheader 2024-08-20T22:46:49.5162926Z Entering 'third_party/XNNPACK' 2024-08-20T22:46:49.5206232Z http.https://github.com/.extraheader 2024-08-20T22:46:49.5265804Z Entering 'third_party/benchmark' 2024-08-20T22:46:49.5308645Z http.https://github.com/.extraheader 2024-08-20T22:46:49.5353449Z Entering 'third_party/cpp-httplib' 2024-08-20T22:46:49.5396441Z http.https://github.com/.extraheader 2024-08-20T22:46:49.5439751Z Entering 'third_party/cpuinfo' 2024-08-20T22:46:49.5482828Z http.https://github.com/.extraheader 2024-08-20T22:46:49.5526151Z Entering 'third_party/cudnn_frontend' 2024-08-20T22:46:49.5574700Z http.https://github.com/.extraheader 2024-08-20T22:46:49.5617873Z Entering 'third_party/cutlass' 2024-08-20T22:46:49.5661687Z http.https://github.com/.extraheader 2024-08-20T22:46:49.5713013Z Entering 'third_party/eigen' 2024-08-20T22:46:49.5756874Z http.https://github.com/.extraheader 2024-08-20T22:46:49.5803047Z Entering 'third_party/fbgemm' 2024-08-20T22:46:49.5849069Z http.https://github.com/.extraheader 2024-08-20T22:46:49.5892318Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:46:49.5936044Z http.https://github.com/.extraheader 2024-08-20T22:46:49.5978535Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:46:49.6021512Z http.https://github.com/.extraheader 2024-08-20T22:46:49.6065946Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:46:49.6109309Z http.https://github.com/.extraheader 2024-08-20T22:46:49.6159350Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:46:49.6202513Z http.https://github.com/.extraheader 2024-08-20T22:46:49.6246725Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:46:49.6289426Z http.https://github.com/.extraheader 2024-08-20T22:46:49.6335018Z Entering 'third_party/flatbuffers' 2024-08-20T22:46:49.6377944Z http.https://github.com/.extraheader 2024-08-20T22:46:49.6424271Z Entering 'third_party/fmt' 2024-08-20T22:46:49.6469583Z http.https://github.com/.extraheader 2024-08-20T22:46:49.6512701Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:46:49.6557015Z http.https://github.com/.extraheader 2024-08-20T22:46:49.6603102Z Entering 'third_party/gloo' 2024-08-20T22:46:49.6647393Z http.https://github.com/.extraheader 2024-08-20T22:46:49.6690529Z Entering 'third_party/googletest' 2024-08-20T22:46:49.6735066Z http.https://github.com/.extraheader 2024-08-20T22:46:49.6778749Z Entering 'third_party/ideep' 2024-08-20T22:46:49.6822676Z http.https://github.com/.extraheader 2024-08-20T22:46:49.6865157Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T22:46:49.6907784Z http.https://github.com/.extraheader 2024-08-20T22:46:49.6962819Z Entering 'third_party/ittapi' 2024-08-20T22:46:49.7006144Z http.https://github.com/.extraheader 2024-08-20T22:46:49.7049317Z Entering 'third_party/kineto' 2024-08-20T22:46:49.7092969Z http.https://github.com/.extraheader 2024-08-20T22:46:49.7137499Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:46:49.7181029Z http.https://github.com/.extraheader 2024-08-20T22:46:49.7224381Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:46:49.7267587Z http.https://github.com/.extraheader 2024-08-20T22:46:49.7313749Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:46:49.7357674Z http.https://github.com/.extraheader 2024-08-20T22:46:49.7402196Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:46:49.7445674Z http.https://github.com/.extraheader 2024-08-20T22:46:49.7491100Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:46:49.7535432Z http.https://github.com/.extraheader 2024-08-20T22:46:49.7578839Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:46:49.7624287Z http.https://github.com/.extraheader 2024-08-20T22:46:49.7674350Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:46:49.7724759Z http.https://github.com/.extraheader 2024-08-20T22:46:49.7770420Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:46:49.7814423Z http.https://github.com/.extraheader 2024-08-20T22:46:49.7862420Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:46:49.7905693Z http.https://github.com/.extraheader 2024-08-20T22:46:49.7954040Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:46:49.7997501Z http.https://github.com/.extraheader 2024-08-20T22:46:49.8045400Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:46:49.8088686Z http.https://github.com/.extraheader 2024-08-20T22:46:49.8133381Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:46:49.8176516Z http.https://github.com/.extraheader 2024-08-20T22:46:49.8222982Z Entering 'third_party/mimalloc' 2024-08-20T22:46:49.8269625Z http.https://github.com/.extraheader 2024-08-20T22:46:49.8313778Z Entering 'third_party/nccl/nccl' 2024-08-20T22:46:49.8357965Z http.https://github.com/.extraheader 2024-08-20T22:46:49.8401889Z Entering 'third_party/nlohmann' 2024-08-20T22:46:49.8445837Z http.https://github.com/.extraheader 2024-08-20T22:46:49.8490851Z Entering 'third_party/onnx' 2024-08-20T22:46:49.8534895Z http.https://github.com/.extraheader 2024-08-20T22:46:49.8592354Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T22:46:49.8641347Z http.https://github.com/.extraheader 2024-08-20T22:46:49.8686511Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T22:46:49.8731385Z http.https://github.com/.extraheader 2024-08-20T22:46:49.8779220Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T22:46:49.8822876Z http.https://github.com/.extraheader 2024-08-20T22:46:49.8867631Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:46:49.8909837Z http.https://github.com/.extraheader 2024-08-20T22:46:49.8953460Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:46:49.8996057Z http.https://github.com/.extraheader 2024-08-20T22:46:49.9043406Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:46:49.9089177Z http.https://github.com/.extraheader 2024-08-20T22:46:49.9134304Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:46:49.9178364Z http.https://github.com/.extraheader 2024-08-20T22:46:49.9223917Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:46:49.9271912Z http.https://github.com/.extraheader 2024-08-20T22:46:49.9314493Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:46:49.9363681Z http.https://github.com/.extraheader 2024-08-20T22:46:49.9406382Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:46:49.9449244Z http.https://github.com/.extraheader 2024-08-20T22:46:49.9490419Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:46:49.9533420Z http.https://github.com/.extraheader 2024-08-20T22:46:49.9578735Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:46:49.9621381Z http.https://github.com/.extraheader 2024-08-20T22:46:49.9669130Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:46:49.9711390Z http.https://github.com/.extraheader 2024-08-20T22:46:49.9776717Z Entering 'third_party/pocketfft' 2024-08-20T22:46:49.9819597Z http.https://github.com/.extraheader 2024-08-20T22:46:49.9863780Z Entering 'third_party/protobuf' 2024-08-20T22:46:49.9906829Z http.https://github.com/.extraheader 2024-08-20T22:46:49.9953520Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:46:49.9998776Z http.https://github.com/.extraheader 2024-08-20T22:46:50.0044873Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T22:46:50.0089395Z http.https://github.com/.extraheader 2024-08-20T22:46:50.0137600Z Entering 'third_party/psimd' 2024-08-20T22:46:50.0180727Z http.https://github.com/.extraheader 2024-08-20T22:46:50.0224018Z Entering 'third_party/pthreadpool' 2024-08-20T22:46:50.0267650Z http.https://github.com/.extraheader 2024-08-20T22:46:50.0311081Z Entering 'third_party/pybind11' 2024-08-20T22:46:50.0355069Z http.https://github.com/.extraheader 2024-08-20T22:46:50.0399685Z Entering 'third_party/python-peachpy' 2024-08-20T22:46:50.0445979Z http.https://github.com/.extraheader 2024-08-20T22:46:50.0491051Z Entering 'third_party/sleef' 2024-08-20T22:46:50.0536107Z http.https://github.com/.extraheader 2024-08-20T22:46:50.0580166Z Entering 'third_party/tensorpipe' 2024-08-20T22:46:50.0624050Z http.https://github.com/.extraheader 2024-08-20T22:46:50.0667518Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:46:50.0710221Z http.https://github.com/.extraheader 2024-08-20T22:46:50.0753943Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:46:50.0796066Z http.https://github.com/.extraheader 2024-08-20T22:46:50.0840256Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:46:50.0886459Z http.https://github.com/.extraheader 2024-08-20T22:46:50.0930198Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:46:50.0971568Z http.https://github.com/.extraheader 2024-08-20T22:46:50.1013348Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:46:50.1057529Z http.https://github.com/.extraheader 2024-08-20T22:46:50.1218901Z A job completed hook has been configured by the self-hosted runner administrator 2024-08-20T22:46:50.1238925Z ##[group]Run '/home/ec2-user/runner-scripts/after_job.sh' 2024-08-20T22:46:50.1247053Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:46:50.1247573Z ##[endgroup] 2024-08-20T22:46:56.9870749Z Cleaning up orphan processes