2024-08-20T22:05:03.3130130Z Current runner version: '2.319.1' 2024-08-20T22:05:03.3136330Z Runner name: 'i-0e82ebf4b91cdd7d9' 2024-08-20T22:05:03.3137246Z Runner group name: 'Default' 2024-08-20T22:05:03.3138083Z Machine name: 'ip-10-0-64-172' 2024-08-20T22:05:03.3155527Z Testing runner upgrade compatibility 2024-08-20T22:05:03.4760325Z ##[group]GITHUB_TOKEN Permissions 2024-08-20T22:05:03.4762556Z Actions: read 2024-08-20T22:05:03.4763080Z Attestations: read 2024-08-20T22:05:03.4763556Z Checks: read 2024-08-20T22:05:03.4763970Z Contents: read 2024-08-20T22:05:03.4764482Z Deployments: read 2024-08-20T22:05:03.4764896Z Discussions: read 2024-08-20T22:05:03.4765332Z Issues: read 2024-08-20T22:05:03.4765821Z Metadata: read 2024-08-20T22:05:03.4766212Z Packages: read 2024-08-20T22:05:03.4766638Z Pages: read 2024-08-20T22:05:03.4767128Z PullRequests: read 2024-08-20T22:05:03.4767603Z RepositoryProjects: read 2024-08-20T22:05:03.4768134Z SecurityEvents: read 2024-08-20T22:05:03.4768721Z Statuses: read 2024-08-20T22:05:03.4769327Z ##[endgroup] 2024-08-20T22:05:03.4772443Z Secret source: Actions 2024-08-20T22:05:03.4773061Z Prepare workflow directory 2024-08-20T22:05:03.5696188Z Prepare all required actions 2024-08-20T22:05:03.5864580Z Getting action download info 2024-08-20T22:05:03.7530814Z Download action repository 'pytorch/test-infra@main' (SHA:0c3a2634aaa2f638c8f640e743f03d696ce1191f) 2024-08-20T22:05:04.2496472Z Download action repository 'pytorch/pytorch@main' (SHA:1ae5d5bb62141d7c9b1b0b66c66a462b4e10b1f2) 2024-08-20T22:05:08.2662531Z Download action repository 'aws-actions/configure-aws-credentials@v3' (SHA:50ac8dd1e1b10d09dac7b8727528b91bed831ac0) 2024-08-20T22:05:08.4542628Z Download action repository 'seemethere/upload-artifact-s3@v5' (SHA:baba72d0712b404f646cebe0730933554ebce96a) 2024-08-20T22:05:08.7803155Z Getting action download info 2024-08-20T22:05:08.8797014Z Download action repository 'malfet/checkout@silent-checkout' (SHA:e07af140b3ccefc05679e3755b9db68f4ee4589c) 2024-08-20T22:05:09.0887149Z Getting action download info 2024-08-20T22:05:09.1895572Z Download action repository 'nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482' (SHA:3e91a01664abd3c5cd539100d10d33b9c5b68482) 2024-08-20T22:05:09.3487152Z Uses: pytorch/pytorch/.github/workflows/_linux-test.yml@refs/tags/ciflow/inductor/133712 (40ec5f6ddd9787aca0449b24128343ff4c4a88b3) 2024-08-20T22:05:09.3489371Z ##[group] Inputs 2024-08-20T22:05:09.3489885Z build-environment: linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-08-20T22:05:09.3496852Z test-matrix: {"include": [{"config": "dynamo_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}]} 2024-08-20T22:05:09.3504636Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:05:09.3505792Z sync-tag: 2024-08-20T22:05:09.3506619Z timeout-minutes: 240 2024-08-20T22:05:09.3506955Z use-gha: 2024-08-20T22:05:09.3507244Z dashboard-tag: 2024-08-20T22:05:09.3507563Z s3-bucket: gha-artifacts 2024-08-20T22:05:09.3507911Z aws-role-to-assume: 2024-08-20T22:05:09.3508245Z ##[endgroup] 2024-08-20T22:05:09.3509278Z Complete job name: cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (aot_eager_torchbench, 1, 2, linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:05:09.4260883Z A job started hook has been configured by the self-hosted runner administrator 2024-08-20T22:05:09.4408761Z ##[group]Run '/home/ec2-user/runner-scripts/before_job.sh' 2024-08-20T22:05:09.4420539Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:05:09.4421068Z ##[endgroup] 2024-08-20T22:05:10.5985426Z Runner Type: linux.g5.4xlarge.nvidia.gpu 2024-08-20T22:05:10.5985956Z Instance Type: g5.4xlarge 2024-08-20T22:05:10.5986644Z AMI Name: al2023-ami-2023.5.20240701.0-kernel-6.1-x86_64 2024-08-20T22:05:10.5987178Z AMI ID: ami-06c68f701d8090592 2024-08-20T22:05:16.3368066Z ##[group]Run pytorch/test-infra/.github/actions/setup-ssh@main 2024-08-20T22:05:16.3368614Z with: 2024-08-20T22:05:16.3369497Z github-secret: *** 2024-08-20T22:05:16.3370436Z instructions: All testing is done inside the container, to start an interactive session run: docker exec -it $(docker container ps --format '{{.ID}}') bash 2024-08-20T22:05:16.3371430Z activate-with-label: false 2024-08-20T22:05:16.3371791Z label: with-ssh 2024-08-20T22:05:16.3372144Z remove-existing-keys: true 2024-08-20T22:05:16.3372537Z fail-silently: true 2024-08-20T22:05:16.3372851Z env: 2024-08-20T22:05:16.3373131Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:05:16.3373492Z ##[endgroup] 2024-08-20T22:05:16.4268829Z Please see https://github.com/pytorch/pytorch/wiki/Debugging-using-with-ssh-for-Github-Actions for more info. 2024-08-20T22:05:16.4271791Z ciflow reference detected, attempting to extract PR number 2024-08-20T22:05:16.6809427Z Grabbing public ssh keys from https://github.com/pytorch-bot[bot].keys 2024-08-20T22:05:16.7552054Z No SSH keys found for user pytorch-bot[bot] 2024-08-20T22:05:16.7552980Z Grabbing public ssh keys from https://github.com/XuehaiPan.keys 2024-08-20T22:05:16.8190070Z ~/.ssh/authorized_keys file found on node, removing ~/.ssh and starting fresh 2024-08-20T22:05:16.8206740Z Public keys pulled and installed to /home/ec2-user/.ssh/authorized_keys 2024-08-20T22:05:16.8231799Z Login using: ssh ec2-user@ec2-44-201-92-84.compute-1.amazonaws.com 2024-08-20T22:05:16.8232988Z All testing is done inside the container, to start an interactive session run: 2024-08-20T22:05:16.8234258Z docker exec -it $(docker container ps --format '{{.ID}}') bash 2024-08-20T22:05:16.8366012Z ##[group]Run pytorch/pytorch/.github/actions/checkout-pytorch@main 2024-08-20T22:05:16.8366572Z with: 2024-08-20T22:05:16.8366855Z submodules: recursive 2024-08-20T22:05:16.8367191Z fetch-depth: 0 2024-08-20T22:05:16.8367486Z env: 2024-08-20T22:05:16.8367761Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:05:16.8368098Z ##[endgroup] 2024-08-20T22:05:16.8559234Z ##[group]Run retry () { 2024-08-20T22:05:16.8559630Z retry () { 2024-08-20T22:05:16.8560153Z  $* || (sleep 1 && $*) || (sleep 2 && $*) || (sleep 4 && $*) || (sleep 8 && $*) 2024-08-20T22:05:16.8560712Z } 2024-08-20T22:05:16.8561033Z echo "${GITHUB_WORKSPACE}" 2024-08-20T22:05:16.8561462Z if [ -z "${NO_SUDO}" ]; then 2024-08-20T22:05:16.8561999Z  retry sudo rm -rf "${GITHUB_WORKSPACE}" 2024-08-20T22:05:16.8562533Z else 2024-08-20T22:05:16.8562887Z  retry rm -rf "${GITHUB_WORKSPACE}" 2024-08-20T22:05:16.8563328Z fi 2024-08-20T22:05:16.8563888Z mkdir "${GITHUB_WORKSPACE}" 2024-08-20T22:05:16.8576250Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:05:16.8576768Z env: 2024-08-20T22:05:16.8577063Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:05:16.8577414Z NO_SUDO: 2024-08-20T22:05:16.8577703Z ##[endgroup] 2024-08-20T22:05:16.8609633Z /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-20T22:05:16.9771450Z ##[group]Run malfet/checkout@silent-checkout 2024-08-20T22:05:16.9771883Z with: 2024-08-20T22:05:16.9772213Z ref: 40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:05:16.9772656Z fetch-depth: 0 2024-08-20T22:05:16.9773098Z submodules: recursive 2024-08-20T22:05:16.9773436Z quiet-checkout: true 2024-08-20T22:05:16.9773787Z repository: pytorch/pytorch 2024-08-20T22:05:16.9774270Z token: *** 2024-08-20T22:05:16.9774565Z ssh-strict: true 2024-08-20T22:05:16.9774886Z persist-credentials: true 2024-08-20T22:05:16.9775243Z clean: true 2024-08-20T22:05:16.9775586Z sparse-checkout-cone-mode: true 2024-08-20T22:05:16.9775972Z lfs: false 2024-08-20T22:05:16.9776270Z set-safe-directory: true 2024-08-20T22:05:16.9776608Z env: 2024-08-20T22:05:16.9776881Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:05:16.9777220Z ##[endgroup] 2024-08-20T22:05:17.0754600Z Syncing repository: pytorch/pytorch 2024-08-20T22:05:17.0756146Z ##[group]Getting Git version info 2024-08-20T22:05:17.0756930Z Working directory is '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2024-08-20T22:05:17.0757786Z [command]/usr/bin/git version 2024-08-20T22:05:17.0758144Z git version 2.40.1 2024-08-20T22:05:17.0759450Z ##[endgroup] 2024-08-20T22:05:17.0773916Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/9677e78d-0746-4dde-b60c-a6e6b4f4ce05' before making global git config changes 2024-08-20T22:05:17.0775161Z Adding repository directory to the temporary git global config as a safe directory 2024-08-20T22:05:17.0778985Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-20T22:05:17.0828900Z Deleting the contents of '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2024-08-20T22:05:17.0832913Z ##[group]Initializing the repository 2024-08-20T22:05:17.0835811Z [command]/usr/bin/git init /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-20T22:05:17.0878061Z hint: Using 'master' as the name for the initial branch. This default branch name 2024-08-20T22:05:17.0879045Z hint: is subject to change. To configure the initial branch name to use in all 2024-08-20T22:05:17.0879850Z hint: of your new repositories, which will suppress this warning, call: 2024-08-20T22:05:17.0880416Z hint: 2024-08-20T22:05:17.0880861Z hint: git config --global init.defaultBranch 2024-08-20T22:05:17.0881329Z hint: 2024-08-20T22:05:17.0881857Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-08-20T22:05:17.0882800Z hint: 'development'. The just-created branch can be renamed via this command: 2024-08-20T22:05:17.0883685Z hint: 2024-08-20T22:05:17.0884029Z hint: git branch -m 2024-08-20T22:05:17.0884782Z Initialized empty Git repository in /home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/ 2024-08-20T22:05:17.0892387Z [command]/usr/bin/git remote add origin https://github.com/pytorch/pytorch 2024-08-20T22:05:17.0934046Z ##[endgroup] 2024-08-20T22:05:17.0934612Z ##[group]Disabling automatic garbage collection 2024-08-20T22:05:17.0936917Z [command]/usr/bin/git config --local gc.auto 0 2024-08-20T22:05:17.0979496Z ##[endgroup] 2024-08-20T22:05:17.0980028Z ##[group]Setting up auth 2024-08-20T22:05:17.0985390Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2024-08-20T22:05:17.1028767Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2024-08-20T22:05:17.1393455Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2024-08-20T22:05:17.1433521Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2024-08-20T22:05:17.1780478Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic *** 2024-08-20T22:05:17.1835414Z ##[endgroup] 2024-08-20T22:05:17.1836090Z ##[group]Fetching the repository 2024-08-20T22:05:17.1841597Z [command]/usr/bin/git -c protocol.version=2 fetch --prune --progress --no-recurse-submodules --quiet origin +refs/heads/*:refs/remotes/origin/* +refs/tags/*:refs/tags/* 2024-08-20T22:05:20.0232890Z remote: Enumerating objects: 1008452 2024-08-20T22:05:20.0234300Z remote: Enumerating objects: 1010208, done. 2024-08-20T22:05:20.0235717Z remote: Counting objects: 0% (1/1756) 2024-08-20T22:05:20.0237005Z remote: Counting objects: 1% (18/1756) 2024-08-20T22:05:20.0238395Z remote: Counting objects: 2% (36/1756) 2024-08-20T22:05:20.0239673Z remote: Counting objects: 3% (53/1756) 2024-08-20T22:05:20.0240963Z remote: Counting objects: 4% (71/1756) 2024-08-20T22:05:20.0242403Z remote: Counting objects: 5% (88/1756) 2024-08-20T22:05:20.0243178Z remote: Counting objects: 6% (106/1756) 2024-08-20T22:05:20.0243859Z remote: Counting objects: 7% (123/1756) 2024-08-20T22:05:20.0244384Z remote: Counting objects: 8% (141/1756) 2024-08-20T22:05:20.0244906Z remote: Counting objects: 9% (159/1756) 2024-08-20T22:05:20.0245472Z remote: Counting objects: 10% (176/1756) 2024-08-20T22:05:20.0245964Z remote: Counting objects: 11% (194/1756) 2024-08-20T22:05:20.0246618Z remote: Counting objects: 12% (211/1756) 2024-08-20T22:05:20.0247302Z remote: Counting objects: 13% (229/1756) 2024-08-20T22:05:20.0247940Z remote: Counting objects: 14% (246/1756) 2024-08-20T22:05:20.0248584Z remote: Counting objects: 15% (264/1756) 2024-08-20T22:05:20.0249219Z remote: Counting objects: 16% (281/1756) 2024-08-20T22:05:20.0250002Z remote: Counting objects: 17% (299/1756) 2024-08-20T22:05:20.0250674Z remote: Counting objects: 18% (317/1756) 2024-08-20T22:05:20.0251313Z remote: Counting objects: 19% (334/1756) 2024-08-20T22:05:20.0251872Z remote: Counting objects: 20% (352/1756) 2024-08-20T22:05:20.0252401Z remote: Counting objects: 21% (369/1756) 2024-08-20T22:05:20.0253049Z remote: Counting objects: 22% (387/1756) 2024-08-20T22:05:20.0253693Z remote: Counting objects: 23% (404/1756) 2024-08-20T22:05:20.0254369Z remote: Counting objects: 24% (422/1756) 2024-08-20T22:05:20.0255019Z remote: Counting objects: 25% (439/1756) 2024-08-20T22:05:20.0255704Z remote: Counting objects: 26% (457/1756) 2024-08-20T22:05:20.0256215Z remote: Counting objects: 27% (475/1756) 2024-08-20T22:05:20.0257043Z remote: Counting objects: 28% (492/1756) 2024-08-20T22:05:20.0257552Z remote: Counting objects: 29% (510/1756) 2024-08-20T22:05:20.0258042Z remote: Counting objects: 30% (527/1756) 2024-08-20T22:05:20.0258687Z remote: Counting objects: 31% (545/1756) 2024-08-20T22:05:20.0259252Z remote: Counting objects: 32% (562/1756) 2024-08-20T22:05:20.0259791Z remote: Counting objects: 33% (580/1756) 2024-08-20T22:05:20.0260451Z remote: Counting objects: 34% (598/1756) 2024-08-20T22:05:20.0261024Z remote: Counting objects: 35% (615/1756) 2024-08-20T22:05:20.0261499Z remote: Counting objects: 36% (633/1756) 2024-08-20T22:05:20.0261992Z remote: Counting objects: 37% (650/1756) 2024-08-20T22:05:20.0262526Z remote: Counting objects: 38% (668/1756) 2024-08-20T22:05:20.0263012Z remote: Counting objects: 39% (685/1756) 2024-08-20T22:05:20.0263487Z remote: Counting objects: 40% (703/1756) 2024-08-20T22:05:20.0264169Z remote: Counting objects: 41% (720/1756) 2024-08-20T22:05:20.0264650Z remote: Counting objects: 42% (738/1756) 2024-08-20T22:05:20.0265130Z remote: Counting objects: 43% (756/1756) 2024-08-20T22:05:20.0265605Z remote: Counting objects: 44% (773/1756) 2024-08-20T22:05:20.0266089Z remote: Counting objects: 45% (791/1756) 2024-08-20T22:05:20.0266572Z remote: Counting objects: 46% (808/1756) 2024-08-20T22:05:20.0267057Z remote: Counting objects: 47% (826/1756) 2024-08-20T22:05:20.0267534Z remote: Counting objects: 48% (843/1756) 2024-08-20T22:05:20.0268018Z remote: Counting objects: 49% (861/1756) 2024-08-20T22:05:20.0268499Z remote: Counting objects: 50% (878/1756) 2024-08-20T22:05:20.0268979Z remote: Counting objects: 51% (896/1756) 2024-08-20T22:05:20.0269452Z remote: Counting objects: 52% (914/1756) 2024-08-20T22:05:20.0269936Z remote: Counting objects: 53% (931/1756) 2024-08-20T22:05:20.0270428Z remote: Counting objects: 54% (949/1756) 2024-08-20T22:05:20.0270908Z remote: Counting objects: 55% (966/1756) 2024-08-20T22:05:20.0271385Z remote: Counting objects: 56% (984/1756) 2024-08-20T22:05:20.0271877Z remote: Counting objects: 57% (1001/1756) 2024-08-20T22:05:20.0272387Z remote: Counting objects: 58% (1019/1756) 2024-08-20T22:05:20.0272893Z remote: Counting objects: 59% (1037/1756) 2024-08-20T22:05:20.0273391Z remote: Counting objects: 60% (1054/1756) 2024-08-20T22:05:20.0273893Z remote: Counting objects: 61% (1072/1756) 2024-08-20T22:05:20.0274396Z remote: Counting objects: 62% (1089/1756) 2024-08-20T22:05:20.0274907Z remote: Counting objects: 63% (1107/1756) 2024-08-20T22:05:20.0275416Z remote: Counting objects: 64% (1124/1756) 2024-08-20T22:05:20.0275910Z remote: Counting objects: 65% (1142/1756) 2024-08-20T22:05:20.0276414Z remote: Counting objects: 66% (1159/1756) 2024-08-20T22:05:20.0276922Z remote: Counting objects: 67% (1177/1756) 2024-08-20T22:05:20.0277418Z remote: Counting objects: 68% (1195/1756) 2024-08-20T22:05:20.0277912Z remote: Counting objects: 69% (1212/1756) 2024-08-20T22:05:20.0278411Z remote: Counting objects: 70% (1230/1756) 2024-08-20T22:05:20.0278908Z remote: Counting objects: 71% (1247/1756) 2024-08-20T22:05:20.0279406Z remote: Counting objects: 72% (1265/1756) 2024-08-20T22:05:20.0279898Z remote: Counting objects: 73% (1282/1756) 2024-08-20T22:05:20.0280393Z remote: Counting objects: 74% (1300/1756) 2024-08-20T22:05:20.0280892Z remote: Counting objects: 75% (1317/1756) 2024-08-20T22:05:20.0281398Z remote: Counting objects: 76% (1335/1756) 2024-08-20T22:05:20.0281906Z remote: Counting objects: 77% (1353/1756) 2024-08-20T22:05:20.0282500Z remote: Counting objects: 78% (1370/1756) 2024-08-20T22:05:20.0283099Z remote: Counting objects: 79% (1388/1756) 2024-08-20T22:05:20.0283605Z remote: Counting objects: 80% (1405/1756) 2024-08-20T22:05:20.0284098Z remote: Counting objects: 81% (1423/1756) 2024-08-20T22:05:20.0284594Z remote: Counting objects: 82% (1440/1756) 2024-08-20T22:05:20.0285148Z remote: Counting objects: 83% (1458/1756) 2024-08-20T22:05:20.0285722Z remote: Counting objects: 84% (1476/1756) 2024-08-20T22:05:20.0286283Z remote: Counting objects: 85% (1493/1756) 2024-08-20T22:05:20.0286817Z remote: Counting objects: 86% (1511/1756) 2024-08-20T22:05:20.0287318Z remote: Counting objects: 87% (1528/1756) 2024-08-20T22:05:20.0287821Z remote: Counting objects: 88% (1546/1756) 2024-08-20T22:05:20.0288326Z remote: Counting objects: 89% (1563/1756) 2024-08-20T22:05:20.0288821Z remote: Counting objects: 90% (1581/1756) 2024-08-20T22:05:20.0289324Z remote: Counting objects: 91% (1598/1756) 2024-08-20T22:05:20.0289940Z remote: Counting objects: 92% (1616/1756) 2024-08-20T22:05:20.0290447Z remote: Counting objects: 93% (1634/1756) 2024-08-20T22:05:20.0290944Z remote: Counting objects: 94% (1651/1756) 2024-08-20T22:05:20.0291448Z remote: Counting objects: 95% (1669/1756) 2024-08-20T22:05:20.0291951Z remote: Counting objects: 96% (1686/1756) 2024-08-20T22:05:20.0292468Z remote: Counting objects: 97% (1704/1756) 2024-08-20T22:05:20.0293018Z remote: Counting objects: 98% (1721/1756) 2024-08-20T22:05:20.0293522Z remote: Counting objects: 99% (1739/1756) 2024-08-20T22:05:20.0294023Z remote: Counting objects: 100% (1756/1756) 2024-08-20T22:05:20.0294566Z remote: Counting objects: 100% (1756/1756), done. 2024-08-20T22:05:20.0413970Z remote: Compressing objects: 0% (1/837) 2024-08-20T22:05:20.0689860Z remote: Compressing objects: 1% (9/837) 2024-08-20T22:05:20.1062216Z remote: Compressing objects: 2% (17/837) 2024-08-20T22:05:20.1459184Z remote: Compressing objects: 3% (26/837) 2024-08-20T22:05:20.2199591Z remote: Compressing objects: 4% (34/837) 2024-08-20T22:05:20.2653171Z remote: Compressing objects: 5% (42/837) 2024-08-20T22:05:20.3242906Z remote: Compressing objects: 6% (51/837) 2024-08-20T22:05:20.3548791Z remote: Compressing objects: 7% (59/837) 2024-08-20T22:05:20.3908518Z remote: Compressing objects: 8% (67/837) 2024-08-20T22:05:20.4110934Z remote: Compressing objects: 9% (76/837) 2024-08-20T22:05:20.4362051Z remote: Compressing objects: 10% (84/837) 2024-08-20T22:05:20.4561651Z remote: Compressing objects: 11% (93/837) 2024-08-20T22:05:20.4726784Z remote: Compressing objects: 12% (101/837) 2024-08-20T22:05:20.4883475Z remote: Compressing objects: 13% (109/837) 2024-08-20T22:05:20.4997496Z remote: Compressing objects: 14% (118/837) 2024-08-20T22:05:20.5082254Z remote: Compressing objects: 15% (126/837) 2024-08-20T22:05:20.5166274Z remote: Compressing objects: 16% (134/837) 2024-08-20T22:05:20.5221666Z remote: Compressing objects: 17% (143/837) 2024-08-20T22:05:20.5271632Z remote: Compressing objects: 18% (151/837) 2024-08-20T22:05:20.5312453Z remote: Compressing objects: 19% (160/837) 2024-08-20T22:05:20.5342115Z remote: Compressing objects: 20% (168/837) 2024-08-20T22:05:20.5363948Z remote: Compressing objects: 21% (176/837) 2024-08-20T22:05:20.5366945Z remote: Compressing objects: 22% (185/837) 2024-08-20T22:05:20.5371357Z remote: Compressing objects: 23% (193/837) 2024-08-20T22:05:20.5377584Z remote: Compressing objects: 24% (201/837) 2024-08-20T22:05:20.5382071Z remote: Compressing objects: 25% (210/837) 2024-08-20T22:05:20.5389785Z remote: Compressing objects: 26% (218/837) 2024-08-20T22:05:20.5400578Z remote: Compressing objects: 27% (226/837) 2024-08-20T22:05:20.5419956Z remote: Compressing objects: 28% (235/837) 2024-08-20T22:05:20.5423905Z remote: Compressing objects: 29% (243/837) 2024-08-20T22:05:20.5435992Z remote: Compressing objects: 30% (252/837) 2024-08-20T22:05:20.5444942Z remote: Compressing objects: 31% (260/837) 2024-08-20T22:05:20.5453274Z remote: Compressing objects: 32% (268/837) 2024-08-20T22:05:20.5458324Z remote: Compressing objects: 33% (277/837) 2024-08-20T22:05:20.5462860Z remote: Compressing objects: 34% (285/837) 2024-08-20T22:05:20.5470253Z remote: Compressing objects: 35% (293/837) 2024-08-20T22:05:20.5476500Z remote: Compressing objects: 36% (302/837) 2024-08-20T22:05:20.5485154Z remote: Compressing objects: 37% (310/837) 2024-08-20T22:05:20.5490412Z remote: Compressing objects: 38% (319/837) 2024-08-20T22:05:20.5496728Z remote: Compressing objects: 39% (327/837) 2024-08-20T22:05:20.5502115Z remote: Compressing objects: 40% (335/837) 2024-08-20T22:05:20.5508657Z remote: Compressing objects: 41% (344/837) 2024-08-20T22:05:20.5515957Z remote: Compressing objects: 42% (352/837) 2024-08-20T22:05:20.5520799Z remote: Compressing objects: 43% (360/837) 2024-08-20T22:05:20.5527233Z remote: Compressing objects: 44% (369/837) 2024-08-20T22:05:20.5533287Z remote: Compressing objects: 45% (377/837) 2024-08-20T22:05:20.5535627Z remote: Compressing objects: 46% (386/837) 2024-08-20T22:05:20.5538979Z remote: Compressing objects: 47% (394/837) 2024-08-20T22:05:20.5542895Z remote: Compressing objects: 48% (402/837) 2024-08-20T22:05:20.5545428Z remote: Compressing objects: 49% (411/837) 2024-08-20T22:05:20.5548165Z remote: Compressing objects: 50% (419/837) 2024-08-20T22:05:20.5551621Z remote: Compressing objects: 51% (427/837) 2024-08-20T22:05:20.5553644Z remote: Compressing objects: 52% (436/837) 2024-08-20T22:05:20.5555473Z remote: Compressing objects: 53% (444/837) 2024-08-20T22:05:20.5557301Z remote: Compressing objects: 54% (452/837) 2024-08-20T22:05:20.5557924Z remote: Compressing objects: 55% (461/837) 2024-08-20T22:05:20.5559943Z remote: Compressing objects: 56% (469/837) 2024-08-20T22:05:20.5560948Z remote: Compressing objects: 57% (478/837) 2024-08-20T22:05:20.5562343Z remote: Compressing objects: 58% (486/837) 2024-08-20T22:05:20.5563115Z remote: Compressing objects: 59% (494/837) 2024-08-20T22:05:20.5563903Z remote: Compressing objects: 60% (503/837) 2024-08-20T22:05:20.5564431Z remote: Compressing objects: 61% (511/837) 2024-08-20T22:05:20.5564963Z remote: Compressing objects: 62% (519/837) 2024-08-20T22:05:20.5565487Z remote: Compressing objects: 63% (528/837) 2024-08-20T22:05:20.5570976Z remote: Compressing objects: 64% (536/837) 2024-08-20T22:05:20.5576495Z remote: Compressing objects: 65% (545/837) 2024-08-20T22:05:20.5581645Z remote: Compressing objects: 66% (553/837) 2024-08-20T22:05:20.5586195Z remote: Compressing objects: 67% (561/837) 2024-08-20T22:05:20.5590940Z remote: Compressing objects: 68% (570/837) 2024-08-20T22:05:20.5593840Z remote: Compressing objects: 69% (578/837) 2024-08-20T22:05:20.5598228Z remote: Compressing objects: 70% (586/837) 2024-08-20T22:05:20.5601236Z remote: Compressing objects: 71% (595/837) 2024-08-20T22:05:20.5604330Z remote: Compressing objects: 72% (603/837) 2024-08-20T22:05:20.5608749Z remote: Compressing objects: 73% (612/837) 2024-08-20T22:05:20.5612380Z remote: Compressing objects: 74% (620/837) 2024-08-20T22:05:20.5614504Z remote: Compressing objects: 75% (628/837) 2024-08-20T22:05:20.5616822Z remote: Compressing objects: 76% (637/837) 2024-08-20T22:05:20.5619892Z remote: Compressing objects: 77% (645/837) 2024-08-20T22:05:20.5621339Z remote: Compressing objects: 78% (653/837) 2024-08-20T22:05:20.5624150Z remote: Compressing objects: 79% (662/837) 2024-08-20T22:05:20.5625597Z remote: Compressing objects: 80% (670/837) 2024-08-20T22:05:20.5627167Z remote: Compressing objects: 81% (678/837) 2024-08-20T22:05:20.5630091Z remote: Compressing objects: 82% (687/837) 2024-08-20T22:05:20.5631489Z remote: Compressing objects: 83% (695/837) 2024-08-20T22:05:20.5633525Z remote: Compressing objects: 84% (704/837) 2024-08-20T22:05:20.5635067Z remote: Compressing objects: 85% (712/837) 2024-08-20T22:05:20.5637504Z remote: Compressing objects: 86% (720/837) 2024-08-20T22:05:20.5638656Z remote: Compressing objects: 87% (729/837) 2024-08-20T22:05:20.5641131Z remote: Compressing objects: 88% (737/837) 2024-08-20T22:05:20.5643714Z remote: Compressing objects: 89% (745/837) 2024-08-20T22:05:20.5645190Z remote: Compressing objects: 90% (754/837) 2024-08-20T22:05:20.5646615Z remote: Compressing objects: 91% (762/837) 2024-08-20T22:05:20.5647447Z remote: Compressing objects: 92% (771/837) 2024-08-20T22:05:20.5647961Z remote: Compressing objects: 93% (779/837) 2024-08-20T22:05:20.5649365Z remote: Compressing objects: 94% (787/837) 2024-08-20T22:05:20.5650686Z remote: Compressing objects: 95% (796/837) 2024-08-20T22:05:20.5652093Z remote: Compressing objects: 96% (804/837) 2024-08-20T22:05:20.5653216Z remote: Compressing objects: 97% (812/837) 2024-08-20T22:05:20.5654409Z remote: Compressing objects: 98% (821/837) 2024-08-20T22:05:20.5656007Z remote: Compressing objects: 99% (829/837) 2024-08-20T22:05:20.5656667Z remote: Compressing objects: 100% (837/837) 2024-08-20T22:05:20.5657229Z remote: Compressing objects: 100% (837/837), done. 2024-08-20T22:05:43.9724833Z remote: Total 1010208 (delta 1154), reused 1394 (delta 916), pack-reused 1008452 (from 1) 2024-08-20T22:06:07.7623270Z [command]/usr/bin/git rev-parse --verify --quiet 40ec5f6ddd9787aca0449b24128343ff4c4a88b3^{object} 2024-08-20T22:06:07.7659333Z 40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:06:07.7664389Z ##[endgroup] 2024-08-20T22:06:07.7666723Z ##[group]Determining the checkout info 2024-08-20T22:06:07.7667378Z ##[endgroup] 2024-08-20T22:06:07.7667898Z ##[group]Checking out the ref 2024-08-20T22:06:07.7669076Z [command]/usr/bin/git checkout --quiet --force 40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:06:09.4777082Z ##[endgroup] 2024-08-20T22:06:09.4777717Z ##[group]Setting up auth for fetching submodules 2024-08-20T22:06:09.4778834Z [command]/usr/bin/git config --global http.https://github.com/.extraheader AUTHORIZATION: basic *** 2024-08-20T22:06:09.4839957Z [command]/usr/bin/git config --global --unset-all url.https://github.com/.insteadOf 2024-08-20T22:06:09.4879327Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf git@github.com: 2024-08-20T22:06:09.4918440Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf org-21003710@github.com: 2024-08-20T22:06:09.4955270Z ##[endgroup] 2024-08-20T22:06:09.4955797Z ##[group]Fetching submodules 2024-08-20T22:06:09.4958731Z [command]/usr/bin/git submodule sync --recursive 2024-08-20T22:06:09.5342140Z [command]/usr/bin/git -c protocol.version=2 submodule update --init --force --recursive 2024-08-20T22:06:09.5706022Z Submodule 'android/libs/fbjni' (https://github.com/facebookincubator/fbjni.git) registered for path 'android/libs/fbjni' 2024-08-20T22:06:09.5708377Z Submodule 'third_party/NNPACK_deps/FP16' (https://github.com/Maratyszcza/FP16.git) registered for path 'third_party/FP16' 2024-08-20T22:06:09.5710556Z Submodule 'third_party/NNPACK_deps/FXdiv' (https://github.com/Maratyszcza/FXdiv.git) registered for path 'third_party/FXdiv' 2024-08-20T22:06:09.5714325Z Submodule 'third_party/NNPACK' (https://github.com/Maratyszcza/NNPACK.git) registered for path 'third_party/NNPACK' 2024-08-20T22:06:09.5718387Z Submodule 'third_party/VulkanMemoryAllocator' (https://github.com/GPUOpen-LibrariesAndSDKs/VulkanMemoryAllocator.git) registered for path 'third_party/VulkanMemoryAllocator' 2024-08-20T22:06:09.5720645Z Submodule 'third_party/XNNPACK' (https://github.com/google/XNNPACK.git) registered for path 'third_party/XNNPACK' 2024-08-20T22:06:09.5724383Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/benchmark' 2024-08-20T22:06:09.5727897Z Submodule 'third_party/cpp-httplib' (https://github.com/yhirose/cpp-httplib.git) registered for path 'third_party/cpp-httplib' 2024-08-20T22:06:09.5731379Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo.git) registered for path 'third_party/cpuinfo' 2024-08-20T22:06:09.5735163Z Submodule 'third_party/cudnn_frontend' (https://github.com/NVIDIA/cudnn-frontend.git) registered for path 'third_party/cudnn_frontend' 2024-08-20T22:06:09.5738713Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/cutlass' 2024-08-20T22:06:09.5743021Z Submodule 'third_party/eigen' (https://gitlab.com/libeigen/eigen.git) registered for path 'third_party/eigen' 2024-08-20T22:06:09.5746850Z Submodule 'third_party/fbgemm' (https://github.com/pytorch/fbgemm) registered for path 'third_party/fbgemm' 2024-08-20T22:06:09.5751251Z Submodule 'third_party/flatbuffers' (https://github.com/google/flatbuffers.git) registered for path 'third_party/flatbuffers' 2024-08-20T22:06:09.5755195Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/fmt' 2024-08-20T22:06:09.5760439Z Submodule 'third_party/gemmlowp/gemmlowp' (https://github.com/google/gemmlowp.git) registered for path 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:06:09.5768039Z Submodule 'third_party/gloo' (https://github.com/facebookincubator/gloo) registered for path 'third_party/gloo' 2024-08-20T22:06:09.5772267Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/googletest' 2024-08-20T22:06:09.5776318Z Submodule 'third_party/ideep' (https://github.com/intel/ideep) registered for path 'third_party/ideep' 2024-08-20T22:06:09.5780802Z Submodule 'third_party/ittapi' (https://github.com/intel/ittapi.git) registered for path 'third_party/ittapi' 2024-08-20T22:06:09.5785142Z Submodule 'third_party/kineto' (https://github.com/pytorch/kineto) registered for path 'third_party/kineto' 2024-08-20T22:06:09.5789669Z Submodule 'third_party/mimalloc' (https://github.com/microsoft/mimalloc.git) registered for path 'third_party/mimalloc' 2024-08-20T22:06:09.5794107Z Submodule 'third_party/nccl/nccl' (https://github.com/NVIDIA/nccl) registered for path 'third_party/nccl/nccl' 2024-08-20T22:06:09.5798700Z Submodule 'third_party/nlohmann' (https://github.com/nlohmann/json.git) registered for path 'third_party/nlohmann' 2024-08-20T22:06:09.5803351Z Submodule 'third_party/onnx' (https://github.com/onnx/onnx.git) registered for path 'third_party/onnx' 2024-08-20T22:06:09.5808446Z Submodule 'third_party/opentelemetry-cpp' (https://github.com/open-telemetry/opentelemetry-cpp.git) registered for path 'third_party/opentelemetry-cpp' 2024-08-20T22:06:09.5812924Z Submodule 'third_party/pocketfft' (https://github.com/mreineck/pocketfft) registered for path 'third_party/pocketfft' 2024-08-20T22:06:09.5817844Z Submodule 'third_party/protobuf' (https://github.com/protocolbuffers/protobuf.git) registered for path 'third_party/protobuf' 2024-08-20T22:06:09.5822765Z Submodule 'third_party/NNPACK_deps/psimd' (https://github.com/Maratyszcza/psimd.git) registered for path 'third_party/psimd' 2024-08-20T22:06:09.5827902Z Submodule 'third_party/NNPACK_deps/pthreadpool' (https://github.com/Maratyszcza/pthreadpool.git) registered for path 'third_party/pthreadpool' 2024-08-20T22:06:09.5832798Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/pybind11' 2024-08-20T22:06:09.5838165Z Submodule 'third_party/python-peachpy' (https://github.com/malfet/PeachPy.git) registered for path 'third_party/python-peachpy' 2024-08-20T22:06:09.5843231Z Submodule 'third_party/sleef' (https://github.com/shibatch/sleef) registered for path 'third_party/sleef' 2024-08-20T22:06:09.5852046Z Submodule 'third_party/tensorpipe' (https://github.com/pytorch/tensorpipe.git) registered for path 'third_party/tensorpipe' 2024-08-20T22:06:09.5887010Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/android/libs/fbjni'... 2024-08-20T22:06:09.8968274Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FP16'... 2024-08-20T22:06:10.0626740Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FXdiv'... 2024-08-20T22:06:10.2383495Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/NNPACK'... 2024-08-20T22:06:10.5272248Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/VulkanMemoryAllocator'... 2024-08-20T22:06:12.3941759Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/XNNPACK'... 2024-08-20T22:06:23.8141570Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/benchmark'... 2024-08-20T22:06:24.2162861Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpp-httplib'... 2024-08-20T22:06:24.6501496Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpuinfo'... 2024-08-20T22:06:25.3040782Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cudnn_frontend'... 2024-08-20T22:06:26.5252981Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cutlass'... 2024-08-20T22:06:28.5980342Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/eigen'... 2024-08-20T22:06:34.4426198Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm'... 2024-08-20T22:06:35.8683100Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/flatbuffers'... 2024-08-20T22:06:37.6904183Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fmt'... 2024-08-20T22:06:39.0100367Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gemmlowp/gemmlowp'... 2024-08-20T22:06:39.4407347Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gloo'... 2024-08-20T22:06:39.7677868Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/googletest'... 2024-08-20T22:06:40.8945717Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep'... 2024-08-20T22:06:41.2463049Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ittapi'... 2024-08-20T22:06:41.5600160Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto'... 2024-08-20T22:06:43.1693552Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/mimalloc'... 2024-08-20T22:06:43.8555077Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nccl/nccl'... 2024-08-20T22:06:44.5673799Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nlohmann'... 2024-08-20T22:06:50.5718689Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx'... 2024-08-20T22:06:52.5439200Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp'... 2024-08-20T22:06:56.7858910Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pocketfft'... 2024-08-20T22:06:57.0090800Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf'... 2024-08-20T22:07:06.1909179Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/psimd'... 2024-08-20T22:07:06.3989572Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pthreadpool'... 2024-08-20T22:07:06.5991966Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pybind11'... 2024-08-20T22:07:07.4583443Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/python-peachpy'... 2024-08-20T22:07:07.7461203Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/sleef'... 2024-08-20T22:07:08.4381888Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe'... 2024-08-20T22:07:08.8531926Z Submodule path 'android/libs/fbjni': checked out '7e1e1fe3858c63c251c637ae41a20de425dde96f' 2024-08-20T22:07:08.8676931Z Submodule path 'third_party/FP16': checked out '4dfe081cf6bcd15db339cf2680b9281b8451eeb3' 2024-08-20T22:07:08.8796153Z Submodule path 'third_party/FXdiv': checked out 'b408327ac2a15ec3e43352421954f5b1967701d1' 2024-08-20T22:07:08.9105255Z Submodule path 'third_party/NNPACK': checked out 'c07e3a0400713d546e0dea2d5466dd22ea389c73' 2024-08-20T22:07:08.9562358Z Submodule path 'third_party/VulkanMemoryAllocator': checked out 'a6bfc237255a6bac1513f7c1ebde6d8aed6b5191' 2024-08-20T22:07:10.1275896Z Submodule path 'third_party/XNNPACK': checked out 'fcbf55af6cf28a4627bcd1f703ab7ad843f0f3a2' 2024-08-20T22:07:10.1563365Z Submodule path 'third_party/benchmark': checked out '0d98dba29d66e93259db7daa53a9327df767a415' 2024-08-20T22:07:10.2090326Z Submodule path 'third_party/cpp-httplib': checked out '3b6597bba913d51161383657829b7e644e59c006' 2024-08-20T22:07:10.3218344Z Submodule path 'third_party/cpuinfo': checked out '3c8b1533ac03dd6531ab6e7b9245d488f13a82a5' 2024-08-20T22:07:10.3619476Z Submodule path 'third_party/cudnn_frontend': checked out '23511ba176243f27b3b275da1fb3814ea805a171' 2024-08-20T22:07:10.9628886Z Submodule path 'third_party/cutlass': checked out 'bbe579a9e3beb6ea6626d9227ec32d0dae119a49' 2024-08-20T22:07:11.2494772Z Submodule path 'third_party/eigen': checked out '3147391d946bb4b6c68edd901f2add6ac1f31f8c' 2024-08-20T22:07:11.3431832Z Submodule path 'third_party/fbgemm': checked out 'dbc3157bf256f1339b3fa1fef2be89ac4078be0e' 2024-08-20T22:07:11.3454302Z Submodule 'third_party/asmjit' (https://github.com/asmjit/asmjit.git) registered for path 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:07:11.3457359Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo) registered for path 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:07:11.3460776Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:07:11.3464324Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:07:11.3467982Z Submodule 'third_party/hipify_torch' (https://github.com/ROCmSoftwarePlatform/hipify_torch.git) registered for path 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:07:11.3498618Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/asmjit'... 2024-08-20T22:07:12.4295709Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cpuinfo'... 2024-08-20T22:07:13.0629289Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cutlass'... 2024-08-20T22:07:15.1410727Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/googletest'... 2024-08-20T22:07:16.1953652Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/hipify_torch'... 2024-08-20T22:07:16.5253843Z Submodule path 'third_party/fbgemm/third_party/asmjit': checked out 'd3fbf7c9bc7c1d1365a94a45614b91c5a3706b81' 2024-08-20T22:07:16.6362166Z Submodule path 'third_party/fbgemm/third_party/cpuinfo': checked out 'ed8b86a253800bafdb7b25c5c399f91bff9cb1f3' 2024-08-20T22:07:17.1485598Z Submodule path 'third_party/fbgemm/third_party/cutlass': checked out 'fc9ebc645b63f3a6bc80aaefde5c063fb72110d6' 2024-08-20T22:07:17.2190204Z Submodule path 'third_party/fbgemm/third_party/googletest': checked out 'cbf019de22c8dd37b2108da35b2748fd702d1796' 2024-08-20T22:07:17.2341119Z Submodule path 'third_party/fbgemm/third_party/hipify_torch': checked out '23f53b025b466d8ec3c45d52290d3442f7fbe6b1' 2024-08-20T22:07:17.3846626Z Submodule path 'third_party/flatbuffers': checked out '01834de25e4bf3975a9a00e816292b1ad0fe184b' 2024-08-20T22:07:17.4304674Z Submodule path 'third_party/fmt': checked out '0c9fce2ffefecfdce794e1859584e25877b7b592' 2024-08-20T22:07:17.4761909Z Submodule path 'third_party/gemmlowp/gemmlowp': checked out '3fb5c176c17c765a3492cd2f0321b0dab712f350' 2024-08-20T22:07:17.5084114Z Submodule path 'third_party/gloo': checked out '5354032ea08eadd7fc4456477f7f7c6308818509' 2024-08-20T22:07:17.5612242Z Submodule path 'third_party/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2024-08-20T22:07:17.5770863Z Submodule path 'third_party/ideep': checked out '55ca0191687aaf19aca5cdb7881c791e3bea442b' 2024-08-20T22:07:17.5791124Z Submodule 'mkl-dnn' (https://github.com/intel/mkl-dnn.git) registered for path 'third_party/ideep/mkl-dnn' 2024-08-20T22:07:17.5824737Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep/mkl-dnn'... 2024-08-20T22:07:30.7523409Z Submodule path 'third_party/ideep/mkl-dnn': checked out '1137e04ec0b5251ca2b4400a4fd3c667ce843d67' 2024-08-20T22:07:30.7741426Z Submodule path 'third_party/ittapi': checked out '5b8a7d7422611c3a0d799fb5fc5dd4abfae35b42' 2024-08-20T22:07:30.8734784Z Submodule path 'third_party/kineto': checked out 'd9753139d181b9ff42872465aac0e5d3018be415' 2024-08-20T22:07:30.8752456Z Submodule 'libkineto/third_party/dynolog' (https://github.com/facebookincubator/dynolog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:07:30.8756040Z Submodule 'libkineto/third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:07:30.8759592Z Submodule 'libkineto/third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:07:30.8790782Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog'... 2024-08-20T22:07:31.4360596Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/fmt'... 2024-08-20T22:07:32.6815518Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/googletest'... 2024-08-20T22:07:33.8396064Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog': checked out '7d04a0053a845370ae06ce317a22a48e9edcc74e' 2024-08-20T22:07:33.8417038Z Submodule 'third_party/DCGM' (https://github.com/NVIDIA/DCGM.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:07:33.8420245Z Submodule 'third_party/cpr' (https://github.com/libcpr/cpr.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:07:33.8423853Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:07:33.8427602Z Submodule 'third_party/gflags' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:07:33.8431353Z Submodule 'third_party/glog' (https://github.com/google/glog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:07:33.8435230Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:07:33.8439063Z Submodule 'third_party/json' (https://github.com/nlohmann/json.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:07:33.8443075Z Submodule 'third_party/pfs' (https://github.com/dtrugman/pfs.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:07:33.8475749Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'... 2024-08-20T22:07:34.7189873Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'... 2024-08-20T22:07:35.1032323Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'... 2024-08-20T22:07:36.3912560Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'... 2024-08-20T22:07:36.6696491Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/glog'... 2024-08-20T22:07:37.2016318Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'... 2024-08-20T22:07:38.3035598Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/json'... 2024-08-20T22:07:45.7757618Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'... 2024-08-20T22:07:46.2089885Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM': checked out 'ffde4e54bc7249a6039a5e6b45b395141e1217f9' 2024-08-20T22:07:46.2322937Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr': checked out '871ed52d350214a034f6ef8a3b8f51c5ce1bd400' 2024-08-20T22:07:46.2749704Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt': checked out 'cd4af11efc9c622896a3e4cb599fa28668ca3d05' 2024-08-20T22:07:46.2917411Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags': checked out 'e171aa2d15ed9eb17054558e0b3a6a413bb01067' 2024-08-20T22:07:46.2936744Z Submodule 'doc' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:07:46.2968393Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'... 2024-08-20T22:07:46.6108860Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc': checked out '8411df715cf522606e3b1aca386ddfc0b63d34b4' 2024-08-20T22:07:46.6335979Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog': checked out 'b33e3bad4c46c8a6345525fd822af355e5ef9446' 2024-08-20T22:07:46.6812066Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest': checked out '58d77fa8070e8cec2dc1ed015d66b454c8d78850' 2024-08-20T22:07:46.8051374Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json': checked out '4f8fba14066156b73f1189a2b8bd568bde5284c5' 2024-08-20T22:07:46.8251541Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs': checked out 'f68a2fa8ea36c783bdd760371411fcb495aa3150' 2024-08-20T22:07:46.8701639Z Submodule path 'third_party/kineto/libkineto/third_party/fmt': checked out '0041a40c1350ba702d475b9c4ad62da77caea164' 2024-08-20T22:07:46.9363957Z Submodule path 'third_party/kineto/libkineto/third_party/googletest': checked out '7aca84427f224eeed3144123d5230d5871e93347' 2024-08-20T22:07:46.9822912Z Submodule path 'third_party/mimalloc': checked out 'b66e3214d8a104669c2ec05ae91ebc26a8f5ab78' 2024-08-20T22:07:47.0121471Z Submodule path 'third_party/nccl/nccl': checked out 'ab2b89c4c339bd7f816fbc114a4b05d386b66290' 2024-08-20T22:07:47.1358096Z Submodule path 'third_party/nlohmann': checked out '87cda1d6646592ac5866dc703c8e1839046a6806' 2024-08-20T22:07:47.6444956Z Submodule path 'third_party/onnx': checked out '3bf92c03a9f27eba3bda1e5b9e63ea20ec213557' 2024-08-20T22:07:47.6481391Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/onnx/third_party/benchmark' 2024-08-20T22:07:47.6484125Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/onnx/third_party/pybind11' 2024-08-20T22:07:47.6516814Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx/third_party/benchmark'... 2024-08-20T22:07:48.1138929Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx/third_party/pybind11'... 2024-08-20T22:07:49.0570098Z Submodule path 'third_party/onnx/third_party/benchmark': checked out '2dd015dfef425c866d9a43f2c67d8b52d709acb6' 2024-08-20T22:07:49.0980405Z Submodule path 'third_party/onnx/third_party/pybind11': checked out '5b0a6fc2017fcc176545afe3e09c9f9885283242' 2024-08-20T22:07:49.1851181Z Submodule path 'third_party/opentelemetry-cpp': checked out 'a799f4aed9c94b765dcdaabaeab7d5e7e2310878' 2024-08-20T22:07:49.1875018Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark) registered for path 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:07:49.1877670Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:07:49.1881303Z Submodule 'third_party/ms-gsl' (https://github.com/microsoft/GSL) registered for path 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:07:49.1885154Z Submodule 'third_party/nlohmann-json' (https://github.com/nlohmann/json) registered for path 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:07:49.1888981Z Submodule 'third_party/opentelemetry-proto' (https://github.com/open-telemetry/opentelemetry-proto) registered for path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:07:49.1892615Z Submodule 'third_party/opentracing-cpp' (https://github.com/opentracing/opentracing-cpp.git) registered for path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:07:49.1896310Z Submodule 'third_party/prometheus-cpp' (https://github.com/jupp0r/prometheus-cpp) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:07:49.1899977Z Submodule 'tools/vcpkg' (https://github.com/Microsoft/vcpkg) registered for path 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:07:49.1931396Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/benchmark'... 2024-08-20T22:07:49.6565276Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/googletest'... 2024-08-20T22:07:50.7006814Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/ms-gsl'... 2024-08-20T22:07:51.0522171Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/nlohmann-json'... 2024-08-20T22:07:57.2248075Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentelemetry-proto'... 2024-08-20T22:07:57.4993847Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentracing-cpp'... 2024-08-20T22:07:57.7005695Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp'... 2024-08-20T22:07:58.0046988Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/tools/vcpkg'... 2024-08-20T22:08:04.7404111Z Submodule path 'third_party/opentelemetry-cpp/third_party/benchmark': checked out 'd572f4777349d43653b21d6c2fc63020ab326db2' 2024-08-20T22:08:04.7885562Z Submodule path 'third_party/opentelemetry-cpp/third_party/googletest': checked out 'b796f7d44681514f58a683a3a71ff17c94edb0c1' 2024-08-20T22:08:04.8079954Z Submodule path 'third_party/opentelemetry-cpp/third_party/ms-gsl': checked out '6f4529395c5b7c2d661812257cd6780c67e54afa' 2024-08-20T22:08:04.9306804Z Submodule path 'third_party/opentelemetry-cpp/third_party/nlohmann-json': checked out 'bc889afb4c5bf1c0d8ee29ef35eaaf4c8bef8a5d' 2024-08-20T22:08:04.9466518Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto': checked out '4ca4f0335c63cda7ab31ea7ed70d6553aee14dce' 2024-08-20T22:08:04.9654668Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp': checked out '06b57f48ded1fa3bdd3d4346f6ef29e40e08eaf5' 2024-08-20T22:08:04.9855649Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp': checked out 'c9ffcdda9086ffd9e1283ea7a0276d831f3c8a8d' 2024-08-20T22:08:04.9873803Z Submodule 'civetweb' (https://github.com/civetweb/civetweb.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:08:04.9877166Z Submodule 'googletest' (https://github.com/google/googletest.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:08:04.9908648Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'... 2024-08-20T22:08:06.8281293Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'... 2024-08-20T22:08:08.2234939Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb': checked out 'eefb26f82b233268fc98577d265352720d477ba4' 2024-08-20T22:08:08.2769247Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2024-08-20T22:08:08.9245668Z Submodule path 'third_party/opentelemetry-cpp/tools/vcpkg': checked out '8eb57355a4ffb410a2e94c07b4dca2dffbee8e50' 2024-08-20T22:08:08.9389736Z Submodule path 'third_party/pocketfft': checked out '9d3ab05a7fffbc71a492bc6a17be034e83e8f0fe' 2024-08-20T22:08:09.2539356Z Submodule path 'third_party/protobuf': checked out 'd1eca4e4b421cd2997495c4b4e65cea6be4e9b8a' 2024-08-20T22:08:09.2566037Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:08:09.2569215Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/protobuf/third_party/googletest' 2024-08-20T22:08:09.2600035Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/benchmark'... 2024-08-20T22:08:09.7524487Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/googletest'... 2024-08-20T22:08:10.8438120Z Submodule path 'third_party/protobuf/third_party/benchmark': checked out '5b7683f49e1e9223cf9927b24f6fd3d6bd82e3f8' 2024-08-20T22:08:10.9251384Z Submodule path 'third_party/protobuf/third_party/googletest': checked out '5ec7f0c4a113e2f18ac2c6cc7df51ad6afc24081' 2024-08-20T22:08:10.9368418Z Submodule path 'third_party/psimd': checked out '072586a71b55b7f8c584153d223e95687148a900' 2024-08-20T22:08:10.9522552Z Submodule path 'third_party/pthreadpool': checked out '4fe0e1e183925bf8cfa6aae24237e724a96479b8' 2024-08-20T22:08:10.9953734Z Submodule path 'third_party/pybind11': checked out '941f45bcb51457884fa1afd6e24a67377d70f75c' 2024-08-20T22:08:11.0288888Z Submodule path 'third_party/python-peachpy': checked out 'f45429b087dd7d5bc78bb40dc7cf06425c252d67' 2024-08-20T22:08:11.0774709Z Submodule path 'third_party/sleef': checked out '60e76d2bce17d278b439d9da17177c8f957a9e9b' 2024-08-20T22:08:11.1109578Z Submodule path 'third_party/tensorpipe': checked out '52791a2fd214b2a9dc5759d36725909c1daa7f2e' 2024-08-20T22:08:11.1129383Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:08:11.1132679Z Submodule 'third_party/libnop' (https://github.com/google/libnop.git) registered for path 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:08:11.1136294Z Submodule 'third_party/libuv' (https://github.com/libuv/libuv.git) registered for path 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:08:11.1139716Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:08:11.1171885Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/googletest'... 2024-08-20T22:08:12.1728123Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libnop'... 2024-08-20T22:08:12.4116900Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libuv'... 2024-08-20T22:08:13.6341616Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11'... 2024-08-20T22:08:14.6112311Z Submodule path 'third_party/tensorpipe/third_party/googletest': checked out 'aee0f9d9b5b87796ee8a0ab26b7587ec30e8858e' 2024-08-20T22:08:14.6307178Z Submodule path 'third_party/tensorpipe/third_party/libnop': checked out '910b55815be16109f04f4180e9adee14fb4ce281' 2024-08-20T22:08:14.7095725Z Submodule path 'third_party/tensorpipe/third_party/libuv': checked out '1dff88e5161cba5c59276d2070d2e304e4dcb242' 2024-08-20T22:08:14.7436999Z Submodule path 'third_party/tensorpipe/third_party/pybind11': checked out 'a23996fce38ff6ccfbcdc09f1e63f2c4be5ea2ef' 2024-08-20T22:08:14.7455672Z Submodule 'tools/clang' (https://github.com/wjakob/clang-cindex-python3) registered for path 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:08:14.7491688Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11/tools/clang'... 2024-08-20T22:08:15.0960536Z Submodule path 'third_party/tensorpipe/third_party/pybind11/tools/clang': checked out '6a00cbc4a9b8e68b71caf7f774b3f9c753ae84d5' 2024-08-20T22:08:15.1007368Z [command]/usr/bin/git submodule foreach --recursive git config --local gc.auto 0 2024-08-20T22:08:15.1366682Z Entering 'android/libs/fbjni' 2024-08-20T22:08:15.1419014Z Entering 'third_party/FP16' 2024-08-20T22:08:15.1470719Z Entering 'third_party/FXdiv' 2024-08-20T22:08:15.1521909Z Entering 'third_party/NNPACK' 2024-08-20T22:08:15.1575339Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T22:08:15.1627091Z Entering 'third_party/XNNPACK' 2024-08-20T22:08:15.1695387Z Entering 'third_party/benchmark' 2024-08-20T22:08:15.1747243Z Entering 'third_party/cpp-httplib' 2024-08-20T22:08:15.1799558Z Entering 'third_party/cpuinfo' 2024-08-20T22:08:15.1855064Z Entering 'third_party/cudnn_frontend' 2024-08-20T22:08:15.1907156Z Entering 'third_party/cutlass' 2024-08-20T22:08:15.1971052Z Entering 'third_party/eigen' 2024-08-20T22:08:15.2025258Z Entering 'third_party/fbgemm' 2024-08-20T22:08:15.2082529Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:08:15.2131253Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:08:15.2181906Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:08:15.2243286Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:08:15.2293419Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:08:15.2345422Z Entering 'third_party/flatbuffers' 2024-08-20T22:08:15.2404983Z Entering 'third_party/fmt' 2024-08-20T22:08:15.2456863Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:08:15.2511260Z Entering 'third_party/gloo' 2024-08-20T22:08:15.2563414Z Entering 'third_party/googletest' 2024-08-20T22:08:15.2614920Z Entering 'third_party/ideep' 2024-08-20T22:08:15.2664783Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T22:08:15.2722678Z Entering 'third_party/ittapi' 2024-08-20T22:08:15.2775558Z Entering 'third_party/kineto' 2024-08-20T22:08:15.2825886Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:08:15.2876569Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:08:15.2930688Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:08:15.2982818Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:08:15.3033606Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:08:15.3083822Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:08:15.3138403Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:08:15.3190037Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:08:15.3240523Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:08:15.3293166Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:08:15.3346792Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:08:15.3397480Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:08:15.3451365Z Entering 'third_party/mimalloc' 2024-08-20T22:08:15.3505441Z Entering 'third_party/nccl/nccl' 2024-08-20T22:08:15.3560986Z Entering 'third_party/nlohmann' 2024-08-20T22:08:15.3615533Z Entering 'third_party/onnx' 2024-08-20T22:08:15.3683374Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T22:08:15.3734369Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T22:08:15.3791175Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T22:08:15.3844928Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:08:15.3898518Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:08:15.3948907Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:08:15.3999099Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:08:15.4050460Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:08:15.4101502Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:08:15.4151349Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:08:15.4203449Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:08:15.4254952Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:08:15.4308748Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:08:15.4380220Z Entering 'third_party/pocketfft' 2024-08-20T22:08:15.4431086Z Entering 'third_party/protobuf' 2024-08-20T22:08:15.4483792Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:08:15.4538141Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T22:08:15.4592652Z Entering 'third_party/psimd' 2024-08-20T22:08:15.4644180Z Entering 'third_party/pthreadpool' 2024-08-20T22:08:15.4696145Z Entering 'third_party/pybind11' 2024-08-20T22:08:15.4748565Z Entering 'third_party/python-peachpy' 2024-08-20T22:08:15.4799754Z Entering 'third_party/sleef' 2024-08-20T22:08:15.4851764Z Entering 'third_party/tensorpipe' 2024-08-20T22:08:15.4902393Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:08:15.4958080Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:08:15.5007768Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:08:15.5058254Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:08:15.5106264Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:08:15.5180926Z ##[endgroup] 2024-08-20T22:08:15.5183853Z ##[group]Persisting credentials for submodules 2024-08-20T22:08:15.5187021Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'url\.https\:\/\/github\.com\/\.insteadOf' && git config --local --unset-all 'url.https://github.com/.insteadOf' || :" 2024-08-20T22:08:15.5552056Z Entering 'android/libs/fbjni' 2024-08-20T22:08:15.5619824Z Entering 'third_party/FP16' 2024-08-20T22:08:15.5688709Z Entering 'third_party/FXdiv' 2024-08-20T22:08:15.5755662Z Entering 'third_party/NNPACK' 2024-08-20T22:08:15.5827056Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T22:08:15.5895709Z Entering 'third_party/XNNPACK' 2024-08-20T22:08:15.5978228Z Entering 'third_party/benchmark' 2024-08-20T22:08:15.6046244Z Entering 'third_party/cpp-httplib' 2024-08-20T22:08:15.6114344Z Entering 'third_party/cpuinfo' 2024-08-20T22:08:15.6188175Z Entering 'third_party/cudnn_frontend' 2024-08-20T22:08:15.6256880Z Entering 'third_party/cutlass' 2024-08-20T22:08:15.6331773Z Entering 'third_party/eigen' 2024-08-20T22:08:15.6402188Z Entering 'third_party/fbgemm' 2024-08-20T22:08:15.6468895Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:08:15.6535708Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:08:15.6603251Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:08:15.6676865Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:08:15.6743496Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:08:15.6813039Z Entering 'third_party/flatbuffers' 2024-08-20T22:08:15.6882646Z Entering 'third_party/fmt' 2024-08-20T22:08:15.6948912Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:08:15.7019017Z Entering 'third_party/gloo' 2024-08-20T22:08:15.7086294Z Entering 'third_party/googletest' 2024-08-20T22:08:15.7153530Z Entering 'third_party/ideep' 2024-08-20T22:08:15.7222672Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T22:08:15.7297509Z Entering 'third_party/ittapi' 2024-08-20T22:08:15.7365936Z Entering 'third_party/kineto' 2024-08-20T22:08:15.7431076Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:08:15.7495571Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:08:15.7568168Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:08:15.7634786Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:08:15.7701946Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:08:15.7767709Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:08:15.7840084Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:08:15.7909830Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:08:15.7978010Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:08:15.8046747Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:08:15.8118801Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:08:15.8189376Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:08:15.8259398Z Entering 'third_party/mimalloc' 2024-08-20T22:08:15.8327405Z Entering 'third_party/nccl/nccl' 2024-08-20T22:08:15.8396649Z Entering 'third_party/nlohmann' 2024-08-20T22:08:15.8467954Z Entering 'third_party/onnx' 2024-08-20T22:08:15.8548617Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T22:08:15.8616331Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T22:08:15.8687394Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T22:08:15.8756638Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:08:15.8821686Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:08:15.8886668Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:08:15.8951397Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:08:15.9020183Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:08:15.9085563Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:08:15.9150707Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:08:15.9214773Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:08:15.9283365Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:08:15.9353583Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:08:15.9439487Z Entering 'third_party/pocketfft' 2024-08-20T22:08:15.9505726Z Entering 'third_party/protobuf' 2024-08-20T22:08:15.9574931Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:08:15.9640260Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T22:08:15.9711925Z Entering 'third_party/psimd' 2024-08-20T22:08:15.9779723Z Entering 'third_party/pthreadpool' 2024-08-20T22:08:15.9847043Z Entering 'third_party/pybind11' 2024-08-20T22:08:15.9916256Z Entering 'third_party/python-peachpy' 2024-08-20T22:08:15.9989884Z Entering 'third_party/sleef' 2024-08-20T22:08:16.0057881Z Entering 'third_party/tensorpipe' 2024-08-20T22:08:16.0124892Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:08:16.0194380Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:08:16.0264144Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:08:16.0328477Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:08:16.0391582Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:08:16.0483684Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local 'http.https://github.com/.extraheader' 'AUTHORIZATION: basic ***' && git config --local --show-origin --name-only --get-regexp remote.origin.url" 2024-08-20T22:08:16.0843561Z Entering 'android/libs/fbjni' 2024-08-20T22:08:16.0907260Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/android/libs/fbjni/config remote.origin.url 2024-08-20T22:08:16.0929503Z Entering 'third_party/FP16' 2024-08-20T22:08:16.0991072Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FP16/config remote.origin.url 2024-08-20T22:08:16.1012509Z Entering 'third_party/FXdiv' 2024-08-20T22:08:16.1073935Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FXdiv/config remote.origin.url 2024-08-20T22:08:16.1095160Z Entering 'third_party/NNPACK' 2024-08-20T22:08:16.1154923Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK/config remote.origin.url 2024-08-20T22:08:16.1176801Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T22:08:16.1237738Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/VulkanMemoryAllocator/config remote.origin.url 2024-08-20T22:08:16.1260500Z Entering 'third_party/XNNPACK' 2024-08-20T22:08:16.1322205Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/XNNPACK/config remote.origin.url 2024-08-20T22:08:16.1359510Z Entering 'third_party/benchmark' 2024-08-20T22:08:16.1422009Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/benchmark/config remote.origin.url 2024-08-20T22:08:16.1440681Z Entering 'third_party/cpp-httplib' 2024-08-20T22:08:16.1501364Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpp-httplib/config remote.origin.url 2024-08-20T22:08:16.1523425Z Entering 'third_party/cpuinfo' 2024-08-20T22:08:16.1589631Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpuinfo/config remote.origin.url 2024-08-20T22:08:16.1611148Z Entering 'third_party/cudnn_frontend' 2024-08-20T22:08:16.1673094Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cudnn_frontend/config remote.origin.url 2024-08-20T22:08:16.1695386Z Entering 'third_party/cutlass' 2024-08-20T22:08:16.1758309Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cutlass/config remote.origin.url 2024-08-20T22:08:16.1787876Z Entering 'third_party/eigen' 2024-08-20T22:08:16.1849652Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/eigen/config remote.origin.url 2024-08-20T22:08:16.1873318Z Entering 'third_party/fbgemm' 2024-08-20T22:08:16.1940090Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/config remote.origin.url 2024-08-20T22:08:16.1960384Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:08:16.2021376Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/asmjit/config remote.origin.url 2024-08-20T22:08:16.2040913Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:08:16.2102649Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cpuinfo/config remote.origin.url 2024-08-20T22:08:16.2127604Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:08:16.2188267Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cutlass/config remote.origin.url 2024-08-20T22:08:16.2214696Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:08:16.2275827Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/googletest/config remote.origin.url 2024-08-20T22:08:16.2299146Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:08:16.2359909Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/hipify_torch/config remote.origin.url 2024-08-20T22:08:16.2382351Z Entering 'third_party/flatbuffers' 2024-08-20T22:08:16.2443193Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/flatbuffers/config remote.origin.url 2024-08-20T22:08:16.2470082Z Entering 'third_party/fmt' 2024-08-20T22:08:16.2531091Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fmt/config remote.origin.url 2024-08-20T22:08:16.2553101Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:08:16.2614607Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gemmlowp/gemmlowp/config remote.origin.url 2024-08-20T22:08:16.2636380Z Entering 'third_party/gloo' 2024-08-20T22:08:16.2698145Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gloo/config remote.origin.url 2024-08-20T22:08:16.2719872Z Entering 'third_party/googletest' 2024-08-20T22:08:16.2781871Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/googletest/config remote.origin.url 2024-08-20T22:08:16.2803953Z Entering 'third_party/ideep' 2024-08-20T22:08:16.2866690Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/config remote.origin.url 2024-08-20T22:08:16.2886342Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T22:08:16.2947172Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/modules/mkl-dnn/config remote.origin.url 2024-08-20T22:08:16.2977709Z Entering 'third_party/ittapi' 2024-08-20T22:08:16.3039766Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ittapi/config remote.origin.url 2024-08-20T22:08:16.3059580Z Entering 'third_party/kineto' 2024-08-20T22:08:16.3120388Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/config remote.origin.url 2024-08-20T22:08:16.3140248Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:08:16.3204300Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/config remote.origin.url 2024-08-20T22:08:16.3223520Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:08:16.3285869Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/DCGM/config remote.origin.url 2024-08-20T22:08:16.3307557Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:08:16.3369678Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/cpr/config remote.origin.url 2024-08-20T22:08:16.3389926Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:08:16.3452164Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/fmt/config remote.origin.url 2024-08-20T22:08:16.3472853Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:08:16.3535362Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/config remote.origin.url 2024-08-20T22:08:16.3553779Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:08:16.3616553Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/modules/doc/config remote.origin.url 2024-08-20T22:08:16.3639779Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:08:16.3702285Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/glog/config remote.origin.url 2024-08-20T22:08:16.3722727Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:08:16.3784889Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/googletest/config remote.origin.url 2024-08-20T22:08:16.3807671Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:08:16.3869832Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/json/config remote.origin.url 2024-08-20T22:08:16.3891474Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:08:16.3954531Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/pfs/config remote.origin.url 2024-08-20T22:08:16.3978088Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:08:16.4039142Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/fmt/config remote.origin.url 2024-08-20T22:08:16.4060358Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:08:16.4121525Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/googletest/config remote.origin.url 2024-08-20T22:08:16.4145035Z Entering 'third_party/mimalloc' 2024-08-20T22:08:16.4207914Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/mimalloc/config remote.origin.url 2024-08-20T22:08:16.4229737Z Entering 'third_party/nccl/nccl' 2024-08-20T22:08:16.4291438Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nccl/nccl/config remote.origin.url 2024-08-20T22:08:16.4313459Z Entering 'third_party/nlohmann' 2024-08-20T22:08:16.4384010Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nlohmann/config remote.origin.url 2024-08-20T22:08:16.4406680Z Entering 'third_party/onnx' 2024-08-20T22:08:16.4468115Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/config remote.origin.url 2024-08-20T22:08:16.4502071Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T22:08:16.4569134Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/benchmark/config remote.origin.url 2024-08-20T22:08:16.4590606Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T22:08:16.4654703Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/pybind11/config remote.origin.url 2024-08-20T22:08:16.4680772Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T22:08:16.4743138Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/config remote.origin.url 2024-08-20T22:08:16.4765842Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:08:16.4824888Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/benchmark/config remote.origin.url 2024-08-20T22:08:16.4844906Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:08:16.4910315Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/googletest/config remote.origin.url 2024-08-20T22:08:16.4930482Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:08:16.4991613Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/ms-gsl/config remote.origin.url 2024-08-20T22:08:16.5011543Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:08:16.5073852Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/nlohmann-json/config remote.origin.url 2024-08-20T22:08:16.5093567Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:08:16.5154304Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentelemetry-proto/config remote.origin.url 2024-08-20T22:08:16.5174455Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:08:16.5234793Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentracing-cpp/config remote.origin.url 2024-08-20T22:08:16.5254798Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:08:16.5317370Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/config remote.origin.url 2024-08-20T22:08:16.5333977Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:08:16.5395949Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/civetweb/config remote.origin.url 2024-08-20T22:08:16.5421463Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:08:16.5483286Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/googletest/config remote.origin.url 2024-08-20T22:08:16.5510624Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:08:16.5572035Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/tools/vcpkg/config remote.origin.url 2024-08-20T22:08:16.5616827Z Entering 'third_party/pocketfft' 2024-08-20T22:08:16.5679481Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pocketfft/config remote.origin.url 2024-08-20T22:08:16.5700877Z Entering 'third_party/protobuf' 2024-08-20T22:08:16.5763053Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/config remote.origin.url 2024-08-20T22:08:16.5786344Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:08:16.5848005Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/benchmark/config remote.origin.url 2024-08-20T22:08:16.5868868Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T22:08:16.5929977Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/googletest/config remote.origin.url 2024-08-20T22:08:16.5953981Z Entering 'third_party/psimd' 2024-08-20T22:08:16.6019865Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/psimd/config remote.origin.url 2024-08-20T22:08:16.6040569Z Entering 'third_party/pthreadpool' 2024-08-20T22:08:16.6110884Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/pthreadpool/config remote.origin.url 2024-08-20T22:08:16.6131786Z Entering 'third_party/pybind11' 2024-08-20T22:08:16.6191623Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pybind11/config remote.origin.url 2024-08-20T22:08:16.6213628Z Entering 'third_party/python-peachpy' 2024-08-20T22:08:16.6274850Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/python-peachpy/config remote.origin.url 2024-08-20T22:08:16.6295923Z Entering 'third_party/sleef' 2024-08-20T22:08:16.6356831Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/sleef/config remote.origin.url 2024-08-20T22:08:16.6378956Z Entering 'third_party/tensorpipe' 2024-08-20T22:08:16.6440341Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/config remote.origin.url 2024-08-20T22:08:16.6460133Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:08:16.6519770Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/googletest/config remote.origin.url 2024-08-20T22:08:16.6539779Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:08:16.6599969Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libnop/config remote.origin.url 2024-08-20T22:08:16.6619799Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:08:16.6681958Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libuv/config remote.origin.url 2024-08-20T22:08:16.6702173Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:08:16.6762957Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/config remote.origin.url 2024-08-20T22:08:16.6780873Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:08:16.6841804Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/modules/tools/clang/config remote.origin.url 2024-08-20T22:08:16.7798837Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'git@github.com:' 2024-08-20T22:08:16.8160373Z Entering 'android/libs/fbjni' 2024-08-20T22:08:16.8212997Z Entering 'third_party/FP16' 2024-08-20T22:08:16.8265912Z Entering 'third_party/FXdiv' 2024-08-20T22:08:16.8318012Z Entering 'third_party/NNPACK' 2024-08-20T22:08:16.8371432Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T22:08:16.8423877Z Entering 'third_party/XNNPACK' 2024-08-20T22:08:16.8491759Z Entering 'third_party/benchmark' 2024-08-20T22:08:16.8543146Z Entering 'third_party/cpp-httplib' 2024-08-20T22:08:16.8594405Z Entering 'third_party/cpuinfo' 2024-08-20T22:08:16.8647653Z Entering 'third_party/cudnn_frontend' 2024-08-20T22:08:16.8699082Z Entering 'third_party/cutlass' 2024-08-20T22:08:16.8758347Z Entering 'third_party/eigen' 2024-08-20T22:08:16.8811416Z Entering 'third_party/fbgemm' 2024-08-20T22:08:16.8861890Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:08:16.8913311Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:08:16.8968406Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:08:16.9025401Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:08:16.9075335Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:08:16.9133252Z Entering 'third_party/flatbuffers' 2024-08-20T22:08:16.9190286Z Entering 'third_party/fmt' 2024-08-20T22:08:16.9242299Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:08:16.9295468Z Entering 'third_party/gloo' 2024-08-20T22:08:16.9347376Z Entering 'third_party/googletest' 2024-08-20T22:08:16.9399770Z Entering 'third_party/ideep' 2024-08-20T22:08:16.9450257Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T22:08:16.9508624Z Entering 'third_party/ittapi' 2024-08-20T22:08:16.9560315Z Entering 'third_party/kineto' 2024-08-20T22:08:16.9611322Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:08:16.9660448Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:08:16.9712581Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:08:16.9763292Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:08:16.9812474Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:08:16.9860443Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:08:16.9914655Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:08:16.9964947Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:08:17.0014540Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:08:17.0065291Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:08:17.0118448Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:08:17.0171513Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:08:17.0223211Z Entering 'third_party/mimalloc' 2024-08-20T22:08:17.0275556Z Entering 'third_party/nccl/nccl' 2024-08-20T22:08:17.0326440Z Entering 'third_party/nlohmann' 2024-08-20T22:08:17.0378885Z Entering 'third_party/onnx' 2024-08-20T22:08:17.0442962Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T22:08:17.0499067Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T22:08:17.0555672Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T22:08:17.0608896Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:08:17.0659070Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:08:17.0709520Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:08:17.0759693Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:08:17.0810475Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:08:17.0859620Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:08:17.0908627Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:08:17.0957004Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:08:17.1010483Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:08:17.1061615Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:08:17.1132990Z Entering 'third_party/pocketfft' 2024-08-20T22:08:17.1185204Z Entering 'third_party/protobuf' 2024-08-20T22:08:17.1273793Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:08:17.1328710Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T22:08:17.1383186Z Entering 'third_party/psimd' 2024-08-20T22:08:17.1435975Z Entering 'third_party/pthreadpool' 2024-08-20T22:08:17.1487698Z Entering 'third_party/pybind11' 2024-08-20T22:08:17.1539680Z Entering 'third_party/python-peachpy' 2024-08-20T22:08:17.1592052Z Entering 'third_party/sleef' 2024-08-20T22:08:17.1644121Z Entering 'third_party/tensorpipe' 2024-08-20T22:08:17.1697137Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:08:17.1746184Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:08:17.1796535Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:08:17.1851652Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:08:17.1899767Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:08:17.1975380Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'org-21003710@github.com:' 2024-08-20T22:08:17.2335907Z Entering 'android/libs/fbjni' 2024-08-20T22:08:17.2388064Z Entering 'third_party/FP16' 2024-08-20T22:08:17.2440005Z Entering 'third_party/FXdiv' 2024-08-20T22:08:17.2492749Z Entering 'third_party/NNPACK' 2024-08-20T22:08:17.2545358Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T22:08:17.2597947Z Entering 'third_party/XNNPACK' 2024-08-20T22:08:17.2665489Z Entering 'third_party/benchmark' 2024-08-20T22:08:17.2716874Z Entering 'third_party/cpp-httplib' 2024-08-20T22:08:17.2768634Z Entering 'third_party/cpuinfo' 2024-08-20T22:08:17.2821699Z Entering 'third_party/cudnn_frontend' 2024-08-20T22:08:17.2873322Z Entering 'third_party/cutlass' 2024-08-20T22:08:17.2932486Z Entering 'third_party/eigen' 2024-08-20T22:08:17.2986103Z Entering 'third_party/fbgemm' 2024-08-20T22:08:17.3036476Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:08:17.3088157Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:08:17.3138481Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:08:17.3195645Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:08:17.3245187Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:08:17.3298589Z Entering 'third_party/flatbuffers' 2024-08-20T22:08:17.3355105Z Entering 'third_party/fmt' 2024-08-20T22:08:17.3407593Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:08:17.3460441Z Entering 'third_party/gloo' 2024-08-20T22:08:17.3512857Z Entering 'third_party/googletest' 2024-08-20T22:08:17.3565766Z Entering 'third_party/ideep' 2024-08-20T22:08:17.3616114Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T22:08:17.3675497Z Entering 'third_party/ittapi' 2024-08-20T22:08:17.3727788Z Entering 'third_party/kineto' 2024-08-20T22:08:17.3779491Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:08:17.3829069Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:08:17.3882055Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:08:17.3932913Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:08:17.3984464Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:08:17.4032760Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:08:17.4092686Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:08:17.4142252Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:08:17.4194548Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:08:17.4247689Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:08:17.4300604Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:08:17.4350986Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:08:17.4404539Z Entering 'third_party/mimalloc' 2024-08-20T22:08:17.4457410Z Entering 'third_party/nccl/nccl' 2024-08-20T22:08:17.4510211Z Entering 'third_party/nlohmann' 2024-08-20T22:08:17.4564132Z Entering 'third_party/onnx' 2024-08-20T22:08:17.4629618Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T22:08:17.4681048Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T22:08:17.4737611Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T22:08:17.4793707Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:08:17.4848511Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:08:17.4898533Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:08:17.4948692Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:08:17.5002538Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:08:17.5053216Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:08:17.5103051Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:08:17.5151156Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:08:17.5204097Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:08:17.5260647Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:08:17.5333551Z Entering 'third_party/pocketfft' 2024-08-20T22:08:17.5386718Z Entering 'third_party/protobuf' 2024-08-20T22:08:17.5440494Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:08:17.5491096Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T22:08:17.5545259Z Entering 'third_party/psimd' 2024-08-20T22:08:17.5597808Z Entering 'third_party/pthreadpool' 2024-08-20T22:08:17.5648305Z Entering 'third_party/pybind11' 2024-08-20T22:08:17.5702528Z Entering 'third_party/python-peachpy' 2024-08-20T22:08:17.5754120Z Entering 'third_party/sleef' 2024-08-20T22:08:17.5805387Z Entering 'third_party/tensorpipe' 2024-08-20T22:08:17.5855695Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:08:17.5906054Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:08:17.5959189Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:08:17.6009047Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:08:17.6057021Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:08:17.6129094Z ##[endgroup] 2024-08-20T22:08:17.6177937Z [command]/usr/bin/git log -1 --format='%H' 2024-08-20T22:08:17.6212991Z '40ec5f6ddd9787aca0449b24128343ff4c4a88b3' 2024-08-20T22:08:17.6431195Z Prepare all required actions 2024-08-20T22:08:17.6431649Z Getting action download info 2024-08-20T22:08:17.8134253Z ##[group]Run ./.github/actions/setup-linux 2024-08-20T22:08:17.8134679Z env: 2024-08-20T22:08:17.8134961Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:17.8135317Z ##[endgroup] 2024-08-20T22:08:17.8195409Z ##[group]Run set -euo pipefail 2024-08-20T22:08:17.8195840Z set -euo pipefail 2024-08-20T22:08:17.8196236Z function get_ec2_metadata() { 2024-08-20T22:08:17.8196774Z  # Pulled from instance metadata endpoint for EC2 2024-08-20T22:08:17.8197650Z  # see https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/instancedata-data-retrieval.html 2024-08-20T22:08:17.8198409Z  category=$1 2024-08-20T22:08:17.8198942Z  # If it is GCP runner (runner name contains gcp), do not run this 2024-08-20T22:08:17.8199581Z  runner_name_str=i-0e82ebf4b91cdd7d9 2024-08-20T22:08:17.8200078Z  if [[ -f /.inarc ]]; then 2024-08-20T22:08:17.8200575Z  echo "ARC Runner, no info on ec2 metadata" 2024-08-20T22:08:17.8201144Z  elif [[ $runner_name_str == *"gcp"* ]]; then 2024-08-20T22:08:17.8201830Z  echo "Runner is from Google Cloud Platform, No info on ec2 metadata" 2024-08-20T22:08:17.8202504Z  else 2024-08-20T22:08:17.8203001Z  curl -fsSL "http://169.254.169.254/latest/meta-data/${category}" 2024-08-20T22:08:17.8203572Z  fi 2024-08-20T22:08:17.8203865Z } 2024-08-20T22:08:17.8204223Z echo "ami-id: $(get_ec2_metadata ami-id)" 2024-08-20T22:08:17.8204809Z echo "instance-id: $(get_ec2_metadata instance-id)" 2024-08-20T22:08:17.8205463Z echo "instance-type: $(get_ec2_metadata instance-type)" 2024-08-20T22:08:17.8206029Z echo "system info $(uname -a)" 2024-08-20T22:08:17.8217097Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:08:17.8217595Z env: 2024-08-20T22:08:17.8217877Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:17.8218222Z ##[endgroup] 2024-08-20T22:08:17.8329898Z ami-id: ami-06c68f701d8090592 2024-08-20T22:08:17.8387907Z instance-id: i-0e82ebf4b91cdd7d9 2024-08-20T22:08:17.8443932Z instance-type: g5.4xlarge 2024-08-20T22:08:17.8458690Z system info Linux ip-10-0-64-172.ec2.internal 6.1.94-99.176.amzn2023.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Jun 18 14:57:56 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux 2024-08-20T22:08:17.8484076Z ##[group]Run echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> $GITHUB_OUTPUT 2024-08-20T22:08:17.8484988Z echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> $GITHUB_OUTPUT 2024-08-20T22:08:17.8493871Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:08:17.8494368Z env: 2024-08-20T22:08:17.8494652Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:17.8494999Z ##[endgroup] 2024-08-20T22:08:17.8580187Z ##[group]Run if systemctl is-active --quiet docker; then 2024-08-20T22:08:17.8580805Z if systemctl is-active --quiet docker; then 2024-08-20T22:08:17.8581347Z  echo "Docker daemon is running..."; 2024-08-20T22:08:17.8581804Z else 2024-08-20T22:08:17.8582298Z  echo "Starting docker deamon..." && sudo systemctl start docker; 2024-08-20T22:08:17.8583039Z fi 2024-08-20T22:08:17.8594738Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:08:17.8595238Z env: 2024-08-20T22:08:17.8595521Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:17.8596343Z ##[endgroup] 2024-08-20T22:08:17.8688972Z Docker daemon is running... 2024-08-20T22:08:17.8744050Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2024-08-20T22:08:17.8744608Z with: 2024-08-20T22:08:17.8744883Z shell: bash 2024-08-20T22:08:17.8745180Z timeout_minutes: 5 2024-08-20T22:08:17.8745509Z max_attempts: 3 2024-08-20T22:08:17.8745830Z retry_wait_seconds: 30 2024-08-20T22:08:17.8748934Z command: AWS_ACCOUNT_ID=$(aws sts get-caller-identity|grep Account|cut -f4 -d\") aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \ --password-stdin "$AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com" # For LF Runners we need to make sure we also login to Meta's ECR docker registry too. META_AWS_ACCOUNT_ID=308535385114 if [ "$AWS_ACCOUNT_ID" != "$META_AWS_ACCOUNT_ID" ] ; then aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \ --password-stdin "$META_AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com" fi 2024-08-20T22:08:17.8752098Z polling_interval_seconds: 1 2024-08-20T22:08:17.8752485Z warning_on_retry: true 2024-08-20T22:08:17.8752839Z continue_on_error: false 2024-08-20T22:08:17.8753179Z env: 2024-08-20T22:08:17.8753461Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:17.8753823Z AWS_RETRY_MODE: standard 2024-08-20T22:08:17.8754173Z AWS_MAX_ATTEMPTS: 5 2024-08-20T22:08:17.8754523Z AWS_DEFAULT_REGION: us-east-1 2024-08-20T22:08:17.8754905Z ##[endgroup] 2024-08-20T22:08:19.0712381Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-08-20T22:08:19.0713426Z Configure a credential helper to remove this warning. See 2024-08-20T22:08:19.0714539Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-08-20T22:08:19.0715267Z 2024-08-20T22:08:19.0715424Z Login Succeeded 2024-08-20T22:08:19.9306883Z Command completed after 1 attempt(s). 2024-08-20T22:08:19.9369346Z ##[group]Run env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-08-20T22:08:19.9370058Z env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-08-20T22:08:19.9370709Z env | grep '^CI' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-08-20T22:08:19.9379689Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:08:19.9380178Z env: 2024-08-20T22:08:19.9380457Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:19.9380807Z ##[endgroup] 2024-08-20T22:08:19.9474287Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2024-08-20T22:08:19.9475042Z # ignore expansion of "docker ps -q" since it could be empty 2024-08-20T22:08:19.9475625Z # shellcheck disable=SC2046 2024-08-20T22:08:19.9476084Z docker stop $(docker ps -q) || true 2024-08-20T22:08:19.9476566Z # Prune all of the docker images 2024-08-20T22:08:19.9477013Z docker system prune -af 2024-08-20T22:08:19.9485362Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:08:19.9485914Z env: 2024-08-20T22:08:19.9486195Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:19.9486545Z ##[endgroup] 2024-08-20T22:08:19.9797499Z "docker stop" requires at least 1 argument. 2024-08-20T22:08:19.9798411Z See 'docker stop --help'. 2024-08-20T22:08:19.9798723Z 2024-08-20T22:08:19.9799006Z Usage: docker stop [OPTIONS] CONTAINER [CONTAINER...] 2024-08-20T22:08:19.9799517Z 2024-08-20T22:08:19.9799712Z Stop one or more running containers 2024-08-20T22:08:20.0259065Z Total reclaimed space: 0B 2024-08-20T22:08:20.0303094Z ##[group]Run set +e 2024-08-20T22:08:20.0303468Z set +e 2024-08-20T22:08:20.0303787Z set -x 2024-08-20T22:08:20.0304457Z  2024-08-20T22:08:20.0304783Z PT_DOMAIN=download.pytorch.org 2024-08-20T22:08:20.0305728Z # TODO: Flaky access to download.pytorch.org https://github.com/pytorch/pytorch/issues/100400, 2024-08-20T22:08:20.0306789Z # cleaning this up once the issue is fixed. There are more than one resolved IP here, the last 2024-08-20T22:08:20.0307536Z # one is returned at random 2024-08-20T22:08:20.0308083Z RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" | tail -n1) 2024-08-20T22:08:20.0308591Z  2024-08-20T22:08:20.0308913Z if [ -z "${RESOLVED_IP}" ]; then 2024-08-20T22:08:20.0309531Z  echo "Couldn't resolve ${PT_DOMAIN}, retrying with Google DNS..." 2024-08-20T22:08:20.0310447Z  RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" @8.8.8.8 | tail -n1) 2024-08-20T22:08:20.0311001Z  2024-08-20T22:08:20.0311335Z  if [ -z "${RESOLVED_IP}" ]; then 2024-08-20T22:08:20.0311892Z  echo "Couldn't resolve ${PT_DOMAIN}, exiting..." 2024-08-20T22:08:20.0312403Z  exit 1 2024-08-20T22:08:20.0312725Z  fi 2024-08-20T22:08:20.0313018Z fi 2024-08-20T22:08:20.0313304Z  2024-08-20T22:08:20.0313669Z if grep -r "${PT_DOMAIN}" /etc/hosts; then 2024-08-20T22:08:20.0314181Z  # Clean up any old records first 2024-08-20T22:08:20.0314699Z  sudo sed -i "/${PT_DOMAIN}/d" /etc/hosts 2024-08-20T22:08:20.0315212Z fi 2024-08-20T22:08:20.0315489Z  2024-08-20T22:08:20.0315922Z echo "${RESOLVED_IP} ${PT_DOMAIN}" | sudo tee -a /etc/hosts 2024-08-20T22:08:20.0316468Z cat /etc/hosts 2024-08-20T22:08:20.0325361Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:08:20.0325854Z env: 2024-08-20T22:08:20.0326145Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:20.0326498Z ##[endgroup] 2024-08-20T22:08:20.0355941Z + PT_DOMAIN=download.pytorch.org 2024-08-20T22:08:20.0362541Z ++ dig -4 +short download.pytorch.org 2024-08-20T22:08:20.0363162Z ++ tail -n1 2024-08-20T22:08:20.0819535Z + RESOLVED_IP=18.160.10.76 2024-08-20T22:08:20.0820086Z + '[' -z 18.160.10.76 ']' 2024-08-20T22:08:20.0820524Z + grep -r download.pytorch.org /etc/hosts 2024-08-20T22:08:20.0838868Z + echo '18.160.10.76 download.pytorch.org' 2024-08-20T22:08:20.0839856Z + sudo tee -a /etc/hosts 2024-08-20T22:08:20.3521625Z 18.160.10.76 download.pytorch.org 2024-08-20T22:08:20.3544858Z + cat /etc/hosts 2024-08-20T22:08:20.3555481Z 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 2024-08-20T22:08:20.3568304Z ::1 localhost6 localhost6.localdomain6 2024-08-20T22:08:20.3568990Z 18.160.10.76 download.pytorch.org 2024-08-20T22:08:20.3723072Z ##[group]Run pytorch/test-infra/.github/actions/calculate-docker-image@main 2024-08-20T22:08:20.3723673Z with: 2024-08-20T22:08:20.3724764Z docker-image-name: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:20.3725986Z docker-build-dir: .ci/docker 2024-08-20T22:08:20.3726380Z working-directory: . 2024-08-20T22:08:20.3726847Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:20.3727367Z force-push: false 2024-08-20T22:08:20.3727673Z env: 2024-08-20T22:08:20.3727953Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:20.3728294Z ##[endgroup] 2024-08-20T22:08:20.3746898Z ##[group]Run set -ex 2024-08-20T22:08:20.3747267Z set -ex 2024-08-20T22:08:20.3747566Z  2024-08-20T22:08:20.3748384Z # If the docker build directory or the build script doesn't exist, the action will 2024-08-20T22:08:20.3749350Z # gracefully return the docker image name as it is. Pulling docker image in Linux 2024-08-20T22:08:20.3750407Z # job could then download the pre-built image as usual 2024-08-20T22:08:20.3751151Z if [[ ! -d "${DOCKER_BUILD_DIR}" ]] || [[ ! -f "${DOCKER_BUILD_DIR}/build.sh" ]]; then 2024-08-20T22:08:20.3751822Z  echo "skip=true" >> "${GITHUB_OUTPUT}" 2024-08-20T22:08:20.3752632Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2024-08-20T22:08:20.3753200Z  2024-08-20T22:08:20.3753713Z  echo "There is no Docker build script in ${REPO_NAME} repo, skipping..." 2024-08-20T22:08:20.3754338Z  exit 0 2024-08-20T22:08:20.3754652Z else 2024-08-20T22:08:20.3755021Z  echo "skip=false" >> "${GITHUB_OUTPUT}" 2024-08-20T22:08:20.3755476Z fi 2024-08-20T22:08:20.3755763Z  2024-08-20T22:08:20.3756240Z if [[ "${DOCKER_IMAGE_NAME}" == *"${DOCKER_REGISTRY}/${REPO_NAME}"* ]]; then 2024-08-20T22:08:20.3757080Z  # The docker image name already includes the ECR prefix and tag, so we can just 2024-08-20T22:08:20.3757861Z  # use it as it is, but first let's extract the tag 2024-08-20T22:08:20.3758568Z  DOCKER_TAG=$(echo "${DOCKER_IMAGE_NAME}" | awk -F '[:,]' '{print $2}') 2024-08-20T22:08:20.3759289Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-08-20T22:08:20.3759992Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2024-08-20T22:08:20.3760546Z else 2024-08-20T22:08:20.3760989Z  DOCKER_TAG=$(git rev-parse HEAD:"${DOCKER_BUILD_DIR}") 2024-08-20T22:08:20.3761654Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-08-20T22:08:20.3762620Z  echo "docker-image=${DOCKER_REGISTRY}/${REPO_NAME}/${DOCKER_IMAGE_NAME}:${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-08-20T22:08:20.3763362Z fi 2024-08-20T22:08:20.3774920Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:08:20.3775418Z env: 2024-08-20T22:08:20.3775701Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:20.3776053Z REPO_NAME: pytorch 2024-08-20T22:08:20.3777176Z DOCKER_IMAGE_NAME: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:20.3778379Z DOCKER_BUILD_DIR: .ci/docker 2024-08-20T22:08:20.3778883Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:20.3779392Z ##[endgroup] 2024-08-20T22:08:20.3813531Z + [[ ! -d .ci/docker ]] 2024-08-20T22:08:20.3814054Z + [[ ! -f .ci/docker/build.sh ]] 2024-08-20T22:08:20.3814646Z + echo skip=false 2024-08-20T22:08:20.3816722Z + [[ 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 == *\3\0\8\5\3\5\3\8\5\1\1\4\.\d\k\r\.\e\c\r\.\u\s\-\e\a\s\t\-\1\.\a\m\a\z\o\n\a\w\s\.\c\o\m\/\p\y\t\o\r\c\h* ]] 2024-08-20T22:08:20.3820795Z ++ echo 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:20.3822151Z ++ awk -F '[:,]' '{print $2}' 2024-08-20T22:08:20.3846286Z + DOCKER_TAG=f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:20.3847058Z + echo docker-tag=f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:20.3848687Z + echo docker-image=308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:20.3882164Z ##[group]Run set +e 2024-08-20T22:08:20.3882741Z set +e 2024-08-20T22:08:20.3883099Z set -x 2024-08-20T22:08:20.3883553Z  2024-08-20T22:08:20.3883953Z login() { 2024-08-20T22:08:20.3884755Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2024-08-20T22:08:20.3885520Z } 2024-08-20T22:08:20.3885911Z  2024-08-20T22:08:20.3886348Z retry () { 2024-08-20T22:08:20.3886800Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2024-08-20T22:08:20.3887361Z } 2024-08-20T22:08:20.3887781Z  2024-08-20T22:08:20.3888212Z retry login "${DOCKER_REGISTRY}" 2024-08-20T22:08:20.3888829Z  2024-08-20T22:08:20.3889447Z # Check if image already exists, if it does then skip building it 2024-08-20T22:08:20.3890263Z if docker manifest inspect "${DOCKER_IMAGE}"; then 2024-08-20T22:08:20.3890853Z  exit 0 2024-08-20T22:08:20.3891264Z fi 2024-08-20T22:08:20.3891657Z  2024-08-20T22:08:20.3892247Z # NB: This part requires a full checkout. Otherwise, the merge base will 2024-08-20T22:08:20.3893226Z # be empty. The default action would be to continue rebuild the image 2024-08-20T22:08:20.3894019Z if [[ "$BASE_REVISION" = "$(git rev-parse HEAD)" ]]; then 2024-08-20T22:08:20.3894780Z  # if we're on the base branch then use the parent commit 2024-08-20T22:08:20.3895535Z  MERGE_BASE=$(git rev-parse HEAD~) 2024-08-20T22:08:20.3896139Z else 2024-08-20T22:08:20.3896665Z  # otherwise we're on a PR, so use the most recent base commit 2024-08-20T22:08:20.3897518Z  MERGE_BASE=$(git merge-base HEAD "$BASE_REVISION") 2024-08-20T22:08:20.3898112Z fi 2024-08-20T22:08:20.3898511Z  2024-08-20T22:08:20.3898936Z if [[ -z "${MERGE_BASE}" ]]; then 2024-08-20T22:08:20.3899533Z  echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2024-08-20T22:08:20.3900102Z  2024-08-20T22:08:20.3900890Z  echo "Finding merge base only works with full checkout, please set fetch-depth to 0, continuing ..." 2024-08-20T22:08:20.3901702Z  exit 0 2024-08-20T22:08:20.3902134Z fi 2024-08-20T22:08:20.3902635Z  2024-08-20T22:08:20.3903166Z if ! git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}"; then 2024-08-20T22:08:20.3904201Z  echo "Directory '${DOCKER_BUILD_DIR}' not found in commit $MERGE_BASE, you should rebase onto a more recent commit" 2024-08-20T22:08:20.3905142Z  exit 1 2024-08-20T22:08:20.3905558Z fi 2024-08-20T22:08:20.3905986Z  2024-08-20T22:08:20.3906536Z PREVIOUS_DOCKER_TAG=$(git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}") 2024-08-20T22:08:20.3907590Z # If no image exists but the hash is the same as the previous hash then we should error out here 2024-08-20T22:08:20.3908594Z if [[ "${PREVIOUS_DOCKER_TAG}" == "${DOCKER_TAG}" ]]; then 2024-08-20T22:08:20.3909635Z  echo "WARNING: Something has gone wrong and the previous image isn't available for the merge-base of your branch" 2024-08-20T22:08:20.3910839Z  echo " Will re-build docker image to store in local cache, TTS may be longer" 2024-08-20T22:08:20.3911826Z fi 2024-08-20T22:08:20.3912228Z  2024-08-20T22:08:20.3912674Z echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2024-08-20T22:08:20.3921916Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:08:20.3922544Z env: 2024-08-20T22:08:20.3922991Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:20.3923468Z DOCKER_BUILD_DIR: .ci/docker 2024-08-20T22:08:20.3924033Z BASE_REVISION: 40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:08:20.3925475Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:20.3926808Z DOCKER_TAG: f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:20.3927496Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:20.3928252Z ##[endgroup] 2024-08-20T22:08:20.3958019Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:20.3958827Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:20.3960464Z + aws ecr get-login-password --region us-east-1 2024-08-20T22:08:20.3962601Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:20.9238675Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-08-20T22:08:20.9240164Z Configure a credential helper to remove this warning. See 2024-08-20T22:08:20.9241302Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-08-20T22:08:20.9241852Z 2024-08-20T22:08:20.9242008Z Login Succeeded 2024-08-20T22:08:20.9263465Z + docker manifest inspect 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:21.1310254Z { 2024-08-20T22:08:21.1311442Z "schemaVersion": 2, 2024-08-20T22:08:21.1312230Z "mediaType": "application/vnd.docker.distribution.manifest.v2+json", 2024-08-20T22:08:21.1313308Z "config": { 2024-08-20T22:08:21.1314505Z "mediaType": "application/vnd.docker.container.image.v1+json", 2024-08-20T22:08:21.1315724Z "size": 48711, 2024-08-20T22:08:21.1317024Z "digest": "sha256:8fef7805cec6e829013a3d62f158b75bdc2f02cdfe3428c032ea017b488473bb" 2024-08-20T22:08:21.1318130Z }, 2024-08-20T22:08:21.1318669Z "layers": [ 2024-08-20T22:08:21.1319599Z { 2024-08-20T22:08:21.1320259Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1321351Z "size": 28580681, 2024-08-20T22:08:21.1322518Z "digest": "sha256:7a2c559011895d255fce249c00396abff5ae7e0c0a92931d0ed493e71de78e3a" 2024-08-20T22:08:21.1323476Z }, 2024-08-20T22:08:21.1323930Z { 2024-08-20T22:08:21.1324650Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1325598Z "size": 7943451, 2024-08-20T22:08:21.1326446Z "digest": "sha256:224fe954d7252f10539d243d6c9688806f7d13ad775ed02e7f7c79077844510d" 2024-08-20T22:08:21.1327366Z }, 2024-08-20T22:08:21.1327826Z { 2024-08-20T22:08:21.1328800Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1329628Z "size": 55728572, 2024-08-20T22:08:21.1330448Z "digest": "sha256:75722010b82e31715876aeeed0b2cee414296f0124fdfa061ab845ba2a158450" 2024-08-20T22:08:21.1331442Z }, 2024-08-20T22:08:21.1331875Z { 2024-08-20T22:08:21.1332890Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1333691Z "size": 186, 2024-08-20T22:08:21.1334514Z "digest": "sha256:d527cbbb87e3016fd72a18a9b468c945ad0ca27c5770b39debd6ed704db3a195" 2024-08-20T22:08:21.1335541Z }, 2024-08-20T22:08:21.1335947Z { 2024-08-20T22:08:21.1336937Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1337903Z "size": 6886, 2024-08-20T22:08:21.1338723Z "digest": "sha256:b57676e46aee1a8c82e528d78e5a13e31142524eea31c8b213d69ddcb6f1fe80" 2024-08-20T22:08:21.1339604Z }, 2024-08-20T22:08:21.1340461Z { 2024-08-20T22:08:21.1341154Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1342029Z "size": 1329001756, 2024-08-20T22:08:21.1342952Z "digest": "sha256:a8c1e85b5e14cec7af70bf304cb4d4cee6a1d25eb8215b2cf4fdc33e5af5e108" 2024-08-20T22:08:21.1343731Z }, 2024-08-20T22:08:21.1344101Z { 2024-08-20T22:08:21.1344686Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1345322Z "size": 62501, 2024-08-20T22:08:21.1346114Z "digest": "sha256:a41a8d1c11c8d80fe4e82b0d05478f8d51176ff20b8350905fc1b25c93a51198" 2024-08-20T22:08:21.1346829Z }, 2024-08-20T22:08:21.1347251Z { 2024-08-20T22:08:21.1347768Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1348415Z "size": 1684, 2024-08-20T22:08:21.1349120Z "digest": "sha256:0c12278907551c2962927d27c115f6f7bf0df894318b8aea6ece3ef01ccd0a8a" 2024-08-20T22:08:21.1350162Z }, 2024-08-20T22:08:21.1350476Z { 2024-08-20T22:08:21.1351101Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1351743Z "size": 1523, 2024-08-20T22:08:21.1352355Z "digest": "sha256:d8d1234baab3ec9ccb8bb710fc6b8ff6c10896ba2e8d27a347583eca770f9ff1" 2024-08-20T22:08:21.1353156Z }, 2024-08-20T22:08:21.1353500Z { 2024-08-20T22:08:21.1354043Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1354881Z "size": 2528295403, 2024-08-20T22:08:21.1355609Z "digest": "sha256:7ed32bc8e4696fcdb2feef850781160597b2275ad756819c4add88236b0577d5" 2024-08-20T22:08:21.1356329Z }, 2024-08-20T22:08:21.1356723Z { 2024-08-20T22:08:21.1357228Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1357875Z "size": 86016, 2024-08-20T22:08:21.1358585Z "digest": "sha256:ec1e7978c1fe161ced1d98092a51e7c5953ca5fda5577f54df9dbda4afff1b2b" 2024-08-20T22:08:21.1359316Z }, 2024-08-20T22:08:21.1359621Z { 2024-08-20T22:08:21.1360207Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1360870Z "size": 1822, 2024-08-20T22:08:21.1361472Z "digest": "sha256:ac23c5fcc1ef310e9cd0d138b180281188e20a3e28c51cd14751622e3c7d92ea" 2024-08-20T22:08:21.1362253Z }, 2024-08-20T22:08:21.1362684Z { 2024-08-20T22:08:21.1363261Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1363889Z "size": 246761563, 2024-08-20T22:08:21.1364556Z "digest": "sha256:ca426ffc9d2bd051ad1ff5c4f02fd5d9be161e70953cc37882c815080c708f4d" 2024-08-20T22:08:21.1365320Z }, 2024-08-20T22:08:21.1365686Z { 2024-08-20T22:08:21.1366172Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1366867Z "size": 544, 2024-08-20T22:08:21.1367508Z "digest": "sha256:4373aa743caf6660c671295b837048c8350a2165f2336dc3b7b6c96462579e50" 2024-08-20T22:08:21.1368158Z }, 2024-08-20T22:08:21.1368560Z { 2024-08-20T22:08:21.1369131Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1369779Z "size": 1258, 2024-08-20T22:08:21.1370435Z "digest": "sha256:75b2abb16c685854c017d0cf75c626526c956734c656d9e78fdd4520317e9b3c" 2024-08-20T22:08:21.1371133Z }, 2024-08-20T22:08:21.1371471Z { 2024-08-20T22:08:21.1372061Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1372661Z "size": 484, 2024-08-20T22:08:21.1373272Z "digest": "sha256:ef1e3ef1e85f0124270b8506721219150e230184181f8207d64463bf5c67e656" 2024-08-20T22:08:21.1374025Z }, 2024-08-20T22:08:21.1374328Z { 2024-08-20T22:08:21.1374842Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1375629Z "size": 91711766, 2024-08-20T22:08:21.1376266Z "digest": "sha256:0bf61114d37b2d09065aa6852b1e78a32580a1ff011dd5d23f03b0f5c4e710af" 2024-08-20T22:08:21.1376941Z }, 2024-08-20T22:08:21.1377361Z { 2024-08-20T22:08:21.1377880Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1378541Z "size": 3390, 2024-08-20T22:08:21.1379326Z "digest": "sha256:2df849f72ba4258df10c9c45ace21a66d93b73196e78e96f12c13098822f60e2" 2024-08-20T22:08:21.1380047Z }, 2024-08-20T22:08:21.1380386Z { 2024-08-20T22:08:21.1380959Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1381577Z "size": 1909, 2024-08-20T22:08:21.1382218Z "digest": "sha256:34c47d63c5de27418739aa048b4dd781c3006d65691e9b903c95304d0509d89c" 2024-08-20T22:08:21.1382963Z }, 2024-08-20T22:08:21.1383285Z { 2024-08-20T22:08:21.1383810Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1384494Z "size": 701, 2024-08-20T22:08:21.1385189Z "digest": "sha256:1fef4bd19792cbf9d3aea12795089ad41164bb6d607c339b7484e1899825b1d2" 2024-08-20T22:08:21.1385850Z }, 2024-08-20T22:08:21.1386260Z { 2024-08-20T22:08:21.1386781Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1387466Z "size": 2864254879, 2024-08-20T22:08:21.1388113Z "digest": "sha256:6efb96fc87ea1bca54876d85331e5585e28f325a1d60ee1aef7811eabb74f933" 2024-08-20T22:08:21.1388817Z }, 2024-08-20T22:08:21.1389228Z { 2024-08-20T22:08:21.1389733Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1390384Z "size": 380, 2024-08-20T22:08:21.1391058Z "digest": "sha256:b119c4fc6c58d9e72744201ff4850b34184a94eb3566031b7d36e87ecce950a6" 2024-08-20T22:08:21.1391876Z }, 2024-08-20T22:08:21.1392183Z { 2024-08-20T22:08:21.1392785Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1393430Z "size": 12900, 2024-08-20T22:08:21.1394063Z "digest": "sha256:33b639226eeefa41d7bb26a8ecc20d271ceef45571dabfd80aaee3634926381b" 2024-08-20T22:08:21.1394802Z }, 2024-08-20T22:08:21.1395192Z { 2024-08-20T22:08:21.1395718Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1396407Z "size": 803, 2024-08-20T22:08:21.1397024Z "digest": "sha256:d3547bd43146930aa830d54562c98aa678e355cf5f84527e9717eb72fffe8ca3" 2024-08-20T22:08:21.1397730Z }, 2024-08-20T22:08:21.1398103Z { 2024-08-20T22:08:21.1398620Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1399279Z "size": 106, 2024-08-20T22:08:21.1399918Z "digest": "sha256:5645520256fa6d7f2270608eaed53849a131d03fbf4c5d4472c9cfde1a439e47" 2024-08-20T22:08:21.1400602Z }, 2024-08-20T22:08:21.1400980Z { 2024-08-20T22:08:21.1401551Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1402200Z "size": 503, 2024-08-20T22:08:21.1402899Z "digest": "sha256:829ed7d91e3818d0e11834c71551117c7aeec0a51d798e93d641faa0c02582cb" 2024-08-20T22:08:21.1403647Z }, 2024-08-20T22:08:21.1404002Z { 2024-08-20T22:08:21.1404480Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1405162Z "size": 121477267, 2024-08-20T22:08:21.1405820Z "digest": "sha256:385d0421d67c533d628985c453a186028a61f6ad4209ae519ec3d4ecea661d3e" 2024-08-20T22:08:21.1406549Z }, 2024-08-20T22:08:21.1406855Z { 2024-08-20T22:08:21.1407388Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1408074Z "size": 109, 2024-08-20T22:08:21.1408682Z "digest": "sha256:7cbfce999d76851e07dd71056a6d852629d789ccfd46be44cc405b451fb8bb58" 2024-08-20T22:08:21.1409411Z }, 2024-08-20T22:08:21.1409809Z { 2024-08-20T22:08:21.1410351Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1410952Z "size": 490, 2024-08-20T22:08:21.1411634Z "digest": "sha256:6658e558ebe496f0d628947534b0ea1e44808f84f2dfd8a9a704e8aa5329d791" 2024-08-20T22:08:21.1412351Z }, 2024-08-20T22:08:21.1412686Z { 2024-08-20T22:08:21.1413215Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1413868Z "size": 297, 2024-08-20T22:08:21.1414477Z "digest": "sha256:33444a5a7e01a3010fd1cc16b32a66892a08600d7f700747d23faf3c36624f3a" 2024-08-20T22:08:21.1415250Z }, 2024-08-20T22:08:21.1415724Z { 2024-08-20T22:08:21.1416240Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1416950Z "size": 103, 2024-08-20T22:08:21.1417539Z "digest": "sha256:7c47122f4e09b47e891b4ae9e499a35a4eb46faacae87d0e946615adda6e0706" 2024-08-20T22:08:21.1418257Z }, 2024-08-20T22:08:21.1418643Z { 2024-08-20T22:08:21.1419158Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1419783Z "size": 1473, 2024-08-20T22:08:21.1420450Z "digest": "sha256:1811ff4d3556ac255604f346d879528aff2aadd7652c2d39baf4fe6eaa60aec3" 2024-08-20T22:08:21.1421140Z }, 2024-08-20T22:08:21.1421466Z { 2024-08-20T22:08:21.1422032Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1422696Z "size": 594729516, 2024-08-20T22:08:21.1423350Z "digest": "sha256:7754ee068b33f760d9c320c26a1a3935247ace0c8c463a976105c1586a43fb1c" 2024-08-20T22:08:21.1424047Z }, 2024-08-20T22:08:21.1424409Z { 2024-08-20T22:08:21.1424929Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1425605Z "size": 164, 2024-08-20T22:08:21.1426210Z "digest": "sha256:0479fbac3361713c075bf788e778117917dcacdd1ff71ed79a789dd2016a1714" 2024-08-20T22:08:21.1426899Z }, 2024-08-20T22:08:21.1427283Z { 2024-08-20T22:08:21.1427819Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1428619Z "size": 564, 2024-08-20T22:08:21.1429329Z "digest": "sha256:f1d6874dee9c34d154278d2b6935d04447f07fa89d25d4a09398234040d8a7e8" 2024-08-20T22:08:21.1430010Z }, 2024-08-20T22:08:21.1430313Z { 2024-08-20T22:08:21.1430900Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1431539Z "size": 35874203, 2024-08-20T22:08:21.1432271Z "digest": "sha256:afc429e87b593a64f3e0a1be51e09e966ea1aa71e6e8a0bec4edc9f2f7bc1c05" 2024-08-20T22:08:21.1432949Z }, 2024-08-20T22:08:21.1433287Z { 2024-08-20T22:08:21.1433880Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1434509Z "size": 104, 2024-08-20T22:08:21.1435085Z "digest": "sha256:019620471c2592cd22437fe8ed1a94c784114cf7445c5c2ab36dd0bae727fc66" 2024-08-20T22:08:21.1435864Z }, 2024-08-20T22:08:21.1436198Z { 2024-08-20T22:08:21.1436678Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1437374Z "size": 425, 2024-08-20T22:08:21.1438020Z "digest": "sha256:27aeb1b2cd5e28d8f0e54fc1090baf88abc29ebf5fce088b493fcae99c9550d1" 2024-08-20T22:08:21.1438758Z }, 2024-08-20T22:08:21.1439114Z { 2024-08-20T22:08:21.1439638Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1440307Z "size": 20262183, 2024-08-20T22:08:21.1441003Z "digest": "sha256:829c0e19f4b7797e9120a86172fabfd710f9b3971ffd714a616931a3fadc7192" 2024-08-20T22:08:21.1441668Z }, 2024-08-20T22:08:21.1442066Z { 2024-08-20T22:08:21.1442706Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1443381Z "size": 438, 2024-08-20T22:08:21.1443976Z "digest": "sha256:560cd6122a3868e7e82e75eb103d182edf6512114d61ccdfae099af00cb16b4c" 2024-08-20T22:08:21.1444730Z }, 2024-08-20T22:08:21.1445107Z { 2024-08-20T22:08:21.1445598Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1446300Z "size": 701, 2024-08-20T22:08:21.1446960Z "digest": "sha256:1fef4bd19792cbf9d3aea12795089ad41164bb6d607c339b7484e1899825b1d2" 2024-08-20T22:08:21.1447678Z }, 2024-08-20T22:08:21.1448044Z { 2024-08-20T22:08:21.1448599Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1449278Z "size": 141, 2024-08-20T22:08:21.1450246Z "digest": "sha256:5a4eb19d72198a01f3babd4711c40fcf7c6e5cb9d5cfedc507b0061408d47097" 2024-08-20T22:08:21.1450934Z }, 2024-08-20T22:08:21.1451291Z { 2024-08-20T22:08:21.1451921Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1452571Z "size": 135, 2024-08-20T22:08:21.1453297Z "digest": "sha256:da6a838a66c72b5de9a5590c233779880ea901c1264940a1c618825d2501ffd1" 2024-08-20T22:08:21.1454074Z }, 2024-08-20T22:08:21.1454409Z { 2024-08-20T22:08:21.1454888Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1455597Z "size": 4838068375, 2024-08-20T22:08:21.1456266Z "digest": "sha256:cbb79a7053537bed2d80b77198ea552b985563b11d3f8616593c6ab575a3a090" 2024-08-20T22:08:21.1457043Z }, 2024-08-20T22:08:21.1457345Z { 2024-08-20T22:08:21.1457868Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1458581Z "size": 194, 2024-08-20T22:08:21.1459206Z "digest": "sha256:4d4fa6802ab3e6b36d8d4adb650046e9370c4a16a19876970559ef8a312ca855" 2024-08-20T22:08:21.1459861Z }, 2024-08-20T22:08:21.1460272Z { 2024-08-20T22:08:21.1460790Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1461387Z "size": 564, 2024-08-20T22:08:21.1462092Z "digest": "sha256:0f085d4fa279366fcd52d303b7ad8abddc5962a8872174b8109f3f5d5ca5f2cf" 2024-08-20T22:08:21.1462791Z }, 2024-08-20T22:08:21.1463188Z { 2024-08-20T22:08:21.1463721Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1464365Z "size": 43162921, 2024-08-20T22:08:21.1465020Z "digest": "sha256:4a0412373305517489d891a4749e6d2b80b4aeb7df3b8adca0ed0abb2f3e5300" 2024-08-20T22:08:21.1465898Z }, 2024-08-20T22:08:21.1466226Z { 2024-08-20T22:08:21.1466747Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1467439Z "size": 106, 2024-08-20T22:08:21.1468082Z "digest": "sha256:302c8c1779444e54919f83e91c6d5e1fdea653fc899be802b3a2a34d34d99d5d" 2024-08-20T22:08:21.1468738Z }, 2024-08-20T22:08:21.1469128Z { 2024-08-20T22:08:21.1469700Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1470297Z "size": 1380, 2024-08-20T22:08:21.1470970Z "digest": "sha256:02970347dff622ee45629bc28788716d00528464f71f88ec7b74ae5f44a486e2" 2024-08-20T22:08:21.1471676Z }, 2024-08-20T22:08:21.1472021Z { 2024-08-20T22:08:21.1472574Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1473223Z "size": 701, 2024-08-20T22:08:21.1473849Z "digest": "sha256:1fef4bd19792cbf9d3aea12795089ad41164bb6d607c339b7484e1899825b1d2" 2024-08-20T22:08:21.1474627Z }, 2024-08-20T22:08:21.1474943Z { 2024-08-20T22:08:21.1475466Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1476204Z "size": 139, 2024-08-20T22:08:21.1476791Z "digest": "sha256:916c5e8580164926a3aec87e88a5d1c2d02756e49fdeed4198e1e6304efa2fd3" 2024-08-20T22:08:21.1477489Z }, 2024-08-20T22:08:21.1477912Z { 2024-08-20T22:08:21.1478427Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1479049Z "size": 118, 2024-08-20T22:08:21.1479726Z "digest": "sha256:c42b3602a1fb4df5111224650f15adffb025979ae9c614807379ea84e189533b" 2024-08-20T22:08:21.1480427Z }, 2024-08-20T22:08:21.1480842Z { 2024-08-20T22:08:21.1481331Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1481973Z "size": 4324672728, 2024-08-20T22:08:21.1482794Z "digest": "sha256:11fad972ef6cb9d2dc236504b0ee5b6e5ea996e4576ece0ed3262fbb9ee2de60" 2024-08-20T22:08:21.1483535Z }, 2024-08-20T22:08:21.1483843Z { 2024-08-20T22:08:21.1484441Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1485081Z "size": 174, 2024-08-20T22:08:21.1485681Z "digest": "sha256:f957c16244819132b478272aaf24231699c4fcbd495c229a574f94daab8d6b86" 2024-08-20T22:08:21.1486420Z }, 2024-08-20T22:08:21.1486761Z { 2024-08-20T22:08:21.1487299Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1487952Z "size": 907, 2024-08-20T22:08:21.1488593Z "digest": "sha256:768c31dca016b80bbdc973c8ee818034bdbd17b7ea9bdadbf0ec45ea51005720" 2024-08-20T22:08:21.1489321Z }, 2024-08-20T22:08:21.1489835Z { 2024-08-20T22:08:21.1490341Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1490979Z "size": 701, 2024-08-20T22:08:21.1491656Z "digest": "sha256:1fef4bd19792cbf9d3aea12795089ad41164bb6d607c339b7484e1899825b1d2" 2024-08-20T22:08:21.1492348Z }, 2024-08-20T22:08:21.1492690Z { 2024-08-20T22:08:21.1493255Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1493916Z "size": 134, 2024-08-20T22:08:21.1494514Z "digest": "sha256:8c32d0ecebbe2054c96a3a5c1f3d6c8b87c2e826686b369e5242cd55d0f01c2d" 2024-08-20T22:08:21.1495290Z }, 2024-08-20T22:08:21.1495627Z { 2024-08-20T22:08:21.1496172Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1496837Z "size": 32, 2024-08-20T22:08:21.1497464Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-20T22:08:21.1498173Z }, 2024-08-20T22:08:21.1498593Z { 2024-08-20T22:08:21.1499084Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1499718Z "size": 158, 2024-08-20T22:08:21.1500414Z "digest": "sha256:78ee77eddef23f20afc78e2924f4467041cadb754634ee3df431c68211cf676d" 2024-08-20T22:08:21.1501078Z }, 2024-08-20T22:08:21.1501436Z { 2024-08-20T22:08:21.1502006Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1502720Z "size": 1841, 2024-08-20T22:08:21.1503365Z "digest": "sha256:37513e9b43d7123e7ddee09100f62a72b57af7b3833eaecd515e247e2f63e13f" 2024-08-20T22:08:21.1504116Z }, 2024-08-20T22:08:21.1504481Z { 2024-08-20T22:08:21.1505077Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1505687Z "size": 7529776, 2024-08-20T22:08:21.1506352Z "digest": "sha256:a7a5392e2bf6b73d9be292cc22a99ad4637636c15733beb7afbe6403b5ba21a8" 2024-08-20T22:08:21.1507105Z }, 2024-08-20T22:08:21.1507406Z { 2024-08-20T22:08:21.1507949Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1508629Z "size": 163, 2024-08-20T22:08:21.1509244Z "digest": "sha256:b10de02255c021b2366b85bf12ddf593aac89f88964201c455b71a145bc5ca2e" 2024-08-20T22:08:21.1509954Z }, 2024-08-20T22:08:21.1510344Z { 2024-08-20T22:08:21.1510881Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1511513Z "size": 7943, 2024-08-20T22:08:21.1512169Z "digest": "sha256:e56eeff2db93ffe5002a2bb764795b7333321c6802cc28bef0801a619fe6a07e" 2024-08-20T22:08:21.1512896Z }, 2024-08-20T22:08:21.1513242Z { 2024-08-20T22:08:21.1513766Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1514421Z "size": 8068, 2024-08-20T22:08:21.1515068Z "digest": "sha256:70ac3e38d0fd1f0f46ad710c3fc485fd01406606054e8cf84a63af1570bc9f3a" 2024-08-20T22:08:21.1515845Z }, 2024-08-20T22:08:21.1516176Z { 2024-08-20T22:08:21.1516725Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1517442Z "size": 302, 2024-08-20T22:08:21.1518060Z "digest": "sha256:eb09cbf3e4168749cc8605e3188ed35070f6037d13930e443c38d8941734488f" 2024-08-20T22:08:21.1518711Z }, 2024-08-20T22:08:21.1519130Z { 2024-08-20T22:08:21.1519653Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1520290Z "size": 7629638, 2024-08-20T22:08:21.1520959Z "digest": "sha256:ee1273153675e6543b58f5be50321abee5e91f7351701d5d501a6837eaf676ef" 2024-08-20T22:08:21.1521655Z }, 2024-08-20T22:08:21.1521994Z { 2024-08-20T22:08:21.1522613Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1523279Z "size": 108, 2024-08-20T22:08:21.1523923Z "digest": "sha256:e22979f9e0eedfa16f98eb4fa26f30a50c237f5ffd2f6e5b898f2b908058496d" 2024-08-20T22:08:21.1524679Z }, 2024-08-20T22:08:21.1524980Z { 2024-08-20T22:08:21.1525519Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1526206Z "size": 54145661, 2024-08-20T22:08:21.1526976Z "digest": "sha256:6c1f0aabce7c84f9b0b9ab3b96325778dba1c1465b7463c5b4c6be1cf52b74db" 2024-08-20T22:08:21.1527656Z }, 2024-08-20T22:08:21.1528060Z { 2024-08-20T22:08:21.1528593Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1529284Z "size": 473, 2024-08-20T22:08:21.1529881Z "digest": "sha256:7ebe49c3a23e71b289ce012b48dad35791a2f2aa7fcee2326a64d763b0d14df8" 2024-08-20T22:08:21.1530643Z }, 2024-08-20T22:08:21.1531040Z { 2024-08-20T22:08:21.1531524Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1532194Z "size": 1374858766, 2024-08-20T22:08:21.1532895Z "digest": "sha256:5d115b29b5d53e5418762bc41ae975dd245bcffc3d058b8902c58146d505cb37" 2024-08-20T22:08:21.1533614Z }, 2024-08-20T22:08:21.1533996Z + exit 0 2024-08-20T22:08:21.1534370Z { 2024-08-20T22:08:21.1534916Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1535557Z "size": 106, 2024-08-20T22:08:21.1536213Z "digest": "sha256:7f2d7a04fbe65bbe1e895138e0cfeeef53ad926c890bab8e7e132ad1e655e48f" 2024-08-20T22:08:21.1536982Z }, 2024-08-20T22:08:21.1537326Z { 2024-08-20T22:08:21.1537896Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1538522Z "size": 559, 2024-08-20T22:08:21.1539144Z "digest": "sha256:d79fd7d526989e554455eda7d459f2c88444030f61710101e52ec8c7a49b7b79" 2024-08-20T22:08:21.1540005Z }, 2024-08-20T22:08:21.1540350Z { 2024-08-20T22:08:21.1540840Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1541553Z "size": 46248488, 2024-08-20T22:08:21.1542191Z "digest": "sha256:9752d6fbbcab4e7403f26777c5b65911320de6389c81b833a47ba45c4f3354b4" 2024-08-20T22:08:21.1542852Z }, 2024-08-20T22:08:21.1543310Z { 2024-08-20T22:08:21.1543823Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1544481Z "size": 111, 2024-08-20T22:08:21.1545132Z "digest": "sha256:83808b2eff4d71ed46db7c29f66fe918f328405c25b314225dfad01b4868d1f4" 2024-08-20T22:08:21.1545829Z }, 2024-08-20T22:08:21.1546313Z { 2024-08-20T22:08:21.1546838Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1547462Z "size": 32, 2024-08-20T22:08:21.1548147Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-20T22:08:21.1548860Z }, 2024-08-20T22:08:21.1549219Z { 2024-08-20T22:08:21.1550086Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1550763Z "size": 32, 2024-08-20T22:08:21.1551419Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-20T22:08:21.1552158Z }, 2024-08-20T22:08:21.1552508Z { 2024-08-20T22:08:21.1553054Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1553750Z "size": 32, 2024-08-20T22:08:21.1554346Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-20T22:08:21.1555079Z }, 2024-08-20T22:08:21.1555474Z { 2024-08-20T22:08:21.1556017Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:21.1556615Z "size": 32, 2024-08-20T22:08:21.1557332Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-20T22:08:21.1558053Z } 2024-08-20T22:08:21.1558402Z ] 2024-08-20T22:08:21.1558755Z } 2024-08-20T22:08:21.1856130Z ##[group]Run tag=${ECR_DOCKER_IMAGE##*/} 2024-08-20T22:08:21.1856629Z tag=${ECR_DOCKER_IMAGE##*/} 2024-08-20T22:08:21.1857172Z echo "docker pull ghcr.io/pytorch/ci-image:${tag/:/-}" 2024-08-20T22:08:21.1866417Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:08:21.1866924Z env: 2024-08-20T22:08:21.1867215Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:21.1868356Z ECR_DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:21.1869512Z ##[endgroup] 2024-08-20T22:08:21.1902167Z docker pull ghcr.io/pytorch/ci-image:pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks-f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:21.1955076Z ##[group]Run pytorch/test-infra/.github/actions/pull-docker-image@main 2024-08-20T22:08:21.1955664Z with: 2024-08-20T22:08:21.1956736Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:21.1958033Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:21.1958554Z env: 2024-08-20T22:08:21.1958837Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:21.1959196Z ##[endgroup] 2024-08-20T22:08:21.1976616Z ##[group]Run set -x 2024-08-20T22:08:21.1976967Z set -x 2024-08-20T22:08:21.1977278Z set +e 2024-08-20T22:08:21.1977583Z  2024-08-20T22:08:21.1977865Z login() { 2024-08-20T22:08:21.1978520Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2024-08-20T22:08:21.1979231Z } 2024-08-20T22:08:21.1979524Z  2024-08-20T22:08:21.1979838Z retry () { 2024-08-20T22:08:21.1980236Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2024-08-20T22:08:21.1980683Z } 2024-08-20T22:08:21.1981121Z  2024-08-20T22:08:21.1981447Z retry login "${DOCKER_REGISTRY}" 2024-08-20T22:08:21.1981864Z  2024-08-20T22:08:21.1982145Z set -e 2024-08-20T22:08:21.1982619Z # ignore output since only exit code is used for conditional 2024-08-20T22:08:21.1983314Z # only pull docker image if it's not available locally 2024-08-20T22:08:21.1984063Z if ! docker inspect --type=image "${DOCKER_IMAGE}" >/dev/null 2>/dev/null; then 2024-08-20T22:08:21.1984754Z  retry docker pull "${DOCKER_IMAGE}" 2024-08-20T22:08:21.1985194Z fi 2024-08-20T22:08:21.1993912Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:08:21.1994410Z env: 2024-08-20T22:08:21.1994696Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:21.1995825Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:21.1997111Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:21.1997629Z ##[endgroup] 2024-08-20T22:08:21.2026920Z + set +e 2024-08-20T22:08:21.2027464Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:21.2028093Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:21.2030657Z + aws ecr get-login-password --region us-east-1 2024-08-20T22:08:21.2032021Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:21.7303852Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-08-20T22:08:21.7304675Z Configure a credential helper to remove this warning. See 2024-08-20T22:08:21.7305500Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-08-20T22:08:21.7306054Z 2024-08-20T22:08:21.7306179Z Login Succeeded 2024-08-20T22:08:21.7326416Z + set -e 2024-08-20T22:08:21.7327754Z + docker inspect --type=image 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:21.7484153Z + retry docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:21.7486287Z + docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:22.0274463Z f6d216893d65c7b8ae43df4daaf247db808378e9: Pulling from pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks 2024-08-20T22:08:22.0276087Z 7a2c55901189: Pulling fs layer 2024-08-20T22:08:22.0276669Z 224fe954d725: Pulling fs layer 2024-08-20T22:08:22.0277546Z 75722010b82e: Pulling fs layer 2024-08-20T22:08:22.0278032Z d527cbbb87e3: Pulling fs layer 2024-08-20T22:08:22.0278498Z b57676e46aee: Pulling fs layer 2024-08-20T22:08:22.0279087Z a8c1e85b5e14: Pulling fs layer 2024-08-20T22:08:22.0279633Z a41a8d1c11c8: Pulling fs layer 2024-08-20T22:08:22.0280152Z 0c1227890755: Pulling fs layer 2024-08-20T22:08:22.0280640Z d8d1234baab3: Pulling fs layer 2024-08-20T22:08:22.0281150Z 7ed32bc8e469: Pulling fs layer 2024-08-20T22:08:22.0281693Z ec1e7978c1fe: Pulling fs layer 2024-08-20T22:08:22.0282199Z ac23c5fcc1ef: Pulling fs layer 2024-08-20T22:08:22.0282793Z ca426ffc9d2b: Pulling fs layer 2024-08-20T22:08:22.0283165Z 4373aa743caf: Pulling fs layer 2024-08-20T22:08:22.0283535Z 75b2abb16c68: Pulling fs layer 2024-08-20T22:08:22.0283893Z ef1e3ef1e85f: Pulling fs layer 2024-08-20T22:08:22.0284264Z 0bf61114d37b: Pulling fs layer 2024-08-20T22:08:22.0284636Z 2df849f72ba4: Pulling fs layer 2024-08-20T22:08:22.0285003Z 34c47d63c5de: Pulling fs layer 2024-08-20T22:08:22.0285380Z 1fef4bd19792: Pulling fs layer 2024-08-20T22:08:22.0285749Z 6efb96fc87ea: Pulling fs layer 2024-08-20T22:08:22.0286133Z b119c4fc6c58: Pulling fs layer 2024-08-20T22:08:22.0286713Z 33b639226eee: Pulling fs layer 2024-08-20T22:08:22.0287130Z d3547bd43146: Pulling fs layer 2024-08-20T22:08:22.0287490Z 5645520256fa: Pulling fs layer 2024-08-20T22:08:22.0287962Z 829ed7d91e38: Pulling fs layer 2024-08-20T22:08:22.0288444Z 385d0421d67c: Pulling fs layer 2024-08-20T22:08:22.0288911Z 7cbfce999d76: Pulling fs layer 2024-08-20T22:08:22.0289387Z 6658e558ebe4: Pulling fs layer 2024-08-20T22:08:22.0289861Z 33444a5a7e01: Pulling fs layer 2024-08-20T22:08:22.0290327Z 7c47122f4e09: Pulling fs layer 2024-08-20T22:08:22.0290782Z 34c47d63c5de: Waiting 2024-08-20T22:08:22.0291209Z 1811ff4d3556: Pulling fs layer 2024-08-20T22:08:22.0291666Z 2df849f72ba4: Waiting 2024-08-20T22:08:22.0292091Z 7754ee068b33: Pulling fs layer 2024-08-20T22:08:22.0292460Z 0479fbac3361: Pulling fs layer 2024-08-20T22:08:22.0292851Z 0bf61114d37b: Waiting 2024-08-20T22:08:22.0293182Z f1d6874dee9c: Pulling fs layer 2024-08-20T22:08:22.0293542Z ca426ffc9d2b: Waiting 2024-08-20T22:08:22.0293854Z 6efb96fc87ea: Waiting 2024-08-20T22:08:22.0294192Z afc429e87b59: Pulling fs layer 2024-08-20T22:08:22.0294547Z 4373aa743caf: Waiting 2024-08-20T22:08:22.0294856Z 75b2abb16c68: Waiting 2024-08-20T22:08:22.0295181Z 019620471c25: Pulling fs layer 2024-08-20T22:08:22.0295548Z 27aeb1b2cd5e: Pulling fs layer 2024-08-20T22:08:22.0295917Z 829c0e19f4b7: Pulling fs layer 2024-08-20T22:08:22.0296276Z 560cd6122a38: Pulling fs layer 2024-08-20T22:08:22.0296629Z ef1e3ef1e85f: Waiting 2024-08-20T22:08:22.0296943Z 0c1227890755: Waiting 2024-08-20T22:08:22.0297265Z 5a4eb19d7219: Pulling fs layer 2024-08-20T22:08:22.0297629Z da6a838a66c7: Pulling fs layer 2024-08-20T22:08:22.0297983Z d8d1234baab3: Waiting 2024-08-20T22:08:22.0298310Z cbb79a705353: Pulling fs layer 2024-08-20T22:08:22.0298673Z 4d4fa6802ab3: Pulling fs layer 2024-08-20T22:08:22.0299039Z 0f085d4fa279: Pulling fs layer 2024-08-20T22:08:22.0299408Z 4a0412373305: Pulling fs layer 2024-08-20T22:08:22.0299769Z 302c8c177944: Pulling fs layer 2024-08-20T22:08:22.0300124Z 02970347dff6: Pulling fs layer 2024-08-20T22:08:22.0300489Z 916c5e858016: Pulling fs layer 2024-08-20T22:08:22.0300866Z c42b3602a1fb: Pulling fs layer 2024-08-20T22:08:22.0301235Z 11fad972ef6c: Pulling fs layer 2024-08-20T22:08:22.0301592Z f957c1624481: Pulling fs layer 2024-08-20T22:08:22.0301940Z 7ed32bc8e469: Waiting 2024-08-20T22:08:22.0302255Z 829ed7d91e38: Waiting 2024-08-20T22:08:22.0302574Z 768c31dca016: Pulling fs layer 2024-08-20T22:08:22.0302922Z 0479fbac3361: Waiting 2024-08-20T22:08:22.0303251Z 8c32d0ecebbe: Pulling fs layer 2024-08-20T22:08:22.0303606Z b119c4fc6c58: Waiting 2024-08-20T22:08:22.0303926Z 4f4fb700ef54: Pulling fs layer 2024-08-20T22:08:22.0304279Z 33b639226eee: Waiting 2024-08-20T22:08:22.0304606Z 78ee77eddef2: Pulling fs layer 2024-08-20T22:08:22.0304962Z f1d6874dee9c: Waiting 2024-08-20T22:08:22.0305283Z 37513e9b43d7: Pulling fs layer 2024-08-20T22:08:22.0305782Z 7cbfce999d76: Waiting 2024-08-20T22:08:22.0306163Z a7a5392e2bf6: Pulling fs layer 2024-08-20T22:08:22.0306530Z b10de02255c0: Pulling fs layer 2024-08-20T22:08:22.0306888Z afc429e87b59: Waiting 2024-08-20T22:08:22.0307212Z e56eeff2db93: Pulling fs layer 2024-08-20T22:08:22.0307558Z 019620471c25: Waiting 2024-08-20T22:08:22.0307871Z 70ac3e38d0fd: Pulling fs layer 2024-08-20T22:08:22.0308234Z eb09cbf3e416: Pulling fs layer 2024-08-20T22:08:22.0308583Z 27aeb1b2cd5e: Waiting 2024-08-20T22:08:22.0308895Z ee1273153675: Pulling fs layer 2024-08-20T22:08:22.0309265Z e22979f9e0ee: Pulling fs layer 2024-08-20T22:08:22.0309611Z 829c0e19f4b7: Waiting 2024-08-20T22:08:22.0309933Z 6c1f0aabce7c: Pulling fs layer 2024-08-20T22:08:22.0310291Z 7ebe49c3a23e: Pulling fs layer 2024-08-20T22:08:22.0310654Z 5d115b29b5d5: Pulling fs layer 2024-08-20T22:08:22.0310999Z 560cd6122a38: Waiting 2024-08-20T22:08:22.0311304Z 6658e558ebe4: Waiting 2024-08-20T22:08:22.0311622Z 7f2d7a04fbe6: Pulling fs layer 2024-08-20T22:08:22.0311991Z d79fd7d52698: Pulling fs layer 2024-08-20T22:08:22.0312355Z 9752d6fbbcab: Pulling fs layer 2024-08-20T22:08:22.0312709Z 83808b2eff4d: Pulling fs layer 2024-08-20T22:08:22.0313147Z 7c47122f4e09: Waiting 2024-08-20T22:08:22.0313452Z cbb79a705353: Waiting 2024-08-20T22:08:22.0313763Z 4d4fa6802ab3: Waiting 2024-08-20T22:08:22.0314066Z 0f085d4fa279: Waiting 2024-08-20T22:08:22.0314374Z ac23c5fcc1ef: Waiting 2024-08-20T22:08:22.0314680Z 4a0412373305: Waiting 2024-08-20T22:08:22.0314982Z 5645520256fa: Waiting 2024-08-20T22:08:22.0315282Z 1fef4bd19792: Waiting 2024-08-20T22:08:22.0315588Z 11fad972ef6c: Waiting 2024-08-20T22:08:22.0315896Z 8c32d0ecebbe: Waiting 2024-08-20T22:08:22.0316198Z f957c1624481: Waiting 2024-08-20T22:08:22.0316500Z 02970347dff6: Waiting 2024-08-20T22:08:22.0316807Z 768c31dca016: Waiting 2024-08-20T22:08:22.0317112Z 4f4fb700ef54: Waiting 2024-08-20T22:08:22.0317411Z 7754ee068b33: Waiting 2024-08-20T22:08:22.0317715Z 78ee77eddef2: Waiting 2024-08-20T22:08:22.0318034Z 916c5e858016: Waiting 2024-08-20T22:08:22.0318334Z c42b3602a1fb: Waiting 2024-08-20T22:08:22.0318642Z 385d0421d67c: Waiting 2024-08-20T22:08:22.0318946Z 33444a5a7e01: Waiting 2024-08-20T22:08:22.0319253Z 37513e9b43d7: Waiting 2024-08-20T22:08:22.0319554Z a41a8d1c11c8: Waiting 2024-08-20T22:08:22.0319859Z 9752d6fbbcab: Waiting 2024-08-20T22:08:22.0320164Z b57676e46aee: Waiting 2024-08-20T22:08:22.0320475Z eb09cbf3e416: Waiting 2024-08-20T22:08:22.0320779Z 83808b2eff4d: Waiting 2024-08-20T22:08:22.0321082Z a7a5392e2bf6: Waiting 2024-08-20T22:08:22.0321390Z e56eeff2db93: Waiting 2024-08-20T22:08:22.0321691Z b10de02255c0: Waiting 2024-08-20T22:08:22.0321994Z 70ac3e38d0fd: Waiting 2024-08-20T22:08:22.0322300Z ee1273153675: Waiting 2024-08-20T22:08:22.0322699Z 6c1f0aabce7c: Waiting 2024-08-20T22:08:22.0323005Z 7ebe49c3a23e: Waiting 2024-08-20T22:08:22.0323398Z da6a838a66c7: Waiting 2024-08-20T22:08:22.0323777Z 5d115b29b5d5: Waiting 2024-08-20T22:08:22.0324101Z 7f2d7a04fbe6: Waiting 2024-08-20T22:08:22.0324464Z d79fd7d52698: Waiting 2024-08-20T22:08:22.0324789Z e22979f9e0ee: Waiting 2024-08-20T22:08:22.0325155Z d3547bd43146: Waiting 2024-08-20T22:08:22.1484531Z 224fe954d725: Verifying Checksum 2024-08-20T22:08:22.1485017Z 224fe954d725: Download complete 2024-08-20T22:08:22.2421866Z d527cbbb87e3: Verifying Checksum 2024-08-20T22:08:22.2422341Z d527cbbb87e3: Download complete 2024-08-20T22:08:22.3014148Z b57676e46aee: Download complete 2024-08-20T22:08:22.3582695Z 7a2c55901189: Download complete 2024-08-20T22:08:22.4445228Z a41a8d1c11c8: Verifying Checksum 2024-08-20T22:08:22.4445831Z a41a8d1c11c8: Download complete 2024-08-20T22:08:22.5062162Z 0c1227890755: Verifying Checksum 2024-08-20T22:08:22.5062749Z 0c1227890755: Download complete 2024-08-20T22:08:22.5890676Z d8d1234baab3: Verifying Checksum 2024-08-20T22:08:22.5891341Z d8d1234baab3: Download complete 2024-08-20T22:08:22.6360192Z 75722010b82e: Verifying Checksum 2024-08-20T22:08:22.7087085Z 75722010b82e: Download complete 2024-08-20T22:08:22.7087877Z ec1e7978c1fe: Download complete 2024-08-20T22:08:22.7805036Z ac23c5fcc1ef: Verifying Checksum 2024-08-20T22:08:22.7805495Z ac23c5fcc1ef: Download complete 2024-08-20T22:08:23.5037983Z 7a2c55901189: Pull complete 2024-08-20T22:08:23.8149632Z 224fe954d725: Pull complete 2024-08-20T22:08:24.7365144Z 75722010b82e: Pull complete 2024-08-20T22:08:24.7569227Z d527cbbb87e3: Pull complete 2024-08-20T22:08:24.7755932Z b57676e46aee: Pull complete 2024-08-20T22:08:25.3063997Z ca426ffc9d2b: Verifying Checksum 2024-08-20T22:08:25.3064458Z ca426ffc9d2b: Download complete 2024-08-20T22:08:25.3792281Z 4373aa743caf: Verifying Checksum 2024-08-20T22:08:25.3792774Z 4373aa743caf: Download complete 2024-08-20T22:08:25.4520537Z 75b2abb16c68: Verifying Checksum 2024-08-20T22:08:25.4520986Z 75b2abb16c68: Download complete 2024-08-20T22:08:25.5381749Z ef1e3ef1e85f: Verifying Checksum 2024-08-20T22:08:25.5382199Z ef1e3ef1e85f: Download complete 2024-08-20T22:08:26.5040157Z 0bf61114d37b: Verifying Checksum 2024-08-20T22:08:26.5040649Z 0bf61114d37b: Download complete 2024-08-20T22:08:26.5650365Z 2df849f72ba4: Verifying Checksum 2024-08-20T22:08:26.5650857Z 2df849f72ba4: Download complete 2024-08-20T22:08:26.6330677Z 34c47d63c5de: Download complete 2024-08-20T22:08:26.7212513Z 1fef4bd19792: Download complete 2024-08-20T22:08:35.6334152Z a8c1e85b5e14: Verifying Checksum 2024-08-20T22:08:35.6334703Z a8c1e85b5e14: Download complete 2024-08-20T22:08:35.7137231Z b119c4fc6c58: Verifying Checksum 2024-08-20T22:08:35.7137686Z b119c4fc6c58: Download complete 2024-08-20T22:08:35.7932165Z 33b639226eee: Verifying Checksum 2024-08-20T22:08:35.7932650Z 33b639226eee: Download complete 2024-08-20T22:08:35.8654090Z d3547bd43146: Verifying Checksum 2024-08-20T22:08:35.8654543Z d3547bd43146: Download complete 2024-08-20T22:08:35.9406425Z 5645520256fa: Download complete 2024-08-20T22:08:36.0143623Z 829ed7d91e38: Verifying Checksum 2024-08-20T22:08:36.0144064Z 829ed7d91e38: Download complete 2024-08-20T22:08:37.2853784Z 385d0421d67c: Verifying Checksum 2024-08-20T22:08:37.2854566Z 385d0421d67c: Download complete 2024-08-20T22:08:37.3645475Z 7cbfce999d76: Download complete 2024-08-20T22:08:37.4463189Z 6658e558ebe4: Download complete 2024-08-20T22:08:37.5118591Z 33444a5a7e01: Verifying Checksum 2024-08-20T22:08:37.5119205Z 33444a5a7e01: Download complete 2024-08-20T22:08:37.5887727Z 7c47122f4e09: Download complete 2024-08-20T22:08:37.6666099Z 1811ff4d3556: Verifying Checksum 2024-08-20T22:08:37.6666554Z 1811ff4d3556: Download complete 2024-08-20T22:08:43.8732063Z 7754ee068b33: Verifying Checksum 2024-08-20T22:08:43.8732539Z 7754ee068b33: Download complete 2024-08-20T22:08:43.9384537Z 0479fbac3361: Verifying Checksum 2024-08-20T22:08:43.9384996Z 0479fbac3361: Download complete 2024-08-20T22:08:44.0254882Z f1d6874dee9c: Verifying Checksum 2024-08-20T22:08:44.0255509Z f1d6874dee9c: Download complete 2024-08-20T22:08:44.4351754Z afc429e87b59: Verifying Checksum 2024-08-20T22:08:44.4352368Z afc429e87b59: Download complete 2024-08-20T22:08:44.5337103Z 019620471c25: Verifying Checksum 2024-08-20T22:08:44.5337608Z 019620471c25: Download complete 2024-08-20T22:08:44.6071176Z 27aeb1b2cd5e: Verifying Checksum 2024-08-20T22:08:44.6071633Z 27aeb1b2cd5e: Download complete 2024-08-20T22:08:44.8643126Z 829c0e19f4b7: Verifying Checksum 2024-08-20T22:08:44.8643784Z 829c0e19f4b7: Download complete 2024-08-20T22:08:44.9351147Z 560cd6122a38: Verifying Checksum 2024-08-20T22:08:44.9351745Z 560cd6122a38: Download complete 2024-08-20T22:08:45.0019248Z 5a4eb19d7219: Download complete 2024-08-20T22:08:45.0710069Z da6a838a66c7: Download complete 2024-08-20T22:08:47.9344297Z 7ed32bc8e469: Verifying Checksum 2024-08-20T22:08:47.9344970Z 7ed32bc8e469: Download complete 2024-08-20T22:08:48.0107370Z 4d4fa6802ab3: Verifying Checksum 2024-08-20T22:08:48.0107955Z 4d4fa6802ab3: Download complete 2024-08-20T22:08:48.0922319Z 0f085d4fa279: Download complete 2024-08-20T22:08:48.5830765Z 4a0412373305: Verifying Checksum 2024-08-20T22:08:48.5831237Z 4a0412373305: Download complete 2024-08-20T22:08:48.6585282Z 302c8c177944: Download complete 2024-08-20T22:08:48.7340372Z a8c1e85b5e14: Pull complete 2024-08-20T22:08:48.7508637Z 02970347dff6: Verifying Checksum 2024-08-20T22:08:48.7509229Z 02970347dff6: Download complete 2024-08-20T22:08:48.8166796Z 916c5e858016: Download complete 2024-08-20T22:08:48.8870168Z a41a8d1c11c8: Pull complete 2024-08-20T22:08:48.8957318Z c42b3602a1fb: Verifying Checksum 2024-08-20T22:08:48.8957806Z c42b3602a1fb: Download complete 2024-08-20T22:08:49.0597691Z 0c1227890755: Pull complete 2024-08-20T22:08:49.1862696Z d8d1234baab3: Pull complete 2024-08-20T22:08:55.4099570Z 6efb96fc87ea: Verifying Checksum 2024-08-20T22:08:55.4100168Z 6efb96fc87ea: Download complete 2024-08-20T22:08:55.4813786Z f957c1624481: Verifying Checksum 2024-08-20T22:08:55.4814292Z f957c1624481: Download complete 2024-08-20T22:08:55.5639218Z 768c31dca016: Verifying Checksum 2024-08-20T22:08:55.5639776Z 768c31dca016: Download complete 2024-08-20T22:08:55.6362105Z 8c32d0ecebbe: Verifying Checksum 2024-08-20T22:08:55.6362692Z 8c32d0ecebbe: Download complete 2024-08-20T22:08:55.6464347Z 4f4fb700ef54: Download complete 2024-08-20T22:08:55.7184451Z 78ee77eddef2: Verifying Checksum 2024-08-20T22:08:55.7185346Z 78ee77eddef2: Download complete 2024-08-20T22:08:55.7950013Z 37513e9b43d7: Verifying Checksum 2024-08-20T22:08:55.7950461Z 37513e9b43d7: Download complete 2024-08-20T22:08:55.9309681Z a7a5392e2bf6: Verifying Checksum 2024-08-20T22:08:55.9310231Z a7a5392e2bf6: Download complete 2024-08-20T22:08:56.0035798Z b10de02255c0: Download complete 2024-08-20T22:08:56.0855404Z e56eeff2db93: Verifying Checksum 2024-08-20T22:08:56.0856053Z e56eeff2db93: Download complete 2024-08-20T22:08:56.1713484Z 70ac3e38d0fd: Download complete 2024-08-20T22:08:56.2393296Z eb09cbf3e416: Download complete 2024-08-20T22:08:56.3724388Z ee1273153675: Verifying Checksum 2024-08-20T22:08:56.3724957Z ee1273153675: Download complete 2024-08-20T22:08:56.4433839Z e22979f9e0ee: Download complete 2024-08-20T22:08:57.0963966Z 6c1f0aabce7c: Verifying Checksum 2024-08-20T22:08:57.0964614Z 6c1f0aabce7c: Download complete 2024-08-20T22:08:57.1834225Z 7ebe49c3a23e: Verifying Checksum 2024-08-20T22:08:57.1834840Z 7ebe49c3a23e: Download complete 2024-08-20T22:09:23.1688815Z 5d115b29b5d5: Verifying Checksum 2024-08-20T22:09:23.1689285Z 5d115b29b5d5: Download complete 2024-08-20T22:09:23.2529679Z 7f2d7a04fbe6: Verifying Checksum 2024-08-20T22:09:23.2530283Z 7f2d7a04fbe6: Download complete 2024-08-20T22:09:23.3255892Z d79fd7d52698: Download complete 2024-08-20T22:09:24.6987037Z 9752d6fbbcab: Verifying Checksum 2024-08-20T22:09:24.7604967Z 9752d6fbbcab: Download complete 2024-08-20T22:09:24.7605385Z 83808b2eff4d: Verifying Checksum 2024-08-20T22:09:24.7605784Z 83808b2eff4d: Download complete 2024-08-20T22:10:03.2964595Z 11fad972ef6c: Verifying Checksum 2024-08-20T22:10:03.2966627Z 11fad972ef6c: Download complete 2024-08-20T22:10:04.7030362Z cbb79a705353: Verifying Checksum 2024-08-20T22:10:04.7030933Z cbb79a705353: Download complete 2024-08-20T22:10:18.6813044Z 7ed32bc8e469: Pull complete 2024-08-20T22:10:18.9106057Z ec1e7978c1fe: Pull complete 2024-08-20T22:10:19.1334444Z ac23c5fcc1ef: Pull complete 2024-08-20T22:10:27.7668722Z ca426ffc9d2b: Pull complete 2024-08-20T22:10:27.9917072Z 4373aa743caf: Pull complete 2024-08-20T22:10:28.2142785Z 75b2abb16c68: Pull complete 2024-08-20T22:10:28.4522666Z ef1e3ef1e85f: Pull complete 2024-08-20T22:10:30.9816645Z 0bf61114d37b: Pull complete 2024-08-20T22:10:31.0595898Z 2df849f72ba4: Pull complete 2024-08-20T22:10:31.1767763Z 34c47d63c5de: Pull complete 2024-08-20T22:10:31.3175875Z 1fef4bd19792: Pull complete 2024-08-20T22:11:29.8143977Z 6efb96fc87ea: Pull complete 2024-08-20T22:11:29.9559573Z b119c4fc6c58: Pull complete 2024-08-20T22:11:30.1206450Z 33b639226eee: Pull complete 2024-08-20T22:11:30.3419177Z d3547bd43146: Pull complete 2024-08-20T22:11:30.5632112Z 5645520256fa: Pull complete 2024-08-20T22:11:30.7532522Z 829ed7d91e38: Pull complete 2024-08-20T22:11:34.3085988Z 385d0421d67c: Pull complete 2024-08-20T22:11:34.5147378Z 7cbfce999d76: Pull complete 2024-08-20T22:11:34.7252672Z 6658e558ebe4: Pull complete 2024-08-20T22:11:34.8255511Z 33444a5a7e01: Pull complete 2024-08-20T22:11:35.0447199Z 7c47122f4e09: Pull complete 2024-08-20T22:11:35.1896589Z 1811ff4d3556: Pull complete 2024-08-20T22:11:45.5728290Z 7754ee068b33: Pull complete 2024-08-20T22:11:45.8000904Z 0479fbac3361: Pull complete 2024-08-20T22:11:46.0424442Z f1d6874dee9c: Pull complete 2024-08-20T22:11:47.0115732Z afc429e87b59: Pull complete 2024-08-20T22:11:47.2099354Z 019620471c25: Pull complete 2024-08-20T22:11:47.4198033Z 27aeb1b2cd5e: Pull complete 2024-08-20T22:11:47.9263830Z 829c0e19f4b7: Pull complete 2024-08-20T22:11:48.1289111Z 560cd6122a38: Pull complete 2024-08-20T22:11:48.4641081Z 5a4eb19d7219: Pull complete 2024-08-20T22:11:48.6884611Z da6a838a66c7: Pull complete 2024-08-20T22:12:27.2138943Z cbb79a705353: Pull complete 2024-08-20T22:12:27.4483212Z 4d4fa6802ab3: Pull complete 2024-08-20T22:12:27.6738119Z 0f085d4fa279: Pull complete 2024-08-20T22:12:30.1105711Z 4a0412373305: Pull complete 2024-08-20T22:12:30.1312652Z 302c8c177944: Pull complete 2024-08-20T22:12:30.1487633Z 02970347dff6: Pull complete 2024-08-20T22:12:30.1863513Z 916c5e858016: Pull complete 2024-08-20T22:12:30.2056291Z c42b3602a1fb: Pull complete 2024-08-20T22:13:52.0223418Z 11fad972ef6c: Pull complete 2024-08-20T22:13:52.2417027Z f957c1624481: Pull complete 2024-08-20T22:13:52.4477300Z 768c31dca016: Pull complete 2024-08-20T22:13:52.8535312Z 8c32d0ecebbe: Pull complete 2024-08-20T22:13:53.0723425Z 4f4fb700ef54: Pull complete 2024-08-20T22:13:53.2746360Z 78ee77eddef2: Pull complete 2024-08-20T22:13:53.4802025Z 37513e9b43d7: Pull complete 2024-08-20T22:13:53.8619845Z a7a5392e2bf6: Pull complete 2024-08-20T22:13:54.0786540Z b10de02255c0: Pull complete 2024-08-20T22:13:54.3026281Z e56eeff2db93: Pull complete 2024-08-20T22:13:54.5319447Z 70ac3e38d0fd: Pull complete 2024-08-20T22:13:54.7557936Z eb09cbf3e416: Pull complete 2024-08-20T22:13:56.1647596Z ee1273153675: Pull complete 2024-08-20T22:13:56.3840604Z e22979f9e0ee: Pull complete 2024-08-20T22:13:58.5247328Z 6c1f0aabce7c: Pull complete 2024-08-20T22:13:58.7653903Z 7ebe49c3a23e: Pull complete 2024-08-20T22:14:12.1637909Z 5d115b29b5d5: Pull complete 2024-08-20T22:14:12.3636311Z 7f2d7a04fbe6: Pull complete 2024-08-20T22:14:12.5583475Z d79fd7d52698: Pull complete 2024-08-20T22:14:13.4132536Z 9752d6fbbcab: Pull complete 2024-08-20T22:14:13.6077885Z 83808b2eff4d: Pull complete 2024-08-20T22:14:14.4964577Z Digest: sha256:3a95d3a177465127ef6cd3b50787d6a050367070fd9063dbb688fad07a96b402 2024-08-20T22:14:14.5218039Z Status: Downloaded newer image for 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:14:14.5396357Z 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:14:14.5538412Z ##[group]Run echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> "$GITHUB_OUTPUT" 2024-08-20T22:14:14.5539342Z echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> "$GITHUB_OUTPUT" 2024-08-20T22:14:14.5551301Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:14:14.5551800Z env: 2024-08-20T22:14:14.5552079Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:14:14.5552421Z ##[endgroup] 2024-08-20T22:14:14.5733331Z ##[group]Run pytorch/test-infra/.github/actions/setup-nvidia@main 2024-08-20T22:14:14.5733886Z with: 2024-08-20T22:14:14.5734183Z driver-version: 550.54.15 2024-08-20T22:14:14.5734529Z env: 2024-08-20T22:14:14.5734812Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:14:14.5735167Z ##[endgroup] 2024-08-20T22:14:14.5845614Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2024-08-20T22:14:14.5846174Z with: 2024-08-20T22:14:14.5846458Z timeout_minutes: 10 2024-08-20T22:14:14.5846786Z max_attempts: 3 2024-08-20T22:14:14.5879467Z command: # Is it disgusting to have a full shell script here in this github action? Sure # But is it the best way to make it so that this action relies on nothing else? Absolutely set -eou pipefail DISTRIBUTION=$(. /etc/os-release;echo $ID$VERSION_ID) DRIVER_FN="NVIDIA-Linux-x86_64-${DRIVER_VERSION}.run" install_nvidia_docker2_amzn2() { ( set -x # Needed for yum-config-manager sudo yum install -y yum-utils if [[ "${DISTRIBUTION}" == "amzn2023" ]] ; then YUM_REPO_URL="https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo" else # Amazon Linux 2 YUM_REPO_URL="https://nvidia.github.io/nvidia-docker/${DISTRIBUTION}/nvidia-docker.repo" fi sudo yum-config-manager --add-repo "${YUM_REPO_URL}" sudo yum install -y nvidia-docker2 sudo systemctl restart docker ) } install_nvidia_docker2_ubuntu20() { ( set -x # Install nvidia-driver package if not installed status="$(dpkg-query -W --showformat='${db:Status-Status}' nvidia-docker2 2>&1)" if [ ! $? = 0 ] || [ ! "$status" = installed ]; then sudo apt-get install -y nvidia-docker2 sudo systemctl restart docker fi ) } pre_install_nvidia_driver_amzn2() { ( # Purge any nvidia driver installed from RHEL repo sudo yum remove -y nvidia-driver-latest-dkms ) } install_nvidia_driver_common() { ( # Try to gather more information about the runner and its existing NVIDIA driver if any echo "Before installing NVIDIA driver" lspci lsmod modinfo nvidia || true HAS_NVIDIA_DRIVER=0 # Check if NVIDIA driver has already been installed if [ -x "$(command -v nvidia-smi)" ]; then set +e # The driver exists, check its version next. Also check only the first GPU if there are more than one of them # so that the same driver version is not print over multiple lines INSTALLED_DRIVER_VERSION=$(nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0) NVIDIA_SMI_STATUS=$? if [ "$NVIDIA_SMI_STATUS" -ne 0 ] && [ "$NVIDIA_SMI_STATUS" -ne 14 ]; then echo "Failed to get NVIDIA driver version ($INSTALLED_DRIVER_VERSION). Continuing" elif [ "$INSTALLED_DRIVER_VERSION" != "$DRIVER_VERSION" ]; then echo "NVIDIA driver ($INSTALLED_DRIVER_VERSION) has been installed, but we expect to have $DRIVER_VERSION instead. Continuing" else HAS_NVIDIA_DRIVER=1 echo "NVIDIA driver ($INSTALLED_DRIVER_VERSION) has already been installed. Skipping NVIDIA driver installation" fi set -e fi if [ "$HAS_NVIDIA_DRIVER" -eq 0 ]; then # CAUTION: this may need to be updated in future if [ "${DISTRIBUTION}" != ubuntu20.04 ]; then sudo yum groupinstall -y "Development Tools" # ensure our kernel install is the same as our underlying kernel, # groupinstall "Development Tools" has a habit of mismatching kernel headers sudo yum install -y "kernel-devel-uname-r == $(uname -r)" sudo modprobe backlight fi sudo curl -fsL -o /tmp/nvidia_driver "https://s3.amazonaws.com/ossci-linux/nvidia_driver/$DRIVER_FN" set +e sudo /bin/bash /tmp/nvidia_driver -s --no-drm NVIDIA_INSTALLATION_STATUS=$? RESET_GPU=0 if [ "$NVIDIA_INSTALLATION_STATUS" -ne 0 ]; then sudo cat /var/log/nvidia-installer.log # Fail to install NVIDIA driver, try to reset the GPU RESET_GPU=1 elif [ -x "$(command -v nvidia-smi)" ]; then # Check again if nvidia-smi works even if the driver installation completes successfully INSTALLED_DRIVER_VERSION=$(nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0) NVIDIA_SMI_STATUS=$? if [ "$NVIDIA_SMI_STATUS" -ne 0 ] && [ "$NVIDIA_SMI_STATUS" -ne 14 ]; then RESET_GPU=1 fi fi if [ "$RESET_GPU" -eq 1 ]; then NVIDIA_DEVICES=$(lspci -D | grep -i NVIDIA | cut -d' ' -f1) # The GPU can get stuck in a failure state if somehow the test crashs the GPU microcode. When this # happens, we'll try to reset all NVIDIA devices https://github.com/pytorch/pytorch/issues/88388 for PCI_ID in $NVIDIA_DEVICES; do DEVICE_ENABLED=$(cat /sys/bus/pci/devices/$PCI_ID/enable) echo "Reseting $PCI_ID (enabled state: $DEVICE_ENABLED)" # This requires sudo permission of course echo "1" | sudo tee /sys/bus/pci/devices/$PCI_ID/reset sleep 1 done fi sudo rm -fv /tmp/nvidia_driver set -e fi ) } post_install_nvidia_driver_common() { ( sudo modprobe nvidia || true echo "After installing NVIDIA driver" lspci lsmod modinfo nvidia || true ( set +e nvidia-smi # NB: Annoyingly, nvidia-smi command returns successfully with return code 0 even in # the case where the driver has already crashed as it still can get the driver version # and some basic information like the bus ID. However, the rest of the information # would be missing (ERR!), for example: # # +-----------------------------------------------------------------------------+ # | NVIDIA-SMI 525.89.02 Driver Version: 525.89.02 CUDA Version: 12.0 | # |-------------------------------+----------------------+----------------------+ # | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | # | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | # | | | MIG M. | # |===============================+======================+======================| # | 0 ERR! Off | 00000000:00:1E.0 Off | ERR! | # |ERR! ERR! ERR! ERR! / ERR! | 4184MiB / 23028MiB | ERR! Default | # | | | ERR! | # +-------------------------------+----------------------+----------------------+ # # +-----------------------------------------------------------------------------+ # | Processes: | # | GPU GI CI PID Type Process name GPU Memory | # | ID ID Usage | # |=============================================================================| # +-----------------------------------------------------------------------------+ # # This should be reported as a failure instead as it will guarantee to fail when # Docker tries to run with --gpus all # # So, the correct check here is to query one of the missing piece of info like # GPU name, so that the command can fail accordingly nvidia-smi --query-gpu=gpu_name --format=csv,noheader --id=0 NVIDIA_SMI_STATUS=$? # Allowable exit statuses for nvidia-smi, see: https://github.com/NVIDIA/gpu-operator/issues/285 if [ "$NVIDIA_SMI_STATUS" -eq 0 ] || [ "$NVIDIA_SMI_STATUS" -eq 14 ]; then echo "INFO: Ignoring allowed status ${NVIDIA_SMI_STATUS}" else echo "ERROR: nvidia-smi exited with unresolved status ${NVIDIA_SMI_STATUS}" exit ${NVIDIA_SMI_STATUS} fi set -e ) ) } install_nvidia_driver_amzn2() { ( set -x pre_install_nvidia_driver_amzn2 install_nvidia_driver_common post_install_nvidia_driver_common ) } install_nvidia_driver_ubuntu20() { ( set -x install_nvidia_driver_common post_install_nvidia_driver_common ) } echo "== Installing nvidia driver ${DRIVER_FN} ==" case "${DISTRIBUTION}" in amzn*) install_nvidia_driver_amzn2 ;; ubuntu20.04) install_nvidia_driver_ubuntu20 ;; *) echo "ERROR: Unknown distribution ${DISTRIBUTION}" exit 1 ;; esac # Install container toolkit based on distribution echo "== Installing nvidia container toolkit for ${DISTRIBUTION} ==" case "${DISTRIBUTION}" in amzn*) install_nvidia_docker2_amzn2 ;; ubuntu20.04) install_nvidia_docker2_ubuntu20 ;; *) echo "ERROR: Unknown distribution ${DISTRIBUTION}" exit 1 ;; esac echo "GPU_FLAG=--gpus all -e NVIDIA_DRIVER_CAPABILITIES=all" >> "${GITHUB_ENV}" # Fix https://github.com/NVIDIA/nvidia-docker/issues/1648 on runners with # more than one GPUs. This just needs to be run once. The command fails # on subsequent runs and complains that the mode is already on, but that's # ok sudo nvidia-persistenced || true # This should show persistence mode ON nvidia-smi 2024-08-20T22:14:14.5912566Z retry_wait_seconds: 10 2024-08-20T22:14:14.5912930Z polling_interval_seconds: 1 2024-08-20T22:14:14.5913296Z warning_on_retry: true 2024-08-20T22:14:14.5913646Z continue_on_error: false 2024-08-20T22:14:14.5913978Z env: 2024-08-20T22:14:14.5914249Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:14:14.5914594Z DRIVER_VERSION: 550.54.15 2024-08-20T22:14:14.5914941Z ##[endgroup] 2024-08-20T22:14:14.6725327Z == Installing nvidia driver NVIDIA-Linux-x86_64-550.54.15.run == 2024-08-20T22:14:14.6726453Z + pre_install_nvidia_driver_amzn2 2024-08-20T22:14:14.6727523Z + sudo yum remove -y nvidia-driver-latest-dkms 2024-08-20T22:14:15.1634864Z No match for argument: nvidia-driver-latest-dkms 2024-08-20T22:14:15.1635418Z No packages marked for removal. 2024-08-20T22:14:15.1700093Z Dependencies resolved. 2024-08-20T22:14:15.1711525Z Nothing to do. 2024-08-20T22:14:15.1712423Z Complete! 2024-08-20T22:14:15.2427752Z + install_nvidia_driver_common 2024-08-20T22:14:15.2430402Z + echo 'Before installing NVIDIA driver' 2024-08-20T22:14:15.2431025Z + lspci 2024-08-20T22:14:15.2431450Z Before installing NVIDIA driver 2024-08-20T22:14:15.3134088Z 00:00.0 Host bridge: Intel Corporation 440FX - 82441FX PMC [Natoma] 2024-08-20T22:14:15.3134846Z 00:01.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II] 2024-08-20T22:14:15.3135935Z 00:01.3 Non-VGA unclassified device: Intel Corporation 82371AB/EB/MB PIIX4 ACPI (rev 08) 2024-08-20T22:14:15.3137085Z 00:03.0 VGA compatible controller: Amazon.com, Inc. Device 1111 2024-08-20T22:14:15.3137914Z 00:04.0 Non-Volatile memory controller: Amazon.com, Inc. NVMe EBS Controller 2024-08-20T22:14:15.3138708Z 00:05.0 Ethernet controller: Amazon.com, Inc. Elastic Network Adapter (ENA) 2024-08-20T22:14:15.3139445Z 00:1e.0 3D controller: NVIDIA Corporation GA102GL [A10G] (rev a1) 2024-08-20T22:14:15.3140266Z 00:1f.0 Non-Volatile memory controller: Amazon.com, Inc. NVMe SSD Controller 2024-08-20T22:14:15.3140857Z + lsmod 2024-08-20T22:14:15.3182313Z Module Size Used by 2024-08-20T22:14:15.3182956Z xt_conntrack 16384 1 2024-08-20T22:14:15.3183428Z nft_chain_nat 16384 3 2024-08-20T22:14:15.3183898Z xt_MASQUERADE 20480 1 2024-08-20T22:14:15.3184490Z nf_nat 57344 2 nft_chain_nat,xt_MASQUERADE 2024-08-20T22:14:15.3185133Z nf_conntrack_netlink 57344 0 2024-08-20T22:14:15.3185750Z nf_conntrack 184320 4 xt_conntrack,nf_nat,nf_conntrack_netlink,xt_MASQUERADE 2024-08-20T22:14:15.3186422Z nf_defrag_ipv6 24576 1 nf_conntrack 2024-08-20T22:14:15.3186886Z nf_defrag_ipv4 16384 1 nf_conntrack 2024-08-20T22:14:15.3187356Z xfrm_user 57344 1 2024-08-20T22:14:15.3187770Z xfrm_algo 16384 1 xfrm_user 2024-08-20T22:14:15.3188192Z xt_addrtype 16384 2 2024-08-20T22:14:15.3188603Z nft_compat 20480 4 2024-08-20T22:14:15.3189049Z nf_tables 307200 57 nft_compat,nft_chain_nat 2024-08-20T22:14:15.3189732Z nfnetlink 20480 4 nft_compat,nf_conntrack_netlink,nf_tables 2024-08-20T22:14:15.3190263Z br_netfilter 36864 0 2024-08-20T22:14:15.3190826Z bridge 307200 1 br_netfilter 2024-08-20T22:14:15.3191414Z stp 16384 1 bridge 2024-08-20T22:14:15.3191957Z llc 16384 2 bridge,stp 2024-08-20T22:14:15.3192488Z overlay 167936 0 2024-08-20T22:14:15.3192847Z tls 114688 0 2024-08-20T22:14:15.3193218Z nls_ascii 16384 1 2024-08-20T22:14:15.3193584Z sunrpc 692224 1 2024-08-20T22:14:15.3193964Z nls_cp437 20480 1 2024-08-20T22:14:15.3194320Z vfat 24576 1 2024-08-20T22:14:15.3194683Z fat 86016 1 vfat 2024-08-20T22:14:15.3195070Z ena 167936 0 2024-08-20T22:14:15.3195637Z ghash_clmulni_intel 16384 0 2024-08-20T22:14:15.3196010Z ptp 36864 1 ena 2024-08-20T22:14:15.3196401Z pps_core 24576 1 ptp 2024-08-20T22:14:15.3196797Z aesni_intel 393216 0 2024-08-20T22:14:15.3197159Z i8042 45056 0 2024-08-20T22:14:15.3197520Z serio 28672 3 i8042 2024-08-20T22:14:15.3197939Z crypto_simd 16384 1 aesni_intel 2024-08-20T22:14:15.3198457Z cryptd 28672 2 crypto_simd,ghash_clmulni_intel 2024-08-20T22:14:15.3198938Z button 24576 0 2024-08-20T22:14:15.3199306Z sch_fq_codel 20480 17 2024-08-20T22:14:15.3199679Z dm_mod 188416 0 2024-08-20T22:14:15.3200040Z fuse 163840 1 2024-08-20T22:14:15.3200390Z loop 36864 0 2024-08-20T22:14:15.3200761Z dax 45056 1 dm_mod 2024-08-20T22:14:15.3201161Z configfs 57344 1 2024-08-20T22:14:15.3201549Z dmi_sysfs 20480 0 2024-08-20T22:14:15.3202037Z crc32_pclmul 16384 0 2024-08-20T22:14:15.3202517Z crc32c_intel 24576 0 2024-08-20T22:14:15.3203083Z efivarfs 24576 1 2024-08-20T22:14:15.3203544Z + modinfo nvidia 2024-08-20T22:14:15.3204589Z filename: /lib/modules/6.1.94-99.176.amzn2023.x86_64/kernel/drivers/video/nvidia.ko 2024-08-20T22:14:15.3205288Z alias: char-major-195-* 2024-08-20T22:14:15.3205671Z version: 550.54.15 2024-08-20T22:14:15.3206014Z supported: external 2024-08-20T22:14:15.3206347Z license: NVIDIA 2024-08-20T22:14:15.3206725Z firmware: nvidia/550.54.15/gsp_tu10x.bin 2024-08-20T22:14:15.3207198Z firmware: nvidia/550.54.15/gsp_ga10x.bin 2024-08-20T22:14:15.3207653Z srcversion: 833721318DA517F0C2FEC97 2024-08-20T22:14:15.3208103Z alias: pci:v000010DEd*sv*sd*bc06sc80i00* 2024-08-20T22:14:15.3208638Z alias: pci:v000010DEd*sv*sd*bc03sc02i00* 2024-08-20T22:14:15.3209129Z alias: pci:v000010DEd*sv*sd*bc03sc00i00* 2024-08-20T22:14:15.3209620Z depends: i2c-core,drm 2024-08-20T22:14:15.3209976Z retpoline: Y 2024-08-20T22:14:15.3210286Z name: nvidia 2024-08-20T22:14:15.3211006Z vermagic: 6.1.94-99.176.amzn2023.x86_64 SMP preempt mod_unload modversions 2024-08-20T22:14:15.3211696Z parm: NvSwitchRegDwords:NvSwitch regkey (charp) 2024-08-20T22:14:15.3212334Z parm: NvSwitchBlacklist:NvSwitchBlacklist=uuid[,uuid...] (charp) 2024-08-20T22:14:15.3213026Z parm: NVreg_ResmanDebugLevel:int 2024-08-20T22:14:15.3213464Z parm: NVreg_RmLogonRC:int 2024-08-20T22:14:15.3213896Z parm: NVreg_ModifyDeviceFiles:int 2024-08-20T22:14:15.3214352Z parm: NVreg_DeviceFileUID:int 2024-08-20T22:14:15.3214784Z parm: NVreg_DeviceFileGID:int 2024-08-20T22:14:15.3215223Z parm: NVreg_DeviceFileMode:int 2024-08-20T22:14:15.3215738Z parm: NVreg_InitializeSystemMemoryAllocations:int 2024-08-20T22:14:15.3216289Z parm: NVreg_UsePageAttributeTable:int 2024-08-20T22:14:15.3216770Z parm: NVreg_EnablePCIeGen3:int 2024-08-20T22:14:15.3217197Z parm: NVreg_EnableMSI:int 2024-08-20T22:14:15.3217606Z parm: NVreg_TCEBypassMode:int 2024-08-20T22:14:15.3218064Z parm: NVreg_EnableStreamMemOPs:int 2024-08-20T22:14:15.3218587Z parm: NVreg_RestrictProfilingToAdminUsers:int 2024-08-20T22:14:15.3219200Z parm: NVreg_PreserveVideoMemoryAllocations:int 2024-08-20T22:14:15.3219775Z parm: NVreg_EnableS0ixPowerManagement:int 2024-08-20T22:14:15.3220375Z parm: NVreg_S0ixPowerManagementVideoMemoryThreshold:int 2024-08-20T22:14:15.3220963Z parm: NVreg_DynamicPowerManagement:int 2024-08-20T22:14:15.3221564Z parm: NVreg_DynamicPowerManagementVideoMemoryThreshold:int 2024-08-20T22:14:15.3222146Z parm: NVreg_EnableGpuFirmware:int 2024-08-20T22:14:15.3222628Z parm: NVreg_EnableGpuFirmwareLogs:int 2024-08-20T22:14:15.3223152Z parm: NVreg_OpenRmEnableUnsupportedGpus:int 2024-08-20T22:14:15.3223792Z parm: NVreg_EnableUserNUMAManagement:int 2024-08-20T22:14:15.3224281Z parm: NVreg_MemoryPoolSize:int 2024-08-20T22:14:15.3224741Z parm: NVreg_KMallocHeapMaxSize:int 2024-08-20T22:14:15.3225220Z parm: NVreg_VMallocHeapMaxSize:int 2024-08-20T22:14:15.3225680Z parm: NVreg_IgnoreMMIOCheck:int 2024-08-20T22:14:15.3226132Z parm: NVreg_NvLinkDisable:int 2024-08-20T22:14:15.3226629Z parm: NVreg_EnablePCIERelaxedOrderingMode:int 2024-08-20T22:14:15.3227146Z parm: NVreg_RegisterPCIDriver:int 2024-08-20T22:14:15.3227618Z parm: NVreg_EnableResizableBar:int 2024-08-20T22:14:15.3228102Z parm: NVreg_EnableDbgBreakpoint:int 2024-08-20T22:14:15.3228649Z parm: NVreg_EnableNonblockingOpen:int 2024-08-20T22:14:15.3229156Z parm: NVreg_RegistryDwords:charp 2024-08-20T22:14:15.3229639Z parm: NVreg_RegistryDwordsPerDevice:charp 2024-08-20T22:14:15.3230121Z parm: NVreg_RmMsg:charp 2024-08-20T22:14:15.3230524Z parm: NVreg_GpuBlacklist:charp 2024-08-20T22:14:15.3230976Z parm: NVreg_TemporaryFilePath:charp 2024-08-20T22:14:15.3231445Z parm: NVreg_ExcludedGpus:charp 2024-08-20T22:14:15.3231896Z parm: NVreg_DmaRemapPeerMmio:int 2024-08-20T22:14:15.3232366Z parm: NVreg_RmNvlinkBandwidth:charp 2024-08-20T22:14:15.3232828Z parm: NVreg_ImexChannelCount:int 2024-08-20T22:14:15.3233271Z parm: rm_firmware_active:charp 2024-08-20T22:14:15.3233673Z + HAS_NVIDIA_DRIVER=0 2024-08-20T22:14:15.3234079Z ++ command -v nvidia-smi 2024-08-20T22:14:15.3234478Z + '[' -x /usr/bin/nvidia-smi ']' 2024-08-20T22:14:15.3234839Z + set +e 2024-08-20T22:14:15.3235348Z ++ nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0 2024-08-20T22:14:17.5896563Z + INSTALLED_DRIVER_VERSION=550.54.15 2024-08-20T22:14:17.5897168Z + NVIDIA_SMI_STATUS=0 2024-08-20T22:14:17.5897764Z + '[' 0 -ne 0 ']' 2024-08-20T22:14:17.5898299Z + '[' 550.54.15 '!=' 550.54.15 ']' 2024-08-20T22:14:17.5898849Z + HAS_NVIDIA_DRIVER=1 2024-08-20T22:14:17.5901244Z + echo 'NVIDIA driver (550.54.15) has already been installed. Skipping NVIDIA driver installation' 2024-08-20T22:14:17.5902310Z + set -e 2024-08-20T22:14:17.5902734Z + '[' 1 -eq 0 ']' 2024-08-20T22:14:17.5903318Z NVIDIA driver (550.54.15) has already been installed. Skipping NVIDIA driver installation 2024-08-20T22:14:17.5904013Z + post_install_nvidia_driver_common 2024-08-20T22:14:17.5904412Z + sudo modprobe nvidia 2024-08-20T22:14:17.6741605Z + echo 'After installing NVIDIA driver' 2024-08-20T22:14:17.6742124Z + lspci 2024-08-20T22:14:17.6742575Z After installing NVIDIA driver 2024-08-20T22:14:17.6852680Z 00:00.0 Host bridge: Intel Corporation 440FX - 82441FX PMC [Natoma] 2024-08-20T22:14:17.6853686Z 00:01.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II] 2024-08-20T22:14:17.6854841Z 00:01.3 Non-VGA unclassified device: Intel Corporation 82371AB/EB/MB PIIX4 ACPI (rev 08) 2024-08-20T22:14:17.6855816Z 00:03.0 VGA compatible controller: Amazon.com, Inc. Device 1111 2024-08-20T22:14:17.6856643Z 00:04.0 Non-Volatile memory controller: Amazon.com, Inc. NVMe EBS Controller 2024-08-20T22:14:17.6857429Z 00:05.0 Ethernet controller: Amazon.com, Inc. Elastic Network Adapter (ENA) 2024-08-20T22:14:17.6858156Z 00:1e.0 3D controller: NVIDIA Corporation GA102GL [A10G] (rev a1) 2024-08-20T22:14:17.6858965Z 00:1f.0 Non-Volatile memory controller: Amazon.com, Inc. NVMe SSD Controller 2024-08-20T22:14:17.6859548Z + lsmod 2024-08-20T22:14:17.6885150Z Module Size Used by 2024-08-20T22:14:17.6885686Z nvidia_uvm 4706304 0 2024-08-20T22:14:17.6886220Z nvidia 54071296 1 nvidia_uvm 2024-08-20T22:14:17.6886791Z drm 602112 1 nvidia 2024-08-20T22:14:17.6887429Z drm_panel_orientation_quirks 28672 1 drm 2024-08-20T22:14:17.6887946Z backlight 24576 1 drm 2024-08-20T22:14:17.6888367Z i2c_core 106496 2 nvidia,drm 2024-08-20T22:14:17.6889298Z xt_conntrack 16384 1 2024-08-20T22:14:17.6889799Z nft_chain_nat 16384 3 2024-08-20T22:14:17.6890294Z xt_MASQUERADE 20480 1 2024-08-20T22:14:17.6890818Z nf_nat 57344 2 nft_chain_nat,xt_MASQUERADE 2024-08-20T22:14:17.6891306Z nf_conntrack_netlink 57344 0 2024-08-20T22:14:17.6891879Z nf_conntrack 184320 4 xt_conntrack,nf_nat,nf_conntrack_netlink,xt_MASQUERADE 2024-08-20T22:14:17.6892521Z nf_defrag_ipv6 24576 1 nf_conntrack 2024-08-20T22:14:17.6892989Z nf_defrag_ipv4 16384 1 nf_conntrack 2024-08-20T22:14:17.6893422Z xfrm_user 57344 1 2024-08-20T22:14:17.6893813Z xfrm_algo 16384 1 xfrm_user 2024-08-20T22:14:17.6894235Z xt_addrtype 16384 2 2024-08-20T22:14:17.6894616Z nft_compat 20480 4 2024-08-20T22:14:17.6895066Z nf_tables 307200 57 nft_compat,nft_chain_nat 2024-08-20T22:14:17.6895676Z nfnetlink 20480 4 nft_compat,nf_conntrack_netlink,nf_tables 2024-08-20T22:14:17.6896222Z br_netfilter 36864 0 2024-08-20T22:14:17.6896638Z bridge 307200 1 br_netfilter 2024-08-20T22:14:17.6897081Z stp 16384 1 bridge 2024-08-20T22:14:17.6897503Z llc 16384 2 bridge,stp 2024-08-20T22:14:17.6897919Z overlay 167936 0 2024-08-20T22:14:17.6898285Z tls 114688 0 2024-08-20T22:14:17.6898644Z nls_ascii 16384 1 2024-08-20T22:14:17.6899016Z sunrpc 692224 1 2024-08-20T22:14:17.6899396Z nls_cp437 20480 1 2024-08-20T22:14:17.6899797Z vfat 24576 1 2024-08-20T22:14:17.6900159Z fat 86016 1 vfat 2024-08-20T22:14:17.6900548Z ena 167936 0 2024-08-20T22:14:17.6900919Z ghash_clmulni_intel 16384 0 2024-08-20T22:14:17.6901295Z ptp 36864 1 ena 2024-08-20T22:14:17.6901713Z pps_core 24576 1 ptp 2024-08-20T22:14:17.6902260Z aesni_intel 393216 0 2024-08-20T22:14:17.6902790Z i8042 45056 0 2024-08-20T22:14:17.6903221Z serio 28672 3 i8042 2024-08-20T22:14:17.6904031Z crypto_simd 16384 1 aesni_intel 2024-08-20T22:14:17.6904730Z cryptd 28672 2 crypto_simd,ghash_clmulni_intel 2024-08-20T22:14:17.6905374Z button 24576 0 2024-08-20T22:14:17.6905848Z sch_fq_codel 20480 17 2024-08-20T22:14:17.6906335Z dm_mod 188416 0 2024-08-20T22:14:17.6906758Z fuse 163840 1 2024-08-20T22:14:17.6907115Z loop 36864 0 2024-08-20T22:14:17.6907603Z dax 45056 1 dm_mod 2024-08-20T22:14:17.6908195Z configfs 57344 1 2024-08-20T22:14:17.6908726Z dmi_sysfs 20480 0 2024-08-20T22:14:17.6909100Z crc32_pclmul 16384 0 2024-08-20T22:14:17.6909471Z crc32c_intel 24576 0 2024-08-20T22:14:17.6909839Z efivarfs 24576 1 2024-08-20T22:14:17.6910213Z + modinfo nvidia 2024-08-20T22:14:17.6910906Z filename: /lib/modules/6.1.94-99.176.amzn2023.x86_64/kernel/drivers/video/nvidia.ko 2024-08-20T22:14:17.6911612Z alias: char-major-195-* 2024-08-20T22:14:17.6911995Z version: 550.54.15 2024-08-20T22:14:17.6912343Z supported: external 2024-08-20T22:14:17.6912677Z license: NVIDIA 2024-08-20T22:14:17.6913057Z firmware: nvidia/550.54.15/gsp_tu10x.bin 2024-08-20T22:14:17.6913535Z firmware: nvidia/550.54.15/gsp_ga10x.bin 2024-08-20T22:14:17.6913998Z srcversion: 833721318DA517F0C2FEC97 2024-08-20T22:14:17.6914458Z alias: pci:v000010DEd*sv*sd*bc06sc80i00* 2024-08-20T22:14:17.6914959Z alias: pci:v000010DEd*sv*sd*bc03sc02i00* 2024-08-20T22:14:17.6915452Z alias: pci:v000010DEd*sv*sd*bc03sc00i00* 2024-08-20T22:14:17.6915954Z depends: i2c-core,drm 2024-08-20T22:14:17.6916306Z retpoline: Y 2024-08-20T22:14:17.6916622Z name: nvidia 2024-08-20T22:14:17.6917234Z vermagic: 6.1.94-99.176.amzn2023.x86_64 SMP preempt mod_unload modversions 2024-08-20T22:14:17.6918137Z parm: NvSwitchRegDwords:NvSwitch regkey (charp) 2024-08-20T22:14:17.6918775Z parm: NvSwitchBlacklist:NvSwitchBlacklist=uuid[,uuid...] (charp) 2024-08-20T22:14:17.6919363Z parm: NVreg_ResmanDebugLevel:int 2024-08-20T22:14:17.6919807Z parm: NVreg_RmLogonRC:int 2024-08-20T22:14:17.6920235Z parm: NVreg_ModifyDeviceFiles:int 2024-08-20T22:14:17.6920694Z parm: NVreg_DeviceFileUID:int 2024-08-20T22:14:17.6921140Z parm: NVreg_DeviceFileGID:int 2024-08-20T22:14:17.6921585Z parm: NVreg_DeviceFileMode:int 2024-08-20T22:14:17.6922105Z parm: NVreg_InitializeSystemMemoryAllocations:int 2024-08-20T22:14:17.6922663Z parm: NVreg_UsePageAttributeTable:int 2024-08-20T22:14:17.6923220Z parm: NVreg_EnablePCIeGen3:int 2024-08-20T22:14:17.6923649Z parm: NVreg_EnableMSI:int 2024-08-20T22:14:17.6924065Z parm: NVreg_TCEBypassMode:int 2024-08-20T22:14:17.6924543Z parm: NVreg_EnableStreamMemOPs:int 2024-08-20T22:14:17.6925073Z parm: NVreg_RestrictProfilingToAdminUsers:int 2024-08-20T22:14:17.6925656Z parm: NVreg_PreserveVideoMemoryAllocations:int 2024-08-20T22:14:17.6926205Z parm: NVreg_EnableS0ixPowerManagement:int 2024-08-20T22:14:17.6926812Z parm: NVreg_S0ixPowerManagementVideoMemoryThreshold:int 2024-08-20T22:14:17.6927404Z parm: NVreg_DynamicPowerManagement:int 2024-08-20T22:14:17.6928011Z parm: NVreg_DynamicPowerManagementVideoMemoryThreshold:int 2024-08-20T22:14:17.6928590Z parm: NVreg_EnableGpuFirmware:int 2024-08-20T22:14:17.6929105Z parm: NVreg_EnableGpuFirmwareLogs:int 2024-08-20T22:14:17.6929668Z parm: NVreg_OpenRmEnableUnsupportedGpus:int 2024-08-20T22:14:17.6930213Z parm: NVreg_EnableUserNUMAManagement:int 2024-08-20T22:14:17.6930697Z parm: NVreg_MemoryPoolSize:int 2024-08-20T22:14:17.6931164Z parm: NVreg_KMallocHeapMaxSize:int 2024-08-20T22:14:17.6931649Z parm: NVreg_VMallocHeapMaxSize:int 2024-08-20T22:14:17.6932113Z parm: NVreg_IgnoreMMIOCheck:int 2024-08-20T22:14:17.6932656Z parm: NVreg_NvLinkDisable:int 2024-08-20T22:14:17.6933159Z parm: NVreg_EnablePCIERelaxedOrderingMode:int 2024-08-20T22:14:17.6933685Z parm: NVreg_RegisterPCIDriver:int 2024-08-20T22:14:17.6934158Z parm: NVreg_EnableResizableBar:int 2024-08-20T22:14:17.6934645Z parm: NVreg_EnableDbgBreakpoint:int 2024-08-20T22:14:17.6935140Z parm: NVreg_EnableNonblockingOpen:int 2024-08-20T22:14:17.6935629Z parm: NVreg_RegistryDwords:charp 2024-08-20T22:14:17.6936126Z parm: NVreg_RegistryDwordsPerDevice:charp 2024-08-20T22:14:17.6936605Z parm: NVreg_RmMsg:charp 2024-08-20T22:14:17.6937017Z parm: NVreg_GpuBlacklist:charp 2024-08-20T22:14:17.6937482Z parm: NVreg_TemporaryFilePath:charp 2024-08-20T22:14:17.6937946Z parm: NVreg_ExcludedGpus:charp 2024-08-20T22:14:17.6938401Z parm: NVreg_DmaRemapPeerMmio:int 2024-08-20T22:14:17.6938883Z parm: NVreg_RmNvlinkBandwidth:charp 2024-08-20T22:14:17.6939357Z parm: NVreg_ImexChannelCount:int 2024-08-20T22:14:17.6939798Z parm: rm_firmware_active:charp 2024-08-20T22:14:17.6940203Z + set +e 2024-08-20T22:14:17.6940518Z + nvidia-smi 2024-08-20T22:14:19.2639891Z Tue Aug 20 22:14:19 2024 2024-08-20T22:14:19.2640949Z +-----------------------------------------------------------------------------------------+ 2024-08-20T22:14:19.2641835Z | NVIDIA-SMI 550.54.15 Driver Version: 550.54.15 CUDA Version: 12.4 | 2024-08-20T22:14:19.2642625Z |-----------------------------------------+------------------------+----------------------+ 2024-08-20T22:14:19.2643480Z | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | 2024-08-20T22:14:19.2644363Z | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | 2024-08-20T22:14:19.2645361Z | | | MIG M. | 2024-08-20T22:14:19.2645920Z |=========================================+========================+======================| 2024-08-20T22:14:19.2737007Z | 0 NVIDIA A10G Off | 00000000:00:1E.0 Off | 0 | 2024-08-20T22:14:19.2737862Z | 0% 29C P0 56W / 300W | 0MiB / 23028MiB | 5% Default | 2024-08-20T22:14:19.2738749Z | | | N/A | 2024-08-20T22:14:19.2739623Z +-----------------------------------------+------------------------+----------------------+ 2024-08-20T22:14:19.2740328Z 2024-08-20T22:14:19.2740987Z +-----------------------------------------------------------------------------------------+ 2024-08-20T22:14:19.2741832Z | Processes: | 2024-08-20T22:14:19.2742668Z | GPU GI CI PID Type Process name GPU Memory | 2024-08-20T22:14:19.2743364Z | ID ID Usage | 2024-08-20T22:14:19.2743926Z |=========================================================================================| 2024-08-20T22:14:19.2744570Z | No running processes found | 2024-08-20T22:14:19.2745351Z +-----------------------------------------------------------------------------------------+ 2024-08-20T22:14:19.8785579Z + nvidia-smi --query-gpu=gpu_name --format=csv,noheader --id=0 2024-08-20T22:14:21.4396655Z NVIDIA A10G 2024-08-20T22:14:21.8937959Z + NVIDIA_SMI_STATUS=0 2024-08-20T22:14:21.8938735Z + '[' 0 -eq 0 ']' 2024-08-20T22:14:21.8939720Z + echo 'INFO: Ignoring allowed status 0' 2024-08-20T22:14:21.8940183Z + set -e 2024-08-20T22:14:21.8940481Z INFO: Ignoring allowed status 0 2024-08-20T22:14:21.8946838Z == Installing nvidia container toolkit for amzn2023 == 2024-08-20T22:14:21.8951675Z + sudo yum install -y yum-utils 2024-08-20T22:14:22.2876734Z Last metadata expiration check: 0:09:37 ago on Tue Aug 20 22:04:45 2024. 2024-08-20T22:14:22.3098180Z Package dnf-utils-4.3.0-13.amzn2023.0.4.noarch is already installed. 2024-08-20T22:14:22.3401191Z Dependencies resolved. 2024-08-20T22:14:22.3527302Z Nothing to do. 2024-08-20T22:14:22.3527683Z Complete! 2024-08-20T22:14:22.4223119Z + [[ amzn2023 == \a\m\z\n\2\0\2\3 ]] 2024-08-20T22:14:22.4224445Z + YUM_REPO_URL=https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo 2024-08-20T22:14:22.4225760Z + sudo yum-config-manager --add-repo https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo 2024-08-20T22:14:22.6746967Z Adding repo from: https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo 2024-08-20T22:14:22.7475552Z + sudo yum install -y nvidia-docker2 2024-08-20T22:14:23.2881151Z nvidia-container-toolkit 11 kB/s | 833 B 00:00 2024-08-20T22:14:23.3099931Z Package nvidia-docker2-2.14.0-1.noarch is already installed. 2024-08-20T22:14:23.3397963Z Dependencies resolved. 2024-08-20T22:14:23.3521064Z Nothing to do. 2024-08-20T22:14:23.3521401Z Complete! 2024-08-20T22:14:23.4443201Z + sudo systemctl restart docker 2024-08-20T22:15:18.3584779Z Tue Aug 20 22:15:18 2024 2024-08-20T22:15:18.3585644Z +-----------------------------------------------------------------------------------------+ 2024-08-20T22:15:18.3589296Z | NVIDIA-SMI 550.54.15 Driver Version: 550.54.15 CUDA Version: 12.4 | 2024-08-20T22:15:18.3590290Z |-----------------------------------------+------------------------+----------------------+ 2024-08-20T22:15:18.3591366Z | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | 2024-08-20T22:15:18.3592569Z | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | 2024-08-20T22:15:18.3593275Z | | | MIG M. | 2024-08-20T22:15:18.3593827Z |=========================================+========================+======================| 2024-08-20T22:15:18.3707404Z | 0 NVIDIA A10G On | 00000000:00:1E.0 Off | 0 | 2024-08-20T22:15:18.3708400Z | 0% 29C P0 56W / 300W | 0MiB / 23028MiB | 5% Default | 2024-08-20T22:15:18.3709214Z | | | N/A | 2024-08-20T22:15:18.3710155Z +-----------------------------------------+------------------------+----------------------+ 2024-08-20T22:15:18.3710953Z 2024-08-20T22:15:18.3711899Z +-----------------------------------------------------------------------------------------+ 2024-08-20T22:15:18.3712761Z | Processes: | 2024-08-20T22:15:18.3713667Z | GPU GI CI PID Type Process name GPU Memory | 2024-08-20T22:15:18.3714555Z | ID ID Usage | 2024-08-20T22:15:18.3715308Z |=========================================================================================| 2024-08-20T22:15:18.3716150Z | No running processes found | 2024-08-20T22:15:18.3717156Z +-----------------------------------------------------------------------------------------+ 2024-08-20T22:15:18.7141852Z Command completed after 1 attempt(s). 2024-08-20T22:15:18.7222550Z ##[group]Run python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84 2024-08-20T22:15:18.7223328Z python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84 2024-08-20T22:15:18.7224030Z python3 -m tools.stats.monitor > usage_log.txt 2>&1 & 2024-08-20T22:15:18.7224678Z echo "monitor-script-pid=${!}" >> "${GITHUB_OUTPUT}" 2024-08-20T22:15:18.7238639Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:15:18.7239136Z env: 2024-08-20T22:15:18.7239421Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:18.7239870Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:18.7240357Z ##[endgroup] 2024-08-20T22:15:19.0210825Z Defaulting to user installation because normal site-packages is not writeable 2024-08-20T22:15:19.4372759Z Collecting psutil==5.9.1 2024-08-20T22:15:19.4733139Z Downloading psutil-5.9.1-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (281 kB) 2024-08-20T22:15:19.5274221Z Collecting nvidia-ml-py==11.525.84 2024-08-20T22:15:19.5313541Z Downloading nvidia_ml_py-11.525.84-py3-none-any.whl (34 kB) 2024-08-20T22:15:19.6188487Z Installing collected packages: psutil, nvidia-ml-py 2024-08-20T22:15:19.7749593Z Successfully installed nvidia-ml-py-11.525.84 psutil-5.9.1 2024-08-20T22:15:19.9701276Z Prepare all required actions 2024-08-20T22:15:19.9701787Z Getting action download info 2024-08-20T22:15:20.0654131Z Download action repository 'seemethere/download-artifact-s3@v4' (SHA:1da556a7aa0a088e3153970611f6c432d58e80e6) 2024-08-20T22:15:20.2571948Z Download action repository 'actions/download-artifact@v3' (SHA:9bc31d5ccc31df68ecc42ccf4149144866c47d8a) 2024-08-20T22:15:20.3801102Z ##[group]Run ./.github/actions/download-build-artifacts 2024-08-20T22:15:20.3801584Z with: 2024-08-20T22:15:20.3801925Z name: linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-08-20T22:15:20.3802379Z s3-bucket: gha-artifacts 2024-08-20T22:15:20.3802831Z env: 2024-08-20T22:15:20.3803102Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:20.3803554Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:20.3804208Z ##[endgroup] 2024-08-20T22:15:20.3837725Z ##[group]Run seemethere/download-artifact-s3@v4 2024-08-20T22:15:20.3838167Z with: 2024-08-20T22:15:20.3838541Z name: linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-08-20T22:15:20.3838995Z s3-bucket: gha-artifacts 2024-08-20T22:15:20.3839351Z region: us-east-1 2024-08-20T22:15:20.3839654Z env: 2024-08-20T22:15:20.3839933Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:20.3840381Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:20.3840872Z ##[endgroup] 2024-08-20T22:15:20.8555050Z (node:52448) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2024-08-20T22:15:20.8555944Z 2024-08-20T22:15:20.8556232Z Please migrate your code to use AWS SDK for JavaScript (v3). 2024-08-20T22:15:20.8556942Z For more information, check the migration guide at https://a.co/7PzMCcy 2024-08-20T22:15:20.8557813Z (Use `node --trace-warnings ...` to show where the warning was created) 2024-08-20T22:15:20.9267363Z Found 1 objects with prefix pytorch/pytorch/10479310721/linux-focal-cuda12.1-py3.10-gcc9-sm86/ 2024-08-20T22:15:20.9268612Z Starting download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2024-08-20T22:15:28.4545632Z Finished download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2024-08-20T22:15:28.4551989Z Artifact download has finished successfully 2024-08-20T22:15:28.4920722Z ##[group]Run unzip -o artifacts.zip 2024-08-20T22:15:28.4921170Z unzip -o artifacts.zip 2024-08-20T22:15:28.4930242Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:15:28.4930735Z env: 2024-08-20T22:15:28.4931021Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:28.4931475Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:28.4931959Z ##[endgroup] 2024-08-20T22:15:28.5174602Z Archive: artifacts.zip 2024-08-20T22:15:28.5175430Z creating: dist/ 2024-08-20T22:15:30.6453717Z inflating: dist/torch-2.5.0a0+git40ec5f6-cp310-cp310-linux_x86_64.whl 2024-08-20T22:15:30.6454397Z creating: build/custom_test_artifacts/ 2024-08-20T22:15:30.6455004Z creating: build/custom_test_artifacts/custom-op-build/ 2024-08-20T22:15:30.6455751Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/ 2024-08-20T22:15:30.6456596Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/pkgRedirects/ 2024-08-20T22:15:30.6463343Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeConfigureLog.yaml 2024-08-20T22:15:30.6464301Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/ 2024-08-20T22:15:30.6465258Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-08-20T22:15:30.6466266Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-08-20T22:15:30.6467246Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-08-20T22:15:30.6468354Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-08-20T22:15:30.6470352Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-08-20T22:15:30.6471379Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-08-20T22:15:30.6472387Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-08-20T22:15:30.6473787Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-08-20T22:15:30.6475609Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-08-20T22:15:30.6477510Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-08-20T22:15:30.6479012Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-08-20T22:15:30.6480636Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-08-20T22:15:30.6482207Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-08-20T22:15:30.6483325Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/ 2024-08-20T22:15:30.6484338Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/ 2024-08-20T22:15:30.6523621Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2024-08-20T22:15:30.6563627Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2024-08-20T22:15:30.6565091Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2024-08-20T22:15:30.6610406Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2024-08-20T22:15:30.6611848Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2024-08-20T22:15:30.6613292Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2024-08-20T22:15:30.6614783Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2024-08-20T22:15:30.6616217Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2024-08-20T22:15:30.6617675Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2024-08-20T22:15:30.6619095Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2024-08-20T22:15:30.6620513Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2024-08-20T22:15:30.6621885Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2024-08-20T22:15:30.6623190Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2024-08-20T22:15:30.6624446Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c 2024-08-20T22:15:30.6625695Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin 2024-08-20T22:15:30.6626934Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2024-08-20T22:15:30.6628153Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o 2024-08-20T22:15:30.6629384Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu 2024-08-20T22:15:30.6685953Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out 2024-08-20T22:15:30.6746087Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin 2024-08-20T22:15:30.6748498Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake 2024-08-20T22:15:30.6750771Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeScratch/ 2024-08-20T22:15:30.6752507Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeTmp/ 2024-08-20T22:15:30.6754328Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/cmake.check_cache 2024-08-20T22:15:30.6756181Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/ 2024-08-20T22:15:30.6757313Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.ts 2024-08-20T22:15:30.6758668Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.make 2024-08-20T22:15:30.6759785Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/depend.make 2024-08-20T22:15:30.6760828Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/link.txt 2024-08-20T22:15:30.6761907Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/cmake_clean.cmake 2024-08-20T22:15:30.6763077Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/build.make 2024-08-20T22:15:30.6764163Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/DependInfo.cmake 2024-08-20T22:15:30.6765248Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/flags.make 2024-08-20T22:15:30.6766329Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/progress.make 2024-08-20T22:15:30.6778981Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o.d 2024-08-20T22:15:30.6922586Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o 2024-08-20T22:15:30.6923600Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/ 2024-08-20T22:15:30.6924696Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.ts 2024-08-20T22:15:30.6925909Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.make 2024-08-20T22:15:30.6927061Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/depend.make 2024-08-20T22:15:30.6928149Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/link.txt 2024-08-20T22:15:30.6929281Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/cmake_clean.cmake 2024-08-20T22:15:30.6930436Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/build.make 2024-08-20T22:15:30.6931575Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/DependInfo.cmake 2024-08-20T22:15:30.6932712Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/flags.make 2024-08-20T22:15:30.6933832Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/progress.make 2024-08-20T22:15:30.6952280Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o.d 2024-08-20T22:15:30.7035673Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o 2024-08-20T22:15:30.7036930Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-08-20T22:15:30.7038020Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/TargetDirectories.txt 2024-08-20T22:15:30.7039185Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/progress.marks 2024-08-20T22:15:30.7040122Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile2 2024-08-20T22:15:30.7041026Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile.cmake 2024-08-20T22:15:30.7041943Z inflating: build/custom_test_artifacts/custom-op-build/detect_cuda_version.cc 2024-08-20T22:15:30.7044280Z inflating: build/custom_test_artifacts/custom-op-build/CMakeCache.txt 2024-08-20T22:15:30.7045286Z inflating: build/custom_test_artifacts/custom-op-build/Makefile 2024-08-20T22:15:30.7046455Z inflating: build/custom_test_artifacts/custom-op-build/cmake_install.cmake 2024-08-20T22:15:30.7166955Z inflating: build/custom_test_artifacts/custom-op-build/libcustom_ops.so 2024-08-20T22:15:30.7230627Z inflating: build/custom_test_artifacts/custom-op-build/test_custom_ops 2024-08-20T22:15:30.7233071Z creating: build/custom_test_artifacts/jit-hook-build/ 2024-08-20T22:15:30.7234506Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/ 2024-08-20T22:15:30.7236169Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/pkgRedirects/ 2024-08-20T22:15:30.7238888Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeConfigureLog.yaml 2024-08-20T22:15:30.7240145Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/ 2024-08-20T22:15:30.7241217Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-08-20T22:15:30.7242202Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-08-20T22:15:30.7243586Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-08-20T22:15:30.7244869Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-08-20T22:15:30.7246266Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-08-20T22:15:30.7247272Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-08-20T22:15:30.7248445Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-08-20T22:15:30.7250019Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-08-20T22:15:30.7251458Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-08-20T22:15:30.7252972Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-08-20T22:15:30.7254167Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-08-20T22:15:30.7255682Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-08-20T22:15:30.7257275Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-08-20T22:15:30.7258317Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/ 2024-08-20T22:15:30.7259316Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/ 2024-08-20T22:15:30.7298142Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2024-08-20T22:15:30.7337635Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2024-08-20T22:15:30.7339170Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2024-08-20T22:15:30.7384570Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2024-08-20T22:15:30.7386069Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2024-08-20T22:15:30.7388032Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2024-08-20T22:15:30.7389988Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2024-08-20T22:15:30.7391810Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2024-08-20T22:15:30.7393642Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2024-08-20T22:15:30.7395430Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2024-08-20T22:15:30.7397271Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2024-08-20T22:15:30.7399113Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2024-08-20T22:15:30.7400420Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2024-08-20T22:15:30.7401650Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c 2024-08-20T22:15:30.7402956Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin 2024-08-20T22:15:30.7404179Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2024-08-20T22:15:30.7405359Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o 2024-08-20T22:15:30.7406615Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu 2024-08-20T22:15:30.7459566Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out 2024-08-20T22:15:30.7521195Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin 2024-08-20T22:15:30.7524503Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake 2024-08-20T22:15:30.7526840Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeScratch/ 2024-08-20T22:15:30.7527985Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeTmp/ 2024-08-20T22:15:30.7529173Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/cmake.check_cache 2024-08-20T22:15:30.7530409Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/ 2024-08-20T22:15:30.7531578Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.ts 2024-08-20T22:15:30.7532785Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.make 2024-08-20T22:15:30.7533927Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/depend.make 2024-08-20T22:15:30.7534998Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/link.txt 2024-08-20T22:15:30.7536104Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/cmake_clean.cmake 2024-08-20T22:15:30.7537256Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/build.make 2024-08-20T22:15:30.7538360Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/DependInfo.cmake 2024-08-20T22:15:30.7539458Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/flags.make 2024-08-20T22:15:30.7540551Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/progress.make 2024-08-20T22:15:30.7552299Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o.d 2024-08-20T22:15:30.7617008Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o 2024-08-20T22:15:30.7618615Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-08-20T22:15:30.7620026Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/TargetDirectories.txt 2024-08-20T22:15:30.7621246Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/progress.marks 2024-08-20T22:15:30.7622345Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile2 2024-08-20T22:15:30.7623233Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile.cmake 2024-08-20T22:15:30.7624151Z inflating: build/custom_test_artifacts/jit-hook-build/detect_cuda_version.cc 2024-08-20T22:15:30.7625286Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeCache.txt 2024-08-20T22:15:30.7626519Z inflating: build/custom_test_artifacts/jit-hook-build/Makefile 2024-08-20T22:15:30.7627543Z inflating: build/custom_test_artifacts/jit-hook-build/cmake_install.cmake 2024-08-20T22:15:30.7677662Z inflating: build/custom_test_artifacts/jit-hook-build/test_jit_hooks 2024-08-20T22:15:30.7678680Z creating: build/custom_test_artifacts/custom-backend-build/ 2024-08-20T22:15:30.7679459Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/ 2024-08-20T22:15:30.7680355Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/pkgRedirects/ 2024-08-20T22:15:30.7686810Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeConfigureLog.yaml 2024-08-20T22:15:30.7688129Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/ 2024-08-20T22:15:30.7689228Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-08-20T22:15:30.7690330Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-08-20T22:15:30.7691692Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-08-20T22:15:30.7693188Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-08-20T22:15:30.7694539Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-08-20T22:15:30.7695651Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-08-20T22:15:30.7696971Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-08-20T22:15:30.7698466Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-08-20T22:15:30.7699951Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-08-20T22:15:30.7701418Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-08-20T22:15:30.7702847Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-08-20T22:15:30.7704386Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-08-20T22:15:30.7705817Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-08-20T22:15:30.7706922Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/ 2024-08-20T22:15:30.7707988Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/ 2024-08-20T22:15:30.7746265Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2024-08-20T22:15:30.7785768Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2024-08-20T22:15:30.7788919Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2024-08-20T22:15:30.7832819Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2024-08-20T22:15:30.7834721Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2024-08-20T22:15:30.7836738Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2024-08-20T22:15:30.7838888Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2024-08-20T22:15:30.7840758Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2024-08-20T22:15:30.7843096Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2024-08-20T22:15:30.7845088Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2024-08-20T22:15:30.7846929Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2024-08-20T22:15:30.7848361Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2024-08-20T22:15:30.7849701Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2024-08-20T22:15:30.7851263Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c 2024-08-20T22:15:30.7852556Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin 2024-08-20T22:15:30.7853842Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2024-08-20T22:15:30.7855094Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o 2024-08-20T22:15:30.7856365Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu 2024-08-20T22:15:30.7908726Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out 2024-08-20T22:15:30.7969312Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin 2024-08-20T22:15:30.7970996Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake 2024-08-20T22:15:30.7972440Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeScratch/ 2024-08-20T22:15:30.7973714Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeTmp/ 2024-08-20T22:15:30.7975040Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/cmake.check_cache 2024-08-20T22:15:30.7976335Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/ 2024-08-20T22:15:30.7977871Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.ts 2024-08-20T22:15:30.7979524Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.make 2024-08-20T22:15:30.7980816Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/depend.make 2024-08-20T22:15:30.7981960Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/link.txt 2024-08-20T22:15:30.7983158Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/cmake_clean.cmake 2024-08-20T22:15:30.7984861Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/build.make 2024-08-20T22:15:30.7986075Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/DependInfo.cmake 2024-08-20T22:15:30.7987297Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/flags.make 2024-08-20T22:15:30.7988466Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/progress.make 2024-08-20T22:15:30.7989716Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o.d 2024-08-20T22:15:30.8111743Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o 2024-08-20T22:15:30.8114823Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/ 2024-08-20T22:15:30.8117386Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.ts 2024-08-20T22:15:30.8119004Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.make 2024-08-20T22:15:30.8120269Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/depend.make 2024-08-20T22:15:30.8121467Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/link.txt 2024-08-20T22:15:30.8122778Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/cmake_clean.cmake 2024-08-20T22:15:30.8124025Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/build.make 2024-08-20T22:15:30.8125266Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/DependInfo.cmake 2024-08-20T22:15:30.8126513Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/flags.make 2024-08-20T22:15:30.8127740Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/progress.make 2024-08-20T22:15:30.8139853Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o.d 2024-08-20T22:15:30.8196606Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o 2024-08-20T22:15:30.8198278Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-08-20T22:15:30.8199771Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/TargetDirectories.txt 2024-08-20T22:15:30.8201161Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/progress.marks 2024-08-20T22:15:30.8202192Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile2 2024-08-20T22:15:30.8203240Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile.cmake 2024-08-20T22:15:30.8204444Z inflating: build/custom_test_artifacts/custom-backend-build/detect_cuda_version.cc 2024-08-20T22:15:30.8205661Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeCache.txt 2024-08-20T22:15:30.8206679Z inflating: build/custom_test_artifacts/custom-backend-build/Makefile 2024-08-20T22:15:30.8207554Z inflating: build/custom_test_artifacts/custom-backend-build/cmake_install.cmake 2024-08-20T22:15:30.8311466Z inflating: build/custom_test_artifacts/custom-backend-build/libcustom_backend.so 2024-08-20T22:15:30.8355033Z inflating: build/custom_test_artifacts/custom-backend-build/test_custom_backend 2024-08-20T22:15:30.8356482Z creating: build/lib/ 2024-08-20T22:15:30.8443189Z inflating: build/lib/libprotobuf-lite.a 2024-08-20T22:15:30.8900010Z inflating: build/lib/libprotobuf.a 2024-08-20T22:15:30.8909275Z inflating: build/lib/libpthreadpool.a 2024-08-20T22:15:30.8917819Z inflating: build/lib/libcpuinfo.a 2024-08-20T22:15:30.8926141Z inflating: build/lib/libcpuinfo_internals.a 2024-08-20T22:15:30.8926787Z inflating: build/lib/libclog.a 2024-08-20T22:15:30.8945468Z inflating: build/lib/libnnpack.a 2024-08-20T22:15:30.8948060Z inflating: build/lib/libnnpack_reference_layers.a 2024-08-20T22:15:30.9013533Z inflating: build/lib/libgtest.a 2024-08-20T22:15:30.9088615Z inflating: build/lib/libbenchmark.a 2024-08-20T22:15:30.9152968Z inflating: build/lib/libasmjit.a 2024-08-20T22:15:30.9160148Z inflating: build/lib/libittnotify.a 2024-08-20T22:15:30.9188053Z inflating: build/lib/libtensorpipe_uv.a 2024-08-20T22:15:30.9315481Z inflating: build/lib/libgloo.a 2024-08-20T22:15:30.9335759Z inflating: build/lib/libfmt.a 2024-08-20T22:15:30.9431838Z inflating: build/lib/libc10.so 2024-08-20T22:15:30.9433407Z inflating: build/lib/libcaffe2_nvrtc.so 2024-08-20T22:15:30.9434946Z inflating: build/lib/libtorch_global_deps.so 2024-08-20T22:15:30.9938443Z inflating: build/lib/libprotoc.a 2024-08-20T22:15:30.9958506Z inflating: build/lib/libpytorch_qnnpack.a 2024-08-20T22:15:30.9976451Z inflating: build/lib/libgmock.a 2024-08-20T22:15:30.9977062Z inflating: build/lib/libgtest_main.a 2024-08-20T22:15:30.9977798Z inflating: build/lib/libbenchmark_main.a 2024-08-20T22:15:31.0368242Z inflating: build/lib/libgloo_cuda.a 2024-08-20T22:15:32.0547325Z inflating: build/lib/libdnnl.a 2024-08-20T22:15:32.1120808Z inflating: build/lib/libtensorpipe.a 2024-08-20T22:15:32.1178684Z inflating: build/lib/libc10_cuda.so 2024-08-20T22:15:32.1179474Z inflating: build/lib/libgmock_main.a 2024-08-20T22:15:32.2440486Z inflating: build/lib/libfbgemm.a 2024-08-20T22:15:32.2696239Z inflating: build/lib/libtensorpipe_cuda.a 2024-08-20T22:15:32.3204623Z inflating: build/lib/libkineto.a 2024-08-20T22:15:32.3389793Z inflating: build/lib/libXNNPACK.a 2024-08-20T22:15:32.3432197Z inflating: build/lib/libonnx_proto.a 2024-08-20T22:15:32.4125873Z inflating: build/lib/libonnx.a 2024-08-20T22:15:34.8605650Z inflating: build/lib/libtorch_cpu.so 2024-08-20T22:15:34.8610789Z inflating: build/lib/libunbox_lib.a 2024-08-20T22:15:34.8615027Z inflating: build/lib/libshm.so 2024-08-20T22:15:36.9245322Z inflating: build/lib/libtorch_cuda.so 2024-08-20T22:15:36.9246510Z inflating: build/lib/libtorch.so 2024-08-20T22:15:36.9249485Z inflating: build/lib/libc10d_cuda_test.so 2024-08-20T22:15:37.7421057Z inflating: build/lib/libtorch_cuda_linalg.so 2024-08-20T22:15:37.9419799Z inflating: build/lib/libtorch_python.so 2024-08-20T22:15:37.9492420Z inflating: build/lib/libtorchbind_test.so 2024-08-20T22:15:37.9514514Z inflating: build/lib/libjitbackend_test.so 2024-08-20T22:15:37.9539956Z inflating: build/lib/libbackend_with_compiler.so 2024-08-20T22:15:37.9566372Z inflating: build/lib/libaoti_custom_ops.so 2024-08-20T22:15:37.9600813Z inflating: build/lib/libnnapi_backend.so 2024-08-20T22:15:37.9601378Z creating: build/bin/ 2024-08-20T22:15:37.9652139Z inflating: build/bin/c10_CompileTimeFunctionPointer_test 2024-08-20T22:15:37.9703983Z inflating: build/bin/c10_DeviceGuard_test 2024-08-20T22:15:37.9755539Z inflating: build/bin/c10_Device_test 2024-08-20T22:15:37.9814948Z inflating: build/bin/c10_DispatchKeySet_test 2024-08-20T22:15:37.9869195Z inflating: build/bin/c10_Scalar_test 2024-08-20T22:15:37.9918022Z inflating: build/bin/c10_StreamGuard_test 2024-08-20T22:15:37.9969490Z inflating: build/bin/c10_SymInt_test 2024-08-20T22:15:38.0024581Z inflating: build/bin/c10_InlineDeviceGuard_test 2024-08-20T22:15:38.0081301Z inflating: build/bin/c10_InlineStreamGuard_test 2024-08-20T22:15:38.0137004Z inflating: build/bin/c10_SizesAndStrides_test 2024-08-20T22:15:38.0209062Z inflating: build/bin/c10_cow_test 2024-08-20T22:15:38.0261839Z inflating: build/bin/c10_Bitset_test 2024-08-20T22:15:38.0310967Z inflating: build/bin/c10_ConstexprCrc_test 2024-08-20T22:15:38.0361358Z inflating: build/bin/c10_DeadlockDetection_test 2024-08-20T22:15:38.0412374Z inflating: build/bin/c10_Half_test 2024-08-20T22:15:38.0469569Z inflating: build/bin/c10_LeftRight_test 2024-08-20T22:15:38.0524449Z inflating: build/bin/c10_Metaprogramming_test 2024-08-20T22:15:38.0574941Z inflating: build/bin/c10_Synchronized_test 2024-08-20T22:15:38.0631418Z inflating: build/bin/c10_ThreadLocal_test 2024-08-20T22:15:38.0683079Z inflating: build/bin/c10_TypeIndex_test 2024-08-20T22:15:38.0734470Z inflating: build/bin/c10_TypeList_test 2024-08-20T22:15:38.0784406Z inflating: build/bin/c10_TypeTraits_test 2024-08-20T22:15:38.0835965Z inflating: build/bin/c10_accumulate_test 2024-08-20T22:15:38.0892039Z inflating: build/bin/c10_bfloat16_test 2024-08-20T22:15:38.0943159Z inflating: build/bin/c10_bit_cast_test 2024-08-20T22:15:38.0999620Z inflating: build/bin/c10_complex_math_test 2024-08-20T22:15:38.1055773Z inflating: build/bin/c10_complex_test 2024-08-20T22:15:38.1108972Z inflating: build/bin/c10_exception_test 2024-08-20T22:15:38.1160309Z inflating: build/bin/c10_flags_test 2024-08-20T22:15:38.1210761Z inflating: build/bin/c10_generic_math_test 2024-08-20T22:15:38.1376369Z inflating: build/bin/c10_intrusive_ptr_test 2024-08-20T22:15:38.1427811Z inflating: build/bin/c10_irange_test 2024-08-20T22:15:38.1481386Z inflating: build/bin/c10_lazy_test 2024-08-20T22:15:38.1538753Z inflating: build/bin/c10_logging_test 2024-08-20T22:15:38.1614406Z inflating: build/bin/c10_optional_test 2024-08-20T22:15:38.1677542Z inflating: build/bin/c10_ordered_preserving_dict_test 2024-08-20T22:15:38.1731590Z inflating: build/bin/c10_registry_test 2024-08-20T22:15:38.1884216Z inflating: build/bin/c10_small_vector_test 2024-08-20T22:15:38.1935403Z inflating: build/bin/c10_ssize_test 2024-08-20T22:15:38.1988381Z inflating: build/bin/c10_string_util_test 2024-08-20T22:15:38.2038444Z inflating: build/bin/c10_tempfile_test 2024-08-20T22:15:38.2097685Z inflating: build/bin/c10_string_view_test 2024-08-20T22:15:38.2147089Z inflating: build/bin/c10_intrusive_ptr_benchmark 2024-08-20T22:15:38.2203217Z inflating: build/bin/c10_typeid_test 2024-08-20T22:15:38.2651527Z inflating: build/bin/protoc-3.13.0.0 2024-08-20T22:15:38.3101192Z inflating: build/bin/protoc 2024-08-20T22:15:38.3154616Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_1_var_test 2024-08-20T22:15:38.3207127Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_catches_stream 2024-08-20T22:15:38.3260557Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_catches_thread_and_block_and_device 2024-08-20T22:15:38.3313382Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_from_2_processes 2024-08-20T22:15:38.3365969Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_blocks_and_threads 2024-08-20T22:15:38.3419071Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_multiple_blocks 2024-08-20T22:15:38.3469292Z inflating: build/bin/c10_cuda_CUDATest 2024-08-20T22:15:38.3521946Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_same_block 2024-08-20T22:15:38.3855029Z inflating: build/bin/vec_test_all_types_DEFAULT 2024-08-20T22:15:38.4201634Z inflating: build/bin/vec_test_all_types_AVX512 2024-08-20T22:15:38.4562677Z inflating: build/bin/vec_test_all_types_AVX2 2024-08-20T22:15:38.4615592Z inflating: build/bin/BackoffTest 2024-08-20T22:15:38.4669136Z inflating: build/bin/FileStoreTest 2024-08-20T22:15:38.4725134Z inflating: build/bin/TCPStoreTest 2024-08-20T22:15:38.4779649Z inflating: build/bin/HashStoreTest 2024-08-20T22:15:38.4792611Z inflating: build/bin/ProcessGroupMPITest 2024-08-20T22:15:38.4846967Z inflating: build/bin/test_edge_op_registration 2024-08-20T22:15:38.4851765Z inflating: build/bin/torch_shm_manager 2024-08-20T22:15:38.4854745Z inflating: build/bin/example_allreduce 2024-08-20T22:15:38.4910348Z inflating: build/bin/test_dist_autograd 2024-08-20T22:15:38.4980043Z inflating: build/bin/test_cpp_rpc 2024-08-20T22:15:38.4982873Z inflating: build/bin/parallel_benchmark 2024-08-20T22:15:38.5049562Z inflating: build/bin/test_mobile_nnc 2024-08-20T22:15:38.5059048Z inflating: build/bin/aot_model_compiler_test 2024-08-20T22:15:38.5406529Z inflating: build/bin/test_lazy 2024-08-20T22:15:38.6592031Z inflating: build/bin/test_api 2024-08-20T22:15:38.6666673Z inflating: build/bin/Dict_test 2024-08-20T22:15:38.6719181Z inflating: build/bin/Dimname_test 2024-08-20T22:15:38.6784323Z inflating: build/bin/MaybeOwned_test 2024-08-20T22:15:38.6841993Z inflating: build/bin/NamedTensor_test 2024-08-20T22:15:38.6901720Z inflating: build/bin/apply_utils_test 2024-08-20T22:15:38.6961131Z inflating: build/bin/atest 2024-08-20T22:15:38.7024672Z inflating: build/bin/basic 2024-08-20T22:15:38.7080172Z inflating: build/bin/broadcast_test 2024-08-20T22:15:38.7131101Z inflating: build/bin/cpu_allocator_test 2024-08-20T22:15:38.7190054Z inflating: build/bin/cpu_generator_test 2024-08-20T22:15:38.7243542Z inflating: build/bin/cpu_profiling_allocator_test 2024-08-20T22:15:38.7337630Z inflating: build/bin/cpu_rng_test 2024-08-20T22:15:38.7387928Z inflating: build/bin/dispatch_key_set_test 2024-08-20T22:15:38.7438135Z inflating: build/bin/dlconvertor_test 2024-08-20T22:15:38.7496974Z inflating: build/bin/extension_backend_test 2024-08-20T22:15:38.7552716Z inflating: build/bin/half_test 2024-08-20T22:15:38.7648956Z inflating: build/bin/ivalue_test 2024-08-20T22:15:38.7699302Z inflating: build/bin/lazy_tensor_test 2024-08-20T22:15:38.7754775Z inflating: build/bin/math_kernel_test 2024-08-20T22:15:38.7808707Z inflating: build/bin/memory_format_test 2024-08-20T22:15:38.7862975Z inflating: build/bin/memory_overlapping_test 2024-08-20T22:15:38.7916609Z inflating: build/bin/mobile_memory_cleanup 2024-08-20T22:15:38.7973059Z inflating: build/bin/native_test 2024-08-20T22:15:38.8023889Z inflating: build/bin/operator_name_test 2024-08-20T22:15:38.8076126Z inflating: build/bin/operators_test 2024-08-20T22:15:38.8128108Z inflating: build/bin/packedtensoraccessor_test 2024-08-20T22:15:38.8195666Z inflating: build/bin/pow_test 2024-08-20T22:15:38.8253740Z inflating: build/bin/quantized_test 2024-08-20T22:15:38.8304477Z inflating: build/bin/reduce_ops_test 2024-08-20T22:15:38.8356123Z inflating: build/bin/reportMemoryUsage_test 2024-08-20T22:15:38.8412565Z inflating: build/bin/scalar_tensor_test 2024-08-20T22:15:38.8472546Z inflating: build/bin/scalar_test 2024-08-20T22:15:38.8523942Z inflating: build/bin/StorageUtils_test 2024-08-20T22:15:38.8576978Z inflating: build/bin/stride_properties_test 2024-08-20T22:15:38.8656345Z inflating: build/bin/tensor_iterator_test 2024-08-20T22:15:38.8710783Z inflating: build/bin/test_parallel 2024-08-20T22:15:38.8713721Z inflating: build/bin/thread_init_test 2024-08-20T22:15:38.8770374Z inflating: build/bin/type_ptr_test 2024-08-20T22:15:38.8830848Z inflating: build/bin/type_test 2024-08-20T22:15:38.8883289Z inflating: build/bin/undefined_tensor_test 2024-08-20T22:15:38.8885153Z inflating: build/bin/verify_api_visibility 2024-08-20T22:15:38.8955094Z inflating: build/bin/legacy_vmap_test 2024-08-20T22:15:38.9006991Z inflating: build/bin/weakref_test 2024-08-20T22:15:38.9058955Z inflating: build/bin/wrapdim_test 2024-08-20T22:15:38.9110862Z inflating: build/bin/xla_tensor_test 2024-08-20T22:15:38.9171488Z inflating: build/bin/IListRef_test 2024-08-20T22:15:38.9278565Z inflating: build/bin/List_test 2024-08-20T22:15:38.9345657Z inflating: build/bin/KernelFunction_test 2024-08-20T22:15:38.9468677Z inflating: build/bin/kernel_function_legacy_test 2024-08-20T22:15:38.9565890Z inflating: build/bin/kernel_function_test 2024-08-20T22:15:38.9695430Z inflating: build/bin/kernel_lambda_legacy_test 2024-08-20T22:15:38.9800533Z inflating: build/bin/kernel_lambda_test 2024-08-20T22:15:38.9861810Z inflating: build/bin/kernel_stackbased_test 2024-08-20T22:15:38.9959201Z inflating: build/bin/make_boxed_from_unboxed_functor_test 2024-08-20T22:15:39.0010553Z inflating: build/bin/CppSignature_test 2024-08-20T22:15:39.0059961Z inflating: build/bin/op_allowlist_test 2024-08-20T22:15:39.0116738Z inflating: build/bin/backend_fallback_test 2024-08-20T22:15:39.0421846Z inflating: build/bin/op_registration_test 2024-08-20T22:15:39.0485371Z inflating: build/bin/inline_container_test 2024-08-20T22:15:39.0538599Z inflating: build/bin/cuda_apply_test 2024-08-20T22:15:39.0591092Z inflating: build/bin/cuda_allocator_test 2024-08-20T22:15:39.0650884Z inflating: build/bin/cuda_atomic_ops_test 2024-08-20T22:15:39.0705573Z inflating: build/bin/cuda_caching_host_allocator_test 2024-08-20T22:15:39.0776220Z inflating: build/bin/cuda_complex_math_test 2024-08-20T22:15:39.0835775Z inflating: build/bin/cuda_complex_test 2024-08-20T22:15:39.0885464Z inflating: build/bin/cuda_device_test 2024-08-20T22:15:39.0943631Z inflating: build/bin/cuda_cub_test 2024-08-20T22:15:39.0994961Z inflating: build/bin/cuda_dlconvertor_test 2024-08-20T22:15:39.1059882Z inflating: build/bin/cuda_distributions_test 2024-08-20T22:15:39.1117232Z inflating: build/bin/cuda_generator_test 2024-08-20T22:15:39.1167268Z inflating: build/bin/cuda_half_test 2024-08-20T22:15:39.1219186Z inflating: build/bin/cuda_integer_divider_test 2024-08-20T22:15:39.1268452Z inflating: build/bin/cuda_optional_test 2024-08-20T22:15:39.1320249Z inflating: build/bin/cuda_packedtensoraccessor_test 2024-08-20T22:15:39.1373412Z inflating: build/bin/cuda_reportMemoryUsage_test 2024-08-20T22:15:39.1424020Z inflating: build/bin/cuda_allocatorTraceTracker_test 2024-08-20T22:15:39.1484783Z inflating: build/bin/cuda_stream_test 2024-08-20T22:15:39.1534369Z inflating: build/bin/cuda_cudnn_test 2024-08-20T22:15:39.1586993Z inflating: build/bin/cuda_vectorized_test 2024-08-20T22:15:39.1601533Z inflating: build/bin/tutorial_tensorexpr 2024-08-20T22:15:39.1667715Z inflating: build/bin/ProcessGroupGlooTest 2024-08-20T22:15:39.1725446Z inflating: build/bin/ProcessGroupGlooAsyncTest 2024-08-20T22:15:39.1789757Z inflating: build/bin/ProcessGroupNCCLTest 2024-08-20T22:15:39.1852652Z inflating: build/bin/ProcessGroupNCCLErrorsTest 2024-08-20T22:15:39.2683719Z inflating: build/bin/test_tensorexpr 2024-08-20T22:15:39.3267147Z inflating: build/bin/test_jit 2024-08-20T22:15:39.3267588Z creating: .additional_ci_files/ 2024-08-20T22:15:39.3328391Z inflating: .additional_ci_files/test-times.json 2024-08-20T22:15:39.3570438Z inflating: .additional_ci_files/test-class-times.json 2024-08-20T22:15:39.3605210Z ##[group]Run rm artifacts.zip 2024-08-20T22:15:39.3605631Z rm artifacts.zip 2024-08-20T22:15:39.3615627Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:15:39.3616121Z env: 2024-08-20T22:15:39.3616404Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:39.3616862Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:39.3617346Z ##[endgroup] 2024-08-20T22:15:39.4717692Z ##[group]Run df -H 2024-08-20T22:15:39.4718021Z df -H 2024-08-20T22:15:39.4726760Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:15:39.4727291Z env: 2024-08-20T22:15:39.4727584Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:39.4728070Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:39.4728644Z ##[endgroup] 2024-08-20T22:15:39.4780708Z Filesystem Size Used Avail Use% Mounted on 2024-08-20T22:15:39.4782038Z devtmpfs 4.2M 0 4.2M 0% /dev 2024-08-20T22:15:39.4783184Z tmpfs 34G 0 34G 0% /dev/shm 2024-08-20T22:15:39.4784129Z tmpfs 14G 553k 14G 1% /run 2024-08-20T22:15:39.4785099Z /dev/nvme0n1p1 161G 53G 109G 33% / 2024-08-20T22:15:39.4786350Z tmpfs 34G 4.1k 34G 1% /tmp 2024-08-20T22:15:39.4787319Z /dev/nvme0n1p128 11M 1.4M 9.2M 13% /boot/efi 2024-08-20T22:15:39.4788318Z tmpfs 6.7G 0 6.7G 0% /run/user/0 2024-08-20T22:15:39.4828290Z Prepare all required actions 2024-08-20T22:15:39.4828738Z Getting action download info 2024-08-20T22:15:39.5926813Z ##[group]Run ./.github/actions/download-td-artifacts 2024-08-20T22:15:39.5927271Z with: 2024-08-20T22:15:39.5927531Z env: 2024-08-20T22:15:39.5927810Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:39.5928255Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:39.5928737Z ##[endgroup] 2024-08-20T22:15:39.6109173Z ##[group]Run seemethere/download-artifact-s3@v4 2024-08-20T22:15:39.6109619Z with: 2024-08-20T22:15:39.6109888Z name: td_results 2024-08-20T22:15:39.6110376Z s3-bucket: gha-artifacts 2024-08-20T22:15:39.6110732Z region: us-east-1 2024-08-20T22:15:39.6111033Z env: 2024-08-20T22:15:39.6111303Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:39.6111755Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:39.6112231Z ##[endgroup] 2024-08-20T22:15:40.0968235Z (node:52468) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2024-08-20T22:15:40.0968977Z 2024-08-20T22:15:40.0969236Z Please migrate your code to use AWS SDK for JavaScript (v3). 2024-08-20T22:15:40.0969959Z For more information, check the migration guide at https://a.co/7PzMCcy 2024-08-20T22:15:40.0970922Z (Use `node --trace-warnings ...` to show where the warning was created) 2024-08-20T22:15:40.1542164Z Found 0 objects with prefix pytorch/pytorch/10479310721/td_results/ 2024-08-20T22:15:40.1548832Z Artifact download has finished successfully 2024-08-20T22:15:40.1869389Z ##[group]Run mkdir -p .additional_ci_files 2024-08-20T22:15:40.1869889Z mkdir -p .additional_ci_files 2024-08-20T22:15:40.1870452Z mv td_results.json .additional_ci_files/td_results.json 2024-08-20T22:15:40.1879402Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:15:40.1879897Z env: 2024-08-20T22:15:40.1880176Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:40.1880634Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:40.1881114Z ##[endgroup] 2024-08-20T22:15:40.1936397Z mv: cannot stat 'td_results.json': No such file or directory 2024-08-20T22:15:40.1951112Z ##[error]Process completed with exit code 1. 2024-08-20T22:15:40.1985975Z ##[group]Run .github/scripts/parse_ref.py 2024-08-20T22:15:40.1986465Z .github/scripts/parse_ref.py 2024-08-20T22:15:40.1994724Z shell: /usr/bin/bash -e {0} 2024-08-20T22:15:40.1995082Z env: 2024-08-20T22:15:40.1995364Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:40.1995818Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:40.1996308Z ##[endgroup] 2024-08-20T22:15:40.2279699Z Prepare all required actions 2024-08-20T22:15:40.2318063Z ##[group]Run ./.github/actions/get-workflow-job-id 2024-08-20T22:15:40.2318515Z with: 2024-08-20T22:15:40.2319087Z github-token: *** 2024-08-20T22:15:40.2319394Z env: 2024-08-20T22:15:40.2319665Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:40.2320114Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:40.2320593Z ##[endgroup] 2024-08-20T22:15:40.2337211Z ##[group]Run set -eux 2024-08-20T22:15:40.2337550Z set -eux 2024-08-20T22:15:40.2338130Z python3 .github/scripts/get_workflow_job_id.py "${GITHUB_RUN_ID}" "${RUNNER_NAME}" 2024-08-20T22:15:40.2346860Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:15:40.2347350Z env: 2024-08-20T22:15:40.2347633Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:40.2348083Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:40.2348762Z GITHUB_TOKEN: *** 2024-08-20T22:15:40.2349080Z ##[endgroup] 2024-08-20T22:15:40.2377233Z + python3 .github/scripts/get_workflow_job_id.py 10479310721 i-0e82ebf4b91cdd7d9 2024-08-20T22:15:40.8705004Z setting job-id=29026298848 2024-08-20T22:15:40.8707343Z setting job-name=cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (aot_eager_torchbench, 1, 2, linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:15:40.8930301Z Prepare all required actions 2024-08-20T22:15:40.8930743Z Getting action download info 2024-08-20T22:15:41.0140671Z ##[group]Run ./.github/actions/filter-test-configs 2024-08-20T22:15:41.0141134Z with: 2024-08-20T22:15:41.0141595Z github-token: *** 2024-08-20T22:15:41.0148033Z test-matrix: {"include": [{"config": "dynamo_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}]} 2024-08-20T22:15:41.0155811Z job-name: cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (aot_eager_torchbench, 1, 2, linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:15:41.0156687Z env: 2024-08-20T22:15:41.0156976Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:41.0157431Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:41.0157918Z ##[endgroup] 2024-08-20T22:15:41.0200063Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2024-08-20T22:15:41.0200615Z with: 2024-08-20T22:15:41.0200886Z shell: bash 2024-08-20T22:15:41.0201188Z timeout_minutes: 10 2024-08-20T22:15:41.0201517Z max_attempts: 5 2024-08-20T22:15:41.0201837Z retry_wait_seconds: 30 2024-08-20T22:15:41.0203015Z command: set -eux # PyYAML 6.0 doesn't work with MacOS x86 anymore # This must run on Python-3.7 (AmazonLinux2) so can't use request=3.32.2 python3 -m pip install requests==2.27.1 pyyaml==6.0.1 2024-08-20T22:15:41.0204184Z polling_interval_seconds: 1 2024-08-20T22:15:41.0204557Z warning_on_retry: true 2024-08-20T22:15:41.0204903Z continue_on_error: false 2024-08-20T22:15:41.0205248Z env: 2024-08-20T22:15:41.0205524Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:41.0205964Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:41.0206604Z GITHUB_TOKEN: *** 2024-08-20T22:15:41.0206919Z ##[endgroup] 2024-08-20T22:15:41.0973735Z + python3 -m pip install requests==2.27.1 pyyaml==6.0.1 2024-08-20T22:15:41.3343607Z Defaulting to user installation because normal site-packages is not writeable 2024-08-20T22:15:41.4860880Z Collecting requests==2.27.1 2024-08-20T22:15:41.5239312Z Downloading requests-2.27.1-py2.py3-none-any.whl (63 kB) 2024-08-20T22:15:41.7198654Z Collecting pyyaml==6.0.1 2024-08-20T22:15:41.7254598Z Downloading PyYAML-6.0.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (738 kB) 2024-08-20T22:15:41.7697724Z Requirement already satisfied: idna<4,>=2.5 in /usr/lib/python3.9/site-packages (from requests==2.27.1) (2.10) 2024-08-20T22:15:41.8166113Z Collecting certifi>=2017.4.17 2024-08-20T22:15:41.8216370Z Downloading certifi-2024.7.4-py3-none-any.whl (162 kB) 2024-08-20T22:15:41.8286748Z Requirement already satisfied: urllib3<1.27,>=1.21.1 in /usr/lib/python3.9/site-packages (from requests==2.27.1) (1.25.10) 2024-08-20T22:15:42.1316223Z Collecting charset-normalizer~=2.0.0 2024-08-20T22:15:42.1365856Z Downloading charset_normalizer-2.0.12-py3-none-any.whl (39 kB) 2024-08-20T22:15:42.2169037Z Installing collected packages: charset-normalizer, certifi, requests, pyyaml 2024-08-20T22:15:42.3354589Z Successfully installed certifi-2024.7.4 charset-normalizer-2.0.12 pyyaml-6.0.1 requests-2.27.1 2024-08-20T22:15:43.0761103Z Command completed after 1 attempt(s). 2024-08-20T22:15:43.0821817Z ##[group]Run set -x 2024-08-20T22:15:43.0822323Z set -x 2024-08-20T22:15:43.0822624Z  2024-08-20T22:15:43.0823167Z # Use relative path here as this could be checked out anywhere, not necessarily 2024-08-20T22:15:43.0823830Z # in runner workspace 2024-08-20T22:15:43.0824361Z python3 "${GITHUB_ACTION_PATH}/../../scripts/parse_ref.py" 2024-08-20T22:15:43.0833312Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:15:43.0833807Z env: 2024-08-20T22:15:43.0834088Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:43.0834565Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:43.0835086Z ##[endgroup] 2024-08-20T22:15:43.0865180Z + python3 /home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/filter-test-configs/../../scripts/parse_ref.py 2024-08-20T22:15:43.1101444Z ##[group]Run echo "Workflow: ${GITHUB_WORKFLOW}" 2024-08-20T22:15:43.1101981Z echo "Workflow: ${GITHUB_WORKFLOW}" 2024-08-20T22:15:43.1102442Z echo "Job name: ${JOB_NAME}" 2024-08-20T22:15:43.1102848Z  2024-08-20T22:15:43.1103385Z # Use relative path here as this could be checked out anywhere, not necessarily 2024-08-20T22:15:43.1104058Z # in runner workspace 2024-08-20T22:15:43.1104637Z python3 "${GITHUB_ACTION_PATH}/../../scripts/filter_test_configs.py" \ 2024-08-20T22:15:43.1105268Z  --workflow "${GITHUB_WORKFLOW}" \ 2024-08-20T22:15:43.1105714Z  --job-name "${JOB_NAME}" \ 2024-08-20T22:15:43.1112356Z  --test-matrix "{"include": [{"config": "dynamo_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}]}" \ 2024-08-20T22:15:43.1119300Z  --selected-test-configs "" \ 2024-08-20T22:15:43.1119783Z  --pr-number "${PR_NUMBER}" \ 2024-08-20T22:15:43.1120391Z  --tag "${TAG}" \ 2024-08-20T22:15:43.1120797Z  --event-name "${EVENT_NAME}" \ 2024-08-20T22:15:43.1121241Z  --schedule "${SCHEDULE}" \ 2024-08-20T22:15:43.1121675Z  --branch "${HEAD_BRANCH}" 2024-08-20T22:15:43.1129905Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:15:43.1130402Z env: 2024-08-20T22:15:43.1130679Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:43.1131139Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:43.1131808Z GITHUB_TOKEN: *** 2024-08-20T22:15:43.1132623Z JOB_NAME: cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (aot_eager_torchbench, 1, 2, linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:15:43.1133641Z PR_NUMBER: 2024-08-20T22:15:43.1133964Z TAG: ciflow/inductor/133712 2024-08-20T22:15:43.1134336Z EVENT_NAME: push 2024-08-20T22:15:43.1134647Z SCHEDULE: 2024-08-20T22:15:43.1134933Z HEAD_BRANCH: 2024-08-20T22:15:43.1135233Z ##[endgroup] 2024-08-20T22:15:43.1163379Z Workflow: inductor-periodic 2024-08-20T22:15:43.1164408Z Job name: cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (aot_eager_torchbench, 1, 2, linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:15:43.3747357Z INFO:root:Found no test-config label on the PR, so all test configs are included 2024-08-20T22:15:43.5268524Z ##[group]Run echo "Filtered matrix:" 2024-08-20T22:15:43.5268979Z echo "Filtered matrix:" 2024-08-20T22:15:43.5275554Z echo "{"include": [{"config": "dynamo_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}]}" 2024-08-20T22:15:43.5282434Z  2024-08-20T22:15:43.5282712Z echo 2024-08-20T22:15:43.5283181Z echo "Is the current job unstable? False" 2024-08-20T22:15:43.5283631Z  2024-08-20T22:15:43.5283906Z echo 2024-08-20T22:15:43.5284268Z echo "Is keep-going label set? False" 2024-08-20T22:15:43.5284702Z  2024-08-20T22:15:43.5284977Z echo 2024-08-20T22:15:43.5285297Z echo "Renabled issues? " 2024-08-20T22:15:43.5294154Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:15:43.5294645Z env: 2024-08-20T22:15:43.5294930Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:43.5295384Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:43.5295865Z ##[endgroup] 2024-08-20T22:15:43.5327198Z Filtered matrix: 2024-08-20T22:15:43.5335208Z {include: [{config: dynamo_eager_torchbench, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamo_eager_torchbench, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamo_eager_huggingface, shard: 1, num_shards: 1, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamo_eager_timm, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamo_eager_timm, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: aot_eager_torchbench, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: aot_eager_torchbench, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: aot_eager_huggingface, shard: 1, num_shards: 1, runner: linux.g5.4xlarge.nvidia.gpu}, {config: aot_eager_timm, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: aot_eager_timm, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_aot_eager_torchbench, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_aot_eager_torchbench, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_aot_eager_huggingface, shard: 1, num_shards: 1, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_aot_eager_timm, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_aot_eager_timm, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}]} 2024-08-20T22:15:43.5341905Z 2024-08-20T22:15:43.5342058Z Is the current job unstable? False 2024-08-20T22:15:43.5342343Z 2024-08-20T22:15:43.5342718Z Is keep-going label set? False 2024-08-20T22:15:43.5342976Z 2024-08-20T22:15:43.5343109Z Renabled issues? 2024-08-20T22:15:43.5386345Z ##[group]Run echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2024-08-20T22:15:43.5387064Z echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2024-08-20T22:15:43.5395250Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:15:43.5395748Z env: 2024-08-20T22:15:43.5396037Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:43.5396497Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:43.5396987Z JOB_TIMEOUT: 240 2024-08-20T22:15:43.5397298Z ##[endgroup] 2024-08-20T22:15:43.5488128Z ##[group]Run set -x 2024-08-20T22:15:43.5488529Z set -x 2024-08-20T22:15:43.5488826Z  2024-08-20T22:15:43.5489178Z if [[ $TEST_CONFIG == 'multigpu' ]]; then 2024-08-20T22:15:43.5489737Z  TEST_COMMAND=.ci/pytorch/multigpu-test.sh 2024-08-20T22:15:43.5490315Z elif [[ $BUILD_ENVIRONMENT == *onnx* ]]; then 2024-08-20T22:15:43.5490817Z  TEST_COMMAND=.ci/onnx/test.sh 2024-08-20T22:15:43.5491226Z else 2024-08-20T22:15:43.5491560Z  TEST_COMMAND=.ci/pytorch/test.sh 2024-08-20T22:15:43.5491991Z fi 2024-08-20T22:15:43.5492268Z  2024-08-20T22:15:43.5492727Z # detached container should get cleaned up by teardown_ec2_linux 2024-08-20T22:15:43.5493460Z # TODO: Stop building test binaries as part of the build phase 2024-08-20T22:15:43.5494125Z # Used for GPU_FLAG since that doesn't play nice 2024-08-20T22:15:43.5494708Z # shellcheck disable=SC2086,SC2090 2024-08-20T22:15:43.5495164Z container_name=$(docker run \ 2024-08-20T22:15:43.5495578Z  ${GPU_FLAG:-} \ 2024-08-20T22:15:43.5495947Z  -e BUILD_ENVIRONMENT \ 2024-08-20T22:15:43.5496341Z  -e PR_NUMBER \ 2024-08-20T22:15:43.5496693Z  -e GITHUB_ACTIONS \ 2024-08-20T22:15:43.5497078Z  -e GITHUB_REPOSITORY \ 2024-08-20T22:15:43.5497482Z  -e GITHUB_WORKFLOW \ 2024-08-20T22:15:43.5497865Z  -e GITHUB_JOB \ 2024-08-20T22:15:43.5498219Z  -e GITHUB_RUN_ID \ 2024-08-20T22:15:43.5498602Z  -e GITHUB_RUN_NUMBER \ 2024-08-20T22:15:43.5499008Z  -e GITHUB_RUN_ATTEMPT \ 2024-08-20T22:15:43.5499403Z  -e JOB_ID \ 2024-08-20T22:15:43.5499733Z  -e JOB_NAME \ 2024-08-20T22:15:43.5500077Z  -e BASE_SHA \ 2024-08-20T22:15:43.5500417Z  -e BRANCH \ 2024-08-20T22:15:43.5500742Z  -e SHA1 \ 2024-08-20T22:15:43.5501087Z  -e AWS_DEFAULT_REGION \ 2024-08-20T22:15:43.5501488Z  -e IN_WHEEL_TEST \ 2024-08-20T22:15:43.5501864Z  -e SHARD_NUMBER \ 2024-08-20T22:15:43.5502225Z  -e TEST_CONFIG \ 2024-08-20T22:15:43.5502590Z  -e NUM_TEST_SHARDS \ 2024-08-20T22:15:43.5502977Z  -e REENABLED_ISSUES \ 2024-08-20T22:15:43.5503385Z  -e CONTINUE_THROUGH_ERROR \ 2024-08-20T22:15:43.5503799Z  -e VERBOSE_TEST_LOGS \ 2024-08-20T22:15:43.5504194Z  -e TEST_SHOWLOCALS \ 2024-08-20T22:15:43.5504580Z  -e NO_TEST_TIMEOUT \ 2024-08-20T22:15:43.5505122Z  -e NO_TD \ 2024-08-20T22:15:43.5505458Z  -e TD_DISTRIBUTED \ 2024-08-20T22:15:43.5505835Z  -e PR_LABELS \ 2024-08-20T22:15:43.5506237Z  -e MAX_JOBS="$(nproc --ignore=2)" \ 2024-08-20T22:15:43.5506682Z  -e SCCACHE_BUCKET \ 2024-08-20T22:15:43.5507077Z  -e SCCACHE_S3_KEY_PREFIX \ 2024-08-20T22:15:43.5507485Z  -e XLA_CUDA \ 2024-08-20T22:15:43.5507886Z  -e XLA_CLANG_CACHE_S3_BUCKET_NAME \ 2024-08-20T22:15:43.5508385Z  -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK \ 2024-08-20T22:15:43.5508899Z  -e PYTORCH_TEST_RERUN_DISABLED_TESTS \ 2024-08-20T22:15:43.5509413Z  -e SKIP_SCCACHE_INITIALIZATION=1 \ 2024-08-20T22:15:43.5509878Z  -e HUGGING_FACE_HUB_TOKEN \ 2024-08-20T22:15:43.5510366Z  -e SCRIBE_GRAPHQL_ACCESS_TOKEN \ 2024-08-20T22:15:43.5510803Z  -e DASHBOARD_TAG \ 2024-08-20T22:15:43.5511274Z  --env-file="/tmp/github_env_${GITHUB_RUN_ID}" \ 2024-08-20T22:15:43.5511831Z  --security-opt seccomp=unconfined \ 2024-08-20T22:15:43.5512284Z  --cap-add=SYS_PTRACE \ 2024-08-20T22:15:43.5512669Z  --ipc=host \ 2024-08-20T22:15:43.5513029Z  --shm-size="${SHM_SIZE}" \ 2024-08-20T22:15:43.5513421Z  --tty \ 2024-08-20T22:15:43.5513730Z  --detach \ 2024-08-20T22:15:43.5514209Z  --name="${container_name}" \ 2024-08-20T22:15:43.5514626Z  --user jenkins \ 2024-08-20T22:15:43.5515107Z  -v "${GITHUB_WORKSPACE}:/var/lib/jenkins/workspace" \ 2024-08-20T22:15:43.5515656Z  -w /var/lib/jenkins/workspace \ 2024-08-20T22:15:43.5516088Z  "${DOCKER_IMAGE}" 2024-08-20T22:15:43.5516436Z ) 2024-08-20T22:15:43.5516837Z # Propagate download.pytorch.org IP to container 2024-08-20T22:15:43.5517747Z grep download.pytorch.org /etc/hosts | docker exec -i "${container_name}" sudo bash -c "/bin/cat >> /etc/hosts" 2024-08-20T22:15:43.5518704Z echo "DOCKER_CONTAINER_ID=${container_name}" >> "${GITHUB_ENV}" 2024-08-20T22:15:43.5519600Z docker exec -t "${container_name}" sh -c "pip install $(echo dist/*.whl)[opt-einsum] && ${TEST_COMMAND}" 2024-08-20T22:15:43.5528753Z shell: /usr/bin/bash -e {0} 2024-08-20T22:15:43.5529103Z env: 2024-08-20T22:15:43.5529414Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:43.5529898Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:43.5530500Z BUILD_ENVIRONMENT: linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-08-20T22:15:43.5530996Z PR_NUMBER: 2024-08-20T22:15:43.5531322Z GITHUB_REPOSITORY: pytorch/pytorch 2024-08-20T22:15:43.5531754Z GITHUB_WORKFLOW: inductor-periodic 2024-08-20T22:15:43.5532154Z GITHUB_JOB: test 2024-08-20T22:15:43.5532468Z GITHUB_RUN_ID: 10479310721 2024-08-20T22:15:43.5532833Z GITHUB_RUN_NUMBER: 54565 2024-08-20T22:15:43.5533189Z GITHUB_RUN_ATTEMPT: 1 2024-08-20T22:15:43.5533526Z JOB_ID: 29026298848 2024-08-20T22:15:43.5534344Z JOB_NAME: cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (aot_eager_torchbench, 1, 2, linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:15:43.5535215Z BRANCH: 2024-08-20T22:15:43.5535560Z SHA1: 40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:15:43.5536081Z BASE_SHA: 40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:15:43.5536564Z TEST_CONFIG: aot_eager_torchbench 2024-08-20T22:15:43.5536965Z SHARD_NUMBER: 1 2024-08-20T22:15:43.5537279Z NUM_TEST_SHARDS: 2 2024-08-20T22:15:43.5537607Z REENABLED_ISSUES: 2024-08-20T22:15:43.5537941Z CONTINUE_THROUGH_ERROR: False 2024-08-20T22:15:43.5538326Z VERBOSE_TEST_LOGS: False 2024-08-20T22:15:43.5538687Z TEST_SHOWLOCALS: False 2024-08-20T22:15:43.5539032Z NO_TEST_TIMEOUT: False 2024-08-20T22:15:43.5539368Z NO_TD: False 2024-08-20T22:15:43.5539673Z TD_DISTRIBUTED: False 2024-08-20T22:15:43.5540090Z SCCACHE_BUCKET: ossci-compiler-cache-circleci-v2 2024-08-20T22:15:43.5540599Z SCCACHE_S3_KEY_PREFIX: inductor-periodic 2024-08-20T22:15:43.5541127Z SHM_SIZE: 2g 2024-08-20T22:15:43.5542199Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:15:43.5543354Z XLA_CUDA: 2024-08-20T22:15:43.5543827Z XLA_CLANG_CACHE_S3_BUCKET_NAME: ossci-compiler-clang-cache-circleci-xla 2024-08-20T22:15:43.5544440Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK: 0 2024-08-20T22:15:43.5544873Z PYTORCH_TEST_RERUN_DISABLED_TESTS: 0 2024-08-20T22:15:43.5545279Z DASHBOARD_TAG: 2024-08-20T22:15:43.5545790Z HUGGING_FACE_HUB_TOKEN: *** 2024-08-20T22:15:43.5546175Z SCRIBE_GRAPHQL_ACCESS_TOKEN: 2024-08-20T22:15:43.5546551Z ##[endgroup] 2024-08-20T22:15:43.5576634Z + [[ aot_eager_torchbench == \m\u\l\t\i\g\p\u ]] 2024-08-20T22:15:43.5577625Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *onnx* ]] 2024-08-20T22:15:43.5578195Z + TEST_COMMAND=.ci/pytorch/test.sh 2024-08-20T22:15:43.5585813Z +++ nproc --ignore=2 2024-08-20T22:15:43.5613920Z ++ docker run --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all -e BUILD_ENVIRONMENT -e PR_NUMBER -e GITHUB_ACTIONS -e GITHUB_REPOSITORY -e GITHUB_WORKFLOW -e GITHUB_JOB -e GITHUB_RUN_ID -e GITHUB_RUN_NUMBER -e GITHUB_RUN_ATTEMPT -e JOB_ID -e JOB_NAME -e BASE_SHA -e BRANCH -e SHA1 -e AWS_DEFAULT_REGION -e IN_WHEEL_TEST -e SHARD_NUMBER -e TEST_CONFIG -e NUM_TEST_SHARDS -e REENABLED_ISSUES -e CONTINUE_THROUGH_ERROR -e VERBOSE_TEST_LOGS -e TEST_SHOWLOCALS -e NO_TEST_TIMEOUT -e NO_TD -e TD_DISTRIBUTED -e PR_LABELS -e MAX_JOBS=14 -e SCCACHE_BUCKET -e SCCACHE_S3_KEY_PREFIX -e XLA_CUDA -e XLA_CLANG_CACHE_S3_BUCKET_NAME -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK -e PYTORCH_TEST_RERUN_DISABLED_TESTS -e SKIP_SCCACHE_INITIALIZATION=1 -e HUGGING_FACE_HUB_TOKEN -e SCRIBE_GRAPHQL_ACCESS_TOKEN -e DASHBOARD_TAG --env-file=/tmp/github_env_10479310721 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --ipc=host --shm-size=2g --tty --detach --name= --user jenkins -v /home/ec2-user/actions-runner/_work/pytorch/pytorch:/var/lib/jenkins/workspace -w /var/lib/jenkins/workspace 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:15:54.9454528Z + container_name=61d9bed6547bc97a242141be39386baa55845d3b63f44f2988ee9a1ae9d14ac6 2024-08-20T22:15:54.9456657Z + grep download.pytorch.org /etc/hosts 2024-08-20T22:15:54.9459097Z + docker exec -i 61d9bed6547bc97a242141be39386baa55845d3b63f44f2988ee9a1ae9d14ac6 sudo bash -c '/bin/cat >> /etc/hosts' 2024-08-20T22:15:55.0917760Z + echo DOCKER_CONTAINER_ID=61d9bed6547bc97a242141be39386baa55845d3b63f44f2988ee9a1ae9d14ac6 2024-08-20T22:15:55.0921771Z ++ echo dist/torch-2.5.0a0+git40ec5f6-cp310-cp310-linux_x86_64.whl 2024-08-20T22:15:55.0925668Z + docker exec -t 61d9bed6547bc97a242141be39386baa55845d3b63f44f2988ee9a1ae9d14ac6 sh -c 'pip install dist/torch-2.5.0a0+git40ec5f6-cp310-cp310-linux_x86_64.whl[opt-einsum] && .ci/pytorch/test.sh' 2024-08-20T22:15:55.4900768Z Processing ./dist/torch-2.5.0a0+git40ec5f6-cp310-cp310-linux_x86_64.whl (from torch==2.5.0a0+git40ec5f6) 2024-08-20T22:15:55.8146157Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (3.13.1) 2024-08-20T22:15:55.8148815Z Requirement already satisfied: typing-extensions>=4.8.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (4.12.2) 2024-08-20T22:15:55.8151886Z Requirement already satisfied: networkx in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (2.8.8) 2024-08-20T22:15:55.8155515Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (3.1.4) 2024-08-20T22:15:55.8158000Z Requirement already satisfied: fsspec in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (2024.6.1) 2024-08-20T22:15:55.8163227Z Requirement already satisfied: sympy==1.13.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (1.13.1) 2024-08-20T22:15:55.8179182Z Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from sympy==1.13.1->torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (1.3.0) 2024-08-20T22:15:55.8192309Z Requirement already satisfied: opt-einsum>=3.3 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (3.3.0) 2024-08-20T22:15:55.8209500Z Requirement already satisfied: numpy>=1.7 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from opt-einsum>=3.3->torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (1.22.4) 2024-08-20T22:15:55.8594542Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from jinja2->torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (2.1.5) 2024-08-20T22:15:56.4380566Z Installing collected packages: torch 2024-08-20T22:16:06.1928606Z ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 2024-08-20T22:16:06.1930578Z timm 1.0.9.dev0 requires torchvision, which is not installed. 2024-08-20T22:16:06.1933114Z Successfully installed torch-2.5.0a0+git40ec5f6 2024-08-20T22:16:06.2741461Z + export TERM=vt100 2024-08-20T22:16:06.2741843Z + TERM=vt100 2024-08-20T22:16:06.2743948Z ++ dirname .ci/pytorch/test.sh 2024-08-20T22:16:06.2753302Z + source .ci/pytorch/common.sh 2024-08-20T22:16:06.2757183Z +++ dirname .ci/pytorch/common.sh 2024-08-20T22:16:06.2765982Z ++ source .ci/pytorch/common_utils.sh 2024-08-20T22:16:06.2767880Z +++ declare -f -t trap_add 2024-08-20T22:16:06.2773200Z ++ set -ex 2024-08-20T22:16:06.2773866Z ++ [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *rocm* ]] 2024-08-20T22:16:06.2774432Z ++ BUILD_TEST_LIBTORCH=0 2024-08-20T22:16:06.2775030Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *rocm* ]] 2024-08-20T22:16:06.2777122Z ++ stat -c %u /var/lib/jenkins/workspace 2024-08-20T22:16:06.2796225Z + WORKSPACE_ORIGINAL_OWNER_ID=1000 2024-08-20T22:16:06.2796741Z + trap_add cleanup_workspace EXIT 2024-08-20T22:16:06.2797166Z + trap_add_cmd=cleanup_workspace 2024-08-20T22:16:06.2797530Z + shift 2024-08-20T22:16:06.2797810Z + for trap_add_name in "$@" 2024-08-20T22:16:06.2804544Z +++ trap -p EXIT 2024-08-20T22:16:06.2807644Z ++ eval 'extract_trap_cmd ' 2024-08-20T22:16:06.2808136Z +++ extract_trap_cmd 2024-08-20T22:16:06.2808613Z +++ printf '%s\n' '' 2024-08-20T22:16:06.2809100Z ++ printf '%s\n' cleanup_workspace 2024-08-20T22:16:06.2811031Z + trap -- ' 2024-08-20T22:16:06.2811513Z cleanup_workspace' EXIT 2024-08-20T22:16:06.2812143Z + sudo chown -R jenkins /var/lib/jenkins/workspace 2024-08-20T22:16:06.9856191Z + git config --global --add safe.directory /var/lib/jenkins/workspace 2024-08-20T22:16:06.9877501Z + echo 'Environment variables:' 2024-08-20T22:16:06.9877984Z Environment variables: 2024-08-20T22:16:06.9878353Z + env 2024-08-20T22:16:06.9888915Z INSTALLED_DB=yes 2024-08-20T22:16:06.9889497Z NV_LIBCUBLAS_VERSION=12.1.3.1-1 2024-08-20T22:16:06.9890017Z NVIDIA_VISIBLE_DEVICES=all 2024-08-20T22:16:06.9890572Z NV_NVML_DEV_VERSION=12.1.105-1 2024-08-20T22:16:06.9891283Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-20T22:16:06.9892051Z CONTINUE_THROUGH_ERROR=False 2024-08-20T22:16:06.9892706Z NV_LIBNCCL_DEV_PACKAGE=libnccl-dev=2.17.1-1+cuda12.1 2024-08-20T22:16:06.9893247Z NV_LIBNCCL_DEV_PACKAGE_VERSION=2.17.1-1 2024-08-20T22:16:06.9893982Z BUILD_ENVIRONMENT=linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-08-20T22:16:06.9894590Z HOSTNAME=61d9bed6547b 2024-08-20T22:16:06.9895486Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_c04f95fc-d3c6-42d2-853b-f875efa8dcd4 2024-08-20T22:16:06.9896676Z GITHUB_ACTION=__self 2024-08-20T22:16:06.9897045Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2024-08-20T22:16:06.9901844Z NVIDIA_REQUIRE_CUDA=cuda>=12.1 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 brand=tesla,driver>=525,driver<526 brand=unknown,driver>=525,driver<526 brand=nvidia,driver>=525,driver<526 brand=nvidiartx,driver>=525,driver<526 brand=geforce,driver>=525,driver<526 brand=geforcertx,driver>=525,driver<526 brand=quadro,driver>=525,driver<526 brand=quadrortx,driver>=525,driver<526 brand=titan,driver>=525,driver<526 brand=titanrtx,driver>=525,driver<526 2024-08-20T22:16:06.9906200Z NV_LIBCUBLAS_DEV_PACKAGE=libcublas-dev-12-1=12.1.3.1-1 2024-08-20T22:16:06.9906709Z NV_NVTX_VERSION=12.1.105-1 2024-08-20T22:16:06.9907071Z GITHUB_RUN_NUMBER=54565 2024-08-20T22:16:06.9907426Z TEST_CONFIG=aot_eager_torchbench 2024-08-20T22:16:06.9907830Z GITHUB_REPOSITORY_OWNER_ID=21003710 2024-08-20T22:16:06.9908296Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2024-08-20T22:16:06.9908757Z NV_CUDA_CUDART_DEV_VERSION=12.1.105-1 2024-08-20T22:16:06.9909198Z NV_LIBCUSPARSE_VERSION=12.1.0.106-1 2024-08-20T22:16:06.9909813Z SCRIBE_GRAPHQL_ACCESS_TOKEN= 2024-08-20T22:16:06.9910213Z NV_LIBNPP_VERSION=12.1.0.40-1 2024-08-20T22:16:06.9910662Z GITHUB_TRIGGERING_ACTOR=pytorch-bot[bot] 2024-08-20T22:16:06.9911147Z CMAKE_CUDA_COMPILER_LAUNCHER=/opt/cache/bin/sccache 2024-08-20T22:16:06.9911601Z GITHUB_REF_TYPE=tag 2024-08-20T22:16:06.9911925Z TORCH_CUDA_ARCH_LIST=Maxwell 2024-08-20T22:16:06.9912301Z NCCL_VERSION=2.17.1-1 2024-08-20T22:16:06.9912690Z BASE_SHA=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:16:06.9913128Z XLA_CUDA= 2024-08-20T22:16:06.9913630Z HUGGING_FACE_HUB_TOKEN=*** 2024-08-20T22:16:06.9915890Z *** 2024-08-20T22:16:06.9916194Z CARGO_NET_GIT_FETCH_WITH_CLI=true 2024-08-20T22:16:06.9916586Z GITHUB_REPOSITORY_ID=65600975 2024-08-20T22:16:06.9916948Z GITHUB_ACTIONS=true 2024-08-20T22:16:06.9917279Z NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:16:06.9917796Z NV_NVPROF_DEV_PACKAGE=cuda-nvprof-12-1=12.1.105-1 2024-08-20T22:16:06.9918327Z NV_LIBNPP_PACKAGE=libnpp-12-1=12.1.0.40-1 2024-08-20T22:16:06.9918801Z SHA1=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:16:06.9919314Z NV_LIBNCCL_DEV_PACKAGE_NAME=libnccl-dev 2024-08-20T22:16:06.9919793Z GITHUB_SHA=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:16:06.9920718Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/inductor-periodic.yml@refs/tags/ciflow/inductor/133712 2024-08-20T22:16:06.9921476Z UCC_HOME=/usr 2024-08-20T22:16:06.9921813Z NV_LIBCUBLAS_DEV_VERSION=12.1.3.1-1 2024-08-20T22:16:06.9922210Z VERBOSE_TEST_LOGS=False 2024-08-20T22:16:06.9922548Z NVIDIA_PRODUCT_NAME=CUDA 2024-08-20T22:16:06.9923109Z NV_LIBCUBLAS_DEV_PACKAGE_NAME=libcublas-dev-12-1 2024-08-20T22:16:06.9923608Z GITHUB_REF=refs/tags/ciflow/inductor/133712 2024-08-20T22:16:06.9924069Z NV_CUDA_CUDART_VERSION=12.1.105-1 2024-08-20T22:16:06.9924449Z SHARD_NUMBER=1 2024-08-20T22:16:06.9924754Z GITHUB_REF_PROTECTED=false 2024-08-20T22:16:06.9925104Z HOME=/var/lib/jenkins 2024-08-20T22:16:06.9925489Z GITHUB_API_URL=https://api.github.com 2024-08-20T22:16:06.9925948Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2024-08-20T22:16:06.9926423Z UCX_COMMIT=7bb2722ff2187a0cad557ae4a6afa090569f83fb 2024-08-20T22:16:06.9926980Z SCCACHE_S3_KEY_PREFIX=inductor-periodic 2024-08-20T22:16:06.9927389Z CUDA_VERSION=12.1.1 2024-08-20T22:16:06.9927812Z NV_LIBCUBLAS_PACKAGE=libcublas-12-1=12.1.3.1-1 2024-08-20T22:16:06.9928246Z NUM_TEST_SHARDS=2 2024-08-20T22:16:06.9928540Z UCX_HOME=/usr 2024-08-20T22:16:06.9929053Z NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE=cuda-nsight-compute-12-1=12.1.1-1 2024-08-20T22:16:06.9930128Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_c04f95fc-d3c6-42d2-853b-f875efa8dcd4 2024-08-20T22:16:06.9931664Z JOB_NAME=cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (aot_eager_torchbench, 1, 2, linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:16:06.9933033Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_c04f95fc-d3c6-42d2-853b-f875efa8dcd4 2024-08-20T22:16:06.9934134Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2024-08-20T22:16:06.9934794Z GITHUB_EVENT_NAME=push 2024-08-20T22:16:06.9935121Z DASHBOARD_TAG= 2024-08-20T22:16:06.9935428Z GITHUB_RUN_ID=10479310721 2024-08-20T22:16:06.9935882Z NV_LIBNPP_DEV_PACKAGE=libnpp-dev-12-1=12.1.0.40-1 2024-08-20T22:16:06.9936420Z NV_LIBCUBLAS_PACKAGE_NAME=libcublas-12-1 2024-08-20T22:16:06.9937413Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_c04f95fc-d3c6-42d2-853b-f875efa8dcd4 2024-08-20T22:16:06.9938326Z GITHUB_ACTOR=pytorch-bot[bot] 2024-08-20T22:16:06.9938728Z NV_LIBNPP_DEV_VERSION=12.1.0.40-1 2024-08-20T22:16:06.9939110Z PR_NUMBER= 2024-08-20T22:16:06.9939396Z GITHUB_RUN_ATTEMPT=1 2024-08-20T22:16:06.9939732Z ANACONDA_PYTHON_VERSION=3.10 2024-08-20T22:16:06.9940173Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2024-08-20T22:16:06.9940633Z TERM=vt100 2024-08-20T22:16:06.9940967Z NV_LIBCUSPARSE_DEV_VERSION=12.1.0.106-1 2024-08-20T22:16:06.9941374Z INSTALLED_VISION=yes 2024-08-20T22:16:06.9941794Z BRANCH= 2024-08-20T22:16:06.9942080Z OPENSSL_ROOT_DIR=/opt/openssl 2024-08-20T22:16:06.9942471Z LIBRARY_PATH=/usr/local/cuda/lib64/stubs 2024-08-20T22:16:06.9942892Z CUDA_PATH=/usr/local/cuda 2024-08-20T22:16:06.9943644Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2024-08-20T22:16:06.9944397Z GITHUB_SERVER_URL=https://github.com 2024-08-20T22:16:06.9944874Z UCC_COMMIT=20eae37090a4ce1b32bcce6144ccad0b49943e0b 2024-08-20T22:16:06.9945334Z REENABLED_ISSUES= 2024-08-20T22:16:06.9945630Z SHLVL=1 2024-08-20T22:16:06.9945894Z MAX_JOBS=14 2024-08-20T22:16:06.9946206Z NV_CUDA_LIB_VERSION=12.1.1-1 2024-08-20T22:16:06.9946557Z NVARCH=x86_64 2024-08-20T22:16:06.9946853Z GITHUB_ACTOR_ID=54816060 2024-08-20T22:16:06.9947297Z GITHUB_WORKFLOW_SHA=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:16:06.9947827Z GITHUB_REF_NAME=ciflow/inductor/133712 2024-08-20T22:16:06.9948321Z NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-1 2024-08-20T22:16:06.9948988Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2024-08-20T22:16:06.9949547Z GITHUB_JOB=test 2024-08-20T22:16:06.9950268Z NV_LIBNCCL_PACKAGE=libnccl2=2.17.1-1+cuda12.1 2024-08-20T22:16:06.9950828Z LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64 2024-08-20T22:16:06.9951333Z NO_TEST_TIMEOUT=False 2024-08-20T22:16:06.9951655Z TD_DISTRIBUTED=False 2024-08-20T22:16:06.9952032Z NV_CUDA_NSIGHT_COMPUTE_VERSION=12.1.1-1 2024-08-20T22:16:06.9952466Z GITHUB_REPOSITORY=pytorch/pytorch 2024-08-20T22:16:06.9952886Z NV_NVPROF_VERSION=12.1.105-1 2024-08-20T22:16:06.9953243Z GITHUB_RETENTION_DAYS=90 2024-08-20T22:16:06.9953596Z OPENSSL_DIR=/opt/openssl 2024-08-20T22:16:06.9953945Z GITHUB_ACTION_REPOSITORY= 2024-08-20T22:16:06.9954956Z PATH=/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-08-20T22:16:06.9956056Z GITHUB_BASE_REF= 2024-08-20T22:16:06.9956381Z NV_LIBNCCL_PACKAGE_NAME=libnccl2 2024-08-20T22:16:06.9956753Z CI=true 2024-08-20T22:16:06.9957063Z NV_LIBNCCL_PACKAGE_VERSION=2.17.1-1 2024-08-20T22:16:06.9957477Z GITHUB_REPOSITORY_OWNER=pytorch 2024-08-20T22:16:06.9957847Z JOB_ID=29026298848 2024-08-20T22:16:06.9958157Z INSTALLED_PROTOBUF=yes 2024-08-20T22:16:06.9958478Z GITHUB_HEAD_REF= 2024-08-20T22:16:06.9958777Z GITHUB_ACTION_REF= 2024-08-20T22:16:06.9959211Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2024-08-20T22:16:06.9959673Z TEST_SHOWLOCALS=False 2024-08-20T22:16:06.9960058Z GITHUB_WORKFLOW=inductor-periodic 2024-08-20T22:16:06.9960462Z DEBIAN_FRONTEND=noninteractive 2024-08-20T22:16:06.9961536Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_c04f95fc-d3c6-42d2-853b-f875efa8dcd4 2024-08-20T22:16:06.9962341Z NO_TD=False 2024-08-20T22:16:06.9962649Z SKIP_SCCACHE_INITIALIZATION=1 2024-08-20T22:16:06.9963106Z _=/usr/bin/env 2024-08-20T22:16:06.9963587Z ++ python -c 'import site; print(site.getsitepackages()[0])' 2024-08-20T22:16:07.0121382Z + TORCH_INSTALL_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch 2024-08-20T22:16:07.0122692Z + TORCH_BIN_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/bin 2024-08-20T22:16:07.0123960Z + TORCH_LIB_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/lib 2024-08-20T22:16:07.0125027Z + TORCH_TEST_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/test 2024-08-20T22:16:07.0125624Z + BUILD_DIR=build 2024-08-20T22:16:07.0125965Z + BUILD_RENAMED_DIR=build_renamed 2024-08-20T22:16:07.0126353Z + BUILD_BIN_DIR=build/bin 2024-08-20T22:16:07.0126690Z + SHARD_NUMBER=1 2024-08-20T22:16:07.0126995Z + NUM_TEST_SHARDS=2 2024-08-20T22:16:07.0127310Z + export VALGRIND=ON 2024-08-20T22:16:07.0127671Z + VALGRIND=ON 2024-08-20T22:16:07.0128225Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *clang9* ]] 2024-08-20T22:16:07.0128778Z + [[ 0 == \1 ]] 2024-08-20T22:16:07.0129077Z + [[ False == \1 ]] 2024-08-20T22:16:07.0130565Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *bazel* ]] 2024-08-20T22:16:07.0131151Z ++ realpath build/custom_test_artifacts 2024-08-20T22:16:07.0139973Z + CUSTOM_TEST_ARTIFACT_BUILD_DIR=/var/lib/jenkins/workspace/build/custom_test_artifacts 2024-08-20T22:16:07.0140801Z + [[ -n '' ]] 2024-08-20T22:16:07.0141159Z + echo 'Environment variables' 2024-08-20T22:16:07.0141536Z Environment variables 2024-08-20T22:16:07.0141843Z + env 2024-08-20T22:16:07.0150434Z INSTALLED_DB=yes 2024-08-20T22:16:07.0151464Z NV_LIBCUBLAS_VERSION=12.1.3.1-1 2024-08-20T22:16:07.0151999Z NVIDIA_VISIBLE_DEVICES=all 2024-08-20T22:16:07.0152538Z NV_NVML_DEV_VERSION=12.1.105-1 2024-08-20T22:16:07.0153392Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-20T22:16:07.0154169Z CONTINUE_THROUGH_ERROR=False 2024-08-20T22:16:07.0154894Z NV_LIBNCCL_DEV_PACKAGE=libnccl-dev=2.17.1-1+cuda12.1 2024-08-20T22:16:07.0155529Z NV_LIBNCCL_DEV_PACKAGE_VERSION=2.17.1-1 2024-08-20T22:16:07.0156186Z BUILD_ENVIRONMENT=linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-08-20T22:16:07.0156852Z HOSTNAME=61d9bed6547b 2024-08-20T22:16:07.0157929Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_c04f95fc-d3c6-42d2-853b-f875efa8dcd4 2024-08-20T22:16:07.0158898Z GITHUB_ACTION=__self 2024-08-20T22:16:07.0159244Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2024-08-20T22:16:07.0163961Z NVIDIA_REQUIRE_CUDA=cuda>=12.1 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 brand=tesla,driver>=525,driver<526 brand=unknown,driver>=525,driver<526 brand=nvidia,driver>=525,driver<526 brand=nvidiartx,driver>=525,driver<526 brand=geforce,driver>=525,driver<526 brand=geforcertx,driver>=525,driver<526 brand=quadro,driver>=525,driver<526 brand=quadrortx,driver>=525,driver<526 brand=titan,driver>=525,driver<526 brand=titanrtx,driver>=525,driver<526 2024-08-20T22:16:07.0168073Z NV_LIBCUBLAS_DEV_PACKAGE=libcublas-dev-12-1=12.1.3.1-1 2024-08-20T22:16:07.0168587Z NV_NVTX_VERSION=12.1.105-1 2024-08-20T22:16:07.0168942Z GITHUB_RUN_NUMBER=54565 2024-08-20T22:16:07.0169299Z TEST_CONFIG=aot_eager_torchbench 2024-08-20T22:16:07.0169713Z GITHUB_REPOSITORY_OWNER_ID=21003710 2024-08-20T22:16:07.0170193Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2024-08-20T22:16:07.0170667Z NV_CUDA_CUDART_DEV_VERSION=12.1.105-1 2024-08-20T22:16:07.0171110Z NV_LIBCUSPARSE_VERSION=12.1.0.106-1 2024-08-20T22:16:07.0171727Z SCRIBE_GRAPHQL_ACCESS_TOKEN= 2024-08-20T22:16:07.0172133Z NV_LIBNPP_VERSION=12.1.0.40-1 2024-08-20T22:16:07.0172593Z GITHUB_TRIGGERING_ACTOR=pytorch-bot[bot] 2024-08-20T22:16:07.0173081Z CMAKE_CUDA_COMPILER_LAUNCHER=/opt/cache/bin/sccache 2024-08-20T22:16:07.0173548Z GITHUB_REF_TYPE=tag 2024-08-20T22:16:07.0173877Z TORCH_CUDA_ARCH_LIST=Maxwell 2024-08-20T22:16:07.0174257Z NCCL_VERSION=2.17.1-1 2024-08-20T22:16:07.0174661Z BASE_SHA=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:16:07.0175113Z XLA_CUDA= 2024-08-20T22:16:07.0175622Z HUGGING_FACE_HUB_TOKEN=*** 2024-08-20T22:16:07.0176012Z *** 2024-08-20T22:16:07.0176289Z CARGO_NET_GIT_FETCH_WITH_CLI=true 2024-08-20T22:16:07.0176693Z GITHUB_REPOSITORY_ID=65600975 2024-08-20T22:16:07.0177067Z GITHUB_ACTIONS=true 2024-08-20T22:16:07.0177391Z NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:16:07.0177886Z NV_NVPROF_DEV_PACKAGE=cuda-nvprof-12-1=12.1.105-1 2024-08-20T22:16:07.0178419Z NV_LIBNPP_PACKAGE=libnpp-12-1=12.1.0.40-1 2024-08-20T22:16:07.0178894Z SHA1=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:16:07.0179400Z NV_LIBNCCL_DEV_PACKAGE_NAME=libnccl-dev 2024-08-20T22:16:07.0179889Z GITHUB_SHA=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:16:07.0180813Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/inductor-periodic.yml@refs/tags/ciflow/inductor/133712 2024-08-20T22:16:07.0181574Z UCC_HOME=/usr 2024-08-20T22:16:07.0182081Z NV_LIBCUBLAS_DEV_VERSION=12.1.3.1-1 2024-08-20T22:16:07.0182483Z VERBOSE_TEST_LOGS=False 2024-08-20T22:16:07.0182825Z NVIDIA_PRODUCT_NAME=CUDA 2024-08-20T22:16:07.0183296Z NV_LIBCUBLAS_DEV_PACKAGE_NAME=libcublas-dev-12-1 2024-08-20T22:16:07.0183784Z GITHUB_REF=refs/tags/ciflow/inductor/133712 2024-08-20T22:16:07.0184252Z NV_CUDA_CUDART_VERSION=12.1.105-1 2024-08-20T22:16:07.0184634Z SHARD_NUMBER=1 2024-08-20T22:16:07.0184943Z GITHUB_REF_PROTECTED=false 2024-08-20T22:16:07.0185294Z HOME=/var/lib/jenkins 2024-08-20T22:16:07.0185657Z GITHUB_API_URL=https://api.github.com 2024-08-20T22:16:07.0186092Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2024-08-20T22:16:07.0186566Z UCX_COMMIT=7bb2722ff2187a0cad557ae4a6afa090569f83fb 2024-08-20T22:16:07.0187125Z SCCACHE_S3_KEY_PREFIX=inductor-periodic 2024-08-20T22:16:07.0187536Z CUDA_VERSION=12.1.1 2024-08-20T22:16:07.0187959Z NV_LIBCUBLAS_PACKAGE=libcublas-12-1=12.1.3.1-1 2024-08-20T22:16:07.0188398Z NUM_TEST_SHARDS=2 2024-08-20T22:16:07.0188696Z UCX_HOME=/usr 2024-08-20T22:16:07.0189218Z NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE=cuda-nsight-compute-12-1=12.1.1-1 2024-08-20T22:16:07.0190293Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_c04f95fc-d3c6-42d2-853b-f875efa8dcd4 2024-08-20T22:16:07.0191690Z JOB_NAME=cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (aot_eager_torchbench, 1, 2, linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:16:07.0193061Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_c04f95fc-d3c6-42d2-853b-f875efa8dcd4 2024-08-20T22:16:07.0194173Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2024-08-20T22:16:07.0194826Z GITHUB_EVENT_NAME=push 2024-08-20T22:16:07.0195146Z DASHBOARD_TAG= 2024-08-20T22:16:07.0195450Z GITHUB_RUN_ID=10479310721 2024-08-20T22:16:07.0195928Z NV_LIBNPP_DEV_PACKAGE=libnpp-dev-12-1=12.1.0.40-1 2024-08-20T22:16:07.0196466Z NV_LIBCUBLAS_PACKAGE_NAME=libcublas-12-1 2024-08-20T22:16:07.0197458Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_c04f95fc-d3c6-42d2-853b-f875efa8dcd4 2024-08-20T22:16:07.0198362Z GITHUB_ACTOR=pytorch-bot[bot] 2024-08-20T22:16:07.0198768Z NV_LIBNPP_DEV_VERSION=12.1.0.40-1 2024-08-20T22:16:07.0199140Z PR_NUMBER= 2024-08-20T22:16:07.0199419Z GITHUB_RUN_ATTEMPT=1 2024-08-20T22:16:07.0199733Z VALGRIND=ON 2024-08-20T22:16:07.0200035Z ANACONDA_PYTHON_VERSION=3.10 2024-08-20T22:16:07.0200469Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2024-08-20T22:16:07.0200922Z TERM=vt100 2024-08-20T22:16:07.0201259Z NV_LIBCUSPARSE_DEV_VERSION=12.1.0.106-1 2024-08-20T22:16:07.0201777Z INSTALLED_VISION=yes 2024-08-20T22:16:07.0202084Z BRANCH= 2024-08-20T22:16:07.0202366Z OPENSSL_ROOT_DIR=/opt/openssl 2024-08-20T22:16:07.0202838Z LIBRARY_PATH=/usr/local/cuda/lib64/stubs 2024-08-20T22:16:07.0203258Z CUDA_PATH=/usr/local/cuda 2024-08-20T22:16:07.0204012Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2024-08-20T22:16:07.0204761Z GITHUB_SERVER_URL=https://github.com 2024-08-20T22:16:07.0205240Z UCC_COMMIT=20eae37090a4ce1b32bcce6144ccad0b49943e0b 2024-08-20T22:16:07.0205704Z REENABLED_ISSUES= 2024-08-20T22:16:07.0206001Z SHLVL=1 2024-08-20T22:16:07.0206262Z MAX_JOBS=14 2024-08-20T22:16:07.0206576Z NV_CUDA_LIB_VERSION=12.1.1-1 2024-08-20T22:16:07.0206923Z NVARCH=x86_64 2024-08-20T22:16:07.0207218Z GITHUB_ACTOR_ID=54816060 2024-08-20T22:16:07.0207671Z GITHUB_WORKFLOW_SHA=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:16:07.0208202Z GITHUB_REF_NAME=ciflow/inductor/133712 2024-08-20T22:16:07.0208686Z NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-1 2024-08-20T22:16:07.0209352Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2024-08-20T22:16:07.0209919Z GITHUB_JOB=test 2024-08-20T22:16:07.0210314Z NV_LIBNCCL_PACKAGE=libnccl2=2.17.1-1+cuda12.1 2024-08-20T22:16:07.0210863Z LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64 2024-08-20T22:16:07.0211375Z NO_TEST_TIMEOUT=False 2024-08-20T22:16:07.0211702Z TD_DISTRIBUTED=False 2024-08-20T22:16:07.0212182Z NV_CUDA_NSIGHT_COMPUTE_VERSION=12.1.1-1 2024-08-20T22:16:07.0212623Z GITHUB_REPOSITORY=pytorch/pytorch 2024-08-20T22:16:07.0213043Z NV_NVPROF_VERSION=12.1.105-1 2024-08-20T22:16:07.0213405Z GITHUB_RETENTION_DAYS=90 2024-08-20T22:16:07.0213744Z OPENSSL_DIR=/opt/openssl 2024-08-20T22:16:07.0214103Z GITHUB_ACTION_REPOSITORY= 2024-08-20T22:16:07.0215180Z PATH=/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-08-20T22:16:07.0216225Z GITHUB_BASE_REF= 2024-08-20T22:16:07.0216549Z NV_LIBNCCL_PACKAGE_NAME=libnccl2 2024-08-20T22:16:07.0216917Z CI=true 2024-08-20T22:16:07.0217240Z NV_LIBNCCL_PACKAGE_VERSION=2.17.1-1 2024-08-20T22:16:07.0217644Z GITHUB_REPOSITORY_OWNER=pytorch 2024-08-20T22:16:07.0218014Z JOB_ID=29026298848 2024-08-20T22:16:07.0218324Z INSTALLED_PROTOBUF=yes 2024-08-20T22:16:07.0218650Z GITHUB_HEAD_REF= 2024-08-20T22:16:07.0218944Z GITHUB_ACTION_REF= 2024-08-20T22:16:07.0219388Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2024-08-20T22:16:07.0219850Z TEST_SHOWLOCALS=False 2024-08-20T22:16:07.0220240Z GITHUB_WORKFLOW=inductor-periodic 2024-08-20T22:16:07.0220639Z DEBIAN_FRONTEND=noninteractive 2024-08-20T22:16:07.0221536Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_c04f95fc-d3c6-42d2-853b-f875efa8dcd4 2024-08-20T22:16:07.0222352Z NO_TD=False 2024-08-20T22:16:07.0222661Z SKIP_SCCACHE_INITIALIZATION=1 2024-08-20T22:16:07.0223018Z _=/usr/bin/env 2024-08-20T22:16:07.0223370Z + echo 'Testing pytorch' 2024-08-20T22:16:07.0223717Z Testing pytorch 2024-08-20T22:16:07.0224037Z + export LANG=C.UTF-8 2024-08-20T22:16:07.0224378Z + LANG=C.UTF-8 2024-08-20T22:16:07.0224668Z + PR_NUMBER= 2024-08-20T22:16:07.0225008Z + [[ aot_eager_torchbench == \d\e\f\a\u\l\t ]] 2024-08-20T22:16:07.0225513Z + [[ aot_eager_torchbench == \d\i\s\t\r\i\b\u\t\e\d ]] 2024-08-20T22:16:07.0226012Z + [[ aot_eager_torchbench == \s\l\o\w ]] 2024-08-20T22:16:07.0226715Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *slow-gradcheck* ]] 2024-08-20T22:16:07.0227418Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *cuda* ]] 2024-08-20T22:16:07.0227959Z + export PYTORCH_TESTING_DEVICE_ONLY_FOR=cuda 2024-08-20T22:16:07.0228432Z + PYTORCH_TESTING_DEVICE_ONLY_FOR=cuda 2024-08-20T22:16:07.0228876Z + [[ aot_eager_torchbench == *crossref* ]] 2024-08-20T22:16:07.0229456Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *rocm* ]] 2024-08-20T22:16:07.0230082Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *xpu* ]] 2024-08-20T22:16:07.0230730Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *-bazel-* ]] 2024-08-20T22:16:07.0231395Z + pip_install --user ninja==1.10.2 2024-08-20T22:16:07.0231926Z + pip install --progress-bar off --user ninja==1.10.2 2024-08-20T22:16:08.1930361Z Collecting ninja==1.10.2 2024-08-20T22:16:08.2104949Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl.metadata (5.0 kB) 2024-08-20T22:16:08.2641170Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl (108 kB) 2024-08-20T22:16:08.8688010Z Installing collected packages: ninja 2024-08-20T22:16:08.8768265Z  WARNING: The script ninja is installed in '/var/lib/jenkins/.local/bin' which is not on PATH. 2024-08-20T22:16:08.8769597Z Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. 2024-08-20T22:16:08.9240568Z Successfully installed ninja-1.10.2 2024-08-20T22:16:09.0009834Z + export PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-08-20T22:16:09.0011963Z + PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-08-20T22:16:09.0013545Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *aarch64* ]] 2024-08-20T22:16:09.0014456Z + install_tlparse 2024-08-20T22:16:09.0014863Z + pip_install --user tlparse==0.3.25 2024-08-20T22:16:09.0015430Z + pip install --progress-bar off --user tlparse==0.3.25 2024-08-20T22:16:09.4329301Z Collecting tlparse==0.3.25 2024-08-20T22:16:09.4536307Z Downloading tlparse-0.3.25-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (1.7 kB) 2024-08-20T22:16:09.5103095Z Downloading tlparse-0.3.25-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.2 MB) 2024-08-20T22:16:10.1901879Z Installing collected packages: tlparse 2024-08-20T22:16:10.2704535Z Successfully installed tlparse-0.3.25 2024-08-20T22:16:10.3486400Z ++ python -m site --user-base 2024-08-20T22:16:10.3725538Z + PATH=/var/lib/jenkins/.local/bin:/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-08-20T22:16:10.3727335Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *asan* ]] 2024-08-20T22:16:10.3728044Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *-debug* ]] 2024-08-20T22:16:10.3728703Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *-bazel-* ]] 2024-08-20T22:16:10.3729632Z + echo 'We are not in debug mode: linux-focal-cuda12.1-py3.10-gcc9-sm86. Expect the assertion to pass' 2024-08-20T22:16:10.3730762Z We are not in debug mode: linux-focal-cuda12.1-py3.10-gcc9-sm86. Expect the assertion to pass 2024-08-20T22:16:10.3731454Z + cd test 2024-08-20T22:16:10.3731978Z + python -c 'import torch; torch._C._crash_if_debug_asserts_fail(424242)' 2024-08-20T22:16:12.0037277Z + [[ aot_eager_torchbench == \n\o\g\p\u\_\N\O\_\A\V\X\2 ]] 2024-08-20T22:16:12.0037897Z + [[ aot_eager_torchbench == \n\o\g\p\u\_\A\V\X\5\1\2 ]] 2024-08-20T22:16:12.0039778Z + DYNAMO_BENCHMARK_FLAGS=() 2024-08-20T22:16:12.0040560Z + [[ aot_eager_torchbench == *pr_time_benchmarks* ]] 2024-08-20T22:16:12.0041117Z + [[ aot_eager_torchbench == *dynamo_eager* ]] 2024-08-20T22:16:12.0041613Z + [[ aot_eager_torchbench == *aot_eager* ]] 2024-08-20T22:16:12.0042344Z + DYNAMO_BENCHMARK_FLAGS+=(--backend aot_eager) 2024-08-20T22:16:12.0042941Z + [[ aot_eager_torchbench == *dynamic* ]] 2024-08-20T22:16:12.0043379Z + [[ aot_eager_torchbench == *cpu* ]] 2024-08-20T22:16:12.0043864Z + DYNAMO_BENCHMARK_FLAGS+=(--device cuda) 2024-08-20T22:16:12.0073495Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *libtorch* ]] 2024-08-20T22:16:12.0074181Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *-bazel-* ]] 2024-08-20T22:16:12.0076513Z + cd test 2024-08-20T22:16:12.0076999Z + python -c 'import torch; print(torch.__config__.show())' 2024-08-20T22:16:13.4696493Z PyTorch built with: 2024-08-20T22:16:13.4697195Z - GCC 9.4 2024-08-20T22:16:13.4697537Z - C++ Version: 201703 2024-08-20T22:16:13.4698398Z - Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications 2024-08-20T22:16:13.4699482Z - Intel(R) MKL-DNN v3.4.2 (Git Hash 1137e04ec0b5251ca2b4400a4fd3c667ce843d67) 2024-08-20T22:16:13.4700178Z - OpenMP 201511 (a.k.a. OpenMP 4.5) 2024-08-20T22:16:13.4700708Z - LAPACK is enabled (usually provided by MKL) 2024-08-20T22:16:13.4701188Z - NNPACK is enabled 2024-08-20T22:16:13.4701589Z - CPU capability usage: AVX2 2024-08-20T22:16:13.4702003Z - CUDA Runtime 12.1 2024-08-20T22:16:13.4702530Z - NVCC architecture flags: -gencode;arch=compute_86,code=sm_86 2024-08-20T22:16:13.4703133Z - CuDNN 90.1 (built against CUDA 12.4) 2024-08-20T22:16:13.4703791Z - Magma 2.6.1 2024-08-20T22:16:13.4711344Z - Build settings: BLAS_INFO=mkl, BUILD_TYPE=Release, CUDA_VERSION=12.1, CUDNN_VERSION=9.1.0, CXX_COMPILER=/opt/cache/bin/c++, CXX_FLAGS= -D_GLIBCXX_USE_CXX11_ABI=1 -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOROCTRACER -DLIBKINETO_NOXPUPTI=ON -DUSE_FBGEMM -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -O2 -fPIC -Wall -Wextra -Werror=return-type -Werror=non-virtual-dtor -Werror=bool-operation -Wnarrowing -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-unused-parameter -Wno-strict-overflow -Wno-strict-aliasing -Wno-stringop-overflow -Wsuggest-override -Wno-psabi -Wno-error=old-style-cast -Wno-missing-braces -fdiagnostics-color=always -faligned-new -Werror -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Wno-stringop-overflow, FORCE_FALLBACK_CUDA_MPI=1, LAPACK_INFO=mkl, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, PERF_WITH_AVX512=1, TORCH_VERSION=2.5.0, USE_CUDA=ON, USE_CUDNN=ON, USE_CUSPARSELT=ON, USE_EXCEPTION_PTR=1, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_GLOO=ON, USE_MKL=ON, USE_MKLDNN=ON, USE_MPI=ON, USE_NCCL=ON, USE_NNPACK=ON, USE_OPENMP=ON, USE_ROCM=OFF, USE_ROCM_KERNEL_ASSERT=OFF, 2024-08-20T22:16:13.4717840Z 2024-08-20T22:16:13.7957331Z + cd test 2024-08-20T22:16:13.7958061Z + python -c 'import torch; print(torch.__config__.parallel_info())' 2024-08-20T22:16:15.1690633Z ATen/Parallel: 2024-08-20T22:16:15.1691485Z at::get_num_threads() : 8 2024-08-20T22:16:15.1692519Z at::get_num_interop_threads() : 16 2024-08-20T22:16:15.1693512Z OpenMP 201511 (a.k.a. OpenMP 4.5) 2024-08-20T22:16:15.1694294Z omp_get_max_threads() : 8 2024-08-20T22:16:15.1696208Z Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications 2024-08-20T22:16:15.1697212Z mkl_get_max_threads() : 8 2024-08-20T22:16:15.1697832Z Intel(R) MKL-DNN v3.4.2 (Git Hash 1137e04ec0b5251ca2b4400a4fd3c667ce843d67) 2024-08-20T22:16:15.1698465Z std::thread::hardware_concurrency() : 16 2024-08-20T22:16:15.1698897Z Environment variables: 2024-08-20T22:16:15.1699265Z OMP_NUM_THREADS : [not set] 2024-08-20T22:16:15.1699630Z MKL_NUM_THREADS : [not set] 2024-08-20T22:16:15.1700003Z ATen parallel backend: OpenMP 2024-08-20T22:16:15.1700254Z 2024-08-20T22:16:15.4439119Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *aarch64* ]] 2024-08-20T22:16:15.4439855Z + [[ aot_eager_torchbench == *backward* ]] 2024-08-20T22:16:15.4440495Z + [[ aot_eager_torchbench == *xla* ]] 2024-08-20T22:16:15.4440995Z + [[ aot_eager_torchbench == *executorch* ]] 2024-08-20T22:16:15.4441485Z + [[ aot_eager_torchbench == \j\i\t\_\l\e\g\a\c\y ]] 2024-08-20T22:16:15.4442141Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *libtorch* ]] 2024-08-20T22:16:15.4442682Z + [[ aot_eager_torchbench == distributed ]] 2024-08-20T22:16:15.4443285Z + [[ aot_eager_torchbench == *inductor_distributed* ]] 2024-08-20T22:16:15.4443859Z + [[ aot_eager_torchbench == *inductor-halide* ]] 2024-08-20T22:16:15.4444479Z + [[ aot_eager_torchbench == *inductor-micro-benchmark* ]] 2024-08-20T22:16:15.4445357Z + [[ aot_eager_torchbench == *huggingface* ]] 2024-08-20T22:16:15.4445813Z + [[ aot_eager_torchbench == *timm* ]] 2024-08-20T22:16:15.4446254Z + [[ aot_eager_torchbench == *torchbench* ]] 2024-08-20T22:16:15.4446735Z + [[ aot_eager_torchbench == *cpu* ]] 2024-08-20T22:16:15.4447175Z + install_torchaudio cuda 2024-08-20T22:16:15.4447515Z + local commit 2024-08-20T22:16:15.4447821Z ++ get_pinned_commit audio 2024-08-20T22:16:15.4448195Z ++ cat .github/ci_commit_pins/audio.txt 2024-08-20T22:16:15.4464903Z + commit=b3f6f511f2a1082bd56b13a3f6794e7fc3ba4862 2024-08-20T22:16:15.4465366Z + [[ cuda == \c\u\d\a ]] 2024-08-20T22:16:15.4465790Z + TORCH_CUDA_ARCH_LIST='8.0;8.6' 2024-08-20T22:16:15.4466759Z + pip_install --no-use-pep517 --user git+https://github.com/pytorch/audio.git@b3f6f511f2a1082bd56b13a3f6794e7fc3ba4862 2024-08-20T22:16:15.4468189Z + pip install --progress-bar off --no-use-pep517 --user git+https://github.com/pytorch/audio.git@b3f6f511f2a1082bd56b13a3f6794e7fc3ba4862 2024-08-20T22:16:15.7826180Z Collecting git+https://github.com/pytorch/audio.git@b3f6f511f2a1082bd56b13a3f6794e7fc3ba4862 2024-08-20T22:16:15.7831272Z Cloning https://github.com/pytorch/audio.git (to revision b3f6f511f2a1082bd56b13a3f6794e7fc3ba4862) to /tmp/pip-req-build-cqmvc8eo 2024-08-20T22:16:15.7862334Z Running command git clone --filter=blob:none --quiet https://github.com/pytorch/audio.git /tmp/pip-req-build-cqmvc8eo 2024-08-20T22:16:16.5582995Z Running command git rev-parse -q --verify 'sha^b3f6f511f2a1082bd56b13a3f6794e7fc3ba4862' 2024-08-20T22:16:16.5609579Z Running command git fetch -q https://github.com/pytorch/audio.git b3f6f511f2a1082bd56b13a3f6794e7fc3ba4862 2024-08-20T22:16:16.9713179Z Resolved https://github.com/pytorch/audio.git to commit b3f6f511f2a1082bd56b13a3f6794e7fc3ba4862 2024-08-20T22:16:16.9714301Z Running command git submodule update --init --recursive -q 2024-08-20T22:16:19.4024329Z Preparing metadata (setup.py) ... [?25l- done 2024-08-20T22:16:19.4052300Z [?25hRequirement already satisfied: torch in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchaudio==2.4.0a0+b3f6f51) (2.5.0a0+git40ec5f6) 2024-08-20T22:16:19.4079522Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchaudio==2.4.0a0+b3f6f51) (3.13.1) 2024-08-20T22:16:19.4083168Z Requirement already satisfied: typing-extensions>=4.8.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchaudio==2.4.0a0+b3f6f51) (4.12.2) 2024-08-20T22:16:19.4086152Z Requirement already satisfied: networkx in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchaudio==2.4.0a0+b3f6f51) (2.8.8) 2024-08-20T22:16:19.4089006Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchaudio==2.4.0a0+b3f6f51) (3.1.4) 2024-08-20T22:16:19.4091908Z Requirement already satisfied: fsspec in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchaudio==2.4.0a0+b3f6f51) (2024.6.1) 2024-08-20T22:16:19.4096722Z Requirement already satisfied: sympy==1.13.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchaudio==2.4.0a0+b3f6f51) (1.13.1) 2024-08-20T22:16:19.4110593Z Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from sympy==1.13.1->torch->torchaudio==2.4.0a0+b3f6f51) (1.3.0) 2024-08-20T22:16:19.4585560Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from jinja2->torch->torchaudio==2.4.0a0+b3f6f51) (2.1.5) 2024-08-20T22:16:19.4648075Z Building wheels for collected packages: torchaudio 2024-08-20T22:18:52.4669182Z Building wheel for torchaudio (setup.py) ... [?25l- \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / done 2024-08-20T22:18:52.4704306Z [?25h Created wheel for torchaudio: filename=torchaudio-2.4.0a0+b3f6f51-cp310-cp310-linux_x86_64.whl size=2310393 sha256=7fa52833999adfdd85f82f5ca31345e5bf3791f42fd4f8d172d2f20587195d01 2024-08-20T22:18:52.4705960Z Stored in directory: /var/lib/jenkins/.cache/pip/wheels/b5/02/94/08dddd0295a3ebec4d4a4d9f226adfd865d48fb8ae4af2cc95 2024-08-20T22:18:52.4734873Z Successfully built torchaudio 2024-08-20T22:18:52.9687230Z Installing collected packages: torchaudio 2024-08-20T22:18:53.1816965Z Successfully installed torchaudio-2.4.0a0+b3f6f51 2024-08-20T22:18:53.3636992Z + install_torchtext 2024-08-20T22:18:53.3637375Z + local data_commit 2024-08-20T22:18:53.3637693Z + local text_commit 2024-08-20T22:18:53.3642154Z ++ get_pinned_commit data 2024-08-20T22:18:53.3642721Z ++ cat .github/ci_commit_pins/data.txt 2024-08-20T22:18:53.3664332Z + data_commit=11bb5b847ea8b9e0d9bb82db3304daf383008d3f 2024-08-20T22:18:53.3667727Z ++ get_pinned_commit text 2024-08-20T22:18:53.3668175Z ++ cat .github/ci_commit_pins/text.txt 2024-08-20T22:18:53.3683988Z + text_commit=b0ebddc648d279826089db91775375221777a2db 2024-08-20T22:18:53.3685379Z + pip_install --no-use-pep517 --user git+https://github.com/pytorch/data.git@11bb5b847ea8b9e0d9bb82db3304daf383008d3f 2024-08-20T22:18:53.3687121Z + pip install --progress-bar off --no-use-pep517 --user git+https://github.com/pytorch/data.git@11bb5b847ea8b9e0d9bb82db3304daf383008d3f 2024-08-20T22:18:53.7056887Z Collecting git+https://github.com/pytorch/data.git@11bb5b847ea8b9e0d9bb82db3304daf383008d3f 2024-08-20T22:18:53.7062764Z Cloning https://github.com/pytorch/data.git (to revision 11bb5b847ea8b9e0d9bb82db3304daf383008d3f) to /tmp/pip-req-build-dqd8rxbp 2024-08-20T22:18:53.7103615Z Running command git clone --filter=blob:none --quiet https://github.com/pytorch/data.git /tmp/pip-req-build-dqd8rxbp 2024-08-20T22:18:54.1522790Z Running command git rev-parse -q --verify 'sha^11bb5b847ea8b9e0d9bb82db3304daf383008d3f' 2024-08-20T22:18:54.1554397Z Running command git fetch -q https://github.com/pytorch/data.git 11bb5b847ea8b9e0d9bb82db3304daf383008d3f 2024-08-20T22:18:54.4159601Z Running command git checkout -q 11bb5b847ea8b9e0d9bb82db3304daf383008d3f 2024-08-20T22:18:54.5692162Z Resolved https://github.com/pytorch/data.git to commit 11bb5b847ea8b9e0d9bb82db3304daf383008d3f 2024-08-20T22:18:54.5693381Z Running command git submodule update --init --recursive -q 2024-08-20T22:20:14.3525708Z Preparing metadata (setup.py) ... [?25l- done 2024-08-20T22:20:14.3562234Z [?25hRequirement already satisfied: urllib3>=1.25 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchdata==0.7.0a0+11bb5b8) (1.26.19) 2024-08-20T22:20:14.3565169Z Requirement already satisfied: requests in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchdata==0.7.0a0+11bb5b8) (2.32.3) 2024-08-20T22:20:14.3569718Z Requirement already satisfied: torch>2.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchdata==0.7.0a0+11bb5b8) (2.5.0a0+git40ec5f6) 2024-08-20T22:20:14.3600970Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch>2.0->torchdata==0.7.0a0+11bb5b8) (3.13.1) 2024-08-20T22:20:14.3604612Z Requirement already satisfied: typing-extensions>=4.8.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch>2.0->torchdata==0.7.0a0+11bb5b8) (4.12.2) 2024-08-20T22:20:14.3607854Z Requirement already satisfied: networkx in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch>2.0->torchdata==0.7.0a0+11bb5b8) (2.8.8) 2024-08-20T22:20:14.3611032Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch>2.0->torchdata==0.7.0a0+11bb5b8) (3.1.4) 2024-08-20T22:20:14.3614467Z Requirement already satisfied: fsspec in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch>2.0->torchdata==0.7.0a0+11bb5b8) (2024.6.1) 2024-08-20T22:20:14.3619860Z Requirement already satisfied: sympy==1.13.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch>2.0->torchdata==0.7.0a0+11bb5b8) (1.13.1) 2024-08-20T22:20:14.3634275Z Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from sympy==1.13.1->torch>2.0->torchdata==0.7.0a0+11bb5b8) (1.3.0) 2024-08-20T22:20:14.3694778Z Requirement already satisfied: charset-normalizer<4,>=2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from requests->torchdata==0.7.0a0+11bb5b8) (3.3.2) 2024-08-20T22:20:14.3698022Z Requirement already satisfied: idna<4,>=2.5 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from requests->torchdata==0.7.0a0+11bb5b8) (3.7) 2024-08-20T22:20:14.3703173Z Requirement already satisfied: certifi>=2017.4.17 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from requests->torchdata==0.7.0a0+11bb5b8) (2024.7.4) 2024-08-20T22:20:14.4200047Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from jinja2->torch>2.0->torchdata==0.7.0a0+11bb5b8) (2.1.5) 2024-08-20T22:20:14.4265515Z Building wheels for collected packages: torchdata 2024-08-20T22:20:16.3634053Z Building wheel for torchdata (setup.py) ... [?25l- \ | done 2024-08-20T22:20:16.3642924Z [?25h Created wheel for torchdata: filename=torchdata-0.7.0a0+11bb5b8-py3-none-any.whl size=182970 sha256=5ef1017747a483cd33efca643fe9dfc885733ba306af7aa707b07260e3cc438c 2024-08-20T22:20:16.3644653Z Stored in directory: /var/lib/jenkins/.cache/pip/wheels/ca/59/a3/c8250bfc8d3d4d639498d4beb2e0f0e70b9a508ac61fde85ce 2024-08-20T22:20:16.3672059Z Successfully built torchdata 2024-08-20T22:20:16.8500663Z Installing collected packages: torchdata 2024-08-20T22:20:16.9457157Z Successfully installed torchdata-0.7.0a0+11bb5b8 2024-08-20T22:20:21.9416095Z + pip_install --no-use-pep517 --user git+https://github.com/pytorch/text.git@b0ebddc648d279826089db91775375221777a2db 2024-08-20T22:20:21.9417612Z + pip install --progress-bar off --no-use-pep517 --user git+https://github.com/pytorch/text.git@b0ebddc648d279826089db91775375221777a2db 2024-08-20T22:20:22.2878968Z Collecting git+https://github.com/pytorch/text.git@b0ebddc648d279826089db91775375221777a2db 2024-08-20T22:20:22.2883390Z Cloning https://github.com/pytorch/text.git (to revision b0ebddc648d279826089db91775375221777a2db) to /tmp/pip-req-build-ziuqzrxb 2024-08-20T22:20:22.2914609Z Running command git clone --filter=blob:none --quiet https://github.com/pytorch/text.git /tmp/pip-req-build-ziuqzrxb 2024-08-20T22:20:23.2741220Z Running command git rev-parse -q --verify 'sha^b0ebddc648d279826089db91775375221777a2db' 2024-08-20T22:20:23.2770014Z Running command git fetch -q https://github.com/pytorch/text.git b0ebddc648d279826089db91775375221777a2db 2024-08-20T22:20:23.7720095Z Running command git checkout -q b0ebddc648d279826089db91775375221777a2db 2024-08-20T22:20:23.9430408Z Resolved https://github.com/pytorch/text.git to commit b0ebddc648d279826089db91775375221777a2db 2024-08-20T22:20:23.9431544Z Running command git submodule update --init --recursive -q 2024-08-20T22:20:31.3609446Z Preparing metadata (setup.py) ... [?25l- done 2024-08-20T22:20:31.3642773Z [?25hRequirement already satisfied: tqdm in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchtext==0.16.0a0+b0ebddc) (4.66.5) 2024-08-20T22:20:31.3645902Z Requirement already satisfied: requests in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchtext==0.16.0a0+b0ebddc) (2.32.3) 2024-08-20T22:20:31.3649192Z Requirement already satisfied: torch in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchtext==0.16.0a0+b0ebddc) (2.5.0a0+git40ec5f6) 2024-08-20T22:20:31.3651920Z Requirement already satisfied: numpy in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchtext==0.16.0a0+b0ebddc) (1.22.4) 2024-08-20T22:20:31.3655637Z Requirement already satisfied: torchdata in /var/lib/jenkins/.local/lib/python3.10/site-packages (from torchtext==0.16.0a0+b0ebddc) (0.7.0a0+11bb5b8) 2024-08-20T22:20:31.3681356Z Requirement already satisfied: charset-normalizer<4,>=2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from requests->torchtext==0.16.0a0+b0ebddc) (3.3.2) 2024-08-20T22:20:31.3685049Z Requirement already satisfied: idna<4,>=2.5 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from requests->torchtext==0.16.0a0+b0ebddc) (3.7) 2024-08-20T22:20:31.3689009Z Requirement already satisfied: urllib3<3,>=1.21.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from requests->torchtext==0.16.0a0+b0ebddc) (1.26.19) 2024-08-20T22:20:31.3692579Z Requirement already satisfied: certifi>=2017.4.17 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from requests->torchtext==0.16.0a0+b0ebddc) (2024.7.4) 2024-08-20T22:20:31.3719047Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchtext==0.16.0a0+b0ebddc) (3.13.1) 2024-08-20T22:20:31.3722572Z Requirement already satisfied: typing-extensions>=4.8.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchtext==0.16.0a0+b0ebddc) (4.12.2) 2024-08-20T22:20:31.3725259Z Requirement already satisfied: networkx in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchtext==0.16.0a0+b0ebddc) (2.8.8) 2024-08-20T22:20:31.3729237Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchtext==0.16.0a0+b0ebddc) (3.1.4) 2024-08-20T22:20:31.3731652Z Requirement already satisfied: fsspec in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchtext==0.16.0a0+b0ebddc) (2024.6.1) 2024-08-20T22:20:31.3736888Z Requirement already satisfied: sympy==1.13.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchtext==0.16.0a0+b0ebddc) (1.13.1) 2024-08-20T22:20:31.3751525Z Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from sympy==1.13.1->torch->torchtext==0.16.0a0+b0ebddc) (1.3.0) 2024-08-20T22:20:31.4322686Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from jinja2->torch->torchtext==0.16.0a0+b0ebddc) (2.1.5) 2024-08-20T22:20:31.4389531Z Building wheels for collected packages: torchtext 2024-08-20T22:21:09.9148217Z Building wheel for torchtext (setup.py) ... [?25l- \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ done 2024-08-20T22:21:09.9180390Z [?25h Created wheel for torchtext: filename=torchtext-0.16.0a0+b0ebddc-cp310-cp310-linux_x86_64.whl size=2045465 sha256=50f90a4bc3d5b1504a6a27ee932d90f3a01ea3ec4d03a334dad7398d0cb85ba1 2024-08-20T22:21:09.9183763Z Stored in directory: /var/lib/jenkins/.cache/pip/wheels/e5/3d/d7/faafad098ec9437ecdf4495c0f5e72b817fffbb06063e32cbf 2024-08-20T22:21:09.9207654Z Successfully built torchtext 2024-08-20T22:21:10.4027564Z Installing collected packages: torchtext 2024-08-20T22:21:10.5178752Z Successfully installed torchtext-0.16.0a0+b0ebddc 2024-08-20T22:21:10.6780276Z + install_torchvision 2024-08-20T22:21:10.6780718Z + local orig_preload 2024-08-20T22:21:10.6781043Z + local commit 2024-08-20T22:21:10.6784078Z ++ get_pinned_commit vision 2024-08-20T22:21:10.6784552Z ++ cat .github/ci_commit_pins/vision.txt 2024-08-20T22:21:10.6800315Z + commit=d23a6e1664d20707c11781299611436e1f0c104f 2024-08-20T22:21:10.6800866Z + orig_preload= 2024-08-20T22:21:10.6801396Z + '[' -n '' ']' 2024-08-20T22:21:10.6802324Z + pip_install --no-use-pep517 --user git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2024-08-20T22:21:10.6803977Z + pip install --progress-bar off --no-use-pep517 --user git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2024-08-20T22:21:11.0157921Z Collecting git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2024-08-20T22:21:11.0162901Z Cloning https://github.com/pytorch/vision.git (to revision d23a6e1664d20707c11781299611436e1f0c104f) to /tmp/pip-req-build-7xmn0mek 2024-08-20T22:21:11.0192950Z Running command git clone --filter=blob:none --quiet https://github.com/pytorch/vision.git /tmp/pip-req-build-7xmn0mek 2024-08-20T22:21:12.6362604Z Running command git rev-parse -q --verify 'sha^d23a6e1664d20707c11781299611436e1f0c104f' 2024-08-20T22:21:12.6390659Z Running command git fetch -q https://github.com/pytorch/vision.git d23a6e1664d20707c11781299611436e1f0c104f 2024-08-20T22:21:13.9698779Z Running command git checkout -q d23a6e1664d20707c11781299611436e1f0c104f 2024-08-20T22:21:14.2657929Z Resolved https://github.com/pytorch/vision.git to commit d23a6e1664d20707c11781299611436e1f0c104f 2024-08-20T22:21:16.7909666Z Preparing metadata (setup.py) ... [?25l- \ done 2024-08-20T22:21:16.7942286Z [?25hRequirement already satisfied: numpy in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (1.22.4) 2024-08-20T22:21:16.7946170Z Requirement already satisfied: torch in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (2.5.0a0+git40ec5f6) 2024-08-20T22:21:16.7951239Z Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (10.3.0) 2024-08-20T22:21:16.8020443Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (3.13.1) 2024-08-20T22:21:16.8024803Z Requirement already satisfied: typing-extensions>=4.8.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (4.12.2) 2024-08-20T22:21:16.8027423Z Requirement already satisfied: networkx in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (2.8.8) 2024-08-20T22:21:16.8030638Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (3.1.4) 2024-08-20T22:21:16.8033159Z Requirement already satisfied: fsspec in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (2024.6.1) 2024-08-20T22:21:16.8038460Z Requirement already satisfied: sympy==1.13.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (1.13.1) 2024-08-20T22:21:16.8053095Z Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from sympy==1.13.1->torch->torchvision==0.19.0a0+d23a6e1) (1.3.0) 2024-08-20T22:21:16.8529227Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from jinja2->torch->torchvision==0.19.0a0+d23a6e1) (2.1.5) 2024-08-20T22:21:16.8592014Z Building wheels for collected packages: torchvision 2024-08-20T22:22:31.8184385Z Building wheel for torchvision (setup.py) ... [?25l- \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ done 2024-08-20T22:22:31.8217670Z [?25h Created wheel for torchvision: filename=torchvision-0.19.0a0+d23a6e1-cp310-cp310-linux_x86_64.whl size=2116181 sha256=7601f0953b78377858c30780efe3beb1f1af550b62e44be3a6e0c92610a8579d 2024-08-20T22:22:31.8220159Z Stored in directory: /var/lib/jenkins/.cache/pip/wheels/0e/56/35/02931e71eb23fd2b85591c7ec05b733ca7c8b328a2fd151f96 2024-08-20T22:22:31.8253301Z Successfully built torchvision 2024-08-20T22:22:32.3114589Z Installing collected packages: torchvision 2024-08-20T22:22:32.7244159Z Successfully installed torchvision-0.19.0a0+d23a6e1 2024-08-20T22:22:32.8691026Z + '[' -n '' ']' 2024-08-20T22:22:32.8692974Z + TORCH_CUDA_ARCH_LIST='8.0;8.6' 2024-08-20T22:22:32.8693627Z + pip_install git+https://github.com/pytorch/ao.git 2024-08-20T22:22:32.8694368Z + pip install --progress-bar off git+https://github.com/pytorch/ao.git 2024-08-20T22:22:33.2070056Z Collecting git+https://github.com/pytorch/ao.git 2024-08-20T22:22:33.2075957Z Cloning https://github.com/pytorch/ao.git to /tmp/pip-req-build-7w6sgx27 2024-08-20T22:22:33.2104441Z Running command git clone --filter=blob:none --quiet https://github.com/pytorch/ao.git /tmp/pip-req-build-7w6sgx27 2024-08-20T22:22:33.7967162Z Resolved https://github.com/pytorch/ao.git to commit 2c8e3f368613f896fde14cc24b9268c9e125575e 2024-08-20T22:22:36.2509098Z Preparing metadata (setup.py) ... [?25l- done 2024-08-20T22:22:36.2544841Z [?25hBuilding wheels for collected packages: torchao 2024-08-20T22:23:54.4324800Z Building wheel for torchao (setup.py) ... [?25l- \ | / - \ | / done 2024-08-20T22:23:54.4341894Z [?25h Created wheel for torchao: filename=torchao-0.4.0+git2c8e3f3-cp310-cp310-linux_x86_64.whl size=928019 sha256=f2c900af0b213b0a935ac0e13dfbea8e6001b8a69b5203c17312e60df23ffaee 2024-08-20T22:23:54.4344993Z Stored in directory: /tmp/pip-ephem-wheel-cache-xk3fpu97/wheels/c0/df/d8/b1e2f5f1ea3bf141268a83a667137647b234f04c636e1e7a5e 2024-08-20T22:23:54.4375308Z Successfully built torchao 2024-08-20T22:23:54.9993872Z Installing collected packages: torchao 2024-08-20T22:23:55.2408892Z Successfully installed torchao-0.4.0+git2c8e3f3 2024-08-20T22:23:55.3471303Z + id=0 2024-08-20T22:23:55.3474305Z + pip_install opencv-python==4.8.0.74 2024-08-20T22:23:55.3475067Z + pip install --progress-bar off opencv-python==4.8.0.74 2024-08-20T22:23:55.8245928Z Collecting opencv-python==4.8.0.74 2024-08-20T22:23:55.8451754Z Downloading opencv_python-4.8.0.74-cp37-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (19 kB) 2024-08-20T22:23:55.8533159Z Requirement already satisfied: numpy>=1.21.2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from opencv-python==4.8.0.74) (1.22.4) 2024-08-20T22:23:55.8615452Z Downloading opencv_python-4.8.0.74-cp37-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (61.7 MB) 2024-08-20T22:23:57.0374682Z Installing collected packages: opencv-python 2024-08-20T22:23:57.8963939Z Successfully installed opencv-python-4.8.0.74 2024-08-20T22:23:57.9924879Z + [[ aot_eager_torchbench == *inductor_torchbench_smoketest_perf* ]] 2024-08-20T22:23:57.9925986Z + [[ aot_eager_torchbench == *inductor_torchbench_cpu_smoketest_perf* ]] 2024-08-20T22:23:57.9929217Z + [[ aot_eager_torchbench == *torchbench_gcp_smoketest* ]] 2024-08-20T22:23:57.9930006Z + checkout_install_torchbench 2024-08-20T22:23:57.9930492Z + local commit 2024-08-20T22:23:57.9956693Z ++ get_pinned_commit torchbench 2024-08-20T22:23:57.9957143Z ++ cat .github/ci_commit_pins/torchbench.txt 2024-08-20T22:23:57.9957661Z + commit=23512dbebd44a11eb84afbf53c3c071dd105297e 2024-08-20T22:23:57.9958242Z + git clone https://github.com/pytorch/benchmark torchbench 2024-08-20T22:23:57.9964430Z Cloning into 'torchbench'... 2024-08-20T22:23:58.1301905Z remote: Enumerating objects: 31001, done. 2024-08-20T22:23:58.1304337Z remote: Counting objects: 0% (1/1741) 2024-08-20T22:23:58.1306696Z remote: Counting objects: 1% (18/1741) 2024-08-20T22:23:58.1309814Z remote: Counting objects: 2% (35/1741) 2024-08-20T22:23:58.1310459Z remote: Counting objects: 3% (53/1741) 2024-08-20T22:23:58.1311220Z remote: Counting objects: 4% (70/1741) 2024-08-20T22:23:58.1312045Z remote: Counting objects: 5% (88/1741) 2024-08-20T22:23:58.1312636Z remote: Counting objects: 6% (105/1741) 2024-08-20T22:23:58.1313246Z remote: Counting objects: 7% (122/1741) 2024-08-20T22:23:58.1313881Z remote: Counting objects: 8% (140/1741) 2024-08-20T22:23:58.1318572Z remote: Counting objects: 9% (157/1741) 2024-08-20T22:23:58.1319278Z remote: Counting objects: 10% (175/1741) 2024-08-20T22:23:58.1319990Z remote: Counting objects: 11% (192/1741) 2024-08-20T22:23:58.1320693Z remote: Counting objects: 12% (209/1741) 2024-08-20T22:23:58.1321226Z remote: Counting objects: 13% (227/1741) 2024-08-20T22:23:58.1321919Z remote: Counting objects: 14% (244/1741) 2024-08-20T22:23:58.1323055Z remote: Counting objects: 15% (262/1741) 2024-08-20T22:23:58.1323675Z remote: Counting objects: 16% (279/1741) 2024-08-20T22:23:58.1324419Z remote: Counting objects: 17% (296/1741) 2024-08-20T22:23:58.1325110Z remote: Counting objects: 18% (314/1741) 2024-08-20T22:23:58.1325777Z remote: Counting objects: 19% (331/1741) 2024-08-20T22:23:58.1326383Z remote: Counting objects: 20% (349/1741) 2024-08-20T22:23:58.1326913Z remote: Counting objects: 21% (366/1741) 2024-08-20T22:23:58.1327439Z remote: Counting objects: 22% (384/1741) 2024-08-20T22:23:58.1327956Z remote: Counting objects: 23% (401/1741) 2024-08-20T22:23:58.1328480Z remote: Counting objects: 24% (418/1741) 2024-08-20T22:23:58.1329000Z remote: Counting objects: 25% (436/1741) 2024-08-20T22:23:58.1329524Z remote: Counting objects: 26% (453/1741) 2024-08-20T22:23:58.1330040Z remote: Counting objects: 27% (471/1741) 2024-08-20T22:23:58.1330563Z remote: Counting objects: 28% (488/1741) 2024-08-20T22:23:58.1331093Z remote: Counting objects: 29% (505/1741) 2024-08-20T22:23:58.1331620Z remote: Counting objects: 30% (523/1741) 2024-08-20T22:23:58.1332133Z remote: Counting objects: 31% (540/1741) 2024-08-20T22:23:58.1332661Z remote: Counting objects: 32% (558/1741) 2024-08-20T22:23:58.1333184Z remote: Counting objects: 33% (575/1741) 2024-08-20T22:23:58.1333927Z remote: Counting objects: 34% (592/1741) 2024-08-20T22:23:58.1334466Z remote: Counting objects: 35% (610/1741) 2024-08-20T22:23:58.1334995Z remote: Counting objects: 36% (627/1741) 2024-08-20T22:23:58.1335520Z remote: Counting objects: 37% (645/1741) 2024-08-20T22:23:58.1336039Z remote: Counting objects: 38% (662/1741) 2024-08-20T22:23:58.1336554Z remote: Counting objects: 39% (679/1741) 2024-08-20T22:23:58.1337077Z remote: Counting objects: 40% (697/1741) 2024-08-20T22:23:58.1337600Z remote: Counting objects: 41% (714/1741) 2024-08-20T22:23:58.1338127Z remote: Counting objects: 42% (732/1741) 2024-08-20T22:23:58.1338652Z remote: Counting objects: 43% (749/1741) 2024-08-20T22:23:58.1339173Z remote: Counting objects: 44% (767/1741) 2024-08-20T22:23:58.1339693Z remote: Counting objects: 45% (784/1741) 2024-08-20T22:23:58.1340205Z remote: Counting objects: 46% (801/1741) 2024-08-20T22:23:58.1340726Z remote: Counting objects: 47% (819/1741) 2024-08-20T22:23:58.1341253Z remote: Counting objects: 48% (836/1741) 2024-08-20T22:23:58.1341774Z remote: Counting objects: 49% (854/1741) 2024-08-20T22:23:58.1342285Z remote: Counting objects: 50% (871/1741) 2024-08-20T22:23:58.1342807Z remote: Counting objects: 51% (888/1741) 2024-08-20T22:23:58.1343335Z remote: Counting objects: 52% (906/1741) 2024-08-20T22:23:58.1343855Z remote: Counting objects: 53% (923/1741) 2024-08-20T22:23:58.1344370Z remote: Counting objects: 54% (941/1741) 2024-08-20T22:23:58.1344890Z remote: Counting objects: 55% (958/1741) 2024-08-20T22:23:58.1345423Z remote: Counting objects: 56% (975/1741) 2024-08-20T22:23:58.1345946Z remote: Counting objects: 57% (993/1741) 2024-08-20T22:23:58.1346503Z remote: Counting objects: 58% (1010/1741) 2024-08-20T22:23:58.1347059Z remote: Counting objects: 59% (1028/1741) 2024-08-20T22:23:58.1347596Z remote: Counting objects: 60% (1045/1741) 2024-08-20T22:23:58.1348129Z remote: Counting objects: 61% (1063/1741) 2024-08-20T22:23:58.1348666Z remote: Counting objects: 62% (1080/1741) 2024-08-20T22:23:58.1349190Z remote: Counting objects: 63% (1097/1741) 2024-08-20T22:23:58.1349713Z remote: Counting objects: 64% (1115/1741) 2024-08-20T22:23:58.1350628Z remote: Counting objects: 65% (1132/1741) 2024-08-20T22:23:58.1351156Z remote: Counting objects: 66% (1150/1741) 2024-08-20T22:23:58.1351680Z remote: Counting objects: 67% (1167/1741) 2024-08-20T22:23:58.1352207Z remote: Counting objects: 68% (1184/1741) 2024-08-20T22:23:58.1352728Z remote: Counting objects: 69% (1202/1741) 2024-08-20T22:23:58.1353413Z remote: Counting objects: 70% (1219/1741) 2024-08-20T22:23:58.1353933Z remote: Counting objects: 71% (1237/1741) 2024-08-20T22:23:58.1354460Z remote: Counting objects: 72% (1254/1741) 2024-08-20T22:23:58.1354995Z remote: Counting objects: 73% (1271/1741) 2024-08-20T22:23:58.1355516Z remote: Counting objects: 74% (1289/1741) 2024-08-20T22:23:58.1356040Z remote: Counting objects: 75% (1306/1741) 2024-08-20T22:23:58.1356564Z remote: Counting objects: 76% (1324/1741) 2024-08-20T22:23:58.1357078Z remote: Counting objects: 77% (1341/1741) 2024-08-20T22:23:58.1357599Z remote: Counting objects: 78% (1358/1741) 2024-08-20T22:23:58.1358118Z remote: Counting objects: 79% (1376/1741) 2024-08-20T22:23:58.1358642Z remote: Counting objects: 80% (1393/1741) 2024-08-20T22:23:58.1359157Z remote: Counting objects: 81% (1411/1741) 2024-08-20T22:23:58.1359678Z remote: Counting objects: 82% (1428/1741) 2024-08-20T22:23:58.1360201Z remote: Counting objects: 83% (1446/1741) 2024-08-20T22:23:58.1360728Z remote: Counting objects: 84% (1463/1741) 2024-08-20T22:23:58.1361242Z remote: Counting objects: 85% (1480/1741) 2024-08-20T22:23:58.1361764Z remote: Counting objects: 86% (1498/1741) 2024-08-20T22:23:58.1362285Z remote: Counting objects: 87% (1515/1741) 2024-08-20T22:23:58.1362896Z remote: Counting objects: 88% (1533/1741) 2024-08-20T22:23:58.1363539Z remote: Counting objects: 89% (1550/1741) 2024-08-20T22:23:58.1364068Z remote: Counting objects: 90% (1567/1741) 2024-08-20T22:23:58.1364586Z remote: Counting objects: 91% (1585/1741) 2024-08-20T22:23:58.1365101Z remote: Counting objects: 92% (1602/1741) 2024-08-20T22:23:58.1365623Z remote: Counting objects: 93% (1620/1741) 2024-08-20T22:23:58.1366141Z remote: Counting objects: 94% (1637/1741) 2024-08-20T22:23:58.1366659Z remote: Counting objects: 95% (1654/1741) 2024-08-20T22:23:58.1367172Z remote: Counting objects: 96% (1672/1741) 2024-08-20T22:23:58.1367696Z remote: Counting objects: 97% (1689/1741) 2024-08-20T22:23:58.1368218Z remote: Counting objects: 98% (1707/1741) 2024-08-20T22:23:58.1368736Z remote: Counting objects: 99% (1724/1741) 2024-08-20T22:23:58.1369252Z remote: Counting objects: 100% (1741/1741) 2024-08-20T22:23:58.1369804Z remote: Counting objects: 100% (1741/1741), done. 2024-08-20T22:23:58.1370373Z remote: Compressing objects: 0% (1/898) 2024-08-20T22:23:58.1422311Z remote: Compressing objects: 1% (9/898) 2024-08-20T22:23:58.1543246Z remote: Compressing objects: 2% (18/898) 2024-08-20T22:23:58.1632409Z remote: Compressing objects: 3% (27/898) 2024-08-20T22:23:58.1686593Z remote: Compressing objects: 4% (36/898) 2024-08-20T22:23:58.1739944Z remote: Compressing objects: 5% (45/898) 2024-08-20T22:23:58.1772067Z remote: Compressing objects: 6% (54/898) 2024-08-20T22:23:58.1798976Z remote: Compressing objects: 7% (63/898) 2024-08-20T22:23:58.1838112Z remote: Compressing objects: 8% (72/898) 2024-08-20T22:23:58.1871002Z remote: Compressing objects: 9% (81/898) 2024-08-20T22:23:58.1900075Z remote: Compressing objects: 10% (90/898) 2024-08-20T22:23:58.1913369Z remote: Compressing objects: 11% (99/898) 2024-08-20T22:23:58.1924902Z remote: Compressing objects: 12% (108/898) 2024-08-20T22:23:58.1940941Z remote: Compressing objects: 13% (117/898) 2024-08-20T22:23:58.1957314Z remote: Compressing objects: 14% (126/898) 2024-08-20T22:23:58.1966599Z remote: Compressing objects: 15% (135/898) 2024-08-20T22:23:58.1975245Z remote: Compressing objects: 16% (144/898) 2024-08-20T22:23:58.1981762Z remote: Compressing objects: 17% (153/898) 2024-08-20T22:23:58.1984925Z remote: Compressing objects: 18% (162/898) 2024-08-20T22:23:58.1988023Z remote: Compressing objects: 19% (171/898) 2024-08-20T22:23:58.1990384Z remote: Compressing objects: 20% (180/898) 2024-08-20T22:23:58.1992170Z remote: Compressing objects: 21% (189/898) 2024-08-20T22:23:58.1992928Z remote: Compressing objects: 22% (198/898) 2024-08-20T22:23:58.1995745Z remote: Compressing objects: 23% (207/898) 2024-08-20T22:23:58.1997143Z remote: Compressing objects: 24% (216/898) 2024-08-20T22:23:58.1998015Z remote: Compressing objects: 25% (225/898) 2024-08-20T22:23:58.2002114Z remote: Compressing objects: 26% (234/898) 2024-08-20T22:23:58.2009874Z remote: Compressing objects: 27% (243/898) 2024-08-20T22:23:58.2012859Z remote: Compressing objects: 28% (252/898) 2024-08-20T22:23:58.2017600Z remote: Compressing objects: 29% (261/898) 2024-08-20T22:23:58.2020286Z remote: Compressing objects: 30% (270/898) 2024-08-20T22:23:58.2023994Z remote: Compressing objects: 31% (279/898) 2024-08-20T22:23:58.2026760Z remote: Compressing objects: 32% (288/898) 2024-08-20T22:23:58.2032439Z remote: Compressing objects: 33% (297/898) 2024-08-20T22:23:58.2034543Z remote: Compressing objects: 34% (306/898) 2024-08-20T22:23:58.2037134Z remote: Compressing objects: 35% (315/898) 2024-08-20T22:23:58.2039571Z remote: Compressing objects: 36% (324/898) 2024-08-20T22:23:58.2042870Z remote: Compressing objects: 37% (333/898) 2024-08-20T22:23:58.2044813Z remote: Compressing objects: 38% (342/898) 2024-08-20T22:23:58.2045795Z remote: Compressing objects: 39% (351/898) 2024-08-20T22:23:58.2047948Z remote: Compressing objects: 40% (360/898) 2024-08-20T22:23:58.2051149Z remote: Compressing objects: 41% (369/898) 2024-08-20T22:23:58.2051800Z remote: Compressing objects: 42% (378/898) 2024-08-20T22:23:58.2053013Z remote: Compressing objects: 43% (387/898) 2024-08-20T22:23:58.2053718Z remote: Compressing objects: 44% (396/898) 2024-08-20T22:23:58.2054310Z remote: Compressing objects: 45% (405/898) 2024-08-20T22:23:58.2055291Z remote: Compressing objects: 46% (414/898) 2024-08-20T22:23:58.2056032Z remote: Compressing objects: 47% (423/898) 2024-08-20T22:23:58.2056742Z remote: Compressing objects: 48% (432/898) 2024-08-20T22:23:58.2057293Z remote: Compressing objects: 49% (441/898) 2024-08-20T22:23:58.2057940Z remote: Compressing objects: 50% (449/898) 2024-08-20T22:23:58.2058638Z remote: Compressing objects: 51% (458/898) 2024-08-20T22:23:58.2059337Z remote: Compressing objects: 52% (467/898) 2024-08-20T22:23:58.2060013Z remote: Compressing objects: 53% (476/898) 2024-08-20T22:23:58.2060761Z remote: Compressing objects: 54% (485/898) 2024-08-20T22:23:58.2061337Z remote: Compressing objects: 55% (494/898) 2024-08-20T22:23:58.2062053Z remote: Compressing objects: 56% (503/898) 2024-08-20T22:23:58.2062736Z remote: Compressing objects: 57% (512/898) 2024-08-20T22:23:58.2063274Z remote: Compressing objects: 58% (521/898) 2024-08-20T22:23:58.2063802Z remote: Compressing objects: 59% (530/898) 2024-08-20T22:23:58.2064336Z remote: Compressing objects: 60% (539/898) 2024-08-20T22:23:58.2064872Z remote: Compressing objects: 61% (548/898) 2024-08-20T22:23:58.2065400Z remote: Compressing objects: 62% (557/898) 2024-08-20T22:23:58.2065941Z remote: Compressing objects: 63% (566/898) 2024-08-20T22:23:58.2066477Z remote: Compressing objects: 64% (575/898) 2024-08-20T22:23:58.2067112Z remote: Compressing objects: 65% (584/898) 2024-08-20T22:23:58.2067818Z remote: Compressing objects: 66% (593/898) 2024-08-20T22:23:58.2068386Z remote: Compressing objects: 67% (602/898) 2024-08-20T22:23:58.2068936Z remote: Compressing objects: 68% (611/898) 2024-08-20T22:23:58.2069476Z remote: Compressing objects: 69% (620/898) 2024-08-20T22:23:58.2070003Z remote: Compressing objects: 70% (629/898) 2024-08-20T22:23:58.2070552Z remote: Compressing objects: 71% (638/898) 2024-08-20T22:23:58.2071088Z remote: Compressing objects: 72% (647/898) 2024-08-20T22:23:58.2071624Z remote: Compressing objects: 73% (656/898) 2024-08-20T22:23:58.2072160Z remote: Compressing objects: 74% (665/898) 2024-08-20T22:23:58.2072697Z remote: Compressing objects: 75% (674/898) 2024-08-20T22:23:58.2076179Z remote: Compressing objects: 76% (683/898) 2024-08-20T22:23:58.2083336Z remote: Compressing objects: 77% (692/898) 2024-08-20T22:23:58.2088747Z remote: Compressing objects: 78% (701/898) 2024-08-20T22:23:58.2094468Z remote: Compressing objects: 79% (710/898) 2024-08-20T22:23:58.2101271Z remote: Compressing objects: 80% (719/898) 2024-08-20T22:23:58.2112191Z remote: Compressing objects: 81% (728/898) 2024-08-20T22:23:58.2119378Z remote: Compressing objects: 82% (737/898) 2024-08-20T22:23:58.2123929Z remote: Compressing objects: 83% (746/898) 2024-08-20T22:23:58.2126829Z remote: Compressing objects: 84% (755/898) 2024-08-20T22:23:58.2129228Z remote: Compressing objects: 85% (764/898) 2024-08-20T22:23:58.2133646Z remote: Compressing objects: 86% (773/898) 2024-08-20T22:23:58.2137996Z remote: Compressing objects: 87% (782/898) 2024-08-20T22:23:58.2141833Z remote: Compressing objects: 88% (791/898) 2024-08-20T22:23:58.2146005Z remote: Compressing objects: 89% (800/898) 2024-08-20T22:23:58.2151422Z remote: Compressing objects: 90% (809/898) 2024-08-20T22:23:58.2154158Z remote: Compressing objects: 91% (818/898) 2024-08-20T22:23:58.2155441Z remote: Compressing objects: 92% (827/898) 2024-08-20T22:23:58.2160132Z remote: Compressing objects: 93% (836/898) 2024-08-20T22:23:58.2162359Z remote: Compressing objects: 94% (845/898) 2024-08-20T22:23:58.2165207Z remote: Compressing objects: 95% (854/898) 2024-08-20T22:23:58.2169162Z remote: Compressing objects: 96% (863/898) 2024-08-20T22:23:58.2171947Z remote: Compressing objects: 97% (872/898) 2024-08-20T22:23:58.2172683Z remote: Compressing objects: 98% (881/898) 2024-08-20T22:23:58.2173654Z remote: Compressing objects: 99% (890/898) 2024-08-20T22:23:58.2174395Z remote: Compressing objects: 100% (898/898) 2024-08-20T22:23:58.2174992Z remote: Compressing objects: 100% (898/898), done. 2024-08-20T22:23:58.2252192Z Receiving objects: 0% (1/31001) 2024-08-20T22:23:58.2294637Z Receiving objects: 1% (311/31001) 2024-08-20T22:23:58.2334896Z Receiving objects: 2% (621/31001) 2024-08-20T22:23:58.2373928Z Receiving objects: 3% (931/31001) 2024-08-20T22:23:58.2410357Z Receiving objects: 4% (1241/31001) 2024-08-20T22:23:58.2443242Z Receiving objects: 5% (1551/31001) 2024-08-20T22:23:58.2481337Z Receiving objects: 6% (1861/31001) 2024-08-20T22:23:58.2520422Z Receiving objects: 7% (2171/31001) 2024-08-20T22:23:58.2550911Z Receiving objects: 8% (2481/31001) 2024-08-20T22:23:58.2584211Z Receiving objects: 9% (2791/31001) 2024-08-20T22:23:58.2655027Z Receiving objects: 10% (3101/31001) 2024-08-20T22:23:58.2703140Z Receiving objects: 11% (3411/31001) 2024-08-20T22:23:58.2771346Z Receiving objects: 12% (3721/31001) 2024-08-20T22:23:58.2902032Z Receiving objects: 13% (4031/31001) 2024-08-20T22:23:58.3046860Z Receiving objects: 14% (4341/31001) 2024-08-20T22:23:58.3121430Z Receiving objects: 15% (4651/31001) 2024-08-20T22:23:58.3195567Z Receiving objects: 16% (4961/31001) 2024-08-20T22:23:58.3255510Z Receiving objects: 17% (5271/31001) 2024-08-20T22:23:58.3283680Z Receiving objects: 18% (5581/31001) 2024-08-20T22:23:58.3341792Z Receiving objects: 19% (5891/31001) 2024-08-20T22:23:58.3375922Z Receiving objects: 20% (6201/31001) 2024-08-20T22:23:58.3392140Z Receiving objects: 21% (6511/31001) 2024-08-20T22:23:58.3560486Z Receiving objects: 22% (6821/31001) 2024-08-20T22:23:59.2198527Z Receiving objects: 23% (7131/31001) 2024-08-20T22:23:59.3383666Z Receiving objects: 23% (7377/31001), 75.50 MiB | 75.57 MiB/s 2024-08-20T22:23:59.8901943Z Receiving objects: 24% (7441/31001), 75.50 MiB | 75.57 MiB/s 2024-08-20T22:23:59.9632291Z Receiving objects: 25% (7751/31001), 113.18 MiB | 75.50 MiB/s 2024-08-20T22:24:00.0361349Z Receiving objects: 26% (8061/31001), 113.18 MiB | 75.50 MiB/s 2024-08-20T22:24:00.1079850Z Receiving objects: 27% (8371/31001), 113.18 MiB | 75.50 MiB/s 2024-08-20T22:24:00.1794328Z Receiving objects: 28% (8681/31001), 113.18 MiB | 75.50 MiB/s 2024-08-20T22:24:00.2198576Z Receiving objects: 29% (8991/31001), 113.18 MiB | 75.50 MiB/s 2024-08-20T22:24:00.2521689Z Receiving objects: 29% (9162/31001), 151.20 MiB | 75.64 MiB/s 2024-08-20T22:24:00.3249514Z Receiving objects: 30% (9301/31001), 151.20 MiB | 75.64 MiB/s 2024-08-20T22:24:00.3976806Z Receiving objects: 31% (9611/31001), 151.20 MiB | 75.64 MiB/s 2024-08-20T22:24:00.6319128Z Receiving objects: 32% (9921/31001), 151.20 MiB | 75.64 MiB/s 2024-08-20T22:24:00.7058811Z Receiving objects: 33% (10231/31001), 151.20 MiB | 75.64 MiB/s 2024-08-20T22:24:00.7182952Z Receiving objects: 34% (10541/31001), 151.20 MiB | 75.64 MiB/s 2024-08-20T22:24:00.9783689Z Receiving objects: 35% (10851/31001), 151.20 MiB | 75.64 MiB/s 2024-08-20T22:24:01.2200547Z Receiving objects: 36% (11161/31001), 184.77 MiB | 73.94 MiB/s 2024-08-20T22:24:01.2270124Z Receiving objects: 36% (11450/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.2288514Z Receiving objects: 37% (11471/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.2310272Z Receiving objects: 38% (11781/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.2328578Z Receiving objects: 39% (12091/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.2342852Z Receiving objects: 40% (12401/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.2354492Z Receiving objects: 41% (12711/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.2367017Z Receiving objects: 42% (13021/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.2382775Z Receiving objects: 43% (13331/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.2398225Z Receiving objects: 44% (13641/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.2406365Z Receiving objects: 45% (13951/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.2410808Z Receiving objects: 46% (14261/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.2424342Z Receiving objects: 47% (14571/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.2445731Z Receiving objects: 48% (14881/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.2458687Z Receiving objects: 49% (15191/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.2657384Z Receiving objects: 50% (15501/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.2663251Z Receiving objects: 51% (15811/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.2670219Z Receiving objects: 52% (16121/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.2676084Z Receiving objects: 53% (16431/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.2681542Z Receiving objects: 54% (16741/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.2698994Z Receiving objects: 55% (17051/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.2709283Z Receiving objects: 56% (17361/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.2715316Z Receiving objects: 57% (17671/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.2728929Z Receiving objects: 58% (17981/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.2740433Z Receiving objects: 59% (18291/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.2750824Z Receiving objects: 60% (18601/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.2888120Z Receiving objects: 61% (18911/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.2893674Z Receiving objects: 62% (19221/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.2899393Z Receiving objects: 63% (19531/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.2907234Z Receiving objects: 64% (19841/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.2914885Z Receiving objects: 65% (20151/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.2923492Z Receiving objects: 66% (20461/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.3180463Z Receiving objects: 67% (20771/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.3577072Z Receiving objects: 68% (21081/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.3584547Z Receiving objects: 69% (21391/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.3597919Z Receiving objects: 70% (21701/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.3609305Z Receiving objects: 71% (22011/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.3623747Z Receiving objects: 72% (22321/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.3632822Z Receiving objects: 73% (22631/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.3647990Z Receiving objects: 74% (22941/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.3659363Z Receiving objects: 75% (23251/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.3666406Z Receiving objects: 76% (23561/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.3674311Z Receiving objects: 77% (23871/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.3886320Z Receiving objects: 78% (24181/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.3919494Z Receiving objects: 79% (24491/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.3928690Z Receiving objects: 80% (24801/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.3940580Z Receiving objects: 81% (25111/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.3953231Z Receiving objects: 82% (25421/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.4001185Z Receiving objects: 83% (25731/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.4138576Z Receiving objects: 84% (26041/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.4144251Z Receiving objects: 85% (26351/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.4152374Z Receiving objects: 86% (26661/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.4157751Z Receiving objects: 87% (26971/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.4165115Z Receiving objects: 88% (27281/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.4171179Z Receiving objects: 89% (27591/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.4281770Z Receiving objects: 90% (27901/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.4295809Z Receiving objects: 91% (28211/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.4307687Z Receiving objects: 92% (28521/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.4324557Z Receiving objects: 93% (28831/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.4359062Z Receiving objects: 94% (29141/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.4370491Z Receiving objects: 95% (29451/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.4377026Z Receiving objects: 96% (29761/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.4383464Z Receiving objects: 97% (30071/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.4450886Z Receiving objects: 98% (30381/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.4476878Z Receiving objects: 99% (30691/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.4478856Z remote: Total 31001 (delta 1013), reused 1477 (delta 824), pack-reused 29260 (from 1) 2024-08-20T22:24:01.4495368Z Receiving objects: 100% (31001/31001), 221.44 MiB | 73.83 MiB/s 2024-08-20T22:24:01.4496233Z Receiving objects: 100% (31001/31001), 232.50 MiB | 71.99 MiB/s, done. 2024-08-20T22:24:01.4527118Z Resolving deltas: 0% (0/16733) 2024-08-20T22:24:01.4540964Z Resolving deltas: 1% (168/16733) 2024-08-20T22:24:01.4552661Z Resolving deltas: 2% (389/16733) 2024-08-20T22:24:01.4576619Z Resolving deltas: 3% (504/16733) 2024-08-20T22:24:01.4589682Z Resolving deltas: 4% (670/16733) 2024-08-20T22:24:01.4599265Z Resolving deltas: 5% (882/16733) 2024-08-20T22:24:01.4612499Z Resolving deltas: 6% (1004/16733) 2024-08-20T22:24:01.4622386Z Resolving deltas: 7% (1175/16733) 2024-08-20T22:24:01.4630974Z Resolving deltas: 8% (1364/16733) 2024-08-20T22:24:01.4642436Z Resolving deltas: 9% (1507/16733) 2024-08-20T22:24:01.4653164Z Resolving deltas: 10% (1684/16733) 2024-08-20T22:24:01.4666500Z Resolving deltas: 11% (1843/16733) 2024-08-20T22:24:01.4679445Z Resolving deltas: 12% (2009/16733) 2024-08-20T22:24:01.4692678Z Resolving deltas: 13% (2183/16733) 2024-08-20T22:24:01.4706621Z Resolving deltas: 14% (2394/16733) 2024-08-20T22:24:01.4723580Z Resolving deltas: 15% (2510/16733) 2024-08-20T22:24:01.4737182Z Resolving deltas: 16% (2690/16733) 2024-08-20T22:24:01.4774614Z Resolving deltas: 17% (2859/16733) 2024-08-20T22:24:01.4799997Z Resolving deltas: 18% (3032/16733) 2024-08-20T22:24:01.4821167Z Resolving deltas: 19% (3189/16733) 2024-08-20T22:24:01.4823495Z Resolving deltas: 20% (3486/16733) 2024-08-20T22:24:01.4840881Z Resolving deltas: 21% (3514/16733) 2024-08-20T22:24:01.4858318Z Resolving deltas: 22% (3707/16733) 2024-08-20T22:24:01.4869308Z Resolving deltas: 23% (3915/16733) 2024-08-20T22:24:01.4882087Z Resolving deltas: 24% (4057/16733) 2024-08-20T22:24:01.4920931Z Resolving deltas: 25% (4184/16733) 2024-08-20T22:24:01.4941211Z Resolving deltas: 26% (4369/16733) 2024-08-20T22:24:01.4954880Z Resolving deltas: 27% (4542/16733) 2024-08-20T22:24:01.4972725Z Resolving deltas: 28% (4689/16733) 2024-08-20T22:24:01.4989558Z Resolving deltas: 29% (4859/16733) 2024-08-20T22:24:01.5004038Z Resolving deltas: 30% (5020/16733) 2024-08-20T22:24:01.5016249Z Resolving deltas: 31% (5192/16733) 2024-08-20T22:24:01.5025055Z Resolving deltas: 32% (5388/16733) 2024-08-20T22:24:01.5040253Z Resolving deltas: 33% (5526/16733) 2024-08-20T22:24:01.5062125Z Resolving deltas: 34% (5703/16733) 2024-08-20T22:24:01.5080891Z Resolving deltas: 35% (5865/16733) 2024-08-20T22:24:01.5092649Z Resolving deltas: 36% (6046/16733) 2024-08-20T22:24:01.5113716Z Resolving deltas: 37% (6219/16733) 2024-08-20T22:24:01.5129763Z Resolving deltas: 38% (6359/16733) 2024-08-20T22:24:01.5138525Z Resolving deltas: 39% (6591/16733) 2024-08-20T22:24:01.5161684Z Resolving deltas: 40% (6735/16733) 2024-08-20T22:24:01.5168202Z Resolving deltas: 41% (6927/16733) 2024-08-20T22:24:01.5179040Z Resolving deltas: 42% (7048/16733) 2024-08-20T22:24:01.5187917Z Resolving deltas: 43% (7245/16733) 2024-08-20T22:24:01.5211078Z Resolving deltas: 44% (7369/16733) 2024-08-20T22:24:01.5227099Z Resolving deltas: 45% (7530/16733) 2024-08-20T22:24:01.5239277Z Resolving deltas: 46% (7700/16733) 2024-08-20T22:24:01.5254980Z Resolving deltas: 47% (7869/16733) 2024-08-20T22:24:01.5266385Z Resolving deltas: 48% (8032/16733) 2024-08-20T22:24:01.5272434Z Resolving deltas: 49% (8231/16733) 2024-08-20T22:24:01.5282489Z Resolving deltas: 50% (8375/16733) 2024-08-20T22:24:01.5305619Z Resolving deltas: 51% (8547/16733) 2024-08-20T22:24:01.5307818Z Resolving deltas: 52% (8843/16733) 2024-08-20T22:24:01.5316658Z Resolving deltas: 53% (8883/16733) 2024-08-20T22:24:01.5330180Z Resolving deltas: 54% (9036/16733) 2024-08-20T22:24:01.5342006Z Resolving deltas: 55% (9204/16733) 2024-08-20T22:24:01.5349399Z Resolving deltas: 56% (9380/16733) 2024-08-20T22:24:01.5360057Z Resolving deltas: 57% (9548/16733) 2024-08-20T22:24:01.5368749Z Resolving deltas: 58% (9799/16733) 2024-08-20T22:24:01.5380094Z Resolving deltas: 59% (9923/16733) 2024-08-20T22:24:01.5387541Z Resolving deltas: 60% (10101/16733) 2024-08-20T22:24:01.5402159Z Resolving deltas: 61% (10218/16733) 2024-08-20T22:24:01.5411990Z Resolving deltas: 62% (10418/16733) 2024-08-20T22:24:01.5433901Z Resolving deltas: 63% (10567/16733) 2024-08-20T22:24:01.5455248Z Resolving deltas: 65% (10882/16733) 2024-08-20T22:24:01.5459439Z Resolving deltas: 66% (11176/16733) 2024-08-20T22:24:01.5478577Z Resolving deltas: 67% (11239/16733) 2024-08-20T22:24:01.5486935Z Resolving deltas: 68% (11379/16733) 2024-08-20T22:24:01.5499788Z Resolving deltas: 69% (11546/16733) 2024-08-20T22:24:01.5515668Z Resolving deltas: 70% (11714/16733) 2024-08-20T22:24:01.5528485Z Resolving deltas: 71% (11881/16733) 2024-08-20T22:24:01.5537409Z Resolving deltas: 72% (12050/16733) 2024-08-20T22:24:01.5544866Z Resolving deltas: 73% (12216/16733) 2024-08-20T22:24:01.5560137Z Resolving deltas: 74% (12386/16733) 2024-08-20T22:24:01.5564706Z Resolving deltas: 75% (12642/16733) 2024-08-20T22:24:01.5571752Z Resolving deltas: 76% (12734/16733) 2024-08-20T22:24:01.5579843Z Resolving deltas: 77% (12897/16733) 2024-08-20T22:24:01.5592171Z Resolving deltas: 78% (13053/16733) 2024-08-20T22:24:01.5599728Z Resolving deltas: 79% (13253/16733) 2024-08-20T22:24:01.5608792Z Resolving deltas: 80% (13387/16733) 2024-08-20T22:24:01.5618071Z Resolving deltas: 81% (13574/16733) 2024-08-20T22:24:01.5627552Z Resolving deltas: 82% (13745/16733) 2024-08-20T22:24:01.5636219Z Resolving deltas: 83% (13892/16733) 2024-08-20T22:24:01.5644547Z Resolving deltas: 84% (14087/16733) 2024-08-20T22:24:01.5650629Z Resolving deltas: 85% (14261/16733) 2024-08-20T22:24:01.5659315Z Resolving deltas: 86% (14405/16733) 2024-08-20T22:24:01.5666610Z Resolving deltas: 87% (14559/16733) 2024-08-20T22:24:01.5676921Z Resolving deltas: 88% (14726/16733) 2024-08-20T22:24:01.5683350Z Resolving deltas: 89% (14910/16733) 2024-08-20T22:24:01.5690381Z Resolving deltas: 90% (15079/16733) 2024-08-20T22:24:01.5698984Z Resolving deltas: 91% (15229/16733) 2024-08-20T22:24:01.5706580Z Resolving deltas: 92% (15396/16733) 2024-08-20T22:24:01.5715192Z Resolving deltas: 93% (15571/16733) 2024-08-20T22:24:01.5723599Z Resolving deltas: 94% (15736/16733) 2024-08-20T22:24:01.5738165Z Resolving deltas: 95% (15933/16733) 2024-08-20T22:24:01.5740577Z Resolving deltas: 96% (16210/16733) 2024-08-20T22:24:01.5748752Z Resolving deltas: 97% (16243/16733) 2024-08-20T22:24:01.5806267Z Resolving deltas: 98% (16399/16733) 2024-08-20T22:24:01.5865808Z Resolving deltas: 99% (16586/16733) 2024-08-20T22:24:01.5866237Z Resolving deltas: 100% (16733/16733) 2024-08-20T22:24:01.5866661Z Resolving deltas: 100% (16733/16733), done. 2024-08-20T22:24:02.5860795Z + pushd torchbench 2024-08-20T22:24:02.5861201Z ~/workspace/torchbench ~/workspace 2024-08-20T22:24:02.5861713Z + git checkout 23512dbebd44a11eb84afbf53c3c071dd105297e 2024-08-20T22:24:02.6647474Z Note: switching to '23512dbebd44a11eb84afbf53c3c071dd105297e'. 2024-08-20T22:24:02.6648109Z 2024-08-20T22:24:02.6648651Z You are in 'detached HEAD' state. You can look around, make experimental 2024-08-20T22:24:02.6649540Z changes and commit them, and you can discard any commits you make in this 2024-08-20T22:24:02.6650481Z state without impacting any branches by switching back to a branch. 2024-08-20T22:24:02.6650938Z 2024-08-20T22:24:02.6651244Z If you want to create a new branch to retain commits you create, you may 2024-08-20T22:24:02.6652051Z do so (now or later) by using -c with the switch command. Example: 2024-08-20T22:24:02.6652467Z 2024-08-20T22:24:02.6652665Z git switch -c 2024-08-20T22:24:02.6652932Z 2024-08-20T22:24:02.6653067Z Or undo this operation with: 2024-08-20T22:24:02.6653327Z 2024-08-20T22:24:02.6653444Z git switch - 2024-08-20T22:24:02.6653626Z 2024-08-20T22:24:02.6653956Z Turn off this advice by setting config variable advice.detachedHead to false 2024-08-20T22:24:02.6654445Z 2024-08-20T22:24:02.6654614Z HEAD is now at 23512dbe Pin numpy version 2024-08-20T22:24:02.6658717Z + '[' '' ']' 2024-08-20T22:24:02.6659162Z + python install.py --continue_on_fail 2024-08-20T22:24:04.9279139Z checking packages torch, torchvision, torchaudio are installed...OK 2024-08-20T22:24:23.1433154Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/BERT_pytorch...OK 2024-08-20T22:24:26.2425452Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/Background_Matting...OK 2024-08-20T22:24:28.1406112Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/LearningToPaint...OK 2024-08-20T22:24:30.0131457Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/Super_SloMo...OK 2024-08-20T22:24:30.0366259Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/alexnet...OK 2024-08-20T22:24:37.6518379Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/basic_gnn_edgecnn...OK 2024-08-20T22:24:40.3582350Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/basic_gnn_gcn...OK 2024-08-20T22:24:43.0662170Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/basic_gnn_gin...OK 2024-08-20T22:24:45.8105080Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/basic_gnn_sage...OK 2024-08-20T22:24:45.8108419Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/cm3leon_generate...SKIP - No install.py is found 2024-08-20T22:24:46.8654540Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/dcgan...OK 2024-08-20T22:24:49.6619237Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/demucs...OK 2024-08-20T22:24:49.6851575Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/densenet121...OK 2024-08-20T22:25:46.3006416Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/detectron2_fasterrcnn_r_101_c4...OK 2024-08-20T22:25:54.8167689Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/detectron2_fasterrcnn_r_101_dc5...OK 2024-08-20T22:26:01.9978651Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/detectron2_fasterrcnn_r_101_fpn...OK 2024-08-20T22:26:08.7813034Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/detectron2_fasterrcnn_r_50_c4...OK 2024-08-20T22:26:18.0737234Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/detectron2_fasterrcnn_r_50_dc5...OK 2024-08-20T22:26:25.1787865Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/detectron2_fasterrcnn_r_50_fpn...OK 2024-08-20T22:26:32.2076673Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/detectron2_fcos_r_50_fpn...OK 2024-08-20T22:26:39.0430322Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/detectron2_maskrcnn...OK 2024-08-20T22:26:46.1504384Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/detectron2_maskrcnn_r_101_c4...OK 2024-08-20T22:26:53.8497228Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/detectron2_maskrcnn_r_101_fpn...OK 2024-08-20T22:27:00.6062274Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/detectron2_maskrcnn_r_50_c4...OK 2024-08-20T22:27:07.8333496Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/detectron2_maskrcnn_r_50_fpn...OK 2024-08-20T22:27:09.0479502Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/dlrm...OK 2024-08-20T22:27:43.5047155Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/doctr_det_predictor...OK 2024-08-20T22:27:48.3705278Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/doctr_reco_predictor...OK 2024-08-20T22:27:53.5854320Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/drq...OK 2024-08-20T22:28:04.4100862Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/fastNLP_Bert...OK 2024-08-20T22:28:05.5922077Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/functorch_dp_cifar10...OK 2024-08-20T22:28:07.0593585Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/functorch_maml_omniglot...OK 2024-08-20T22:28:13.7137859Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/hf_Albert...OK 2024-08-20T22:28:20.7512350Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/hf_Bart...OK 2024-08-20T22:28:26.1821593Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/hf_Bert...OK 2024-08-20T22:28:33.8118723Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/hf_Bert_large...OK 2024-08-20T22:28:39.6857744Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/hf_BigBird...OK 2024-08-20T22:28:44.6543981Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/hf_DistilBert...OK 2024-08-20T22:28:50.8176436Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/hf_GPT2...OK 2024-08-20T22:29:07.1915438Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/hf_GPT2_large...OK 2024-08-20T22:29:13.3465870Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/hf_Longformer...OK 2024-08-20T22:29:17.2513291Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/hf_Reformer...OK 2024-08-20T22:29:21.9745544Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/hf_T5...OK 2024-08-20T22:29:28.7154981Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/hf_T5_base...OK 2024-08-20T22:29:28.7157951Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/hf_T5_generate...SKIP - No install.py is found 2024-08-20T22:29:41.6674657Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/hf_T5_large...OK 2024-08-20T22:29:45.5749131Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/hf_Whisper...OK 2024-08-20T22:29:45.5751250Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/hf_clip...SKIP - No install.py is found 2024-08-20T22:29:53.1393370Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/hf_distil_whisper...OK 2024-08-20T22:29:54.3708096Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/lennard_jones...OK 2024-08-20T22:29:55.6125950Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/llama...OK 2024-08-20T22:30:40.3181448Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/llama_v2_7b_16h...OK 2024-08-20T22:32:09.2183536Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/llava...OK 2024-08-20T22:32:09.2467993Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/maml...OK 2024-08-20T22:32:10.7776061Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/maml_omniglot...OK 2024-08-20T22:32:10.8017127Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/mnasnet1_0...OK 2024-08-20T22:32:10.8258742Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/mobilenet_v2...OK 2024-08-20T22:32:10.8499230Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/mobilenet_v2_quantized_qat...OK 2024-08-20T22:32:10.8738357Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/mobilenet_v3_large...OK 2024-08-20T22:32:10.8980404Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/moco...OK 2024-08-20T22:32:31.9250417Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/moondream...OK 2024-08-20T22:32:31.9252518Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/nanogpt...SKIP - No install.py is found 2024-08-20T22:32:33.1731571Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/nvidia_deeprecommender...OK 2024-08-20T22:32:35.6106746Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/opacus_cifar10...OK 2024-08-20T22:32:35.6348787Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/phlippe_densenet...OK 2024-08-20T22:32:35.6588195Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/phlippe_resnet...OK 2024-08-20T22:32:35.6832352Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/pyhpc_equation_of_state...OK 2024-08-20T22:32:35.7073933Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/pyhpc_isoneutral_mixing...OK 2024-08-20T22:32:35.7315383Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/pyhpc_turbulent_kinetic_energy...OK 2024-08-20T22:32:42.3474950Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/pytorch_CycleGAN_and_pix2pix...OK 2024-08-20T22:32:43.8047545Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/pytorch_stargan...OK 2024-08-20T22:32:47.2777869Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/pytorch_unet...OK 2024-08-20T22:32:47.3019471Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/resnet152...OK 2024-08-20T22:32:47.3270937Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/resnet18...OK 2024-08-20T22:32:47.3515240Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/resnet50...OK 2024-08-20T22:32:47.3755991Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/resnet50_quantized_qat...OK 2024-08-20T22:32:47.3998711Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/resnext50_32x4d...OK 2024-08-20T22:33:02.3167842Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/sam...OK 2024-08-20T22:33:19.5484343Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/sam_fast...OK 2024-08-20T22:33:19.5728971Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/shufflenet_v2_x1_0...OK 2024-08-20T22:33:19.5731231Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/simple_gpt...SKIP - No install.py is found 2024-08-20T22:33:19.5734246Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/simple_gpt_tp_manual...SKIP - No install.py is found 2024-08-20T22:33:22.0094097Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/soft_actor_critic...OK 2024-08-20T22:33:23.7602929Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/speech_transformer...OK 2024-08-20T22:33:23.7847678Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/squeezenet1_1...OK 2024-08-20T22:33:48.7772666Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/stable_diffusion_text_encoder...OK 2024-08-20T22:33:55.3319392Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/stable_diffusion_unet...OK 2024-08-20T22:33:59.9249358Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/tacotron2...OK 2024-08-20T22:34:06.3683674Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/timm_efficientdet...OK 2024-08-20T22:34:06.3928077Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/timm_efficientnet...OK 2024-08-20T22:34:06.4178236Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/timm_nfnet...OK 2024-08-20T22:34:06.4416947Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/timm_regnet...OK 2024-08-20T22:34:06.4660467Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/timm_resnest...OK 2024-08-20T22:34:06.4908359Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/timm_vision_transformer...OK 2024-08-20T22:34:06.5150616Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/timm_vision_transformer_large...OK 2024-08-20T22:34:06.5393213Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/timm_vovnet...OK 2024-08-20T22:34:16.3766464Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/torch_multimodal_clip...OK 2024-08-20T22:34:28.2130860Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/tts_angular...OK 2024-08-20T22:34:28.2386514Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/vgg16...OK 2024-08-20T22:34:30.3370762Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/vision_maskrcnn...OK 2024-08-20T22:34:32.3185575Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/yolov3...OK 2024-08-20T22:34:32.7991716Z + echo 'Print all dependencies after TorchBench is installed' 2024-08-20T22:34:32.7992379Z Print all dependencies after TorchBench is installed 2024-08-20T22:34:32.7995926Z + python -mpip freeze 2024-08-20T22:34:33.2815586Z absl-py==2.1.0 2024-08-20T22:34:33.2815950Z accelerate==0.33.0 2024-08-20T22:34:33.2818613Z aiohappyeyeballs==2.4.0 2024-08-20T22:34:33.2819338Z aiohttp==3.10.5 2024-08-20T22:34:33.2819808Z aiosignal==1.3.1 2024-08-20T22:34:33.2820256Z annotated-types==0.7.0 2024-08-20T22:34:33.2820678Z antlr4-python3-runtime==4.9.3 2024-08-20T22:34:33.2821151Z anyascii==0.3.2 2024-08-20T22:34:33.2821562Z astroid==3.2.4 2024-08-20T22:34:33.2821906Z astunparse==1.6.3 2024-08-20T22:34:33.2822344Z async-timeout==4.0.3 2024-08-20T22:34:33.2822780Z attrs==23.1.0 2024-08-20T22:34:33.2823193Z audioread==3.0.1 2024-08-20T22:34:33.2823549Z babel==2.16.0 2024-08-20T22:34:33.2823850Z beautifulsoup4==4.12.3 2024-08-20T22:34:33.2824948Z -e git+https://github.com/pytorch/benchmark@23512dbebd44a11eb84afbf53c3c071dd105297e#egg=bert_pytorch&subdirectory=torchbenchmark/models/BERT_pytorch 2024-08-20T22:34:33.2825920Z bibtexparser==2.0.0b7 2024-08-20T22:34:33.2826266Z black==24.8.0 2024-08-20T22:34:33.2826583Z blinker==1.8.2 2024-08-20T22:34:33.2826875Z blis==0.7.11 2024-08-20T22:34:33.2827158Z blobfile==2.1.1 2024-08-20T22:34:33.2829537Z bokeh==3.5.1 2024-08-20T22:34:33.2829950Z boto3==1.19.12 2024-08-20T22:34:33.2832421Z botocore==1.22.12 2024-08-20T22:34:33.2832823Z bs4==0.0.2 2024-08-20T22:34:33.2833186Z cachetools==5.5.0 2024-08-20T22:34:33.2833599Z cardboardlint==1.3.1 2024-08-20T22:34:33.2834020Z catalogue==2.0.10 2024-08-20T22:34:33.2834408Z certifi==2024.7.4 2024-08-20T22:34:33.2834789Z cffi==1.17.0 2024-08-20T22:34:33.2835574Z charset-normalizer==3.3.2 2024-08-20T22:34:33.2836071Z click==8.1.7 2024-08-20T22:34:33.2836443Z clldutils==3.22.2 2024-08-20T22:34:33.2836847Z cloudpathlib==0.18.1 2024-08-20T22:34:33.2837357Z cloudpickle==3.0.0 2024-08-20T22:34:33.2837766Z colorama==0.4.6 2024-08-20T22:34:33.2838142Z colorlog==6.8.2 2024-08-20T22:34:33.2838531Z confection==0.1.5 2024-08-20T22:34:33.2838926Z contourpy==1.2.1 2024-08-20T22:34:33.2839289Z coremltools==5.0b5 2024-08-20T22:34:33.2839598Z cryptography==43.0.0 2024-08-20T22:34:33.2839915Z csvw==3.3.0 2024-08-20T22:34:33.2840191Z cycler==0.12.1 2024-08-20T22:34:33.2840488Z cymem==2.0.8 2024-08-20T22:34:33.2840832Z DALL-E==0.1 2024-08-20T22:34:33.2841112Z datasets==2.21.0 2024-08-20T22:34:33.2841414Z decorator==5.1.1 2024-08-20T22:34:33.2841708Z defusedxml==0.7.1 2024-08-20T22:34:33.2842012Z Deprecated==1.2.14 2024-08-20T22:34:33.2842831Z detectron2 @ git+https://github.com/facebookresearch/detectron2.git@1a4df4d954089534daebbd7a0a45f08ece87056e 2024-08-20T22:34:33.2843616Z diffusers==0.20.2 2024-08-20T22:34:33.2843918Z dill==0.3.8 2024-08-20T22:34:33.2844201Z diskcache==5.6.3 2024-08-20T22:34:33.2844499Z distro==1.9.0 2024-08-20T22:34:33.2844777Z dlinfo==1.2.1 2024-08-20T22:34:33.2845121Z docker-pycreds==0.4.0 2024-08-20T22:34:33.2845458Z dominate==2.9.1 2024-08-20T22:34:33.2846282Z effdet @ git+https://github.com/rwightman/efficientdet-pytorch.git@d43c9e34cd62d22b4205831bb735f6dd83b8e881 2024-08-20T22:34:33.2847065Z einops==0.8.0 2024-08-20T22:34:33.2847363Z exceptiongroup==1.2.2 2024-08-20T22:34:33.2847691Z execnet==2.1.1 2024-08-20T22:34:33.2847983Z expecttest==0.1.6 2024-08-20T22:34:33.2848300Z FastNLP==0.6.0 2024-08-20T22:34:33.2848638Z ffmpeg-python==0.2.0 2024-08-20T22:34:33.2848959Z filelock==3.13.1 2024-08-20T22:34:33.2849248Z Flask==3.0.3 2024-08-20T22:34:33.2849534Z flatbuffers==2.0 2024-08-20T22:34:33.2850171Z fonttools==4.53.1 2024-08-20T22:34:33.2850471Z frozenlist==1.4.1 2024-08-20T22:34:33.2850773Z fsspec==2024.6.1 2024-08-20T22:34:33.2851069Z ftfy==6.2.3 2024-08-20T22:34:33.2851674Z functorch @ git+https://github.com/pytorch/functorch.git@b71aa0b4387b86c278132209b99538be48ef4c74 2024-08-20T22:34:33.2852364Z future==1.0.0 2024-08-20T22:34:33.2852667Z fvcore==0.1.5.post20221221 2024-08-20T22:34:33.2853010Z gdown==5.2.0 2024-08-20T22:34:33.2853294Z geojson==2.5.0 2024-08-20T22:34:33.2853576Z ghstack==0.8.0 2024-08-20T22:34:33.2853865Z gitdb==4.0.11 2024-08-20T22:34:33.2854153Z GitPython==3.1.43 2024-08-20T22:34:33.2854504Z google-auth==2.34.0 2024-08-20T22:34:33.2854876Z google-auth-oauthlib==1.0.0 2024-08-20T22:34:33.2855232Z grpcio==1.65.5 2024-08-20T22:34:33.2855716Z gym==0.26.2 2024-08-20T22:34:33.2856096Z gym-notices==0.0.8 2024-08-20T22:34:33.2856437Z h5py==3.11.0 2024-08-20T22:34:33.2856717Z higher==0.2.1 2024-08-20T22:34:33.2857049Z huggingface-hub==0.24.6 2024-08-20T22:34:33.2857414Z hydra-core==1.3.2 2024-08-20T22:34:33.2857718Z hypothesis==5.35.1 2024-08-20T22:34:33.2858015Z idna==3.7 2024-08-20T22:34:33.2858279Z imageio==2.35.1 2024-08-20T22:34:33.2858590Z importlib_metadata==8.4.0 2024-08-20T22:34:33.2858932Z inflect==7.3.1 2024-08-20T22:34:33.2859212Z iniconfig==2.0.0 2024-08-20T22:34:33.2859513Z iopath==0.1.9 2024-08-20T22:34:33.2859797Z isodate==0.6.1 2024-08-20T22:34:33.2860081Z isort==5.13.2 2024-08-20T22:34:33.2860362Z itsdangerous==2.2.0 2024-08-20T22:34:33.2860666Z Jinja2==3.1.4 2024-08-20T22:34:33.2860951Z jmespath==0.10.0 2024-08-20T22:34:33.2861237Z joblib==1.4.2 2024-08-20T22:34:33.2861526Z jsonpatch==1.33 2024-08-20T22:34:33.2861826Z jsonpointer==3.0.0 2024-08-20T22:34:33.2862130Z jsonschema==4.23.0 2024-08-20T22:34:33.2862520Z jsonschema-specifications==2023.12.1 2024-08-20T22:34:33.2862932Z junitparser==2.1.1 2024-08-20T22:34:33.2863273Z kaldi-io==0.9.8 2024-08-20T22:34:33.2863562Z kiwisolver==1.4.5 2024-08-20T22:34:33.2863861Z kornia==0.7.3 2024-08-20T22:34:33.2864226Z kornia_rs==0.1.5 2024-08-20T22:34:33.2864528Z lameenc==1.7.0 2024-08-20T22:34:33.2864810Z langcodes==3.4.0 2024-08-20T22:34:33.2865116Z langdetect==1.0.9 2024-08-20T22:34:33.2865603Z language-tags==1.2.0 2024-08-20T22:34:33.2865927Z language_data==1.2.0 2024-08-20T22:34:33.2866233Z lark==0.12.0 2024-08-20T22:34:33.2866524Z lazy_loader==0.4 2024-08-20T22:34:33.2866818Z libcst==1.4.0 2024-08-20T22:34:33.2867094Z librosa==0.9.2 2024-08-20T22:34:33.2867386Z lintrunner==0.12.5 2024-08-20T22:34:33.2867688Z llvmlite==0.38.1 2024-08-20T22:34:33.2867978Z lxml==4.9.4 2024-08-20T22:34:33.2868286Z marisa-trie==1.2.0 2024-08-20T22:34:33.2868586Z Markdown==3.7 2024-08-20T22:34:33.2868915Z markdown-it-py==3.0.0 2024-08-20T22:34:33.2869232Z MarkupSafe==2.1.5 2024-08-20T22:34:33.2869543Z matplotlib==3.8.4 2024-08-20T22:34:33.2869838Z mccabe==0.7.0 2024-08-20T22:34:33.2870124Z mdurl==0.1.2 2024-08-20T22:34:33.2870440Z ml-dtypes==0.4.0 2024-08-20T22:34:33.2870739Z MonkeyType==23.3.0 2024-08-20T22:34:33.2871083Z more-itertools==10.4.0 2024-08-20T22:34:33.2871397Z mpmath==1.3.0 2024-08-20T22:34:33.2871681Z msgpack==1.0.8 2024-08-20T22:34:33.2871971Z multidict==6.0.5 2024-08-20T22:34:33.2872279Z multiprocess==0.70.16 2024-08-20T22:34:33.2872592Z murmurhash==1.0.10 2024-08-20T22:34:33.2872887Z musdb==0.4.2 2024-08-20T22:34:33.2873168Z museval==0.4.1 2024-08-20T22:34:33.2873444Z mypy==1.10.0 2024-08-20T22:34:33.2873772Z mypy-extensions==1.0.0 2024-08-20T22:34:33.2874096Z networkx==2.8.8 2024-08-20T22:34:33.2874382Z ninja==1.10.2 2024-08-20T22:34:33.2874652Z nose==1.3.7 2024-08-20T22:34:33.2874929Z numba==0.55.2 2024-08-20T22:34:33.2875208Z numpy==1.21.2 2024-08-20T22:34:33.2875645Z nvidia-cublas-cu12==12.1.3.1 2024-08-20T22:34:33.2876074Z nvidia-cuda-cupti-cu12==12.1.105 2024-08-20T22:34:33.2876578Z nvidia-cuda-nvrtc-cu12==12.1.105 2024-08-20T22:34:33.2877028Z nvidia-cuda-runtime-cu12==12.1.105 2024-08-20T22:34:33.2877460Z nvidia-cudnn-cu12==9.1.0.70 2024-08-20T22:34:33.2877863Z nvidia-cufft-cu12==11.0.2.54 2024-08-20T22:34:33.2878272Z nvidia-curand-cu12==10.3.2.106 2024-08-20T22:34:33.2878703Z nvidia-cusolver-cu12==11.4.5.107 2024-08-20T22:34:33.2879135Z nvidia-cusparse-cu12==12.1.0.106 2024-08-20T22:34:33.2879562Z nvidia-nccl-cu12==2.20.5 2024-08-20T22:34:33.2879958Z nvidia-nvjitlink-cu12==12.6.20 2024-08-20T22:34:33.2880367Z nvidia-nvtx-cu12==12.1.105 2024-08-20T22:34:33.2880705Z oauthlib==3.2.2 2024-08-20T22:34:33.2880997Z omegaconf==2.3.0 2024-08-20T22:34:33.2881288Z onnx==1.16.1 2024-08-20T22:34:33.2881578Z onnxscript==0.1.0.dev20240817 2024-08-20T22:34:33.2881931Z opacus==1.5.2 2024-08-20T22:34:33.2882268Z opencv-python==4.8.0.74 2024-08-20T22:34:33.2882627Z opt-einsum==3.3.0 2024-08-20T22:34:33.2883002Z optree==0.12.1 2024-08-20T22:34:33.2883292Z packaging==24.1 2024-08-20T22:34:33.2883685Z pandas==2.0.3 2024-08-20T22:34:33.2883961Z patch==1.16 2024-08-20T22:34:33.2884239Z pathspec==0.12.1 2024-08-20T22:34:33.2884539Z phonemizer==3.3.0 2024-08-20T22:34:33.2884829Z pillow==10.3.0 2024-08-20T22:34:33.2885124Z platformdirs==4.2.2 2024-08-20T22:34:33.2885432Z pluggy==1.5.0 2024-08-20T22:34:33.2885713Z pooch==1.8.2 2024-08-20T22:34:33.2885992Z portalocker==2.10.1 2024-08-20T22:34:33.2886301Z preshed==3.0.9 2024-08-20T22:34:33.2886592Z prettytable==3.11.0 2024-08-20T22:34:33.2886892Z protobuf==3.20.2 2024-08-20T22:34:33.2887190Z psutil==6.0.0 2024-08-20T22:34:33.2887516Z py-cpuinfo==9.0.0 2024-08-20T22:34:33.2887816Z pyaml==24.7.0 2024-08-20T22:34:33.2888091Z pyarrow==17.0.0 2024-08-20T22:34:33.2888380Z pyasn1==0.6.0 2024-08-20T22:34:33.2888668Z pyasn1_modules==0.4.0 2024-08-20T22:34:33.2888993Z pyclipper==1.3.0.post5 2024-08-20T22:34:33.2889312Z pycocotools==2.0.8 2024-08-20T22:34:33.2889616Z pycparser==2.22 2024-08-20T22:34:33.2889918Z pycryptodomex==3.20.0 2024-08-20T22:34:33.2890234Z pydantic==2.8.2 2024-08-20T22:34:33.2890539Z pydantic_core==2.20.1 2024-08-20T22:34:33.2890853Z pydot==3.0.1 2024-08-20T22:34:33.2891133Z pygame==2.6.0 2024-08-20T22:34:33.2891411Z PyGithub==2.3.0 2024-08-20T22:34:33.2891704Z Pygments==2.15.0 2024-08-20T22:34:33.2891995Z PyJWT==2.9.0 2024-08-20T22:34:33.2892273Z pylatexenc==2.10 2024-08-20T22:34:33.2892569Z pylint==3.2.6 2024-08-20T22:34:33.2892851Z PyNaCl==1.5.0 2024-08-20T22:34:33.2893220Z pynvml==11.5.3 2024-08-20T22:34:33.2893507Z pyparsing==3.1.2 2024-08-20T22:34:33.2893812Z pypdfium2==4.30.0 2024-08-20T22:34:33.2894107Z pysbd==0.3.4 2024-08-20T22:34:33.2894382Z PySocks==1.7.1 2024-08-20T22:34:33.2894667Z pytest==7.3.2 2024-08-20T22:34:33.2895007Z pytest-benchmark==4.0.0 2024-08-20T22:34:33.2895377Z pytest-cpp==2.3.0 2024-08-20T22:34:33.2895727Z pytest-flakefinder==1.1.0 2024-08-20T22:34:33.2896125Z pytest-rerunfailures==14.0 2024-08-20T22:34:33.2896538Z pytest-xdist==3.3.1 2024-08-20T22:34:33.2896923Z python-dateutil==2.9.0.post0 2024-08-20T22:34:33.2897703Z python-doctr @ git+https://github.com/xuzhao9/doctr.git@7f8a3e61bd6480c4e7b7cde47af0aa2153309c56 2024-08-20T22:34:33.2899112Z pytorch-labs-segment-anything-fast @ git+https://github.com/pytorch-labs/segment-anything-fast.git@de861af9badd03e8b40f5e063d70754a3dc6b4f4 2024-08-20T22:34:33.2900062Z pytz==2024.1 2024-08-20T22:34:33.2900343Z PyWavelets==1.4.1 2024-08-20T22:34:33.2900715Z PyYAML @ file:///croot/pyyaml_1698096049011/work 2024-08-20T22:34:33.2901160Z rapidfuzz==3.9.6 2024-08-20T22:34:33.2901452Z rdflib==7.0.0 2024-08-20T22:34:33.2901727Z redis==5.0.8 2024-08-20T22:34:33.2902009Z referencing==0.35.1 2024-08-20T22:34:33.2902314Z regex==2024.7.24 2024-08-20T22:34:33.2902598Z requests==2.32.3 2024-08-20T22:34:33.2902950Z requests-oauthlib==2.0.0 2024-08-20T22:34:33.2903288Z resampy==0.4.3 2024-08-20T22:34:33.2903573Z rfc3986==1.5.0 2024-08-20T22:34:33.2903846Z rich==13.7.1 2024-08-20T22:34:33.2904124Z rockset==1.0.3 2024-08-20T22:34:33.2904452Z rpds-py==0.20.0 2024-08-20T22:34:33.2904742Z rsa==4.9 2024-08-20T22:34:33.2905008Z s3transfer==0.5.2 2024-08-20T22:34:33.2905309Z safetensors==0.4.4 2024-08-20T22:34:33.2905652Z scikit-image==0.21.0 2024-08-20T22:34:33.2906002Z scikit-learn==1.5.1 2024-08-20T22:34:33.2906304Z scipy==1.10.1 2024-08-20T22:34:33.2906587Z segments==2.2.1 2024-08-20T22:34:33.2906883Z sentencepiece==0.2.0 2024-08-20T22:34:33.2907227Z sentry-sdk==2.13.0 2024-08-20T22:34:33.2907536Z setproctitle==1.3.3 2024-08-20T22:34:33.2907846Z shapely==2.0.6 2024-08-20T22:34:33.2908130Z shellingham==1.5.4 2024-08-20T22:34:33.2908433Z simplejson==3.19.3 2024-08-20T22:34:33.2908819Z six @ file:///tmp/build/80754af9/six_1644875935023/work 2024-08-20T22:34:33.2909317Z smart-open==7.0.4 2024-08-20T22:34:33.2909608Z smmap==5.0.1 2024-08-20T22:34:33.2909903Z sortedcontainers==2.4.0 2024-08-20T22:34:33.2910233Z soundfile==0.12.1 2024-08-20T22:34:33.2910523Z soupsieve==2.6 2024-08-20T22:34:33.2910809Z soxr==0.4.0 2024-08-20T22:34:33.2911082Z spacy==3.7.6 2024-08-20T22:34:33.2911405Z spacy-legacy==3.0.12 2024-08-20T22:34:33.2911878Z spacy-loggers==1.0.5 2024-08-20T22:34:33.2912192Z srsly==2.4.8 2024-08-20T22:34:33.2912472Z stempeg==0.2.3 2024-08-20T22:34:33.2912753Z submitit==1.5.1 2024-08-20T22:34:33.2913041Z sympy==1.13.1 2024-08-20T22:34:33.2913323Z tabulate==0.9.0 2024-08-20T22:34:33.2913664Z tb-nightly==2.13.0a20230426 2024-08-20T22:34:33.2914002Z tensorboard==2.13.0 2024-08-20T22:34:33.2914373Z tensorboard-data-server==0.7.2 2024-08-20T22:34:33.2914751Z tensorboardX==2.6.2.2 2024-08-20T22:34:33.2915062Z termcolor==2.4.0 2024-08-20T22:34:33.2915355Z thinc==8.2.5 2024-08-20T22:34:33.2915641Z threadpoolctl==3.5.0 2024-08-20T22:34:33.2915955Z tifffile==2024.8.10 2024-08-20T22:34:33.2916740Z timm @ git+https://github.com/huggingface/pytorch-image-models.git@730b907b4d45a4713cbc425cbf224c46089fd514 2024-08-20T22:34:33.2917501Z tlparse==0.3.25 2024-08-20T22:34:33.2917793Z tokenizers==0.15.2 2024-08-20T22:34:33.2918091Z tomli==2.0.1 2024-08-20T22:34:33.2918364Z tomlkit==0.13.2 2024-08-20T22:34:33.2919550Z torch @ file:///var/lib/jenkins/workspace/dist/torch-2.5.0a0%2Bgit40ec5f6-cp310-cp310-linux_x86_64.whl#sha256=b70a70c0c1fc7cc3f43c6342d758f4ffd3a540a88b786d266604d87618be5127 2024-08-20T22:34:33.2921160Z torch_geometric @ git+https://github.com/pyg-team/pytorch_geometric.git@cabcd4097442ba60aa1efa11e1619dd9bb8fb527 2024-08-20T22:34:33.2922253Z torchao @ git+https://github.com/pytorch/ao.git@2c8e3f368613f896fde14cc24b9268c9e125575e 2024-08-20T22:34:33.2923425Z torchaudio @ git+https://github.com/pytorch/audio.git@b3f6f511f2a1082bd56b13a3f6794e7fc3ba4862 2024-08-20T22:34:33.2924425Z torchdata @ git+https://github.com/pytorch/data.git@11bb5b847ea8b9e0d9bb82db3304daf383008d3f 2024-08-20T22:34:33.2925503Z torchmultimodal @ git+https://github.com/facebookresearch/multimodal.git@e4d288b45b89cee462a21ab264405f3f368adc21 2024-08-20T22:34:33.2926569Z torchtext @ git+https://github.com/pytorch/text.git@b0ebddc648d279826089db91775375221777a2db 2024-08-20T22:34:33.2927539Z torchvision @ git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2024-08-20T22:34:33.2928216Z tornado==6.4.1 2024-08-20T22:34:33.2928508Z tqdm==4.66.5 2024-08-20T22:34:33.2928796Z transformers==4.38.1 2024-08-20T22:34:33.2929105Z treetable==0.2.5 2024-08-20T22:34:33.2929905Z -e git+https://github.com/openai/triton@dedb7bdf339a3546896d4820366ca562c586bfa0#egg=triton&subdirectory=python 2024-08-20T22:34:33.2930686Z typeguard==4.3.0 2024-08-20T22:34:33.2930983Z typer==0.12.4 2024-08-20T22:34:33.2931272Z typing_extensions==4.12.2 2024-08-20T22:34:33.2931607Z tzdata==2024.1 2024-08-20T22:34:33.2931915Z Unidecode==1.3.8 2024-08-20T22:34:33.2932282Z unittest-xml-reporting==3.2.0 2024-08-20T22:34:33.2932645Z uritemplate==4.1.1 2024-08-20T22:34:33.2932949Z urllib3==1.26.19 2024-08-20T22:34:33.2933247Z visdom==0.2.4 2024-08-20T22:34:33.2933523Z wandb==0.17.7 2024-08-20T22:34:33.2933803Z wasabi==1.1.3 2024-08-20T22:34:33.2934085Z wcwidth==0.2.13 2024-08-20T22:34:33.2934374Z weasel==0.4.1 2024-08-20T22:34:33.2934703Z websocket-client==1.8.0 2024-08-20T22:34:33.2935039Z Werkzeug==3.0.3 2024-08-20T22:34:33.2935327Z wrapt==1.16.0 2024-08-20T22:34:33.2935611Z xdoctest==1.1.0 2024-08-20T22:34:33.2935894Z xxhash==3.5.0 2024-08-20T22:34:33.2936189Z xyzservices==2024.6.0 2024-08-20T22:34:33.2936503Z yacs==0.1.8 2024-08-20T22:34:33.2936768Z yarl==1.9.4 2024-08-20T22:34:33.2937078Z z3-solver==4.12.2.0 2024-08-20T22:34:33.2937380Z zipp==3.20.0 2024-08-20T22:34:33.3125433Z + popd 2024-08-20T22:34:33.3125818Z ~/workspace 2024-08-20T22:34:33.3126234Z + [[ aot_eager_torchbench != *cpu* ]] 2024-08-20T22:34:33.3126799Z + install_torchrec_and_fbgemm 2024-08-20T22:34:33.3127294Z + local torchrec_commit 2024-08-20T22:34:33.3128028Z ++ get_pinned_commit torchrec 2024-08-20T22:34:33.3128551Z ++ cat .github/ci_commit_pins/torchrec.txt 2024-08-20T22:34:33.3157084Z + torchrec_commit=6cd9fd362514d14ebb9ed51314c62ac1e1e2bbf2 2024-08-20T22:34:33.3157598Z + local fbgemm_commit 2024-08-20T22:34:33.3161216Z ++ get_pinned_commit fbgemm 2024-08-20T22:34:33.3161626Z ++ cat .github/ci_commit_pins/fbgemm.txt 2024-08-20T22:34:33.3187702Z + fbgemm_commit=de731af65b4f04696e85c729e3282450b51b95fd 2024-08-20T22:34:33.3188344Z + pip_uninstall torchrec-nightly 2024-08-20T22:34:33.3188809Z + pip uninstall -y torchrec-nightly 2024-08-20T22:34:33.6966735Z WARNING: Skipping torchrec-nightly as it is not installed. 2024-08-20T22:34:33.7320383Z + pip_uninstall fbgemm-gpu-nightly 2024-08-20T22:34:33.7320934Z + pip uninstall -y fbgemm-gpu-nightly 2024-08-20T22:34:34.1088482Z WARNING: Skipping fbgemm-gpu-nightly as it is not installed. 2024-08-20T22:34:34.1437013Z + pip_install setuptools-git-versioning scikit-build pyre-extensions 2024-08-20T22:34:34.1438007Z + pip install --progress-bar off setuptools-git-versioning scikit-build pyre-extensions 2024-08-20T22:34:34.6701395Z Collecting setuptools-git-versioning 2024-08-20T22:34:34.6873975Z Downloading setuptools_git_versioning-2.0.0-py3-none-any.whl.metadata (5.8 kB) 2024-08-20T22:34:34.8034588Z Collecting scikit-build 2024-08-20T22:34:34.8064221Z Downloading scikit_build-0.18.0-py3-none-any.whl.metadata (17 kB) 2024-08-20T22:34:34.9287025Z Collecting pyre-extensions 2024-08-20T22:34:34.9316672Z Downloading pyre_extensions-0.0.30-py3-none-any.whl.metadata (4.0 kB) 2024-08-20T22:34:34.9883500Z Requirement already satisfied: packaging in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from setuptools-git-versioning) (24.1) 2024-08-20T22:34:34.9886516Z Requirement already satisfied: setuptools in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from setuptools-git-versioning) (72.1.0) 2024-08-20T22:34:35.0459529Z Collecting toml>=0.10.2 (from setuptools-git-versioning) 2024-08-20T22:34:35.0489754Z Downloading toml-0.10.2-py2.py3-none-any.whl.metadata (7.1 kB) 2024-08-20T22:34:35.1008693Z Requirement already satisfied: distro in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from scikit-build) (1.9.0) 2024-08-20T22:34:35.1014261Z Requirement already satisfied: tomli in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from scikit-build) (2.0.1) 2024-08-20T22:34:35.1018178Z Requirement already satisfied: wheel>=0.32.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from scikit-build) (0.43.0) 2024-08-20T22:34:35.1546326Z Collecting typing-inspect (from pyre-extensions) 2024-08-20T22:34:35.1575915Z Downloading typing_inspect-0.9.0-py3-none-any.whl.metadata (1.5 kB) 2024-08-20T22:34:35.2107799Z Requirement already satisfied: typing-extensions in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from pyre-extensions) (4.12.2) 2024-08-20T22:34:35.2185608Z Requirement already satisfied: mypy-extensions>=0.3.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from typing-inspect->pyre-extensions) (1.0.0) 2024-08-20T22:34:35.2221550Z Downloading setuptools_git_versioning-2.0.0-py3-none-any.whl (10 kB) 2024-08-20T22:34:35.2785244Z Downloading scikit_build-0.18.0-py3-none-any.whl (85 kB) 2024-08-20T22:34:35.3355794Z Downloading pyre_extensions-0.0.30-py3-none-any.whl (12 kB) 2024-08-20T22:34:35.3860449Z Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-08-20T22:34:35.4408409Z Downloading typing_inspect-0.9.0-py3-none-any.whl (8.8 kB) 2024-08-20T22:34:36.3297177Z Installing collected packages: typing-inspect, toml, scikit-build, setuptools-git-versioning, pyre-extensions 2024-08-20T22:34:36.6902838Z Successfully installed pyre-extensions-0.0.30 scikit-build-0.18.0 setuptools-git-versioning-2.0.0 toml-0.10.2 typing-inspect-0.9.0 2024-08-20T22:34:36.7961110Z + CUDA_PATH=/usr/local/cuda-12.1 2024-08-20T22:34:36.7962350Z + pip_install --no-use-pep517 --user 'git+https://github.com/pytorch/FBGEMM.git@de731af65b4f04696e85c729e3282450b51b95fd#egg=fbgemm-gpu&subdirectory=fbgemm_gpu' 2024-08-20T22:34:36.7964312Z + pip install --progress-bar off --no-use-pep517 --user 'git+https://github.com/pytorch/FBGEMM.git@de731af65b4f04696e85c729e3282450b51b95fd#egg=fbgemm-gpu&subdirectory=fbgemm_gpu' 2024-08-20T22:34:37.1670314Z Collecting fbgemm-gpu 2024-08-20T22:34:37.1672777Z Cloning https://github.com/pytorch/FBGEMM.git (to revision de731af65b4f04696e85c729e3282450b51b95fd) to /tmp/pip-install-4lo1i_yg/fbgemm-gpu_07d495caf8704ac5bd4eaff2a1d3770c 2024-08-20T22:34:37.1701810Z Running command git clone --filter=blob:none --quiet https://github.com/pytorch/FBGEMM.git /tmp/pip-install-4lo1i_yg/fbgemm-gpu_07d495caf8704ac5bd4eaff2a1d3770c 2024-08-20T22:34:38.2614888Z Running command git rev-parse -q --verify 'sha^de731af65b4f04696e85c729e3282450b51b95fd' 2024-08-20T22:34:38.2641452Z Running command git fetch -q https://github.com/pytorch/FBGEMM.git de731af65b4f04696e85c729e3282450b51b95fd 2024-08-20T22:34:38.7627411Z Running command git checkout -q de731af65b4f04696e85c729e3282450b51b95fd 2024-08-20T22:34:39.2892238Z Resolved https://github.com/pytorch/FBGEMM.git to commit de731af65b4f04696e85c729e3282450b51b95fd 2024-08-20T22:34:39.2893395Z Running command git submodule update --init --recursive -q 2024-08-20T22:34:48.7042990Z Preparing metadata (setup.py) ... [?25l- done 2024-08-20T22:34:48.7063928Z [?25hRequirement already satisfied: numpy in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from fbgemm-gpu) (1.21.2) 2024-08-20T22:34:48.7072249Z Building wheels for collected packages: fbgemm-gpu 2024-08-20T23:19:31.0695771Z Building wheel for fbgemm-gpu (setup.py) ... [?25l- \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / done 2024-08-20T23:19:31.2527463Z [?25h Created wheel for fbgemm-gpu: filename=fbgemm_gpu-0.4.1rc0.post421-cp310-cp310-linux_x86_64.whl size=252619246 sha256=87069ae36d8b399fb290fb7958b510084cb92f4c77a1aeba134ae310f63b09cc 2024-08-20T23:19:31.2529834Z Stored in directory: /var/lib/jenkins/.cache/pip/wheels/d8/d9/f3/f5c260aba9c9f0a533444c12621a0c2ceb8fbcffce2b5beb39 2024-08-20T23:19:31.2548673Z Successfully built fbgemm-gpu 2024-08-20T23:19:32.0990270Z Installing collected packages: fbgemm-gpu 2024-08-20T23:19:35.4871062Z Successfully installed fbgemm-gpu-0.4.1rc0.post421 2024-08-20T23:19:36.3943223Z + pip_install --no-use-pep517 --user git+https://github.com/pytorch/torchrec.git@6cd9fd362514d14ebb9ed51314c62ac1e1e2bbf2 2024-08-20T23:19:36.3944812Z + pip install --progress-bar off --no-use-pep517 --user git+https://github.com/pytorch/torchrec.git@6cd9fd362514d14ebb9ed51314c62ac1e1e2bbf2 2024-08-20T23:19:36.7643649Z Collecting git+https://github.com/pytorch/torchrec.git@6cd9fd362514d14ebb9ed51314c62ac1e1e2bbf2 2024-08-20T23:19:36.7647859Z Cloning https://github.com/pytorch/torchrec.git (to revision 6cd9fd362514d14ebb9ed51314c62ac1e1e2bbf2) to /tmp/pip-req-build-ioox8u1w 2024-08-20T23:19:36.7677799Z Running command git clone --filter=blob:none --quiet https://github.com/pytorch/torchrec.git /tmp/pip-req-build-ioox8u1w 2024-08-20T23:19:37.5681082Z Running command git rev-parse -q --verify 'sha^6cd9fd362514d14ebb9ed51314c62ac1e1e2bbf2' 2024-08-20T23:19:37.5710617Z Running command git fetch -q https://github.com/pytorch/torchrec.git 6cd9fd362514d14ebb9ed51314c62ac1e1e2bbf2 2024-08-20T23:19:37.8858337Z Running command git checkout -q 6cd9fd362514d14ebb9ed51314c62ac1e1e2bbf2 2024-08-20T23:19:38.2288214Z Resolved https://github.com/pytorch/torchrec.git to commit 6cd9fd362514d14ebb9ed51314c62ac1e1e2bbf2 2024-08-20T23:19:38.5020156Z Preparing metadata (setup.py) ... [?25l- done 2024-08-20T23:19:38.5054221Z [?25hRequirement already satisfied: iopath in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchrec==0.3.2) (0.1.9) 2024-08-20T23:19:38.5058174Z Requirement already satisfied: pandas in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchrec==0.3.2) (2.0.3) 2024-08-20T23:19:38.5061281Z Requirement already satisfied: tabulate in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchrec==0.3.2) (0.9.0) 2024-08-20T23:19:38.5597195Z Collecting torchmetrics (from torchrec==0.3.2) 2024-08-20T23:19:38.5797563Z Downloading torchmetrics-1.4.1-py3-none-any.whl.metadata (20 kB) 2024-08-20T23:19:38.6197338Z Requirement already satisfied: tqdm in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchrec==0.3.2) (4.66.5) 2024-08-20T23:19:38.6199112Z Requirement already satisfied: fbgemm-gpu in /var/lib/jenkins/.local/lib/python3.10/site-packages (from torchrec==0.3.2) (0.4.1rc0.post421) 2024-08-20T23:19:38.6209188Z Requirement already satisfied: numpy in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from fbgemm-gpu->torchrec==0.3.2) (1.21.2) 2024-08-20T23:19:38.6218673Z Requirement already satisfied: portalocker in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from iopath->torchrec==0.3.2) (2.10.1) 2024-08-20T23:19:38.6489697Z Requirement already satisfied: python-dateutil>=2.8.2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from pandas->torchrec==0.3.2) (2.9.0.post0) 2024-08-20T23:19:38.6493263Z Requirement already satisfied: pytz>=2020.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from pandas->torchrec==0.3.2) (2024.1) 2024-08-20T23:19:38.6498754Z Requirement already satisfied: tzdata>=2022.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from pandas->torchrec==0.3.2) (2024.1) 2024-08-20T23:19:38.6521988Z Requirement already satisfied: packaging>17.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchmetrics->torchrec==0.3.2) (24.1) 2024-08-20T23:19:38.6526369Z Requirement already satisfied: torch>=1.10.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchmetrics->torchrec==0.3.2) (2.5.0a0+git40ec5f6) 2024-08-20T23:19:38.6692875Z Collecting lightning-utilities>=0.8.0 (from torchmetrics->torchrec==0.3.2) 2024-08-20T23:19:38.6730970Z Downloading lightning_utilities-0.11.6-py3-none-any.whl.metadata (5.2 kB) 2024-08-20T23:19:38.6827343Z Requirement already satisfied: setuptools in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from lightning-utilities>=0.8.0->torchmetrics->torchrec==0.3.2) (72.1.0) 2024-08-20T23:19:38.6832015Z Requirement already satisfied: typing-extensions in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from lightning-utilities>=0.8.0->torchmetrics->torchrec==0.3.2) (4.12.2) 2024-08-20T23:19:38.6853494Z Requirement already satisfied: six>=1.5 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from python-dateutil>=2.8.2->pandas->torchrec==0.3.2) (1.16.0) 2024-08-20T23:19:38.6887904Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch>=1.10.0->torchmetrics->torchrec==0.3.2) (3.13.1) 2024-08-20T23:19:38.6892050Z Requirement already satisfied: networkx in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch>=1.10.0->torchmetrics->torchrec==0.3.2) (2.8.8) 2024-08-20T23:19:38.6896507Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch>=1.10.0->torchmetrics->torchrec==0.3.2) (3.1.4) 2024-08-20T23:19:38.6900222Z Requirement already satisfied: fsspec in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch>=1.10.0->torchmetrics->torchrec==0.3.2) (2024.6.1) 2024-08-20T23:19:38.6905724Z Requirement already satisfied: sympy==1.13.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch>=1.10.0->torchmetrics->torchrec==0.3.2) (1.13.1) 2024-08-20T23:19:38.6921697Z Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from sympy==1.13.1->torch>=1.10.0->torchmetrics->torchrec==0.3.2) (1.3.0) 2024-08-20T23:19:38.7342575Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from jinja2->torch>=1.10.0->torchmetrics->torchrec==0.3.2) (2.1.5) 2024-08-20T23:19:38.7488677Z Downloading torchmetrics-1.4.1-py3-none-any.whl (866 kB) 2024-08-20T23:19:38.7720843Z Downloading lightning_utilities-0.11.6-py3-none-any.whl (26 kB) 2024-08-20T23:19:38.7820894Z Building wheels for collected packages: torchrec 2024-08-20T23:19:39.3106577Z Building wheel for torchrec (setup.py) ... [?25l- \ | done 2024-08-20T23:19:39.3113672Z [?25h Created wheel for torchrec: filename=torchrec-0.3.2-py3-none-any.whl size=374488 sha256=d0f29f2e91496931edfef0043870853c9f176a8a9bf2b940f3c379bb46fa4b7e 2024-08-20T23:19:39.3116343Z Stored in directory: /var/lib/jenkins/.cache/pip/wheels/8e/a1/47/39ede01672ba82c08fb521bfc057cc4347e4b0e951738c8ca8 2024-08-20T23:19:39.3138400Z Successfully built torchrec 2024-08-20T23:19:40.0990894Z Installing collected packages: lightning-utilities, torchmetrics, torchrec 2024-08-20T23:19:40.7106738Z Successfully installed lightning-utilities-0.11.6 torchmetrics-1.4.1 torchrec-0.3.2 2024-08-20T23:19:40.8509429Z ++ pwd 2024-08-20T23:19:40.8511494Z + PYTHONPATH=/var/lib/jenkins/workspace/torchbench 2024-08-20T23:19:40.8512006Z + test_dynamo_benchmark torchbench 0 2024-08-20T23:19:40.8516630Z ++ pwd 2024-08-20T23:19:40.8519975Z + TEST_REPORTS_DIR=/var/lib/jenkins/workspace/test/test-reports 2024-08-20T23:19:40.8520600Z + local suite=torchbench 2024-08-20T23:19:40.8520949Z + shift 2024-08-20T23:19:40.8521227Z + local shard_id=0 2024-08-20T23:19:40.8521609Z + shift 2024-08-20T23:19:40.8521938Z + [[ aot_eager_torchbench == *perf_compare* ]] 2024-08-20T23:19:40.8522494Z + [[ aot_eager_torchbench == *perf* ]] 2024-08-20T23:19:40.8525137Z + [[ aot_eager_torchbench == *cpu* ]] 2024-08-20T23:19:40.8525687Z + [[ aot_eager_torchbench == *aot_inductor* ]] 2024-08-20T23:19:40.8526598Z + test_single_dynamo_benchmark inference torchbench 0 --inference --bfloat16 2024-08-20T23:19:40.8527187Z ++ pwd 2024-08-20T23:19:40.8529650Z + TEST_REPORTS_DIR=/var/lib/jenkins/workspace/test/test-reports 2024-08-20T23:19:40.8530360Z + mkdir -p /var/lib/jenkins/workspace/test/test-reports 2024-08-20T23:19:40.8580689Z + local name=inference 2024-08-20T23:19:40.8581044Z + shift 2024-08-20T23:19:40.8581333Z + local suite=torchbench 2024-08-20T23:19:40.8581811Z + shift 2024-08-20T23:19:40.8582124Z + local shard_id=0 2024-08-20T23:19:40.8582438Z + shift 2024-08-20T23:19:40.8582722Z + partition_flags=() 2024-08-20T23:19:40.8583061Z + local partition_flags 2024-08-20T23:19:40.8583519Z + [[ -n 2 ]] 2024-08-20T23:19:40.8583941Z + [[ -n 0 ]] 2024-08-20T23:19:40.8584594Z + partition_flags=(--total-partitions "$NUM_TEST_SHARDS" --partition-id "$shard_id") 2024-08-20T23:19:40.8585308Z + [[ aot_eager_torchbench == *perf_compare* ]] 2024-08-20T23:19:40.8585779Z + [[ aot_eager_torchbench == *perf* ]] 2024-08-20T23:19:40.8586249Z + [[ aot_eager_torchbench == *aot_inductor* ]] 2024-08-20T23:19:40.8586717Z + [[ aot_eager_torchbench == *_avx2* ]] 2024-08-20T23:19:40.8587166Z + [[ aot_eager_torchbench == *_avx512* ]] 2024-08-20T23:19:40.8588795Z + python benchmarks/dynamo/torchbench.py --ci --accuracy --timing --explain --backend aot_eager --device cuda --inference --bfloat16 --total-partitions 2 --partition-id 0 --output /var/lib/jenkins/workspace/test/test-reports/inference_torchbench.csv 2024-08-20T23:19:46.7797442Z 2024-08-20T23:19:47.5096818Z loading model: 0it [00:00, ?it/s]/var/lib/jenkins/.local/lib/python3.10/site-packages/torchrec/optim/apply_optimizer_in_backward.py:47: DeprecationWarning: `TorchScript` support for functional optimizers is deprecated and will be removed in a future PyTorch release. Consider using the `torch.compile` optimizer instead. 2024-08-20T23:19:47.5098941Z from torch.distributed.optim import _apply_optimizer_in_backward 2024-08-20T23:19:47.8884773Z 2024-08-20T23:19:47.8884974Z loading model: 0it [00:01, ?it/s] 2024-08-20T23:19:47.8885554Z cuda eval torchrec_dlrm 2024-08-20T23:19:47.8916262Z Traceback (most recent call last): 2024-08-20T23:19:47.8917095Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/common.py", line 2507, in validate_model 2024-08-20T23:19:47.8918139Z self.model_iter_fn(model, example_inputs) 2024-08-20T23:19:47.8918932Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/torchbench.py", line 434, in forward_pass 2024-08-20T23:19:47.8919736Z return mod(*inputs) 2024-08-20T23:19:47.8921078Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1736, in _wrapped_call_impl 2024-08-20T23:19:47.8921978Z return self._call_impl(*args, **kwargs) 2024-08-20T23:19:47.8923278Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1747, in _call_impl 2024-08-20T23:19:47.8924316Z return forward_call(*args, **kwargs) 2024-08-20T23:19:47.8925310Z File "/var/lib/jenkins/.local/lib/python3.10/site-packages/torchrec/models/dlrm.py", line 893, in forward 2024-08-20T23:19:47.8926338Z logits = self.model(batch.dense_features, batch.sparse_features) 2024-08-20T23:19:47.8927611Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1736, in _wrapped_call_impl 2024-08-20T23:19:47.8928572Z return self._call_impl(*args, **kwargs) 2024-08-20T23:19:47.8929603Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1747, in _call_impl 2024-08-20T23:19:47.8930510Z return forward_call(*args, **kwargs) 2024-08-20T23:19:47.8931480Z File "/var/lib/jenkins/.local/lib/python3.10/site-packages/torchrec/models/dlrm.py", line 572, in forward 2024-08-20T23:19:47.8932342Z concatenated_dense = self.inter_arch( 2024-08-20T23:19:47.8933481Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1736, in _wrapped_call_impl 2024-08-20T23:19:47.8934436Z return self._call_impl(*args, **kwargs) 2024-08-20T23:19:47.8935447Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1747, in _call_impl 2024-08-20T23:19:47.8936355Z return forward_call(*args, **kwargs) 2024-08-20T23:19:47.8937314Z File "/var/lib/jenkins/.local/lib/python3.10/site-packages/torchrec/models/dlrm.py", line 284, in forward 2024-08-20T23:19:47.8938336Z return self.crossnet(combined_values.reshape([B, -1])) 2024-08-20T23:19:47.8939507Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1736, in _wrapped_call_impl 2024-08-20T23:19:47.8940455Z return self._call_impl(*args, **kwargs) 2024-08-20T23:19:47.8941467Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1747, in _call_impl 2024-08-20T23:19:47.8942367Z return forward_call(*args, **kwargs) 2024-08-20T23:19:47.8943333Z File "/var/lib/jenkins/.local/lib/python3.10/site-packages/torchrec/modules/crossnet.py", line 175, in forward 2024-08-20T23:19:47.8944358Z x_l_v = torch.nn.functional.linear(x_l, self.V_kernels[layer]) 2024-08-20T23:19:47.8945269Z RuntimeError: expected mat1 and mat2 to have the same dtype, but got: float != c10::BFloat16 2024-08-20T23:19:47.8945829Z 2024-08-20T23:19:47.8946184Z The above exception was the direct cause of the following exception: 2024-08-20T23:19:47.8946633Z 2024-08-20T23:19:47.8947059Z Traceback (most recent call last): 2024-08-20T23:19:47.8947742Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/common.py", line 4607, in run 2024-08-20T23:19:47.8948428Z ) = runner.load_model( 2024-08-20T23:19:47.8949146Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/torchbench.py", line 362, in load_model 2024-08-20T23:19:47.8950300Z self.validate_model(model, example_inputs) 2024-08-20T23:19:47.8951143Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/common.py", line 2509, in validate_model 2024-08-20T23:19:47.8951964Z raise RuntimeError("Eager run failed") from e 2024-08-20T23:19:47.8952436Z RuntimeError: Eager run failed 2024-08-20T23:19:47.8952751Z 2024-08-20T23:19:47.8952870Z eager_fail_to_run 2024-08-20T23:19:51.5359217Z 2024-08-20T23:19:53.7430688Z loading model: 0it [00:00, ?it/s] 2024-08-20T23:19:53.7431163Z loading model: 0it [00:02, ?it/s] 2024-08-20T23:19:53.7491771Z cuda eval BERT_pytorch 2024-08-20T23:20:02.7843024Z pass 2024-08-20T23:20:02.7861129Z TIMING: backend_compile:4.12254 entire_frame_compile:8.18437 total_wall_time:8.18437 2024-08-20T23:20:02.7862533Z STATS: call_* op count: 1076 | FakeTensor.__torch_dispatch__:4 | FakeTensorMode.__torch_dispatch__:21988 | ProxyTorchDispatchMode.__torch_dispatch__:9196 2024-08-20T23:20:02.7863646Z Dynamo produced 1 graphs covering 1076 ops with 0 graph breaks (0 unique) 2024-08-20T23:20:06.5576091Z 2024-08-20T23:20:11.2016755Z loading model: 0it [00:00, ?it/s] 2024-08-20T23:20:11.2017633Z loading model: 0it [00:04, ?it/s] 2024-08-20T23:20:11.2066301Z cuda eval Background_Matting 2024-08-20T23:20:11.2078966Z pass_due_to_skip 2024-08-20T23:20:11.2628799Z TIMING: 2024-08-20T23:20:11.2629093Z STATS: call_* op count: 0 2024-08-20T23:20:11.2632810Z Dynamo produced 0 graphs covering 0 ops with 0 graph breaks (0 unique) 2024-08-20T23:20:14.8792022Z 2024-08-20T23:20:17.8138033Z loading model: 0it [00:00, ?it/s] 2024-08-20T23:20:17.8138903Z loading model: 0it [00:02, ?it/s] 2024-08-20T23:20:17.8162679Z cuda eval LearningToPaint 2024-08-20T23:20:21.6525519Z pass 2024-08-20T23:20:21.6526123Z TIMING: backend_compile:1.51195 entire_frame_compile:3.3249 total_wall_time:3.3249 2024-08-20T23:20:21.6527135Z STATS: call_* op count: 142 | FakeTensorMode.__torch_dispatch__:7195 | ProxyTorchDispatchMode.__torch_dispatch__:1711 2024-08-20T23:20:21.6528116Z Dynamo produced 1 graphs covering 142 ops with 0 graph breaks (0 unique) 2024-08-20T23:20:25.5896040Z 2024-08-20T23:20:27.0980218Z loading model: 0it [00:00, ?it/s]Downloading: "https://download.pytorch.org/models/vgg16-397923af.pth" to /var/lib/jenkins/.cache/torch/hub/checkpoints/vgg16-397923af.pth 2024-08-20T23:20:27.1161051Z 2024-08-20T23:20:27.1161131Z 2024-08-20T23:20:27.2164483Z 0% 0.00/528M [00:00 will be ignored 2024-08-20T23:38:36.2837761Z pass 2024-08-20T23:38:36.3271180Z TIMING: entire_frame_compile:20.21551 backend_compile:10.57714 total_wall_time:20.21551 2024-08-20T23:38:36.3272405Z STATS: call_* op count: 671 | FakeTensorMode.__torch_dispatch__:29869 | ProxyTorchDispatchMode.__torch_dispatch__:13583 | FakeTensor.__torch_dispatch__:1774 2024-08-20T23:38:36.3273523Z Dynamo produced 3 graphs covering 671 ops with 7 graph breaks (5 unique) 2024-08-20T23:38:40.4718837Z 2024-08-20T23:38:41.9727573Z loading model: 0it [00:00, ?it/s] 2024-08-20T23:38:41.9728163Z loading model: 0it [00:01, ?it/s] 2024-08-20T23:38:41.9730171Z cuda train alexnet 2024-08-20T23:38:45.0622230Z pass 2024-08-20T23:38:45.0834746Z TIMING: entire_frame_compile:1.71867 backend_compile:1.17304 total_wall_time:1.71867 2024-08-20T23:38:45.0835951Z STATS: call_* op count: 26 | FakeTensorMode.__torch_dispatch__:1615 | ProxyTorchDispatchMode.__torch_dispatch__:674 | FakeTensor.__torch_dispatch__:22 2024-08-20T23:38:45.0837045Z Dynamo produced 2 graphs covering 26 ops with 6 graph breaks (5 unique) 2024-08-20T23:38:48.8592886Z 2024-08-20T23:38:50.8160527Z loading model: 0it [00:00, ?it/s] 2024-08-20T23:38:50.8161141Z loading model: 0it [00:01, ?it/s] 2024-08-20T23:38:50.8161602Z cuda train basic_gnn_edgecnn 2024-08-20T23:38:53.5944999Z W0820 23:38:53.593000 37153 torch/_logging/_internal.py:1058] [24/0] Profiler function will be ignored 2024-08-20T23:38:54.6816058Z pass 2024-08-20T23:38:54.6984562Z TIMING: entire_frame_compile:2.91399 backend_compile:1.05136 total_wall_time:2.91399 2024-08-20T23:38:54.6985794Z STATS: call_* op count: 102 | FakeTensorMode.__torch_dispatch__:3640 | ProxyTorchDispatchMode.__torch_dispatch__:1462 | FakeTensor.__torch_dispatch__:398 2024-08-20T23:38:54.6986954Z Dynamo produced 8 graphs covering 102 ops with 20 graph breaks (6 unique) 2024-08-20T23:38:58.5408289Z 2024-08-20T23:39:00.5430389Z loading model: 0it [00:00, ?it/s] 2024-08-20T23:39:00.5430896Z loading model: 0it [00:02, ?it/s] 2024-08-20T23:39:00.5431338Z cuda train basic_gnn_gcn 2024-08-20T23:39:02.2068849Z W0820 23:39:02.206000 37243 torch/_logging/_internal.py:1058] [18/0] Profiler function will be ignored 2024-08-20T23:39:02.8336903Z pass 2024-08-20T23:39:02.8450549Z TIMING: entire_frame_compile:1.67322 backend_compile:0.69732 total_wall_time:1.67322 2024-08-20T23:39:02.8452058Z STATS: call_* op count: 98 | FakeTensorMode.__torch_dispatch__:2157 | FakeTensor.__torch_dispatch__:192 | ProxyTorchDispatchMode.__torch_dispatch__:866 2024-08-20T23:39:02.8453153Z Dynamo produced 10 graphs covering 98 ops with 13 graph breaks (6 unique) 2024-08-20T23:39:06.6565965Z 2024-08-20T23:39:08.5629159Z loading model: 0it [00:00, ?it/s] 2024-08-20T23:39:08.5629646Z loading model: 0it [00:01, ?it/s] 2024-08-20T23:39:08.5630074Z cuda train basic_gnn_gin 2024-08-20T23:39:10.2265554Z W0820 23:39:10.225000 37333 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T23:39:11.2964759Z pass 2024-08-20T23:39:11.3041126Z TIMING: entire_frame_compile:2.14885 backend_compile:0.94127 total_wall_time:2.14885 2024-08-20T23:39:11.3042299Z STATS: call_* op count: 109 | FakeTensorMode.__torch_dispatch__:3059 | ProxyTorchDispatchMode.__torch_dispatch__:1395 | FakeTensor.__torch_dispatch__:248 2024-08-20T23:39:11.3043484Z Dynamo produced 3 graphs covering 109 ops with 7 graph breaks (5 unique) 2024-08-20T23:39:15.1455583Z 2024-08-20T23:39:17.0570006Z loading model: 0it [00:00, ?it/s] 2024-08-20T23:39:17.0570480Z loading model: 0it [00:01, ?it/s] 2024-08-20T23:39:17.0570942Z cuda train basic_gnn_sage 2024-08-20T23:39:18.5445758Z W0820 23:39:18.543000 37423 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T23:39:19.4182490Z pass 2024-08-20T23:39:19.4250465Z TIMING: entire_frame_compile:1.78198 backend_compile:0.77874 total_wall_time:1.78198 2024-08-20T23:39:19.4251696Z STATS: call_* op count: 106 | FakeTensorMode.__torch_dispatch__:2513 | ProxyTorchDispatchMode.__torch_dispatch__:1102 | FakeTensor.__torch_dispatch__:194 2024-08-20T23:39:19.4252788Z Dynamo produced 3 graphs covering 106 ops with 7 graph breaks (5 unique) 2024-08-20T23:39:23.2334172Z 2024-08-20T23:39:23.8193363Z loading model: 0it [00:00, ?it/s] 2024-08-20T23:39:23.8193859Z loading model: 0it [00:00, ?it/s] 2024-08-20T23:39:23.8194300Z cuda train dcgan 2024-08-20T23:39:25.8493523Z pass 2024-08-20T23:39:25.8509993Z TIMING: entire_frame_compile:1.72781 backend_compile:1.17084 total_wall_time:1.72781 2024-08-20T23:39:25.8511229Z STATS: call_* op count: 17 | FakeTensorMode.__torch_dispatch__:1528 | FakeTensor.__torch_dispatch__:30 | ProxyTorchDispatchMode.__torch_dispatch__:427 2024-08-20T23:39:25.8512324Z Dynamo produced 2 graphs covering 17 ops with 6 graph breaks (5 unique) 2024-08-20T23:39:29.6151486Z 2024-08-20T23:39:33.2754250Z loading model: 0it [00:00, ?it/s] 2024-08-20T23:39:33.2754853Z loading model: 0it [00:03, ?it/s] 2024-08-20T23:39:33.2755415Z cuda train demucs 2024-08-20T23:40:31.7819237Z pass 2024-08-20T23:40:31.8069453Z TIMING: entire_frame_compile:3.81574 backend_compile:1.99851 total_wall_time:3.81574 2024-08-20T23:40:31.8071818Z STATS: call_* op count: 88 | FakeTensorMode.__torch_dispatch__:4772 | ProxyTorchDispatchMode.__torch_dispatch__:1789 | FakeTensor.__torch_dispatch__:61 2024-08-20T23:40:31.8075997Z Dynamo produced 6 graphs covering 88 ops with 9 graph breaks (6 unique) 2024-08-20T23:40:35.6812910Z 2024-08-20T23:40:37.9535708Z loading model: 0it [00:00, ?it/s] 2024-08-20T23:40:37.9536354Z loading model: 0it [00:02, ?it/s] 2024-08-20T23:40:37.9536916Z cuda train densenet121 2024-08-20T23:41:14.8417224Z pass 2024-08-20T23:41:14.8545625Z TIMING: entire_frame_compile:31.05864 backend_compile:15.56414 total_wall_time:31.05864 2024-08-20T23:41:14.8547991Z STATS: call_* op count: 435 | FakeTensorMode.__torch_dispatch__:54008 | ProxyTorchDispatchMode.__torch_dispatch__:18440 | FakeTensor.__torch_dispatch__:22 2024-08-20T23:41:14.8552144Z Dynamo produced 2 graphs covering 435 ops with 6 graph breaks (5 unique) 2024-08-20T23:41:19.4388799Z 2024-08-20T23:41:24.7288861Z loading model: 0it [00:00, ?it/s] 2024-08-20T23:41:24.7289803Z loading model: 0it [00:05, ?it/s] 2024-08-20T23:41:24.7290262Z cuda train detectron2_maskrcnn_r_50_c4 2024-08-20T23:41:24.7304560Z Traceback (most recent call last): 2024-08-20T23:41:24.7305553Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/common.py", line 2507, in validate_model 2024-08-20T23:41:24.7306397Z self.model_iter_fn(model, example_inputs) 2024-08-20T23:41:24.7307231Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/torchbench.py", line 443, in forward_and_backward_pass 2024-08-20T23:41:24.7308195Z pred = mod(*cloned_inputs) 2024-08-20T23:41:24.7309348Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1736, in _wrapped_call_impl 2024-08-20T23:41:24.7310245Z return self._call_impl(*args, **kwargs) 2024-08-20T23:41:24.7311194Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1747, in _call_impl 2024-08-20T23:41:24.7312028Z return forward_call(*args, **kwargs) 2024-08-20T23:41:24.7313332Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/detectron2/modeling/meta_arch/rcnn.py", line 150, in forward 2024-08-20T23:41:24.7314392Z return self.inference(batched_inputs) 2024-08-20T23:41:24.7315388Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/detectron2/modeling/meta_arch/rcnn.py", line 213, in inference 2024-08-20T23:41:24.7316636Z results, _ = self.roi_heads(images, features, proposals, None) 2024-08-20T23:41:24.7317732Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1736, in _wrapped_call_impl 2024-08-20T23:41:24.7318634Z return self._call_impl(*args, **kwargs) 2024-08-20T23:41:24.7319570Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1747, in _call_impl 2024-08-20T23:41:24.7320403Z return forward_call(*args, **kwargs) 2024-08-20T23:41:24.7321389Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/detectron2/modeling/roi_heads/roi_heads.py", line 477, in forward 2024-08-20T23:41:24.7322303Z box_features = self._shared_roi_transform( 2024-08-20T23:41:24.7323513Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/detectron2/modeling/roi_heads/roi_heads.py", line 456, in _shared_roi_transform 2024-08-20T23:41:24.7324467Z x = self.pooler(features, boxes) 2024-08-20T23:41:24.7325434Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1736, in _wrapped_call_impl 2024-08-20T23:41:24.7326321Z return self._call_impl(*args, **kwargs) 2024-08-20T23:41:24.7327260Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1747, in _call_impl 2024-08-20T23:41:24.7328093Z return forward_call(*args, **kwargs) 2024-08-20T23:41:24.7329003Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/detectron2/modeling/poolers.py", line 246, in forward 2024-08-20T23:41:24.7329888Z return self.level_poolers[0](x[0], pooler_fmt_boxes) 2024-08-20T23:41:24.7330936Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1736, in _wrapped_call_impl 2024-08-20T23:41:24.7331821Z return self._call_impl(*args, **kwargs) 2024-08-20T23:41:24.7332754Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1747, in _call_impl 2024-08-20T23:41:24.7333578Z return forward_call(*args, **kwargs) 2024-08-20T23:41:24.7334483Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/detectron2/layers/roi_align.py", line 58, in forward 2024-08-20T23:41:24.7335275Z return roi_align( 2024-08-20T23:41:24.7336100Z File "/var/lib/jenkins/.local/lib/python3.10/site-packages/torchvision/ops/roi_align.py", line 236, in roi_align 2024-08-20T23:41:24.7337208Z return _roi_align(input, rois, spatial_scale, output_size[0], output_size[1], sampling_ratio, aligned) 2024-08-20T23:41:24.7338411Z File "/var/lib/jenkins/.local/lib/python3.10/site-packages/torchvision/ops/roi_align.py", line 168, in _roi_align 2024-08-20T23:41:24.7339584Z val = _bilinear_interpolate(input, roi_batch_ind, y, x, ymask, xmask) # [K, C, PH, PW, IY, IX] 2024-08-20T23:41:24.7340823Z File "/var/lib/jenkins/.local/lib/python3.10/site-packages/torchvision/ops/roi_align.py", line 62, in _bilinear_interpolate 2024-08-20T23:41:24.7341699Z v1 = masked_index(y_low, x_low) 2024-08-20T23:41:24.7342606Z File "/var/lib/jenkins/.local/lib/python3.10/site-packages/torchvision/ops/roi_align.py", line 55, in masked_index 2024-08-20T23:41:24.7343419Z return input[ 2024-08-20T23:41:24.7346531Z torch.OutOfMemoryError: CUDA out of memory. Tried to allocate 21890.87 GiB. GPU 0 has a total capacity of 21.98 GiB of which 16.54 GiB is free. Process 93348 has 5.42 GiB memory in use. Of the allocated memory 4.58 GiB is allocated by PyTorch, and 558.89 MiB is reserved by PyTorch but unallocated. If reserved but unallocated memory is large try setting PYTORCH_CUDA_ALLOC_CONF=expandable_segments:True to avoid fragmentation. See documentation for Memory Management (https://pytorch.org/docs/stable/notes/cuda.html#environment-variables) 2024-08-20T23:41:24.7349276Z 2024-08-20T23:41:24.7349572Z The above exception was the direct cause of the following exception: 2024-08-20T23:41:24.7350354Z 2024-08-20T23:41:24.7350505Z Traceback (most recent call last): 2024-08-20T23:41:24.7351305Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/common.py", line 4607, in run 2024-08-20T23:41:24.7351970Z ) = runner.load_model( 2024-08-20T23:41:24.7352625Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/torchbench.py", line 362, in load_model 2024-08-20T23:41:24.7353377Z self.validate_model(model, example_inputs) 2024-08-20T23:41:24.7354124Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/common.py", line 2509, in validate_model 2024-08-20T23:41:24.7354886Z raise RuntimeError("Eager run failed") from e 2024-08-20T23:41:24.7355351Z RuntimeError: Eager run failed 2024-08-20T23:41:24.7355617Z 2024-08-20T23:41:24.7355737Z eager_fail_to_run 2024-08-20T23:41:28.4672327Z 2024-08-20T23:41:37.3416535Z loading model: 0it [00:00, ?it/s] 2024-08-20T23:41:37.3417090Z loading model: 0it [00:08, ?it/s] 2024-08-20T23:41:37.3417529Z cuda train dlrm 2024-08-20T23:41:40.1039424Z pass 2024-08-20T23:41:40.1451091Z TIMING: entire_frame_compile:2.07482 backend_compile:1.3386 total_wall_time:2.07482 2024-08-20T23:41:40.1453747Z STATS: call_* op count: 40 | FakeTensorMode.__torch_dispatch__:2480 | ProxyTorchDispatchMode.__torch_dispatch__:1006 | FakeTensor.__torch_dispatch__:22 2024-08-20T23:41:40.1454912Z Dynamo produced 2 graphs covering 40 ops with 6 graph breaks (5 unique) 2024-08-20T23:41:43.9029072Z 2024-08-20T23:41:45.2905248Z loading model: 0it [00:00, ?it/s] 2024-08-20T23:41:45.2905841Z loading model: 0it [00:01, ?it/s] 2024-08-20T23:41:45.2906287Z cuda train drq 2024-08-20T23:41:47.5477241Z W0820 23:41:47.546000 37983 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T23:41:50.1329348Z pass 2024-08-20T23:41:50.1358220Z TIMING: entire_frame_compile:4.50618 backend_compile:2.66009 total_wall_time:4.50618 2024-08-20T23:41:50.1359436Z STATS: call_* op count: 136 | FakeTensorMode.__torch_dispatch__:5656 | ProxyTorchDispatchMode.__torch_dispatch__:2562 | FakeTensor.__torch_dispatch__:420 2024-08-20T23:41:50.1360535Z Dynamo produced 5 graphs covering 136 ops with 7 graph breaks (5 unique) 2024-08-20T23:41:54.0455043Z 2024-08-20T23:41:55.9016691Z loading model: 0it [00:00, ?it/s] 2024-08-20T23:41:55.9017217Z loading model: 0it [00:01, ?it/s] 2024-08-20T23:41:55.9017664Z cuda train fastNLP_Bert 2024-08-20T23:42:01.6786659Z W0820 23:42:01.677000 38089 torch/_dynamo/variables/tensor.py:776] [3/0] Graph break from `Tensor.item()`, consider setting: 2024-08-20T23:42:01.6788281Z W0820 23:42:01.677000 38089 torch/_dynamo/variables/tensor.py:776] [3/0] torch._dynamo.config.capture_scalar_outputs = True 2024-08-20T23:42:01.6789722Z W0820 23:42:01.677000 38089 torch/_dynamo/variables/tensor.py:776] [3/0] or: 2024-08-20T23:42:01.6790685Z W0820 23:42:01.677000 38089 torch/_dynamo/variables/tensor.py:776] [3/0] env TORCHDYNAMO_CAPTURE_SCALAR_OUTPUTS=1 2024-08-20T23:42:01.6792135Z W0820 23:42:01.677000 38089 torch/_dynamo/variables/tensor.py:776] [3/0] to include these operations in the captured graph. 2024-08-20T23:42:01.6793396Z W0820 23:42:01.677000 38089 torch/_dynamo/variables/tensor.py:776] [3/0] 2024-08-20T23:42:01.6794291Z W0820 23:42:01.677000 38089 torch/_dynamo/variables/tensor.py:776] [3/0] Graph break: from user code at: 2024-08-20T23:42:01.6795888Z W0820 23:42:01.677000 38089 torch/_dynamo/variables/tensor.py:776] [3/0] File "/var/lib/jenkins/workspace/benchmarks/dynamo/torchbench.py", line 443, in torch_dynamo_resume_in_forward_and_backward_pass_at_438 2024-08-20T23:42:01.6797726Z W0820 23:42:01.677000 38089 torch/_dynamo/variables/tensor.py:776] [3/0] pred = mod(*cloned_inputs) 2024-08-20T23:42:01.6799561Z W0820 23:42:01.677000 38089 torch/_dynamo/variables/tensor.py:776] [3/0] File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/fastNLP/models/bert.py", line 265, in forward 2024-08-20T23:42:01.6800995Z W0820 23:42:01.677000 38089 torch/_dynamo/variables/tensor.py:776] [3/0] sequence_output = self.bert(words) 2024-08-20T23:42:01.6802988Z W0820 23:42:01.677000 38089 torch/_dynamo/variables/tensor.py:776] [3/0] File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/fastNLP/embeddings/bert_embedding.py", line 137, in forward 2024-08-20T23:42:01.6804481Z W0820 23:42:01.677000 38089 torch/_dynamo/variables/tensor.py:776] [3/0] outputs = self.model(words) 2024-08-20T23:42:01.6806111Z W0820 23:42:01.677000 38089 torch/_dynamo/variables/tensor.py:776] [3/0] File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/fastNLP/embeddings/bert_embedding.py", line 445, in forward 2024-08-20T23:42:01.6808129Z W0820 23:42:01.677000 38089 torch/_dynamo/variables/tensor.py:776] [3/0] max_word_piece_length = batch_word_pieces_length.sum(dim=-1).max().item() # 表示word piece的长度(包括padding) 2024-08-20T23:42:01.6811369Z W0820 23:42:01.677000 38089 torch/_dynamo/variables/tensor.py:776] [3/0] 2024-08-20T23:42:01.6812102Z W0820 23:42:01.677000 38089 torch/_dynamo/variables/tensor.py:776] [3/0] 2024-08-20T23:42:12.6673894Z pass 2024-08-20T23:42:12.7567627Z TIMING: entire_frame_compile:10.66673 backend_compile:6.88948 total_wall_time:10.66673 2024-08-20T23:42:12.7568826Z STATS: call_* op count: 448 | FakeTensorMode.__torch_dispatch__:24991 | ProxyTorchDispatchMode.__torch_dispatch__:13734 | FakeTensor.__torch_dispatch__:52 2024-08-20T23:42:12.7569946Z Dynamo produced 7 graphs covering 448 ops with 10 graph breaks (6 unique) 2024-08-20T23:42:16.7837971Z 2024-08-20T23:42:17.6916234Z loading model: 0it [00:00, ?it/s] 2024-08-20T23:42:17.6916815Z loading model: 0it [00:00, ?it/s] 2024-08-20T23:42:17.6917348Z cuda train functorch_dp_cifar10 2024-08-20T23:42:22.5297071Z W0820 23:42:22.528000 38186 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T23:42:29.0218360Z pass 2024-08-20T23:42:29.0326753Z TIMING: entire_frame_compile:10.69367 backend_compile:5.99481 total_wall_time:10.69367 2024-08-20T23:42:29.0328030Z STATS: call_* op count: 276 | FakeTensorMode.__torch_dispatch__:13138 | ProxyTorchDispatchMode.__torch_dispatch__:5405 | FakeTensor.__torch_dispatch__:1208 2024-08-20T23:42:29.0329153Z Dynamo produced 3 graphs covering 276 ops with 7 graph breaks (5 unique) 2024-08-20T23:42:33.0103493Z 2024-08-20T23:42:33.6502782Z loading model: 0it [00:00, ?it/s] 2024-08-20T23:42:33.6503287Z loading model: 0it [00:00, ?it/s] 2024-08-20T23:42:33.6503738Z cuda train functorch_maml_omniglot 2024-08-20T23:42:35.5273819Z W0820 23:42:35.526000 38282 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T23:42:36.9487586Z pass 2024-08-20T23:42:36.9488519Z TIMING: entire_frame_compile:2.93638 backend_compile:1.71854 total_wall_time:2.93638 2024-08-20T23:42:36.9489849Z STATS: call_* op count: 77 | FakeTensorMode.__torch_dispatch__:2830 | ProxyTorchDispatchMode.__torch_dispatch__:1104 | FakeTensor.__torch_dispatch__:296 2024-08-20T23:42:36.9491344Z Dynamo produced 3 graphs covering 77 ops with 7 graph breaks (5 unique) 2024-08-20T23:42:40.7761364Z 2024-08-20T23:42:42.1820399Z loading model: 0it [00:00, ?it/s] 2024-08-20T23:42:42.1821532Z loading model: 0it [00:01, ?it/s] 2024-08-20T23:42:42.1822527Z cuda train hf_Albert 2024-08-20T23:42:57.5429897Z W0820 23:42:57.542000 38379 torch/_logging/_internal.py:1058] [5/0] Profiler function will be ignored 2024-08-20T23:43:00.1053178Z pass 2024-08-20T23:43:00.1594542Z TIMING: entire_frame_compile:11.07195 backend_compile:7.30398 total_wall_time:11.07195 2024-08-20T23:43:00.1596048Z STATS: call_* op count: 541 | FakeTensorMode.__torch_dispatch__:29288 | ProxyTorchDispatchMode.__torch_dispatch__:15170 | FakeTensor.__torch_dispatch__:572 2024-08-20T23:43:00.1597184Z Dynamo produced 3 graphs covering 541 ops with 6 graph breaks (5 unique) 2024-08-20T23:43:04.1072229Z 2024-08-20T23:43:08.0852819Z loading model: 0it [00:00, ?it/s] 2024-08-20T23:43:08.0854441Z loading model: 0it [00:03, ?it/s] 2024-08-20T23:43:08.0855040Z cuda train hf_Bart 2024-08-20T23:43:31.0183009Z W0820 23:43:31.017000 38476 torch/_logging/_internal.py:1058] [5/0] Profiler function will be ignored 2024-08-20T23:43:54.2228953Z pass 2024-08-20T23:43:54.2788367Z TIMING: entire_frame_compile:35.97268 backend_compile:19.69692 total_wall_time:35.97268 2024-08-20T23:43:54.2791464Z STATS: call_* op count: 1249 | FakeTensorMode.__torch_dispatch__:55109 | FakeTensor.__torch_dispatch__:4980 | ProxyTorchDispatchMode.__torch_dispatch__:26116 2024-08-20T23:43:54.2792650Z Dynamo produced 3 graphs covering 1249 ops with 6 graph breaks (5 unique) 2024-08-20T23:43:58.7631602Z 2024-08-20T23:44:01.3593496Z loading model: 0it [00:00, ?it/s] 2024-08-20T23:44:01.3594623Z loading model: 0it [00:02, ?it/s] 2024-08-20T23:44:01.3597989Z cuda train hf_Bert 2024-08-20T23:44:20.9253662Z W0820 23:44:20.924000 38573 torch/_logging/_internal.py:1058] [5/0] Profiler function will be ignored 2024-08-20T23:44:38.9006390Z pass 2024-08-20T23:44:38.9509468Z TIMING: entire_frame_compile:29.51525 backend_compile:16.08607 total_wall_time:29.51525 2024-08-20T23:44:38.9510668Z STATS: call_* op count: 994 | FakeTensorMode.__torch_dispatch__:45157 | ProxyTorchDispatchMode.__torch_dispatch__:21388 | FakeTensor.__torch_dispatch__:3692 2024-08-20T23:44:38.9516270Z Dynamo produced 3 graphs covering 994 ops with 6 graph breaks (5 unique) 2024-08-20T23:44:43.2902490Z 2024-08-20T23:44:48.1025697Z loading model: 0it [00:00, ?it/s] 2024-08-20T23:44:48.1026168Z loading model: 0it [00:04, ?it/s] 2024-08-20T23:44:48.1026609Z cuda train hf_Bert_large 2024-08-20T23:45:30.9129330Z W0820 23:45:30.912000 38670 torch/_logging/_internal.py:1058] [5/0] Profiler function will be ignored 2024-08-20T23:46:05.6157448Z pass 2024-08-20T23:46:05.7920814Z TIMING: entire_frame_compile:57.35553 backend_compile:31.01146 total_wall_time:57.35553 2024-08-20T23:46:05.7922036Z STATS: call_* op count: 1918 | FakeTensorMode.__torch_dispatch__:88021 | ProxyTorchDispatchMode.__torch_dispatch__:41896 | FakeTensor.__torch_dispatch__:7148 2024-08-20T23:46:05.7923225Z Dynamo produced 3 graphs covering 1918 ops with 6 graph breaks (5 unique) 2024-08-20T23:46:10.7598653Z 2024-08-20T23:46:14.3461148Z loading model: 0it [00:00, ?it/s] 2024-08-20T23:46:14.3461711Z loading model: 0it [00:03, ?it/s] 2024-08-20T23:46:14.3462230Z cuda train hf_BigBird 2024-08-20T23:46:25.6360656Z WARNING:common:fp64 golden ref were not generated for hf_BigBird. Setting accuracy check to cosine 2024-08-20T23:47:08.9898631Z W0820 23:47:08.989000 38767 torch/_logging/_internal.py:1058] [5/0] Profiler function will be ignored 2024-08-20T23:47:28.2435522Z pass 2024-08-20T23:47:28.2886498Z TIMING: entire_frame_compile:58.07775 backend_compile:35.0339 total_wall_time:58.07775 2024-08-20T23:47:28.2887934Z STATS: call_* op count: 3974 | FakeTensorMode.__torch_dispatch__:145798 | ProxyTorchDispatchMode.__torch_dispatch__:67573 | FakeTensor.__torch_dispatch__:3694 2024-08-20T23:47:28.2889094Z Dynamo produced 3 graphs covering 3974 ops with 6 graph breaks (5 unique) 2024-08-20T23:47:33.4078509Z 2024-08-20T23:47:35.5463558Z loading model: 0it [00:00, ?it/s] 2024-08-20T23:47:35.5464037Z loading model: 0it [00:02, ?it/s] 2024-08-20T23:47:35.5464487Z cuda train hf_DistilBert 2024-08-20T23:47:46.3264013Z W0820 23:47:46.325000 38864 torch/_logging/_internal.py:1058] [5/0] Profiler function will be ignored 2024-08-20T23:47:55.7460903Z pass 2024-08-20T23:47:55.7725526Z TIMING: entire_frame_compile:15.39208 backend_compile:8.82173 total_wall_time:15.39208 2024-08-20T23:47:55.7728488Z STATS: call_* op count: 539 | FakeTensorMode.__torch_dispatch__:23637 | ProxyTorchDispatchMode.__torch_dispatch__:11112 | FakeTensor.__torch_dispatch__:1942 2024-08-20T23:47:55.7730775Z Dynamo produced 3 graphs covering 539 ops with 6 graph breaks (5 unique) 2024-08-20T23:47:59.8219070Z 2024-08-20T23:48:03.0892107Z loading model: 0it [00:00, ?it/s] 2024-08-20T23:48:03.0893075Z loading model: 0it [00:03, ?it/s] 2024-08-20T23:48:03.0893727Z cuda train hf_GPT2 2024-08-20T23:48:18.6947854Z W0820 23:48:18.693000 38961 torch/_logging/_internal.py:1058] [5/0] Profiler function will be ignored 2024-08-20T23:48:31.9737328Z pass 2024-08-20T23:48:32.0738485Z TIMING: entire_frame_compile:23.81801 backend_compile:12.95566 total_wall_time:23.81801 2024-08-20T23:48:32.0741377Z STATS: call_* op count: 1087 | FakeTensorMode.__torch_dispatch__:38478 | ProxyTorchDispatchMode.__torch_dispatch__:17951 | FakeTensor.__torch_dispatch__:2768 2024-08-20T23:48:32.0742531Z Dynamo produced 3 graphs covering 1087 ops with 6 graph breaks (5 unique) 2024-08-20T23:48:36.2796503Z 2024-08-20T23:48:49.7260618Z loading model: 0it [00:00, ?it/s] 2024-08-20T23:48:49.7261071Z loading model: 0it [00:13, ?it/s] 2024-08-20T23:48:49.7266105Z cuda train hf_GPT2_large 2024-08-20T23:48:49.7266608Z pass_due_to_skip 2024-08-20T23:48:50.2309704Z TIMING: 2024-08-20T23:48:50.2310325Z STATS: call_* op count: 0 2024-08-20T23:48:50.2311410Z Dynamo produced 0 graphs covering 0 ops with 0 graph breaks (0 unique) 2024-08-20T23:48:53.8143910Z 2024-08-20T23:48:55.4709235Z loading model: 0it [00:00, ?it/s] 2024-08-20T23:48:55.4709709Z loading model: 0it [00:01, ?it/s] 2024-08-20T23:48:55.4710184Z cuda train hf_Reformer 2024-08-20T23:49:09.5276976Z W0820 23:49:09.526000 39101 torch/_logging/_internal.py:1058] [32/0] Profiler function will be ignored 2024-08-20T23:49:16.8721705Z pass 2024-08-20T23:49:16.9397222Z TIMING: entire_frame_compile:13.33906 backend_compile:6.38328 total_wall_time:13.33906 2024-08-20T23:49:16.9400419Z STATS: call_* op count: 687 | FakeTensorMode.__torch_dispatch__:19441 | ProxyTorchDispatchMode.__torch_dispatch__:7563 | FakeTensor.__torch_dispatch__:1520 | attempt fast:23 | fast is_contiguous:23 2024-08-20T23:49:16.9401745Z Dynamo produced 17 graphs covering 687 ops with 25 graph breaks (9 unique) 2024-08-20T23:49:21.0919913Z 2024-08-20T23:49:25.3824364Z loading model: 0it [00:00, ?it/s] 2024-08-20T23:49:25.3824844Z loading model: 0it [00:04, ?it/s] 2024-08-20T23:49:25.3830890Z cuda train hf_T5_base 2024-08-20T23:49:28.5317945Z WARNING:common:fp64 golden ref were not generated for hf_T5_base. Setting accuracy check to cosine 2024-08-20T23:49:30.6377879Z ERROR:common: 2024-08-20T23:49:30.6378379Z Traceback (most recent call last): 2024-08-20T23:49:30.6379310Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/common.py", line 2753, in check_accuracy 2024-08-20T23:49:30.6380240Z correct_rerun_result = self.run_n_iterations( 2024-08-20T23:49:30.6382738Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/common.py", line 2545, in run_n_iterations 2024-08-20T23:49:30.6383654Z self.model_iter_fn(mod, inputs, collect_outputs=False) 2024-08-20T23:49:30.6384661Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/torchbench.py", line 445, in forward_and_backward_pass 2024-08-20T23:49:30.6385534Z self.grad_scaler.scale(loss).backward() 2024-08-20T23:49:30.6386598Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/_tensor.py", line 522, in backward 2024-08-20T23:49:30.6387343Z torch.autograd.backward( 2024-08-20T23:49:30.6388205Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/__init__.py", line 347, in backward 2024-08-20T23:49:30.6388989Z _engine_run_backward( 2024-08-20T23:49:30.6389874Z File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/graph.py", line 817, in _engine_run_backward 2024-08-20T23:49:30.6391392Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2024-08-20T23:49:30.6394880Z torch.OutOfMemoryError: CUDA out of memory. Tried to allocate 192.00 MiB. GPU 0 has a total capacity of 21.98 GiB of which 88.44 MiB is free. Process 95024 has 21.88 GiB memory in use. Of the allocated memory 20.95 GiB is allocated by PyTorch, and 595.70 MiB is reserved by PyTorch but unallocated. If reserved but unallocated memory is large try setting PYTORCH_CUDA_ALLOC_CONF=expandable_segments:True to avoid fragmentation. See documentation for Memory Management (https://pytorch.org/docs/stable/notes/cuda.html#environment-variables) 2024-08-20T23:49:30.7236757Z eager_2nd_run_OOM 2024-08-20T23:49:30.7270895Z TIMING: 2024-08-20T23:49:30.7271201Z STATS: call_* op count: 0 2024-08-20T23:49:30.7271742Z Dynamo produced 0 graphs covering 0 ops with 0 graph breaks (0 unique) 2024-08-20T23:49:34.3792605Z 2024-08-20T23:49:44.6922665Z loading model: 0it [00:00, ?it/s] 2024-08-20T23:49:44.6923287Z loading model: 0it [00:10, ?it/s] 2024-08-20T23:49:44.6923829Z cuda train hf_T5_large 2024-08-20T23:49:44.6925962Z pass_due_to_skip 2024-08-20T23:49:45.1652274Z TIMING: 2024-08-20T23:49:45.1652586Z STATS: call_* op count: 0 2024-08-20T23:49:45.1653128Z Dynamo produced 0 graphs covering 0 ops with 0 graph breaks (0 unique) 2024-08-20T23:49:48.7569410Z 2024-08-20T23:49:49.9213122Z loading model: 0it [00:00, ?it/s] 2024-08-20T23:49:49.9213589Z loading model: 0it [00:01, ?it/s] 2024-08-20T23:49:49.9214033Z cuda train hf_Whisper 2024-08-20T23:49:56.8595351Z W0820 23:49:56.858000 39285 torch/_logging/_internal.py:1058] [5/0] Profiler function will be ignored 2024-08-20T23:50:03.2359999Z pass 2024-08-20T23:50:03.2428992Z TIMING: entire_frame_compile:10.36696 backend_compile:6.054 total_wall_time:10.36696 2024-08-20T23:50:03.2431480Z STATS: call_* op count: 346 | FakeTensorMode.__torch_dispatch__:14879 | FakeTensor.__torch_dispatch__:1408 | ProxyTorchDispatchMode.__torch_dispatch__:6891 2024-08-20T23:50:03.2432626Z Dynamo produced 3 graphs covering 346 ops with 6 graph breaks (5 unique) 2024-08-20T23:50:07.2633250Z 2024-08-20T23:50:07.5640602Z loading model: 0it [00:00, ?it/s] 2024-08-20T23:50:07.5641225Z loading model: 0it [00:00, ?it/s] 2024-08-20T23:50:07.5642827Z cuda train hf_distil_whisper 2024-08-20T23:50:07.5656791Z Traceback (most recent call last): 2024-08-20T23:50:07.5657605Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/common.py", line 4607, in run 2024-08-20T23:50:07.5658420Z ) = runner.load_model( 2024-08-20T23:50:07.5659599Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/torchbench.py", line 302, in load_model 2024-08-20T23:50:07.5660539Z benchmark = benchmark_cls( 2024-08-20T23:50:07.5661405Z File "/var/lib/jenkins/workspace/torchbench/torchbenchmark/util/model.py", line 24, in __call__ 2024-08-20T23:50:07.5662213Z obj = type.__call__(cls, *args, **kwargs) 2024-08-20T23:50:07.5663351Z File "/var/lib/jenkins/workspace/torchbench/torchbenchmark/models/hf_distil_whisper/__init__.py", line 12, in __init__ 2024-08-20T23:50:07.5664640Z raise NotImplementedError("Training is not implemented.") 2024-08-20T23:50:07.5665282Z NotImplementedError: Training is not implemented. 2024-08-20T23:50:07.5665686Z 2024-08-20T23:50:07.5665825Z model_fail_to_load 2024-08-20T23:50:10.9929541Z 2024-08-20T23:50:11.4763913Z loading model: 0it [00:00, ?it/s] 2024-08-20T23:50:11.4764376Z loading model: 0it [00:00, ?it/s] 2024-08-20T23:50:11.4764816Z cuda train lennard_jones 2024-08-20T23:50:13.0334485Z W0820 23:50:13.032000 39416 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T23:50:14.0636793Z pass 2024-08-20T23:50:14.0637558Z TIMING: entire_frame_compile:2.32417 backend_compile:1.58665 total_wall_time:2.32417 2024-08-20T23:50:14.0639263Z STATS: call_* op count: 60 | FakeTensorMode.__torch_dispatch__:2050 | ProxyTorchDispatchMode.__torch_dispatch__:921 | FakeTensor.__torch_dispatch__:224 2024-08-20T23:50:14.0640372Z Dynamo produced 3 graphs covering 60 ops with 7 graph breaks (5 unique) 2024-08-20T23:50:15.0268407Z accuracy pass_rate=81.82% 2024-08-20T23:50:15.0271822Z calls_captured gmean=0.00x mean=447.394x 2024-08-20T23:50:15.0275164Z unique_graphs gmean=0.00x mean=3.303x 2024-08-20T23:50:15.0278387Z graph_breaks gmean=0.00x mean=6.545x 2024-08-20T23:50:15.0281731Z unique_graph_breaks gmean=0.00x mean=4.333x 2024-08-20T23:50:15.0285248Z autograd_captures gmean=0.00x mean=0.000x 2024-08-20T23:50:15.0288465Z autograd_compiles gmean=0.00x mean=0.000x 2024-08-20T23:50:15.0291677Z cudagraph_skips gmean=0.00x mean=0.000x 2024-08-20T23:50:15.6566297Z + python benchmarks/dynamo/check_accuracy.py --actual /var/lib/jenkins/workspace/test/test-reports/training_torchbench.csv --expected benchmarks/dynamo/ci_expected_accuracy/aot_eager_torchbench_training.csv 2024-08-20T23:50:15.9934055Z torchrec_dlrm PASS 2024-08-20T23:50:15.9937405Z BERT_pytorch PASS 2024-08-20T23:50:15.9941765Z Background_Matting XFAIL 2024-08-20T23:50:15.9946309Z LearningToPaint PASS 2024-08-20T23:50:15.9951642Z Super_SloMo PASS 2024-08-20T23:50:15.9955634Z alexnet PASS 2024-08-20T23:50:15.9960033Z basic_gnn_edgecnn PASS 2024-08-20T23:50:15.9964396Z basic_gnn_gcn PASS 2024-08-20T23:50:15.9969146Z basic_gnn_gin PASS 2024-08-20T23:50:15.9973930Z basic_gnn_sage PASS 2024-08-20T23:50:15.9977964Z dcgan PASS 2024-08-20T23:50:15.9982269Z demucs PASS 2024-08-20T23:50:15.9986745Z densenet121 PASS 2024-08-20T23:50:15.9991148Z detectron2_maskrcnn_r_50_c4 XFAIL 2024-08-20T23:50:15.9995586Z dlrm PASS 2024-08-20T23:50:16.0000018Z drq PASS 2024-08-20T23:50:16.0004698Z fastNLP_Bert PASS 2024-08-20T23:50:16.0009025Z functorch_dp_cifar10 PASS 2024-08-20T23:50:16.0013507Z functorch_maml_omniglot PASS 2024-08-20T23:50:16.0017704Z hf_Albert PASS 2024-08-20T23:50:16.0022154Z hf_Bart PASS 2024-08-20T23:50:16.0026499Z hf_Bert PASS 2024-08-20T23:50:16.0030984Z hf_Bert_large PASS 2024-08-20T23:50:16.0035234Z hf_BigBird PASS 2024-08-20T23:50:16.0039731Z hf_DistilBert PASS 2024-08-20T23:50:16.0044268Z hf_GPT2 PASS 2024-08-20T23:50:16.0048646Z hf_GPT2_large XFAIL 2024-08-20T23:50:16.0053475Z hf_Reformer PASS 2024-08-20T23:50:16.0057842Z hf_T5_base XFAIL 2024-08-20T23:50:16.0062176Z hf_T5_large XFAIL 2024-08-20T23:50:16.0066648Z hf_Whisper PASS 2024-08-20T23:50:16.0071151Z hf_distil_whisper XFAIL 2024-08-20T23:50:16.0075556Z lennard_jones PASS 2024-08-20T23:50:16.0583223Z + python benchmarks/dynamo/check_graph_breaks.py --actual /var/lib/jenkins/workspace/test/test-reports/training_torchbench.csv --expected benchmarks/dynamo/ci_expected_accuracy/aot_eager_torchbench_training.csv 2024-08-20T23:50:16.3925734Z torchrec_dlrm PASS 2024-08-20T23:50:16.3929967Z BERT_pytorch PASS 2024-08-20T23:50:16.3934119Z Background_Matting PASS 2024-08-20T23:50:16.3938730Z LearningToPaint PASS 2024-08-20T23:50:16.3943250Z Super_SloMo PASS 2024-08-20T23:50:16.3947584Z alexnet PASS 2024-08-20T23:50:16.3952530Z basic_gnn_edgecnn PASS 2024-08-20T23:50:16.3957270Z basic_gnn_gcn PASS 2024-08-20T23:50:16.3961405Z basic_gnn_gin PASS 2024-08-20T23:50:16.3965880Z basic_gnn_sage PASS 2024-08-20T23:50:16.3970447Z dcgan PASS 2024-08-20T23:50:16.3974893Z demucs PASS 2024-08-20T23:50:16.3979256Z densenet121 PASS 2024-08-20T23:50:16.3983679Z detectron2_maskrcnn_r_50_c4 PASS 2024-08-20T23:50:16.3988023Z dlrm PASS 2024-08-20T23:50:16.3992342Z drq PASS 2024-08-20T23:50:16.3996818Z fastNLP_Bert PASS 2024-08-20T23:50:16.4001099Z functorch_dp_cifar10 PASS 2024-08-20T23:50:16.4005935Z functorch_maml_omniglot PASS 2024-08-20T23:50:16.4010134Z hf_Albert PASS 2024-08-20T23:50:16.4014421Z hf_Bart PASS 2024-08-20T23:50:16.4018832Z hf_Bert PASS 2024-08-20T23:50:16.4023208Z hf_Bert_large PASS 2024-08-20T23:50:16.4027679Z hf_BigBird PASS 2024-08-20T23:50:16.4031857Z hf_DistilBert PASS 2024-08-20T23:50:16.4036226Z hf_GPT2 PASS 2024-08-20T23:50:16.4040731Z hf_GPT2_large PASS 2024-08-20T23:50:16.4045222Z hf_Reformer PASS 2024-08-20T23:50:16.4049592Z hf_T5_base PASS 2024-08-20T23:50:16.4054368Z hf_T5_large PASS 2024-08-20T23:50:16.4058675Z hf_Whisper PASS 2024-08-20T23:50:16.4063070Z hf_distil_whisper PASS 2024-08-20T23:50:16.4067447Z lennard_jones PASS 2024-08-20T23:50:16.4577377Z + cleanup_workspace 2024-08-20T23:50:16.4578517Z + echo 'sudo may print the following warning message that can be ignored. The chown command will still run.' 2024-08-20T23:50:16.4579625Z sudo may print the following warning message that can be ignored. The chown command will still run. 2024-08-20T23:50:16.4580556Z + echo ' sudo: setrlimit(RLIMIT_STACK): Operation not permitted' 2024-08-20T23:50:16.4581198Z sudo: setrlimit(RLIMIT_STACK): Operation not permitted 2024-08-20T23:50:16.4581999Z + echo 'For more details refer to https://github.com/sudo-project/sudo/issues/42' 2024-08-20T23:50:16.4582882Z For more details refer to https://github.com/sudo-project/sudo/issues/42 2024-08-20T23:50:16.4583580Z + sudo chown -R 1000 /var/lib/jenkins/workspace 2024-08-20T23:50:17.2290696Z ##[group]Run cat test/**/*_toprint.log || true 2024-08-20T23:50:17.2291207Z cat test/**/*_toprint.log || true 2024-08-20T23:50:17.2304770Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T23:50:17.2305270Z env: 2024-08-20T23:50:17.2305555Z GIT_DEFAULT_BRANCH: main 2024-08-20T23:50:17.2306007Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T23:50:17.2306737Z DOCKER_CONTAINER_ID: 61d9bed6547bc97a242141be39386baa55845d3b63f44f2988ee9a1ae9d14ac6 2024-08-20T23:50:17.2307375Z ##[endgroup] 2024-08-20T23:50:17.2407829Z cat: 'test/**/*_toprint.log': No such file or directory 2024-08-20T23:50:17.2442131Z ##[group]Run kill "$MONITOR_SCRIPT_PID" 2024-08-20T23:50:17.2442609Z kill "$MONITOR_SCRIPT_PID" 2024-08-20T23:50:17.2451890Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T23:50:17.2452388Z env: 2024-08-20T23:50:17.2452662Z GIT_DEFAULT_BRANCH: main 2024-08-20T23:50:17.2453114Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T23:50:17.2453844Z DOCKER_CONTAINER_ID: 61d9bed6547bc97a242141be39386baa55845d3b63f44f2988ee9a1ae9d14ac6 2024-08-20T23:50:17.2454514Z MONITOR_SCRIPT_PID: 52436 2024-08-20T23:50:17.2454871Z ##[endgroup] 2024-08-20T23:50:17.2660370Z Prepare all required actions 2024-08-20T23:50:17.2660813Z Getting action download info 2024-08-20T23:50:17.4750498Z Download action repository 'actions/upload-artifact@v3' (SHA:a8a3f3ad30e3422c9c7b888a15615d19a852ae32) 2024-08-20T23:50:17.6184503Z ##[group]Run ./.github/actions/upload-test-artifacts 2024-08-20T23:50:17.6184987Z with: 2024-08-20T23:50:17.6185528Z file-suffix: test-aot_eager_torchbench-1-2-linux.g5.4xlarge.nvidia.gpu_29026298848 2024-08-20T23:50:17.6186197Z s3-bucket: gha-artifacts 2024-08-20T23:50:17.6186542Z env: 2024-08-20T23:50:17.6186836Z GIT_DEFAULT_BRANCH: main 2024-08-20T23:50:17.6187296Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T23:50:17.6188034Z DOCKER_CONTAINER_ID: 61d9bed6547bc97a242141be39386baa55845d3b63f44f2988ee9a1ae9d14ac6 2024-08-20T23:50:17.6188671Z ##[endgroup] 2024-08-20T23:50:17.6222316Z ##[group]Run # Remove any previous test jsons if they exist 2024-08-20T23:50:17.6222954Z # Remove any previous test jsons if they exist 2024-08-20T23:50:17.6223462Z rm -f test-jsons-*.zip 2024-08-20T23:50:17.6223986Z zip -r "test-jsons-${FILE_SUFFIX}.zip" test -i '*.json' 2024-08-20T23:50:17.6233080Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T23:50:17.6233576Z env: 2024-08-20T23:50:17.6233850Z GIT_DEFAULT_BRANCH: main 2024-08-20T23:50:17.6234302Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T23:50:17.6235078Z DOCKER_CONTAINER_ID: 61d9bed6547bc97a242141be39386baa55845d3b63f44f2988ee9a1ae9d14ac6 2024-08-20T23:50:17.6235965Z FILE_SUFFIX: test-aot_eager_torchbench-1-2-linux.g5.4xlarge.nvidia.gpu_29026298848 2024-08-20T23:50:17.6236603Z ##[endgroup] 2024-08-20T23:50:17.6619326Z adding: test/allowlist_for_publicAPI.json (deflated 79%) 2024-08-20T23:50:17.6660035Z adding: test/benchmark_utils/callgrind_artifacts.json (deflated 92%) 2024-08-20T23:50:17.6672581Z adding: test/minioptest_failures_dict.json (deflated 70%) 2024-08-20T23:50:17.6678753Z adding: test/profiler/profiler_utils_mock_events.json (deflated 87%) 2024-08-20T23:50:17.6691093Z adding: test/slow_tests.json (deflated 82%) 2024-08-20T23:50:17.7335965Z ##[group]Run # Remove any previous test reports if they exist 2024-08-20T23:50:17.7336616Z # Remove any previous test reports if they exist 2024-08-20T23:50:17.7337151Z rm -f test-reports-*.zip 2024-08-20T23:50:17.7337742Z zip -r "test-reports-${FILE_SUFFIX}.zip" test -i '*.xml' -i '*.csv' 2024-08-20T23:50:17.7346953Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T23:50:17.7347452Z env: 2024-08-20T23:50:17.7347746Z GIT_DEFAULT_BRANCH: main 2024-08-20T23:50:17.7348208Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T23:50:17.7348948Z DOCKER_CONTAINER_ID: 61d9bed6547bc97a242141be39386baa55845d3b63f44f2988ee9a1ae9d14ac6 2024-08-20T23:50:17.7350309Z FILE_SUFFIX: test-aot_eager_torchbench-1-2-linux.g5.4xlarge.nvidia.gpu_29026298848 2024-08-20T23:50:17.7350978Z ##[endgroup] 2024-08-20T23:50:17.7616567Z adding: test/test-reports/inference_torchbench.csv (deflated 73%) 2024-08-20T23:50:17.7621124Z adding: test/test-reports/inference_torchbench_graph_breaks.csv (deflated 92%) 2024-08-20T23:50:17.7622945Z adding: test/test-reports/inference_torchbench_graph_break_deduped.csv (deflated 80%) 2024-08-20T23:50:17.7623872Z adding: test/test-reports/training_torchbench.csv (deflated 64%) 2024-08-20T23:50:17.7630581Z adding: test/test-reports/training_torchbench_graph_breaks.csv (deflated 96%) 2024-08-20T23:50:17.7631754Z adding: test/test-reports/training_torchbench_graph_break_deduped.csv (deflated 76%) 2024-08-20T23:50:17.7664334Z ##[group]Run # Remove any previous usage logs if they exist 2024-08-20T23:50:17.7664962Z # Remove any previous usage logs if they exist 2024-08-20T23:50:17.7665464Z rm -f logs-*.zip 2024-08-20T23:50:17.7666143Z # this workflow is also run in bazel build test, but we dont generate usage reports for it 2024-08-20T23:50:17.7667123Z # so check to see if the file exists first 2024-08-20T23:50:17.7667629Z if [ -f 'usage_log.txt' ]; then 2024-08-20T23:50:17.7668155Z  zip "logs-${FILE_SUFFIX}.zip" 'usage_log.txt' 2024-08-20T23:50:17.7668643Z fi 2024-08-20T23:50:17.7669015Z if ls test/**/*.log 1> /dev/null 2>&1; then 2024-08-20T23:50:17.7669583Z  zip -r "logs-${FILE_SUFFIX}.zip" test -i '*.log' 2024-08-20T23:50:17.7670082Z fi 2024-08-20T23:50:17.7679719Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T23:50:17.7680219Z env: 2024-08-20T23:50:17.7680498Z GIT_DEFAULT_BRANCH: main 2024-08-20T23:50:17.7680951Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T23:50:17.7681682Z DOCKER_CONTAINER_ID: 61d9bed6547bc97a242141be39386baa55845d3b63f44f2988ee9a1ae9d14ac6 2024-08-20T23:50:17.7682575Z FILE_SUFFIX: test-aot_eager_torchbench-1-2-linux.g5.4xlarge.nvidia.gpu_29026298848 2024-08-20T23:50:17.7683321Z ##[endgroup] 2024-08-20T23:50:17.7782027Z adding: usage_log.txt (deflated 92%) 2024-08-20T23:50:17.7869892Z ##[group]Run # Remove any previous debugging artifacts if they exist 2024-08-20T23:50:17.7870607Z # Remove any previous debugging artifacts if they exist 2024-08-20T23:50:17.7871148Z rm -f debug-*.zip 2024-08-20T23:50:17.7871541Z if [ -d 'test/debug' ]; then 2024-08-20T23:50:17.7872052Z  zip -r "debug-${FILE_SUFFIX}.zip" test/debug 2024-08-20T23:50:17.7872530Z fi 2024-08-20T23:50:17.7880787Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T23:50:17.7881289Z env: 2024-08-20T23:50:17.7881570Z GIT_DEFAULT_BRANCH: main 2024-08-20T23:50:17.7882024Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T23:50:17.7882753Z DOCKER_CONTAINER_ID: 61d9bed6547bc97a242141be39386baa55845d3b63f44f2988ee9a1ae9d14ac6 2024-08-20T23:50:17.7883749Z FILE_SUFFIX: test-aot_eager_torchbench-1-2-linux.g5.4xlarge.nvidia.gpu_29026298848 2024-08-20T23:50:17.7884395Z ##[endgroup] 2024-08-20T23:50:17.7980639Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-08-20T23:50:17.7981073Z with: 2024-08-20T23:50:17.7981362Z s3-bucket: gha-artifacts 2024-08-20T23:50:17.7981794Z s3-prefix: pytorch/pytorch/10479310721/1/artifact 2024-08-20T23:50:17.7982269Z retention-days: 14 2024-08-20T23:50:17.7982602Z if-no-files-found: warn 2024-08-20T23:50:17.7982962Z path: test-jsons-*.zip 2024-08-20T23:50:17.7983308Z name: artifact 2024-08-20T23:50:17.7983612Z region: us-east-1 2024-08-20T23:50:17.7983917Z env: 2024-08-20T23:50:17.7984199Z GIT_DEFAULT_BRANCH: main 2024-08-20T23:50:17.7984700Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T23:50:17.7985426Z DOCKER_CONTAINER_ID: 61d9bed6547bc97a242141be39386baa55845d3b63f44f2988ee9a1ae9d14ac6 2024-08-20T23:50:17.7986055Z ##[endgroup] 2024-08-20T23:50:18.1854914Z NOTE: s3-prefix specified, ignoring name parameter 2024-08-20T23:50:18.1855750Z With the provided path, there will be 1 file uploaded 2024-08-20T23:50:18.1856458Z Uploading to s3 prefix: pytorch/pytorch/10479310721/1/artifact 2024-08-20T23:50:18.3089600Z Starting upload of test-jsons-test-aot_eager_torchbench-1-2-linux.g5.4xlarge.nvidia.gpu_29026298848.zip 2024-08-20T23:50:18.4196946Z Finished upload of test-jsons-test-aot_eager_torchbench-1-2-linux.g5.4xlarge.nvidia.gpu_29026298848.zip 2024-08-20T23:50:18.4479493Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-08-20T23:50:18.4479930Z with: 2024-08-20T23:50:18.4480229Z s3-bucket: gha-artifacts 2024-08-20T23:50:18.4480675Z s3-prefix: pytorch/pytorch/10479310721/1/artifact 2024-08-20T23:50:18.4481155Z retention-days: 14 2024-08-20T23:50:18.4481488Z if-no-files-found: error 2024-08-20T23:50:18.4481862Z path: test-reports-*.zip 2024-08-20T23:50:18.4482219Z name: artifact 2024-08-20T23:50:18.4482525Z region: us-east-1 2024-08-20T23:50:18.4482848Z env: 2024-08-20T23:50:18.4483205Z GIT_DEFAULT_BRANCH: main 2024-08-20T23:50:18.4483873Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T23:50:18.4484609Z DOCKER_CONTAINER_ID: 61d9bed6547bc97a242141be39386baa55845d3b63f44f2988ee9a1ae9d14ac6 2024-08-20T23:50:18.4485251Z ##[endgroup] 2024-08-20T23:50:18.8074035Z NOTE: s3-prefix specified, ignoring name parameter 2024-08-20T23:50:18.8074643Z With the provided path, there will be 1 file uploaded 2024-08-20T23:50:18.8075246Z Uploading to s3 prefix: pytorch/pytorch/10479310721/1/artifact 2024-08-20T23:50:18.8132595Z Starting upload of test-reports-test-aot_eager_torchbench-1-2-linux.g5.4xlarge.nvidia.gpu_29026298848.zip 2024-08-20T23:50:18.9018346Z Finished upload of test-reports-test-aot_eager_torchbench-1-2-linux.g5.4xlarge.nvidia.gpu_29026298848.zip 2024-08-20T23:50:18.9300095Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-08-20T23:50:18.9300530Z with: 2024-08-20T23:50:18.9300824Z s3-bucket: gha-artifacts 2024-08-20T23:50:18.9301275Z s3-prefix: pytorch/pytorch/10479310721/1/artifact 2024-08-20T23:50:18.9301756Z retention-days: 14 2024-08-20T23:50:18.9302112Z if-no-files-found: ignore 2024-08-20T23:50:18.9302476Z path: logs-*.zip 2024-08-20T23:50:18.9302789Z name: artifact 2024-08-20T23:50:18.9303096Z region: us-east-1 2024-08-20T23:50:18.9303404Z env: 2024-08-20T23:50:18.9303687Z GIT_DEFAULT_BRANCH: main 2024-08-20T23:50:18.9304143Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T23:50:18.9304859Z DOCKER_CONTAINER_ID: 61d9bed6547bc97a242141be39386baa55845d3b63f44f2988ee9a1ae9d14ac6 2024-08-20T23:50:18.9305488Z ##[endgroup] 2024-08-20T23:50:19.2872664Z NOTE: s3-prefix specified, ignoring name parameter 2024-08-20T23:50:19.2873958Z With the provided path, there will be 1 file uploaded 2024-08-20T23:50:19.2875233Z Uploading to s3 prefix: pytorch/pytorch/10479310721/1/artifact 2024-08-20T23:50:19.2930643Z Starting upload of logs-test-aot_eager_torchbench-1-2-linux.g5.4xlarge.nvidia.gpu_29026298848.zip 2024-08-20T23:50:19.4069001Z Finished upload of logs-test-aot_eager_torchbench-1-2-linux.g5.4xlarge.nvidia.gpu_29026298848.zip 2024-08-20T23:50:19.4350878Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-08-20T23:50:19.4351322Z with: 2024-08-20T23:50:19.4351611Z s3-bucket: gha-artifacts 2024-08-20T23:50:19.4352048Z s3-prefix: pytorch/pytorch/10479310721/1/artifact 2024-08-20T23:50:19.4352522Z retention-days: 14 2024-08-20T23:50:19.4352856Z if-no-files-found: ignore 2024-08-20T23:50:19.4353217Z path: debug-*.zip 2024-08-20T23:50:19.4353529Z name: artifact 2024-08-20T23:50:19.4353828Z region: us-east-1 2024-08-20T23:50:19.4354133Z env: 2024-08-20T23:50:19.4354409Z GIT_DEFAULT_BRANCH: main 2024-08-20T23:50:19.4354860Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T23:50:19.4355579Z DOCKER_CONTAINER_ID: 61d9bed6547bc97a242141be39386baa55845d3b63f44f2988ee9a1ae9d14ac6 2024-08-20T23:50:19.4356212Z ##[endgroup] 2024-08-20T23:50:19.7820254Z No files were found with the provided path: debug-*.zip. No artifacts will be uploaded. 2024-08-20T23:50:19.8108452Z ##[group]Run # shellcheck disable=SC2156 2024-08-20T23:50:19.8108943Z # shellcheck disable=SC2156 2024-08-20T23:50:19.8109728Z find . -iname "core.[1-9]*" -exec docker exec "${DOCKER_CONTAINER_ID}" sh -c "gdb python {} -ex 'bt' -ex 'q'" \; 2024-08-20T23:50:19.8119414Z shell: /usr/bin/bash -e {0} 2024-08-20T23:50:19.8119768Z env: 2024-08-20T23:50:19.8120049Z GIT_DEFAULT_BRANCH: main 2024-08-20T23:50:19.8120501Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T23:50:19.8121223Z DOCKER_CONTAINER_ID: 61d9bed6547bc97a242141be39386baa55845d3b63f44f2988ee9a1ae9d14ac6 2024-08-20T23:50:19.8121862Z ##[endgroup] 2024-08-20T23:50:20.0796262Z ##[group]Run pytorch/test-infra/.github/actions/teardown-linux@main 2024-08-20T23:50:20.0796831Z with: 2024-08-20T23:50:20.0797092Z env: 2024-08-20T23:50:20.0797371Z GIT_DEFAULT_BRANCH: main 2024-08-20T23:50:20.0797831Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T23:50:20.0798561Z DOCKER_CONTAINER_ID: 61d9bed6547bc97a242141be39386baa55845d3b63f44f2988ee9a1ae9d14ac6 2024-08-20T23:50:20.0799196Z ##[endgroup] 2024-08-20T23:50:20.0818425Z ##[group]Run set -eou pipefail 2024-08-20T23:50:20.0818824Z set -eou pipefail 2024-08-20T23:50:20.0819174Z  2024-08-20T23:50:20.0819675Z echo "Holding runner for 2 hours until all ssh sessions have logged out" 2024-08-20T23:50:20.0820302Z for _ in $(seq 1440); do 2024-08-20T23:50:20.0820769Z  # Break if no ssh session exists anymore 2024-08-20T23:50:20.0821265Z  if [ "$(who)" = "" ]; then 2024-08-20T23:50:20.0821671Z  break 2024-08-20T23:50:20.0822011Z  fi 2024-08-20T23:50:20.0822312Z  echo "." 2024-08-20T23:50:20.0822640Z  sleep 5 2024-08-20T23:50:20.0822959Z done 2024-08-20T23:50:20.0831621Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T23:50:20.0832122Z env: 2024-08-20T23:50:20.0832404Z GIT_DEFAULT_BRANCH: main 2024-08-20T23:50:20.0832857Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T23:50:20.0833590Z DOCKER_CONTAINER_ID: 61d9bed6547bc97a242141be39386baa55845d3b63f44f2988ee9a1ae9d14ac6 2024-08-20T23:50:20.0834220Z ##[endgroup] 2024-08-20T23:50:20.0862211Z Holding runner for 2 hours until all ssh sessions have logged out 2024-08-20T23:50:20.0947277Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2024-08-20T23:50:20.0948035Z # ignore expansion of "docker ps -q" since it could be empty 2024-08-20T23:50:20.0948624Z # shellcheck disable=SC2046 2024-08-20T23:50:20.0949103Z docker stop $(docker ps -q) || true 2024-08-20T23:50:20.0949580Z # Prune all of the docker images 2024-08-20T23:50:20.0950281Z docker system prune -af 2024-08-20T23:50:20.0959873Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T23:50:20.0960382Z env: 2024-08-20T23:50:20.0960658Z GIT_DEFAULT_BRANCH: main 2024-08-20T23:50:20.0961108Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T23:50:20.0961837Z DOCKER_CONTAINER_ID: 61d9bed6547bc97a242141be39386baa55845d3b63f44f2988ee9a1ae9d14ac6 2024-08-20T23:50:20.0962469Z ##[endgroup] 2024-08-20T23:50:20.9197902Z 61d9bed6547b 2024-08-20T23:50:24.8827569Z Deleted Containers: 2024-08-20T23:50:24.8828201Z 61d9bed6547bc97a242141be39386baa55845d3b63f44f2988ee9a1ae9d14ac6 2024-08-20T23:50:24.8828657Z 2024-08-20T23:50:33.7470907Z Deleted Images: 2024-08-20T23:50:33.7472826Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T23:50:33.7475280Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks@sha256:3a95d3a177465127ef6cd3b50787d6a050367070fd9063dbb688fad07a96b402 2024-08-20T23:50:33.7477153Z deleted: sha256:8fef7805cec6e829013a3d62f158b75bdc2f02cdfe3428c032ea017b488473bb 2024-08-20T23:50:33.7478002Z deleted: sha256:c2ce10014dd98f6abbfbf2265f9780a8204c2a7a27463e61ee565573a23d141d 2024-08-20T23:50:33.7478947Z deleted: sha256:ae249c0e6e6013bd6ffea2ca0b0160c015c9ebf7c03070bc2f983a9ff2415bf5 2024-08-20T23:50:33.7479837Z deleted: sha256:8a73883c1067c0e29ff128f553518682b47ed9707d2f35e7d5138e2caf029d61 2024-08-20T23:50:33.7480654Z deleted: sha256:9c040db729fa084584aaf5573082408a2196bc64e5952270c79dc610ed4680b6 2024-08-20T23:50:33.7481443Z deleted: sha256:17311eeeb8b71b16699880c0f646e185107496c4d41da5d23370603768ec030c 2024-08-20T23:50:33.7482251Z deleted: sha256:07cc10bece8501b1c8035d4385ad9e9867dd6e92fa32218a4dcb3e42af7e0411 2024-08-20T23:50:33.7483418Z deleted: sha256:f3e32d05099d1a3115a4722bc2e94a48752c3e965446773673808252671bb967 2024-08-20T23:50:33.7484244Z deleted: sha256:be7c3f41475e3e72ffe3ac2f92ab2f4cf49d5496b2aae738942ac3bb687d742c 2024-08-20T23:50:33.7485080Z deleted: sha256:4fcac490be825129b468cf458089f1fcf8fd56afc44ef4ab27c2eff41ab1ac90 2024-08-20T23:50:33.7485915Z deleted: sha256:31c66d80a2a4792897f267d363c0cf84fb821c5d4a275ab1636f778fd0284c08 2024-08-20T23:50:33.7486719Z deleted: sha256:8a8bcb6085e7e438e5533e8a5613e2ae5888543853568d023af3e2623a1593a9 2024-08-20T23:50:33.7487528Z deleted: sha256:2f6cb60029c79d11567b738f5bdbfb9cb1838cc0f194c4a5e6ae685178d2ed34 2024-08-20T23:50:33.7488336Z deleted: sha256:e546391804d3313f558e1ac16e93cb29a417a92e4eccaf0d4bd12af3bbcf39e3 2024-08-20T23:50:33.7489150Z deleted: sha256:1623b2aa16f2bdc6b572f6799498d9a92fa8114d07c440599b17aea72e22f8b1 2024-08-20T23:50:33.7489977Z deleted: sha256:c0386ca58b7cb7afee015b7e58d2f70525eaf73d6da2cc63868b20e14b1f9497 2024-08-20T23:50:33.7490810Z deleted: sha256:dcbf534ff289186e246531925fed90f72516eb3d63663bad234d611cdc025d62 2024-08-20T23:50:33.7491631Z deleted: sha256:0bab537af579f56c9cd51c7073fd53635fffb424b363236e0de38a7dd0e60ae8 2024-08-20T23:50:33.7492445Z deleted: sha256:d85a852ae1ee027e2fc17240ed68b87957b0a6d210c9119752d8979a0dcd55cf 2024-08-20T23:50:33.7493260Z deleted: sha256:f3821d761b555362e44cf9a1447d8fd2d95b37d54aea67c7519cd9e5db0c4d7e 2024-08-20T23:50:33.7494082Z deleted: sha256:c05e84a545db5dfcb0847c73d2b0f4749fa67aabce05705632ff7f76c84d4688 2024-08-20T23:50:33.7494904Z deleted: sha256:27054eae7ca67b2bd5ca0fd3f4488bf5c5f78e95487d8c45616f3d753d48a8b5 2024-08-20T23:50:33.7495709Z deleted: sha256:9804139f6ae97796aaa993fe4b89ea0cf111eb4d30a79f4c87c339c2e1e04fa0 2024-08-20T23:50:33.7496517Z deleted: sha256:ad6ae2fc594aaa359ff4e287323836570454eb24dd162930655e414d1d77c6dd 2024-08-20T23:50:33.7497345Z deleted: sha256:9cfbb36e328af52a248853a46aab88e266c09e2b44a03e0a42194a031b9b9453 2024-08-20T23:50:33.7498345Z deleted: sha256:a8a842bd7f37b8d50b6d12d6f95f46bbba57953db466fcbde9ba522625f024ef 2024-08-20T23:50:33.7499171Z deleted: sha256:da9738654b3c86f89ebeed2560f1bae093f1219f1eff90b0394b7f211ecabd04 2024-08-20T23:50:33.7499998Z deleted: sha256:cc683bf0cb245394e0f568984b2dd4fce1b6a3a7fe7c44734bae1aa1caaa3251 2024-08-20T23:50:33.7500822Z deleted: sha256:965f220e71c7d1ec19aaf41b1529ab287beb9d86eb8482c4c14094485ab34475 2024-08-20T23:50:33.7501646Z deleted: sha256:da32ecec41a73ce7dd29464f90c7951510a18cd378753659a78cd7fabd10dc36 2024-08-20T23:50:33.7502450Z deleted: sha256:d828d187cee9ad48dbc3702fb61d359619dd8a1ed582878680b51686bf117e5a 2024-08-20T23:50:33.7503260Z deleted: sha256:712111f4b12ff8e2787597d5fdcb043bd0824e55ddd97f262ef550506ca195f0 2024-08-20T23:50:33.7504067Z deleted: sha256:a064eea405958ad14dc6c794e5df9fd1d4515424272801ec559d45a59317309a 2024-08-20T23:50:33.7504882Z deleted: sha256:e124382d136bd5e9a8b409ca79c1f1ef76458deaf444b1b2060d3fa99dbeb506 2024-08-20T23:50:33.7505694Z deleted: sha256:6e10fe757cc190a1b31b47010f4f7610e02cb1b4b438f190dcd301aa4fe2278e 2024-08-20T23:50:33.7506517Z deleted: sha256:4cea352e10f46ca4729f96ac6c4600fc53d4c36e7658c2e0f19f4f309cd4a2a7 2024-08-20T23:50:33.7507346Z deleted: sha256:518bba00fe1d0933053066d21cac0235c9fb485abbc41557ec184b293095c924 2024-08-20T23:50:33.7508298Z deleted: sha256:a64f9ca42e9f27ff2690c15a5c84312e6efaccad45668d9b496cb542165cfb5a 2024-08-20T23:50:33.7509143Z deleted: sha256:096ea0fa14a6c420658f5276b8a8f5d264c0de7e18161ceda2cfc2f4a92cd9bf 2024-08-20T23:50:33.7509949Z deleted: sha256:6f91c94ce6e3f8034c91c66ee25c66a3d85dba9d813b749bd6d2000942a99edc 2024-08-20T23:50:33.7510770Z deleted: sha256:8f8d255eeae546cead8f9a94d237fa57a99940c0f5d51bc29a9d41c7df9cffd9 2024-08-20T23:50:33.7511608Z deleted: sha256:fe05276f4a49f91eef56bfbc3da87cfff5eb116a827fa2d30efe42ce1c134b40 2024-08-20T23:50:33.7512426Z deleted: sha256:5f83cd75d0669c813d4f58978c92e14305cd8f6a07eb9a60665a583460fa7b59 2024-08-20T23:50:33.7513219Z deleted: sha256:8f7ab6366169d39d8953129f650f1927d2fb1328b3f11e2fd9076adb5f46b93a 2024-08-20T23:50:33.7514144Z deleted: sha256:4146cfd5dba0f5308954749f98596b14a1d8f6d23bd93f7ad86c6c3d72239328 2024-08-20T23:50:33.7514984Z deleted: sha256:c6d83cb9ccc606ff63bb3c4d5a5e1ff1450c619b5aae494303a94ae25971cca0 2024-08-20T23:50:33.7515808Z deleted: sha256:71e037e0a3e0963c4565534a7387c082afcb04475d3ac629acf7a0ab2f49fadc 2024-08-20T23:50:33.7516609Z deleted: sha256:4b31135c564686bdaf23262b901237880aea635655721cc7e8c95dc42b05e06d 2024-08-20T23:50:33.7517417Z deleted: sha256:d09bd5c2f35cedcb846543941ee64ce1f684b52e4285696c93b3fb2032da8579 2024-08-20T23:50:33.7518253Z deleted: sha256:4de7fb7d4fc22212aae5fc1ceb637526916d0cced240d7c93d5edd6b0ea28013 2024-08-20T23:50:33.7519072Z deleted: sha256:69890e3e82746e10aff2f1084f11afb4b95a4a6c26b30f64b7001bc0a5fe32bf 2024-08-20T23:50:33.7519870Z deleted: sha256:0156df53b3224e645336ea52b4bb816f1e8d8c9b591748cd645e5e5649fa507b 2024-08-20T23:50:33.7520671Z deleted: sha256:0664624cb9cc4a386f31bf49919a8d8a11d9fea428d05585d9e6228f754bc7cd 2024-08-20T23:50:33.7521492Z deleted: sha256:8c2ddd5fa535c768c058a23f5cc4b6c64cdd71bb7458491282aabc7f7bb94d69 2024-08-20T23:50:33.7522375Z deleted: sha256:8dd03dbe0e1c5f47dd333074dff4bd00415f2f63727a65bf17866774e2ebbd0d 2024-08-20T23:50:33.7523303Z deleted: sha256:3c56b63e094bd18fad9da7a541d537210bca3b730c590d3641213259f6908d6f 2024-08-20T23:50:33.7524113Z deleted: sha256:51484fef07bd1266d4d6ff3d767751172660fc4cc6a1ffe883523a63c985e31e 2024-08-20T23:50:33.7524924Z deleted: sha256:03e83c94023982ab7dd8dc65a6df2024e342f1b760c91ec7a680ee45824869c7 2024-08-20T23:50:33.7525734Z deleted: sha256:58440ab3e8175b5de94a76485c8689a6dc186015475ebf4b386ebba309c5da34 2024-08-20T23:50:33.7526555Z deleted: sha256:9a980f3383e8aa511f0ef68982cb6dfc53b38d1ac8c3d673cb3ba3d45158c91e 2024-08-20T23:50:33.7527382Z deleted: sha256:cb0269c9cf1c47b6c4188ca7be4db261b5d3fc4b4a5153629e222dba7b1f9f98 2024-08-20T23:50:33.7528218Z deleted: sha256:41f1ba870cdffc05e0bf8d87b640fb9d4c153d7f4f3b775f37f94e9f3d584aad 2024-08-20T23:50:33.7529049Z deleted: sha256:7b502ab352f48e8b6eb5e6824a29f308952a5ee7c7d987562e1df7e47639d7f1 2024-08-20T23:50:33.7529857Z deleted: sha256:6ba5217e18738660e6ca8b7a7ec88845e70b0fd781301520bf46c71d99df3144 2024-08-20T23:50:33.7530676Z deleted: sha256:dd5a1c233594780163726bdbbf5de00f7b6b8dca1dace8a001340714c54baedb 2024-08-20T23:50:33.7531495Z deleted: sha256:c27f0db27da73e01f67f6cb78d10f355e350d829479ba4351d82055bb29f6597 2024-08-20T23:50:33.7532325Z deleted: sha256:4e3ce3c854f35c08be3dd95e0d6e718512a885e4614291d7d8b7cd23f48b7dd8 2024-08-20T23:50:33.7533162Z deleted: sha256:c2d6fb088bbec16e60cf0ad74b016f7287c92e659ec2db01271bc309b4dc6d83 2024-08-20T23:50:33.7533999Z deleted: sha256:35a033279d5c9bd6b862bfa9331d8fcbf98bbaf778a778fabc882384db9204f8 2024-08-20T23:50:33.7534813Z deleted: sha256:ab9b00c496073d62e69e032178858d3d6d4c4bab9e87065d3785c6da57351d00 2024-08-20T23:50:33.7535620Z deleted: sha256:7ed947299e109c2459de6e240d86f049c30f93f2380659ce441d8737b8cd065f 2024-08-20T23:50:33.7536444Z deleted: sha256:410d5a7f7a9a1cb4551c106b9cc728a9dcff598f9be231a351ce6a0a33f81e64 2024-08-20T23:50:33.7537274Z deleted: sha256:5f0021bb56efa14bb93978c01513e2a1187ba30e69bdb0546d0ef39b30873f88 2024-08-20T23:50:33.7538200Z deleted: sha256:c1601aa97eb84151c14da3aeea351201bd99144d36d66b397f6555d80245d86d 2024-08-20T23:50:33.7539173Z deleted: sha256:72af05a89be22accdc1ca5d66dcbbb33993a9ef5997f849df1d4ba4c48049f25 2024-08-20T23:50:33.7540398Z deleted: sha256:38b90c9663dcaa2bc57a4dd3008298e7ea93e9535fa42312b4dc4246e7491af9 2024-08-20T23:50:33.7541344Z deleted: sha256:bda61b6cefb3ec8eeb74fef1ca1c7f9a5845fe5e8f07b8123323e897425d5c29 2024-08-20T23:50:33.7542235Z deleted: sha256:5a18e1aa877074529a84cbddf19f8d5403787823378ceae6b72fb62f78d43037 2024-08-20T23:50:33.7543192Z deleted: sha256:6c3e7df31590f02f10cb71fc4eb27653e9b428df2e6e5421a455b062bd2e39f9 2024-08-20T23:50:33.7543740Z 2024-08-20T23:50:33.7543943Z Total reclaimed space: 49.69GB 2024-08-20T23:50:33.7640850Z Post job cleanup. 2024-08-20T23:50:33.7693058Z Post job cleanup. 2024-08-20T23:50:33.8613859Z [command]/usr/bin/git version 2024-08-20T23:50:33.8676240Z git version 2.40.1 2024-08-20T23:50:33.8715622Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/50bfda88-e423-4934-af5f-a511d0b5066c' before making global git config changes 2024-08-20T23:50:33.8716859Z Adding repository directory to the temporary git global config as a safe directory 2024-08-20T23:50:33.8720916Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-20T23:50:33.8771613Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2024-08-20T23:50:33.8817253Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2024-08-20T23:50:33.9190404Z Entering 'android/libs/fbjni' 2024-08-20T23:50:33.9254819Z Entering 'third_party/FP16' 2024-08-20T23:50:33.9323796Z Entering 'third_party/FXdiv' 2024-08-20T23:50:33.9388915Z Entering 'third_party/NNPACK' 2024-08-20T23:50:33.9455646Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T23:50:33.9522353Z Entering 'third_party/XNNPACK' 2024-08-20T23:50:33.9612621Z Entering 'third_party/benchmark' 2024-08-20T23:50:33.9684277Z Entering 'third_party/cpp-httplib' 2024-08-20T23:50:33.9754754Z Entering 'third_party/cpuinfo' 2024-08-20T23:50:33.9823579Z Entering 'third_party/cudnn_frontend' 2024-08-20T23:50:33.9893294Z Entering 'third_party/cutlass' 2024-08-20T23:50:33.9969861Z Entering 'third_party/eigen' 2024-08-20T23:50:34.0041451Z Entering 'third_party/fbgemm' 2024-08-20T23:50:34.0110435Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T23:50:34.0180006Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T23:50:34.0246223Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T23:50:34.0319499Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T23:50:34.0386764Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T23:50:34.0454690Z Entering 'third_party/flatbuffers' 2024-08-20T23:50:34.0525429Z Entering 'third_party/fmt' 2024-08-20T23:50:34.0595582Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T23:50:34.0665260Z Entering 'third_party/gloo' 2024-08-20T23:50:34.0734385Z Entering 'third_party/googletest' 2024-08-20T23:50:34.0803151Z Entering 'third_party/ideep' 2024-08-20T23:50:34.0868624Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T23:50:34.0942553Z Entering 'third_party/ittapi' 2024-08-20T23:50:34.1010973Z Entering 'third_party/kineto' 2024-08-20T23:50:34.1083298Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T23:50:34.1149422Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T23:50:34.1223965Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T23:50:34.1293647Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T23:50:34.1363493Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T23:50:34.1429236Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T23:50:34.1499816Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T23:50:34.1566581Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T23:50:34.1634027Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T23:50:34.1702256Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T23:50:34.1773485Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T23:50:34.1840601Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T23:50:34.1914392Z Entering 'third_party/mimalloc' 2024-08-20T23:50:34.1984313Z Entering 'third_party/nccl/nccl' 2024-08-20T23:50:34.2051888Z Entering 'third_party/nlohmann' 2024-08-20T23:50:34.2123963Z Entering 'third_party/onnx' 2024-08-20T23:50:34.2207598Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T23:50:34.2277996Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T23:50:34.2351112Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T23:50:34.2418653Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T23:50:34.2484766Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T23:50:34.2551260Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T23:50:34.2621291Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T23:50:34.2689634Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T23:50:34.2758540Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T23:50:34.2824844Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T23:50:34.2888966Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T23:50:34.2964092Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T23:50:34.3033626Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T23:50:34.3124686Z Entering 'third_party/pocketfft' 2024-08-20T23:50:34.3197224Z Entering 'third_party/protobuf' 2024-08-20T23:50:34.3271999Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T23:50:34.3340127Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T23:50:34.3410258Z Entering 'third_party/psimd' 2024-08-20T23:50:34.3485144Z Entering 'third_party/pthreadpool' 2024-08-20T23:50:34.3552651Z Entering 'third_party/pybind11' 2024-08-20T23:50:34.3624000Z Entering 'third_party/python-peachpy' 2024-08-20T23:50:34.3691698Z Entering 'third_party/sleef' 2024-08-20T23:50:34.3760078Z Entering 'third_party/tensorpipe' 2024-08-20T23:50:34.3830860Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T23:50:34.3897524Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T23:50:34.3964383Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T23:50:34.4030844Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T23:50:34.4095838Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T23:50:34.4192393Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2024-08-20T23:50:34.4228239Z http.https://github.com/.extraheader 2024-08-20T23:50:34.4237480Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader 2024-08-20T23:50:34.4285837Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2024-08-20T23:50:34.4648799Z Entering 'android/libs/fbjni' 2024-08-20T23:50:34.4692175Z http.https://github.com/.extraheader 2024-08-20T23:50:34.4737010Z Entering 'third_party/FP16' 2024-08-20T23:50:34.4784174Z http.https://github.com/.extraheader 2024-08-20T23:50:34.4828414Z Entering 'third_party/FXdiv' 2024-08-20T23:50:34.4877155Z http.https://github.com/.extraheader 2024-08-20T23:50:34.4924415Z Entering 'third_party/NNPACK' 2024-08-20T23:50:34.4967862Z http.https://github.com/.extraheader 2024-08-20T23:50:34.5010477Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T23:50:34.5054331Z http.https://github.com/.extraheader 2024-08-20T23:50:34.5097424Z Entering 'third_party/XNNPACK' 2024-08-20T23:50:34.5141185Z http.https://github.com/.extraheader 2024-08-20T23:50:34.5199847Z Entering 'third_party/benchmark' 2024-08-20T23:50:34.5243722Z http.https://github.com/.extraheader 2024-08-20T23:50:34.5288583Z Entering 'third_party/cpp-httplib' 2024-08-20T23:50:34.5331709Z http.https://github.com/.extraheader 2024-08-20T23:50:34.5375476Z Entering 'third_party/cpuinfo' 2024-08-20T23:50:34.5418906Z http.https://github.com/.extraheader 2024-08-20T23:50:34.5465261Z Entering 'third_party/cudnn_frontend' 2024-08-20T23:50:34.5508735Z http.https://github.com/.extraheader 2024-08-20T23:50:34.5553283Z Entering 'third_party/cutlass' 2024-08-20T23:50:34.5597777Z http.https://github.com/.extraheader 2024-08-20T23:50:34.5653580Z Entering 'third_party/eigen' 2024-08-20T23:50:34.5696408Z http.https://github.com/.extraheader 2024-08-20T23:50:34.5741656Z Entering 'third_party/fbgemm' 2024-08-20T23:50:34.5785617Z http.https://github.com/.extraheader 2024-08-20T23:50:34.5828247Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T23:50:34.5870410Z http.https://github.com/.extraheader 2024-08-20T23:50:34.5913414Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T23:50:34.5960014Z http.https://github.com/.extraheader 2024-08-20T23:50:34.6004225Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T23:50:34.6047506Z http.https://github.com/.extraheader 2024-08-20T23:50:34.6098599Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T23:50:34.6141060Z http.https://github.com/.extraheader 2024-08-20T23:50:34.6184588Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T23:50:34.6227163Z http.https://github.com/.extraheader 2024-08-20T23:50:34.6274184Z Entering 'third_party/flatbuffers' 2024-08-20T23:50:34.6318751Z http.https://github.com/.extraheader 2024-08-20T23:50:34.6366277Z Entering 'third_party/fmt' 2024-08-20T23:50:34.6409818Z http.https://github.com/.extraheader 2024-08-20T23:50:34.6454420Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T23:50:34.6497480Z http.https://github.com/.extraheader 2024-08-20T23:50:34.6541781Z Entering 'third_party/gloo' 2024-08-20T23:50:34.6586391Z http.https://github.com/.extraheader 2024-08-20T23:50:34.6630083Z Entering 'third_party/googletest' 2024-08-20T23:50:34.6673973Z http.https://github.com/.extraheader 2024-08-20T23:50:34.6719093Z Entering 'third_party/ideep' 2024-08-20T23:50:34.6762915Z http.https://github.com/.extraheader 2024-08-20T23:50:34.6804753Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T23:50:34.6847347Z http.https://github.com/.extraheader 2024-08-20T23:50:34.6899742Z Entering 'third_party/ittapi' 2024-08-20T23:50:34.6944246Z http.https://github.com/.extraheader 2024-08-20T23:50:34.6991117Z Entering 'third_party/kineto' 2024-08-20T23:50:34.7032875Z http.https://github.com/.extraheader 2024-08-20T23:50:34.7076031Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T23:50:34.7119569Z http.https://github.com/.extraheader 2024-08-20T23:50:34.7166267Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T23:50:34.7210185Z http.https://github.com/.extraheader 2024-08-20T23:50:34.7257376Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T23:50:34.7300560Z http.https://github.com/.extraheader 2024-08-20T23:50:34.7344846Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T23:50:34.7390570Z http.https://github.com/.extraheader 2024-08-20T23:50:34.7437385Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T23:50:34.7480976Z http.https://github.com/.extraheader 2024-08-20T23:50:34.7523772Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T23:50:34.7571404Z http.https://github.com/.extraheader 2024-08-20T23:50:34.7619336Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T23:50:34.7663364Z http.https://github.com/.extraheader 2024-08-20T23:50:34.7707626Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T23:50:34.7752176Z http.https://github.com/.extraheader 2024-08-20T23:50:34.7798364Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T23:50:34.7846064Z http.https://github.com/.extraheader 2024-08-20T23:50:34.7892113Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T23:50:34.7935516Z http.https://github.com/.extraheader 2024-08-20T23:50:34.7985558Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T23:50:34.8028860Z http.https://github.com/.extraheader 2024-08-20T23:50:34.8075704Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T23:50:34.8118152Z http.https://github.com/.extraheader 2024-08-20T23:50:34.8165371Z Entering 'third_party/mimalloc' 2024-08-20T23:50:34.8209306Z http.https://github.com/.extraheader 2024-08-20T23:50:34.8253569Z Entering 'third_party/nccl/nccl' 2024-08-20T23:50:34.8296957Z http.https://github.com/.extraheader 2024-08-20T23:50:34.8341704Z Entering 'third_party/nlohmann' 2024-08-20T23:50:34.8384593Z http.https://github.com/.extraheader 2024-08-20T23:50:34.8428306Z Entering 'third_party/onnx' 2024-08-20T23:50:34.8472634Z http.https://github.com/.extraheader 2024-08-20T23:50:34.8530059Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T23:50:34.8573151Z http.https://github.com/.extraheader 2024-08-20T23:50:34.8615959Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T23:50:34.8661727Z http.https://github.com/.extraheader 2024-08-20T23:50:34.8710188Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T23:50:34.8756327Z http.https://github.com/.extraheader 2024-08-20T23:50:34.8801177Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T23:50:34.8843429Z http.https://github.com/.extraheader 2024-08-20T23:50:34.8887673Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T23:50:34.8932194Z http.https://github.com/.extraheader 2024-08-20T23:50:34.8975787Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T23:50:34.9022708Z http.https://github.com/.extraheader 2024-08-20T23:50:34.9066384Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T23:50:34.9111208Z http.https://github.com/.extraheader 2024-08-20T23:50:34.9156835Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T23:50:34.9199479Z http.https://github.com/.extraheader 2024-08-20T23:50:34.9243609Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T23:50:34.9287631Z http.https://github.com/.extraheader 2024-08-20T23:50:34.9330790Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T23:50:34.9373751Z http.https://github.com/.extraheader 2024-08-20T23:50:34.9415602Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T23:50:34.9459469Z http.https://github.com/.extraheader 2024-08-20T23:50:34.9506073Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T23:50:34.9549419Z http.https://github.com/.extraheader 2024-08-20T23:50:34.9598905Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T23:50:34.9648152Z http.https://github.com/.extraheader 2024-08-20T23:50:34.9712515Z Entering 'third_party/pocketfft' 2024-08-20T23:50:34.9757943Z http.https://github.com/.extraheader 2024-08-20T23:50:34.9802121Z Entering 'third_party/protobuf' 2024-08-20T23:50:34.9846735Z http.https://github.com/.extraheader 2024-08-20T23:50:34.9893563Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T23:50:34.9940038Z http.https://github.com/.extraheader 2024-08-20T23:50:34.9983373Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T23:50:35.0025840Z http.https://github.com/.extraheader 2024-08-20T23:50:35.0073067Z Entering 'third_party/psimd' 2024-08-20T23:50:35.0117473Z http.https://github.com/.extraheader 2024-08-20T23:50:35.0162997Z Entering 'third_party/pthreadpool' 2024-08-20T23:50:35.0207417Z http.https://github.com/.extraheader 2024-08-20T23:50:35.0252329Z Entering 'third_party/pybind11' 2024-08-20T23:50:35.0297446Z http.https://github.com/.extraheader 2024-08-20T23:50:35.0342143Z Entering 'third_party/python-peachpy' 2024-08-20T23:50:35.0386876Z http.https://github.com/.extraheader 2024-08-20T23:50:35.0434580Z Entering 'third_party/sleef' 2024-08-20T23:50:35.0478704Z http.https://github.com/.extraheader 2024-08-20T23:50:35.0522899Z Entering 'third_party/tensorpipe' 2024-08-20T23:50:35.0565618Z http.https://github.com/.extraheader 2024-08-20T23:50:35.0608424Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T23:50:35.0650060Z http.https://github.com/.extraheader 2024-08-20T23:50:35.0692374Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T23:50:35.0734962Z http.https://github.com/.extraheader 2024-08-20T23:50:35.0778517Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T23:50:35.0825752Z http.https://github.com/.extraheader 2024-08-20T23:50:35.0869261Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T23:50:35.0911106Z http.https://github.com/.extraheader 2024-08-20T23:50:35.0953482Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T23:50:35.0996019Z http.https://github.com/.extraheader 2024-08-20T23:50:35.1156462Z A job completed hook has been configured by the self-hosted runner administrator 2024-08-20T23:50:35.1178144Z ##[group]Run '/home/ec2-user/runner-scripts/after_job.sh' 2024-08-20T23:50:35.1186232Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T23:50:35.1186748Z ##[endgroup] 2024-08-20T23:50:42.0878046Z Cleaning up orphan processes