2024-08-20T22:04:58.1616472Z Current runner version: '2.319.1' 2024-08-20T22:04:58.1622782Z Runner name: 'i-02ff85e28d998fa83' 2024-08-20T22:04:58.1623595Z Runner group name: 'Default' 2024-08-20T22:04:58.1624455Z Machine name: 'ip-10-0-74-254' 2024-08-20T22:04:58.1640959Z Testing runner upgrade compatibility 2024-08-20T22:04:58.3609654Z ##[group]GITHUB_TOKEN Permissions 2024-08-20T22:04:58.3611453Z Actions: read 2024-08-20T22:04:58.3611933Z Attestations: read 2024-08-20T22:04:58.3612346Z Checks: read 2024-08-20T22:04:58.3612760Z Contents: read 2024-08-20T22:04:58.3613213Z Deployments: read 2024-08-20T22:04:58.3613611Z Discussions: read 2024-08-20T22:04:58.3614069Z Issues: read 2024-08-20T22:04:58.3614502Z Metadata: read 2024-08-20T22:04:58.3614886Z Packages: read 2024-08-20T22:04:58.3615279Z Pages: read 2024-08-20T22:04:58.3615707Z PullRequests: read 2024-08-20T22:04:58.3616147Z RepositoryProjects: read 2024-08-20T22:04:58.3616565Z SecurityEvents: read 2024-08-20T22:04:58.3617028Z Statuses: read 2024-08-20T22:04:58.3617612Z ##[endgroup] 2024-08-20T22:04:58.3620667Z Secret source: Actions 2024-08-20T22:04:58.3621225Z Prepare workflow directory 2024-08-20T22:04:58.4549810Z Prepare all required actions 2024-08-20T22:04:58.4715987Z Getting action download info 2024-08-20T22:04:58.6480647Z Download action repository 'pytorch/test-infra@main' (SHA:0c3a2634aaa2f638c8f640e743f03d696ce1191f) 2024-08-20T22:04:59.2342789Z Download action repository 'pytorch/pytorch@main' (SHA:1ae5d5bb62141d7c9b1b0b66c66a462b4e10b1f2) 2024-08-20T22:05:03.3107933Z Download action repository 'aws-actions/configure-aws-credentials@v3' (SHA:50ac8dd1e1b10d09dac7b8727528b91bed831ac0) 2024-08-20T22:05:03.5569866Z Download action repository 'seemethere/upload-artifact-s3@v5' (SHA:baba72d0712b404f646cebe0730933554ebce96a) 2024-08-20T22:05:03.8039789Z Getting action download info 2024-08-20T22:05:03.8934381Z Download action repository 'malfet/checkout@silent-checkout' (SHA:e07af140b3ccefc05679e3755b9db68f4ee4589c) 2024-08-20T22:05:04.1078603Z Getting action download info 2024-08-20T22:05:04.2734123Z Download action repository 'nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482' (SHA:3e91a01664abd3c5cd539100d10d33b9c5b68482) 2024-08-20T22:05:04.4272751Z Uses: pytorch/pytorch/.github/workflows/_linux-test.yml@refs/tags/ciflow/inductor/133712 (40ec5f6ddd9787aca0449b24128343ff4c4a88b3) 2024-08-20T22:05:04.4275107Z ##[group] Inputs 2024-08-20T22:05:04.4275615Z build-environment: linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-08-20T22:05:04.4282607Z test-matrix: {"include": [{"config": "dynamo_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}]} 2024-08-20T22:05:04.4290401Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:05:04.4291558Z sync-tag: 2024-08-20T22:05:04.4292377Z timeout-minutes: 240 2024-08-20T22:05:04.4292717Z use-gha: 2024-08-20T22:05:04.4293007Z dashboard-tag: 2024-08-20T22:05:04.4293330Z s3-bucket: gha-artifacts 2024-08-20T22:05:04.4293679Z aws-role-to-assume: 2024-08-20T22:05:04.4294013Z ##[endgroup] 2024-08-20T22:05:04.4295046Z Complete job name: cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (dynamic_aot_eager_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:05:04.5016351Z A job started hook has been configured by the self-hosted runner administrator 2024-08-20T22:05:04.5159080Z ##[group]Run '/home/ec2-user/runner-scripts/before_job.sh' 2024-08-20T22:05:04.5171341Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:05:04.5171880Z ##[endgroup] 2024-08-20T22:05:05.7347045Z Runner Type: linux.g5.4xlarge.nvidia.gpu 2024-08-20T22:05:05.7347601Z Instance Type: g5.4xlarge 2024-08-20T22:05:05.7348289Z AMI Name: al2023-ami-2023.5.20240701.0-kernel-6.1-x86_64 2024-08-20T22:05:05.7348834Z AMI ID: ami-06c68f701d8090592 2024-08-20T22:05:11.5133595Z ##[group]Run pytorch/test-infra/.github/actions/setup-ssh@main 2024-08-20T22:05:11.5134136Z with: 2024-08-20T22:05:11.5134987Z github-secret: *** 2024-08-20T22:05:11.5135913Z instructions: All testing is done inside the container, to start an interactive session run: docker exec -it $(docker container ps --format '{{.ID}}') bash 2024-08-20T22:05:11.5136888Z activate-with-label: false 2024-08-20T22:05:11.5137245Z label: with-ssh 2024-08-20T22:05:11.5137569Z remove-existing-keys: true 2024-08-20T22:05:11.5137929Z fail-silently: true 2024-08-20T22:05:11.5138237Z env: 2024-08-20T22:05:11.5138511Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:05:11.5138865Z ##[endgroup] 2024-08-20T22:05:11.6032919Z Please see https://github.com/pytorch/pytorch/wiki/Debugging-using-with-ssh-for-Github-Actions for more info. 2024-08-20T22:05:11.6035537Z ciflow reference detected, attempting to extract PR number 2024-08-20T22:05:11.8521187Z Grabbing public ssh keys from https://github.com/pytorch-bot[bot].keys 2024-08-20T22:05:11.9319755Z No SSH keys found for user pytorch-bot[bot] 2024-08-20T22:05:11.9320377Z Grabbing public ssh keys from https://github.com/XuehaiPan.keys 2024-08-20T22:05:12.0420089Z ~/.ssh/authorized_keys file found on node, removing ~/.ssh and starting fresh 2024-08-20T22:05:12.0434783Z Public keys pulled and installed to /home/ec2-user/.ssh/authorized_keys 2024-08-20T22:05:12.0458463Z Login using: ssh ec2-user@ec2-44-221-73-42.compute-1.amazonaws.com 2024-08-20T22:05:12.0459226Z All testing is done inside the container, to start an interactive session run: 2024-08-20T22:05:12.0460020Z docker exec -it $(docker container ps --format '{{.ID}}') bash 2024-08-20T22:05:12.0590312Z ##[group]Run pytorch/pytorch/.github/actions/checkout-pytorch@main 2024-08-20T22:05:12.0590866Z with: 2024-08-20T22:05:12.0591153Z submodules: recursive 2024-08-20T22:05:12.0591490Z fetch-depth: 0 2024-08-20T22:05:12.0591787Z env: 2024-08-20T22:05:12.0592070Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:05:12.0592410Z ##[endgroup] 2024-08-20T22:05:12.0785488Z ##[group]Run retry () { 2024-08-20T22:05:12.0785876Z retry () { 2024-08-20T22:05:12.0786391Z  $* || (sleep 1 && $*) || (sleep 2 && $*) || (sleep 4 && $*) || (sleep 8 && $*) 2024-08-20T22:05:12.0786941Z } 2024-08-20T22:05:12.0787250Z echo "${GITHUB_WORKSPACE}" 2024-08-20T22:05:12.0787674Z if [ -z "${NO_SUDO}" ]; then 2024-08-20T22:05:12.0788149Z  retry sudo rm -rf "${GITHUB_WORKSPACE}" 2024-08-20T22:05:12.0788608Z else 2024-08-20T22:05:12.0788954Z  retry rm -rf "${GITHUB_WORKSPACE}" 2024-08-20T22:05:12.0789381Z fi 2024-08-20T22:05:12.0789919Z mkdir "${GITHUB_WORKSPACE}" 2024-08-20T22:05:12.0801986Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:05:12.0802497Z env: 2024-08-20T22:05:12.0802780Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:05:12.0803126Z NO_SUDO: 2024-08-20T22:05:12.0803407Z ##[endgroup] 2024-08-20T22:05:12.0835763Z /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-20T22:05:12.3024628Z ##[group]Run malfet/checkout@silent-checkout 2024-08-20T22:05:12.3025058Z with: 2024-08-20T22:05:12.3025380Z ref: 40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:05:12.3025814Z fetch-depth: 0 2024-08-20T22:05:12.3026121Z submodules: recursive 2024-08-20T22:05:12.3026448Z quiet-checkout: true 2024-08-20T22:05:12.3026791Z repository: pytorch/pytorch 2024-08-20T22:05:12.3027266Z token: *** 2024-08-20T22:05:12.3027551Z ssh-strict: true 2024-08-20T22:05:12.3027870Z persist-credentials: true 2024-08-20T22:05:12.3028218Z clean: true 2024-08-20T22:05:12.3028560Z sparse-checkout-cone-mode: true 2024-08-20T22:05:12.3028938Z lfs: false 2024-08-20T22:05:12.3029227Z set-safe-directory: true 2024-08-20T22:05:12.3029560Z env: 2024-08-20T22:05:12.3029826Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:05:12.3030154Z ##[endgroup] 2024-08-20T22:05:12.3999208Z Syncing repository: pytorch/pytorch 2024-08-20T22:05:12.4000690Z ##[group]Getting Git version info 2024-08-20T22:05:12.4001463Z Working directory is '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2024-08-20T22:05:12.4002294Z [command]/usr/bin/git version 2024-08-20T22:05:12.4002648Z git version 2.40.1 2024-08-20T22:05:12.4004146Z ##[endgroup] 2024-08-20T22:05:12.4018493Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/cae912c2-1f20-4c60-b7ba-bb6fd7b648ac' before making global git config changes 2024-08-20T22:05:12.4019726Z Adding repository directory to the temporary git global config as a safe directory 2024-08-20T22:05:12.4023166Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-20T22:05:12.4074465Z Deleting the contents of '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2024-08-20T22:05:12.4078734Z ##[group]Initializing the repository 2024-08-20T22:05:12.4081435Z [command]/usr/bin/git init /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-20T22:05:12.4124690Z hint: Using 'master' as the name for the initial branch. This default branch name 2024-08-20T22:05:12.4125575Z hint: is subject to change. To configure the initial branch name to use in all 2024-08-20T22:05:12.4126378Z hint: of your new repositories, which will suppress this warning, call: 2024-08-20T22:05:12.4126963Z hint: 2024-08-20T22:05:12.4127429Z hint: git config --global init.defaultBranch 2024-08-20T22:05:12.4127908Z hint: 2024-08-20T22:05:12.4128452Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-08-20T22:05:12.4129297Z hint: 'development'. The just-created branch can be renamed via this command: 2024-08-20T22:05:12.4130190Z hint: 2024-08-20T22:05:12.4130528Z hint: git branch -m 2024-08-20T22:05:12.4131279Z Initialized empty Git repository in /home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/ 2024-08-20T22:05:12.4138132Z [command]/usr/bin/git remote add origin https://github.com/pytorch/pytorch 2024-08-20T22:05:12.4180590Z ##[endgroup] 2024-08-20T22:05:12.4181216Z ##[group]Disabling automatic garbage collection 2024-08-20T22:05:12.4183593Z [command]/usr/bin/git config --local gc.auto 0 2024-08-20T22:05:12.4227329Z ##[endgroup] 2024-08-20T22:05:12.4227860Z ##[group]Setting up auth 2024-08-20T22:05:12.4233656Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2024-08-20T22:05:12.4276097Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2024-08-20T22:05:12.4673121Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2024-08-20T22:05:12.4715021Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2024-08-20T22:05:12.5068714Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic *** 2024-08-20T22:05:12.5125742Z ##[endgroup] 2024-08-20T22:05:12.5126309Z ##[group]Fetching the repository 2024-08-20T22:05:12.5132657Z [command]/usr/bin/git -c protocol.version=2 fetch --prune --progress --no-recurse-submodules --quiet origin +refs/heads/*:refs/remotes/origin/* +refs/tags/*:refs/tags/* 2024-08-20T22:05:15.0748438Z remote: Enumerating objects: 1008452 2024-08-20T22:05:15.0749243Z remote: Enumerating objects: 1010208, done. 2024-08-20T22:05:15.0750361Z remote: Counting objects: 0% (1/1756) 2024-08-20T22:05:15.0751210Z remote: Counting objects: 1% (18/1756) 2024-08-20T22:05:15.0752029Z remote: Counting objects: 2% (36/1756) 2024-08-20T22:05:15.0752725Z remote: Counting objects: 3% (53/1756) 2024-08-20T22:05:15.0753565Z remote: Counting objects: 4% (71/1756) 2024-08-20T22:05:15.0754390Z remote: Counting objects: 5% (88/1756) 2024-08-20T22:05:15.0755324Z remote: Counting objects: 6% (106/1756) 2024-08-20T22:05:15.0756178Z remote: Counting objects: 7% (123/1756) 2024-08-20T22:05:15.0757037Z remote: Counting objects: 8% (141/1756) 2024-08-20T22:05:15.0758100Z remote: Counting objects: 9% (159/1756) 2024-08-20T22:05:15.0758707Z remote: Counting objects: 10% (176/1756) 2024-08-20T22:05:15.0759379Z remote: Counting objects: 11% (194/1756) 2024-08-20T22:05:15.0760278Z remote: Counting objects: 12% (211/1756) 2024-08-20T22:05:15.0761108Z remote: Counting objects: 13% (229/1756) 2024-08-20T22:05:15.0762099Z remote: Counting objects: 14% (246/1756) 2024-08-20T22:05:15.0762960Z remote: Counting objects: 15% (264/1756) 2024-08-20T22:05:15.0763899Z remote: Counting objects: 16% (281/1756) 2024-08-20T22:05:15.0764788Z remote: Counting objects: 17% (299/1756) 2024-08-20T22:05:15.0765488Z remote: Counting objects: 18% (317/1756) 2024-08-20T22:05:15.0766369Z remote: Counting objects: 19% (334/1756) 2024-08-20T22:05:15.0767219Z remote: Counting objects: 20% (352/1756) 2024-08-20T22:05:15.0768070Z remote: Counting objects: 21% (369/1756) 2024-08-20T22:05:15.0768862Z remote: Counting objects: 22% (387/1756) 2024-08-20T22:05:15.0769796Z remote: Counting objects: 23% (404/1756) 2024-08-20T22:05:15.0770833Z remote: Counting objects: 24% (422/1756) 2024-08-20T22:05:15.0771547Z remote: Counting objects: 25% (439/1756) 2024-08-20T22:05:15.0772029Z remote: Counting objects: 26% (457/1756) 2024-08-20T22:05:15.0772520Z remote: Counting objects: 27% (475/1756) 2024-08-20T22:05:15.0773288Z remote: Counting objects: 28% (492/1756) 2024-08-20T22:05:15.0773909Z remote: Counting objects: 29% (510/1756) 2024-08-20T22:05:15.0774634Z remote: Counting objects: 30% (527/1756) 2024-08-20T22:05:15.0775200Z remote: Counting objects: 31% (545/1756) 2024-08-20T22:05:15.0775693Z remote: Counting objects: 32% (562/1756) 2024-08-20T22:05:15.0776179Z remote: Counting objects: 33% (580/1756) 2024-08-20T22:05:15.0776672Z remote: Counting objects: 34% (598/1756) 2024-08-20T22:05:15.0777172Z remote: Counting objects: 35% (615/1756) 2024-08-20T22:05:15.0777668Z remote: Counting objects: 36% (633/1756) 2024-08-20T22:05:15.0778162Z remote: Counting objects: 37% (650/1756) 2024-08-20T22:05:15.0778650Z remote: Counting objects: 38% (668/1756) 2024-08-20T22:05:15.0779141Z remote: Counting objects: 39% (685/1756) 2024-08-20T22:05:15.0779630Z remote: Counting objects: 40% (703/1756) 2024-08-20T22:05:15.0780319Z remote: Counting objects: 41% (720/1756) 2024-08-20T22:05:15.0780814Z remote: Counting objects: 42% (738/1756) 2024-08-20T22:05:15.0781308Z remote: Counting objects: 43% (756/1756) 2024-08-20T22:05:15.0781801Z remote: Counting objects: 44% (773/1756) 2024-08-20T22:05:15.0782287Z remote: Counting objects: 45% (791/1756) 2024-08-20T22:05:15.0782780Z remote: Counting objects: 46% (808/1756) 2024-08-20T22:05:15.0783272Z remote: Counting objects: 47% (826/1756) 2024-08-20T22:05:15.0783762Z remote: Counting objects: 48% (843/1756) 2024-08-20T22:05:15.0784252Z remote: Counting objects: 49% (861/1756) 2024-08-20T22:05:15.0784850Z remote: Counting objects: 50% (878/1756) 2024-08-20T22:05:15.0785341Z remote: Counting objects: 51% (896/1756) 2024-08-20T22:05:15.0785834Z remote: Counting objects: 52% (914/1756) 2024-08-20T22:05:15.0786327Z remote: Counting objects: 53% (931/1756) 2024-08-20T22:05:15.0786830Z remote: Counting objects: 54% (949/1756) 2024-08-20T22:05:15.0787322Z remote: Counting objects: 55% (966/1756) 2024-08-20T22:05:15.0787810Z remote: Counting objects: 56% (984/1756) 2024-08-20T22:05:15.0788308Z remote: Counting objects: 57% (1001/1756) 2024-08-20T22:05:15.0788829Z remote: Counting objects: 58% (1019/1756) 2024-08-20T22:05:15.0789350Z remote: Counting objects: 59% (1037/1756) 2024-08-20T22:05:15.0789875Z remote: Counting objects: 60% (1054/1756) 2024-08-20T22:05:15.0790388Z remote: Counting objects: 61% (1072/1756) 2024-08-20T22:05:15.0790899Z remote: Counting objects: 62% (1089/1756) 2024-08-20T22:05:15.0791425Z remote: Counting objects: 63% (1107/1756) 2024-08-20T22:05:15.0791942Z remote: Counting objects: 64% (1124/1756) 2024-08-20T22:05:15.0792454Z remote: Counting objects: 65% (1142/1756) 2024-08-20T22:05:15.0792995Z remote: Counting objects: 66% (1159/1756) 2024-08-20T22:05:15.0793502Z remote: Counting objects: 67% (1177/1756) 2024-08-20T22:05:15.0794007Z remote: Counting objects: 68% (1195/1756) 2024-08-20T22:05:15.0794512Z remote: Counting objects: 69% (1212/1756) 2024-08-20T22:05:15.0795026Z remote: Counting objects: 70% (1230/1756) 2024-08-20T22:05:15.0795526Z remote: Counting objects: 71% (1247/1756) 2024-08-20T22:05:15.0796031Z remote: Counting objects: 72% (1265/1756) 2024-08-20T22:05:15.0796537Z remote: Counting objects: 73% (1282/1756) 2024-08-20T22:05:15.0797046Z remote: Counting objects: 74% (1300/1756) 2024-08-20T22:05:15.0797548Z remote: Counting objects: 75% (1317/1756) 2024-08-20T22:05:15.0798051Z remote: Counting objects: 76% (1335/1756) 2024-08-20T22:05:15.0798558Z remote: Counting objects: 77% (1353/1756) 2024-08-20T22:05:15.0799056Z remote: Counting objects: 78% (1370/1756) 2024-08-20T22:05:15.0799661Z remote: Counting objects: 79% (1388/1756) 2024-08-20T22:05:15.0800165Z remote: Counting objects: 80% (1405/1756) 2024-08-20T22:05:15.0800663Z remote: Counting objects: 81% (1423/1756) 2024-08-20T22:05:15.0801159Z remote: Counting objects: 82% (1440/1756) 2024-08-20T22:05:15.0801655Z remote: Counting objects: 83% (1458/1756) 2024-08-20T22:05:15.0802206Z remote: Counting objects: 84% (1476/1756) 2024-08-20T22:05:15.0802701Z remote: Counting objects: 85% (1493/1756) 2024-08-20T22:05:15.0803191Z remote: Counting objects: 86% (1511/1756) 2024-08-20T22:05:15.0803687Z remote: Counting objects: 87% (1528/1756) 2024-08-20T22:05:15.0804184Z remote: Counting objects: 88% (1546/1756) 2024-08-20T22:05:15.0804686Z remote: Counting objects: 89% (1563/1756) 2024-08-20T22:05:15.0805175Z remote: Counting objects: 90% (1581/1756) 2024-08-20T22:05:15.0805680Z remote: Counting objects: 91% (1598/1756) 2024-08-20T22:05:15.0806283Z remote: Counting objects: 92% (1616/1756) 2024-08-20T22:05:15.0806781Z remote: Counting objects: 93% (1634/1756) 2024-08-20T22:05:15.0807276Z remote: Counting objects: 94% (1651/1756) 2024-08-20T22:05:15.0807771Z remote: Counting objects: 95% (1669/1756) 2024-08-20T22:05:15.0808265Z remote: Counting objects: 96% (1686/1756) 2024-08-20T22:05:15.0808764Z remote: Counting objects: 97% (1704/1756) 2024-08-20T22:05:15.0809256Z remote: Counting objects: 98% (1721/1756) 2024-08-20T22:05:15.0809751Z remote: Counting objects: 99% (1739/1756) 2024-08-20T22:05:15.0810250Z remote: Counting objects: 100% (1756/1756) 2024-08-20T22:05:15.0810785Z remote: Counting objects: 100% (1756/1756), done. 2024-08-20T22:05:15.0906067Z remote: Compressing objects: 0% (1/837) 2024-08-20T22:05:15.1167300Z remote: Compressing objects: 1% (9/837) 2024-08-20T22:05:15.1505009Z remote: Compressing objects: 2% (17/837) 2024-08-20T22:05:15.1902803Z remote: Compressing objects: 3% (26/837) 2024-08-20T22:05:15.2604609Z remote: Compressing objects: 4% (34/837) 2024-08-20T22:05:15.3025996Z remote: Compressing objects: 5% (42/837) 2024-08-20T22:05:15.3589236Z remote: Compressing objects: 6% (51/837) 2024-08-20T22:05:15.3907642Z remote: Compressing objects: 7% (59/837) 2024-08-20T22:05:15.4270901Z remote: Compressing objects: 8% (67/837) 2024-08-20T22:05:15.4475939Z remote: Compressing objects: 9% (76/837) 2024-08-20T22:05:15.4726758Z remote: Compressing objects: 10% (84/837) 2024-08-20T22:05:15.4923610Z remote: Compressing objects: 11% (93/837) 2024-08-20T22:05:15.5091132Z remote: Compressing objects: 12% (101/837) 2024-08-20T22:05:15.5249557Z remote: Compressing objects: 13% (109/837) 2024-08-20T22:05:15.5363467Z remote: Compressing objects: 14% (118/837) 2024-08-20T22:05:15.5445328Z remote: Compressing objects: 15% (126/837) 2024-08-20T22:05:15.5531961Z remote: Compressing objects: 16% (134/837) 2024-08-20T22:05:15.5587413Z remote: Compressing objects: 17% (143/837) 2024-08-20T22:05:15.5637227Z remote: Compressing objects: 18% (151/837) 2024-08-20T22:05:15.5676633Z remote: Compressing objects: 19% (160/837) 2024-08-20T22:05:15.5707436Z remote: Compressing objects: 20% (168/837) 2024-08-20T22:05:15.5728970Z remote: Compressing objects: 21% (176/837) 2024-08-20T22:05:15.5732158Z remote: Compressing objects: 22% (185/837) 2024-08-20T22:05:15.5736487Z remote: Compressing objects: 23% (193/837) 2024-08-20T22:05:15.5741966Z remote: Compressing objects: 24% (201/837) 2024-08-20T22:05:15.5746589Z remote: Compressing objects: 25% (210/837) 2024-08-20T22:05:15.5754218Z remote: Compressing objects: 26% (218/837) 2024-08-20T22:05:15.5764075Z remote: Compressing objects: 27% (226/837) 2024-08-20T22:05:15.5783530Z remote: Compressing objects: 28% (235/837) 2024-08-20T22:05:15.5787238Z remote: Compressing objects: 29% (243/837) 2024-08-20T22:05:15.5798832Z remote: Compressing objects: 30% (252/837) 2024-08-20T22:05:15.5807712Z remote: Compressing objects: 31% (260/837) 2024-08-20T22:05:15.5815218Z remote: Compressing objects: 32% (268/837) 2024-08-20T22:05:15.5820358Z remote: Compressing objects: 33% (277/837) 2024-08-20T22:05:15.5824468Z remote: Compressing objects: 34% (285/837) 2024-08-20T22:05:15.5831924Z remote: Compressing objects: 35% (293/837) 2024-08-20T22:05:15.5838022Z remote: Compressing objects: 36% (302/837) 2024-08-20T22:05:15.5846818Z remote: Compressing objects: 37% (310/837) 2024-08-20T22:05:15.5852299Z remote: Compressing objects: 38% (319/837) 2024-08-20T22:05:15.5858300Z remote: Compressing objects: 39% (327/837) 2024-08-20T22:05:15.5863840Z remote: Compressing objects: 40% (335/837) 2024-08-20T22:05:15.5870021Z remote: Compressing objects: 41% (344/837) 2024-08-20T22:05:15.5877405Z remote: Compressing objects: 42% (352/837) 2024-08-20T22:05:15.5882152Z remote: Compressing objects: 43% (360/837) 2024-08-20T22:05:15.5888505Z remote: Compressing objects: 44% (369/837) 2024-08-20T22:05:15.5893782Z remote: Compressing objects: 45% (377/837) 2024-08-20T22:05:15.5897030Z remote: Compressing objects: 46% (386/837) 2024-08-20T22:05:15.5900322Z remote: Compressing objects: 47% (394/837) 2024-08-20T22:05:15.5903700Z remote: Compressing objects: 48% (402/837) 2024-08-20T22:05:15.5906199Z remote: Compressing objects: 49% (411/837) 2024-08-20T22:05:15.5908858Z remote: Compressing objects: 50% (419/837) 2024-08-20T22:05:15.5912397Z remote: Compressing objects: 51% (427/837) 2024-08-20T22:05:15.5913547Z remote: Compressing objects: 52% (436/837) 2024-08-20T22:05:15.5915607Z remote: Compressing objects: 53% (444/837) 2024-08-20T22:05:15.5916764Z remote: Compressing objects: 54% (452/837) 2024-08-20T22:05:15.5918209Z remote: Compressing objects: 55% (461/837) 2024-08-20T22:05:15.5919720Z remote: Compressing objects: 56% (469/837) 2024-08-20T22:05:15.5920317Z remote: Compressing objects: 57% (478/837) 2024-08-20T22:05:15.5920860Z remote: Compressing objects: 58% (486/837) 2024-08-20T22:05:15.5921401Z remote: Compressing objects: 59% (494/837) 2024-08-20T22:05:15.5921979Z remote: Compressing objects: 60% (503/837) 2024-08-20T22:05:15.5922509Z remote: Compressing objects: 61% (511/837) 2024-08-20T22:05:15.5923032Z remote: Compressing objects: 62% (519/837) 2024-08-20T22:05:15.5923551Z remote: Compressing objects: 63% (528/837) 2024-08-20T22:05:15.5928481Z remote: Compressing objects: 64% (536/837) 2024-08-20T22:05:15.5934147Z remote: Compressing objects: 65% (545/837) 2024-08-20T22:05:15.5939277Z remote: Compressing objects: 66% (553/837) 2024-08-20T22:05:15.5943856Z remote: Compressing objects: 67% (561/837) 2024-08-20T22:05:15.5947666Z remote: Compressing objects: 68% (570/837) 2024-08-20T22:05:15.5951480Z remote: Compressing objects: 69% (578/837) 2024-08-20T22:05:15.5955522Z remote: Compressing objects: 70% (586/837) 2024-08-20T22:05:15.5958219Z remote: Compressing objects: 71% (595/837) 2024-08-20T22:05:15.5961614Z remote: Compressing objects: 72% (603/837) 2024-08-20T22:05:15.5964796Z remote: Compressing objects: 73% (612/837) 2024-08-20T22:05:15.5967567Z remote: Compressing objects: 74% (620/837) 2024-08-20T22:05:15.5970890Z remote: Compressing objects: 75% (628/837) 2024-08-20T22:05:15.5972948Z remote: Compressing objects: 76% (637/837) 2024-08-20T22:05:15.5975409Z remote: Compressing objects: 77% (645/837) 2024-08-20T22:05:15.5977889Z remote: Compressing objects: 78% (653/837) 2024-08-20T22:05:15.5979625Z remote: Compressing objects: 79% (662/837) 2024-08-20T22:05:15.5980674Z remote: Compressing objects: 80% (670/837) 2024-08-20T22:05:15.5983421Z remote: Compressing objects: 81% (678/837) 2024-08-20T22:05:15.5984789Z remote: Compressing objects: 82% (687/837) 2024-08-20T22:05:15.5986711Z remote: Compressing objects: 83% (695/837) 2024-08-20T22:05:15.5988215Z remote: Compressing objects: 84% (704/837) 2024-08-20T22:05:15.5989486Z remote: Compressing objects: 85% (712/837) 2024-08-20T22:05:15.5991531Z remote: Compressing objects: 86% (720/837) 2024-08-20T22:05:15.5992667Z remote: Compressing objects: 87% (729/837) 2024-08-20T22:05:15.5994500Z remote: Compressing objects: 88% (737/837) 2024-08-20T22:05:15.5996859Z remote: Compressing objects: 89% (745/837) 2024-08-20T22:05:15.5998940Z remote: Compressing objects: 90% (754/837) 2024-08-20T22:05:15.6000078Z remote: Compressing objects: 91% (762/837) 2024-08-20T22:05:15.6000840Z remote: Compressing objects: 92% (771/837) 2024-08-20T22:05:15.6001478Z remote: Compressing objects: 93% (779/837) 2024-08-20T22:05:15.6002536Z remote: Compressing objects: 94% (787/837) 2024-08-20T22:05:15.6003502Z remote: Compressing objects: 95% (796/837) 2024-08-20T22:05:15.6005373Z remote: Compressing objects: 96% (804/837) 2024-08-20T22:05:15.6006020Z remote: Compressing objects: 97% (812/837) 2024-08-20T22:05:15.6007021Z remote: Compressing objects: 98% (821/837) 2024-08-20T22:05:15.6008260Z remote: Compressing objects: 99% (829/837) 2024-08-20T22:05:15.6009203Z remote: Compressing objects: 100% (837/837) 2024-08-20T22:05:15.6009772Z remote: Compressing objects: 100% (837/837), done. 2024-08-20T22:05:39.0584902Z remote: Total 1010208 (delta 1154), reused 1394 (delta 916), pack-reused 1008452 (from 1) 2024-08-20T22:06:02.4717395Z [command]/usr/bin/git rev-parse --verify --quiet 40ec5f6ddd9787aca0449b24128343ff4c4a88b3^{object} 2024-08-20T22:06:02.4754560Z 40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:06:02.4760178Z ##[endgroup] 2024-08-20T22:06:02.4760834Z ##[group]Determining the checkout info 2024-08-20T22:06:02.4761728Z ##[endgroup] 2024-08-20T22:06:02.4762234Z ##[group]Checking out the ref 2024-08-20T22:06:02.4765366Z [command]/usr/bin/git checkout --quiet --force 40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:06:04.1855354Z ##[endgroup] 2024-08-20T22:06:04.1855977Z ##[group]Setting up auth for fetching submodules 2024-08-20T22:06:04.1862321Z [command]/usr/bin/git config --global http.https://github.com/.extraheader AUTHORIZATION: basic *** 2024-08-20T22:06:04.1919403Z [command]/usr/bin/git config --global --unset-all url.https://github.com/.insteadOf 2024-08-20T22:06:04.1958599Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf git@github.com: 2024-08-20T22:06:04.1998049Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf org-21003710@github.com: 2024-08-20T22:06:04.2034636Z ##[endgroup] 2024-08-20T22:06:04.2035217Z ##[group]Fetching submodules 2024-08-20T22:06:04.2038359Z [command]/usr/bin/git submodule sync --recursive 2024-08-20T22:06:04.2413703Z [command]/usr/bin/git -c protocol.version=2 submodule update --init --force --recursive 2024-08-20T22:06:04.2774516Z Submodule 'android/libs/fbjni' (https://github.com/facebookincubator/fbjni.git) registered for path 'android/libs/fbjni' 2024-08-20T22:06:04.2776284Z Submodule 'third_party/NNPACK_deps/FP16' (https://github.com/Maratyszcza/FP16.git) registered for path 'third_party/FP16' 2024-08-20T22:06:04.2779545Z Submodule 'third_party/NNPACK_deps/FXdiv' (https://github.com/Maratyszcza/FXdiv.git) registered for path 'third_party/FXdiv' 2024-08-20T22:06:04.2782798Z Submodule 'third_party/NNPACK' (https://github.com/Maratyszcza/NNPACK.git) registered for path 'third_party/NNPACK' 2024-08-20T22:06:04.2787069Z Submodule 'third_party/VulkanMemoryAllocator' (https://github.com/GPUOpen-LibrariesAndSDKs/VulkanMemoryAllocator.git) registered for path 'third_party/VulkanMemoryAllocator' 2024-08-20T22:06:04.2789629Z Submodule 'third_party/XNNPACK' (https://github.com/google/XNNPACK.git) registered for path 'third_party/XNNPACK' 2024-08-20T22:06:04.2793347Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/benchmark' 2024-08-20T22:06:04.2797102Z Submodule 'third_party/cpp-httplib' (https://github.com/yhirose/cpp-httplib.git) registered for path 'third_party/cpp-httplib' 2024-08-20T22:06:04.2800735Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo.git) registered for path 'third_party/cpuinfo' 2024-08-20T22:06:04.2804599Z Submodule 'third_party/cudnn_frontend' (https://github.com/NVIDIA/cudnn-frontend.git) registered for path 'third_party/cudnn_frontend' 2024-08-20T22:06:04.2808276Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/cutlass' 2024-08-20T22:06:04.2812230Z Submodule 'third_party/eigen' (https://gitlab.com/libeigen/eigen.git) registered for path 'third_party/eigen' 2024-08-20T22:06:04.2816217Z Submodule 'third_party/fbgemm' (https://github.com/pytorch/fbgemm) registered for path 'third_party/fbgemm' 2024-08-20T22:06:04.2820282Z Submodule 'third_party/flatbuffers' (https://github.com/google/flatbuffers.git) registered for path 'third_party/flatbuffers' 2024-08-20T22:06:04.2824224Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/fmt' 2024-08-20T22:06:04.2828796Z Submodule 'third_party/gemmlowp/gemmlowp' (https://github.com/google/gemmlowp.git) registered for path 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:06:04.2836499Z Submodule 'third_party/gloo' (https://github.com/facebookincubator/gloo) registered for path 'third_party/gloo' 2024-08-20T22:06:04.2840786Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/googletest' 2024-08-20T22:06:04.2845326Z Submodule 'third_party/ideep' (https://github.com/intel/ideep) registered for path 'third_party/ideep' 2024-08-20T22:06:04.2850000Z Submodule 'third_party/ittapi' (https://github.com/intel/ittapi.git) registered for path 'third_party/ittapi' 2024-08-20T22:06:04.2854757Z Submodule 'third_party/kineto' (https://github.com/pytorch/kineto) registered for path 'third_party/kineto' 2024-08-20T22:06:04.2859481Z Submodule 'third_party/mimalloc' (https://github.com/microsoft/mimalloc.git) registered for path 'third_party/mimalloc' 2024-08-20T22:06:04.2864195Z Submodule 'third_party/nccl/nccl' (https://github.com/NVIDIA/nccl) registered for path 'third_party/nccl/nccl' 2024-08-20T22:06:04.2869265Z Submodule 'third_party/nlohmann' (https://github.com/nlohmann/json.git) registered for path 'third_party/nlohmann' 2024-08-20T22:06:04.2874444Z Submodule 'third_party/onnx' (https://github.com/onnx/onnx.git) registered for path 'third_party/onnx' 2024-08-20T22:06:04.2879626Z Submodule 'third_party/opentelemetry-cpp' (https://github.com/open-telemetry/opentelemetry-cpp.git) registered for path 'third_party/opentelemetry-cpp' 2024-08-20T22:06:04.2884319Z Submodule 'third_party/pocketfft' (https://github.com/mreineck/pocketfft) registered for path 'third_party/pocketfft' 2024-08-20T22:06:04.2889409Z Submodule 'third_party/protobuf' (https://github.com/protocolbuffers/protobuf.git) registered for path 'third_party/protobuf' 2024-08-20T22:06:04.2894457Z Submodule 'third_party/NNPACK_deps/psimd' (https://github.com/Maratyszcza/psimd.git) registered for path 'third_party/psimd' 2024-08-20T22:06:04.2899755Z Submodule 'third_party/NNPACK_deps/pthreadpool' (https://github.com/Maratyszcza/pthreadpool.git) registered for path 'third_party/pthreadpool' 2024-08-20T22:06:04.2904974Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/pybind11' 2024-08-20T22:06:04.2910541Z Submodule 'third_party/python-peachpy' (https://github.com/malfet/PeachPy.git) registered for path 'third_party/python-peachpy' 2024-08-20T22:06:04.2915588Z Submodule 'third_party/sleef' (https://github.com/shibatch/sleef) registered for path 'third_party/sleef' 2024-08-20T22:06:04.2924356Z Submodule 'third_party/tensorpipe' (https://github.com/pytorch/tensorpipe.git) registered for path 'third_party/tensorpipe' 2024-08-20T22:06:04.2960155Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/android/libs/fbjni'... 2024-08-20T22:06:04.5815640Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FP16'... 2024-08-20T22:06:04.7626166Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FXdiv'... 2024-08-20T22:06:04.9653998Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/NNPACK'... 2024-08-20T22:06:05.3174647Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/VulkanMemoryAllocator'... 2024-08-20T22:06:07.2429150Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/XNNPACK'... 2024-08-20T22:06:18.6661130Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/benchmark'... 2024-08-20T22:06:19.0587681Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpp-httplib'... 2024-08-20T22:06:19.4655984Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpuinfo'... 2024-08-20T22:06:20.0911602Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cudnn_frontend'... 2024-08-20T22:06:21.4214541Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cutlass'... 2024-08-20T22:06:23.6272782Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/eigen'... 2024-08-20T22:06:29.6269861Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm'... 2024-08-20T22:06:31.0681751Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/flatbuffers'... 2024-08-20T22:06:32.8971115Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fmt'... 2024-08-20T22:06:34.2188897Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gemmlowp/gemmlowp'... 2024-08-20T22:06:34.6575491Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gloo'... 2024-08-20T22:06:35.0410756Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/googletest'... 2024-08-20T22:06:36.1811342Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep'... 2024-08-20T22:06:36.5543222Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ittapi'... 2024-08-20T22:06:36.8183728Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto'... 2024-08-20T22:06:38.4496016Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/mimalloc'... 2024-08-20T22:06:39.1511010Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nccl/nccl'... 2024-08-20T22:06:39.8508922Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nlohmann'... 2024-08-20T22:06:45.8923495Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx'... 2024-08-20T22:06:47.9439061Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp'... 2024-08-20T22:06:52.1128253Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pocketfft'... 2024-08-20T22:06:52.3366504Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf'... 2024-08-20T22:07:01.5630325Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/psimd'... 2024-08-20T22:07:01.7291319Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pthreadpool'... 2024-08-20T22:07:01.9804688Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pybind11'... 2024-08-20T22:07:02.8992213Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/python-peachpy'... 2024-08-20T22:07:03.1813033Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/sleef'... 2024-08-20T22:07:03.8544821Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe'... 2024-08-20T22:07:04.2620465Z Submodule path 'android/libs/fbjni': checked out '7e1e1fe3858c63c251c637ae41a20de425dde96f' 2024-08-20T22:07:04.2769997Z Submodule path 'third_party/FP16': checked out '4dfe081cf6bcd15db339cf2680b9281b8451eeb3' 2024-08-20T22:07:04.2887652Z Submodule path 'third_party/FXdiv': checked out 'b408327ac2a15ec3e43352421954f5b1967701d1' 2024-08-20T22:07:04.3198710Z Submodule path 'third_party/NNPACK': checked out 'c07e3a0400713d546e0dea2d5466dd22ea389c73' 2024-08-20T22:07:04.3653127Z Submodule path 'third_party/VulkanMemoryAllocator': checked out 'a6bfc237255a6bac1513f7c1ebde6d8aed6b5191' 2024-08-20T22:07:05.5345613Z Submodule path 'third_party/XNNPACK': checked out 'fcbf55af6cf28a4627bcd1f703ab7ad843f0f3a2' 2024-08-20T22:07:05.5620967Z Submodule path 'third_party/benchmark': checked out '0d98dba29d66e93259db7daa53a9327df767a415' 2024-08-20T22:07:05.6140979Z Submodule path 'third_party/cpp-httplib': checked out '3b6597bba913d51161383657829b7e644e59c006' 2024-08-20T22:07:05.7242545Z Submodule path 'third_party/cpuinfo': checked out '3c8b1533ac03dd6531ab6e7b9245d488f13a82a5' 2024-08-20T22:07:05.7644952Z Submodule path 'third_party/cudnn_frontend': checked out '23511ba176243f27b3b275da1fb3814ea805a171' 2024-08-20T22:07:06.3881893Z Submodule path 'third_party/cutlass': checked out 'bbe579a9e3beb6ea6626d9227ec32d0dae119a49' 2024-08-20T22:07:06.6760034Z Submodule path 'third_party/eigen': checked out '3147391d946bb4b6c68edd901f2add6ac1f31f8c' 2024-08-20T22:07:06.7704290Z Submodule path 'third_party/fbgemm': checked out 'dbc3157bf256f1339b3fa1fef2be89ac4078be0e' 2024-08-20T22:07:06.7727386Z Submodule 'third_party/asmjit' (https://github.com/asmjit/asmjit.git) registered for path 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:07:06.7730665Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo) registered for path 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:07:06.7734094Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:07:06.7737590Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:07:06.7741155Z Submodule 'third_party/hipify_torch' (https://github.com/ROCmSoftwarePlatform/hipify_torch.git) registered for path 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:07:06.7772650Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/asmjit'... 2024-08-20T22:07:07.8299765Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cpuinfo'... 2024-08-20T22:07:08.4291594Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cutlass'... 2024-08-20T22:07:10.5324120Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/googletest'... 2024-08-20T22:07:11.6285550Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/hipify_torch'... 2024-08-20T22:07:11.9650803Z Submodule path 'third_party/fbgemm/third_party/asmjit': checked out 'd3fbf7c9bc7c1d1365a94a45614b91c5a3706b81' 2024-08-20T22:07:12.0756330Z Submodule path 'third_party/fbgemm/third_party/cpuinfo': checked out 'ed8b86a253800bafdb7b25c5c399f91bff9cb1f3' 2024-08-20T22:07:12.5844053Z Submodule path 'third_party/fbgemm/third_party/cutlass': checked out 'fc9ebc645b63f3a6bc80aaefde5c063fb72110d6' 2024-08-20T22:07:12.6544085Z Submodule path 'third_party/fbgemm/third_party/googletest': checked out 'cbf019de22c8dd37b2108da35b2748fd702d1796' 2024-08-20T22:07:12.6691330Z Submodule path 'third_party/fbgemm/third_party/hipify_torch': checked out '23f53b025b466d8ec3c45d52290d3442f7fbe6b1' 2024-08-20T22:07:12.8145595Z Submodule path 'third_party/flatbuffers': checked out '01834de25e4bf3975a9a00e816292b1ad0fe184b' 2024-08-20T22:07:12.8597212Z Submodule path 'third_party/fmt': checked out '0c9fce2ffefecfdce794e1859584e25877b7b592' 2024-08-20T22:07:12.9042494Z Submodule path 'third_party/gemmlowp/gemmlowp': checked out '3fb5c176c17c765a3492cd2f0321b0dab712f350' 2024-08-20T22:07:12.9358007Z Submodule path 'third_party/gloo': checked out '5354032ea08eadd7fc4456477f7f7c6308818509' 2024-08-20T22:07:12.9880591Z Submodule path 'third_party/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2024-08-20T22:07:13.0037990Z Submodule path 'third_party/ideep': checked out '55ca0191687aaf19aca5cdb7881c791e3bea442b' 2024-08-20T22:07:13.0058066Z Submodule 'mkl-dnn' (https://github.com/intel/mkl-dnn.git) registered for path 'third_party/ideep/mkl-dnn' 2024-08-20T22:07:13.0090619Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep/mkl-dnn'... 2024-08-20T22:07:26.3354389Z Submodule path 'third_party/ideep/mkl-dnn': checked out '1137e04ec0b5251ca2b4400a4fd3c667ce843d67' 2024-08-20T22:07:26.3570698Z Submodule path 'third_party/ittapi': checked out '5b8a7d7422611c3a0d799fb5fc5dd4abfae35b42' 2024-08-20T22:07:26.4564420Z Submodule path 'third_party/kineto': checked out 'd9753139d181b9ff42872465aac0e5d3018be415' 2024-08-20T22:07:26.4588150Z Submodule 'libkineto/third_party/dynolog' (https://github.com/facebookincubator/dynolog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:07:26.4591211Z Submodule 'libkineto/third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:07:26.4594760Z Submodule 'libkineto/third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:07:26.4626474Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog'... 2024-08-20T22:07:27.0030745Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/fmt'... 2024-08-20T22:07:28.2096880Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/googletest'... 2024-08-20T22:07:29.3449759Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog': checked out '7d04a0053a845370ae06ce317a22a48e9edcc74e' 2024-08-20T22:07:29.3469076Z Submodule 'third_party/DCGM' (https://github.com/NVIDIA/DCGM.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:07:29.3472906Z Submodule 'third_party/cpr' (https://github.com/libcpr/cpr.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:07:29.3476490Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:07:29.3480234Z Submodule 'third_party/gflags' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:07:29.3483917Z Submodule 'third_party/glog' (https://github.com/google/glog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:07:29.3487755Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:07:29.3491528Z Submodule 'third_party/json' (https://github.com/nlohmann/json.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:07:29.3495458Z Submodule 'third_party/pfs' (https://github.com/dtrugman/pfs.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:07:29.3527811Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'... 2024-08-20T22:07:30.1896084Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'... 2024-08-20T22:07:30.5711369Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'... 2024-08-20T22:07:31.7987370Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'... 2024-08-20T22:07:32.0819323Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/glog'... 2024-08-20T22:07:32.6078513Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'... 2024-08-20T22:07:33.6648550Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/json'... 2024-08-20T22:07:40.9389662Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'... 2024-08-20T22:07:41.3369496Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM': checked out 'ffde4e54bc7249a6039a5e6b45b395141e1217f9' 2024-08-20T22:07:41.3603127Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr': checked out '871ed52d350214a034f6ef8a3b8f51c5ce1bd400' 2024-08-20T22:07:41.4032948Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt': checked out 'cd4af11efc9c622896a3e4cb599fa28668ca3d05' 2024-08-20T22:07:41.4197810Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags': checked out 'e171aa2d15ed9eb17054558e0b3a6a413bb01067' 2024-08-20T22:07:41.4217035Z Submodule 'doc' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:07:41.4249739Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'... 2024-08-20T22:07:41.7270768Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc': checked out '8411df715cf522606e3b1aca386ddfc0b63d34b4' 2024-08-20T22:07:41.7495737Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog': checked out 'b33e3bad4c46c8a6345525fd822af355e5ef9446' 2024-08-20T22:07:41.7969162Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest': checked out '58d77fa8070e8cec2dc1ed015d66b454c8d78850' 2024-08-20T22:07:41.9151440Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json': checked out '4f8fba14066156b73f1189a2b8bd568bde5284c5' 2024-08-20T22:07:41.9349469Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs': checked out 'f68a2fa8ea36c783bdd760371411fcb495aa3150' 2024-08-20T22:07:41.9800373Z Submodule path 'third_party/kineto/libkineto/third_party/fmt': checked out '0041a40c1350ba702d475b9c4ad62da77caea164' 2024-08-20T22:07:42.0459479Z Submodule path 'third_party/kineto/libkineto/third_party/googletest': checked out '7aca84427f224eeed3144123d5230d5871e93347' 2024-08-20T22:07:42.0923203Z Submodule path 'third_party/mimalloc': checked out 'b66e3214d8a104669c2ec05ae91ebc26a8f5ab78' 2024-08-20T22:07:42.1217852Z Submodule path 'third_party/nccl/nccl': checked out 'ab2b89c4c339bd7f816fbc114a4b05d386b66290' 2024-08-20T22:07:42.2477360Z Submodule path 'third_party/nlohmann': checked out '87cda1d6646592ac5866dc703c8e1839046a6806' 2024-08-20T22:07:42.7571054Z Submodule path 'third_party/onnx': checked out '3bf92c03a9f27eba3bda1e5b9e63ea20ec213557' 2024-08-20T22:07:42.7609552Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/onnx/third_party/benchmark' 2024-08-20T22:07:42.7612644Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/onnx/third_party/pybind11' 2024-08-20T22:07:42.7643616Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx/third_party/benchmark'... 2024-08-20T22:07:43.2426096Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx/third_party/pybind11'... 2024-08-20T22:07:44.1794613Z Submodule path 'third_party/onnx/third_party/benchmark': checked out '2dd015dfef425c866d9a43f2c67d8b52d709acb6' 2024-08-20T22:07:44.2207116Z Submodule path 'third_party/onnx/third_party/pybind11': checked out '5b0a6fc2017fcc176545afe3e09c9f9885283242' 2024-08-20T22:07:44.3110242Z Submodule path 'third_party/opentelemetry-cpp': checked out 'a799f4aed9c94b765dcdaabaeab7d5e7e2310878' 2024-08-20T22:07:44.3133820Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark) registered for path 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:07:44.3137186Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:07:44.3140450Z Submodule 'third_party/ms-gsl' (https://github.com/microsoft/GSL) registered for path 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:07:44.3144069Z Submodule 'third_party/nlohmann-json' (https://github.com/nlohmann/json) registered for path 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:07:44.3148112Z Submodule 'third_party/opentelemetry-proto' (https://github.com/open-telemetry/opentelemetry-proto) registered for path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:07:44.3151639Z Submodule 'third_party/opentracing-cpp' (https://github.com/opentracing/opentracing-cpp.git) registered for path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:07:44.3155349Z Submodule 'third_party/prometheus-cpp' (https://github.com/jupp0r/prometheus-cpp) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:07:44.3158851Z Submodule 'tools/vcpkg' (https://github.com/Microsoft/vcpkg) registered for path 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:07:44.3191205Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/benchmark'... 2024-08-20T22:07:44.7728552Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/googletest'... 2024-08-20T22:07:45.8350030Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/ms-gsl'... 2024-08-20T22:07:46.2364717Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/nlohmann-json'... 2024-08-20T22:07:52.2953457Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentelemetry-proto'... 2024-08-20T22:07:52.5584051Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentracing-cpp'... 2024-08-20T22:07:52.7457215Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp'... 2024-08-20T22:07:53.0486176Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/tools/vcpkg'... 2024-08-20T22:08:00.1204000Z Submodule path 'third_party/opentelemetry-cpp/third_party/benchmark': checked out 'd572f4777349d43653b21d6c2fc63020ab326db2' 2024-08-20T22:08:00.1677309Z Submodule path 'third_party/opentelemetry-cpp/third_party/googletest': checked out 'b796f7d44681514f58a683a3a71ff17c94edb0c1' 2024-08-20T22:08:00.1868196Z Submodule path 'third_party/opentelemetry-cpp/third_party/ms-gsl': checked out '6f4529395c5b7c2d661812257cd6780c67e54afa' 2024-08-20T22:08:00.3072771Z Submodule path 'third_party/opentelemetry-cpp/third_party/nlohmann-json': checked out 'bc889afb4c5bf1c0d8ee29ef35eaaf4c8bef8a5d' 2024-08-20T22:08:00.3236524Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto': checked out '4ca4f0335c63cda7ab31ea7ed70d6553aee14dce' 2024-08-20T22:08:00.3424942Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp': checked out '06b57f48ded1fa3bdd3d4346f6ef29e40e08eaf5' 2024-08-20T22:08:00.3626085Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp': checked out 'c9ffcdda9086ffd9e1283ea7a0276d831f3c8a8d' 2024-08-20T22:08:00.3645339Z Submodule 'civetweb' (https://github.com/civetweb/civetweb.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:08:00.3648889Z Submodule 'googletest' (https://github.com/google/googletest.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:08:00.3684164Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'... 2024-08-20T22:08:02.3169502Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'... 2024-08-20T22:08:03.7165858Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb': checked out 'eefb26f82b233268fc98577d265352720d477ba4' 2024-08-20T22:08:03.7694218Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2024-08-20T22:08:04.4108260Z Submodule path 'third_party/opentelemetry-cpp/tools/vcpkg': checked out '8eb57355a4ffb410a2e94c07b4dca2dffbee8e50' 2024-08-20T22:08:04.4248697Z Submodule path 'third_party/pocketfft': checked out '9d3ab05a7fffbc71a492bc6a17be034e83e8f0fe' 2024-08-20T22:08:04.7319136Z Submodule path 'third_party/protobuf': checked out 'd1eca4e4b421cd2997495c4b4e65cea6be4e9b8a' 2024-08-20T22:08:04.7344256Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:08:04.7347533Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/protobuf/third_party/googletest' 2024-08-20T22:08:04.7379263Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/benchmark'... 2024-08-20T22:08:05.2977370Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/googletest'... 2024-08-20T22:08:06.3959207Z Submodule path 'third_party/protobuf/third_party/benchmark': checked out '5b7683f49e1e9223cf9927b24f6fd3d6bd82e3f8' 2024-08-20T22:08:06.4755595Z Submodule path 'third_party/protobuf/third_party/googletest': checked out '5ec7f0c4a113e2f18ac2c6cc7df51ad6afc24081' 2024-08-20T22:08:06.4872472Z Submodule path 'third_party/psimd': checked out '072586a71b55b7f8c584153d223e95687148a900' 2024-08-20T22:08:06.5026762Z Submodule path 'third_party/pthreadpool': checked out '4fe0e1e183925bf8cfa6aae24237e724a96479b8' 2024-08-20T22:08:06.5465919Z Submodule path 'third_party/pybind11': checked out '941f45bcb51457884fa1afd6e24a67377d70f75c' 2024-08-20T22:08:06.5800815Z Submodule path 'third_party/python-peachpy': checked out 'f45429b087dd7d5bc78bb40dc7cf06425c252d67' 2024-08-20T22:08:06.6282362Z Submodule path 'third_party/sleef': checked out '60e76d2bce17d278b439d9da17177c8f957a9e9b' 2024-08-20T22:08:06.6621782Z Submodule path 'third_party/tensorpipe': checked out '52791a2fd214b2a9dc5759d36725909c1daa7f2e' 2024-08-20T22:08:06.6642440Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:08:06.6645578Z Submodule 'third_party/libnop' (https://github.com/google/libnop.git) registered for path 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:08:06.6649552Z Submodule 'third_party/libuv' (https://github.com/libuv/libuv.git) registered for path 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:08:06.6653036Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:08:06.6685192Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/googletest'... 2024-08-20T22:08:07.7879929Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libnop'... 2024-08-20T22:08:08.0204810Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libuv'... 2024-08-20T22:08:09.1926826Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11'... 2024-08-20T22:08:10.1674246Z Submodule path 'third_party/tensorpipe/third_party/googletest': checked out 'aee0f9d9b5b87796ee8a0ab26b7587ec30e8858e' 2024-08-20T22:08:10.1861599Z Submodule path 'third_party/tensorpipe/third_party/libnop': checked out '910b55815be16109f04f4180e9adee14fb4ce281' 2024-08-20T22:08:10.2647945Z Submodule path 'third_party/tensorpipe/third_party/libuv': checked out '1dff88e5161cba5c59276d2070d2e304e4dcb242' 2024-08-20T22:08:10.2988476Z Submodule path 'third_party/tensorpipe/third_party/pybind11': checked out 'a23996fce38ff6ccfbcdc09f1e63f2c4be5ea2ef' 2024-08-20T22:08:10.3008017Z Submodule 'tools/clang' (https://github.com/wjakob/clang-cindex-python3) registered for path 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:08:10.3039137Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11/tools/clang'... 2024-08-20T22:08:10.5232199Z Submodule path 'third_party/tensorpipe/third_party/pybind11/tools/clang': checked out '6a00cbc4a9b8e68b71caf7f774b3f9c753ae84d5' 2024-08-20T22:08:10.5277628Z [command]/usr/bin/git submodule foreach --recursive git config --local gc.auto 0 2024-08-20T22:08:10.5637418Z Entering 'android/libs/fbjni' 2024-08-20T22:08:10.5688272Z Entering 'third_party/FP16' 2024-08-20T22:08:10.5737962Z Entering 'third_party/FXdiv' 2024-08-20T22:08:10.5789902Z Entering 'third_party/NNPACK' 2024-08-20T22:08:10.5842377Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T22:08:10.5896124Z Entering 'third_party/XNNPACK' 2024-08-20T22:08:10.5964002Z Entering 'third_party/benchmark' 2024-08-20T22:08:10.6016376Z Entering 'third_party/cpp-httplib' 2024-08-20T22:08:10.6067294Z Entering 'third_party/cpuinfo' 2024-08-20T22:08:10.6119663Z Entering 'third_party/cudnn_frontend' 2024-08-20T22:08:10.6169249Z Entering 'third_party/cutlass' 2024-08-20T22:08:10.6227365Z Entering 'third_party/eigen' 2024-08-20T22:08:10.6278711Z Entering 'third_party/fbgemm' 2024-08-20T22:08:10.6327847Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:08:10.6379033Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:08:10.6429380Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:08:10.6491012Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:08:10.6544409Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:08:10.6597702Z Entering 'third_party/flatbuffers' 2024-08-20T22:08:10.6652025Z Entering 'third_party/fmt' 2024-08-20T22:08:10.6703077Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:08:10.6754224Z Entering 'third_party/gloo' 2024-08-20T22:08:10.6805377Z Entering 'third_party/googletest' 2024-08-20T22:08:10.6856030Z Entering 'third_party/ideep' 2024-08-20T22:08:10.6904823Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T22:08:10.6962750Z Entering 'third_party/ittapi' 2024-08-20T22:08:10.7014508Z Entering 'third_party/kineto' 2024-08-20T22:08:10.7063454Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:08:10.7114622Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:08:10.7166658Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:08:10.7217130Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:08:10.7266924Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:08:10.7316346Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:08:10.7370900Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:08:10.7422533Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:08:10.7473607Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:08:10.7525767Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:08:10.7580778Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:08:10.7631799Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:08:10.7685376Z Entering 'third_party/mimalloc' 2024-08-20T22:08:10.7737482Z Entering 'third_party/nccl/nccl' 2024-08-20T22:08:10.7789821Z Entering 'third_party/nlohmann' 2024-08-20T22:08:10.7842325Z Entering 'third_party/onnx' 2024-08-20T22:08:10.7908499Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T22:08:10.7958491Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T22:08:10.8015650Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T22:08:10.8067359Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:08:10.8117237Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:08:10.8168126Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:08:10.8218402Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:08:10.8275516Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:08:10.8324946Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:08:10.8375455Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:08:10.8424108Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:08:10.8477075Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:08:10.8532107Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:08:10.8603490Z Entering 'third_party/pocketfft' 2024-08-20T22:08:10.8654871Z Entering 'third_party/protobuf' 2024-08-20T22:08:10.8710108Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:08:10.8759922Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T22:08:10.8816082Z Entering 'third_party/psimd' 2024-08-20T22:08:10.8866863Z Entering 'third_party/pthreadpool' 2024-08-20T22:08:10.8916822Z Entering 'third_party/pybind11' 2024-08-20T22:08:10.8966992Z Entering 'third_party/python-peachpy' 2024-08-20T22:08:10.9019217Z Entering 'third_party/sleef' 2024-08-20T22:08:10.9069563Z Entering 'third_party/tensorpipe' 2024-08-20T22:08:10.9119686Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:08:10.9168972Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:08:10.9223364Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:08:10.9276128Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:08:10.9324139Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:08:10.9396165Z ##[endgroup] 2024-08-20T22:08:10.9398157Z ##[group]Persisting credentials for submodules 2024-08-20T22:08:10.9402359Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'url\.https\:\/\/github\.com\/\.insteadOf' && git config --local --unset-all 'url.https://github.com/.insteadOf' || :" 2024-08-20T22:08:10.9762946Z Entering 'android/libs/fbjni' 2024-08-20T22:08:10.9830487Z Entering 'third_party/FP16' 2024-08-20T22:08:10.9901203Z Entering 'third_party/FXdiv' 2024-08-20T22:08:10.9968552Z Entering 'third_party/NNPACK' 2024-08-20T22:08:11.0041075Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T22:08:11.0108752Z Entering 'third_party/XNNPACK' 2024-08-20T22:08:11.0194246Z Entering 'third_party/benchmark' 2024-08-20T22:08:11.0262533Z Entering 'third_party/cpp-httplib' 2024-08-20T22:08:11.0331445Z Entering 'third_party/cpuinfo' 2024-08-20T22:08:11.0399891Z Entering 'third_party/cudnn_frontend' 2024-08-20T22:08:11.0472620Z Entering 'third_party/cutlass' 2024-08-20T22:08:11.0548208Z Entering 'third_party/eigen' 2024-08-20T22:08:11.0618442Z Entering 'third_party/fbgemm' 2024-08-20T22:08:11.0685712Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:08:11.0751168Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:08:11.0818528Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:08:11.0891165Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:08:11.0956184Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:08:11.1026040Z Entering 'third_party/flatbuffers' 2024-08-20T22:08:11.1097986Z Entering 'third_party/fmt' 2024-08-20T22:08:11.1165755Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:08:11.1233859Z Entering 'third_party/gloo' 2024-08-20T22:08:11.1302244Z Entering 'third_party/googletest' 2024-08-20T22:08:11.1373306Z Entering 'third_party/ideep' 2024-08-20T22:08:11.1438425Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T22:08:11.1512107Z Entering 'third_party/ittapi' 2024-08-20T22:08:11.1580427Z Entering 'third_party/kineto' 2024-08-20T22:08:11.1647246Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:08:11.1712533Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:08:11.1781834Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:08:11.1849140Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:08:11.1917330Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:08:11.1982550Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:08:11.2052786Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:08:11.2123301Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:08:11.2191539Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:08:11.2260182Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:08:11.2330964Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:08:11.2396748Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:08:11.2465135Z Entering 'third_party/mimalloc' 2024-08-20T22:08:11.2535637Z Entering 'third_party/nccl/nccl' 2024-08-20T22:08:11.2603594Z Entering 'third_party/nlohmann' 2024-08-20T22:08:11.2671813Z Entering 'third_party/onnx' 2024-08-20T22:08:11.2753301Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T22:08:11.2821336Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T22:08:11.2893280Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T22:08:11.2961401Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:08:11.3026968Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:08:11.3093598Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:08:11.3158513Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:08:11.3225955Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:08:11.3291074Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:08:11.3355690Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:08:11.3419944Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:08:11.3489528Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:08:11.3559034Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:08:11.3646371Z Entering 'third_party/pocketfft' 2024-08-20T22:08:11.3714943Z Entering 'third_party/protobuf' 2024-08-20T22:08:11.3785657Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:08:11.3851202Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T22:08:11.3920435Z Entering 'third_party/psimd' 2024-08-20T22:08:11.3988172Z Entering 'third_party/pthreadpool' 2024-08-20T22:08:11.4055161Z Entering 'third_party/pybind11' 2024-08-20T22:08:11.4124490Z Entering 'third_party/python-peachpy' 2024-08-20T22:08:11.4191363Z Entering 'third_party/sleef' 2024-08-20T22:08:11.4258326Z Entering 'third_party/tensorpipe' 2024-08-20T22:08:11.4324484Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:08:11.4389370Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:08:11.4455144Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:08:11.4521262Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:08:11.4589165Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:08:11.4679208Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local 'http.https://github.com/.extraheader' 'AUTHORIZATION: basic ***' && git config --local --show-origin --name-only --get-regexp remote.origin.url" 2024-08-20T22:08:11.5037049Z Entering 'android/libs/fbjni' 2024-08-20T22:08:11.5100705Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/android/libs/fbjni/config remote.origin.url 2024-08-20T22:08:11.5122219Z Entering 'third_party/FP16' 2024-08-20T22:08:11.5183871Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FP16/config remote.origin.url 2024-08-20T22:08:11.5205274Z Entering 'third_party/FXdiv' 2024-08-20T22:08:11.5266276Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FXdiv/config remote.origin.url 2024-08-20T22:08:11.5289722Z Entering 'third_party/NNPACK' 2024-08-20T22:08:11.5349594Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK/config remote.origin.url 2024-08-20T22:08:11.5373929Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T22:08:11.5435548Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/VulkanMemoryAllocator/config remote.origin.url 2024-08-20T22:08:11.5456755Z Entering 'third_party/XNNPACK' 2024-08-20T22:08:11.5524173Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/XNNPACK/config remote.origin.url 2024-08-20T22:08:11.5571007Z Entering 'third_party/benchmark' 2024-08-20T22:08:11.5627893Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/benchmark/config remote.origin.url 2024-08-20T22:08:11.5651047Z Entering 'third_party/cpp-httplib' 2024-08-20T22:08:11.5712718Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpp-httplib/config remote.origin.url 2024-08-20T22:08:11.5734363Z Entering 'third_party/cpuinfo' 2024-08-20T22:08:11.5796288Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpuinfo/config remote.origin.url 2024-08-20T22:08:11.5818781Z Entering 'third_party/cudnn_frontend' 2024-08-20T22:08:11.5881270Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cudnn_frontend/config remote.origin.url 2024-08-20T22:08:11.5902809Z Entering 'third_party/cutlass' 2024-08-20T22:08:11.5963661Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cutlass/config remote.origin.url 2024-08-20T22:08:11.5993179Z Entering 'third_party/eigen' 2024-08-20T22:08:11.6054369Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/eigen/config remote.origin.url 2024-08-20T22:08:11.6079045Z Entering 'third_party/fbgemm' 2024-08-20T22:08:11.6141932Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/config remote.origin.url 2024-08-20T22:08:11.6163735Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:08:11.6227321Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/asmjit/config remote.origin.url 2024-08-20T22:08:11.6247450Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:08:11.6309863Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cpuinfo/config remote.origin.url 2024-08-20T22:08:11.6330562Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:08:11.6392048Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cutlass/config remote.origin.url 2024-08-20T22:08:11.6418995Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:08:11.6480147Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/googletest/config remote.origin.url 2024-08-20T22:08:11.6500649Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:08:11.6561834Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/hipify_torch/config remote.origin.url 2024-08-20T22:08:11.6586217Z Entering 'third_party/flatbuffers' 2024-08-20T22:08:11.6647842Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/flatbuffers/config remote.origin.url 2024-08-20T22:08:11.6677981Z Entering 'third_party/fmt' 2024-08-20T22:08:11.6739264Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fmt/config remote.origin.url 2024-08-20T22:08:11.6761142Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:08:11.6823236Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gemmlowp/gemmlowp/config remote.origin.url 2024-08-20T22:08:11.6845395Z Entering 'third_party/gloo' 2024-08-20T22:08:11.6906256Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gloo/config remote.origin.url 2024-08-20T22:08:11.6927960Z Entering 'third_party/googletest' 2024-08-20T22:08:11.6995665Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/googletest/config remote.origin.url 2024-08-20T22:08:11.7018989Z Entering 'third_party/ideep' 2024-08-20T22:08:11.7080549Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/config remote.origin.url 2024-08-20T22:08:11.7099430Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T22:08:11.7159710Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/modules/mkl-dnn/config remote.origin.url 2024-08-20T22:08:11.7189406Z Entering 'third_party/ittapi' 2024-08-20T22:08:11.7250363Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ittapi/config remote.origin.url 2024-08-20T22:08:11.7271955Z Entering 'third_party/kineto' 2024-08-20T22:08:11.7337457Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/config remote.origin.url 2024-08-20T22:08:11.7356021Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:08:11.7422687Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/config remote.origin.url 2024-08-20T22:08:11.7442926Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:08:11.7506908Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/DCGM/config remote.origin.url 2024-08-20T22:08:11.7528625Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:08:11.7595362Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/cpr/config remote.origin.url 2024-08-20T22:08:11.7615877Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:08:11.7678285Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/fmt/config remote.origin.url 2024-08-20T22:08:11.7698628Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:08:11.7760838Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/config remote.origin.url 2024-08-20T22:08:11.7779322Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:08:11.7842976Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/modules/doc/config remote.origin.url 2024-08-20T22:08:11.7866518Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:08:11.7928033Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/glog/config remote.origin.url 2024-08-20T22:08:11.7948732Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:08:11.8010890Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/googletest/config remote.origin.url 2024-08-20T22:08:11.8035156Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:08:11.8097361Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/json/config remote.origin.url 2024-08-20T22:08:11.8124342Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:08:11.8186176Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/pfs/config remote.origin.url 2024-08-20T22:08:11.8209275Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:08:11.8270003Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/fmt/config remote.origin.url 2024-08-20T22:08:11.8289931Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:08:11.8350815Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/googletest/config remote.origin.url 2024-08-20T22:08:11.8374247Z Entering 'third_party/mimalloc' 2024-08-20T22:08:11.8433722Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/mimalloc/config remote.origin.url 2024-08-20T22:08:11.8455490Z Entering 'third_party/nccl/nccl' 2024-08-20T22:08:11.8517816Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nccl/nccl/config remote.origin.url 2024-08-20T22:08:11.8539205Z Entering 'third_party/nlohmann' 2024-08-20T22:08:11.8600338Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nlohmann/config remote.origin.url 2024-08-20T22:08:11.8622826Z Entering 'third_party/onnx' 2024-08-20T22:08:11.8688378Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/config remote.origin.url 2024-08-20T22:08:11.8722716Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T22:08:11.8785441Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/benchmark/config remote.origin.url 2024-08-20T22:08:11.8806707Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T22:08:11.8868395Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/pybind11/config remote.origin.url 2024-08-20T22:08:11.8896142Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T22:08:11.8961055Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/config remote.origin.url 2024-08-20T22:08:11.8984174Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:08:11.9045488Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/benchmark/config remote.origin.url 2024-08-20T22:08:11.9065722Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:08:11.9128096Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/googletest/config remote.origin.url 2024-08-20T22:08:11.9148956Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:08:11.9210805Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/ms-gsl/config remote.origin.url 2024-08-20T22:08:11.9230956Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:08:11.9292076Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/nlohmann-json/config remote.origin.url 2024-08-20T22:08:11.9314217Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:08:11.9377844Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentelemetry-proto/config remote.origin.url 2024-08-20T22:08:11.9398329Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:08:11.9460427Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentracing-cpp/config remote.origin.url 2024-08-20T22:08:11.9481070Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:08:11.9543065Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/config remote.origin.url 2024-08-20T22:08:11.9561822Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:08:11.9623737Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/civetweb/config remote.origin.url 2024-08-20T22:08:11.9645678Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:08:11.9707871Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/googletest/config remote.origin.url 2024-08-20T22:08:11.9731374Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:08:11.9793375Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/tools/vcpkg/config remote.origin.url 2024-08-20T22:08:11.9834695Z Entering 'third_party/pocketfft' 2024-08-20T22:08:11.9895440Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pocketfft/config remote.origin.url 2024-08-20T22:08:11.9916940Z Entering 'third_party/protobuf' 2024-08-20T22:08:11.9984175Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/config remote.origin.url 2024-08-20T22:08:12.0006971Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:08:12.0068493Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/benchmark/config remote.origin.url 2024-08-20T22:08:12.0090138Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T22:08:12.0153854Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/googletest/config remote.origin.url 2024-08-20T22:08:12.0179043Z Entering 'third_party/psimd' 2024-08-20T22:08:12.0239313Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/psimd/config remote.origin.url 2024-08-20T22:08:12.0260455Z Entering 'third_party/pthreadpool' 2024-08-20T22:08:12.0326703Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/pthreadpool/config remote.origin.url 2024-08-20T22:08:12.0347768Z Entering 'third_party/pybind11' 2024-08-20T22:08:12.0408410Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pybind11/config remote.origin.url 2024-08-20T22:08:12.0430208Z Entering 'third_party/python-peachpy' 2024-08-20T22:08:12.0491644Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/python-peachpy/config remote.origin.url 2024-08-20T22:08:12.0511469Z Entering 'third_party/sleef' 2024-08-20T22:08:12.0571009Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/sleef/config remote.origin.url 2024-08-20T22:08:12.0592423Z Entering 'third_party/tensorpipe' 2024-08-20T22:08:12.0653461Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/config remote.origin.url 2024-08-20T22:08:12.0673796Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:08:12.0733514Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/googletest/config remote.origin.url 2024-08-20T22:08:12.0754569Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:08:12.0815577Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libnop/config remote.origin.url 2024-08-20T22:08:12.0836696Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:08:12.0898667Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libuv/config remote.origin.url 2024-08-20T22:08:12.0919937Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:08:12.0982679Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/config remote.origin.url 2024-08-20T22:08:12.1001431Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:08:12.1060781Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/modules/tools/clang/config remote.origin.url 2024-08-20T22:08:12.2299940Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'git@github.com:' 2024-08-20T22:08:12.2670395Z Entering 'android/libs/fbjni' 2024-08-20T22:08:12.2719156Z Entering 'third_party/FP16' 2024-08-20T22:08:12.2768559Z Entering 'third_party/FXdiv' 2024-08-20T22:08:12.2817989Z Entering 'third_party/NNPACK' 2024-08-20T22:08:12.2870331Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T22:08:12.2922069Z Entering 'third_party/XNNPACK' 2024-08-20T22:08:12.2989742Z Entering 'third_party/benchmark' 2024-08-20T22:08:12.3043272Z Entering 'third_party/cpp-httplib' 2024-08-20T22:08:12.3094758Z Entering 'third_party/cpuinfo' 2024-08-20T22:08:12.3146807Z Entering 'third_party/cudnn_frontend' 2024-08-20T22:08:12.3199094Z Entering 'third_party/cutlass' 2024-08-20T22:08:12.3258412Z Entering 'third_party/eigen' 2024-08-20T22:08:12.3311399Z Entering 'third_party/fbgemm' 2024-08-20T22:08:12.3361860Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:08:12.3410991Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:08:12.3461458Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:08:12.3517987Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:08:12.3566385Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:08:12.3618778Z Entering 'third_party/flatbuffers' 2024-08-20T22:08:12.3673029Z Entering 'third_party/fmt' 2024-08-20T22:08:12.3722640Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:08:12.3773921Z Entering 'third_party/gloo' 2024-08-20T22:08:12.3824130Z Entering 'third_party/googletest' 2024-08-20T22:08:12.3874359Z Entering 'third_party/ideep' 2024-08-20T22:08:12.3924725Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T22:08:12.3983359Z Entering 'third_party/ittapi' 2024-08-20T22:08:12.4036116Z Entering 'third_party/kineto' 2024-08-20T22:08:12.4086655Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:08:12.4136545Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:08:12.4190110Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:08:12.4244964Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:08:12.4296467Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:08:12.4351243Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:08:12.4406454Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:08:12.4457958Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:08:12.4509628Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:08:12.4565485Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:08:12.4619884Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:08:12.4670044Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:08:12.4723492Z Entering 'third_party/mimalloc' 2024-08-20T22:08:12.4775464Z Entering 'third_party/nccl/nccl' 2024-08-20T22:08:12.4828172Z Entering 'third_party/nlohmann' 2024-08-20T22:08:12.4880893Z Entering 'third_party/onnx' 2024-08-20T22:08:12.4946024Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T22:08:12.4998345Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T22:08:12.5055055Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T22:08:12.5109715Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:08:12.5159895Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:08:12.5210822Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:08:12.5260081Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:08:12.5312014Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:08:12.5362251Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:08:12.5412673Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:08:12.5460459Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:08:12.5517499Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:08:12.5572002Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:08:12.5642925Z Entering 'third_party/pocketfft' 2024-08-20T22:08:12.5694061Z Entering 'third_party/protobuf' 2024-08-20T22:08:12.5747992Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:08:12.5797997Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T22:08:12.5850580Z Entering 'third_party/psimd' 2024-08-20T22:08:12.5903861Z Entering 'third_party/pthreadpool' 2024-08-20T22:08:12.5955327Z Entering 'third_party/pybind11' 2024-08-20T22:08:12.6009053Z Entering 'third_party/python-peachpy' 2024-08-20T22:08:12.6060008Z Entering 'third_party/sleef' 2024-08-20T22:08:12.6112732Z Entering 'third_party/tensorpipe' 2024-08-20T22:08:12.6162386Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:08:12.6213341Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:08:12.6263284Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:08:12.6313997Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:08:12.6362085Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:08:12.6438112Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'org-21003710@github.com:' 2024-08-20T22:08:12.6802734Z Entering 'android/libs/fbjni' 2024-08-20T22:08:12.6853043Z Entering 'third_party/FP16' 2024-08-20T22:08:12.6904327Z Entering 'third_party/FXdiv' 2024-08-20T22:08:12.6956389Z Entering 'third_party/NNPACK' 2024-08-20T22:08:12.7008190Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T22:08:12.7059383Z Entering 'third_party/XNNPACK' 2024-08-20T22:08:12.7127686Z Entering 'third_party/benchmark' 2024-08-20T22:08:12.7179266Z Entering 'third_party/cpp-httplib' 2024-08-20T22:08:12.7230334Z Entering 'third_party/cpuinfo' 2024-08-20T22:08:12.7284036Z Entering 'third_party/cudnn_frontend' 2024-08-20T22:08:12.7334869Z Entering 'third_party/cutlass' 2024-08-20T22:08:12.7393750Z Entering 'third_party/eigen' 2024-08-20T22:08:12.7447596Z Entering 'third_party/fbgemm' 2024-08-20T22:08:12.7499672Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T22:08:12.7550489Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T22:08:12.7601637Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T22:08:12.7657430Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T22:08:12.7710148Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T22:08:12.7762355Z Entering 'third_party/flatbuffers' 2024-08-20T22:08:12.7817669Z Entering 'third_party/fmt' 2024-08-20T22:08:12.7869926Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T22:08:12.7922726Z Entering 'third_party/gloo' 2024-08-20T22:08:12.7974316Z Entering 'third_party/googletest' 2024-08-20T22:08:12.8025768Z Entering 'third_party/ideep' 2024-08-20T22:08:12.8075592Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T22:08:12.8133710Z Entering 'third_party/ittapi' 2024-08-20T22:08:12.8186031Z Entering 'third_party/kineto' 2024-08-20T22:08:12.8235810Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T22:08:12.8287991Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T22:08:12.8339681Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T22:08:12.8389543Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T22:08:12.8438921Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T22:08:12.8487556Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T22:08:12.8542175Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T22:08:12.8593993Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T22:08:12.8644648Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T22:08:12.8697456Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T22:08:12.8751213Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T22:08:12.8802578Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T22:08:12.8855611Z Entering 'third_party/mimalloc' 2024-08-20T22:08:12.8910531Z Entering 'third_party/nccl/nccl' 2024-08-20T22:08:12.8962339Z Entering 'third_party/nlohmann' 2024-08-20T22:08:12.9020845Z Entering 'third_party/onnx' 2024-08-20T22:08:12.9084943Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T22:08:12.9136035Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T22:08:12.9193455Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T22:08:12.9247390Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T22:08:12.9297578Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T22:08:12.9352031Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T22:08:12.9402788Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T22:08:12.9453611Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T22:08:12.9503817Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T22:08:12.9553000Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T22:08:12.9602761Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T22:08:12.9655425Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T22:08:12.9708492Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T22:08:12.9783440Z Entering 'third_party/pocketfft' 2024-08-20T22:08:12.9835452Z Entering 'third_party/protobuf' 2024-08-20T22:08:12.9890243Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T22:08:12.9939748Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T22:08:12.9993775Z Entering 'third_party/psimd' 2024-08-20T22:08:13.0046014Z Entering 'third_party/pthreadpool' 2024-08-20T22:08:13.0099012Z Entering 'third_party/pybind11' 2024-08-20T22:08:13.0150920Z Entering 'third_party/python-peachpy' 2024-08-20T22:08:13.0203245Z Entering 'third_party/sleef' 2024-08-20T22:08:13.0255000Z Entering 'third_party/tensorpipe' 2024-08-20T22:08:13.0306735Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T22:08:13.0358538Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T22:08:13.0408333Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T22:08:13.0458679Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T22:08:13.0512191Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T22:08:13.0585665Z ##[endgroup] 2024-08-20T22:08:13.0634272Z [command]/usr/bin/git log -1 --format='%H' 2024-08-20T22:08:13.0669549Z '40ec5f6ddd9787aca0449b24128343ff4c4a88b3' 2024-08-20T22:08:13.0896439Z Prepare all required actions 2024-08-20T22:08:13.0896888Z Getting action download info 2024-08-20T22:08:13.2556721Z ##[group]Run ./.github/actions/setup-linux 2024-08-20T22:08:13.2557141Z env: 2024-08-20T22:08:13.2557417Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:13.2557763Z ##[endgroup] 2024-08-20T22:08:13.2619163Z ##[group]Run set -euo pipefail 2024-08-20T22:08:13.2619591Z set -euo pipefail 2024-08-20T22:08:13.2619982Z function get_ec2_metadata() { 2024-08-20T22:08:13.2620509Z  # Pulled from instance metadata endpoint for EC2 2024-08-20T22:08:13.2621376Z  # see https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/instancedata-data-retrieval.html 2024-08-20T22:08:13.2622126Z  category=$1 2024-08-20T22:08:13.2622649Z  # If it is GCP runner (runner name contains gcp), do not run this 2024-08-20T22:08:13.2623277Z  runner_name_str=i-02ff85e28d998fa83 2024-08-20T22:08:13.2623761Z  if [[ -f /.inarc ]]; then 2024-08-20T22:08:13.2624249Z  echo "ARC Runner, no info on ec2 metadata" 2024-08-20T22:08:13.2624895Z  elif [[ $runner_name_str == *"gcp"* ]]; then 2024-08-20T22:08:13.2625566Z  echo "Runner is from Google Cloud Platform, No info on ec2 metadata" 2024-08-20T22:08:13.2626163Z  else 2024-08-20T22:08:13.2626652Z  curl -fsSL "http://169.254.169.254/latest/meta-data/${category}" 2024-08-20T22:08:13.2627218Z  fi 2024-08-20T22:08:13.2627505Z } 2024-08-20T22:08:13.2627857Z echo "ami-id: $(get_ec2_metadata ami-id)" 2024-08-20T22:08:13.2628438Z echo "instance-id: $(get_ec2_metadata instance-id)" 2024-08-20T22:08:13.2629081Z echo "instance-type: $(get_ec2_metadata instance-type)" 2024-08-20T22:08:13.2629642Z echo "system info $(uname -a)" 2024-08-20T22:08:13.2641085Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:08:13.2641581Z env: 2024-08-20T22:08:13.2641871Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:13.2642220Z ##[endgroup] 2024-08-20T22:08:13.2752248Z ami-id: ami-06c68f701d8090592 2024-08-20T22:08:13.2814287Z instance-id: i-02ff85e28d998fa83 2024-08-20T22:08:13.2871072Z instance-type: g5.4xlarge 2024-08-20T22:08:13.2885394Z system info Linux ip-10-0-74-254.ec2.internal 6.1.94-99.176.amzn2023.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Jun 18 14:57:56 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux 2024-08-20T22:08:13.2908811Z ##[group]Run echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> $GITHUB_OUTPUT 2024-08-20T22:08:13.2909775Z echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> $GITHUB_OUTPUT 2024-08-20T22:08:13.2918908Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:08:13.2919401Z env: 2024-08-20T22:08:13.2919730Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:13.2920086Z ##[endgroup] 2024-08-20T22:08:13.2996794Z ##[group]Run if systemctl is-active --quiet docker; then 2024-08-20T22:08:13.2997386Z if systemctl is-active --quiet docker; then 2024-08-20T22:08:13.2997915Z  echo "Docker daemon is running..."; 2024-08-20T22:08:13.2998357Z else 2024-08-20T22:08:13.2998836Z  echo "Starting docker deamon..." && sudo systemctl start docker; 2024-08-20T22:08:13.2999566Z fi 2024-08-20T22:08:13.3008173Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:08:13.3008671Z env: 2024-08-20T22:08:13.3008957Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:13.3009309Z ##[endgroup] 2024-08-20T22:08:13.3102062Z Docker daemon is running... 2024-08-20T22:08:13.3149389Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2024-08-20T22:08:13.3149998Z with: 2024-08-20T22:08:13.3150263Z shell: bash 2024-08-20T22:08:13.3150550Z timeout_minutes: 5 2024-08-20T22:08:13.3150869Z max_attempts: 3 2024-08-20T22:08:13.3151177Z retry_wait_seconds: 30 2024-08-20T22:08:13.3154239Z command: AWS_ACCOUNT_ID=$(aws sts get-caller-identity|grep Account|cut -f4 -d\") aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \ --password-stdin "$AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com" # For LF Runners we need to make sure we also login to Meta's ECR docker registry too. META_AWS_ACCOUNT_ID=308535385114 if [ "$AWS_ACCOUNT_ID" != "$META_AWS_ACCOUNT_ID" ] ; then aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \ --password-stdin "$META_AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com" fi 2024-08-20T22:08:13.3157182Z polling_interval_seconds: 1 2024-08-20T22:08:13.3157549Z warning_on_retry: true 2024-08-20T22:08:13.3157887Z continue_on_error: false 2024-08-20T22:08:13.3158216Z env: 2024-08-20T22:08:13.3158482Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:13.3158828Z AWS_RETRY_MODE: standard 2024-08-20T22:08:13.3159165Z AWS_MAX_ATTEMPTS: 5 2024-08-20T22:08:13.3159525Z AWS_DEFAULT_REGION: us-east-1 2024-08-20T22:08:13.3159918Z ##[endgroup] 2024-08-20T22:08:14.4633964Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-08-20T22:08:14.4634782Z Configure a credential helper to remove this warning. See 2024-08-20T22:08:14.4635627Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-08-20T22:08:14.4636168Z 2024-08-20T22:08:14.4636290Z Login Succeeded 2024-08-20T22:08:15.3717584Z Command completed after 1 attempt(s). 2024-08-20T22:08:15.3782819Z ##[group]Run env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-08-20T22:08:15.3783524Z env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-08-20T22:08:15.3784163Z env | grep '^CI' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-08-20T22:08:15.3794064Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:08:15.3794555Z env: 2024-08-20T22:08:15.3794838Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:15.3795193Z ##[endgroup] 2024-08-20T22:08:15.3889944Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2024-08-20T22:08:15.3890693Z # ignore expansion of "docker ps -q" since it could be empty 2024-08-20T22:08:15.3891276Z # shellcheck disable=SC2046 2024-08-20T22:08:15.3891734Z docker stop $(docker ps -q) || true 2024-08-20T22:08:15.3892214Z # Prune all of the docker images 2024-08-20T22:08:15.3892656Z docker system prune -af 2024-08-20T22:08:15.3900976Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:08:15.3901470Z env: 2024-08-20T22:08:15.3901750Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:15.3902100Z ##[endgroup] 2024-08-20T22:08:15.4215173Z "docker stop" requires at least 1 argument. 2024-08-20T22:08:15.4215976Z See 'docker stop --help'. 2024-08-20T22:08:15.4216218Z 2024-08-20T22:08:15.4216441Z Usage: docker stop [OPTIONS] CONTAINER [CONTAINER...] 2024-08-20T22:08:15.4216803Z 2024-08-20T22:08:15.4216960Z Stop one or more running containers 2024-08-20T22:08:15.4403189Z Total reclaimed space: 0B 2024-08-20T22:08:15.4447373Z ##[group]Run set +e 2024-08-20T22:08:15.4447742Z set +e 2024-08-20T22:08:15.4448058Z set -x 2024-08-20T22:08:15.4448360Z  2024-08-20T22:08:15.4448683Z PT_DOMAIN=download.pytorch.org 2024-08-20T22:08:15.4449643Z # TODO: Flaky access to download.pytorch.org https://github.com/pytorch/pytorch/issues/100400, 2024-08-20T22:08:15.4450746Z # cleaning this up once the issue is fixed. There are more than one resolved IP here, the last 2024-08-20T22:08:15.4451488Z # one is returned at random 2024-08-20T22:08:15.4452031Z RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" | tail -n1) 2024-08-20T22:08:15.4452538Z  2024-08-20T22:08:15.4452862Z if [ -z "${RESOLVED_IP}" ]; then 2024-08-20T22:08:15.4453479Z  echo "Couldn't resolve ${PT_DOMAIN}, retrying with Google DNS..." 2024-08-20T22:08:15.4454400Z  RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" @8.8.8.8 | tail -n1) 2024-08-20T22:08:15.4454941Z  2024-08-20T22:08:15.4455265Z  if [ -z "${RESOLVED_IP}" ]; then 2024-08-20T22:08:15.4455807Z  echo "Couldn't resolve ${PT_DOMAIN}, exiting..." 2024-08-20T22:08:15.4456305Z  exit 1 2024-08-20T22:08:15.4456617Z  fi 2024-08-20T22:08:15.4456901Z fi 2024-08-20T22:08:15.4457180Z  2024-08-20T22:08:15.4457536Z if grep -r "${PT_DOMAIN}" /etc/hosts; then 2024-08-20T22:08:15.4458036Z  # Clean up any old records first 2024-08-20T22:08:15.4458536Z  sudo sed -i "/${PT_DOMAIN}/d" /etc/hosts 2024-08-20T22:08:15.4458986Z fi 2024-08-20T22:08:15.4459259Z  2024-08-20T22:08:15.4459689Z echo "${RESOLVED_IP} ${PT_DOMAIN}" | sudo tee -a /etc/hosts 2024-08-20T22:08:15.4460279Z cat /etc/hosts 2024-08-20T22:08:15.4469245Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:08:15.4469737Z env: 2024-08-20T22:08:15.4470034Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:15.4470412Z ##[endgroup] 2024-08-20T22:08:15.4500257Z + PT_DOMAIN=download.pytorch.org 2024-08-20T22:08:15.4506928Z ++ dig -4 +short download.pytorch.org 2024-08-20T22:08:15.4507397Z ++ tail -n1 2024-08-20T22:08:15.4981876Z + RESOLVED_IP=18.160.10.76 2024-08-20T22:08:15.4982554Z + '[' -z 18.160.10.76 ']' 2024-08-20T22:08:15.4983132Z + grep -r download.pytorch.org /etc/hosts 2024-08-20T22:08:15.5001085Z + echo '18.160.10.76 download.pytorch.org' 2024-08-20T22:08:15.5001847Z + sudo tee -a /etc/hosts 2024-08-20T22:08:15.7439294Z 18.160.10.76 download.pytorch.org 2024-08-20T22:08:15.7463570Z + cat /etc/hosts 2024-08-20T22:08:15.7474212Z 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 2024-08-20T22:08:15.7488729Z ::1 localhost6 localhost6.localdomain6 2024-08-20T22:08:15.7489444Z 18.160.10.76 download.pytorch.org 2024-08-20T22:08:15.7645448Z ##[group]Run pytorch/test-infra/.github/actions/calculate-docker-image@main 2024-08-20T22:08:15.7646042Z with: 2024-08-20T22:08:15.7647123Z docker-image-name: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:15.7648329Z docker-build-dir: .ci/docker 2024-08-20T22:08:15.7648714Z working-directory: . 2024-08-20T22:08:15.7649178Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:15.7649688Z force-push: false 2024-08-20T22:08:15.7649995Z env: 2024-08-20T22:08:15.7650305Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:15.7650634Z ##[endgroup] 2024-08-20T22:08:15.7669344Z ##[group]Run set -ex 2024-08-20T22:08:15.7669716Z set -ex 2024-08-20T22:08:15.7670012Z  2024-08-20T22:08:15.7670989Z # If the docker build directory or the build script doesn't exist, the action will 2024-08-20T22:08:15.7671957Z # gracefully return the docker image name as it is. Pulling docker image in Linux 2024-08-20T22:08:15.7672745Z # job could then download the pre-built image as usual 2024-08-20T22:08:15.7673475Z if [[ ! -d "${DOCKER_BUILD_DIR}" ]] || [[ ! -f "${DOCKER_BUILD_DIR}/build.sh" ]]; then 2024-08-20T22:08:15.7674136Z  echo "skip=true" >> "${GITHUB_OUTPUT}" 2024-08-20T22:08:15.7674924Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2024-08-20T22:08:15.7675472Z  2024-08-20T22:08:15.7675976Z  echo "There is no Docker build script in ${REPO_NAME} repo, skipping..." 2024-08-20T22:08:15.7676590Z  exit 0 2024-08-20T22:08:15.7676890Z else 2024-08-20T22:08:15.7677251Z  echo "skip=false" >> "${GITHUB_OUTPUT}" 2024-08-20T22:08:15.7677697Z fi 2024-08-20T22:08:15.7677973Z  2024-08-20T22:08:15.7678437Z if [[ "${DOCKER_IMAGE_NAME}" == *"${DOCKER_REGISTRY}/${REPO_NAME}"* ]]; then 2024-08-20T22:08:15.7679262Z  # The docker image name already includes the ECR prefix and tag, so we can just 2024-08-20T22:08:15.7680025Z  # use it as it is, but first let's extract the tag 2024-08-20T22:08:15.7680718Z  DOCKER_TAG=$(echo "${DOCKER_IMAGE_NAME}" | awk -F '[:,]' '{print $2}') 2024-08-20T22:08:15.7681428Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-08-20T22:08:15.7682126Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2024-08-20T22:08:15.7682673Z else 2024-08-20T22:08:15.7683103Z  DOCKER_TAG=$(git rev-parse HEAD:"${DOCKER_BUILD_DIR}") 2024-08-20T22:08:15.7683758Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-08-20T22:08:15.7684634Z  echo "docker-image=${DOCKER_REGISTRY}/${REPO_NAME}/${DOCKER_IMAGE_NAME}:${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-08-20T22:08:15.7685362Z fi 2024-08-20T22:08:15.7696149Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:08:15.7696651Z env: 2024-08-20T22:08:15.7696935Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:15.7697292Z REPO_NAME: pytorch 2024-08-20T22:08:15.7698421Z DOCKER_IMAGE_NAME: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:15.7699619Z DOCKER_BUILD_DIR: .ci/docker 2024-08-20T22:08:15.7700127Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:15.7700639Z ##[endgroup] 2024-08-20T22:08:15.7730072Z + [[ ! -d .ci/docker ]] 2024-08-20T22:08:15.7730535Z + [[ ! -f .ci/docker/build.sh ]] 2024-08-20T22:08:15.7730923Z + echo skip=false 2024-08-20T22:08:15.7732895Z + [[ 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 == *\3\0\8\5\3\5\3\8\5\1\1\4\.\d\k\r\.\e\c\r\.\u\s\-\e\a\s\t\-\1\.\a\m\a\z\o\n\a\w\s\.\c\o\m\/\p\y\t\o\r\c\h* ]] 2024-08-20T22:08:15.7738027Z ++ echo 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:15.7739263Z ++ awk -F '[:,]' '{print $2}' 2024-08-20T22:08:15.7765196Z + DOCKER_TAG=f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:15.7765909Z + echo docker-tag=f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:15.7767353Z + echo docker-image=308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:15.7801631Z ##[group]Run set +e 2024-08-20T22:08:15.7802171Z set +e 2024-08-20T22:08:15.7802555Z set -x 2024-08-20T22:08:15.7802944Z  2024-08-20T22:08:15.7803378Z login() { 2024-08-20T22:08:15.7804175Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2024-08-20T22:08:15.7804973Z } 2024-08-20T22:08:15.7805410Z  2024-08-20T22:08:15.7805787Z retry () { 2024-08-20T22:08:15.7806234Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2024-08-20T22:08:15.7806835Z } 2024-08-20T22:08:15.7807208Z  2024-08-20T22:08:15.7807615Z retry login "${DOCKER_REGISTRY}" 2024-08-20T22:08:15.7808326Z  2024-08-20T22:08:15.7808890Z # Check if image already exists, if it does then skip building it 2024-08-20T22:08:15.7809690Z if docker manifest inspect "${DOCKER_IMAGE}"; then 2024-08-20T22:08:15.7810400Z  exit 0 2024-08-20T22:08:15.7810794Z fi 2024-08-20T22:08:15.7811198Z  2024-08-20T22:08:15.7811835Z # NB: This part requires a full checkout. Otherwise, the merge base will 2024-08-20T22:08:15.7812765Z # be empty. The default action would be to continue rebuild the image 2024-08-20T22:08:15.7813550Z if [[ "$BASE_REVISION" = "$(git rev-parse HEAD)" ]]; then 2024-08-20T22:08:15.7814353Z  # if we're on the base branch then use the parent commit 2024-08-20T22:08:15.7815043Z  MERGE_BASE=$(git rev-parse HEAD~) 2024-08-20T22:08:15.7815620Z else 2024-08-20T22:08:15.7816142Z  # otherwise we're on a PR, so use the most recent base commit 2024-08-20T22:08:15.7816943Z  MERGE_BASE=$(git merge-base HEAD "$BASE_REVISION") 2024-08-20T22:08:15.7817650Z fi 2024-08-20T22:08:15.7818024Z  2024-08-20T22:08:15.7818421Z if [[ -z "${MERGE_BASE}" ]]; then 2024-08-20T22:08:15.7819054Z  echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2024-08-20T22:08:15.7819623Z  2024-08-20T22:08:15.7820363Z  echo "Finding merge base only works with full checkout, please set fetch-depth to 0, continuing ..." 2024-08-20T22:08:15.7821268Z  exit 0 2024-08-20T22:08:15.7821685Z fi 2024-08-20T22:08:15.7822053Z  2024-08-20T22:08:15.7822594Z if ! git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}"; then 2024-08-20T22:08:15.7823658Z  echo "Directory '${DOCKER_BUILD_DIR}' not found in commit $MERGE_BASE, you should rebase onto a more recent commit" 2024-08-20T22:08:15.7824628Z  exit 1 2024-08-20T22:08:15.7825137Z fi 2024-08-20T22:08:15.7825537Z  2024-08-20T22:08:15.7826082Z PREVIOUS_DOCKER_TAG=$(git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}") 2024-08-20T22:08:15.7827183Z # If no image exists but the hash is the same as the previous hash then we should error out here 2024-08-20T22:08:15.7828132Z if [[ "${PREVIOUS_DOCKER_TAG}" == "${DOCKER_TAG}" ]]; then 2024-08-20T22:08:15.7829174Z  echo "WARNING: Something has gone wrong and the previous image isn't available for the merge-base of your branch" 2024-08-20T22:08:15.7830372Z  echo " Will re-build docker image to store in local cache, TTS may be longer" 2024-08-20T22:08:15.7831270Z fi 2024-08-20T22:08:15.7831677Z  2024-08-20T22:08:15.7832180Z echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2024-08-20T22:08:15.7841775Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:08:15.7842427Z env: 2024-08-20T22:08:15.7842805Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:15.7843333Z DOCKER_BUILD_DIR: .ci/docker 2024-08-20T22:08:15.7843868Z BASE_REVISION: 40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:08:15.7845350Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:15.7846767Z DOCKER_TAG: f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:15.7847457Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:15.7848075Z ##[endgroup] 2024-08-20T22:08:15.7879130Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:15.7880062Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:15.7882499Z + aws ecr get-login-password --region us-east-1 2024-08-20T22:08:15.7883365Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:16.3255031Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-08-20T22:08:16.3256291Z Configure a credential helper to remove this warning. See 2024-08-20T22:08:16.3257407Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-08-20T22:08:16.3257948Z 2024-08-20T22:08:16.3258156Z Login Succeeded 2024-08-20T22:08:16.3279473Z + docker manifest inspect 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:16.5363123Z { 2024-08-20T22:08:16.5363919Z "schemaVersion": 2, 2024-08-20T22:08:16.5364944Z "mediaType": "application/vnd.docker.distribution.manifest.v2+json", 2024-08-20T22:08:16.5365933Z "config": { 2024-08-20T22:08:16.5367075Z "mediaType": "application/vnd.docker.container.image.v1+json", 2024-08-20T22:08:16.5368419Z "size": 48711, 2024-08-20T22:08:16.5369030Z "digest": "sha256:8fef7805cec6e829013a3d62f158b75bdc2f02cdfe3428c032ea017b488473bb" 2024-08-20T22:08:16.5370042Z }, 2024-08-20T22:08:16.5371061Z "layers": [ 2024-08-20T22:08:16.5372162Z { 2024-08-20T22:08:16.5372915Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5374570Z "size": 28580681, 2024-08-20T22:08:16.5375618Z "digest": "sha256:7a2c559011895d255fce249c00396abff5ae7e0c0a92931d0ed493e71de78e3a" 2024-08-20T22:08:16.5376538Z }, 2024-08-20T22:08:16.5376957Z { 2024-08-20T22:08:16.5377470Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5378107Z "size": 7943451, 2024-08-20T22:08:16.5378782Z "digest": "sha256:224fe954d7252f10539d243d6c9688806f7d13ad775ed02e7f7c79077844510d" 2024-08-20T22:08:16.5379493Z }, 2024-08-20T22:08:16.5379796Z { 2024-08-20T22:08:16.5380389Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5381026Z "size": 55728572, 2024-08-20T22:08:16.5381618Z "digest": "sha256:75722010b82e31715876aeeed0b2cee414296f0124fdfa061ab845ba2a158450" 2024-08-20T22:08:16.5382377Z }, 2024-08-20T22:08:16.5382711Z { 2024-08-20T22:08:16.5383229Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5384037Z "size": 186, 2024-08-20T22:08:16.5384808Z "digest": "sha256:d527cbbb87e3016fd72a18a9b468c945ad0ca27c5770b39debd6ed704db3a195" 2024-08-20T22:08:16.5385504Z }, 2024-08-20T22:08:16.5385925Z { 2024-08-20T22:08:16.5386400Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5387176Z "size": 6886, 2024-08-20T22:08:16.5387851Z "digest": "sha256:b57676e46aee1a8c82e528d78e5a13e31142524eea31c8b213d69ddcb6f1fe80" 2024-08-20T22:08:16.5388502Z }, 2024-08-20T22:08:16.5389067Z { 2024-08-20T22:08:16.5389642Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5390301Z "size": 1329001756, 2024-08-20T22:08:16.5390928Z "digest": "sha256:a8c1e85b5e14cec7af70bf304cb4d4cee6a1d25eb8215b2cf4fdc33e5af5e108" 2024-08-20T22:08:16.5391695Z }, 2024-08-20T22:08:16.5392052Z { 2024-08-20T22:08:16.5392613Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5393212Z "size": 62501, 2024-08-20T22:08:16.5394210Z "digest": "sha256:a41a8d1c11c8d80fe4e82b0d05478f8d51176ff20b8350905fc1b25c93a51198" 2024-08-20T22:08:16.5394927Z }, 2024-08-20T22:08:16.5395271Z { 2024-08-20T22:08:16.5395829Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5396456Z "size": 1684, 2024-08-20T22:08:16.5397091Z "digest": "sha256:0c12278907551c2962927d27c115f6f7bf0df894318b8aea6ece3ef01ccd0a8a" 2024-08-20T22:08:16.5397827Z }, 2024-08-20T22:08:16.5398129Z { 2024-08-20T22:08:16.5398671Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5399352Z "size": 1523, 2024-08-20T22:08:16.5399989Z "digest": "sha256:d8d1234baab3ec9ccb8bb710fc6b8ff6c10896ba2e8d27a347583eca770f9ff1" 2024-08-20T22:08:16.5400733Z }, 2024-08-20T22:08:16.5401114Z { 2024-08-20T22:08:16.5401624Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5402400Z "size": 2528295403, 2024-08-20T22:08:16.5403111Z "digest": "sha256:7ed32bc8e4696fcdb2feef850781160597b2275ad756819c4add88236b0577d5" 2024-08-20T22:08:16.5403826Z }, 2024-08-20T22:08:16.5404156Z { 2024-08-20T22:08:16.5404692Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5405349Z "size": 86016, 2024-08-20T22:08:16.5405977Z "digest": "sha256:ec1e7978c1fe161ced1d98092a51e7c5953ca5fda5577f54df9dbda4afff1b2b" 2024-08-20T22:08:16.5406745Z }, 2024-08-20T22:08:16.5407050Z { 2024-08-20T22:08:16.5407569Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5408278Z "size": 1822, 2024-08-20T22:08:16.5408870Z "digest": "sha256:ac23c5fcc1ef310e9cd0d138b180281188e20a3e28c51cd14751622e3c7d92ea" 2024-08-20T22:08:16.5409570Z }, 2024-08-20T22:08:16.5409984Z { 2024-08-20T22:08:16.5410505Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5411149Z "size": 246761563, 2024-08-20T22:08:16.5411889Z "digest": "sha256:ca426ffc9d2bd051ad1ff5c4f02fd5d9be161e70953cc37882c815080c708f4d" 2024-08-20T22:08:16.5412583Z }, 2024-08-20T22:08:16.5412999Z { 2024-08-20T22:08:16.5413479Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5414106Z "size": 544, 2024-08-20T22:08:16.5414782Z "digest": "sha256:4373aa743caf6660c671295b837048c8350a2165f2336dc3b7b6c96462579e50" 2024-08-20T22:08:16.5415452Z }, 2024-08-20T22:08:16.5415747Z { 2024-08-20T22:08:16.5416330Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5416976Z "size": 1258, 2024-08-20T22:08:16.5417561Z "digest": "sha256:75b2abb16c685854c017d0cf75c626526c956734c656d9e78fdd4520317e9b3c" 2024-08-20T22:08:16.5418313Z }, 2024-08-20T22:08:16.5418644Z { 2024-08-20T22:08:16.5419178Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5419821Z "size": 484, 2024-08-20T22:08:16.5420426Z "digest": "sha256:ef1e3ef1e85f0124270b8506721219150e230184181f8207d64463bf5c67e656" 2024-08-20T22:08:16.5421126Z }, 2024-08-20T22:08:16.5421505Z { 2024-08-20T22:08:16.5421985Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5422639Z "size": 91711766, 2024-08-20T22:08:16.5423322Z "digest": "sha256:0bf61114d37b2d09065aa6852b1e78a32580a1ff011dd5d23f03b0f5c4e710af" 2024-08-20T22:08:16.5424004Z }, 2024-08-20T22:08:16.5424326Z { 2024-08-20T22:08:16.5424969Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5425617Z "size": 3390, 2024-08-20T22:08:16.5426302Z "digest": "sha256:2df849f72ba4258df10c9c45ace21a66d93b73196e78e96f12c13098822f60e2" 2024-08-20T22:08:16.5427054Z }, 2024-08-20T22:08:16.5427410Z { 2024-08-20T22:08:16.5427922Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5428577Z "size": 1909, 2024-08-20T22:08:16.5429206Z "digest": "sha256:34c47d63c5de27418739aa048b4dd781c3006d65691e9b903c95304d0509d89c" 2024-08-20T22:08:16.5429897Z }, 2024-08-20T22:08:16.5430333Z { 2024-08-20T22:08:16.5430838Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5431463Z "size": 701, 2024-08-20T22:08:16.5432164Z "digest": "sha256:1fef4bd19792cbf9d3aea12795089ad41164bb6d607c339b7484e1899825b1d2" 2024-08-20T22:08:16.5432819Z }, 2024-08-20T22:08:16.5433149Z { 2024-08-20T22:08:16.5433733Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5434361Z "size": 2864254879, 2024-08-20T22:08:16.5434979Z "digest": "sha256:6efb96fc87ea1bca54876d85331e5585e28f325a1d60ee1aef7811eabb74f933" 2024-08-20T22:08:16.5435762Z }, 2024-08-20T22:08:16.5436094Z { 2024-08-20T22:08:16.5436694Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5437294Z "size": 380, 2024-08-20T22:08:16.5437935Z "digest": "sha256:b119c4fc6c58d9e72744201ff4850b34184a94eb3566031b7d36e87ecce950a6" 2024-08-20T22:08:16.5438787Z }, 2024-08-20T22:08:16.5439101Z { 2024-08-20T22:08:16.5439625Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5440355Z "size": 12900, 2024-08-20T22:08:16.5441015Z "digest": "sha256:33b639226eeefa41d7bb26a8ecc20d271ceef45571dabfd80aaee3634926381b" 2024-08-20T22:08:16.5441698Z }, 2024-08-20T22:08:16.5442152Z { 2024-08-20T22:08:16.5442644Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5443307Z "size": 803, 2024-08-20T22:08:16.5443981Z "digest": "sha256:d3547bd43146930aa830d54562c98aa678e355cf5f84527e9717eb72fffe8ca3" 2024-08-20T22:08:16.5444710Z }, 2024-08-20T22:08:16.5445014Z { 2024-08-20T22:08:16.5445592Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5446251Z "size": 106, 2024-08-20T22:08:16.5446866Z "digest": "sha256:5645520256fa6d7f2270608eaed53849a131d03fbf4c5d4472c9cfde1a439e47" 2024-08-20T22:08:16.5447577Z }, 2024-08-20T22:08:16.5447951Z { 2024-08-20T22:08:16.5448474Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5449126Z "size": 503, 2024-08-20T22:08:16.5449763Z "digest": "sha256:829ed7d91e3818d0e11834c71551117c7aeec0a51d798e93d641faa0c02582cb" 2024-08-20T22:08:16.5450505Z }, 2024-08-20T22:08:16.5450928Z { 2024-08-20T22:08:16.5451433Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5452066Z "size": 121477267, 2024-08-20T22:08:16.5452788Z "digest": "sha256:385d0421d67c533d628985c453a186028a61f6ad4209ae519ec3d4ecea661d3e" 2024-08-20T22:08:16.5453469Z }, 2024-08-20T22:08:16.5453765Z { 2024-08-20T22:08:16.5454363Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5454987Z "size": 109, 2024-08-20T22:08:16.5455565Z "digest": "sha256:7cbfce999d76851e07dd71056a6d852629d789ccfd46be44cc405b451fb8bb58" 2024-08-20T22:08:16.5456329Z }, 2024-08-20T22:08:16.5456660Z { 2024-08-20T22:08:16.5457245Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5457840Z "size": 490, 2024-08-20T22:08:16.5458474Z "digest": "sha256:6658e558ebe496f0d628947534b0ea1e44808f84f2dfd8a9a704e8aa5329d791" 2024-08-20T22:08:16.5459231Z }, 2024-08-20T22:08:16.5459565Z { 2024-08-20T22:08:16.5460046Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5460796Z "size": 297, 2024-08-20T22:08:16.5461407Z "digest": "sha256:33444a5a7e01a3010fd1cc16b32a66892a08600d7f700747d23faf3c36624f3a" 2024-08-20T22:08:16.5462087Z }, 2024-08-20T22:08:16.5462555Z { 2024-08-20T22:08:16.5463074Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5463730Z "size": 103, 2024-08-20T22:08:16.5464364Z "digest": "sha256:7c47122f4e09b47e891b4ae9e499a35a4eb46faacae87d0e946615adda6e0706" 2024-08-20T22:08:16.5465153Z }, 2024-08-20T22:08:16.5465512Z { 2024-08-20T22:08:16.5466081Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5466679Z "size": 1473, 2024-08-20T22:08:16.5467320Z "digest": "sha256:1811ff4d3556ac255604f346d879528aff2aadd7652c2d39baf4fe6eaa60aec3" 2024-08-20T22:08:16.5468061Z }, 2024-08-20T22:08:16.5468418Z { 2024-08-20T22:08:16.5468898Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5469595Z "size": 594729516, 2024-08-20T22:08:16.5470269Z "digest": "sha256:7754ee068b33f760d9c320c26a1a3935247ace0c8c463a976105c1586a43fb1c" 2024-08-20T22:08:16.5471425Z }, 2024-08-20T22:08:16.5471844Z { 2024-08-20T22:08:16.5472403Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5473045Z "size": 164, 2024-08-20T22:08:16.5473684Z "digest": "sha256:0479fbac3361713c075bf788e778117917dcacdd1ff71ed79a789dd2016a1714" 2024-08-20T22:08:16.5474399Z }, 2024-08-20T22:08:16.5474737Z { 2024-08-20T22:08:16.5475324Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5476084Z "size": 564, 2024-08-20T22:08:16.5476695Z "digest": "sha256:f1d6874dee9c34d154278d2b6935d04447f07fa89d25d4a09398234040d8a7e8" 2024-08-20T22:08:16.5477454Z }, 2024-08-20T22:08:16.5477791Z { 2024-08-20T22:08:16.5478294Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5479025Z "size": 35874203, 2024-08-20T22:08:16.5479675Z "digest": "sha256:afc429e87b593a64f3e0a1be51e09e966ea1aa71e6e8a0bec4edc9f2f7bc1c05" 2024-08-20T22:08:16.5480367Z }, 2024-08-20T22:08:16.5480766Z { 2024-08-20T22:08:16.5481292Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5481997Z "size": 104, 2024-08-20T22:08:16.5482573Z "digest": "sha256:019620471c2592cd22437fe8ed1a94c784114cf7445c5c2ab36dd0bae727fc66" 2024-08-20T22:08:16.5483260Z }, 2024-08-20T22:08:16.5483672Z { 2024-08-20T22:08:16.5484195Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5484792Z "size": 425, 2024-08-20T22:08:16.5485542Z "digest": "sha256:27aeb1b2cd5e28d8f0e54fc1090baf88abc29ebf5fce088b493fcae99c9550d1" 2024-08-20T22:08:16.5486254Z }, 2024-08-20T22:08:16.5486578Z { 2024-08-20T22:08:16.5487145Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5487779Z "size": 20262183, 2024-08-20T22:08:16.5488430Z "digest": "sha256:829c0e19f4b7797e9120a86172fabfd710f9b3971ffd714a616931a3fadc7192" 2024-08-20T22:08:16.5489134Z }, 2024-08-20T22:08:16.5489473Z { 2024-08-20T22:08:16.5490016Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5490745Z "size": 438, 2024-08-20T22:08:16.5491327Z "digest": "sha256:560cd6122a3868e7e82e75eb103d182edf6512114d61ccdfae099af00cb16b4c" 2024-08-20T22:08:16.5492052Z }, 2024-08-20T22:08:16.5492447Z { 2024-08-20T22:08:16.5492989Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5493652Z "size": 701, 2024-08-20T22:08:16.5494341Z "digest": "sha256:1fef4bd19792cbf9d3aea12795089ad41164bb6d607c339b7484e1899825b1d2" 2024-08-20T22:08:16.5495051Z }, 2024-08-20T22:08:16.5495351Z { 2024-08-20T22:08:16.5495966Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5496597Z "size": 141, 2024-08-20T22:08:16.5497233Z "digest": "sha256:5a4eb19d72198a01f3babd4711c40fcf7c6e5cb9d5cfedc507b0061408d47097" 2024-08-20T22:08:16.5497976Z }, 2024-08-20T22:08:16.5498319Z { 2024-08-20T22:08:16.5498860Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5499557Z "size": 135, 2024-08-20T22:08:16.5500269Z "digest": "sha256:da6a838a66c72b5de9a5590c233779880ea901c1264940a1c618825d2501ffd1" 2024-08-20T22:08:16.5501035Z }, 2024-08-20T22:08:16.5501430Z { 2024-08-20T22:08:16.5501914Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5502571Z "size": 4838068375, 2024-08-20T22:08:16.5503261Z "digest": "sha256:cbb79a7053537bed2d80b77198ea552b985563b11d3f8616593c6ab575a3a090" 2024-08-20T22:08:16.5503958Z }, 2024-08-20T22:08:16.5504283Z { 2024-08-20T22:08:16.5504955Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5505640Z "size": 194, 2024-08-20T22:08:16.5506312Z "digest": "sha256:4d4fa6802ab3e6b36d8d4adb650046e9370c4a16a19876970559ef8a312ca855" 2024-08-20T22:08:16.5506974Z }, 2024-08-20T22:08:16.5507339Z { 2024-08-20T22:08:16.5507892Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5508519Z "size": 564, 2024-08-20T22:08:16.5509135Z "digest": "sha256:0f085d4fa279366fcd52d303b7ad8abddc5962a8872174b8109f3f5d5ca5f2cf" 2024-08-20T22:08:16.5509873Z }, 2024-08-20T22:08:16.5510214Z { 2024-08-20T22:08:16.5510711Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5511396Z "size": 43162921, 2024-08-20T22:08:16.5512083Z "digest": "sha256:4a0412373305517489d891a4749e6d2b80b4aeb7df3b8adca0ed0abb2f3e5300" 2024-08-20T22:08:16.5512923Z }, 2024-08-20T22:08:16.5513289Z { 2024-08-20T22:08:16.5513833Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5514458Z "size": 106, 2024-08-20T22:08:16.5515144Z "digest": "sha256:302c8c1779444e54919f83e91c6d5e1fdea653fc899be802b3a2a34d34d99d5d" 2024-08-20T22:08:16.5515790Z }, 2024-08-20T22:08:16.5516129Z { 2024-08-20T22:08:16.5516724Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5517312Z "size": 1380, 2024-08-20T22:08:16.5517931Z "digest": "sha256:02970347dff622ee45629bc28788716d00528464f71f88ec7b74ae5f44a486e2" 2024-08-20T22:08:16.5518716Z }, 2024-08-20T22:08:16.5519052Z { 2024-08-20T22:08:16.5519525Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5520232Z "size": 701, 2024-08-20T22:08:16.5520900Z "digest": "sha256:1fef4bd19792cbf9d3aea12795089ad41164bb6d607c339b7484e1899825b1d2" 2024-08-20T22:08:16.5521608Z }, 2024-08-20T22:08:16.5521972Z { 2024-08-20T22:08:16.5522490Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5523150Z "size": 139, 2024-08-20T22:08:16.5523807Z "digest": "sha256:916c5e8580164926a3aec87e88a5d1c2d02756e49fdeed4198e1e6304efa2fd3" 2024-08-20T22:08:16.5524457Z }, 2024-08-20T22:08:16.5524815Z { 2024-08-20T22:08:16.5525400Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5525992Z "size": 118, 2024-08-20T22:08:16.5526620Z "digest": "sha256:c42b3602a1fb4df5111224650f15adffb025979ae9c614807379ea84e189533b" 2024-08-20T22:08:16.5527373Z }, 2024-08-20T22:08:16.5527729Z { 2024-08-20T22:08:16.5528213Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5528901Z "size": 4324672728, 2024-08-20T22:08:16.5529584Z "digest": "sha256:11fad972ef6cb9d2dc236504b0ee5b6e5ea996e4576ece0ed3262fbb9ee2de60" 2024-08-20T22:08:16.5530338Z }, 2024-08-20T22:08:16.5530676Z { 2024-08-20T22:08:16.5531247Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5531960Z "size": 174, 2024-08-20T22:08:16.5532528Z "digest": "sha256:f957c16244819132b478272aaf24231699c4fcbd495c229a574f94daab8d6b86" 2024-08-20T22:08:16.5533234Z }, 2024-08-20T22:08:16.5533623Z { 2024-08-20T22:08:16.5534162Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5534749Z "size": 907, 2024-08-20T22:08:16.5535425Z "digest": "sha256:768c31dca016b80bbdc973c8ee818034bdbd17b7ea9bdadbf0ec45ea51005720" 2024-08-20T22:08:16.5536150Z }, 2024-08-20T22:08:16.5536581Z { 2024-08-20T22:08:16.5537154Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5537806Z "size": 701, 2024-08-20T22:08:16.5538422Z "digest": "sha256:1fef4bd19792cbf9d3aea12795089ad41164bb6d607c339b7484e1899825b1d2" 2024-08-20T22:08:16.5539251Z }, 2024-08-20T22:08:16.5539569Z { 2024-08-20T22:08:16.5540101Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5540865Z "size": 134, 2024-08-20T22:08:16.5541455Z "digest": "sha256:8c32d0ecebbe2054c96a3a5c1f3d6c8b87c2e826686b369e5242cd55d0f01c2d" 2024-08-20T22:08:16.5542163Z }, 2024-08-20T22:08:16.5542573Z { 2024-08-20T22:08:16.5543095Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5543688Z "size": 32, 2024-08-20T22:08:16.5544398Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-20T22:08:16.5545158Z }, 2024-08-20T22:08:16.5545555Z { 2024-08-20T22:08:16.5546090Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5546722Z "size": 158, 2024-08-20T22:08:16.5547365Z "digest": "sha256:78ee77eddef23f20afc78e2924f4467041cadb754634ee3df431c68211cf676d" 2024-08-20T22:08:16.5548114Z }, 2024-08-20T22:08:16.5548423Z { 2024-08-20T22:08:16.5548958Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5549735Z "size": 1841, 2024-08-20T22:08:16.5550348Z "digest": "sha256:37513e9b43d7123e7ddee09100f62a72b57af7b3833eaecd515e247e2f63e13f" 2024-08-20T22:08:16.5551034Z }, 2024-08-20T22:08:16.5551422Z { 2024-08-20T22:08:16.5551990Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5552594Z "size": 7529776, 2024-08-20T22:08:16.5553276Z "digest": "sha256:a7a5392e2bf6b73d9be292cc22a99ad4637636c15733beb7afbe6403b5ba21a8" 2024-08-20T22:08:16.5554000Z }, 2024-08-20T22:08:16.5554403Z { 2024-08-20T22:08:16.5554899Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5555557Z "size": 163, 2024-08-20T22:08:16.5556246Z "digest": "sha256:b10de02255c021b2366b85bf12ddf593aac89f88964201c455b71a145bc5ca2e" 2024-08-20T22:08:16.5556931Z }, 2024-08-20T22:08:16.5557281Z { 2024-08-20T22:08:16.5557850Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5558504Z "size": 7943, 2024-08-20T22:08:16.5559132Z "digest": "sha256:e56eeff2db93ffe5002a2bb764795b7333321c6802cc28bef0801a619fe6a07e" 2024-08-20T22:08:16.5559935Z + exit 0 2024-08-20T22:08:16.5560327Z }, 2024-08-20T22:08:16.5560707Z { 2024-08-20T22:08:16.5561288Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5561885Z "size": 8068, 2024-08-20T22:08:16.5562511Z "digest": "sha256:70ac3e38d0fd1f0f46ad710c3fc485fd01406606054e8cf84a63af1570bc9f3a" 2024-08-20T22:08:16.5563272Z }, 2024-08-20T22:08:16.5563570Z { 2024-08-20T22:08:16.5564098Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5564808Z "size": 302, 2024-08-20T22:08:16.5565446Z "digest": "sha256:eb09cbf3e4168749cc8605e3188ed35070f6037d13930e443c38d8941734488f" 2024-08-20T22:08:16.5566089Z }, 2024-08-20T22:08:16.5566506Z { 2024-08-20T22:08:16.5567035Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5567699Z "size": 7629638, 2024-08-20T22:08:16.5568349Z "digest": "sha256:ee1273153675e6543b58f5be50321abee5e91f7351701d5d501a6837eaf676ef" 2024-08-20T22:08:16.5569033Z }, 2024-08-20T22:08:16.5569400Z { 2024-08-20T22:08:16.5569976Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5570869Z "size": 108, 2024-08-20T22:08:16.5571535Z "digest": "sha256:e22979f9e0eedfa16f98eb4fa26f30a50c237f5ffd2f6e5b898f2b908058496d" 2024-08-20T22:08:16.5572307Z }, 2024-08-20T22:08:16.5572651Z { 2024-08-20T22:08:16.5573190Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5574050Z "size": 54145661, 2024-08-20T22:08:16.5574723Z "digest": "sha256:6c1f0aabce7c84f9b0b9ab3b96325778dba1c1465b7463c5b4c6be1cf52b74db" 2024-08-20T22:08:16.5575388Z }, 2024-08-20T22:08:16.5575801Z { 2024-08-20T22:08:16.5576335Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5577020Z "size": 473, 2024-08-20T22:08:16.5577622Z "digest": "sha256:7ebe49c3a23e71b289ce012b48dad35791a2f2aa7fcee2326a64d763b0d14df8" 2024-08-20T22:08:16.5578345Z }, 2024-08-20T22:08:16.5578733Z { 2024-08-20T22:08:16.5579264Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5579899Z "size": 1374858766, 2024-08-20T22:08:16.5580588Z "digest": "sha256:5d115b29b5d53e5418762bc41ae975dd245bcffc3d058b8902c58146d505cb37" 2024-08-20T22:08:16.5581302Z }, 2024-08-20T22:08:16.5581601Z { 2024-08-20T22:08:16.5582173Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5582821Z "size": 106, 2024-08-20T22:08:16.5583457Z "digest": "sha256:7f2d7a04fbe65bbe1e895138e0cfeeef53ad926c890bab8e7e132ad1e655e48f" 2024-08-20T22:08:16.5584165Z }, 2024-08-20T22:08:16.5584588Z { 2024-08-20T22:08:16.5585107Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5585853Z "size": 559, 2024-08-20T22:08:16.5586426Z "digest": "sha256:d79fd7d526989e554455eda7d459f2c88444030f61710101e52ec8c7a49b7b79" 2024-08-20T22:08:16.5587241Z }, 2024-08-20T22:08:16.5587660Z { 2024-08-20T22:08:16.5588144Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5588807Z "size": 46248488, 2024-08-20T22:08:16.5589500Z "digest": "sha256:9752d6fbbcab4e7403f26777c5b65911320de6389c81b833a47ba45c4f3354b4" 2024-08-20T22:08:16.5590193Z }, 2024-08-20T22:08:16.5590519Z { 2024-08-20T22:08:16.5591127Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5591763Z "size": 111, 2024-08-20T22:08:16.5592409Z "digest": "sha256:83808b2eff4d71ed46db7c29f66fe918f328405c25b314225dfad01b4868d1f4" 2024-08-20T22:08:16.5593139Z }, 2024-08-20T22:08:16.5593553Z { 2024-08-20T22:08:16.5594098Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5594724Z "size": 32, 2024-08-20T22:08:16.5595333Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-20T22:08:16.5596080Z }, 2024-08-20T22:08:16.5596410Z { 2024-08-20T22:08:16.5596906Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5597581Z "size": 32, 2024-08-20T22:08:16.5598214Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-20T22:08:16.5598902Z }, 2024-08-20T22:08:16.5599282Z { 2024-08-20T22:08:16.5599818Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5600443Z "size": 32, 2024-08-20T22:08:16.5601111Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-20T22:08:16.5601791Z }, 2024-08-20T22:08:16.5602122Z { 2024-08-20T22:08:16.5602684Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T22:08:16.5603336Z "size": 32, 2024-08-20T22:08:16.5603913Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-20T22:08:16.5604677Z } 2024-08-20T22:08:16.5605015Z ] 2024-08-20T22:08:16.5605312Z } 2024-08-20T22:08:16.5907341Z ##[group]Run tag=${ECR_DOCKER_IMAGE##*/} 2024-08-20T22:08:16.5907842Z tag=${ECR_DOCKER_IMAGE##*/} 2024-08-20T22:08:16.5908389Z echo "docker pull ghcr.io/pytorch/ci-image:${tag/:/-}" 2024-08-20T22:08:16.5917637Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:08:16.5918148Z env: 2024-08-20T22:08:16.5918441Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:16.5919589Z ECR_DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:16.5920808Z ##[endgroup] 2024-08-20T22:08:16.5952753Z docker pull ghcr.io/pytorch/ci-image:pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks-f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:16.6003926Z ##[group]Run pytorch/test-infra/.github/actions/pull-docker-image@main 2024-08-20T22:08:16.6004502Z with: 2024-08-20T22:08:16.6005576Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:16.6006881Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:16.6007397Z env: 2024-08-20T22:08:16.6007677Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:16.6008034Z ##[endgroup] 2024-08-20T22:08:16.6025650Z ##[group]Run set -x 2024-08-20T22:08:16.6026003Z set -x 2024-08-20T22:08:16.6026318Z set +e 2024-08-20T22:08:16.6026626Z  2024-08-20T22:08:16.6026914Z login() { 2024-08-20T22:08:16.6027579Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2024-08-20T22:08:16.6028297Z } 2024-08-20T22:08:16.6028588Z  2024-08-20T22:08:16.6028905Z retry () { 2024-08-20T22:08:16.6029309Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2024-08-20T22:08:16.6029923Z } 2024-08-20T22:08:16.6030219Z  2024-08-20T22:08:16.6030601Z retry login "${DOCKER_REGISTRY}" 2024-08-20T22:08:16.6031029Z  2024-08-20T22:08:16.6031317Z set -e 2024-08-20T22:08:16.6031799Z # ignore output since only exit code is used for conditional 2024-08-20T22:08:16.6032519Z # only pull docker image if it's not available locally 2024-08-20T22:08:16.6033282Z if ! docker inspect --type=image "${DOCKER_IMAGE}" >/dev/null 2>/dev/null; then 2024-08-20T22:08:16.6033982Z  retry docker pull "${DOCKER_IMAGE}" 2024-08-20T22:08:16.6034433Z fi 2024-08-20T22:08:16.6042547Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:08:16.6043049Z env: 2024-08-20T22:08:16.6043339Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:08:16.6044481Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:16.6045794Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:16.6046317Z ##[endgroup] 2024-08-20T22:08:16.6074567Z + set +e 2024-08-20T22:08:16.6075359Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:16.6076011Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:16.6078799Z + aws ecr get-login-password --region us-east-1 2024-08-20T22:08:16.6079583Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T22:08:17.1347612Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-08-20T22:08:17.1348526Z Configure a credential helper to remove this warning. See 2024-08-20T22:08:17.1349447Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-08-20T22:08:17.1350067Z 2024-08-20T22:08:17.1350196Z Login Succeeded 2024-08-20T22:08:17.1369599Z + set -e 2024-08-20T22:08:17.1371302Z + docker inspect --type=image 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:17.1537267Z + retry docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:17.1539392Z + docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:08:17.3866150Z f6d216893d65c7b8ae43df4daaf247db808378e9: Pulling from pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks 2024-08-20T22:08:17.3869860Z 7a2c55901189: Pulling fs layer 2024-08-20T22:08:17.3870299Z 224fe954d725: Pulling fs layer 2024-08-20T22:08:17.3871440Z 75722010b82e: Pulling fs layer 2024-08-20T22:08:17.3871900Z d527cbbb87e3: Pulling fs layer 2024-08-20T22:08:17.3872399Z b57676e46aee: Pulling fs layer 2024-08-20T22:08:17.3872906Z a8c1e85b5e14: Pulling fs layer 2024-08-20T22:08:17.3873446Z a41a8d1c11c8: Pulling fs layer 2024-08-20T22:08:17.3873931Z 0c1227890755: Pulling fs layer 2024-08-20T22:08:17.3874417Z d8d1234baab3: Pulling fs layer 2024-08-20T22:08:17.3874875Z d527cbbb87e3: Waiting 2024-08-20T22:08:17.3875310Z 7ed32bc8e469: Pulling fs layer 2024-08-20T22:08:17.3875704Z ec1e7978c1fe: Pulling fs layer 2024-08-20T22:08:17.3876083Z ac23c5fcc1ef: Pulling fs layer 2024-08-20T22:08:17.3876437Z b57676e46aee: Waiting 2024-08-20T22:08:17.3876755Z a8c1e85b5e14: Waiting 2024-08-20T22:08:17.3877087Z ca426ffc9d2b: Pulling fs layer 2024-08-20T22:08:17.3877458Z 4373aa743caf: Pulling fs layer 2024-08-20T22:08:17.3877805Z a41a8d1c11c8: Waiting 2024-08-20T22:08:17.3878114Z 0c1227890755: Waiting 2024-08-20T22:08:17.3878493Z d8d1234baab3: Waiting 2024-08-20T22:08:17.3878816Z 7ed32bc8e469: Waiting 2024-08-20T22:08:17.3879147Z 75b2abb16c68: Pulling fs layer 2024-08-20T22:08:17.3879520Z ef1e3ef1e85f: Pulling fs layer 2024-08-20T22:08:17.3880091Z 0bf61114d37b: Pulling fs layer 2024-08-20T22:08:17.3880484Z 2df849f72ba4: Pulling fs layer 2024-08-20T22:08:17.3880868Z 34c47d63c5de: Pulling fs layer 2024-08-20T22:08:17.3881332Z ec1e7978c1fe: Waiting 2024-08-20T22:08:17.3881656Z ac23c5fcc1ef: Waiting 2024-08-20T22:08:17.3882068Z 1fef4bd19792: Pulling fs layer 2024-08-20T22:08:17.3882535Z 6efb96fc87ea: Pulling fs layer 2024-08-20T22:08:17.3883025Z b119c4fc6c58: Pulling fs layer 2024-08-20T22:08:17.3883492Z ca426ffc9d2b: Waiting 2024-08-20T22:08:17.3883843Z 4373aa743caf: Waiting 2024-08-20T22:08:17.3884170Z 33b639226eee: Pulling fs layer 2024-08-20T22:08:17.3884538Z d3547bd43146: Pulling fs layer 2024-08-20T22:08:17.3884896Z 5645520256fa: Pulling fs layer 2024-08-20T22:08:17.3885260Z 829ed7d91e38: Pulling fs layer 2024-08-20T22:08:17.3885613Z 1fef4bd19792: Waiting 2024-08-20T22:08:17.3885947Z 385d0421d67c: Pulling fs layer 2024-08-20T22:08:17.3886299Z 2df849f72ba4: Waiting 2024-08-20T22:08:17.3886614Z 34c47d63c5de: Waiting 2024-08-20T22:08:17.3886952Z 7cbfce999d76: Pulling fs layer 2024-08-20T22:08:17.3887303Z ef1e3ef1e85f: Waiting 2024-08-20T22:08:17.3887693Z 6658e558ebe4: Pulling fs layer 2024-08-20T22:08:17.3888109Z 33444a5a7e01: Pulling fs layer 2024-08-20T22:08:17.3888488Z 7c47122f4e09: Pulling fs layer 2024-08-20T22:08:17.3888897Z 1811ff4d3556: Pulling fs layer 2024-08-20T22:08:17.3889312Z 7754ee068b33: Pulling fs layer 2024-08-20T22:08:17.3889714Z 0479fbac3361: Pulling fs layer 2024-08-20T22:08:17.3890067Z 385d0421d67c: Waiting 2024-08-20T22:08:17.3890426Z 5645520256fa: Waiting 2024-08-20T22:08:17.3890756Z f1d6874dee9c: Pulling fs layer 2024-08-20T22:08:17.3891191Z afc429e87b59: Pulling fs layer 2024-08-20T22:08:17.3891572Z 33444a5a7e01: Waiting 2024-08-20T22:08:17.3891891Z 019620471c25: Pulling fs layer 2024-08-20T22:08:17.3892240Z 7c47122f4e09: Waiting 2024-08-20T22:08:17.3892574Z 27aeb1b2cd5e: Pulling fs layer 2024-08-20T22:08:17.3892932Z 0bf61114d37b: Waiting 2024-08-20T22:08:17.3893256Z 829c0e19f4b7: Pulling fs layer 2024-08-20T22:08:17.3893637Z 560cd6122a38: Pulling fs layer 2024-08-20T22:08:17.3893987Z 7754ee068b33: Waiting 2024-08-20T22:08:17.3894291Z afc429e87b59: Waiting 2024-08-20T22:08:17.3894606Z 829c0e19f4b7: Waiting 2024-08-20T22:08:17.3894932Z 5a4eb19d7219: Pulling fs layer 2024-08-20T22:08:17.3895304Z da6a838a66c7: Pulling fs layer 2024-08-20T22:08:17.3895667Z cbb79a705353: Pulling fs layer 2024-08-20T22:08:17.3896030Z 0479fbac3361: Waiting 2024-08-20T22:08:17.3896357Z 4d4fa6802ab3: Pulling fs layer 2024-08-20T22:08:17.3896729Z 0f085d4fa279: Pulling fs layer 2024-08-20T22:08:17.3897078Z da6a838a66c7: Waiting 2024-08-20T22:08:17.3897400Z 4a0412373305: Pulling fs layer 2024-08-20T22:08:17.3897752Z cbb79a705353: Waiting 2024-08-20T22:08:17.3898072Z 302c8c177944: Pulling fs layer 2024-08-20T22:08:17.3898426Z 1811ff4d3556: Waiting 2024-08-20T22:08:17.3898942Z 4a0412373305: Waiting 2024-08-20T22:08:17.3899257Z 5a4eb19d7219: Waiting 2024-08-20T22:08:17.3899579Z 02970347dff6: Pulling fs layer 2024-08-20T22:08:17.3899943Z 916c5e858016: Pulling fs layer 2024-08-20T22:08:17.3900297Z 019620471c25: Waiting 2024-08-20T22:08:17.3900622Z c42b3602a1fb: Pulling fs layer 2024-08-20T22:08:17.3900972Z 02970347dff6: Waiting 2024-08-20T22:08:17.3901281Z 0f085d4fa279: Waiting 2024-08-20T22:08:17.3901610Z 11fad972ef6c: Pulling fs layer 2024-08-20T22:08:17.3901977Z f957c1624481: Pulling fs layer 2024-08-20T22:08:17.3902330Z 560cd6122a38: Waiting 2024-08-20T22:08:17.3902655Z 768c31dca016: Pulling fs layer 2024-08-20T22:08:17.3903008Z 4d4fa6802ab3: Waiting 2024-08-20T22:08:17.3903330Z 8c32d0ecebbe: Pulling fs layer 2024-08-20T22:08:17.3903702Z 4f4fb700ef54: Pulling fs layer 2024-08-20T22:08:17.3904060Z 11fad972ef6c: Waiting 2024-08-20T22:08:17.3904369Z 8c32d0ecebbe: Waiting 2024-08-20T22:08:17.3904818Z 78ee77eddef2: Pulling fs layer 2024-08-20T22:08:17.3905193Z 37513e9b43d7: Pulling fs layer 2024-08-20T22:08:17.3905551Z 4f4fb700ef54: Waiting 2024-08-20T22:08:17.3905859Z 768c31dca016: Waiting 2024-08-20T22:08:17.3906188Z a7a5392e2bf6: Pulling fs layer 2024-08-20T22:08:17.3906645Z b10de02255c0: Pulling fs layer 2024-08-20T22:08:17.3907016Z e56eeff2db93: Pulling fs layer 2024-08-20T22:08:17.3907382Z 70ac3e38d0fd: Pulling fs layer 2024-08-20T22:08:17.3907753Z eb09cbf3e416: Pulling fs layer 2024-08-20T22:08:17.3908110Z a7a5392e2bf6: Waiting 2024-08-20T22:08:17.3908418Z 70ac3e38d0fd: Waiting 2024-08-20T22:08:17.3908746Z ee1273153675: Pulling fs layer 2024-08-20T22:08:17.3909098Z e56eeff2db93: Waiting 2024-08-20T22:08:17.3909429Z e22979f9e0ee: Pulling fs layer 2024-08-20T22:08:17.3909795Z 6c1f0aabce7c: Pulling fs layer 2024-08-20T22:08:17.3910169Z 7ebe49c3a23e: Pulling fs layer 2024-08-20T22:08:17.3910525Z ee1273153675: Waiting 2024-08-20T22:08:17.3910851Z 5d115b29b5d5: Pulling fs layer 2024-08-20T22:08:17.3911261Z 7f2d7a04fbe6: Pulling fs layer 2024-08-20T22:08:17.3911623Z 6c1f0aabce7c: Waiting 2024-08-20T22:08:17.3911944Z e22979f9e0ee: Waiting 2024-08-20T22:08:17.3912252Z 7ebe49c3a23e: Waiting 2024-08-20T22:08:17.3912580Z d79fd7d52698: Pulling fs layer 2024-08-20T22:08:17.3912966Z 9752d6fbbcab: Pulling fs layer 2024-08-20T22:08:17.3913324Z d79fd7d52698: Waiting 2024-08-20T22:08:17.3913647Z 83808b2eff4d: Pulling fs layer 2024-08-20T22:08:17.3914004Z 9752d6fbbcab: Waiting 2024-08-20T22:08:17.3914317Z 83808b2eff4d: Waiting 2024-08-20T22:08:17.3914629Z eb09cbf3e416: Waiting 2024-08-20T22:08:17.5350339Z 224fe954d725: Verifying Checksum 2024-08-20T22:08:17.5350931Z 224fe954d725: Download complete 2024-08-20T22:08:17.5977993Z d527cbbb87e3: Verifying Checksum 2024-08-20T22:08:17.5978503Z d527cbbb87e3: Download complete 2024-08-20T22:08:17.6674406Z b57676e46aee: Verifying Checksum 2024-08-20T22:08:17.6674979Z b57676e46aee: Download complete 2024-08-20T22:08:17.7352329Z 7a2c55901189: Download complete 2024-08-20T22:08:17.8043936Z a41a8d1c11c8: Download complete 2024-08-20T22:08:17.8846696Z 0c1227890755: Download complete 2024-08-20T22:08:17.9540108Z d8d1234baab3: Verifying Checksum 2024-08-20T22:08:17.9540552Z d8d1234baab3: Download complete 2024-08-20T22:08:18.0401045Z 75722010b82e: Verifying Checksum 2024-08-20T22:08:18.0401632Z 75722010b82e: Download complete 2024-08-20T22:08:18.1148034Z ec1e7978c1fe: Verifying Checksum 2024-08-20T22:08:18.1148617Z ec1e7978c1fe: Download complete 2024-08-20T22:08:18.1929955Z ac23c5fcc1ef: Verifying Checksum 2024-08-20T22:08:18.1930427Z ac23c5fcc1ef: Download complete 2024-08-20T22:08:18.9558054Z 7a2c55901189: Pull complete 2024-08-20T22:08:19.2573460Z 224fe954d725: Pull complete 2024-08-20T22:08:20.1715938Z 75722010b82e: Pull complete 2024-08-20T22:08:20.1838429Z d527cbbb87e3: Pull complete 2024-08-20T22:08:20.1951947Z b57676e46aee: Pull complete 2024-08-20T22:08:20.7164531Z ca426ffc9d2b: Verifying Checksum 2024-08-20T22:08:20.7165127Z ca426ffc9d2b: Download complete 2024-08-20T22:08:20.7923248Z 4373aa743caf: Verifying Checksum 2024-08-20T22:08:20.7923828Z 4373aa743caf: Download complete 2024-08-20T22:08:20.8600995Z 75b2abb16c68: Verifying Checksum 2024-08-20T22:08:20.8601583Z 75b2abb16c68: Download complete 2024-08-20T22:08:20.9498585Z ef1e3ef1e85f: Verifying Checksum 2024-08-20T22:08:20.9499136Z ef1e3ef1e85f: Download complete 2024-08-20T22:08:21.9182189Z 0bf61114d37b: Verifying Checksum 2024-08-20T22:08:21.9182804Z 0bf61114d37b: Download complete 2024-08-20T22:08:21.9791120Z 2df849f72ba4: Verifying Checksum 2024-08-20T22:08:21.9791629Z 2df849f72ba4: Download complete 2024-08-20T22:08:22.0498123Z 34c47d63c5de: Verifying Checksum 2024-08-20T22:08:22.0498568Z 34c47d63c5de: Download complete 2024-08-20T22:08:22.1337104Z 1fef4bd19792: Verifying Checksum 2024-08-20T22:08:22.1337585Z 1fef4bd19792: Download complete 2024-08-20T22:08:31.0161003Z a8c1e85b5e14: Verifying Checksum 2024-08-20T22:08:31.0161597Z a8c1e85b5e14: Download complete 2024-08-20T22:08:31.0796680Z b119c4fc6c58: Verifying Checksum 2024-08-20T22:08:31.0797239Z b119c4fc6c58: Download complete 2024-08-20T22:08:31.1492552Z 33b639226eee: Download complete 2024-08-20T22:08:31.2183042Z d3547bd43146: Verifying Checksum 2024-08-20T22:08:31.2183518Z d3547bd43146: Download complete 2024-08-20T22:08:31.2894770Z 5645520256fa: Verifying Checksum 2024-08-20T22:08:31.2895342Z 5645520256fa: Download complete 2024-08-20T22:08:31.3557621Z 829ed7d91e38: Verifying Checksum 2024-08-20T22:08:31.3558203Z 829ed7d91e38: Download complete 2024-08-20T22:08:32.6105685Z 385d0421d67c: Verifying Checksum 2024-08-20T22:08:32.6106281Z 385d0421d67c: Download complete 2024-08-20T22:08:32.6917612Z 7cbfce999d76: Download complete 2024-08-20T22:08:32.7695314Z 6658e558ebe4: Download complete 2024-08-20T22:08:32.8774530Z 33444a5a7e01: Verifying Checksum 2024-08-20T22:08:32.8775072Z 33444a5a7e01: Download complete 2024-08-20T22:08:32.9461402Z 7c47122f4e09: Verifying Checksum 2024-08-20T22:08:32.9462044Z 7c47122f4e09: Download complete 2024-08-20T22:08:33.0090226Z 1811ff4d3556: Verifying Checksum 2024-08-20T22:08:33.0091602Z 1811ff4d3556: Download complete 2024-08-20T22:08:38.9989382Z 7754ee068b33: Verifying Checksum 2024-08-20T22:08:38.9989987Z 7754ee068b33: Download complete 2024-08-20T22:08:39.0835507Z 0479fbac3361: Download complete 2024-08-20T22:08:39.1640450Z f1d6874dee9c: Verifying Checksum 2024-08-20T22:08:39.1640909Z f1d6874dee9c: Download complete 2024-08-20T22:08:39.5677822Z afc429e87b59: Verifying Checksum 2024-08-20T22:08:39.5678497Z afc429e87b59: Download complete 2024-08-20T22:08:39.6414276Z 019620471c25: Verifying Checksum 2024-08-20T22:08:39.6414752Z 019620471c25: Download complete 2024-08-20T22:08:39.7216477Z 27aeb1b2cd5e: Download complete 2024-08-20T22:08:39.9733762Z 829c0e19f4b7: Verifying Checksum 2024-08-20T22:08:39.9734275Z 829c0e19f4b7: Download complete 2024-08-20T22:08:40.0474695Z 560cd6122a38: Download complete 2024-08-20T22:08:40.1121091Z 5a4eb19d7219: Verifying Checksum 2024-08-20T22:08:40.1121686Z 5a4eb19d7219: Download complete 2024-08-20T22:08:40.1945364Z da6a838a66c7: Verifying Checksum 2024-08-20T22:08:40.1945949Z da6a838a66c7: Download complete 2024-08-20T22:08:43.2869694Z 7ed32bc8e469: Verifying Checksum 2024-08-20T22:08:43.2870269Z 7ed32bc8e469: Download complete 2024-08-20T22:08:43.3540292Z 4d4fa6802ab3: Verifying Checksum 2024-08-20T22:08:43.3540770Z 4d4fa6802ab3: Download complete 2024-08-20T22:08:43.5757749Z 0f085d4fa279: Verifying Checksum 2024-08-20T22:08:43.5758251Z 0f085d4fa279: Download complete 2024-08-20T22:08:44.0543034Z 4a0412373305: Verifying Checksum 2024-08-20T22:08:44.0543507Z 4a0412373305: Download complete 2024-08-20T22:08:44.1239709Z 302c8c177944: Verifying Checksum 2024-08-20T22:08:44.1240153Z 302c8c177944: Download complete 2024-08-20T22:08:44.1876634Z 02970347dff6: Download complete 2024-08-20T22:08:44.2741540Z 916c5e858016: Verifying Checksum 2024-08-20T22:08:44.3470794Z c42b3602a1fb: Verifying Checksum 2024-08-20T22:08:44.3471410Z c42b3602a1fb: Download complete 2024-08-20T22:08:44.4960770Z a8c1e85b5e14: Pull complete 2024-08-20T22:08:44.7351124Z a41a8d1c11c8: Pull complete 2024-08-20T22:08:44.9726934Z 0c1227890755: Pull complete 2024-08-20T22:08:45.1955427Z d8d1234baab3: Pull complete 2024-08-20T22:08:50.8237548Z 6efb96fc87ea: Verifying Checksum 2024-08-20T22:08:50.8238203Z 6efb96fc87ea: Download complete 2024-08-20T22:08:50.9155413Z f957c1624481: Download complete 2024-08-20T22:08:50.9920849Z 768c31dca016: Download complete 2024-08-20T22:08:51.0875837Z 8c32d0ecebbe: Verifying Checksum 2024-08-20T22:08:51.0876500Z 8c32d0ecebbe: Download complete 2024-08-20T22:08:51.1033764Z 4f4fb700ef54: Verifying Checksum 2024-08-20T22:08:51.1034597Z 4f4fb700ef54: Download complete 2024-08-20T22:08:51.1884523Z 78ee77eddef2: Download complete 2024-08-20T22:08:51.2575334Z 37513e9b43d7: Verifying Checksum 2024-08-20T22:08:51.2575964Z 37513e9b43d7: Download complete 2024-08-20T22:08:51.4255173Z a7a5392e2bf6: Verifying Checksum 2024-08-20T22:08:51.4255702Z a7a5392e2bf6: Download complete 2024-08-20T22:08:51.5070307Z b10de02255c0: Verifying Checksum 2024-08-20T22:08:51.5071096Z b10de02255c0: Download complete 2024-08-20T22:08:51.5860954Z e56eeff2db93: Verifying Checksum 2024-08-20T22:08:51.5861543Z e56eeff2db93: Download complete 2024-08-20T22:08:51.6723287Z 70ac3e38d0fd: Verifying Checksum 2024-08-20T22:08:51.6724109Z 70ac3e38d0fd: Download complete 2024-08-20T22:08:51.7390571Z eb09cbf3e416: Verifying Checksum 2024-08-20T22:08:51.7391126Z eb09cbf3e416: Download complete 2024-08-20T22:08:51.8779832Z ee1273153675: Verifying Checksum 2024-08-20T22:08:51.8780405Z ee1273153675: Download complete 2024-08-20T22:08:51.9548716Z e22979f9e0ee: Verifying Checksum 2024-08-20T22:08:51.9549304Z e22979f9e0ee: Download complete 2024-08-20T22:08:52.5524844Z 6c1f0aabce7c: Verifying Checksum 2024-08-20T22:08:52.5525469Z 6c1f0aabce7c: Download complete 2024-08-20T22:08:52.6609299Z 7ebe49c3a23e: Download complete 2024-08-20T22:09:18.1903321Z 5d115b29b5d5: Verifying Checksum 2024-08-20T22:09:18.1905525Z 5d115b29b5d5: Download complete 2024-08-20T22:09:18.2685237Z 7f2d7a04fbe6: Download complete 2024-08-20T22:09:18.3516546Z d79fd7d52698: Verifying Checksum 2024-08-20T22:09:18.3517005Z d79fd7d52698: Download complete 2024-08-20T22:09:19.6090563Z 9752d6fbbcab: Verifying Checksum 2024-08-20T22:09:19.6091034Z 9752d6fbbcab: Download complete 2024-08-20T22:09:19.6708272Z 83808b2eff4d: Download complete 2024-08-20T22:09:58.3604757Z cbb79a705353: Verifying Checksum 2024-08-20T22:09:58.3606496Z cbb79a705353: Download complete 2024-08-20T22:09:59.7095009Z 11fad972ef6c: Verifying Checksum 2024-08-20T22:09:59.7095862Z 11fad972ef6c: Download complete 2024-08-20T22:10:14.4270754Z 7ed32bc8e469: Pull complete 2024-08-20T22:10:14.6679576Z ec1e7978c1fe: Pull complete 2024-08-20T22:10:14.8975337Z ac23c5fcc1ef: Pull complete 2024-08-20T22:10:23.5363846Z ca426ffc9d2b: Pull complete 2024-08-20T22:10:23.7533829Z 4373aa743caf: Pull complete 2024-08-20T22:10:23.9908537Z 75b2abb16c68: Pull complete 2024-08-20T22:10:24.2276308Z ef1e3ef1e85f: Pull complete 2024-08-20T22:10:26.7548688Z 0bf61114d37b: Pull complete 2024-08-20T22:10:26.8631380Z 2df849f72ba4: Pull complete 2024-08-20T22:10:26.9612846Z 34c47d63c5de: Pull complete 2024-08-20T22:10:27.1527900Z 1fef4bd19792: Pull complete 2024-08-20T22:11:28.2296176Z 6efb96fc87ea: Pull complete 2024-08-20T22:11:28.3048396Z b119c4fc6c58: Pull complete 2024-08-20T22:11:28.3956896Z 33b639226eee: Pull complete 2024-08-20T22:11:28.4492763Z d3547bd43146: Pull complete 2024-08-20T22:11:28.5085523Z 5645520256fa: Pull complete 2024-08-20T22:11:28.6230304Z 829ed7d91e38: Pull complete 2024-08-20T22:11:32.2038676Z 385d0421d67c: Pull complete 2024-08-20T22:11:32.4311165Z 7cbfce999d76: Pull complete 2024-08-20T22:11:32.6515648Z 6658e558ebe4: Pull complete 2024-08-20T22:11:32.8738921Z 33444a5a7e01: Pull complete 2024-08-20T22:11:33.1017399Z 7c47122f4e09: Pull complete 2024-08-20T22:11:33.3272509Z 1811ff4d3556: Pull complete 2024-08-20T22:11:44.0404980Z 7754ee068b33: Pull complete 2024-08-20T22:11:44.2660672Z 0479fbac3361: Pull complete 2024-08-20T22:11:44.4924703Z f1d6874dee9c: Pull complete 2024-08-20T22:11:45.5151868Z afc429e87b59: Pull complete 2024-08-20T22:11:45.7483304Z 019620471c25: Pull complete 2024-08-20T22:11:45.9720005Z 27aeb1b2cd5e: Pull complete 2024-08-20T22:11:46.5038592Z 829c0e19f4b7: Pull complete 2024-08-20T22:11:46.7410683Z 560cd6122a38: Pull complete 2024-08-20T22:11:47.1214486Z 5a4eb19d7219: Pull complete 2024-08-20T22:11:47.3564733Z da6a838a66c7: Pull complete 2024-08-20T22:12:35.2173467Z cbb79a705353: Pull complete 2024-08-20T22:12:37.1918275Z 4d4fa6802ab3: Pull complete 2024-08-20T22:12:39.8427985Z 0f085d4fa279: Pull complete 2024-08-20T22:12:42.4476733Z 4a0412373305: Pull complete 2024-08-20T22:12:42.6532208Z 302c8c177944: Pull complete 2024-08-20T22:12:42.8775552Z 02970347dff6: Pull complete 2024-08-20T22:12:43.2739706Z 916c5e858016: Pull complete 2024-08-20T22:12:43.5081820Z c42b3602a1fb: Pull complete 2024-08-20T22:14:06.0757560Z 11fad972ef6c: Pull complete 2024-08-20T22:14:06.1571296Z f957c1624481: Pull complete 2024-08-20T22:14:06.2505226Z 768c31dca016: Pull complete 2024-08-20T22:14:06.4925849Z 8c32d0ecebbe: Pull complete 2024-08-20T22:14:06.5782308Z 4f4fb700ef54: Pull complete 2024-08-20T22:14:06.8101409Z 78ee77eddef2: Pull complete 2024-08-20T22:14:07.0414815Z 37513e9b43d7: Pull complete 2024-08-20T22:14:07.4302105Z a7a5392e2bf6: Pull complete 2024-08-20T22:14:07.6702044Z b10de02255c0: Pull complete 2024-08-20T22:14:07.9003432Z e56eeff2db93: Pull complete 2024-08-20T22:14:08.1418650Z 70ac3e38d0fd: Pull complete 2024-08-20T22:14:08.3794361Z eb09cbf3e416: Pull complete 2024-08-20T22:14:10.7386918Z ee1273153675: Pull complete 2024-08-20T22:14:15.6078537Z e22979f9e0ee: Pull complete 2024-08-20T22:14:17.9455846Z 6c1f0aabce7c: Pull complete 2024-08-20T22:14:18.1687146Z 7ebe49c3a23e: Pull complete 2024-08-20T22:14:31.6132525Z 5d115b29b5d5: Pull complete 2024-08-20T22:14:31.6894231Z 7f2d7a04fbe6: Pull complete 2024-08-20T22:14:31.7771228Z d79fd7d52698: Pull complete 2024-08-20T22:14:32.5244146Z 9752d6fbbcab: Pull complete 2024-08-20T22:14:32.6823678Z 83808b2eff4d: Pull complete 2024-08-20T22:14:33.5761514Z Digest: sha256:3a95d3a177465127ef6cd3b50787d6a050367070fd9063dbb688fad07a96b402 2024-08-20T22:14:33.6158025Z Status: Downloaded newer image for 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:14:33.6390489Z 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:14:33.6497543Z ##[group]Run echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> "$GITHUB_OUTPUT" 2024-08-20T22:14:33.6498448Z echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> "$GITHUB_OUTPUT" 2024-08-20T22:14:33.6509982Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:14:33.6510479Z env: 2024-08-20T22:14:33.6510766Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:14:33.6511121Z ##[endgroup] 2024-08-20T22:14:33.6700280Z ##[group]Run pytorch/test-infra/.github/actions/setup-nvidia@main 2024-08-20T22:14:33.6700825Z with: 2024-08-20T22:14:33.6701115Z driver-version: 550.54.15 2024-08-20T22:14:33.6701462Z env: 2024-08-20T22:14:33.6701749Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:14:33.6702172Z ##[endgroup] 2024-08-20T22:14:33.6790039Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2024-08-20T22:14:33.6790591Z with: 2024-08-20T22:14:33.6790875Z timeout_minutes: 10 2024-08-20T22:14:33.6791203Z max_attempts: 3 2024-08-20T22:14:33.6823422Z command: # Is it disgusting to have a full shell script here in this github action? Sure # But is it the best way to make it so that this action relies on nothing else? Absolutely set -eou pipefail DISTRIBUTION=$(. /etc/os-release;echo $ID$VERSION_ID) DRIVER_FN="NVIDIA-Linux-x86_64-${DRIVER_VERSION}.run" install_nvidia_docker2_amzn2() { ( set -x # Needed for yum-config-manager sudo yum install -y yum-utils if [[ "${DISTRIBUTION}" == "amzn2023" ]] ; then YUM_REPO_URL="https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo" else # Amazon Linux 2 YUM_REPO_URL="https://nvidia.github.io/nvidia-docker/${DISTRIBUTION}/nvidia-docker.repo" fi sudo yum-config-manager --add-repo "${YUM_REPO_URL}" sudo yum install -y nvidia-docker2 sudo systemctl restart docker ) } install_nvidia_docker2_ubuntu20() { ( set -x # Install nvidia-driver package if not installed status="$(dpkg-query -W --showformat='${db:Status-Status}' nvidia-docker2 2>&1)" if [ ! $? = 0 ] || [ ! "$status" = installed ]; then sudo apt-get install -y nvidia-docker2 sudo systemctl restart docker fi ) } pre_install_nvidia_driver_amzn2() { ( # Purge any nvidia driver installed from RHEL repo sudo yum remove -y nvidia-driver-latest-dkms ) } install_nvidia_driver_common() { ( # Try to gather more information about the runner and its existing NVIDIA driver if any echo "Before installing NVIDIA driver" lspci lsmod modinfo nvidia || true HAS_NVIDIA_DRIVER=0 # Check if NVIDIA driver has already been installed if [ -x "$(command -v nvidia-smi)" ]; then set +e # The driver exists, check its version next. Also check only the first GPU if there are more than one of them # so that the same driver version is not print over multiple lines INSTALLED_DRIVER_VERSION=$(nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0) NVIDIA_SMI_STATUS=$? if [ "$NVIDIA_SMI_STATUS" -ne 0 ] && [ "$NVIDIA_SMI_STATUS" -ne 14 ]; then echo "Failed to get NVIDIA driver version ($INSTALLED_DRIVER_VERSION). Continuing" elif [ "$INSTALLED_DRIVER_VERSION" != "$DRIVER_VERSION" ]; then echo "NVIDIA driver ($INSTALLED_DRIVER_VERSION) has been installed, but we expect to have $DRIVER_VERSION instead. Continuing" else HAS_NVIDIA_DRIVER=1 echo "NVIDIA driver ($INSTALLED_DRIVER_VERSION) has already been installed. Skipping NVIDIA driver installation" fi set -e fi if [ "$HAS_NVIDIA_DRIVER" -eq 0 ]; then # CAUTION: this may need to be updated in future if [ "${DISTRIBUTION}" != ubuntu20.04 ]; then sudo yum groupinstall -y "Development Tools" # ensure our kernel install is the same as our underlying kernel, # groupinstall "Development Tools" has a habit of mismatching kernel headers sudo yum install -y "kernel-devel-uname-r == $(uname -r)" sudo modprobe backlight fi sudo curl -fsL -o /tmp/nvidia_driver "https://s3.amazonaws.com/ossci-linux/nvidia_driver/$DRIVER_FN" set +e sudo /bin/bash /tmp/nvidia_driver -s --no-drm NVIDIA_INSTALLATION_STATUS=$? RESET_GPU=0 if [ "$NVIDIA_INSTALLATION_STATUS" -ne 0 ]; then sudo cat /var/log/nvidia-installer.log # Fail to install NVIDIA driver, try to reset the GPU RESET_GPU=1 elif [ -x "$(command -v nvidia-smi)" ]; then # Check again if nvidia-smi works even if the driver installation completes successfully INSTALLED_DRIVER_VERSION=$(nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0) NVIDIA_SMI_STATUS=$? if [ "$NVIDIA_SMI_STATUS" -ne 0 ] && [ "$NVIDIA_SMI_STATUS" -ne 14 ]; then RESET_GPU=1 fi fi if [ "$RESET_GPU" -eq 1 ]; then NVIDIA_DEVICES=$(lspci -D | grep -i NVIDIA | cut -d' ' -f1) # The GPU can get stuck in a failure state if somehow the test crashs the GPU microcode. When this # happens, we'll try to reset all NVIDIA devices https://github.com/pytorch/pytorch/issues/88388 for PCI_ID in $NVIDIA_DEVICES; do DEVICE_ENABLED=$(cat /sys/bus/pci/devices/$PCI_ID/enable) echo "Reseting $PCI_ID (enabled state: $DEVICE_ENABLED)" # This requires sudo permission of course echo "1" | sudo tee /sys/bus/pci/devices/$PCI_ID/reset sleep 1 done fi sudo rm -fv /tmp/nvidia_driver set -e fi ) } post_install_nvidia_driver_common() { ( sudo modprobe nvidia || true echo "After installing NVIDIA driver" lspci lsmod modinfo nvidia || true ( set +e nvidia-smi # NB: Annoyingly, nvidia-smi command returns successfully with return code 0 even in # the case where the driver has already crashed as it still can get the driver version # and some basic information like the bus ID. However, the rest of the information # would be missing (ERR!), for example: # # +-----------------------------------------------------------------------------+ # | NVIDIA-SMI 525.89.02 Driver Version: 525.89.02 CUDA Version: 12.0 | # |-------------------------------+----------------------+----------------------+ # | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | # | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | # | | | MIG M. | # |===============================+======================+======================| # | 0 ERR! Off | 00000000:00:1E.0 Off | ERR! | # |ERR! ERR! ERR! ERR! / ERR! | 4184MiB / 23028MiB | ERR! Default | # | | | ERR! | # +-------------------------------+----------------------+----------------------+ # # +-----------------------------------------------------------------------------+ # | Processes: | # | GPU GI CI PID Type Process name GPU Memory | # | ID ID Usage | # |=============================================================================| # +-----------------------------------------------------------------------------+ # # This should be reported as a failure instead as it will guarantee to fail when # Docker tries to run with --gpus all # # So, the correct check here is to query one of the missing piece of info like # GPU name, so that the command can fail accordingly nvidia-smi --query-gpu=gpu_name --format=csv,noheader --id=0 NVIDIA_SMI_STATUS=$? # Allowable exit statuses for nvidia-smi, see: https://github.com/NVIDIA/gpu-operator/issues/285 if [ "$NVIDIA_SMI_STATUS" -eq 0 ] || [ "$NVIDIA_SMI_STATUS" -eq 14 ]; then echo "INFO: Ignoring allowed status ${NVIDIA_SMI_STATUS}" else echo "ERROR: nvidia-smi exited with unresolved status ${NVIDIA_SMI_STATUS}" exit ${NVIDIA_SMI_STATUS} fi set -e ) ) } install_nvidia_driver_amzn2() { ( set -x pre_install_nvidia_driver_amzn2 install_nvidia_driver_common post_install_nvidia_driver_common ) } install_nvidia_driver_ubuntu20() { ( set -x install_nvidia_driver_common post_install_nvidia_driver_common ) } echo "== Installing nvidia driver ${DRIVER_FN} ==" case "${DISTRIBUTION}" in amzn*) install_nvidia_driver_amzn2 ;; ubuntu20.04) install_nvidia_driver_ubuntu20 ;; *) echo "ERROR: Unknown distribution ${DISTRIBUTION}" exit 1 ;; esac # Install container toolkit based on distribution echo "== Installing nvidia container toolkit for ${DISTRIBUTION} ==" case "${DISTRIBUTION}" in amzn*) install_nvidia_docker2_amzn2 ;; ubuntu20.04) install_nvidia_docker2_ubuntu20 ;; *) echo "ERROR: Unknown distribution ${DISTRIBUTION}" exit 1 ;; esac echo "GPU_FLAG=--gpus all -e NVIDIA_DRIVER_CAPABILITIES=all" >> "${GITHUB_ENV}" # Fix https://github.com/NVIDIA/nvidia-docker/issues/1648 on runners with # more than one GPUs. This just needs to be run once. The command fails # on subsequent runs and complains that the mode is already on, but that's # ok sudo nvidia-persistenced || true # This should show persistence mode ON nvidia-smi 2024-08-20T22:14:33.6856160Z retry_wait_seconds: 10 2024-08-20T22:14:33.6856524Z polling_interval_seconds: 1 2024-08-20T22:14:33.6856889Z warning_on_retry: true 2024-08-20T22:14:33.6857240Z continue_on_error: false 2024-08-20T22:14:33.6857571Z env: 2024-08-20T22:14:33.6857938Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:14:33.6858301Z DRIVER_VERSION: 550.54.15 2024-08-20T22:14:33.6858662Z ##[endgroup] 2024-08-20T22:14:33.7661224Z == Installing nvidia driver NVIDIA-Linux-x86_64-550.54.15.run == 2024-08-20T22:14:33.7661818Z + pre_install_nvidia_driver_amzn2 2024-08-20T22:14:33.7662885Z + sudo yum remove -y nvidia-driver-latest-dkms 2024-08-20T22:14:34.2758255Z No match for argument: nvidia-driver-latest-dkms 2024-08-20T22:14:34.2758895Z No packages marked for removal. 2024-08-20T22:14:34.2822014Z Dependencies resolved. 2024-08-20T22:14:34.2832107Z Nothing to do. 2024-08-20T22:14:34.2832531Z Complete! 2024-08-20T22:14:34.3600086Z + install_nvidia_driver_common 2024-08-20T22:14:34.3603338Z + echo 'Before installing NVIDIA driver' 2024-08-20T22:14:34.3603899Z + lspci 2024-08-20T22:14:34.3604286Z Before installing NVIDIA driver 2024-08-20T22:14:34.4635948Z 00:00.0 Host bridge: Intel Corporation 440FX - 82441FX PMC [Natoma] 2024-08-20T22:14:34.4636820Z 00:01.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II] 2024-08-20T22:14:34.4637779Z 00:01.3 Non-VGA unclassified device: Intel Corporation 82371AB/EB/MB PIIX4 ACPI (rev 08) 2024-08-20T22:14:34.4638582Z 00:03.0 VGA compatible controller: Amazon.com, Inc. Device 1111 2024-08-20T22:14:34.4639441Z 00:04.0 Non-Volatile memory controller: Amazon.com, Inc. NVMe EBS Controller 2024-08-20T22:14:34.4640384Z 00:05.0 Ethernet controller: Amazon.com, Inc. Elastic Network Adapter (ENA) 2024-08-20T22:14:34.4641309Z 00:1e.0 3D controller: NVIDIA Corporation GA102GL [A10G] (rev a1) 2024-08-20T22:14:34.4642458Z 00:1f.0 Non-Volatile memory controller: Amazon.com, Inc. NVMe SSD Controller 2024-08-20T22:14:34.4643216Z + lsmod 2024-08-20T22:14:34.4678602Z Module Size Used by 2024-08-20T22:14:34.4679192Z xt_conntrack 16384 1 2024-08-20T22:14:34.4679715Z nft_chain_nat 16384 3 2024-08-20T22:14:34.4680100Z xt_MASQUERADE 20480 1 2024-08-20T22:14:34.4680554Z nf_nat 57344 2 nft_chain_nat,xt_MASQUERADE 2024-08-20T22:14:34.4681055Z nf_conntrack_netlink 57344 0 2024-08-20T22:14:34.4681638Z nf_conntrack 184320 4 xt_conntrack,nf_nat,nf_conntrack_netlink,xt_MASQUERADE 2024-08-20T22:14:34.4682300Z nf_defrag_ipv6 24576 1 nf_conntrack 2024-08-20T22:14:34.4682782Z nf_defrag_ipv4 16384 1 nf_conntrack 2024-08-20T22:14:34.4683222Z xfrm_user 57344 1 2024-08-20T22:14:34.4683681Z xfrm_algo 16384 1 xfrm_user 2024-08-20T22:14:34.4684239Z xt_addrtype 16384 2 2024-08-20T22:14:34.4684723Z nft_compat 20480 4 2024-08-20T22:14:34.4685196Z nf_tables 307200 57 nft_compat,nft_chain_nat 2024-08-20T22:14:34.4685810Z nfnetlink 20480 4 nft_compat,nf_conntrack_netlink,nf_tables 2024-08-20T22:14:34.4686367Z br_netfilter 36864 0 2024-08-20T22:14:34.4686768Z bridge 307200 1 br_netfilter 2024-08-20T22:14:34.4687215Z stp 16384 1 bridge 2024-08-20T22:14:34.4687637Z llc 16384 2 bridge,stp 2024-08-20T22:14:34.4688063Z overlay 167936 0 2024-08-20T22:14:34.4688424Z tls 114688 0 2024-08-20T22:14:34.4688792Z nls_ascii 16384 1 2024-08-20T22:14:34.4689163Z nls_cp437 20480 1 2024-08-20T22:14:34.4689519Z vfat 24576 1 2024-08-20T22:14:34.4689895Z fat 86016 1 vfat 2024-08-20T22:14:34.4690285Z ena 167936 0 2024-08-20T22:14:34.4690651Z ptp 36864 1 ena 2024-08-20T22:14:34.4691040Z ghash_clmulni_intel 16384 0 2024-08-20T22:14:34.4691430Z sunrpc 692224 1 2024-08-20T22:14:34.4691926Z pps_core 24576 1 ptp 2024-08-20T22:14:34.4692328Z aesni_intel 393216 0 2024-08-20T22:14:34.4692691Z i8042 45056 0 2024-08-20T22:14:34.4693066Z serio 28672 3 i8042 2024-08-20T22:14:34.4693491Z crypto_simd 16384 1 aesni_intel 2024-08-20T22:14:34.4694012Z cryptd 28672 2 crypto_simd,ghash_clmulni_intel 2024-08-20T22:14:34.4694684Z button 24576 0 2024-08-20T22:14:34.4695058Z sch_fq_codel 20480 17 2024-08-20T22:14:34.4695430Z dm_mod 188416 0 2024-08-20T22:14:34.4695788Z fuse 163840 1 2024-08-20T22:14:34.4696154Z configfs 57344 1 2024-08-20T22:14:34.4696532Z dax 45056 1 dm_mod 2024-08-20T22:14:34.4696927Z loop 36864 0 2024-08-20T22:14:34.4697311Z dmi_sysfs 20480 0 2024-08-20T22:14:34.4697688Z crc32_pclmul 16384 0 2024-08-20T22:14:34.4698099Z crc32c_intel 24576 0 2024-08-20T22:14:34.4698544Z efivarfs 24576 1 2024-08-20T22:14:34.4699002Z + modinfo nvidia 2024-08-20T22:14:34.4699774Z filename: /lib/modules/6.1.94-99.176.amzn2023.x86_64/kernel/drivers/video/nvidia.ko 2024-08-20T22:14:34.4700472Z alias: char-major-195-* 2024-08-20T22:14:34.4700853Z version: 550.54.15 2024-08-20T22:14:34.4701200Z supported: external 2024-08-20T22:14:34.4701542Z license: NVIDIA 2024-08-20T22:14:34.4701930Z firmware: nvidia/550.54.15/gsp_tu10x.bin 2024-08-20T22:14:34.4702454Z firmware: nvidia/550.54.15/gsp_ga10x.bin 2024-08-20T22:14:34.4702916Z srcversion: 833721318DA517F0C2FEC97 2024-08-20T22:14:34.4703388Z alias: pci:v000010DEd*sv*sd*bc06sc80i00* 2024-08-20T22:14:34.4703889Z alias: pci:v000010DEd*sv*sd*bc03sc02i00* 2024-08-20T22:14:34.4704368Z alias: pci:v000010DEd*sv*sd*bc03sc00i00* 2024-08-20T22:14:34.4704860Z depends: i2c-core,drm 2024-08-20T22:14:34.4705321Z retpoline: Y 2024-08-20T22:14:34.4705633Z name: nvidia 2024-08-20T22:14:34.4706405Z vermagic: 6.1.94-99.176.amzn2023.x86_64 SMP preempt mod_unload modversions 2024-08-20T22:14:34.4707098Z parm: NvSwitchRegDwords:NvSwitch regkey (charp) 2024-08-20T22:14:34.4707740Z parm: NvSwitchBlacklist:NvSwitchBlacklist=uuid[,uuid...] (charp) 2024-08-20T22:14:34.4708332Z parm: NVreg_ResmanDebugLevel:int 2024-08-20T22:14:34.4708776Z parm: NVreg_RmLogonRC:int 2024-08-20T22:14:34.4709204Z parm: NVreg_ModifyDeviceFiles:int 2024-08-20T22:14:34.4709660Z parm: NVreg_DeviceFileUID:int 2024-08-20T22:14:34.4710099Z parm: NVreg_DeviceFileGID:int 2024-08-20T22:14:34.4710526Z parm: NVreg_DeviceFileMode:int 2024-08-20T22:14:34.4711054Z parm: NVreg_InitializeSystemMemoryAllocations:int 2024-08-20T22:14:34.4711612Z parm: NVreg_UsePageAttributeTable:int 2024-08-20T22:14:34.4712114Z parm: NVreg_EnablePCIeGen3:int 2024-08-20T22:14:34.4712570Z parm: NVreg_EnableMSI:int 2024-08-20T22:14:34.4712993Z parm: NVreg_TCEBypassMode:int 2024-08-20T22:14:34.4713450Z parm: NVreg_EnableStreamMemOPs:int 2024-08-20T22:14:34.4713978Z parm: NVreg_RestrictProfilingToAdminUsers:int 2024-08-20T22:14:34.4714549Z parm: NVreg_PreserveVideoMemoryAllocations:int 2024-08-20T22:14:34.4715112Z parm: NVreg_EnableS0ixPowerManagement:int 2024-08-20T22:14:34.4715717Z parm: NVreg_S0ixPowerManagementVideoMemoryThreshold:int 2024-08-20T22:14:34.4716310Z parm: NVreg_DynamicPowerManagement:int 2024-08-20T22:14:34.4716911Z parm: NVreg_DynamicPowerManagementVideoMemoryThreshold:int 2024-08-20T22:14:34.4717503Z parm: NVreg_EnableGpuFirmware:int 2024-08-20T22:14:34.4717989Z parm: NVreg_EnableGpuFirmwareLogs:int 2024-08-20T22:14:34.4718521Z parm: NVreg_OpenRmEnableUnsupportedGpus:int 2024-08-20T22:14:34.4719056Z parm: NVreg_EnableUserNUMAManagement:int 2024-08-20T22:14:34.4719551Z parm: NVreg_MemoryPoolSize:int 2024-08-20T22:14:34.4720071Z parm: NVreg_KMallocHeapMaxSize:int 2024-08-20T22:14:34.4720617Z parm: NVreg_VMallocHeapMaxSize:int 2024-08-20T22:14:34.4721082Z parm: NVreg_IgnoreMMIOCheck:int 2024-08-20T22:14:34.4721532Z parm: NVreg_NvLinkDisable:int 2024-08-20T22:14:34.4722136Z parm: NVreg_EnablePCIERelaxedOrderingMode:int 2024-08-20T22:14:34.4722650Z parm: NVreg_RegisterPCIDriver:int 2024-08-20T22:14:34.4723131Z parm: NVreg_EnableResizableBar:int 2024-08-20T22:14:34.4723614Z parm: NVreg_EnableDbgBreakpoint:int 2024-08-20T22:14:34.4724107Z parm: NVreg_EnableNonblockingOpen:int 2024-08-20T22:14:34.4724583Z parm: NVreg_RegistryDwords:charp 2024-08-20T22:14:34.4725156Z parm: NVreg_RegistryDwordsPerDevice:charp 2024-08-20T22:14:34.4725637Z parm: NVreg_RmMsg:charp 2024-08-20T22:14:34.4726050Z parm: NVreg_GpuBlacklist:charp 2024-08-20T22:14:34.4726507Z parm: NVreg_TemporaryFilePath:charp 2024-08-20T22:14:34.4726986Z parm: NVreg_ExcludedGpus:charp 2024-08-20T22:14:34.4727436Z parm: NVreg_DmaRemapPeerMmio:int 2024-08-20T22:14:34.4727909Z parm: NVreg_RmNvlinkBandwidth:charp 2024-08-20T22:14:34.4728373Z parm: NVreg_ImexChannelCount:int 2024-08-20T22:14:34.4728834Z parm: rm_firmware_active:charp 2024-08-20T22:14:34.4729253Z + HAS_NVIDIA_DRIVER=0 2024-08-20T22:14:34.4729647Z ++ command -v nvidia-smi 2024-08-20T22:14:34.4730058Z + '[' -x /usr/bin/nvidia-smi ']' 2024-08-20T22:14:34.4730429Z + set +e 2024-08-20T22:14:34.4730939Z ++ nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0 2024-08-20T22:14:36.7329162Z + INSTALLED_DRIVER_VERSION=550.54.15 2024-08-20T22:14:36.7329787Z + NVIDIA_SMI_STATUS=0 2024-08-20T22:14:36.7330411Z + '[' 0 -ne 0 ']' 2024-08-20T22:14:36.7330792Z + '[' 550.54.15 '!=' 550.54.15 ']' 2024-08-20T22:14:36.7331173Z + HAS_NVIDIA_DRIVER=1 2024-08-20T22:14:36.7332263Z + echo 'NVIDIA driver (550.54.15) has already been installed. Skipping NVIDIA driver installation' 2024-08-20T22:14:36.7332978Z + set -e 2024-08-20T22:14:36.7333299Z + '[' 1 -eq 0 ']' 2024-08-20T22:14:36.7333919Z NVIDIA driver (550.54.15) has already been installed. Skipping NVIDIA driver installation 2024-08-20T22:14:36.7334596Z + post_install_nvidia_driver_common 2024-08-20T22:14:36.7336120Z + sudo modprobe nvidia 2024-08-20T22:14:36.8963220Z + echo 'After installing NVIDIA driver' 2024-08-20T22:14:36.8963825Z + lspci 2024-08-20T22:14:36.8964121Z After installing NVIDIA driver 2024-08-20T22:14:36.9067948Z 00:00.0 Host bridge: Intel Corporation 440FX - 82441FX PMC [Natoma] 2024-08-20T22:14:36.9068708Z 00:01.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II] 2024-08-20T22:14:36.9069631Z 00:01.3 Non-VGA unclassified device: Intel Corporation 82371AB/EB/MB PIIX4 ACPI (rev 08) 2024-08-20T22:14:36.9070417Z 00:03.0 VGA compatible controller: Amazon.com, Inc. Device 1111 2024-08-20T22:14:36.9071509Z 00:04.0 Non-Volatile memory controller: Amazon.com, Inc. NVMe EBS Controller 2024-08-20T22:14:36.9072291Z 00:05.0 Ethernet controller: Amazon.com, Inc. Elastic Network Adapter (ENA) 2024-08-20T22:14:36.9073030Z 00:1e.0 3D controller: NVIDIA Corporation GA102GL [A10G] (rev a1) 2024-08-20T22:14:36.9073884Z 00:1f.0 Non-Volatile memory controller: Amazon.com, Inc. NVMe SSD Controller 2024-08-20T22:14:36.9074479Z + lsmod 2024-08-20T22:14:36.9099898Z Module Size Used by 2024-08-20T22:14:36.9100315Z nvidia_uvm 4706304 0 2024-08-20T22:14:36.9100712Z nvidia 54071296 1 nvidia_uvm 2024-08-20T22:14:36.9101139Z drm 602112 1 nvidia 2024-08-20T22:14:36.9101572Z drm_panel_orientation_quirks 28672 1 drm 2024-08-20T22:14:36.9102030Z backlight 24576 1 drm 2024-08-20T22:14:36.9102564Z i2c_core 106496 2 nvidia,drm 2024-08-20T22:14:36.9103077Z xt_conntrack 16384 1 2024-08-20T22:14:36.9103618Z nft_chain_nat 16384 3 2024-08-20T22:14:36.9104114Z xt_MASQUERADE 20480 1 2024-08-20T22:14:36.9104607Z nf_nat 57344 2 nft_chain_nat,xt_MASQUERADE 2024-08-20T22:14:36.9105214Z nf_conntrack_netlink 57344 0 2024-08-20T22:14:36.9105779Z nf_conntrack 184320 4 xt_conntrack,nf_nat,nf_conntrack_netlink,xt_MASQUERADE 2024-08-20T22:14:36.9106655Z nf_defrag_ipv6 24576 1 nf_conntrack 2024-08-20T22:14:36.9107118Z nf_defrag_ipv4 16384 1 nf_conntrack 2024-08-20T22:14:36.9107551Z xfrm_user 57344 1 2024-08-20T22:14:36.9107938Z xfrm_algo 16384 1 xfrm_user 2024-08-20T22:14:36.9108355Z xt_addrtype 16384 2 2024-08-20T22:14:36.9108731Z nft_compat 20480 4 2024-08-20T22:14:36.9109183Z nf_tables 307200 57 nft_compat,nft_chain_nat 2024-08-20T22:14:36.9109779Z nfnetlink 20480 4 nft_compat,nf_conntrack_netlink,nf_tables 2024-08-20T22:14:36.9110318Z br_netfilter 36864 0 2024-08-20T22:14:36.9110726Z bridge 307200 1 br_netfilter 2024-08-20T22:14:36.9111170Z stp 16384 1 bridge 2024-08-20T22:14:36.9111585Z llc 16384 2 bridge,stp 2024-08-20T22:14:36.9112007Z overlay 167936 0 2024-08-20T22:14:36.9112370Z tls 114688 0 2024-08-20T22:14:36.9112727Z nls_ascii 16384 1 2024-08-20T22:14:36.9113102Z nls_cp437 20480 1 2024-08-20T22:14:36.9113518Z vfat 24576 1 2024-08-20T22:14:36.9113889Z fat 86016 1 vfat 2024-08-20T22:14:36.9114273Z ena 167936 0 2024-08-20T22:14:36.9114641Z ptp 36864 1 ena 2024-08-20T22:14:36.9115036Z ghash_clmulni_intel 16384 0 2024-08-20T22:14:36.9115412Z sunrpc 692224 1 2024-08-20T22:14:36.9115782Z pps_core 24576 1 ptp 2024-08-20T22:14:36.9116174Z aesni_intel 393216 0 2024-08-20T22:14:36.9116537Z i8042 45056 0 2024-08-20T22:14:36.9116898Z serio 28672 3 i8042 2024-08-20T22:14:36.9117499Z crypto_simd 16384 1 aesni_intel 2024-08-20T22:14:36.9118184Z cryptd 28672 2 crypto_simd,ghash_clmulni_intel 2024-08-20T22:14:36.9118838Z button 24576 0 2024-08-20T22:14:36.9119313Z sch_fq_codel 20480 17 2024-08-20T22:14:36.9119715Z dm_mod 188416 0 2024-08-20T22:14:36.9120157Z fuse 163840 1 2024-08-20T22:14:36.9120637Z configfs 57344 1 2024-08-20T22:14:36.9121126Z dax 45056 1 dm_mod 2024-08-20T22:14:36.9121561Z loop 36864 0 2024-08-20T22:14:36.9122035Z dmi_sysfs 20480 0 2024-08-20T22:14:36.9122518Z crc32_pclmul 16384 0 2024-08-20T22:14:36.9122938Z crc32c_intel 24576 0 2024-08-20T22:14:36.9123308Z efivarfs 24576 1 2024-08-20T22:14:36.9123664Z + modinfo nvidia 2024-08-20T22:14:36.9124333Z filename: /lib/modules/6.1.94-99.176.amzn2023.x86_64/kernel/drivers/video/nvidia.ko 2024-08-20T22:14:36.9125041Z alias: char-major-195-* 2024-08-20T22:14:36.9125433Z version: 550.54.15 2024-08-20T22:14:36.9125781Z supported: external 2024-08-20T22:14:36.9126115Z license: NVIDIA 2024-08-20T22:14:36.9126496Z firmware: nvidia/550.54.15/gsp_tu10x.bin 2024-08-20T22:14:36.9126976Z firmware: nvidia/550.54.15/gsp_ga10x.bin 2024-08-20T22:14:36.9127437Z srcversion: 833721318DA517F0C2FEC97 2024-08-20T22:14:36.9127892Z alias: pci:v000010DEd*sv*sd*bc06sc80i00* 2024-08-20T22:14:36.9128392Z alias: pci:v000010DEd*sv*sd*bc03sc02i00* 2024-08-20T22:14:36.9128874Z alias: pci:v000010DEd*sv*sd*bc03sc00i00* 2024-08-20T22:14:36.9129363Z depends: i2c-core,drm 2024-08-20T22:14:36.9129714Z retpoline: Y 2024-08-20T22:14:36.9130022Z name: nvidia 2024-08-20T22:14:36.9130621Z vermagic: 6.1.94-99.176.amzn2023.x86_64 SMP preempt mod_unload modversions 2024-08-20T22:14:36.9131310Z parm: NvSwitchRegDwords:NvSwitch regkey (charp) 2024-08-20T22:14:36.9131962Z parm: NvSwitchBlacklist:NvSwitchBlacklist=uuid[,uuid...] (charp) 2024-08-20T22:14:36.9132548Z parm: NVreg_ResmanDebugLevel:int 2024-08-20T22:14:36.9132988Z parm: NVreg_RmLogonRC:int 2024-08-20T22:14:36.9133470Z parm: NVreg_ModifyDeviceFiles:int 2024-08-20T22:14:36.9134052Z parm: NVreg_DeviceFileUID:int 2024-08-20T22:14:36.9134483Z parm: NVreg_DeviceFileGID:int 2024-08-20T22:14:36.9134922Z parm: NVreg_DeviceFileMode:int 2024-08-20T22:14:36.9135444Z parm: NVreg_InitializeSystemMemoryAllocations:int 2024-08-20T22:14:36.9135993Z parm: NVreg_UsePageAttributeTable:int 2024-08-20T22:14:36.9136470Z parm: NVreg_EnablePCIeGen3:int 2024-08-20T22:14:36.9136902Z parm: NVreg_EnableMSI:int 2024-08-20T22:14:36.9137316Z parm: NVreg_TCEBypassMode:int 2024-08-20T22:14:36.9137769Z parm: NVreg_EnableStreamMemOPs:int 2024-08-20T22:14:36.9138296Z parm: NVreg_RestrictProfilingToAdminUsers:int 2024-08-20T22:14:36.9138881Z parm: NVreg_PreserveVideoMemoryAllocations:int 2024-08-20T22:14:36.9139433Z parm: NVreg_EnableS0ixPowerManagement:int 2024-08-20T22:14:36.9140034Z parm: NVreg_S0ixPowerManagementVideoMemoryThreshold:int 2024-08-20T22:14:36.9140636Z parm: NVreg_DynamicPowerManagement:int 2024-08-20T22:14:36.9141245Z parm: NVreg_DynamicPowerManagementVideoMemoryThreshold:int 2024-08-20T22:14:36.9141834Z parm: NVreg_EnableGpuFirmware:int 2024-08-20T22:14:36.9142316Z parm: NVreg_EnableGpuFirmwareLogs:int 2024-08-20T22:14:36.9142846Z parm: NVreg_OpenRmEnableUnsupportedGpus:int 2024-08-20T22:14:36.9143394Z parm: NVreg_EnableUserNUMAManagement:int 2024-08-20T22:14:36.9143931Z parm: NVreg_MemoryPoolSize:int 2024-08-20T22:14:36.9144393Z parm: NVreg_KMallocHeapMaxSize:int 2024-08-20T22:14:36.9144877Z parm: NVreg_VMallocHeapMaxSize:int 2024-08-20T22:14:36.9145467Z parm: NVreg_IgnoreMMIOCheck:int 2024-08-20T22:14:36.9146009Z parm: NVreg_NvLinkDisable:int 2024-08-20T22:14:36.9146512Z parm: NVreg_EnablePCIERelaxedOrderingMode:int 2024-08-20T22:14:36.9147029Z parm: NVreg_RegisterPCIDriver:int 2024-08-20T22:14:36.9147503Z parm: NVreg_EnableResizableBar:int 2024-08-20T22:14:36.9147988Z parm: NVreg_EnableDbgBreakpoint:int 2024-08-20T22:14:36.9148491Z parm: NVreg_EnableNonblockingOpen:int 2024-08-20T22:14:36.9148973Z parm: NVreg_RegistryDwords:charp 2024-08-20T22:14:36.9149469Z parm: NVreg_RegistryDwordsPerDevice:charp 2024-08-20T22:14:36.9149941Z parm: NVreg_RmMsg:charp 2024-08-20T22:14:36.9150351Z parm: NVreg_GpuBlacklist:charp 2024-08-20T22:14:36.9150814Z parm: NVreg_TemporaryFilePath:charp 2024-08-20T22:14:36.9151280Z parm: NVreg_ExcludedGpus:charp 2024-08-20T22:14:36.9151725Z parm: NVreg_DmaRemapPeerMmio:int 2024-08-20T22:14:36.9152208Z parm: NVreg_RmNvlinkBandwidth:charp 2024-08-20T22:14:36.9152681Z parm: NVreg_ImexChannelCount:int 2024-08-20T22:14:36.9153127Z parm: rm_firmware_active:charp 2024-08-20T22:14:36.9153526Z + set +e 2024-08-20T22:14:36.9153842Z + nvidia-smi 2024-08-20T22:14:38.4767189Z Tue Aug 20 22:14:38 2024 2024-08-20T22:14:38.4768015Z +-----------------------------------------------------------------------------------------+ 2024-08-20T22:14:38.4768854Z | NVIDIA-SMI 550.54.15 Driver Version: 550.54.15 CUDA Version: 12.4 | 2024-08-20T22:14:38.4769638Z |-----------------------------------------+------------------------+----------------------+ 2024-08-20T22:14:38.4770762Z | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | 2024-08-20T22:14:38.4771675Z | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | 2024-08-20T22:14:38.4772363Z | | | MIG M. | 2024-08-20T22:14:38.4772912Z |=========================================+========================+======================| 2024-08-20T22:14:38.4866835Z | 0 NVIDIA A10G Off | 00000000:00:1E.0 Off | 0 | 2024-08-20T22:14:38.4867636Z | 0% 30C P0 58W / 300W | 0MiB / 23028MiB | 5% Default | 2024-08-20T22:14:38.4868527Z | | | N/A | 2024-08-20T22:14:38.4869218Z +-----------------------------------------+------------------------+----------------------+ 2024-08-20T22:14:38.4869787Z 2024-08-20T22:14:38.4870665Z +-----------------------------------------------------------------------------------------+ 2024-08-20T22:14:38.4871316Z | Processes: | 2024-08-20T22:14:38.4872014Z | GPU GI CI PID Type Process name GPU Memory | 2024-08-20T22:14:38.4872698Z | ID ID Usage | 2024-08-20T22:14:38.4873250Z |=========================================================================================| 2024-08-20T22:14:38.4873925Z | No running processes found | 2024-08-20T22:14:38.4874717Z +-----------------------------------------------------------------------------------------+ 2024-08-20T22:14:39.0858775Z + nvidia-smi --query-gpu=gpu_name --format=csv,noheader --id=0 2024-08-20T22:14:40.6532377Z NVIDIA A10G 2024-08-20T22:14:41.1089164Z + NVIDIA_SMI_STATUS=0 2024-08-20T22:14:41.1089754Z + '[' 0 -eq 0 ']' 2024-08-20T22:14:41.1090460Z + echo 'INFO: Ignoring allowed status 0' 2024-08-20T22:14:41.1091024Z + set -e 2024-08-20T22:14:41.1091335Z INFO: Ignoring allowed status 0 2024-08-20T22:14:41.1099050Z == Installing nvidia container toolkit for amzn2023 == 2024-08-20T22:14:41.1103298Z + sudo yum install -y yum-utils 2024-08-20T22:14:41.5364571Z Last metadata expiration check: 0:09:59 ago on Tue Aug 20 22:04:42 2024. 2024-08-20T22:14:41.5590621Z Package dnf-utils-4.3.0-13.amzn2023.0.4.noarch is already installed. 2024-08-20T22:14:41.5895815Z Dependencies resolved. 2024-08-20T22:14:41.6020938Z Nothing to do. 2024-08-20T22:14:41.6021428Z Complete! 2024-08-20T22:14:41.6753060Z + [[ amzn2023 == \a\m\z\n\2\0\2\3 ]] 2024-08-20T22:14:41.6754345Z + YUM_REPO_URL=https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo 2024-08-20T22:14:41.6756188Z + sudo yum-config-manager --add-repo https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo 2024-08-20T22:14:41.9452725Z Adding repo from: https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo 2024-08-20T22:14:42.0164550Z + sudo yum install -y nvidia-docker2 2024-08-20T22:14:42.4890034Z nvidia-container-toolkit 10 kB/s | 833 B 00:00 2024-08-20T22:14:42.5113186Z Package nvidia-docker2-2.14.0-1.noarch is already installed. 2024-08-20T22:14:42.5408772Z Dependencies resolved. 2024-08-20T22:14:42.5533081Z Nothing to do. 2024-08-20T22:14:42.5533519Z Complete! 2024-08-20T22:14:42.6453219Z + sudo systemctl restart docker 2024-08-20T22:15:39.2976566Z Tue Aug 20 22:15:39 2024 2024-08-20T22:15:39.2977386Z +-----------------------------------------------------------------------------------------+ 2024-08-20T22:15:39.2978216Z | NVIDIA-SMI 550.54.15 Driver Version: 550.54.15 CUDA Version: 12.4 | 2024-08-20T22:15:39.2978999Z |-----------------------------------------+------------------------+----------------------+ 2024-08-20T22:15:39.2981678Z | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | 2024-08-20T22:15:39.2982717Z | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | 2024-08-20T22:15:39.2983428Z | | | MIG M. | 2024-08-20T22:15:39.2983963Z |=========================================+========================+======================| 2024-08-20T22:15:39.3095401Z | 0 NVIDIA A10G On | 00000000:00:1E.0 Off | 0 | 2024-08-20T22:15:39.3097532Z | 0% 31C P0 58W / 300W | 0MiB / 23028MiB | 5% Default | 2024-08-20T22:15:39.3098266Z | | | N/A | 2024-08-20T22:15:39.3099013Z +-----------------------------------------+------------------------+----------------------+ 2024-08-20T22:15:39.3099584Z 2024-08-20T22:15:39.3100559Z +-----------------------------------------------------------------------------------------+ 2024-08-20T22:15:39.3101374Z | Processes: | 2024-08-20T22:15:39.3102080Z | GPU GI CI PID Type Process name GPU Memory | 2024-08-20T22:15:39.3102759Z | ID ID Usage | 2024-08-20T22:15:39.3103328Z |=========================================================================================| 2024-08-20T22:15:39.3103970Z | No running processes found | 2024-08-20T22:15:39.3104741Z +-----------------------------------------------------------------------------------------+ 2024-08-20T22:15:39.8051938Z Command completed after 1 attempt(s). 2024-08-20T22:15:39.8136734Z ##[group]Run python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84 2024-08-20T22:15:39.8137502Z python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84 2024-08-20T22:15:39.8138189Z python3 -m tools.stats.monitor > usage_log.txt 2>&1 & 2024-08-20T22:15:39.8138833Z echo "monitor-script-pid=${!}" >> "${GITHUB_OUTPUT}" 2024-08-20T22:15:39.8152906Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:15:39.8153408Z env: 2024-08-20T22:15:39.8153691Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:39.8154134Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:39.8154628Z ##[endgroup] 2024-08-20T22:15:40.0991518Z Defaulting to user installation because normal site-packages is not writeable 2024-08-20T22:15:40.5179633Z Collecting psutil==5.9.1 2024-08-20T22:15:40.5585700Z Downloading psutil-5.9.1-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (281 kB) 2024-08-20T22:15:40.6126124Z Collecting nvidia-ml-py==11.525.84 2024-08-20T22:15:40.6172104Z Downloading nvidia_ml_py-11.525.84-py3-none-any.whl (34 kB) 2024-08-20T22:15:40.6961755Z Installing collected packages: psutil, nvidia-ml-py 2024-08-20T22:15:40.8506658Z Successfully installed nvidia-ml-py-11.525.84 psutil-5.9.1 2024-08-20T22:15:41.0514549Z Prepare all required actions 2024-08-20T22:15:41.0515122Z Getting action download info 2024-08-20T22:15:41.1663358Z Download action repository 'seemethere/download-artifact-s3@v4' (SHA:1da556a7aa0a088e3153970611f6c432d58e80e6) 2024-08-20T22:15:41.3407458Z Download action repository 'actions/download-artifact@v3' (SHA:9bc31d5ccc31df68ecc42ccf4149144866c47d8a) 2024-08-20T22:15:41.4885373Z ##[group]Run ./.github/actions/download-build-artifacts 2024-08-20T22:15:41.4885850Z with: 2024-08-20T22:15:41.4886187Z name: linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-08-20T22:15:41.4886642Z s3-bucket: gha-artifacts 2024-08-20T22:15:41.4886979Z env: 2024-08-20T22:15:41.4887252Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:41.4887707Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:41.4888193Z ##[endgroup] 2024-08-20T22:15:41.4922133Z ##[group]Run seemethere/download-artifact-s3@v4 2024-08-20T22:15:41.4922591Z with: 2024-08-20T22:15:41.4922974Z name: linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-08-20T22:15:41.4923443Z s3-bucket: gha-artifacts 2024-08-20T22:15:41.4923807Z region: us-east-1 2024-08-20T22:15:41.4924121Z env: 2024-08-20T22:15:41.4924413Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:41.4924871Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:41.4925536Z ##[endgroup] 2024-08-20T22:15:41.9683249Z (node:52555) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2024-08-20T22:15:41.9684161Z 2024-08-20T22:15:41.9684427Z Please migrate your code to use AWS SDK for JavaScript (v3). 2024-08-20T22:15:41.9685150Z For more information, check the migration guide at https://a.co/7PzMCcy 2024-08-20T22:15:41.9686021Z (Use `node --trace-warnings ...` to show where the warning was created) 2024-08-20T22:15:42.0406422Z Found 1 objects with prefix pytorch/pytorch/10479310721/linux-focal-cuda12.1-py3.10-gcc9-sm86/ 2024-08-20T22:15:42.0407659Z Starting download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2024-08-20T22:15:49.5719835Z Finished download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2024-08-20T22:15:49.5725764Z Artifact download has finished successfully 2024-08-20T22:15:49.6101648Z ##[group]Run unzip -o artifacts.zip 2024-08-20T22:15:49.6102100Z unzip -o artifacts.zip 2024-08-20T22:15:49.6112197Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:15:49.6112713Z env: 2024-08-20T22:15:49.6113024Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:15:49.6113476Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:15:49.6113958Z ##[endgroup] 2024-08-20T22:15:49.6391186Z Archive: artifacts.zip 2024-08-20T22:15:49.6392257Z creating: dist/ 2024-08-20T22:15:51.7691545Z inflating: dist/torch-2.5.0a0+git40ec5f6-cp310-cp310-linux_x86_64.whl 2024-08-20T22:15:51.7692228Z creating: build/custom_test_artifacts/ 2024-08-20T22:15:51.7692819Z creating: build/custom_test_artifacts/custom-op-build/ 2024-08-20T22:15:51.7693560Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/ 2024-08-20T22:15:51.7694395Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/pkgRedirects/ 2024-08-20T22:15:51.7700997Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeConfigureLog.yaml 2024-08-20T22:15:51.7701941Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/ 2024-08-20T22:15:51.7702882Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-08-20T22:15:51.7703874Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-08-20T22:15:51.7704848Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-08-20T22:15:51.7706027Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-08-20T22:15:51.7707543Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-08-20T22:15:51.7708547Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-08-20T22:15:51.7709540Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-08-20T22:15:51.7711017Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-08-20T22:15:51.7712778Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-08-20T22:15:51.7714894Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-08-20T22:15:51.7716018Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-08-20T22:15:51.7717572Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-08-20T22:15:51.7719653Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-08-20T22:15:51.7720691Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/ 2024-08-20T22:15:51.7721689Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/ 2024-08-20T22:15:51.7761378Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2024-08-20T22:15:51.7801502Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2024-08-20T22:15:51.7802983Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2024-08-20T22:15:51.7848465Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2024-08-20T22:15:51.7849869Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2024-08-20T22:15:51.7851287Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2024-08-20T22:15:51.7852732Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2024-08-20T22:15:51.7854194Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2024-08-20T22:15:51.7855563Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2024-08-20T22:15:51.7856937Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2024-08-20T22:15:51.7858308Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2024-08-20T22:15:51.7859640Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2024-08-20T22:15:51.7860910Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2024-08-20T22:15:51.7862144Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c 2024-08-20T22:15:51.7863416Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin 2024-08-20T22:15:51.7864629Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2024-08-20T22:15:51.7865895Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o 2024-08-20T22:15:51.7867101Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu 2024-08-20T22:15:51.7924260Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out 2024-08-20T22:15:51.7984701Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin 2024-08-20T22:15:51.7985926Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake 2024-08-20T22:15:51.7986911Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeScratch/ 2024-08-20T22:15:51.7987779Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeTmp/ 2024-08-20T22:15:51.7988677Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/cmake.check_cache 2024-08-20T22:15:51.7989595Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/ 2024-08-20T22:15:51.7990614Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.ts 2024-08-20T22:15:51.7991755Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.make 2024-08-20T22:15:51.7992851Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/depend.make 2024-08-20T22:15:51.7993937Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/link.txt 2024-08-20T22:15:51.7995168Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/cmake_clean.cmake 2024-08-20T22:15:51.7996237Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/build.make 2024-08-20T22:15:51.7997307Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/DependInfo.cmake 2024-08-20T22:15:51.7998377Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/flags.make 2024-08-20T22:15:51.7999436Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/progress.make 2024-08-20T22:15:51.8017032Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o.d 2024-08-20T22:15:51.8160343Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o 2024-08-20T22:15:51.8161331Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/ 2024-08-20T22:15:51.8162418Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.ts 2024-08-20T22:15:51.8163629Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.make 2024-08-20T22:15:51.8164781Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/depend.make 2024-08-20T22:15:51.8165862Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/link.txt 2024-08-20T22:15:51.8166977Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/cmake_clean.cmake 2024-08-20T22:15:51.8168109Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/build.make 2024-08-20T22:15:51.8169239Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/DependInfo.cmake 2024-08-20T22:15:51.8170358Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/flags.make 2024-08-20T22:15:51.8171671Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/progress.make 2024-08-20T22:15:51.8190221Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o.d 2024-08-20T22:15:51.8273586Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o 2024-08-20T22:15:51.8274765Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-08-20T22:15:51.8275831Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/TargetDirectories.txt 2024-08-20T22:15:51.8276960Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/progress.marks 2024-08-20T22:15:51.8277867Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile2 2024-08-20T22:15:51.8278760Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile.cmake 2024-08-20T22:15:51.8279664Z inflating: build/custom_test_artifacts/custom-op-build/detect_cuda_version.cc 2024-08-20T22:15:51.8281985Z inflating: build/custom_test_artifacts/custom-op-build/CMakeCache.txt 2024-08-20T22:15:51.8282849Z inflating: build/custom_test_artifacts/custom-op-build/Makefile 2024-08-20T22:15:51.8284517Z inflating: build/custom_test_artifacts/custom-op-build/cmake_install.cmake 2024-08-20T22:15:51.8404342Z inflating: build/custom_test_artifacts/custom-op-build/libcustom_ops.so 2024-08-20T22:15:51.8466921Z inflating: build/custom_test_artifacts/custom-op-build/test_custom_ops 2024-08-20T22:15:51.8467662Z creating: build/custom_test_artifacts/jit-hook-build/ 2024-08-20T22:15:51.8468390Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/ 2024-08-20T22:15:51.8469206Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/pkgRedirects/ 2024-08-20T22:15:51.8476069Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeConfigureLog.yaml 2024-08-20T22:15:51.8477283Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/ 2024-08-20T22:15:51.8478209Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-08-20T22:15:51.8479177Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-08-20T22:15:51.8480134Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-08-20T22:15:51.8481217Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-08-20T22:15:51.8482816Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-08-20T22:15:51.8483858Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-08-20T22:15:51.8484830Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-08-20T22:15:51.8486387Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-08-20T22:15:51.8488073Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-08-20T22:15:51.8490227Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-08-20T22:15:51.8491357Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-08-20T22:15:51.8492683Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-08-20T22:15:51.8494047Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-08-20T22:15:51.8495079Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/ 2024-08-20T22:15:51.8496075Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/ 2024-08-20T22:15:51.8535891Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2024-08-20T22:15:51.8575796Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2024-08-20T22:15:51.8577223Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2024-08-20T22:15:51.8623653Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2024-08-20T22:15:51.8625186Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2024-08-20T22:15:51.8627002Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2024-08-20T22:15:51.8628479Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2024-08-20T22:15:51.8629877Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2024-08-20T22:15:51.8631223Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2024-08-20T22:15:51.8632586Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2024-08-20T22:15:51.8634087Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2024-08-20T22:15:51.8635442Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2024-08-20T22:15:51.8636699Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2024-08-20T22:15:51.8637903Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c 2024-08-20T22:15:51.8639250Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin 2024-08-20T22:15:51.8640456Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2024-08-20T22:15:51.8641623Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o 2024-08-20T22:15:51.8642811Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu 2024-08-20T22:15:51.8697861Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out 2024-08-20T22:15:51.8758445Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin 2024-08-20T22:15:51.8759620Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake 2024-08-20T22:15:51.8760591Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeScratch/ 2024-08-20T22:15:51.8761449Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeTmp/ 2024-08-20T22:15:51.8762319Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/cmake.check_cache 2024-08-20T22:15:51.8763254Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/ 2024-08-20T22:15:51.8764365Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.ts 2024-08-20T22:15:51.8765533Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.make 2024-08-20T22:15:51.8766662Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/depend.make 2024-08-20T22:15:51.8767713Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/link.txt 2024-08-20T22:15:51.8768823Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/cmake_clean.cmake 2024-08-20T22:15:51.8770001Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/build.make 2024-08-20T22:15:51.8771333Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/DependInfo.cmake 2024-08-20T22:15:51.8772425Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/flags.make 2024-08-20T22:15:51.8773511Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/progress.make 2024-08-20T22:15:51.8791242Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o.d 2024-08-20T22:15:51.8855553Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o 2024-08-20T22:15:51.8856723Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-08-20T22:15:51.8857784Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/TargetDirectories.txt 2024-08-20T22:15:51.8858730Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/progress.marks 2024-08-20T22:15:51.8859617Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile2 2024-08-20T22:15:51.8860494Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile.cmake 2024-08-20T22:15:51.8861379Z inflating: build/custom_test_artifacts/jit-hook-build/detect_cuda_version.cc 2024-08-20T22:15:51.8863858Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeCache.txt 2024-08-20T22:15:51.8864616Z inflating: build/custom_test_artifacts/jit-hook-build/Makefile 2024-08-20T22:15:51.8865610Z inflating: build/custom_test_artifacts/jit-hook-build/cmake_install.cmake 2024-08-20T22:15:51.8916268Z inflating: build/custom_test_artifacts/jit-hook-build/test_jit_hooks 2024-08-20T22:15:51.8917037Z creating: build/custom_test_artifacts/custom-backend-build/ 2024-08-20T22:15:51.8917976Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/ 2024-08-20T22:15:51.8918857Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/pkgRedirects/ 2024-08-20T22:15:51.8924977Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeConfigureLog.yaml 2024-08-20T22:15:51.8925973Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/ 2024-08-20T22:15:51.8926974Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-08-20T22:15:51.8928021Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-08-20T22:15:51.8929063Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-08-20T22:15:51.8930221Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-08-20T22:15:51.8931698Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-08-20T22:15:51.8932815Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-08-20T22:15:51.8933898Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-08-20T22:15:51.8935458Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-08-20T22:15:51.8938053Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-08-20T22:15:51.8939510Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-08-20T22:15:51.8940698Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-08-20T22:15:51.8942238Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-08-20T22:15:51.8943597Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-08-20T22:15:51.8944823Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/ 2024-08-20T22:15:51.8945938Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/ 2024-08-20T22:15:51.8986095Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2024-08-20T22:15:51.9025578Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2024-08-20T22:15:51.9027313Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2024-08-20T22:15:51.9076980Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2024-08-20T22:15:51.9078466Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2024-08-20T22:15:51.9079951Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2024-08-20T22:15:51.9081466Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2024-08-20T22:15:51.9082935Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2024-08-20T22:15:51.9084371Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2024-08-20T22:15:51.9085814Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2024-08-20T22:15:51.9087253Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2024-08-20T22:15:51.9088951Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2024-08-20T22:15:51.9090277Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2024-08-20T22:15:51.9091555Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c 2024-08-20T22:15:51.9092816Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin 2024-08-20T22:15:51.9094098Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2024-08-20T22:15:51.9095328Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o 2024-08-20T22:15:51.9096588Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu 2024-08-20T22:15:51.9151835Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out 2024-08-20T22:15:51.9212275Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin 2024-08-20T22:15:51.9213553Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake 2024-08-20T22:15:51.9214603Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeScratch/ 2024-08-20T22:15:51.9215530Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeTmp/ 2024-08-20T22:15:51.9216486Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/cmake.check_cache 2024-08-20T22:15:51.9217482Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/ 2024-08-20T22:15:51.9218608Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.ts 2024-08-20T22:15:51.9219849Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.make 2024-08-20T22:15:51.9221047Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/depend.make 2024-08-20T22:15:51.9222174Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/link.txt 2024-08-20T22:15:51.9223343Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/cmake_clean.cmake 2024-08-20T22:15:51.9224677Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/build.make 2024-08-20T22:15:51.9225916Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/DependInfo.cmake 2024-08-20T22:15:51.9227240Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/flags.make 2024-08-20T22:15:51.9228405Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/progress.make 2024-08-20T22:15:51.9229641Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o.d 2024-08-20T22:15:51.9353808Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o 2024-08-20T22:15:51.9354958Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/ 2024-08-20T22:15:51.9356136Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.ts 2024-08-20T22:15:51.9357444Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.make 2024-08-20T22:15:51.9358686Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/depend.make 2024-08-20T22:15:51.9360026Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/link.txt 2024-08-20T22:15:51.9361250Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/cmake_clean.cmake 2024-08-20T22:15:51.9362475Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/build.make 2024-08-20T22:15:51.9363700Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/DependInfo.cmake 2024-08-20T22:15:51.9364918Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/flags.make 2024-08-20T22:15:51.9366133Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/progress.make 2024-08-20T22:15:51.9383631Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o.d 2024-08-20T22:15:51.9439210Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o 2024-08-20T22:15:51.9440491Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-08-20T22:15:51.9441622Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/TargetDirectories.txt 2024-08-20T22:15:51.9442650Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/progress.marks 2024-08-20T22:15:51.9443599Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile2 2024-08-20T22:15:51.9444562Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile.cmake 2024-08-20T22:15:51.9445519Z inflating: build/custom_test_artifacts/custom-backend-build/detect_cuda_version.cc 2024-08-20T22:15:51.9447668Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeCache.txt 2024-08-20T22:15:51.9448794Z inflating: build/custom_test_artifacts/custom-backend-build/Makefile 2024-08-20T22:15:51.9449680Z inflating: build/custom_test_artifacts/custom-backend-build/cmake_install.cmake 2024-08-20T22:15:51.9553039Z inflating: build/custom_test_artifacts/custom-backend-build/libcustom_backend.so 2024-08-20T22:15:51.9596323Z inflating: build/custom_test_artifacts/custom-backend-build/test_custom_backend 2024-08-20T22:15:51.9596959Z creating: build/lib/ 2024-08-20T22:15:51.9685546Z inflating: build/lib/libprotobuf-lite.a 2024-08-20T22:15:52.0141416Z inflating: build/lib/libprotobuf.a 2024-08-20T22:15:52.0151309Z inflating: build/lib/libpthreadpool.a 2024-08-20T22:15:52.0159818Z inflating: build/lib/libcpuinfo.a 2024-08-20T22:15:52.0167785Z inflating: build/lib/libcpuinfo_internals.a 2024-08-20T22:15:52.0168458Z inflating: build/lib/libclog.a 2024-08-20T22:15:52.0187519Z inflating: build/lib/libnnpack.a 2024-08-20T22:15:52.0190302Z inflating: build/lib/libnnpack_reference_layers.a 2024-08-20T22:15:52.0255584Z inflating: build/lib/libgtest.a 2024-08-20T22:15:52.0330880Z inflating: build/lib/libbenchmark.a 2024-08-20T22:15:52.0394940Z inflating: build/lib/libasmjit.a 2024-08-20T22:15:52.0402474Z inflating: build/lib/libittnotify.a 2024-08-20T22:15:52.0430550Z inflating: build/lib/libtensorpipe_uv.a 2024-08-20T22:15:52.0557735Z inflating: build/lib/libgloo.a 2024-08-20T22:15:52.0578917Z inflating: build/lib/libfmt.a 2024-08-20T22:15:52.0674431Z inflating: build/lib/libc10.so 2024-08-20T22:15:52.0676216Z inflating: build/lib/libcaffe2_nvrtc.so 2024-08-20T22:15:52.0677445Z inflating: build/lib/libtorch_global_deps.so 2024-08-20T22:15:52.1182182Z inflating: build/lib/libprotoc.a 2024-08-20T22:15:52.1201601Z inflating: build/lib/libpytorch_qnnpack.a 2024-08-20T22:15:52.1219673Z inflating: build/lib/libgmock.a 2024-08-20T22:15:52.1220156Z inflating: build/lib/libgtest_main.a 2024-08-20T22:15:52.1221195Z inflating: build/lib/libbenchmark_main.a 2024-08-20T22:15:52.1611566Z inflating: build/lib/libgloo_cuda.a 2024-08-20T22:15:53.1803824Z inflating: build/lib/libdnnl.a 2024-08-20T22:15:53.2379167Z inflating: build/lib/libtensorpipe.a 2024-08-20T22:15:53.2436447Z inflating: build/lib/libc10_cuda.so 2024-08-20T22:15:53.2437355Z inflating: build/lib/libgmock_main.a 2024-08-20T22:15:53.3695267Z inflating: build/lib/libfbgemm.a 2024-08-20T22:15:53.3951601Z inflating: build/lib/libtensorpipe_cuda.a 2024-08-20T22:15:53.4458974Z inflating: build/lib/libkineto.a 2024-08-20T22:15:53.4643622Z inflating: build/lib/libXNNPACK.a 2024-08-20T22:15:53.4685943Z inflating: build/lib/libonnx_proto.a 2024-08-20T22:15:53.5379429Z inflating: build/lib/libonnx.a 2024-08-20T22:15:55.9883928Z inflating: build/lib/libtorch_cpu.so 2024-08-20T22:15:55.9889036Z inflating: build/lib/libunbox_lib.a 2024-08-20T22:15:55.9893503Z inflating: build/lib/libshm.so 2024-08-20T22:15:58.0593036Z inflating: build/lib/libtorch_cuda.so 2024-08-20T22:15:58.0594764Z inflating: build/lib/libtorch.so 2024-08-20T22:15:58.0598255Z inflating: build/lib/libc10d_cuda_test.so 2024-08-20T22:15:58.8813914Z inflating: build/lib/libtorch_cuda_linalg.so 2024-08-20T22:15:59.0812437Z inflating: build/lib/libtorch_python.so 2024-08-20T22:15:59.0884998Z inflating: build/lib/libtorchbind_test.so 2024-08-20T22:15:59.0906051Z inflating: build/lib/libjitbackend_test.so 2024-08-20T22:15:59.0931560Z inflating: build/lib/libbackend_with_compiler.so 2024-08-20T22:15:59.0957937Z inflating: build/lib/libaoti_custom_ops.so 2024-08-20T22:15:59.0992860Z inflating: build/lib/libnnapi_backend.so 2024-08-20T22:15:59.0993353Z creating: build/bin/ 2024-08-20T22:15:59.1043895Z inflating: build/bin/c10_CompileTimeFunctionPointer_test 2024-08-20T22:15:59.1095859Z inflating: build/bin/c10_DeviceGuard_test 2024-08-20T22:15:59.1147780Z inflating: build/bin/c10_Device_test 2024-08-20T22:15:59.1206625Z inflating: build/bin/c10_DispatchKeySet_test 2024-08-20T22:15:59.1260222Z inflating: build/bin/c10_Scalar_test 2024-08-20T22:15:59.1309744Z inflating: build/bin/c10_StreamGuard_test 2024-08-20T22:15:59.1361320Z inflating: build/bin/c10_SymInt_test 2024-08-20T22:15:59.1416605Z inflating: build/bin/c10_InlineDeviceGuard_test 2024-08-20T22:15:59.1472602Z inflating: build/bin/c10_InlineStreamGuard_test 2024-08-20T22:15:59.1529313Z inflating: build/bin/c10_SizesAndStrides_test 2024-08-20T22:15:59.1600808Z inflating: build/bin/c10_cow_test 2024-08-20T22:15:59.1654730Z inflating: build/bin/c10_Bitset_test 2024-08-20T22:15:59.1703688Z inflating: build/bin/c10_ConstexprCrc_test 2024-08-20T22:15:59.1754050Z inflating: build/bin/c10_DeadlockDetection_test 2024-08-20T22:15:59.1805192Z inflating: build/bin/c10_Half_test 2024-08-20T22:15:59.1861801Z inflating: build/bin/c10_LeftRight_test 2024-08-20T22:15:59.1917735Z inflating: build/bin/c10_Metaprogramming_test 2024-08-20T22:15:59.1967926Z inflating: build/bin/c10_Synchronized_test 2024-08-20T22:15:59.2024574Z inflating: build/bin/c10_ThreadLocal_test 2024-08-20T22:15:59.2076291Z inflating: build/bin/c10_TypeIndex_test 2024-08-20T22:15:59.2128108Z inflating: build/bin/c10_TypeList_test 2024-08-20T22:15:59.2177316Z inflating: build/bin/c10_TypeTraits_test 2024-08-20T22:15:59.2229582Z inflating: build/bin/c10_accumulate_test 2024-08-20T22:15:59.2285757Z inflating: build/bin/c10_bfloat16_test 2024-08-20T22:15:59.2337152Z inflating: build/bin/c10_bit_cast_test 2024-08-20T22:15:59.2393481Z inflating: build/bin/c10_complex_math_test 2024-08-20T22:15:59.2450014Z inflating: build/bin/c10_complex_test 2024-08-20T22:15:59.2503293Z inflating: build/bin/c10_exception_test 2024-08-20T22:15:59.2553540Z inflating: build/bin/c10_flags_test 2024-08-20T22:15:59.2604391Z inflating: build/bin/c10_generic_math_test 2024-08-20T22:15:59.2770377Z inflating: build/bin/c10_intrusive_ptr_test 2024-08-20T22:15:59.2821563Z inflating: build/bin/c10_irange_test 2024-08-20T22:15:59.2875620Z inflating: build/bin/c10_lazy_test 2024-08-20T22:15:59.2933305Z inflating: build/bin/c10_logging_test 2024-08-20T22:15:59.3009011Z inflating: build/bin/c10_optional_test 2024-08-20T22:15:59.3072079Z inflating: build/bin/c10_ordered_preserving_dict_test 2024-08-20T22:15:59.3126470Z inflating: build/bin/c10_registry_test 2024-08-20T22:15:59.3278767Z inflating: build/bin/c10_small_vector_test 2024-08-20T22:15:59.3330733Z inflating: build/bin/c10_ssize_test 2024-08-20T22:15:59.3383824Z inflating: build/bin/c10_string_util_test 2024-08-20T22:15:59.3434750Z inflating: build/bin/c10_tempfile_test 2024-08-20T22:15:59.3494019Z inflating: build/bin/c10_string_view_test 2024-08-20T22:15:59.3543454Z inflating: build/bin/c10_intrusive_ptr_benchmark 2024-08-20T22:15:59.3600459Z inflating: build/bin/c10_typeid_test 2024-08-20T22:15:59.4049142Z inflating: build/bin/protoc-3.13.0.0 2024-08-20T22:15:59.4498784Z inflating: build/bin/protoc 2024-08-20T22:15:59.4552932Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_1_var_test 2024-08-20T22:15:59.4606146Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_catches_stream 2024-08-20T22:15:59.4659349Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_catches_thread_and_block_and_device 2024-08-20T22:15:59.4711794Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_from_2_processes 2024-08-20T22:15:59.4765044Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_blocks_and_threads 2024-08-20T22:15:59.4818917Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_multiple_blocks 2024-08-20T22:15:59.4869310Z inflating: build/bin/c10_cuda_CUDATest 2024-08-20T22:15:59.4922752Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_same_block 2024-08-20T22:15:59.5257802Z inflating: build/bin/vec_test_all_types_DEFAULT 2024-08-20T22:15:59.5604047Z inflating: build/bin/vec_test_all_types_AVX512 2024-08-20T22:15:59.5967006Z inflating: build/bin/vec_test_all_types_AVX2 2024-08-20T22:15:59.6019311Z inflating: build/bin/BackoffTest 2024-08-20T22:15:59.6073759Z inflating: build/bin/FileStoreTest 2024-08-20T22:15:59.6129751Z inflating: build/bin/TCPStoreTest 2024-08-20T22:15:59.6183287Z inflating: build/bin/HashStoreTest 2024-08-20T22:15:59.6197313Z inflating: build/bin/ProcessGroupMPITest 2024-08-20T22:15:59.6251447Z inflating: build/bin/test_edge_op_registration 2024-08-20T22:15:59.6256046Z inflating: build/bin/torch_shm_manager 2024-08-20T22:15:59.6258932Z inflating: build/bin/example_allreduce 2024-08-20T22:15:59.6315265Z inflating: build/bin/test_dist_autograd 2024-08-20T22:15:59.6384573Z inflating: build/bin/test_cpp_rpc 2024-08-20T22:15:59.6387238Z inflating: build/bin/parallel_benchmark 2024-08-20T22:15:59.6455285Z inflating: build/bin/test_mobile_nnc 2024-08-20T22:15:59.6463925Z inflating: build/bin/aot_model_compiler_test 2024-08-20T22:15:59.6812670Z inflating: build/bin/test_lazy 2024-08-20T22:15:59.7999525Z inflating: build/bin/test_api 2024-08-20T22:15:59.8073896Z inflating: build/bin/Dict_test 2024-08-20T22:15:59.8127659Z inflating: build/bin/Dimname_test 2024-08-20T22:15:59.8192034Z inflating: build/bin/MaybeOwned_test 2024-08-20T22:15:59.8250333Z inflating: build/bin/NamedTensor_test 2024-08-20T22:15:59.8309851Z inflating: build/bin/apply_utils_test 2024-08-20T22:15:59.8370184Z inflating: build/bin/atest 2024-08-20T22:15:59.8433682Z inflating: build/bin/basic 2024-08-20T22:15:59.8489188Z inflating: build/bin/broadcast_test 2024-08-20T22:15:59.8540034Z inflating: build/bin/cpu_allocator_test 2024-08-20T22:15:59.8599191Z inflating: build/bin/cpu_generator_test 2024-08-20T22:15:59.8652704Z inflating: build/bin/cpu_profiling_allocator_test 2024-08-20T22:15:59.8746726Z inflating: build/bin/cpu_rng_test 2024-08-20T22:15:59.8797466Z inflating: build/bin/dispatch_key_set_test 2024-08-20T22:15:59.8849207Z inflating: build/bin/dlconvertor_test 2024-08-20T22:15:59.8907062Z inflating: build/bin/extension_backend_test 2024-08-20T22:15:59.8962461Z inflating: build/bin/half_test 2024-08-20T22:15:59.9059803Z inflating: build/bin/ivalue_test 2024-08-20T22:15:59.9110471Z inflating: build/bin/lazy_tensor_test 2024-08-20T22:15:59.9165650Z inflating: build/bin/math_kernel_test 2024-08-20T22:15:59.9221193Z inflating: build/bin/memory_format_test 2024-08-20T22:15:59.9275047Z inflating: build/bin/memory_overlapping_test 2024-08-20T22:15:59.9328496Z inflating: build/bin/mobile_memory_cleanup 2024-08-20T22:15:59.9385194Z inflating: build/bin/native_test 2024-08-20T22:15:59.9436095Z inflating: build/bin/operator_name_test 2024-08-20T22:15:59.9488231Z inflating: build/bin/operators_test 2024-08-20T22:15:59.9540271Z inflating: build/bin/packedtensoraccessor_test 2024-08-20T22:15:59.9608276Z inflating: build/bin/pow_test 2024-08-20T22:15:59.9666212Z inflating: build/bin/quantized_test 2024-08-20T22:15:59.9716934Z inflating: build/bin/reduce_ops_test 2024-08-20T22:15:59.9768655Z inflating: build/bin/reportMemoryUsage_test 2024-08-20T22:15:59.9825923Z inflating: build/bin/scalar_tensor_test 2024-08-20T22:15:59.9884904Z inflating: build/bin/scalar_test 2024-08-20T22:15:59.9937805Z inflating: build/bin/StorageUtils_test 2024-08-20T22:15:59.9990645Z inflating: build/bin/stride_properties_test 2024-08-20T22:16:00.0071490Z inflating: build/bin/tensor_iterator_test 2024-08-20T22:16:00.0125385Z inflating: build/bin/test_parallel 2024-08-20T22:16:00.0128511Z inflating: build/bin/thread_init_test 2024-08-20T22:16:00.0185001Z inflating: build/bin/type_ptr_test 2024-08-20T22:16:00.0245400Z inflating: build/bin/type_test 2024-08-20T22:16:00.0298266Z inflating: build/bin/undefined_tensor_test 2024-08-20T22:16:00.0299920Z inflating: build/bin/verify_api_visibility 2024-08-20T22:16:00.0369949Z inflating: build/bin/legacy_vmap_test 2024-08-20T22:16:00.0422558Z inflating: build/bin/weakref_test 2024-08-20T22:16:00.0474865Z inflating: build/bin/wrapdim_test 2024-08-20T22:16:00.0528379Z inflating: build/bin/xla_tensor_test 2024-08-20T22:16:00.0588642Z inflating: build/bin/IListRef_test 2024-08-20T22:16:00.0696646Z inflating: build/bin/List_test 2024-08-20T22:16:00.0763597Z inflating: build/bin/KernelFunction_test 2024-08-20T22:16:00.0888153Z inflating: build/bin/kernel_function_legacy_test 2024-08-20T22:16:00.0985532Z inflating: build/bin/kernel_function_test 2024-08-20T22:16:00.1114991Z inflating: build/bin/kernel_lambda_legacy_test 2024-08-20T22:16:00.1219786Z inflating: build/bin/kernel_lambda_test 2024-08-20T22:16:00.1281071Z inflating: build/bin/kernel_stackbased_test 2024-08-20T22:16:00.1378142Z inflating: build/bin/make_boxed_from_unboxed_functor_test 2024-08-20T22:16:00.1429597Z inflating: build/bin/CppSignature_test 2024-08-20T22:16:00.1480198Z inflating: build/bin/op_allowlist_test 2024-08-20T22:16:00.1536558Z inflating: build/bin/backend_fallback_test 2024-08-20T22:16:00.1840493Z inflating: build/bin/op_registration_test 2024-08-20T22:16:00.1905192Z inflating: build/bin/inline_container_test 2024-08-20T22:16:00.1958028Z inflating: build/bin/cuda_apply_test 2024-08-20T22:16:00.2011137Z inflating: build/bin/cuda_allocator_test 2024-08-20T22:16:00.2069857Z inflating: build/bin/cuda_atomic_ops_test 2024-08-20T22:16:00.2124979Z inflating: build/bin/cuda_caching_host_allocator_test 2024-08-20T22:16:00.2195636Z inflating: build/bin/cuda_complex_math_test 2024-08-20T22:16:00.2255588Z inflating: build/bin/cuda_complex_test 2024-08-20T22:16:00.2305525Z inflating: build/bin/cuda_device_test 2024-08-20T22:16:00.2363200Z inflating: build/bin/cuda_cub_test 2024-08-20T22:16:00.2414706Z inflating: build/bin/cuda_dlconvertor_test 2024-08-20T22:16:00.2480142Z inflating: build/bin/cuda_distributions_test 2024-08-20T22:16:00.2538020Z inflating: build/bin/cuda_generator_test 2024-08-20T22:16:00.2588795Z inflating: build/bin/cuda_half_test 2024-08-20T22:16:00.2640801Z inflating: build/bin/cuda_integer_divider_test 2024-08-20T22:16:00.2690589Z inflating: build/bin/cuda_optional_test 2024-08-20T22:16:00.2743013Z inflating: build/bin/cuda_packedtensoraccessor_test 2024-08-20T22:16:00.2796769Z inflating: build/bin/cuda_reportMemoryUsage_test 2024-08-20T22:16:00.2847168Z inflating: build/bin/cuda_allocatorTraceTracker_test 2024-08-20T22:16:00.2908636Z inflating: build/bin/cuda_stream_test 2024-08-20T22:16:00.2958310Z inflating: build/bin/cuda_cudnn_test 2024-08-20T22:16:00.3010846Z inflating: build/bin/cuda_vectorized_test 2024-08-20T22:16:00.3025813Z inflating: build/bin/tutorial_tensorexpr 2024-08-20T22:16:00.3091953Z inflating: build/bin/ProcessGroupGlooTest 2024-08-20T22:16:00.3149617Z inflating: build/bin/ProcessGroupGlooAsyncTest 2024-08-20T22:16:00.3213933Z inflating: build/bin/ProcessGroupNCCLTest 2024-08-20T22:16:00.3276773Z inflating: build/bin/ProcessGroupNCCLErrorsTest 2024-08-20T22:16:00.4108576Z inflating: build/bin/test_tensorexpr 2024-08-20T22:16:00.4692447Z inflating: build/bin/test_jit 2024-08-20T22:16:00.4693313Z creating: .additional_ci_files/ 2024-08-20T22:16:00.4753439Z inflating: .additional_ci_files/test-times.json 2024-08-20T22:16:00.4994209Z inflating: .additional_ci_files/test-class-times.json 2024-08-20T22:16:00.5029591Z ##[group]Run rm artifacts.zip 2024-08-20T22:16:00.5030000Z rm artifacts.zip 2024-08-20T22:16:00.5039603Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:16:00.5040102Z env: 2024-08-20T22:16:00.5040392Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:16:00.5040850Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:16:00.5041341Z ##[endgroup] 2024-08-20T22:16:00.6141836Z ##[group]Run df -H 2024-08-20T22:16:00.6142171Z df -H 2024-08-20T22:16:00.6151233Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:16:00.6151736Z env: 2024-08-20T22:16:00.6152029Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:16:00.6152492Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:16:00.6152979Z ##[endgroup] 2024-08-20T22:16:00.6202439Z Filesystem Size Used Avail Use% Mounted on 2024-08-20T22:16:00.6202980Z devtmpfs 4.2M 0 4.2M 0% /dev 2024-08-20T22:16:00.6203549Z tmpfs 34G 0 34G 0% /dev/shm 2024-08-20T22:16:00.6204020Z tmpfs 14G 553k 14G 1% /run 2024-08-20T22:16:00.6204462Z /dev/nvme0n1p1 161G 53G 109G 33% / 2024-08-20T22:16:00.6205147Z tmpfs 34G 4.1k 34G 1% /tmp 2024-08-20T22:16:00.6205630Z /dev/nvme0n1p128 11M 1.4M 9.2M 13% /boot/efi 2024-08-20T22:16:00.6206651Z tmpfs 6.7G 0 6.7G 0% /run/user/0 2024-08-20T22:16:00.6246982Z Prepare all required actions 2024-08-20T22:16:00.6247432Z Getting action download info 2024-08-20T22:16:00.7552775Z ##[group]Run ./.github/actions/download-td-artifacts 2024-08-20T22:16:00.7553242Z with: 2024-08-20T22:16:00.7553507Z env: 2024-08-20T22:16:00.7553791Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:16:00.7554247Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:16:00.7554733Z ##[endgroup] 2024-08-20T22:16:00.7587696Z ##[group]Run seemethere/download-artifact-s3@v4 2024-08-20T22:16:00.7588136Z with: 2024-08-20T22:16:00.7588403Z name: td_results 2024-08-20T22:16:00.7588724Z s3-bucket: gha-artifacts 2024-08-20T22:16:00.7589072Z region: us-east-1 2024-08-20T22:16:00.7589371Z env: 2024-08-20T22:16:00.7589637Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:16:00.7590089Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:16:00.7590567Z ##[endgroup] 2024-08-20T22:16:01.2344760Z (node:52580) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2024-08-20T22:16:01.2346044Z 2024-08-20T22:16:01.2346311Z Please migrate your code to use AWS SDK for JavaScript (v3). 2024-08-20T22:16:01.2347043Z For more information, check the migration guide at https://a.co/7PzMCcy 2024-08-20T22:16:01.2347907Z (Use `node --trace-warnings ...` to show where the warning was created) 2024-08-20T22:16:01.2944087Z Found 0 objects with prefix pytorch/pytorch/10479310721/td_results/ 2024-08-20T22:16:01.2951845Z Artifact download has finished successfully 2024-08-20T22:16:01.3273691Z ##[group]Run mkdir -p .additional_ci_files 2024-08-20T22:16:01.3274169Z mkdir -p .additional_ci_files 2024-08-20T22:16:01.3274729Z mv td_results.json .additional_ci_files/td_results.json 2024-08-20T22:16:01.3284988Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:16:01.3285486Z env: 2024-08-20T22:16:01.3285774Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:16:01.3286248Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:16:01.3286731Z ##[endgroup] 2024-08-20T22:16:01.3347734Z mv: cannot stat 'td_results.json': No such file or directory 2024-08-20T22:16:01.3363138Z ##[error]Process completed with exit code 1. 2024-08-20T22:16:01.3397652Z ##[group]Run .github/scripts/parse_ref.py 2024-08-20T22:16:01.3398144Z .github/scripts/parse_ref.py 2024-08-20T22:16:01.3406220Z shell: /usr/bin/bash -e {0} 2024-08-20T22:16:01.3406606Z env: 2024-08-20T22:16:01.3406943Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:16:01.3407416Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:16:01.3407907Z ##[endgroup] 2024-08-20T22:16:01.3698420Z Prepare all required actions 2024-08-20T22:16:01.3736890Z ##[group]Run ./.github/actions/get-workflow-job-id 2024-08-20T22:16:01.3737350Z with: 2024-08-20T22:16:01.3737896Z github-token: *** 2024-08-20T22:16:01.3738204Z env: 2024-08-20T22:16:01.3738475Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:16:01.3738935Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:16:01.3739428Z ##[endgroup] 2024-08-20T22:16:01.3756127Z ##[group]Run set -eux 2024-08-20T22:16:01.3756475Z set -eux 2024-08-20T22:16:01.3757060Z python3 .github/scripts/get_workflow_job_id.py "${GITHUB_RUN_ID}" "${RUNNER_NAME}" 2024-08-20T22:16:01.3766105Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:16:01.3766661Z env: 2024-08-20T22:16:01.3766947Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:16:01.3767408Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:16:01.3768052Z GITHUB_TOKEN: *** 2024-08-20T22:16:01.3768369Z ##[endgroup] 2024-08-20T22:16:01.3802247Z + python3 .github/scripts/get_workflow_job_id.py 10479310721 i-02ff85e28d998fa83 2024-08-20T22:16:02.0931558Z setting job-id=29026300668 2024-08-20T22:16:02.0933627Z setting job-name=cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (dynamic_aot_eager_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:16:02.1148741Z Prepare all required actions 2024-08-20T22:16:02.1149193Z Getting action download info 2024-08-20T22:16:02.2205188Z ##[group]Run ./.github/actions/filter-test-configs 2024-08-20T22:16:02.2205639Z with: 2024-08-20T22:16:02.2206100Z github-token: *** 2024-08-20T22:16:02.2212553Z test-matrix: {"include": [{"config": "dynamo_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}]} 2024-08-20T22:16:02.2220057Z job-name: cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (dynamic_aot_eager_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:16:02.2220941Z env: 2024-08-20T22:16:02.2221226Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:16:02.2221675Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:16:02.2222152Z ##[endgroup] 2024-08-20T22:16:02.2264533Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2024-08-20T22:16:02.2265079Z with: 2024-08-20T22:16:02.2265435Z shell: bash 2024-08-20T22:16:02.2265731Z timeout_minutes: 10 2024-08-20T22:16:02.2266044Z max_attempts: 5 2024-08-20T22:16:02.2266353Z retry_wait_seconds: 30 2024-08-20T22:16:02.2267446Z command: set -eux # PyYAML 6.0 doesn't work with MacOS x86 anymore # This must run on Python-3.7 (AmazonLinux2) so can't use request=3.32.2 python3 -m pip install requests==2.27.1 pyyaml==6.0.1 2024-08-20T22:16:02.2268585Z polling_interval_seconds: 1 2024-08-20T22:16:02.2268949Z warning_on_retry: true 2024-08-20T22:16:02.2269285Z continue_on_error: false 2024-08-20T22:16:02.2269623Z env: 2024-08-20T22:16:02.2269891Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:16:02.2270325Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:16:02.2271180Z GITHUB_TOKEN: *** 2024-08-20T22:16:02.2271495Z ##[endgroup] 2024-08-20T22:16:02.3033334Z + python3 -m pip install requests==2.27.1 pyyaml==6.0.1 2024-08-20T22:16:02.5412083Z Defaulting to user installation because normal site-packages is not writeable 2024-08-20T22:16:02.6840687Z Collecting requests==2.27.1 2024-08-20T22:16:02.7192257Z Downloading requests-2.27.1-py2.py3-none-any.whl (63 kB) 2024-08-20T22:16:02.9096491Z Collecting pyyaml==6.0.1 2024-08-20T22:16:02.9139902Z Downloading PyYAML-6.0.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (738 kB) 2024-08-20T22:16:02.9422431Z Requirement already satisfied: urllib3<1.27,>=1.21.1 in /usr/lib/python3.9/site-packages (from requests==2.27.1) (1.25.10) 2024-08-20T22:16:02.9873803Z Collecting certifi>=2017.4.17 2024-08-20T22:16:02.9915175Z Downloading certifi-2024.7.4-py3-none-any.whl (162 kB) 2024-08-20T22:16:02.9963553Z Requirement already satisfied: idna<4,>=2.5 in /usr/lib/python3.9/site-packages (from requests==2.27.1) (2.10) 2024-08-20T22:16:03.2972006Z Collecting charset-normalizer~=2.0.0 2024-08-20T22:16:03.3016385Z Downloading charset_normalizer-2.0.12-py3-none-any.whl (39 kB) 2024-08-20T22:16:03.3805091Z Installing collected packages: charset-normalizer, certifi, requests, pyyaml 2024-08-20T22:16:03.4949869Z Successfully installed certifi-2024.7.4 charset-normalizer-2.0.12 pyyaml-6.0.1 requests-2.27.1 2024-08-20T22:16:04.2814445Z Command completed after 1 attempt(s). 2024-08-20T22:16:04.2875778Z ##[group]Run set -x 2024-08-20T22:16:04.2876116Z set -x 2024-08-20T22:16:04.2876420Z  2024-08-20T22:16:04.2876980Z # Use relative path here as this could be checked out anywhere, not necessarily 2024-08-20T22:16:04.2877688Z # in runner workspace 2024-08-20T22:16:04.2878231Z python3 "${GITHUB_ACTION_PATH}/../../scripts/parse_ref.py" 2024-08-20T22:16:04.2887300Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:16:04.2887973Z env: 2024-08-20T22:16:04.2888248Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:16:04.2888702Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:16:04.2889183Z ##[endgroup] 2024-08-20T22:16:04.2919123Z + python3 /home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/filter-test-configs/../../scripts/parse_ref.py 2024-08-20T22:16:04.3160571Z ##[group]Run echo "Workflow: ${GITHUB_WORKFLOW}" 2024-08-20T22:16:04.3161104Z echo "Workflow: ${GITHUB_WORKFLOW}" 2024-08-20T22:16:04.3161566Z echo "Job name: ${JOB_NAME}" 2024-08-20T22:16:04.3161963Z  2024-08-20T22:16:04.3162504Z # Use relative path here as this could be checked out anywhere, not necessarily 2024-08-20T22:16:04.3163171Z # in runner workspace 2024-08-20T22:16:04.3163748Z python3 "${GITHUB_ACTION_PATH}/../../scripts/filter_test_configs.py" \ 2024-08-20T22:16:04.3164379Z  --workflow "${GITHUB_WORKFLOW}" \ 2024-08-20T22:16:04.3164839Z  --job-name "${JOB_NAME}" \ 2024-08-20T22:16:04.3171844Z  --test-matrix "{"include": [{"config": "dynamo_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}]}" \ 2024-08-20T22:16:04.3178713Z  --selected-test-configs "" \ 2024-08-20T22:16:04.3179165Z  --pr-number "${PR_NUMBER}" \ 2024-08-20T22:16:04.3180425Z  --tag "${TAG}" \ 2024-08-20T22:16:04.3180834Z  --event-name "${EVENT_NAME}" \ 2024-08-20T22:16:04.3181280Z  --schedule "${SCHEDULE}" \ 2024-08-20T22:16:04.3181712Z  --branch "${HEAD_BRANCH}" 2024-08-20T22:16:04.3190063Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:16:04.3190574Z env: 2024-08-20T22:16:04.3190863Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:16:04.3191320Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:16:04.3192006Z GITHUB_TOKEN: *** 2024-08-20T22:16:04.3192847Z JOB_NAME: cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (dynamic_aot_eager_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:16:04.3193748Z PR_NUMBER: 2024-08-20T22:16:04.3194072Z TAG: ciflow/inductor/133712 2024-08-20T22:16:04.3194452Z EVENT_NAME: push 2024-08-20T22:16:04.3194776Z SCHEDULE: 2024-08-20T22:16:04.3195078Z HEAD_BRANCH: 2024-08-20T22:16:04.3195379Z ##[endgroup] 2024-08-20T22:16:04.3222931Z Workflow: inductor-periodic 2024-08-20T22:16:04.3223936Z Job name: cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (dynamic_aot_eager_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:16:04.5560618Z INFO:root:Found no test-config label on the PR, so all test configs are included 2024-08-20T22:16:04.7103292Z ##[group]Run echo "Filtered matrix:" 2024-08-20T22:16:04.7103752Z echo "Filtered matrix:" 2024-08-20T22:16:04.7110381Z echo "{"include": [{"config": "dynamo_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamo_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "dynamic_aot_eager_timm", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}]}" 2024-08-20T22:16:04.7117169Z  2024-08-20T22:16:04.7117460Z echo 2024-08-20T22:16:04.7117859Z echo "Is the current job unstable? False" 2024-08-20T22:16:04.7118330Z  2024-08-20T22:16:04.7118629Z echo 2024-08-20T22:16:04.7119003Z echo "Is keep-going label set? False" 2024-08-20T22:16:04.7119453Z  2024-08-20T22:16:04.7119740Z echo 2024-08-20T22:16:04.7120069Z echo "Renabled issues? " 2024-08-20T22:16:04.7128964Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:16:04.7129463Z env: 2024-08-20T22:16:04.7129755Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:16:04.7130219Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:16:04.7130708Z ##[endgroup] 2024-08-20T22:16:04.7159937Z Filtered matrix: 2024-08-20T22:16:04.7167772Z {include: [{config: dynamo_eager_torchbench, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamo_eager_torchbench, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamo_eager_huggingface, shard: 1, num_shards: 1, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamo_eager_timm, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamo_eager_timm, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: aot_eager_torchbench, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: aot_eager_torchbench, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: aot_eager_huggingface, shard: 1, num_shards: 1, runner: linux.g5.4xlarge.nvidia.gpu}, {config: aot_eager_timm, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: aot_eager_timm, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_aot_eager_torchbench, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_aot_eager_torchbench, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_aot_eager_huggingface, shard: 1, num_shards: 1, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_aot_eager_timm, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: dynamic_aot_eager_timm, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}]} 2024-08-20T22:16:04.7177982Z 2024-08-20T22:16:04.7178133Z Is the current job unstable? False 2024-08-20T22:16:04.7178415Z 2024-08-20T22:16:04.7178779Z Is keep-going label set? False 2024-08-20T22:16:04.7179039Z 2024-08-20T22:16:04.7179172Z Renabled issues? 2024-08-20T22:16:04.7220061Z ##[group]Run echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2024-08-20T22:16:04.7220762Z echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2024-08-20T22:16:04.7229081Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T22:16:04.7229576Z env: 2024-08-20T22:16:04.7229868Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:16:04.7230329Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:16:04.7230823Z JOB_TIMEOUT: 240 2024-08-20T22:16:04.7231134Z ##[endgroup] 2024-08-20T22:16:04.7313280Z ##[group]Run set -x 2024-08-20T22:16:04.7313683Z set -x 2024-08-20T22:16:04.7313975Z  2024-08-20T22:16:04.7314330Z if [[ $TEST_CONFIG == 'multigpu' ]]; then 2024-08-20T22:16:04.7314864Z  TEST_COMMAND=.ci/pytorch/multigpu-test.sh 2024-08-20T22:16:04.7315405Z elif [[ $BUILD_ENVIRONMENT == *onnx* ]]; then 2024-08-20T22:16:04.7315901Z  TEST_COMMAND=.ci/onnx/test.sh 2024-08-20T22:16:04.7316304Z else 2024-08-20T22:16:04.7316684Z  TEST_COMMAND=.ci/pytorch/test.sh 2024-08-20T22:16:04.7317084Z fi 2024-08-20T22:16:04.7317351Z  2024-08-20T22:16:04.7317803Z # detached container should get cleaned up by teardown_ec2_linux 2024-08-20T22:16:04.7318546Z # TODO: Stop building test binaries as part of the build phase 2024-08-20T22:16:04.7319193Z # Used for GPU_FLAG since that doesn't play nice 2024-08-20T22:16:04.7319769Z # shellcheck disable=SC2086,SC2090 2024-08-20T22:16:04.7320222Z container_name=$(docker run \ 2024-08-20T22:16:04.7320631Z  ${GPU_FLAG:-} \ 2024-08-20T22:16:04.7320993Z  -e BUILD_ENVIRONMENT \ 2024-08-20T22:16:04.7321386Z  -e PR_NUMBER \ 2024-08-20T22:16:04.7321733Z  -e GITHUB_ACTIONS \ 2024-08-20T22:16:04.7322116Z  -e GITHUB_REPOSITORY \ 2024-08-20T22:16:04.7322509Z  -e GITHUB_WORKFLOW \ 2024-08-20T22:16:04.7322886Z  -e GITHUB_JOB \ 2024-08-20T22:16:04.7323238Z  -e GITHUB_RUN_ID \ 2024-08-20T22:16:04.7323611Z  -e GITHUB_RUN_NUMBER \ 2024-08-20T22:16:04.7324006Z  -e GITHUB_RUN_ATTEMPT \ 2024-08-20T22:16:04.7324395Z  -e JOB_ID \ 2024-08-20T22:16:04.7324718Z  -e JOB_NAME \ 2024-08-20T22:16:04.7325056Z  -e BASE_SHA \ 2024-08-20T22:16:04.7325397Z  -e BRANCH \ 2024-08-20T22:16:04.7325721Z  -e SHA1 \ 2024-08-20T22:16:04.7326052Z  -e AWS_DEFAULT_REGION \ 2024-08-20T22:16:04.7326458Z  -e IN_WHEEL_TEST \ 2024-08-20T22:16:04.7326873Z  -e SHARD_NUMBER \ 2024-08-20T22:16:04.7327227Z  -e TEST_CONFIG \ 2024-08-20T22:16:04.7327591Z  -e NUM_TEST_SHARDS \ 2024-08-20T22:16:04.7327982Z  -e REENABLED_ISSUES \ 2024-08-20T22:16:04.7328383Z  -e CONTINUE_THROUGH_ERROR \ 2024-08-20T22:16:04.7328792Z  -e VERBOSE_TEST_LOGS \ 2024-08-20T22:16:04.7329188Z  -e TEST_SHOWLOCALS \ 2024-08-20T22:16:04.7329571Z  -e NO_TEST_TIMEOUT \ 2024-08-20T22:16:04.7329938Z  -e NO_TD \ 2024-08-20T22:16:04.7330270Z  -e TD_DISTRIBUTED \ 2024-08-20T22:16:04.7330642Z  -e PR_LABELS \ 2024-08-20T22:16:04.7331037Z  -e MAX_JOBS="$(nproc --ignore=2)" \ 2024-08-20T22:16:04.7331484Z  -e SCCACHE_BUCKET \ 2024-08-20T22:16:04.7331863Z  -e SCCACHE_S3_KEY_PREFIX \ 2024-08-20T22:16:04.7332271Z  -e XLA_CUDA \ 2024-08-20T22:16:04.7332665Z  -e XLA_CLANG_CACHE_S3_BUCKET_NAME \ 2024-08-20T22:16:04.7333322Z  -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK \ 2024-08-20T22:16:04.7333822Z  -e PYTORCH_TEST_RERUN_DISABLED_TESTS \ 2024-08-20T22:16:04.7334326Z  -e SKIP_SCCACHE_INITIALIZATION=1 \ 2024-08-20T22:16:04.7334783Z  -e HUGGING_FACE_HUB_TOKEN \ 2024-08-20T22:16:04.7335225Z  -e SCRIBE_GRAPHQL_ACCESS_TOKEN \ 2024-08-20T22:16:04.7335652Z  -e DASHBOARD_TAG \ 2024-08-20T22:16:04.7336118Z  --env-file="/tmp/github_env_${GITHUB_RUN_ID}" \ 2024-08-20T22:16:04.7336659Z  --security-opt seccomp=unconfined \ 2024-08-20T22:16:04.7337169Z  --cap-add=SYS_PTRACE \ 2024-08-20T22:16:04.7337543Z  --ipc=host \ 2024-08-20T22:16:04.7337896Z  --shm-size="${SHM_SIZE}" \ 2024-08-20T22:16:04.7338283Z  --tty \ 2024-08-20T22:16:04.7338584Z  --detach \ 2024-08-20T22:16:04.7339052Z  --name="${container_name}" \ 2024-08-20T22:16:04.7339472Z  --user jenkins \ 2024-08-20T22:16:04.7339941Z  -v "${GITHUB_WORKSPACE}:/var/lib/jenkins/workspace" \ 2024-08-20T22:16:04.7340480Z  -w /var/lib/jenkins/workspace \ 2024-08-20T22:16:04.7340907Z  "${DOCKER_IMAGE}" 2024-08-20T22:16:04.7341256Z ) 2024-08-20T22:16:04.7341657Z # Propagate download.pytorch.org IP to container 2024-08-20T22:16:04.7342550Z grep download.pytorch.org /etc/hosts | docker exec -i "${container_name}" sudo bash -c "/bin/cat >> /etc/hosts" 2024-08-20T22:16:04.7343496Z echo "DOCKER_CONTAINER_ID=${container_name}" >> "${GITHUB_ENV}" 2024-08-20T22:16:04.7344389Z docker exec -t "${container_name}" sh -c "pip install $(echo dist/*.whl)[opt-einsum] && ${TEST_COMMAND}" 2024-08-20T22:16:04.7352894Z shell: /usr/bin/bash -e {0} 2024-08-20T22:16:04.7353247Z env: 2024-08-20T22:16:04.7353524Z GIT_DEFAULT_BRANCH: main 2024-08-20T22:16:04.7353987Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:16:04.7354597Z BUILD_ENVIRONMENT: linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-08-20T22:16:04.7355105Z PR_NUMBER: 2024-08-20T22:16:04.7355429Z GITHUB_REPOSITORY: pytorch/pytorch 2024-08-20T22:16:04.7355862Z GITHUB_WORKFLOW: inductor-periodic 2024-08-20T22:16:04.7356267Z GITHUB_JOB: test 2024-08-20T22:16:04.7356587Z GITHUB_RUN_ID: 10479310721 2024-08-20T22:16:04.7356952Z GITHUB_RUN_NUMBER: 54565 2024-08-20T22:16:04.7357320Z GITHUB_RUN_ATTEMPT: 1 2024-08-20T22:16:04.7357657Z JOB_ID: 29026300668 2024-08-20T22:16:04.7358489Z JOB_NAME: cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (dynamic_aot_eager_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:16:04.7359373Z BRANCH: 2024-08-20T22:16:04.7359728Z SHA1: 40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:16:04.7360251Z BASE_SHA: 40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:16:04.7360732Z TEST_CONFIG: dynamic_aot_eager_timm 2024-08-20T22:16:04.7361141Z SHARD_NUMBER: 2 2024-08-20T22:16:04.7361463Z NUM_TEST_SHARDS: 2 2024-08-20T22:16:04.7361795Z REENABLED_ISSUES: 2024-08-20T22:16:04.7362131Z CONTINUE_THROUGH_ERROR: False 2024-08-20T22:16:04.7362520Z VERBOSE_TEST_LOGS: False 2024-08-20T22:16:04.7362882Z TEST_SHOWLOCALS: False 2024-08-20T22:16:04.7363233Z NO_TEST_TIMEOUT: False 2024-08-20T22:16:04.7363569Z NO_TD: False 2024-08-20T22:16:04.7363878Z TD_DISTRIBUTED: False 2024-08-20T22:16:04.7364302Z SCCACHE_BUCKET: ossci-compiler-cache-circleci-v2 2024-08-20T22:16:04.7364816Z SCCACHE_S3_KEY_PREFIX: inductor-periodic 2024-08-20T22:16:04.7365246Z SHM_SIZE: 2g 2024-08-20T22:16:04.7366320Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:16:04.7367481Z XLA_CUDA: 2024-08-20T22:16:04.7367963Z XLA_CLANG_CACHE_S3_BUCKET_NAME: ossci-compiler-clang-cache-circleci-xla 2024-08-20T22:16:04.7368573Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK: 0 2024-08-20T22:16:04.7369108Z PYTORCH_TEST_RERUN_DISABLED_TESTS: 0 2024-08-20T22:16:04.7369518Z DASHBOARD_TAG: 2024-08-20T22:16:04.7370032Z HUGGING_FACE_HUB_TOKEN: *** 2024-08-20T22:16:04.7370409Z SCRIBE_GRAPHQL_ACCESS_TOKEN: 2024-08-20T22:16:04.7371128Z ##[endgroup] 2024-08-20T22:16:04.7398286Z + [[ dynamic_aot_eager_timm == \m\u\l\t\i\g\p\u ]] 2024-08-20T22:16:04.7399056Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *onnx* ]] 2024-08-20T22:16:04.7399571Z + TEST_COMMAND=.ci/pytorch/test.sh 2024-08-20T22:16:04.7407182Z +++ nproc --ignore=2 2024-08-20T22:16:04.7435532Z ++ docker run --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all -e BUILD_ENVIRONMENT -e PR_NUMBER -e GITHUB_ACTIONS -e GITHUB_REPOSITORY -e GITHUB_WORKFLOW -e GITHUB_JOB -e GITHUB_RUN_ID -e GITHUB_RUN_NUMBER -e GITHUB_RUN_ATTEMPT -e JOB_ID -e JOB_NAME -e BASE_SHA -e BRANCH -e SHA1 -e AWS_DEFAULT_REGION -e IN_WHEEL_TEST -e SHARD_NUMBER -e TEST_CONFIG -e NUM_TEST_SHARDS -e REENABLED_ISSUES -e CONTINUE_THROUGH_ERROR -e VERBOSE_TEST_LOGS -e TEST_SHOWLOCALS -e NO_TEST_TIMEOUT -e NO_TD -e TD_DISTRIBUTED -e PR_LABELS -e MAX_JOBS=14 -e SCCACHE_BUCKET -e SCCACHE_S3_KEY_PREFIX -e XLA_CUDA -e XLA_CLANG_CACHE_S3_BUCKET_NAME -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK -e PYTORCH_TEST_RERUN_DISABLED_TESTS -e SKIP_SCCACHE_INITIALIZATION=1 -e HUGGING_FACE_HUB_TOKEN -e SCRIBE_GRAPHQL_ACCESS_TOKEN -e DASHBOARD_TAG --env-file=/tmp/github_env_10479310721 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --ipc=host --shm-size=2g --tty --detach --name= --user jenkins -v /home/ec2-user/actions-runner/_work/pytorch/pytorch:/var/lib/jenkins/workspace -w /var/lib/jenkins/workspace 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T22:16:16.1650046Z + container_name=1d3d385f17f1d6c37db5afe728565c3b90add28f14b10207341c2ca1b3f122f7 2024-08-20T22:16:16.1651834Z + grep download.pytorch.org /etc/hosts 2024-08-20T22:16:16.1654049Z + docker exec -i 1d3d385f17f1d6c37db5afe728565c3b90add28f14b10207341c2ca1b3f122f7 sudo bash -c '/bin/cat >> /etc/hosts' 2024-08-20T22:16:16.3338989Z + echo DOCKER_CONTAINER_ID=1d3d385f17f1d6c37db5afe728565c3b90add28f14b10207341c2ca1b3f122f7 2024-08-20T22:16:16.3342916Z ++ echo dist/torch-2.5.0a0+git40ec5f6-cp310-cp310-linux_x86_64.whl 2024-08-20T22:16:16.3345931Z + docker exec -t 1d3d385f17f1d6c37db5afe728565c3b90add28f14b10207341c2ca1b3f122f7 sh -c 'pip install dist/torch-2.5.0a0+git40ec5f6-cp310-cp310-linux_x86_64.whl[opt-einsum] && .ci/pytorch/test.sh' 2024-08-20T22:16:16.7321984Z Processing ./dist/torch-2.5.0a0+git40ec5f6-cp310-cp310-linux_x86_64.whl (from torch==2.5.0a0+git40ec5f6) 2024-08-20T22:16:17.0565567Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (3.13.1) 2024-08-20T22:16:17.0568920Z Requirement already satisfied: typing-extensions>=4.8.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (4.12.2) 2024-08-20T22:16:17.0571840Z Requirement already satisfied: networkx in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (2.8.8) 2024-08-20T22:16:17.0574457Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (3.1.4) 2024-08-20T22:16:17.0576969Z Requirement already satisfied: fsspec in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (2024.6.1) 2024-08-20T22:16:17.0582432Z Requirement already satisfied: sympy==1.13.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (1.13.1) 2024-08-20T22:16:17.0598176Z Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from sympy==1.13.1->torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (1.3.0) 2024-08-20T22:16:17.0611312Z Requirement already satisfied: opt-einsum>=3.3 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (3.3.0) 2024-08-20T22:16:17.0628375Z Requirement already satisfied: numpy>=1.7 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from opt-einsum>=3.3->torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (1.22.4) 2024-08-20T22:16:17.1014764Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from jinja2->torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (2.1.5) 2024-08-20T22:16:17.6721145Z Installing collected packages: torch 2024-08-20T22:16:27.4896113Z ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 2024-08-20T22:16:27.4899364Z timm 1.0.9.dev0 requires torchvision, which is not installed. 2024-08-20T22:16:27.4900133Z Successfully installed torch-2.5.0a0+git40ec5f6 2024-08-20T22:16:27.5705805Z + export TERM=vt100 2024-08-20T22:16:27.5706196Z + TERM=vt100 2024-08-20T22:16:27.5711010Z ++ dirname .ci/pytorch/test.sh 2024-08-20T22:16:27.5724154Z + source .ci/pytorch/common.sh 2024-08-20T22:16:27.5727933Z +++ dirname .ci/pytorch/common.sh 2024-08-20T22:16:27.5737321Z ++ source .ci/pytorch/common_utils.sh 2024-08-20T22:16:27.5739281Z +++ declare -f -t trap_add 2024-08-20T22:16:27.5744321Z ++ set -ex 2024-08-20T22:16:27.5744871Z ++ [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *rocm* ]] 2024-08-20T22:16:27.5748727Z ++ BUILD_TEST_LIBTORCH=0 2024-08-20T22:16:27.5749734Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *rocm* ]] 2024-08-20T22:16:27.5750342Z ++ stat -c %u /var/lib/jenkins/workspace 2024-08-20T22:16:27.5768682Z + WORKSPACE_ORIGINAL_OWNER_ID=1000 2024-08-20T22:16:27.5769206Z + trap_add cleanup_workspace EXIT 2024-08-20T22:16:27.5769644Z + trap_add_cmd=cleanup_workspace 2024-08-20T22:16:27.5770017Z + shift 2024-08-20T22:16:27.5770305Z + for trap_add_name in "$@" 2024-08-20T22:16:27.5777801Z +++ trap -p EXIT 2024-08-20T22:16:27.5780692Z ++ eval 'extract_trap_cmd ' 2024-08-20T22:16:27.5781087Z +++ extract_trap_cmd 2024-08-20T22:16:27.5781455Z +++ printf '%s\n' '' 2024-08-20T22:16:27.5781853Z ++ printf '%s\n' cleanup_workspace 2024-08-20T22:16:27.5784400Z + trap -- ' 2024-08-20T22:16:27.5784836Z cleanup_workspace' EXIT 2024-08-20T22:16:27.5785313Z + sudo chown -R jenkins /var/lib/jenkins/workspace 2024-08-20T22:16:28.2931863Z + git config --global --add safe.directory /var/lib/jenkins/workspace 2024-08-20T22:16:28.2956048Z + echo 'Environment variables:' 2024-08-20T22:16:28.2956468Z Environment variables: 2024-08-20T22:16:28.2956801Z + env 2024-08-20T22:16:28.2966860Z INSTALLED_DB=yes 2024-08-20T22:16:28.2967393Z NV_LIBCUBLAS_VERSION=12.1.3.1-1 2024-08-20T22:16:28.2967911Z NVIDIA_VISIBLE_DEVICES=all 2024-08-20T22:16:28.2968484Z NV_NVML_DEV_VERSION=12.1.105-1 2024-08-20T22:16:28.2969339Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-20T22:16:28.2970115Z CONTINUE_THROUGH_ERROR=False 2024-08-20T22:16:28.2970997Z NV_LIBNCCL_DEV_PACKAGE=libnccl-dev=2.17.1-1+cuda12.1 2024-08-20T22:16:28.2971525Z NV_LIBNCCL_DEV_PACKAGE_VERSION=2.17.1-1 2024-08-20T22:16:28.2974802Z BUILD_ENVIRONMENT=linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-08-20T22:16:28.2975553Z HOSTNAME=1d3d385f17f1 2024-08-20T22:16:28.2976550Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_1e10d306-fe8f-4bdd-bdc6-61f80a827046 2024-08-20T22:16:28.2977404Z GITHUB_ACTION=__self 2024-08-20T22:16:28.2977840Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2024-08-20T22:16:28.2981970Z NVIDIA_REQUIRE_CUDA=cuda>=12.1 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 brand=tesla,driver>=525,driver<526 brand=unknown,driver>=525,driver<526 brand=nvidia,driver>=525,driver<526 brand=nvidiartx,driver>=525,driver<526 brand=geforce,driver>=525,driver<526 brand=geforcertx,driver>=525,driver<526 brand=quadro,driver>=525,driver<526 brand=quadrortx,driver>=525,driver<526 brand=titan,driver>=525,driver<526 brand=titanrtx,driver>=525,driver<526 2024-08-20T22:16:28.2986195Z NV_LIBCUBLAS_DEV_PACKAGE=libcublas-dev-12-1=12.1.3.1-1 2024-08-20T22:16:28.2986701Z NV_NVTX_VERSION=12.1.105-1 2024-08-20T22:16:28.2987052Z GITHUB_RUN_NUMBER=54565 2024-08-20T22:16:28.2987403Z TEST_CONFIG=dynamic_aot_eager_timm 2024-08-20T22:16:28.2988164Z GITHUB_REPOSITORY_OWNER_ID=21003710 2024-08-20T22:16:28.2988647Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2024-08-20T22:16:28.2989114Z NV_CUDA_CUDART_DEV_VERSION=12.1.105-1 2024-08-20T22:16:28.2989618Z NV_LIBCUSPARSE_VERSION=12.1.0.106-1 2024-08-20T22:16:28.2990203Z SCRIBE_GRAPHQL_ACCESS_TOKEN= 2024-08-20T22:16:28.2990605Z NV_LIBNPP_VERSION=12.1.0.40-1 2024-08-20T22:16:28.2991048Z GITHUB_TRIGGERING_ACTOR=pytorch-bot[bot] 2024-08-20T22:16:28.2991534Z CMAKE_CUDA_COMPILER_LAUNCHER=/opt/cache/bin/sccache 2024-08-20T22:16:28.2991994Z GITHUB_REF_TYPE=tag 2024-08-20T22:16:28.2992313Z TORCH_CUDA_ARCH_LIST=Maxwell 2024-08-20T22:16:28.2992692Z NCCL_VERSION=2.17.1-1 2024-08-20T22:16:28.2993129Z BASE_SHA=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:16:28.2993561Z XLA_CUDA= 2024-08-20T22:16:28.2994062Z HUGGING_FACE_HUB_TOKEN=*** 2024-08-20T22:16:28.2996611Z *** 2024-08-20T22:16:28.2996910Z CARGO_NET_GIT_FETCH_WITH_CLI=true 2024-08-20T22:16:28.2997304Z GITHUB_REPOSITORY_ID=65600975 2024-08-20T22:16:28.2997661Z GITHUB_ACTIONS=true 2024-08-20T22:16:28.2997991Z NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:16:28.2998512Z NV_NVPROF_DEV_PACKAGE=cuda-nvprof-12-1=12.1.105-1 2024-08-20T22:16:28.2999043Z NV_LIBNPP_PACKAGE=libnpp-12-1=12.1.0.40-1 2024-08-20T22:16:28.2999519Z SHA1=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:16:28.3000043Z NV_LIBNCCL_DEV_PACKAGE_NAME=libnccl-dev 2024-08-20T22:16:28.3000523Z GITHUB_SHA=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:16:28.3001447Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/inductor-periodic.yml@refs/tags/ciflow/inductor/133712 2024-08-20T22:16:28.3002204Z UCC_HOME=/usr 2024-08-20T22:16:28.3002544Z NV_LIBCUBLAS_DEV_VERSION=12.1.3.1-1 2024-08-20T22:16:28.3003197Z VERBOSE_TEST_LOGS=False 2024-08-20T22:16:28.3003535Z NVIDIA_PRODUCT_NAME=CUDA 2024-08-20T22:16:28.3004003Z NV_LIBCUBLAS_DEV_PACKAGE_NAME=libcublas-dev-12-1 2024-08-20T22:16:28.3004714Z GITHUB_REF=refs/tags/ciflow/inductor/133712 2024-08-20T22:16:28.3005187Z NV_CUDA_CUDART_VERSION=12.1.105-1 2024-08-20T22:16:28.3005558Z SHARD_NUMBER=2 2024-08-20T22:16:28.3005868Z GITHUB_REF_PROTECTED=false 2024-08-20T22:16:28.3006217Z HOME=/var/lib/jenkins 2024-08-20T22:16:28.3006570Z GITHUB_API_URL=https://api.github.com 2024-08-20T22:16:28.3007011Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2024-08-20T22:16:28.3007485Z UCX_COMMIT=7bb2722ff2187a0cad557ae4a6afa090569f83fb 2024-08-20T22:16:28.3008027Z SCCACHE_S3_KEY_PREFIX=inductor-periodic 2024-08-20T22:16:28.3008431Z CUDA_VERSION=12.1.1 2024-08-20T22:16:28.3008857Z NV_LIBCUBLAS_PACKAGE=libcublas-12-1=12.1.3.1-1 2024-08-20T22:16:28.3009291Z NUM_TEST_SHARDS=2 2024-08-20T22:16:28.3009595Z UCX_HOME=/usr 2024-08-20T22:16:28.3010106Z NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE=cuda-nsight-compute-12-1=12.1.1-1 2024-08-20T22:16:28.3011179Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_1e10d306-fe8f-4bdd-bdc6-61f80a827046 2024-08-20T22:16:28.3012590Z JOB_NAME=cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (dynamic_aot_eager_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:16:28.3014022Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_1e10d306-fe8f-4bdd-bdc6-61f80a827046 2024-08-20T22:16:28.3015130Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2024-08-20T22:16:28.3015897Z GITHUB_EVENT_NAME=push 2024-08-20T22:16:28.3016225Z DASHBOARD_TAG= 2024-08-20T22:16:28.3016526Z GITHUB_RUN_ID=10479310721 2024-08-20T22:16:28.3016983Z NV_LIBNPP_DEV_PACKAGE=libnpp-dev-12-1=12.1.0.40-1 2024-08-20T22:16:28.3017520Z NV_LIBCUBLAS_PACKAGE_NAME=libcublas-12-1 2024-08-20T22:16:28.3018511Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_1e10d306-fe8f-4bdd-bdc6-61f80a827046 2024-08-20T22:16:28.3019412Z GITHUB_ACTOR=pytorch-bot[bot] 2024-08-20T22:16:28.3019815Z NV_LIBNPP_DEV_VERSION=12.1.0.40-1 2024-08-20T22:16:28.3020188Z PR_NUMBER= 2024-08-20T22:16:28.3020470Z GITHUB_RUN_ATTEMPT=1 2024-08-20T22:16:28.3020800Z ANACONDA_PYTHON_VERSION=3.10 2024-08-20T22:16:28.3021237Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2024-08-20T22:16:28.3021690Z TERM=vt100 2024-08-20T22:16:28.3022027Z NV_LIBCUSPARSE_DEV_VERSION=12.1.0.106-1 2024-08-20T22:16:28.3022433Z INSTALLED_VISION=yes 2024-08-20T22:16:28.3022870Z BRANCH= 2024-08-20T22:16:28.3023197Z OPENSSL_ROOT_DIR=/opt/openssl 2024-08-20T22:16:28.3023594Z LIBRARY_PATH=/usr/local/cuda/lib64/stubs 2024-08-20T22:16:28.3024004Z CUDA_PATH=/usr/local/cuda 2024-08-20T22:16:28.3024875Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2024-08-20T22:16:28.3025617Z GITHUB_SERVER_URL=https://github.com 2024-08-20T22:16:28.3026095Z UCC_COMMIT=20eae37090a4ce1b32bcce6144ccad0b49943e0b 2024-08-20T22:16:28.3026552Z REENABLED_ISSUES= 2024-08-20T22:16:28.3026846Z SHLVL=1 2024-08-20T22:16:28.3027106Z MAX_JOBS=14 2024-08-20T22:16:28.3027417Z NV_CUDA_LIB_VERSION=12.1.1-1 2024-08-20T22:16:28.3027770Z NVARCH=x86_64 2024-08-20T22:16:28.3028068Z GITHUB_ACTOR_ID=54816060 2024-08-20T22:16:28.3028520Z GITHUB_WORKFLOW_SHA=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:16:28.3029046Z GITHUB_REF_NAME=ciflow/inductor/133712 2024-08-20T22:16:28.3029536Z NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-1 2024-08-20T22:16:28.3030203Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2024-08-20T22:16:28.3030772Z GITHUB_JOB=test 2024-08-20T22:16:28.3031165Z NV_LIBNCCL_PACKAGE=libnccl2=2.17.1-1+cuda12.1 2024-08-20T22:16:28.3031709Z LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64 2024-08-20T22:16:28.3032218Z NO_TEST_TIMEOUT=False 2024-08-20T22:16:28.3032541Z TD_DISTRIBUTED=False 2024-08-20T22:16:28.3032919Z NV_CUDA_NSIGHT_COMPUTE_VERSION=12.1.1-1 2024-08-20T22:16:28.3033348Z GITHUB_REPOSITORY=pytorch/pytorch 2024-08-20T22:16:28.3033765Z NV_NVPROF_VERSION=12.1.105-1 2024-08-20T22:16:28.3034120Z GITHUB_RETENTION_DAYS=90 2024-08-20T22:16:28.3034463Z OPENSSL_DIR=/opt/openssl 2024-08-20T22:16:28.3034814Z GITHUB_ACTION_REPOSITORY= 2024-08-20T22:16:28.3035834Z PATH=/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-08-20T22:16:28.3036875Z GITHUB_BASE_REF= 2024-08-20T22:16:28.3037207Z NV_LIBNCCL_PACKAGE_NAME=libnccl2 2024-08-20T22:16:28.3037579Z CI=true 2024-08-20T22:16:28.3037900Z NV_LIBNCCL_PACKAGE_VERSION=2.17.1-1 2024-08-20T22:16:28.3038307Z GITHUB_REPOSITORY_OWNER=pytorch 2024-08-20T22:16:28.3038678Z JOB_ID=29026300668 2024-08-20T22:16:28.3038987Z INSTALLED_PROTOBUF=yes 2024-08-20T22:16:28.3039312Z GITHUB_HEAD_REF= 2024-08-20T22:16:28.3039620Z GITHUB_ACTION_REF= 2024-08-20T22:16:28.3040060Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2024-08-20T22:16:28.3040589Z TEST_SHOWLOCALS=False 2024-08-20T22:16:28.3040975Z GITHUB_WORKFLOW=inductor-periodic 2024-08-20T22:16:28.3041377Z DEBIAN_FRONTEND=noninteractive 2024-08-20T22:16:28.3042277Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_1e10d306-fe8f-4bdd-bdc6-61f80a827046 2024-08-20T22:16:28.3043078Z NO_TD=False 2024-08-20T22:16:28.3043372Z SKIP_SCCACHE_INITIALIZATION=1 2024-08-20T22:16:28.3043741Z _=/usr/bin/env 2024-08-20T22:16:28.3044218Z ++ python -c 'import site; print(site.getsitepackages()[0])' 2024-08-20T22:16:28.3204979Z + TORCH_INSTALL_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch 2024-08-20T22:16:28.3207392Z + TORCH_BIN_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/bin 2024-08-20T22:16:28.3208353Z + TORCH_LIB_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/lib 2024-08-20T22:16:28.3209233Z + TORCH_TEST_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/test 2024-08-20T22:16:28.3209840Z + BUILD_DIR=build 2024-08-20T22:16:28.3210168Z + BUILD_RENAMED_DIR=build_renamed 2024-08-20T22:16:28.3210565Z + BUILD_BIN_DIR=build/bin 2024-08-20T22:16:28.3210913Z + SHARD_NUMBER=2 2024-08-20T22:16:28.3211222Z + NUM_TEST_SHARDS=2 2024-08-20T22:16:28.3211540Z + export VALGRIND=ON 2024-08-20T22:16:28.3211864Z + VALGRIND=ON 2024-08-20T22:16:28.3212409Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *clang9* ]] 2024-08-20T22:16:28.3213000Z + [[ 0 == \1 ]] 2024-08-20T22:16:28.3213398Z + [[ False == \1 ]] 2024-08-20T22:16:28.3214190Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *bazel* ]] 2024-08-20T22:16:28.3214728Z ++ realpath build/custom_test_artifacts 2024-08-20T22:16:28.3226936Z + CUSTOM_TEST_ARTIFACT_BUILD_DIR=/var/lib/jenkins/workspace/build/custom_test_artifacts 2024-08-20T22:16:28.3227661Z + [[ -n '' ]] 2024-08-20T22:16:28.3228023Z + echo 'Environment variables' 2024-08-20T22:16:28.3228402Z Environment variables 2024-08-20T22:16:28.3228709Z + env 2024-08-20T22:16:28.3238218Z INSTALLED_DB=yes 2024-08-20T22:16:28.3238781Z NV_LIBCUBLAS_VERSION=12.1.3.1-1 2024-08-20T22:16:28.3239304Z NVIDIA_VISIBLE_DEVICES=all 2024-08-20T22:16:28.3239837Z NV_NVML_DEV_VERSION=12.1.105-1 2024-08-20T22:16:28.3240647Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-20T22:16:28.3241433Z CONTINUE_THROUGH_ERROR=False 2024-08-20T22:16:28.3242057Z NV_LIBNCCL_DEV_PACKAGE=libnccl-dev=2.17.1-1+cuda12.1 2024-08-20T22:16:28.3242746Z NV_LIBNCCL_DEV_PACKAGE_VERSION=2.17.1-1 2024-08-20T22:16:28.3243443Z BUILD_ENVIRONMENT=linux-focal-cuda12.1-py3.10-gcc9-sm86 2024-08-20T22:16:28.3244033Z HOSTNAME=1d3d385f17f1 2024-08-20T22:16:28.3245045Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_1e10d306-fe8f-4bdd-bdc6-61f80a827046 2024-08-20T22:16:28.3245839Z GITHUB_ACTION=__self 2024-08-20T22:16:28.3246177Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2024-08-20T22:16:28.3250604Z NVIDIA_REQUIRE_CUDA=cuda>=12.1 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 brand=tesla,driver>=525,driver<526 brand=unknown,driver>=525,driver<526 brand=nvidia,driver>=525,driver<526 brand=nvidiartx,driver>=525,driver<526 brand=geforce,driver>=525,driver<526 brand=geforcertx,driver>=525,driver<526 brand=quadro,driver>=525,driver<526 brand=quadrortx,driver>=525,driver<526 brand=titan,driver>=525,driver<526 brand=titanrtx,driver>=525,driver<526 2024-08-20T22:16:28.3254828Z NV_LIBCUBLAS_DEV_PACKAGE=libcublas-dev-12-1=12.1.3.1-1 2024-08-20T22:16:28.3255344Z NV_NVTX_VERSION=12.1.105-1 2024-08-20T22:16:28.3255699Z GITHUB_RUN_NUMBER=54565 2024-08-20T22:16:28.3256050Z TEST_CONFIG=dynamic_aot_eager_timm 2024-08-20T22:16:28.3256451Z GITHUB_REPOSITORY_OWNER_ID=21003710 2024-08-20T22:16:28.3256934Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2024-08-20T22:16:28.3257398Z NV_CUDA_CUDART_DEV_VERSION=12.1.105-1 2024-08-20T22:16:28.3257832Z NV_LIBCUSPARSE_VERSION=12.1.0.106-1 2024-08-20T22:16:28.3258236Z SCRIBE_GRAPHQL_ACCESS_TOKEN= 2024-08-20T22:16:28.3258636Z NV_LIBNPP_VERSION=12.1.0.40-1 2024-08-20T22:16:28.3259092Z GITHUB_TRIGGERING_ACTOR=pytorch-bot[bot] 2024-08-20T22:16:28.3259575Z CMAKE_CUDA_COMPILER_LAUNCHER=/opt/cache/bin/sccache 2024-08-20T22:16:28.3260034Z GITHUB_REF_TYPE=tag 2024-08-20T22:16:28.3260356Z TORCH_CUDA_ARCH_LIST=Maxwell 2024-08-20T22:16:28.3260735Z NCCL_VERSION=2.17.1-1 2024-08-20T22:16:28.3261121Z BASE_SHA=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:16:28.3261703Z XLA_CUDA= 2024-08-20T22:16:28.3262199Z HUGGING_FACE_HUB_TOKEN=*** 2024-08-20T22:16:28.3262591Z *** 2024-08-20T22:16:28.3262863Z CARGO_NET_GIT_FETCH_WITH_CLI=true 2024-08-20T22:16:28.3263260Z GITHUB_REPOSITORY_ID=65600975 2024-08-20T22:16:28.3263663Z GITHUB_ACTIONS=true 2024-08-20T22:16:28.3263991Z NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T22:16:28.3264480Z NV_NVPROF_DEV_PACKAGE=cuda-nvprof-12-1=12.1.105-1 2024-08-20T22:16:28.3265136Z NV_LIBNPP_PACKAGE=libnpp-12-1=12.1.0.40-1 2024-08-20T22:16:28.3265599Z SHA1=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:16:28.3266120Z NV_LIBNCCL_DEV_PACKAGE_NAME=libnccl-dev 2024-08-20T22:16:28.3266597Z GITHUB_SHA=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:16:28.3267520Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/inductor-periodic.yml@refs/tags/ciflow/inductor/133712 2024-08-20T22:16:28.3268278Z UCC_HOME=/usr 2024-08-20T22:16:28.3268714Z NV_LIBCUBLAS_DEV_VERSION=12.1.3.1-1 2024-08-20T22:16:28.3269127Z VERBOSE_TEST_LOGS=False 2024-08-20T22:16:28.3269467Z NVIDIA_PRODUCT_NAME=CUDA 2024-08-20T22:16:28.3269926Z NV_LIBCUBLAS_DEV_PACKAGE_NAME=libcublas-dev-12-1 2024-08-20T22:16:28.3270416Z GITHUB_REF=refs/tags/ciflow/inductor/133712 2024-08-20T22:16:28.3271265Z NV_CUDA_CUDART_VERSION=12.1.105-1 2024-08-20T22:16:28.3271643Z SHARD_NUMBER=2 2024-08-20T22:16:28.3271954Z GITHUB_REF_PROTECTED=false 2024-08-20T22:16:28.3272297Z HOME=/var/lib/jenkins 2024-08-20T22:16:28.3272661Z GITHUB_API_URL=https://api.github.com 2024-08-20T22:16:28.3273092Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2024-08-20T22:16:28.3273561Z UCX_COMMIT=7bb2722ff2187a0cad557ae4a6afa090569f83fb 2024-08-20T22:16:28.3274117Z SCCACHE_S3_KEY_PREFIX=inductor-periodic 2024-08-20T22:16:28.3274529Z CUDA_VERSION=12.1.1 2024-08-20T22:16:28.3274953Z NV_LIBCUBLAS_PACKAGE=libcublas-12-1=12.1.3.1-1 2024-08-20T22:16:28.3275390Z NUM_TEST_SHARDS=2 2024-08-20T22:16:28.3275691Z UCX_HOME=/usr 2024-08-20T22:16:28.3276216Z NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE=cuda-nsight-compute-12-1=12.1.1-1 2024-08-20T22:16:28.3277288Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_1e10d306-fe8f-4bdd-bdc6-61f80a827046 2024-08-20T22:16:28.3278689Z JOB_NAME=cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (dynamic_aot_eager_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) 2024-08-20T22:16:28.3280076Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_1e10d306-fe8f-4bdd-bdc6-61f80a827046 2024-08-20T22:16:28.3281182Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2024-08-20T22:16:28.3281825Z GITHUB_EVENT_NAME=push 2024-08-20T22:16:28.3282148Z DASHBOARD_TAG= 2024-08-20T22:16:28.3282460Z GITHUB_RUN_ID=10479310721 2024-08-20T22:16:28.3282924Z NV_LIBNPP_DEV_PACKAGE=libnpp-dev-12-1=12.1.0.40-1 2024-08-20T22:16:28.3283515Z NV_LIBCUBLAS_PACKAGE_NAME=libcublas-12-1 2024-08-20T22:16:28.3284505Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_1e10d306-fe8f-4bdd-bdc6-61f80a827046 2024-08-20T22:16:28.3285426Z GITHUB_ACTOR=pytorch-bot[bot] 2024-08-20T22:16:28.3285836Z NV_LIBNPP_DEV_VERSION=12.1.0.40-1 2024-08-20T22:16:28.3286210Z PR_NUMBER= 2024-08-20T22:16:28.3286487Z GITHUB_RUN_ATTEMPT=1 2024-08-20T22:16:28.3286805Z VALGRIND=ON 2024-08-20T22:16:28.3287105Z ANACONDA_PYTHON_VERSION=3.10 2024-08-20T22:16:28.3287546Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2024-08-20T22:16:28.3287991Z TERM=vt100 2024-08-20T22:16:28.3288329Z NV_LIBCUSPARSE_DEV_VERSION=12.1.0.106-1 2024-08-20T22:16:28.3288742Z INSTALLED_VISION=yes 2024-08-20T22:16:28.3289048Z BRANCH= 2024-08-20T22:16:28.3289332Z OPENSSL_ROOT_DIR=/opt/openssl 2024-08-20T22:16:28.3289729Z LIBRARY_PATH=/usr/local/cuda/lib64/stubs 2024-08-20T22:16:28.3290151Z CUDA_PATH=/usr/local/cuda 2024-08-20T22:16:28.3290889Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2024-08-20T22:16:28.3291647Z GITHUB_SERVER_URL=https://github.com 2024-08-20T22:16:28.3292294Z UCC_COMMIT=20eae37090a4ce1b32bcce6144ccad0b49943e0b 2024-08-20T22:16:28.3292763Z REENABLED_ISSUES= 2024-08-20T22:16:28.3293054Z SHLVL=1 2024-08-20T22:16:28.3293326Z MAX_JOBS=14 2024-08-20T22:16:28.3293685Z NV_CUDA_LIB_VERSION=12.1.1-1 2024-08-20T22:16:28.3294027Z NVARCH=x86_64 2024-08-20T22:16:28.3294327Z GITHUB_ACTOR_ID=54816060 2024-08-20T22:16:28.3294780Z GITHUB_WORKFLOW_SHA=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T22:16:28.3295312Z GITHUB_REF_NAME=ciflow/inductor/133712 2024-08-20T22:16:28.3295800Z NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-1 2024-08-20T22:16:28.3296465Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2024-08-20T22:16:28.3297037Z GITHUB_JOB=test 2024-08-20T22:16:28.3297436Z NV_LIBNCCL_PACKAGE=libnccl2=2.17.1-1+cuda12.1 2024-08-20T22:16:28.3297980Z LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64 2024-08-20T22:16:28.3298491Z NO_TEST_TIMEOUT=False 2024-08-20T22:16:28.3298957Z TD_DISTRIBUTED=False 2024-08-20T22:16:28.3299343Z NV_CUDA_NSIGHT_COMPUTE_VERSION=12.1.1-1 2024-08-20T22:16:28.3299780Z GITHUB_REPOSITORY=pytorch/pytorch 2024-08-20T22:16:28.3300202Z NV_NVPROF_VERSION=12.1.105-1 2024-08-20T22:16:28.3300565Z GITHUB_RETENTION_DAYS=90 2024-08-20T22:16:28.3300903Z OPENSSL_DIR=/opt/openssl 2024-08-20T22:16:28.3301256Z GITHUB_ACTION_REPOSITORY= 2024-08-20T22:16:28.3302283Z PATH=/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-08-20T22:16:28.3303343Z GITHUB_BASE_REF= 2024-08-20T22:16:28.3303662Z NV_LIBNCCL_PACKAGE_NAME=libnccl2 2024-08-20T22:16:28.3304036Z CI=true 2024-08-20T22:16:28.3304355Z NV_LIBNCCL_PACKAGE_VERSION=2.17.1-1 2024-08-20T22:16:28.3304864Z GITHUB_REPOSITORY_OWNER=pytorch 2024-08-20T22:16:28.3305230Z JOB_ID=29026300668 2024-08-20T22:16:28.3305538Z INSTALLED_PROTOBUF=yes 2024-08-20T22:16:28.3305864Z GITHUB_HEAD_REF= 2024-08-20T22:16:28.3306167Z GITHUB_ACTION_REF= 2024-08-20T22:16:28.3306604Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2024-08-20T22:16:28.3307066Z TEST_SHOWLOCALS=False 2024-08-20T22:16:28.3307457Z GITHUB_WORKFLOW=inductor-periodic 2024-08-20T22:16:28.3307851Z DEBIAN_FRONTEND=noninteractive 2024-08-20T22:16:28.3308749Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_1e10d306-fe8f-4bdd-bdc6-61f80a827046 2024-08-20T22:16:28.3309547Z NO_TD=False 2024-08-20T22:16:28.3309852Z SKIP_SCCACHE_INITIALIZATION=1 2024-08-20T22:16:28.3310202Z _=/usr/bin/env 2024-08-20T22:16:28.3310560Z + echo 'Testing pytorch' 2024-08-20T22:16:28.3310900Z Testing pytorch 2024-08-20T22:16:28.3311221Z + export LANG=C.UTF-8 2024-08-20T22:16:28.3311556Z + LANG=C.UTF-8 2024-08-20T22:16:28.3311849Z + PR_NUMBER= 2024-08-20T22:16:28.3312199Z + [[ dynamic_aot_eager_timm == \d\e\f\a\u\l\t ]] 2024-08-20T22:16:28.3312713Z + [[ dynamic_aot_eager_timm == \d\i\s\t\r\i\b\u\t\e\d ]] 2024-08-20T22:16:28.3313249Z + [[ dynamic_aot_eager_timm == \s\l\o\w ]] 2024-08-20T22:16:28.3313908Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *slow-gradcheck* ]] 2024-08-20T22:16:28.3314604Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *cuda* ]] 2024-08-20T22:16:28.3315135Z + export PYTORCH_TESTING_DEVICE_ONLY_FOR=cuda 2024-08-20T22:16:28.3315602Z + PYTORCH_TESTING_DEVICE_ONLY_FOR=cuda 2024-08-20T22:16:28.3316050Z + [[ dynamic_aot_eager_timm == *crossref* ]] 2024-08-20T22:16:28.3316632Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *rocm* ]] 2024-08-20T22:16:28.3317259Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *xpu* ]] 2024-08-20T22:16:28.3317899Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *-bazel-* ]] 2024-08-20T22:16:28.3318457Z + pip_install --user ninja==1.10.2 2024-08-20T22:16:28.3318990Z + pip install --progress-bar off --user ninja==1.10.2 2024-08-20T22:16:29.5647585Z Collecting ninja==1.10.2 2024-08-20T22:16:29.5839807Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl.metadata (5.0 kB) 2024-08-20T22:16:29.6416927Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl (108 kB) 2024-08-20T22:16:30.2525257Z Installing collected packages: ninja 2024-08-20T22:16:30.2603888Z  WARNING: The script ninja is installed in '/var/lib/jenkins/.local/bin' which is not on PATH. 2024-08-20T22:16:30.2605134Z Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. 2024-08-20T22:16:30.3121366Z Successfully installed ninja-1.10.2 2024-08-20T22:16:30.3919882Z + export PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-08-20T22:16:30.3921948Z + PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-08-20T22:16:30.3923592Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *aarch64* ]] 2024-08-20T22:16:30.3924106Z + install_tlparse 2024-08-20T22:16:30.3924499Z + pip_install --user tlparse==0.3.25 2024-08-20T22:16:30.3925061Z + pip install --progress-bar off --user tlparse==0.3.25 2024-08-20T22:16:30.8174659Z Collecting tlparse==0.3.25 2024-08-20T22:16:30.8341499Z Downloading tlparse-0.3.25-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (1.7 kB) 2024-08-20T22:16:30.8926390Z Downloading tlparse-0.3.25-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.2 MB) 2024-08-20T22:16:31.5248138Z Installing collected packages: tlparse 2024-08-20T22:16:31.5955287Z Successfully installed tlparse-0.3.25 2024-08-20T22:16:31.6722479Z ++ python -m site --user-base 2024-08-20T22:16:31.6960868Z + PATH=/var/lib/jenkins/.local/bin:/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-08-20T22:16:31.6962890Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *asan* ]] 2024-08-20T22:16:31.6963656Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *-debug* ]] 2024-08-20T22:16:31.6964521Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 != *-bazel-* ]] 2024-08-20T22:16:31.6965620Z + echo 'We are not in debug mode: linux-focal-cuda12.1-py3.10-gcc9-sm86. Expect the assertion to pass' 2024-08-20T22:16:31.6966907Z We are not in debug mode: linux-focal-cuda12.1-py3.10-gcc9-sm86. Expect the assertion to pass 2024-08-20T22:16:31.6967607Z + cd test 2024-08-20T22:16:31.6968138Z + python -c 'import torch; torch._C._crash_if_debug_asserts_fail(424242)' 2024-08-20T22:16:33.3173563Z + [[ dynamic_aot_eager_timm == \n\o\g\p\u\_\N\O\_\A\V\X\2 ]] 2024-08-20T22:16:33.3174294Z + [[ dynamic_aot_eager_timm == \n\o\g\p\u\_\A\V\X\5\1\2 ]] 2024-08-20T22:16:33.3176938Z + DYNAMO_BENCHMARK_FLAGS=() 2024-08-20T22:16:33.3177582Z + [[ dynamic_aot_eager_timm == *pr_time_benchmarks* ]] 2024-08-20T22:16:33.3178294Z + [[ dynamic_aot_eager_timm == *dynamo_eager* ]] 2024-08-20T22:16:33.3178935Z + [[ dynamic_aot_eager_timm == *aot_eager* ]] 2024-08-20T22:16:33.3179697Z + DYNAMO_BENCHMARK_FLAGS+=(--backend aot_eager) 2024-08-20T22:16:33.3180180Z + [[ dynamic_aot_eager_timm == *dynamic* ]] 2024-08-20T22:16:33.3180818Z + DYNAMO_BENCHMARK_FLAGS+=(--dynamic-shapes --dynamic-batch-only) 2024-08-20T22:16:33.3181390Z + [[ dynamic_aot_eager_timm == *cpu* ]] 2024-08-20T22:16:33.3181893Z + DYNAMO_BENCHMARK_FLAGS+=(--device cuda) 2024-08-20T22:16:33.3210612Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *libtorch* ]] 2024-08-20T22:16:33.3211469Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *-bazel-* ]] 2024-08-20T22:16:33.3215427Z + cd test 2024-08-20T22:16:33.3216608Z + python -c 'import torch; print(torch.__config__.show())' 2024-08-20T22:16:34.7844746Z PyTorch built with: 2024-08-20T22:16:34.7845514Z - GCC 9.4 2024-08-20T22:16:34.7845972Z - C++ Version: 201703 2024-08-20T22:16:34.7846858Z - Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications 2024-08-20T22:16:34.7847934Z - Intel(R) MKL-DNN v3.4.2 (Git Hash 1137e04ec0b5251ca2b4400a4fd3c667ce843d67) 2024-08-20T22:16:34.7849023Z - OpenMP 201511 (a.k.a. OpenMP 4.5) 2024-08-20T22:16:34.7849547Z - LAPACK is enabled (usually provided by MKL) 2024-08-20T22:16:34.7850039Z - NNPACK is enabled 2024-08-20T22:16:34.7850429Z - CPU capability usage: AVX2 2024-08-20T22:16:34.7850838Z - CUDA Runtime 12.1 2024-08-20T22:16:34.7851365Z - NVCC architecture flags: -gencode;arch=compute_86,code=sm_86 2024-08-20T22:16:34.7851973Z - CuDNN 90.1 (built against CUDA 12.4) 2024-08-20T22:16:34.7852429Z - Magma 2.6.1 2024-08-20T22:16:34.7859629Z - Build settings: BLAS_INFO=mkl, BUILD_TYPE=Release, CUDA_VERSION=12.1, CUDNN_VERSION=9.1.0, CXX_COMPILER=/opt/cache/bin/c++, CXX_FLAGS= -D_GLIBCXX_USE_CXX11_ABI=1 -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOROCTRACER -DLIBKINETO_NOXPUPTI=ON -DUSE_FBGEMM -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -O2 -fPIC -Wall -Wextra -Werror=return-type -Werror=non-virtual-dtor -Werror=bool-operation -Wnarrowing -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-unused-parameter -Wno-strict-overflow -Wno-strict-aliasing -Wno-stringop-overflow -Wsuggest-override -Wno-psabi -Wno-error=old-style-cast -Wno-missing-braces -fdiagnostics-color=always -faligned-new -Werror -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Wno-stringop-overflow, FORCE_FALLBACK_CUDA_MPI=1, LAPACK_INFO=mkl, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, PERF_WITH_AVX512=1, TORCH_VERSION=2.5.0, USE_CUDA=ON, USE_CUDNN=ON, USE_CUSPARSELT=ON, USE_EXCEPTION_PTR=1, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_GLOO=ON, USE_MKL=ON, USE_MKLDNN=ON, USE_MPI=ON, USE_NCCL=ON, USE_NNPACK=ON, USE_OPENMP=ON, USE_ROCM=OFF, USE_ROCM_KERNEL_ASSERT=OFF, 2024-08-20T22:16:34.7865946Z 2024-08-20T22:16:35.1090226Z + cd test 2024-08-20T22:16:35.1090999Z + python -c 'import torch; print(torch.__config__.parallel_info())' 2024-08-20T22:16:36.4470975Z ATen/Parallel: 2024-08-20T22:16:36.4471478Z at::get_num_threads() : 8 2024-08-20T22:16:36.4471998Z at::get_num_interop_threads() : 16 2024-08-20T22:16:36.4472532Z OpenMP 201511 (a.k.a. OpenMP 4.5) 2024-08-20T22:16:36.4473012Z omp_get_max_threads() : 8 2024-08-20T22:16:36.4474126Z Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications 2024-08-20T22:16:36.4474943Z mkl_get_max_threads() : 8 2024-08-20T22:16:36.4475591Z Intel(R) MKL-DNN v3.4.2 (Git Hash 1137e04ec0b5251ca2b4400a4fd3c667ce843d67) 2024-08-20T22:16:36.4476217Z std::thread::hardware_concurrency() : 16 2024-08-20T22:16:36.4476643Z Environment variables: 2024-08-20T22:16:36.4476984Z OMP_NUM_THREADS : [not set] 2024-08-20T22:16:36.4477353Z MKL_NUM_THREADS : [not set] 2024-08-20T22:16:36.4477723Z ATen parallel backend: OpenMP 2024-08-20T22:16:36.4477976Z 2024-08-20T22:16:36.7256517Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *aarch64* ]] 2024-08-20T22:16:36.7257285Z + [[ dynamic_aot_eager_timm == *backward* ]] 2024-08-20T22:16:36.7257814Z + [[ dynamic_aot_eager_timm == *xla* ]] 2024-08-20T22:16:36.7258275Z + [[ dynamic_aot_eager_timm == *executorch* ]] 2024-08-20T22:16:36.7258791Z + [[ dynamic_aot_eager_timm == \j\i\t\_\l\e\g\a\c\y ]] 2024-08-20T22:16:36.7259515Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm86 == *libtorch* ]] 2024-08-20T22:16:36.7260218Z + [[ dynamic_aot_eager_timm == distributed ]] 2024-08-20T22:16:36.7260903Z + [[ dynamic_aot_eager_timm == *inductor_distributed* ]] 2024-08-20T22:16:36.7261563Z + [[ dynamic_aot_eager_timm == *inductor-halide* ]] 2024-08-20T22:16:36.7262188Z + [[ dynamic_aot_eager_timm == *inductor-micro-benchmark* ]] 2024-08-20T22:16:36.7262742Z + [[ dynamic_aot_eager_timm == *huggingface* ]] 2024-08-20T22:16:36.7263212Z + [[ dynamic_aot_eager_timm == *timm* ]] 2024-08-20T22:16:36.7263641Z + install_torchvision 2024-08-20T22:16:36.7263968Z + local orig_preload 2024-08-20T22:16:36.7264300Z + local commit 2024-08-20T22:16:36.7264734Z ++ get_pinned_commit vision 2024-08-20T22:16:36.7265484Z ++ cat .github/ci_commit_pins/vision.txt 2024-08-20T22:16:36.7278886Z + commit=d23a6e1664d20707c11781299611436e1f0c104f 2024-08-20T22:16:36.7279513Z + orig_preload= 2024-08-20T22:16:36.7280098Z + '[' -n '' ']' 2024-08-20T22:16:36.7281210Z + pip_install --no-use-pep517 --user git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2024-08-20T22:16:36.7282727Z + pip install --progress-bar off --no-use-pep517 --user git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2024-08-20T22:16:37.0624831Z Collecting git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2024-08-20T22:16:37.0628622Z Cloning https://github.com/pytorch/vision.git (to revision d23a6e1664d20707c11781299611436e1f0c104f) to /tmp/pip-req-build-v1uv3_bi 2024-08-20T22:16:37.0659023Z Running command git clone --filter=blob:none --quiet https://github.com/pytorch/vision.git /tmp/pip-req-build-v1uv3_bi 2024-08-20T22:16:38.5897224Z Running command git rev-parse -q --verify 'sha^d23a6e1664d20707c11781299611436e1f0c104f' 2024-08-20T22:16:38.5926211Z Running command git fetch -q https://github.com/pytorch/vision.git d23a6e1664d20707c11781299611436e1f0c104f 2024-08-20T22:16:39.9198871Z Running command git checkout -q d23a6e1664d20707c11781299611436e1f0c104f 2024-08-20T22:16:40.2264461Z Resolved https://github.com/pytorch/vision.git to commit d23a6e1664d20707c11781299611436e1f0c104f 2024-08-20T22:16:42.7203824Z Preparing metadata (setup.py) ... [?25l- \ done 2024-08-20T22:16:42.7235959Z [?25hRequirement already satisfied: numpy in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (1.22.4) 2024-08-20T22:16:42.7240234Z Requirement already satisfied: torch in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (2.5.0a0+git40ec5f6) 2024-08-20T22:16:42.7244319Z Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (10.3.0) 2024-08-20T22:16:42.7314415Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (3.13.1) 2024-08-20T22:16:42.7318669Z Requirement already satisfied: typing-extensions>=4.8.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (4.12.2) 2024-08-20T22:16:42.7321697Z Requirement already satisfied: networkx in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (2.8.8) 2024-08-20T22:16:42.7325074Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (3.1.4) 2024-08-20T22:16:42.7328262Z Requirement already satisfied: fsspec in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (2024.6.1) 2024-08-20T22:16:42.7333182Z Requirement already satisfied: sympy==1.13.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (1.13.1) 2024-08-20T22:16:42.7346904Z Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from sympy==1.13.1->torch->torchvision==0.19.0a0+d23a6e1) (1.3.0) 2024-08-20T22:16:42.7816123Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from jinja2->torch->torchvision==0.19.0a0+d23a6e1) (2.1.5) 2024-08-20T22:16:42.7879414Z Building wheels for collected packages: torchvision 2024-08-20T22:17:59.1723501Z Building wheel for torchvision (setup.py) ... [?25l- \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / done 2024-08-20T22:17:59.1758240Z [?25h Created wheel for torchvision: filename=torchvision-0.19.0a0+d23a6e1-cp310-cp310-linux_x86_64.whl size=2115931 sha256=6ff0f3049b7e924d446e4aeb6c142e681eaf4c963416bdb163a51b59ee6d8fae 2024-08-20T22:17:59.1760222Z Stored in directory: /var/lib/jenkins/.cache/pip/wheels/0e/56/35/02931e71eb23fd2b85591c7ec05b733ca7c8b328a2fd151f96 2024-08-20T22:17:59.1794021Z Successfully built torchvision 2024-08-20T22:17:59.6640023Z Installing collected packages: torchvision 2024-08-20T22:18:00.0746113Z Successfully installed torchvision-0.19.0a0+d23a6e1 2024-08-20T22:18:00.2158549Z + '[' -n '' ']' 2024-08-20T22:18:00.2159008Z + id=1 2024-08-20T22:18:00.2159411Z + test_dynamo_benchmark timm_models 1 2024-08-20T22:18:00.2162363Z ++ pwd 2024-08-20T22:18:00.2165729Z + TEST_REPORTS_DIR=/var/lib/jenkins/workspace/test/test-reports 2024-08-20T22:18:00.2166371Z + local suite=timm_models 2024-08-20T22:18:00.2166813Z + shift 2024-08-20T22:18:00.2167160Z + local shard_id=1 2024-08-20T22:18:00.2167529Z + shift 2024-08-20T22:18:00.2172528Z + [[ dynamic_aot_eager_timm == *perf_compare* ]] 2024-08-20T22:18:00.2173444Z + [[ dynamic_aot_eager_timm == *perf* ]] 2024-08-20T22:18:00.2173930Z + [[ dynamic_aot_eager_timm == *cpu* ]] 2024-08-20T22:18:00.2174406Z + [[ dynamic_aot_eager_timm == *aot_inductor* ]] 2024-08-20T22:18:00.2175160Z + test_single_dynamo_benchmark inference timm_models 1 --inference --bfloat16 2024-08-20T22:18:00.2175738Z ++ pwd 2024-08-20T22:18:00.2176216Z + TEST_REPORTS_DIR=/var/lib/jenkins/workspace/test/test-reports 2024-08-20T22:18:00.2176886Z + mkdir -p /var/lib/jenkins/workspace/test/test-reports 2024-08-20T22:18:00.2200835Z + local name=inference 2024-08-20T22:18:00.2201167Z + shift 2024-08-20T22:18:00.2201463Z + local suite=timm_models 2024-08-20T22:18:00.2201805Z + shift 2024-08-20T22:18:00.2202071Z + local shard_id=1 2024-08-20T22:18:00.2202378Z + shift 2024-08-20T22:18:00.2202658Z + partition_flags=() 2024-08-20T22:18:00.2202985Z + local partition_flags 2024-08-20T22:18:00.2205337Z + [[ -n 2 ]] 2024-08-20T22:18:00.2205731Z + [[ -n 1 ]] 2024-08-20T22:18:00.2206397Z + partition_flags=(--total-partitions "$NUM_TEST_SHARDS" --partition-id "$shard_id") 2024-08-20T22:18:00.2207097Z + [[ dynamic_aot_eager_timm == *perf_compare* ]] 2024-08-20T22:18:00.2207581Z + [[ dynamic_aot_eager_timm == *perf* ]] 2024-08-20T22:18:00.2208053Z + [[ dynamic_aot_eager_timm == *aot_inductor* ]] 2024-08-20T22:18:00.2208519Z + [[ dynamic_aot_eager_timm == *_avx2* ]] 2024-08-20T22:18:00.2208974Z + [[ dynamic_aot_eager_timm == *_avx512* ]] 2024-08-20T22:18:00.2210808Z + python benchmarks/dynamo/timm_models.py --ci --accuracy --timing --explain --backend aot_eager --dynamic-shapes --dynamic-batch-only --device cuda --inference --bfloat16 --total-partitions 2 --partition-id 1 --output /var/lib/jenkins/workspace/test/test-reports/inference_timm_models.csv 2024-08-20T22:18:06.6740753Z 2024-08-20T22:18:06.8194927Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:18:06.8195293Z 2024-08-20T22:18:06.8899665Z model.safetensors: 0% 0.00/29.6M [00:00 will be ignored 2024-08-20T22:32:59.1957195Z pass 2024-08-20T22:32:59.2009053Z TIMING: entire_frame_compile:40.16384 backend_compile:21.3541 total_wall_time:40.16384 2024-08-20T22:32:59.2010529Z STATS: call_* op count: 700 | FakeTensorMode.__torch_dispatch__:40585 | attempt fast:1254 | fast is_contiguous:1254 | FakeTensor.__torch_dispatch__:3080 | ProxyTorchDispatchMode.__torch_dispatch__:12852 2024-08-20T22:32:59.2012299Z Dynamo produced 4 graphs covering 700 ops with 7 graph breaks (5 unique) 2024-08-20T22:33:04.6597766Z 2024-08-20T22:33:05.5126989Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:33:05.5127578Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:33:05.5128995Z cuda train mobilenetv2_100 2024-08-20T22:33:38.8368491Z W0820 22:33:38.836000 4862 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T22:33:55.1373284Z pass 2024-08-20T22:33:55.1450309Z TIMING: entire_frame_compile:48.49502 backend_compile:26.67134 total_wall_time:48.49502 2024-08-20T22:33:55.1455050Z STATS: call_* op count: 699 | FakeTensorMode.__torch_dispatch__:44768 | attempt fast:1254 | fast is_contiguous:1254 | FakeTensor.__torch_dispatch__:3178 | ProxyTorchDispatchMode.__torch_dispatch__:12588 2024-08-20T22:33:55.1456376Z Dynamo produced 3 graphs covering 699 ops with 7 graph breaks (5 unique) 2024-08-20T22:34:00.8949264Z 2024-08-20T22:34:01.8009937Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:34:01.8010952Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:34:01.8015231Z cuda train mobilenetv3_large_100 2024-08-20T22:34:36.8230966Z W0820 22:34:36.822000 4959 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T22:34:55.7945508Z pass 2024-08-20T22:34:55.8009226Z TIMING: entire_frame_compile:52.85336 backend_compile:28.83077 total_wall_time:52.85336 2024-08-20T22:34:55.8012608Z STATS: call_* op count: 775 | FakeTensorMode.__torch_dispatch__:47458 | attempt fast:1559 | fast is_contiguous:1559 | FakeTensor.__torch_dispatch__:3494 | ProxyTorchDispatchMode.__torch_dispatch__:14152 2024-08-20T22:34:55.8014010Z Dynamo produced 3 graphs covering 775 ops with 7 graph breaks (5 unique) 2024-08-20T22:35:01.7561891Z 2024-08-20T22:35:02.6607952Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:35:02.6608441Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:35:02.6608880Z cuda train mobilevit_s 2024-08-20T22:35:51.5834868Z pass 2024-08-20T22:35:51.6105559Z TIMING: entire_frame_compile:47.18507 backend_compile:28.70875 total_wall_time:47.18507 2024-08-20T22:35:51.6109378Z STATS: call_* op count: 370 | FakeTensorMode.__torch_dispatch__:43080 | attempt fast:2058 | fast is_contiguous:2052 | FakeTensor.__torch_dispatch__:258 | ProxyTorchDispatchMode.__torch_dispatch__:10817 | slow no contiguity match:6 2024-08-20T22:35:51.6110833Z Dynamo produced 3 graphs covering 370 ops with 6 graph breaks (5 unique) 2024-08-20T22:36:01.0506475Z 2024-08-20T22:36:02.3203523Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:36:02.3203993Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:36:02.3204418Z cuda train nfnet_l0 2024-08-20T22:36:38.3067147Z W0820 22:36:38.305000 5154 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T22:37:05.7319379Z pass 2024-08-20T22:37:05.7662877Z TIMING: entire_frame_compile:60.88964 backend_compile:34.29239 total_wall_time:60.88964 2024-08-20T22:37:05.7665680Z STATS: call_* op count: 1205 | FakeTensorMode.__torch_dispatch__:57264 | attempt fast:784 | fast is_contiguous:784 | FakeTensor.__torch_dispatch__:4274 | ProxyTorchDispatchMode.__torch_dispatch__:21252 2024-08-20T22:37:05.7667002Z Dynamo produced 3 graphs covering 1205 ops with 7 graph breaks (5 unique) 2024-08-20T22:37:11.6967768Z 2024-08-20T22:37:12.7807767Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:37:12.7808227Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:37:12.7814852Z cuda train pit_b_224 2024-08-20T22:37:45.1235433Z pass 2024-08-20T22:37:45.1764847Z TIMING: entire_frame_compile:28.5747 backend_compile:17.81122 total_wall_time:28.5747 2024-08-20T22:37:45.1768170Z STATS: call_* op count: 310 | FakeTensorMode.__torch_dispatch__:31294 | attempt fast:1734 | fast is_contiguous:1734 | FakeTensor.__torch_dispatch__:178 | ProxyTorchDispatchMode.__torch_dispatch__:8724 2024-08-20T22:37:45.1769524Z Dynamo produced 2 graphs covering 310 ops with 6 graph breaks (5 unique) 2024-08-20T22:37:51.2659048Z 2024-08-20T22:37:53.0266331Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:37:53.0266849Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:37:53.0267296Z cuda train pnasnet5large 2024-08-20T22:39:59.5855346Z pass 2024-08-20T22:39:59.7604573Z TIMING: entire_frame_compile:116.88407 backend_compile:62.3791 total_wall_time:116.88407 2024-08-20T22:39:59.7607584Z STATS: call_* op count: 1161 | FakeTensorMode.__torch_dispatch__:128644 | attempt fast:5041 | fast is_contiguous:5017 | FakeTensor.__torch_dispatch__:36 | ProxyTorchDispatchMode.__torch_dispatch__:30261 | slow no contiguity match:24 2024-08-20T22:39:59.7609624Z Dynamo produced 2 graphs covering 1161 ops with 5 graph breaks (4 unique) 2024-08-20T22:40:09.4640427Z 2024-08-20T22:40:10.8920305Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:40:10.8920903Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:40:10.8923351Z cuda train poolformer_m36 2024-08-20T22:41:12.3902198Z pass 2024-08-20T22:41:12.4526916Z TIMING: entire_frame_compile:57.7145 backend_compile:36.13337 total_wall_time:57.7145 2024-08-20T22:41:12.4531573Z STATS: call_* op count: 554 | FakeTensorMode.__torch_dispatch__:56009 | attempt fast:4863 | fast is_contiguous:4791 | ProxyTorchDispatchMode.__torch_dispatch__:13481 | slow both tensors nontrivially broadcast:72 | FakeTensor.__torch_dispatch__:22 2024-08-20T22:41:12.4533116Z Dynamo produced 2 graphs covering 554 ops with 6 graph breaks (5 unique) 2024-08-20T22:41:18.9542608Z 2024-08-20T22:41:19.8343822Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:41:19.8344304Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:41:19.8344742Z cuda train regnety_002 2024-08-20T22:41:49.9006324Z pass 2024-08-20T22:41:49.9044051Z TIMING: entire_frame_compile:29.15059 backend_compile:16.62635 total_wall_time:29.15059 2024-08-20T22:41:49.9046797Z STATS: call_* op count: 271 | FakeTensorMode.__torch_dispatch__:30117 | attempt fast:1215 | fast is_contiguous:1215 | FakeTensor.__torch_dispatch__:34 | ProxyTorchDispatchMode.__torch_dispatch__:7367 2024-08-20T22:41:49.9048129Z Dynamo produced 2 graphs covering 271 ops with 6 graph breaks (5 unique) 2024-08-20T22:41:55.1943344Z 2024-08-20T22:41:56.3281274Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:41:56.3281957Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:41:56.3286703Z cuda train repvgg_a2 2024-08-20T22:42:24.1046979Z W0820 22:42:24.103000 5643 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T22:42:40.4706868Z pass 2024-08-20T22:42:40.4980571Z TIMING: entire_frame_compile:41.62169 backend_compile:22.31361 total_wall_time:41.62169 2024-08-20T22:42:40.4983661Z STATS: call_* op count: 756 | FakeTensorMode.__torch_dispatch__:43451 | attempt fast:1571 | fast is_contiguous:1571 | FakeTensor.__torch_dispatch__:3142 | ProxyTorchDispatchMode.__torch_dispatch__:13620 2024-08-20T22:42:40.4985070Z Dynamo produced 3 graphs covering 756 ops with 7 graph breaks (5 unique) 2024-08-20T22:42:45.7735313Z 2024-08-20T22:42:47.2918668Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:42:47.2919259Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:42:47.2919769Z cuda train res2net101_26w_4s 2024-08-20T22:44:17.6075910Z pass 2024-08-20T22:44:17.6469263Z TIMING: entire_frame_compile:85.92117 backend_compile:52.20253 total_wall_time:85.92117 2024-08-20T22:44:17.6473914Z STATS: call_* op count: 977 | FakeTensorMode.__torch_dispatch__:99820 | attempt fast:4307 | fast is_contiguous:4017 | FakeTensor.__torch_dispatch__:46 | slow no contiguity match:290 | ProxyTorchDispatchMode.__torch_dispatch__:21353 2024-08-20T22:44:17.6476864Z Dynamo produced 2 graphs covering 977 ops with 6 graph breaks (5 unique) 2024-08-20T22:44:25.8880860Z 2024-08-20T22:44:27.1460355Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:44:27.1461066Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:44:27.1462857Z cuda train res2net50_14w_8s 2024-08-20T22:45:48.5985892Z pass 2024-08-20T22:45:48.6211673Z TIMING: entire_frame_compile:78.45573 backend_compile:46.935 total_wall_time:78.45573 2024-08-20T22:45:48.6216886Z STATS: call_* op count: 852 | FakeTensorMode.__torch_dispatch__:92301 | attempt fast:3843 | fast is_contiguous:3483 | FakeTensor.__torch_dispatch__:48 | slow no contiguity match:360 | ProxyTorchDispatchMode.__torch_dispatch__:18803 2024-08-20T22:45:48.6219829Z Dynamo produced 2 graphs covering 852 ops with 6 graph breaks (5 unique) 2024-08-20T22:45:56.1934936Z 2024-08-20T22:45:57.2994559Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:45:57.2995027Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:45:57.2995493Z cuda train res2next50 2024-08-20T22:46:42.5945387Z pass 2024-08-20T22:46:42.6192799Z TIMING: entire_frame_compile:42.97264 backend_compile:25.87309 total_wall_time:42.97264 2024-08-20T22:46:42.6194319Z STATS: call_* op count: 484 | FakeTensorMode.__torch_dispatch__:49484 | attempt fast:2131 | fast is_contiguous:2011 | FakeTensor.__torch_dispatch__:38 | slow no contiguity match:120 | ProxyTorchDispatchMode.__torch_dispatch__:10643 2024-08-20T22:46:42.6195761Z Dynamo produced 2 graphs covering 484 ops with 6 graph breaks (5 unique) 2024-08-20T22:46:48.6578891Z 2024-08-20T22:46:49.3889915Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:46:49.3890617Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:46:49.3891281Z cuda train resmlp_12_224 2024-08-20T22:47:08.8304775Z pass 2024-08-20T22:47:08.8435193Z TIMING: entire_frame_compile:18.17535 backend_compile:11.13568 total_wall_time:18.17535 2024-08-20T22:47:08.8437020Z STATS: call_* op count: 179 | FakeTensorMode.__torch_dispatch__:19401 | attempt fast:1062 | slow no contiguity match:405 | fast is_contiguous:657 | ProxyTorchDispatchMode.__torch_dispatch__:6468 | FakeTensor.__torch_dispatch__:22 2024-08-20T22:47:08.8438489Z Dynamo produced 2 graphs covering 179 ops with 6 graph breaks (5 unique) 2024-08-20T22:47:13.6533005Z 2024-08-20T22:47:15.2753405Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:47:15.2753858Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:47:15.2756274Z cuda train resnest101e 2024-08-20T22:48:49.4347723Z pass 2024-08-20T22:48:49.4927356Z TIMING: entire_frame_compile:88.26447 backend_compile:53.79464 total_wall_time:88.26447 2024-08-20T22:48:49.4929116Z STATS: call_* op count: 1028 | FakeTensorMode.__torch_dispatch__:95664 | attempt fast:3898 | fast is_contiguous:3832 | FakeTensor.__torch_dispatch__:38 | ProxyTorchDispatchMode.__torch_dispatch__:23525 | slow no contiguity match:66 2024-08-20T22:48:49.4931016Z Dynamo produced 2 graphs covering 1028 ops with 6 graph breaks (5 unique) 2024-08-20T22:48:58.5914513Z 2024-08-20T22:48:59.7102414Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:48:59.7103019Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:48:59.7105148Z cuda train rexnet_100 2024-08-20T22:49:55.4937572Z W0820 22:49:55.492000 6229 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T22:50:18.1131978Z pass 2024-08-20T22:50:18.1303214Z TIMING: entire_frame_compile:76.89597 backend_compile:43.60906 total_wall_time:76.89597 2024-08-20T22:50:18.1307631Z STATS: call_* op count: 1034 | FakeTensorMode.__torch_dispatch__:63499 | attempt fast:1766 | fast is_contiguous:1711 | FakeTensor.__torch_dispatch__:4668 | slow no contiguity match:55 | ProxyTorchDispatchMode.__torch_dispatch__:19554 2024-08-20T22:50:18.1309920Z Dynamo produced 3 graphs covering 1034 ops with 7 graph breaks (5 unique) 2024-08-20T22:50:29.5951317Z 2024-08-20T22:50:30.6922806Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:50:30.6923461Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:50:30.6927400Z cuda train sebotnet33ts_256 2024-08-20T22:51:16.1047792Z pass 2024-08-20T22:51:16.1242126Z TIMING: entire_frame_compile:43.48144 backend_compile:27.01977 total_wall_time:43.48144 2024-08-20T22:51:16.1243634Z STATS: call_* op count: 373 | FakeTensorMode.__torch_dispatch__:35979 | attempt fast:1368 | fast is_contiguous:1348 | FakeTensor.__torch_dispatch__:184 | slow no contiguity match:20 | ProxyTorchDispatchMode.__torch_dispatch__:8767 2024-08-20T22:51:16.1245136Z Dynamo produced 3 graphs covering 373 ops with 6 graph breaks (5 unique) 2024-08-20T22:51:24.9687781Z 2024-08-20T22:51:26.1474854Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:51:26.1475317Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:51:26.1475749Z cuda train selecsls42b 2024-08-20T22:51:47.4579800Z pass 2024-08-20T22:51:47.4855687Z TIMING: entire_frame_compile:19.79495 backend_compile:11.497 total_wall_time:19.79495 2024-08-20T22:51:47.4858476Z STATS: call_* op count: 178 | FakeTensorMode.__torch_dispatch__:21638 | attempt fast:966 | fast is_contiguous:951 | FakeTensor.__torch_dispatch__:48 | ProxyTorchDispatchMode.__torch_dispatch__:4891 | slow no contiguity match:15 2024-08-20T22:51:47.4860214Z Dynamo produced 2 graphs covering 178 ops with 6 graph breaks (5 unique) 2024-08-20T22:51:52.4005179Z 2024-08-20T22:51:53.2743665Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:51:53.2744822Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:51:53.2746000Z cuda train spnasnet_100 2024-08-20T22:52:23.5061652Z W0820 22:52:23.505000 6523 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T22:52:43.2500448Z pass 2024-08-20T22:52:43.2557941Z TIMING: entire_frame_compile:48.70172 backend_compile:26.1395 total_wall_time:48.70172 2024-08-20T22:52:43.2561075Z STATS: call_* op count: 855 | FakeTensorMode.__torch_dispatch__:49715 | attempt fast:1550 | fast is_contiguous:1550 | FakeTensor.__torch_dispatch__:3738 | ProxyTorchDispatchMode.__torch_dispatch__:15761 2024-08-20T22:52:43.2562416Z Dynamo produced 3 graphs covering 855 ops with 7 graph breaks (5 unique) 2024-08-20T22:52:48.6215116Z 2024-08-20T22:52:50.5267984Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:52:50.5268460Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:52:50.5268906Z cuda train swin_base_patch4_window7_224 2024-08-20T22:55:15.8492431Z W0820 22:55:15.848000 6620 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T22:55:44.1907430Z pass 2024-08-20T22:55:44.2699856Z TIMING: entire_frame_compile:167.81028 backend_compile:113.42394 total_wall_time:167.81028 2024-08-20T22:55:44.2702955Z STATS: call_* op count: 2449 | FakeTensorMode.__torch_dispatch__:123553 | attempt fast:4105 | fast is_contiguous:4009 | slow no contiguity match:96 | ProxyTorchDispatchMode.__torch_dispatch__:39943 | FakeTensor.__torch_dispatch__:6090 2024-08-20T22:55:44.2704437Z Dynamo produced 3 graphs covering 2449 ops with 7 graph breaks (5 unique) 2024-08-20T22:56:32.0973376Z 2024-08-20T22:56:35.3528975Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:56:35.3531884Z loading model: 0it [00:03, ?it/s] 2024-08-20T22:56:35.3532361Z cuda train swsl_resnext101_32x16d 2024-08-20T22:57:33.4768702Z pass 2024-08-20T22:57:33.6348755Z TIMING: entire_frame_compile:47.13806 backend_compile:28.23234 total_wall_time:47.13806 2024-08-20T22:57:33.6351467Z STATS: call_* op count: 453 | FakeTensorMode.__torch_dispatch__:52589 | attempt fast:2499 | fast is_contiguous:2499 | FakeTensor.__torch_dispatch__:36 | ProxyTorchDispatchMode.__torch_dispatch__:11922 2024-08-20T22:57:33.6354030Z Dynamo produced 2 graphs covering 453 ops with 6 graph breaks (5 unique) 2024-08-20T22:57:39.7695615Z 2024-08-20T22:57:40.6856807Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:57:40.6859964Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:57:40.6860580Z cuda train tf_efficientnet_b0 2024-08-20T22:58:24.7253892Z pass 2024-08-20T22:58:24.7376113Z TIMING: entire_frame_compile:42.92453 backend_compile:25.74474 total_wall_time:42.92453 2024-08-20T22:58:24.7380620Z STATS: call_* op count: 297 | FakeTensorMode.__torch_dispatch__:38296 | attempt fast:1732 | fast is_contiguous:1732 | FakeTensor.__torch_dispatch__:250 | ProxyTorchDispatchMode.__torch_dispatch__:9286 2024-08-20T22:58:24.7383142Z Dynamo produced 2 graphs covering 297 ops with 6 graph breaks (5 unique) 2024-08-20T22:58:30.3455159Z 2024-08-20T22:58:31.3943991Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:58:31.3944469Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:58:31.3944905Z cuda train tf_mixnet_l 2024-08-20T22:59:30.7767984Z pass 2024-08-20T22:59:30.7944483Z TIMING: entire_frame_compile:57.82374 backend_compile:33.64673 total_wall_time:57.82374 2024-08-20T22:59:30.7947160Z STATS: call_* op count: 598 | FakeTensorMode.__torch_dispatch__:54957 | attempt fast:1956 | fast is_contiguous:1956 | FakeTensor.__torch_dispatch__:246 | ProxyTorchDispatchMode.__torch_dispatch__:13503 2024-08-20T22:59:30.7950019Z Dynamo produced 2 graphs covering 598 ops with 6 graph breaks (5 unique) 2024-08-20T22:59:37.0540196Z 2024-08-20T22:59:38.0575124Z loading model: 0it [00:00, ?it/s] 2024-08-20T22:59:38.0575626Z loading model: 0it [00:01, ?it/s] 2024-08-20T22:59:38.0576056Z cuda train tinynet_a 2024-08-20T23:00:28.6504416Z E0820 23:00:28.649000 7012 torch/_dynamo/utils.py:1688] RMSE (res-fp64): 0.00408, (ref-fp64): 0.00019 and shape=torch.Size([32]). res.dtype: torch.float32, multiplier: 3.000000, tol: 0.010000, use_larger_multiplier_for_smaller_tensor: 0 2024-08-20T23:00:28.6506226Z E0820 23:00:28.649000 7012 torch/_dynamo/utils.py:1580] Accuracy failed for key name bn1.weight.grad 2024-08-20T23:00:28.6546503Z fail_accuracy 2024-08-20T23:00:28.6653355Z TIMING: entire_frame_compile:49.4824 backend_compile:29.93026 total_wall_time:49.4824 2024-08-20T23:00:28.6656468Z STATS: call_* op count: 346 | FakeTensorMode.__torch_dispatch__:44749 | attempt fast:2056 | fast is_contiguous:2056 | FakeTensor.__torch_dispatch__:286 | ProxyTorchDispatchMode.__torch_dispatch__:10942 2024-08-20T23:00:28.6657790Z Dynamo produced 2 graphs covering 346 ops with 6 graph breaks (5 unique) 2024-08-20T23:00:34.4573151Z 2024-08-20T23:00:35.4540337Z loading model: 0it [00:00, ?it/s] 2024-08-20T23:00:35.4541041Z loading model: 0it [00:00, ?it/s] 2024-08-20T23:00:35.4541715Z cuda train tnt_s_patch16_224 2024-08-20T23:02:29.4987893Z W0820 23:02:29.497000 7110 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T23:02:59.5384246Z pass 2024-08-20T23:02:59.5665964Z TIMING: entire_frame_compile:140.47672 backend_compile:91.97793 total_wall_time:140.47672 2024-08-20T23:02:59.5668337Z STATS: call_* op count: 1850 | FakeTensorMode.__torch_dispatch__:112038 | attempt fast:3969 | fast is_contiguous:3825 | slow no contiguity match:144 | ProxyTorchDispatchMode.__torch_dispatch__:38370 | FakeTensor.__torch_dispatch__:6414 2024-08-20T23:02:59.5670681Z Dynamo produced 3 graphs covering 1850 ops with 7 graph breaks (5 unique) 2024-08-20T23:03:23.1701611Z 2024-08-20T23:03:24.5709442Z loading model: 0it [00:00, ?it/s] 2024-08-20T23:03:24.5709890Z loading model: 0it [00:01, ?it/s] 2024-08-20T23:03:24.5712834Z cuda train twins_pcpvt_base 2024-08-20T23:04:49.7700819Z W0820 23:04:49.769000 7208 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T23:05:37.3237182Z pass 2024-08-20T23:05:37.3610801Z TIMING: entire_frame_compile:128.1019 backend_compile:76.59483 total_wall_time:128.1019 2024-08-20T23:05:37.3615805Z STATS: call_* op count: 2432 | FakeTensorMode.__torch_dispatch__:137518 | attempt fast:4814 | fast is_contiguous:4752 | FakeTensor.__torch_dispatch__:9872 | slow no contiguity match:61 | ProxyTorchDispatchMode.__torch_dispatch__:48600 | fast channels_last:1 2024-08-20T23:05:37.3617670Z Dynamo produced 3 graphs covering 2432 ops with 7 graph breaks (5 unique) 2024-08-20T23:05:48.5864396Z 2024-08-20T23:05:49.8310968Z loading model: 0it [00:00, ?it/s] 2024-08-20T23:05:49.8311444Z loading model: 0it [00:01, ?it/s] 2024-08-20T23:05:49.8311887Z cuda train visformer_small 2024-08-20T23:06:18.6245690Z W0820 23:06:18.623000 7305 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T23:06:32.7255926Z pass 2024-08-20T23:06:32.7604982Z TIMING: entire_frame_compile:40.47321 backend_compile:22.45798 total_wall_time:40.47321 2024-08-20T23:06:32.7608159Z STATS: call_* op count: 703 | FakeTensorMode.__torch_dispatch__:38000 | attempt fast:1457 | fast is_contiguous:1457 | FakeTensor.__torch_dispatch__:2300 | ProxyTorchDispatchMode.__torch_dispatch__:12063 2024-08-20T23:06:32.7609492Z Dynamo produced 3 graphs covering 703 ops with 7 graph breaks (5 unique) 2024-08-20T23:06:38.3531817Z 2024-08-20T23:06:39.9227754Z loading model: 0it [00:00, ?it/s] 2024-08-20T23:06:39.9228621Z loading model: 0it [00:01, ?it/s] 2024-08-20T23:06:39.9229497Z cuda train vit_base_patch16_224 2024-08-20T23:07:07.5445666Z W0820 23:07:07.543000 7403 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T23:07:21.0008772Z pass 2024-08-20T23:07:21.0904782Z TIMING: entire_frame_compile:36.11994 backend_compile:21.94962 total_wall_time:36.11994 2024-08-20T23:07:21.0906153Z STATS: call_* op count: 740 | FakeTensorMode.__torch_dispatch__:41327 | attempt fast:1591 | fast is_contiguous:1591 | FakeTensor.__torch_dispatch__:2952 | ProxyTorchDispatchMode.__torch_dispatch__:14361 2024-08-20T23:07:21.0908777Z Dynamo produced 3 graphs covering 740 ops with 7 graph breaks (5 unique) 2024-08-20T23:07:26.3481276Z 2024-08-20T23:07:27.5017873Z loading model: 0it [00:00, ?it/s] 2024-08-20T23:07:27.5019143Z loading model: 0it [00:01, ?it/s] 2024-08-20T23:07:27.5019856Z cuda train volo_d1_224 2024-08-20T23:08:23.6583107Z W0820 23:08:23.657000 7501 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T23:08:47.0777689Z pass 2024-08-20T23:08:47.0975511Z TIMING: entire_frame_compile:76.2903 backend_compile:46.84093 total_wall_time:76.2903 2024-08-20T23:08:47.0977391Z STATS: call_* op count: 1282 | FakeTensorMode.__torch_dispatch__:78359 | attempt fast:2670 | fast is_contiguous:2487 | FakeTensor.__torch_dispatch__:4800 | slow no contiguity match:183 | ProxyTorchDispatchMode.__torch_dispatch__:25433 2024-08-20T23:08:47.0978906Z Dynamo produced 3 graphs covering 1282 ops with 7 graph breaks (5 unique) 2024-08-20T23:08:56.6769093Z 2024-08-20T23:09:00.1233151Z loading model: 0it [00:00, ?it/s] 2024-08-20T23:09:00.1233613Z loading model: 0it [00:03, ?it/s] 2024-08-20T23:09:00.1234066Z cuda train xcit_large_24_p8_224 2024-08-20T23:09:04.4307922Z WARNING:common:fp64 golden ref were not generated for xcit_large_24_p8_224. Setting accuracy check to cosine 2024-08-20T23:11:09.6508106Z W0820 23:11:09.649000 7598 torch/_logging/_internal.py:1058] [6/0] Profiler function will be ignored 2024-08-20T23:12:07.8248134Z pass_due_to_skip 2024-08-20T23:12:08.0907298Z TIMING: entire_frame_compile:178.99942 backend_compile:109.0563 total_wall_time:178.99942 2024-08-20T23:12:08.0909054Z STATS: call_* op count: 3042 | FakeTensorMode.__torch_dispatch__:185388 | attempt fast:7060 | fast is_contiguous:4957 | FakeTensor.__torch_dispatch__:11426 | slow no contiguity match:1502 | fast channels_last:601 | ProxyTorchDispatchMode.__torch_dispatch__:63704 2024-08-20T23:12:08.0910629Z Dynamo produced 3 graphs covering 3042 ops with 7 graph breaks (5 unique) 2024-08-20T23:12:16.6840167Z accuracy pass_rate=93.55% 2024-08-20T23:12:16.6843517Z calls_captured gmean=691.71x mean=888.258x 2024-08-20T23:12:16.6847086Z unique_graphs gmean=2.49x mean=2.548x 2024-08-20T23:12:16.6850220Z graph_breaks gmean=6.39x mean=6.419x 2024-08-20T23:12:16.6853501Z unique_graph_breaks gmean=4.96x mean=4.968x 2024-08-20T23:12:16.6856967Z autograd_captures gmean=0.00x mean=0.000x 2024-08-20T23:12:16.6860420Z autograd_compiles gmean=0.00x mean=0.000x 2024-08-20T23:12:16.6863527Z cudagraph_skips gmean=0.00x mean=0.000x 2024-08-20T23:12:17.3306969Z + python benchmarks/dynamo/check_accuracy.py --actual /var/lib/jenkins/workspace/test/test-reports/training_timm_models.csv --expected benchmarks/dynamo/ci_expected_accuracy/dynamic_aot_eager_timm_training.csv 2024-08-20T23:12:17.5928781Z mixnet_l PASS 2024-08-20T23:12:17.5933360Z mnasnet_100 PASS 2024-08-20T23:12:17.5938247Z mobilenetv2_100 PASS 2024-08-20T23:12:17.5943158Z mobilenetv3_large_100 PASS 2024-08-20T23:12:17.5948088Z mobilevit_s PASS 2024-08-20T23:12:17.5953021Z nfnet_l0 PASS 2024-08-20T23:12:17.5957603Z pit_b_224 PASS 2024-08-20T23:12:17.5962237Z pnasnet5large PASS 2024-08-20T23:12:17.5967032Z poolformer_m36 PASS 2024-08-20T23:12:17.5972286Z regnety_002 PASS 2024-08-20T23:12:17.5978272Z repvgg_a2 PASS 2024-08-20T23:12:17.5982316Z res2net101_26w_4s PASS 2024-08-20T23:12:17.5987255Z res2net50_14w_8s PASS 2024-08-20T23:12:17.5991765Z res2next50 PASS 2024-08-20T23:12:17.5996251Z resmlp_12_224 PASS 2024-08-20T23:12:17.6000590Z resnest101e PASS 2024-08-20T23:12:17.6004907Z rexnet_100 PASS 2024-08-20T23:12:17.6009280Z sebotnet33ts_256 PASS 2024-08-20T23:12:17.6013792Z selecsls42b PASS 2024-08-20T23:12:17.6018427Z spnasnet_100 PASS 2024-08-20T23:12:17.6022621Z swin_base_patch4_window7_224 PASS 2024-08-20T23:12:17.6027263Z swsl_resnext101_32x16d PASS 2024-08-20T23:12:17.6031692Z tf_efficientnet_b0 PASS 2024-08-20T23:12:17.6035914Z tf_mixnet_l PASS 2024-08-20T23:12:17.6040410Z tinynet_a XFAIL 2024-08-20T23:12:17.6044770Z tnt_s_patch16_224 PASS 2024-08-20T23:12:17.6049262Z twins_pcpvt_base PASS 2024-08-20T23:12:17.6053680Z visformer_small PASS 2024-08-20T23:12:17.6058167Z vit_base_patch16_224 PASS 2024-08-20T23:12:17.6062623Z volo_d1_224 PASS 2024-08-20T23:12:17.6067333Z xcit_large_24_p8_224 XFAIL 2024-08-20T23:12:17.6484670Z + python benchmarks/dynamo/check_graph_breaks.py --actual /var/lib/jenkins/workspace/test/test-reports/training_timm_models.csv --expected benchmarks/dynamo/ci_expected_accuracy/dynamic_aot_eager_timm_training.csv 2024-08-20T23:12:17.9136837Z mixnet_l PASS 2024-08-20T23:12:17.9141367Z mnasnet_100 PASS 2024-08-20T23:12:17.9146947Z mobilenetv2_100 PASS 2024-08-20T23:12:17.9151740Z mobilenetv3_large_100 PASS 2024-08-20T23:12:17.9156487Z mobilevit_s PASS 2024-08-20T23:12:17.9161418Z nfnet_l0 PASS 2024-08-20T23:12:17.9166429Z pit_b_224 PASS 2024-08-20T23:12:17.9171641Z pnasnet5large PASS 2024-08-20T23:12:17.9176884Z poolformer_m36 PASS 2024-08-20T23:12:17.9181652Z regnety_002 PASS 2024-08-20T23:12:17.9186466Z repvgg_a2 PASS 2024-08-20T23:12:17.9191259Z res2net101_26w_4s PASS 2024-08-20T23:12:17.9196210Z res2net50_14w_8s PASS 2024-08-20T23:12:17.9200919Z res2next50 PASS 2024-08-20T23:12:17.9205789Z resmlp_12_224 PASS 2024-08-20T23:12:17.9210669Z resnest101e PASS 2024-08-20T23:12:17.9215435Z rexnet_100 PASS 2024-08-20T23:12:17.9220227Z sebotnet33ts_256 PASS 2024-08-20T23:12:17.9225211Z selecsls42b PASS 2024-08-20T23:12:17.9230220Z spnasnet_100 PASS 2024-08-20T23:12:17.9235107Z swin_base_patch4_window7_224 PASS 2024-08-20T23:12:17.9239880Z swsl_resnext101_32x16d PASS 2024-08-20T23:12:17.9244824Z tf_efficientnet_b0 PASS 2024-08-20T23:12:17.9249658Z tf_mixnet_l PASS 2024-08-20T23:12:17.9254879Z tinynet_a PASS 2024-08-20T23:12:17.9259486Z tnt_s_patch16_224 PASS 2024-08-20T23:12:17.9264330Z twins_pcpvt_base PASS 2024-08-20T23:12:17.9269352Z visformer_small PASS 2024-08-20T23:12:17.9274996Z vit_base_patch16_224 PASS 2024-08-20T23:12:17.9279506Z volo_d1_224 PASS 2024-08-20T23:12:17.9284497Z xcit_large_24_p8_224 PASS 2024-08-20T23:12:17.9712359Z + cleanup_workspace 2024-08-20T23:12:17.9713248Z + echo 'sudo may print the following warning message that can be ignored. The chown command will still run.' 2024-08-20T23:12:17.9714315Z sudo may print the following warning message that can be ignored. The chown command will still run. 2024-08-20T23:12:17.9715221Z + echo ' sudo: setrlimit(RLIMIT_STACK): Operation not permitted' 2024-08-20T23:12:17.9715859Z sudo: setrlimit(RLIMIT_STACK): Operation not permitted 2024-08-20T23:12:17.9716658Z + echo 'For more details refer to https://github.com/sudo-project/sudo/issues/42' 2024-08-20T23:12:17.9717527Z For more details refer to https://github.com/sudo-project/sudo/issues/42 2024-08-20T23:12:17.9718215Z + sudo chown -R 1000 /var/lib/jenkins/workspace 2024-08-20T23:12:18.7139765Z ##[group]Run cat test/**/*_toprint.log || true 2024-08-20T23:12:18.7140295Z cat test/**/*_toprint.log || true 2024-08-20T23:12:18.7153940Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T23:12:18.7154451Z env: 2024-08-20T23:12:18.7154736Z GIT_DEFAULT_BRANCH: main 2024-08-20T23:12:18.7155202Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T23:12:18.7155941Z DOCKER_CONTAINER_ID: 1d3d385f17f1d6c37db5afe728565c3b90add28f14b10207341c2ca1b3f122f7 2024-08-20T23:12:18.7156587Z ##[endgroup] 2024-08-20T23:12:18.7251366Z cat: 'test/**/*_toprint.log': No such file or directory 2024-08-20T23:12:18.7284317Z ##[group]Run kill "$MONITOR_SCRIPT_PID" 2024-08-20T23:12:18.7284805Z kill "$MONITOR_SCRIPT_PID" 2024-08-20T23:12:18.7293361Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T23:12:18.7293866Z env: 2024-08-20T23:12:18.7294139Z GIT_DEFAULT_BRANCH: main 2024-08-20T23:12:18.7294594Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T23:12:18.7295323Z DOCKER_CONTAINER_ID: 1d3d385f17f1d6c37db5afe728565c3b90add28f14b10207341c2ca1b3f122f7 2024-08-20T23:12:18.7295992Z MONITOR_SCRIPT_PID: 52540 2024-08-20T23:12:18.7296341Z ##[endgroup] 2024-08-20T23:12:18.7490186Z Prepare all required actions 2024-08-20T23:12:18.7490628Z Getting action download info 2024-08-20T23:12:18.9559128Z Download action repository 'actions/upload-artifact@v3' (SHA:a8a3f3ad30e3422c9c7b888a15615d19a852ae32) 2024-08-20T23:12:19.1211589Z ##[group]Run ./.github/actions/upload-test-artifacts 2024-08-20T23:12:19.1212057Z with: 2024-08-20T23:12:19.1212595Z file-suffix: test-dynamic_aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_29026300668 2024-08-20T23:12:19.1213258Z s3-bucket: gha-artifacts 2024-08-20T23:12:19.1213591Z env: 2024-08-20T23:12:19.1213868Z GIT_DEFAULT_BRANCH: main 2024-08-20T23:12:19.1214313Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T23:12:19.1215043Z DOCKER_CONTAINER_ID: 1d3d385f17f1d6c37db5afe728565c3b90add28f14b10207341c2ca1b3f122f7 2024-08-20T23:12:19.1215670Z ##[endgroup] 2024-08-20T23:12:19.1242021Z ##[group]Run # Remove any previous test jsons if they exist 2024-08-20T23:12:19.1242662Z # Remove any previous test jsons if they exist 2024-08-20T23:12:19.1243175Z rm -f test-jsons-*.zip 2024-08-20T23:12:19.1243699Z zip -r "test-jsons-${FILE_SUFFIX}.zip" test -i '*.json' 2024-08-20T23:12:19.1252579Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T23:12:19.1253065Z env: 2024-08-20T23:12:19.1253348Z GIT_DEFAULT_BRANCH: main 2024-08-20T23:12:19.1253800Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T23:12:19.1254531Z DOCKER_CONTAINER_ID: 1d3d385f17f1d6c37db5afe728565c3b90add28f14b10207341c2ca1b3f122f7 2024-08-20T23:12:19.1255415Z FILE_SUFFIX: test-dynamic_aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_29026300668 2024-08-20T23:12:19.1256066Z ##[endgroup] 2024-08-20T23:12:19.1620675Z adding: test/allowlist_for_publicAPI.json (deflated 79%) 2024-08-20T23:12:19.1649864Z adding: test/benchmark_utils/callgrind_artifacts.json (deflated 92%) 2024-08-20T23:12:19.1650821Z adding: test/minioptest_failures_dict.json (deflated 70%) 2024-08-20T23:12:19.1656807Z adding: test/profiler/profiler_utils_mock_events.json (deflated 87%) 2024-08-20T23:12:19.1662299Z adding: test/slow_tests.json (deflated 82%) 2024-08-20T23:12:19.1694931Z ##[group]Run # Remove any previous test reports if they exist 2024-08-20T23:12:19.1695653Z # Remove any previous test reports if they exist 2024-08-20T23:12:19.1696235Z rm -f test-reports-*.zip 2024-08-20T23:12:19.1696824Z zip -r "test-reports-${FILE_SUFFIX}.zip" test -i '*.xml' -i '*.csv' 2024-08-20T23:12:19.1705769Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T23:12:19.1706256Z env: 2024-08-20T23:12:19.1706538Z GIT_DEFAULT_BRANCH: main 2024-08-20T23:12:19.1706992Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T23:12:19.1707733Z DOCKER_CONTAINER_ID: 1d3d385f17f1d6c37db5afe728565c3b90add28f14b10207341c2ca1b3f122f7 2024-08-20T23:12:19.1708629Z FILE_SUFFIX: test-dynamic_aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_29026300668 2024-08-20T23:12:19.1709280Z ##[endgroup] 2024-08-20T23:12:19.1971406Z adding: test/test-reports/inference_timm_models.csv (deflated 69%) 2024-08-20T23:12:19.1972232Z adding: test/test-reports/training_timm_models.csv (deflated 66%) 2024-08-20T23:12:19.1976741Z adding: test/test-reports/training_timm_model_graph_breaks.csv (deflated 97%) 2024-08-20T23:12:19.1977682Z adding: test/test-reports/training_timm_model_graph_break_deduped.csv (deflated 74%) 2024-08-20T23:12:19.2009430Z ##[group]Run # Remove any previous usage logs if they exist 2024-08-20T23:12:19.2010044Z # Remove any previous usage logs if they exist 2024-08-20T23:12:19.2010535Z rm -f logs-*.zip 2024-08-20T23:12:19.2011195Z # this workflow is also run in bazel build test, but we dont generate usage reports for it 2024-08-20T23:12:19.2011965Z # so check to see if the file exists first 2024-08-20T23:12:19.2012481Z if [ -f 'usage_log.txt' ]; then 2024-08-20T23:12:19.2013268Z  zip "logs-${FILE_SUFFIX}.zip" 'usage_log.txt' 2024-08-20T23:12:19.2013749Z fi 2024-08-20T23:12:19.2014117Z if ls test/**/*.log 1> /dev/null 2>&1; then 2024-08-20T23:12:19.2014685Z  zip -r "logs-${FILE_SUFFIX}.zip" test -i '*.log' 2024-08-20T23:12:19.2015168Z fi 2024-08-20T23:12:19.2023748Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T23:12:19.2024246Z env: 2024-08-20T23:12:19.2024530Z GIT_DEFAULT_BRANCH: main 2024-08-20T23:12:19.2025059Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T23:12:19.2025796Z DOCKER_CONTAINER_ID: 1d3d385f17f1d6c37db5afe728565c3b90add28f14b10207341c2ca1b3f122f7 2024-08-20T23:12:19.2026683Z FILE_SUFFIX: test-dynamic_aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_29026300668 2024-08-20T23:12:19.2027328Z ##[endgroup] 2024-08-20T23:12:19.2110588Z adding: usage_log.txt (deflated 92%) 2024-08-20T23:12:19.2199125Z ##[group]Run # Remove any previous debugging artifacts if they exist 2024-08-20T23:12:19.2199827Z # Remove any previous debugging artifacts if they exist 2024-08-20T23:12:19.2200378Z rm -f debug-*.zip 2024-08-20T23:12:19.2200764Z if [ -d 'test/debug' ]; then 2024-08-20T23:12:19.2201268Z  zip -r "debug-${FILE_SUFFIX}.zip" test/debug 2024-08-20T23:12:19.2201733Z fi 2024-08-20T23:12:19.2209774Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T23:12:19.2210269Z env: 2024-08-20T23:12:19.2210550Z GIT_DEFAULT_BRANCH: main 2024-08-20T23:12:19.2210995Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T23:12:19.2211732Z DOCKER_CONTAINER_ID: 1d3d385f17f1d6c37db5afe728565c3b90add28f14b10207341c2ca1b3f122f7 2024-08-20T23:12:19.2212639Z FILE_SUFFIX: test-dynamic_aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_29026300668 2024-08-20T23:12:19.2213317Z ##[endgroup] 2024-08-20T23:12:19.2306095Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-08-20T23:12:19.2306729Z with: 2024-08-20T23:12:19.2307025Z s3-bucket: gha-artifacts 2024-08-20T23:12:19.2307470Z s3-prefix: pytorch/pytorch/10479310721/1/artifact 2024-08-20T23:12:19.2307946Z retention-days: 14 2024-08-20T23:12:19.2308294Z if-no-files-found: warn 2024-08-20T23:12:19.2308658Z path: test-jsons-*.zip 2024-08-20T23:12:19.2309008Z name: artifact 2024-08-20T23:12:19.2309320Z region: us-east-1 2024-08-20T23:12:19.2309643Z env: 2024-08-20T23:12:19.2309926Z GIT_DEFAULT_BRANCH: main 2024-08-20T23:12:19.2310387Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T23:12:19.2311126Z DOCKER_CONTAINER_ID: 1d3d385f17f1d6c37db5afe728565c3b90add28f14b10207341c2ca1b3f122f7 2024-08-20T23:12:19.2311772Z ##[endgroup] 2024-08-20T23:12:19.5816234Z NOTE: s3-prefix specified, ignoring name parameter 2024-08-20T23:12:19.5816915Z With the provided path, there will be 1 file uploaded 2024-08-20T23:12:19.5817520Z Uploading to s3 prefix: pytorch/pytorch/10479310721/1/artifact 2024-08-20T23:12:19.6775847Z Starting upload of test-jsons-test-dynamic_aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_29026300668.zip 2024-08-20T23:12:19.8206771Z Finished upload of test-jsons-test-dynamic_aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_29026300668.zip 2024-08-20T23:12:19.8478025Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-08-20T23:12:19.8478460Z with: 2024-08-20T23:12:19.8478749Z s3-bucket: gha-artifacts 2024-08-20T23:12:19.8479183Z s3-prefix: pytorch/pytorch/10479310721/1/artifact 2024-08-20T23:12:19.8479653Z retention-days: 14 2024-08-20T23:12:19.8479988Z if-no-files-found: error 2024-08-20T23:12:19.8480356Z path: test-reports-*.zip 2024-08-20T23:12:19.8480706Z name: artifact 2024-08-20T23:12:19.8481007Z region: us-east-1 2024-08-20T23:12:19.8481309Z env: 2024-08-20T23:12:19.8481585Z GIT_DEFAULT_BRANCH: main 2024-08-20T23:12:19.8482036Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T23:12:19.8482761Z DOCKER_CONTAINER_ID: 1d3d385f17f1d6c37db5afe728565c3b90add28f14b10207341c2ca1b3f122f7 2024-08-20T23:12:19.8483406Z ##[endgroup] 2024-08-20T23:12:20.1988667Z NOTE: s3-prefix specified, ignoring name parameter 2024-08-20T23:12:20.1989477Z With the provided path, there will be 1 file uploaded 2024-08-20T23:12:20.1990184Z Uploading to s3 prefix: pytorch/pytorch/10479310721/1/artifact 2024-08-20T23:12:20.2045572Z Starting upload of test-reports-test-dynamic_aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_29026300668.zip 2024-08-20T23:12:20.2884083Z Finished upload of test-reports-test-dynamic_aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_29026300668.zip 2024-08-20T23:12:20.3161659Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-08-20T23:12:20.3162094Z with: 2024-08-20T23:12:20.3162388Z s3-bucket: gha-artifacts 2024-08-20T23:12:20.3162825Z s3-prefix: pytorch/pytorch/10479310721/1/artifact 2024-08-20T23:12:20.3163296Z retention-days: 14 2024-08-20T23:12:20.3163627Z if-no-files-found: ignore 2024-08-20T23:12:20.3164008Z path: logs-*.zip 2024-08-20T23:12:20.3164321Z name: artifact 2024-08-20T23:12:20.3164621Z region: us-east-1 2024-08-20T23:12:20.3164939Z env: 2024-08-20T23:12:20.3165216Z GIT_DEFAULT_BRANCH: main 2024-08-20T23:12:20.3165672Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T23:12:20.3166398Z DOCKER_CONTAINER_ID: 1d3d385f17f1d6c37db5afe728565c3b90add28f14b10207341c2ca1b3f122f7 2024-08-20T23:12:20.3167032Z ##[endgroup] 2024-08-20T23:12:20.6674178Z NOTE: s3-prefix specified, ignoring name parameter 2024-08-20T23:12:20.6674781Z With the provided path, there will be 1 file uploaded 2024-08-20T23:12:20.6675398Z Uploading to s3 prefix: pytorch/pytorch/10479310721/1/artifact 2024-08-20T23:12:20.6731595Z Starting upload of logs-test-dynamic_aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_29026300668.zip 2024-08-20T23:12:20.7788166Z Finished upload of logs-test-dynamic_aot_eager_timm-2-2-linux.g5.4xlarge.nvidia.gpu_29026300668.zip 2024-08-20T23:12:20.8060623Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-08-20T23:12:20.8061257Z with: 2024-08-20T23:12:20.8061548Z s3-bucket: gha-artifacts 2024-08-20T23:12:20.8062000Z s3-prefix: pytorch/pytorch/10479310721/1/artifact 2024-08-20T23:12:20.8062476Z retention-days: 14 2024-08-20T23:12:20.8062809Z if-no-files-found: ignore 2024-08-20T23:12:20.8063170Z path: debug-*.zip 2024-08-20T23:12:20.8063491Z name: artifact 2024-08-20T23:12:20.8063791Z region: us-east-1 2024-08-20T23:12:20.8064095Z env: 2024-08-20T23:12:20.8064370Z GIT_DEFAULT_BRANCH: main 2024-08-20T23:12:20.8064962Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T23:12:20.8065688Z DOCKER_CONTAINER_ID: 1d3d385f17f1d6c37db5afe728565c3b90add28f14b10207341c2ca1b3f122f7 2024-08-20T23:12:20.8066325Z ##[endgroup] 2024-08-20T23:12:21.1579602Z No files were found with the provided path: debug-*.zip. No artifacts will be uploaded. 2024-08-20T23:12:21.1851736Z ##[group]Run # shellcheck disable=SC2156 2024-08-20T23:12:21.1852224Z # shellcheck disable=SC2156 2024-08-20T23:12:21.1853033Z find . -iname "core.[1-9]*" -exec docker exec "${DOCKER_CONTAINER_ID}" sh -c "gdb python {} -ex 'bt' -ex 'q'" \; 2024-08-20T23:12:21.1862848Z shell: /usr/bin/bash -e {0} 2024-08-20T23:12:21.1863200Z env: 2024-08-20T23:12:21.1863480Z GIT_DEFAULT_BRANCH: main 2024-08-20T23:12:21.1863933Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T23:12:21.1864738Z DOCKER_CONTAINER_ID: 1d3d385f17f1d6c37db5afe728565c3b90add28f14b10207341c2ca1b3f122f7 2024-08-20T23:12:21.1865373Z ##[endgroup] 2024-08-20T23:12:21.4473956Z ##[group]Run pytorch/test-infra/.github/actions/teardown-linux@main 2024-08-20T23:12:21.4474527Z with: 2024-08-20T23:12:21.4474792Z env: 2024-08-20T23:12:21.4475071Z GIT_DEFAULT_BRANCH: main 2024-08-20T23:12:21.4475520Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T23:12:21.4476258Z DOCKER_CONTAINER_ID: 1d3d385f17f1d6c37db5afe728565c3b90add28f14b10207341c2ca1b3f122f7 2024-08-20T23:12:21.4476898Z ##[endgroup] 2024-08-20T23:12:21.4496130Z ##[group]Run set -eou pipefail 2024-08-20T23:12:21.4496540Z set -eou pipefail 2024-08-20T23:12:21.4496898Z  2024-08-20T23:12:21.4497410Z echo "Holding runner for 2 hours until all ssh sessions have logged out" 2024-08-20T23:12:21.4498049Z for _ in $(seq 1440); do 2024-08-20T23:12:21.4498531Z  # Break if no ssh session exists anymore 2024-08-20T23:12:21.4499051Z  if [ "$(who)" = "" ]; then 2024-08-20T23:12:21.4499462Z  break 2024-08-20T23:12:21.4499808Z  fi 2024-08-20T23:12:21.4500111Z  echo "." 2024-08-20T23:12:21.4500448Z  sleep 5 2024-08-20T23:12:21.4500771Z done 2024-08-20T23:12:21.4509569Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T23:12:21.4510067Z env: 2024-08-20T23:12:21.4510353Z GIT_DEFAULT_BRANCH: main 2024-08-20T23:12:21.4510811Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T23:12:21.4511552Z DOCKER_CONTAINER_ID: 1d3d385f17f1d6c37db5afe728565c3b90add28f14b10207341c2ca1b3f122f7 2024-08-20T23:12:21.4512190Z ##[endgroup] 2024-08-20T23:12:21.4545092Z Holding runner for 2 hours until all ssh sessions have logged out 2024-08-20T23:12:21.4676509Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2024-08-20T23:12:21.4677266Z # ignore expansion of "docker ps -q" since it could be empty 2024-08-20T23:12:21.4677856Z # shellcheck disable=SC2046 2024-08-20T23:12:21.4678332Z docker stop $(docker ps -q) || true 2024-08-20T23:12:21.4678804Z # Prune all of the docker images 2024-08-20T23:12:21.4679260Z docker system prune -af 2024-08-20T23:12:21.4688096Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T23:12:21.4688597Z env: 2024-08-20T23:12:21.4688880Z GIT_DEFAULT_BRANCH: main 2024-08-20T23:12:21.4689337Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T23:12:21.4690079Z DOCKER_CONTAINER_ID: 1d3d385f17f1d6c37db5afe728565c3b90add28f14b10207341c2ca1b3f122f7 2024-08-20T23:12:21.4690906Z ##[endgroup] 2024-08-20T23:12:22.0644719Z 1d3d385f17f1 2024-08-20T23:12:23.5087545Z Deleted Containers: 2024-08-20T23:12:23.5088163Z 1d3d385f17f1d6c37db5afe728565c3b90add28f14b10207341c2ca1b3f122f7 2024-08-20T23:12:23.5088901Z 2024-08-20T23:12:34.4101524Z Deleted Images: 2024-08-20T23:12:34.4103732Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T23:12:34.4106669Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks@sha256:3a95d3a177465127ef6cd3b50787d6a050367070fd9063dbb688fad07a96b402 2024-08-20T23:12:34.4108540Z deleted: sha256:8fef7805cec6e829013a3d62f158b75bdc2f02cdfe3428c032ea017b488473bb 2024-08-20T23:12:34.4109494Z deleted: sha256:c2ce10014dd98f6abbfbf2265f9780a8204c2a7a27463e61ee565573a23d141d 2024-08-20T23:12:34.4110447Z deleted: sha256:ae249c0e6e6013bd6ffea2ca0b0160c015c9ebf7c03070bc2f983a9ff2415bf5 2024-08-20T23:12:34.4111440Z deleted: sha256:8a73883c1067c0e29ff128f553518682b47ed9707d2f35e7d5138e2caf029d61 2024-08-20T23:12:34.4112348Z deleted: sha256:9c040db729fa084584aaf5573082408a2196bc64e5952270c79dc610ed4680b6 2024-08-20T23:12:34.4132683Z deleted: sha256:17311eeeb8b71b16699880c0f646e185107496c4d41da5d23370603768ec030c 2024-08-20T23:12:34.4133578Z deleted: sha256:07cc10bece8501b1c8035d4385ad9e9867dd6e92fa32218a4dcb3e42af7e0411 2024-08-20T23:12:34.4134756Z deleted: sha256:f3e32d05099d1a3115a4722bc2e94a48752c3e965446773673808252671bb967 2024-08-20T23:12:34.4135621Z deleted: sha256:be7c3f41475e3e72ffe3ac2f92ab2f4cf49d5496b2aae738942ac3bb687d742c 2024-08-20T23:12:34.4136473Z deleted: sha256:4fcac490be825129b468cf458089f1fcf8fd56afc44ef4ab27c2eff41ab1ac90 2024-08-20T23:12:34.4137352Z deleted: sha256:31c66d80a2a4792897f267d363c0cf84fb821c5d4a275ab1636f778fd0284c08 2024-08-20T23:12:34.4138364Z deleted: sha256:8a8bcb6085e7e438e5533e8a5613e2ae5888543853568d023af3e2623a1593a9 2024-08-20T23:12:34.4139190Z deleted: sha256:2f6cb60029c79d11567b738f5bdbfb9cb1838cc0f194c4a5e6ae685178d2ed34 2024-08-20T23:12:34.4140022Z deleted: sha256:e546391804d3313f558e1ac16e93cb29a417a92e4eccaf0d4bd12af3bbcf39e3 2024-08-20T23:12:34.4140834Z deleted: sha256:1623b2aa16f2bdc6b572f6799498d9a92fa8114d07c440599b17aea72e22f8b1 2024-08-20T23:12:34.4141987Z deleted: sha256:c0386ca58b7cb7afee015b7e58d2f70525eaf73d6da2cc63868b20e14b1f9497 2024-08-20T23:12:34.4142838Z deleted: sha256:dcbf534ff289186e246531925fed90f72516eb3d63663bad234d611cdc025d62 2024-08-20T23:12:34.4143661Z deleted: sha256:0bab537af579f56c9cd51c7073fd53635fffb424b363236e0de38a7dd0e60ae8 2024-08-20T23:12:34.4144481Z deleted: sha256:d85a852ae1ee027e2fc17240ed68b87957b0a6d210c9119752d8979a0dcd55cf 2024-08-20T23:12:34.4145395Z deleted: sha256:f3821d761b555362e44cf9a1447d8fd2d95b37d54aea67c7519cd9e5db0c4d7e 2024-08-20T23:12:34.4146223Z deleted: sha256:c05e84a545db5dfcb0847c73d2b0f4749fa67aabce05705632ff7f76c84d4688 2024-08-20T23:12:34.4147072Z deleted: sha256:27054eae7ca67b2bd5ca0fd3f4488bf5c5f78e95487d8c45616f3d753d48a8b5 2024-08-20T23:12:34.4147902Z deleted: sha256:9804139f6ae97796aaa993fe4b89ea0cf111eb4d30a79f4c87c339c2e1e04fa0 2024-08-20T23:12:34.4148713Z deleted: sha256:ad6ae2fc594aaa359ff4e287323836570454eb24dd162930655e414d1d77c6dd 2024-08-20T23:12:34.4149529Z deleted: sha256:9cfbb36e328af52a248853a46aab88e266c09e2b44a03e0a42194a031b9b9453 2024-08-20T23:12:34.4150358Z deleted: sha256:a8a842bd7f37b8d50b6d12d6f95f46bbba57953db466fcbde9ba522625f024ef 2024-08-20T23:12:34.4151187Z deleted: sha256:da9738654b3c86f89ebeed2560f1bae093f1219f1eff90b0394b7f211ecabd04 2024-08-20T23:12:34.4152008Z deleted: sha256:cc683bf0cb245394e0f568984b2dd4fce1b6a3a7fe7c44734bae1aa1caaa3251 2024-08-20T23:12:34.4152837Z deleted: sha256:965f220e71c7d1ec19aaf41b1529ab287beb9d86eb8482c4c14094485ab34475 2024-08-20T23:12:34.4153659Z deleted: sha256:da32ecec41a73ce7dd29464f90c7951510a18cd378753659a78cd7fabd10dc36 2024-08-20T23:12:34.4154728Z deleted: sha256:d828d187cee9ad48dbc3702fb61d359619dd8a1ed582878680b51686bf117e5a 2024-08-20T23:12:34.4155548Z deleted: sha256:712111f4b12ff8e2787597d5fdcb043bd0824e55ddd97f262ef550506ca195f0 2024-08-20T23:12:34.4156356Z deleted: sha256:a064eea405958ad14dc6c794e5df9fd1d4515424272801ec559d45a59317309a 2024-08-20T23:12:34.4157175Z deleted: sha256:e124382d136bd5e9a8b409ca79c1f1ef76458deaf444b1b2060d3fa99dbeb506 2024-08-20T23:12:34.4157999Z deleted: sha256:6e10fe757cc190a1b31b47010f4f7610e02cb1b4b438f190dcd301aa4fe2278e 2024-08-20T23:12:34.4158818Z deleted: sha256:4cea352e10f46ca4729f96ac6c4600fc53d4c36e7658c2e0f19f4f309cd4a2a7 2024-08-20T23:12:34.4159625Z deleted: sha256:518bba00fe1d0933053066d21cac0235c9fb485abbc41557ec184b293095c924 2024-08-20T23:12:34.4160449Z deleted: sha256:a64f9ca42e9f27ff2690c15a5c84312e6efaccad45668d9b496cb542165cfb5a 2024-08-20T23:12:34.4161274Z deleted: sha256:096ea0fa14a6c420658f5276b8a8f5d264c0de7e18161ceda2cfc2f4a92cd9bf 2024-08-20T23:12:34.4162100Z deleted: sha256:6f91c94ce6e3f8034c91c66ee25c66a3d85dba9d813b749bd6d2000942a99edc 2024-08-20T23:12:34.4162922Z deleted: sha256:8f8d255eeae546cead8f9a94d237fa57a99940c0f5d51bc29a9d41c7df9cffd9 2024-08-20T23:12:34.4163759Z deleted: sha256:fe05276f4a49f91eef56bfbc3da87cfff5eb116a827fa2d30efe42ce1c134b40 2024-08-20T23:12:34.4164585Z deleted: sha256:5f83cd75d0669c813d4f58978c92e14305cd8f6a07eb9a60665a583460fa7b59 2024-08-20T23:12:34.4165394Z deleted: sha256:8f7ab6366169d39d8953129f650f1927d2fb1328b3f11e2fd9076adb5f46b93a 2024-08-20T23:12:34.4166309Z deleted: sha256:4146cfd5dba0f5308954749f98596b14a1d8f6d23bd93f7ad86c6c3d72239328 2024-08-20T23:12:34.4167168Z deleted: sha256:c6d83cb9ccc606ff63bb3c4d5a5e1ff1450c619b5aae494303a94ae25971cca0 2024-08-20T23:12:34.4168017Z deleted: sha256:71e037e0a3e0963c4565534a7387c082afcb04475d3ac629acf7a0ab2f49fadc 2024-08-20T23:12:34.4168822Z deleted: sha256:4b31135c564686bdaf23262b901237880aea635655721cc7e8c95dc42b05e06d 2024-08-20T23:12:34.4169633Z deleted: sha256:d09bd5c2f35cedcb846543941ee64ce1f684b52e4285696c93b3fb2032da8579 2024-08-20T23:12:34.4170694Z deleted: sha256:4de7fb7d4fc22212aae5fc1ceb637526916d0cced240d7c93d5edd6b0ea28013 2024-08-20T23:12:34.4171711Z deleted: sha256:69890e3e82746e10aff2f1084f11afb4b95a4a6c26b30f64b7001bc0a5fe32bf 2024-08-20T23:12:34.4172515Z deleted: sha256:0156df53b3224e645336ea52b4bb816f1e8d8c9b591748cd645e5e5649fa507b 2024-08-20T23:12:34.4173321Z deleted: sha256:0664624cb9cc4a386f31bf49919a8d8a11d9fea428d05585d9e6228f754bc7cd 2024-08-20T23:12:34.4174143Z deleted: sha256:8c2ddd5fa535c768c058a23f5cc4b6c64cdd71bb7458491282aabc7f7bb94d69 2024-08-20T23:12:34.4174971Z deleted: sha256:8dd03dbe0e1c5f47dd333074dff4bd00415f2f63727a65bf17866774e2ebbd0d 2024-08-20T23:12:34.4175797Z deleted: sha256:3c56b63e094bd18fad9da7a541d537210bca3b730c590d3641213259f6908d6f 2024-08-20T23:12:34.4176612Z deleted: sha256:51484fef07bd1266d4d6ff3d767751172660fc4cc6a1ffe883523a63c985e31e 2024-08-20T23:12:34.4177437Z deleted: sha256:03e83c94023982ab7dd8dc65a6df2024e342f1b760c91ec7a680ee45824869c7 2024-08-20T23:12:34.4178277Z deleted: sha256:58440ab3e8175b5de94a76485c8689a6dc186015475ebf4b386ebba309c5da34 2024-08-20T23:12:34.4179097Z deleted: sha256:9a980f3383e8aa511f0ef68982cb6dfc53b38d1ac8c3d673cb3ba3d45158c91e 2024-08-20T23:12:34.4179924Z deleted: sha256:cb0269c9cf1c47b6c4188ca7be4db261b5d3fc4b4a5153629e222dba7b1f9f98 2024-08-20T23:12:34.4180751Z deleted: sha256:41f1ba870cdffc05e0bf8d87b640fb9d4c153d7f4f3b775f37f94e9f3d584aad 2024-08-20T23:12:34.4181580Z deleted: sha256:7b502ab352f48e8b6eb5e6824a29f308952a5ee7c7d987562e1df7e47639d7f1 2024-08-20T23:12:34.4182392Z deleted: sha256:6ba5217e18738660e6ca8b7a7ec88845e70b0fd781301520bf46c71d99df3144 2024-08-20T23:12:34.4183205Z deleted: sha256:dd5a1c233594780163726bdbbf5de00f7b6b8dca1dace8a001340714c54baedb 2024-08-20T23:12:34.4184019Z deleted: sha256:c27f0db27da73e01f67f6cb78d10f355e350d829479ba4351d82055bb29f6597 2024-08-20T23:12:34.4184927Z deleted: sha256:4e3ce3c854f35c08be3dd95e0d6e718512a885e4614291d7d8b7cd23f48b7dd8 2024-08-20T23:12:34.4185900Z deleted: sha256:c2d6fb088bbec16e60cf0ad74b016f7287c92e659ec2db01271bc309b4dc6d83 2024-08-20T23:12:34.4186777Z deleted: sha256:35a033279d5c9bd6b862bfa9331d8fcbf98bbaf778a778fabc882384db9204f8 2024-08-20T23:12:34.4187595Z deleted: sha256:ab9b00c496073d62e69e032178858d3d6d4c4bab9e87065d3785c6da57351d00 2024-08-20T23:12:34.4188388Z deleted: sha256:7ed947299e109c2459de6e240d86f049c30f93f2380659ce441d8737b8cd065f 2024-08-20T23:12:34.4189210Z deleted: sha256:410d5a7f7a9a1cb4551c106b9cc728a9dcff598f9be231a351ce6a0a33f81e64 2024-08-20T23:12:34.4190037Z deleted: sha256:5f0021bb56efa14bb93978c01513e2a1187ba30e69bdb0546d0ef39b30873f88 2024-08-20T23:12:34.4190851Z deleted: sha256:c1601aa97eb84151c14da3aeea351201bd99144d36d66b397f6555d80245d86d 2024-08-20T23:12:34.4191675Z deleted: sha256:72af05a89be22accdc1ca5d66dcbbb33993a9ef5997f849df1d4ba4c48049f25 2024-08-20T23:12:34.4192499Z deleted: sha256:38b90c9663dcaa2bc57a4dd3008298e7ea93e9535fa42312b4dc4246e7491af9 2024-08-20T23:12:34.4193334Z deleted: sha256:bda61b6cefb3ec8eeb74fef1ca1c7f9a5845fe5e8f07b8123323e897425d5c29 2024-08-20T23:12:34.4194170Z deleted: sha256:5a18e1aa877074529a84cbddf19f8d5403787823378ceae6b72fb62f78d43037 2024-08-20T23:12:34.4194975Z deleted: sha256:6c3e7df31590f02f10cb71fc4eb27653e9b428df2e6e5421a455b062bd2e39f9 2024-08-20T23:12:34.4195465Z 2024-08-20T23:12:34.4195620Z Total reclaimed space: 44.86GB 2024-08-20T23:12:34.4264909Z Post job cleanup. 2024-08-20T23:12:34.4316658Z Post job cleanup. 2024-08-20T23:12:34.5203566Z [command]/usr/bin/git version 2024-08-20T23:12:34.5253750Z git version 2.40.1 2024-08-20T23:12:34.5294144Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/884fd2a8-e296-4524-9c9b-f2f92d2d5c99' before making global git config changes 2024-08-20T23:12:34.5295364Z Adding repository directory to the temporary git global config as a safe directory 2024-08-20T23:12:34.5300064Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-20T23:12:34.5349575Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2024-08-20T23:12:34.5396310Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2024-08-20T23:12:34.5768496Z Entering 'android/libs/fbjni' 2024-08-20T23:12:34.5838350Z Entering 'third_party/FP16' 2024-08-20T23:12:34.5906985Z Entering 'third_party/FXdiv' 2024-08-20T23:12:34.5974381Z Entering 'third_party/NNPACK' 2024-08-20T23:12:34.6042100Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T23:12:34.6110417Z Entering 'third_party/XNNPACK' 2024-08-20T23:12:34.6193889Z Entering 'third_party/benchmark' 2024-08-20T23:12:34.6261331Z Entering 'third_party/cpp-httplib' 2024-08-20T23:12:34.6333605Z Entering 'third_party/cpuinfo' 2024-08-20T23:12:34.6402914Z Entering 'third_party/cudnn_frontend' 2024-08-20T23:12:34.6472547Z Entering 'third_party/cutlass' 2024-08-20T23:12:34.6546747Z Entering 'third_party/eigen' 2024-08-20T23:12:34.6616049Z Entering 'third_party/fbgemm' 2024-08-20T23:12:34.6685830Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T23:12:34.6752775Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T23:12:34.6819187Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T23:12:34.6895653Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T23:12:34.6962867Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T23:12:34.7031577Z Entering 'third_party/flatbuffers' 2024-08-20T23:12:34.7103085Z Entering 'third_party/fmt' 2024-08-20T23:12:34.7171966Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T23:12:34.7240846Z Entering 'third_party/gloo' 2024-08-20T23:12:34.7309982Z Entering 'third_party/googletest' 2024-08-20T23:12:34.7380185Z Entering 'third_party/ideep' 2024-08-20T23:12:34.7446219Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T23:12:34.7522739Z Entering 'third_party/ittapi' 2024-08-20T23:12:34.7592054Z Entering 'third_party/kineto' 2024-08-20T23:12:34.7659062Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T23:12:34.7724388Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T23:12:34.7792834Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T23:12:34.7861659Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T23:12:34.7929879Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T23:12:34.7995333Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T23:12:34.8066716Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T23:12:34.8134575Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T23:12:34.8201888Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T23:12:34.8269939Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T23:12:34.8340565Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T23:12:34.8410377Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T23:12:34.8479937Z Entering 'third_party/mimalloc' 2024-08-20T23:12:34.8550458Z Entering 'third_party/nccl/nccl' 2024-08-20T23:12:34.8620458Z Entering 'third_party/nlohmann' 2024-08-20T23:12:34.8690729Z Entering 'third_party/onnx' 2024-08-20T23:12:34.8773344Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T23:12:34.8841194Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T23:12:34.8914220Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T23:12:34.8982904Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T23:12:34.9048053Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T23:12:34.9113629Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T23:12:34.9179217Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T23:12:34.9245566Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T23:12:34.9311409Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T23:12:34.9376527Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T23:12:34.9440112Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T23:12:34.9510045Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T23:12:34.9579384Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T23:12:34.9666592Z Entering 'third_party/pocketfft' 2024-08-20T23:12:34.9735077Z Entering 'third_party/protobuf' 2024-08-20T23:12:34.9804693Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T23:12:34.9871398Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T23:12:34.9946480Z Entering 'third_party/psimd' 2024-08-20T23:12:35.0015302Z Entering 'third_party/pthreadpool' 2024-08-20T23:12:35.0083735Z Entering 'third_party/pybind11' 2024-08-20T23:12:35.0151972Z Entering 'third_party/python-peachpy' 2024-08-20T23:12:35.0221415Z Entering 'third_party/sleef' 2024-08-20T23:12:35.0289241Z Entering 'third_party/tensorpipe' 2024-08-20T23:12:35.0355321Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T23:12:35.0421857Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T23:12:35.0488452Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T23:12:35.0553581Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T23:12:35.0617266Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T23:12:35.0711091Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2024-08-20T23:12:35.0747035Z http.https://github.com/.extraheader 2024-08-20T23:12:35.0756906Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader 2024-08-20T23:12:35.0805320Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2024-08-20T23:12:35.1171957Z Entering 'android/libs/fbjni' 2024-08-20T23:12:35.1214813Z http.https://github.com/.extraheader 2024-08-20T23:12:35.1258481Z Entering 'third_party/FP16' 2024-08-20T23:12:35.1306335Z http.https://github.com/.extraheader 2024-08-20T23:12:35.1348760Z Entering 'third_party/FXdiv' 2024-08-20T23:12:35.1392906Z http.https://github.com/.extraheader 2024-08-20T23:12:35.1435604Z Entering 'third_party/NNPACK' 2024-08-20T23:12:35.1479121Z http.https://github.com/.extraheader 2024-08-20T23:12:35.1521797Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T23:12:35.1565765Z http.https://github.com/.extraheader 2024-08-20T23:12:35.1609568Z Entering 'third_party/XNNPACK' 2024-08-20T23:12:35.1652763Z http.https://github.com/.extraheader 2024-08-20T23:12:35.1712449Z Entering 'third_party/benchmark' 2024-08-20T23:12:35.1755562Z http.https://github.com/.extraheader 2024-08-20T23:12:35.1799030Z Entering 'third_party/cpp-httplib' 2024-08-20T23:12:35.1841876Z http.https://github.com/.extraheader 2024-08-20T23:12:35.1885023Z Entering 'third_party/cpuinfo' 2024-08-20T23:12:35.1928454Z http.https://github.com/.extraheader 2024-08-20T23:12:35.1975126Z Entering 'third_party/cudnn_frontend' 2024-08-20T23:12:35.2018320Z http.https://github.com/.extraheader 2024-08-20T23:12:35.2062168Z Entering 'third_party/cutlass' 2024-08-20T23:12:35.2104935Z http.https://github.com/.extraheader 2024-08-20T23:12:35.2155417Z Entering 'third_party/eigen' 2024-08-20T23:12:35.2199320Z http.https://github.com/.extraheader 2024-08-20T23:12:35.2245328Z Entering 'third_party/fbgemm' 2024-08-20T23:12:35.2289229Z http.https://github.com/.extraheader 2024-08-20T23:12:35.2333960Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T23:12:35.2377505Z http.https://github.com/.extraheader 2024-08-20T23:12:35.2420272Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T23:12:35.2462215Z http.https://github.com/.extraheader 2024-08-20T23:12:35.2505948Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T23:12:35.2547663Z http.https://github.com/.extraheader 2024-08-20T23:12:35.2604497Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T23:12:35.2646622Z http.https://github.com/.extraheader 2024-08-20T23:12:35.2693650Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T23:12:35.2735459Z http.https://github.com/.extraheader 2024-08-20T23:12:35.2781277Z Entering 'third_party/flatbuffers' 2024-08-20T23:12:35.2825135Z http.https://github.com/.extraheader 2024-08-20T23:12:35.2871942Z Entering 'third_party/fmt' 2024-08-20T23:12:35.2914739Z http.https://github.com/.extraheader 2024-08-20T23:12:35.2957828Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T23:12:35.3001627Z http.https://github.com/.extraheader 2024-08-20T23:12:35.3044492Z Entering 'third_party/gloo' 2024-08-20T23:12:35.3093209Z http.https://github.com/.extraheader 2024-08-20T23:12:35.3136793Z Entering 'third_party/googletest' 2024-08-20T23:12:35.3185192Z http.https://github.com/.extraheader 2024-08-20T23:12:35.3229143Z Entering 'third_party/ideep' 2024-08-20T23:12:35.3275614Z http.https://github.com/.extraheader 2024-08-20T23:12:35.3316972Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T23:12:35.3363734Z http.https://github.com/.extraheader 2024-08-20T23:12:35.3415968Z Entering 'third_party/ittapi' 2024-08-20T23:12:35.3459019Z http.https://github.com/.extraheader 2024-08-20T23:12:35.3502605Z Entering 'third_party/kineto' 2024-08-20T23:12:35.3545969Z http.https://github.com/.extraheader 2024-08-20T23:12:35.3588449Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T23:12:35.3636606Z http.https://github.com/.extraheader 2024-08-20T23:12:35.3682224Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T23:12:35.3725065Z http.https://github.com/.extraheader 2024-08-20T23:12:35.3775175Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T23:12:35.3818205Z http.https://github.com/.extraheader 2024-08-20T23:12:35.3863105Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T23:12:35.3906027Z http.https://github.com/.extraheader 2024-08-20T23:12:35.3950292Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T23:12:35.3993436Z http.https://github.com/.extraheader 2024-08-20T23:12:35.4035957Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T23:12:35.4079852Z http.https://github.com/.extraheader 2024-08-20T23:12:35.4127249Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T23:12:35.4175533Z http.https://github.com/.extraheader 2024-08-20T23:12:35.4219010Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T23:12:35.4261587Z http.https://github.com/.extraheader 2024-08-20T23:12:35.4305734Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T23:12:35.4348659Z http.https://github.com/.extraheader 2024-08-20T23:12:35.4397009Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T23:12:35.4439629Z http.https://github.com/.extraheader 2024-08-20T23:12:35.4487498Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T23:12:35.4530715Z http.https://github.com/.extraheader 2024-08-20T23:12:35.4574337Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T23:12:35.4616480Z http.https://github.com/.extraheader 2024-08-20T23:12:35.4663075Z Entering 'third_party/mimalloc' 2024-08-20T23:12:35.4708140Z http.https://github.com/.extraheader 2024-08-20T23:12:35.4752308Z Entering 'third_party/nccl/nccl' 2024-08-20T23:12:35.4796581Z http.https://github.com/.extraheader 2024-08-20T23:12:35.4839989Z Entering 'third_party/nlohmann' 2024-08-20T23:12:35.4883422Z http.https://github.com/.extraheader 2024-08-20T23:12:35.4928075Z Entering 'third_party/onnx' 2024-08-20T23:12:35.4972011Z http.https://github.com/.extraheader 2024-08-20T23:12:35.5030097Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T23:12:35.5073064Z http.https://github.com/.extraheader 2024-08-20T23:12:35.5116799Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T23:12:35.5159881Z http.https://github.com/.extraheader 2024-08-20T23:12:35.5208158Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T23:12:35.5251704Z http.https://github.com/.extraheader 2024-08-20T23:12:35.5297178Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T23:12:35.5339322Z http.https://github.com/.extraheader 2024-08-20T23:12:35.5382740Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T23:12:35.5424913Z http.https://github.com/.extraheader 2024-08-20T23:12:35.5468140Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T23:12:35.5515613Z http.https://github.com/.extraheader 2024-08-20T23:12:35.5558063Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T23:12:35.5601406Z http.https://github.com/.extraheader 2024-08-20T23:12:35.5645769Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T23:12:35.5687724Z http.https://github.com/.extraheader 2024-08-20T23:12:35.5730345Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T23:12:35.5773272Z http.https://github.com/.extraheader 2024-08-20T23:12:35.5816145Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T23:12:35.5858595Z http.https://github.com/.extraheader 2024-08-20T23:12:35.5900274Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T23:12:35.5943057Z http.https://github.com/.extraheader 2024-08-20T23:12:35.5989303Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T23:12:35.6031206Z http.https://github.com/.extraheader 2024-08-20T23:12:35.6078405Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T23:12:35.6124963Z http.https://github.com/.extraheader 2024-08-20T23:12:35.6189546Z Entering 'third_party/pocketfft' 2024-08-20T23:12:35.6232922Z http.https://github.com/.extraheader 2024-08-20T23:12:35.6275338Z Entering 'third_party/protobuf' 2024-08-20T23:12:35.6323599Z http.https://github.com/.extraheader 2024-08-20T23:12:35.6367663Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T23:12:35.6411799Z http.https://github.com/.extraheader 2024-08-20T23:12:35.6454667Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T23:12:35.6496709Z http.https://github.com/.extraheader 2024-08-20T23:12:35.6543045Z Entering 'third_party/psimd' 2024-08-20T23:12:35.6589565Z http.https://github.com/.extraheader 2024-08-20T23:12:35.6632126Z Entering 'third_party/pthreadpool' 2024-08-20T23:12:35.6676173Z http.https://github.com/.extraheader 2024-08-20T23:12:35.6722899Z Entering 'third_party/pybind11' 2024-08-20T23:12:35.6766453Z http.https://github.com/.extraheader 2024-08-20T23:12:35.6812966Z Entering 'third_party/python-peachpy' 2024-08-20T23:12:35.6856439Z http.https://github.com/.extraheader 2024-08-20T23:12:35.6901629Z Entering 'third_party/sleef' 2024-08-20T23:12:35.6945113Z http.https://github.com/.extraheader 2024-08-20T23:12:35.6992882Z Entering 'third_party/tensorpipe' 2024-08-20T23:12:35.7035159Z http.https://github.com/.extraheader 2024-08-20T23:12:35.7077612Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T23:12:35.7119495Z http.https://github.com/.extraheader 2024-08-20T23:12:35.7162480Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T23:12:35.7204833Z http.https://github.com/.extraheader 2024-08-20T23:12:35.7247564Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T23:12:35.7289727Z http.https://github.com/.extraheader 2024-08-20T23:12:35.7334115Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T23:12:35.7376160Z http.https://github.com/.extraheader 2024-08-20T23:12:35.7417762Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T23:12:35.7459960Z http.https://github.com/.extraheader 2024-08-20T23:12:35.7618155Z A job completed hook has been configured by the self-hosted runner administrator 2024-08-20T23:12:35.7639622Z ##[group]Run '/home/ec2-user/runner-scripts/after_job.sh' 2024-08-20T23:12:35.7647663Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T23:12:35.7648186Z ##[endgroup] 2024-08-20T23:12:42.6912478Z Cleaning up orphan processes