2024-12-18T00:16:23.4247361Z Current runner version: '2.321.0' 2024-12-18T00:16:23.4254508Z Runner name: 'i-028bf30e8c4fafc3a' 2024-12-18T00:16:23.4255554Z Runner group name: 'Default' 2024-12-18T00:16:23.4256785Z Machine name: 'ip-10-0-40-191' 2024-12-18T00:16:23.4262234Z ##[group]GITHUB_TOKEN Permissions 2024-12-18T00:16:23.4265471Z Actions: read 2024-12-18T00:16:23.4266214Z Attestations: read 2024-12-18T00:16:23.4267073Z Checks: read 2024-12-18T00:16:23.4267743Z Contents: read 2024-12-18T00:16:23.4268449Z Deployments: read 2024-12-18T00:16:23.4269233Z Discussions: read 2024-12-18T00:16:23.4269961Z Issues: read 2024-12-18T00:16:23.4270765Z Metadata: read 2024-12-18T00:16:23.4271501Z Packages: read 2024-12-18T00:16:23.4272224Z Pages: read 2024-12-18T00:16:23.4272949Z PullRequests: read 2024-12-18T00:16:23.4273754Z RepositoryProjects: read 2024-12-18T00:16:23.4274551Z SecurityEvents: read 2024-12-18T00:16:23.4275271Z Statuses: read 2024-12-18T00:16:23.4276019Z ##[endgroup] 2024-12-18T00:16:23.4279627Z Secret source: Actions 2024-12-18T00:16:23.4280810Z Prepare workflow directory 2024-12-18T00:16:23.4957002Z Prepare all required actions 2024-12-18T00:16:23.4996255Z Getting action download info 2024-12-18T00:16:23.7151619Z Download action repository 'pytorch/test-infra@release/2.6' (SHA:eb0adf5a84668865394af69e26428b32c8105c1c) 2024-12-18T00:16:25.5102799Z Download action repository 'pytorch/pytorch@release/2.6' (SHA:0cdf8b1d09254cfda66191d1bd01e3041c3c76f7) 2024-12-18T00:16:39.9956443Z Download action repository 'aws-actions/configure-aws-credentials@v3' (SHA:50ac8dd1e1b10d09dac7b8727528b91bed831ac0) 2024-12-18T00:16:40.2138911Z Download action repository 'seemethere/upload-artifact-s3@v5' (SHA:baba72d0712b404f646cebe0730933554ebce96a) 2024-12-18T00:16:40.5152017Z Getting action download info 2024-12-18T00:16:40.6336304Z Download action repository 'malfet/checkout@silent-checkout' (SHA:e07af140b3ccefc05679e3755b9db68f4ee4589c) 2024-12-18T00:16:40.9623744Z Getting action download info 2024-12-18T00:16:41.0771108Z Download action repository 'nick-fields/retry@v3.0.0' (SHA:7152eba30c6575329ac0576536151aca5a72780e) 2024-12-18T00:16:41.2637845Z Getting action download info 2024-12-18T00:16:41.3986777Z Download action repository 'nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482' (SHA:3e91a01664abd3c5cd539100d10d33b9c5b68482) 2024-12-18T00:16:41.5560669Z Getting action download info 2024-12-18T00:16:41.6694543Z Download action repository 'pytorch/test-infra@main' (SHA:a07505a74641a4ff5123d635defac481ef28ef1e) 2024-12-18T00:16:42.9247078Z Uses: pytorch/pytorch/.github/workflows/_linux-test.yml@refs/heads/release/2.6 (0cdf8b1d09254cfda66191d1bd01e3041c3c76f7) 2024-12-18T00:16:42.9249058Z ##[group] Inputs 2024-12-18T00:16:42.9249424Z build-environment: linux-focal-cuda12.4-py3.10-gcc9-sm86 2024-12-18T00:16:42.9251092Z test-matrix: {"include": [{"config": "inductor", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_distributed", "shard": 1, "num_shards": 1, "runner": "linux.g5.12xlarge.nvidia.gpu"}, {"config": "inductor_cpp_wrapper", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}]} 2024-12-18T00:16:42.9253149Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:16:42.9254045Z sync-tag: 2024-12-18T00:16:42.9254801Z timeout-minutes: 240 2024-12-18T00:16:42.9255071Z use-gha: 2024-12-18T00:16:42.9255289Z dashboard-tag: 2024-12-18T00:16:42.9255542Z s3-bucket: gha-artifacts 2024-12-18T00:16:42.9255815Z aws-role-to-assume: 2024-12-18T00:16:42.9256361Z disable-monitor: false 2024-12-18T00:16:42.9256640Z ##[endgroup] 2024-12-18T00:16:42.9257159Z Complete job name: unit-test / cuda12.4-py3.10-gcc9-sm86 / test (inductor_cpp_wrapper, 1, 1, linux.g5.4xlarge.nvidia.gpu) 2024-12-18T00:16:42.9786657Z A job started hook has been configured by the self-hosted runner administrator 2024-12-18T00:16:42.9888468Z ##[group]Run '/home/ec2-user/runner-scripts/before_job.sh' 2024-12-18T00:16:42.9899382Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:16:42.9900043Z ##[endgroup] 2024-12-18T00:16:45.0008837Z Runner Type: linux.g5.4xlarge.nvidia.gpu 2024-12-18T00:16:45.0009328Z Instance Type: g5.4xlarge 2024-12-18T00:16:45.0009596Z AMI Name: unknown 2024-12-18T00:16:45.0049336Z AMI ID: ami-0fff1b9a61dec8a5f 2024-12-18T00:16:50.8730700Z ##[group]Run pytorch/test-infra/.github/actions/setup-ssh@release/2.6 2024-12-18T00:16:50.8731146Z with: 2024-12-18T00:16:50.8731744Z github-secret: *** 2024-12-18T00:16:50.8732425Z instructions: All testing is done inside the container, to start an interactive session run: docker exec -it $(docker container ps --format '{{.ID}}') bash 2024-12-18T00:16:50.8733160Z activate-with-label: false 2024-12-18T00:16:50.8733442Z label: with-ssh 2024-12-18T00:16:50.8733685Z remove-existing-keys: true 2024-12-18T00:16:50.8733981Z fail-silently: true 2024-12-18T00:16:50.8734221Z env: 2024-12-18T00:16:50.8734434Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:16:50.8734700Z ##[endgroup] 2024-12-18T00:16:50.9959085Z Please see https://github.com/pytorch/pytorch/wiki/Debugging-using-with-ssh-for-Github-Actions for more info. 2024-12-18T00:16:50.9960535Z Not on pull request and ciflow reference could not be extracted, skipping adding ssh keys 2024-12-18T00:16:51.0114442Z ##[group]Run pytorch/pytorch/.github/actions/checkout-pytorch@release/2.6 2024-12-18T00:16:51.0114902Z with: 2024-12-18T00:16:51.0115108Z no-sudo: true 2024-12-18T00:16:51.0115384Z submodules: recursive 2024-12-18T00:16:51.0115643Z fetch-depth: 0 2024-12-18T00:16:51.0115876Z env: 2024-12-18T00:16:51.0116085Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:16:51.0116349Z ##[endgroup] 2024-12-18T00:16:51.0232694Z ##[group]Run echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2024-12-18T00:16:51.0233672Z echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2024-12-18T00:16:51.0243077Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:16:51.0243455Z env: 2024-12-18T00:16:51.0243682Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:16:51.0243942Z ##[endgroup] 2024-12-18T00:16:51.0349726Z ##[group]Run retry () { 2024-12-18T00:16:51.0350030Z retry () { 2024-12-18T00:16:51.0350388Z  $* || (sleep 1 && $*) || (sleep 2 && $*) || (sleep 4 && $*) || (sleep 8 && $*) 2024-12-18T00:16:51.0350828Z } 2024-12-18T00:16:51.0351072Z echo "${GITHUB_WORKSPACE}" 2024-12-18T00:16:51.0351400Z if [ -z "${NO_SUDO}" ]; then 2024-12-18T00:16:51.0351750Z  retry sudo rm -rf "${GITHUB_WORKSPACE}" 2024-12-18T00:16:51.0352077Z else 2024-12-18T00:16:51.0352340Z  retry rm -rf "${GITHUB_WORKSPACE}" 2024-12-18T00:16:51.0352656Z fi 2024-12-18T00:16:51.0352910Z mkdir "${GITHUB_WORKSPACE}" 2024-12-18T00:16:51.0361703Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:16:51.0362082Z env: 2024-12-18T00:16:51.0362299Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:16:51.0362562Z NO_SUDO: true 2024-12-18T00:16:51.0362793Z ##[endgroup] 2024-12-18T00:16:51.0392373Z /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-12-18T00:16:55.6285850Z ##[group]Run malfet/checkout@silent-checkout 2024-12-18T00:16:55.6286182Z with: 2024-12-18T00:16:55.6286438Z ref: 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:16:55.6286772Z fetch-depth: 0 2024-12-18T00:16:55.6287016Z submodules: recursive 2024-12-18T00:16:55.6287270Z quiet-checkout: true 2024-12-18T00:16:55.6287543Z repository: pytorch/pytorch 2024-12-18T00:16:55.6287914Z token: *** 2024-12-18T00:16:55.6288140Z ssh-strict: true 2024-12-18T00:16:55.6288397Z persist-credentials: true 2024-12-18T00:16:55.6288668Z clean: true 2024-12-18T00:16:55.6289159Z sparse-checkout-cone-mode: true 2024-12-18T00:16:55.6289454Z lfs: false 2024-12-18T00:16:55.6289686Z set-safe-directory: true 2024-12-18T00:16:55.6289954Z env: 2024-12-18T00:16:55.6290162Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:16:55.6290418Z ##[endgroup] 2024-12-18T00:16:55.7228921Z Syncing repository: pytorch/pytorch 2024-12-18T00:16:55.7230833Z ##[group]Getting Git version info 2024-12-18T00:16:55.7231608Z Working directory is '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2024-12-18T00:16:55.7232610Z [command]/usr/bin/git version 2024-12-18T00:16:55.7233061Z git version 2.40.1 2024-12-18T00:16:55.7249594Z ##[endgroup] 2024-12-18T00:16:55.7264558Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/2e03873b-af1b-4d42-a2db-b0b2c1a6aace' before making global git config changes 2024-12-18T00:16:55.7265493Z Adding repository directory to the temporary git global config as a safe directory 2024-12-18T00:16:55.7268800Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-12-18T00:16:55.7301449Z Deleting the contents of '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2024-12-18T00:16:55.7305083Z ##[group]Initializing the repository 2024-12-18T00:16:55.7308252Z [command]/usr/bin/git init /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-12-18T00:16:55.7339339Z hint: Using 'master' as the name for the initial branch. This default branch name 2024-12-18T00:16:55.7340052Z hint: is subject to change. To configure the initial branch name to use in all 2024-12-18T00:16:55.7340608Z hint: of your new repositories, which will suppress this warning, call: 2024-12-18T00:16:55.7341176Z hint: 2024-12-18T00:16:55.7341479Z hint: git config --global init.defaultBranch 2024-12-18T00:16:55.7341831Z hint: 2024-12-18T00:16:55.7342171Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-12-18T00:16:55.7342732Z hint: 'development'. The just-created branch can be renamed via this command: 2024-12-18T00:16:55.7343190Z hint: 2024-12-18T00:16:55.7343423Z hint: git branch -m 2024-12-18T00:16:55.7345519Z Initialized empty Git repository in /home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/ 2024-12-18T00:16:55.7354560Z [command]/usr/bin/git remote add origin https://github.com/pytorch/pytorch 2024-12-18T00:16:55.7393693Z ##[endgroup] 2024-12-18T00:16:55.7394418Z ##[group]Disabling automatic garbage collection 2024-12-18T00:16:55.7397509Z [command]/usr/bin/git config --local gc.auto 0 2024-12-18T00:16:55.7425536Z ##[endgroup] 2024-12-18T00:16:55.7426184Z ##[group]Setting up auth 2024-12-18T00:16:55.7431425Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2024-12-18T00:16:55.7459795Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2024-12-18T00:16:55.7808755Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2024-12-18T00:16:55.7839369Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2024-12-18T00:16:55.8183078Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic *** 2024-12-18T00:16:55.8228452Z ##[endgroup] 2024-12-18T00:16:55.8229143Z ##[group]Fetching the repository 2024-12-18T00:16:55.8235209Z [command]/usr/bin/git -c protocol.version=2 fetch --prune --progress --no-recurse-submodules --quiet origin +refs/heads/*:refs/remotes/origin/* +refs/tags/*:refs/tags/* 2024-12-18T00:16:58.4272288Z remote: Enumerating objects: 1056419 2024-12-18T00:16:58.4273113Z remote: Enumerating objects: 1057269, done. 2024-12-18T00:16:58.4273764Z remote: Counting objects: 0% (1/850) 2024-12-18T00:16:58.4274323Z remote: Counting objects: 1% (9/850) 2024-12-18T00:16:58.4275635Z remote: Counting objects: 2% (17/850) 2024-12-18T00:16:58.4276223Z remote: Counting objects: 3% (26/850) 2024-12-18T00:16:58.4276961Z remote: Counting objects: 4% (34/850) 2024-12-18T00:16:58.4277605Z remote: Counting objects: 5% (43/850) 2024-12-18T00:16:58.4278199Z remote: Counting objects: 6% (51/850) 2024-12-18T00:16:58.4278843Z remote: Counting objects: 7% (60/850) 2024-12-18T00:16:58.4279498Z remote: Counting objects: 8% (68/850) 2024-12-18T00:16:58.4280147Z remote: Counting objects: 9% (77/850) 2024-12-18T00:16:58.4280811Z remote: Counting objects: 10% (85/850) 2024-12-18T00:16:58.4281418Z remote: Counting objects: 11% (94/850) 2024-12-18T00:16:58.4282006Z remote: Counting objects: 12% (102/850) 2024-12-18T00:16:58.4282654Z remote: Counting objects: 13% (111/850) 2024-12-18T00:16:58.4283221Z remote: Counting objects: 14% (119/850) 2024-12-18T00:16:58.4283793Z remote: Counting objects: 15% (128/850) 2024-12-18T00:16:58.4284188Z remote: Counting objects: 16% (136/850) 2024-12-18T00:16:58.4284700Z remote: Counting objects: 17% (145/850) 2024-12-18T00:16:58.4285218Z remote: Counting objects: 18% (153/850) 2024-12-18T00:16:58.4285572Z remote: Counting objects: 19% (162/850) 2024-12-18T00:16:58.4286182Z remote: Counting objects: 20% (170/850) 2024-12-18T00:16:58.4286603Z remote: Counting objects: 21% (179/850) 2024-12-18T00:16:58.4286956Z remote: Counting objects: 22% (187/850) 2024-12-18T00:16:58.4287306Z remote: Counting objects: 23% (196/850) 2024-12-18T00:16:58.4287649Z remote: Counting objects: 24% (204/850) 2024-12-18T00:16:58.4288005Z remote: Counting objects: 25% (213/850) 2024-12-18T00:16:58.4288360Z remote: Counting objects: 26% (221/850) 2024-12-18T00:16:58.4288793Z remote: Counting objects: 27% (230/850) 2024-12-18T00:16:58.4289155Z remote: Counting objects: 28% (238/850) 2024-12-18T00:16:58.4289502Z remote: Counting objects: 29% (247/850) 2024-12-18T00:16:58.4289857Z remote: Counting objects: 30% (255/850) 2024-12-18T00:16:58.4290209Z remote: Counting objects: 31% (264/850) 2024-12-18T00:16:58.4290566Z remote: Counting objects: 32% (272/850) 2024-12-18T00:16:58.4290923Z remote: Counting objects: 33% (281/850) 2024-12-18T00:16:58.4291280Z remote: Counting objects: 34% (289/850) 2024-12-18T00:16:58.4291624Z remote: Counting objects: 35% (298/850) 2024-12-18T00:16:58.4291980Z remote: Counting objects: 36% (306/850) 2024-12-18T00:16:58.4292340Z remote: Counting objects: 37% (315/850) 2024-12-18T00:16:58.4292691Z remote: Counting objects: 38% (323/850) 2024-12-18T00:16:58.4293042Z remote: Counting objects: 39% (332/850) 2024-12-18T00:16:58.4293386Z remote: Counting objects: 40% (340/850) 2024-12-18T00:16:58.4293742Z remote: Counting objects: 41% (349/850) 2024-12-18T00:16:58.4294107Z remote: Counting objects: 42% (357/850) 2024-12-18T00:16:58.4294459Z remote: Counting objects: 43% (366/850) 2024-12-18T00:16:58.4294810Z remote: Counting objects: 44% (374/850) 2024-12-18T00:16:58.4295161Z remote: Counting objects: 45% (383/850) 2024-12-18T00:16:58.4295520Z remote: Counting objects: 46% (391/850) 2024-12-18T00:16:58.4295874Z remote: Counting objects: 47% (400/850) 2024-12-18T00:16:58.4296231Z remote: Counting objects: 48% (408/850) 2024-12-18T00:16:58.4296590Z remote: Counting objects: 49% (417/850) 2024-12-18T00:16:58.4296948Z remote: Counting objects: 50% (425/850) 2024-12-18T00:16:58.4297301Z remote: Counting objects: 51% (434/850) 2024-12-18T00:16:58.4297660Z remote: Counting objects: 52% (442/850) 2024-12-18T00:16:58.4298016Z remote: Counting objects: 53% (451/850) 2024-12-18T00:16:58.4298370Z remote: Counting objects: 54% (459/850) 2024-12-18T00:16:58.4298827Z remote: Counting objects: 55% (468/850) 2024-12-18T00:16:58.4299238Z remote: Counting objects: 56% (476/850) 2024-12-18T00:16:58.4299593Z remote: Counting objects: 57% (485/850) 2024-12-18T00:16:58.4299942Z remote: Counting objects: 58% (493/850) 2024-12-18T00:16:58.4300306Z remote: Counting objects: 59% (502/850) 2024-12-18T00:16:58.4300662Z remote: Counting objects: 60% (510/850) 2024-12-18T00:16:58.4301128Z remote: Counting objects: 61% (519/850) 2024-12-18T00:16:58.4301483Z remote: Counting objects: 62% (527/850) 2024-12-18T00:16:58.4301858Z remote: Counting objects: 63% (536/850) 2024-12-18T00:16:58.4302257Z remote: Counting objects: 64% (544/850) 2024-12-18T00:16:58.4302614Z remote: Counting objects: 65% (553/850) 2024-12-18T00:16:58.4302973Z remote: Counting objects: 66% (561/850) 2024-12-18T00:16:58.4303334Z remote: Counting objects: 67% (570/850) 2024-12-18T00:16:58.4303692Z remote: Counting objects: 68% (578/850) 2024-12-18T00:16:58.4304051Z remote: Counting objects: 69% (587/850) 2024-12-18T00:16:58.4304408Z remote: Counting objects: 70% (595/850) 2024-12-18T00:16:58.4304762Z remote: Counting objects: 71% (604/850) 2024-12-18T00:16:58.4305119Z remote: Counting objects: 72% (612/850) 2024-12-18T00:16:58.4305567Z remote: Counting objects: 73% (621/850) 2024-12-18T00:16:58.4305923Z remote: Counting objects: 74% (629/850) 2024-12-18T00:16:58.4306275Z remote: Counting objects: 75% (638/850) 2024-12-18T00:16:58.4306635Z remote: Counting objects: 76% (646/850) 2024-12-18T00:16:58.4306988Z remote: Counting objects: 77% (655/850) 2024-12-18T00:16:58.4307346Z remote: Counting objects: 78% (663/850) 2024-12-18T00:16:58.4307703Z remote: Counting objects: 79% (672/850) 2024-12-18T00:16:58.4308057Z remote: Counting objects: 80% (680/850) 2024-12-18T00:16:58.4308421Z remote: Counting objects: 81% (689/850) 2024-12-18T00:16:58.4308773Z remote: Counting objects: 82% (697/850) 2024-12-18T00:16:58.4309136Z remote: Counting objects: 83% (706/850) 2024-12-18T00:16:58.4309484Z remote: Counting objects: 84% (714/850) 2024-12-18T00:16:58.4309833Z remote: Counting objects: 85% (723/850) 2024-12-18T00:16:58.4310195Z remote: Counting objects: 86% (731/850) 2024-12-18T00:16:58.4310546Z remote: Counting objects: 87% (740/850) 2024-12-18T00:16:58.4310903Z remote: Counting objects: 88% (748/850) 2024-12-18T00:16:58.4311249Z remote: Counting objects: 89% (757/850) 2024-12-18T00:16:58.4311601Z remote: Counting objects: 90% (765/850) 2024-12-18T00:16:58.4311955Z remote: Counting objects: 91% (774/850) 2024-12-18T00:16:58.4312309Z remote: Counting objects: 92% (782/850) 2024-12-18T00:16:58.4312667Z remote: Counting objects: 93% (791/850) 2024-12-18T00:16:58.4313018Z remote: Counting objects: 94% (799/850) 2024-12-18T00:16:58.4313381Z remote: Counting objects: 95% (808/850) 2024-12-18T00:16:58.4313736Z remote: Counting objects: 96% (816/850) 2024-12-18T00:16:58.4314091Z remote: Counting objects: 97% (825/850) 2024-12-18T00:16:58.4314450Z remote: Counting objects: 98% (833/850) 2024-12-18T00:16:58.4314807Z remote: Counting objects: 99% (842/850) 2024-12-18T00:16:58.4315155Z remote: Counting objects: 100% (850/850) 2024-12-18T00:16:58.4315531Z remote: Counting objects: 100% (850/850), done. 2024-12-18T00:16:58.4356607Z remote: Compressing objects: 0% (1/307) 2024-12-18T00:16:58.4406264Z remote: Compressing objects: 1% (4/307) 2024-12-18T00:16:58.4443525Z remote: Compressing objects: 2% (7/307) 2024-12-18T00:16:58.4652216Z remote: Compressing objects: 3% (10/307) 2024-12-18T00:16:58.4938414Z remote: Compressing objects: 4% (13/307) 2024-12-18T00:16:58.5435455Z remote: Compressing objects: 5% (16/307) 2024-12-18T00:16:58.5966348Z remote: Compressing objects: 6% (19/307) 2024-12-18T00:16:58.6440121Z remote: Compressing objects: 7% (22/307) 2024-12-18T00:16:58.6848829Z remote: Compressing objects: 8% (25/307) 2024-12-18T00:16:58.7229811Z remote: Compressing objects: 9% (28/307) 2024-12-18T00:16:58.7455485Z remote: Compressing objects: 10% (31/307) 2024-12-18T00:16:58.7549417Z remote: Compressing objects: 11% (34/307) 2024-12-18T00:16:58.7630444Z remote: Compressing objects: 12% (37/307) 2024-12-18T00:16:58.7678188Z remote: Compressing objects: 13% (40/307) 2024-12-18T00:16:58.7679077Z remote: Compressing objects: 14% (43/307) 2024-12-18T00:16:58.7681655Z remote: Compressing objects: 15% (47/307) 2024-12-18T00:16:58.7684683Z remote: Compressing objects: 16% (50/307) 2024-12-18T00:16:58.7687883Z remote: Compressing objects: 17% (53/307) 2024-12-18T00:16:58.7691862Z remote: Compressing objects: 18% (56/307) 2024-12-18T00:16:58.7693048Z remote: Compressing objects: 19% (59/307) 2024-12-18T00:16:58.7694876Z remote: Compressing objects: 20% (62/307) 2024-12-18T00:16:58.7696886Z remote: Compressing objects: 21% (65/307) 2024-12-18T00:16:58.7699449Z remote: Compressing objects: 22% (68/307) 2024-12-18T00:16:58.7701052Z remote: Compressing objects: 23% (71/307) 2024-12-18T00:16:58.7704803Z remote: Compressing objects: 24% (74/307) 2024-12-18T00:16:58.7710311Z remote: Compressing objects: 25% (77/307) 2024-12-18T00:16:58.7717925Z remote: Compressing objects: 26% (80/307) 2024-12-18T00:16:58.7720132Z remote: Compressing objects: 27% (83/307) 2024-12-18T00:16:58.7722860Z remote: Compressing objects: 28% (86/307) 2024-12-18T00:16:58.7725722Z remote: Compressing objects: 29% (90/307) 2024-12-18T00:16:58.7732648Z remote: Compressing objects: 30% (93/307) 2024-12-18T00:16:58.7733056Z remote: Compressing objects: 31% (96/307) 2024-12-18T00:16:58.7738913Z remote: Compressing objects: 32% (99/307) 2024-12-18T00:16:58.7744731Z remote: Compressing objects: 33% (102/307) 2024-12-18T00:16:58.7750154Z remote: Compressing objects: 34% (105/307) 2024-12-18T00:16:58.7752562Z remote: Compressing objects: 35% (108/307) 2024-12-18T00:16:58.7753922Z remote: Compressing objects: 36% (111/307) 2024-12-18T00:16:58.7755300Z remote: Compressing objects: 37% (114/307) 2024-12-18T00:16:58.7757916Z remote: Compressing objects: 38% (117/307) 2024-12-18T00:16:58.7762349Z remote: Compressing objects: 39% (120/307) 2024-12-18T00:16:58.7767644Z remote: Compressing objects: 40% (123/307) 2024-12-18T00:16:58.7773325Z remote: Compressing objects: 41% (126/307) 2024-12-18T00:16:58.7773781Z remote: Compressing objects: 42% (129/307) 2024-12-18T00:16:58.7776913Z remote: Compressing objects: 43% (133/307) 2024-12-18T00:16:58.7782675Z remote: Compressing objects: 44% (136/307) 2024-12-18T00:16:58.7783065Z remote: Compressing objects: 45% (139/307) 2024-12-18T00:16:58.7785850Z remote: Compressing objects: 46% (142/307) 2024-12-18T00:16:58.7790199Z remote: Compressing objects: 47% (145/307) 2024-12-18T00:16:58.7793887Z remote: Compressing objects: 48% (148/307) 2024-12-18T00:16:58.7795540Z remote: Compressing objects: 49% (151/307) 2024-12-18T00:16:58.7796103Z remote: Compressing objects: 50% (154/307) 2024-12-18T00:16:58.7796477Z remote: Compressing objects: 51% (157/307) 2024-12-18T00:16:58.7797877Z remote: Compressing objects: 52% (160/307) 2024-12-18T00:16:58.7799737Z remote: Compressing objects: 53% (163/307) 2024-12-18T00:16:58.7801879Z remote: Compressing objects: 54% (166/307) 2024-12-18T00:16:58.7802656Z remote: Compressing objects: 55% (169/307) 2024-12-18T00:16:58.7804076Z remote: Compressing objects: 56% (172/307) 2024-12-18T00:16:58.7806988Z remote: Compressing objects: 57% (175/307) 2024-12-18T00:16:58.7808324Z remote: Compressing objects: 58% (179/307) 2024-12-18T00:16:58.7811950Z remote: Compressing objects: 59% (182/307) 2024-12-18T00:16:58.7812568Z remote: Compressing objects: 60% (185/307) 2024-12-18T00:16:58.7813263Z remote: Compressing objects: 61% (188/307) 2024-12-18T00:16:58.7816499Z remote: Compressing objects: 62% (191/307) 2024-12-18T00:16:58.7820370Z remote: Compressing objects: 63% (194/307) 2024-12-18T00:16:58.7824329Z remote: Compressing objects: 64% (197/307) 2024-12-18T00:16:58.7825874Z remote: Compressing objects: 65% (200/307) 2024-12-18T00:16:58.7828504Z remote: Compressing objects: 66% (203/307) 2024-12-18T00:16:58.7831265Z remote: Compressing objects: 67% (206/307) 2024-12-18T00:16:58.7834705Z remote: Compressing objects: 68% (209/307) 2024-12-18T00:16:58.7836325Z remote: Compressing objects: 69% (212/307) 2024-12-18T00:16:58.7838641Z remote: Compressing objects: 70% (215/307) 2024-12-18T00:16:58.7840229Z remote: Compressing objects: 71% (218/307) 2024-12-18T00:16:58.7841795Z remote: Compressing objects: 72% (222/307) 2024-12-18T00:16:58.7842612Z remote: Compressing objects: 73% (225/307) 2024-12-18T00:16:58.7843783Z remote: Compressing objects: 74% (228/307) 2024-12-18T00:16:58.7844434Z remote: Compressing objects: 75% (231/307) 2024-12-18T00:16:58.7845097Z remote: Compressing objects: 76% (234/307) 2024-12-18T00:16:58.7846529Z remote: Compressing objects: 77% (237/307) 2024-12-18T00:16:58.7847080Z remote: Compressing objects: 78% (240/307) 2024-12-18T00:16:58.7847871Z remote: Compressing objects: 79% (243/307) 2024-12-18T00:16:58.7848709Z remote: Compressing objects: 80% (246/307) 2024-12-18T00:16:58.7850601Z remote: Compressing objects: 81% (249/307) 2024-12-18T00:16:58.7852705Z remote: Compressing objects: 82% (252/307) 2024-12-18T00:16:58.7854897Z remote: Compressing objects: 83% (255/307) 2024-12-18T00:16:58.7857104Z remote: Compressing objects: 84% (258/307) 2024-12-18T00:16:58.7858607Z remote: Compressing objects: 85% (261/307) 2024-12-18T00:16:58.7860639Z remote: Compressing objects: 86% (265/307) 2024-12-18T00:16:58.7861676Z remote: Compressing objects: 87% (268/307) 2024-12-18T00:16:58.7862654Z remote: Compressing objects: 88% (271/307) 2024-12-18T00:16:58.7863631Z remote: Compressing objects: 89% (274/307) 2024-12-18T00:16:58.7864660Z remote: Compressing objects: 90% (277/307) 2024-12-18T00:16:58.7865497Z remote: Compressing objects: 91% (280/307) 2024-12-18T00:16:58.7867691Z remote: Compressing objects: 92% (283/307) 2024-12-18T00:16:58.7868439Z remote: Compressing objects: 93% (286/307) 2024-12-18T00:16:58.7869042Z remote: Compressing objects: 94% (289/307) 2024-12-18T00:16:58.7869842Z remote: Compressing objects: 95% (292/307) 2024-12-18T00:16:58.7870525Z remote: Compressing objects: 96% (295/307) 2024-12-18T00:16:58.7871264Z remote: Compressing objects: 97% (298/307) 2024-12-18T00:16:58.7871732Z remote: Compressing objects: 98% (301/307) 2024-12-18T00:16:58.7872103Z remote: Compressing objects: 99% (304/307) 2024-12-18T00:16:58.7872476Z remote: Compressing objects: 100% (307/307) 2024-12-18T00:16:58.7872878Z remote: Compressing objects: 100% (307/307), done. 2024-12-18T00:17:21.6479671Z remote: Total 1057269 (delta 699), reused 546 (delta 543), pack-reused 1056419 (from 2) 2024-12-18T00:17:44.2666697Z [command]/usr/bin/git rev-parse --verify --quiet 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7^{object} 2024-12-18T00:17:44.2693230Z 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:17:44.2698574Z ##[endgroup] 2024-12-18T00:17:44.2699135Z ##[group]Determining the checkout info 2024-12-18T00:17:44.2699818Z ##[endgroup] 2024-12-18T00:17:44.2700357Z ##[group]Checking out the ref 2024-12-18T00:17:44.2703361Z [command]/usr/bin/git checkout --quiet --force 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:17:46.0702836Z ##[endgroup] 2024-12-18T00:17:46.0703852Z ##[group]Setting up auth for fetching submodules 2024-12-18T00:17:46.0708240Z [command]/usr/bin/git config --global http.https://github.com/.extraheader AUTHORIZATION: basic *** 2024-12-18T00:17:46.0754803Z [command]/usr/bin/git config --global --unset-all url.https://github.com/.insteadOf 2024-12-18T00:17:46.0782927Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf git@github.com: 2024-12-18T00:17:46.0812329Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf org-21003710@github.com: 2024-12-18T00:17:46.0842609Z ##[endgroup] 2024-12-18T00:17:46.0843232Z ##[group]Fetching submodules 2024-12-18T00:17:46.0845793Z [command]/usr/bin/git submodule sync --recursive 2024-12-18T00:17:46.1224820Z [command]/usr/bin/git -c protocol.version=2 submodule update --init --force --recursive 2024-12-18T00:17:46.1588633Z Submodule 'android/libs/fbjni' (https://github.com/facebookincubator/fbjni.git) registered for path 'android/libs/fbjni' 2024-12-18T00:17:46.1590756Z Submodule 'third_party/NNPACK_deps/FP16' (https://github.com/Maratyszcza/FP16.git) registered for path 'third_party/FP16' 2024-12-18T00:17:46.1594198Z Submodule 'third_party/NNPACK_deps/FXdiv' (https://github.com/Maratyszcza/FXdiv.git) registered for path 'third_party/FXdiv' 2024-12-18T00:17:46.1597734Z Submodule 'third_party/NNPACK' (https://github.com/Maratyszcza/NNPACK.git) registered for path 'third_party/NNPACK' 2024-12-18T00:17:46.1601442Z Submodule 'third_party/NVTX' (https://github.com/NVIDIA/NVTX.git) registered for path 'third_party/NVTX' 2024-12-18T00:17:46.1605545Z Submodule 'third_party/VulkanMemoryAllocator' (https://github.com/GPUOpen-LibrariesAndSDKs/VulkanMemoryAllocator.git) registered for path 'third_party/VulkanMemoryAllocator' 2024-12-18T00:17:46.1609138Z Submodule 'third_party/XNNPACK' (https://github.com/google/XNNPACK.git) registered for path 'third_party/XNNPACK' 2024-12-18T00:17:46.1613286Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/benchmark' 2024-12-18T00:17:46.1617427Z Submodule 'third_party/composable_kernel' (https://github.com/ROCm/composable_kernel.git) registered for path 'third_party/composable_kernel' 2024-12-18T00:17:46.1621556Z Submodule 'third_party/cpp-httplib' (https://github.com/yhirose/cpp-httplib.git) registered for path 'third_party/cpp-httplib' 2024-12-18T00:17:46.1626737Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo.git) registered for path 'third_party/cpuinfo' 2024-12-18T00:17:46.1631321Z Submodule 'third_party/cudnn_frontend' (https://github.com/NVIDIA/cudnn-frontend.git) registered for path 'third_party/cudnn_frontend' 2024-12-18T00:17:46.1635527Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/cutlass' 2024-12-18T00:17:46.1640026Z Submodule 'third_party/eigen' (https://gitlab.com/libeigen/eigen.git) registered for path 'third_party/eigen' 2024-12-18T00:17:46.1644611Z Submodule 'third_party/fbgemm' (https://github.com/pytorch/fbgemm) registered for path 'third_party/fbgemm' 2024-12-18T00:17:46.1649374Z Submodule 'third_party/flatbuffers' (https://github.com/google/flatbuffers.git) registered for path 'third_party/flatbuffers' 2024-12-18T00:17:46.1657350Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/fmt' 2024-12-18T00:17:46.1662425Z Submodule 'third_party/gemmlowp/gemmlowp' (https://github.com/google/gemmlowp.git) registered for path 'third_party/gemmlowp/gemmlowp' 2024-12-18T00:17:46.1666980Z Submodule 'third_party/gloo' (https://github.com/facebookincubator/gloo) registered for path 'third_party/gloo' 2024-12-18T00:17:46.1672022Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/googletest' 2024-12-18T00:17:46.1676781Z Submodule 'third_party/ideep' (https://github.com/intel/ideep) registered for path 'third_party/ideep' 2024-12-18T00:17:46.1681856Z Submodule 'third_party/ittapi' (https://github.com/intel/ittapi.git) registered for path 'third_party/ittapi' 2024-12-18T00:17:46.1686782Z Submodule 'third_party/kineto' (https://github.com/pytorch/kineto) registered for path 'third_party/kineto' 2024-12-18T00:17:46.1691942Z Submodule 'third_party/mimalloc' (https://github.com/microsoft/mimalloc.git) registered for path 'third_party/mimalloc' 2024-12-18T00:17:46.1697064Z Submodule 'third_party/nccl/nccl' (https://github.com/NVIDIA/nccl) registered for path 'third_party/nccl/nccl' 2024-12-18T00:17:46.1702453Z Submodule 'third_party/nlohmann' (https://github.com/nlohmann/json.git) registered for path 'third_party/nlohmann' 2024-12-18T00:17:46.1707678Z Submodule 'third_party/onnx' (https://github.com/onnx/onnx.git) registered for path 'third_party/onnx' 2024-12-18T00:17:46.1713435Z Submodule 'third_party/opentelemetry-cpp' (https://github.com/open-telemetry/opentelemetry-cpp.git) registered for path 'third_party/opentelemetry-cpp' 2024-12-18T00:17:46.1718768Z Submodule 'third_party/pocketfft' (https://github.com/mreineck/pocketfft) registered for path 'third_party/pocketfft' 2024-12-18T00:17:46.1724710Z Submodule 'third_party/protobuf' (https://github.com/protocolbuffers/protobuf.git) registered for path 'third_party/protobuf' 2024-12-18T00:17:46.1730624Z Submodule 'third_party/NNPACK_deps/psimd' (https://github.com/Maratyszcza/psimd.git) registered for path 'third_party/psimd' 2024-12-18T00:17:46.1736376Z Submodule 'third_party/NNPACK_deps/pthreadpool' (https://github.com/Maratyszcza/pthreadpool.git) registered for path 'third_party/pthreadpool' 2024-12-18T00:17:46.1742247Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/pybind11' 2024-12-18T00:17:46.1751493Z Submodule 'third_party/python-peachpy' (https://github.com/malfet/PeachPy.git) registered for path 'third_party/python-peachpy' 2024-12-18T00:17:46.1757486Z Submodule 'third_party/sleef' (https://github.com/shibatch/sleef) registered for path 'third_party/sleef' 2024-12-18T00:17:46.1763555Z Submodule 'third_party/tensorpipe' (https://github.com/pytorch/tensorpipe.git) registered for path 'third_party/tensorpipe' 2024-12-18T00:17:46.1799499Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/android/libs/fbjni'... 2024-12-18T00:17:46.5093402Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FP16'... 2024-12-18T00:17:46.7059420Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FXdiv'... 2024-12-18T00:17:46.9013233Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/NNPACK'... 2024-12-18T00:17:47.2073947Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/NVTX'... 2024-12-18T00:17:47.5301950Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/VulkanMemoryAllocator'... 2024-12-18T00:17:49.4459891Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/XNNPACK'... 2024-12-18T00:18:00.7200351Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/benchmark'... 2024-12-18T00:18:01.1572147Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/composable_kernel'... 2024-12-18T00:18:03.4056007Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpp-httplib'... 2024-12-18T00:18:03.9374871Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpuinfo'... 2024-12-18T00:18:04.5470247Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cudnn_frontend'... 2024-12-18T00:18:05.8267516Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cutlass'... 2024-12-18T00:18:08.0726747Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/eigen'... 2024-12-18T00:18:13.9533904Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm'... 2024-12-18T00:18:15.5566235Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/flatbuffers'... 2024-12-18T00:18:16.7485963Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fmt'... 2024-12-18T00:18:17.9655785Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gemmlowp/gemmlowp'... 2024-12-18T00:18:18.4399336Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gloo'... 2024-12-18T00:18:18.8651053Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/googletest'... 2024-12-18T00:18:20.0074883Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep'... 2024-12-18T00:18:20.4004656Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ittapi'... 2024-12-18T00:18:20.7113368Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto'... 2024-12-18T00:18:22.3178345Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/mimalloc'... 2024-12-18T00:18:23.2069456Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nccl/nccl'... 2024-12-18T00:18:23.5877444Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nlohmann'... 2024-12-18T00:18:30.1483512Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx'... 2024-12-18T00:18:32.3713987Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp'... 2024-12-18T00:18:37.3322760Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pocketfft'... 2024-12-18T00:18:37.5837344Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf'... 2024-12-18T00:18:46.9516461Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/psimd'... 2024-12-18T00:18:47.1536502Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pthreadpool'... 2024-12-18T00:18:47.3650498Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pybind11'... 2024-12-18T00:18:48.5058555Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/python-peachpy'... 2024-12-18T00:18:48.8524977Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/sleef'... 2024-12-18T00:18:49.4812481Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe'... 2024-12-18T00:18:49.9290207Z Submodule path 'android/libs/fbjni': checked out '7e1e1fe3858c63c251c637ae41a20de425dde96f' 2024-12-18T00:18:49.9438186Z Submodule path 'third_party/FP16': checked out '4dfe081cf6bcd15db339cf2680b9281b8451eeb3' 2024-12-18T00:18:49.9556528Z Submodule path 'third_party/FXdiv': checked out 'b408327ac2a15ec3e43352421954f5b1967701d1' 2024-12-18T00:18:49.9863003Z Submodule path 'third_party/NNPACK': checked out 'c07e3a0400713d546e0dea2d5466dd22ea389c73' 2024-12-18T00:18:50.0314001Z Submodule path 'third_party/NVTX': checked out 'e170594ac7cf1dac584da473d4ca9301087090c1' 2024-12-18T00:18:50.0774854Z Submodule path 'third_party/VulkanMemoryAllocator': checked out 'a6bfc237255a6bac1513f7c1ebde6d8aed6b5191' 2024-12-18T00:18:51.0051858Z Submodule path 'third_party/XNNPACK': checked out '4ea82e595b36106653175dcb04b2aa532660d0d8' 2024-12-18T00:18:51.0339612Z Submodule path 'third_party/benchmark': checked out '0d98dba29d66e93259db7daa53a9327df767a415' 2024-12-18T00:18:51.3377013Z Submodule path 'third_party/composable_kernel': checked out '50ee4267e27b875d149e642f4cebd47be1dc3b57' 2024-12-18T00:18:51.3947785Z Submodule path 'third_party/cpp-httplib': checked out '3b6597bba913d51161383657829b7e644e59c006' 2024-12-18T00:18:51.5095768Z Submodule path 'third_party/cpuinfo': checked out '1e83a2fdd3102f65c6f1fb602c1b320486218a99' 2024-12-18T00:18:51.5510838Z Submodule path 'third_party/cudnn_frontend': checked out '936021bfed8c91dc416af1588b2c4eca631a9e45' 2024-12-18T00:18:52.1802940Z Submodule path 'third_party/cutlass': checked out 'bbe579a9e3beb6ea6626d9227ec32d0dae119a49' 2024-12-18T00:18:52.4765487Z Submodule path 'third_party/eigen': checked out '3147391d946bb4b6c68edd901f2add6ac1f31f8c' 2024-12-18T00:18:52.5834277Z Submodule path 'third_party/fbgemm': checked out 'dbc3157bf256f1339b3fa1fef2be89ac4078be0e' 2024-12-18T00:18:52.5857047Z Submodule 'third_party/asmjit' (https://github.com/asmjit/asmjit.git) registered for path 'third_party/fbgemm/third_party/asmjit' 2024-12-18T00:18:52.5860466Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo) registered for path 'third_party/fbgemm/third_party/cpuinfo' 2024-12-18T00:18:52.5864089Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/fbgemm/third_party/cutlass' 2024-12-18T00:18:52.5867421Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/fbgemm/third_party/googletest' 2024-12-18T00:18:52.5871031Z Submodule 'third_party/hipify_torch' (https://github.com/ROCmSoftwarePlatform/hipify_torch.git) registered for path 'third_party/fbgemm/third_party/hipify_torch' 2024-12-18T00:18:52.5904301Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/asmjit'... 2024-12-18T00:18:53.4712176Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cpuinfo'... 2024-12-18T00:18:54.1017699Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cutlass'... 2024-12-18T00:18:56.3717688Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/googletest'... 2024-12-18T00:18:57.4349058Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/hipify_torch'... 2024-12-18T00:18:57.8198661Z Submodule path 'third_party/fbgemm/third_party/asmjit': checked out 'd3fbf7c9bc7c1d1365a94a45614b91c5a3706b81' 2024-12-18T00:18:57.9327791Z Submodule path 'third_party/fbgemm/third_party/cpuinfo': checked out 'ed8b86a253800bafdb7b25c5c399f91bff9cb1f3' 2024-12-18T00:18:58.4295591Z Submodule path 'third_party/fbgemm/third_party/cutlass': checked out 'fc9ebc645b63f3a6bc80aaefde5c063fb72110d6' 2024-12-18T00:18:58.5008119Z Submodule path 'third_party/fbgemm/third_party/googletest': checked out 'cbf019de22c8dd37b2108da35b2748fd702d1796' 2024-12-18T00:18:58.5161592Z Submodule path 'third_party/fbgemm/third_party/hipify_torch': checked out '23f53b025b466d8ec3c45d52290d3442f7fbe6b1' 2024-12-18T00:18:58.6819599Z Submodule path 'third_party/flatbuffers': checked out '01834de25e4bf3975a9a00e816292b1ad0fe184b' 2024-12-18T00:18:58.7254967Z Submodule path 'third_party/fmt': checked out '0c9fce2ffefecfdce794e1859584e25877b7b592' 2024-12-18T00:18:58.7716262Z Submodule path 'third_party/gemmlowp/gemmlowp': checked out '3fb5c176c17c765a3492cd2f0321b0dab712f350' 2024-12-18T00:18:58.8056977Z Submodule path 'third_party/gloo': checked out '5354032ea08eadd7fc4456477f7f7c6308818509' 2024-12-18T00:18:58.8567862Z Submodule path 'third_party/googletest': checked out 'b514bdc898e2951020cbdca1304b75f5950d1f59' 2024-12-18T00:18:58.8728729Z Submodule path 'third_party/ideep': checked out 'c7ccd5bdbe5434ba156f4e856dcef0601637334b' 2024-12-18T00:18:58.8747186Z Submodule 'mkl-dnn' (https://github.com/intel/mkl-dnn.git) registered for path 'third_party/ideep/mkl-dnn' 2024-12-18T00:18:58.8778737Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep/mkl-dnn'... 2024-12-18T00:19:13.4089914Z Submodule path 'third_party/ideep/mkl-dnn': checked out '66f0cb9eb66affd2da3bf5f8d897376f04aae6af' 2024-12-18T00:19:13.4312106Z Submodule path 'third_party/ittapi': checked out '5b8a7d7422611c3a0d799fb5fc5dd4abfae35b42' 2024-12-18T00:19:13.5309437Z Submodule path 'third_party/kineto': checked out '338140f58a28d599da3434ced4fd2d75dd1a213d' 2024-12-18T00:19:13.5334689Z Submodule 'libkineto/third_party/dynolog' (https://github.com/facebookincubator/dynolog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog' 2024-12-18T00:19:13.5337883Z Submodule 'libkineto/third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/fmt' 2024-12-18T00:19:13.5341573Z Submodule 'libkineto/third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/googletest' 2024-12-18T00:19:13.5373677Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog'... 2024-12-18T00:19:14.3457709Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/fmt'... 2024-12-18T00:19:15.5809043Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/googletest'... 2024-12-18T00:19:16.7287188Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog': checked out '7d04a0053a845370ae06ce317a22a48e9edcc74e' 2024-12-18T00:19:16.7307589Z Submodule 'third_party/DCGM' (https://github.com/NVIDIA/DCGM.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-12-18T00:19:16.7311196Z Submodule 'third_party/cpr' (https://github.com/libcpr/cpr.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-12-18T00:19:16.7314340Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-12-18T00:19:16.7317904Z Submodule 'third_party/gflags' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-12-18T00:19:16.7321869Z Submodule 'third_party/glog' (https://github.com/google/glog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-12-18T00:19:16.7325663Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-12-18T00:19:16.7330075Z Submodule 'third_party/json' (https://github.com/nlohmann/json.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-12-18T00:19:16.7333859Z Submodule 'third_party/pfs' (https://github.com/dtrugman/pfs.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-12-18T00:19:16.7366018Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'... 2024-12-18T00:19:17.7928421Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'... 2024-12-18T00:19:18.1868099Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'... 2024-12-18T00:19:19.3994907Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'... 2024-12-18T00:19:19.6965769Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/glog'... 2024-12-18T00:19:20.1946007Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'... 2024-12-18T00:19:21.3013762Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/json'... 2024-12-18T00:19:28.5671530Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'... 2024-12-18T00:19:29.0231029Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM': checked out 'ffde4e54bc7249a6039a5e6b45b395141e1217f9' 2024-12-18T00:19:29.0463452Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr': checked out '871ed52d350214a034f6ef8a3b8f51c5ce1bd400' 2024-12-18T00:19:29.0887029Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt': checked out 'cd4af11efc9c622896a3e4cb599fa28668ca3d05' 2024-12-18T00:19:29.1059871Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags': checked out 'e171aa2d15ed9eb17054558e0b3a6a413bb01067' 2024-12-18T00:19:29.1080220Z Submodule 'doc' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-12-18T00:19:29.1113929Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'... 2024-12-18T00:19:29.4114693Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc': checked out '8411df715cf522606e3b1aca386ddfc0b63d34b4' 2024-12-18T00:19:29.4357115Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog': checked out 'b33e3bad4c46c8a6345525fd822af355e5ef9446' 2024-12-18T00:19:29.4846866Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest': checked out '58d77fa8070e8cec2dc1ed015d66b454c8d78850' 2024-12-18T00:19:29.6066461Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json': checked out '4f8fba14066156b73f1189a2b8bd568bde5284c5' 2024-12-18T00:19:29.6275310Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs': checked out 'f68a2fa8ea36c783bdd760371411fcb495aa3150' 2024-12-18T00:19:29.6728172Z Submodule path 'third_party/kineto/libkineto/third_party/fmt': checked out '0041a40c1350ba702d475b9c4ad62da77caea164' 2024-12-18T00:19:29.7413721Z Submodule path 'third_party/kineto/libkineto/third_party/googletest': checked out '7aca84427f224eeed3144123d5230d5871e93347' 2024-12-18T00:19:29.7860658Z Submodule path 'third_party/mimalloc': checked out 'b66e3214d8a104669c2ec05ae91ebc26a8f5ab78' 2024-12-18T00:19:29.8228049Z Submodule path 'third_party/nccl/nccl': checked out 'ab2b89c4c339bd7f816fbc114a4b05d386b66290' 2024-12-18T00:19:29.9560631Z Submodule path 'third_party/nlohmann': checked out '87cda1d6646592ac5866dc703c8e1839046a6806' 2024-12-18T00:19:30.4734198Z Submodule path 'third_party/onnx': checked out 'b8baa8446686496da4cc8fda09f2b6fe65c2a02c' 2024-12-18T00:19:30.4773273Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/onnx/third_party/pybind11' 2024-12-18T00:19:30.4804847Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx/third_party/pybind11'... 2024-12-18T00:19:31.7899683Z Submodule path 'third_party/onnx/third_party/pybind11': checked out '3e9dfa2866941655c56877882565e7577de6fc7b' 2024-12-18T00:19:31.8772069Z Submodule path 'third_party/opentelemetry-cpp': checked out 'a799f4aed9c94b765dcdaabaeab7d5e7e2310878' 2024-12-18T00:19:31.8795166Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark) registered for path 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-12-18T00:19:31.8798451Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/opentelemetry-cpp/third_party/googletest' 2024-12-18T00:19:31.8801773Z Submodule 'third_party/ms-gsl' (https://github.com/microsoft/GSL) registered for path 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-12-18T00:19:31.8805275Z Submodule 'third_party/nlohmann-json' (https://github.com/nlohmann/json) registered for path 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-12-18T00:19:31.8808979Z Submodule 'third_party/opentelemetry-proto' (https://github.com/open-telemetry/opentelemetry-proto) registered for path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-12-18T00:19:31.8812524Z Submodule 'third_party/opentracing-cpp' (https://github.com/opentracing/opentracing-cpp.git) registered for path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-12-18T00:19:31.8816146Z Submodule 'third_party/prometheus-cpp' (https://github.com/jupp0r/prometheus-cpp) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-12-18T00:19:31.8819691Z Submodule 'tools/vcpkg' (https://github.com/Microsoft/vcpkg) registered for path 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-12-18T00:19:31.8852240Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/benchmark'... 2024-12-18T00:19:32.3564393Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/googletest'... 2024-12-18T00:19:33.5157157Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/ms-gsl'... 2024-12-18T00:19:33.8834171Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/nlohmann-json'... 2024-12-18T00:19:41.1091017Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentelemetry-proto'... 2024-12-18T00:19:41.3951253Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentracing-cpp'... 2024-12-18T00:19:41.5996160Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp'... 2024-12-18T00:19:41.9149910Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/tools/vcpkg'... 2024-12-18T00:19:49.2400081Z Submodule path 'third_party/opentelemetry-cpp/third_party/benchmark': checked out 'd572f4777349d43653b21d6c2fc63020ab326db2' 2024-12-18T00:19:49.2876188Z Submodule path 'third_party/opentelemetry-cpp/third_party/googletest': checked out 'b796f7d44681514f58a683a3a71ff17c94edb0c1' 2024-12-18T00:19:49.3070278Z Submodule path 'third_party/opentelemetry-cpp/third_party/ms-gsl': checked out '6f4529395c5b7c2d661812257cd6780c67e54afa' 2024-12-18T00:19:49.4407239Z Submodule path 'third_party/opentelemetry-cpp/third_party/nlohmann-json': checked out 'bc889afb4c5bf1c0d8ee29ef35eaaf4c8bef8a5d' 2024-12-18T00:19:49.4570745Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto': checked out '4ca4f0335c63cda7ab31ea7ed70d6553aee14dce' 2024-12-18T00:19:49.4758576Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp': checked out '06b57f48ded1fa3bdd3d4346f6ef29e40e08eaf5' 2024-12-18T00:19:49.4963600Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp': checked out 'c9ffcdda9086ffd9e1283ea7a0276d831f3c8a8d' 2024-12-18T00:19:49.4982921Z Submodule 'civetweb' (https://github.com/civetweb/civetweb.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-12-18T00:19:49.4986080Z Submodule 'googletest' (https://github.com/google/googletest.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-12-18T00:19:49.5017376Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'... 2024-12-18T00:19:51.4100952Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'... 2024-12-18T00:19:52.7770163Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb': checked out 'eefb26f82b233268fc98577d265352720d477ba4' 2024-12-18T00:19:52.8304699Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2024-12-18T00:19:53.4942843Z Submodule path 'third_party/opentelemetry-cpp/tools/vcpkg': checked out '8eb57355a4ffb410a2e94c07b4dca2dffbee8e50' 2024-12-18T00:19:53.5088915Z Submodule path 'third_party/pocketfft': checked out '9d3ab05a7fffbc71a492bc6a17be034e83e8f0fe' 2024-12-18T00:19:53.8420101Z Submodule path 'third_party/protobuf': checked out 'd1eca4e4b421cd2997495c4b4e65cea6be4e9b8a' 2024-12-18T00:19:53.8443012Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/protobuf/third_party/benchmark' 2024-12-18T00:19:53.8446266Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/protobuf/third_party/googletest' 2024-12-18T00:19:53.8479685Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/benchmark'... 2024-12-18T00:19:54.3141389Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/googletest'... 2024-12-18T00:19:55.3522004Z Submodule path 'third_party/protobuf/third_party/benchmark': checked out '5b7683f49e1e9223cf9927b24f6fd3d6bd82e3f8' 2024-12-18T00:19:55.4341076Z Submodule path 'third_party/protobuf/third_party/googletest': checked out '5ec7f0c4a113e2f18ac2c6cc7df51ad6afc24081' 2024-12-18T00:19:55.4461179Z Submodule path 'third_party/psimd': checked out '072586a71b55b7f8c584153d223e95687148a900' 2024-12-18T00:19:55.4609360Z Submodule path 'third_party/pthreadpool': checked out '4fe0e1e183925bf8cfa6aae24237e724a96479b8' 2024-12-18T00:19:55.5039887Z Submodule path 'third_party/pybind11': checked out 'a2e59f0e7065404b44dfe92a28aca47ba1378dc4' 2024-12-18T00:19:55.5384117Z Submodule path 'third_party/python-peachpy': checked out 'f45429b087dd7d5bc78bb40dc7cf06425c252d67' 2024-12-18T00:19:55.5886653Z Submodule path 'third_party/sleef': checked out '60e76d2bce17d278b439d9da17177c8f957a9e9b' 2024-12-18T00:19:55.6238092Z Submodule path 'third_party/tensorpipe': checked out '52791a2fd214b2a9dc5759d36725909c1daa7f2e' 2024-12-18T00:19:55.6259139Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/tensorpipe/third_party/googletest' 2024-12-18T00:19:55.6262611Z Submodule 'third_party/libnop' (https://github.com/google/libnop.git) registered for path 'third_party/tensorpipe/third_party/libnop' 2024-12-18T00:19:55.6266251Z Submodule 'third_party/libuv' (https://github.com/libuv/libuv.git) registered for path 'third_party/tensorpipe/third_party/libuv' 2024-12-18T00:19:55.6269839Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/tensorpipe/third_party/pybind11' 2024-12-18T00:19:55.6300182Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/googletest'... 2024-12-18T00:19:56.6769488Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libnop'... 2024-12-18T00:19:56.9285567Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libuv'... 2024-12-18T00:19:59.2288883Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11'... 2024-12-18T00:20:00.3729179Z Submodule path 'third_party/tensorpipe/third_party/googletest': checked out 'aee0f9d9b5b87796ee8a0ab26b7587ec30e8858e' 2024-12-18T00:20:00.3925881Z Submodule path 'third_party/tensorpipe/third_party/libnop': checked out '910b55815be16109f04f4180e9adee14fb4ce281' 2024-12-18T00:20:00.4665219Z Submodule path 'third_party/tensorpipe/third_party/libuv': checked out '1dff88e5161cba5c59276d2070d2e304e4dcb242' 2024-12-18T00:20:00.5021439Z Submodule path 'third_party/tensorpipe/third_party/pybind11': checked out 'a23996fce38ff6ccfbcdc09f1e63f2c4be5ea2ef' 2024-12-18T00:20:00.5042236Z Submodule 'tools/clang' (https://github.com/wjakob/clang-cindex-python3) registered for path 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-12-18T00:20:00.5075878Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11/tools/clang'... 2024-12-18T00:20:00.8022331Z Submodule path 'third_party/tensorpipe/third_party/pybind11/tools/clang': checked out '6a00cbc4a9b8e68b71caf7f774b3f9c753ae84d5' 2024-12-18T00:20:00.8068994Z [command]/usr/bin/git submodule foreach --recursive git config --local gc.auto 0 2024-12-18T00:20:00.8435159Z Entering 'android/libs/fbjni' 2024-12-18T00:20:00.8492661Z Entering 'third_party/FP16' 2024-12-18T00:20:00.8550296Z Entering 'third_party/FXdiv' 2024-12-18T00:20:00.8608323Z Entering 'third_party/NNPACK' 2024-12-18T00:20:00.8670668Z Entering 'third_party/NVTX' 2024-12-18T00:20:00.8727958Z Entering 'third_party/VulkanMemoryAllocator' 2024-12-18T00:20:00.8787903Z Entering 'third_party/XNNPACK' 2024-12-18T00:20:00.8861107Z Entering 'third_party/benchmark' 2024-12-18T00:20:00.8915819Z Entering 'third_party/composable_kernel' 2024-12-18T00:20:00.8980993Z Entering 'third_party/cpp-httplib' 2024-12-18T00:20:00.9034210Z Entering 'third_party/cpuinfo' 2024-12-18T00:20:00.9088953Z Entering 'third_party/cudnn_frontend' 2024-12-18T00:20:00.9147725Z Entering 'third_party/cutlass' 2024-12-18T00:20:00.9214052Z Entering 'third_party/eigen' 2024-12-18T00:20:00.9274623Z Entering 'third_party/fbgemm' 2024-12-18T00:20:00.9329926Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-12-18T00:20:00.9381289Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-12-18T00:20:00.9433965Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-12-18T00:20:00.9491786Z Entering 'third_party/fbgemm/third_party/googletest' 2024-12-18T00:20:00.9545350Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-12-18T00:20:00.9598617Z Entering 'third_party/flatbuffers' 2024-12-18T00:20:00.9654568Z Entering 'third_party/fmt' 2024-12-18T00:20:00.9712436Z Entering 'third_party/gemmlowp/gemmlowp' 2024-12-18T00:20:00.9766511Z Entering 'third_party/gloo' 2024-12-18T00:20:00.9826298Z Entering 'third_party/googletest' 2024-12-18T00:20:00.9881764Z Entering 'third_party/ideep' 2024-12-18T00:20:00.9939922Z Entering 'third_party/ideep/mkl-dnn' 2024-12-18T00:20:00.9999288Z Entering 'third_party/ittapi' 2024-12-18T00:20:01.0062544Z Entering 'third_party/kineto' 2024-12-18T00:20:01.0119356Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-12-18T00:20:01.0174745Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-12-18T00:20:01.0230814Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-12-18T00:20:01.0282881Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-12-18T00:20:01.0336035Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-12-18T00:20:01.0389227Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-12-18T00:20:01.0447004Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-12-18T00:20:01.0499106Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-12-18T00:20:01.0557876Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-12-18T00:20:01.0614913Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-12-18T00:20:01.0678658Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-12-18T00:20:01.0733279Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-12-18T00:20:01.0790801Z Entering 'third_party/mimalloc' 2024-12-18T00:20:01.0846779Z Entering 'third_party/nccl/nccl' 2024-12-18T00:20:01.0903230Z Entering 'third_party/nlohmann' 2024-12-18T00:20:01.0956852Z Entering 'third_party/onnx' 2024-12-18T00:20:01.1023852Z Entering 'third_party/onnx/third_party/pybind11' 2024-12-18T00:20:01.1086067Z Entering 'third_party/opentelemetry-cpp' 2024-12-18T00:20:01.1140442Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-12-18T00:20:01.1192361Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-12-18T00:20:01.1246495Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-12-18T00:20:01.1297138Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-12-18T00:20:01.1349790Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-12-18T00:20:01.1403323Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-12-18T00:20:01.1457731Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-12-18T00:20:01.1506597Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-12-18T00:20:01.1560847Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-12-18T00:20:01.1619146Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-12-18T00:20:01.1695462Z Entering 'third_party/pocketfft' 2024-12-18T00:20:01.1747834Z Entering 'third_party/protobuf' 2024-12-18T00:20:01.1801965Z Entering 'third_party/protobuf/third_party/benchmark' 2024-12-18T00:20:01.1853411Z Entering 'third_party/protobuf/third_party/googletest' 2024-12-18T00:20:01.1913553Z Entering 'third_party/psimd' 2024-12-18T00:20:01.1967967Z Entering 'third_party/pthreadpool' 2024-12-18T00:20:01.2019517Z Entering 'third_party/pybind11' 2024-12-18T00:20:01.2072727Z Entering 'third_party/python-peachpy' 2024-12-18T00:20:01.2123795Z Entering 'third_party/sleef' 2024-12-18T00:20:01.2175767Z Entering 'third_party/tensorpipe' 2024-12-18T00:20:01.2226602Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-12-18T00:20:01.2276770Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-12-18T00:20:01.2327377Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-12-18T00:20:01.2378526Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-12-18T00:20:01.2428864Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-12-18T00:20:01.2501777Z ##[endgroup] 2024-12-18T00:20:01.2506114Z ##[group]Persisting credentials for submodules 2024-12-18T00:20:01.2507506Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'url\.https\:\/\/github\.com\/\.insteadOf' && git config --local --unset-all 'url.https://github.com/.insteadOf' || :" 2024-12-18T00:20:01.2867927Z Entering 'android/libs/fbjni' 2024-12-18T00:20:01.2935423Z Entering 'third_party/FP16' 2024-12-18T00:20:01.3004797Z Entering 'third_party/FXdiv' 2024-12-18T00:20:01.3073955Z Entering 'third_party/NNPACK' 2024-12-18T00:20:01.3142232Z Entering 'third_party/NVTX' 2024-12-18T00:20:01.3209945Z Entering 'third_party/VulkanMemoryAllocator' 2024-12-18T00:20:01.3278611Z Entering 'third_party/XNNPACK' 2024-12-18T00:20:01.3360133Z Entering 'third_party/benchmark' 2024-12-18T00:20:01.3429461Z Entering 'third_party/composable_kernel' 2024-12-18T00:20:01.3502306Z Entering 'third_party/cpp-httplib' 2024-12-18T00:20:01.3572906Z Entering 'third_party/cpuinfo' 2024-12-18T00:20:01.3640974Z Entering 'third_party/cudnn_frontend' 2024-12-18T00:20:01.3708349Z Entering 'third_party/cutlass' 2024-12-18T00:20:01.3782889Z Entering 'third_party/eigen' 2024-12-18T00:20:01.3851866Z Entering 'third_party/fbgemm' 2024-12-18T00:20:01.3917266Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-12-18T00:20:01.3985809Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-12-18T00:20:01.4052781Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-12-18T00:20:01.4125105Z Entering 'third_party/fbgemm/third_party/googletest' 2024-12-18T00:20:01.4196341Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-12-18T00:20:01.4266253Z Entering 'third_party/flatbuffers' 2024-12-18T00:20:01.4336057Z Entering 'third_party/fmt' 2024-12-18T00:20:01.4408301Z Entering 'third_party/gemmlowp/gemmlowp' 2024-12-18T00:20:01.4477810Z Entering 'third_party/gloo' 2024-12-18T00:20:01.4552345Z Entering 'third_party/googletest' 2024-12-18T00:20:01.4621529Z Entering 'third_party/ideep' 2024-12-18T00:20:01.4687885Z Entering 'third_party/ideep/mkl-dnn' 2024-12-18T00:20:01.4764061Z Entering 'third_party/ittapi' 2024-12-18T00:20:01.4832920Z Entering 'third_party/kineto' 2024-12-18T00:20:01.4898456Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-12-18T00:20:01.4965212Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-12-18T00:20:01.5039730Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-12-18T00:20:01.5107501Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-12-18T00:20:01.5176381Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-12-18T00:20:01.5247615Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-12-18T00:20:01.5320456Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-12-18T00:20:01.5388414Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-12-18T00:20:01.5455980Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-12-18T00:20:01.5532378Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-12-18T00:20:01.5605010Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-12-18T00:20:01.5673763Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-12-18T00:20:01.5744713Z Entering 'third_party/mimalloc' 2024-12-18T00:20:01.5817480Z Entering 'third_party/nccl/nccl' 2024-12-18T00:20:01.5885837Z Entering 'third_party/nlohmann' 2024-12-18T00:20:01.5955101Z Entering 'third_party/onnx' 2024-12-18T00:20:01.6035311Z Entering 'third_party/onnx/third_party/pybind11' 2024-12-18T00:20:01.6107880Z Entering 'third_party/opentelemetry-cpp' 2024-12-18T00:20:01.6176848Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-12-18T00:20:01.6243322Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-12-18T00:20:01.6309115Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-12-18T00:20:01.6375290Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-12-18T00:20:01.6442120Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-12-18T00:20:01.6507503Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-12-18T00:20:01.6575131Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-12-18T00:20:01.6639156Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-12-18T00:20:01.6708356Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-12-18T00:20:01.6779092Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-12-18T00:20:01.6866863Z Entering 'third_party/pocketfft' 2024-12-18T00:20:01.6934365Z Entering 'third_party/protobuf' 2024-12-18T00:20:01.7002923Z Entering 'third_party/protobuf/third_party/benchmark' 2024-12-18T00:20:01.7070083Z Entering 'third_party/protobuf/third_party/googletest' 2024-12-18T00:20:01.7141319Z Entering 'third_party/psimd' 2024-12-18T00:20:01.7208157Z Entering 'third_party/pthreadpool' 2024-12-18T00:20:01.7280658Z Entering 'third_party/pybind11' 2024-12-18T00:20:01.7349400Z Entering 'third_party/python-peachpy' 2024-12-18T00:20:01.7415930Z Entering 'third_party/sleef' 2024-12-18T00:20:01.7484996Z Entering 'third_party/tensorpipe' 2024-12-18T00:20:01.7551483Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-12-18T00:20:01.7621037Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-12-18T00:20:01.7689553Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-12-18T00:20:01.7756137Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-12-18T00:20:01.7821034Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-12-18T00:20:01.7915974Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local 'http.https://github.com/.extraheader' 'AUTHORIZATION: basic ***' && git config --local --show-origin --name-only --get-regexp remote.origin.url" 2024-12-18T00:20:01.8271321Z Entering 'android/libs/fbjni' 2024-12-18T00:20:01.8333540Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/android/libs/fbjni/config remote.origin.url 2024-12-18T00:20:01.8355192Z Entering 'third_party/FP16' 2024-12-18T00:20:01.8419580Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FP16/config remote.origin.url 2024-12-18T00:20:01.8443715Z Entering 'third_party/FXdiv' 2024-12-18T00:20:01.8505528Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FXdiv/config remote.origin.url 2024-12-18T00:20:01.8526925Z Entering 'third_party/NNPACK' 2024-12-18T00:20:01.8590070Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK/config remote.origin.url 2024-12-18T00:20:01.8611933Z Entering 'third_party/NVTX' 2024-12-18T00:20:01.8676206Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NVTX/config remote.origin.url 2024-12-18T00:20:01.8698975Z Entering 'third_party/VulkanMemoryAllocator' 2024-12-18T00:20:01.8761246Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/VulkanMemoryAllocator/config remote.origin.url 2024-12-18T00:20:01.8784769Z Entering 'third_party/XNNPACK' 2024-12-18T00:20:01.8847511Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/XNNPACK/config remote.origin.url 2024-12-18T00:20:01.8884043Z Entering 'third_party/benchmark' 2024-12-18T00:20:01.8946883Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/benchmark/config remote.origin.url 2024-12-18T00:20:01.8968859Z Entering 'third_party/composable_kernel' 2024-12-18T00:20:01.9031917Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/composable_kernel/config remote.origin.url 2024-12-18T00:20:01.9059525Z Entering 'third_party/cpp-httplib' 2024-12-18T00:20:01.9121960Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpp-httplib/config remote.origin.url 2024-12-18T00:20:01.9144100Z Entering 'third_party/cpuinfo' 2024-12-18T00:20:01.9205977Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpuinfo/config remote.origin.url 2024-12-18T00:20:01.9228466Z Entering 'third_party/cudnn_frontend' 2024-12-18T00:20:01.9290734Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cudnn_frontend/config remote.origin.url 2024-12-18T00:20:01.9312716Z Entering 'third_party/cutlass' 2024-12-18T00:20:01.9375123Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cutlass/config remote.origin.url 2024-12-18T00:20:01.9404757Z Entering 'third_party/eigen' 2024-12-18T00:20:01.9468217Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/eigen/config remote.origin.url 2024-12-18T00:20:01.9492136Z Entering 'third_party/fbgemm' 2024-12-18T00:20:01.9555192Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/config remote.origin.url 2024-12-18T00:20:01.9575557Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-12-18T00:20:01.9648139Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/asmjit/config remote.origin.url 2024-12-18T00:20:01.9669368Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-12-18T00:20:01.9734196Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cpuinfo/config remote.origin.url 2024-12-18T00:20:01.9755673Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-12-18T00:20:01.9816091Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cutlass/config remote.origin.url 2024-12-18T00:20:01.9845569Z Entering 'third_party/fbgemm/third_party/googletest' 2024-12-18T00:20:01.9906484Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/googletest/config remote.origin.url 2024-12-18T00:20:01.9927624Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-12-18T00:20:01.9992790Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/hipify_torch/config remote.origin.url 2024-12-18T00:20:02.0015983Z Entering 'third_party/flatbuffers' 2024-12-18T00:20:02.0079647Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/flatbuffers/config remote.origin.url 2024-12-18T00:20:02.0103755Z Entering 'third_party/fmt' 2024-12-18T00:20:02.0166661Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fmt/config remote.origin.url 2024-12-18T00:20:02.0189897Z Entering 'third_party/gemmlowp/gemmlowp' 2024-12-18T00:20:02.0253280Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gemmlowp/gemmlowp/config remote.origin.url 2024-12-18T00:20:02.0275216Z Entering 'third_party/gloo' 2024-12-18T00:20:02.0342461Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gloo/config remote.origin.url 2024-12-18T00:20:02.0364442Z Entering 'third_party/googletest' 2024-12-18T00:20:02.0426893Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/googletest/config remote.origin.url 2024-12-18T00:20:02.0448829Z Entering 'third_party/ideep' 2024-12-18T00:20:02.0510346Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/config remote.origin.url 2024-12-18T00:20:02.0531358Z Entering 'third_party/ideep/mkl-dnn' 2024-12-18T00:20:02.0595786Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/modules/mkl-dnn/config remote.origin.url 2024-12-18T00:20:02.0626507Z Entering 'third_party/ittapi' 2024-12-18T00:20:02.0686761Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ittapi/config remote.origin.url 2024-12-18T00:20:02.0708202Z Entering 'third_party/kineto' 2024-12-18T00:20:02.0770854Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/config remote.origin.url 2024-12-18T00:20:02.0791398Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-12-18T00:20:02.0857160Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/config remote.origin.url 2024-12-18T00:20:02.0877057Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-12-18T00:20:02.0939322Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/DCGM/config remote.origin.url 2024-12-18T00:20:02.0963375Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-12-18T00:20:02.1024737Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/cpr/config remote.origin.url 2024-12-18T00:20:02.1045933Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-12-18T00:20:02.1108079Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/fmt/config remote.origin.url 2024-12-18T00:20:02.1131037Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-12-18T00:20:02.1195128Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/config remote.origin.url 2024-12-18T00:20:02.1214267Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-12-18T00:20:02.1281529Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/modules/doc/config remote.origin.url 2024-12-18T00:20:02.1304603Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-12-18T00:20:02.1368616Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/glog/config remote.origin.url 2024-12-18T00:20:02.1390392Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-12-18T00:20:02.1454256Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/googletest/config remote.origin.url 2024-12-18T00:20:02.1475997Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-12-18T00:20:02.1539703Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/json/config remote.origin.url 2024-12-18T00:20:02.1562357Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-12-18T00:20:02.1628320Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/pfs/config remote.origin.url 2024-12-18T00:20:02.1650293Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-12-18T00:20:02.1712008Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/fmt/config remote.origin.url 2024-12-18T00:20:02.1733694Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-12-18T00:20:02.1796262Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/googletest/config remote.origin.url 2024-12-18T00:20:02.1820135Z Entering 'third_party/mimalloc' 2024-12-18T00:20:02.1882861Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/mimalloc/config remote.origin.url 2024-12-18T00:20:02.1905096Z Entering 'third_party/nccl/nccl' 2024-12-18T00:20:02.1969615Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nccl/nccl/config remote.origin.url 2024-12-18T00:20:02.1993991Z Entering 'third_party/nlohmann' 2024-12-18T00:20:02.2055387Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nlohmann/config remote.origin.url 2024-12-18T00:20:02.2082483Z Entering 'third_party/onnx' 2024-12-18T00:20:02.2145582Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/config remote.origin.url 2024-12-18T00:20:02.2181480Z Entering 'third_party/onnx/third_party/pybind11' 2024-12-18T00:20:02.2245390Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/pybind11/config remote.origin.url 2024-12-18T00:20:02.2278317Z Entering 'third_party/opentelemetry-cpp' 2024-12-18T00:20:02.2343658Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/config remote.origin.url 2024-12-18T00:20:02.2365181Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-12-18T00:20:02.2433420Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/benchmark/config remote.origin.url 2024-12-18T00:20:02.2454327Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-12-18T00:20:02.2516608Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/googletest/config remote.origin.url 2024-12-18T00:20:02.2538761Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-12-18T00:20:02.2600999Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/ms-gsl/config remote.origin.url 2024-12-18T00:20:02.2621972Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-12-18T00:20:02.2684102Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/nlohmann-json/config remote.origin.url 2024-12-18T00:20:02.2707042Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-12-18T00:20:02.2769651Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentelemetry-proto/config remote.origin.url 2024-12-18T00:20:02.2790558Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-12-18T00:20:02.2852669Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentracing-cpp/config remote.origin.url 2024-12-18T00:20:02.2873553Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-12-18T00:20:02.2936394Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/config remote.origin.url 2024-12-18T00:20:02.2955767Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-12-18T00:20:02.3019587Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/civetweb/config remote.origin.url 2024-12-18T00:20:02.3044669Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-12-18T00:20:02.3107243Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/googletest/config remote.origin.url 2024-12-18T00:20:02.3132644Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-12-18T00:20:02.3195807Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/tools/vcpkg/config remote.origin.url 2024-12-18T00:20:02.3238969Z Entering 'third_party/pocketfft' 2024-12-18T00:20:02.3303769Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pocketfft/config remote.origin.url 2024-12-18T00:20:02.3325065Z Entering 'third_party/protobuf' 2024-12-18T00:20:02.3387955Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/config remote.origin.url 2024-12-18T00:20:02.3410891Z Entering 'third_party/protobuf/third_party/benchmark' 2024-12-18T00:20:02.3476004Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/benchmark/config remote.origin.url 2024-12-18T00:20:02.3497062Z Entering 'third_party/protobuf/third_party/googletest' 2024-12-18T00:20:02.3560064Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/googletest/config remote.origin.url 2024-12-18T00:20:02.3584692Z Entering 'third_party/psimd' 2024-12-18T00:20:02.3652372Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/psimd/config remote.origin.url 2024-12-18T00:20:02.3673958Z Entering 'third_party/pthreadpool' 2024-12-18T00:20:02.3739574Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/pthreadpool/config remote.origin.url 2024-12-18T00:20:02.3761754Z Entering 'third_party/pybind11' 2024-12-18T00:20:02.3825251Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pybind11/config remote.origin.url 2024-12-18T00:20:02.3848696Z Entering 'third_party/python-peachpy' 2024-12-18T00:20:02.3910853Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/python-peachpy/config remote.origin.url 2024-12-18T00:20:02.3933363Z Entering 'third_party/sleef' 2024-12-18T00:20:02.3995152Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/sleef/config remote.origin.url 2024-12-18T00:20:02.4017442Z Entering 'third_party/tensorpipe' 2024-12-18T00:20:02.4080749Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/config remote.origin.url 2024-12-18T00:20:02.4101080Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-12-18T00:20:02.4163115Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/googletest/config remote.origin.url 2024-12-18T00:20:02.4185030Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-12-18T00:20:02.4247750Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libnop/config remote.origin.url 2024-12-18T00:20:02.4269258Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-12-18T00:20:02.4334501Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libuv/config remote.origin.url 2024-12-18T00:20:02.4356272Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-12-18T00:20:02.4418968Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/config remote.origin.url 2024-12-18T00:20:02.4438209Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-12-18T00:20:02.4500648Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/modules/tools/clang/config remote.origin.url 2024-12-18T00:20:02.5603794Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'git@github.com:' 2024-12-18T00:20:02.5967907Z Entering 'android/libs/fbjni' 2024-12-18T00:20:02.6021429Z Entering 'third_party/FP16' 2024-12-18T00:20:02.6076013Z Entering 'third_party/FXdiv' 2024-12-18T00:20:02.6130407Z Entering 'third_party/NNPACK' 2024-12-18T00:20:02.6183572Z Entering 'third_party/NVTX' 2024-12-18T00:20:02.6238045Z Entering 'third_party/VulkanMemoryAllocator' 2024-12-18T00:20:02.6291661Z Entering 'third_party/XNNPACK' 2024-12-18T00:20:02.6359917Z Entering 'third_party/benchmark' 2024-12-18T00:20:02.6411177Z Entering 'third_party/composable_kernel' 2024-12-18T00:20:02.6473896Z Entering 'third_party/cpp-httplib' 2024-12-18T00:20:02.6525406Z Entering 'third_party/cpuinfo' 2024-12-18T00:20:02.6579593Z Entering 'third_party/cudnn_frontend' 2024-12-18T00:20:02.6636877Z Entering 'third_party/cutlass' 2024-12-18T00:20:02.6699378Z Entering 'third_party/eigen' 2024-12-18T00:20:02.6755117Z Entering 'third_party/fbgemm' 2024-12-18T00:20:02.6814777Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-12-18T00:20:02.6867327Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-12-18T00:20:02.6922560Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-12-18T00:20:02.6981182Z Entering 'third_party/fbgemm/third_party/googletest' 2024-12-18T00:20:02.7035950Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-12-18T00:20:02.7089369Z Entering 'third_party/flatbuffers' 2024-12-18T00:20:02.7146135Z Entering 'third_party/fmt' 2024-12-18T00:20:02.7199152Z Entering 'third_party/gemmlowp/gemmlowp' 2024-12-18T00:20:02.7254979Z Entering 'third_party/gloo' 2024-12-18T00:20:02.7306380Z Entering 'third_party/googletest' 2024-12-18T00:20:02.7359720Z Entering 'third_party/ideep' 2024-12-18T00:20:02.7413813Z Entering 'third_party/ideep/mkl-dnn' 2024-12-18T00:20:02.7475338Z Entering 'third_party/ittapi' 2024-12-18T00:20:02.7528442Z Entering 'third_party/kineto' 2024-12-18T00:20:02.7583764Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-12-18T00:20:02.7638990Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-12-18T00:20:02.7691238Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-12-18T00:20:02.7741893Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-12-18T00:20:02.7792267Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-12-18T00:20:02.7843498Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-12-18T00:20:02.7898594Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-12-18T00:20:02.7950123Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-12-18T00:20:02.8001661Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-12-18T00:20:02.8055129Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-12-18T00:20:02.8110183Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-12-18T00:20:02.8161744Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-12-18T00:20:02.8215278Z Entering 'third_party/mimalloc' 2024-12-18T00:20:02.8269900Z Entering 'third_party/nccl/nccl' 2024-12-18T00:20:02.8323461Z Entering 'third_party/nlohmann' 2024-12-18T00:20:02.8378395Z Entering 'third_party/onnx' 2024-12-18T00:20:02.8448471Z Entering 'third_party/onnx/third_party/pybind11' 2024-12-18T00:20:02.8505770Z Entering 'third_party/opentelemetry-cpp' 2024-12-18T00:20:02.8559754Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-12-18T00:20:02.8610888Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-12-18T00:20:02.8664666Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-12-18T00:20:02.8715513Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-12-18T00:20:02.8769356Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-12-18T00:20:02.8824093Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-12-18T00:20:02.8877412Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-12-18T00:20:02.8925892Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-12-18T00:20:02.8979712Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-12-18T00:20:02.9034479Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-12-18T00:20:02.9108240Z Entering 'third_party/pocketfft' 2024-12-18T00:20:02.9162253Z Entering 'third_party/protobuf' 2024-12-18T00:20:02.9217029Z Entering 'third_party/protobuf/third_party/benchmark' 2024-12-18T00:20:02.9268459Z Entering 'third_party/protobuf/third_party/googletest' 2024-12-18T00:20:02.9322361Z Entering 'third_party/psimd' 2024-12-18T00:20:02.9376790Z Entering 'third_party/pthreadpool' 2024-12-18T00:20:02.9430113Z Entering 'third_party/pybind11' 2024-12-18T00:20:02.9484574Z Entering 'third_party/python-peachpy' 2024-12-18T00:20:02.9539048Z Entering 'third_party/sleef' 2024-12-18T00:20:02.9591057Z Entering 'third_party/tensorpipe' 2024-12-18T00:20:02.9642862Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-12-18T00:20:02.9692494Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-12-18T00:20:02.9742489Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-12-18T00:20:02.9793882Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-12-18T00:20:02.9842874Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-12-18T00:20:02.9920392Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'org-21003710@github.com:' 2024-12-18T00:20:03.0279428Z Entering 'android/libs/fbjni' 2024-12-18T00:20:03.0332792Z Entering 'third_party/FP16' 2024-12-18T00:20:03.0385283Z Entering 'third_party/FXdiv' 2024-12-18T00:20:03.0441981Z Entering 'third_party/NNPACK' 2024-12-18T00:20:03.0494373Z Entering 'third_party/NVTX' 2024-12-18T00:20:03.0547609Z Entering 'third_party/VulkanMemoryAllocator' 2024-12-18T00:20:03.0604213Z Entering 'third_party/XNNPACK' 2024-12-18T00:20:03.0672042Z Entering 'third_party/benchmark' 2024-12-18T00:20:03.0724353Z Entering 'third_party/composable_kernel' 2024-12-18T00:20:03.0782409Z Entering 'third_party/cpp-httplib' 2024-12-18T00:20:03.0842325Z Entering 'third_party/cpuinfo' 2024-12-18T00:20:03.0894495Z Entering 'third_party/cudnn_frontend' 2024-12-18T00:20:03.0946329Z Entering 'third_party/cutlass' 2024-12-18T00:20:03.1005549Z Entering 'third_party/eigen' 2024-12-18T00:20:03.1059079Z Entering 'third_party/fbgemm' 2024-12-18T00:20:03.1113667Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-12-18T00:20:03.1163800Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-12-18T00:20:03.1214114Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-12-18T00:20:03.1275325Z Entering 'third_party/fbgemm/third_party/googletest' 2024-12-18T00:20:03.1325458Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-12-18T00:20:03.1379608Z Entering 'third_party/flatbuffers' 2024-12-18T00:20:03.1435495Z Entering 'third_party/fmt' 2024-12-18T00:20:03.1487447Z Entering 'third_party/gemmlowp/gemmlowp' 2024-12-18T00:20:03.1539801Z Entering 'third_party/gloo' 2024-12-18T00:20:03.1593220Z Entering 'third_party/googletest' 2024-12-18T00:20:03.1644706Z Entering 'third_party/ideep' 2024-12-18T00:20:03.1696126Z Entering 'third_party/ideep/mkl-dnn' 2024-12-18T00:20:03.1756075Z Entering 'third_party/ittapi' 2024-12-18T00:20:03.1808288Z Entering 'third_party/kineto' 2024-12-18T00:20:03.1861336Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-12-18T00:20:03.1909907Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-12-18T00:20:03.1964753Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-12-18T00:20:03.2015697Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-12-18T00:20:03.2068367Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-12-18T00:20:03.2118414Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-12-18T00:20:03.2173579Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-12-18T00:20:03.2224908Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-12-18T00:20:03.2290864Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-12-18T00:20:03.2334492Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-12-18T00:20:03.2388007Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-12-18T00:20:03.2438097Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-12-18T00:20:03.2490632Z Entering 'third_party/mimalloc' 2024-12-18T00:20:03.2543524Z Entering 'third_party/nccl/nccl' 2024-12-18T00:20:03.2597519Z Entering 'third_party/nlohmann' 2024-12-18T00:20:03.2651428Z Entering 'third_party/onnx' 2024-12-18T00:20:03.2718807Z Entering 'third_party/onnx/third_party/pybind11' 2024-12-18T00:20:03.2775736Z Entering 'third_party/opentelemetry-cpp' 2024-12-18T00:20:03.2829311Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-12-18T00:20:03.2879364Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-12-18T00:20:03.2930417Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-12-18T00:20:03.2979250Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-12-18T00:20:03.3031134Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-12-18T00:20:03.3080980Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-12-18T00:20:03.3131605Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-12-18T00:20:03.3181581Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-12-18T00:20:03.3234062Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-12-18T00:20:03.3288811Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-12-18T00:20:03.3362780Z Entering 'third_party/pocketfft' 2024-12-18T00:20:03.3419250Z Entering 'third_party/protobuf' 2024-12-18T00:20:03.3474141Z Entering 'third_party/protobuf/third_party/benchmark' 2024-12-18T00:20:03.3524702Z Entering 'third_party/protobuf/third_party/googletest' 2024-12-18T00:20:03.3583605Z Entering 'third_party/psimd' 2024-12-18T00:20:03.3640203Z Entering 'third_party/pthreadpool' 2024-12-18T00:20:03.3691839Z Entering 'third_party/pybind11' 2024-12-18T00:20:03.3745734Z Entering 'third_party/python-peachpy' 2024-12-18T00:20:03.3797169Z Entering 'third_party/sleef' 2024-12-18T00:20:03.3854970Z Entering 'third_party/tensorpipe' 2024-12-18T00:20:03.3911367Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-12-18T00:20:03.3963971Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-12-18T00:20:03.4014217Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-12-18T00:20:03.4070573Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-12-18T00:20:03.4119576Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-12-18T00:20:03.4196016Z ##[endgroup] 2024-12-18T00:20:03.4235178Z [command]/usr/bin/git log -1 --format='%H' 2024-12-18T00:20:03.4259075Z '0cdf8b1d09254cfda66191d1bd01e3041c3c76f7' 2024-12-18T00:20:03.4439756Z Prepare all required actions 2024-12-18T00:20:03.4440219Z Getting action download info 2024-12-18T00:20:03.6308236Z ##[group]Run ./.github/actions/setup-linux 2024-12-18T00:20:03.6308562Z env: 2024-12-18T00:20:03.6308775Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:20:03.6309037Z ##[endgroup] 2024-12-18T00:20:03.6353656Z ##[group]Run set -euo pipefail 2024-12-18T00:20:03.6354009Z set -euo pipefail 2024-12-18T00:20:03.6354312Z function get_ec2_metadata() { 2024-12-18T00:20:03.6354686Z  # Pulled from instance metadata endpoint for EC2 2024-12-18T00:20:03.6355304Z  # see https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/instancedata-data-retrieval.html 2024-12-18T00:20:03.6355867Z  category=$1 2024-12-18T00:20:03.6356254Z  # If it is GCP runner (runner name contains gcp), do not run this 2024-12-18T00:20:03.6356701Z  runner_name_str=i-028bf30e8c4fafc3a 2024-12-18T00:20:03.6357078Z  if [[ -f /.inarc ]]; then 2024-12-18T00:20:03.6357433Z  echo "ARC Runner, no info on ec2 metadata" 2024-12-18T00:20:03.6357823Z  elif [[ $runner_name_str == *"gcp"* ]]; then 2024-12-18T00:20:03.6358288Z  echo "Runner is from Google Cloud Platform, No info on ec2 metadata" 2024-12-18T00:20:03.6358714Z  else 2024-12-18T00:20:03.6359633Z  curl -H "X-aws-ec2-metadata-token: $(curl -s -X PUT "http://169.254.169.254/latest/api/token" -H "X-aws-ec2-metadata-token-ttl-seconds: 30")" -fsSL "http://169.254.169.254/latest/meta-data/${category}" 2024-12-18T00:20:03.6360569Z  fi 2024-12-18T00:20:03.6360802Z } 2024-12-18T00:20:03.6361073Z echo "ami-id: $(get_ec2_metadata ami-id)" 2024-12-18T00:20:03.6361520Z echo "instance-id: $(get_ec2_metadata instance-id)" 2024-12-18T00:20:03.6361996Z echo "instance-type: $(get_ec2_metadata instance-type)" 2024-12-18T00:20:03.6362418Z echo "system info $(uname -a)" 2024-12-18T00:20:03.6373118Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:20:03.6373493Z env: 2024-12-18T00:20:03.6373713Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:20:03.6373982Z ##[endgroup] 2024-12-18T00:20:03.6531780Z ami-id: ami-0fff1b9a61dec8a5f 2024-12-18T00:20:03.6644218Z instance-id: i-028bf30e8c4fafc3a 2024-12-18T00:20:03.6753891Z instance-type: g5.4xlarge 2024-12-18T00:20:03.6767309Z system info Linux ip-10-0-40-191.ec2.internal 6.1.109-118.189.amzn2023.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Sep 10 08:59:12 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux 2024-12-18T00:20:03.6803040Z ##[group]Run echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2024-12-18T00:20:03.6803944Z echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2024-12-18T00:20:03.6813970Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:20:03.6814354Z env: 2024-12-18T00:20:03.6814569Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:20:03.6814832Z ##[endgroup] 2024-12-18T00:20:03.6881369Z ##[group]Run if systemctl is-active --quiet docker; then 2024-12-18T00:20:03.6881805Z if systemctl is-active --quiet docker; then 2024-12-18T00:20:03.6882185Z  echo "Docker daemon is running..."; 2024-12-18T00:20:03.6882501Z else 2024-12-18T00:20:03.6882843Z  echo "Starting docker deamon..." && sudo systemctl start docker; 2024-12-18T00:20:03.6883261Z fi 2024-12-18T00:20:03.6892021Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:20:03.6892401Z env: 2024-12-18T00:20:03.6892621Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:20:03.6893069Z ##[endgroup] 2024-12-18T00:20:03.6980418Z Docker daemon is running... 2024-12-18T00:20:03.7027187Z ##[group]Run nick-fields/retry@v3.0.0 2024-12-18T00:20:03.7027493Z with: 2024-12-18T00:20:03.7027703Z shell: bash 2024-12-18T00:20:03.7028112Z timeout_minutes: 5 2024-12-18T00:20:03.7028360Z max_attempts: 3 2024-12-18T00:20:03.7028597Z retry_wait_seconds: 30 2024-12-18T00:20:03.7030741Z command: AWS_ACCOUNT_ID=$(aws sts get-caller-identity|grep Account|cut -f4 -d\") aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \ --password-stdin "$AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com" # For LF Runners we need to make sure we also login to Meta's ECR docker registry too. META_AWS_ACCOUNT_ID=308535385114 if [ "$AWS_ACCOUNT_ID" != "$META_AWS_ACCOUNT_ID" ] ; then aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \ --password-stdin "$META_AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com" fi 2024-12-18T00:20:03.7032949Z polling_interval_seconds: 1 2024-12-18T00:20:03.7033233Z warning_on_retry: true 2024-12-18T00:20:03.7033498Z continue_on_error: false 2024-12-18T00:20:03.7033745Z env: 2024-12-18T00:20:03.7033964Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:20:03.7034232Z AWS_RETRY_MODE: standard 2024-12-18T00:20:03.7034492Z AWS_MAX_ATTEMPTS: 5 2024-12-18T00:20:03.7034750Z AWS_DEFAULT_REGION: us-east-1 2024-12-18T00:20:03.7035015Z ##[endgroup] 2024-12-18T00:20:05.0012047Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-12-18T00:20:05.0012638Z Configure a credential helper to remove this warning. See 2024-12-18T00:20:05.0013211Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-12-18T00:20:05.0013601Z 2024-12-18T00:20:05.0013697Z Login Succeeded 2024-12-18T00:20:05.8873862Z Command completed after 1 attempt(s). 2024-12-18T00:20:05.8952287Z ##[group]Run env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-12-18T00:20:05.8952831Z env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-12-18T00:20:05.8953321Z env | grep '^CI' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-12-18T00:20:05.8963433Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:20:05.8963798Z env: 2024-12-18T00:20:05.8964015Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:20:05.8964283Z ##[endgroup] 2024-12-18T00:20:05.9066605Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2024-12-18T00:20:05.9067153Z # ignore expansion of "docker ps -q" since it could be empty 2024-12-18T00:20:05.9067567Z # shellcheck disable=SC2046 2024-12-18T00:20:05.9067888Z docker stop $(docker ps -q) || true 2024-12-18T00:20:05.9068229Z # Prune all of the docker images 2024-12-18T00:20:05.9068547Z docker system prune -af 2024-12-18T00:20:05.9076711Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:20:05.9077082Z env: 2024-12-18T00:20:05.9077316Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:20:05.9077575Z ##[endgroup] 2024-12-18T00:20:05.9385329Z "docker stop" requires at least 1 argument. 2024-12-18T00:20:05.9385743Z See 'docker stop --help'. 2024-12-18T00:20:05.9385924Z 2024-12-18T00:20:05.9386132Z Usage: docker stop [OPTIONS] CONTAINER [CONTAINER...] 2024-12-18T00:20:05.9386402Z 2024-12-18T00:20:05.9386520Z Stop one or more running containers 2024-12-18T00:20:10.8365468Z Deleted Images: 2024-12-18T00:20:10.8365871Z untagged: pytorch/manylinux2_28-builder:cuda11.8 2024-12-18T00:20:10.8366507Z untagged: pytorch/manylinux2_28-builder@sha256:90d3547633a3f7caf5592125c777dcb5350df43816372822a691005cf6b7ed25 2024-12-18T00:20:10.8367266Z deleted: sha256:a1c8cba29088a7db82a4ce38ec13f855868a2d043571c051bbe72e345d5b68c5 2024-12-18T00:20:10.8367900Z deleted: sha256:d6ec59a0ec3d0b50a24c71e7919feb8e617592e21e0da01fc5c53e59ed0ce146 2024-12-18T00:20:10.8368521Z deleted: sha256:e605b089b4adb278f256f5471e126d6f8b50ef1ba8d9f2d173952062df573b58 2024-12-18T00:20:10.8369447Z deleted: sha256:fc2a0a83e687c8ee0b259cc78627409b671b358eef8568eda351cf89b5863b2e 2024-12-18T00:20:10.8370064Z deleted: sha256:6449ccf3f39b80f84d12a058cb60d0ae528d16d05347c49f354942a12837ef69 2024-12-18T00:20:10.8370850Z deleted: sha256:46e481d9512fa29f0a0a4b3218709b82e68e3f2e9eaf9c33a1721394cba594a5 2024-12-18T00:20:10.8371479Z deleted: sha256:88dedf71dfd563098f2506b0074b42a64c8046eaa3ee66edbe98f07b1e5b340b 2024-12-18T00:20:10.8372088Z deleted: sha256:843a9a878406b068ce7d594765e2d2fe7769f6a7fd283383e48592a3dac468dc 2024-12-18T00:20:10.8372689Z deleted: sha256:6b852475e7e0cd1b76c2ca026c40220c872ca316c75152420d4aa93746b54fc4 2024-12-18T00:20:10.8373303Z deleted: sha256:207c9e28aed88d5e23f7623510bdc8ee0d71bdfbc215be68defeb3a995711c6c 2024-12-18T00:20:10.8373915Z deleted: sha256:0f10239d4b2bde10955d84e23020579c6af513b12196ca9b28c662712405d706 2024-12-18T00:20:10.8374508Z deleted: sha256:61f6457a8d7497f7ab02d479c816016f1d4ba295afb7d1846b50395dfb293e62 2024-12-18T00:20:10.8375116Z deleted: sha256:300184cbbcc28fdb5540c3d0a0928d864722e7fc1f34c82234e8cc5c848f785b 2024-12-18T00:20:10.8375725Z deleted: sha256:e9712603ee2c139253f99236d4f8650ea200f461ae4379ffd98a6278d9fb7a2b 2024-12-18T00:20:10.8376335Z deleted: sha256:3961abbbef327e49acd88ea9750cbae10d6320025786e92fb08fac3228b5d681 2024-12-18T00:20:10.8376966Z deleted: sha256:8f87f631acc06b266dad2234ee2ce8e3f6ed75746a33367f8f09a1b9fb1e9de8 2024-12-18T00:20:10.8377588Z deleted: sha256:a0ffee1174dc3bc81ecdd9ea1300e381d75442d874de6f715596e60facb0a273 2024-12-18T00:20:10.8378201Z deleted: sha256:9026e3d0783716dd7a0e20787094f40ec91c2852ff85bb08e40b1aafe9ad08ce 2024-12-18T00:20:10.8378820Z deleted: sha256:d812a9d2b45b2af26da70e29df7ddfa7dc6d711a4abdd2990399dd4b324e7b83 2024-12-18T00:20:10.8412863Z deleted: sha256:9180249228b1f6400e109e70720d6ad4e0fe0b1319fed8fdbb2f2f59370dfe18 2024-12-18T00:20:10.8413851Z deleted: sha256:ae4169d0f65f75d30c65d43b112cbb1ae5dcac98fe5373fe8144bf6cc5acec5c 2024-12-18T00:20:10.8414563Z deleted: sha256:f531f5d8ec2be429140998c66281f19c6a489865dd1d5050a1ccb899e8c1cd85 2024-12-18T00:20:10.8415226Z deleted: sha256:c1e2376fb69b77776dae4278bf9883fde169f894361cf882d5d043e922a473c7 2024-12-18T00:20:10.8415901Z deleted: sha256:d9ab500a7f794381588bad57359190d042202cf7003eadb059758a8925d85b00 2024-12-18T00:20:10.8416509Z deleted: sha256:619b55cd9281022eba6134199ef83acc809d98228f717dd261acca3fdca3055a 2024-12-18T00:20:10.8417114Z deleted: sha256:f630b477a5826dd23a39e894b998864bd43305822eb68bf1f0790c5ae41892f6 2024-12-18T00:20:10.8417873Z deleted: sha256:38ceb8baa78333fad9243f0d72e6830f62e9eaaa66edab51774c02fc11d9ed20 2024-12-18T00:20:10.8418759Z deleted: sha256:7c24b9be1c50cf4ef5c70fb6698167a827a4726b3cb306c07da2f0351c66cade 2024-12-18T00:20:10.8419604Z deleted: sha256:a5d3eecefb86d1288d1094060fe133cd2ad1b68a11d4b08161e6b1a009390edf 2024-12-18T00:20:10.8420043Z 2024-12-18T00:20:10.8420167Z Total reclaimed space: 11.78GB 2024-12-18T00:20:10.8450863Z ##[group]Run set +e 2024-12-18T00:20:10.8451153Z set +e 2024-12-18T00:20:10.8451404Z set -x 2024-12-18T00:20:10.8451638Z  2024-12-18T00:20:10.8451886Z PT_DOMAIN=download.pytorch.org 2024-12-18T00:20:10.8452454Z # TODO: Flaky access to download.pytorch.org https://github.com/pytorch/pytorch/issues/100400, 2024-12-18T00:20:10.8453184Z # cleaning this up once the issue is fixed. There are more than one resolved IP here, the last 2024-12-18T00:20:10.8453696Z # one is returned at random 2024-12-18T00:20:10.8454088Z RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" | tail -n1) 2024-12-18T00:20:10.8454460Z  2024-12-18T00:20:10.8454693Z if [ -z "${RESOLVED_IP}" ]; then 2024-12-18T00:20:10.8455117Z  echo "Couldn't resolve ${PT_DOMAIN}, retrying with Google DNS..." 2024-12-18T00:20:10.8455624Z  RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" @8.8.8.8 | tail -n1) 2024-12-18T00:20:10.8456009Z  2024-12-18T00:20:10.8456251Z  if [ -z "${RESOLVED_IP}" ]; then 2024-12-18T00:20:10.8456813Z  echo "Couldn't resolve ${PT_DOMAIN}, exiting..." 2024-12-18T00:20:10.8457178Z  exit 1 2024-12-18T00:20:10.8457422Z  fi 2024-12-18T00:20:10.8457651Z fi 2024-12-18T00:20:10.8458040Z  2024-12-18T00:20:10.8458303Z if grep -r "${PT_DOMAIN}" /etc/hosts; then 2024-12-18T00:20:10.8458674Z  # Clean up any old records first 2024-12-18T00:20:10.8459040Z  sudo sed -i "/${PT_DOMAIN}/d" /etc/hosts 2024-12-18T00:20:10.8459377Z fi 2024-12-18T00:20:10.8459599Z  2024-12-18T00:20:10.8459909Z echo "${RESOLVED_IP} ${PT_DOMAIN}" | sudo tee -a /etc/hosts 2024-12-18T00:20:10.8460294Z cat /etc/hosts 2024-12-18T00:20:10.8469996Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:20:10.8470374Z env: 2024-12-18T00:20:10.8470595Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:20:10.8470868Z ##[endgroup] 2024-12-18T00:20:10.8503469Z + PT_DOMAIN=download.pytorch.org 2024-12-18T00:20:10.8509625Z ++ dig -4 +short download.pytorch.org 2024-12-18T00:20:10.8512732Z ++ tail -n1 2024-12-18T00:20:10.8808364Z + RESOLVED_IP=3.171.85.110 2024-12-18T00:20:10.8808664Z + '[' -z 3.171.85.110 ']' 2024-12-18T00:20:10.8808980Z + grep -r download.pytorch.org /etc/hosts 2024-12-18T00:20:10.8824577Z + sudo sed -i /download.pytorch.org/d /etc/hosts 2024-12-18T00:20:10.8824934Z 3.167.99.125 download.pytorch.org 2024-12-18T00:20:10.9838125Z + echo '3.171.85.110 download.pytorch.org' 2024-12-18T00:20:10.9838603Z + sudo tee -a /etc/hosts 2024-12-18T00:20:11.0170422Z 3.171.85.110 download.pytorch.org 2024-12-18T00:20:11.0192337Z + cat /etc/hosts 2024-12-18T00:20:11.0203307Z 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 2024-12-18T00:20:11.0207246Z ::1 localhost6 localhost6.localdomain6 2024-12-18T00:20:11.0207690Z 3.171.85.110 download.pytorch.org 2024-12-18T00:20:11.0361884Z ##[group]Run pytorch/test-infra/.github/actions/calculate-docker-image@release/2.6 2024-12-18T00:20:11.0362364Z with: 2024-12-18T00:20:11.0363221Z docker-image-name: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:20:11.0364126Z docker-build-dir: .ci/docker 2024-12-18T00:20:11.0364405Z working-directory: . 2024-12-18T00:20:11.0364748Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-18T00:20:11.0365131Z force-push: false 2024-12-18T00:20:11.0365347Z env: 2024-12-18T00:20:11.0365556Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:20:11.0365808Z ##[endgroup] 2024-12-18T00:20:11.0394124Z ##[group]Run set -ex 2024-12-18T00:20:11.0394416Z set -ex 2024-12-18T00:20:11.0394645Z  2024-12-18T00:20:11.0395029Z # If the docker build directory or the build script doesn't exist, the action will 2024-12-18T00:20:11.0395699Z # gracefully return the docker image name as it is. Pulling docker image in Linux 2024-12-18T00:20:11.0396250Z # job could then download the pre-built image as usual 2024-12-18T00:20:11.0396744Z if [[ ! -d "${DOCKER_BUILD_DIR}" ]] || [[ ! -f "${DOCKER_BUILD_DIR}/build.sh" ]]; then 2024-12-18T00:20:11.0397203Z  echo "skip=true" >> "${GITHUB_OUTPUT}" 2024-12-18T00:20:11.0397643Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2024-12-18T00:20:11.0398049Z  2024-12-18T00:20:11.0398404Z  echo "There is no Docker build script in ${REPO_NAME} repo, skipping..." 2024-12-18T00:20:11.0398832Z  exit 0 2024-12-18T00:20:11.0399063Z else 2024-12-18T00:20:11.0399334Z  echo "skip=false" >> "${GITHUB_OUTPUT}" 2024-12-18T00:20:11.0399657Z fi 2024-12-18T00:20:11.0399873Z  2024-12-18T00:20:11.0400205Z if [[ "${DOCKER_IMAGE_NAME}" == *"${DOCKER_REGISTRY}/${REPO_NAME}"* ]]; then 2024-12-18T00:20:11.0400783Z  # The docker image name already includes the ECR prefix and tag, so we can just 2024-12-18T00:20:11.0401484Z  # use it as it is, but first let's extract the tag 2024-12-18T00:20:11.0401954Z  DOCKER_TAG=$(echo "${DOCKER_IMAGE_NAME}" | awk -F '[:,]' '{print $2}') 2024-12-18T00:20:11.0402450Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-12-18T00:20:11.0402951Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2024-12-18T00:20:11.0403379Z else 2024-12-18T00:20:11.0403684Z  DOCKER_TAG=$(git rev-parse HEAD:"${DOCKER_BUILD_DIR}") 2024-12-18T00:20:11.0404133Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-12-18T00:20:11.0404765Z  echo "docker-image=${DOCKER_REGISTRY}/${REPO_NAME}/${DOCKER_IMAGE_NAME}:${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-12-18T00:20:11.0405308Z fi 2024-12-18T00:20:11.0414482Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:20:11.0414854Z env: 2024-12-18T00:20:11.0415065Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:20:11.0415338Z REPO_NAME: pytorch 2024-12-18T00:20:11.0416166Z DOCKER_IMAGE_NAME: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:20:11.0417055Z DOCKER_BUILD_DIR: .ci/docker 2024-12-18T00:20:11.0417420Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-18T00:20:11.0417803Z ##[endgroup] 2024-12-18T00:20:11.0447034Z + [[ ! -d .ci/docker ]] 2024-12-18T00:20:11.0447314Z + [[ ! -f .ci/docker/build.sh ]] 2024-12-18T00:20:11.0447597Z + echo skip=false 2024-12-18T00:20:11.0448853Z + [[ 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:45e1356b47a284893081276eff3000b7b534f3b1 == *\3\0\8\5\3\5\3\8\5\1\1\4\.\d\k\r\.\e\c\r\.\u\s\-\e\a\s\t\-\1\.\a\m\a\z\o\n\a\w\s\.\c\o\m\/\p\y\t\o\r\c\h* ]] 2024-12-18T00:20:11.0454928Z ++ echo 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:20:11.0455821Z ++ awk -F '[:,]' '{print $2}' 2024-12-18T00:20:11.0479629Z + DOCKER_TAG=45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:20:11.0480054Z + echo docker-tag=45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:20:11.0481004Z + echo docker-image=308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:20:11.0519497Z ##[group]Run set +e 2024-12-18T00:20:11.0519825Z set +e 2024-12-18T00:20:11.0520064Z set -x 2024-12-18T00:20:11.0520297Z  2024-12-18T00:20:11.0520510Z login() { 2024-12-18T00:20:11.0521002Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2024-12-18T00:20:11.0521523Z } 2024-12-18T00:20:11.0521745Z  2024-12-18T00:20:11.0521977Z retry () { 2024-12-18T00:20:11.0522252Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2024-12-18T00:20:11.0522659Z } 2024-12-18T00:20:11.0522927Z  2024-12-18T00:20:11.0523165Z retry login "${DOCKER_REGISTRY}" 2024-12-18T00:20:11.0523471Z  2024-12-18T00:20:11.0523689Z START_TIME=$(date +%s) 2024-12-18T00:20:11.0523985Z # Wait up to 90 minutes 2024-12-18T00:20:11.0524345Z while [[ $(( $(date +%s) - 5400 )) -lt $START_TIME ]]; do 2024-12-18T00:20:11.0524824Z  # Check if image already exists, if it does then skip building it 2024-12-18T00:20:11.0525302Z  if docker manifest inspect "${DOCKER_IMAGE}"; then 2024-12-18T00:20:11.0525661Z  exit 0 2024-12-18T00:20:11.0525893Z  fi 2024-12-18T00:20:11.0526117Z  2024-12-18T00:20:11.0526854Z  # NB: This flag is used by Docker build workflow to push the image to ECR, so we can 2024-12-18T00:20:11.0527699Z  # use this to differentiate between the Docker build and regular build jobs. For the 2024-12-18T00:20:11.0528357Z  # latter, it will wait for the Docker images to become available before continuing 2024-12-18T00:20:11.0528859Z  if [ "${DOCKER_PUSH:-false}" == "true" ]; then 2024-12-18T00:20:11.0529246Z  # It's a Docker build job, let's build the image 2024-12-18T00:20:11.0529588Z  break 2024-12-18T00:20:11.0529824Z  else 2024-12-18T00:20:11.0530159Z  # It's a regular build job, wait for the image to become available 2024-12-18T00:20:11.0530566Z  sleep 300 2024-12-18T00:20:11.0530812Z  fi 2024-12-18T00:20:11.0531034Z done 2024-12-18T00:20:11.0531253Z  2024-12-18T00:20:11.0531607Z # NB: This part requires a full checkout. Otherwise, the merge base will 2024-12-18T00:20:11.0532165Z # be empty. The default action would be to continue rebuild the image 2024-12-18T00:20:11.0532675Z if [[ "$BASE_REVISION" = "$(git rev-parse HEAD)" ]]; then 2024-12-18T00:20:11.0533120Z  # if we're on the base branch then use the parent commit 2024-12-18T00:20:11.0533516Z  MERGE_BASE=$(git rev-parse HEAD~) 2024-12-18T00:20:11.0533843Z else 2024-12-18T00:20:11.0534167Z  # otherwise we're on a PR, so use the most recent base commit 2024-12-18T00:20:11.0534626Z  MERGE_BASE=$(git merge-base HEAD "$BASE_REVISION") 2024-12-18T00:20:11.0534977Z fi 2024-12-18T00:20:11.0535197Z  2024-12-18T00:20:11.0535435Z if [[ -z "${MERGE_BASE}" ]]; then 2024-12-18T00:20:11.0535834Z  echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2024-12-18T00:20:11.0536226Z  2024-12-18T00:20:11.0536857Z  echo "Finding merge base only works with full checkout, please set fetch-depth to 0, continuing ..." 2024-12-18T00:20:11.0537394Z  exit 0 2024-12-18T00:20:11.0537633Z fi 2024-12-18T00:20:11.0537849Z  2024-12-18T00:20:11.0538158Z if ! git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}"; then 2024-12-18T00:20:11.0538817Z  echo "Directory '${DOCKER_BUILD_DIR}' not found in commit $MERGE_BASE, you should rebase onto a more recent commit" 2024-12-18T00:20:11.0539369Z  exit 1 2024-12-18T00:20:11.0539597Z fi 2024-12-18T00:20:11.0539812Z  2024-12-18T00:20:11.0540168Z PREVIOUS_DOCKER_TAG=$(git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}") 2024-12-18T00:20:11.0540880Z # If no image exists but the hash is the same as the previous hash then we should error out here 2024-12-18T00:20:11.0541450Z if [[ "${PREVIOUS_DOCKER_TAG}" == "${DOCKER_TAG}" ]]; then 2024-12-18T00:20:11.0542111Z  echo "WARNING: Something has gone wrong and the previous image isn't available for the merge-base of your branch" 2024-12-18T00:20:11.0542868Z  echo " Will re-build docker image to store in local cache, TTS may be longer" 2024-12-18T00:20:11.0543322Z fi 2024-12-18T00:20:11.0543540Z  2024-12-18T00:20:11.0543809Z echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2024-12-18T00:20:11.0552666Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:20:11.0553030Z env: 2024-12-18T00:20:11.0553246Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:20:11.0553521Z DOCKER_BUILD_DIR: .ci/docker 2024-12-18T00:20:11.0553888Z BASE_REVISION: 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:20:11.0554808Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:20:11.0555707Z DOCKER_TAG: 45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:20:11.0556144Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-18T00:20:11.0556527Z DOCKER_PUSH: 2024-12-18T00:20:11.0556751Z ##[endgroup] 2024-12-18T00:20:11.0585920Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-18T00:20:11.0586364Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-18T00:20:11.0589634Z + aws ecr get-login-password --region us-east-1 2024-12-18T00:20:11.0590482Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-18T00:20:11.6075580Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-12-18T00:20:11.6076168Z Configure a credential helper to remove this warning. See 2024-12-18T00:20:11.6076724Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-12-18T00:20:11.6077099Z 2024-12-18T00:20:11.6077631Z Login Succeeded 2024-12-18T00:20:11.6104640Z ++ date +%s 2024-12-18T00:20:11.6118958Z + START_TIME=1734481211 2024-12-18T00:20:11.6122959Z ++ date +%s 2024-12-18T00:20:11.6135203Z + [[ 1734475811 -lt 1734481211 ]] 2024-12-18T00:20:11.6136197Z + docker manifest inspect 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:20:11.8529533Z { 2024-12-18T00:20:11.8530776Z "schemaVersion": 2, 2024-12-18T00:20:11.8531216Z "mediaType": "application/vnd.docker.distribution.manifest.v2+json", 2024-12-18T00:20:11.8531664Z "config": { 2024-12-18T00:20:11.8531997Z "mediaType": "application/vnd.docker.container.image.v1+json", 2024-12-18T00:20:11.8532416Z "size": 52680, 2024-12-18T00:20:11.8532847Z "digest": "sha256:67e93a8badaf799ceb664d7c453077c6c6785d56dc10c720be9358edeb91759b" 2024-12-18T00:20:11.8533355Z }, 2024-12-18T00:20:11.8533588Z "layers": [ 2024-12-18T00:20:11.8533802Z { 2024-12-18T00:20:11.8534138Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8534568Z "size": 28584506, 2024-12-18T00:20:11.8535352Z "digest": "sha256:80888bc6716fcbb8874e75ac88898d3e38e6f1bc55678f0e97ca9d706b7f3733" 2024-12-18T00:20:11.8535831Z }, 2024-12-18T00:20:11.8536040Z { 2024-12-18T00:20:11.8536368Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8536786Z "size": 7944698, 2024-12-18T00:20:11.8537213Z "digest": "sha256:fbcd35dc5bc3a7bda41926aadd083020f942b001ebac6f1d30480f0f065394c0" 2024-12-18T00:20:11.8537704Z }, 2024-12-18T00:20:11.8537895Z { 2024-12-18T00:20:11.8538233Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8538659Z "size": 57593527, 2024-12-18T00:20:11.8539091Z "digest": "sha256:c7232af9ae05f7de83f8d6171bd0c35a4dd0a85ebafb15b950dbc08f89ea5fb5" 2024-12-18T00:20:11.8539566Z }, 2024-12-18T00:20:11.8539763Z { 2024-12-18T00:20:11.8540092Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8540511Z "size": 185, 2024-12-18T00:20:11.8541030Z "digest": "sha256:db6cdef1932a0d9ca6ef9a539e08d491f66d1b1ed81926ae1525375bdd8100cc" 2024-12-18T00:20:11.8541518Z }, 2024-12-18T00:20:11.8541709Z { 2024-12-18T00:20:11.8542041Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8542642Z "size": 6886, 2024-12-18T00:20:11.8543166Z "digest": "sha256:56dc8550293751a1604e97ac949cfae82ba20cb2a28e034737bafd7382559609" 2024-12-18T00:20:11.8543920Z }, 2024-12-18T00:20:11.8544177Z { 2024-12-18T00:20:11.8544611Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8545166Z "size": 1374287670, 2024-12-18T00:20:11.8545696Z "digest": "sha256:30c0ea6140d07e2a8deb70d780f277c63cf61836ff33d66eef944728a4bef6bd" 2024-12-18T00:20:11.8546230Z }, 2024-12-18T00:20:11.8546536Z { 2024-12-18T00:20:11.8546968Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8547518Z "size": 62641, 2024-12-18T00:20:11.8548096Z "digest": "sha256:71bdb1a72c2d6dc97bbdbca82383f0260c4ee87556701e8e606c08a6bb0f0da5" 2024-12-18T00:20:11.8548688Z }, 2024-12-18T00:20:11.8548921Z { 2024-12-18T00:20:11.8549421Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8550131Z "size": 1685, 2024-12-18T00:20:11.8550655Z "digest": "sha256:4829486be7c30f19f4136fa56adbb3de206ed0bbf0705b59fb2147406778ce38" 2024-12-18T00:20:11.8551245Z }, 2024-12-18T00:20:11.8551488Z { 2024-12-18T00:20:11.8551926Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8552472Z "size": 1523, 2024-12-18T00:20:11.8552964Z "digest": "sha256:1f4e68d7b5e4224ba1da78ef461ff7f01e8d59c09d39281277521384105a9441" 2024-12-18T00:20:11.8553586Z }, 2024-12-18T00:20:11.8553875Z { 2024-12-18T00:20:11.8554247Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8554884Z "size": 2626741021, 2024-12-18T00:20:11.8555391Z "digest": "sha256:7c373e2d9b7e82a6878d4a31293dd857915a0fe47d07dce541cea03b043d57fc" 2024-12-18T00:20:11.8555945Z }, 2024-12-18T00:20:11.8556291Z { 2024-12-18T00:20:11.8556661Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8557177Z "size": 86545, 2024-12-18T00:20:11.8557721Z "digest": "sha256:6223811417458a3c93b84ee3b65f8b08d9e2828b926f0aed863041610d7d95d4" 2024-12-18T00:20:11.8558266Z }, 2024-12-18T00:20:11.8558603Z { 2024-12-18T00:20:11.8558989Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8559521Z "size": 1824, 2024-12-18T00:20:11.8560048Z "digest": "sha256:f003d065e31e5e8c0cea490c88a912dd331bddcbd2f5ff22ccc692a5343bcbeb" 2024-12-18T00:20:11.8560632Z }, 2024-12-18T00:20:11.8560935Z { 2024-12-18T00:20:11.8561333Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8561850Z "size": 246420139, 2024-12-18T00:20:11.8562384Z "digest": "sha256:cd6ce71168153e485b99493ce07032bbd9fd5cefceb68ef33ce088244306a653" 2024-12-18T00:20:11.8563058Z }, 2024-12-18T00:20:11.8563347Z { 2024-12-18T00:20:11.8563930Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8564393Z "size": 703, 2024-12-18T00:20:11.8564884Z "digest": "sha256:e843066a8f68042266cfe814f1729975619fb8f733f371be115e8b2fe81cbc9d" 2024-12-18T00:20:11.8565488Z }, 2024-12-18T00:20:11.8565786Z { 2024-12-18T00:20:11.8566230Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8566704Z "size": 1256, 2024-12-18T00:20:11.8567229Z "digest": "sha256:bac50ca2930bc4b1afa8a2f1b4b0d1d499d63b7922b784af690c3b31ec0c2f70" 2024-12-18T00:20:11.8567837Z }, 2024-12-18T00:20:11.8568131Z { 2024-12-18T00:20:11.8568568Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8569061Z "size": 484, 2024-12-18T00:20:11.8569584Z "digest": "sha256:57e52c6751f4d865ada4cae919859fe563fe5dcbb93ca82cb4746f98caccbd3a" 2024-12-18T00:20:11.8570135Z }, 2024-12-18T00:20:11.8570463Z { 2024-12-18T00:20:11.8570901Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8571360Z "size": 91715265, 2024-12-18T00:20:11.8571919Z "digest": "sha256:a9c5c14d77c035c7501566b1247024dfd241bd6bc12fbe2bca28ec7d90b26069" 2024-12-18T00:20:11.8572486Z }, 2024-12-18T00:20:11.8572749Z { 2024-12-18T00:20:11.8573252Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8573760Z "size": 3706, 2024-12-18T00:20:11.8574238Z "digest": "sha256:b86099b8619ad88e8fe6c8e693180d52e0f2fbeac5927f0b403c8a9ef76d7f6b" 2024-12-18T00:20:11.8574880Z }, 2024-12-18T00:20:11.8575156Z { 2024-12-18T00:20:11.8575597Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8576125Z "size": 1860, 2024-12-18T00:20:11.8576594Z "digest": "sha256:3c8ea8a600fff6cce4c1b36acc5f3949ecd664e55b5eaf4a50fe5499351574a6" 2024-12-18T00:20:11.8577178Z }, 2024-12-18T00:20:11.8577490Z { 2024-12-18T00:20:11.8577896Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8578469Z "size": 701, 2024-12-18T00:20:11.8578932Z "digest": "sha256:bebd539a1d598fe86afc0da77bf16ae4c7ebfb9f031f21ed7634150fbe23f996" 2024-12-18T00:20:11.8579629Z }, 2024-12-18T00:20:11.8579957Z { 2024-12-18T00:20:11.8580368Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8581004Z "size": 478, 2024-12-18T00:20:11.8581520Z "digest": "sha256:292b18ec2dab9bd60d00192387c1269d39b0b4886b782585d2c879808218fc66" 2024-12-18T00:20:11.8582062Z }, 2024-12-18T00:20:11.8582348Z { 2024-12-18T00:20:11.8582819Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8583339Z "size": 2941869535, 2024-12-18T00:20:11.8583866Z "digest": "sha256:76e3817b4b4cec0a5b005161867dc257681b792271ba9d23c9b79b3a6801dcd9" 2024-12-18T00:20:11.8584383Z }, 2024-12-18T00:20:11.8584687Z { 2024-12-18T00:20:11.8585127Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8585645Z "size": 380, 2024-12-18T00:20:11.8586152Z "digest": "sha256:50b1f245e9f5be8670d8ba5790e3b96450eee3428dcac7060367db48ae00234e" 2024-12-18T00:20:11.8586705Z }, 2024-12-18T00:20:11.8587112Z { 2024-12-18T00:20:11.8587532Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8588084Z "size": 12901, 2024-12-18T00:20:11.8588615Z "digest": "sha256:ad93cf5205f24ada86b5f7eab5b63ed97ae7858368f6fdbce373343d2568d66e" 2024-12-18T00:20:11.8589141Z }, 2024-12-18T00:20:11.8589486Z { 2024-12-18T00:20:11.8589930Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8590418Z "size": 863, 2024-12-18T00:20:11.8591000Z "digest": "sha256:8d17c59eaf7d84d49e3660380debcc70734b2a178e6cab86f0d4fd3e7a8100d1" 2024-12-18T00:20:11.8591524Z }, 2024-12-18T00:20:11.8591798Z { 2024-12-18T00:20:11.8592303Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8592882Z "size": 106, 2024-12-18T00:20:11.8593591Z "digest": "sha256:b36a8ccf5c8c8ef0bf3e168ec9f568a0ada36c49103c9cacfef6dd072ddd681a" 2024-12-18T00:20:11.8594223Z }, 2024-12-18T00:20:11.8594493Z { 2024-12-18T00:20:11.8594990Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8595535Z "size": 504, 2024-12-18T00:20:11.8596043Z "digest": "sha256:aa0a3b87e9e34ab15903206018bfd9fb1eb54fd21f05a61ef254557703890732" 2024-12-18T00:20:11.8596676Z }, 2024-12-18T00:20:11.8596937Z { 2024-12-18T00:20:11.8597395Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8598029Z "size": 121477314, 2024-12-18T00:20:11.8598546Z "digest": "sha256:72a632052c5be4900c60ce09e32f8a0fd3b637ab0b7685dc5b07bda4776ddd15" 2024-12-18T00:20:11.8599111Z }, 2024-12-18T00:20:11.8599425Z { 2024-12-18T00:20:11.8599833Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8600345Z "size": 109, 2024-12-18T00:20:11.8600919Z "digest": "sha256:ceed6316bc249ffffee9563cb7505023b3e70fba306f187bd612fece63508263" 2024-12-18T00:20:11.8601501Z }, 2024-12-18T00:20:11.8601733Z { 2024-12-18T00:20:11.8602223Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8602754Z "size": 489, 2024-12-18T00:20:11.8603291Z "digest": "sha256:d0ca0f491f809a9f1dedd391f5b25cc3f59d8e95e7f76299f18ec3c931e56ed1" 2024-12-18T00:20:11.8603963Z }, 2024-12-18T00:20:11.8604240Z { 2024-12-18T00:20:11.8604688Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8605239Z "size": 296, 2024-12-18T00:20:11.8605741Z "digest": "sha256:cf02c706cd567c781eeb567c90960801dc1ef78872b73fbc047df898951ecbb8" 2024-12-18T00:20:11.8606342Z }, 2024-12-18T00:20:11.8606654Z { 2024-12-18T00:20:11.8607037Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8607595Z "size": 103, 2024-12-18T00:20:11.8608122Z "digest": "sha256:16073d3f107dab837d7edb5e6044449660fec7e2ded263ca81d5dcfea5beb486" 2024-12-18T00:20:11.8608676Z }, 2024-12-18T00:20:11.8609140Z { 2024-12-18T00:20:11.8609518Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8610105Z "size": 1473, 2024-12-18T00:20:11.8610683Z "digest": "sha256:d234faf2f1bfb6cb9d4ba14103226d20d540e568b47690b67c2a2b2c5a49645f" 2024-12-18T00:20:11.8611248Z }, 2024-12-18T00:20:11.8611771Z { 2024-12-18T00:20:11.8626109Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8626838Z "size": 430258758, 2024-12-18T00:20:11.8627256Z "digest": "sha256:3f0ade86af1a5bc72c9088735bb1a7ab9819fa20fdd96437fc080b2c711dfd3d" 2024-12-18T00:20:11.8627728Z }, 2024-12-18T00:20:11.8627919Z { 2024-12-18T00:20:11.8628242Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8628648Z "size": 164, 2024-12-18T00:20:11.8629038Z "digest": "sha256:034b6a03f5f751ed12f7505175ce3443eb3ed7b34d02d1bb25de0ee52d93a44b" 2024-12-18T00:20:11.8629485Z }, 2024-12-18T00:20:11.8629688Z { 2024-12-18T00:20:11.8630007Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8630413Z "size": 564, 2024-12-18T00:20:11.8630798Z "digest": "sha256:21f8f066852dd484ccbf79470452fe8005cde08773dd4fedc07fed783a0b9bf8" 2024-12-18T00:20:11.8631242Z }, 2024-12-18T00:20:11.8631429Z { 2024-12-18T00:20:11.8631742Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8632142Z "size": 35865656, 2024-12-18T00:20:11.8632534Z "digest": "sha256:9dc1f315a979ec860a882d7df33584e02c1d18f86293521839ce42e21082e639" 2024-12-18T00:20:11.8632986Z }, 2024-12-18T00:20:11.8633176Z { 2024-12-18T00:20:11.8633520Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8633940Z "size": 104, 2024-12-18T00:20:11.8634313Z "digest": "sha256:cd6a6063178b945c150fe21a31df6e33203295dd814802e0658835e810fb2bf9" 2024-12-18T00:20:11.8634746Z }, 2024-12-18T00:20:11.8634937Z { 2024-12-18T00:20:11.8635459Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8635864Z "size": 425, 2024-12-18T00:20:11.8636244Z "digest": "sha256:2116738f4ea9299766a55629d39b881c4d33fc4fc0ce915965be1a850fcd7aaa" 2024-12-18T00:20:11.8636676Z }, 2024-12-18T00:20:11.8636865Z { 2024-12-18T00:20:11.8637180Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8637573Z "size": 20262160, 2024-12-18T00:20:11.8637973Z "digest": "sha256:d7fa134316d91d2ec39bceb121619d44cdfdf1c7ac30c72768a9fd48f9763bd1" 2024-12-18T00:20:11.8638438Z }, 2024-12-18T00:20:11.8638624Z { 2024-12-18T00:20:11.8638937Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8639331Z "size": 643, 2024-12-18T00:20:11.8639718Z "digest": "sha256:af03dc3fd15ea8f5f1fa41d514400f6a1d963985cf046b09d789f7f0359b2aba" 2024-12-18T00:20:11.8640163Z }, 2024-12-18T00:20:11.8640350Z { 2024-12-18T00:20:11.8640674Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8641066Z "size": 701, 2024-12-18T00:20:11.8641463Z "digest": "sha256:bebd539a1d598fe86afc0da77bf16ae4c7ebfb9f031f21ed7634150fbe23f996" 2024-12-18T00:20:11.8641923Z }, 2024-12-18T00:20:11.8642111Z { 2024-12-18T00:20:11.8642426Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8642827Z "size": 142, 2024-12-18T00:20:11.8643207Z "digest": "sha256:fd9de3dc425828e7b8984d4ced05f4102762137b81a5dc67104fc6b0805c570d" 2024-12-18T00:20:11.8643653Z }, 2024-12-18T00:20:11.8643843Z { 2024-12-18T00:20:11.8644162Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8644557Z "size": 135, 2024-12-18T00:20:11.8644938Z "digest": "sha256:b85093661f7768ac691f4b3ee5f553b9ab14cb2a6877c8edc6133d74caa88f69" 2024-12-18T00:20:11.8645386Z }, 2024-12-18T00:20:11.8645576Z { 2024-12-18T00:20:11.8645892Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8646296Z "size": 4995482131, 2024-12-18T00:20:11.8646703Z "digest": "sha256:ab6ef6c2ac4d23af7a3249cee1d4761f63a89513796ba720da7cc425c8afa6d2" 2024-12-18T00:20:11.8647297Z }, 2024-12-18T00:20:11.8647490Z { 2024-12-18T00:20:11.8647807Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8648213Z "size": 196, 2024-12-18T00:20:11.8648593Z "digest": "sha256:56c896077120aaa4cbcc2203662d13b4ea14cf998e9657e91b252535ceae5348" 2024-12-18T00:20:11.8649036Z }, 2024-12-18T00:20:11.8649225Z { 2024-12-18T00:20:11.8649540Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8649945Z "size": 564, 2024-12-18T00:20:11.8650331Z "digest": "sha256:d88e9c5e7c70fe36bd1bd2e94d43d4192d94a1f28e323234a73a75a2d1da48f1" 2024-12-18T00:20:11.8650781Z }, 2024-12-18T00:20:11.8650967Z { 2024-12-18T00:20:11.8651284Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8651673Z "size": 43164612, 2024-12-18T00:20:11.8652081Z "digest": "sha256:53617ee83302d7f97eb56f6756d78d18f8dc41bf252bf2d04cb643198f400f6f" 2024-12-18T00:20:11.8652554Z }, 2024-12-18T00:20:11.8652744Z { 2024-12-18T00:20:11.8653060Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8653458Z "size": 106, 2024-12-18T00:20:11.8653855Z "digest": "sha256:3edbde10d4043bf2ebf32fddfa55c8d0923435465637df7dc8f4addcc03a0b84" 2024-12-18T00:20:11.8654330Z }, 2024-12-18T00:20:11.8654518Z { 2024-12-18T00:20:11.8654837Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8655235Z "size": 1402, 2024-12-18T00:20:11.8655624Z "digest": "sha256:f4038f7524c3ed705e7560db6dd6efe76f548363f16bc7a93cfe360d5bc6dcaa" 2024-12-18T00:20:11.8656071Z }, 2024-12-18T00:20:11.8656260Z { 2024-12-18T00:20:11.8656575Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8656968Z "size": 701, 2024-12-18T00:20:11.8657478Z "digest": "sha256:bebd539a1d598fe86afc0da77bf16ae4c7ebfb9f031f21ed7634150fbe23f996" 2024-12-18T00:20:11.8657943Z }, 2024-12-18T00:20:11.8658142Z { 2024-12-18T00:20:11.8658457Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8658848Z "size": 137, 2024-12-18T00:20:11.8659236Z "digest": "sha256:4a51173f77576ab68fba2f862dd4d12b9ff1f250145c090520b05f88f5c81391" 2024-12-18T00:20:11.8659683Z }, 2024-12-18T00:20:11.8659872Z { 2024-12-18T00:20:11.8660190Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8660582Z "size": 120, 2024-12-18T00:20:11.8661056Z "digest": "sha256:ed6a71d41274e5b1eea4025d24a4851d6880b902b08f7d4dd0618ea81154f575" 2024-12-18T00:20:11.8661504Z }, 2024-12-18T00:20:11.8661694Z { 2024-12-18T00:20:11.8662009Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8662412Z "size": 4886226234, 2024-12-18T00:20:11.8662827Z "digest": "sha256:389dc939e2a414ef26b642b1e8657a710358afa6a6be3ebc4380b01ffacbbacc" 2024-12-18T00:20:11.8663277Z }, 2024-12-18T00:20:11.8663473Z { 2024-12-18T00:20:11.8663844Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8664235Z "size": 174, 2024-12-18T00:20:11.8664631Z "digest": "sha256:0341eaeed33df462f8bd28003bb9b09739b0786abba58ccc17ba4cec535ee4ef" 2024-12-18T00:20:11.8665089Z }, 2024-12-18T00:20:11.8665281Z { 2024-12-18T00:20:11.8665599Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8665991Z "size": 908, 2024-12-18T00:20:11.8666384Z "digest": "sha256:537cdb2d31685c0dbaf612d24633539a141cfcb69d90c5ce932923a6e4ab4474" 2024-12-18T00:20:11.8666836Z }, 2024-12-18T00:20:11.8667025Z { 2024-12-18T00:20:11.8667345Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8667733Z "size": 701, 2024-12-18T00:20:11.8668134Z "digest": "sha256:bebd539a1d598fe86afc0da77bf16ae4c7ebfb9f031f21ed7634150fbe23f996" 2024-12-18T00:20:11.8668605Z }, 2024-12-18T00:20:11.8668797Z { 2024-12-18T00:20:11.8669109Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8669597Z "size": 135, 2024-12-18T00:20:11.8669979Z "digest": "sha256:76d4a07024975dd727ff7b1c8873c513043bc9a5d310b469e51c3b110fdb6084" 2024-12-18T00:20:11.8670419Z }, 2024-12-18T00:20:11.8670607Z { 2024-12-18T00:20:11.8670923Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8671312Z "size": 32, 2024-12-18T00:20:11.8671704Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-12-18T00:20:11.8672158Z }, 2024-12-18T00:20:11.8672347Z { 2024-12-18T00:20:11.8672666Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8673055Z "size": 159, 2024-12-18T00:20:11.8673459Z "digest": "sha256:3287a539d61e3913b93941ecd49e55887b5122d63403e0fe9e7a3a63b6ed03c6" 2024-12-18T00:20:11.8673918Z }, 2024-12-18T00:20:11.8674118Z { 2024-12-18T00:20:11.8674433Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8674835Z "size": 1932, 2024-12-18T00:20:11.8675217Z "digest": "sha256:9b763e24a7d42c731eb337815675c9478832146e73305559d0db1c88a0731492" 2024-12-18T00:20:11.8675649Z }, 2024-12-18T00:20:11.8675836Z { 2024-12-18T00:20:11.8676148Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8676540Z "size": 196810750, 2024-12-18T00:20:11.8676948Z "digest": "sha256:f6ef3d4c814e330a230273579dc978970563774df75f73fba78181ddcf6ab98e" 2024-12-18T00:20:11.8677393Z }, 2024-12-18T00:20:11.8677585Z { 2024-12-18T00:20:11.8677902Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8678297Z "size": 165, 2024-12-18T00:20:11.8678688Z "digest": "sha256:06914b00eb49b8005245cba4a631c34d0a2aaf8bf6291bc6477705206de11a06" 2024-12-18T00:20:11.8679129Z }, 2024-12-18T00:20:11.8679318Z { 2024-12-18T00:20:11.8679729Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8680121Z "size": 7943, 2024-12-18T00:20:11.8680507Z "digest": "sha256:724553524224508e03de9422ca47b1a1c047e53cd305c2a1344147bb0d82d1d0" 2024-12-18T00:20:11.8680946Z }, 2024-12-18T00:20:11.8681133Z { 2024-12-18T00:20:11.8681445Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8681832Z "size": 8070, 2024-12-18T00:20:11.8682230Z "digest": "sha256:47d9fb6dae26902b0fdb744916689adbd42add22a476d1c5ec89ae4e30b91e39" 2024-12-18T00:20:11.8682687Z }, 2024-12-18T00:20:11.8682879Z { 2024-12-18T00:20:11.8683190Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8683622Z "size": 303, 2024-12-18T00:20:11.8684031Z "digest": "sha256:acce7b690dcb2fde77ba3ce65df70452fc7c98de73a42fe72652e477f86fc62d" 2024-12-18T00:20:11.8684489Z }, 2024-12-18T00:20:11.8684674Z { 2024-12-18T00:20:11.8684996Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8685388Z "size": 7633763, 2024-12-18T00:20:11.8685796Z "digest": "sha256:58dc9f64def75bcb2abecdf39b798c3800e837d37da971e766a05731ea5537c2" 2024-12-18T00:20:11.8686258Z }, 2024-12-18T00:20:11.8686444Z { 2024-12-18T00:20:11.8686751Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8687140Z "size": 108, 2024-12-18T00:20:11.8687532Z "digest": "sha256:94dfe5ef1b7e91ebd6a1a5acc1d7732e051334d5102d8a69c509c1d2f6e95598" 2024-12-18T00:20:11.8687984Z }, 2024-12-18T00:20:11.8688172Z { 2024-12-18T00:20:11.8688485Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8688880Z "size": 54145665, 2024-12-18T00:20:11.8689274Z "digest": "sha256:40a2c9135b0683a7e2432748a9a6ff19926f6a2a49722d844c07e307320f7362" 2024-12-18T00:20:11.8689714Z }, 2024-12-18T00:20:11.8689902Z { 2024-12-18T00:20:11.8690211Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8690611Z "size": 484, 2024-12-18T00:20:11.8690992Z "digest": "sha256:8839d6b0c8218eccb426367e5bfe066b172b8c6059bae8473e915e11c4e582a9" 2024-12-18T00:20:11.8691521Z }, 2024-12-18T00:20:11.8691709Z { 2024-12-18T00:20:11.8692016Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8692410Z "size": 1374859271, 2024-12-18T00:20:11.8692809Z "digest": "sha256:1c588f0a9e97f3e192252a179d987d1ba1e5201ba4b6e74c429074e9e34df1b2" 2024-12-18T00:20:11.8693249Z }, 2024-12-18T00:20:11.8693437Z { 2024-12-18T00:20:11.8693745Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8694138Z "size": 106, 2024-12-18T00:20:11.8694523Z "digest": "sha256:6727e7e279360b8b66f0137a15b357efede06e69bfd0800ebad6ed7c8ed71df4" 2024-12-18T00:20:11.8694974Z }, 2024-12-18T00:20:11.8695155Z { 2024-12-18T00:20:11.8695468Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8695862Z "size": 568, 2024-12-18T00:20:11.8696250Z "digest": "sha256:3a55100d1957b103c43e314deb55697c459aa6fa225f91e7b1c69bc4c01dca4e" 2024-12-18T00:20:11.8696692Z }, 2024-12-18T00:20:11.8696873Z { 2024-12-18T00:20:11.8697185Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8697577Z "size": 303706071, 2024-12-18T00:20:11.8697970Z "digest": "sha256:3d6f160d335161c5321e13ce2823ec68379a6a3401b07bd7378602a69c85b80c" 2024-12-18T00:20:11.8698414Z }, 2024-12-18T00:20:11.8698592Z { 2024-12-18T00:20:11.8698902Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8699294Z "size": 111, 2024-12-18T00:20:11.8699680Z "digest": "sha256:b2a8bb947a87562144fe67a39c280d4dee50cbe9d8ff349140f5db6c377517e6" 2024-12-18T00:20:11.8700126Z }, 2024-12-18T00:20:11.8700308Z { 2024-12-18T00:20:11.8700619Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8701062Z "size": 529, 2024-12-18T00:20:11.8701551Z "digest": "sha256:69a74b2360f4ede95654274ce7ef6cc1597a7234cc17e86d5cdf4c98286d97c3" 2024-12-18T00:20:11.8701996Z }, 2024-12-18T00:20:11.8702187Z { 2024-12-18T00:20:11.8702503Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8702896Z "size": 48289052, 2024-12-18T00:20:11.8703295Z "digest": "sha256:f9e12a253d89c16863b9d4d90138ffa673447c9b7f27afcba54a2a679e58b5ab" 2024-12-18T00:20:11.8703788Z }, 2024-12-18T00:20:11.8703968Z { 2024-12-18T00:20:11.8704284Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8704677Z "size": 106, 2024-12-18T00:20:11.8705066Z "digest": "sha256:8fdb06d51b96d538045b9566a381de3dc25e59d1adb9d0a4e567afcb3213f676" 2024-12-18T00:20:11.8705511Z }, 2024-12-18T00:20:11.8705692Z { 2024-12-18T00:20:11.8706001Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8706391Z "size": 32, 2024-12-18T00:20:11.8706787Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-12-18T00:20:11.8707235Z }, 2024-12-18T00:20:11.8707416Z { 2024-12-18T00:20:11.8707733Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8708125Z "size": 32, 2024-12-18T00:20:11.8708518Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-12-18T00:20:11.8708967Z }, 2024-12-18T00:20:11.8709148Z { 2024-12-18T00:20:11.8709457Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8709848Z "size": 32, 2024-12-18T00:20:11.8710245Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-12-18T00:20:11.8710688Z }, 2024-12-18T00:20:11.8710867Z { 2024-12-18T00:20:11.8711178Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:20:11.8711572Z "size": 32, 2024-12-18T00:20:11.8711963Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-12-18T00:20:11.8712420Z } 2024-12-18T00:20:11.8712605Z ] 2024-12-18T00:20:11.8712792Z } 2024-12-18T00:20:11.8712999Z + exit 0 2024-12-18T00:20:11.8747628Z ##[group]Run set -eux 2024-12-18T00:20:11.8747923Z set -eux 2024-12-18T00:20:11.8748747Z aws secretsmanager get-secret-value --secret-id docker_hub_readonly_token | jq --raw-output '.SecretString' | jq -r .docker_hub_readonly_token | docker login --username pytorchbot --password-stdin 2024-12-18T00:20:11.8758223Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:20:11.8758593Z env: 2024-12-18T00:20:11.8758807Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:20:11.8759070Z ##[endgroup] 2024-12-18T00:20:11.8791008Z + aws secretsmanager get-secret-value --secret-id docker_hub_readonly_token 2024-12-18T00:20:11.8792353Z + jq --raw-output .SecretString 2024-12-18T00:20:11.8793346Z + jq -r .docker_hub_readonly_token 2024-12-18T00:20:11.8795242Z + docker login --username pytorchbot --password-stdin 2024-12-18T00:20:12.5025807Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-12-18T00:20:12.5026641Z Configure a credential helper to remove this warning. See 2024-12-18T00:20:12.5027227Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-12-18T00:20:12.5027615Z 2024-12-18T00:20:12.5030265Z Login Succeeded 2024-12-18T00:20:12.5127837Z ##[group]Run tag=${ECR_DOCKER_IMAGE##*/} 2024-12-18T00:20:12.5128217Z tag=${ECR_DOCKER_IMAGE##*/} 2024-12-18T00:20:12.5128608Z echo "docker pull ghcr.io/pytorch/ci-image:${tag/:/-}" 2024-12-18T00:20:12.5137435Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:20:12.5137810Z env: 2024-12-18T00:20:12.5138044Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:20:12.5138894Z ECR_DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:20:12.5139755Z ##[endgroup] 2024-12-18T00:20:12.5170712Z docker pull ghcr.io/pytorch/ci-image:pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks-45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:20:12.5221393Z ##[group]Run pytorch/test-infra/.github/actions/pull-docker-image@release/2.6 2024-12-18T00:20:12.5221861Z with: 2024-12-18T00:20:12.5222646Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:20:12.5223606Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-18T00:20:12.5223986Z env: 2024-12-18T00:20:12.5224200Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:20:12.5224486Z ##[endgroup] 2024-12-18T00:20:12.5244278Z ##[group]Run set -x 2024-12-18T00:20:12.5244554Z set -x 2024-12-18T00:20:12.5244787Z set +e 2024-12-18T00:20:12.5245007Z  2024-12-18T00:20:12.5245226Z login() { 2024-12-18T00:20:12.5245690Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2024-12-18T00:20:12.5246202Z } 2024-12-18T00:20:12.5246432Z  2024-12-18T00:20:12.5246674Z retry () { 2024-12-18T00:20:12.5246951Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2024-12-18T00:20:12.5247260Z } 2024-12-18T00:20:12.5247473Z  2024-12-18T00:20:12.5247709Z retry login "${DOCKER_REGISTRY}" 2024-12-18T00:20:12.5248011Z  2024-12-18T00:20:12.5248218Z set -e 2024-12-18T00:20:12.5248545Z # ignore output since only exit code is used for conditional 2024-12-18T00:20:12.5249018Z # only pull docker image if it's not available locally 2024-12-18T00:20:12.5249539Z if ! docker inspect --type=image "${DOCKER_IMAGE}" >/dev/null 2>/dev/null; then 2024-12-18T00:20:12.5250020Z  retry docker pull "${DOCKER_IMAGE}" 2024-12-18T00:20:12.5250333Z fi 2024-12-18T00:20:12.5259030Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:20:12.5259394Z env: 2024-12-18T00:20:12.5259612Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:20:12.5260629Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:20:12.5261700Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-18T00:20:12.5262083Z ##[endgroup] 2024-12-18T00:20:12.5290485Z + set +e 2024-12-18T00:20:12.5290961Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-18T00:20:12.5291407Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-18T00:20:12.5294860Z + aws ecr get-login-password --region us-east-1 2024-12-18T00:20:12.5295560Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-18T00:20:13.0918759Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-12-18T00:20:13.0920255Z Configure a credential helper to remove this warning. See 2024-12-18T00:20:13.0921395Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-12-18T00:20:13.0922192Z 2024-12-18T00:20:13.0922385Z Login Succeeded 2024-12-18T00:20:13.0943984Z + set -e 2024-12-18T00:20:13.0944849Z + docker inspect --type=image 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:20:13.1110749Z + retry docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:20:13.1112197Z + docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:20:13.4340972Z 45e1356b47a284893081276eff3000b7b534f3b1: Pulling from pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks 2024-12-18T00:20:13.4352069Z 80888bc6716f: Pulling fs layer 2024-12-18T00:20:13.4352403Z fbcd35dc5bc3: Pulling fs layer 2024-12-18T00:20:13.4353148Z c7232af9ae05: Pulling fs layer 2024-12-18T00:20:13.4353453Z db6cdef1932a: Pulling fs layer 2024-12-18T00:20:13.4353729Z 56dc85502937: Pulling fs layer 2024-12-18T00:20:13.4354026Z 30c0ea6140d0: Pulling fs layer 2024-12-18T00:20:13.4354362Z 71bdb1a72c2d: Pulling fs layer 2024-12-18T00:20:13.4354679Z 4829486be7c3: Pulling fs layer 2024-12-18T00:20:13.4354959Z 1f4e68d7b5e4: Pulling fs layer 2024-12-18T00:20:13.4355233Z 7c373e2d9b7e: Pulling fs layer 2024-12-18T00:20:13.4355513Z 622381141745: Pulling fs layer 2024-12-18T00:20:13.4355797Z f003d065e31e: Pulling fs layer 2024-12-18T00:20:13.4356089Z cd6ce7116815: Pulling fs layer 2024-12-18T00:20:13.4356369Z e843066a8f68: Pulling fs layer 2024-12-18T00:20:13.4356644Z bac50ca2930b: Pulling fs layer 2024-12-18T00:20:13.4356925Z 57e52c6751f4: Pulling fs layer 2024-12-18T00:20:13.4357202Z a9c5c14d77c0: Pulling fs layer 2024-12-18T00:20:13.4357481Z b86099b8619a: Pulling fs layer 2024-12-18T00:20:13.4357751Z 30c0ea6140d0: Waiting 2024-12-18T00:20:13.4358017Z 3c8ea8a600ff: Pulling fs layer 2024-12-18T00:20:13.4358294Z 71bdb1a72c2d: Waiting 2024-12-18T00:20:13.4358550Z bebd539a1d59: Pulling fs layer 2024-12-18T00:20:13.4358823Z 4829486be7c3: Waiting 2024-12-18T00:20:13.4359074Z 292b18ec2dab: Pulling fs layer 2024-12-18T00:20:13.4359339Z 1f4e68d7b5e4: Waiting 2024-12-18T00:20:13.4359588Z 76e3817b4b4c: Pulling fs layer 2024-12-18T00:20:13.4359984Z 50b1f245e9f5: Pulling fs layer 2024-12-18T00:20:13.4360354Z 7c373e2d9b7e: Waiting 2024-12-18T00:20:13.4360668Z ad93cf5205f2: Pulling fs layer 2024-12-18T00:20:13.4361284Z cd6ce7116815: Waiting 2024-12-18T00:20:13.4361648Z 622381141745: Waiting 2024-12-18T00:20:13.4362076Z 8d17c59eaf7d: Pulling fs layer 2024-12-18T00:20:13.4362494Z e843066a8f68: Waiting 2024-12-18T00:20:13.4362839Z f003d065e31e: Waiting 2024-12-18T00:20:13.4363262Z b36a8ccf5c8c: Pulling fs layer 2024-12-18T00:20:13.4363607Z aa0a3b87e9e3: Pulling fs layer 2024-12-18T00:20:13.4364080Z 72a632052c5b: Pulling fs layer 2024-12-18T00:20:13.4364694Z ceed6316bc24: Pulling fs layer 2024-12-18T00:20:13.4365097Z d0ca0f491f80: Pulling fs layer 2024-12-18T00:20:13.4365502Z cf02c706cd56: Pulling fs layer 2024-12-18T00:20:13.4376417Z bac50ca2930b: Waiting 2024-12-18T00:20:13.4376697Z 76e3817b4b4c: Waiting 2024-12-18T00:20:13.4376949Z 16073d3f107d: Pulling fs layer 2024-12-18T00:20:13.4377216Z 50b1f245e9f5: Waiting 2024-12-18T00:20:13.4377480Z d234faf2f1bf: Pulling fs layer 2024-12-18T00:20:13.4377753Z 57e52c6751f4: Waiting 2024-12-18T00:20:13.4378009Z ad93cf5205f2: Waiting 2024-12-18T00:20:13.4378268Z 3f0ade86af1a: Pulling fs layer 2024-12-18T00:20:13.4378544Z a9c5c14d77c0: Waiting 2024-12-18T00:20:13.4378798Z 034b6a03f5f7: Pulling fs layer 2024-12-18T00:20:13.4379067Z b86099b8619a: Waiting 2024-12-18T00:20:13.4379309Z 21f8f066852d: Pulling fs layer 2024-12-18T00:20:13.4379581Z 8d17c59eaf7d: Waiting 2024-12-18T00:20:13.4379824Z 3c8ea8a600ff: Waiting 2024-12-18T00:20:13.4380066Z bebd539a1d59: Waiting 2024-12-18T00:20:13.4380320Z 9dc1f315a979: Pulling fs layer 2024-12-18T00:20:13.4380601Z b36a8ccf5c8c: Waiting 2024-12-18T00:20:13.4380983Z cd6a6063178b: Pulling fs layer 2024-12-18T00:20:13.4381324Z 292b18ec2dab: Waiting 2024-12-18T00:20:13.4381575Z aa0a3b87e9e3: Waiting 2024-12-18T00:20:13.4381814Z 72a632052c5b: Waiting 2024-12-18T00:20:13.4382050Z 2116738f4ea9: Pulling fs layer 2024-12-18T00:20:13.4382320Z db6cdef1932a: Waiting 2024-12-18T00:20:13.4382560Z ceed6316bc24: Waiting 2024-12-18T00:20:13.4382799Z 3f0ade86af1a: Waiting 2024-12-18T00:20:13.4383047Z d7fa134316d9: Pulling fs layer 2024-12-18T00:20:13.4383309Z d0ca0f491f80: Waiting 2024-12-18T00:20:13.4383558Z af03dc3fd15e: Pulling fs layer 2024-12-18T00:20:13.4383828Z 034b6a03f5f7: Waiting 2024-12-18T00:20:13.4384067Z cf02c706cd56: Waiting 2024-12-18T00:20:13.4384299Z 21f8f066852d: Waiting 2024-12-18T00:20:13.4384523Z 16073d3f107d: Waiting 2024-12-18T00:20:13.4384755Z 56dc85502937: Waiting 2024-12-18T00:20:13.4384985Z d234faf2f1bf: Waiting 2024-12-18T00:20:13.4385224Z 9dc1f315a979: Waiting 2024-12-18T00:20:13.4385614Z d7fa134316d9: Waiting 2024-12-18T00:20:13.4385853Z af03dc3fd15e: Waiting 2024-12-18T00:20:13.4386088Z 2116738f4ea9: Waiting 2024-12-18T00:20:13.4386316Z cd6a6063178b: Waiting 2024-12-18T00:20:13.4386558Z fd9de3dc4258: Pulling fs layer 2024-12-18T00:20:13.4386827Z b85093661f77: Pulling fs layer 2024-12-18T00:20:13.4387105Z ab6ef6c2ac4d: Pulling fs layer 2024-12-18T00:20:13.4387381Z 56c896077120: Pulling fs layer 2024-12-18T00:20:13.4387641Z fd9de3dc4258: Waiting 2024-12-18T00:20:13.4387880Z b85093661f77: Waiting 2024-12-18T00:20:13.4388165Z d88e9c5e7c70: Pulling fs layer 2024-12-18T00:20:13.4388459Z 53617ee83302: Pulling fs layer 2024-12-18T00:20:13.4388768Z d88e9c5e7c70: Waiting 2024-12-18T00:20:13.4389022Z 3edbde10d404: Pulling fs layer 2024-12-18T00:20:13.4389330Z f4038f7524c3: Pulling fs layer 2024-12-18T00:20:13.4389643Z ab6ef6c2ac4d: Waiting 2024-12-18T00:20:13.4389897Z 4a51173f7757: Pulling fs layer 2024-12-18T00:20:13.4390210Z 3edbde10d404: Waiting 2024-12-18T00:20:13.4390456Z 53617ee83302: Waiting 2024-12-18T00:20:13.4390697Z ed6a71d41274: Pulling fs layer 2024-12-18T00:20:13.4390992Z f4038f7524c3: Waiting 2024-12-18T00:20:13.4391240Z 389dc939e2a4: Pulling fs layer 2024-12-18T00:20:13.4391508Z 4a51173f7757: Waiting 2024-12-18T00:20:13.4391746Z ed6a71d41274: Waiting 2024-12-18T00:20:13.4391994Z 0341eaeed33d: Pulling fs layer 2024-12-18T00:20:13.4392270Z 537cdb2d3168: Pulling fs layer 2024-12-18T00:20:13.4392553Z 76d4a0702497: Pulling fs layer 2024-12-18T00:20:13.4392816Z 537cdb2d3168: Waiting 2024-12-18T00:20:13.4393061Z 0341eaeed33d: Waiting 2024-12-18T00:20:13.4393312Z 4f4fb700ef54: Pulling fs layer 2024-12-18T00:20:13.4393581Z 3287a539d61e: Pulling fs layer 2024-12-18T00:20:13.4393848Z 76d4a0702497: Waiting 2024-12-18T00:20:13.4394083Z 4f4fb700ef54: Waiting 2024-12-18T00:20:13.4394332Z 9b763e24a7d4: Pulling fs layer 2024-12-18T00:20:13.4394595Z 3287a539d61e: Waiting 2024-12-18T00:20:13.4394831Z f6ef3d4c814e: Pulling fs layer 2024-12-18T00:20:13.4395117Z 06914b00eb49: Pulling fs layer 2024-12-18T00:20:13.4395500Z 724553524224: Pulling fs layer 2024-12-18T00:20:13.4395772Z 47d9fb6dae26: Pulling fs layer 2024-12-18T00:20:13.4396030Z f6ef3d4c814e: Waiting 2024-12-18T00:20:13.4396278Z acce7b690dcb: Pulling fs layer 2024-12-18T00:20:13.4396554Z 58dc9f64def7: Pulling fs layer 2024-12-18T00:20:13.4396828Z 94dfe5ef1b7e: Pulling fs layer 2024-12-18T00:20:13.4397090Z 06914b00eb49: Waiting 2024-12-18T00:20:13.4397335Z 40a2c9135b06: Pulling fs layer 2024-12-18T00:20:13.4397593Z 724553524224: Waiting 2024-12-18T00:20:13.4397840Z 8839d6b0c821: Pulling fs layer 2024-12-18T00:20:13.4398111Z 1c588f0a9e97: Pulling fs layer 2024-12-18T00:20:13.4398374Z 6727e7e27936: Pulling fs layer 2024-12-18T00:20:13.4398643Z 47d9fb6dae26: Waiting 2024-12-18T00:20:13.4398887Z 3a55100d1957: Pulling fs layer 2024-12-18T00:20:13.4399160Z 3d6f160d3351: Pulling fs layer 2024-12-18T00:20:13.4399429Z b2a8bb947a87: Pulling fs layer 2024-12-18T00:20:13.4399695Z 69a74b2360f4: Pulling fs layer 2024-12-18T00:20:13.4399968Z f9e12a253d89: Pulling fs layer 2024-12-18T00:20:13.4400255Z 8fdb06d51b96: Pulling fs layer 2024-12-18T00:20:13.4400526Z acce7b690dcb: Waiting 2024-12-18T00:20:13.4400768Z 58dc9f64def7: Waiting 2024-12-18T00:20:13.4400995Z 3a55100d1957: Waiting 2024-12-18T00:20:13.4401231Z 94dfe5ef1b7e: Waiting 2024-12-18T00:20:13.4401469Z 1c588f0a9e97: Waiting 2024-12-18T00:20:13.4401703Z 8839d6b0c821: Waiting 2024-12-18T00:20:13.4401932Z 6727e7e27936: Waiting 2024-12-18T00:20:13.4402157Z 3d6f160d3351: Waiting 2024-12-18T00:20:13.4402391Z 40a2c9135b06: Waiting 2024-12-18T00:20:13.4402623Z f9e12a253d89: Waiting 2024-12-18T00:20:13.4402860Z b2a8bb947a87: Waiting 2024-12-18T00:20:13.4403090Z 8fdb06d51b96: Waiting 2024-12-18T00:20:13.4403323Z 69a74b2360f4: Waiting 2024-12-18T00:20:13.5609575Z fbcd35dc5bc3: Verifying Checksum 2024-12-18T00:20:13.5609910Z fbcd35dc5bc3: Download complete 2024-12-18T00:20:13.6419010Z db6cdef1932a: Verifying Checksum 2024-12-18T00:20:13.6419333Z db6cdef1932a: Download complete 2024-12-18T00:20:13.7262701Z 56dc85502937: Download complete 2024-12-18T00:20:13.7778519Z 80888bc6716f: Verifying Checksum 2024-12-18T00:20:13.7779044Z 80888bc6716f: Download complete 2024-12-18T00:20:13.8653858Z 71bdb1a72c2d: Verifying Checksum 2024-12-18T00:20:13.8654219Z 71bdb1a72c2d: Download complete 2024-12-18T00:20:13.9489226Z 4829486be7c3: Verifying Checksum 2024-12-18T00:20:13.9489567Z 4829486be7c3: Download complete 2024-12-18T00:20:14.0390168Z 1f4e68d7b5e4: Verifying Checksum 2024-12-18T00:20:14.0390668Z 1f4e68d7b5e4: Download complete 2024-12-18T00:20:14.0751503Z c7232af9ae05: Verifying Checksum 2024-12-18T00:20:14.0751829Z c7232af9ae05: Download complete 2024-12-18T00:20:14.1713960Z 622381141745: Verifying Checksum 2024-12-18T00:20:14.1714359Z 622381141745: Download complete 2024-12-18T00:20:14.2514228Z f003d065e31e: Verifying Checksum 2024-12-18T00:20:14.2514729Z f003d065e31e: Download complete 2024-12-18T00:20:14.8439213Z 80888bc6716f: Pull complete 2024-12-18T00:20:15.1266038Z fbcd35dc5bc3: Pull complete 2024-12-18T00:20:15.8546803Z c7232af9ae05: Pull complete 2024-12-18T00:20:15.8684892Z db6cdef1932a: Pull complete 2024-12-18T00:20:15.8828559Z 56dc85502937: Pull complete 2024-12-18T00:20:16.7644799Z cd6ce7116815: Verifying Checksum 2024-12-18T00:20:16.7645249Z cd6ce7116815: Download complete 2024-12-18T00:20:16.8848059Z e843066a8f68: Verifying Checksum 2024-12-18T00:20:16.8848509Z e843066a8f68: Download complete 2024-12-18T00:20:16.9684877Z bac50ca2930b: Download complete 2024-12-18T00:20:17.0522083Z 57e52c6751f4: Download complete 2024-12-18T00:20:18.0527162Z a9c5c14d77c0: Verifying Checksum 2024-12-18T00:20:18.0527575Z a9c5c14d77c0: Download complete 2024-12-18T00:20:18.1423750Z b86099b8619a: Verifying Checksum 2024-12-18T00:20:18.1424227Z b86099b8619a: Download complete 2024-12-18T00:20:18.2225258Z 3c8ea8a600ff: Verifying Checksum 2024-12-18T00:20:18.2229036Z 3c8ea8a600ff: Download complete 2024-12-18T00:20:18.3086781Z bebd539a1d59: Verifying Checksum 2024-12-18T00:20:18.3087146Z bebd539a1d59: Download complete 2024-12-18T00:20:18.3908964Z 292b18ec2dab: Verifying Checksum 2024-12-18T00:20:18.3909357Z 292b18ec2dab: Download complete 2024-12-18T00:20:27.5089322Z 30c0ea6140d0: Verifying Checksum 2024-12-18T00:20:27.5089680Z 30c0ea6140d0: Download complete 2024-12-18T00:20:27.6021406Z 50b1f245e9f5: Download complete 2024-12-18T00:20:27.6859894Z ad93cf5205f2: Download complete 2024-12-18T00:20:27.7708475Z 8d17c59eaf7d: Verifying Checksum 2024-12-18T00:20:27.7709288Z 8d17c59eaf7d: Download complete 2024-12-18T00:20:27.8424050Z b36a8ccf5c8c: Verifying Checksum 2024-12-18T00:20:27.8424518Z b36a8ccf5c8c: Download complete 2024-12-18T00:20:27.9255279Z aa0a3b87e9e3: Download complete 2024-12-18T00:20:29.2059133Z 72a632052c5b: Verifying Checksum 2024-12-18T00:20:29.2059548Z 72a632052c5b: Download complete 2024-12-18T00:20:29.2874888Z ceed6316bc24: Verifying Checksum 2024-12-18T00:20:29.2875222Z ceed6316bc24: Download complete 2024-12-18T00:20:29.3738497Z d0ca0f491f80: Verifying Checksum 2024-12-18T00:20:29.3738974Z d0ca0f491f80: Download complete 2024-12-18T00:20:29.4483945Z cf02c706cd56: Verifying Checksum 2024-12-18T00:20:29.4484397Z cf02c706cd56: Download complete 2024-12-18T00:20:29.5504874Z 16073d3f107d: Verifying Checksum 2024-12-18T00:20:29.5505329Z 16073d3f107d: Download complete 2024-12-18T00:20:29.6399368Z d234faf2f1bf: Verifying Checksum 2024-12-18T00:20:29.6399818Z d234faf2f1bf: Download complete 2024-12-18T00:20:34.0052161Z 3f0ade86af1a: Verifying Checksum 2024-12-18T00:20:34.0052713Z 3f0ade86af1a: Download complete 2024-12-18T00:20:34.0792873Z 034b6a03f5f7: Download complete 2024-12-18T00:20:34.1995786Z 21f8f066852d: Download complete 2024-12-18T00:20:34.6224560Z 9dc1f315a979: Verifying Checksum 2024-12-18T00:20:34.6224905Z 9dc1f315a979: Download complete 2024-12-18T00:20:34.7190654Z cd6a6063178b: Download complete 2024-12-18T00:20:34.8121405Z 2116738f4ea9: Verifying Checksum 2024-12-18T00:20:34.8121771Z 2116738f4ea9: Download complete 2024-12-18T00:20:36.1327853Z d7fa134316d9: Verifying Checksum 2024-12-18T00:20:36.1328361Z d7fa134316d9: Download complete 2024-12-18T00:20:36.2244700Z af03dc3fd15e: Verifying Checksum 2024-12-18T00:20:36.2245176Z af03dc3fd15e: Download complete 2024-12-18T00:20:36.2999511Z fd9de3dc4258: Verifying Checksum 2024-12-18T00:20:36.2999843Z fd9de3dc4258: Download complete 2024-12-18T00:20:36.3858279Z b85093661f77: Verifying Checksum 2024-12-18T00:20:36.3858676Z b85093661f77: Download complete 2024-12-18T00:20:39.4379959Z 30c0ea6140d0: Pull complete 2024-12-18T00:20:39.6310058Z 71bdb1a72c2d: Pull complete 2024-12-18T00:20:39.8198175Z 4829486be7c3: Pull complete 2024-12-18T00:20:40.0367805Z 1f4e68d7b5e4: Pull complete 2024-12-18T00:20:40.3806629Z 7c373e2d9b7e: Verifying Checksum 2024-12-18T00:20:40.3807121Z 7c373e2d9b7e: Download complete 2024-12-18T00:20:40.4760168Z 56c896077120: Verifying Checksum 2024-12-18T00:20:40.4760524Z 56c896077120: Download complete 2024-12-18T00:20:40.5730321Z d88e9c5e7c70: Download complete 2024-12-18T00:20:41.0725514Z 53617ee83302: Verifying Checksum 2024-12-18T00:20:41.0725929Z 53617ee83302: Download complete 2024-12-18T00:20:41.1471133Z 3edbde10d404: Download complete 2024-12-18T00:20:41.2252442Z f4038f7524c3: Verifying Checksum 2024-12-18T00:20:41.2252933Z f4038f7524c3: Download complete 2024-12-18T00:20:41.3246149Z 4a51173f7757: Download complete 2024-12-18T00:20:41.4163290Z ed6a71d41274: Verifying Checksum 2024-12-18T00:20:41.4163667Z ed6a71d41274: Download complete 2024-12-18T00:20:47.8713242Z 76e3817b4b4c: Verifying Checksum 2024-12-18T00:20:47.8713742Z 76e3817b4b4c: Download complete 2024-12-18T00:20:47.9643121Z 0341eaeed33d: Download complete 2024-12-18T00:20:48.0422546Z 537cdb2d3168: Verifying Checksum 2024-12-18T00:20:48.0422910Z 537cdb2d3168: Download complete 2024-12-18T00:20:48.1263562Z 76d4a0702497: Verifying Checksum 2024-12-18T00:20:48.1264008Z 76d4a0702497: Download complete 2024-12-18T00:20:48.1352001Z 4f4fb700ef54: Verifying Checksum 2024-12-18T00:20:48.1352321Z 4f4fb700ef54: Download complete 2024-12-18T00:20:48.2158327Z 3287a539d61e: Verifying Checksum 2024-12-18T00:20:48.2159149Z 3287a539d61e: Download complete 2024-12-18T00:20:48.3080107Z 9b763e24a7d4: Download complete 2024-12-18T00:20:50.3316457Z f6ef3d4c814e: Verifying Checksum 2024-12-18T00:20:50.3316908Z f6ef3d4c814e: Download complete 2024-12-18T00:20:50.4013426Z 06914b00eb49: Download complete 2024-12-18T00:20:50.4902275Z 724553524224: Verifying Checksum 2024-12-18T00:20:50.4902671Z 724553524224: Download complete 2024-12-18T00:20:50.5843316Z 47d9fb6dae26: Verifying Checksum 2024-12-18T00:20:50.5843734Z 47d9fb6dae26: Download complete 2024-12-18T00:20:50.6830704Z acce7b690dcb: Download complete 2024-12-18T00:20:50.8146883Z 58dc9f64def7: Verifying Checksum 2024-12-18T00:20:50.8147250Z 58dc9f64def7: Download complete 2024-12-18T00:20:50.9020940Z 94dfe5ef1b7e: Download complete 2024-12-18T00:20:51.5153374Z 40a2c9135b06: Verifying Checksum 2024-12-18T00:20:51.5153734Z 40a2c9135b06: Download complete 2024-12-18T00:20:51.6021645Z 8839d6b0c821: Verifying Checksum 2024-12-18T00:20:51.6022113Z 8839d6b0c821: Download complete 2024-12-18T00:21:26.6232350Z 1c588f0a9e97: Verifying Checksum 2024-12-18T00:21:26.6232716Z 1c588f0a9e97: Download complete 2024-12-18T00:21:26.7139395Z 6727e7e27936: Verifying Checksum 2024-12-18T00:21:26.7139711Z 6727e7e27936: Download complete 2024-12-18T00:21:26.8486584Z 3a55100d1957: Download complete 2024-12-18T00:21:34.8722856Z 3d6f160d3351: Verifying Checksum 2024-12-18T00:21:34.8723290Z 3d6f160d3351: Download complete 2024-12-18T00:21:34.9900956Z b2a8bb947a87: Download complete 2024-12-18T00:21:35.0838965Z 69a74b2360f4: Verifying Checksum 2024-12-18T00:21:35.0839336Z 69a74b2360f4: Download complete 2024-12-18T00:21:36.4238558Z f9e12a253d89: Verifying Checksum 2024-12-18T00:21:36.4239020Z f9e12a253d89: Download complete 2024-12-18T00:21:36.5126043Z 8fdb06d51b96: Verifying Checksum 2024-12-18T00:21:36.5126678Z 8fdb06d51b96: Download complete 2024-12-18T00:22:05.2952180Z ab6ef6c2ac4d: Verifying Checksum 2024-12-18T00:22:05.2954980Z ab6ef6c2ac4d: Download complete 2024-12-18T00:22:10.2333349Z 389dc939e2a4: Verifying Checksum 2024-12-18T00:22:10.2334827Z 389dc939e2a4: Download complete 2024-12-18T00:22:22.0518242Z 7c373e2d9b7e: Pull complete 2024-12-18T00:22:22.2847666Z 622381141745: Pull complete 2024-12-18T00:22:22.5217714Z f003d065e31e: Pull complete 2024-12-18T00:22:30.0188132Z cd6ce7116815: Pull complete 2024-12-18T00:22:30.1363685Z e843066a8f68: Pull complete 2024-12-18T00:22:30.2926544Z bac50ca2930b: Pull complete 2024-12-18T00:22:30.4961883Z 57e52c6751f4: Pull complete 2024-12-18T00:22:32.8210105Z a9c5c14d77c0: Pull complete 2024-12-18T00:22:33.0733322Z b86099b8619a: Pull complete 2024-12-18T00:22:33.2944411Z 3c8ea8a600ff: Pull complete 2024-12-18T00:22:33.4404108Z bebd539a1d59: Pull complete 2024-12-18T00:22:33.5995108Z 292b18ec2dab: Pull complete 2024-12-18T00:23:26.8792463Z 76e3817b4b4c: Pull complete 2024-12-18T00:23:27.1125664Z 50b1f245e9f5: Pull complete 2024-12-18T00:23:27.3151710Z ad93cf5205f2: Pull complete 2024-12-18T00:23:27.4317412Z 8d17c59eaf7d: Pull complete 2024-12-18T00:23:27.6456146Z b36a8ccf5c8c: Pull complete 2024-12-18T00:23:27.8787570Z aa0a3b87e9e3: Pull complete 2024-12-18T00:23:30.3969051Z 72a632052c5b: Pull complete 2024-12-18T00:23:30.6160343Z ceed6316bc24: Pull complete 2024-12-18T00:23:30.8374705Z d0ca0f491f80: Pull complete 2024-12-18T00:23:31.0751189Z cf02c706cd56: Pull complete 2024-12-18T00:23:31.3004338Z 16073d3f107d: Pull complete 2024-12-18T00:23:31.5254071Z d234faf2f1bf: Pull complete 2024-12-18T00:23:40.0171294Z 3f0ade86af1a: Pull complete 2024-12-18T00:23:40.2542215Z 034b6a03f5f7: Pull complete 2024-12-18T00:23:40.4873648Z 21f8f066852d: Pull complete 2024-12-18T00:23:41.2794719Z 9dc1f315a979: Pull complete 2024-12-18T00:23:41.5115754Z cd6a6063178b: Pull complete 2024-12-18T00:23:41.7370004Z 2116738f4ea9: Pull complete 2024-12-18T00:23:42.1849430Z d7fa134316d9: Pull complete 2024-12-18T00:23:42.3631909Z af03dc3fd15e: Pull complete 2024-12-18T00:23:42.7123861Z fd9de3dc4258: Pull complete 2024-12-18T00:23:42.8942790Z b85093661f77: Pull complete 2024-12-18T00:24:13.4439575Z ab6ef6c2ac4d: Pull complete 2024-12-18T00:24:13.5492963Z 56c896077120: Pull complete 2024-12-18T00:24:13.6916715Z d88e9c5e7c70: Pull complete 2024-12-18T00:24:16.2224682Z 53617ee83302: Pull complete 2024-12-18T00:24:16.4474819Z 3edbde10d404: Pull complete 2024-12-18T00:24:16.6683566Z f4038f7524c3: Pull complete 2024-12-18T00:24:17.1104737Z 4a51173f7757: Pull complete 2024-12-18T00:24:17.3478192Z ed6a71d41274: Pull complete 2024-12-18T00:25:46.4322095Z 389dc939e2a4: Pull complete 2024-12-18T00:25:46.6536491Z 0341eaeed33d: Pull complete 2024-12-18T00:25:46.8771256Z 537cdb2d3168: Pull complete 2024-12-18T00:25:47.2802862Z 76d4a0702497: Pull complete 2024-12-18T00:25:47.5116810Z 4f4fb700ef54: Pull complete 2024-12-18T00:25:47.7370521Z 3287a539d61e: Pull complete 2024-12-18T00:25:47.9745090Z 9b763e24a7d4: Pull complete 2024-12-18T00:25:55.0635975Z f6ef3d4c814e: Pull complete 2024-12-18T00:25:55.2967518Z 06914b00eb49: Pull complete 2024-12-18T00:25:55.5221043Z 724553524224: Pull complete 2024-12-18T00:25:55.7535029Z 47d9fb6dae26: Pull complete 2024-12-18T00:25:55.9807738Z acce7b690dcb: Pull complete 2024-12-18T00:25:57.3896781Z 58dc9f64def7: Pull complete 2024-12-18T00:25:57.6110321Z 94dfe5ef1b7e: Pull complete 2024-12-18T00:25:59.3215078Z 40a2c9135b06: Pull complete 2024-12-18T00:25:59.4737176Z 8839d6b0c821: Pull complete 2024-12-18T00:26:11.8433394Z 1c588f0a9e97: Pull complete 2024-12-18T00:26:12.0538928Z 6727e7e27936: Pull complete 2024-12-18T00:26:12.2684981Z 3a55100d1957: Pull complete 2024-12-18T00:26:15.1375838Z 3d6f160d3351: Pull complete 2024-12-18T00:26:15.3034155Z b2a8bb947a87: Pull complete 2024-12-18T00:26:15.4651009Z 69a74b2360f4: Pull complete 2024-12-18T00:26:16.0544026Z f9e12a253d89: Pull complete 2024-12-18T00:26:16.2769118Z 8fdb06d51b96: Pull complete 2024-12-18T00:26:17.2236848Z Digest: sha256:ff80d4c93d18e8ab7a2501f0e62b7c40cf97aa83fc9702e88b9c2d02cdcbecdb 2024-12-18T00:26:17.2707262Z Status: Downloaded newer image for 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:26:17.2987080Z 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:26:17.3050940Z ##[group]Run echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2024-12-18T00:26:17.3051846Z echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2024-12-18T00:26:17.3063130Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:26:17.3063493Z env: 2024-12-18T00:26:17.3063709Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:26:17.3063970Z ##[endgroup] 2024-12-18T00:26:17.3347817Z ##[group]Run pytorch/test-infra/.github/actions/setup-nvidia@release/2.6 2024-12-18T00:26:17.3348251Z with: 2024-12-18T00:26:17.3348472Z driver-version: 550.54.15 2024-12-18T00:26:17.3348744Z env: 2024-12-18T00:26:17.3348953Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:26:17.3349201Z ##[endgroup] 2024-12-18T00:26:17.3470321Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2024-12-18T00:26:17.3470728Z with: 2024-12-18T00:26:17.3470945Z timeout_minutes: 10 2024-12-18T00:26:17.3471197Z max_attempts: 3 2024-12-18T00:26:17.3496079Z command: # Is it disgusting to have a full shell script here in this github action? Sure # But is it the best way to make it so that this action relies on nothing else? Absolutely set -eou pipefail DISTRIBUTION=$(. /etc/os-release;echo $ID$VERSION_ID) DRIVER_FN="NVIDIA-Linux-x86_64-${DRIVER_VERSION}.run" install_nvidia_docker2_amzn2() { ( set -x # Needed for yum-config-manager sudo yum install -y yum-utils if [[ "${DISTRIBUTION}" == "amzn2023" ]] ; then YUM_REPO_URL="https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo" else # Amazon Linux 2 YUM_REPO_URL="https://nvidia.github.io/nvidia-docker/${DISTRIBUTION}/nvidia-docker.repo" fi sudo yum-config-manager --add-repo "${YUM_REPO_URL}" sudo yum install -y nvidia-docker2 nvidia-container-toolkit-1.16.2 sudo systemctl restart docker ) } install_nvidia_docker2_ubuntu20() { ( set -x # Install nvidia-driver package if not installed status="$(dpkg-query -W --showformat='${db:Status-Status}' nvidia-docker2 2>&1)" if [ ! $? = 0 ] || [ ! "$status" = installed ]; then sudo apt-get install -y nvidia-docker2 nvidia-container-toolkit-1.16.2 sudo systemctl restart docker fi ) } pre_install_nvidia_driver_amzn2() { ( # Purge any nvidia driver installed from RHEL repo sudo yum remove -y nvidia-driver-latest-dkms ) } install_nvidia_driver_common() { ( # Try to gather more information about the runner and its existing NVIDIA driver if any echo "Before installing NVIDIA driver" lspci lsmod modinfo nvidia || true HAS_NVIDIA_DRIVER=0 # Check if NVIDIA driver has already been installed if [ -x "$(command -v nvidia-smi)" ]; then set +e # The driver exists, check its version next. Also check only the first GPU if there are more than one of them # so that the same driver version is not print over multiple lines INSTALLED_DRIVER_VERSION=$(nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0) NVIDIA_SMI_STATUS=$? if [ "$NVIDIA_SMI_STATUS" -ne 0 ] && [ "$NVIDIA_SMI_STATUS" -ne 14 ]; then echo "Failed to get NVIDIA driver version ($INSTALLED_DRIVER_VERSION). Continuing" elif [ "$INSTALLED_DRIVER_VERSION" != "$DRIVER_VERSION" ]; then echo "NVIDIA driver ($INSTALLED_DRIVER_VERSION) has been installed, but we expect to have $DRIVER_VERSION instead. Continuing" else HAS_NVIDIA_DRIVER=1 echo "NVIDIA driver ($INSTALLED_DRIVER_VERSION) has already been installed. Skipping NVIDIA driver installation" fi set -e fi if [ "$HAS_NVIDIA_DRIVER" -eq 0 ]; then # CAUTION: this may need to be updated in future if [ "${DISTRIBUTION}" != ubuntu20.04 ]; then sudo yum groupinstall -y "Development Tools" # ensure our kernel install is the same as our underlying kernel, # groupinstall "Development Tools" has a habit of mismatching kernel headers sudo yum install -y "kernel-devel-uname-r == $(uname -r)" sudo modprobe backlight fi sudo curl -fsL -o /tmp/nvidia_driver "https://s3.amazonaws.com/ossci-linux/nvidia_driver/$DRIVER_FN" set +e sudo /bin/bash /tmp/nvidia_driver -s --no-drm NVIDIA_INSTALLATION_STATUS=$? RESET_GPU=0 if [ "$NVIDIA_INSTALLATION_STATUS" -ne 0 ]; then sudo cat /var/log/nvidia-installer.log # Fail to install NVIDIA driver, try to reset the GPU RESET_GPU=1 elif [ -x "$(command -v nvidia-smi)" ]; then # Check again if nvidia-smi works even if the driver installation completes successfully INSTALLED_DRIVER_VERSION=$(nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0) NVIDIA_SMI_STATUS=$? if [ "$NVIDIA_SMI_STATUS" -ne 0 ] && [ "$NVIDIA_SMI_STATUS" -ne 14 ]; then RESET_GPU=1 fi fi if [ "$RESET_GPU" -eq 1 ]; then NVIDIA_DEVICES=$(lspci -D | grep -i NVIDIA | cut -d' ' -f1) # The GPU can get stuck in a failure state if somehow the test crashs the GPU microcode. When this # happens, we'll try to reset all NVIDIA devices https://github.com/pytorch/pytorch/issues/88388 for PCI_ID in $NVIDIA_DEVICES; do DEVICE_ENABLED=$(cat /sys/bus/pci/devices/$PCI_ID/enable) echo "Reseting $PCI_ID (enabled state: $DEVICE_ENABLED)" # This requires sudo permission of course echo "1" | sudo tee /sys/bus/pci/devices/$PCI_ID/reset sleep 1 done fi sudo rm -fv /tmp/nvidia_driver set -e fi ) } post_install_nvidia_driver_common() { ( sudo modprobe nvidia || true echo "After installing NVIDIA driver" lspci lsmod modinfo nvidia || true ( set +e nvidia-smi # NB: Annoyingly, nvidia-smi command returns successfully with return code 0 even in # the case where the driver has already crashed as it still can get the driver version # and some basic information like the bus ID. However, the rest of the information # would be missing (ERR!), for example: # # +-----------------------------------------------------------------------------+ # | NVIDIA-SMI 525.89.02 Driver Version: 525.89.02 CUDA Version: 12.0 | # |-------------------------------+----------------------+----------------------+ # | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | # | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | # | | | MIG M. | # |===============================+======================+======================| # | 0 ERR! Off | 00000000:00:1E.0 Off | ERR! | # |ERR! ERR! ERR! ERR! / ERR! | 4184MiB / 23028MiB | ERR! Default | # | | | ERR! | # +-------------------------------+----------------------+----------------------+ # # +-----------------------------------------------------------------------------+ # | Processes: | # | GPU GI CI PID Type Process name GPU Memory | # | ID ID Usage | # |=============================================================================| # +-----------------------------------------------------------------------------+ # # This should be reported as a failure instead as it will guarantee to fail when # Docker tries to run with --gpus all # # So, the correct check here is to query one of the missing piece of info like # GPU name, so that the command can fail accordingly nvidia-smi --query-gpu=gpu_name --format=csv,noheader --id=0 NVIDIA_SMI_STATUS=$? # Allowable exit statuses for nvidia-smi, see: https://github.com/NVIDIA/gpu-operator/issues/285 if [ "$NVIDIA_SMI_STATUS" -eq 0 ] || [ "$NVIDIA_SMI_STATUS" -eq 14 ]; then echo "INFO: Ignoring allowed status ${NVIDIA_SMI_STATUS}" else echo "ERROR: nvidia-smi exited with unresolved status ${NVIDIA_SMI_STATUS}" exit ${NVIDIA_SMI_STATUS} fi set -e ) ) } install_nvidia_driver_amzn2() { ( set -x pre_install_nvidia_driver_amzn2 install_nvidia_driver_common post_install_nvidia_driver_common ) } install_nvidia_driver_ubuntu20() { ( set -x install_nvidia_driver_common post_install_nvidia_driver_common ) } echo "== Installing nvidia driver ${DRIVER_FN} ==" case "${DISTRIBUTION}" in amzn*) install_nvidia_driver_amzn2 ;; ubuntu20.04) install_nvidia_driver_ubuntu20 ;; *) echo "ERROR: Unknown distribution ${DISTRIBUTION}" exit 1 ;; esac # Install container toolkit based on distribution echo "== Installing nvidia container toolkit for ${DISTRIBUTION} ==" case "${DISTRIBUTION}" in amzn*) install_nvidia_docker2_amzn2 ;; ubuntu20.04) install_nvidia_docker2_ubuntu20 ;; *) echo "ERROR: Unknown distribution ${DISTRIBUTION}" exit 1 ;; esac echo "GPU_FLAG=--gpus all -e NVIDIA_DRIVER_CAPABILITIES=all" >> "${GITHUB_ENV}" # Fix https://github.com/NVIDIA/nvidia-docker/issues/1648 on runners with # more than one GPUs. This just needs to be run once. The command fails # on subsequent runs and complains that the mode is already on, but that's # ok sudo nvidia-persistenced || true # This should show persistence mode ON nvidia-smi 2024-12-18T00:26:17.3521353Z retry_wait_seconds: 10 2024-12-18T00:26:17.3521627Z polling_interval_seconds: 1 2024-12-18T00:26:17.3521918Z warning_on_retry: true 2024-12-18T00:26:17.3522180Z continue_on_error: false 2024-12-18T00:26:17.3522435Z env: 2024-12-18T00:26:17.3522653Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:26:17.3522926Z DRIVER_VERSION: 550.54.15 2024-12-18T00:26:17.3523187Z ##[endgroup] 2024-12-18T00:26:17.4344649Z == Installing nvidia driver NVIDIA-Linux-x86_64-550.54.15.run == 2024-12-18T00:26:17.4345390Z + pre_install_nvidia_driver_amzn2 2024-12-18T00:26:17.4346425Z + sudo yum remove -y nvidia-driver-latest-dkms 2024-12-18T00:26:18.2295594Z No match for argument: nvidia-driver-latest-dkms 2024-12-18T00:26:18.2296288Z No packages marked for removal. 2024-12-18T00:26:18.2661017Z Dependencies resolved. 2024-12-18T00:26:18.2671029Z Nothing to do. 2024-12-18T00:26:18.2671574Z Complete! 2024-12-18T00:26:18.3271434Z + install_nvidia_driver_common 2024-12-18T00:26:18.3275658Z + echo 'Before installing NVIDIA driver' 2024-12-18T00:26:18.3276347Z Before installing NVIDIA driver 2024-12-18T00:26:18.3278740Z + lspci 2024-12-18T00:26:18.3398523Z 00:00.0 Host bridge: Intel Corporation 440FX - 82441FX PMC [Natoma] 2024-12-18T00:26:18.3399056Z 00:01.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II] 2024-12-18T00:26:18.3399656Z 00:01.3 Non-VGA unclassified device: Intel Corporation 82371AB/EB/MB PIIX4 ACPI (rev 08) 2024-12-18T00:26:18.3400219Z 00:03.0 VGA compatible controller: Amazon.com, Inc. Device 1111 2024-12-18T00:26:18.3400735Z 00:04.0 Non-Volatile memory controller: Amazon.com, Inc. NVMe EBS Controller 2024-12-18T00:26:18.3401317Z 00:05.0 Ethernet controller: Amazon.com, Inc. Elastic Network Adapter (ENA) 2024-12-18T00:26:18.3401836Z 00:1e.0 3D controller: NVIDIA Corporation GA102GL [A10G] (rev a1) 2024-12-18T00:26:18.3402354Z 00:1f.0 Non-Volatile memory controller: Amazon.com, Inc. NVMe SSD Controller 2024-12-18T00:26:18.3403067Z + lsmod 2024-12-18T00:26:18.3447108Z Module Size Used by 2024-12-18T00:26:18.3447415Z xt_nat 16384 0 2024-12-18T00:26:18.3447717Z ib_core 454656 0 2024-12-18T00:26:18.3448006Z veth 36864 0 2024-12-18T00:26:18.3448281Z nvidia_modeset 1351680 0 2024-12-18T00:26:18.3448579Z video 65536 1 nvidia_modeset 2024-12-18T00:26:18.3448897Z wmi 36864 1 video 2024-12-18T00:26:18.3449186Z nvidia_uvm 4706304 0 2024-12-18T00:26:18.3449498Z nvidia 54071296 7 nvidia_uvm,nvidia_modeset 2024-12-18T00:26:18.3449850Z drm 602112 1 nvidia 2024-12-18T00:26:18.3450172Z drm_panel_orientation_quirks 32768 1 drm 2024-12-18T00:26:18.3450568Z backlight 24576 3 video,drm,nvidia_modeset 2024-12-18T00:26:18.3450931Z i2c_core 106496 2 nvidia,drm 2024-12-18T00:26:18.3451244Z xt_conntrack 16384 1 2024-12-18T00:26:18.3451521Z nft_chain_nat 16384 3 2024-12-18T00:26:18.3451832Z xt_MASQUERADE 20480 1 2024-12-18T00:26:18.3452288Z nf_nat 57344 3 xt_nat,nft_chain_nat,xt_MASQUERADE 2024-12-18T00:26:18.3452992Z nf_conntrack_netlink 57344 0 2024-12-18T00:26:18.3453439Z nf_conntrack 184320 5 xt_conntrack,nf_nat,xt_nat,nf_conntrack_netlink,xt_MASQUERADE 2024-12-18T00:26:18.3453935Z nf_defrag_ipv6 24576 1 nf_conntrack 2024-12-18T00:26:18.3454265Z nf_defrag_ipv4 16384 1 nf_conntrack 2024-12-18T00:26:18.3454581Z xfrm_user 57344 1 2024-12-18T00:26:18.3454869Z xfrm_algo 16384 1 xfrm_user 2024-12-18T00:26:18.3455177Z xt_addrtype 16384 2 2024-12-18T00:26:18.3455454Z nft_compat 20480 4 2024-12-18T00:26:18.3455776Z nf_tables 311296 57 nft_compat,nft_chain_nat 2024-12-18T00:26:18.3456208Z nfnetlink 20480 4 nft_compat,nf_conntrack_netlink,nf_tables 2024-12-18T00:26:18.3456604Z br_netfilter 36864 0 2024-12-18T00:26:18.3456906Z bridge 323584 1 br_netfilter 2024-12-18T00:26:18.3457219Z stp 16384 1 bridge 2024-12-18T00:26:18.3457519Z llc 16384 2 bridge,stp 2024-12-18T00:26:18.3457831Z overlay 167936 0 2024-12-18T00:26:18.3458106Z tls 114688 0 2024-12-18T00:26:18.3458373Z nls_ascii 16384 1 2024-12-18T00:26:18.3458646Z nls_cp437 20480 1 2024-12-18T00:26:18.3458905Z vfat 24576 1 2024-12-18T00:26:18.3459171Z fat 86016 1 vfat 2024-12-18T00:26:18.3459463Z sunrpc 692224 1 2024-12-18T00:26:18.3459736Z ena 167936 0 2024-12-18T00:26:18.3460004Z i8042 45056 0 2024-12-18T00:26:18.3460272Z serio 28672 3 i8042 2024-12-18T00:26:18.3460560Z button 24576 0 2024-12-18T00:26:18.3460978Z ghash_clmulni_intel 16384 0 2024-12-18T00:26:18.3461254Z sch_fq_codel 20480 17 2024-12-18T00:26:18.3461533Z dm_mod 188416 0 2024-12-18T00:26:18.3461800Z fuse 163840 1 2024-12-18T00:26:18.3462070Z configfs 57344 1 2024-12-18T00:26:18.3462344Z loop 36864 0 2024-12-18T00:26:18.3462612Z dax 45056 1 dm_mod 2024-12-18T00:26:18.3462911Z dmi_sysfs 20480 0 2024-12-18T00:26:18.3463184Z crc32_pclmul 16384 0 2024-12-18T00:26:18.3463456Z crc32c_intel 24576 0 2024-12-18T00:26:18.3463727Z efivarfs 24576 1 2024-12-18T00:26:18.3463991Z + modinfo nvidia 2024-12-18T00:26:18.3466825Z filename: /lib/modules/6.1.109-118.189.amzn2023.x86_64/kernel/drivers/video/nvidia.ko 2024-12-18T00:26:18.3467419Z alias: char-major-195-* 2024-12-18T00:26:18.3467704Z version: 550.54.15 2024-12-18T00:26:18.3467966Z supported: external 2024-12-18T00:26:18.3468219Z license: NVIDIA 2024-12-18T00:26:18.3468491Z firmware: nvidia/550.54.15/gsp_tu10x.bin 2024-12-18T00:26:18.3469040Z firmware: nvidia/550.54.15/gsp_ga10x.bin 2024-12-18T00:26:18.3469380Z srcversion: 833721318DA517F0C2FEC97 2024-12-18T00:26:18.3469713Z alias: pci:v000010DEd*sv*sd*bc06sc80i00* 2024-12-18T00:26:18.3470074Z alias: pci:v000010DEd*sv*sd*bc03sc02i00* 2024-12-18T00:26:18.3470420Z alias: pci:v000010DEd*sv*sd*bc03sc00i00* 2024-12-18T00:26:18.3470747Z depends: i2c-core,drm 2024-12-18T00:26:18.3471019Z retpoline: Y 2024-12-18T00:26:18.3471252Z name: nvidia 2024-12-18T00:26:18.3471627Z vermagic: 6.1.109-118.189.amzn2023.x86_64 SMP preempt mod_unload modversions 2024-12-18T00:26:18.3472115Z parm: NvSwitchRegDwords:NvSwitch regkey (charp) 2024-12-18T00:26:18.3472580Z parm: NvSwitchBlacklist:NvSwitchBlacklist=uuid[,uuid...] (charp) 2024-12-18T00:26:18.3473016Z parm: NVreg_ResmanDebugLevel:int 2024-12-18T00:26:18.3473343Z parm: NVreg_RmLogonRC:int 2024-12-18T00:26:18.3473667Z parm: NVreg_ModifyDeviceFiles:int 2024-12-18T00:26:18.3473998Z parm: NVreg_DeviceFileUID:int 2024-12-18T00:26:18.3474312Z parm: NVreg_DeviceFileGID:int 2024-12-18T00:26:18.3474740Z parm: NVreg_DeviceFileMode:int 2024-12-18T00:26:18.3475118Z parm: NVreg_InitializeSystemMemoryAllocations:int 2024-12-18T00:26:18.3475524Z parm: NVreg_UsePageAttributeTable:int 2024-12-18T00:26:18.3475879Z parm: NVreg_EnablePCIeGen3:int 2024-12-18T00:26:18.3476193Z parm: NVreg_EnableMSI:int 2024-12-18T00:26:18.3476498Z parm: NVreg_TCEBypassMode:int 2024-12-18T00:26:18.3476832Z parm: NVreg_EnableStreamMemOPs:int 2024-12-18T00:26:18.3477226Z parm: NVreg_RestrictProfilingToAdminUsers:int 2024-12-18T00:26:18.3477685Z parm: NVreg_PreserveVideoMemoryAllocations:int 2024-12-18T00:26:18.3478078Z parm: NVreg_EnableS0ixPowerManagement:int 2024-12-18T00:26:18.3478510Z parm: NVreg_S0ixPowerManagementVideoMemoryThreshold:int 2024-12-18T00:26:18.3478948Z parm: NVreg_DynamicPowerManagement:int 2024-12-18T00:26:18.3479388Z parm: NVreg_DynamicPowerManagementVideoMemoryThreshold:int 2024-12-18T00:26:18.3479826Z parm: NVreg_EnableGpuFirmware:int 2024-12-18T00:26:18.3480220Z parm: NVreg_EnableGpuFirmwareLogs:int 2024-12-18T00:26:18.3480712Z parm: NVreg_OpenRmEnableUnsupportedGpus:int 2024-12-18T00:26:18.3481107Z parm: NVreg_EnableUserNUMAManagement:int 2024-12-18T00:26:18.3481470Z parm: NVreg_MemoryPoolSize:int 2024-12-18T00:26:18.3481816Z parm: NVreg_KMallocHeapMaxSize:int 2024-12-18T00:26:18.3482159Z parm: NVreg_VMallocHeapMaxSize:int 2024-12-18T00:26:18.3482500Z parm: NVreg_IgnoreMMIOCheck:int 2024-12-18T00:26:18.3482827Z parm: NVreg_NvLinkDisable:int 2024-12-18T00:26:18.3483194Z parm: NVreg_EnablePCIERelaxedOrderingMode:int 2024-12-18T00:26:18.3483573Z parm: NVreg_RegisterPCIDriver:int 2024-12-18T00:26:18.3483928Z parm: NVreg_EnableResizableBar:int 2024-12-18T00:26:18.3484274Z parm: NVreg_EnableDbgBreakpoint:int 2024-12-18T00:26:18.3484636Z parm: NVreg_EnableNonblockingOpen:int 2024-12-18T00:26:18.3484995Z parm: NVreg_RegistryDwords:charp 2024-12-18T00:26:18.3485353Z parm: NVreg_RegistryDwordsPerDevice:charp 2024-12-18T00:26:18.3485697Z parm: NVreg_RmMsg:charp 2024-12-18T00:26:18.3485996Z parm: NVreg_GpuBlacklist:charp 2024-12-18T00:26:18.3486335Z parm: NVreg_TemporaryFilePath:charp 2024-12-18T00:26:18.3486678Z parm: NVreg_ExcludedGpus:charp 2024-12-18T00:26:18.3487010Z parm: NVreg_DmaRemapPeerMmio:int 2024-12-18T00:26:18.3487356Z parm: NVreg_RmNvlinkBandwidth:charp 2024-12-18T00:26:18.3487700Z parm: NVreg_ImexChannelCount:int 2024-12-18T00:26:18.3488028Z parm: rm_firmware_active:charp 2024-12-18T00:26:18.3488341Z + HAS_NVIDIA_DRIVER=0 2024-12-18T00:26:18.3488598Z ++ command -v nvidia-smi 2024-12-18T00:26:18.3488978Z + '[' -x /usr/bin/nvidia-smi ']' 2024-12-18T00:26:18.3489249Z + set +e 2024-12-18T00:26:18.3491104Z ++ nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0 2024-12-18T00:26:18.3760447Z + INSTALLED_DRIVER_VERSION=550.54.15 2024-12-18T00:26:18.3760755Z + NVIDIA_SMI_STATUS=0 2024-12-18T00:26:18.3761005Z + '[' 0 -ne 0 ']' 2024-12-18T00:26:18.3761230Z + '[' 550.54.15 '!=' 550.54.15 ']' 2024-12-18T00:26:18.3761509Z + HAS_NVIDIA_DRIVER=1 2024-12-18T00:26:18.3761953Z + echo 'NVIDIA driver (550.54.15) has already been installed. Skipping NVIDIA driver installation' 2024-12-18T00:26:18.3762446Z + set -e 2024-12-18T00:26:18.3762831Z NVIDIA driver (550.54.15) has already been installed. Skipping NVIDIA driver installation 2024-12-18T00:26:18.3763287Z + '[' 1 -eq 0 ']' 2024-12-18T00:26:18.3765678Z + post_install_nvidia_driver_common 2024-12-18T00:26:18.3769102Z + sudo modprobe nvidia 2024-12-18T00:26:18.5122696Z + echo 'After installing NVIDIA driver' 2024-12-18T00:26:18.5123251Z + lspci 2024-12-18T00:26:18.5123571Z After installing NVIDIA driver 2024-12-18T00:26:18.5240647Z 00:00.0 Host bridge: Intel Corporation 440FX - 82441FX PMC [Natoma] 2024-12-18T00:26:18.5241457Z 00:01.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II] 2024-12-18T00:26:18.5242037Z 00:01.3 Non-VGA unclassified device: Intel Corporation 82371AB/EB/MB PIIX4 ACPI (rev 08) 2024-12-18T00:26:18.5242584Z 00:03.0 VGA compatible controller: Amazon.com, Inc. Device 1111 2024-12-18T00:26:18.5243090Z 00:04.0 Non-Volatile memory controller: Amazon.com, Inc. NVMe EBS Controller 2024-12-18T00:26:18.5243656Z 00:05.0 Ethernet controller: Amazon.com, Inc. Elastic Network Adapter (ENA) 2024-12-18T00:26:18.5244168Z 00:1e.0 3D controller: NVIDIA Corporation GA102GL [A10G] (rev a1) 2024-12-18T00:26:18.5244681Z 00:1f.0 Non-Volatile memory controller: Amazon.com, Inc. NVMe SSD Controller 2024-12-18T00:26:18.5245114Z + lsmod 2024-12-18T00:26:18.5274636Z Module Size Used by 2024-12-18T00:26:18.5274956Z xt_nat 16384 0 2024-12-18T00:26:18.5275308Z ib_core 454656 0 2024-12-18T00:26:18.5275617Z veth 36864 0 2024-12-18T00:26:18.5275898Z nvidia_modeset 1351680 0 2024-12-18T00:26:18.5276189Z video 65536 1 nvidia_modeset 2024-12-18T00:26:18.5276512Z wmi 36864 1 video 2024-12-18T00:26:18.5276801Z nvidia_uvm 4706304 0 2024-12-18T00:26:18.5277118Z nvidia 54071296 7 nvidia_uvm,nvidia_modeset 2024-12-18T00:26:18.5277467Z drm 602112 1 nvidia 2024-12-18T00:26:18.5277790Z drm_panel_orientation_quirks 32768 1 drm 2024-12-18T00:26:18.5278164Z backlight 24576 3 video,drm,nvidia_modeset 2024-12-18T00:26:18.5278527Z i2c_core 106496 2 nvidia,drm 2024-12-18T00:26:18.5278839Z xt_conntrack 16384 1 2024-12-18T00:26:18.5279121Z nft_chain_nat 16384 3 2024-12-18T00:26:18.5279399Z xt_MASQUERADE 20480 1 2024-12-18T00:26:18.5279728Z nf_nat 57344 3 xt_nat,nft_chain_nat,xt_MASQUERADE 2024-12-18T00:26:18.5280089Z nf_conntrack_netlink 57344 0 2024-12-18T00:26:18.5280529Z nf_conntrack 184320 5 xt_conntrack,nf_nat,xt_nat,nf_conntrack_netlink,xt_MASQUERADE 2024-12-18T00:26:18.5281013Z nf_defrag_ipv6 24576 1 nf_conntrack 2024-12-18T00:26:18.5281340Z nf_defrag_ipv4 16384 1 nf_conntrack 2024-12-18T00:26:18.5281646Z xfrm_user 57344 1 2024-12-18T00:26:18.5281927Z xfrm_algo 16384 1 xfrm_user 2024-12-18T00:26:18.5282229Z xt_addrtype 16384 2 2024-12-18T00:26:18.5282503Z nft_compat 20480 4 2024-12-18T00:26:18.5282825Z nf_tables 311296 57 nft_compat,nft_chain_nat 2024-12-18T00:26:18.5283249Z nfnetlink 20480 4 nft_compat,nf_conntrack_netlink,nf_tables 2024-12-18T00:26:18.5283639Z br_netfilter 36864 0 2024-12-18T00:26:18.5283932Z bridge 323584 1 br_netfilter 2024-12-18T00:26:18.5284444Z stp 16384 1 bridge 2024-12-18T00:26:18.5284753Z llc 16384 2 bridge,stp 2024-12-18T00:26:18.5285048Z overlay 167936 0 2024-12-18T00:26:18.5285313Z tls 114688 0 2024-12-18T00:26:18.5285588Z nls_ascii 16384 1 2024-12-18T00:26:18.5285854Z nls_cp437 20480 1 2024-12-18T00:26:18.5286120Z vfat 24576 1 2024-12-18T00:26:18.5286382Z fat 86016 1 vfat 2024-12-18T00:26:18.5286665Z sunrpc 692224 1 2024-12-18T00:26:18.5286931Z ena 167936 0 2024-12-18T00:26:18.5287188Z i8042 45056 0 2024-12-18T00:26:18.5287464Z serio 28672 3 i8042 2024-12-18T00:26:18.5287754Z button 24576 0 2024-12-18T00:26:18.5288066Z ghash_clmulni_intel 16384 0 2024-12-18T00:26:18.5288347Z sch_fq_codel 20480 17 2024-12-18T00:26:18.5288625Z dm_mod 188416 0 2024-12-18T00:26:18.5288887Z fuse 163840 1 2024-12-18T00:26:18.5289154Z configfs 57344 1 2024-12-18T00:26:18.5289425Z loop 36864 0 2024-12-18T00:26:18.5289698Z dax 45056 1 dm_mod 2024-12-18T00:26:18.5290109Z dmi_sysfs 20480 0 2024-12-18T00:26:18.5290382Z crc32_pclmul 16384 0 2024-12-18T00:26:18.5290646Z crc32c_intel 24576 0 2024-12-18T00:26:18.5290917Z efivarfs 24576 1 2024-12-18T00:26:18.5291185Z + modinfo nvidia 2024-12-18T00:26:18.5291859Z filename: /lib/modules/6.1.109-118.189.amzn2023.x86_64/kernel/drivers/video/nvidia.ko 2024-12-18T00:26:18.5292343Z alias: char-major-195-* 2024-12-18T00:26:18.5292621Z version: 550.54.15 2024-12-18T00:26:18.5292886Z supported: external 2024-12-18T00:26:18.5293142Z license: NVIDIA 2024-12-18T00:26:18.5293422Z firmware: nvidia/550.54.15/gsp_tu10x.bin 2024-12-18T00:26:18.5293777Z firmware: nvidia/550.54.15/gsp_ga10x.bin 2024-12-18T00:26:18.5294111Z srcversion: 833721318DA517F0C2FEC97 2024-12-18T00:26:18.5294444Z alias: pci:v000010DEd*sv*sd*bc06sc80i00* 2024-12-18T00:26:18.5294797Z alias: pci:v000010DEd*sv*sd*bc03sc02i00* 2024-12-18T00:26:18.5295152Z alias: pci:v000010DEd*sv*sd*bc03sc00i00* 2024-12-18T00:26:18.5295480Z depends: i2c-core,drm 2024-12-18T00:26:18.5295745Z retpoline: Y 2024-12-18T00:26:18.5295975Z name: nvidia 2024-12-18T00:26:18.5296362Z vermagic: 6.1.109-118.189.amzn2023.x86_64 SMP preempt mod_unload modversions 2024-12-18T00:26:18.5296861Z parm: NvSwitchRegDwords:NvSwitch regkey (charp) 2024-12-18T00:26:18.5297325Z parm: NvSwitchBlacklist:NvSwitchBlacklist=uuid[,uuid...] (charp) 2024-12-18T00:26:18.5297791Z parm: NVreg_ResmanDebugLevel:int 2024-12-18T00:26:18.5298137Z parm: NVreg_RmLogonRC:int 2024-12-18T00:26:18.5298454Z parm: NVreg_ModifyDeviceFiles:int 2024-12-18T00:26:18.5298805Z parm: NVreg_DeviceFileUID:int 2024-12-18T00:26:18.5299128Z parm: NVreg_DeviceFileGID:int 2024-12-18T00:26:18.5299450Z parm: NVreg_DeviceFileMode:int 2024-12-18T00:26:18.5299824Z parm: NVreg_InitializeSystemMemoryAllocations:int 2024-12-18T00:26:18.5300237Z parm: NVreg_UsePageAttributeTable:int 2024-12-18T00:26:18.5300587Z parm: NVreg_EnablePCIeGen3:int 2024-12-18T00:26:18.5301052Z parm: NVreg_EnableMSI:int 2024-12-18T00:26:18.5301360Z parm: NVreg_TCEBypassMode:int 2024-12-18T00:26:18.5301691Z parm: NVreg_EnableStreamMemOPs:int 2024-12-18T00:26:18.5302075Z parm: NVreg_RestrictProfilingToAdminUsers:int 2024-12-18T00:26:18.5302495Z parm: NVreg_PreserveVideoMemoryAllocations:int 2024-12-18T00:26:18.5302894Z parm: NVreg_EnableS0ixPowerManagement:int 2024-12-18T00:26:18.5303328Z parm: NVreg_S0ixPowerManagementVideoMemoryThreshold:int 2024-12-18T00:26:18.5303752Z parm: NVreg_DynamicPowerManagement:int 2024-12-18T00:26:18.5304304Z parm: NVreg_DynamicPowerManagementVideoMemoryThreshold:int 2024-12-18T00:26:18.5304743Z parm: NVreg_EnableGpuFirmware:int 2024-12-18T00:26:18.5305214Z parm: NVreg_EnableGpuFirmwareLogs:int 2024-12-18T00:26:18.5305621Z parm: NVreg_OpenRmEnableUnsupportedGpus:int 2024-12-18T00:26:18.5306009Z parm: NVreg_EnableUserNUMAManagement:int 2024-12-18T00:26:18.5306370Z parm: NVreg_MemoryPoolSize:int 2024-12-18T00:26:18.5306706Z parm: NVreg_KMallocHeapMaxSize:int 2024-12-18T00:26:18.5307054Z parm: NVreg_VMallocHeapMaxSize:int 2024-12-18T00:26:18.5307393Z parm: NVreg_IgnoreMMIOCheck:int 2024-12-18T00:26:18.5307720Z parm: NVreg_NvLinkDisable:int 2024-12-18T00:26:18.5308138Z parm: NVreg_EnablePCIERelaxedOrderingMode:int 2024-12-18T00:26:18.5308516Z parm: NVreg_RegisterPCIDriver:int 2024-12-18T00:26:18.5308946Z parm: NVreg_EnableResizableBar:int 2024-12-18T00:26:18.5309304Z parm: NVreg_EnableDbgBreakpoint:int 2024-12-18T00:26:18.5309678Z parm: NVreg_EnableNonblockingOpen:int 2024-12-18T00:26:18.5310033Z parm: NVreg_RegistryDwords:charp 2024-12-18T00:26:18.5310397Z parm: NVreg_RegistryDwordsPerDevice:charp 2024-12-18T00:26:18.5310846Z parm: NVreg_RmMsg:charp 2024-12-18T00:26:18.5311159Z parm: NVreg_GpuBlacklist:charp 2024-12-18T00:26:18.5311499Z parm: NVreg_TemporaryFilePath:charp 2024-12-18T00:26:18.5311839Z parm: NVreg_ExcludedGpus:charp 2024-12-18T00:26:18.5312173Z parm: NVreg_DmaRemapPeerMmio:int 2024-12-18T00:26:18.5312521Z parm: NVreg_RmNvlinkBandwidth:charp 2024-12-18T00:26:18.5312869Z parm: NVreg_ImexChannelCount:int 2024-12-18T00:26:18.5313200Z parm: rm_firmware_active:charp 2024-12-18T00:26:18.5313496Z + set +e 2024-12-18T00:26:18.5313710Z + nvidia-smi 2024-12-18T00:26:18.5504267Z Wed Dec 18 00:26:18 2024 2024-12-18T00:26:18.5505023Z +-----------------------------------------------------------------------------------------+ 2024-12-18T00:26:18.5506048Z | NVIDIA-SMI 550.54.15 Driver Version: 550.54.15 CUDA Version: 12.4 | 2024-12-18T00:26:18.5507086Z |-----------------------------------------+------------------------+----------------------+ 2024-12-18T00:26:18.5507935Z | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | 2024-12-18T00:26:18.5508517Z | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | 2024-12-18T00:26:18.5508978Z | | | MIG M. | 2024-12-18T00:26:18.5509332Z |=========================================+========================+======================| 2024-12-18T00:26:18.5736884Z | 0 NVIDIA A10G On | 00000000:00:1E.0 Off | 0 | 2024-12-18T00:26:18.5737358Z | 0% 19C P8 15W / 300W | 0MiB / 23028MiB | 0% Default | 2024-12-18T00:26:18.5737778Z | | | N/A | 2024-12-18T00:26:18.5738200Z +-----------------------------------------+------------------------+----------------------+ 2024-12-18T00:26:18.5741977Z 2024-12-18T00:26:18.5742397Z +-----------------------------------------------------------------------------------------+ 2024-12-18T00:26:18.5742854Z | Processes: | 2024-12-18T00:26:18.5743340Z | GPU GI CI PID Type Process name GPU Memory | 2024-12-18T00:26:18.5743798Z | ID ID Usage | 2024-12-18T00:26:18.5744161Z |=========================================================================================| 2024-12-18T00:26:18.5748987Z | No running processes found | 2024-12-18T00:26:18.5749489Z +-----------------------------------------------------------------------------------------+ 2024-12-18T00:26:18.8628016Z + nvidia-smi --query-gpu=gpu_name --format=csv,noheader --id=0 2024-12-18T00:26:18.8812548Z NVIDIA A10G 2024-12-18T00:26:18.8873830Z + NVIDIA_SMI_STATUS=0 2024-12-18T00:26:18.8874280Z + '[' 0 -eq 0 ']' 2024-12-18T00:26:18.8874575Z + echo 'INFO: Ignoring allowed status 0' 2024-12-18T00:26:18.8874886Z + set -e 2024-12-18T00:26:18.8875114Z INFO: Ignoring allowed status 0 2024-12-18T00:26:18.8883661Z == Installing nvidia container toolkit for amzn2023 == 2024-12-18T00:26:18.8887321Z + sudo yum install -y yum-utils 2024-12-18T00:26:19.5150892Z Last metadata expiration check: 2:22:52 ago on Tue Dec 17 22:03:27 2024. 2024-12-18T00:26:19.5373736Z Package dnf-utils-4.3.0-13.amzn2023.0.4.noarch is already installed. 2024-12-18T00:26:19.5701941Z Dependencies resolved. 2024-12-18T00:26:19.5843166Z Nothing to do. 2024-12-18T00:26:19.5843510Z Complete! 2024-12-18T00:26:19.6727299Z + [[ amzn2023 == \a\m\z\n\2\0\2\3 ]] 2024-12-18T00:26:19.6730229Z + YUM_REPO_URL=https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo 2024-12-18T00:26:19.6731592Z + sudo yum-config-manager --add-repo https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo 2024-12-18T00:26:19.9516247Z Adding repo from: https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo 2024-12-18T00:26:20.0234012Z + sudo yum install -y nvidia-docker2 nvidia-container-toolkit-1.16.2 2024-12-18T00:26:20.4781676Z nvidia-container-toolkit 10 kB/s | 833 B 00:00 2024-12-18T00:26:20.5013376Z Package nvidia-docker2-2.14.0-1.noarch is already installed. 2024-12-18T00:26:20.5021194Z Package nvidia-container-toolkit-1.16.2-1.x86_64 is already installed. 2024-12-18T00:26:20.5357709Z Dependencies resolved. 2024-12-18T00:26:20.5498695Z Nothing to do. 2024-12-18T00:26:20.5499133Z Complete! 2024-12-18T00:26:20.6464231Z + sudo systemctl restart docker 2024-12-18T00:27:20.3295504Z nvidia-persistenced failed to initialize. Check syslog for more details. 2024-12-18T00:27:20.3537671Z Wed Dec 18 00:27:20 2024 2024-12-18T00:27:20.3538073Z +-----------------------------------------------------------------------------------------+ 2024-12-18T00:27:20.3538605Z | NVIDIA-SMI 550.54.15 Driver Version: 550.54.15 CUDA Version: 12.4 | 2024-12-18T00:27:20.3539126Z |-----------------------------------------+------------------------+----------------------+ 2024-12-18T00:27:20.3539646Z | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | 2024-12-18T00:27:20.3540243Z | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | 2024-12-18T00:27:20.3540809Z | | | MIG M. | 2024-12-18T00:27:20.3541211Z |=========================================+========================+======================| 2024-12-18T00:27:20.3734352Z | 0 NVIDIA A10G On | 00000000:00:1E.0 Off | 0 | 2024-12-18T00:27:20.3734932Z | 0% 19C P8 15W / 300W | 0MiB / 23028MiB | 0% Default | 2024-12-18T00:27:20.3735388Z | | | N/A | 2024-12-18T00:27:20.3735802Z +-----------------------------------------+------------------------+----------------------+ 2024-12-18T00:27:20.3739315Z 2024-12-18T00:27:20.3739888Z +-----------------------------------------------------------------------------------------+ 2024-12-18T00:27:20.3740357Z | Processes: | 2024-12-18T00:27:20.3740971Z | GPU GI CI PID Type Process name GPU Memory | 2024-12-18T00:27:20.3741728Z | ID ID Usage | 2024-12-18T00:27:20.3742099Z |=========================================================================================| 2024-12-18T00:27:20.3746547Z | No running processes found | 2024-12-18T00:27:20.3747051Z +-----------------------------------------------------------------------------------------+ 2024-12-18T00:27:21.4757407Z Command completed after 1 attempt(s). 2024-12-18T00:27:21.4851774Z ##[group]Run python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84 2024-12-18T00:27:21.4852334Z python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84 2024-12-18T00:27:21.4852820Z python3 -m tools.stats.monitor > usage_log.txt 2>&1 & 2024-12-18T00:27:21.4853277Z echo "monitor-script-pid=${!}" >> "${GITHUB_OUTPUT}" 2024-12-18T00:27:21.4867809Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:27:21.4868181Z env: 2024-12-18T00:27:21.4868395Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:27:21.4868723Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:27:21.4869287Z ##[endgroup] 2024-12-18T00:27:21.7361080Z Defaulting to user installation because normal site-packages is not writeable 2024-12-18T00:27:21.7549878Z Requirement already satisfied: psutil==5.9.1 in /home/ec2-user/.local/lib/python3.9/site-packages (5.9.1) 2024-12-18T00:27:21.7555488Z Requirement already satisfied: nvidia-ml-py==11.525.84 in /home/ec2-user/.local/lib/python3.9/site-packages (11.525.84) 2024-12-18T00:27:21.8907807Z Prepare all required actions 2024-12-18T00:27:21.8908840Z Getting action download info 2024-12-18T00:27:22.0433113Z Download action repository 'seemethere/download-artifact-s3@v4' (SHA:1da556a7aa0a088e3153970611f6c432d58e80e6) 2024-12-18T00:27:22.4397175Z Download action repository 'actions/download-artifact@v4' (SHA:fa0a91b85d4f404e444e00e005971372dc801d16) 2024-12-18T00:27:22.7238567Z ##[group]Run ./.github/actions/download-build-artifacts 2024-12-18T00:27:22.7238997Z with: 2024-12-18T00:27:22.7239298Z name: linux-focal-cuda12.4-py3.10-gcc9-sm86 2024-12-18T00:27:22.7239719Z s3-bucket: gha-artifacts 2024-12-18T00:27:22.7240034Z env: 2024-12-18T00:27:22.7240285Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:27:22.7240685Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:27:22.7241113Z ##[endgroup] 2024-12-18T00:27:22.7281931Z ##[group]Run seemethere/download-artifact-s3@v4 2024-12-18T00:27:22.7282332Z with: 2024-12-18T00:27:22.7282662Z name: linux-focal-cuda12.4-py3.10-gcc9-sm86 2024-12-18T00:27:22.7283054Z s3-bucket: gha-artifacts 2024-12-18T00:27:22.7283365Z region: us-east-1 2024-12-18T00:27:22.7283635Z env: 2024-12-18T00:27:22.7283891Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:27:22.7284279Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:27:22.7284701Z ##[endgroup] 2024-12-18T00:27:23.2033607Z (node:192204) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2024-12-18T00:27:23.2034101Z 2024-12-18T00:27:23.2034301Z Please migrate your code to use AWS SDK for JavaScript (v3). 2024-12-18T00:27:23.2034854Z For more information, check the migration guide at https://a.co/7PzMCcy 2024-12-18T00:27:23.2035425Z (Use `node --trace-warnings ...` to show where the warning was created) 2024-12-18T00:27:23.3072426Z Found 1 objects with prefix pytorch/pytorch/12383255690/linux-focal-cuda12.4-py3.10-gcc9-sm86/ 2024-12-18T00:27:23.3073197Z Starting download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2024-12-18T00:27:31.1541810Z Finished download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2024-12-18T00:27:31.1547498Z Artifact download has finished successfully 2024-12-18T00:27:31.1918439Z ##[group]Run unzip -o artifacts.zip 2024-12-18T00:27:31.1918775Z unzip -o artifacts.zip 2024-12-18T00:27:31.1928934Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:27:31.1929306Z env: 2024-12-18T00:27:31.1929524Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:27:31.1929853Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:27:31.1930220Z ##[endgroup] 2024-12-18T00:27:31.1980102Z Archive: artifacts.zip 2024-12-18T00:27:31.1981968Z creating: dist/ 2024-12-18T00:27:33.3845298Z inflating: dist/torch-2.6.0a0+git0cdf8b1-cp310-cp310-linux_x86_64.whl 2024-12-18T00:27:33.3845890Z creating: build/custom_test_artifacts/ 2024-12-18T00:27:33.3846368Z creating: build/custom_test_artifacts/custom-op-build/ 2024-12-18T00:27:33.3846965Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/ 2024-12-18T00:27:33.3847532Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/pkgRedirects/ 2024-12-18T00:27:33.3854963Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeConfigureLog.yaml 2024-12-18T00:27:33.3855742Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/ 2024-12-18T00:27:33.3856487Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-12-18T00:27:33.3857243Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-12-18T00:27:33.3858207Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-12-18T00:27:33.3859469Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-12-18T00:27:33.3861894Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-12-18T00:27:33.3862673Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-12-18T00:27:33.3863362Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-12-18T00:27:33.3865055Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-12-18T00:27:33.3867012Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-12-18T00:27:33.3868925Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-12-18T00:27:33.3870681Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-12-18T00:27:33.3871555Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-12-18T00:27:33.3873485Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-12-18T00:27:33.3874228Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/ 2024-12-18T00:27:33.3874932Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/ 2024-12-18T00:27:33.3916391Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2024-12-18T00:27:33.3957978Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2024-12-18T00:27:33.3959011Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2024-12-18T00:27:33.4006362Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2024-12-18T00:27:33.4007354Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2024-12-18T00:27:33.4008909Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2024-12-18T00:27:33.4009954Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2024-12-18T00:27:33.4010954Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2024-12-18T00:27:33.4011926Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2024-12-18T00:27:33.4012916Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2024-12-18T00:27:33.4014298Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2024-12-18T00:27:33.4015362Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2024-12-18T00:27:33.4016318Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2024-12-18T00:27:33.4017328Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c 2024-12-18T00:27:33.4018432Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin 2024-12-18T00:27:33.4019317Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2024-12-18T00:27:33.4020543Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o 2024-12-18T00:27:33.4022259Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu 2024-12-18T00:27:33.4096788Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out 2024-12-18T00:27:33.4170613Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin 2024-12-18T00:27:33.4171454Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake 2024-12-18T00:27:33.4172162Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeScratch/ 2024-12-18T00:27:33.4172761Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeTmp/ 2024-12-18T00:27:33.4173392Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/cmake.check_cache 2024-12-18T00:27:33.4174046Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/ 2024-12-18T00:27:33.4174757Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.ts 2024-12-18T00:27:33.4175600Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.make 2024-12-18T00:27:33.4176381Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/depend.make 2024-12-18T00:27:33.4177132Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/link.txt 2024-12-18T00:27:33.4177898Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/cmake_clean.cmake 2024-12-18T00:27:33.4179179Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/build.make 2024-12-18T00:27:33.4179978Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/DependInfo.cmake 2024-12-18T00:27:33.4180843Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/flags.make 2024-12-18T00:27:33.4182155Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/progress.make 2024-12-18T00:27:33.4203599Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o.d 2024-12-18T00:27:33.4347759Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o 2024-12-18T00:27:33.4348478Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/ 2024-12-18T00:27:33.4349260Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.ts 2024-12-18T00:27:33.4350135Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.make 2024-12-18T00:27:33.4350970Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/depend.make 2024-12-18T00:27:33.4351756Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/link.txt 2024-12-18T00:27:33.4352569Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/cmake_clean.cmake 2024-12-18T00:27:33.4353387Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/build.make 2024-12-18T00:27:33.4354205Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/DependInfo.cmake 2024-12-18T00:27:33.4355015Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/flags.make 2024-12-18T00:27:33.4355823Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/progress.make 2024-12-18T00:27:33.4377387Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o.d 2024-12-18T00:27:33.4461092Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o 2024-12-18T00:27:33.4462293Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-12-18T00:27:33.4463195Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/TargetDirectories.txt 2024-12-18T00:27:33.4464144Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/progress.marks 2024-12-18T00:27:33.4464873Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile2 2024-12-18T00:27:33.4465812Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile.cmake 2024-12-18T00:27:33.4466524Z inflating: build/custom_test_artifacts/custom-op-build/detect_cuda_version.cc 2024-12-18T00:27:33.4469703Z inflating: build/custom_test_artifacts/custom-op-build/CMakeCache.txt 2024-12-18T00:27:33.4470515Z inflating: build/custom_test_artifacts/custom-op-build/Makefile 2024-12-18T00:27:33.4471410Z inflating: build/custom_test_artifacts/custom-op-build/cmake_install.cmake 2024-12-18T00:27:33.4592748Z inflating: build/custom_test_artifacts/custom-op-build/libcustom_ops.so 2024-12-18T00:27:33.4656702Z inflating: build/custom_test_artifacts/custom-op-build/test_custom_ops 2024-12-18T00:27:33.4657837Z creating: build/custom_test_artifacts/jit-hook-build/ 2024-12-18T00:27:33.4658765Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/ 2024-12-18T00:27:33.4659571Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/pkgRedirects/ 2024-12-18T00:27:33.4664989Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeConfigureLog.yaml 2024-12-18T00:27:33.4665627Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/ 2024-12-18T00:27:33.4666262Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-12-18T00:27:33.4666933Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-12-18T00:27:33.4667595Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-12-18T00:27:33.4669728Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-12-18T00:27:33.4671561Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-12-18T00:27:33.4672247Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-12-18T00:27:33.4672909Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-12-18T00:27:33.4675141Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-12-18T00:27:33.4676652Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-12-18T00:27:33.4678754Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-12-18T00:27:33.4679550Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-12-18T00:27:33.4681503Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-12-18T00:27:33.4682626Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-12-18T00:27:33.4683348Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/ 2024-12-18T00:27:33.4684022Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/ 2024-12-18T00:27:33.4726248Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2024-12-18T00:27:33.4768837Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2024-12-18T00:27:33.4770525Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2024-12-18T00:27:33.4817107Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2024-12-18T00:27:33.4818087Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2024-12-18T00:27:33.4819584Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2024-12-18T00:27:33.4820647Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2024-12-18T00:27:33.4821721Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2024-12-18T00:27:33.4822680Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2024-12-18T00:27:33.4823652Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2024-12-18T00:27:33.4824612Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2024-12-18T00:27:33.4825558Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2024-12-18T00:27:33.4826604Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2024-12-18T00:27:33.4827478Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c 2024-12-18T00:27:33.4828452Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin 2024-12-18T00:27:33.4829332Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2024-12-18T00:27:33.4830527Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o 2024-12-18T00:27:33.4832360Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu 2024-12-18T00:27:33.4909171Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out 2024-12-18T00:27:33.4982628Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin 2024-12-18T00:27:33.4983459Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake 2024-12-18T00:27:33.4984142Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeScratch/ 2024-12-18T00:27:33.4984728Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeTmp/ 2024-12-18T00:27:33.4985530Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/cmake.check_cache 2024-12-18T00:27:33.4986200Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/ 2024-12-18T00:27:33.4986937Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.ts 2024-12-18T00:27:33.4987766Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.make 2024-12-18T00:27:33.4988567Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/depend.make 2024-12-18T00:27:33.4989307Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/link.txt 2024-12-18T00:27:33.4990073Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/cmake_clean.cmake 2024-12-18T00:27:33.4990911Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/build.make 2024-12-18T00:27:33.4991696Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/DependInfo.cmake 2024-12-18T00:27:33.4992642Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/flags.make 2024-12-18T00:27:33.4993417Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/progress.make 2024-12-18T00:27:33.5015224Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o.d 2024-12-18T00:27:33.5079670Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o 2024-12-18T00:27:33.5080776Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-12-18T00:27:33.5081537Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/TargetDirectories.txt 2024-12-18T00:27:33.5082206Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/progress.marks 2024-12-18T00:27:33.5083076Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile2 2024-12-18T00:27:33.5084365Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile.cmake 2024-12-18T00:27:33.5085073Z inflating: build/custom_test_artifacts/jit-hook-build/detect_cuda_version.cc 2024-12-18T00:27:33.5088099Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeCache.txt 2024-12-18T00:27:33.5088727Z inflating: build/custom_test_artifacts/jit-hook-build/Makefile 2024-12-18T00:27:33.5089707Z inflating: build/custom_test_artifacts/jit-hook-build/cmake_install.cmake 2024-12-18T00:27:33.5139988Z inflating: build/custom_test_artifacts/jit-hook-build/test_jit_hooks 2024-12-18T00:27:33.5140515Z creating: build/custom_test_artifacts/custom-backend-build/ 2024-12-18T00:27:33.5141092Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/ 2024-12-18T00:27:33.5141704Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/pkgRedirects/ 2024-12-18T00:27:33.5148980Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeConfigureLog.yaml 2024-12-18T00:27:33.5149687Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/ 2024-12-18T00:27:33.5150376Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-12-18T00:27:33.5151112Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-12-18T00:27:33.5151830Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-12-18T00:27:33.5153847Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-12-18T00:27:33.5155263Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-12-18T00:27:33.5156004Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-12-18T00:27:33.5156738Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-12-18T00:27:33.5159210Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-12-18T00:27:33.5160665Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-12-18T00:27:33.5162823Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-12-18T00:27:33.5163679Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-12-18T00:27:33.5165242Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-12-18T00:27:33.5166639Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-12-18T00:27:33.5167409Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/ 2024-12-18T00:27:33.5168154Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/ 2024-12-18T00:27:33.5209874Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2024-12-18T00:27:33.5251678Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2024-12-18T00:27:33.5252927Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2024-12-18T00:27:33.5300031Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2024-12-18T00:27:33.5301139Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2024-12-18T00:27:33.5302198Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2024-12-18T00:27:33.5303291Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2024-12-18T00:27:33.5304327Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2024-12-18T00:27:33.5305359Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2024-12-18T00:27:33.5306393Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2024-12-18T00:27:33.5307419Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2024-12-18T00:27:33.5308427Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2024-12-18T00:27:33.5309382Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2024-12-18T00:27:33.5310314Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c 2024-12-18T00:27:33.5311227Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin 2024-12-18T00:27:33.5312143Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2024-12-18T00:27:33.5313049Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o 2024-12-18T00:27:33.5314978Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu 2024-12-18T00:27:33.5389506Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out 2024-12-18T00:27:33.5463744Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin 2024-12-18T00:27:33.5464726Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake 2024-12-18T00:27:33.5465479Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeScratch/ 2024-12-18T00:27:33.5466125Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeTmp/ 2024-12-18T00:27:33.5466794Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/cmake.check_cache 2024-12-18T00:27:33.5467505Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/ 2024-12-18T00:27:33.5468288Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.ts 2024-12-18T00:27:33.5469183Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.make 2024-12-18T00:27:33.5470049Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/depend.make 2024-12-18T00:27:33.5471039Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/link.txt 2024-12-18T00:27:33.5471869Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/cmake_clean.cmake 2024-12-18T00:27:33.5472824Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/build.make 2024-12-18T00:27:33.5473660Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/DependInfo.cmake 2024-12-18T00:27:33.5474490Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/flags.make 2024-12-18T00:27:33.5475312Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/progress.make 2024-12-18T00:27:33.5479874Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o.d 2024-12-18T00:27:33.5602881Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o 2024-12-18T00:27:33.5604539Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/ 2024-12-18T00:27:33.5606191Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.ts 2024-12-18T00:27:33.5608058Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.make 2024-12-18T00:27:33.5609755Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/depend.make 2024-12-18T00:27:33.5610633Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/link.txt 2024-12-18T00:27:33.5611504Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/cmake_clean.cmake 2024-12-18T00:27:33.5612389Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/build.make 2024-12-18T00:27:33.5613271Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/DependInfo.cmake 2024-12-18T00:27:33.5614154Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/flags.make 2024-12-18T00:27:33.5615029Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/progress.make 2024-12-18T00:27:33.5631934Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o.d 2024-12-18T00:27:33.5687124Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o 2024-12-18T00:27:33.5688041Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-12-18T00:27:33.5688847Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/TargetDirectories.txt 2024-12-18T00:27:33.5689589Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/progress.marks 2024-12-18T00:27:33.5690458Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile2 2024-12-18T00:27:33.5692072Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile.cmake 2024-12-18T00:27:33.5692746Z inflating: build/custom_test_artifacts/custom-backend-build/detect_cuda_version.cc 2024-12-18T00:27:33.5695875Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeCache.txt 2024-12-18T00:27:33.5696673Z inflating: build/custom_test_artifacts/custom-backend-build/Makefile 2024-12-18T00:27:33.5697544Z inflating: build/custom_test_artifacts/custom-backend-build/cmake_install.cmake 2024-12-18T00:27:33.5799108Z inflating: build/custom_test_artifacts/custom-backend-build/libcustom_backend.so 2024-12-18T00:27:33.5841718Z inflating: build/custom_test_artifacts/custom-backend-build/test_custom_backend 2024-12-18T00:27:33.5842363Z creating: build/lib/ 2024-12-18T00:27:33.5933399Z inflating: build/lib/libprotobuf-lite.a 2024-12-18T00:27:33.6388798Z inflating: build/lib/libprotobuf.a 2024-12-18T00:27:33.6398691Z inflating: build/lib/libpthreadpool.a 2024-12-18T00:27:33.6406879Z inflating: build/lib/libcpuinfo.a 2024-12-18T00:27:33.6415006Z inflating: build/lib/libcpuinfo_internals.a 2024-12-18T00:27:33.6415697Z inflating: build/lib/libclog.a 2024-12-18T00:27:33.6434571Z inflating: build/lib/libnnpack.a 2024-12-18T00:27:33.6437208Z inflating: build/lib/libnnpack_reference_layers.a 2024-12-18T00:27:33.6624043Z inflating: build/lib/libmicrokernels-prod.a 2024-12-18T00:27:33.6692913Z inflating: build/lib/libgtest.a 2024-12-18T00:27:33.6767518Z inflating: build/lib/libbenchmark.a 2024-12-18T00:27:33.6831392Z inflating: build/lib/libasmjit.a 2024-12-18T00:27:33.6839249Z inflating: build/lib/libittnotify.a 2024-12-18T00:27:33.6867123Z inflating: build/lib/libtensorpipe_uv.a 2024-12-18T00:27:33.6994362Z inflating: build/lib/libgloo.a 2024-12-18T00:27:33.7015822Z inflating: build/lib/libfmt.a 2024-12-18T00:27:33.7115629Z inflating: build/lib/libc10.so 2024-12-18T00:27:33.7117514Z inflating: build/lib/libcaffe2_nvrtc.so 2024-12-18T00:27:33.7118970Z inflating: build/lib/libtorch_global_deps.so 2024-12-18T00:27:33.7624408Z inflating: build/lib/libprotoc.a 2024-12-18T00:27:33.7644037Z inflating: build/lib/libpytorch_qnnpack.a 2024-12-18T00:27:33.7663252Z inflating: build/lib/libgmock.a 2024-12-18T00:27:33.7663578Z inflating: build/lib/libgtest_main.a 2024-12-18T00:27:33.7664351Z inflating: build/lib/libbenchmark_main.a 2024-12-18T00:27:33.8238367Z inflating: build/lib/libtensorpipe.a 2024-12-18T00:27:33.8627548Z inflating: build/lib/libgloo_cuda.a 2024-12-18T00:27:34.8944110Z inflating: build/lib/libdnnl.a 2024-12-18T00:27:34.9002984Z inflating: build/lib/libc10_cuda.so 2024-12-18T00:27:34.9003614Z inflating: build/lib/libgmock_main.a 2024-12-18T00:27:35.0266946Z inflating: build/lib/libfbgemm.a 2024-12-18T00:27:35.0523664Z inflating: build/lib/libtensorpipe_cuda.a 2024-12-18T00:27:35.1031056Z inflating: build/lib/libkineto.a 2024-12-18T00:27:35.1120749Z inflating: build/lib/libXNNPACK.a 2024-12-18T00:27:35.1163488Z inflating: build/lib/libonnx_proto.a 2024-12-18T00:27:35.1893996Z inflating: build/lib/libonnx.a 2024-12-18T00:27:35.2765370Z inflating: build/lib/libmicrokernels-all.a 2024-12-18T00:27:37.8048362Z inflating: build/lib/libtorch_cpu.so 2024-12-18T00:27:37.8053495Z inflating: build/lib/libunbox_lib.a 2024-12-18T00:27:37.8057760Z inflating: build/lib/libshm.so 2024-12-18T00:27:39.8991563Z inflating: build/lib/libtorch_cuda.so 2024-12-18T00:27:39.8992715Z inflating: build/lib/libtorch.so 2024-12-18T00:27:39.8995670Z inflating: build/lib/libc10d_cuda_test.so 2024-12-18T00:27:40.7782900Z inflating: build/lib/libtorch_cuda_linalg.so 2024-12-18T00:27:40.9864019Z inflating: build/lib/libtorch_python.so 2024-12-18T00:27:40.9934951Z inflating: build/lib/libtorchbind_test.so 2024-12-18T00:27:40.9954781Z inflating: build/lib/libjitbackend_test.so 2024-12-18T00:27:40.9979347Z inflating: build/lib/libbackend_with_compiler.so 2024-12-18T00:27:41.0004680Z inflating: build/lib/libaoti_custom_ops.so 2024-12-18T00:27:41.0039356Z inflating: build/lib/libnnapi_backend.so 2024-12-18T00:27:41.0039690Z creating: build/bin/ 2024-12-18T00:27:41.0093509Z inflating: build/bin/c10_CompileTimeFunctionPointer_test 2024-12-18T00:27:41.0148569Z inflating: build/bin/c10_DeviceGuard_test 2024-12-18T00:27:41.0203988Z inflating: build/bin/c10_Device_test 2024-12-18T00:27:41.0267124Z inflating: build/bin/c10_DispatchKeySet_test 2024-12-18T00:27:41.0323973Z inflating: build/bin/c10_Scalar_test 2024-12-18T00:27:41.0376202Z inflating: build/bin/c10_StreamGuard_test 2024-12-18T00:27:41.0431418Z inflating: build/bin/c10_SymInt_test 2024-12-18T00:27:41.0489014Z inflating: build/bin/c10_InlineDeviceGuard_test 2024-12-18T00:27:41.0548827Z inflating: build/bin/c10_InlineStreamGuard_test 2024-12-18T00:27:41.0608339Z inflating: build/bin/c10_SizesAndStrides_test 2024-12-18T00:27:41.0683044Z inflating: build/bin/c10_cow_test 2024-12-18T00:27:41.0736117Z inflating: build/bin/c10_ArrayRef_test 2024-12-18T00:27:41.0792177Z inflating: build/bin/c10_Bitset_test 2024-12-18T00:27:41.0844393Z inflating: build/bin/c10_ConstexprCrc_test 2024-12-18T00:27:41.0897433Z inflating: build/bin/c10_DeadlockDetection_test 2024-12-18T00:27:41.0952447Z inflating: build/bin/c10_Half_test 2024-12-18T00:27:41.1012343Z inflating: build/bin/c10_LeftRight_test 2024-12-18T00:27:41.1071182Z inflating: build/bin/c10_Metaprogramming_test 2024-12-18T00:27:41.1127303Z inflating: build/bin/c10_NetworkFlow_test 2024-12-18T00:27:41.1181720Z inflating: build/bin/c10_Synchronized_test 2024-12-18T00:27:41.1239956Z inflating: build/bin/c10_ThreadLocal_test 2024-12-18T00:27:41.1295184Z inflating: build/bin/c10_TypeIndex_test 2024-12-18T00:27:41.1350065Z inflating: build/bin/c10_TypeList_test 2024-12-18T00:27:41.1402080Z inflating: build/bin/c10_TypeTraits_test 2024-12-18T00:27:41.1457480Z inflating: build/bin/c10_accumulate_test 2024-12-18T00:27:41.1517019Z inflating: build/bin/c10_bfloat16_test 2024-12-18T00:27:41.1571552Z inflating: build/bin/c10_bit_cast_test 2024-12-18T00:27:41.1631655Z inflating: build/bin/c10_complex_math_test 2024-12-18T00:27:41.1690626Z inflating: build/bin/c10_complex_test 2024-12-18T00:27:41.1743263Z inflating: build/bin/c10_error_test 2024-12-18T00:27:41.1799659Z inflating: build/bin/c10_exception_test 2024-12-18T00:27:41.1853829Z inflating: build/bin/c10_flags_test 2024-12-18T00:27:41.1907740Z inflating: build/bin/c10_generic_math_test 2024-12-18T00:27:41.2082671Z inflating: build/bin/c10_intrusive_ptr_test 2024-12-18T00:27:41.2137359Z inflating: build/bin/c10_irange_test 2024-12-18T00:27:41.2194451Z inflating: build/bin/c10_lazy_test 2024-12-18T00:27:41.2255505Z inflating: build/bin/c10_logging_test 2024-12-18T00:27:41.2335417Z inflating: build/bin/c10_optional_test 2024-12-18T00:27:41.2401563Z inflating: build/bin/c10_ordered_preserving_dict_test 2024-12-18T00:27:41.2458587Z inflating: build/bin/c10_registry_test 2024-12-18T00:27:41.2618789Z inflating: build/bin/c10_small_vector_test 2024-12-18T00:27:41.2675223Z inflating: build/bin/c10_ssize_test 2024-12-18T00:27:41.2730329Z inflating: build/bin/c10_string_util_test 2024-12-18T00:27:41.2793486Z inflating: build/bin/c10_string_view_test 2024-12-18T00:27:41.2848160Z inflating: build/bin/c10_tempfile_test 2024-12-18T00:27:41.2906959Z inflating: build/bin/c10_typeid_test 2024-12-18T00:27:41.2958177Z inflating: build/bin/c10_intrusive_ptr_benchmark 2024-12-18T00:27:41.3407051Z inflating: build/bin/protoc-3.13.0.0 2024-12-18T00:27:41.3854581Z inflating: build/bin/protoc 2024-12-18T00:27:41.3911694Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_1_var_test 2024-12-18T00:27:41.3969071Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_catches_stream 2024-12-18T00:27:41.4025270Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_catches_thread_and_block_and_device 2024-12-18T00:27:41.4081055Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_from_2_processes 2024-12-18T00:27:41.4137170Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_blocks_and_threads 2024-12-18T00:27:41.4193308Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_multiple_blocks 2024-12-18T00:27:41.4249529Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_same_block 2024-12-18T00:27:41.4301933Z inflating: build/bin/c10_cuda_CUDATest 2024-12-18T00:27:41.4704599Z inflating: build/bin/vec_test_all_types_DEFAULT 2024-12-18T00:27:41.5116543Z inflating: build/bin/vec_test_all_types_AVX512 2024-12-18T00:27:41.5544185Z inflating: build/bin/vec_test_all_types_AVX2 2024-12-18T00:27:41.5600160Z inflating: build/bin/BackoffTest 2024-12-18T00:27:41.5658818Z inflating: build/bin/FileStoreTest 2024-12-18T00:27:41.5717464Z inflating: build/bin/TCPStoreTest 2024-12-18T00:27:41.5774732Z inflating: build/bin/HashStoreTest 2024-12-18T00:27:41.5788473Z inflating: build/bin/ProcessGroupMPITest 2024-12-18T00:27:41.5846252Z inflating: build/bin/test_edge_op_registration 2024-12-18T00:27:41.5850773Z inflating: build/bin/torch_shm_manager 2024-12-18T00:27:41.5853648Z inflating: build/bin/example_allreduce 2024-12-18T00:27:41.5912118Z inflating: build/bin/test_dist_autograd 2024-12-18T00:27:41.5985268Z inflating: build/bin/test_cpp_rpc 2024-12-18T00:27:41.5987795Z inflating: build/bin/parallel_benchmark 2024-12-18T00:27:41.6058785Z inflating: build/bin/test_mobile_nnc 2024-12-18T00:27:41.6068079Z inflating: build/bin/aot_model_compiler_test 2024-12-18T00:27:41.6421585Z inflating: build/bin/test_lazy 2024-12-18T00:27:41.7613721Z inflating: build/bin/test_api 2024-12-18T00:27:41.7692120Z inflating: build/bin/Dict_test 2024-12-18T00:27:41.7747609Z inflating: build/bin/Dimname_test 2024-12-18T00:27:41.7817746Z inflating: build/bin/MaybeOwned_test 2024-12-18T00:27:41.7878902Z inflating: build/bin/NamedTensor_test 2024-12-18T00:27:41.7941764Z inflating: build/bin/apply_utils_test 2024-12-18T00:27:41.8004563Z inflating: build/bin/atest 2024-12-18T00:27:41.8071790Z inflating: build/bin/basic 2024-12-18T00:27:41.8130221Z inflating: build/bin/broadcast_test 2024-12-18T00:27:41.8185003Z inflating: build/bin/cpu_allocator_test 2024-12-18T00:27:41.8247663Z inflating: build/bin/cpu_generator_test 2024-12-18T00:27:41.8304481Z inflating: build/bin/cpu_profiling_allocator_test 2024-12-18T00:27:41.8400438Z inflating: build/bin/cpu_rng_test 2024-12-18T00:27:41.8454034Z inflating: build/bin/dispatch_key_set_test 2024-12-18T00:27:41.8508172Z inflating: build/bin/dlconvertor_test 2024-12-18T00:27:41.8571311Z inflating: build/bin/extension_backend_test 2024-12-18T00:27:41.8630110Z inflating: build/bin/half_test 2024-12-18T00:27:41.8731930Z inflating: build/bin/ivalue_test 2024-12-18T00:27:41.8785314Z inflating: build/bin/lazy_tensor_test 2024-12-18T00:27:41.8844480Z inflating: build/bin/math_kernel_test 2024-12-18T00:27:41.8902001Z inflating: build/bin/memory_format_test 2024-12-18T00:27:41.8958423Z inflating: build/bin/memory_overlapping_test 2024-12-18T00:27:41.9015046Z inflating: build/bin/mobile_memory_cleanup 2024-12-18T00:27:41.9075317Z inflating: build/bin/native_test 2024-12-18T00:27:41.9130545Z inflating: build/bin/operator_name_test 2024-12-18T00:27:41.9184671Z inflating: build/bin/operators_test 2024-12-18T00:27:41.9240535Z inflating: build/bin/packedtensoraccessor_test 2024-12-18T00:27:41.9311024Z inflating: build/bin/pow_test 2024-12-18T00:27:41.9372366Z inflating: build/bin/quantized_test 2024-12-18T00:27:41.9425498Z inflating: build/bin/reduce_ops_test 2024-12-18T00:27:41.9480420Z inflating: build/bin/reportMemoryUsage_test 2024-12-18T00:27:41.9542528Z inflating: build/bin/scalar_tensor_test 2024-12-18T00:27:41.9604835Z inflating: build/bin/scalar_test 2024-12-18T00:27:41.9660770Z inflating: build/bin/StorageUtils_test 2024-12-18T00:27:41.9716040Z inflating: build/bin/stride_properties_test 2024-12-18T00:27:41.9799338Z inflating: build/bin/tensor_iterator_test 2024-12-18T00:27:41.9859490Z inflating: build/bin/test_parallel 2024-12-18T00:27:41.9862717Z inflating: build/bin/thread_init_test 2024-12-18T00:27:41.9921442Z inflating: build/bin/type_ptr_test 2024-12-18T00:27:41.9986961Z inflating: build/bin/type_test 2024-12-18T00:27:42.0043247Z inflating: build/bin/undefined_tensor_test 2024-12-18T00:27:42.0045109Z inflating: build/bin/verify_api_visibility 2024-12-18T00:27:42.0118872Z inflating: build/bin/legacy_vmap_test 2024-12-18T00:27:42.0174162Z inflating: build/bin/weakref_test 2024-12-18T00:27:42.0229112Z inflating: build/bin/wrapdim_test 2024-12-18T00:27:42.0284136Z inflating: build/bin/xla_tensor_test 2024-12-18T00:27:42.0347404Z inflating: build/bin/IListRef_test 2024-12-18T00:27:42.0459113Z inflating: build/bin/List_test 2024-12-18T00:27:42.0529284Z inflating: build/bin/KernelFunction_test 2024-12-18T00:27:42.0655441Z inflating: build/bin/kernel_function_legacy_test 2024-12-18T00:27:42.0755913Z inflating: build/bin/kernel_function_test 2024-12-18T00:27:42.0890490Z inflating: build/bin/kernel_lambda_legacy_test 2024-12-18T00:27:42.0998863Z inflating: build/bin/kernel_lambda_test 2024-12-18T00:27:42.1064494Z inflating: build/bin/kernel_stackbased_test 2024-12-18T00:27:42.1164258Z inflating: build/bin/make_boxed_from_unboxed_functor_test 2024-12-18T00:27:42.1218846Z inflating: build/bin/CppSignature_test 2024-12-18T00:27:42.1278486Z inflating: build/bin/backend_fallback_test 2024-12-18T00:27:42.1330801Z inflating: build/bin/op_allowlist_test 2024-12-18T00:27:42.1639189Z inflating: build/bin/op_registration_test 2024-12-18T00:27:42.1706630Z inflating: build/bin/inline_container_test 2024-12-18T00:27:42.1763405Z inflating: build/bin/cuda_apply_test 2024-12-18T00:27:42.1818947Z inflating: build/bin/cuda_allocator_test 2024-12-18T00:27:42.1877517Z inflating: build/bin/cuda_caching_host_allocator_test 2024-12-18T00:27:42.1941212Z inflating: build/bin/cuda_atomic_ops_test 2024-12-18T00:27:42.2015482Z inflating: build/bin/cuda_complex_math_test 2024-12-18T00:27:42.2079037Z inflating: build/bin/cuda_complex_test 2024-12-18T00:27:42.2132668Z inflating: build/bin/cuda_device_test 2024-12-18T00:27:42.2194393Z inflating: build/bin/cuda_cub_test 2024-12-18T00:27:42.2249999Z inflating: build/bin/cuda_dlconvertor_test 2024-12-18T00:27:42.2318775Z inflating: build/bin/cuda_distributions_test 2024-12-18T00:27:42.2379803Z inflating: build/bin/cuda_generator_test 2024-12-18T00:27:42.2434234Z inflating: build/bin/cuda_half_test 2024-12-18T00:27:42.2489391Z inflating: build/bin/cuda_integer_divider_test 2024-12-18T00:27:42.2542368Z inflating: build/bin/cuda_optional_test 2024-12-18T00:27:42.2597553Z inflating: build/bin/cuda_packedtensoraccessor_test 2024-12-18T00:27:42.2654029Z inflating: build/bin/cuda_reportMemoryUsage_test 2024-12-18T00:27:42.2707103Z inflating: build/bin/cuda_allocatorTraceTracker_test 2024-12-18T00:27:42.2773402Z inflating: build/bin/cuda_stream_test 2024-12-18T00:27:42.2826062Z inflating: build/bin/cuda_cudnn_test 2024-12-18T00:27:42.2881936Z inflating: build/bin/cuda_vectorized_test 2024-12-18T00:27:42.2896423Z inflating: build/bin/tutorial_tensorexpr 2024-12-18T00:27:42.2966140Z inflating: build/bin/ProcessGroupGlooTest 2024-12-18T00:27:42.3027242Z inflating: build/bin/ProcessGroupGlooAsyncTest 2024-12-18T00:27:42.3094963Z inflating: build/bin/ProcessGroupNCCLTest 2024-12-18T00:27:42.3161237Z inflating: build/bin/ProcessGroupNCCLErrorsTest 2024-12-18T00:27:42.4005881Z inflating: build/bin/test_tensorexpr 2024-12-18T00:27:42.4591728Z inflating: build/bin/test_jit 2024-12-18T00:27:42.4592098Z creating: .additional_ci_files/ 2024-12-18T00:27:42.4682966Z inflating: .additional_ci_files/test-times.json 2024-12-18T00:27:42.5045308Z inflating: .additional_ci_files/test-class-times.json 2024-12-18T00:27:42.5085417Z ##[group]Run rm artifacts.zip 2024-12-18T00:27:42.5085714Z rm artifacts.zip 2024-12-18T00:27:42.5094449Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:27:42.5094815Z env: 2024-12-18T00:27:42.5095035Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:27:42.5095384Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:27:42.5095758Z ##[endgroup] 2024-12-18T00:27:42.6262398Z ##[group]Run df -H 2024-12-18T00:27:42.6262651Z df -H 2024-12-18T00:27:42.6271351Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:27:42.6271729Z env: 2024-12-18T00:27:42.6271947Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:27:42.6272275Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:27:42.6272630Z ##[endgroup] 2024-12-18T00:27:42.6335231Z Filesystem Size Used Avail Use% Mounted on 2024-12-18T00:27:42.6335945Z devtmpfs 4.2M 0 4.2M 0% /dev 2024-12-18T00:27:42.6336284Z tmpfs 34G 0 34G 0% /dev/shm 2024-12-18T00:27:42.6336626Z tmpfs 14G 553k 14G 1% /run 2024-12-18T00:27:42.6336955Z /dev/nvme0n1p1 161G 60G 102G 37% / 2024-12-18T00:27:42.6337279Z tmpfs 34G 25k 34G 1% /tmp 2024-12-18T00:27:42.6337630Z /dev/nvme0n1p128 11M 1.4M 9.2M 13% /boot/efi 2024-12-18T00:27:42.6337993Z tmpfs 6.7G 0 6.7G 0% /run/user/0 2024-12-18T00:27:42.6370601Z Prepare all required actions 2024-12-18T00:27:42.6370975Z Getting action download info 2024-12-18T00:27:42.7962407Z ##[group]Run ./.github/actions/download-td-artifacts 2024-12-18T00:27:42.7962750Z with: 2024-12-18T00:27:42.7962955Z env: 2024-12-18T00:27:42.7963171Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:27:42.7963505Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:27:42.7963875Z ##[endgroup] 2024-12-18T00:27:42.7997341Z ##[group]Run seemethere/download-artifact-s3@v4 2024-12-18T00:27:42.7997675Z with: 2024-12-18T00:27:42.7997886Z name: td_results 2024-12-18T00:27:42.7998130Z s3-bucket: gha-artifacts 2024-12-18T00:27:42.7998389Z region: us-east-1 2024-12-18T00:27:42.7998615Z env: 2024-12-18T00:27:42.7998826Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:27:42.7999150Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:27:42.7999500Z ##[endgroup] 2024-12-18T00:27:43.2615388Z (node:192225) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2024-12-18T00:27:43.2616351Z 2024-12-18T00:27:43.2616550Z Please migrate your code to use AWS SDK for JavaScript (v3). 2024-12-18T00:27:43.2617067Z For more information, check the migration guide at https://a.co/7PzMCcy 2024-12-18T00:27:43.2617618Z (Use `node --trace-warnings ...` to show where the warning was created) 2024-12-18T00:27:43.3570772Z Found 0 objects with prefix pytorch/pytorch/12383255690/td_results/ 2024-12-18T00:27:43.3577060Z Artifact download has finished successfully 2024-12-18T00:27:43.3932825Z ##[group]Run mkdir -p .additional_ci_files 2024-12-18T00:27:43.3933194Z mkdir -p .additional_ci_files 2024-12-18T00:27:43.3933618Z mv td_results.json .additional_ci_files/td_results.json || true 2024-12-18T00:27:43.3943267Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:27:43.3943638Z env: 2024-12-18T00:27:43.3943855Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:27:43.3944220Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:27:43.3944612Z ##[endgroup] 2024-12-18T00:27:43.4019878Z mv: cannot stat 'td_results.json': No such file or directory 2024-12-18T00:27:43.4058143Z ##[group]Run .github/scripts/parse_ref.py 2024-12-18T00:27:43.4058557Z .github/scripts/parse_ref.py 2024-12-18T00:27:43.4067729Z shell: /usr/bin/bash -e {0} 2024-12-18T00:27:43.4067995Z env: 2024-12-18T00:27:43.4068217Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:27:43.4068553Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:27:43.4068920Z ##[endgroup] 2024-12-18T00:27:43.4358437Z Prepare all required actions 2024-12-18T00:27:43.4409534Z ##[group]Run ./.github/actions/get-workflow-job-id 2024-12-18T00:27:43.4410073Z with: 2024-12-18T00:27:43.4410624Z github-token: *** 2024-12-18T00:27:43.4410982Z env: 2024-12-18T00:27:43.4411288Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:27:43.4411781Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:27:43.4412310Z ##[endgroup] 2024-12-18T00:27:43.4456099Z ##[group]Run set -eux 2024-12-18T00:27:43.4456479Z set -eux 2024-12-18T00:27:43.4457101Z python3 .github/scripts/get_workflow_job_id.py "${GITHUB_RUN_ID}" "${RUNNER_NAME}" 2024-12-18T00:27:43.4468888Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:27:43.4469475Z env: 2024-12-18T00:27:43.4469798Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:27:43.4470305Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:27:43.4471109Z GITHUB_TOKEN: *** 2024-12-18T00:27:43.4471486Z ##[endgroup] 2024-12-18T00:27:43.4506669Z + python3 .github/scripts/get_workflow_job_id.py 12383255690 i-028bf30e8c4fafc3a 2024-12-18T00:27:44.4503237Z setting job-id=34567098339 2024-12-18T00:27:44.4503848Z setting job-name=unit-test / cuda12.4-py3.10-gcc9-sm86 / test (inductor_cpp_wrapper, 1, 1, linux.g5.4xlarge.nvidia.gpu) 2024-12-18T00:27:44.4677349Z Prepare all required actions 2024-12-18T00:27:44.4677720Z Getting action download info 2024-12-18T00:27:44.6321624Z ##[group]Run ./.github/actions/filter-test-configs 2024-12-18T00:27:44.6321974Z with: 2024-12-18T00:27:44.6322362Z github-token: *** 2024-12-18T00:27:44.6323749Z test-matrix: {"include": [{"config": "inductor", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_distributed", "shard": 1, "num_shards": 1, "runner": "linux.g5.12xlarge.nvidia.gpu"}, {"config": "inductor_cpp_wrapper", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}]} 2024-12-18T00:27:44.6325472Z job-name: unit-test / cuda12.4-py3.10-gcc9-sm86 / test (inductor_cpp_wrapper, 1, 1, linux.g5.4xlarge.nvidia.gpu) 2024-12-18T00:27:44.6326031Z env: 2024-12-18T00:27:44.6326243Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:27:44.6327045Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:27:44.6327407Z ##[endgroup] 2024-12-18T00:27:44.6370182Z ##[group]Run nick-fields/retry@v3.0.0 2024-12-18T00:27:44.6370492Z with: 2024-12-18T00:27:44.6370703Z shell: bash 2024-12-18T00:27:44.6370926Z timeout_minutes: 10 2024-12-18T00:27:44.6371172Z max_attempts: 5 2024-12-18T00:27:44.6371409Z retry_wait_seconds: 30 2024-12-18T00:27:44.6372185Z command: set -eux # PyYAML 6.0 doesn't work with MacOS x86 anymore # This must run on Python-3.7 (AmazonLinux2) so can't use request=3.32.2 python3 -m pip install requests==2.27.1 pyyaml==6.0.1 2024-12-18T00:27:44.6372977Z polling_interval_seconds: 1 2024-12-18T00:27:44.6373251Z warning_on_retry: true 2024-12-18T00:27:44.6373517Z continue_on_error: false 2024-12-18T00:27:44.6373781Z env: 2024-12-18T00:27:44.6374000Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:27:44.6374328Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:27:44.6374839Z GITHUB_TOKEN: *** 2024-12-18T00:27:44.6375076Z ##[endgroup] 2024-12-18T00:27:44.7364052Z + python3 -m pip install requests==2.27.1 pyyaml==6.0.1 2024-12-18T00:27:44.9738706Z Defaulting to user installation because normal site-packages is not writeable 2024-12-18T00:27:44.9923872Z Requirement already satisfied: requests==2.27.1 in /home/ec2-user/.local/lib/python3.9/site-packages (2.27.1) 2024-12-18T00:27:44.9927199Z Requirement already satisfied: pyyaml==6.0.1 in /home/ec2-user/.local/lib/python3.9/site-packages (6.0.1) 2024-12-18T00:27:45.0050791Z Requirement already satisfied: idna<4,>=2.5 in /usr/lib/python3.9/site-packages (from requests==2.27.1) (2.10) 2024-12-18T00:27:45.0053710Z Requirement already satisfied: certifi>=2017.4.17 in /home/ec2-user/.local/lib/python3.9/site-packages (from requests==2.27.1) (2024.12.14) 2024-12-18T00:27:45.0061495Z Requirement already satisfied: charset-normalizer~=2.0.0 in /home/ec2-user/.local/lib/python3.9/site-packages (from requests==2.27.1) (2.0.12) 2024-12-18T00:27:45.0066655Z Requirement already satisfied: urllib3<1.27,>=1.21.1 in /usr/lib/python3.9/site-packages (from requests==2.27.1) (1.25.10) 2024-12-18T00:27:45.7140385Z Command completed after 1 attempt(s). 2024-12-18T00:27:45.7212547Z ##[group]Run set -x 2024-12-18T00:27:45.7212818Z set -x 2024-12-18T00:27:45.7213048Z  2024-12-18T00:27:45.7213412Z # Use relative path here as this could be checked out anywhere, not necessarily 2024-12-18T00:27:45.7213883Z # in runner workspace 2024-12-18T00:27:45.7214261Z python3 "${GITHUB_ACTION_PATH}/../../scripts/parse_ref.py" 2024-12-18T00:27:45.7223083Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:27:45.7223454Z env: 2024-12-18T00:27:45.7223664Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:27:45.7223993Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:27:45.7224343Z ##[endgroup] 2024-12-18T00:27:45.7253652Z + python3 /home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/filter-test-configs/../../scripts/parse_ref.py 2024-12-18T00:27:45.7496176Z ##[group]Run echo "Workflow: ${GITHUB_WORKFLOW}" 2024-12-18T00:27:45.7496581Z echo "Workflow: ${GITHUB_WORKFLOW}" 2024-12-18T00:27:45.7496922Z echo "Job name: ${JOB_NAME}" 2024-12-18T00:27:45.7497216Z  2024-12-18T00:27:45.7497589Z # Use relative path here as this could be checked out anywhere, not necessarily 2024-12-18T00:27:45.7498062Z # in runner workspace 2024-12-18T00:27:45.7498478Z python3 "${GITHUB_ACTION_PATH}/../../scripts/filter_test_configs.py" \ 2024-12-18T00:27:45.7498942Z  --workflow "${GITHUB_WORKFLOW}" \ 2024-12-18T00:27:45.7499269Z  --job-name "${JOB_NAME}" \ 2024-12-18T00:27:45.7500742Z  --test-matrix "{"include": [{"config": "inductor", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_distributed", "shard": 1, "num_shards": 1, "runner": "linux.g5.12xlarge.nvidia.gpu"}, {"config": "inductor_cpp_wrapper", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}]}" \ 2024-12-18T00:27:45.7502376Z  --selected-test-configs "" \ 2024-12-18T00:27:45.7502713Z  --pr-number "${PR_NUMBER}" \ 2024-12-18T00:27:45.7503026Z  --tag "${TAG}" \ 2024-12-18T00:27:45.7503318Z  --event-name "${EVENT_NAME}" \ 2024-12-18T00:27:45.7503642Z  --schedule "${SCHEDULE}" \ 2024-12-18T00:27:45.7503949Z  --branch "${HEAD_BRANCH}" 2024-12-18T00:27:45.7512688Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:27:45.7513061Z env: 2024-12-18T00:27:45.7513277Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:27:45.7513606Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:27:45.7514137Z GITHUB_TOKEN: *** 2024-12-18T00:27:45.7514645Z JOB_NAME: unit-test / cuda12.4-py3.10-gcc9-sm86 / test (inductor_cpp_wrapper, 1, 1, linux.g5.4xlarge.nvidia.gpu) 2024-12-18T00:27:45.7515195Z PR_NUMBER: 2024-12-18T00:27:45.7515417Z TAG: 2024-12-18T00:27:45.7515623Z EVENT_NAME: push 2024-12-18T00:27:45.7515861Z SCHEDULE: 2024-12-18T00:27:45.7516077Z HEAD_BRANCH: 2024-12-18T00:27:45.7516295Z ##[endgroup] 2024-12-18T00:27:45.7544329Z Workflow: inductor 2024-12-18T00:27:45.7544847Z Job name: unit-test / cuda12.4-py3.10-gcc9-sm86 / test (inductor_cpp_wrapper, 1, 1, linux.g5.4xlarge.nvidia.gpu) 2024-12-18T00:27:46.0601599Z ##[group]Run echo "Filtered matrix:" 2024-12-18T00:27:46.0601954Z echo "Filtered matrix:" 2024-12-18T00:27:46.0603437Z echo "{"include": [{"config": "inductor", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "inductor_distributed", "shard": 1, "num_shards": 1, "runner": "linux.g5.12xlarge.nvidia.gpu"}, {"config": "inductor_cpp_wrapper", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}]}" 2024-12-18T00:27:46.0604913Z  2024-12-18T00:27:46.0605128Z echo 2024-12-18T00:27:46.0605401Z echo "Is the current job unstable? False" 2024-12-18T00:27:46.0605927Z  2024-12-18T00:27:46.0606139Z echo 2024-12-18T00:27:46.0606405Z echo "Is keep-going label set? False" 2024-12-18T00:27:46.0606732Z  2024-12-18T00:27:46.0606937Z echo 2024-12-18T00:27:46.0607176Z echo "Renabled issues? " 2024-12-18T00:27:46.0615796Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:27:46.0616174Z env: 2024-12-18T00:27:46.0616395Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:27:46.0616727Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:27:46.0617092Z ##[endgroup] 2024-12-18T00:27:46.0645729Z Filtered matrix: 2024-12-18T00:27:46.0648263Z {include: [{config: inductor, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: inductor, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: inductor_distributed, shard: 1, num_shards: 1, runner: linux.g5.12xlarge.nvidia.gpu}, {config: inductor_cpp_wrapper, shard: 1, num_shards: 1, runner: linux.g5.4xlarge.nvidia.gpu}]} 2024-12-18T00:27:46.0650433Z 2024-12-18T00:27:46.0650626Z Is the current job unstable? False 2024-12-18T00:27:46.0650975Z 2024-12-18T00:27:46.0651153Z Is keep-going label set? False 2024-12-18T00:27:46.0651468Z 2024-12-18T00:27:46.0651627Z Renabled issues? 2024-12-18T00:27:46.0699121Z ##[group]Run echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2024-12-18T00:27:46.0699615Z echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2024-12-18T00:27:46.0708478Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:27:46.0724051Z env: 2024-12-18T00:27:46.0724299Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:27:46.0724631Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:27:46.0724984Z JOB_TIMEOUT: 240 2024-12-18T00:27:46.0725215Z ##[endgroup] 2024-12-18T00:27:46.0799492Z ##[group]Run set -x 2024-12-18T00:27:46.0799797Z set -x 2024-12-18T00:27:46.0800034Z  2024-12-18T00:27:46.0800288Z if [[ $TEST_CONFIG == 'multigpu' ]]; then 2024-12-18T00:27:46.0800668Z  TEST_COMMAND=.ci/pytorch/multigpu-test.sh 2024-12-18T00:27:46.0801056Z elif [[ $BUILD_ENVIRONMENT == *onnx* ]]; then 2024-12-18T00:27:46.0801402Z  TEST_COMMAND=.ci/onnx/test.sh 2024-12-18T00:27:46.0801696Z else 2024-12-18T00:27:46.0801946Z  TEST_COMMAND=.ci/pytorch/test.sh 2024-12-18T00:27:46.0802248Z fi 2024-12-18T00:27:46.0802457Z  2024-12-18T00:27:46.0802774Z # detached container should get cleaned up by teardown_ec2_linux 2024-12-18T00:27:46.0803290Z # TODO: Stop building test binaries as part of the build phase 2024-12-18T00:27:46.0803743Z # Used for GPU_FLAG since that doesn't play nice 2024-12-18T00:27:46.0804142Z # shellcheck disable=SC2086,SC2090 2024-12-18T00:27:46.0804472Z container_name=$(docker run \ 2024-12-18T00:27:46.0804779Z  ${GPU_FLAG:-} \ 2024-12-18T00:27:46.0805084Z  ${SCCACHE_SERVER_PORT_DOCKER_FLAG:-} \ 2024-12-18T00:27:46.0805424Z  -e BUILD_ENVIRONMENT \ 2024-12-18T00:27:46.0805718Z  -e PR_NUMBER \ 2024-12-18T00:27:46.0805981Z  -e GITHUB_ACTIONS \ 2024-12-18T00:27:46.0806267Z  -e GITHUB_REPOSITORY \ 2024-12-18T00:27:46.0806568Z  -e GITHUB_WORKFLOW \ 2024-12-18T00:27:46.0806851Z  -e GITHUB_JOB \ 2024-12-18T00:27:46.0807117Z  -e GITHUB_RUN_ID \ 2024-12-18T00:27:46.0807388Z  -e GITHUB_RUN_NUMBER \ 2024-12-18T00:27:46.0807682Z  -e GITHUB_RUN_ATTEMPT \ 2024-12-18T00:27:46.0807971Z  -e JOB_ID \ 2024-12-18T00:27:46.0808224Z  -e JOB_NAME \ 2024-12-18T00:27:46.0808484Z  -e BASE_SHA \ 2024-12-18T00:27:46.0808732Z  -e BRANCH \ 2024-12-18T00:27:46.0808987Z  -e SHA1 \ 2024-12-18T00:27:46.0809238Z  -e AWS_DEFAULT_REGION \ 2024-12-18T00:27:46.0809722Z  -e IN_WHEEL_TEST \ 2024-12-18T00:27:46.0809997Z  -e SHARD_NUMBER \ 2024-12-18T00:27:46.0810261Z  -e TEST_CONFIG \ 2024-12-18T00:27:46.0810532Z  -e NUM_TEST_SHARDS \ 2024-12-18T00:27:46.0810817Z  -e REENABLED_ISSUES \ 2024-12-18T00:27:46.0811117Z  -e CONTINUE_THROUGH_ERROR \ 2024-12-18T00:27:46.0811422Z  -e VERBOSE_TEST_LOGS \ 2024-12-18T00:27:46.0811705Z  -e TEST_SHOWLOCALS \ 2024-12-18T00:27:46.0811989Z  -e NO_TEST_TIMEOUT \ 2024-12-18T00:27:46.0812259Z  -e NO_TD \ 2024-12-18T00:27:46.0812509Z  -e TD_DISTRIBUTED \ 2024-12-18T00:27:46.0812785Z  -e PR_LABELS \ 2024-12-18T00:27:46.0813074Z  -e MAX_JOBS="$(nproc --ignore=2)" \ 2024-12-18T00:27:46.0813391Z  -e SCCACHE_BUCKET \ 2024-12-18T00:27:46.0813676Z  -e SCCACHE_REGION \ 2024-12-18T00:27:46.0813961Z  -e SCCACHE_S3_KEY_PREFIX \ 2024-12-18T00:27:46.0814255Z  -e XLA_CUDA \ 2024-12-18T00:27:46.0814547Z  -e XLA_CLANG_CACHE_S3_BUCKET_NAME \ 2024-12-18T00:27:46.0814886Z  -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK \ 2024-12-18T00:27:46.0815247Z  -e PYTORCH_TEST_RERUN_DISABLED_TESTS \ 2024-12-18T00:27:46.0815601Z  -e SKIP_SCCACHE_INITIALIZATION=1 \ 2024-12-18T00:27:46.0815938Z  -e HUGGING_FACE_HUB_TOKEN \ 2024-12-18T00:27:46.0816260Z  -e SCRIBE_GRAPHQL_ACCESS_TOKEN \ 2024-12-18T00:27:46.0816568Z  -e DASHBOARD_TAG \ 2024-12-18T00:27:46.0816837Z  -e IS_A100_RUNNER \ 2024-12-18T00:27:46.0817118Z  -e ARTIFACTS_FILE_SUFFIX \ 2024-12-18T00:27:46.0817472Z  --env-file="/tmp/github_env_${GITHUB_RUN_ID}" \ 2024-12-18T00:27:46.0817886Z  --security-opt seccomp=unconfined \ 2024-12-18T00:27:46.0818369Z  --cap-add=SYS_PTRACE \ 2024-12-18T00:27:46.0818654Z  --ipc=host \ 2024-12-18T00:27:46.0818921Z  --shm-size="${SHM_SIZE}" \ 2024-12-18T00:27:46.0819216Z  --tty \ 2024-12-18T00:27:46.0819451Z  --detach \ 2024-12-18T00:27:46.0819716Z  --name="${container_name}" \ 2024-12-18T00:27:46.0820015Z  --user jenkins \ 2024-12-18T00:27:46.0820357Z  -v "${GITHUB_WORKSPACE}:/var/lib/jenkins/workspace" \ 2024-12-18T00:27:46.0820750Z  -w /var/lib/jenkins/workspace \ 2024-12-18T00:27:46.0821215Z  "${DOCKER_IMAGE}" 2024-12-18T00:27:46.0821472Z ) 2024-12-18T00:27:46.0821749Z # Propagate download.pytorch.org IP to container 2024-12-18T00:27:46.0822392Z grep download.pytorch.org /etc/hosts | docker exec -i "${container_name}" sudo bash -c "/bin/cat >> /etc/hosts" 2024-12-18T00:27:46.0823069Z echo "DOCKER_CONTAINER_ID=${container_name}" >> "${GITHUB_ENV}" 2024-12-18T00:27:46.0823740Z docker exec -t "${container_name}" sh -c "python3 -m pip install $(echo dist/*.whl)[opt-einsum] && ${TEST_COMMAND}" 2024-12-18T00:27:46.0832426Z shell: /usr/bin/bash -e {0} 2024-12-18T00:27:46.0832695Z env: 2024-12-18T00:27:46.0832918Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:27:46.0833240Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:27:46.0833677Z BUILD_ENVIRONMENT: linux-focal-cuda12.4-py3.10-gcc9-sm86 2024-12-18T00:27:46.0834044Z PR_NUMBER: 2024-12-18T00:27:46.0834288Z GITHUB_REPOSITORY: pytorch/pytorch 2024-12-18T00:27:46.0834594Z GITHUB_WORKFLOW: inductor 2024-12-18T00:27:46.0834843Z GITHUB_JOB: test 2024-12-18T00:27:46.0835079Z GITHUB_RUN_ID: 12383255690 2024-12-18T00:27:46.0835348Z GITHUB_RUN_NUMBER: 109429 2024-12-18T00:27:46.0835612Z GITHUB_RUN_ATTEMPT: 1 2024-12-18T00:27:46.0835852Z JOB_ID: 34567098339 2024-12-18T00:27:46.0836340Z JOB_NAME: unit-test / cuda12.4-py3.10-gcc9-sm86 / test (inductor_cpp_wrapper, 1, 1, linux.g5.4xlarge.nvidia.gpu) 2024-12-18T00:27:46.0836895Z BRANCH: release/2.6 2024-12-18T00:27:46.0837174Z SHA1: 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:27:46.0837699Z BASE_SHA: 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:27:46.0838096Z TEST_CONFIG: inductor_cpp_wrapper 2024-12-18T00:27:46.0838379Z SHARD_NUMBER: 1 2024-12-18T00:27:46.0838601Z NUM_TEST_SHARDS: 1 2024-12-18T00:27:46.0838840Z REENABLED_ISSUES: 2024-12-18T00:27:46.0839091Z CONTINUE_THROUGH_ERROR: False 2024-12-18T00:27:46.0839370Z VERBOSE_TEST_LOGS: False 2024-12-18T00:27:46.0839626Z TEST_SHOWLOCALS: False 2024-12-18T00:27:46.0839885Z NO_TEST_TIMEOUT: False 2024-12-18T00:27:46.0840130Z NO_TD: False 2024-12-18T00:27:46.0840354Z TD_DISTRIBUTED: False 2024-12-18T00:27:46.0840657Z SCCACHE_BUCKET: ossci-compiler-cache-circleci-v2 2024-12-18T00:27:46.0841001Z SCCACHE_REGION: us-east-1 2024-12-18T00:27:46.0841273Z SCCACHE_S3_KEY_PREFIX: inductor 2024-12-18T00:27:46.0841551Z SHM_SIZE: 2g 2024-12-18T00:27:46.0842345Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:27:46.0843200Z XLA_CUDA: 2024-12-18T00:27:46.0843545Z XLA_CLANG_CACHE_S3_BUCKET_NAME: ossci-compiler-clang-cache-circleci-xla 2024-12-18T00:27:46.0843981Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK: 0 2024-12-18T00:27:46.0844291Z PYTORCH_TEST_RERUN_DISABLED_TESTS: 0 2024-12-18T00:27:46.0844584Z DASHBOARD_TAG: 2024-12-18T00:27:46.0844987Z HUGGING_FACE_HUB_TOKEN: *** 2024-12-18T00:27:46.0845388Z SCRIBE_GRAPHQL_ACCESS_TOKEN: *** 2024-12-18T00:27:46.0845684Z IS_A100_RUNNER: 0 2024-12-18T00:27:46.0846126Z ARTIFACTS_FILE_SUFFIX: test-inductor_cpp_wrapper-1-1-linux.g5.4xlarge.nvidia.gpu_34567098339 2024-12-18T00:27:46.0846630Z ##[endgroup] 2024-12-18T00:27:46.0873222Z + [[ inductor_cpp_wrapper == \m\u\l\t\i\g\p\u ]] 2024-12-18T00:27:46.0873873Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm86 == *onnx* ]] 2024-12-18T00:27:46.0874725Z + TEST_COMMAND=.ci/pytorch/test.sh 2024-12-18T00:27:46.0883753Z +++ nproc --ignore=2 2024-12-18T00:27:46.0901856Z ++ docker run --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all -e BUILD_ENVIRONMENT -e PR_NUMBER -e GITHUB_ACTIONS -e GITHUB_REPOSITORY -e GITHUB_WORKFLOW -e GITHUB_JOB -e GITHUB_RUN_ID -e GITHUB_RUN_NUMBER -e GITHUB_RUN_ATTEMPT -e JOB_ID -e JOB_NAME -e BASE_SHA -e BRANCH -e SHA1 -e AWS_DEFAULT_REGION -e IN_WHEEL_TEST -e SHARD_NUMBER -e TEST_CONFIG -e NUM_TEST_SHARDS -e REENABLED_ISSUES -e CONTINUE_THROUGH_ERROR -e VERBOSE_TEST_LOGS -e TEST_SHOWLOCALS -e NO_TEST_TIMEOUT -e NO_TD -e TD_DISTRIBUTED -e PR_LABELS -e MAX_JOBS=14 -e SCCACHE_BUCKET -e SCCACHE_REGION -e SCCACHE_S3_KEY_PREFIX -e XLA_CUDA -e XLA_CLANG_CACHE_S3_BUCKET_NAME -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK -e PYTORCH_TEST_RERUN_DISABLED_TESTS -e SKIP_SCCACHE_INITIALIZATION=1 -e HUGGING_FACE_HUB_TOKEN -e SCRIBE_GRAPHQL_ACCESS_TOKEN -e DASHBOARD_TAG -e IS_A100_RUNNER -e ARTIFACTS_FILE_SUFFIX --env-file=/tmp/github_env_12383255690 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --ipc=host --shm-size=2g --tty --detach --name= --user jenkins -v /home/ec2-user/actions-runner/_work/pytorch/pytorch:/var/lib/jenkins/workspace -w /var/lib/jenkins/workspace 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:27:57.8620132Z + container_name=01327ec69d77cd023280c7e9fc2ea5779e1166b4f670f543346f4278933279f7 2024-12-18T00:27:57.8623290Z + grep download.pytorch.org /etc/hosts 2024-12-18T00:27:57.8625070Z + docker exec -i 01327ec69d77cd023280c7e9fc2ea5779e1166b4f670f543346f4278933279f7 sudo bash -c '/bin/cat >> /etc/hosts' 2024-12-18T00:27:58.0103282Z + echo DOCKER_CONTAINER_ID=01327ec69d77cd023280c7e9fc2ea5779e1166b4f670f543346f4278933279f7 2024-12-18T00:27:58.0106767Z ++ echo dist/torch-2.6.0a0+git0cdf8b1-cp310-cp310-linux_x86_64.whl 2024-12-18T00:27:58.0109753Z + docker exec -t 01327ec69d77cd023280c7e9fc2ea5779e1166b4f670f543346f4278933279f7 sh -c 'python3 -m pip install dist/torch-2.6.0a0+git0cdf8b1-cp310-cp310-linux_x86_64.whl[opt-einsum] && .ci/pytorch/test.sh' 2024-12-18T00:27:58.4099810Z Processing ./dist/torch-2.6.0a0+git0cdf8b1-cp310-cp310-linux_x86_64.whl (from torch==2.6.0a0+git0cdf8b1) 2024-12-18T00:27:58.7437171Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (3.16.1) 2024-12-18T00:27:58.7439320Z Requirement already satisfied: typing-extensions>=4.10.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (4.12.2) 2024-12-18T00:27:58.7442696Z Requirement already satisfied: networkx in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (2.8.8) 2024-12-18T00:27:58.7446198Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (3.1.4) 2024-12-18T00:27:58.7449072Z Requirement already satisfied: fsspec in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (2024.10.0) 2024-12-18T00:27:58.7453687Z Requirement already satisfied: sympy==1.13.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (1.13.1) 2024-12-18T00:27:58.7470420Z Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from sympy==1.13.1->torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (1.3.0) 2024-12-18T00:27:58.7483380Z Requirement already satisfied: opt-einsum>=3.3 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (3.3.0) 2024-12-18T00:27:58.7501010Z Requirement already satisfied: numpy>=1.7 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from opt-einsum>=3.3->torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (1.22.4) 2024-12-18T00:27:58.7887671Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from jinja2->torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (3.0.2) 2024-12-18T00:27:59.3789108Z Installing collected packages: torch 2024-12-18T00:28:10.0996727Z ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 2024-12-18T00:28:10.0997768Z timm 1.0.9.dev0 requires torchvision, which is not installed. 2024-12-18T00:28:10.0998303Z Successfully installed torch-2.6.0a0+git0cdf8b1 2024-12-18T00:28:10.1821893Z + export TERM=vt100 2024-12-18T00:28:10.1822165Z + TERM=vt100 2024-12-18T00:28:10.1824813Z ++ dirname .ci/pytorch/test.sh 2024-12-18T00:28:10.1837151Z + source .ci/pytorch/common.sh 2024-12-18T00:28:10.1841700Z +++ dirname .ci/pytorch/common.sh 2024-12-18T00:28:10.1852321Z ++ source .ci/pytorch/common_utils.sh 2024-12-18T00:28:10.1853883Z +++ declare -f -t trap_add 2024-12-18T00:28:10.1859754Z ++ set -ex 2024-12-18T00:28:10.1860053Z ++ [[ linux-focal-cuda12.4-py3.10-gcc9-sm86 == *rocm* ]] 2024-12-18T00:28:10.1860433Z ++ BUILD_TEST_LIBTORCH=0 2024-12-18T00:28:10.1860759Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm86 != *rocm* ]] 2024-12-18T00:28:10.1861245Z + [[ -d /var/lib/jenkins/workspace ]] 2024-12-18T00:28:10.1865813Z ++ stat -c %u /var/lib/jenkins/workspace 2024-12-18T00:28:10.1884005Z + WORKSPACE_ORIGINAL_OWNER_ID=1000 2024-12-18T00:28:10.1884485Z + trap_add cleanup_workspace EXIT 2024-12-18T00:28:10.1884920Z + trap_add_cmd=cleanup_workspace 2024-12-18T00:28:10.1885327Z + shift 2024-12-18T00:28:10.1885566Z + for trap_add_name in "$@" 2024-12-18T00:28:10.1893500Z +++ trap -p EXIT 2024-12-18T00:28:10.1896415Z ++ eval 'extract_trap_cmd ' 2024-12-18T00:28:10.1896797Z +++ extract_trap_cmd 2024-12-18T00:28:10.1897128Z +++ printf '%s\n' '' 2024-12-18T00:28:10.1897496Z ++ printf '%s\n' cleanup_workspace 2024-12-18T00:28:10.1901181Z + trap -- ' 2024-12-18T00:28:10.1901462Z cleanup_workspace' EXIT 2024-12-18T00:28:10.1901802Z + sudo chown -R jenkins /var/lib/jenkins/workspace 2024-12-18T00:28:10.8892340Z + git config --global --add safe.directory /var/lib/jenkins/workspace 2024-12-18T00:28:10.8916475Z + echo 'Environment variables:' 2024-12-18T00:28:10.8916822Z Environment variables: 2024-12-18T00:28:10.8917191Z + env 2024-12-18T00:28:10.8929325Z INSTALLED_DB=yes 2024-12-18T00:28:10.8929689Z NV_LIBCUBLAS_VERSION=12.4.5.8-1 2024-12-18T00:28:10.8930038Z NVIDIA_VISIBLE_DEVICES=all 2024-12-18T00:28:10.8930424Z NV_NVML_DEV_VERSION=12.4.127-1 2024-12-18T00:28:10.8930880Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-12-18T00:28:10.8931336Z CONTINUE_THROUGH_ERROR=False 2024-12-18T00:28:10.8931699Z NV_LIBNCCL_DEV_PACKAGE=libnccl-dev=2.21.5-1+cuda12.4 2024-12-18T00:28:10.8932138Z NV_LIBNCCL_DEV_PACKAGE_VERSION=2.21.5-1 2024-12-18T00:28:10.8932660Z BUILD_ENVIRONMENT=linux-focal-cuda12.4-py3.10-gcc9-sm86 2024-12-18T00:28:10.8933197Z HOSTNAME=01327ec69d77 2024-12-18T00:28:10.8933964Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_c1e25cbb-6ab9-424e-a55b-af3316b6c425 2024-12-18T00:28:10.8934762Z GITHUB_ACTION=__self 2024-12-18T00:28:10.8935029Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2024-12-18T00:28:10.8940341Z NVIDIA_REQUIRE_CUDA=cuda>=12.4 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 brand=tesla,driver>=525,driver<526 brand=unknown,driver>=525,driver<526 brand=nvidia,driver>=525,driver<526 brand=nvidiartx,driver>=525,driver<526 brand=geforce,driver>=525,driver<526 brand=geforcertx,driver>=525,driver<526 brand=quadro,driver>=525,driver<526 brand=quadrortx,driver>=525,driver<526 brand=titan,driver>=525,driver<526 brand=titanrtx,driver>=525,driver<526 brand=tesla,driver>=535,driver<536 brand=unknown,driver>=535,driver<536 brand=nvidia,driver>=535,driver<536 brand=nvidiartx,driver>=535,driver<536 brand=geforce,driver>=535,driver<536 brand=geforcertx,driver>=535,driver<536 brand=quadro,driver>=535,driver<536 brand=quadrortx,driver>=535,driver<536 brand=titan,driver>=535,driver<536 brand=titanrtx,driver>=535,driver<536 2024-12-18T00:28:10.8945066Z NV_LIBCUBLAS_DEV_PACKAGE=libcublas-dev-12-4=12.4.5.8-1 2024-12-18T00:28:10.8945436Z NV_NVTX_VERSION=12.4.127-1 2024-12-18T00:28:10.8945715Z GITHUB_RUN_NUMBER=109429 2024-12-18T00:28:10.8945997Z TEST_CONFIG=inductor_cpp_wrapper 2024-12-18T00:28:10.8946301Z GITHUB_REPOSITORY_OWNER_ID=21003710 2024-12-18T00:28:10.8946622Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2024-12-18T00:28:10.8946936Z IS_A100_RUNNER=0 2024-12-18T00:28:10.8947191Z NV_CUDA_CUDART_DEV_VERSION=12.4.127-1 2024-12-18T00:28:10.8947520Z NV_LIBCUSPARSE_VERSION=12.3.1.170-1 2024-12-18T00:28:10.8948032Z SCRIBE_GRAPHQL_ACCESS_TOKEN=*** 2024-12-18T00:28:10.8948367Z NV_LIBNPP_VERSION=12.2.5.30-1 2024-12-18T00:28:10.8948671Z GITHUB_TRIGGERING_ACTOR=malfet 2024-12-18T00:28:10.8948998Z CMAKE_CUDA_COMPILER_LAUNCHER=/opt/cache/bin/sccache 2024-12-18T00:28:10.8949350Z GITHUB_REF_TYPE=branch 2024-12-18T00:28:10.8949617Z TORCH_CUDA_ARCH_LIST=Maxwell 2024-12-18T00:28:10.8949900Z NCCL_VERSION=2.21.5-1 2024-12-18T00:28:10.8950196Z BASE_SHA=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:28:10.8950528Z XLA_CUDA= 2024-12-18T00:28:10.8950858Z HUGGING_FACE_HUB_TOKEN=*** 2024-12-18T00:28:10.8953261Z *** 2024-12-18T00:28:10.8953498Z CARGO_NET_GIT_FETCH_WITH_CLI=true 2024-12-18T00:28:10.8953810Z GITHUB_REPOSITORY_ID=65600975 2024-12-18T00:28:10.8954087Z GITHUB_ACTIONS=true 2024-12-18T00:28:10.8954352Z NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:28:10.8954686Z NV_NVPROF_DEV_PACKAGE=cuda-nvprof-12-4=12.4.127-1 2024-12-18T00:28:10.8955056Z NV_LIBNPP_PACKAGE=libnpp-12-4=12.2.5.30-1 2024-12-18T00:28:10.8955420Z SHA1=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:28:10.8955768Z NV_LIBNCCL_DEV_PACKAGE_NAME=libnccl-dev 2024-12-18T00:28:10.8956334Z GITHUB_SHA=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:28:10.8956887Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/inductor.yml@refs/heads/release/2.6 2024-12-18T00:28:10.8957393Z UCC_HOME=/usr 2024-12-18T00:28:10.8957638Z NV_LIBCUBLAS_DEV_VERSION=12.4.5.8-1 2024-12-18T00:28:10.8957942Z VERBOSE_TEST_LOGS=False 2024-12-18T00:28:10.8958200Z NVIDIA_PRODUCT_NAME=CUDA 2024-12-18T00:28:10.8958513Z NV_LIBCUBLAS_DEV_PACKAGE_NAME=libcublas-dev-12-4 2024-12-18T00:28:10.8958871Z GITHUB_REF=refs/heads/release/2.6 2024-12-18T00:28:10.8959174Z NV_CUDA_CUDART_VERSION=12.4.127-1 2024-12-18T00:28:10.8959451Z SHARD_NUMBER=1 2024-12-18T00:28:10.8959694Z GITHUB_REF_PROTECTED=true 2024-12-18T00:28:10.8959963Z HOME=/var/lib/jenkins 2024-12-18T00:28:10.8960243Z GITHUB_API_URL=https://api.github.com 2024-12-18T00:28:10.8960582Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2024-12-18T00:28:10.8960929Z UCX_COMMIT=7bb2722ff2187a0cad557ae4a6afa090569f83fb 2024-12-18T00:28:10.8961293Z SCCACHE_S3_KEY_PREFIX=inductor 2024-12-18T00:28:10.8961584Z CUDA_VERSION=12.4.1 2024-12-18T00:28:10.8961865Z NV_LIBCUBLAS_PACKAGE=libcublas-12-4=12.4.5.8-1 2024-12-18T00:28:10.8962195Z NUM_TEST_SHARDS=1 2024-12-18T00:28:10.8962422Z UCX_HOME=/usr 2024-12-18T00:28:10.8962767Z NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE=cuda-nsight-compute-12-4=12.4.1-1 2024-12-18T00:28:10.8963517Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_c1e25cbb-6ab9-424e-a55b-af3316b6c425 2024-12-18T00:28:10.8964413Z JOB_NAME=unit-test / cuda12.4-py3.10-gcc9-sm86 / test (inductor_cpp_wrapper, 1, 1, linux.g5.4xlarge.nvidia.gpu) 2024-12-18T00:28:10.8965336Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_c1e25cbb-6ab9-424e-a55b-af3316b6c425 2024-12-18T00:28:10.8966230Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2024-12-18T00:28:10.8966724Z GITHUB_EVENT_NAME=push 2024-12-18T00:28:10.8966983Z DASHBOARD_TAG= 2024-12-18T00:28:10.8967226Z GITHUB_RUN_ID=12383255690 2024-12-18T00:28:10.8967538Z NV_LIBNPP_DEV_PACKAGE=libnpp-dev-12-4=12.2.5.30-1 2024-12-18T00:28:10.8967913Z NV_LIBCUBLAS_PACKAGE_NAME=libcublas-12-4 2024-12-18T00:28:10.8968587Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_c1e25cbb-6ab9-424e-a55b-af3316b6c425 2024-12-18T00:28:10.8969257Z GITHUB_ACTOR=malfet 2024-12-18T00:28:10.8969512Z NV_LIBNPP_DEV_VERSION=12.2.5.30-1 2024-12-18T00:28:10.8969799Z PR_NUMBER= 2024-12-18T00:28:10.8970023Z GITHUB_RUN_ATTEMPT=1 2024-12-18T00:28:10.8970281Z ANACONDA_PYTHON_VERSION=3.10 2024-12-18T00:28:10.8970625Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2024-12-18T00:28:10.8970971Z TERM=vt100 2024-12-18T00:28:10.8971215Z NV_LIBCUSPARSE_DEV_VERSION=12.3.1.170-1 2024-12-18T00:28:10.8971530Z INSTALLED_VISION=yes 2024-12-18T00:28:10.8971775Z BRANCH=release/2.6 2024-12-18T00:28:10.8972031Z SCCACHE_REGION=us-east-1 2024-12-18T00:28:10.8972310Z OPENSSL_ROOT_DIR=/opt/openssl 2024-12-18T00:28:10.8972619Z LIBRARY_PATH=/usr/local/cuda/lib64/stubs 2024-12-18T00:28:10.8972943Z CUDA_PATH=/usr/local/cuda 2024-12-18T00:28:10.8973450Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2024-12-18T00:28:10.8974023Z GITHUB_SERVER_URL=https://github.com 2024-12-18T00:28:10.8974382Z UCC_COMMIT=20eae37090a4ce1b32bcce6144ccad0b49943e0b 2024-12-18T00:28:10.8974732Z REENABLED_ISSUES= 2024-12-18T00:28:10.8974963Z SHLVL=1 2024-12-18T00:28:10.8975169Z MAX_JOBS=14 2024-12-18T00:28:10.8975401Z NV_CUDA_LIB_VERSION=12.4.1-1 2024-12-18T00:28:10.8975674Z NVARCH=x86_64 2024-12-18T00:28:10.8975905Z GITHUB_ACTOR_ID=2453524 2024-12-18T00:28:10.8976244Z GITHUB_WORKFLOW_SHA=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:28:10.8976627Z GITHUB_REF_NAME=release/2.6 2024-12-18T00:28:10.8976927Z NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-4 2024-12-18T00:28:10.8977384Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2024-12-18T00:28:10.8977810Z GITHUB_JOB=test 2024-12-18T00:28:10.8978170Z NV_LIBNCCL_PACKAGE=libnccl2=2.21.5-1+cuda12.4 2024-12-18T00:28:10.8978574Z LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64 2024-12-18T00:28:10.8978957Z NO_TEST_TIMEOUT=False 2024-12-18T00:28:10.8979212Z TD_DISTRIBUTED=False 2024-12-18T00:28:10.8979487Z NV_CUDA_NSIGHT_COMPUTE_VERSION=12.4.1-1 2024-12-18T00:28:10.8979816Z GITHUB_REPOSITORY=pytorch/pytorch 2024-12-18T00:28:10.8980115Z NV_NVPROF_VERSION=12.4.127-1 2024-12-18T00:28:10.8980400Z GITHUB_RETENTION_DAYS=90 2024-12-18T00:28:10.8980669Z OPENSSL_DIR=/opt/openssl 2024-12-18T00:28:10.8981078Z GITHUB_ACTION_REPOSITORY= 2024-12-18T00:28:10.8981868Z PATH=/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-12-18T00:28:10.8982656Z GITHUB_BASE_REF= 2024-12-18T00:28:10.8983120Z ARTIFACTS_FILE_SUFFIX=test-inductor_cpp_wrapper-1-1-linux.g5.4xlarge.nvidia.gpu_34567098339 2024-12-18T00:28:10.8983656Z NV_LIBNCCL_PACKAGE_NAME=libnccl2 2024-12-18T00:28:10.8983943Z CI=true 2024-12-18T00:28:10.8984178Z NV_LIBNCCL_PACKAGE_VERSION=2.21.5-1 2024-12-18T00:28:10.8984490Z GITHUB_REPOSITORY_OWNER=pytorch 2024-12-18T00:28:10.8984772Z JOB_ID=34567098339 2024-12-18T00:28:10.8985012Z INSTALLED_PROTOBUF=yes 2024-12-18T00:28:10.8985268Z GITHUB_HEAD_REF= 2024-12-18T00:28:10.8985506Z GITHUB_ACTION_REF= 2024-12-18T00:28:10.8985797Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2024-12-18T00:28:10.8986152Z TEST_SHOWLOCALS=False 2024-12-18T00:28:10.8986413Z GITHUB_WORKFLOW=inductor 2024-12-18T00:28:10.8986695Z DEBIAN_FRONTEND=noninteractive 2024-12-18T00:28:10.8987320Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_c1e25cbb-6ab9-424e-a55b-af3316b6c425 2024-12-18T00:28:10.8987942Z NO_TD=False 2024-12-18T00:28:10.8988184Z SKIP_SCCACHE_INITIALIZATION=1 2024-12-18T00:28:10.8988564Z _=/usr/bin/env 2024-12-18T00:28:10.8988888Z ++ python -c 'import site; print(site.getsitepackages()[0])' 2024-12-18T00:28:10.9166117Z + TORCH_INSTALL_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch 2024-12-18T00:28:10.9166943Z + TORCH_BIN_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/bin 2024-12-18T00:28:10.9167621Z + TORCH_LIB_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/lib 2024-12-18T00:28:10.9168229Z + TORCH_TEST_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/test 2024-12-18T00:28:10.9168840Z + BUILD_DIR=build 2024-12-18T00:28:10.9169173Z + BUILD_RENAMED_DIR=build_renamed 2024-12-18T00:28:10.9169527Z + BUILD_BIN_DIR=build/bin 2024-12-18T00:28:10.9169776Z + SHARD_NUMBER=1 2024-12-18T00:28:10.9170003Z + NUM_TEST_SHARDS=1 2024-12-18T00:28:10.9170241Z + export VALGRIND=ON 2024-12-18T00:28:10.9170477Z + VALGRIND=ON 2024-12-18T00:28:10.9170777Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm86 == *clang9* ]] 2024-12-18T00:28:10.9171206Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm86 == *xpu* ]] 2024-12-18T00:28:10.9171550Z + [[ 0 == \1 ]] 2024-12-18T00:28:10.9171773Z + [[ False == \1 ]] 2024-12-18T00:28:10.9172075Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm86 != *bazel* ]] 2024-12-18T00:28:10.9173567Z ++ realpath build/custom_test_artifacts 2024-12-18T00:28:10.9185825Z + CUSTOM_TEST_ARTIFACT_BUILD_DIR=/var/lib/jenkins/workspace/build/custom_test_artifacts 2024-12-18T00:28:10.9186337Z + [[ -n '' ]] 2024-12-18T00:28:10.9186589Z + echo 'Environment variables' 2024-12-18T00:28:10.9186876Z Environment variables 2024-12-18T00:28:10.9187121Z + env 2024-12-18T00:28:10.9194001Z INSTALLED_DB=yes 2024-12-18T00:28:10.9194271Z NV_LIBCUBLAS_VERSION=12.4.5.8-1 2024-12-18T00:28:10.9194560Z NVIDIA_VISIBLE_DEVICES=all 2024-12-18T00:28:10.9194835Z NV_NVML_DEV_VERSION=12.4.127-1 2024-12-18T00:28:10.9195239Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-12-18T00:28:10.9195688Z CONTINUE_THROUGH_ERROR=False 2024-12-18T00:28:10.9196029Z NV_LIBNCCL_DEV_PACKAGE=libnccl-dev=2.21.5-1+cuda12.4 2024-12-18T00:28:10.9196403Z NV_LIBNCCL_DEV_PACKAGE_VERSION=2.21.5-1 2024-12-18T00:28:10.9197041Z BUILD_ENVIRONMENT=linux-focal-cuda12.4-py3.10-gcc9-sm86 2024-12-18T00:28:10.9197416Z HOSTNAME=01327ec69d77 2024-12-18T00:28:10.9197996Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_c1e25cbb-6ab9-424e-a55b-af3316b6c425 2024-12-18T00:28:10.9198602Z GITHUB_ACTION=__self 2024-12-18T00:28:10.9198890Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2024-12-18T00:28:10.9202917Z NVIDIA_REQUIRE_CUDA=cuda>=12.4 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 brand=tesla,driver>=525,driver<526 brand=unknown,driver>=525,driver<526 brand=nvidia,driver>=525,driver<526 brand=nvidiartx,driver>=525,driver<526 brand=geforce,driver>=525,driver<526 brand=geforcertx,driver>=525,driver<526 brand=quadro,driver>=525,driver<526 brand=quadrortx,driver>=525,driver<526 brand=titan,driver>=525,driver<526 brand=titanrtx,driver>=525,driver<526 brand=tesla,driver>=535,driver<536 brand=unknown,driver>=535,driver<536 brand=nvidia,driver>=535,driver<536 brand=nvidiartx,driver>=535,driver<536 brand=geforce,driver>=535,driver<536 brand=geforcertx,driver>=535,driver<536 brand=quadro,driver>=535,driver<536 brand=quadrortx,driver>=535,driver<536 brand=titan,driver>=535,driver<536 brand=titanrtx,driver>=535,driver<536 2024-12-18T00:28:10.9207350Z NV_LIBCUBLAS_DEV_PACKAGE=libcublas-dev-12-4=12.4.5.8-1 2024-12-18T00:28:10.9207712Z NV_NVTX_VERSION=12.4.127-1 2024-12-18T00:28:10.9207987Z GITHUB_RUN_NUMBER=109429 2024-12-18T00:28:10.9208267Z TEST_CONFIG=inductor_cpp_wrapper 2024-12-18T00:28:10.9208571Z GITHUB_REPOSITORY_OWNER_ID=21003710 2024-12-18T00:28:10.9209062Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2024-12-18T00:28:10.9209381Z IS_A100_RUNNER=0 2024-12-18T00:28:10.9209634Z NV_CUDA_CUDART_DEV_VERSION=12.4.127-1 2024-12-18T00:28:10.9209960Z NV_LIBCUSPARSE_VERSION=12.3.1.170-1 2024-12-18T00:28:10.9210431Z SCRIBE_GRAPHQL_ACCESS_TOKEN=*** 2024-12-18T00:28:10.9210727Z NV_LIBNPP_VERSION=12.2.5.30-1 2024-12-18T00:28:10.9211009Z GITHUB_TRIGGERING_ACTOR=malfet 2024-12-18T00:28:10.9211343Z CMAKE_CUDA_COMPILER_LAUNCHER=/opt/cache/bin/sccache 2024-12-18T00:28:10.9211695Z GITHUB_REF_TYPE=branch 2024-12-18T00:28:10.9211955Z TORCH_CUDA_ARCH_LIST=Maxwell 2024-12-18T00:28:10.9212257Z NCCL_VERSION=2.21.5-1 2024-12-18T00:28:10.9212545Z BASE_SHA=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:28:10.9212867Z XLA_CUDA= 2024-12-18T00:28:10.9213203Z HUGGING_FACE_HUB_TOKEN=*** 2024-12-18T00:28:10.9213711Z *** 2024-12-18T00:28:10.9214023Z CARGO_NET_GIT_FETCH_WITH_CLI=true 2024-12-18T00:28:10.9214460Z GITHUB_REPOSITORY_ID=65600975 2024-12-18T00:28:10.9214878Z GITHUB_ACTIONS=true 2024-12-18T00:28:10.9215139Z NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:28:10.9215465Z NV_NVPROF_DEV_PACKAGE=cuda-nvprof-12-4=12.4.127-1 2024-12-18T00:28:10.9215828Z NV_LIBNPP_PACKAGE=libnpp-12-4=12.2.5.30-1 2024-12-18T00:28:10.9216176Z SHA1=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:28:10.9216521Z NV_LIBNCCL_DEV_PACKAGE_NAME=libnccl-dev 2024-12-18T00:28:10.9218248Z GITHUB_SHA=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:28:10.9218788Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/inductor.yml@refs/heads/release/2.6 2024-12-18T00:28:10.9219280Z UCC_HOME=/usr 2024-12-18T00:28:10.9219519Z NV_LIBCUBLAS_DEV_VERSION=12.4.5.8-1 2024-12-18T00:28:10.9219811Z VERBOSE_TEST_LOGS=False 2024-12-18T00:28:10.9220065Z NVIDIA_PRODUCT_NAME=CUDA 2024-12-18T00:28:10.9220429Z NV_LIBCUBLAS_DEV_PACKAGE_NAME=libcublas-dev-12-4 2024-12-18T00:28:10.9221017Z GITHUB_REF=refs/heads/release/2.6 2024-12-18T00:28:10.9221325Z NV_CUDA_CUDART_VERSION=12.4.127-1 2024-12-18T00:28:10.9221608Z SHARD_NUMBER=1 2024-12-18T00:28:10.9221848Z GITHUB_REF_PROTECTED=true 2024-12-18T00:28:10.9222111Z HOME=/var/lib/jenkins 2024-12-18T00:28:10.9222388Z GITHUB_API_URL=https://api.github.com 2024-12-18T00:28:10.9222849Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2024-12-18T00:28:10.9223197Z UCX_COMMIT=7bb2722ff2187a0cad557ae4a6afa090569f83fb 2024-12-18T00:28:10.9223626Z SCCACHE_S3_KEY_PREFIX=inductor 2024-12-18T00:28:10.9223906Z CUDA_VERSION=12.4.1 2024-12-18T00:28:10.9224185Z NV_LIBCUBLAS_PACKAGE=libcublas-12-4=12.4.5.8-1 2024-12-18T00:28:10.9224510Z NUM_TEST_SHARDS=1 2024-12-18T00:28:10.9224743Z UCX_HOME=/usr 2024-12-18T00:28:10.9225079Z NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE=cuda-nsight-compute-12-4=12.4.1-1 2024-12-18T00:28:10.9225812Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_c1e25cbb-6ab9-424e-a55b-af3316b6c425 2024-12-18T00:28:10.9226984Z JOB_NAME=unit-test / cuda12.4-py3.10-gcc9-sm86 / test (inductor_cpp_wrapper, 1, 1, linux.g5.4xlarge.nvidia.gpu) 2024-12-18T00:28:10.9227850Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_c1e25cbb-6ab9-424e-a55b-af3316b6c425 2024-12-18T00:28:10.9228625Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2024-12-18T00:28:10.9229121Z GITHUB_EVENT_NAME=push 2024-12-18T00:28:10.9229369Z DASHBOARD_TAG= 2024-12-18T00:28:10.9229606Z GITHUB_RUN_ID=12383255690 2024-12-18T00:28:10.9229915Z NV_LIBNPP_DEV_PACKAGE=libnpp-dev-12-4=12.2.5.30-1 2024-12-18T00:28:10.9230316Z NV_LIBCUBLAS_PACKAGE_NAME=libcublas-12-4 2024-12-18T00:28:10.9231035Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_c1e25cbb-6ab9-424e-a55b-af3316b6c425 2024-12-18T00:28:10.9231678Z GITHUB_ACTOR=malfet 2024-12-18T00:28:10.9231933Z NV_LIBNPP_DEV_VERSION=12.2.5.30-1 2024-12-18T00:28:10.9232215Z PR_NUMBER= 2024-12-18T00:28:10.9232432Z GITHUB_RUN_ATTEMPT=1 2024-12-18T00:28:10.9232678Z VALGRIND=ON 2024-12-18T00:28:10.9232900Z ANACONDA_PYTHON_VERSION=3.10 2024-12-18T00:28:10.9233391Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2024-12-18T00:28:10.9233739Z TERM=vt100 2024-12-18T00:28:10.9233974Z NV_LIBCUSPARSE_DEV_VERSION=12.3.1.170-1 2024-12-18T00:28:10.9234284Z INSTALLED_VISION=yes 2024-12-18T00:28:10.9234524Z BRANCH=release/2.6 2024-12-18T00:28:10.9234764Z SCCACHE_REGION=us-east-1 2024-12-18T00:28:10.9235057Z OPENSSL_ROOT_DIR=/opt/openssl 2024-12-18T00:28:10.9235379Z LIBRARY_PATH=/usr/local/cuda/lib64/stubs 2024-12-18T00:28:10.9235685Z CUDA_PATH=/usr/local/cuda 2024-12-18T00:28:10.9236186Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2024-12-18T00:28:10.9236744Z GITHUB_SERVER_URL=https://github.com 2024-12-18T00:28:10.9237098Z UCC_COMMIT=20eae37090a4ce1b32bcce6144ccad0b49943e0b 2024-12-18T00:28:10.9237437Z REENABLED_ISSUES= 2024-12-18T00:28:10.9237665Z SHLVL=1 2024-12-18T00:28:10.9237863Z MAX_JOBS=14 2024-12-18T00:28:10.9238086Z NV_CUDA_LIB_VERSION=12.4.1-1 2024-12-18T00:28:10.9238352Z NVARCH=x86_64 2024-12-18T00:28:10.9238580Z GITHUB_ACTOR_ID=2453524 2024-12-18T00:28:10.9238914Z GITHUB_WORKFLOW_SHA=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:28:10.9239294Z GITHUB_REF_NAME=release/2.6 2024-12-18T00:28:10.9239591Z NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-4 2024-12-18T00:28:10.9240028Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2024-12-18T00:28:10.9240445Z GITHUB_JOB=test 2024-12-18T00:28:10.9240700Z NV_LIBNCCL_PACKAGE=libnccl2=2.21.5-1+cuda12.4 2024-12-18T00:28:10.9241100Z LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64 2024-12-18T00:28:10.9241473Z NO_TEST_TIMEOUT=False 2024-12-18T00:28:10.9241724Z TD_DISTRIBUTED=False 2024-12-18T00:28:10.9241992Z NV_CUDA_NSIGHT_COMPUTE_VERSION=12.4.1-1 2024-12-18T00:28:10.9242308Z GITHUB_REPOSITORY=pytorch/pytorch 2024-12-18T00:28:10.9242609Z NV_NVPROF_VERSION=12.4.127-1 2024-12-18T00:28:10.9242886Z GITHUB_RETENTION_DAYS=90 2024-12-18T00:28:10.9243150Z OPENSSL_DIR=/opt/openssl 2024-12-18T00:28:10.9243420Z GITHUB_ACTION_REPOSITORY= 2024-12-18T00:28:10.9244174Z PATH=/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-12-18T00:28:10.9245075Z GITHUB_BASE_REF= 2024-12-18T00:28:10.9245524Z ARTIFACTS_FILE_SUFFIX=test-inductor_cpp_wrapper-1-1-linux.g5.4xlarge.nvidia.gpu_34567098339 2024-12-18T00:28:10.9246048Z NV_LIBNCCL_PACKAGE_NAME=libnccl2 2024-12-18T00:28:10.9246323Z CI=true 2024-12-18T00:28:10.9246552Z NV_LIBNCCL_PACKAGE_VERSION=2.21.5-1 2024-12-18T00:28:10.9246850Z GITHUB_REPOSITORY_OWNER=pytorch 2024-12-18T00:28:10.9247125Z JOB_ID=34567098339 2024-12-18T00:28:10.9247362Z INSTALLED_PROTOBUF=yes 2024-12-18T00:28:10.9247611Z GITHUB_HEAD_REF= 2024-12-18T00:28:10.9247834Z GITHUB_ACTION_REF= 2024-12-18T00:28:10.9248121Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2024-12-18T00:28:10.9248465Z TEST_SHOWLOCALS=False 2024-12-18T00:28:10.9248718Z GITHUB_WORKFLOW=inductor 2024-12-18T00:28:10.9248988Z DEBIAN_FRONTEND=noninteractive 2024-12-18T00:28:10.9249595Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_c1e25cbb-6ab9-424e-a55b-af3316b6c425 2024-12-18T00:28:10.9250213Z NO_TD=False 2024-12-18T00:28:10.9250445Z SKIP_SCCACHE_INITIALIZATION=1 2024-12-18T00:28:10.9250719Z _=/usr/bin/env 2024-12-18T00:28:10.9250952Z + echo 'Testing pytorch' 2024-12-18T00:28:10.9251205Z Testing pytorch 2024-12-18T00:28:10.9251451Z + export LANG=C.UTF-8 2024-12-18T00:28:10.9251703Z + LANG=C.UTF-8 2024-12-18T00:28:10.9251926Z + PR_NUMBER= 2024-12-18T00:28:10.9252176Z + [[ inductor_cpp_wrapper == \d\e\f\a\u\l\t ]] 2024-12-18T00:28:10.9252537Z + [[ inductor_cpp_wrapper == \d\i\s\t\r\i\b\u\t\e\d ]] 2024-12-18T00:28:10.9252894Z + [[ inductor_cpp_wrapper == \s\l\o\w ]] 2024-12-18T00:28:10.9253302Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm86 == *slow-gradcheck* ]] 2024-12-18T00:28:10.9253762Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm86 == *cuda* ]] 2024-12-18T00:28:10.9254145Z + export PYTORCH_TESTING_DEVICE_ONLY_FOR=cuda 2024-12-18T00:28:10.9254582Z + PYTORCH_TESTING_DEVICE_ONLY_FOR=cuda 2024-12-18T00:28:10.9254912Z + [[ inductor_cpp_wrapper == *crossref* ]] 2024-12-18T00:28:10.9255331Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm86 == *rocm* ]] 2024-12-18T00:28:10.9255746Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm86 == *xpu* ]] 2024-12-18T00:28:10.9256170Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm86 != *-bazel-* ]] 2024-12-18T00:28:10.9256552Z + pip_install --user ninja==1.10.2 2024-12-18T00:28:10.9256937Z + pip_install_pkg='python3 -m pip install --progress-bar off' 2024-12-18T00:28:10.9257415Z + python3 -m pip install --progress-bar off --user ninja==1.10.2 2024-12-18T00:28:12.1686565Z Collecting ninja==1.10.2 2024-12-18T00:28:12.1864759Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl.metadata (5.0 kB) 2024-12-18T00:28:12.2539293Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl (108 kB) 2024-12-18T00:28:12.8617120Z Installing collected packages: ninja 2024-12-18T00:28:12.8703180Z  WARNING: The script ninja is installed in '/var/lib/jenkins/.local/bin' which is not on PATH. 2024-12-18T00:28:12.8704105Z Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. 2024-12-18T00:28:12.9238969Z Successfully installed ninja-1.10.2 2024-12-18T00:28:13.0134664Z + export PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-12-18T00:28:13.0136197Z + PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-12-18T00:28:13.0137327Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm86 == *aarch64* ]] 2024-12-18T00:28:13.0137702Z + install_tlparse 2024-12-18T00:28:13.0137959Z + pip_install --user tlparse==0.3.25 2024-12-18T00:28:13.0138379Z + pip_install_pkg='python3 -m pip install --progress-bar off' 2024-12-18T00:28:13.0138867Z + python3 -m pip install --progress-bar off --user tlparse==0.3.25 2024-12-18T00:28:13.4317503Z Collecting tlparse==0.3.25 2024-12-18T00:28:13.4484699Z Downloading tlparse-0.3.25-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (1.7 kB) 2024-12-18T00:28:13.4593983Z Downloading tlparse-0.3.25-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.2 MB) 2024-12-18T00:28:14.0493667Z Installing collected packages: tlparse 2024-12-18T00:28:14.0832590Z Successfully installed tlparse-0.3.25 2024-12-18T00:28:14.1687355Z ++ python -m site --user-base 2024-12-18T00:28:14.1928976Z + PATH=/var/lib/jenkins/.local/bin:/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-12-18T00:28:14.1930551Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm86 == *asan* ]] 2024-12-18T00:28:14.1931017Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm86 == *-debug* ]] 2024-12-18T00:28:14.1931464Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm86 != *-bazel-* ]] 2024-12-18T00:28:14.1932077Z + echo 'We are not in debug mode: linux-focal-cuda12.4-py3.10-gcc9-sm86. Expect the assertion to pass' 2024-12-18T00:28:14.1932821Z We are not in debug mode: linux-focal-cuda12.4-py3.10-gcc9-sm86. Expect the assertion to pass 2024-12-18T00:28:14.1935610Z + cd test 2024-12-18T00:28:14.1936298Z + python -c 'import torch; torch._C._crash_if_debug_asserts_fail(424242)' 2024-12-18T00:28:15.8771339Z + [[ inductor_cpp_wrapper == \n\o\g\p\u\_\N\O\_\A\V\X\2 ]] 2024-12-18T00:28:15.8771807Z + [[ inductor_cpp_wrapper == \n\o\g\p\u\_\A\V\X\5\1\2 ]] 2024-12-18T00:28:15.8776089Z + DYNAMO_BENCHMARK_FLAGS=() 2024-12-18T00:28:15.8777519Z + [[ inductor_cpp_wrapper == *pr_time_benchmarks* ]] 2024-12-18T00:28:15.8777904Z + [[ inductor_cpp_wrapper == *dynamo_eager* ]] 2024-12-18T00:28:15.8778254Z + [[ inductor_cpp_wrapper == *aot_eager* ]] 2024-12-18T00:28:15.8778992Z + [[ inductor_cpp_wrapper == *aot_inductor* ]] 2024-12-18T00:28:15.8779347Z + [[ inductor_cpp_wrapper == *inductor* ]] 2024-12-18T00:28:15.8779679Z + [[ inductor_cpp_wrapper != *perf* ]] 2024-12-18T00:28:15.8780026Z + DYNAMO_BENCHMARK_FLAGS+=(--inductor) 2024-12-18T00:28:15.8780354Z + [[ inductor_cpp_wrapper == *dynamic* ]] 2024-12-18T00:28:15.8780675Z + [[ inductor_cpp_wrapper == *cpu* ]] 2024-12-18T00:28:15.8781077Z + DYNAMO_BENCHMARK_FLAGS+=(--device cuda) 2024-12-18T00:28:15.8810148Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm86 == *libtorch* ]] 2024-12-18T00:28:15.8810606Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm86 == *-bazel-* ]] 2024-12-18T00:28:15.8813457Z + cd test 2024-12-18T00:28:15.8813897Z + python -c 'import torch; print(torch.__config__.show())' 2024-12-18T00:28:17.3811062Z PyTorch built with: 2024-12-18T00:28:17.3811373Z - GCC 9.4 2024-12-18T00:28:17.3811621Z - C++ Version: 201703 2024-12-18T00:28:17.3812209Z - Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications 2024-12-18T00:28:17.3812967Z - Intel(R) MKL-DNN v3.5.3 (Git Hash 66f0cb9eb66affd2da3bf5f8d897376f04aae6af) 2024-12-18T00:28:17.3813440Z - OpenMP 201511 (a.k.a. OpenMP 4.5) 2024-12-18T00:28:17.3813779Z - LAPACK is enabled (usually provided by MKL) 2024-12-18T00:28:17.3814123Z - NNPACK is enabled 2024-12-18T00:28:17.3814402Z - CPU capability usage: AVX2 2024-12-18T00:28:17.3814696Z - CUDA Runtime 12.4 2024-12-18T00:28:17.3815141Z - NVCC architecture flags: -gencode;arch=compute_86,code=sm_86 2024-12-18T00:28:17.3815596Z - CuDNN 90.1 2024-12-18T00:28:17.3815929Z - Magma 2.6.1 2024-12-18T00:28:17.3821196Z - Build settings: BLAS_INFO=mkl, BUILD_TYPE=Release, COMMIT_SHA=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7, CUDA_VERSION=12.4, CUDNN_VERSION=9.1.0, CXX_COMPILER=/opt/cache/bin/c++, CXX_FLAGS= -D_GLIBCXX_USE_CXX11_ABI=1 -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOROCTRACER -DLIBKINETO_NOXPUPTI=ON -DUSE_FBGEMM -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -O2 -fPIC -Wall -Wextra -Werror=return-type -Werror=non-virtual-dtor -Werror=bool-operation -Wnarrowing -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-unused-parameter -Wno-strict-overflow -Wno-strict-aliasing -Wno-stringop-overflow -Wsuggest-override -Wno-psabi -Wno-error=old-style-cast -Wno-missing-braces -fdiagnostics-color=always -faligned-new -Werror -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Wno-stringop-overflow, FORCE_FALLBACK_CUDA_MPI=1, LAPACK_INFO=mkl, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, TORCH_VERSION=2.6.0, USE_CUDA=ON, USE_CUDNN=ON, USE_CUSPARSELT=ON, USE_EXCEPTION_PTR=1, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_GLOO=ON, USE_MKL=ON, USE_MKLDNN=ON, USE_MPI=ON, USE_NCCL=ON, USE_NNPACK=ON, USE_OPENMP=ON, USE_ROCM=OFF, USE_ROCM_KERNEL_ASSERT=OFF, 2024-12-18T00:28:17.3839954Z 2024-12-18T00:28:17.7329018Z + cd test 2024-12-18T00:28:17.7329444Z + python -c 'import torch; print(torch.__config__.parallel_info())' 2024-12-18T00:28:19.1120121Z ATen/Parallel: 2024-12-18T00:28:19.1120445Z at::get_num_threads() : 8 2024-12-18T00:28:19.1120768Z at::get_num_interop_threads() : 16 2024-12-18T00:28:19.1121082Z OpenMP 201511 (a.k.a. OpenMP 4.5) 2024-12-18T00:28:19.1121387Z omp_get_max_threads() : 8 2024-12-18T00:28:19.1121944Z Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications 2024-12-18T00:28:19.1122542Z mkl_get_max_threads() : 8 2024-12-18T00:28:19.1122943Z Intel(R) MKL-DNN v3.5.3 (Git Hash 66f0cb9eb66affd2da3bf5f8d897376f04aae6af) 2024-12-18T00:28:19.1123387Z std::thread::hardware_concurrency() : 16 2024-12-18T00:28:19.1123716Z Environment variables: 2024-12-18T00:28:19.1123990Z OMP_NUM_THREADS : [not set] 2024-12-18T00:28:19.1124274Z MKL_NUM_THREADS : [not set] 2024-12-18T00:28:19.1124574Z ATen parallel backend: OpenMP 2024-12-18T00:28:19.1124757Z 2024-12-18T00:28:19.4133085Z + [[ inductor_cpp_wrapper == *numpy_2* ]] 2024-12-18T00:28:19.4133847Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm86 == *aarch64* ]] 2024-12-18T00:28:19.4134249Z + [[ inductor_cpp_wrapper == *backward* ]] 2024-12-18T00:28:19.4134598Z + [[ inductor_cpp_wrapper == *xla* ]] 2024-12-18T00:28:19.4134952Z + [[ inductor_cpp_wrapper == *executorch* ]] 2024-12-18T00:28:19.4135325Z + [[ inductor_cpp_wrapper == \j\i\t\_\l\e\g\a\c\y ]] 2024-12-18T00:28:19.4135753Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm86 == *libtorch* ]] 2024-12-18T00:28:19.4136159Z + [[ inductor_cpp_wrapper == distributed ]] 2024-12-18T00:28:19.4136529Z + [[ inductor_cpp_wrapper == *inductor_distributed* ]] 2024-12-18T00:28:19.4136927Z + [[ inductor_cpp_wrapper == *inductor-halide* ]] 2024-12-18T00:28:19.4137326Z + [[ inductor_cpp_wrapper == *inductor-triton-cpu* ]] 2024-12-18T00:28:19.4137761Z + [[ inductor_cpp_wrapper == *inductor-micro-benchmark* ]] 2024-12-18T00:28:19.4138170Z + [[ inductor_cpp_wrapper == *huggingface* ]] 2024-12-18T00:28:19.4138508Z + [[ inductor_cpp_wrapper == *timm* ]] 2024-12-18T00:28:19.4138853Z + [[ inductor_cpp_wrapper == *torchbench* ]] 2024-12-18T00:28:19.4139238Z + [[ inductor_cpp_wrapper == *inductor_cpp_wrapper* ]] 2024-12-18T00:28:19.4139608Z + install_torchaudio cuda 2024-12-18T00:28:19.4139878Z + local commit 2024-12-18T00:28:19.4140118Z ++ get_pinned_commit audio 2024-12-18T00:28:19.4140412Z ++ cat .github/ci_commit_pins/audio.txt 2024-12-18T00:28:19.4159628Z + commit=332760d4b300f00a0d862e3cfe1495db3b1a14f9 2024-12-18T00:28:19.4159996Z + [[ cuda == \c\u\d\a ]] 2024-12-18T00:28:19.4160268Z + TORCH_CUDA_ARCH_LIST='8.0;8.6' 2024-12-18T00:28:19.4160878Z + pip_install --no-use-pep517 --user git+https://github.com/pytorch/audio.git@332760d4b300f00a0d862e3cfe1495db3b1a14f9 2024-12-18T00:28:19.4161565Z + pip_install_pkg='python3 -m pip install --progress-bar off' 2024-12-18T00:28:19.4162361Z + python3 -m pip install --progress-bar off --no-use-pep517 --user git+https://github.com/pytorch/audio.git@332760d4b300f00a0d862e3cfe1495db3b1a14f9 2024-12-18T00:28:19.7496522Z Collecting git+https://github.com/pytorch/audio.git@332760d4b300f00a0d862e3cfe1495db3b1a14f9 2024-12-18T00:28:19.7499965Z Cloning https://github.com/pytorch/audio.git (to revision 332760d4b300f00a0d862e3cfe1495db3b1a14f9) to /tmp/pip-req-build-x5aw92va 2024-12-18T00:28:19.7532803Z Running command git clone --filter=blob:none --quiet https://github.com/pytorch/audio.git /tmp/pip-req-build-x5aw92va 2024-12-18T00:28:20.5374245Z Running command git rev-parse -q --verify 'sha^332760d4b300f00a0d862e3cfe1495db3b1a14f9' 2024-12-18T00:28:20.5401063Z Running command git fetch -q https://github.com/pytorch/audio.git 332760d4b300f00a0d862e3cfe1495db3b1a14f9 2024-12-18T00:28:20.9595853Z Running command git checkout -q 332760d4b300f00a0d862e3cfe1495db3b1a14f9 2024-12-18T00:28:21.1190094Z Resolved https://github.com/pytorch/audio.git to commit 332760d4b300f00a0d862e3cfe1495db3b1a14f9 2024-12-18T00:28:21.1190754Z Running command git submodule update --init --recursive -q 2024-12-18T00:28:23.7084497Z Preparing metadata (setup.py) ... [?25l- done 2024-12-18T00:28:23.7115170Z [?25hRequirement already satisfied: torch in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchaudio==2.5.0a0+332760d) (2.6.0a0+git0cdf8b1) 2024-12-18T00:28:23.7141201Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchaudio==2.5.0a0+332760d) (3.16.1) 2024-12-18T00:28:23.7145650Z Requirement already satisfied: typing-extensions>=4.10.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchaudio==2.5.0a0+332760d) (4.12.2) 2024-12-18T00:28:23.7148831Z Requirement already satisfied: networkx in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchaudio==2.5.0a0+332760d) (2.8.8) 2024-12-18T00:28:23.7152290Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchaudio==2.5.0a0+332760d) (3.1.4) 2024-12-18T00:28:23.7156133Z Requirement already satisfied: fsspec in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchaudio==2.5.0a0+332760d) (2024.10.0) 2024-12-18T00:28:23.7161181Z Requirement already satisfied: sympy==1.13.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchaudio==2.5.0a0+332760d) (1.13.1) 2024-12-18T00:28:23.7175995Z Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from sympy==1.13.1->torch->torchaudio==2.5.0a0+332760d) (1.3.0) 2024-12-18T00:28:23.7649293Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from jinja2->torch->torchaudio==2.5.0a0+332760d) (3.0.2) 2024-12-18T00:28:23.7712724Z Building wheels for collected packages: torchaudio 2024-12-18T00:30:42.2605921Z Building wheel for torchaudio (setup.py) ... [?25l- \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - done 2024-12-18T00:30:42.2642379Z [?25h Created wheel for torchaudio: filename=torchaudio-2.5.0a0+332760d-cp310-cp310-linux_x86_64.whl size=2326948 sha256=873458e53f086faa759648b76df7f57e48669a9c1217c34f0540d449efd1d009 2024-12-18T00:30:42.2643891Z Stored in directory: /var/lib/jenkins/.cache/pip/wheels/78/2e/5c/66e884f380e2436e82a6c71c80865fe12e30aca3d9350545dd 2024-12-18T00:30:42.2673700Z Successfully built torchaudio 2024-12-18T00:30:42.7610390Z Installing collected packages: torchaudio 2024-12-18T00:30:42.9762240Z Successfully installed torchaudio-2.5.0a0+332760d 2024-12-18T00:30:43.1627329Z + install_torchvision 2024-12-18T00:30:43.1627635Z + local orig_preload 2024-12-18T00:30:43.1627879Z + local commit 2024-12-18T00:30:43.1632580Z ++ get_pinned_commit vision 2024-12-18T00:30:43.1632934Z ++ cat .github/ci_commit_pins/vision.txt 2024-12-18T00:30:43.1661953Z + commit=d23a6e1664d20707c11781299611436e1f0c104f 2024-12-18T00:30:43.1663499Z + orig_preload= 2024-12-18T00:30:43.1663730Z + '[' -n '' ']' 2024-12-18T00:30:43.1664288Z + pip_install --no-use-pep517 --user git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2024-12-18T00:30:43.1664983Z + pip_install_pkg='python3 -m pip install --progress-bar off' 2024-12-18T00:30:43.1665777Z + python3 -m pip install --progress-bar off --no-use-pep517 --user git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2024-12-18T00:30:43.5033974Z Collecting git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2024-12-18T00:30:43.5038419Z Cloning https://github.com/pytorch/vision.git (to revision d23a6e1664d20707c11781299611436e1f0c104f) to /tmp/pip-req-build-cuwd68xy 2024-12-18T00:30:43.5080592Z Running command git clone --filter=blob:none --quiet https://github.com/pytorch/vision.git /tmp/pip-req-build-cuwd68xy 2024-12-18T00:30:45.0966321Z Running command git rev-parse -q --verify 'sha^d23a6e1664d20707c11781299611436e1f0c104f' 2024-12-18T00:30:45.0996347Z Running command git fetch -q https://github.com/pytorch/vision.git d23a6e1664d20707c11781299611436e1f0c104f 2024-12-18T00:30:46.5015169Z Running command git checkout -q d23a6e1664d20707c11781299611436e1f0c104f 2024-12-18T00:30:46.8217958Z Resolved https://github.com/pytorch/vision.git to commit d23a6e1664d20707c11781299611436e1f0c104f 2024-12-18T00:30:49.6735833Z Preparing metadata (setup.py) ... [?25l- \ done 2024-12-18T00:30:49.6770985Z [?25hRequirement already satisfied: numpy in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (1.22.4) 2024-12-18T00:30:49.6773891Z Requirement already satisfied: torch in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (2.6.0a0+git0cdf8b1) 2024-12-18T00:30:49.6777625Z Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (11.0.0) 2024-12-18T00:30:49.6844228Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (3.16.1) 2024-12-18T00:30:49.6847910Z Requirement already satisfied: typing-extensions>=4.10.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (4.12.2) 2024-12-18T00:30:49.6851599Z Requirement already satisfied: networkx in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (2.8.8) 2024-12-18T00:30:49.6854717Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (3.1.4) 2024-12-18T00:30:49.6857824Z Requirement already satisfied: fsspec in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (2024.10.0) 2024-12-18T00:30:49.6863237Z Requirement already satisfied: sympy==1.13.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (1.13.1) 2024-12-18T00:30:49.6877040Z Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from sympy==1.13.1->torch->torchvision==0.19.0a0+d23a6e1) (1.3.0) 2024-12-18T00:30:49.7365269Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from jinja2->torch->torchvision==0.19.0a0+d23a6e1) (3.0.2) 2024-12-18T00:30:49.7429533Z Building wheels for collected packages: torchvision 2024-12-18T00:32:05.5748224Z Building wheel for torchvision (setup.py) ... [?25l- \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | done 2024-12-18T00:32:05.5780044Z [?25h Created wheel for torchvision: filename=torchvision-0.19.0a0+d23a6e1-cp310-cp310-linux_x86_64.whl size=2028014 sha256=c6b018b22b327973049eeef4a2ee65244f6233da39db7615f9cc2c0999076239 2024-12-18T00:32:05.5781908Z Stored in directory: /var/lib/jenkins/.cache/pip/wheels/0e/56/35/02931e71eb23fd2b85591c7ec05b733ca7c8b328a2fd151f96 2024-12-18T00:32:05.5817534Z Successfully built torchvision 2024-12-18T00:32:06.0771974Z Installing collected packages: torchvision 2024-12-18T00:32:06.4894601Z Successfully installed torchvision-0.19.0a0+d23a6e1 2024-12-18T00:32:06.6404905Z + '[' -n '' ']' 2024-12-18T00:32:06.6405200Z + checkout_install_torchbench hf_T5 llama moco 2024-12-18T00:32:06.6405537Z + local commit 2024-12-18T00:32:06.6411904Z ++ get_pinned_commit torchbench 2024-12-18T00:32:06.6412350Z ++ cat .github/ci_commit_pins/torchbench.txt 2024-12-18T00:32:06.6437720Z + commit=766a5e3a189384659fd35a68c3b17b88c761aaac 2024-12-18T00:32:06.6438267Z + git clone https://github.com/pytorch/benchmark torchbench 2024-12-18T00:32:06.6457617Z Cloning into 'torchbench'... 2024-12-18T00:32:06.8136706Z remote: Enumerating objects: 34540, done. 2024-12-18T00:32:06.8137309Z remote: Counting objects: 0% (1/1700) 2024-12-18T00:32:06.8137735Z remote: Counting objects: 1% (17/1700) 2024-12-18T00:32:06.8138211Z remote: Counting objects: 2% (34/1700) 2024-12-18T00:32:06.8138603Z remote: Counting objects: 3% (51/1700) 2024-12-18T00:32:06.8139055Z remote: Counting objects: 4% (68/1700) 2024-12-18T00:32:06.8139444Z remote: Counting objects: 5% (85/1700) 2024-12-18T00:32:06.8139915Z remote: Counting objects: 6% (102/1700) 2024-12-18T00:32:06.8140325Z remote: Counting objects: 7% (119/1700) 2024-12-18T00:32:06.8140983Z remote: Counting objects: 8% (136/1700) 2024-12-18T00:32:06.8141535Z remote: Counting objects: 9% (153/1700) 2024-12-18T00:32:06.8142055Z remote: Counting objects: 10% (170/1700) 2024-12-18T00:32:06.8142562Z remote: Counting objects: 11% (187/1700) 2024-12-18T00:32:06.8142983Z remote: Counting objects: 12% (204/1700) 2024-12-18T00:32:06.8143712Z remote: Counting objects: 13% (221/1700) 2024-12-18T00:32:06.8144227Z remote: Counting objects: 14% (238/1700) 2024-12-18T00:32:06.8144746Z remote: Counting objects: 15% (255/1700) 2024-12-18T00:32:06.8145147Z remote: Counting objects: 16% (272/1700) 2024-12-18T00:32:06.8145547Z remote: Counting objects: 17% (289/1700) 2024-12-18T00:32:06.8145954Z remote: Counting objects: 18% (306/1700) 2024-12-18T00:32:06.8146437Z remote: Counting objects: 19% (323/1700) 2024-12-18T00:32:06.8146821Z remote: Counting objects: 20% (340/1700) 2024-12-18T00:32:06.8147293Z remote: Counting objects: 21% (357/1700) 2024-12-18T00:32:06.8147682Z remote: Counting objects: 22% (374/1700) 2024-12-18T00:32:06.8148162Z remote: Counting objects: 23% (391/1700) 2024-12-18T00:32:06.8148553Z remote: Counting objects: 24% (408/1700) 2024-12-18T00:32:06.8149013Z remote: Counting objects: 25% (425/1700) 2024-12-18T00:32:06.8149401Z remote: Counting objects: 26% (442/1700) 2024-12-18T00:32:06.8149878Z remote: Counting objects: 27% (459/1700) 2024-12-18T00:32:06.8150280Z remote: Counting objects: 28% (476/1700) 2024-12-18T00:32:06.8150754Z remote: Counting objects: 29% (493/1700) 2024-12-18T00:32:06.8151145Z remote: Counting objects: 30% (510/1700) 2024-12-18T00:32:06.8151610Z remote: Counting objects: 31% (527/1700) 2024-12-18T00:32:06.8152010Z remote: Counting objects: 32% (544/1700) 2024-12-18T00:32:06.8152478Z remote: Counting objects: 33% (561/1700) 2024-12-18T00:32:06.8152875Z remote: Counting objects: 34% (578/1700) 2024-12-18T00:32:06.8153339Z remote: Counting objects: 35% (595/1700) 2024-12-18T00:32:06.8153733Z remote: Counting objects: 36% (612/1700) 2024-12-18T00:32:06.8154202Z remote: Counting objects: 37% (629/1700) 2024-12-18T00:32:06.8154605Z remote: Counting objects: 38% (646/1700) 2024-12-18T00:32:06.8155082Z remote: Counting objects: 39% (663/1700) 2024-12-18T00:32:06.8155471Z remote: Counting objects: 40% (680/1700) 2024-12-18T00:32:06.8155951Z remote: Counting objects: 41% (697/1700) 2024-12-18T00:32:06.8156344Z remote: Counting objects: 42% (714/1700) 2024-12-18T00:32:06.8157018Z remote: Counting objects: 43% (731/1700) 2024-12-18T00:32:06.8157456Z remote: Counting objects: 44% (748/1700) 2024-12-18T00:32:06.8157875Z remote: Counting objects: 45% (765/1700) 2024-12-18T00:32:06.8158313Z remote: Counting objects: 46% (782/1700) 2024-12-18T00:32:06.8158737Z remote: Counting objects: 47% (799/1700) 2024-12-18T00:32:06.8159177Z remote: Counting objects: 48% (816/1700) 2024-12-18T00:32:06.8159599Z remote: Counting objects: 49% (833/1700) 2024-12-18T00:32:06.8160025Z remote: Counting objects: 50% (850/1700) 2024-12-18T00:32:06.8160457Z remote: Counting objects: 51% (867/1700) 2024-12-18T00:32:06.8160895Z remote: Counting objects: 52% (884/1700) 2024-12-18T00:32:06.8161321Z remote: Counting objects: 53% (901/1700) 2024-12-18T00:32:06.8161765Z remote: Counting objects: 54% (918/1700) 2024-12-18T00:32:06.8162183Z remote: Counting objects: 55% (935/1700) 2024-12-18T00:32:06.8162628Z remote: Counting objects: 56% (952/1700) 2024-12-18T00:32:06.8163061Z remote: Counting objects: 57% (969/1700) 2024-12-18T00:32:06.8163502Z remote: Counting objects: 58% (986/1700) 2024-12-18T00:32:06.8163927Z remote: Counting objects: 59% (1003/1700) 2024-12-18T00:32:06.8164382Z remote: Counting objects: 60% (1020/1700) 2024-12-18T00:32:06.8164822Z remote: Counting objects: 61% (1037/1700) 2024-12-18T00:32:06.8165296Z remote: Counting objects: 62% (1054/1700) 2024-12-18T00:32:06.8165695Z remote: Counting objects: 63% (1071/1700) 2024-12-18T00:32:06.8166159Z remote: Counting objects: 64% (1088/1700) 2024-12-18T00:32:06.8166560Z remote: Counting objects: 65% (1105/1700) 2024-12-18T00:32:06.8167034Z remote: Counting objects: 66% (1122/1700) 2024-12-18T00:32:06.8167428Z remote: Counting objects: 67% (1139/1700) 2024-12-18T00:32:06.8168105Z remote: Counting objects: 68% (1156/1700) 2024-12-18T00:32:06.8168547Z remote: Counting objects: 69% (1173/1700) 2024-12-18T00:32:06.8169024Z remote: Counting objects: 70% (1190/1700) 2024-12-18T00:32:06.8169445Z remote: Counting objects: 71% (1207/1700) 2024-12-18T00:32:06.8169893Z remote: Counting objects: 72% (1224/1700) 2024-12-18T00:32:06.8170306Z remote: Counting objects: 73% (1241/1700) 2024-12-18T00:32:06.8170762Z remote: Counting objects: 74% (1258/1700) 2024-12-18T00:32:06.8171189Z remote: Counting objects: 75% (1275/1700) 2024-12-18T00:32:06.8171645Z remote: Counting objects: 76% (1292/1700) 2024-12-18T00:32:06.8172077Z remote: Counting objects: 77% (1309/1700) 2024-12-18T00:32:06.8172520Z remote: Counting objects: 78% (1326/1700) 2024-12-18T00:32:06.8172956Z remote: Counting objects: 79% (1343/1700) 2024-12-18T00:32:06.8173393Z remote: Counting objects: 80% (1360/1700) 2024-12-18T00:32:06.8173849Z remote: Counting objects: 81% (1377/1700) 2024-12-18T00:32:06.8174286Z remote: Counting objects: 82% (1394/1700) 2024-12-18T00:32:06.8174741Z remote: Counting objects: 83% (1411/1700) 2024-12-18T00:32:06.8175171Z remote: Counting objects: 84% (1428/1700) 2024-12-18T00:32:06.8175642Z remote: Counting objects: 85% (1445/1700) 2024-12-18T00:32:06.8176052Z remote: Counting objects: 86% (1462/1700) 2024-12-18T00:32:06.8176519Z remote: Counting objects: 87% (1479/1700) 2024-12-18T00:32:06.8176920Z remote: Counting objects: 88% (1496/1700) 2024-12-18T00:32:06.8177392Z remote: Counting objects: 89% (1513/1700) 2024-12-18T00:32:06.8177801Z remote: Counting objects: 90% (1530/1700) 2024-12-18T00:32:06.8178276Z remote: Counting objects: 91% (1547/1700) 2024-12-18T00:32:06.8178668Z remote: Counting objects: 92% (1564/1700) 2024-12-18T00:32:06.8179069Z remote: Counting objects: 93% (1581/1700) 2024-12-18T00:32:06.8179545Z remote: Counting objects: 94% (1598/1700) 2024-12-18T00:32:06.8179952Z remote: Counting objects: 95% (1615/1700) 2024-12-18T00:32:06.8180354Z remote: Counting objects: 96% (1632/1700) 2024-12-18T00:32:06.8180972Z remote: Counting objects: 97% (1649/1700) 2024-12-18T00:32:06.8181505Z remote: Counting objects: 98% (1666/1700) 2024-12-18T00:32:06.8181903Z remote: Counting objects: 99% (1683/1700) 2024-12-18T00:32:06.8182296Z remote: Counting objects: 100% (1700/1700) 2024-12-18T00:32:06.8182718Z remote: Counting objects: 100% (1700/1700), done. 2024-12-18T00:32:06.8183246Z remote: Compressing objects: 0% (1/453) 2024-12-18T00:32:06.8204872Z remote: Compressing objects: 1% (5/453) 2024-12-18T00:32:06.8241257Z remote: Compressing objects: 2% (10/453) 2024-12-18T00:32:06.8310046Z remote: Compressing objects: 3% (14/453) 2024-12-18T00:32:06.8326298Z remote: Compressing objects: 4% (19/453) 2024-12-18T00:32:06.8392020Z remote: Compressing objects: 5% (23/453) 2024-12-18T00:32:06.8429479Z remote: Compressing objects: 6% (28/453) 2024-12-18T00:32:06.8444229Z remote: Compressing objects: 7% (32/453) 2024-12-18T00:32:06.8474564Z remote: Compressing objects: 8% (37/453) 2024-12-18T00:32:06.8510345Z remote: Compressing objects: 9% (41/453) 2024-12-18T00:32:06.8537785Z remote: Compressing objects: 10% (46/453) 2024-12-18T00:32:06.8552796Z remote: Compressing objects: 11% (50/453) 2024-12-18T00:32:06.8568313Z remote: Compressing objects: 12% (55/453) 2024-12-18T00:32:06.8590164Z remote: Compressing objects: 13% (59/453) 2024-12-18T00:32:06.8612810Z remote: Compressing objects: 14% (64/453) 2024-12-18T00:32:06.8631433Z remote: Compressing objects: 15% (68/453) 2024-12-18T00:32:06.8646356Z remote: Compressing objects: 16% (73/453) 2024-12-18T00:32:06.8658061Z remote: Compressing objects: 17% (78/453) 2024-12-18T00:32:06.8669793Z remote: Compressing objects: 18% (82/453) 2024-12-18T00:32:06.8683444Z remote: Compressing objects: 19% (87/453) 2024-12-18T00:32:06.8696079Z remote: Compressing objects: 20% (91/453) 2024-12-18T00:32:06.8706556Z remote: Compressing objects: 21% (96/453) 2024-12-18T00:32:06.8717071Z remote: Compressing objects: 22% (100/453) 2024-12-18T00:32:06.8722905Z remote: Compressing objects: 23% (105/453) 2024-12-18T00:32:06.8730060Z remote: Compressing objects: 24% (109/453) 2024-12-18T00:32:06.8731352Z remote: Compressing objects: 25% (114/453) 2024-12-18T00:32:06.8738463Z remote: Compressing objects: 26% (118/453) 2024-12-18T00:32:06.8740718Z remote: Compressing objects: 27% (123/453) 2024-12-18T00:32:06.8743919Z remote: Compressing objects: 28% (127/453) 2024-12-18T00:32:06.8744364Z remote: Compressing objects: 29% (132/453) 2024-12-18T00:32:06.8744876Z remote: Compressing objects: 30% (136/453) 2024-12-18T00:32:06.8745293Z remote: Compressing objects: 31% (141/453) 2024-12-18T00:32:06.8746020Z remote: Compressing objects: 32% (145/453) 2024-12-18T00:32:06.8746465Z remote: Compressing objects: 33% (150/453) 2024-12-18T00:32:06.8746892Z remote: Compressing objects: 34% (155/453) 2024-12-18T00:32:06.8748695Z remote: Compressing objects: 35% (159/453) 2024-12-18T00:32:06.8751029Z remote: Compressing objects: 36% (164/453) 2024-12-18T00:32:06.8756659Z remote: Compressing objects: 37% (168/453) 2024-12-18T00:32:06.8758953Z remote: Compressing objects: 38% (173/453) 2024-12-18T00:32:06.8761572Z remote: Compressing objects: 39% (177/453) 2024-12-18T00:32:06.8761996Z remote: Compressing objects: 40% (182/453) 2024-12-18T00:32:06.8762399Z remote: Compressing objects: 41% (186/453) 2024-12-18T00:32:06.8764064Z remote: Compressing objects: 42% (191/453) 2024-12-18T00:32:06.8764489Z remote: Compressing objects: 43% (195/453) 2024-12-18T00:32:06.8764902Z remote: Compressing objects: 44% (200/453) 2024-12-18T00:32:06.8766624Z remote: Compressing objects: 45% (204/453) 2024-12-18T00:32:06.8767048Z remote: Compressing objects: 46% (209/453) 2024-12-18T00:32:06.8769017Z remote: Compressing objects: 47% (213/453) 2024-12-18T00:32:06.8771690Z remote: Compressing objects: 48% (218/453) 2024-12-18T00:32:06.8772109Z remote: Compressing objects: 49% (222/453) 2024-12-18T00:32:06.8793881Z remote: Compressing objects: 50% (227/453) 2024-12-18T00:32:06.8796464Z remote: Compressing objects: 51% (232/453) 2024-12-18T00:32:06.8796941Z remote: Compressing objects: 52% (236/453) 2024-12-18T00:32:06.8797441Z remote: Compressing objects: 53% (241/453) 2024-12-18T00:32:06.8797852Z remote: Compressing objects: 54% (245/453) 2024-12-18T00:32:06.8798263Z remote: Compressing objects: 55% (250/453) 2024-12-18T00:32:06.8798674Z remote: Compressing objects: 56% (254/453) 2024-12-18T00:32:06.8799081Z remote: Compressing objects: 57% (259/453) 2024-12-18T00:32:06.8799589Z remote: Compressing objects: 58% (263/453) 2024-12-18T00:32:06.8800002Z remote: Compressing objects: 59% (268/453) 2024-12-18T00:32:06.8800410Z remote: Compressing objects: 60% (272/453) 2024-12-18T00:32:06.8800828Z remote: Compressing objects: 61% (277/453) 2024-12-18T00:32:06.8801237Z remote: Compressing objects: 62% (281/453) 2024-12-18T00:32:06.8801664Z remote: Compressing objects: 63% (286/453) 2024-12-18T00:32:06.8802127Z remote: Compressing objects: 64% (290/453) 2024-12-18T00:32:06.8802584Z remote: Compressing objects: 65% (295/453) 2024-12-18T00:32:06.8802997Z remote: Compressing objects: 66% (299/453) 2024-12-18T00:32:06.8803404Z remote: Compressing objects: 67% (304/453) 2024-12-18T00:32:06.8803812Z remote: Compressing objects: 68% (309/453) 2024-12-18T00:32:06.8804221Z remote: Compressing objects: 69% (313/453) 2024-12-18T00:32:06.8804697Z remote: Compressing objects: 70% (318/453) 2024-12-18T00:32:06.8805148Z remote: Compressing objects: 71% (322/453) 2024-12-18T00:32:06.8805558Z remote: Compressing objects: 72% (327/453) 2024-12-18T00:32:06.8805968Z remote: Compressing objects: 73% (331/453) 2024-12-18T00:32:06.8806415Z remote: Compressing objects: 74% (336/453) 2024-12-18T00:32:06.8807038Z remote: Compressing objects: 75% (340/453) 2024-12-18T00:32:06.8807553Z remote: Compressing objects: 76% (345/453) 2024-12-18T00:32:06.8809613Z remote: Compressing objects: 77% (349/453) 2024-12-18T00:32:06.8810126Z remote: Compressing objects: 78% (354/453) 2024-12-18T00:32:06.8810541Z remote: Compressing objects: 79% (358/453) 2024-12-18T00:32:06.8810947Z remote: Compressing objects: 80% (363/453) 2024-12-18T00:32:06.8811359Z remote: Compressing objects: 81% (367/453) 2024-12-18T00:32:06.8811769Z remote: Compressing objects: 82% (372/453) 2024-12-18T00:32:06.8812282Z remote: Compressing objects: 83% (376/453) 2024-12-18T00:32:06.8812705Z remote: Compressing objects: 84% (381/453) 2024-12-18T00:32:06.8813716Z remote: Compressing objects: 85% (386/453) 2024-12-18T00:32:06.8816620Z remote: Compressing objects: 86% (390/453) 2024-12-18T00:32:06.8817058Z remote: Compressing objects: 87% (395/453) 2024-12-18T00:32:06.8819254Z remote: Compressing objects: 88% (399/453) 2024-12-18T00:32:06.8819684Z remote: Compressing objects: 89% (404/453) 2024-12-18T00:32:06.8820213Z remote: Compressing objects: 90% (408/453) 2024-12-18T00:32:06.8822098Z remote: Compressing objects: 91% (413/453) 2024-12-18T00:32:06.8822602Z remote: Compressing objects: 92% (417/453) 2024-12-18T00:32:06.8823046Z remote: Compressing objects: 93% (422/453) 2024-12-18T00:32:06.8824249Z remote: Compressing objects: 94% (426/453) 2024-12-18T00:32:06.8824674Z remote: Compressing objects: 95% (431/453) 2024-12-18T00:32:06.8825185Z remote: Compressing objects: 96% (435/453) 2024-12-18T00:32:06.8825601Z remote: Compressing objects: 97% (440/453) 2024-12-18T00:32:06.8826905Z remote: Compressing objects: 98% (444/453) 2024-12-18T00:32:06.8827362Z remote: Compressing objects: 99% (449/453) 2024-12-18T00:32:06.8827811Z remote: Compressing objects: 100% (453/453) 2024-12-18T00:32:06.8828269Z remote: Compressing objects: 100% (453/453), done. 2024-12-18T00:32:06.8912648Z Receiving objects: 0% (1/34540) 2024-12-18T00:32:06.8961871Z Receiving objects: 1% (346/34540) 2024-12-18T00:32:06.9004693Z Receiving objects: 2% (691/34540) 2024-12-18T00:32:06.9042921Z Receiving objects: 3% (1037/34540) 2024-12-18T00:32:06.9079788Z Receiving objects: 4% (1382/34540) 2024-12-18T00:32:06.9116985Z Receiving objects: 5% (1727/34540) 2024-12-18T00:32:06.9165421Z Receiving objects: 6% (2073/34540) 2024-12-18T00:32:06.9199857Z Receiving objects: 7% (2418/34540) 2024-12-18T00:32:06.9235884Z Receiving objects: 8% (2764/34540) 2024-12-18T00:32:06.9313140Z Receiving objects: 9% (3109/34540) 2024-12-18T00:32:06.9368015Z Receiving objects: 10% (3454/34540) 2024-12-18T00:32:06.9441504Z Receiving objects: 11% (3800/34540) 2024-12-18T00:32:06.9629048Z Receiving objects: 12% (4145/34540) 2024-12-18T00:32:06.9747025Z Receiving objects: 13% (4491/34540) 2024-12-18T00:32:06.9838464Z Receiving objects: 14% (4836/34540) 2024-12-18T00:32:06.9894728Z Receiving objects: 15% (5181/34540) 2024-12-18T00:32:06.9933855Z Receiving objects: 16% (5527/34540) 2024-12-18T00:32:06.9994372Z Receiving objects: 17% (5872/34540) 2024-12-18T00:32:07.0030537Z Receiving objects: 18% (6218/34540) 2024-12-18T00:32:07.0051876Z Receiving objects: 19% (6563/34540) 2024-12-18T00:32:07.1859122Z Receiving objects: 20% (6908/34540) 2024-12-18T00:32:07.8854423Z Receiving objects: 21% (7254/34540) 2024-12-18T00:32:08.5128118Z Receiving objects: 21% (7393/34540), 75.48 MiB | 75.48 MiB/s 2024-12-18T00:32:08.6000075Z Receiving objects: 22% (7599/34540), 113.06 MiB | 75.37 MiB/s 2024-12-18T00:32:08.6789179Z Receiving objects: 23% (7945/34540), 113.06 MiB | 75.37 MiB/s 2024-12-18T00:32:08.7592441Z Receiving objects: 24% (8290/34540), 113.06 MiB | 75.37 MiB/s 2024-12-18T00:32:08.8384708Z Receiving objects: 25% (8635/34540), 113.06 MiB | 75.37 MiB/s 2024-12-18T00:32:08.8853478Z Receiving objects: 26% (8981/34540), 113.06 MiB | 75.37 MiB/s 2024-12-18T00:32:08.9189625Z Receiving objects: 26% (9181/34540), 151.25 MiB | 75.63 MiB/s 2024-12-18T00:32:08.9988949Z Receiving objects: 27% (9326/34540), 151.25 MiB | 75.63 MiB/s 2024-12-18T00:32:09.0839061Z Receiving objects: 28% (9672/34540), 151.25 MiB | 75.63 MiB/s 2024-12-18T00:32:09.3277518Z Receiving objects: 29% (10017/34540), 151.25 MiB | 75.63 MiB/s 2024-12-18T00:32:09.3892706Z Receiving objects: 30% (10362/34540), 151.25 MiB | 75.63 MiB/s 2024-12-18T00:32:09.5947926Z Receiving objects: 31% (10708/34540), 184.41 MiB | 73.76 MiB/s 2024-12-18T00:32:09.8853780Z Receiving objects: 32% (11053/34540), 184.41 MiB | 73.76 MiB/s 2024-12-18T00:32:09.9009336Z Receiving objects: 32% (11314/34540), 184.41 MiB | 73.76 MiB/s 2024-12-18T00:32:09.9226141Z Receiving objects: 33% (11399/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:09.9252625Z Receiving objects: 34% (11744/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:09.9271123Z Receiving objects: 35% (12089/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:09.9287193Z Receiving objects: 36% (12435/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:09.9300294Z Receiving objects: 37% (12780/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:09.9312587Z Receiving objects: 38% (13126/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:09.9333078Z Receiving objects: 39% (13471/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:09.9346080Z Receiving objects: 40% (13816/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:09.9351268Z Receiving objects: 41% (14162/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:09.9365211Z Receiving objects: 42% (14507/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:09.9388593Z Receiving objects: 43% (14853/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:09.9403457Z Receiving objects: 44% (15198/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:09.9601588Z Receiving objects: 45% (15543/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:09.9607723Z Receiving objects: 46% (15889/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:09.9615944Z Receiving objects: 47% (16234/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:09.9621910Z Receiving objects: 48% (16580/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:09.9639559Z Receiving objects: 49% (16925/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:09.9651634Z Receiving objects: 50% (17270/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:09.9657645Z Receiving objects: 51% (17616/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:09.9676271Z Receiving objects: 52% (17961/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:09.9685438Z Receiving objects: 53% (18307/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:09.9696466Z Receiving objects: 54% (18652/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:09.9834475Z Receiving objects: 55% (18997/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:09.9841647Z Receiving objects: 56% (19343/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:09.9848633Z Receiving objects: 57% (19688/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:09.9858973Z Receiving objects: 58% (20034/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:09.9868580Z Receiving objects: 59% (20379/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:10.0124731Z Receiving objects: 60% (20724/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:10.0522786Z Receiving objects: 61% (21070/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:10.0534281Z Receiving objects: 62% (21415/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:10.0548301Z Receiving objects: 63% (21761/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:10.0561209Z Receiving objects: 64% (22106/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:10.0574983Z Receiving objects: 65% (22451/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:10.0584963Z Receiving objects: 66% (22797/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:10.0604740Z Receiving objects: 67% (23142/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:10.0612286Z Receiving objects: 68% (23488/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:10.0621347Z Receiving objects: 69% (23833/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:10.0834514Z Receiving objects: 70% (24178/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:10.0868611Z Receiving objects: 71% (24524/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:10.0879253Z Receiving objects: 72% (24869/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:10.0892443Z Receiving objects: 73% (25215/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:10.0933629Z Receiving objects: 74% (25560/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:10.1083301Z Receiving objects: 75% (25905/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:10.1090483Z Receiving objects: 76% (26251/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:10.1097195Z Receiving objects: 77% (26596/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:10.1105050Z Receiving objects: 78% (26942/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:10.1113397Z Receiving objects: 79% (27287/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:10.1120109Z Receiving objects: 80% (27632/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:10.1234869Z Receiving objects: 81% (27978/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:10.1253281Z Receiving objects: 82% (28323/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:10.1266932Z Receiving objects: 83% (28669/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:10.1334841Z Receiving objects: 84% (29014/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:10.1459933Z Receiving objects: 85% (29359/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:10.1514097Z Receiving objects: 86% (29705/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:10.1577146Z Receiving objects: 87% (30050/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:10.1670698Z Receiving objects: 88% (30396/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:10.1788478Z Receiving objects: 89% (30741/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:10.1874827Z Receiving objects: 90% (31086/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:10.1928013Z Receiving objects: 91% (31432/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:10.1952112Z Receiving objects: 92% (31777/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:10.1970821Z Receiving objects: 93% (32123/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:10.1995294Z Receiving objects: 94% (32468/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:10.2005699Z Receiving objects: 95% (32813/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:10.2010429Z Receiving objects: 96% (33159/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:10.2016042Z Receiving objects: 97% (33504/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:10.2057048Z Receiving objects: 98% (33850/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:10.2079084Z Receiving objects: 99% (34195/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:10.2080089Z remote: Total 34540 (delta 1494), reused 1287 (delta 1247), pack-reused 32840 (from 5) 2024-12-18T00:32:10.2097877Z Receiving objects: 100% (34540/34540), 219.16 MiB | 73.05 MiB/s 2024-12-18T00:32:10.2098405Z Receiving objects: 100% (34540/34540), 234.54 MiB | 70.56 MiB/s, done. 2024-12-18T00:32:10.2133537Z Resolving deltas: 0% (0/18566) 2024-12-18T00:32:10.2146952Z Resolving deltas: 1% (186/18566) 2024-12-18T00:32:10.2160823Z Resolving deltas: 2% (398/18566) 2024-12-18T00:32:10.2191521Z Resolving deltas: 3% (557/18566) 2024-12-18T00:32:10.2199352Z Resolving deltas: 4% (777/18566) 2024-12-18T00:32:10.2210982Z Resolving deltas: 5% (931/18566) 2024-12-18T00:32:10.2222961Z Resolving deltas: 6% (1124/18566) 2024-12-18T00:32:10.2233741Z Resolving deltas: 7% (1300/18566) 2024-12-18T00:32:10.2246342Z Resolving deltas: 8% (1489/18566) 2024-12-18T00:32:10.2260434Z Resolving deltas: 9% (1677/18566) 2024-12-18T00:32:10.2272489Z Resolving deltas: 10% (1862/18566) 2024-12-18T00:32:10.2285880Z Resolving deltas: 11% (2061/18566) 2024-12-18T00:32:10.2297722Z Resolving deltas: 12% (2229/18566) 2024-12-18T00:32:10.2316280Z Resolving deltas: 13% (2415/18566) 2024-12-18T00:32:10.2349584Z Resolving deltas: 14% (2603/18566) 2024-12-18T00:32:10.2357328Z Resolving deltas: 16% (3013/18566) 2024-12-18T00:32:10.2365317Z Resolving deltas: 17% (3182/18566) 2024-12-18T00:32:10.2404136Z Resolving deltas: 18% (3355/18566) 2024-12-18T00:32:10.2430061Z Resolving deltas: 19% (3531/18566) 2024-12-18T00:32:10.2435605Z Resolving deltas: 20% (3807/18566) 2024-12-18T00:32:10.2446018Z Resolving deltas: 21% (3916/18566) 2024-12-18T00:32:10.2458106Z Resolving deltas: 22% (4087/18566) 2024-12-18T00:32:10.2470984Z Resolving deltas: 23% (4309/18566) 2024-12-18T00:32:10.2506876Z Resolving deltas: 24% (4485/18566) 2024-12-18T00:32:10.2529754Z Resolving deltas: 25% (4646/18566) 2024-12-18T00:32:10.2544566Z Resolving deltas: 26% (4850/18566) 2024-12-18T00:32:10.2562434Z Resolving deltas: 27% (5016/18566) 2024-12-18T00:32:10.2576375Z Resolving deltas: 28% (5229/18566) 2024-12-18T00:32:10.2592094Z Resolving deltas: 29% (5385/18566) 2024-12-18T00:32:10.2602664Z Resolving deltas: 30% (5573/18566) 2024-12-18T00:32:10.2614495Z Resolving deltas: 31% (5763/18566) 2024-12-18T00:32:10.2637100Z Resolving deltas: 32% (5942/18566) 2024-12-18T00:32:10.2659355Z Resolving deltas: 33% (6131/18566) 2024-12-18T00:32:10.2673320Z Resolving deltas: 34% (6351/18566) 2024-12-18T00:32:10.2684191Z Resolving deltas: 35% (6549/18566) 2024-12-18T00:32:10.2701267Z Resolving deltas: 36% (6685/18566) 2024-12-18T00:32:10.2713846Z Resolving deltas: 37% (6871/18566) 2024-12-18T00:32:10.2736309Z Resolving deltas: 38% (7099/18566) 2024-12-18T00:32:10.2741442Z Resolving deltas: 39% (7309/18566) 2024-12-18T00:32:10.2750927Z Resolving deltas: 40% (7429/18566) 2024-12-18T00:32:10.2765643Z Resolving deltas: 41% (7618/18566) 2024-12-18T00:32:10.2792007Z Resolving deltas: 42% (7801/18566) 2024-12-18T00:32:10.2804833Z Resolving deltas: 43% (7986/18566) 2024-12-18T00:32:10.2830572Z Resolving deltas: 44% (8175/18566) 2024-12-18T00:32:10.2843872Z Resolving deltas: 45% (8355/18566) 2024-12-18T00:32:10.2852775Z Resolving deltas: 46% (8543/18566) 2024-12-18T00:32:10.2864970Z Resolving deltas: 47% (8736/18566) 2024-12-18T00:32:10.2877303Z Resolving deltas: 48% (8915/18566) 2024-12-18T00:32:10.2895244Z Resolving deltas: 49% (9098/18566) 2024-12-18T00:32:10.2903009Z Resolving deltas: 50% (9287/18566) 2024-12-18T00:32:10.2915335Z Resolving deltas: 51% (9473/18566) 2024-12-18T00:32:10.2919376Z Resolving deltas: 52% (9825/18566) 2024-12-18T00:32:10.2926690Z Resolving deltas: 53% (9909/18566) 2024-12-18T00:32:10.2933871Z Resolving deltas: 54% (10066/18566) 2024-12-18T00:32:10.2945842Z Resolving deltas: 55% (10244/18566) 2024-12-18T00:32:10.2952543Z Resolving deltas: 56% (10463/18566) 2024-12-18T00:32:10.2958011Z Resolving deltas: 57% (10642/18566) 2024-12-18T00:32:10.2977248Z Resolving deltas: 58% (10799/18566) 2024-12-18T00:32:10.2983086Z Resolving deltas: 59% (11090/18566) 2024-12-18T00:32:10.3003043Z Resolving deltas: 60% (11209/18566) 2024-12-18T00:32:10.3010498Z Resolving deltas: 61% (11363/18566) 2024-12-18T00:32:10.3021400Z Resolving deltas: 62% (11542/18566) 2024-12-18T00:32:10.3039056Z Resolving deltas: 63% (11703/18566) 2024-12-18T00:32:10.3051395Z Resolving deltas: 64% (11884/18566) 2024-12-18T00:32:10.3086962Z Resolving deltas: 65% (12076/18566) 2024-12-18T00:32:10.3087266Z Resolving deltas: 67% (12619/18566) 2024-12-18T00:32:10.3103220Z Resolving deltas: 68% (12634/18566) 2024-12-18T00:32:10.3116029Z Resolving deltas: 69% (12842/18566) 2024-12-18T00:32:10.3136308Z Resolving deltas: 70% (13003/18566) 2024-12-18T00:32:10.3147798Z Resolving deltas: 71% (13203/18566) 2024-12-18T00:32:10.3162478Z Resolving deltas: 72% (13368/18566) 2024-12-18T00:32:10.3174443Z Resolving deltas: 73% (13566/18566) 2024-12-18T00:32:10.3187993Z Resolving deltas: 74% (13740/18566) 2024-12-18T00:32:10.3196692Z Resolving deltas: 75% (13927/18566) 2024-12-18T00:32:10.3231508Z Resolving deltas: 76% (14116/18566) 2024-12-18T00:32:10.3241286Z Resolving deltas: 77% (14310/18566) 2024-12-18T00:32:10.3252738Z Resolving deltas: 78% (14482/18566) 2024-12-18T00:32:10.3266353Z Resolving deltas: 79% (14681/18566) 2024-12-18T00:32:10.3272277Z Resolving deltas: 80% (14901/18566) 2024-12-18T00:32:10.3281090Z Resolving deltas: 81% (15042/18566) 2024-12-18T00:32:10.3289086Z Resolving deltas: 82% (15225/18566) 2024-12-18T00:32:10.3296832Z Resolving deltas: 83% (15414/18566) 2024-12-18T00:32:10.3321485Z Resolving deltas: 84% (15596/18566) 2024-12-18T00:32:10.3356597Z Resolving deltas: 85% (15783/18566) 2024-12-18T00:32:10.3364218Z Resolving deltas: 86% (16027/18566) 2024-12-18T00:32:10.3374908Z Resolving deltas: 87% (16154/18566) 2024-12-18T00:32:10.3392268Z Resolving deltas: 88% (16347/18566) 2024-12-18T00:32:10.3424900Z Resolving deltas: 89% (16526/18566) 2024-12-18T00:32:10.3474565Z Resolving deltas: 90% (16719/18566) 2024-12-18T00:32:10.3493067Z Resolving deltas: 91% (16903/18566) 2024-12-18T00:32:10.3513809Z Resolving deltas: 92% (17159/18566) 2024-12-18T00:32:10.3517783Z Resolving deltas: 93% (17418/18566) 2024-12-18T00:32:10.3532760Z Resolving deltas: 94% (17492/18566) 2024-12-18T00:32:10.3542041Z Resolving deltas: 95% (17720/18566) 2024-12-18T00:32:10.3554827Z Resolving deltas: 96% (17881/18566) 2024-12-18T00:32:10.3564543Z Resolving deltas: 97% (18064/18566) 2024-12-18T00:32:10.3607849Z Resolving deltas: 98% (18204/18566) 2024-12-18T00:32:10.3842070Z Resolving deltas: 99% (18407/18566) 2024-12-18T00:32:10.3842484Z Resolving deltas: 100% (18566/18566) 2024-12-18T00:32:10.3842906Z Resolving deltas: 100% (18566/18566), done. 2024-12-18T00:32:11.4027899Z + pushd torchbench 2024-12-18T00:32:11.4028288Z ~/workspace/torchbench ~/workspace 2024-12-18T00:32:11.4028768Z + git checkout 766a5e3a189384659fd35a68c3b17b88c761aaac 2024-12-18T00:32:11.5103120Z Note: switching to '766a5e3a189384659fd35a68c3b17b88c761aaac'. 2024-12-18T00:32:11.5103550Z 2024-12-18T00:32:11.5103844Z You are in 'detached HEAD' state. You can look around, make experimental 2024-12-18T00:32:11.5104484Z changes and commit them, and you can discard any commits you make in this 2024-12-18T00:32:11.5105038Z state without impacting any branches by switching back to a branch. 2024-12-18T00:32:11.5105348Z 2024-12-18T00:32:11.5105815Z If you want to create a new branch to retain commits you create, you may 2024-12-18T00:32:11.5106318Z do so (now or later) by using -c with the switch command. Example: 2024-12-18T00:32:11.5106599Z 2024-12-18T00:32:11.5106719Z git switch -c 2024-12-18T00:32:11.5106924Z 2024-12-18T00:32:11.5107033Z Or undo this operation with: 2024-12-18T00:32:11.5107224Z 2024-12-18T00:32:11.5107319Z git switch - 2024-12-18T00:32:11.5107462Z 2024-12-18T00:32:11.5107697Z Turn off this advice by setting config variable advice.detachedHead to false 2024-12-18T00:32:11.5108042Z 2024-12-18T00:32:11.5108260Z HEAD is now at 766a5e3a Account for older numpy versions in #2514 (#2524) 2024-12-18T00:32:11.5117475Z + '[' hf_T5 ']' 2024-12-18T00:32:11.5117892Z + python install.py --continue_on_fail models hf_T5 llama moco 2024-12-18T00:32:14.1684720Z checking packages torch, torchvision, torchaudio are installed...OK 2024-12-18T00:32:40.2589250Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/hf_T5...OK 2024-12-18T00:32:41.3303063Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/llama...OK 2024-12-18T00:32:41.3539310Z running setup for /var/lib/jenkins/workspace/torchbench/torchbenchmark/models/moco...OK 2024-12-18T00:32:41.9023201Z + echo 'Print all dependencies after TorchBench is installed' 2024-12-18T00:32:41.9023670Z Print all dependencies after TorchBench is installed 2024-12-18T00:32:41.9024044Z + python -mpip freeze 2024-12-18T00:32:42.2291383Z absl-py==2.1.0 2024-12-18T00:32:42.2291789Z accelerate==1.2.1 2024-12-18T00:32:42.2292192Z aiohappyeyeballs==2.4.4 2024-12-18T00:32:42.2292557Z aiohttp==3.11.10 2024-12-18T00:32:42.2292896Z aiosignal==1.3.1 2024-12-18T00:32:42.2293232Z astunparse==1.6.3 2024-12-18T00:32:42.2293553Z async-timeout==5.0.1 2024-12-18T00:32:42.2293822Z attrs==24.2.0 2024-12-18T00:32:42.2294539Z audioread==3.0.1 2024-12-18T00:32:42.2294896Z beautifulsoup4==4.12.3 2024-12-18T00:32:42.2295298Z boto3==1.35.42 2024-12-18T00:32:42.2295660Z botocore==1.35.78 2024-12-18T00:32:42.2296002Z bs4==0.0.2 2024-12-18T00:32:42.2296324Z cachetools==5.5.0 2024-12-18T00:32:42.2296651Z certifi==2024.8.30 2024-12-18T00:32:42.2296995Z cffi==1.17.1 2024-12-18T00:32:42.2297343Z charset-normalizer==3.4.0 2024-12-18T00:32:42.2297737Z click==8.1.7 2024-12-18T00:32:42.2298055Z cloudpickle==3.1.0 2024-12-18T00:32:42.2298395Z colorama==0.4.6 2024-12-18T00:32:42.2298733Z coremltools==5.0b5 2024-12-18T00:32:42.2299075Z cryptography==44.0.0 2024-12-18T00:32:42.2299434Z Cython==3.0.11 2024-12-18T00:32:42.2299744Z datasets==3.2.0 2024-12-18T00:32:42.2300086Z decorator==5.1.1 2024-12-18T00:32:42.2300435Z Deprecated==1.2.15 2024-12-18T00:32:42.2300876Z dill==0.3.8 2024-12-18T00:32:42.2301197Z distro==1.9.0 2024-12-18T00:32:42.2301522Z exceptiongroup==1.2.2 2024-12-18T00:32:42.2301921Z execnet==2.1.1 2024-12-18T00:32:42.2302284Z expecttest==0.2.1 2024-12-18T00:32:42.2302655Z fbscribelogger==0.1.7 2024-12-18T00:32:42.2303017Z filelock==3.16.1 2024-12-18T00:32:42.2303373Z flatbuffers==2.0 2024-12-18T00:32:42.2303727Z frozenlist==1.5.0 2024-12-18T00:32:42.2304059Z fsspec==2024.9.0 2024-12-18T00:32:42.2304294Z future==1.0.0 2024-12-18T00:32:42.2304538Z ghstack==0.8.0 2024-12-18T00:32:42.2304789Z google-auth==2.36.0 2024-12-18T00:32:42.2305064Z google-auth-oauthlib==1.0.0 2024-12-18T00:32:42.2305343Z grpcio==1.68.1 2024-12-18T00:32:42.2305595Z huggingface-hub==0.26.5 2024-12-18T00:32:42.2305862Z hypothesis==5.35.1 2024-12-18T00:32:42.2306113Z idna==3.10 2024-12-18T00:32:42.2306337Z imageio==2.36.1 2024-12-18T00:32:42.2306570Z iniconfig==2.0.0 2024-12-18T00:32:42.2306843Z iopath==0.1.10 2024-12-18T00:32:42.2307084Z Jinja2==3.1.4 2024-12-18T00:32:42.2307318Z jmespath==1.0.1 2024-12-18T00:32:42.2307560Z joblib==1.4.2 2024-12-18T00:32:42.2307799Z junitparser==2.1.1 2024-12-18T00:32:42.2308035Z lark==0.12.0 2024-12-18T00:32:42.2308264Z lazy_loader==0.4 2024-12-18T00:32:42.2308513Z libcst==1.5.1 2024-12-18T00:32:42.2308742Z librosa==0.10.2.post1 2024-12-18T00:32:42.2308989Z lintrunner==0.12.5 2024-12-18T00:32:42.2309431Z llvmlite==0.38.1 2024-12-18T00:32:42.2309658Z lxml==5.3.0 2024-12-18T00:32:42.2309872Z Markdown==3.7 2024-12-18T00:32:42.2310100Z MarkupSafe==3.0.2 2024-12-18T00:32:42.2310330Z ml_dtypes==0.5.0 2024-12-18T00:32:42.2310569Z MonkeyType==23.3.0 2024-12-18T00:32:42.2310810Z mpmath==1.3.0 2024-12-18T00:32:42.2323191Z msgpack==1.1.0 2024-12-18T00:32:42.2323443Z multidict==6.1.0 2024-12-18T00:32:42.2323688Z multiprocess==0.70.16 2024-12-18T00:32:42.2323951Z mypy==1.13.0 2024-12-18T00:32:42.2324188Z mypy-extensions==1.0.0 2024-12-18T00:32:42.2324448Z networkx==2.8.8 2024-12-18T00:32:42.2324675Z ninja==1.10.2 2024-12-18T00:32:42.2324905Z numba==0.55.2 2024-12-18T00:32:42.2325129Z numpy==1.21.2 2024-12-18T00:32:42.2325385Z nvidia-cublas-cu12==12.4.5.8 2024-12-18T00:32:42.2325691Z nvidia-cuda-cupti-cu12==12.4.127 2024-12-18T00:32:42.2326000Z nvidia-cuda-nvrtc-cu12==12.4.127 2024-12-18T00:32:42.2326313Z nvidia-cuda-runtime-cu12==12.4.127 2024-12-18T00:32:42.2327048Z nvidia-cudnn-cu12==9.1.0.70 2024-12-18T00:32:42.2327437Z nvidia-cufft-cu12==11.2.1.3 2024-12-18T00:32:42.2327734Z nvidia-curand-cu12==10.3.5.147 2024-12-18T00:32:42.2328020Z nvidia-cusolver-cu12==11.6.1.9 2024-12-18T00:32:42.2328319Z nvidia-cusparse-cu12==12.3.1.170 2024-12-18T00:32:42.2328618Z nvidia-ml-py==12.560.30 2024-12-18T00:32:42.2328887Z nvidia-nccl-cu12==2.21.5 2024-12-18T00:32:42.2329168Z nvidia-nvjitlink-cu12==12.4.127 2024-12-18T00:32:42.2329449Z nvidia-nvtx-cu12==12.4.127 2024-12-18T00:32:42.2329721Z oauthlib==3.2.2 2024-12-18T00:32:42.2329962Z onnx==1.17.0 2024-12-18T00:32:42.2330198Z onnxscript==0.1.0.dev20240817 2024-12-18T00:32:42.2330473Z opencv-python==4.10.0.84 2024-12-18T00:32:42.2330737Z opt-einsum==3.3.0 2024-12-18T00:32:42.2330983Z optree==0.13.0 2024-12-18T00:32:42.2331218Z packaging==24.2 2024-12-18T00:32:42.2331456Z pandas==2.0.3 2024-12-18T00:32:42.2331855Z parameterized==0.8.1 2024-12-18T00:32:42.2332113Z patch==1.16 2024-12-18T00:32:42.2332333Z pillow==11.0.0 2024-12-18T00:32:42.2332566Z platformdirs==4.3.6 2024-12-18T00:32:42.2332812Z pluggy==1.5.0 2024-12-18T00:32:42.2333029Z ply==3.11 2024-12-18T00:32:42.2333239Z pooch==1.8.2 2024-12-18T00:32:42.2333465Z portalocker==3.0.0 2024-12-18T00:32:42.2333704Z propcache==0.2.1 2024-12-18T00:32:42.2333932Z protobuf==3.20.2 2024-12-18T00:32:42.2334168Z psutil==6.1.0 2024-12-18T00:32:42.2334395Z PuLP==2.9.0 2024-12-18T00:32:42.2334611Z pwlf==2.2.1 2024-12-18T00:32:42.2334841Z py-cpuinfo==9.0.0 2024-12-18T00:32:42.2335076Z pyarrow==18.1.0 2024-12-18T00:32:42.2335308Z pyasn1==0.6.1 2024-12-18T00:32:42.2335544Z pyasn1_modules==0.4.1 2024-12-18T00:32:42.2335805Z pycparser==2.22 2024-12-18T00:32:42.2336044Z pyDOE==0.3.8 2024-12-18T00:32:42.2336265Z PyGithub==2.3.0 2024-12-18T00:32:42.2336506Z Pygments==2.15.0 2024-12-18T00:32:42.2336747Z PyJWT==2.10.1 2024-12-18T00:32:42.2336975Z PyNaCl==1.5.0 2024-12-18T00:32:42.2337194Z pynvml==12.0.0 2024-12-18T00:32:42.2337432Z pytest==8.3.4 2024-12-18T00:32:42.2337673Z pytest-benchmark==5.1.0 2024-12-18T00:32:42.2337947Z pytest-cpp==2.3.0 2024-12-18T00:32:42.2338212Z pytest-flakefinder==1.1.0 2024-12-18T00:32:42.2338497Z pytest-rerunfailures==14.0 2024-12-18T00:32:42.2338786Z pytest-subtests==0.13.1 2024-12-18T00:32:42.2339053Z pytest-xdist==3.3.1 2024-12-18T00:32:42.2339317Z python-dateutil==2.9.0.post0 2024-12-18T00:32:42.2339587Z pytz==2024.2 2024-12-18T00:32:42.2339805Z PyWavelets==1.4.1 2024-12-18T00:32:42.2340027Z PyYAML==6.0.2 2024-12-18T00:32:42.2340236Z redis==5.2.1 2024-12-18T00:32:42.2340443Z regex==2024.11.6 2024-12-18T00:32:42.2340660Z requests==2.32.3 2024-12-18T00:32:42.2340998Z requests-oauthlib==2.0.0 2024-12-18T00:32:42.2341244Z rsa==4.9 2024-12-18T00:32:42.2341449Z s3transfer==0.10.4 2024-12-18T00:32:42.2341691Z safetensors==0.4.5 2024-12-18T00:32:42.2341971Z scikit-image==0.22.0 2024-12-18T00:32:42.2342221Z scikit-learn==1.6.0 2024-12-18T00:32:42.2342451Z scipy==1.10.1 2024-12-18T00:32:42.2342686Z sentencepiece==0.2.0 2024-12-18T00:32:42.2342931Z six==1.17.0 2024-12-18T00:32:42.2343161Z sortedcontainers==2.4.0 2024-12-18T00:32:42.2343567Z soundfile==0.12.1 2024-12-18T00:32:42.2343806Z soupsieve==2.6 2024-12-18T00:32:42.2344038Z soxr==0.5.0.post1 2024-12-18T00:32:42.2344269Z submitit==1.5.2 2024-12-18T00:32:42.2344504Z sympy==1.13.1 2024-12-18T00:32:42.2344730Z tabulate==0.9.0 2024-12-18T00:32:42.2344961Z tb-nightly==2.13.0a20230426 2024-12-18T00:32:42.2345236Z tensorboard==2.13.0 2024-12-18T00:32:42.2345501Z tensorboard-data-server==0.7.2 2024-12-18T00:32:42.2345796Z threadpoolctl==3.5.0 2024-12-18T00:32:42.2346037Z thriftpy2==0.5.2 2024-12-18T00:32:42.2346273Z tifffile==2024.9.20 2024-12-18T00:32:42.2346820Z timm @ git+https://github.com/huggingface/pytorch-image-models.git@730b907b4d45a4713cbc425cbf224c46089fd514 2024-12-18T00:32:42.2347408Z tlparse==0.3.25 2024-12-18T00:32:42.2347645Z tokenizers==0.15.2 2024-12-18T00:32:42.2347873Z tomli==2.2.1 2024-12-18T00:32:42.2348672Z torch @ file:///var/lib/jenkins/workspace/dist/torch-2.6.0a0%2Bgit0cdf8b1-cp310-cp310-linux_x86_64.whl#sha256=dcadd2cd6f8025bfa9997113da51bf28d112b9db4fb82c725ed7dd046c33c456 2024-12-18T00:32:42.2349765Z torchaudio @ git+https://github.com/pytorch/audio.git@332760d4b300f00a0d862e3cfe1495db3b1a14f9 2024-12-18T00:32:42.2350509Z torchvision @ git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2024-12-18T00:32:42.2351031Z tqdm==4.67.1 2024-12-18T00:32:42.2351263Z transformers==4.38.1 2024-12-18T00:32:42.2351847Z -e git+https://github.com/triton-lang/triton@35c6c7c6284582b3f41c71c150e11b517acf074a#egg=triton&subdirectory=python 2024-12-18T00:32:42.2352494Z typing_extensions==4.12.2 2024-12-18T00:32:42.2352762Z tzdata==2024.2 2024-12-18T00:32:42.2353016Z unittest-xml-reporting==3.2.0 2024-12-18T00:32:42.2353302Z urllib3==2.2.3 2024-12-18T00:32:42.2353524Z Werkzeug==3.1.3 2024-12-18T00:32:42.2353755Z wrapt==1.17.0 2024-12-18T00:32:42.2353978Z xdoctest==1.1.0 2024-12-18T00:32:42.2354300Z xxhash==3.5.0 2024-12-18T00:32:42.2354526Z yarl==1.18.3 2024-12-18T00:32:42.2354741Z z3-solver==4.12.2.0 2024-12-18T00:32:42.2606538Z + popd 2024-12-18T00:32:42.2606864Z ~/workspace 2024-12-18T00:32:42.2610720Z ++ pwd 2024-12-18T00:32:42.2613532Z + PYTHONPATH=/var/lib/jenkins/workspace/torchbench 2024-12-18T00:32:42.2614039Z + test_inductor_cpp_wrapper 2024-12-18T00:32:42.2614450Z + export TORCHINDUCTOR_CPP_WRAPPER=1 2024-12-18T00:32:42.2614801Z + TORCHINDUCTOR_CPP_WRAPPER=1 2024-12-18T00:32:42.2618161Z ++ pwd 2024-12-18T00:32:42.2621056Z + TEST_REPORTS_DIR=/var/lib/jenkins/workspace/test/test-reports 2024-12-18T00:32:42.2621694Z + mkdir -p /var/lib/jenkins/workspace/test/test-reports 2024-12-18T00:32:42.2687378Z + python test/run_test.py --include inductor/test_torchinductor.py --verbose 2024-12-18T00:32:42.3712187Z /var/lib/jenkins/workspace/test/run_test.py:22: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html 2024-12-18T00:32:42.3713038Z import pkg_resources 2024-12-18T00:32:45.6527528Z No TD results found 2024-12-18T00:32:45.6528538Z Downloading https://ossci-metrics.s3.amazonaws.com/disabled-tests-condensed.json?versionId=PhiMB7EP3187qvpKvnORewoK3InOIvX5 to /var/lib/jenkins/workspace/test/.pytorch-disabled-tests.json 2024-12-18T00:32:45.7045103Z Ignoring disabled issues: [''] 2024-12-18T00:32:45.7230391Z ##[warning] Gathered no stats from artifacts for linux-focal-cuda12.4-py3.10-gcc9-sm86 build env and inductor_cpp_wrapper test config. Using default build env and inductor_cpp_wrapper test config instead. 2024-12-18T00:32:45.7835922Z ##[warning] Gathered no stats from artifacts for linux-focal-cuda12.4-py3.10-gcc9-sm86 build env and inductor_cpp_wrapper test config. Using default build env and inductor_cpp_wrapper test config instead. 2024-12-18T00:32:45.7860472Z Running all tests 2024-12-18T00:32:45.7867271Z Running parallel tests on 3 processes 2024-12-18T00:32:45.7869473Z Name: tests to run (est. time: 89.26min) 2024-12-18T00:32:45.7870040Z Serial tests (0): 2024-12-18T00:32:45.7870441Z Parallel tests (27): 2024-12-18T00:32:45.7870875Z inductor/test_torchinductor 1/27 2024-12-18T00:32:45.7871692Z inductor/test_torchinductor 2/27 2024-12-18T00:32:45.7872125Z inductor/test_torchinductor 3/27 2024-12-18T00:32:45.7872551Z inductor/test_torchinductor 4/27 2024-12-18T00:32:45.7872992Z inductor/test_torchinductor 5/27 2024-12-18T00:32:45.7873409Z inductor/test_torchinductor 6/27 2024-12-18T00:32:45.7873850Z inductor/test_torchinductor 7/27 2024-12-18T00:32:45.7874304Z inductor/test_torchinductor 8/27 2024-12-18T00:32:45.7874740Z inductor/test_torchinductor 9/27 2024-12-18T00:32:45.7875193Z inductor/test_torchinductor 10/27 2024-12-18T00:32:45.7875635Z inductor/test_torchinductor 11/27 2024-12-18T00:32:45.7876084Z inductor/test_torchinductor 12/27 2024-12-18T00:32:45.7876533Z inductor/test_torchinductor 13/27 2024-12-18T00:32:45.7876977Z inductor/test_torchinductor 14/27 2024-12-18T00:32:45.7877438Z inductor/test_torchinductor 15/27 2024-12-18T00:32:45.7877886Z inductor/test_torchinductor 16/27 2024-12-18T00:32:45.7878374Z inductor/test_torchinductor 17/27 2024-12-18T00:32:45.7878857Z inductor/test_torchinductor 18/27 2024-12-18T00:32:45.7879336Z inductor/test_torchinductor 19/27 2024-12-18T00:32:45.7879825Z inductor/test_torchinductor 20/27 2024-12-18T00:32:45.7880302Z inductor/test_torchinductor 21/27 2024-12-18T00:32:45.7880808Z inductor/test_torchinductor 22/27 2024-12-18T00:32:45.7881273Z inductor/test_torchinductor 23/27 2024-12-18T00:32:45.7881729Z inductor/test_torchinductor 24/27 2024-12-18T00:32:45.7882177Z inductor/test_torchinductor 25/27 2024-12-18T00:32:45.7882638Z inductor/test_torchinductor 26/27 2024-12-18T00:32:45.7883123Z inductor/test_torchinductor 27/27 2024-12-18T00:32:45.7883584Z Name: excluded (est. time: 0.0min) 2024-12-18T00:32:45.7884025Z Serial tests (0): 2024-12-18T00:32:45.7884460Z Parallel tests (0): 2024-12-18T00:32:45.7937687Z Running inductor/test_torchinductor 1/27 ... [2024-12-18 00:32:45.793345] 2024-12-18T00:32:45.7938378Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:32:45.7941863Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'serial', '--shard-id=1', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:32:45.793767] 2024-12-18T00:33:08.4007644Z 2024-12-18T00:33:08.4014247Z inductor/test_torchinductor 1/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_1.27_4e921d29a72d5b8f_.log 2024-12-18T00:33:08.4015170Z Running 0 items in this shard: 2024-12-18T00:33:08.4015366Z 2024-12-18T00:33:08.4015587Z Running inductor/test_torchinductor 2/27 ... [2024-12-18 00:33:08.400388] 2024-12-18T00:33:08.4016026Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:33:08.4017099Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'serial', '--shard-id=2', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:33:08.400856] 2024-12-18T00:33:17.3828928Z 2024-12-18T00:33:17.3830160Z inductor/test_torchinductor 2/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_2.27_da0ab98e80fd10db_.log 2024-12-18T00:33:17.3831328Z Running 0 items in this shard: 2024-12-18T00:33:17.3831616Z 2024-12-18T00:33:17.3831970Z Running inductor/test_torchinductor 3/27 ... [2024-12-18 00:33:17.382564] 2024-12-18T00:33:17.3832841Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:33:17.3834735Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'serial', '--shard-id=3', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:33:17.383073] 2024-12-18T00:33:51.8599316Z 2024-12-18T00:33:51.8602877Z inductor/test_torchinductor 3/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_3.27_69aab753b71d2841_.log 2024-12-18T00:33:51.8604581Z Running 1 items in this shard: test/inductor/test_torchinductor.py::CpuTests::test_large_block_sizes_cpu 2024-12-18T00:33:51.8605095Z 2024-12-18T00:33:51.8605345Z Running inductor/test_torchinductor 4/27 ... [2024-12-18 00:33:51.859677] 2024-12-18T00:33:51.8605787Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:33:51.8606857Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'serial', '--shard-id=4', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:33:51.860079] 2024-12-18T00:34:00.7909733Z 2024-12-18T00:34:00.7910941Z inductor/test_torchinductor 4/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_4.27_75a9bb941572de21_.log 2024-12-18T00:34:00.7911851Z Running 0 items in this shard: 2024-12-18T00:34:00.7912103Z 2024-12-18T00:34:00.7912711Z Running inductor/test_torchinductor 5/27 ... [2024-12-18 00:34:00.790780] 2024-12-18T00:34:00.7913261Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:34:00.7915038Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'serial', '--shard-id=5', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:34:00.791183] 2024-12-18T00:34:09.7231343Z 2024-12-18T00:34:09.7238480Z inductor/test_torchinductor 5/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_5.27_5e925007f200de52_.log 2024-12-18T00:34:09.7239901Z Running 0 items in this shard: 2024-12-18T00:34:09.7240118Z 2024-12-18T00:34:09.7240336Z Running inductor/test_torchinductor 6/27 ... [2024-12-18 00:34:09.722923] 2024-12-18T00:34:09.7240783Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:34:09.7241850Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'serial', '--shard-id=6', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:34:09.723362] 2024-12-18T00:34:18.6548975Z 2024-12-18T00:34:18.6550075Z inductor/test_torchinductor 6/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_6.27_5f43058b61c1d8ed_.log 2024-12-18T00:34:18.6550890Z Running 0 items in this shard: 2024-12-18T00:34:18.6551076Z 2024-12-18T00:34:18.6551308Z Running inductor/test_torchinductor 7/27 ... [2024-12-18 00:34:18.654672] 2024-12-18T00:34:18.6551747Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:34:18.6554328Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'serial', '--shard-id=7', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:34:18.655043] 2024-12-18T00:34:27.5864197Z 2024-12-18T00:34:27.5865778Z inductor/test_torchinductor 7/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_7.27_7ed4a1232802bf0a_.log 2024-12-18T00:34:27.5867215Z Running 0 items in this shard: 2024-12-18T00:34:27.5867584Z 2024-12-18T00:34:27.5868006Z Running inductor/test_torchinductor 8/27 ... [2024-12-18 00:34:27.586038] 2024-12-18T00:34:27.5868628Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:34:27.5869840Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'serial', '--shard-id=8', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:34:27.586501] 2024-12-18T00:34:36.5183388Z 2024-12-18T00:34:36.5184373Z inductor/test_torchinductor 8/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_8.27_97ca1a3aab00c279_.log 2024-12-18T00:34:36.5185206Z Running 0 items in this shard: 2024-12-18T00:34:36.5185392Z 2024-12-18T00:34:36.5185634Z Running inductor/test_torchinductor 9/27 ... [2024-12-18 00:34:36.518039] 2024-12-18T00:34:36.5186075Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:34:36.5187365Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'serial', '--shard-id=9', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:34:36.518421] 2024-12-18T00:34:45.4004843Z 2024-12-18T00:34:45.4005932Z inductor/test_torchinductor 9/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_9.27_b0ceedd9f13b8814_.log 2024-12-18T00:34:45.4006821Z Running 0 items in this shard: 2024-12-18T00:34:45.4007065Z 2024-12-18T00:34:45.4007338Z Running inductor/test_torchinductor 10/27 ... [2024-12-18 00:34:45.400286] 2024-12-18T00:34:45.4007785Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:34:45.4009711Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'serial', '--shard-id=10', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:34:45.400645] 2024-12-18T00:34:54.2824397Z 2024-12-18T00:34:54.2825591Z inductor/test_torchinductor 10/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_10.27_f668a87e4f8ca0bf_.log 2024-12-18T00:34:54.2826594Z Running 0 items in this shard: 2024-12-18T00:34:54.2827227Z 2024-12-18T00:34:54.2827458Z Running inductor/test_torchinductor 11/27 ... [2024-12-18 00:34:54.281678] 2024-12-18T00:34:54.2827917Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:34:54.2828974Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'serial', '--shard-id=11', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:34:54.282035] 2024-12-18T00:35:03.2637653Z 2024-12-18T00:35:03.2638996Z inductor/test_torchinductor 11/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_11.27_91091f1a0806cdca_.log 2024-12-18T00:35:03.2639819Z Running 0 items in this shard: 2024-12-18T00:35:03.2640021Z 2024-12-18T00:35:03.2640246Z Running inductor/test_torchinductor 12/27 ... [2024-12-18 00:35:03.263498] 2024-12-18T00:35:03.2640849Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:35:03.2642230Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'serial', '--shard-id=12', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:35:03.263877] 2024-12-18T00:35:12.3956561Z 2024-12-18T00:35:12.3957513Z inductor/test_torchinductor 12/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_12.27_e227860cb442666c_.log 2024-12-18T00:35:12.3958628Z Running 1 items in this shard: test/inductor/test_torchinductor.py::GPUTests::test_large_block_sizes_cuda 2024-12-18T00:35:12.3959091Z 2024-12-18T00:35:12.3959326Z Running inductor/test_torchinductor 13/27 ... [2024-12-18 00:35:12.395060] 2024-12-18T00:35:12.3959775Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:35:12.3960883Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'serial', '--shard-id=13', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:35:12.395408] 2024-12-18T00:35:21.3268803Z 2024-12-18T00:35:21.3270113Z inductor/test_torchinductor 13/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_13.27_edfd1565e6373c01_.log 2024-12-18T00:35:21.3271016Z Running 0 items in this shard: 2024-12-18T00:35:21.3271214Z 2024-12-18T00:35:21.3271441Z Running inductor/test_torchinductor 14/27 ... [2024-12-18 00:35:21.326634] 2024-12-18T00:35:21.3271893Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:35:21.3273896Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'serial', '--shard-id=14', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:35:21.326983] 2024-12-18T00:35:30.2076314Z 2024-12-18T00:35:30.2077432Z inductor/test_torchinductor 14/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_14.27_ac70490beb4c8e61_.log 2024-12-18T00:35:30.2078343Z Running 0 items in this shard: 2024-12-18T00:35:30.2078627Z 2024-12-18T00:35:30.2078867Z Running inductor/test_torchinductor 15/27 ... [2024-12-18 00:35:30.207328] 2024-12-18T00:35:30.2079323Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:35:30.2080427Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'serial', '--shard-id=15', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:35:30.207678] 2024-12-18T00:35:39.1394166Z 2024-12-18T00:35:39.1395763Z inductor/test_torchinductor 15/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_15.27_19cde6a387376fb6_.log 2024-12-18T00:35:39.1397225Z Running 0 items in this shard: 2024-12-18T00:35:39.1397512Z 2024-12-18T00:35:39.1397811Z Running inductor/test_torchinductor 16/27 ... [2024-12-18 00:35:39.139153] 2024-12-18T00:35:39.1398276Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:35:39.1399332Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'serial', '--shard-id=16', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:35:39.139498] 2024-12-18T00:35:48.0207992Z 2024-12-18T00:35:48.0209058Z inductor/test_torchinductor 16/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_16.27_4e6c8ef383442a4a_.log 2024-12-18T00:35:48.0210046Z Running 0 items in this shard: 2024-12-18T00:35:48.0210305Z 2024-12-18T00:35:48.0210525Z Running inductor/test_torchinductor 17/27 ... [2024-12-18 00:35:48.020320] 2024-12-18T00:35:48.0210980Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:35:48.0212319Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'serial', '--shard-id=17', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:35:48.020700] 2024-12-18T00:35:56.9636308Z 2024-12-18T00:35:56.9637417Z inductor/test_torchinductor 17/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_17.27_ec4a02ac43c89178_.log 2024-12-18T00:35:56.9638311Z Running 0 items in this shard: 2024-12-18T00:35:56.9638499Z 2024-12-18T00:35:56.9638785Z Running inductor/test_torchinductor 18/27 ... [2024-12-18 00:35:56.963414] 2024-12-18T00:35:56.9639244Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:35:56.9640851Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'serial', '--shard-id=18', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:35:56.963770] 2024-12-18T00:36:05.8457146Z 2024-12-18T00:36:05.8458325Z inductor/test_torchinductor 18/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_18.27_cac4bdf2cd740a31_.log 2024-12-18T00:36:05.8459294Z Running 0 items in this shard: 2024-12-18T00:36:05.8459548Z 2024-12-18T00:36:05.8459773Z Running inductor/test_torchinductor 19/27 ... [2024-12-18 00:36:05.845327] 2024-12-18T00:36:05.8460219Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:36:05.8461370Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'serial', '--shard-id=19', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:36:05.845672] 2024-12-18T00:36:14.7771804Z 2024-12-18T00:36:14.7773251Z inductor/test_torchinductor 19/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_19.27_93f8c6120c3caf73_.log 2024-12-18T00:36:14.7774359Z Running 0 items in this shard: 2024-12-18T00:36:14.7774620Z 2024-12-18T00:36:14.7774924Z Running inductor/test_torchinductor 20/27 ... [2024-12-18 00:36:14.776868] 2024-12-18T00:36:14.7775401Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:36:14.7776913Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'serial', '--shard-id=20', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:36:14.777262] 2024-12-18T00:36:23.7594515Z 2024-12-18T00:36:23.7595940Z inductor/test_torchinductor 20/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_20.27_a10812efd389a2e5_.log 2024-12-18T00:36:23.7597348Z Running 0 items in this shard: 2024-12-18T00:36:23.7597567Z 2024-12-18T00:36:23.7597875Z Running inductor/test_torchinductor 21/27 ... [2024-12-18 00:36:23.758951] 2024-12-18T00:36:23.7598342Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:36:23.7599566Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'serial', '--shard-id=21', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:36:23.759323] 2024-12-18T00:36:32.6915869Z 2024-12-18T00:36:32.6917240Z inductor/test_torchinductor 21/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_21.27_75c11f316f2192a8_.log 2024-12-18T00:36:32.6918073Z Running 0 items in this shard: 2024-12-18T00:36:32.6918279Z 2024-12-18T00:36:32.6918501Z Running inductor/test_torchinductor 22/27 ... [2024-12-18 00:36:32.691012] 2024-12-18T00:36:32.6918973Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:36:32.6920044Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'serial', '--shard-id=22', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:36:32.691430] 2024-12-18T00:36:41.6233940Z 2024-12-18T00:36:41.6235265Z inductor/test_torchinductor 22/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_22.27_988123d5aa3190ec_.log 2024-12-18T00:36:41.6236188Z Running 0 items in this shard: 2024-12-18T00:36:41.6236380Z 2024-12-18T00:36:41.6236609Z Running inductor/test_torchinductor 23/27 ... [2024-12-18 00:36:41.622777] 2024-12-18T00:36:41.6237129Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:36:41.6238300Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'serial', '--shard-id=23', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:36:41.623214] 2024-12-18T00:36:50.5549212Z 2024-12-18T00:36:50.5550963Z inductor/test_torchinductor 23/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_23.27_8525c93d8abd4672_.log 2024-12-18T00:36:50.5551962Z Running 0 items in this shard: 2024-12-18T00:36:50.5552154Z 2024-12-18T00:36:50.5552381Z Running inductor/test_torchinductor 24/27 ... [2024-12-18 00:36:50.554318] 2024-12-18T00:36:50.5552828Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:36:50.5553888Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'serial', '--shard-id=24', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:36:50.554749] 2024-12-18T00:36:59.5610896Z 2024-12-18T00:36:59.5611864Z inductor/test_torchinductor 24/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_24.27_c3f1f6abac365865_.log 2024-12-18T00:36:59.5612699Z Running 0 items in this shard: 2024-12-18T00:36:59.5612894Z 2024-12-18T00:36:59.5613117Z Running inductor/test_torchinductor 25/27 ... [2024-12-18 00:36:59.560653] 2024-12-18T00:36:59.5613710Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:36:59.5614877Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'serial', '--shard-id=25', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:36:59.561107] 2024-12-18T00:37:08.4426215Z 2024-12-18T00:37:08.4427533Z inductor/test_torchinductor 25/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_25.27_209c0cf65c30dec9_.log 2024-12-18T00:37:08.4428775Z Running 0 items in this shard: 2024-12-18T00:37:08.4428983Z 2024-12-18T00:37:08.4429210Z Running inductor/test_torchinductor 26/27 ... [2024-12-18 00:37:08.442436] 2024-12-18T00:37:08.4429670Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:37:08.4433426Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'serial', '--shard-id=26', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:37:08.442918] 2024-12-18T00:37:17.3749756Z 2024-12-18T00:37:17.3750740Z inductor/test_torchinductor 26/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_26.27_aa8ad20b2b1d9b2e_.log 2024-12-18T00:37:17.3751621Z Running 0 items in this shard: 2024-12-18T00:37:17.3751811Z 2024-12-18T00:37:17.3752046Z Running inductor/test_torchinductor 27/27 ... [2024-12-18 00:37:17.374822] 2024-12-18T00:37:17.3752514Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:37:17.3756444Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'serial', '--shard-id=27', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:37:17.375283] 2024-12-18T00:37:26.3074971Z 2024-12-18T00:37:26.3076453Z inductor/test_torchinductor 27/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_27.27_028acddb4ed8415d_.log 2024-12-18T00:37:26.3077270Z Running 0 items in this shard: 2024-12-18T00:37:26.3077457Z 2024-12-18T00:37:26.3117832Z Running inductor/test_torchinductor 1/27 ... [2024-12-18 00:37:26.311333] 2024-12-18T00:37:26.3118368Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:37:26.3118776Z Running inductor/test_torchinductor 2/27 ... [2024-12-18 00:37:26.311505] 2024-12-18T00:37:26.3119338Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:37:26.3119919Z Running inductor/test_torchinductor 3/27 ... [2024-12-18 00:37:26.311675] 2024-12-18T00:37:26.3120365Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:37:26.3124560Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'not serial', '--shard-id=1', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:37:26.312044] 2024-12-18T00:37:26.3127143Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'not serial', '--shard-id=2', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:37:26.312087] 2024-12-18T00:37:26.3129518Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'not serial', '--shard-id=3', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:37:26.312182] 2024-12-18T00:45:29.9308162Z 2024-12-18T00:45:29.9309800Z inductor/test_torchinductor 1/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_1.27_ca6ac93c23331536_.log 2024-12-18T00:45:29.9331066Z Running 60 items in this shard: test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_broadcast1_strided, test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_broadcast2_double, test/inductor/test_torchinductor.py::CpuTests::test_AllenaiLongformerBase_repro_cpu, test/inductor/test_torchinductor.py::CpuTests::test_avg_pool2d7_cpu, test/inductor/test_torchinductor.py::CpuTests::test_constant_pad_float64_cpu, test/inductor/test_torchinductor.py::CpuTests::test_conv_inference_heuristics_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_float32_int64_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_float64_int32_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_int64_int8_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_uint8_int64_cpu, test/inductor/test_torchinductor.py::CpuTests::test_fractional_max_pool2d3_cpu, test/inductor/test_torchinductor.py::CpuTests::test_index_put_as_masked_fill_cpu, test/inductor/test_torchinductor.py::CpuTests::test_large_broadcast_reduction_cpu, test/inductor/test_torchinductor.py::CpuTests::test_large_tensor_reduction_cpu, test/inductor/test_torchinductor.py::CpuTests::test_max_pool2d3_cpu, test/inductor/test_torchinductor.py::CpuTests::test_mutable_custom_op_fixed_layout2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_log1p_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_polygamma_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_scaled_modified_bessel_k1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_sin_cpu, test/inductor/test_torchinductor.py::CpuTests::test_transpose_cpu, test/inductor/test_torchinductor.py::CpuTests::test_upsample_cat_conv_cpu, test/inductor/test_torchinductor.py::CpuTests::test_vectorized_ops_masked_cpu, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_broadcast1_double, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_dense_broadcast3, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_transposed_broadcast1, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_transposed_int, test/inductor/test_torchinductor.py::GPUTests::test_adding_tensor_offsets_cuda, test/inductor/test_torchinductor.py::GPUTests::test_alexnet_prefix_cuda, test/inductor/test_torchinductor.py::GPUTests::test_any_cuda, test/inductor/test_torchinductor.py::GPUTests::test_aoti_eager_support_out_cuda, test/inductor/test_torchinductor.py::GPUTests::test_avg_pool3d_backward3_cuda, test/inductor/test_torchinductor.py::GPUTests::test_bmm2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_constant_pad_float64_cuda, test/inductor/test_torchinductor.py::GPUTests::test_custom_scan_op_multi_input_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_bfloat16_float64_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_bfloat16_int8_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_float16_float64_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_int32_int32_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_int8_float64_cuda, test/inductor/test_torchinductor.py::GPUTests::test_embedding_bag_byte_unpack_cuda, test/inductor/test_torchinductor.py::GPUTests::test_forced_buffer_realize_cuda, test/inductor/test_torchinductor.py::GPUTests::test_full_like_cuda, test/inductor/test_torchinductor.py::GPUTests::test_fuse_large_params_cuda, test/inductor/test_torchinductor.py::GPUTests::test_log_softmax_cuda, test/inductor/test_torchinductor.py::GPUTests::test_max_min_cuda, test/inductor/test_torchinductor.py::GPUTests::test_multi_device_cuda, test/inductor/test_torchinductor.py::GPUTests::test_new_ones_cuda, test/inductor/test_torchinductor.py::GPUTests::test_no_mega_fusion_during_lowering_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_hermite_polynomial_he_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_ndtri_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_scaled_modified_bessel_k0_cuda, test/inductor/test_torchinductor.py::GPUTests::test_reinterpret_dtypeview_cuda, test/inductor/test_torchinductor.py::GPUTests::test_roll_cuda, test/inductor/test_torchinductor.py::GPUTests::test_rsqrt_cuda, test/inductor/test_torchinductor.py::GPUTests::test_scalar_input_cuda, test/inductor/test_torchinductor.py::GPUTests::test_scaled_dot_product_efficient_attention_cuda, test/inductor/test_torchinductor.py::GPUTests::test_sdpa_unaligned_mask_freezing_cuda, test/inductor/test_torchinductor.py::GPUTests::test_sort_stable_cuda, test/inductor/test_torchinductor.py::GPUTests::test_sqrt_dynamic_shapes_cuda 2024-12-18T00:45:29.9350738Z 2024-12-18T00:45:34.2995261Z Running inductor/test_torchinductor 4/27 ... [2024-12-18 00:45:34.298796] 2024-12-18T00:45:34.2995869Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:45:34.2997056Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'not serial', '--shard-id=4', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:45:34.299210] 2024-12-18T00:45:51.6313399Z 2024-12-18T00:45:51.6314921Z inductor/test_torchinductor 2/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_2.27_d8aeb8f8f6ff57e7_.log 2024-12-18T00:45:51.6337884Z Running 53 items in this shard: test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_double_int, test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_strided_transposed, test/inductor/test_torchinductor.py::CpuTests::test_argmax_argmin_with_nan_cpu, test/inductor/test_torchinductor.py::CpuTests::test_builtins_round_float_ndigits_pos_cpu, test/inductor/test_torchinductor.py::CpuTests::test_clone_cpu, test/inductor/test_torchinductor.py::CpuTests::test_cos_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_bfloat16_uint8_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_int16_float16_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_int32_float16_cpu, test/inductor/test_torchinductor.py::CpuTests::test_exact_stride_cpu, test/inductor/test_torchinductor.py::CpuTests::test_expand_as_cpu, test/inductor/test_torchinductor.py::CpuTests::test_fill1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_flip_cpu, test/inductor/test_torchinductor.py::CpuTests::test_full_boolean_cpu, test/inductor/test_torchinductor.py::CpuTests::test_horizonal_fusion2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_logsumexp_cpu, test/inductor/test_torchinductor.py::CpuTests::test_max_pool2d_with_indices_backward3_cpu, test/inductor/test_torchinductor.py::CpuTests::test_mul_softmax_symfloat_cpu, test/inductor/test_torchinductor.py::CpuTests::test_multi_device_cpu, test/inductor/test_torchinductor.py::CpuTests::test_nan_to_num_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pad_view_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_bessel_y0_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_erfcx_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_hermite_polynomial_h_cpu, test/inductor/test_torchinductor.py::CpuTests::test_sgn_extremal_cpu, test/inductor/test_torchinductor.py::CpuTests::test_signbit_cpu, test/inductor/test_torchinductor.py::CpuTests::test_views3_cpu, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_broadcast1_transposed, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_broadcast3_strided, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_double_broadcast2, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_double_broadcast3, test/inductor/test_torchinductor.py::GPUTests::test_add_const_int_cuda, test/inductor/test_torchinductor.py::GPUTests::test_argmax_argmin2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_cat_of_loops_and_extern_kernel_cuda, test/inductor/test_torchinductor.py::GPUTests::test_custom_scan_op_compiled_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_int16_int16_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_int8_int64_cuda, test/inductor/test_torchinductor.py::GPUTests::test_gather2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_gelu_cuda, test/inductor/test_torchinductor.py::GPUTests::test_glu_cuda, test/inductor/test_torchinductor.py::GPUTests::test_leaky_relu_cuda, test/inductor/test_torchinductor.py::GPUTests::test_masked_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_psi_cuda, test/inductor/test_torchinductor.py::GPUTests::test_randint_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_copy_cuda, test/inductor/test_torchinductor.py::GPUTests::test_scatter3_cuda, test/inductor/test_torchinductor.py::GPUTests::test_scatter5_cuda, test/inductor/test_torchinductor.py::GPUTests::test_split_with_integer_cuda, test/inductor/test_torchinductor.py::GPUTests::test_to_memory_format_cuda, test/inductor/test_torchinductor.py::GPUTests::test_upsample_bilinear2d_a_cuda, test/inductor/test_torchinductor.py::GPUTests::test_vdd_clamp_cuda, test/inductor/test_torchinductor.py::GPUTests::test_views7_cuda, test/inductor/test_torchinductor.py::TritonCodeGenTests::test_indirect_device_assert 2024-12-18T00:45:51.6358500Z 2024-12-18T00:45:55.9254260Z Running inductor/test_torchinductor 5/27 ... [2024-12-18 00:45:55.924911] 2024-12-18T00:45:55.9254868Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:45:55.9257688Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'not serial', '--shard-id=5', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:45:55.925368] 2024-12-18T00:47:12.2613292Z 2024-12-18T00:47:12.2614696Z inductor/test_torchinductor 3/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_3.27_72cdd3d01872358f_.log 2024-12-18T00:47:12.2634846Z Running 62 items in this shard: test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_broadcast1_broadcast3, test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_double_broadcast1, test/inductor/test_torchinductor.py::CpuTests::test__unsafe_masked_index_cpu, test/inductor/test_torchinductor.py::CpuTests::test_aliased_buffer_reuse_cpu, test/inductor/test_torchinductor.py::CpuTests::test_any_cpu, test/inductor/test_torchinductor.py::CpuTests::test_argmax_argmin2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_cat_single_empty_cpu, test/inductor/test_torchinductor.py::CpuTests::test_consecutive_split_cumsum_cpu, test/inductor/test_torchinductor.py::CpuTests::test_custom_scan_op_compiled_cpu, test/inductor/test_torchinductor.py::CpuTests::test_custom_scan_op_multi_input_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_bfloat16_int32_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_float16_int32_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_float16_uint8_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_float32_float16_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_float32_int8_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_float64_float64_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_float64_int8_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_int64_float16_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_int64_float64_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_int8_int64_cpu, test/inductor/test_torchinductor.py::CpuTests::test_float_index_expression_type_promotion_cpu, test/inductor/test_torchinductor.py::CpuTests::test_gather1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_long_tensor_cpu, test/inductor/test_torchinductor.py::CpuTests::test_min_max_reduction_cpu, test/inductor/test_torchinductor.py::CpuTests::test_permute1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_i0_cpu, test/inductor/test_torchinductor.py::CpuTests::test_scalar_input_cpu, test/inductor/test_torchinductor.py::CpuTests::test_scatter_add3_cpu, test/inductor/test_torchinductor.py::CpuTests::test_slice_mutation3_cpu, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_broadcast2_dense, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_dense_dense, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_strided_double, test/inductor/test_torchinductor.py::GPUTests::test_adaptive_avg_pool1d_argmax_cuda, test/inductor/test_torchinductor.py::GPUTests::test_avg_pool3d_backward4_cuda, test/inductor/test_torchinductor.py::GPUTests::test_bitwise2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_cat_empty_index_cuda, test/inductor/test_torchinductor.py::GPUTests::test_conv_with_as_strided_cuda, test/inductor/test_torchinductor.py::GPUTests::test_convolution1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_float16_int16_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_float32_int16_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_int64_int8_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_int64_uint8_cuda, test/inductor/test_torchinductor.py::GPUTests::test_index_put_fallback1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_max_pool2d_with_indices_backward3_cuda, test/inductor/test_torchinductor.py::GPUTests::test_mixed_mm3_cuda, test/inductor/test_torchinductor.py::GPUTests::test_mul_index_expr_cuda, test/inductor/test_torchinductor.py::GPUTests::test_multilayer_var_lowp_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pattern_matcher_multi_user_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_erf_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_logit_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_xlog1py_cuda, test/inductor/test_torchinductor.py::GPUTests::test_reduction1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_softmax_backward_data_cuda, test/inductor/test_torchinductor.py::GPUTests::test_softmax_one_kernel_persist_cuda, test/inductor/test_torchinductor.py::GPUTests::test_tan_cuda, test/inductor/test_torchinductor.py::GPUTests::test_tmp_not_defined_issue3_cuda, test/inductor/test_torchinductor.py::GPUTests::test_unspec_inputs_float32_cuda, test/inductor/test_torchinductor.py::GPUTests::test_unspec_inputs_float64_cuda, test/inductor/test_torchinductor.py::GPUTests::test_view_on_aliased_cuda, test/inductor/test_torchinductor.py::TritonCodeGenTests::test_has_constant_mask_block_multiple_True_ynumel_exceed_ygrid_size_True, test/inductor/test_torchinductor.py::TritonCodeGenTests::test_inductor_detach_view, test/inductor/test_torchinductor.py::TritonCodeGenTests::test_split_op_with_sym 2024-12-18T00:47:12.2653075Z 2024-12-18T00:47:16.5902073Z Running inductor/test_torchinductor 6/27 ... [2024-12-18 00:47:16.589608] 2024-12-18T00:47:16.5902851Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:47:16.5904330Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'not serial', '--shard-id=6', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:47:16.589997] 2024-12-18T00:52:46.7844916Z 2024-12-18T00:52:46.7845929Z inductor/test_torchinductor 4/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_4.27_3f1fc74983d1d4d4_.log 2024-12-18T00:52:46.7866823Z Running 61 items in this shard: test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_transposed_transposed, test/inductor/test_torchinductor.py::CpuTests::test_cat_extern_kernel_cpu, test/inductor/test_torchinductor.py::CpuTests::test_cumprod_zero_dim_cpu, test/inductor/test_torchinductor.py::CpuTests::test_cumsum_pattern_matcher_issue_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dist_cpu, test/inductor/test_torchinductor.py::CpuTests::test_div4_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dropout_deterministic_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_float16_float16_cpu, test/inductor/test_torchinductor.py::CpuTests::test_empty2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_fallback_mutable_op_no_mutated_tensors_cpu, test/inductor/test_torchinductor.py::CpuTests::test_fallback_mutable_op_with_return_cpu, test/inductor/test_torchinductor.py::CpuTests::test_fft_real_input_real_output_cpu, test/inductor/test_torchinductor.py::CpuTests::test_floordiv_cpu, test/inductor/test_torchinductor.py::CpuTests::test_getitem_cpu, test/inductor/test_torchinductor.py::CpuTests::test_inductor_layout_optimization_input_mutations_cpu, test/inductor/test_torchinductor.py::CpuTests::test_input_mutation4_cpu, test/inductor/test_torchinductor.py::CpuTests::test_move_arange_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_shifted_chebyshev_polynomial_u_cpu, test/inductor/test_torchinductor.py::CpuTests::test_scaled_dot_product_attention_cpu, test/inductor/test_torchinductor.py::CpuTests::test_sdpa_prefer_nd_tiling_False_use_block_ptr_False_cpu, test/inductor/test_torchinductor.py::CpuTests::test_sgn_cpu, test/inductor/test_torchinductor.py::CpuTests::test_slice1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_transpose_add_cpu, test/inductor/test_torchinductor.py::CpuTests::test_uint_cpu, test/inductor/test_torchinductor.py::CpuTests::test_unbacked_floordiv_simplify_errors_cpu, test/inductor/test_torchinductor.py::CpuTests::test_unspec_inputs_bfloat16_cpu, test/inductor/test_torchinductor.py::CpuTests::test_unspec_inputs_float16_cpu, test/inductor/test_torchinductor.py::CpuTests::test_views4_cpu, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_broadcast1_dense, test/inductor/test_torchinductor.py::GPUTests::test_adaptive_max_pool2d2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_as_strided_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_batch_norm_2d_2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_bucketize_int_cuda, test/inductor/test_torchinductor.py::GPUTests::test_builtins_round_float_ndigits_pos_cuda, test/inductor/test_torchinductor.py::GPUTests::test_cat_unbacked_2d_cuda, test/inductor/test_torchinductor.py::GPUTests::test_constant_pad_nd_inplace_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dist_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_float64_float16_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_int8_int32_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_uint8_float64_cuda, test/inductor/test_torchinductor.py::GPUTests::test_empty_strided_cuda, test/inductor/test_torchinductor.py::GPUTests::test_expand_cuda, test/inductor/test_torchinductor.py::GPUTests::test_fallback_mutable_op_with_return_cuda, test/inductor/test_torchinductor.py::GPUTests::test_gather1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_getitem_cuda, test/inductor/test_torchinductor.py::GPUTests::test_grid_sampler_2d_cuda, test/inductor/test_torchinductor.py::GPUTests::test_index_propagation_cuda, test/inductor/test_torchinductor.py::GPUTests::test_index_propagation_remainder_cuda, test/inductor/test_torchinductor.py::GPUTests::test_like_rands2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_linear_float64_cuda, test/inductor/test_torchinductor.py::GPUTests::test_linspace1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_low_memory_max_pool_cuda, test/inductor/test_torchinductor.py::GPUTests::test_multilayer_var_cuda, test/inductor/test_torchinductor.py::GPUTests::test_mutable_custom_op_fixed_layout2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_gammaincc_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pow_int_cuda, test/inductor/test_torchinductor.py::GPUTests::test_sin_cuda, test/inductor/test_torchinductor.py::GPUTests::test_topk_cuda, test/inductor/test_torchinductor.py::GPUTests::test_unspec_inputs_bfloat16_cuda, test/inductor/test_torchinductor.py::GPUTests::test_views5_cuda, test/inductor/test_torchinductor.py::TritonCodeGenTests::test_cant_optimize_compute 2024-12-18T00:52:46.7885546Z 2024-12-18T00:52:51.2070922Z Running inductor/test_torchinductor 7/27 ... [2024-12-18 00:52:51.206378] 2024-12-18T00:52:51.2071864Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:52:51.2075735Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'not serial', '--shard-id=7', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:52:51.206777] 2024-12-18T00:56:54.6111693Z 2024-12-18T00:56:54.6113161Z inductor/test_torchinductor 5/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_5.27_bb0670eaaa0fa793_.log 2024-12-18T00:56:54.6132428Z Running 63 items in this shard: test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_dense_broadcast1, test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_dense_transposed, test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_double_transposed, test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_int_broadcast3, test/inductor/test_torchinductor.py::CpuTests::test_adaptive_avg_pool_with_output_size_0_cpu, test/inductor/test_torchinductor.py::CpuTests::test_aoti_eager_support_str_cpu, test/inductor/test_torchinductor.py::CpuTests::test_avg_pool2d_backward2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_bucketize_int_cpu, test/inductor/test_torchinductor.py::CpuTests::test_conv3d_cpu, test/inductor/test_torchinductor.py::CpuTests::test_device_assert_cpu, test/inductor/test_torchinductor.py::CpuTests::test_exp2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_insignificant_strides_cpu, test/inductor/test_torchinductor.py::CpuTests::test_kwargs_cpu, test/inductor/test_torchinductor.py::CpuTests::test_layer_norm_cpu, test/inductor/test_torchinductor.py::CpuTests::test_multi_threading_cpu, test/inductor/test_torchinductor.py::CpuTests::test_multilayer_sum_low_prec_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_ndtr_cpu, test/inductor/test_torchinductor.py::CpuTests::test_randn_generator_cpu, test/inductor/test_torchinductor.py::CpuTests::test_randn_like_empty_cpu, test/inductor/test_torchinductor.py::CpuTests::test_simplify_loops_cpu, test/inductor/test_torchinductor.py::CpuTests::test_sum5_cpu, test/inductor/test_torchinductor.py::CpuTests::test_unsqueeze_cpu, test/inductor/test_torchinductor.py::GPUTests::test_add_complex_cuda, test/inductor/test_torchinductor.py::GPUTests::test_arange6_cuda, test/inductor/test_torchinductor.py::GPUTests::test_avg_pool2d_backward2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_bool_cuda, test/inductor/test_torchinductor.py::GPUTests::test_buffer_copied_in_graph_cuda, test/inductor/test_torchinductor.py::GPUTests::test_buffer_copied_in_graph_with_different_shapes_cuda, test/inductor/test_torchinductor.py::GPUTests::test_constant_pad_1d_cuda, test/inductor/test_torchinductor.py::GPUTests::test_cumprod_zero_dim_cuda, test/inductor/test_torchinductor.py::GPUTests::test_div7_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_float32_int32_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_int32_float16_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_int64_bfloat16_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_uint8_uint8_cuda, test/inductor/test_torchinductor.py::GPUTests::test_expm1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_fmod_zero_dim_cuda, test/inductor/test_torchinductor.py::GPUTests::test_horizonal_fusion1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_index_dynamic_shapes_cuda, test/inductor/test_torchinductor.py::GPUTests::test_index_put2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_int_input_dynamic_shapes_cuda, test/inductor/test_torchinductor.py::GPUTests::test_invalid_operand_issue1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_layer_norm_cuda, test/inductor/test_torchinductor.py::GPUTests::test_linear2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_masked_fill_promotion_cuda, test/inductor/test_torchinductor.py::GPUTests::test_max_pool2d5_cuda, test/inductor/test_torchinductor.py::GPUTests::test_max_pool2d_with_indices_backward2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_move_arange_cuda, test/inductor/test_torchinductor.py::GPUTests::test_new_empty_strided_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pad_cast_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pad_view_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_airy_ai_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_bessel_y1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_expit_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_round_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pow3_cuda, test/inductor/test_torchinductor.py::GPUTests::test_profiler_mark_wrapper_call_cuda, test/inductor/test_torchinductor.py::GPUTests::test_reduction2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_slice_scatter4_cuda, test/inductor/test_torchinductor.py::GPUTests::test_unfold_zero_dimension_tensor_cuda, test/inductor/test_torchinductor.py::GPUTests::test_unspec_inputs_int32_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_correction_cuda, test/inductor/test_torchinductor.py::GPUTests::test_view_as_complex_cuda 2024-12-18T00:56:54.6150104Z 2024-12-18T00:56:58.9587364Z Running inductor/test_torchinductor 8/27 ... [2024-12-18 00:56:58.958037] 2024-12-18T00:56:58.9587857Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:56:58.9589402Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'not serial', '--shard-id=8', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:56:58.958514] 2024-12-18T01:01:01.1897630Z 2024-12-18T01:01:01.1899054Z inductor/test_torchinductor 7/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_7.27_9e8b864c92ef7101_.log 2024-12-18T01:01:01.1915096Z Running 51 items in this shard: test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_broadcast3_broadcast1, test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_broadcast3_broadcast3, test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_double_broadcast2, test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_strided_double, test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_strided_int, test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_transposed_broadcast1, test/inductor/test_torchinductor.py::CpuTests::test_abs_cpu, test/inductor/test_torchinductor.py::CpuTests::test_bucketize_default_kwargs_cpu, test/inductor/test_torchinductor.py::CpuTests::test_div_prim_cpu, test/inductor/test_torchinductor.py::CpuTests::test_div_zero_dim_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_int16_bfloat16_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_int32_int8_cpu, test/inductor/test_torchinductor.py::CpuTests::test_fallback_mutable_op_basic_cpu, test/inductor/test_torchinductor.py::CpuTests::test_hardswish_cpu, test/inductor/test_torchinductor.py::CpuTests::test_log1p_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_gammainc_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_modified_bessel_i0_cpu, test/inductor/test_torchinductor.py::CpuTests::test_scalar_cpu_tensor_arg_cpu, test/inductor/test_torchinductor.py::CpuTests::test_slice_scatter_cpu, test/inductor/test_torchinductor.py::CpuTests::test_stride_preservation_with_stride_modifying_fx_pass_cpu, test/inductor/test_torchinductor.py::CpuTests::test_tensor1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_upsample_bilinear2d_a_cpu, test/inductor/test_torchinductor.py::CpuTests::test_view_detach_cpu, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_broadcast3_double, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_double_broadcast1, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_int_double, test/inductor/test_torchinductor.py::GPUTests::test_AllenaiLongformerBase_repro_cuda, test/inductor/test_torchinductor.py::GPUTests::test_avg_pool2d2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_avg_pool2d_backward3_cuda, test/inductor/test_torchinductor.py::GPUTests::test_consecutive_split_cumprod_cuda, test/inductor/test_torchinductor.py::GPUTests::test_convolution2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_custom_op_2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_div1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_int16_float16_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_int16_int32_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_int32_int8_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_int64_float32_cuda, test/inductor/test_torchinductor.py::GPUTests::test_float32_to_int32_cuda, test/inductor/test_torchinductor.py::GPUTests::test_fractional_max_pool2d3_cuda, test/inductor/test_torchinductor.py::GPUTests::test_max_pool2d_with_indices_backward6_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_xlogy_cuda, test/inductor/test_torchinductor.py::GPUTests::test_randint_kernel_count_cuda, test/inductor/test_torchinductor.py::GPUTests::test_reduction3_cuda, test/inductor/test_torchinductor.py::GPUTests::test_sigmoid_cuda, test/inductor/test_torchinductor.py::GPUTests::test_slice_scatter2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_split_failed_cuda, test/inductor/test_torchinductor.py::GPUTests::test_sum4_cuda, test/inductor/test_torchinductor.py::GPUTests::test_unspec_inputs_uint8_cuda, test/inductor/test_torchinductor.py::GPUTests::test_upsample_nearest2d_backward_cuda, test/inductor/test_torchinductor.py::TritonCodeGenTests::test_donated_buffer_inplace, test/inductor/test_torchinductor.py::TritonCodeGenTests::test_has_constant_mask_block_multiple_False_ynumel_exceed_ygrid_size_False 2024-12-18T01:01:01.1930685Z 2024-12-18T01:01:05.5940636Z Running inductor/test_torchinductor 9/27 ... [2024-12-18 01:01:05.593395] 2024-12-18T01:01:05.5941235Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T01:01:05.5942443Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'not serial', '--shard-id=9', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:01:05.593837] 2024-12-18T01:04:20.3657900Z 2024-12-18T01:04:20.3659045Z inductor/test_torchinductor 6/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_6.27_ec620111bab8cba1_.log 2024-12-18T01:04:20.3675322Z Running 54 items in this shard: test/inductor/test_torchinductor.py::CpuTests::test_adding_tensor_offsets_cpu, test/inductor/test_torchinductor.py::CpuTests::test_aoti_eager_support_out_cpu, test/inductor/test_torchinductor.py::CpuTests::test_arange2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_arange5_cpu, test/inductor/test_torchinductor.py::CpuTests::test_batch_norm_2d_cpu, test/inductor/test_torchinductor.py::CpuTests::test_bfloat16_to_int16_cpu, test/inductor/test_torchinductor.py::CpuTests::test_cat_negative_dim_cpu, test/inductor/test_torchinductor.py::CpuTests::test_div2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dropout2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_bfloat16_float16_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_bfloat16_int16_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_int32_float32_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_int32_int64_cpu, test/inductor/test_torchinductor.py::CpuTests::test_fmod_zero_dim_cpu, test/inductor/test_torchinductor.py::CpuTests::test_fusing_write_into_disjoint_read_cpu, test/inductor/test_torchinductor.py::CpuTests::test_hardsigmoid_cpu, test/inductor/test_torchinductor.py::CpuTests::test_index_put_reinplace_cpu, test/inductor/test_torchinductor.py::CpuTests::test_log_fp64_cpu, test/inductor/test_torchinductor.py::CpuTests::test_new_empty_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_logit_cpu, test/inductor/test_torchinductor.py::CpuTests::test_round_correctness_cpu, test/inductor/test_torchinductor.py::CpuTests::test_softmax_cpu, test/inductor/test_torchinductor.py::CpuTests::test_softmax_one_kernel_loop_cpu, test/inductor/test_torchinductor.py::CpuTests::test_sum_int_cpu, test/inductor/test_torchinductor.py::CpuTests::test_upsample_nearest1d_cpu, test/inductor/test_torchinductor.py::CpuTests::test_view_as_real_cpu, test/inductor/test_torchinductor.py::CpuTests::test_view_uint8_through_differing_bitwidths_cpu, test/inductor/test_torchinductor.py::CpuTests::test_where_broadcast_cpu, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_broadcast1_broadcast3, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_int_strided, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_strided_broadcast2, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_transposed_broadcast2, test/inductor/test_torchinductor.py::GPUTests::test_arange3_cuda, test/inductor/test_torchinductor.py::GPUTests::test_custom_op_fixed_layout_channels_last_cuda, test/inductor/test_torchinductor.py::GPUTests::test_custom_op_unbacked_symints_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_float64_int64_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_int32_float64_cuda, test/inductor/test_torchinductor.py::GPUTests::test_flip_cat_cuda, test/inductor/test_torchinductor.py::GPUTests::test_isinf_cuda, test/inductor/test_torchinductor.py::GPUTests::test_large_tensor_reduction_cuda, test/inductor/test_torchinductor.py::GPUTests::test_mm_mixed_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_nonzero_unbacked_refinement_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_erfc_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_modified_bessel_k0_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_spherical_bessel_j0_cuda, test/inductor/test_torchinductor.py::GPUTests::test_polar_cuda, test/inductor/test_torchinductor.py::GPUTests::test_resize_as_cuda, test/inductor/test_torchinductor.py::GPUTests::test_scatter_reduce2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_slice_scatter3_cuda, test/inductor/test_torchinductor.py::GPUTests::test_tensor2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_tensor3_cuda, test/inductor/test_torchinductor.py::GPUTests::test_views1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_views3_cuda, test/inductor/test_torchinductor.py::GPUTests::test_zeros_cuda 2024-12-18T01:04:20.3690724Z 2024-12-18T01:04:24.8135462Z Running inductor/test_torchinductor 10/27 ... [2024-12-18 01:04:24.812960] 2024-12-18T01:04:24.8136092Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T01:04:24.8138033Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'not serial', '--shard-id=10', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:04:24.813427] 2024-12-18T01:04:32.7930226Z 2024-12-18T01:04:32.7931273Z inductor/test_torchinductor 8/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_8.27_565f07f6aa61f46c_.log 2024-12-18T01:04:32.7951013Z Running 56 items in this shard: test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_int_strided, test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_strided_broadcast1, test/inductor/test_torchinductor.py::CpuTests::test_arange1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_avg_pool2d8_cpu, test/inductor/test_torchinductor.py::CpuTests::test_batch_norm_2d_2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_bucketize_add_autotune_cpu, test/inductor/test_torchinductor.py::CpuTests::test_builtins_round_int_ndigits_pos_cpu, test/inductor/test_torchinductor.py::CpuTests::test_cat_unbacked_legacy_empty_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtype_mismatch_issue_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_int8_int8_cpu, test/inductor/test_torchinductor.py::CpuTests::test_fallback_mutable_op_list_cpu, test/inductor/test_torchinductor.py::CpuTests::test_masked_fill_promotion_cpu, test/inductor/test_torchinductor.py::CpuTests::test_neg_max_uint8_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_airy_ai_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_ndtri_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_xlogy_cpu, test/inductor/test_torchinductor.py::CpuTests::test_prod_cpu, test/inductor/test_torchinductor.py::CpuTests::test_scatter_add1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_scatter_add2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_slice2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_split_cumsum_low_prec_cpu, test/inductor/test_torchinductor.py::CpuTests::test_sqrt_dynamic_shapes_cpu, test/inductor/test_torchinductor.py::CpuTests::test_unbind_cpu, test/inductor/test_torchinductor.py::CpuTests::test_unspec_inputs_int16_cpu, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_broadcast3_broadcast1, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_int_broadcast2, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_strided_dense, test/inductor/test_torchinductor.py::GPUTests::test_add_const_float_cuda, test/inductor/test_torchinductor.py::GPUTests::test_avg_pool2d4_cuda, test/inductor/test_torchinductor.py::GPUTests::test_bucketize_default_kwargs_cuda, test/inductor/test_torchinductor.py::GPUTests::test_cauchy_cuda, test/inductor/test_torchinductor.py::GPUTests::test_convolution4_cuda, test/inductor/test_torchinductor.py::GPUTests::test_div2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_exp_cuda, test/inductor/test_torchinductor.py::GPUTests::test_expand_as_cuda, test/inductor/test_torchinductor.py::GPUTests::test_fft_real_input_real_output_cuda, test/inductor/test_torchinductor.py::GPUTests::test_fractional_max_pool2d1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_full_boolean_cuda, test/inductor/test_torchinductor.py::GPUTests::test_fusing_write_into_disjoint_read_cuda, test/inductor/test_torchinductor.py::GPUTests::test_large_strided_reduction_cuda, test/inductor/test_torchinductor.py::GPUTests::test_min_max_reduction_cuda, test/inductor/test_torchinductor.py::GPUTests::test_multilayer_prime_size_cuda, test/inductor/test_torchinductor.py::GPUTests::test_mutations_loop_fusion_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_i0e_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_scaled_modified_bessel_k1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_zeta_cuda, test/inductor/test_torchinductor.py::GPUTests::test_rand_like_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_repeat_interleave_2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_scatter1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_sizehint_issue1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_tmp_not_defined_issue1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_to_device_constant_cuda, test/inductor/test_torchinductor.py::GPUTests::test_upsample_bicubic2d_cuda, test/inductor/test_torchinductor.py::GPUTests::test_upsample_nearest2d_cuda, test/inductor/test_torchinductor.py::TritonCodeGenTests::test_inductor_sequence_nr, test/inductor/test_torchinductor.py::TritonCodeGenTests::test_numpy_on_gpu 2024-12-18T01:04:32.7967386Z 2024-12-18T01:04:37.2187101Z Running inductor/test_torchinductor 11/27 ... [2024-12-18 01:04:37.218029] 2024-12-18T01:04:37.2187723Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T01:04:37.2188802Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'not serial', '--shard-id=11', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:04:37.218451] 2024-12-18T01:11:19.1236532Z 2024-12-18T01:11:19.1239099Z inductor/test_torchinductor 9/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_9.27_aaa97bdab74fc578_.log 2024-12-18T01:11:19.1258136Z Running 60 items in this shard: test/inductor/test_torchinductor.py::CpuTests::test_aoti_eager_with_persistent_cache_cpu, test/inductor/test_torchinductor.py::CpuTests::test_avg_pool2d6_cpu, test/inductor/test_torchinductor.py::CpuTests::test_baddbmm_cpu, test/inductor/test_torchinductor.py::CpuTests::test_both_scalars_cpu, test/inductor/test_torchinductor.py::CpuTests::test_cat_empty_cpu, test/inductor/test_torchinductor.py::CpuTests::test_complex_fallback_cpu, test/inductor/test_torchinductor.py::CpuTests::test_constant_pad_fill_dtype_cpu, test/inductor/test_torchinductor.py::CpuTests::test_custom_op_3_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_bfloat16_int64_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_int32_float64_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_int64_int16_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_int8_uint8_cpu, test/inductor/test_torchinductor.py::CpuTests::test_index_put_fallback1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_index_put_index_cpu, test/inductor/test_torchinductor.py::CpuTests::test_like_channels_last_cpu, test/inductor/test_torchinductor.py::CpuTests::test_linspace2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_max_min_cpu, test/inductor/test_torchinductor.py::CpuTests::test_max_pool2d8_cpu, test/inductor/test_torchinductor.py::CpuTests::test_mutable_custom_op_fixed_layout_cpu, test/inductor/test_torchinductor.py::CpuTests::test_narrow_cpu, test/inductor/test_torchinductor.py::CpuTests::test_new_empty_strided_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_i0e_cpu, test/inductor/test_torchinductor.py::CpuTests::test_scatter2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_slice_scatter5_cpu, test/inductor/test_torchinductor.py::CpuTests::test_sort_stable_cpu, test/inductor/test_torchinductor.py::CpuTests::test_split_with_unbacked_symints_cpu, test/inductor/test_torchinductor.py::CpuTests::test_squeeze_varargs_cpu, test/inductor/test_torchinductor.py::CpuTests::test_topk_cpu, test/inductor/test_torchinductor.py::CpuTests::test_views2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_views5_cpu, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_broadcast3_dense, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_int_int, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_transposed_transposed, test/inductor/test_torchinductor.py::GPUTests::test_argmax_argmin_with_nan_cuda, test/inductor/test_torchinductor.py::GPUTests::test_bucketize_computed_offsets_cuda, test/inductor/test_torchinductor.py::GPUTests::test_cat_unbacked_legacy_empty_cuda, test/inductor/test_torchinductor.py::GPUTests::test_config_option_dont_assume_alignment_cuda, test/inductor/test_torchinductor.py::GPUTests::test_div_precision_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_float32_int64_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_int16_bfloat16_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_int16_uint8_cuda, test/inductor/test_torchinductor.py::GPUTests::test_erfc_cuda, test/inductor/test_torchinductor.py::GPUTests::test_fallback_mutable_op_no_mutated_tensors_cuda, test/inductor/test_torchinductor.py::GPUTests::test_hardswish_cuda, test/inductor/test_torchinductor.py::GPUTests::test_index_propagation_device_assert_masked_cuda, test/inductor/test_torchinductor.py::GPUTests::test_index_put3_cuda, test/inductor/test_torchinductor.py::GPUTests::test_logcumsumexp_cuda, test/inductor/test_torchinductor.py::GPUTests::test_mean_cuda, test/inductor/test_torchinductor.py::GPUTests::test_philox_rand_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_modified_bessel_k1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_polygamma_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remainder_cuda, test/inductor/test_torchinductor.py::GPUTests::test_simplify_loops_cuda, test/inductor/test_torchinductor.py::GPUTests::test_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_split_cumsum_low_prec_cuda, test/inductor/test_torchinductor.py::GPUTests::test_to_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_transpose_cuda, test/inductor/test_torchinductor.py::GPUTests::test_views4_cuda, test/inductor/test_torchinductor.py::TritonCodeGenTests::test_kernel_names_descriptive, test/inductor/test_torchinductor.py::NanCheckerTest::test_nan_checker_fail 2024-12-18T01:11:19.1276760Z 2024-12-18T01:11:23.5563623Z Running inductor/test_torchinductor 12/27 ... [2024-12-18 01:11:23.555646] 2024-12-18T01:11:23.5564104Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T01:11:23.5565215Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'not serial', '--shard-id=12', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:11:23.556108] 2024-12-18T01:11:58.1080767Z 2024-12-18T01:11:58.1081780Z inductor/test_torchinductor 11/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_11.27_cafb019f69b4cf8a_.log 2024-12-18T01:11:58.1097747Z Running 52 items in this shard: test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_broadcast1_transposed, test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_int_dense, test/inductor/test_torchinductor.py::CpuTests::test_adaptive_max_pool2d2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_avg_pool2d_backward_cpu, test/inductor/test_torchinductor.py::CpuTests::test_cat_empty_index_cpu, test/inductor/test_torchinductor.py::CpuTests::test_cat_inplace_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_float64_int64_cpu, test/inductor/test_torchinductor.py::CpuTests::test_empty_strided_cpu, test/inductor/test_torchinductor.py::CpuTests::test_erfinv_cpu, test/inductor/test_torchinductor.py::CpuTests::test_fuse_tiled_cpu, test/inductor/test_torchinductor.py::CpuTests::test_lerp_cpu, test/inductor/test_torchinductor.py::CpuTests::test_linear_float64_cpu, test/inductor/test_torchinductor.py::CpuTests::test_neg_index_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pixel_shuffle_channels_last_cpu, test/inductor/test_torchinductor.py::CpuTests::test_scatter3_cpu, test/inductor/test_torchinductor.py::CpuTests::test_scatter5_cpu, test/inductor/test_torchinductor.py::CpuTests::test_select_scatter_cpu, test/inductor/test_torchinductor.py::CpuTests::test_single_elem_indirect_cpu, test/inductor/test_torchinductor.py::CpuTests::test_softmax_backward_data_cpu, test/inductor/test_torchinductor.py::CpuTests::test_split_with_integer_cpu, test/inductor/test_torchinductor.py::CpuTests::test_split_with_sizes_with_unbacked_symints_cpu, test/inductor/test_torchinductor.py::CpuTests::test_std_cpu, test/inductor/test_torchinductor.py::CpuTests::test_sum4_cpu, test/inductor/test_torchinductor.py::CpuTests::test_vdd_clamp_cpu, test/inductor/test_torchinductor.py::GPUTests::test_adaptive_max_pool2d3_cuda, test/inductor/test_torchinductor.py::GPUTests::test_bernoulli2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_builtins_round_cuda, test/inductor/test_torchinductor.py::GPUTests::test_complex_memory_overlap_cuda, test/inductor/test_torchinductor.py::GPUTests::test_convolution3_cuda, test/inductor/test_torchinductor.py::GPUTests::test_cos_cuda, test/inductor/test_torchinductor.py::GPUTests::test_cudnn_rnn_cuda, test/inductor/test_torchinductor.py::GPUTests::test_div_softmax_symfloat_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_bfloat16_float16_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_fusion_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_int32_int16_cuda, test/inductor/test_torchinductor.py::GPUTests::test_embedding_bag_cuda, test/inductor/test_torchinductor.py::GPUTests::test_erfinv_cuda, test/inductor/test_torchinductor.py::GPUTests::test_float_index_expression_cuda, test/inductor/test_torchinductor.py::GPUTests::test_kwargs_cuda, test/inductor/test_torchinductor.py::GPUTests::test_multi_gpu_device_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_chebyshev_polynomial_t_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_i1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pow_symfloat_cuda, test/inductor/test_torchinductor.py::GPUTests::test_repeat_interleave_cuda, test/inductor/test_torchinductor.py::GPUTests::test_scatter_add1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_scatter_bf16_cuda, test/inductor/test_torchinductor.py::GPUTests::test_squeeze2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_sum3_cuda, test/inductor/test_torchinductor.py::GPUTests::test_unspec_inputs_int8_cuda, test/inductor/test_torchinductor.py::TritonCodeGenTests::test_codegen_config_option_dont_assume_alignment, test/inductor/test_torchinductor.py::TritonCodeGenTests::test_red_followed_by_transposed_pointwise, test/inductor/test_torchinductor.py::RNNTest::test_rnn_compile_safe 2024-12-18T01:11:58.1113349Z 2024-12-18T01:12:02.5198309Z Running inductor/test_torchinductor 13/27 ... [2024-12-18 01:12:02.519261] 2024-12-18T01:12:02.5198900Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T01:12:02.5200210Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'not serial', '--shard-id=13', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:12:02.519647] 2024-12-18T01:13:32.7180126Z 2024-12-18T01:13:32.7181233Z inductor/test_torchinductor 10/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_10.27_d3038110b56e1493_.log 2024-12-18T01:13:32.7203773Z Running 73 items in this shard: test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_broadcast2_strided, test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_broadcast3_dense, test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_int_broadcast2, test/inductor/test_torchinductor.py::CpuTests::test_adaptive_max_pool2d3_cpu, test/inductor/test_torchinductor.py::CpuTests::test_add_complex6_cpu, test/inductor/test_torchinductor.py::CpuTests::test_add_complex_cpu, test/inductor/test_torchinductor.py::CpuTests::test_avg_pool2d2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_avg_pool3d_backward2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_avg_pool3d_backward3_cpu, test/inductor/test_torchinductor.py::CpuTests::test_cat_of_loops_and_extern_kernel_cpu, test/inductor/test_torchinductor.py::CpuTests::test_constant_pad_3d_cpu, test/inductor/test_torchinductor.py::CpuTests::test_convolution4_cpu, test/inductor/test_torchinductor.py::CpuTests::test_div6_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_float16_int8_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_float32_int16_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_float64_bfloat16_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_int16_float32_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_int32_uint8_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_int8_float16_cpu, test/inductor/test_torchinductor.py::CpuTests::test_expand_cpu, test/inductor/test_torchinductor.py::CpuTests::test_fractional_max_pool2d2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_index1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_index_select_cpu, test/inductor/test_torchinductor.py::CpuTests::test_inf_cpu, test/inductor/test_torchinductor.py::CpuTests::test_inner_fn_str_and_stride_cpu, test/inductor/test_torchinductor.py::CpuTests::test_mm_mixed_dtype_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_chebyshev_polynomial_v_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_entr_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_xlog1py_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pow_int_cpu, test/inductor/test_torchinductor.py::CpuTests::test_randn_with_dtype_and_device_cpu, test/inductor/test_torchinductor.py::CpuTests::test_repeat_interleave_2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_require_stride_expanded_cpu, test/inductor/test_torchinductor.py::CpuTests::test_silu_cpu, test/inductor/test_torchinductor.py::CpuTests::test_split_cumprod_low_prec_cpu, test/inductor/test_torchinductor.py::CpuTests::test_tensor2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_upsample_bilinear2d_b_cpu, test/inductor/test_torchinductor.py::CpuTests::test_var_correction_cpu, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_broadcast2_broadcast2, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_broadcast2_double, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_double_dense, test/inductor/test_torchinductor.py::GPUTests::test__unsafe_masked_index_cuda, test/inductor/test_torchinductor.py::GPUTests::test_adaptive_avg_pool2d_low_prec_cuda, test/inductor/test_torchinductor.py::GPUTests::test_add_complex6_cuda, test/inductor/test_torchinductor.py::GPUTests::test_avg_pool2d7_cuda, test/inductor/test_torchinductor.py::GPUTests::test_avg_pool2d_backward_cuda, test/inductor/test_torchinductor.py::GPUTests::test_buffer_batch_norm_cuda, test/inductor/test_torchinductor.py::GPUTests::test_cat_extern_kernel_cuda, test/inductor/test_torchinductor.py::GPUTests::test_concat_add_inplace_cuda, test/inductor/test_torchinductor.py::GPUTests::test_conv2d_backward_channels_last_cuda, test/inductor/test_torchinductor.py::GPUTests::test_conv2d_channels_last_cuda, test/inductor/test_torchinductor.py::GPUTests::test_div5_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_float16_bfloat16_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_float16_int32_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_float32_float16_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_float32_uint8_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_int32_bfloat16_cuda, test/inductor/test_torchinductor.py::GPUTests::test_index3_cuda, test/inductor/test_torchinductor.py::GPUTests::test_index_put_deterministic_fallback_cuda, test/inductor/test_torchinductor.py::GPUTests::test_inductor_layout_optimization_input_mutations_cuda, test/inductor/test_torchinductor.py::GPUTests::test_linspace3_cuda, test/inductor/test_torchinductor.py::GPUTests::test_linspace4_cuda, test/inductor/test_torchinductor.py::GPUTests::test_max_pool2d6_cuda, test/inductor/test_torchinductor.py::GPUTests::test_nll_loss_forward_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_erfcx_cuda, test/inductor/test_torchinductor.py::GPUTests::test_reflection_pad2d_cuda, test/inductor/test_torchinductor.py::GPUTests::test_scatter2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_sdpa_prefer_nd_tiling_True_use_block_ptr_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_uint_cuda, test/inductor/test_torchinductor.py::GPUTests::test_view_detach_cuda, test/inductor/test_torchinductor.py::TritonCodeGenTests::test_non_blocking_copy_codegen, test/inductor/test_torchinductor.py::TritonCodeGenTests::test_numpy_autograd, test/inductor/test_torchinductor.py::TritonCodeGenTests::test_optimize_indexing_dtype 2024-12-18T01:13:32.7224604Z 2024-12-18T01:13:37.1008596Z Running inductor/test_torchinductor 14/27 ... [2024-12-18 01:13:37.100194] 2024-12-18T01:13:37.1010661Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T01:13:37.1012488Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'not serial', '--shard-id=14', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:13:37.100627] 2024-12-18T01:23:23.9311203Z 2024-12-18T01:23:23.9312788Z inductor/test_torchinductor 13/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_13.27_be754909e2349298_.log 2024-12-18T01:23:23.9335181Z Running 75 items in this shard: test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_broadcast2_dense, test/inductor/test_torchinductor.py::CpuTests::test_arange4_cpu, test/inductor/test_torchinductor.py::CpuTests::test_arange6_cpu, test/inductor/test_torchinductor.py::CpuTests::test_avg_pool3d_backward_cpu, test/inductor/test_torchinductor.py::CpuTests::test_bitwise_cpu, test/inductor/test_torchinductor.py::CpuTests::test_buffer_batch_norm_cpu, test/inductor/test_torchinductor.py::CpuTests::test_cat_cpu, test/inductor/test_torchinductor.py::CpuTests::test_conv_backward_cpu, test/inductor/test_torchinductor.py::CpuTests::test_convolution3_cpu, test/inductor/test_torchinductor.py::CpuTests::test_div3_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_bfloat16_float32_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_float64_float32_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_int16_float64_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_int8_int16_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_uint8_int16_cpu, test/inductor/test_torchinductor.py::CpuTests::test_elu_cpu, test/inductor/test_torchinductor.py::CpuTests::test_fill2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_gather3_cpu, test/inductor/test_torchinductor.py::CpuTests::test_index_put4_cpu, test/inductor/test_torchinductor.py::CpuTests::test_int_input_dynamic_shapes_cpu, test/inductor/test_torchinductor.py::CpuTests::test_max_pool2d7_cpu, test/inductor/test_torchinductor.py::CpuTests::test_nll_loss_backward_cpu, test/inductor/test_torchinductor.py::CpuTests::test_philox_rand_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_laguerre_polynomial_l_cpu, test/inductor/test_torchinductor.py::CpuTests::test_reduction4_cpu, test/inductor/test_torchinductor.py::CpuTests::test_relu_cpu, test/inductor/test_torchinductor.py::CpuTests::test_remainder_cpu, test/inductor/test_torchinductor.py::CpuTests::test_repeat_cpu, test/inductor/test_torchinductor.py::CpuTests::test_reuse_buffers_with_aliasing_cpu, test/inductor/test_torchinductor.py::CpuTests::test_sdpa_prefer_nd_tiling_True_use_block_ptr_True_cpu, test/inductor/test_torchinductor.py::CpuTests::test_slice_mutation2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_softmax_one_kernel_persist_cpu, test/inductor/test_torchinductor.py::CpuTests::test_sort_cpu, test/inductor/test_torchinductor.py::CpuTests::test_sort_transpose_cpu, test/inductor/test_torchinductor.py::CpuTests::test_split_cumprod_cpu, test/inductor/test_torchinductor.py::CpuTests::test_tan_cpu, test/inductor/test_torchinductor.py::CpuTests::test_to_dtype_cpu, test/inductor/test_torchinductor.py::CpuTests::test_transposed_propagates_cpu, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_broadcast2_broadcast3, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_broadcast3_int, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_int_dense, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_transposed_dense, test/inductor/test_torchinductor.py::GPUTests::test_adaptive_max_pool2d1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_argmax_min_int32_cuda, test/inductor/test_torchinductor.py::GPUTests::test_avg_pool2d3_cuda, test/inductor/test_torchinductor.py::GPUTests::test_buffer_use_after_remove_cuda, test/inductor/test_torchinductor.py::GPUTests::test_cat_negative_dim_cuda, test/inductor/test_torchinductor.py::GPUTests::test_config_option_dont_assume_alignment_cudagraphs_cuda, test/inductor/test_torchinductor.py::GPUTests::test_consecutive_split_cumsum_cuda, test/inductor/test_torchinductor.py::GPUTests::test_cumsum_no_mask_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtype_sympy_expr_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_float32_float64_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_int64_int32_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_int8_int8_cuda, test/inductor/test_torchinductor.py::GPUTests::test_empty1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_inf_cuda, test/inductor/test_torchinductor.py::GPUTests::test_inner_fn_str_and_stride_cuda, test/inductor/test_torchinductor.py::GPUTests::test_input_mutation3_cuda, test/inductor/test_torchinductor.py::GPUTests::test_large_broadcast_reduction_cuda, test/inductor/test_torchinductor.py::GPUTests::test_max_pool2d1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_max_pool2d_with_indices_backward4_cuda, test/inductor/test_torchinductor.py::GPUTests::test_mixed_mm_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pixel_shuffle_channels_last_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_bessel_j1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pow1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_scatter_add2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_sdpa_prefer_nd_tiling_False_use_block_ptr_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_transposed_propagates_cuda, test/inductor/test_torchinductor.py::GPUTests::test_vectorized_ops_masked_cuda, test/inductor/test_torchinductor.py::GPUTests::test_weight_norm_bwd_cuda, test/inductor/test_torchinductor.py::GPUTests::test_where_with_logical_op_cuda, test/inductor/test_torchinductor.py::TritonCodeGenTests::test_divisible_by_16_covers_numel_args, test/inductor/test_torchinductor.py::TritonCodeGenTests::test_layer_norm_inplaces_after_matmul, test/inductor/test_torchinductor.py::TritonCodeGenTests::test_not_materialize_pointwise_reduction, test/inductor/test_torchinductor.py::TritonCodeGenTests::test_optimize_indexing_dtype_with_constraint 2024-12-18T01:23:23.9356600Z 2024-12-18T01:23:28.3727496Z Running inductor/test_torchinductor 15/27 ... [2024-12-18 01:23:28.372132] 2024-12-18T01:23:28.3727990Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T01:23:28.3729649Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'not serial', '--shard-id=15', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:23:28.372557] 2024-12-18T01:26:17.3952299Z 2024-12-18T01:26:17.3953671Z inductor/test_torchinductor 12/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_12.27_9110b36930659b85_.log 2024-12-18T01:26:17.3974293Z Running 65 items in this shard: test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_broadcast1_dense, test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_broadcast2_broadcast3, test/inductor/test_torchinductor.py::CpuTests::test_add_complex4_cpu, test/inductor/test_torchinductor.py::CpuTests::test_alexnet_prefix_cpu, test/inductor/test_torchinductor.py::CpuTests::test_bitwise2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_builtins_round_cpu, test/inductor/test_torchinductor.py::CpuTests::test_cat_unbacked_2d_cpu, test/inductor/test_torchinductor.py::CpuTests::test_config_option_dont_assume_alignment_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_bfloat16_int8_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_float16_int16_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_float32_bfloat16_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_int32_int16_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_int32_int32_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_int64_uint8_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_uint8_float32_cpu, test/inductor/test_torchinductor.py::CpuTests::test_fractional_max_pool2d1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_index_put_deterministic_fallback_cpu, test/inductor/test_torchinductor.py::CpuTests::test_inplace_resize_as_cpu, test/inductor/test_torchinductor.py::CpuTests::test_logcumsumexp_zero_dim_cpu, test/inductor/test_torchinductor.py::CpuTests::test_min_max_reduction_nan_cpu, test/inductor/test_torchinductor.py::CpuTests::test_multilayer_any_cpu, test/inductor/test_torchinductor.py::CpuTests::test_multilayer_prime_size_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pattern_matcher_multi_user_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_chebyshev_polynomial_t_cpu, test/inductor/test_torchinductor.py::CpuTests::test_reflection_pad2d_backward_cpu, test/inductor/test_torchinductor.py::CpuTests::test_reflection_pad2d_cpu, test/inductor/test_torchinductor.py::CpuTests::test_remove_noop_clone_cpu, test/inductor/test_torchinductor.py::CpuTests::test_round_cpu, test/inductor/test_torchinductor.py::CpuTests::test_scheduler_vertical_fusion1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_should_pad_bench_for_bmm_cpu, test/inductor/test_torchinductor.py::CpuTests::test_sum_keepdims_cpu, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_broadcast2_strided, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_double_double, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_double_strided, test/inductor/test_torchinductor.py::GPUTests::test_aoti_eager_override_registration_cuda, test/inductor/test_torchinductor.py::GPUTests::test_avg_pool2d1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_avg_pool2d_backward4_cuda, test/inductor/test_torchinductor.py::GPUTests::test_bfloat16_to_int16_cuda, test/inductor/test_torchinductor.py::GPUTests::test_cat_inplace_cuda, test/inductor/test_torchinductor.py::GPUTests::test_cat_unbacked_empty_1d_cuda, test/inductor/test_torchinductor.py::GPUTests::test_conv_inference_heuristics_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtype_mismatch_issue_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_float32_int8_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_float64_uint8_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_int32_float32_cuda, test/inductor/test_torchinductor.py::GPUTests::test_elu_cuda, test/inductor/test_torchinductor.py::GPUTests::test_fill2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_index_propagation_abs_cuda, test/inductor/test_torchinductor.py::GPUTests::test_index_put_failed_reinplace_cuda, test/inductor/test_torchinductor.py::GPUTests::test_index_tensor_cuda, test/inductor/test_torchinductor.py::GPUTests::test_multi_gpu_recompile_on_index_cuda, test/inductor/test_torchinductor.py::GPUTests::test_permute2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_bessel_y0_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_entr_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_ndtr_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_shifted_chebyshev_polynomial_t_cuda, test/inductor/test_torchinductor.py::GPUTests::test_reflection_pad2d_backward_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_no_ops_cuda, test/inductor/test_torchinductor.py::GPUTests::test_repeat_as_strided_cuda, test/inductor/test_torchinductor.py::GPUTests::test_resize_cuda, test/inductor/test_torchinductor.py::GPUTests::test_roi_align_cuda, test/inductor/test_torchinductor.py::GPUTests::test_split_with_list_cuda, test/inductor/test_torchinductor.py::GPUTests::test_std_cuda, test/inductor/test_torchinductor.py::GPUTests::test_tensor_index_slice_cuda, test/inductor/test_torchinductor.py::TritonCodeGenTests::test_has_constant_mask_block_multiple_True_ynumel_exceed_ygrid_size_False 2024-12-18T01:26:17.3993912Z 2024-12-18T01:26:21.7358062Z Running inductor/test_torchinductor 16/27 ... [2024-12-18 01:26:21.735172] 2024-12-18T01:26:21.7358610Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T01:26:21.7360179Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'not serial', '--shard-id=16', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:26:21.735555] 2024-12-18T01:26:47.4597780Z 2024-12-18T01:26:47.4599018Z inductor/test_torchinductor 14/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_14.27_d764707b21314ac9_.log 2024-12-18T01:26:47.4617302Z Running 60 items in this shard: test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_broadcast3_double, test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_broadcast3_transposed, test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_double_strided, test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_strided_strided, test/inductor/test_torchinductor.py::CpuTests::test_adaptive_avg_pool2d1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_arange3_cpu, test/inductor/test_torchinductor.py::CpuTests::test_avg_pool2d3_cpu, test/inductor/test_torchinductor.py::CpuTests::test_conv_bn_fuse_cpu, test/inductor/test_torchinductor.py::CpuTests::test_convolution2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dropout_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_float16_int64_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_int16_int32_cpu, test/inductor/test_torchinductor.py::CpuTests::test_float16_to_int16_cpu, test/inductor/test_torchinductor.py::CpuTests::test_fmin_fmax_cpu, test/inductor/test_torchinductor.py::CpuTests::test_forced_buffer_realize_cpu, test/inductor/test_torchinductor.py::CpuTests::test_like_rands3_cpu, test/inductor/test_torchinductor.py::CpuTests::test_max_pool2d4_cpu, test/inductor/test_torchinductor.py::CpuTests::test_mixed_mm_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_bessel_j1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_hermite_polynomial_he_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_multigammaln_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_shifted_chebyshev_polynomial_t_cpu, test/inductor/test_torchinductor.py::CpuTests::test_randint_cpu, test/inductor/test_torchinductor.py::CpuTests::test_roi_align_cpu, test/inductor/test_torchinductor.py::CpuTests::test_shape_padding_cpu, test/inductor/test_torchinductor.py::CpuTests::test_slice_mutation1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_sum_dtype_cpu, test/inductor/test_torchinductor.py::CpuTests::test_unbacked_floordiv_simplify_cpu, test/inductor/test_torchinductor.py::CpuTests::test_var_mean_cpu, test/inductor/test_torchinductor.py::CpuTests::test_views1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_where_with_logical_op_cpu, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_broadcast1_broadcast2, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_dense_transposed, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_double_int, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_int_transposed, test/inductor/test_torchinductor.py::GPUTests::test_argmax_argmin3_cuda, test/inductor/test_torchinductor.py::GPUTests::test_avg_pool3d_backward2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_avg_pool3d_backward_cuda, test/inductor/test_torchinductor.py::GPUTests::test_both_scalars_cuda, test/inductor/test_torchinductor.py::GPUTests::test_cat_single_empty_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout3_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_float16_float16_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_int16_float64_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_uint8_bfloat16_cuda, test/inductor/test_torchinductor.py::GPUTests::test_embedding_cuda, test/inductor/test_torchinductor.py::GPUTests::test_functionalize_rng_wrappers_cuda, test/inductor/test_torchinductor.py::GPUTests::test_gather3_cuda, test/inductor/test_torchinductor.py::GPUTests::test_index_put_reinplace_cuda, test/inductor/test_torchinductor.py::GPUTests::test_indirect_load_broadcast_cuda, test/inductor/test_torchinductor.py::GPUTests::test_masked_fill_cuda, test/inductor/test_torchinductor.py::GPUTests::test_max_pool2d4_cuda, test/inductor/test_torchinductor.py::GPUTests::test_multi_threading_cuda, test/inductor/test_torchinductor.py::GPUTests::test_no_op_reduction_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_multigammaln_cuda, test/inductor/test_torchinductor.py::GPUTests::test_require_stride_expanded_cuda, test/inductor/test_torchinductor.py::GPUTests::test_sdpa_unaligned_mask_cuda, test/inductor/test_torchinductor.py::GPUTests::test_slice_scatter_reinplace_cuda, test/inductor/test_torchinductor.py::GPUTests::test_split_cumsum_cuda, test/inductor/test_torchinductor.py::GPUTests::test_triu_cuda, test/inductor/test_torchinductor.py::GPUTests::test_where_broadcast_cuda 2024-12-18T01:26:47.4635469Z 2024-12-18T01:26:51.8420139Z Running inductor/test_torchinductor 17/27 ... [2024-12-18 01:26:51.841432] 2024-12-18T01:26:51.8421011Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T01:26:51.8423769Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'not serial', '--shard-id=17', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:26:51.841822] 2024-12-18T01:34:53.6891769Z 2024-12-18T01:34:53.6892975Z inductor/test_torchinductor 15/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_15.27_b80fba20eb260bcf_.log 2024-12-18T01:34:53.6908182Z Running 50 items in this shard: test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_broadcast2_transposed, test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_int_transposed, test/inductor/test_torchinductor.py::CpuTests::test_const_int32_to_float_cpu, test/inductor/test_torchinductor.py::CpuTests::test_constant_pad_2d_cpu, test/inductor/test_torchinductor.py::CpuTests::test_cumsum_inf_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dense_mask_index_cpu, test/inductor/test_torchinductor.py::CpuTests::test_expanded_reduction_cpu, test/inductor/test_torchinductor.py::CpuTests::test_fmod_cpu, test/inductor/test_torchinductor.py::CpuTests::test_index_propagation_abs_cpu, test/inductor/test_torchinductor.py::CpuTests::test_linear_mixed_dtype_cpu, test/inductor/test_torchinductor.py::CpuTests::test_linspace4_cpu, test/inductor/test_torchinductor.py::CpuTests::test_mixed_mm2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_erfc_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_gammaincc_cpu, test/inductor/test_torchinductor.py::CpuTests::test_profiler_mark_wrapper_call_cpu, test/inductor/test_torchinductor.py::CpuTests::test_reinterpret_dtypeview_cpu, test/inductor/test_torchinductor.py::CpuTests::test_resize_as_cpu, test/inductor/test_torchinductor.py::CpuTests::test_scatter_reduce2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_upsample_nearest3d_cpu, test/inductor/test_torchinductor.py::CpuTests::test_view_on_aliased_cpu, test/inductor/test_torchinductor.py::CpuTests::test_xblock_divides_xnumel_cpu, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_broadcast1_int, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_double_transposed, test/inductor/test_torchinductor.py::GPUTests::test_arange4_cuda, test/inductor/test_torchinductor.py::GPUTests::test_clone_cuda, test/inductor/test_torchinductor.py::GPUTests::test_conv_backward_cuda, test/inductor/test_torchinductor.py::GPUTests::test_cumsum_zero_dim_cuda, test/inductor/test_torchinductor.py::GPUTests::test_custom_op_1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_custom_op_3_cuda, test/inductor/test_torchinductor.py::GPUTests::test_data_type_propogation_cuda, test/inductor/test_torchinductor.py::GPUTests::test_div_zero_dim_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_bfloat16_int64_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_float32_float32_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_int64_int16_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_uint8_int16_cuda, test/inductor/test_torchinductor.py::GPUTests::test_expanded_reduction_cuda, test/inductor/test_torchinductor.py::GPUTests::test_float16_to_int16_cuda, test/inductor/test_torchinductor.py::GPUTests::test_index1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_inplace_add_cuda, test/inductor/test_torchinductor.py::GPUTests::test_like_rands_cuda, test/inductor/test_torchinductor.py::GPUTests::test_max_pool2d3_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_gammainc_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_laguerre_polynomial_l_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_shifted_chebyshev_polynomial_w_cuda, test/inductor/test_torchinductor.py::GPUTests::test_scatter4_cuda, test/inductor/test_torchinductor.py::GPUTests::test_signbit_cuda, test/inductor/test_torchinductor.py::GPUTests::test_slice4_cuda, test/inductor/test_torchinductor.py::GPUTests::test_slice_view_with_graph_break_cuda, test/inductor/test_torchinductor.py::GPUTests::test_to_device_cuda, test/inductor/test_torchinductor.py::GPUTests::test_upsample_bilinear2d_b_cuda 2024-12-18T01:34:53.6922497Z 2024-12-18T01:34:58.0848829Z Running inductor/test_torchinductor 18/27 ... [2024-12-18 01:34:58.084242] 2024-12-18T01:34:58.0849405Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T01:34:58.0851241Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'not serial', '--shard-id=18', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:34:58.084710] 2024-12-18T01:35:19.9361593Z 2024-12-18T01:35:19.9362701Z inductor/test_torchinductor 17/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_17.27_f850c9a23d685c8d_.log 2024-12-18T01:35:19.9384432Z Running 69 items in this shard: test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_broadcast1_broadcast2, test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_broadcast3_int, test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_dense_broadcast3, test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_dense_int, test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_int_broadcast1, test/inductor/test_torchinductor.py::CpuTests::test_bitwise3_cpu, test/inductor/test_torchinductor.py::CpuTests::test_cauchy_cpu, test/inductor/test_torchinductor.py::CpuTests::test_compar_cpu, test/inductor/test_torchinductor.py::CpuTests::test_computed_buffer_inlining_cpu, test/inductor/test_torchinductor.py::CpuTests::test_conv2d_backward_channels_last_cpu, test/inductor/test_torchinductor.py::CpuTests::test_custom_op_fixed_layout_channels_last_cpu, test/inductor/test_torchinductor.py::CpuTests::test_custom_op_unbacked_symints_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_float64_float16_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_fusion_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_int16_int64_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_uint8_bfloat16_cpu, test/inductor/test_torchinductor.py::CpuTests::test_float_index_expression_cpu, test/inductor/test_torchinductor.py::CpuTests::test_full_like_cpu, test/inductor/test_torchinductor.py::CpuTests::test_gather2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_hardtanh_cpu, test/inductor/test_torchinductor.py::CpuTests::test_index_propagation_floordiv_cpu, test/inductor/test_torchinductor.py::CpuTests::test_multilayer_var_lowp_cpu, test/inductor/test_torchinductor.py::CpuTests::test_nll_loss_forward_cpu, test/inductor/test_torchinductor.py::CpuTests::test_no_op_reduction_cpu, test/inductor/test_torchinductor.py::CpuTests::test_nonzero_unbacked_refinement_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_gammaln_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_log_ndtr_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_modified_bessel_k0_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_sinc_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_spherical_bessel_j0_cpu, test/inductor/test_torchinductor.py::CpuTests::test_randint_int64_mod_cpu, test/inductor/test_torchinductor.py::CpuTests::test_reduction2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_remove_noop_copy_cpu, test/inductor/test_torchinductor.py::CpuTests::test_shape_prop_torch_ones_cpu, test/inductor/test_torchinductor.py::CpuTests::test_slice_scatter3_cpu, test/inductor/test_torchinductor.py::CpuTests::test_sort_bool_cpu, test/inductor/test_torchinductor.py::CpuTests::test_squeeze2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_stack_cpu, test/inductor/test_torchinductor.py::CpuTests::test_view_as_complex_cpu, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_broadcast1_strided, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_dense_int, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_strided_broadcast3, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_transposed_double, test/inductor/test_torchinductor.py::GPUTests::test__unsafe_masked_index_put_accumulate_cuda, test/inductor/test_torchinductor.py::GPUTests::test_argmax_argmin_with_duplicates_cuda, test/inductor/test_torchinductor.py::GPUTests::test_avg_pool2d5_cuda, test/inductor/test_torchinductor.py::GPUTests::test_bitwise_cuda, test/inductor/test_torchinductor.py::GPUTests::test_bucketize_add_autotune_cuda, test/inductor/test_torchinductor.py::GPUTests::test_cat_upcasting_cuda, test/inductor/test_torchinductor.py::GPUTests::test_chunk_recompiles_cuda, test/inductor/test_torchinductor.py::GPUTests::test_complex_fallback_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_float32_bfloat16_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_uint8_int32_cuda, test/inductor/test_torchinductor.py::GPUTests::test_empty2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_fmin_fmax_cuda, test/inductor/test_torchinductor.py::GPUTests::test_index_put_index_cuda, test/inductor/test_torchinductor.py::GPUTests::test_isinf2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_kernel_names_cuda, test/inductor/test_torchinductor.py::GPUTests::test_lgamma_cuda, test/inductor/test_torchinductor.py::GPUTests::test_misaligned_address_issue1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_mutable_custom_op_fixed_layout_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_modified_bessel_i0_cuda, test/inductor/test_torchinductor.py::GPUTests::test_reduction_config_limit_cuda, test/inductor/test_torchinductor.py::GPUTests::test_sign_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_slice3_cuda, test/inductor/test_torchinductor.py::GPUTests::test_slice_mutation3_cuda, test/inductor/test_torchinductor.py::GPUTests::test_split_cumsum_index_cuda, test/inductor/test_torchinductor.py::GPUTests::test_unbind_cuda, test/inductor/test_torchinductor.py::GPUTests::test_zero_element_mutation_cuda 2024-12-18T01:35:19.9404364Z 2024-12-18T01:35:24.3367153Z Running inductor/test_torchinductor 19/27 ... [2024-12-18 01:35:24.336148] 2024-12-18T01:35:24.3367679Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T01:35:24.3370585Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'not serial', '--shard-id=19', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:35:24.336590] 2024-12-18T01:35:48.6242098Z 2024-12-18T01:35:48.6244051Z inductor/test_torchinductor 16/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_16.27_cdac7bdc05146e80_.log 2024-12-18T01:35:48.6261570Z Running 56 items in this shard: test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_broadcast1_broadcast1, test/inductor/test_torchinductor.py::CpuTests::test_bernoulli2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_buffer_copied_in_graph_with_different_shapes_cpu, test/inductor/test_torchinductor.py::CpuTests::test_builtins_round_int_ndigits_zero_cpu, test/inductor/test_torchinductor.py::CpuTests::test_conv2d_channels_last_cpu, test/inductor/test_torchinductor.py::CpuTests::test_div7_cpu, test/inductor/test_torchinductor.py::CpuTests::test_div_softmax_symfloat_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_float32_uint8_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_float64_uint8_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_int16_uint8_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_uint8_int8_cpu, test/inductor/test_torchinductor.py::CpuTests::test_full_truncation_cpu, test/inductor/test_torchinductor.py::CpuTests::test_indirect_load_broadcast_cpu, test/inductor/test_torchinductor.py::CpuTests::test_issue102546_cpu, test/inductor/test_torchinductor.py::CpuTests::test_mm_views_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_chebyshev_polynomial_u_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pow1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_reduction5_cpu, test/inductor/test_torchinductor.py::CpuTests::test_scatter_bf16_cpu, test/inductor/test_torchinductor.py::CpuTests::test_sdpa_unaligned_mask_cpu, test/inductor/test_torchinductor.py::CpuTests::test_slice_scatter2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_sum2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_tmp_not_defined_issue1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_unfold_zero_dimension_tensor_cpu, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_strided_broadcast1, test/inductor/test_torchinductor.py::GPUTests::test_as_strided_cuda, test/inductor/test_torchinductor.py::GPUTests::test_bernoulli1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_bmm1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_builtins_round_float_ndigits_zero_cuda, test/inductor/test_torchinductor.py::GPUTests::test_builtins_round_int_ndigits_zero_cuda, test/inductor/test_torchinductor.py::GPUTests::test_config_option_dont_assume_alignment_recompiles_cuda, test/inductor/test_torchinductor.py::GPUTests::test_const_int32_to_float_cuda, test/inductor/test_torchinductor.py::GPUTests::test_constant_pad_fill_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_cumsum_cuda, test/inductor/test_torchinductor.py::GPUTests::test_div6_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_uint8_float16_cuda, test/inductor/test_torchinductor.py::GPUTests::test_fallback_mutable_op_basic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_fractional_max_pool2d4_cuda, test/inductor/test_torchinductor.py::GPUTests::test_horizonal_fusion2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_index_put4_cuda, test/inductor/test_torchinductor.py::GPUTests::test_logsumexp_cuda, test/inductor/test_torchinductor.py::GPUTests::test_matmul_layer_norm_cuda, test/inductor/test_torchinductor.py::GPUTests::test_narrow_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_chebyshev_polynomial_u_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_exp2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_relu_cuda, test/inductor/test_torchinductor.py::GPUTests::test_scalar_output_cuda, test/inductor/test_torchinductor.py::GPUTests::test_scatter_reduce1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_scatter_reduce3_cuda, test/inductor/test_torchinductor.py::GPUTests::test_setitem_with_int_parameter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_sgn_cuda, test/inductor/test_torchinductor.py::GPUTests::test_split_cumprod_low_prec_cuda, test/inductor/test_torchinductor.py::TritonCodeGenTests::test_computed_indirect_mask, test/inductor/test_torchinductor.py::TritonCodeGenTests::test_evict_last_non_coalesced_loads, test/inductor/test_torchinductor.py::TritonCodeGenTests::test_optimize_indexing_assert 2024-12-18T01:35:48.6277567Z 2024-12-18T01:35:53.0383520Z Running inductor/test_torchinductor 20/27 ... [2024-12-18 01:35:53.037709] 2024-12-18T01:35:53.0384015Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T01:35:53.0385102Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'not serial', '--shard-id=20', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:35:53.038129] 2024-12-18T01:46:23.6074701Z 2024-12-18T01:46:23.6078610Z inductor/test_torchinductor 19/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_19.27_a693145ddcd5b297_.log 2024-12-18T01:46:23.6100012Z Running 60 items in this shard: test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_dense_strided, test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_transposed_broadcast2, test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_transposed_broadcast3, test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_transposed_dense, test/inductor/test_torchinductor.py::CpuTests::test_adaptive_avg_pool2d_low_prec_cpu, test/inductor/test_torchinductor.py::CpuTests::test_aoti_eager_dtype_device_layout_cpu, test/inductor/test_torchinductor.py::CpuTests::test_aoti_eager_override_registration_cpu, test/inductor/test_torchinductor.py::CpuTests::test_argmax_argmin_with_duplicates_cpu, test/inductor/test_torchinductor.py::CpuTests::test_as_strided_scatter_cpu, test/inductor/test_torchinductor.py::CpuTests::test_avg_pool2d5_cpu, test/inductor/test_torchinductor.py::CpuTests::test_chunk_recompiles_cpu, test/inductor/test_torchinductor.py::CpuTests::test_convolution1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_cumsum_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_bfloat16_bfloat16_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_int16_int8_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_int64_int32_cpu, test/inductor/test_torchinductor.py::CpuTests::test_embedding_bag_cpu, test/inductor/test_torchinductor.py::CpuTests::test_fft_real_input_cpu, test/inductor/test_torchinductor.py::CpuTests::test_glu_cpu, test/inductor/test_torchinductor.py::CpuTests::test_kernel_names_cpu, test/inductor/test_torchinductor.py::CpuTests::test_log2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_mixed_mm3_cpu, test/inductor/test_torchinductor.py::CpuTests::test_multilayer_var_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pow2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_reduction_config_limit_cpu, test/inductor/test_torchinductor.py::CpuTests::test_scatter1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_scatter4_cpu, test/inductor/test_torchinductor.py::CpuTests::test_sdpa_unaligned_mask_freezing_cpu, test/inductor/test_torchinductor.py::CpuTests::test_to_device_cpu, test/inductor/test_torchinductor.py::CpuTests::test_vertical_fusion1_cpu, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_broadcast1_broadcast1, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_strided_transposed, test/inductor/test_torchinductor.py::GPUTests::test_aoti_eager_dtype_device_layout_cuda, test/inductor/test_torchinductor.py::GPUTests::test_avg_pool2d8_cuda, test/inductor/test_torchinductor.py::GPUTests::test_builtins_round_float_ndigits_neg_cuda, test/inductor/test_torchinductor.py::GPUTests::test_cat_cuda, test/inductor/test_torchinductor.py::GPUTests::test_div_by_zero_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_bfloat16_float32_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_bfloat16_int16_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_int64_int64_cuda, test/inductor/test_torchinductor.py::GPUTests::test_flip_cuda, test/inductor/test_torchinductor.py::GPUTests::test_hardsigmoid_cuda, test/inductor/test_torchinductor.py::GPUTests::test_issue102546_cuda, test/inductor/test_torchinductor.py::GPUTests::test_linspace2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_mm_views_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_digamma_cuda, test/inductor/test_torchinductor.py::GPUTests::test_randint_int64_mod_cuda, test/inductor/test_torchinductor.py::GPUTests::test_reduction4_cuda, test/inductor/test_torchinductor.py::GPUTests::test_rsqrt_dynamic_shapes_cuda, test/inductor/test_torchinductor.py::GPUTests::test_sdpa_prefer_nd_tiling_True_use_block_ptr_False_cuda, test/inductor/test_torchinductor.py::GPUTests::test_sgn_extremal_cuda, test/inductor/test_torchinductor.py::GPUTests::test_shape_prop_torch_ones_cuda, test/inductor/test_torchinductor.py::GPUTests::test_split_cumprod_cuda, test/inductor/test_torchinductor.py::GPUTests::test_sum_keepdims_cuda, test/inductor/test_torchinductor.py::GPUTests::test_unspec_inputs_float16_cuda, test/inductor/test_torchinductor.py::GPUTests::test_unsqueeze_cuda, test/inductor/test_torchinductor.py::GPUTests::test_unsqueeze_inplace_cuda, test/inductor/test_torchinductor.py::GPUTests::test_view_uint8_through_differing_bitwidths_cuda, test/inductor/test_torchinductor.py::NanCheckerTest::test_nan_checker_pass, test/inductor/test_torchinductor.py::TestFull::test_full_dtype 2024-12-18T01:46:23.6118772Z 2024-12-18T01:46:28.0247750Z Running inductor/test_torchinductor 21/27 ... [2024-12-18 01:46:28.024095] 2024-12-18T01:46:28.0248242Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T01:46:28.0249369Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'not serial', '--shard-id=21', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:46:28.024511] 2024-12-18T01:47:13.2240027Z 2024-12-18T01:47:13.2245740Z inductor/test_torchinductor 18/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_18.27_f181e841249877f8_.log 2024-12-18T01:47:13.2264786Z Running 61 items in this shard: test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_broadcast1_double, test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_broadcast1_int, test/inductor/test_torchinductor.py::CpuTests::test_avg_pool2d4_cpu, test/inductor/test_torchinductor.py::CpuTests::test_buffer_copied_in_graph_cpu, test/inductor/test_torchinductor.py::CpuTests::test_builtins_round_float_ndigits_neg_cpu, test/inductor/test_torchinductor.py::CpuTests::test_conv3d_channels_last_cpu, test/inductor/test_torchinductor.py::CpuTests::test_data_type_propogation_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dropout3_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_float16_bfloat16_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_uint8_float16_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_uint8_float64_cpu, test/inductor/test_torchinductor.py::CpuTests::test_embedding_bag_byte_unpack_cpu, test/inductor/test_torchinductor.py::CpuTests::test_exp_cpu, test/inductor/test_torchinductor.py::CpuTests::test_functionalize_rng_wrappers_cpu, test/inductor/test_torchinductor.py::CpuTests::test_index_propagation_device_assert_masked_cpu, test/inductor/test_torchinductor.py::CpuTests::test_index_put1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_index_put_failed_reinplace_cpu, test/inductor/test_torchinductor.py::CpuTests::test_index_put_fallback2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_index_tensor_cpu, test/inductor/test_torchinductor.py::CpuTests::test_input_mutation5_cpu, test/inductor/test_torchinductor.py::CpuTests::test_l1_loss_cpu, test/inductor/test_torchinductor.py::CpuTests::test_like_rands2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_log_softmax_cpu, test/inductor/test_torchinductor.py::CpuTests::test_masked_fill_cpu, test/inductor/test_torchinductor.py::CpuTests::test_mutations_loop_fusion_cpu, test/inductor/test_torchinductor.py::CpuTests::test_remove_no_ops_cpu, test/inductor/test_torchinductor.py::CpuTests::test_resize_cpu, test/inductor/test_torchinductor.py::CpuTests::test_scaled_dot_product_efficient_attention_cpu, test/inductor/test_torchinductor.py::CpuTests::test_slice_scatter4_cpu, test/inductor/test_torchinductor.py::CpuTests::test_slice_view_with_graph_break_cpu, test/inductor/test_torchinductor.py::CpuTests::test_to_memory_format_cpu, test/inductor/test_torchinductor.py::CpuTests::test_zero_element_mutation_cpu, test/inductor/test_torchinductor.py::GPUTests::test_add_complex4_cuda, test/inductor/test_torchinductor.py::GPUTests::test_arange5_cuda, test/inductor/test_torchinductor.py::GPUTests::test_argmax_argmin1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_computed_buffer_inlining_cuda, test/inductor/test_torchinductor.py::GPUTests::test_cumsum_pattern_matcher_issue_cuda, test/inductor/test_torchinductor.py::GPUTests::test_custom_scan_op_cuda, test/inductor/test_torchinductor.py::GPUTests::test_div8_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_float64_float32_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_float64_int32_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_int16_float32_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_int32_int64_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_int64_float16_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_int8_bfloat16_cuda, test/inductor/test_torchinductor.py::GPUTests::test_full_truncation_cuda, test/inductor/test_torchinductor.py::GPUTests::test_input_mutation4_cuda, test/inductor/test_torchinductor.py::GPUTests::test_input_mutation5_cuda, test/inductor/test_torchinductor.py::GPUTests::test_max_pool2d2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_min_max_reduction_nan_cuda, test/inductor/test_torchinductor.py::GPUTests::test_mul_softmax_symfloat_cuda, test/inductor/test_torchinductor.py::GPUTests::test_nan_to_num_cuda, test/inductor/test_torchinductor.py::GPUTests::test_permute1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_expm1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_log_ndtr_cuda, test/inductor/test_torchinductor.py::GPUTests::test_scalar_cpu_tensor_arg_cuda, test/inductor/test_torchinductor.py::GPUTests::test_softmax_one_kernel_loop_cuda, test/inductor/test_torchinductor.py::GPUTests::test_strided_inputs_cuda, test/inductor/test_torchinductor.py::GPUTests::test_unbacked_floordiv_simplify_errors_cuda, test/inductor/test_torchinductor.py::TritonCodeGenTests::test_constant_folding_deallocation 2024-12-18T01:47:13.2282280Z 2024-12-18T01:47:17.6370648Z Running inductor/test_torchinductor 22/27 ... [2024-12-18 01:47:17.636374] 2024-12-18T01:47:17.6371217Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T01:47:17.6372402Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'not serial', '--shard-id=22', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:47:17.636825] 2024-12-18T01:47:33.3697005Z 2024-12-18T01:47:33.3698306Z inductor/test_torchinductor 20/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_20.27_a5948e9c16a120d6_.log 2024-12-18T01:47:33.3720634Z Running 76 items in this shard: test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_transposed_int, test/inductor/test_torchinductor.py::CpuTests::test_adaptive_avg_pool2d2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_add_const_int_cpu, test/inductor/test_torchinductor.py::CpuTests::test_avg_pool2d1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_avg_pool3d_backward4_cpu, test/inductor/test_torchinductor.py::CpuTests::test_bernoulli1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_bmm1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_complex_memory_overlap_cpu, test/inductor/test_torchinductor.py::CpuTests::test_consecutive_split_cumprod_cpu, test/inductor/test_torchinductor.py::CpuTests::test_conv_with_as_strided_cpu, test/inductor/test_torchinductor.py::CpuTests::test_convolution5_cpu, test/inductor/test_torchinductor.py::CpuTests::test_div1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_div5_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_bfloat16_float64_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_float32_int32_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_int8_bfloat16_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_uint8_int32_cpu, test/inductor/test_torchinductor.py::CpuTests::test_erfc_cpu, test/inductor/test_torchinductor.py::CpuTests::test_inplace_mixed_dtype_ops_cpu, test/inductor/test_torchinductor.py::CpuTests::test_invalid_operand_issue1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_leaky_relu_cpu, test/inductor/test_torchinductor.py::CpuTests::test_lgamma_cpu, test/inductor/test_torchinductor.py::CpuTests::test_max_pool2d5_cpu, test/inductor/test_torchinductor.py::CpuTests::test_max_pool2d_with_indices_backward4_cpu, test/inductor/test_torchinductor.py::CpuTests::test_max_pool2d_with_indices_backward_cpu, test/inductor/test_torchinductor.py::CpuTests::test_one_hot_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_digamma_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_expit_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_i1e_cpu, test/inductor/test_torchinductor.py::CpuTests::test_reduction1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_slice3_cpu, test/inductor/test_torchinductor.py::CpuTests::test_split_failed_cpu, test/inductor/test_torchinductor.py::CpuTests::test_tmp_not_defined_issue3_cpu, test/inductor/test_torchinductor.py::CpuTests::test_unroll_small_reduction_cpu, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_broadcast2_broadcast1, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_broadcast2_transposed, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_broadcast3_transposed, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_transposed_strided, test/inductor/test_torchinductor.py::GPUTests::test_add_complex3_cuda, test/inductor/test_torchinductor.py::GPUTests::test_addmm_cuda, test/inductor/test_torchinductor.py::GPUTests::test_angle_cuda, test/inductor/test_torchinductor.py::GPUTests::test_aoti_eager_with_persistent_cache_cuda, test/inductor/test_torchinductor.py::GPUTests::test_arange2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_avg_pool2d6_cuda, test/inductor/test_torchinductor.py::GPUTests::test_baddbmm_cuda, test/inductor/test_torchinductor.py::GPUTests::test_batch_norm_2d_cuda, test/inductor/test_torchinductor.py::GPUTests::test_bucketize_cuda, test/inductor/test_torchinductor.py::GPUTests::test_builtins_round_int_ndigits_pos_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_float16_float32_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_float64_int16_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_int8_float16_cuda, test/inductor/test_torchinductor.py::GPUTests::test_fallback_mutable_op_list_cuda, test/inductor/test_torchinductor.py::GPUTests::test_float_index_expression_type_promotion_cuda, test/inductor/test_torchinductor.py::GPUTests::test_floordiv_cuda, test/inductor/test_torchinductor.py::GPUTests::test_int8_weight_only_quant_cuda, test/inductor/test_torchinductor.py::GPUTests::test_large_grid_cuda, test/inductor/test_torchinductor.py::GPUTests::test_large_pointwise_cuda, test/inductor/test_torchinductor.py::GPUTests::test_linear_mixed_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_long_tensor_cuda, test/inductor/test_torchinductor.py::GPUTests::test_max_pool2d7_cuda, test/inductor/test_torchinductor.py::GPUTests::test_multilayer_any_cuda, test/inductor/test_torchinductor.py::GPUTests::test_new_empty_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_gammaln_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pow2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_randn_with_dtype_and_device_cuda, test/inductor/test_torchinductor.py::GPUTests::test_slice_mutation2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_slice_scatter5_cuda, test/inductor/test_torchinductor.py::GPUTests::test_sort_transpose_cuda, test/inductor/test_torchinductor.py::GPUTests::test_split_cuda, test/inductor/test_torchinductor.py::GPUTests::test_split_with_sizes_with_unbacked_symints_cuda, test/inductor/test_torchinductor.py::GPUTests::test_stride_preservation_with_stride_modifying_fx_pass_cuda, test/inductor/test_torchinductor.py::GPUTests::test_sum_int_cuda, test/inductor/test_torchinductor.py::GPUTests::test_transpose_add_cuda, test/inductor/test_torchinductor.py::GPUTests::test_unroll_small_reduction_cuda, test/inductor/test_torchinductor.py::GPUTests::test_upsample_nearest1d_cuda, test/inductor/test_torchinductor.py::TritonCodeGenTests::test_optimize_compute 2024-12-18T01:47:33.3742433Z 2024-12-18T01:47:37.8247495Z Running inductor/test_torchinductor 23/27 ... [2024-12-18 01:47:37.824187] 2024-12-18T01:47:37.8248017Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T01:47:37.8250482Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'not serial', '--shard-id=23', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:47:37.824602] 2024-12-18T01:54:45.9575468Z 2024-12-18T01:54:45.9576491Z inductor/test_torchinductor 21/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_21.27_a6fdd5fbcb39e3ed_.log 2024-12-18T01:54:45.9593406Z Running 47 items in this shard: test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_dense_double, test/inductor/test_torchinductor.py::CpuTests::test_avg_pool2d_backward4_cpu, test/inductor/test_torchinductor.py::CpuTests::test_builtins_round_float_ndigits_zero_cpu, test/inductor/test_torchinductor.py::CpuTests::test_check_stack_no_cycles_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dropout_trivial_0_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_float16_float32_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_float32_float64_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_float64_int16_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_int8_int32_cpu, test/inductor/test_torchinductor.py::CpuTests::test_index_put3_cpu, test/inductor/test_torchinductor.py::CpuTests::test_inplace_add_cpu, test/inductor/test_torchinductor.py::CpuTests::test_max_pool2d_with_indices_backward6_cpu, test/inductor/test_torchinductor.py::CpuTests::test_multi_gpu_device_cpu, test/inductor/test_torchinductor.py::CpuTests::test_rand_like_deterministic_cpu, test/inductor/test_torchinductor.py::CpuTests::test_scatter6_cpu, test/inductor/test_torchinductor.py::CpuTests::test_slice_scatter_reinplace_cpu, test/inductor/test_torchinductor.py::CpuTests::test_strided_inputs_cpu, test/inductor/test_torchinductor.py::CpuTests::test_tanh_cpu, test/inductor/test_torchinductor.py::CpuTests::test_tensor_index_put_slice_cpu, test/inductor/test_torchinductor.py::CpuTests::test_tmp_not_defined_issue2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_unspec_inputs_int64_cpu, test/inductor/test_torchinductor.py::CpuTests::test_zeros_cpu, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_dense_broadcast2, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_strided_int, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_transposed_broadcast3, test/inductor/test_torchinductor.py::GPUTests::test_custom_op_fixed_layout_sequential_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dist_bf16_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_trivial_1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_float16_int64_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_int8_int16_cuda, test/inductor/test_torchinductor.py::GPUTests::test_fill1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_fmod_cuda, test/inductor/test_torchinductor.py::GPUTests::test_index_put_fallback2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_inplace_activations_cuda, test/inductor/test_torchinductor.py::GPUTests::test_inplace_where_pointwise_cuda, test/inductor/test_torchinductor.py::GPUTests::test_input_mutation1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_max_pool2d_with_indices_backward_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_chebyshev_polynomial_w_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_erfinv_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_i0_cuda, test/inductor/test_torchinductor.py::GPUTests::test_reduction5_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_clone_cuda, test/inductor/test_torchinductor.py::GPUTests::test_scatter6_cuda, test/inductor/test_torchinductor.py::GPUTests::test_sdpa_prefer_nd_tiling_False_use_block_ptr_False_cuda, test/inductor/test_torchinductor.py::GPUTests::test_slice1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_sum_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_tensor_index_put_slice_cuda 2024-12-18T01:54:45.9606794Z 2024-12-18T01:54:50.4209213Z Running inductor/test_torchinductor 24/27 ... [2024-12-18 01:54:50.420248] 2024-12-18T01:54:50.4209928Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T01:54:50.4211640Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'not serial', '--shard-id=24', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:54:50.420724] 2024-12-18T01:56:03.7242672Z 2024-12-18T01:56:03.7244112Z inductor/test_torchinductor 22/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_22.27_01e26c3d18b0195b_.log 2024-12-18T01:56:03.7269717Z Running 53 items in this shard: test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_strided_broadcast2, test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_strided_broadcast3, test/inductor/test_torchinductor.py::CpuTests::test_aoti_eager_cache_hit_cpu, test/inductor/test_torchinductor.py::CpuTests::test_avg_pool2d_backward3_cpu, test/inductor/test_torchinductor.py::CpuTests::test_cat_uint8_cpu, test/inductor/test_torchinductor.py::CpuTests::test_cat_unbacked_empty_1d_cpu, test/inductor/test_torchinductor.py::CpuTests::test_cumsum_zero_dim_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_float16_float64_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_int64_float32_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_int8_float32_cpu, test/inductor/test_torchinductor.py::CpuTests::test_flip_cat_cpu, test/inductor/test_torchinductor.py::CpuTests::test_gelu_cpu, test/inductor/test_torchinductor.py::CpuTests::test_index_propagation_cpu, test/inductor/test_torchinductor.py::CpuTests::test_index_propagation_remainder_cpu, test/inductor/test_torchinductor.py::CpuTests::test_input_mutation3_cpu, test/inductor/test_torchinductor.py::CpuTests::test_large_pointwise_cpu, test/inductor/test_torchinductor.py::CpuTests::test_linear2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_linspace1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_erfinv_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_modified_bessel_i1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_shifted_chebyshev_polynomial_v_cpu, test/inductor/test_torchinductor.py::CpuTests::test_rsqrt_cpu, test/inductor/test_torchinductor.py::CpuTests::test_searchsorted_cpu, test/inductor/test_torchinductor.py::CpuTests::test_sizehint_issue1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_slice4_cpu, test/inductor/test_torchinductor.py::CpuTests::test_tensor3_cpu, test/inductor/test_torchinductor.py::CpuTests::test_unspec_inputs_uint8_cpu, test/inductor/test_torchinductor.py::CpuTests::test_unsqueeze_inplace_cpu, test/inductor/test_torchinductor.py::CpuTests::test_zero_dim_reductions_cpu, test/inductor/test_torchinductor.py::GPUTests::test_aoti_eager_support_str_cuda, test/inductor/test_torchinductor.py::GPUTests::test_aoti_eager_with_scalar_cuda, test/inductor/test_torchinductor.py::GPUTests::test_clamp_type_promotion_cuda, test/inductor/test_torchinductor.py::GPUTests::test_custom_scan_would_split_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dense_mask_index_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_bfloat16_uint8_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_int16_int64_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_uint8_int8_cuda, test/inductor/test_torchinductor.py::GPUTests::test_exp2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_fractional_max_pool2d2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_inplace_mixed_dtype_ops_cuda, test/inductor/test_torchinductor.py::GPUTests::test_log2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_max_pool2d_with_indices_backward5_cuda, test/inductor/test_torchinductor.py::GPUTests::test_neg_max_uint8_cuda, test/inductor/test_torchinductor.py::GPUTests::test_nll_loss_backward_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_chebyshev_polynomial_v_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_shifted_chebyshev_polynomial_u_cuda, test/inductor/test_torchinductor.py::GPUTests::test_shape_padding_cuda, test/inductor/test_torchinductor.py::GPUTests::test_should_pad_bench_for_bmm_cuda, test/inductor/test_torchinductor.py::GPUTests::test_single_elem_indirect_cuda, test/inductor/test_torchinductor.py::GPUTests::test_squeeze_varargs_cuda, test/inductor/test_torchinductor.py::GPUTests::test_stack_cuda, test/inductor/test_torchinductor.py::GPUTests::test_upsample_cat_conv_cuda, test/inductor/test_torchinductor.py::GPUTests::test_upsample_nearest3d_cuda 2024-12-18T01:56:03.7293931Z 2024-12-18T01:56:08.1852632Z Running inductor/test_torchinductor 25/27 ... [2024-12-18 01:56:08.184619] 2024-12-18T01:56:08.1853365Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T01:56:08.1855055Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'not serial', '--shard-id=25', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:56:08.185055] 2024-12-18T01:59:15.6341530Z 2024-12-18T01:59:15.6342763Z inductor/test_torchinductor 23/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_23.27_8e95cfaebd8c707a_.log 2024-12-18T01:59:15.6361864Z Running 65 items in this shard: test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_broadcast2_broadcast1, test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_broadcast3_broadcast2, test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_dense_broadcast2, test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_double_broadcast3, test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_double_double, test/inductor/test_torchinductor.py::CpuTests::test_adaptive_avg_pool1d_argmax_cpu, test/inductor/test_torchinductor.py::CpuTests::test_add_complex5_cpu, test/inductor/test_torchinductor.py::CpuTests::test_add_inplace_permuted_cpu, test/inductor/test_torchinductor.py::CpuTests::test_addmm_cpu, test/inductor/test_torchinductor.py::CpuTests::test_as_strided_cpu, test/inductor/test_torchinductor.py::CpuTests::test_bucketize_computed_offsets_cpu, test/inductor/test_torchinductor.py::CpuTests::test_bucketize_cpu, test/inductor/test_torchinductor.py::CpuTests::test_config_option_dont_assume_alignment_recompiles_cpu, test/inductor/test_torchinductor.py::CpuTests::test_cumsum_no_mask_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_float32_float32_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_int16_int16_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_int64_int64_cpu, test/inductor/test_torchinductor.py::CpuTests::test_embedding_cpu, test/inductor/test_torchinductor.py::CpuTests::test_empty1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_expm1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_inductor_assert_cpu, test/inductor/test_torchinductor.py::CpuTests::test_linear1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_max_pool2d2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_misaligned_address_issue1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_permute2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_exp2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_psi_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_zeta_cpu, test/inductor/test_torchinductor.py::CpuTests::test_scatter_reduce3_cpu, test/inductor/test_torchinductor.py::CpuTests::test_sign_dtype_cpu, test/inductor/test_torchinductor.py::CpuTests::test_unspec_inputs_int32_cpu, test/inductor/test_torchinductor.py::CpuTests::test_upsample_bicubic2d_cpu, test/inductor/test_torchinductor.py::GPUTests::test_abs_cuda, test/inductor/test_torchinductor.py::GPUTests::test_adaptive_avg_pool2d2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_aliased_buffer_reuse_cuda, test/inductor/test_torchinductor.py::GPUTests::test_aoti_eager_cache_hit_cuda, test/inductor/test_torchinductor.py::GPUTests::test_argmax_to_float_cuda, test/inductor/test_torchinductor.py::GPUTests::test_bitwise3_cuda, test/inductor/test_torchinductor.py::GPUTests::test_cat_empty_cuda, test/inductor/test_torchinductor.py::GPUTests::test_clamp_cuda, test/inductor/test_torchinductor.py::GPUTests::test_conv3d_cuda, test/inductor/test_torchinductor.py::GPUTests::test_convolution5_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_float64_int8_cuda, test/inductor/test_torchinductor.py::GPUTests::test_exact_stride_cuda, test/inductor/test_torchinductor.py::GPUTests::test_gather_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_hardtanh_cuda, test/inductor/test_torchinductor.py::GPUTests::test_index_propagation_flip_cuda, test/inductor/test_torchinductor.py::GPUTests::test_index_propagation_nested_indirect_indexing_cuda, test/inductor/test_torchinductor.py::GPUTests::test_log1p_cuda, test/inductor/test_torchinductor.py::GPUTests::test_mixed_mm2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_sinc_cuda, test/inductor/test_torchinductor.py::GPUTests::test_scheduler_vertical_fusion1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_select_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_sort_cuda, test/inductor/test_torchinductor.py::GPUTests::test_sum1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_tanh_cuda, test/inductor/test_torchinductor.py::GPUTests::test_tensor1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_tmp_not_defined_issue2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_unbacked_floordiv_simplify_cuda, test/inductor/test_torchinductor.py::GPUTests::test_unspec_inputs_int64_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_cuda, test/inductor/test_torchinductor.py::GPUTests::test_vertical_fusion1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_views6_cuda, test/inductor/test_torchinductor.py::TritonCodeGenTests::test_bandwidth_profiler, test/inductor/test_torchinductor.py::TritonCodeGenTests::test_sdpa_inference_mode_aot_compile 2024-12-18T01:59:15.6379805Z 2024-12-18T01:59:20.1374114Z Running inductor/test_torchinductor 26/27 ... [2024-12-18 01:59:20.136748] 2024-12-18T01:59:20.1374610Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T01:59:20.1375826Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'not serial', '--shard-id=26', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:59:20.137222] 2024-12-18T02:05:23.9233035Z 2024-12-18T02:05:23.9234243Z inductor/test_torchinductor 25/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_25.27_433758092152d7c2_.log 2024-12-18T02:05:23.9255481Z Running 63 items in this shard: test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_dense_dense, test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_int_int, test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_transposed_double, test/inductor/test_torchinductor.py::CpuTests::test_aoti_eager_with_scalar_cpu, test/inductor/test_torchinductor.py::CpuTests::test_argmax_argmin3_cpu, test/inductor/test_torchinductor.py::CpuTests::test_clamp_cpu, test/inductor/test_torchinductor.py::CpuTests::test_config_option_dont_assume_alignment_cudagraphs_cpu, test/inductor/test_torchinductor.py::CpuTests::test_cudnn_rnn_cpu, test/inductor/test_torchinductor.py::CpuTests::test_custom_op_2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_custom_scan_op_cpu, test/inductor/test_torchinductor.py::CpuTests::test_div9_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtype_sympy_expr_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_int8_float64_cpu, test/inductor/test_torchinductor.py::CpuTests::test_float32_to_int32_cpu, test/inductor/test_torchinductor.py::CpuTests::test_gather_scatter_cpu, test/inductor/test_torchinductor.py::CpuTests::test_grid_sampler_2d_cpu, test/inductor/test_torchinductor.py::CpuTests::test_inplace_activations_cpu, test/inductor/test_torchinductor.py::CpuTests::test_input_mutation1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_input_mutation2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_large_grid_cpu, test/inductor/test_torchinductor.py::CpuTests::test_multi_gpu_recompile_on_index_cpu, test/inductor/test_torchinductor.py::CpuTests::test_new_ones_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_expm1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_modified_bessel_k1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_scaled_modified_bessel_k0_cpu, test/inductor/test_torchinductor.py::CpuTests::test_polar_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pow_symfloat_cpu, test/inductor/test_torchinductor.py::CpuTests::test_randint_kernel_count_cpu, test/inductor/test_torchinductor.py::CpuTests::test_scatter_reduce1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_sdpa_prefer_nd_tiling_False_use_block_ptr_True_cpu, test/inductor/test_torchinductor.py::CpuTests::test_setitem_with_int_parameter_cpu, test/inductor/test_torchinductor.py::CpuTests::test_single_elem_cpu, test/inductor/test_torchinductor.py::CpuTests::test_unspec_inputs_float32_cpu, test/inductor/test_torchinductor.py::CpuTests::test_unspec_inputs_int8_cpu, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_broadcast2_int, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_broadcast3_broadcast3, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_dense_double, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_strided_strided, test/inductor/test_torchinductor.py::GPUTests::test_adaptive_avg_pool_with_output_size_0_cuda, test/inductor/test_torchinductor.py::GPUTests::test_add_inplace_permuted_cuda, test/inductor/test_torchinductor.py::GPUTests::test_arange1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_div_prim_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_float16_uint8_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_int16_int8_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_int32_uint8_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_int8_float32_cuda, test/inductor/test_torchinductor.py::GPUTests::test_index2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_inductor_assert_cuda, test/inductor/test_torchinductor.py::GPUTests::test_l1_loss_cuda, test/inductor/test_torchinductor.py::GPUTests::test_list_clearing_cuda, test/inductor/test_torchinductor.py::GPUTests::test_neg_index_cuda, test/inductor/test_torchinductor.py::GPUTests::test_one_hot_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_bessel_j0_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_shifted_chebyshev_polynomial_v_cuda, test/inductor/test_torchinductor.py::GPUTests::test_reuse_buffers_with_aliasing_cuda, test/inductor/test_torchinductor.py::GPUTests::test_round_cuda, test/inductor/test_torchinductor.py::GPUTests::test_scaled_dot_product_attention_cuda, test/inductor/test_torchinductor.py::GPUTests::test_slice2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_slice_mutation1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_sort_bool_cuda, test/inductor/test_torchinductor.py::GPUTests::test_uint4x2_mixed_mm_cuda, test/inductor/test_torchinductor.py::TritonCodeGenTests::test_ctr_not_moved_to_cuda_when_used_in_index_put, test/inductor/test_torchinductor.py::TritonCodeGenTests::test_evict_last_non_coalesced_loads_block_ptr 2024-12-18T02:05:23.9275337Z 2024-12-18T02:05:28.3396790Z Running inductor/test_torchinductor 27/27 ... [2024-12-18 02:05:28.339065] 2024-12-18T02:05:28.3397347Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T02:05:28.3399177Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor.py', '-m', 'not serial', '--shard-id=27', '--num-shards=27', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 02:05:28.339488] 2024-12-18T02:07:46.9040022Z 2024-12-18T02:07:46.9041035Z inductor/test_torchinductor 24/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_24.27_4f59cacd7a06782e_.log 2024-12-18T02:07:46.9065443Z Running 69 items in this shard: test/inductor/test_torchinductor.py::CpuTests::test__unsafe_masked_index_put_accumulate_cpu, test/inductor/test_torchinductor.py::CpuTests::test_adaptive_max_pool2d1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_argmax_argmin1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_bmm2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_cat_upcasting_cpu, test/inductor/test_torchinductor.py::CpuTests::test_clamp_type_promotion_cpu, test/inductor/test_torchinductor.py::CpuTests::test_concat_add_inplace_cpu, test/inductor/test_torchinductor.py::CpuTests::test_custom_op_fixed_layout_sequential_cpu, test/inductor/test_torchinductor.py::CpuTests::test_div_by_zero_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dropout_trivial_1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_int32_bfloat16_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_int64_bfloat16_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dtypeview_uint8_uint8_cpu, test/inductor/test_torchinductor.py::CpuTests::test_generate_rand_fp8_cpu, test/inductor/test_torchinductor.py::CpuTests::test_horizonal_fusion1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_index2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_index3_cpu, test/inductor/test_torchinductor.py::CpuTests::test_index_dynamic_shapes_cpu, test/inductor/test_torchinductor.py::CpuTests::test_index_put2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_int8_weight_only_quant_cpu, test/inductor/test_torchinductor.py::CpuTests::test_isinf_cpu, test/inductor/test_torchinductor.py::CpuTests::test_like_rands_cpu, test/inductor/test_torchinductor.py::CpuTests::test_list_clearing_cpu, test/inductor/test_torchinductor.py::CpuTests::test_masked_scatter_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_chebyshev_polynomial_w_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_i1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_shifted_chebyshev_polynomial_w_cpu, test/inductor/test_torchinductor.py::CpuTests::test_reduction3_cpu, test/inductor/test_torchinductor.py::CpuTests::test_repeat_interleave_cpu, test/inductor/test_torchinductor.py::CpuTests::test_rsqrt_dynamic_shapes_cpu, test/inductor/test_torchinductor.py::CpuTests::test_sigmoid_cpu, test/inductor/test_torchinductor.py::CpuTests::test_triu_cpu, test/inductor/test_torchinductor.py::CpuTests::test_uint4x2_mixed_mm_cpu, test/inductor/test_torchinductor.py::CpuTests::test_upsample_nearest2d_cpu, test/inductor/test_torchinductor.py::CpuTests::test_vectorized_ops_masked_var_novec_cpu, test/inductor/test_torchinductor.py::CpuTests::test_views6_cpu, test/inductor/test_torchinductor.py::CpuTests::test_views7_cpu, test/inductor/test_torchinductor.py::GPUTests::test_cat_uint8_cuda, test/inductor/test_torchinductor.py::GPUTests::test_compar_cuda, test/inductor/test_torchinductor.py::GPUTests::test_constant_pad_3d_cuda, test/inductor/test_torchinductor.py::GPUTests::test_conv3d_channels_last_cuda, test/inductor/test_torchinductor.py::GPUTests::test_conv_bn_fuse_cuda, test/inductor/test_torchinductor.py::GPUTests::test_cumsum_inf_cuda, test/inductor/test_torchinductor.py::GPUTests::test_div4_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_bfloat16_int32_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_float16_int8_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_float64_bfloat16_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_float64_float64_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_uint8_float32_cuda, test/inductor/test_torchinductor.py::GPUTests::test_index_put1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_index_put_as_masked_fill_cuda, test/inductor/test_torchinductor.py::GPUTests::test_input_mutation2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_insignificant_strides_cuda, test/inductor/test_torchinductor.py::GPUTests::test_like_channels_last_cuda, test/inductor/test_torchinductor.py::GPUTests::test_like_rands3_cuda, test/inductor/test_torchinductor.py::GPUTests::test_linear1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_log_fp64_cuda, test/inductor/test_torchinductor.py::GPUTests::test_logcumsumexp_zero_dim_cuda, test/inductor/test_torchinductor.py::GPUTests::test_max_pool2d8_cuda, test/inductor/test_torchinductor.py::GPUTests::test_multilayer_sum_low_prec_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_i1e_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_modified_bessel_i1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_randn_generator_cuda, test/inductor/test_torchinductor.py::GPUTests::test_searchsorted_cuda, test/inductor/test_torchinductor.py::GPUTests::test_silu_cuda, test/inductor/test_torchinductor.py::GPUTests::test_sum5_cuda, test/inductor/test_torchinductor.py::GPUTests::test_view_as_real_cuda, test/inductor/test_torchinductor.py::GPUTests::test_xblock_divides_xnumel_cuda 2024-12-18T02:07:46.9087259Z 2024-12-18T02:08:16.5950345Z 2024-12-18T02:08:16.5951378Z inductor/test_torchinductor 26/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_26.27_7c92f821f4251d29_.log 2024-12-18T02:08:16.5969084Z Running 59 items in this shard: test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_broadcast2_broadcast2, test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_broadcast3_strided, test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_double_dense, test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_int_double, test/inductor/test_torchinductor.py::CpuTests::test_add_complex3_cpu, test/inductor/test_torchinductor.py::CpuTests::test_angle_cpu, test/inductor/test_torchinductor.py::CpuTests::test_bool_cpu, test/inductor/test_torchinductor.py::CpuTests::test_buffer_use_after_remove_cpu, test/inductor/test_torchinductor.py::CpuTests::test_constant_pad_1d_cpu, test/inductor/test_torchinductor.py::CpuTests::test_constant_pad_nd_inplace_cpu, test/inductor/test_torchinductor.py::CpuTests::test_conv_functional_bn_fuse_cpu, test/inductor/test_torchinductor.py::CpuTests::test_custom_op_1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_diagonal_copy_cpu, test/inductor/test_torchinductor.py::CpuTests::test_dist_bf16_cpu, test/inductor/test_torchinductor.py::CpuTests::test_div_precision_cpu, test/inductor/test_torchinductor.py::CpuTests::test_fractional_max_pool2d4_cpu, test/inductor/test_torchinductor.py::CpuTests::test_index_propagation_flip_cpu, test/inductor/test_torchinductor.py::CpuTests::test_index_propagation_nested_indirect_indexing_cpu, test/inductor/test_torchinductor.py::CpuTests::test_inplace_where_pointwise_cpu, test/inductor/test_torchinductor.py::CpuTests::test_max_pool2d_with_indices_backward2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_mean_cpu, test/inductor/test_torchinductor.py::CpuTests::test_mul_index_expr_cpu, test/inductor/test_torchinductor.py::CpuTests::test_no_mega_fusion_during_lowering_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pad_cast_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_bessel_j0_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_legendre_polynomial_p_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pow3_cpu, test/inductor/test_torchinductor.py::CpuTests::test_repeat_as_strided_cpu, test/inductor/test_torchinductor.py::CpuTests::test_roll_cpu, test/inductor/test_torchinductor.py::CpuTests::test_sdpa_prefer_nd_tiling_True_use_block_ptr_False_cpu, test/inductor/test_torchinductor.py::CpuTests::test_split_with_list_cpu, test/inductor/test_torchinductor.py::CpuTests::test_sum3_cpu, test/inductor/test_torchinductor.py::CpuTests::test_tensor_index_slice_cpu, test/inductor/test_torchinductor.py::CpuTests::test_unspec_inputs_float64_cpu, test/inductor/test_torchinductor.py::CpuTests::test_upsample_nearest2d_backward_cpu, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_broadcast3_broadcast2, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_dense_strided, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_int_broadcast1, test/inductor/test_torchinductor.py::GPUTests::test_check_stack_no_cycles_cuda, test/inductor/test_torchinductor.py::GPUTests::test_conv_functional_bn_fuse_cuda, test/inductor/test_torchinductor.py::GPUTests::test_device_assert_cuda, test/inductor/test_torchinductor.py::GPUTests::test_div3_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_int64_float64_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_int8_uint8_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_uint8_int64_cuda, test/inductor/test_torchinductor.py::GPUTests::test_fuse_tiled_cuda, test/inductor/test_torchinductor.py::GPUTests::test_index_propagation_floordiv_cuda, test/inductor/test_torchinductor.py::GPUTests::test_output_strides_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_hermite_polynomial_h_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_legendre_polynomial_p_cuda, test/inductor/test_torchinductor.py::GPUTests::test_prod_cuda, test/inductor/test_torchinductor.py::GPUTests::test_randn_like_empty_cuda, test/inductor/test_torchinductor.py::GPUTests::test_repeat_cuda, test/inductor/test_torchinductor.py::GPUTests::test_scatter_add3_cuda, test/inductor/test_torchinductor.py::GPUTests::test_softmax_cuda, test/inductor/test_torchinductor.py::GPUTests::test_squeeze1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_sum2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_views2_cuda, test/inductor/test_torchinductor.py::GPUTests::test_zero_dim_reductions_cuda 2024-12-18T02:08:16.5986653Z 2024-12-18T02:13:00.7811964Z 2024-12-18T02:13:00.7812978Z inductor/test_torchinductor 27/27 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_27.27_44db0db289016c44_.log 2024-12-18T02:13:00.7835870Z Running 53 items in this shard: test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_broadcast2_int, test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_strided_dense, test/inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_transposed_strided, test/inductor/test_torchinductor.py::CpuTests::test_add_const_float_cpu, test/inductor/test_torchinductor.py::CpuTests::test_argmax_min_int32_cpu, test/inductor/test_torchinductor.py::CpuTests::test_argmax_to_float_cpu, test/inductor/test_torchinductor.py::CpuTests::test_custom_scan_would_split_cpu, test/inductor/test_torchinductor.py::CpuTests::test_div8_cpu, test/inductor/test_torchinductor.py::CpuTests::test_fuse_large_params_cpu, test/inductor/test_torchinductor.py::CpuTests::test_isinf2_cpu, test/inductor/test_torchinductor.py::CpuTests::test_large_offset_pointwise_cpu, test/inductor/test_torchinductor.py::CpuTests::test_large_strided_reduction_cpu, test/inductor/test_torchinductor.py::CpuTests::test_linspace3_cpu, test/inductor/test_torchinductor.py::CpuTests::test_logcumsumexp_cpu, test/inductor/test_torchinductor.py::CpuTests::test_low_memory_max_pool_cpu, test/inductor/test_torchinductor.py::CpuTests::test_matmul_layer_norm_cpu, test/inductor/test_torchinductor.py::CpuTests::test_max_pool2d1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_max_pool2d6_cpu, test/inductor/test_torchinductor.py::CpuTests::test_max_pool2d_with_indices_backward5_cpu, test/inductor/test_torchinductor.py::CpuTests::test_output_strides_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_bessel_y1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_erf_cpu, test/inductor/test_torchinductor.py::CpuTests::test_pointwise_round_cpu, test/inductor/test_torchinductor.py::CpuTests::test_scalar_output_cpu, test/inductor/test_torchinductor.py::CpuTests::test_split_cpu, test/inductor/test_torchinductor.py::CpuTests::test_split_cumsum_cpu, test/inductor/test_torchinductor.py::CpuTests::test_split_cumsum_index_cpu, test/inductor/test_torchinductor.py::CpuTests::test_squeeze1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_sum1_cpu, test/inductor/test_torchinductor.py::CpuTests::test_to_device_constant_cpu, test/inductor/test_torchinductor.py::CpuTests::test_weight_norm_bwd_cpu, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_dense_broadcast1, test/inductor/test_torchinductor.py::SweepInputsGPUTest::test_cuda_int_broadcast3, test/inductor/test_torchinductor.py::GPUTests::test_adaptive_avg_pool2d1_cuda, test/inductor/test_torchinductor.py::GPUTests::test_add_complex5_cuda, test/inductor/test_torchinductor.py::GPUTests::test_constant_pad_2d_cuda, test/inductor/test_torchinductor.py::GPUTests::test_diagonal_copy_cuda, test/inductor/test_torchinductor.py::GPUTests::test_div9_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_trivial_0_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dtypeview_bfloat16_bfloat16_cuda, test/inductor/test_torchinductor.py::GPUTests::test_fft_real_input_cuda, test/inductor/test_torchinductor.py::GPUTests::test_generate_rand_fp8_cuda, test/inductor/test_torchinductor.py::GPUTests::test_index_select_cuda, test/inductor/test_torchinductor.py::GPUTests::test_inplace_resize_as_cuda, test/inductor/test_torchinductor.py::GPUTests::test_large_offset_pointwise_cuda, test/inductor/test_torchinductor.py::GPUTests::test_lerp_cuda, test/inductor/test_torchinductor.py::GPUTests::test_pointwise_log1p_cuda, test/inductor/test_torchinductor.py::GPUTests::test_round_correctness_cuda, test/inductor/test_torchinductor.py::GPUTests::test_single_elem_cuda, test/inductor/test_torchinductor.py::GPUTests::test_split_with_unbacked_symints_cuda, test/inductor/test_torchinductor.py::GPUTests::test_unspec_inputs_int16_cuda, test/inductor/test_torchinductor.py::GPUTests::test_vectorized_ops_masked_var_novec_cuda, test/inductor/test_torchinductor.py::TritonCodeGenTests::test_comment_graph_fragment 2024-12-18T02:13:00.7850661Z 2024-12-18T02:13:01.8113344Z Running test batch 'tests to run' cost 6016.02 seconds 2024-12-18T02:13:02.5938739Z + [[ 0 == \1 ]] 2024-12-18T02:13:02.5939117Z + echo 'run dynamo benchmark tests with cpp wrapper' 2024-12-18T02:13:02.5939527Z run dynamo benchmark tests with cpp wrapper 2024-12-18T02:13:02.5940761Z + python benchmarks/dynamo/timm_models.py --device cuda --accuracy --amp --training --inductor --disable-cudagraphs --only vit_base_patch16_224 --output /var/lib/jenkins/workspace/test/test-reports/inductor_cpp_wrapper_training.csv 2024-12-18T02:13:06.2937132Z 2024-12-18T02:13:07.2275517Z loading model: 0it [00:00, ?it/s] 2024-12-18T02:13:07.2275780Z 2024-12-18T02:13:07.3332425Z model.safetensors: 0% 0.00/346M [00:00 will be ignored 2024-12-18T02:14:15.3327390Z ('Grad tensors ["L['self'].param_groups[0]['params'][0].grad", "L['self'].param_groups[0]['params'][1].grad", "L['self'].param_groups[0]['params'][2].grad", "L['self'].param_groups[0]['params'][3].grad", "L['self'].param_groups[0]['params'][4].grad", "L['self'].param_groups[0]['params'][5].grad", "L['self'].param_groups[0]['params'][6].grad", "L['self'].param_groups[0]['params'][7].grad", "L['self'].param_groups[0]['params'][8].grad", "L['self'].param_groups[0]['params'][9].grad", "L['self'].param_groups[0]['params'][10].grad", "L['self'].param_groups[0]['params'][11].grad", "L['self'].param_groups[0]['params'][12].grad", "L['self'].param_groups[0]['params'][13].grad", "L['self'].param_groups[0]['params'][14].grad", "L['self'].param_groups[0]['params'][15].grad", "L['self'].param_groups[0]['params'][16].grad", "L['self'].param_groups[0]['params'][17].grad", "L['self'].param_groups[0]['params'][18].grad", "L['self'].param_groups[0]['params'][19].grad", "L['self'].param_groups[0]['params'][20].grad", "L['self'].param_groups[0]['params'][21].grad", "L['self'].param_groups[0]['params'][22].grad", "L['self'].param_groups[0]['params'][23].grad", "L['self'].param_groups[0]['params'][24].grad", "L['self'].param_groups[0]['params'][25].grad", "L['self'].param_groups[0]['params'][26].grad", "L['self'].param_groups[0]['params'][27].grad", "L['self'].param_groups[0]['params'][28].grad", "L['self'].param_groups[0]['params'][29].grad", "L['self'].param_groups[0]['params'][30].grad", "L['self'].param_groups[0]['params'][31].grad", "L['self'].param_groups[0]['params'][32].grad", "L['self'].param_groups[0]['params'][33].grad", "L['self'].param_groups[0]['params'][34].grad", "L['self'].param_groups[0]['params'][35].grad", "L['self'].param_groups[0]['params'][36].grad", "L['self'].param_groups[0]['params'][37].grad", "L['self'].param_groups[0]['params'][38].grad", "L['self'].param_groups[0]['params'][39].grad", "L['self'].param_groups[0]['params'][40].grad", "L['self'].param_groups[0]['params'][41].grad", "L['self'].param_groups[0]['params'][42].grad", "L['self'].param_groups[0]['params'][43].grad", "L['self'].param_groups[0]['params'][44].grad", "L['self'].param_groups[0]['params'][45].grad", "L['self'].param_groups[0]['params'][46].grad", "L['self'].param_groups[0]['params'][47].grad", "L['self'].param_groups[0]['params'][48].grad", "L['self'].param_groups[0]['params'][49].grad", "L['self'].param_groups[0]['params'][50].grad", "L['self'].param_groups[0]['params'][51].grad", "L['self'].param_groups[0]['params'][52].grad", "L['self'].param_groups[0]['params'][53].grad", "L['self'].param_groups[0]['params'][54].grad", "L['self'].param_groups[0]['params'][55].grad", "L['self'].param_groups[0]['params'][56].grad", "L['self'].param_groups[0]['params'][57].grad", "L['self'].param_groups[0]['params'][58].grad", "L['self'].param_groups[0]['params'][59].grad", "L['self'].param_groups[0]['params'][60].grad", "L['self'].param_groups[0]['params'][61].grad", "L['self'].param_groups[0]['params'][62].grad", "L['self'].param_groups[0]['params'][63].grad", "L['self'].param_groups[0]['params'][64].grad", "L['self'].param_groups[0]['params'][65].grad", "L['self'].param_groups[0]['params'][66].grad", "L['self'].param_groups[0]['params'][67].grad", "L['self'].param_groups[0]['params'][68].grad", "L['self'].param_groups[0]['params'][69].grad", "L['self'].param_groups[0]['params'][70].grad", "L['self'].param_groups[0]['params'][71].grad", "L['self'].param_groups[0]['params'][72].grad", "L['self'].param_groups[0]['params'][73].grad", "L['self'].param_groups[0]['params'][74].grad", "L['self'].param_groups[0]['params'][75].grad", "L['self'].param_groups[0]['params'][76].grad", "L['self'].param_groups[0]['params'][77].grad", "L['self'].param_groups[0]['params'][78].grad", "L['self'].param_groups[0]['params'][79].grad", "L['self'].param_groups[0]['params'][80].grad", "L['self'].param_groups[0]['params'][81].grad", "L['self'].param_groups[0]['params'][82].grad", "L['self'].param_groups[0]['params'][83].grad", "L['self'].param_groups[0]['params'][84].grad", "L['self'].param_groups[0]['params'][85].grad", "L['self'].param_groups[0]['params'][86].grad", "L['self'].param_groups[0]['params'][87].grad", "L['self'].param_groups[0]['params'][88].grad", "L['self'].param_groups[0]['params'][89].grad", "L['self'].param_groups[0]['params'][90].grad", "L['self'].param_groups[0]['params'][91].grad", "L['self'].param_groups[0]['params'][92].grad", "L['self'].param_groups[0]['params'][93].grad", "L['self'].param_groups[0]['params'][94].grad", "L['self'].param_groups[0]['params'][95].grad", "L['self'].param_groups[0]['params'][96].grad", "L['self'].param_groups[0]['params'][97].grad", "L['self'].param_groups[0]['params'][98].grad", "L['self'].param_groups[0]['params'][99].grad", "L['self'].param_groups[0]['params'][100].grad", "L['self'].param_groups[0]['params'][101].grad", "L['self'].param_groups[0]['params'][102].grad", "L['self'].param_groups[0]['params'][103].grad", "L['self'].param_groups[0]['params'][104].grad", "L['self'].param_groups[0]['params'][105].grad", "L['self'].param_groups[0]['params'][106].grad", "L['self'].param_groups[0]['params'][107].grad", "L['self'].param_groups[0]['params'][108].grad", "L['self'].param_groups[0]['params'][109].grad", "L['self'].param_groups[0]['params'][110].grad", "L['self'].param_groups[0]['params'][111].grad", "L['self'].param_groups[0]['params'][112].grad", "L['self'].param_groups[0]['params'][113].grad", "L['self'].param_groups[0]['params'][114].grad", "L['self'].param_groups[0]['params'][115].grad", "L['self'].param_groups[0]['params'][116].grad", "L['self'].param_groups[0]['params'][117].grad", "L['self'].param_groups[0]['params'][118].grad", "L['self'].param_groups[0]['params'][119].grad", "L['self'].param_groups[0]['params'][120].grad", "L['self'].param_groups[0]['params'][121].grad", "L['self'].param_groups[0]['params'][122].grad", "L['self'].param_groups[0]['params'][123].grad", "L['self'].param_groups[0]['params'][124].grad", "L['self'].param_groups[0]['params'][125].grad", "L['self'].param_groups[0]['params'][126].grad", "L['self'].param_groups[0]['params'][127].grad", "L['self'].param_groups[0]['params'][128].grad", "L['self'].param_groups[0]['params'][129].grad", "L['self'].param_groups[0]['params'][130].grad", "L['self'].param_groups[0]['params'][131].grad", "L['self'].param_groups[0]['params'][132].grad", "L['self'].param_groups[0]['params'][133].grad", "L['self'].param_groups[0]['params'][134].grad", "L['self'].param_groups[0]['params'][135].grad", "L['self'].param_groups[0]['params'][136].grad", "L['self'].param_groups[0]['params'][137].grad", "L['self'].param_groups[0]['params'][138].grad", "L['self'].param_groups[0]['params'][139].grad", "L['self'].param_groups[0]['params'][140].grad", "L['self'].param_groups[0]['params'][141].grad", "L['self'].param_groups[0]['params'][142].grad", "L['self'].param_groups[0]['params'][143].grad", "L['self'].param_groups[0]['params'][144].grad", "L['self'].param_groups[0]['params'][145].grad", "L['self'].param_groups[0]['params'][146].grad", "L['self'].param_groups[0]['params'][147].grad", "L['self'].param_groups[0]['params'][148].grad", "L['self'].param_groups[0]['params'][149].grad", "L['self'].param_groups[0]['params'][150].grad", "L['self'].param_groups[0]['params'][151].grad"] will be copied during cudagraphs execution.If using cudagraphs and the grad tensor addresses will be the same across runs, use torch._dynamo.decorators.mark_static_address to elide this copy.',) 2024-12-18T02:15:06.4953466Z pass 2024-12-18T02:15:09.5205494Z + python benchmarks/dynamo/check_accuracy.py --actual /var/lib/jenkins/workspace/test/test-reports/inductor_cpp_wrapper_training.csv --expected benchmarks/dynamo/ci_expected_accuracy/inductor_timm_training.csv 2024-12-18T02:15:09.8647240Z vit_base_patch16_224 PASS 2024-12-18T02:15:09.9220711Z + python benchmarks/dynamo/torchbench.py --device cuda --accuracy --bfloat16 --inference --inductor --only hf_T5 --output /var/lib/jenkins/workspace/test/test-reports/inductor_cpp_wrapper_inference.csv 2024-12-18T02:15:13.0734390Z 2024-12-18T02:15:15.1309727Z loading model: 0it [00:00, ?it/s] 2024-12-18T02:15:15.1310134Z loading model: 0it [00:02, ?it/s] 2024-12-18T02:15:15.1352835Z cuda eval hf_T5 2024-12-18T02:16:01.7086346Z pass 2024-12-18T02:16:03.5295235Z + python benchmarks/dynamo/torchbench.py --device cuda --accuracy --bfloat16 --inference --inductor --only llama --output /var/lib/jenkins/workspace/test/test-reports/inductor_cpp_wrapper_inference.csv 2024-12-18T02:16:06.6940894Z 2024-12-18T02:16:07.3603554Z loading model: 0it [00:00, ?it/s] 2024-12-18T02:16:07.3603959Z loading model: 0it [00:00, ?it/s] 2024-12-18T02:16:07.3636787Z cuda eval llama 2024-12-18T02:16:45.3935119Z pass 2024-12-18T02:16:47.0553949Z + python benchmarks/dynamo/torchbench.py --device cuda --accuracy --bfloat16 --inference --inductor --only moco --output /var/lib/jenkins/workspace/test/test-reports/inductor_cpp_wrapper_inference.csv 2024-12-18T02:16:50.2657438Z 2024-12-18T02:16:52.2930580Z loading model: 0it [00:00, ?it/s] 2024-12-18T02:16:52.2932997Z loading model: 0it [00:02, ?it/s] 2024-12-18T02:16:52.3048035Z cuda eval moco 2024-12-18T02:16:55.2645882Z [rank0]:W1218 02:16:55.263000 124255 site-packages/torch/_logging/_internal.py:1089] [0/0] Profiler function will be ignored 2024-12-18T02:17:01.1299132Z [rank0]:W1218 02:17:01.128000 124255 site-packages/torch/_dynamo/backends/distributed.py:88] [2/0_1] Some buckets were extended beyond their requested parameter capacities in order to ensure each subgraph has an output node, required for fx graph partitioning. This can be the case when a subgraph would have only contained nodes performing inplace mutation, and returning no logical outputs. This should not be a problem, unless it results in too few graph partitions for optimal DDP performance. 2024-12-18T02:17:01.1416406Z [rank0]:W1218 02:17:01.140000 124255 site-packages/torch/_dynamo/backends/distributed.py:105] [2/0_1] DDPOptimizer extended these buckets to ensure per-subgraph output nodes: 2024-12-18T02:17:01.1417971Z [rank0]:W1218 02:17:01.140000 124255 site-packages/torch/_dynamo/backends/distributed.py:105] [2/0_1] ┌─────────┬─────────────┬────────────────────────┐ 2024-12-18T02:17:01.1419130Z [rank0]:W1218 02:17:01.140000 124255 site-packages/torch/_dynamo/backends/distributed.py:105] [2/0_1] │ Index │ Extra Ops │ Extra Param Size (b) │ 2024-12-18T02:17:01.1420296Z [rank0]:W1218 02:17:01.140000 124255 site-packages/torch/_dynamo/backends/distributed.py:105] [2/0_1] ├─────────┼─────────────┼────────────────────────┤ 2024-12-18T02:17:01.1421483Z [rank0]:W1218 02:17:01.140000 124255 site-packages/torch/_dynamo/backends/distributed.py:105] [2/0_1] │ 0 │ 470 │ 44910720 │ 2024-12-18T02:17:01.1422621Z [rank0]:W1218 02:17:01.140000 124255 site-packages/torch/_dynamo/backends/distributed.py:105] [2/0_1] └─────────┴─────────────┴────────────────────────┘ 2024-12-18T02:18:12.7652412Z [rank0]:W1218 02:18:12.764000 124255 site-packages/torch/_inductor/utils.py:1543] [3/0_1] DeviceCopy in input program 2024-12-18T02:18:24.7178057Z [rank0]:W1218 02:18:24.716000 124255 site-packages/torch/_dynamo/variables/tensor.py:869] [5/0] Graph break from `Tensor.item()`, consider setting: 2024-12-18T02:18:24.7179724Z [rank0]:W1218 02:18:24.716000 124255 site-packages/torch/_dynamo/variables/tensor.py:869] [5/0] torch._dynamo.config.capture_scalar_outputs = True 2024-12-18T02:18:24.7180601Z [rank0]:W1218 02:18:24.716000 124255 site-packages/torch/_dynamo/variables/tensor.py:869] [5/0] or: 2024-12-18T02:18:24.7181565Z [rank0]:W1218 02:18:24.716000 124255 site-packages/torch/_dynamo/variables/tensor.py:869] [5/0] env TORCHDYNAMO_CAPTURE_SCALAR_OUTPUTS=1 2024-12-18T02:18:24.7182576Z [rank0]:W1218 02:18:24.716000 124255 site-packages/torch/_dynamo/variables/tensor.py:869] [5/0] to include these operations in the captured graph. 2024-12-18T02:18:24.7183425Z [rank0]:W1218 02:18:24.716000 124255 site-packages/torch/_dynamo/variables/tensor.py:869] [5/0] 2024-12-18T02:18:24.7184241Z [rank0]:W1218 02:18:24.716000 124255 site-packages/torch/_dynamo/variables/tensor.py:869] [5/0] Graph break: from user code at: 2024-12-18T02:18:24.7185615Z [rank0]:W1218 02:18:24.716000 124255 site-packages/torch/_dynamo/variables/tensor.py:869] [5/0] File "/var/lib/jenkins/workspace/torchbench/torchbenchmark/models/moco/moco/builder.py", line 158, in torch_dynamo_resume_in_forward_at_133 2024-12-18T02:18:24.7187110Z [rank0]:W1218 02:18:24.716000 124255 site-packages/torch/_dynamo/variables/tensor.py:869] [5/0] self._dequeue_and_enqueue(k) 2024-12-18T02:18:24.7188327Z [rank0]:W1218 02:18:24.716000 124255 site-packages/torch/_dynamo/variables/tensor.py:869] [5/0] File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 116, in decorate_context 2024-12-18T02:18:24.7189533Z [rank0]:W1218 02:18:24.716000 124255 site-packages/torch/_dynamo/variables/tensor.py:869] [5/0] return func(*args, **kwargs) 2024-12-18T02:18:24.7191051Z [rank0]:W1218 02:18:24.716000 124255 site-packages/torch/_dynamo/variables/tensor.py:869] [5/0] File "/var/lib/jenkins/workspace/torchbench/torchbenchmark/models/moco/moco/builder.py", line 59, in _dequeue_and_enqueue 2024-12-18T02:18:24.7192350Z [rank0]:W1218 02:18:24.716000 124255 site-packages/torch/_dynamo/variables/tensor.py:869] [5/0] ptr = int(self.queue_ptr) 2024-12-18T02:18:24.7193131Z [rank0]:W1218 02:18:24.716000 124255 site-packages/torch/_dynamo/variables/tensor.py:869] [5/0] 2024-12-18T02:18:24.7193805Z [rank0]:W1218 02:18:24.716000 124255 site-packages/torch/_dynamo/variables/tensor.py:869] [5/0] 2024-12-18T02:19:01.7358539Z pass 2024-12-18T02:19:02.6827806Z [rank0]:[W1218 02:19:02.229459627 ProcessGroupNCCL.cpp:1496] Warning: WARNING: destroy_process_group() was not called before program exit, which can leak resources. For more info, please see https://pytorch.org/docs/stable/distributed.html#shutdown (function operator()) 2024-12-18T02:19:04.5436132Z + python benchmarks/dynamo/check_accuracy.py --actual /var/lib/jenkins/workspace/test/test-reports/inductor_cpp_wrapper_inference.csv --expected benchmarks/dynamo/ci_expected_accuracy/inductor_torchbench_inference.csv 2024-12-18T02:19:04.9124367Z hf_T5 PASS 2024-12-18T02:19:04.9127773Z llama PASS 2024-12-18T02:19:04.9132748Z moco PASS 2024-12-18T02:19:04.9685821Z + cleanup_workspace 2024-12-18T02:19:04.9686369Z + echo 'sudo may print the following warning message that can be ignored. The chown command will still run.' 2024-12-18T02:19:04.9687120Z sudo may print the following warning message that can be ignored. The chown command will still run. 2024-12-18T02:19:04.9687745Z + echo ' sudo: setrlimit(RLIMIT_STACK): Operation not permitted' 2024-12-18T02:19:04.9688207Z sudo: setrlimit(RLIMIT_STACK): Operation not permitted 2024-12-18T02:19:04.9688745Z + echo 'For more details refer to https://github.com/sudo-project/sudo/issues/42' 2024-12-18T02:19:04.9689350Z For more details refer to https://github.com/sudo-project/sudo/issues/42 2024-12-18T02:19:04.9689816Z + sudo chown -R 1000 /var/lib/jenkins/workspace 2024-12-18T02:19:05.7701335Z ##[group]Run pytorch/test-infra/.github/actions/upload-benchmark-results@release/2.6 2024-12-18T02:19:05.7701830Z with: 2024-12-18T02:19:05.7702077Z benchmark-results-dir: test/test-reports 2024-12-18T02:19:05.7702392Z dry-run: false 2024-12-18T02:19:05.7702619Z schema-version: v3 2024-12-18T02:19:05.7703043Z github-token: *** 2024-12-18T02:19:05.7703280Z env: 2024-12-18T02:19:05.7703493Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:19:05.7703824Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T02:19:05.7704346Z DOCKER_CONTAINER_ID: 01327ec69d77cd023280c7e9fc2ea5779e1166b4f670f543346f4278933279f7 2024-12-18T02:19:05.7704818Z ##[endgroup] 2024-12-18T02:19:05.7731752Z ##[group]Run set -eux 2024-12-18T02:19:05.7732006Z set -eux 2024-12-18T02:19:05.7732264Z python3 -mpip install boto3==1.35.33 2024-12-18T02:19:05.7745716Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T02:19:05.7746089Z env: 2024-12-18T02:19:05.7746334Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:19:05.7746672Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T02:19:05.7747198Z DOCKER_CONTAINER_ID: 01327ec69d77cd023280c7e9fc2ea5779e1166b4f670f543346f4278933279f7 2024-12-18T02:19:05.7747669Z ##[endgroup] 2024-12-18T02:19:05.7783947Z + python3 -mpip install boto3==1.35.33 2024-12-18T02:19:06.1654232Z Defaulting to user installation because normal site-packages is not writeable 2024-12-18T02:19:06.1962725Z Requirement already satisfied: boto3==1.35.33 in /home/ec2-user/.local/lib/python3.9/site-packages (1.35.33) 2024-12-18T02:19:06.2012846Z Requirement already satisfied: s3transfer<0.11.0,>=0.10.0 in /home/ec2-user/.local/lib/python3.9/site-packages (from boto3==1.35.33) (0.10.4) 2024-12-18T02:19:06.2016637Z Requirement already satisfied: jmespath<2.0.0,>=0.7.1 in /usr/lib/python3.9/site-packages (from boto3==1.35.33) (0.10.0) 2024-12-18T02:19:06.2020627Z Requirement already satisfied: botocore<1.36.0,>=1.35.33 in /home/ec2-user/.local/lib/python3.9/site-packages (from boto3==1.35.33) (1.35.83) 2024-12-18T02:19:06.2077060Z Requirement already satisfied: urllib3<1.27,>=1.25.4 in /usr/lib/python3.9/site-packages (from botocore<1.36.0,>=1.35.33->boto3==1.35.33) (1.25.10) 2024-12-18T02:19:06.2083224Z Requirement already satisfied: python-dateutil<3.0.0,>=2.1 in /usr/lib/python3.9/site-packages (from botocore<1.36.0,>=1.35.33->boto3==1.35.33) (2.8.1) 2024-12-18T02:19:06.2120030Z Requirement already satisfied: six>=1.5 in /usr/lib/python3.9/site-packages (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.33->boto3==1.35.33) (1.15.0) 2024-12-18T02:19:06.3367417Z ##[group]Run set -eux 2024-12-18T02:19:06.3367693Z set -eux 2024-12-18T02:19:06.3367925Z  2024-12-18T02:19:06.3368160Z if [[ -z "${GITHUB_TOKEN}" ]]; then 2024-12-18T02:19:06.3368512Z  echo "Missing github-token input" 2024-12-18T02:19:06.3368830Z  exit 1 2024-12-18T02:19:06.3369057Z fi 2024-12-18T02:19:06.3377886Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T02:19:06.3378267Z env: 2024-12-18T02:19:06.3378482Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:19:06.3378811Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T02:19:06.3379460Z DOCKER_CONTAINER_ID: 01327ec69d77cd023280c7e9fc2ea5779e1166b4f670f543346f4278933279f7 2024-12-18T02:19:06.3380318Z GITHUB_TOKEN: *** 2024-12-18T02:19:06.3380566Z ##[endgroup] 2024-12-18T02:19:06.3409544Z + [[ -z *** ]] 2024-12-18T02:19:06.3468426Z ##[group]Run pytorch/test-infra/.github/actions/get-workflow-job-id@main 2024-12-18T02:19:06.3468859Z with: 2024-12-18T02:19:06.3469207Z github-token: *** 2024-12-18T02:19:06.3469448Z env: 2024-12-18T02:19:06.3469671Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:19:06.3469999Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T02:19:06.3470540Z DOCKER_CONTAINER_ID: 01327ec69d77cd023280c7e9fc2ea5779e1166b4f670f543346f4278933279f7 2024-12-18T02:19:06.3471014Z ##[endgroup] 2024-12-18T02:19:06.3511098Z ##[group]Run set -eux 2024-12-18T02:19:06.3511545Z set -eux 2024-12-18T02:19:06.3511781Z  2024-12-18T02:19:06.3512246Z python3 "${GITHUB_ACTION_PATH}/../../scripts/get_workflow_job_id.py" "${GITHUB_RUN_ID}" "${RUNNER_NAME}" 2024-12-18T02:19:06.3521099Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T02:19:06.3521496Z env: 2024-12-18T02:19:06.3521715Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:19:06.3522043Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T02:19:06.3522565Z DOCKER_CONTAINER_ID: 01327ec69d77cd023280c7e9fc2ea5779e1166b4f670f543346f4278933279f7 2024-12-18T02:19:06.3523330Z GITHUB_TOKEN: *** 2024-12-18T02:19:06.3523572Z ##[endgroup] 2024-12-18T02:19:06.3550690Z + python3 /home/ec2-user/actions-runner/_work/_actions/pytorch/test-infra/main/.github/actions/get-workflow-job-id/../../scripts/get_workflow_job_id.py 12383255690 i-028bf30e8c4fafc3a 2024-12-18T02:19:07.6359513Z setting job-id=34567098339 2024-12-18T02:19:07.6360131Z setting job-name=unit-test / cuda12.4-py3.10-gcc9-sm86 / test (inductor_cpp_wrapper, 1, 1, linux.g5.4xlarge.nvidia.gpu) 2024-12-18T02:19:07.6469678Z ##[group]Run set -eux 2024-12-18T02:19:07.6469947Z set -eux 2024-12-18T02:19:07.6470237Z  2024-12-18T02:19:07.6470646Z python3 "${GITHUB_ACTION_PATH}/../../scripts/benchmarks/gather_metadata.py" \ 2024-12-18T02:19:07.6471204Z  --schema-version "${SCHEMA_VERSION}" \ 2024-12-18T02:19:07.6471570Z  --repo "${REPO}" \ 2024-12-18T02:19:07.6471888Z  --head-branch "${HEAD_BRANCH}" \ 2024-12-18T02:19:07.6472231Z  --head-sha "${HEAD_SHA}" \ 2024-12-18T02:19:07.6472583Z  --workflow-id "${WORKFLOW_RUN_ID}" \ 2024-12-18T02:19:07.6472960Z  --run-attempt "${RUN_ATTEMPT}" \ 2024-12-18T02:19:07.6473307Z  --job-id "${JOB_ID}" \ 2024-12-18T02:19:07.6473623Z  --job-name "${JOB_NAME}" 2024-12-18T02:19:07.6482425Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T02:19:07.6482804Z env: 2024-12-18T02:19:07.6483018Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:19:07.6483346Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T02:19:07.6483867Z DOCKER_CONTAINER_ID: 01327ec69d77cd023280c7e9fc2ea5779e1166b4f670f543346f4278933279f7 2024-12-18T02:19:07.6484334Z SCHEMA_VERSION: v3 2024-12-18T02:19:07.6484574Z REPO: pytorch/pytorch 2024-12-18T02:19:07.6484853Z HEAD_BRANCH: refs/heads/release/2.6 2024-12-18T02:19:07.6485196Z HEAD_SHA: 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T02:19:07.6485532Z WORKFLOW_RUN_ID: 12383255690 2024-12-18T02:19:07.6485802Z RUN_ATTEMPT: 1 2024-12-18T02:19:07.6486021Z JOB_ID: 34567098339 2024-12-18T02:19:07.6486529Z JOB_NAME: unit-test / cuda12.4-py3.10-gcc9-sm86 / test (inductor_cpp_wrapper, 1, 1, linux.g5.4xlarge.nvidia.gpu) 2024-12-18T02:19:07.6487080Z ##[endgroup] 2024-12-18T02:19:07.6517376Z + python3 /home/ec2-user/actions-runner/_work/_actions/pytorch/test-infra/release/2.6/.github/actions/upload-benchmark-results/../../scripts/benchmarks/gather_metadata.py --schema-version v3 --repo pytorch/pytorch --head-branch refs/heads/release/2.6 --head-sha 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 --workflow-id 12383255690 --run-attempt 1 --job-id 34567098339 --job-name 'unit-test / cuda12.4-py3.10-gcc9-sm86 / test (inductor_cpp_wrapper, 1, 1, linux.g5.4xlarge.nvidia.gpu)' 2024-12-18T02:19:07.6856202Z ##[group]Run set -eux 2024-12-18T02:19:07.6856469Z set -eux 2024-12-18T02:19:07.6856695Z  2024-12-18T02:19:07.6856950Z # TODO (huydhn): Implement this part 2024-12-18T02:19:07.6857319Z echo "runners=[]" >> "${GITHUB_OUTPUT}" 2024-12-18T02:19:07.6865355Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T02:19:07.6865725Z env: 2024-12-18T02:19:07.6865943Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:19:07.6866267Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T02:19:07.6866997Z DOCKER_CONTAINER_ID: 01327ec69d77cd023280c7e9fc2ea5779e1166b4f670f543346f4278933279f7 2024-12-18T02:19:07.6867662Z ##[endgroup] 2024-12-18T02:19:07.6896569Z + echo 'runners=[]' 2024-12-18T02:19:07.6929743Z ##[group]Run set -eux 2024-12-18T02:19:07.6930015Z set -eux 2024-12-18T02:19:07.6930239Z  2024-12-18T02:19:07.6930491Z # TODO (huydhn): Implement this part 2024-12-18T02:19:07.6930871Z echo "dependencies={}" >> "${GITHUB_OUTPUT}" 2024-12-18T02:19:07.6939866Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T02:19:07.6940238Z env: 2024-12-18T02:19:07.6940457Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:19:07.6940928Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T02:19:07.6941675Z DOCKER_CONTAINER_ID: 01327ec69d77cd023280c7e9fc2ea5779e1166b4f670f543346f4278933279f7 2024-12-18T02:19:07.6942335Z ##[endgroup] 2024-12-18T02:19:07.6968980Z + echo 'dependencies={}' 2024-12-18T02:19:07.6998308Z ##[group]Run set -eux 2024-12-18T02:19:07.6998603Z set -eux 2024-12-18T02:19:07.6998871Z  2024-12-18T02:19:07.6999145Z if [[ ! -d "${BENCHMARK_RESULTS_DIR}" ]]; then 2024-12-18T02:19:07.6999582Z  echo "${BENCHMARK_RESULTS_DIR} does not exist, skipping" 2024-12-18T02:19:07.7000048Z  # We don't want the job to fail if the directory doesn't exist 2024-12-18T02:19:07.7000445Z  exit 0 2024-12-18T02:19:07.7000679Z fi 2024-12-18T02:19:07.7000899Z  2024-12-18T02:19:07.7001136Z if [[ "${DRY_RUN}" == "true" ]]; then 2024-12-18T02:19:07.7001604Z  python3 "${GITHUB_ACTION_PATH}/../../scripts/upload_benchmark_results.py" \ 2024-12-18T02:19:07.7002137Z  --benchmark-results-dir "${BENCHMARK_RESULTS_DIR}" \ 2024-12-18T02:19:07.7002566Z  --metadata "${BENCHMARK_METADATA}" \ 2024-12-18T02:19:07.7002921Z  --runners "${RUNNER_INFO}" \ 2024-12-18T02:19:07.7003273Z  --dependencies "${DEPENDENCIES}" \ 2024-12-18T02:19:07.7003617Z  --dry-run 2024-12-18T02:19:07.7003865Z else 2024-12-18T02:19:07.7004240Z  python3 "${GITHUB_ACTION_PATH}/../../scripts/upload_benchmark_results.py" \ 2024-12-18T02:19:07.7004775Z  --benchmark-results-dir "${BENCHMARK_RESULTS_DIR}" \ 2024-12-18T02:19:07.7005194Z  --metadata "${BENCHMARK_METADATA}" \ 2024-12-18T02:19:07.7005537Z  --runners "${RUNNER_INFO}" \ 2024-12-18T02:19:07.7005875Z  --dependencies "${DEPENDENCIES}" 2024-12-18T02:19:07.7006182Z fi 2024-12-18T02:19:07.7014021Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T02:19:07.7014389Z env: 2024-12-18T02:19:07.7014601Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:19:07.7014929Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T02:19:07.7015453Z DOCKER_CONTAINER_ID: 01327ec69d77cd023280c7e9fc2ea5779e1166b4f670f543346f4278933279f7 2024-12-18T02:19:07.7015949Z BENCHMARK_RESULTS_DIR: test/test-reports 2024-12-18T02:19:07.7016277Z DRY_RUN: false 2024-12-18T02:19:07.7017637Z BENCHMARK_METADATA: {"timestamp": 1734488347, "schema_version": "v3", "name": "unit-test / cuda12.4-py3.10-gcc9-sm86 / test (inductor_cpp_wrapper, 1, 1, linux.g5.4xlarge.nvidia.gpu)", "repo": "pytorch/pytorch", "head_branch": "refs/heads/release/2.6", "head_sha": "0cdf8b1d09254cfda66191d1bd01e3041c3c76f7", "workflow_id": 12383255690, "run_attempt": 1, "job_id": 34567098339} 2024-12-18T02:19:07.7019053Z RUNNER_INFO: [] 2024-12-18T02:19:07.7019291Z DEPENDENCIES: {} 2024-12-18T02:19:07.7019531Z ##[endgroup] 2024-12-18T02:19:07.7047511Z + [[ ! -d test/test-reports ]] 2024-12-18T02:19:07.7047826Z + [[ false == \t\r\u\e ]] 2024-12-18T02:19:07.7050390Z + python3 /home/ec2-user/actions-runner/_work/_actions/pytorch/test-infra/release/2.6/.github/actions/upload-benchmark-results/../../scripts/upload_benchmark_results.py --benchmark-results-dir test/test-reports --metadata '{"timestamp": 1734488347, "schema_version": "v3", "name": "unit-test / cuda12.4-py3.10-gcc9-sm86 / test (inductor_cpp_wrapper, 1, 1, linux.g5.4xlarge.nvidia.gpu)", "repo": "pytorch/pytorch", "head_branch": "refs/heads/release/2.6", "head_sha": "0cdf8b1d09254cfda66191d1bd01e3041c3c76f7", "workflow_id": 12383255690, "run_attempt": 1, "job_id": 34567098339}' --runners '[]' --dependencies '{}' 2024-12-18T02:19:07.9382578Z ##[group]Run cat test/**/*_toprint.log || true 2024-12-18T02:19:07.9382958Z cat test/**/*_toprint.log || true 2024-12-18T02:19:07.9391741Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T02:19:07.9392120Z env: 2024-12-18T02:19:07.9392341Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:19:07.9392672Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T02:19:07.9393200Z DOCKER_CONTAINER_ID: 01327ec69d77cd023280c7e9fc2ea5779e1166b4f670f543346f4278933279f7 2024-12-18T02:19:07.9393670Z ##[endgroup] 2024-12-18T02:19:07.9478276Z cat: 'test/**/*_toprint.log': No such file or directory 2024-12-18T02:19:07.9514801Z ##[group]Run kill "$MONITOR_SCRIPT_PID" 2024-12-18T02:19:07.9515159Z kill "$MONITOR_SCRIPT_PID" 2024-12-18T02:19:07.9523007Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T02:19:07.9523374Z env: 2024-12-18T02:19:07.9523587Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:19:07.9523919Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T02:19:07.9524443Z DOCKER_CONTAINER_ID: 01327ec69d77cd023280c7e9fc2ea5779e1166b4f670f543346f4278933279f7 2024-12-18T02:19:07.9524921Z MONITOR_SCRIPT_PID: 192187 2024-12-18T02:19:07.9525191Z ##[endgroup] 2024-12-18T02:19:07.9671027Z Prepare all required actions 2024-12-18T02:19:07.9671441Z Getting action download info 2024-12-18T02:19:08.1077717Z Download action repository 'actions/upload-artifact@v4' (SHA:6f51ac03b9356f520e9adb1b1b7802705f340c2b) 2024-12-18T02:19:08.4065941Z ##[group]Run ./.github/actions/upload-test-artifacts 2024-12-18T02:19:08.4066302Z with: 2024-12-18T02:19:08.4066698Z file-suffix: test-inductor_cpp_wrapper-1-1-linux.g5.4xlarge.nvidia.gpu_34567098339 2024-12-18T02:19:08.4067205Z s3-bucket: gha-artifacts 2024-12-18T02:19:08.4067465Z env: 2024-12-18T02:19:08.4067676Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:19:08.4068003Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T02:19:08.4068536Z DOCKER_CONTAINER_ID: 01327ec69d77cd023280c7e9fc2ea5779e1166b4f670f543346f4278933279f7 2024-12-18T02:19:08.4069009Z ##[endgroup] 2024-12-18T02:19:08.4101731Z ##[group]Run # Remove any previous test jsons if they exist 2024-12-18T02:19:08.4102212Z # Remove any previous test jsons if they exist 2024-12-18T02:19:08.4102571Z rm -f test-jsons-*.zip 2024-12-18T02:19:08.4102989Z zip -r "test-jsons-${FILE_SUFFIX}.zip" test/test-reports -i '*.json' 2024-12-18T02:19:08.4111912Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T02:19:08.4112288Z env: 2024-12-18T02:19:08.4112510Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:19:08.4112845Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T02:19:08.4113375Z DOCKER_CONTAINER_ID: 01327ec69d77cd023280c7e9fc2ea5779e1166b4f670f543346f4278933279f7 2024-12-18T02:19:08.4114026Z FILE_SUFFIX: test-inductor_cpp_wrapper-1-1-linux.g5.4xlarge.nvidia.gpu_34567098339 2024-12-18T02:19:08.4114504Z ##[endgroup] 2024-12-18T02:19:08.4176492Z adding: test/test-reports/td_exclusions-ced379aedeaf56ab0b6c.json (deflated 25%) 2024-12-18T02:19:08.4178968Z adding: test/test-reports/inductor_cpp_wrapper_training.json (deflated 94%) 2024-12-18T02:19:08.4184244Z adding: test/test-reports/inductor_cpp_wrapper_inference.json (deflated 97%) 2024-12-18T02:19:08.4215592Z ##[group]Run # Remove any previous test reports if they exist 2024-12-18T02:19:08.4216056Z # Remove any previous test reports if they exist 2024-12-18T02:19:08.4216435Z rm -f test-reports-*.zip 2024-12-18T02:19:08.4216896Z zip -r "test-reports-${FILE_SUFFIX}.zip" test/test-reports -i '*.xml' -i '*.csv' 2024-12-18T02:19:08.4225335Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T02:19:08.4225914Z env: 2024-12-18T02:19:08.4226135Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:19:08.4226801Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T02:19:08.4227333Z DOCKER_CONTAINER_ID: 01327ec69d77cd023280c7e9fc2ea5779e1166b4f670f543346f4278933279f7 2024-12-18T02:19:08.4227973Z FILE_SUFFIX: test-inductor_cpp_wrapper-1-1-linux.g5.4xlarge.nvidia.gpu_34567098339 2024-12-18T02:19:08.4228450Z ##[endgroup] 2024-12-18T02:19:08.4287106Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-19ab166280d0e006.xml (deflated 28%) 2024-12-18T02:19:08.4288417Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-94c355aee71d3dfb.xml (deflated 28%) 2024-12-18T02:19:08.4289733Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6621ff1748f0f5d2.xml (deflated 45%) 2024-12-18T02:19:08.4291037Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-d2939a6635438be1.xml (deflated 28%) 2024-12-18T02:19:08.4292318Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-a4ffafb8e3089f70.xml (deflated 28%) 2024-12-18T02:19:08.4293629Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-c17ea08f5374ceb7.xml (deflated 28%) 2024-12-18T02:19:08.4295194Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-d4b58b4acb51fce5.xml (deflated 28%) 2024-12-18T02:19:08.4296508Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-7529c3551e721462.xml (deflated 28%) 2024-12-18T02:19:08.4297780Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-3de1f48d575ecb0d.xml (deflated 28%) 2024-12-18T02:19:08.4299004Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-b60805d63b461945.xml (deflated 28%) 2024-12-18T02:19:08.4300125Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-8cb69c42e5e71e19.xml (deflated 28%) 2024-12-18T02:19:08.4301397Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6317e54f6eb9043d.xml (deflated 43%) 2024-12-18T02:19:08.4302504Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-af89e9ff4bbc6756.xml (deflated 28%) 2024-12-18T02:19:08.4303692Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-ecb681bfca7982f0.xml (deflated 28%) 2024-12-18T02:19:08.4304801Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-f791c673bba4dd1d.xml (deflated 28%) 2024-12-18T02:19:08.4305911Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-341dd22ee8aeee2d.xml (deflated 28%) 2024-12-18T02:19:08.4307100Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-527002f11fe74e65.xml (deflated 28%) 2024-12-18T02:19:08.4308215Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6977008b1f64b55c.xml (deflated 28%) 2024-12-18T02:19:08.4309317Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-f972b68eafa644ee.xml (deflated 28%) 2024-12-18T02:19:08.4310426Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-005bf3678a712652.xml (deflated 28%) 2024-12-18T02:19:08.4311591Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-b19504462ba5e035.xml (deflated 28%) 2024-12-18T02:19:08.4312690Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-36116df937dd48a0.xml (deflated 28%) 2024-12-18T02:19:08.4313804Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-d5bd02ab81c0c44c.xml (deflated 28%) 2024-12-18T02:19:08.4315201Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-2b263d107c3656cf.xml (deflated 28%) 2024-12-18T02:19:08.4316295Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-9b49b1d36d294acc.xml (deflated 28%) 2024-12-18T02:19:08.4317407Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-0ec77422dcfcd292.xml (deflated 28%) 2024-12-18T02:19:08.4318510Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-684aab813e534364.xml (deflated 28%) 2024-12-18T02:19:08.4319681Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-bd8a7f49367bb3e6.xml (deflated 92%) 2024-12-18T02:19:08.4320794Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6f59728d8b64a3cd.xml (deflated 93%) 2024-12-18T02:19:08.4321917Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-656a0ff1aeb7e88e.xml (deflated 94%) 2024-12-18T02:19:08.4323087Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-ab019869205b1c25.xml (deflated 93%) 2024-12-18T02:19:08.4324359Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6ba9da1ba270d54d.xml (deflated 93%) 2024-12-18T02:19:08.4325482Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-becfd437ed5a8d71.xml (deflated 94%) 2024-12-18T02:19:08.4328873Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-b4774b33401159b2.xml (deflated 95%) 2024-12-18T02:19:08.4332637Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-e4e7c6fe6ea0e993.xml (deflated 93%) 2024-12-18T02:19:08.4336855Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-37fe240ff19bc418.xml (deflated 94%) 2024-12-18T02:19:08.4340698Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-07cd9bc1d7168950.xml (deflated 92%) 2024-12-18T02:19:08.4345686Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-40c1bc8ca0d3156f.xml (deflated 93%) 2024-12-18T02:19:08.4350666Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-5877f7cf020c1b1e.xml (deflated 94%) 2024-12-18T02:19:08.4355822Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-347e810a5eed34a5.xml (deflated 94%) 2024-12-18T02:19:08.4360471Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-eb34492b783c4150.xml (deflated 95%) 2024-12-18T02:19:08.4364317Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-37938b434eba3114.xml (deflated 95%) 2024-12-18T02:19:08.4368570Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-09070fc08bd7b893.xml (deflated 94%) 2024-12-18T02:19:08.4372437Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-517e6eabde76c8eb.xml (deflated 94%) 2024-12-18T02:19:08.4377065Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-a30330ba86ba5ec3.xml (deflated 93%) 2024-12-18T02:19:08.4381808Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-4626b00136404b31.xml (deflated 94%) 2024-12-18T02:19:08.4386472Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-86e71ff403c2dede.xml (deflated 94%) 2024-12-18T02:19:08.4389747Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-7423852eafa22d8d.xml (deflated 94%) 2024-12-18T02:19:08.4393960Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-5bac903de61f91cb.xml (deflated 94%) 2024-12-18T02:19:08.4398624Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-f5e793fcf25602e3.xml (deflated 94%) 2024-12-18T02:19:08.4403127Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-1ae10c8ece46448f.xml (deflated 92%) 2024-12-18T02:19:08.4407887Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-8f94958d94b0a781.xml (deflated 94%) 2024-12-18T02:19:08.4412186Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-7fbf086565953ccf.xml (deflated 93%) 2024-12-18T02:19:08.4416630Z adding: test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-582edb4a5d8de6ff.xml (deflated 92%) 2024-12-18T02:19:08.4417634Z adding: test/test-reports/inductor_cpp_wrapper_training.csv (deflated 33%) 2024-12-18T02:19:08.4418251Z adding: test/test-reports/inductor_cpp_wrapper_inference.csv (deflated 43%) 2024-12-18T02:19:08.4450638Z ##[group]Run # Remove any previous usage logs if they exist 2024-12-18T02:19:08.4451084Z # Remove any previous usage logs if they exist 2024-12-18T02:19:08.4451443Z rm -f logs-*.zip 2024-12-18T02:19:08.4452049Z # this workflow is also run in bazel build test, but we dont generate usage reports for it 2024-12-18T02:19:08.4452576Z # so check to see if the file exists first 2024-12-18T02:19:08.4452930Z if [ -f 'usage_log.txt' ]; then 2024-12-18T02:19:08.4453292Z  zip "logs-${FILE_SUFFIX}.zip" 'usage_log.txt' 2024-12-18T02:19:08.4453630Z fi 2024-12-18T02:19:08.4453994Z if find "test/test-reports" -name "*.log" 2>/dev/null | grep -q .; then 2024-12-18T02:19:08.4454541Z  zip -r "logs-${FILE_SUFFIX}.zip" test/test-reports -i '*.log' 2024-12-18T02:19:08.4454923Z fi 2024-12-18T02:19:08.4463199Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T02:19:08.4463569Z env: 2024-12-18T02:19:08.4463792Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:19:08.4464125Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T02:19:08.4464655Z DOCKER_CONTAINER_ID: 01327ec69d77cd023280c7e9fc2ea5779e1166b4f670f543346f4278933279f7 2024-12-18T02:19:08.4465303Z FILE_SUFFIX: test-inductor_cpp_wrapper-1-1-linux.g5.4xlarge.nvidia.gpu_34567098339 2024-12-18T02:19:08.4465779Z ##[endgroup] 2024-12-18T02:19:08.5311530Z adding: usage_log.txt (deflated 99%) 2024-12-18T02:19:08.5361362Z adding: test/test-reports/inductor.test_torchinductor_1.27_4e921d29a72d5b8f_.log (deflated 50%) 2024-12-18T02:19:08.5362156Z adding: test/test-reports/inductor.test_torchinductor_2.27_da0ab98e80fd10db_.log (deflated 50%) 2024-12-18T02:19:08.5362888Z adding: test/test-reports/inductor.test_torchinductor_3.27_69aab753b71d2841_.log (deflated 51%) 2024-12-18T02:19:08.5363602Z adding: test/test-reports/inductor.test_torchinductor_4.27_75a9bb941572de21_.log (deflated 50%) 2024-12-18T02:19:08.5364313Z adding: test/test-reports/inductor.test_torchinductor_5.27_5e925007f200de52_.log (deflated 50%) 2024-12-18T02:19:08.5365037Z adding: test/test-reports/inductor.test_torchinductor_6.27_5f43058b61c1d8ed_.log (deflated 50%) 2024-12-18T02:19:08.5365796Z adding: test/test-reports/inductor.test_torchinductor_7.27_7ed4a1232802bf0a_.log (deflated 50%) 2024-12-18T02:19:08.5366530Z adding: test/test-reports/inductor.test_torchinductor_8.27_97ca1a3aab00c279_.log (deflated 50%) 2024-12-18T02:19:08.5367248Z adding: test/test-reports/inductor.test_torchinductor_9.27_b0ceedd9f13b8814_.log (deflated 50%) 2024-12-18T02:19:08.5367971Z adding: test/test-reports/inductor.test_torchinductor_10.27_f668a87e4f8ca0bf_.log (deflated 50%) 2024-12-18T02:19:08.5368967Z adding: test/test-reports/inductor.test_torchinductor_11.27_91091f1a0806cdca_.log (deflated 50%) 2024-12-18T02:19:08.5369697Z adding: test/test-reports/inductor.test_torchinductor_12.27_e227860cb442666c_.log (deflated 51%) 2024-12-18T02:19:08.5370425Z adding: test/test-reports/inductor.test_torchinductor_13.27_edfd1565e6373c01_.log (deflated 50%) 2024-12-18T02:19:08.5371219Z adding: test/test-reports/inductor.test_torchinductor_14.27_ac70490beb4c8e61_.log (deflated 50%) 2024-12-18T02:19:08.5372138Z adding: test/test-reports/inductor.test_torchinductor_15.27_19cde6a387376fb6_.log (deflated 50%) 2024-12-18T02:19:08.5372967Z adding: test/test-reports/inductor.test_torchinductor_16.27_4e6c8ef383442a4a_.log (deflated 50%) 2024-12-18T02:19:08.5373805Z adding: test/test-reports/inductor.test_torchinductor_17.27_ec4a02ac43c89178_.log (deflated 50%) 2024-12-18T02:19:08.5374608Z adding: test/test-reports/inductor.test_torchinductor_18.27_cac4bdf2cd740a31_.log (deflated 50%) 2024-12-18T02:19:08.5375421Z adding: test/test-reports/inductor.test_torchinductor_19.27_93f8c6120c3caf73_.log (deflated 50%) 2024-12-18T02:19:08.5376161Z adding: test/test-reports/inductor.test_torchinductor_20.27_a10812efd389a2e5_.log (deflated 50%) 2024-12-18T02:19:08.5376896Z adding: test/test-reports/inductor.test_torchinductor_21.27_75c11f316f2192a8_.log (deflated 50%) 2024-12-18T02:19:08.5377678Z adding: test/test-reports/inductor.test_torchinductor_22.27_988123d5aa3190ec_.log (deflated 50%) 2024-12-18T02:19:08.5378647Z adding: test/test-reports/inductor.test_torchinductor_23.27_8525c93d8abd4672_.log (deflated 50%) 2024-12-18T02:19:08.5379378Z adding: test/test-reports/inductor.test_torchinductor_24.27_c3f1f6abac365865_.log (deflated 50%) 2024-12-18T02:19:08.5380183Z adding: test/test-reports/inductor.test_torchinductor_25.27_209c0cf65c30dec9_.log (deflated 50%) 2024-12-18T02:19:08.5381062Z adding: test/test-reports/inductor.test_torchinductor_26.27_aa8ad20b2b1d9b2e_.log (deflated 50%) 2024-12-18T02:19:08.5381806Z adding: test/test-reports/inductor.test_torchinductor_27.27_028acddb4ed8415d_.log (deflated 50%) 2024-12-18T02:19:08.5382611Z adding: test/test-reports/inductor.test_torchinductor_1.27_ca6ac93c23331536_.log (deflated 81%) 2024-12-18T02:19:08.5383338Z adding: test/test-reports/inductor.test_torchinductor_2.27_d8aeb8f8f6ff57e7_.log (deflated 81%) 2024-12-18T02:19:08.5384080Z adding: test/test-reports/inductor.test_torchinductor_3.27_72cdd3d01872358f_.log (deflated 81%) 2024-12-18T02:19:08.5384867Z adding: test/test-reports/inductor.test_torchinductor_4.27_3f1fc74983d1d4d4_.log (deflated 81%) 2024-12-18T02:19:08.5386812Z adding: test/test-reports/inductor.test_torchinductor_5.27_bb0670eaaa0fa793_.log (deflated 80%) 2024-12-18T02:19:08.5388726Z adding: test/test-reports/inductor.test_torchinductor_7.27_9e8b864c92ef7101_.log (deflated 80%) 2024-12-18T02:19:08.5391649Z adding: test/test-reports/inductor.test_torchinductor_6.27_ec620111bab8cba1_.log (deflated 81%) 2024-12-18T02:19:08.5393666Z adding: test/test-reports/inductor.test_torchinductor_8.27_565f07f6aa61f46c_.log (deflated 81%) 2024-12-18T02:19:08.5395972Z adding: test/test-reports/inductor.test_torchinductor_9.27_aaa97bdab74fc578_.log (deflated 79%) 2024-12-18T02:19:08.5397774Z adding: test/test-reports/inductor.test_torchinductor_11.27_cafb019f69b4cf8a_.log (deflated 80%) 2024-12-18T02:19:08.5400948Z adding: test/test-reports/inductor.test_torchinductor_10.27_d3038110b56e1493_.log (deflated 83%) 2024-12-18T02:19:08.5403262Z adding: test/test-reports/inductor.test_torchinductor_13.27_be754909e2349298_.log (deflated 82%) 2024-12-18T02:19:08.5405896Z adding: test/test-reports/inductor.test_torchinductor_12.27_9110b36930659b85_.log (deflated 82%) 2024-12-18T02:19:08.5407734Z adding: test/test-reports/inductor.test_torchinductor_14.27_d764707b21314ac9_.log (deflated 81%) 2024-12-18T02:19:08.5410506Z adding: test/test-reports/inductor.test_torchinductor_15.27_b80fba20eb260bcf_.log (deflated 82%) 2024-12-18T02:19:08.5412784Z adding: test/test-reports/inductor.test_torchinductor_17.27_f850c9a23d685c8d_.log (deflated 83%) 2024-12-18T02:19:08.5414733Z adding: test/test-reports/inductor.test_torchinductor_16.27_cdac7bdc05146e80_.log (deflated 81%) 2024-12-18T02:19:08.5417320Z adding: test/test-reports/inductor.test_torchinductor_19.27_a693145ddcd5b297_.log (deflated 82%) 2024-12-18T02:19:08.5419223Z adding: test/test-reports/inductor.test_torchinductor_18.27_f181e841249877f8_.log (deflated 81%) 2024-12-18T02:19:08.5423106Z adding: test/test-reports/inductor.test_torchinductor_20.27_a5948e9c16a120d6_.log (deflated 83%) 2024-12-18T02:19:08.5425119Z adding: test/test-reports/inductor.test_torchinductor_21.27_a6fdd5fbcb39e3ed_.log (deflated 79%) 2024-12-18T02:19:08.5427212Z adding: test/test-reports/inductor.test_torchinductor_22.27_01e26c3d18b0195b_.log (deflated 82%) 2024-12-18T02:19:08.5429730Z adding: test/test-reports/inductor.test_torchinductor_23.27_8e95cfaebd8c707a_.log (deflated 81%) 2024-12-18T02:19:08.5432039Z adding: test/test-reports/inductor.test_torchinductor_25.27_433758092152d7c2_.log (deflated 81%) 2024-12-18T02:19:08.5434091Z adding: test/test-reports/inductor.test_torchinductor_24.27_4f59cacd7a06782e_.log (deflated 82%) 2024-12-18T02:19:08.5436132Z adding: test/test-reports/inductor.test_torchinductor_26.27_7c92f821f4251d29_.log (deflated 81%) 2024-12-18T02:19:08.5437963Z adding: test/test-reports/inductor.test_torchinductor_27.27_44db0db289016c44_.log (deflated 80%) 2024-12-18T02:19:08.5470307Z ##[group]Run # Remove any previous debugging artifacts if they exist 2024-12-18T02:19:08.5470823Z # Remove any previous debugging artifacts if they exist 2024-12-18T02:19:08.5471224Z rm -f debug-*.zip 2024-12-18T02:19:08.5471513Z if [ -d 'test/debug' ]; then 2024-12-18T02:19:08.5471866Z  zip -r "debug-${FILE_SUFFIX}.zip" test/debug 2024-12-18T02:19:08.5472200Z fi 2024-12-18T02:19:08.5480483Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T02:19:08.5480874Z env: 2024-12-18T02:19:08.5481098Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:19:08.5481424Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T02:19:08.5481954Z DOCKER_CONTAINER_ID: 01327ec69d77cd023280c7e9fc2ea5779e1166b4f670f543346f4278933279f7 2024-12-18T02:19:08.5482603Z FILE_SUFFIX: test-inductor_cpp_wrapper-1-1-linux.g5.4xlarge.nvidia.gpu_34567098339 2024-12-18T02:19:08.5483080Z ##[endgroup] 2024-12-18T02:19:08.5591399Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-12-18T02:19:08.5591738Z with: 2024-12-18T02:19:08.5591960Z s3-bucket: gha-artifacts 2024-12-18T02:19:08.5592270Z s3-prefix: pytorch/pytorch/12383255690/1/artifact 2024-12-18T02:19:08.5592613Z retention-days: 14 2024-12-18T02:19:08.5592872Z if-no-files-found: warn 2024-12-18T02:19:08.5593144Z path: test-jsons-*.zip 2024-12-18T02:19:08.5593401Z name: artifact 2024-12-18T02:19:08.5593629Z region: us-east-1 2024-12-18T02:19:08.5593859Z env: 2024-12-18T02:19:08.5594071Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:19:08.5594420Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T02:19:08.5594948Z DOCKER_CONTAINER_ID: 01327ec69d77cd023280c7e9fc2ea5779e1166b4f670f543346f4278933279f7 2024-12-18T02:19:08.5595410Z ##[endgroup] 2024-12-18T02:19:08.9373648Z NOTE: s3-prefix specified, ignoring name parameter 2024-12-18T02:19:08.9374087Z With the provided path, there will be 1 file uploaded 2024-12-18T02:19:08.9374530Z Uploading to s3 prefix: pytorch/pytorch/12383255690/1/artifact 2024-12-18T02:19:08.9434644Z Starting upload of test-jsons-test-inductor_cpp_wrapper-1-1-linux.g5.4xlarge.nvidia.gpu_34567098339.zip 2024-12-18T02:19:09.0833091Z Finished upload of test-jsons-test-inductor_cpp_wrapper-1-1-linux.g5.4xlarge.nvidia.gpu_34567098339.zip 2024-12-18T02:19:09.1133646Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-12-18T02:19:09.1133990Z with: 2024-12-18T02:19:09.1134222Z s3-bucket: gha-artifacts 2024-12-18T02:19:09.1134548Z s3-prefix: pytorch/pytorch/12383255690/1/artifact 2024-12-18T02:19:09.1135105Z retention-days: 14 2024-12-18T02:19:09.1135365Z if-no-files-found: error 2024-12-18T02:19:09.1135647Z path: test-reports-*.zip 2024-12-18T02:19:09.1135916Z name: artifact 2024-12-18T02:19:09.1136153Z region: us-east-1 2024-12-18T02:19:09.1136386Z env: 2024-12-18T02:19:09.1136600Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:19:09.1136937Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T02:19:09.1137483Z DOCKER_CONTAINER_ID: 01327ec69d77cd023280c7e9fc2ea5779e1166b4f670f543346f4278933279f7 2024-12-18T02:19:09.1137957Z ##[endgroup] 2024-12-18T02:19:09.4573249Z NOTE: s3-prefix specified, ignoring name parameter 2024-12-18T02:19:09.4573709Z With the provided path, there will be 1 file uploaded 2024-12-18T02:19:09.4574159Z Uploading to s3 prefix: pytorch/pytorch/12383255690/1/artifact 2024-12-18T02:19:09.4633545Z Starting upload of test-reports-test-inductor_cpp_wrapper-1-1-linux.g5.4xlarge.nvidia.gpu_34567098339.zip 2024-12-18T02:19:09.5743567Z Finished upload of test-reports-test-inductor_cpp_wrapper-1-1-linux.g5.4xlarge.nvidia.gpu_34567098339.zip 2024-12-18T02:19:09.6053064Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-12-18T02:19:09.6053407Z with: 2024-12-18T02:19:09.6053631Z s3-bucket: gha-artifacts 2024-12-18T02:19:09.6053958Z s3-prefix: pytorch/pytorch/12383255690/1/artifact 2024-12-18T02:19:09.6054306Z retention-days: 14 2024-12-18T02:19:09.6054571Z if-no-files-found: ignore 2024-12-18T02:19:09.6054846Z path: logs-*.zip 2024-12-18T02:19:09.6055079Z name: artifact 2024-12-18T02:19:09.6055512Z region: us-east-1 2024-12-18T02:19:09.6055750Z env: 2024-12-18T02:19:09.6055968Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:19:09.6056304Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T02:19:09.6056827Z DOCKER_CONTAINER_ID: 01327ec69d77cd023280c7e9fc2ea5779e1166b4f670f543346f4278933279f7 2024-12-18T02:19:09.6057301Z ##[endgroup] 2024-12-18T02:19:09.9433132Z NOTE: s3-prefix specified, ignoring name parameter 2024-12-18T02:19:09.9433782Z With the provided path, there will be 1 file uploaded 2024-12-18T02:19:09.9434390Z Uploading to s3 prefix: pytorch/pytorch/12383255690/1/artifact 2024-12-18T02:19:09.9493967Z Starting upload of logs-test-inductor_cpp_wrapper-1-1-linux.g5.4xlarge.nvidia.gpu_34567098339.zip 2024-12-18T02:19:10.1925922Z Finished upload of logs-test-inductor_cpp_wrapper-1-1-linux.g5.4xlarge.nvidia.gpu_34567098339.zip 2024-12-18T02:19:10.2229368Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-12-18T02:19:10.2229705Z with: 2024-12-18T02:19:10.2229936Z s3-bucket: gha-artifacts 2024-12-18T02:19:10.2230262Z s3-prefix: pytorch/pytorch/12383255690/1/artifact 2024-12-18T02:19:10.2230615Z retention-days: 14 2024-12-18T02:19:10.2230874Z if-no-files-found: ignore 2024-12-18T02:19:10.2231147Z path: debug-*.zip 2024-12-18T02:19:10.2231379Z name: artifact 2024-12-18T02:19:10.2231617Z region: us-east-1 2024-12-18T02:19:10.2231846Z env: 2024-12-18T02:19:10.2232066Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:19:10.2232411Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T02:19:10.2232934Z DOCKER_CONTAINER_ID: 01327ec69d77cd023280c7e9fc2ea5779e1166b4f670f543346f4278933279f7 2024-12-18T02:19:10.2233412Z ##[endgroup] 2024-12-18T02:19:10.5541884Z No files were found with the provided path: debug-*.zip. No artifacts will be uploaded. 2024-12-18T02:19:10.5864392Z ##[group]Run # shellcheck disable=SC2156 2024-12-18T02:19:10.5864766Z # shellcheck disable=SC2156 2024-12-18T02:19:10.5865323Z find . -iname "core.[1-9]*" -exec docker exec "${DOCKER_CONTAINER_ID}" sh -c "gdb python {} -ex 'bt' -ex 'q'" \; 2024-12-18T02:19:10.5874355Z shell: /usr/bin/bash -e {0} 2024-12-18T02:19:10.5874626Z env: 2024-12-18T02:19:10.5874862Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:19:10.5875195Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T02:19:10.5875728Z DOCKER_CONTAINER_ID: 01327ec69d77cd023280c7e9fc2ea5779e1166b4f670f543346f4278933279f7 2024-12-18T02:19:10.5876194Z ##[endgroup] 2024-12-18T02:19:10.8654115Z ##[group]Run pytorch/test-infra/.github/actions/teardown-linux@release/2.6 2024-12-18T02:19:10.8654562Z with: 2024-12-18T02:19:10.8654764Z env: 2024-12-18T02:19:10.8654968Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:19:10.8655296Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T02:19:10.8655830Z DOCKER_CONTAINER_ID: 01327ec69d77cd023280c7e9fc2ea5779e1166b4f670f543346f4278933279f7 2024-12-18T02:19:10.8656296Z ##[endgroup] 2024-12-18T02:19:10.8677614Z ##[group]Run set -eou pipefail 2024-12-18T02:19:10.8677934Z set -eou pipefail 2024-12-18T02:19:10.8678201Z  2024-12-18T02:19:10.8678559Z echo "Holding runner for 2 hours until all ssh sessions have logged out" 2024-12-18T02:19:10.8679020Z for _ in $(seq 1440); do 2024-12-18T02:19:10.8679360Z  # Break if no ssh session exists anymore 2024-12-18T02:19:10.8679706Z  if [ "$(who)" = "" ]; then 2024-12-18T02:19:10.8680007Z  break 2024-12-18T02:19:10.8680286Z  fi 2024-12-18T02:19:10.8680520Z  echo "." 2024-12-18T02:19:10.8680760Z  sleep 5 2024-12-18T02:19:10.8681005Z done 2024-12-18T02:19:10.8689783Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T02:19:10.8690152Z env: 2024-12-18T02:19:10.8690373Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:19:10.8690698Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T02:19:10.8691232Z DOCKER_CONTAINER_ID: 01327ec69d77cd023280c7e9fc2ea5779e1166b4f670f543346f4278933279f7 2024-12-18T02:19:10.8691705Z ##[endgroup] 2024-12-18T02:19:10.8721303Z Holding runner for 2 hours until all ssh sessions have logged out 2024-12-18T02:19:10.8808230Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2024-12-18T02:19:10.8808785Z # ignore expansion of "docker ps -q" since it could be empty 2024-12-18T02:19:10.8809208Z # shellcheck disable=SC2046 2024-12-18T02:19:10.8809550Z docker stop $(docker ps -q) || true 2024-12-18T02:19:10.8809898Z # Prune all of the docker images 2024-12-18T02:19:10.8810223Z docker system prune -af 2024-12-18T02:19:10.8819130Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T02:19:10.8819507Z env: 2024-12-18T02:19:10.8819732Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:19:10.8820062Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T02:19:10.8820595Z DOCKER_CONTAINER_ID: 01327ec69d77cd023280c7e9fc2ea5779e1166b4f670f543346f4278933279f7 2024-12-18T02:19:10.8821183Z ##[endgroup] 2024-12-18T02:19:11.5080289Z 01327ec69d77 2024-12-18T02:19:12.9367255Z Deleted Containers: 2024-12-18T02:19:12.9367784Z 01327ec69d77cd023280c7e9fc2ea5779e1166b4f670f543346f4278933279f7 2024-12-18T02:19:12.9368127Z 2024-12-18T02:19:24.7019751Z Deleted Images: 2024-12-18T02:19:24.7020928Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T02:19:24.7022578Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks@sha256:ff80d4c93d18e8ab7a2501f0e62b7c40cf97aa83fc9702e88b9c2d02cdcbecdb 2024-12-18T02:19:24.7023781Z deleted: sha256:67e93a8badaf799ceb664d7c453077c6c6785d56dc10c720be9358edeb91759b 2024-12-18T02:19:24.7024439Z deleted: sha256:7958cbbed07d0e7e404de5150d4669da383984a17de74e455563b7ecc409b2e8 2024-12-18T02:19:24.7025088Z deleted: sha256:dc6a8b10e3a8452ea47655ddad3b52816f12bcbe35298b3aa96aae8a0da9bc12 2024-12-18T02:19:24.7025770Z deleted: sha256:c92bf6e7cfbdecd0dfe86d452eac5dbe5aa5b2a6aa7ef2eaeffb21af2870cda7 2024-12-18T02:19:24.7026724Z deleted: sha256:f9597cb89d67c0c899e266adc5e5f04817474bad200712b3c256ed33c346b3e8 2024-12-18T02:19:24.7027360Z deleted: sha256:eb062308fcca86ab5a341555bf03af093d21f1d44dbe3dce6f9b7781b650b2f1 2024-12-18T02:19:24.7028349Z deleted: sha256:96f28e0a6369023dd4e75125d2454531ff686a14467f3e06d3b5c6da89893472 2024-12-18T02:19:24.7029152Z deleted: sha256:3e6e64b255956d1bf66c97393ae4325f7fc67414cd710e284c17190cb262c92d 2024-12-18T02:19:24.7029762Z deleted: sha256:a3c0a58b4f23e46b45dd1b385363731800042b3f04ca66f8867b99f3c9311f11 2024-12-18T02:19:24.7030378Z deleted: sha256:435e519973ffb9c85330ae8db1d1fb1fa75d673e2f27640c2ca7277c6352092b 2024-12-18T02:19:24.7030983Z deleted: sha256:69800681a8b6382d520ac4b8b8828bd5540a297961ddeb004e415bc46b33f80d 2024-12-18T02:19:24.7031600Z deleted: sha256:1e837ad662894f46afc56a73aa5ccb04064e4a974c9e3cad86ce9e5546b1d63d 2024-12-18T02:19:24.7032236Z deleted: sha256:688eccf2945022bd75f9f2782e2397ea54f1032c2435aa8f7dffa23cbcf2ae99 2024-12-18T02:19:24.7032879Z deleted: sha256:4855651bf4c3c8acad23029fda7d17f43bf32a69e8d575bb43f4491f0d653c1f 2024-12-18T02:19:24.7033522Z deleted: sha256:ca2d39907b7e10e3c7ae753b8bd230fac77c4e4b15980befd71173da8a36da93 2024-12-18T02:19:24.7034157Z deleted: sha256:d4f04a8342f272455eb816a413dc2dfcc75b9ebb9ef7f6fab32436621412ba6b 2024-12-18T02:19:24.7034795Z deleted: sha256:63ae01c22dc840b763ddc08bf4e145c14a04e0ff8a833b357ed45cb0962a8116 2024-12-18T02:19:24.7035418Z deleted: sha256:cf91e4695bf05d3607b7fa68e3ba3d6cc8762e6fac8773483f8116812f3d52c0 2024-12-18T02:19:24.7036046Z deleted: sha256:71baa7b72633376bb45367512dcb676c81b1e09964085a3151381530df7cdc28 2024-12-18T02:19:24.7036659Z deleted: sha256:68855433b69809d035da2a30cb22864ed1cd2795434571a0c77532de19344497 2024-12-18T02:19:24.7037267Z deleted: sha256:929280209b1f4e29860f386a519df32161cb608338d5338f24735201939dc91f 2024-12-18T02:19:24.7037866Z deleted: sha256:25133b63282efce5897b0e8fbf64d8b2a2625e15792dad95bdada277b78c777d 2024-12-18T02:19:24.7038492Z deleted: sha256:11fddfe713ea9ddd5acd8285319a606609b5c428111f15a019c8286e7164b9b4 2024-12-18T02:19:24.7039150Z deleted: sha256:b1464f3888e3b0a1694aa960a726584d01ae6b62df53fe8743d197d2d5051036 2024-12-18T02:19:24.7039759Z deleted: sha256:9627c2925d7a3936b439a6f519083e650d160bc2522d2a9244d6a1dfda02bc83 2024-12-18T02:19:24.7040371Z deleted: sha256:33880827ded8236cc91531c2f928d6de5c7cfb95a241da2653b7e8a8d1ea4881 2024-12-18T02:19:24.7041009Z deleted: sha256:6851b39610a99eb7ec6939a15e35657e144eb3e628a3856afa0a0adff49b8c2f 2024-12-18T02:19:24.7041646Z deleted: sha256:1a76c7f0af1e05689638a3792e8b9d4418648384aed1f56d3ccde5b0a9681d29 2024-12-18T02:19:24.7042277Z deleted: sha256:072f501c97aae0be55d1457426bc5f8238b0bb86eac9e92889b01924352d79a5 2024-12-18T02:19:24.7042907Z deleted: sha256:8277868848759cc86b200280dee8701d7e8328a811bf75330ed24aeaf490e69e 2024-12-18T02:19:24.7043537Z deleted: sha256:1da994d575d08f659512ea580648bfddd62020acc1aef2f7d4c6008d36a6f83f 2024-12-18T02:19:24.7044169Z deleted: sha256:ddf6d49d71559688ae65aeecccbbc58dd555887d4b3306d02a87d049114dd2f9 2024-12-18T02:19:24.7044796Z deleted: sha256:648d99cd03665c7b88aae7e3291f27daa65f496f7ab2c37f0ee62c72a4459151 2024-12-18T02:19:24.7045428Z deleted: sha256:6e57cd88598cddad4070d39467d8e1d4c387388f89d2970a55391653f9243e1a 2024-12-18T02:19:24.7046171Z deleted: sha256:9b0c5db353ac5d4e0995c2a70ae3c28390676afe60dbd11e4ade07c792eac4ce 2024-12-18T02:19:24.7046860Z deleted: sha256:8fa5311fe41b6caf697456e9678220a152bbf6a7645f4b7ff89ea9317ae04444 2024-12-18T02:19:24.7047617Z deleted: sha256:dc438d6465050b81bff4a8c5925e70c2167712dbab174c38f79b6a5d7af407af 2024-12-18T02:19:24.7048276Z deleted: sha256:29b8f0a42a1f3b944f2c54348348d173d322522b578e3d485428d67996f6adde 2024-12-18T02:19:24.7048891Z deleted: sha256:26231024334c7a704f9acba86430547a013e959014bfd7a31e26c6ed78521479 2024-12-18T02:19:24.7049518Z deleted: sha256:4166e9dd7564ae2f46ea2c3dcb8a8ef6bef9e06f4faf1742f4c6f21861967193 2024-12-18T02:19:24.7050135Z deleted: sha256:80a3113f256f146f0a2528ca69aa9244a1f9ba1ecdf54c3ef8ba0fb21507cbc4 2024-12-18T02:19:24.7050766Z deleted: sha256:e90bbba5d7c08e01c5bedb0a855cc5cdd371688e23994155674704963591296f 2024-12-18T02:19:24.7051402Z deleted: sha256:d3b3df431f230849965cc370c2f1853a81d78dd6eb3f7ac3bc3b4ca64aa9818a 2024-12-18T02:19:24.7052036Z deleted: sha256:7a33f9ca143b08c9f5d8c53974b2d6fe840739b5d2cd30694ba1c86db9393908 2024-12-18T02:19:24.7052919Z deleted: sha256:bad1d7dae968956b4a81369dedfbcf539fd5b61dd3051e2eccb5457174fe788c 2024-12-18T02:19:24.7053550Z deleted: sha256:08a420245ca6eed4aa5662d0fec04e7892165cdb3fd2f5b99428adbb4d6199c0 2024-12-18T02:19:24.7054176Z deleted: sha256:c3fda6b9a4d08a345824508dc5625f52e4d23163843d0caf337c60feda68a830 2024-12-18T02:19:24.7054808Z deleted: sha256:c74a8a3ca5e31670eed41e4bbb4a89f25c7c05dacabdf93cbd03984ead0330e2 2024-12-18T02:19:24.7055457Z deleted: sha256:4171d4c54045bd3035546906a7dd3b63c9ca748e0a34eeba27fe918f52cdcf85 2024-12-18T02:19:24.7056069Z deleted: sha256:f6a1d112657a4aeaca96ac2792a10ea09463dc3d633cb8572314814d5abf1ddb 2024-12-18T02:19:24.7056711Z deleted: sha256:af5d54d84b9c302254498eed8b0bbce1cdd705351bf5cc210d3f11c0deb269b3 2024-12-18T02:19:24.7057328Z deleted: sha256:45ae227353c6db8230b86fc1c4b8c50def31bd64895b879d91ea6e600669045d 2024-12-18T02:19:24.7057957Z deleted: sha256:6032ea27ad90071e3b75290e03fd0763a74155f513f356d21e56663a878b0ed9 2024-12-18T02:19:24.7058590Z deleted: sha256:d5aef8ace96787c48070530c09b68e4bcb23bc92a9fb0978220204f64bfbd97f 2024-12-18T02:19:24.7059214Z deleted: sha256:e3116153021ece2a3d29eccdce1f7e0f092316e889c1d534257789f6b5743d51 2024-12-18T02:19:24.7059851Z deleted: sha256:fb0f11460e5fa2e4895230ae84c97fe0552e9509dfbae60abf94e1b8a6563fb9 2024-12-18T02:19:24.7060475Z deleted: sha256:e262415e0abb361b284df9e05790ae27cc3a1ea7b8d4618e7eb3eca17cf1d18e 2024-12-18T02:19:24.7061233Z deleted: sha256:7f810eab57a6121f1a2aae664f7a5940d12f789661445ce3500ecd3b3688b46b 2024-12-18T02:19:24.7061889Z deleted: sha256:6ed71f55ff78520154c43468df2f05a92eaa28ee2aa2e28b8ea860b9ffb258ef 2024-12-18T02:19:24.7062545Z deleted: sha256:92a10d8d42a56a8516d0e9e14fec53263302fe6e6438ced263a3845680456dd7 2024-12-18T02:19:24.7063165Z deleted: sha256:ec67f912ff53e9b7164f48250da3bb4c1ffc94c3eb2c1c56c534a94fe55e3845 2024-12-18T02:19:24.7063788Z deleted: sha256:c85033e4f60ace56eaad80a8151b1bdd1619865b10a9ccee5638878b0a027c23 2024-12-18T02:19:24.7064406Z deleted: sha256:0e8680489f0a37851beb2cb5e42f0df129247a68b755b08a6367ea42180b3e7a 2024-12-18T02:19:24.7065017Z deleted: sha256:3a767fb38f6b1124e5fe9a230fdd383ccb188c38fe1d6ec252260676efe255c8 2024-12-18T02:19:24.7065648Z deleted: sha256:2cce59d2a43773cb7c6b83d239dab3a53659767f96bc0d47a70ee0d51cfa096f 2024-12-18T02:19:24.7066267Z deleted: sha256:51e50e75789ab5b4e40a66bb2f284e2da947e37c0e757c74d49fdeea5da9cbec 2024-12-18T02:19:24.7066901Z deleted: sha256:29e55e4feccba0660950ed92941d309527fe5f41bea609662d0e703b9c76b3a1 2024-12-18T02:19:24.7067545Z deleted: sha256:d15bee8fc455fcb45d16b0abc67f18c99ce1cf2c9e998ef5a100bf8373f2f8ab 2024-12-18T02:19:24.7068175Z deleted: sha256:363936db6a8869d44b6f0bee97a786b168093848e9c08c8042830fc7fccd956b 2024-12-18T02:19:24.7068805Z deleted: sha256:0f54d1f89ceaf71ded488007635a618fac1528bf3603d9415a593fe4926f8b2a 2024-12-18T02:19:24.7069441Z deleted: sha256:2f5796e9879cab7dac02bdbb178aec5301ac00029b38be8613333ac639c4dc3a 2024-12-18T02:19:24.7070077Z deleted: sha256:e68525d57f9da8f6c74b456d92869c4e60e451b88cb403addbc4ea917d8ab3ac 2024-12-18T02:19:24.7070724Z deleted: sha256:3386e25983944ce3b2ebdde10d840832d581a7dfafd1df66568822a18979e268 2024-12-18T02:19:24.7071357Z deleted: sha256:d3a036e6bd36f014b3a1540d5b848655ecdf72a20dc81c0da5f80430700cfa9a 2024-12-18T02:19:24.7071971Z deleted: sha256:96d0556708ff4ec0d5d727d5947d6cb29a9d6c16e1a1ee76a92dc85aa3ea8f25 2024-12-18T02:19:24.7072600Z deleted: sha256:f3c2fb3abccb3a33dbf204d3f0d8857537348e6c1d3cc87a431afe866435d41b 2024-12-18T02:19:24.7073242Z deleted: sha256:45cd6c9a41f12991ee60a89e775abb604b0892ef3936526c18184bbbf4de57da 2024-12-18T02:19:24.7073882Z deleted: sha256:b3cacd0508bbfd2fd668f30c539033e7c6b606bf669258c8e8a3cbf80bf050c6 2024-12-18T02:19:24.7074508Z deleted: sha256:de72ce930361a96c151a8a4725f8360f33df6c812b6ed6d3dd5b6e6710a5d2c0 2024-12-18T02:19:24.7075149Z deleted: sha256:2e5d223d2bfa0f47e628b631a540d20c284dabb380ad9ee4caec65bf8d0ecde2 2024-12-18T02:19:24.7075777Z deleted: sha256:14a85e604a0401093323d356b3bb7f75a8473abd712b4bf1a2ef01fa432b344c 2024-12-18T02:19:24.7076859Z deleted: sha256:15a95a1e8f47d7c18dcbf9a6e2fc530cddcb161c0093c663181f3e73dc9f599e 2024-12-18T02:19:24.7077573Z deleted: sha256:106e8431b412f51ccd75ea46a2d5cb4343b23273cbcf50188377cb93aa9a6d82 2024-12-18T02:19:24.7077938Z 2024-12-18T02:19:24.7078064Z Total reclaimed space: 43.97GB 2024-12-18T02:19:24.7142417Z Post job cleanup. 2024-12-18T02:19:24.7191386Z Post job cleanup. 2024-12-18T02:19:24.8027271Z [command]/usr/bin/git version 2024-12-18T02:19:24.8086029Z git version 2.40.1 2024-12-18T02:19:24.8127983Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/e4d813ad-0569-4dfd-ae4d-9fbb7ec6f3ec' before making global git config changes 2024-12-18T02:19:24.8128918Z Adding repository directory to the temporary git global config as a safe directory 2024-12-18T02:19:24.8132662Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-12-18T02:19:24.8166206Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2024-12-18T02:19:24.8197742Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2024-12-18T02:19:24.8570443Z Entering 'android/libs/fbjni' 2024-12-18T02:19:24.8639077Z Entering 'third_party/FP16' 2024-12-18T02:19:24.8706669Z Entering 'third_party/FXdiv' 2024-12-18T02:19:24.8774541Z Entering 'third_party/NNPACK' 2024-12-18T02:19:24.8844874Z Entering 'third_party/NVTX' 2024-12-18T02:19:24.8914542Z Entering 'third_party/VulkanMemoryAllocator' 2024-12-18T02:19:24.8983048Z Entering 'third_party/XNNPACK' 2024-12-18T02:19:24.9066876Z Entering 'third_party/benchmark' 2024-12-18T02:19:24.9135977Z Entering 'third_party/composable_kernel' 2024-12-18T02:19:24.9211155Z Entering 'third_party/cpp-httplib' 2024-12-18T02:19:24.9280276Z Entering 'third_party/cpuinfo' 2024-12-18T02:19:24.9348817Z Entering 'third_party/cudnn_frontend' 2024-12-18T02:19:24.9422592Z Entering 'third_party/cutlass' 2024-12-18T02:19:24.9499914Z Entering 'third_party/eigen' 2024-12-18T02:19:24.9573351Z Entering 'third_party/fbgemm' 2024-12-18T02:19:24.9645280Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-12-18T02:19:24.9712476Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-12-18T02:19:24.9779638Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-12-18T02:19:24.9852924Z Entering 'third_party/fbgemm/third_party/googletest' 2024-12-18T02:19:24.9919005Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-12-18T02:19:24.9988239Z Entering 'third_party/flatbuffers' 2024-12-18T02:19:25.0059206Z Entering 'third_party/fmt' 2024-12-18T02:19:25.0127784Z Entering 'third_party/gemmlowp/gemmlowp' 2024-12-18T02:19:25.0200047Z Entering 'third_party/gloo' 2024-12-18T02:19:25.0274379Z Entering 'third_party/googletest' 2024-12-18T02:19:25.0343500Z Entering 'third_party/ideep' 2024-12-18T02:19:25.0412008Z Entering 'third_party/ideep/mkl-dnn' 2024-12-18T02:19:25.0489308Z Entering 'third_party/ittapi' 2024-12-18T02:19:25.0558577Z Entering 'third_party/kineto' 2024-12-18T02:19:25.0625750Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-12-18T02:19:25.0691701Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-12-18T02:19:25.0764995Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-12-18T02:19:25.0834182Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-12-18T02:19:25.0901609Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-12-18T02:19:25.0971311Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-12-18T02:19:25.1043498Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-12-18T02:19:25.1111975Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-12-18T02:19:25.1182002Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-12-18T02:19:25.1258068Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-12-18T02:19:25.1329601Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-12-18T02:19:25.1401714Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-12-18T02:19:25.1472871Z Entering 'third_party/mimalloc' 2024-12-18T02:19:25.1544226Z Entering 'third_party/nccl/nccl' 2024-12-18T02:19:25.1615632Z Entering 'third_party/nlohmann' 2024-12-18T02:19:25.1685730Z Entering 'third_party/onnx' 2024-12-18T02:19:25.1768587Z Entering 'third_party/onnx/third_party/pybind11' 2024-12-18T02:19:25.1844535Z Entering 'third_party/opentelemetry-cpp' 2024-12-18T02:19:25.1913256Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-12-18T02:19:25.1981420Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-12-18T02:19:25.2047919Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-12-18T02:19:25.2113928Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-12-18T02:19:25.2183538Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-12-18T02:19:25.2249135Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-12-18T02:19:25.2315562Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-12-18T02:19:25.2380651Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-12-18T02:19:25.2451695Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-12-18T02:19:25.2524088Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-12-18T02:19:25.2617583Z Entering 'third_party/pocketfft' 2024-12-18T02:19:25.2688036Z Entering 'third_party/protobuf' 2024-12-18T02:19:25.2759110Z Entering 'third_party/protobuf/third_party/benchmark' 2024-12-18T02:19:25.2827085Z Entering 'third_party/protobuf/third_party/googletest' 2024-12-18T02:19:25.2899186Z Entering 'third_party/psimd' 2024-12-18T02:19:25.2968581Z Entering 'third_party/pthreadpool' 2024-12-18T02:19:25.3038506Z Entering 'third_party/pybind11' 2024-12-18T02:19:25.3107112Z Entering 'third_party/python-peachpy' 2024-12-18T02:19:25.3177362Z Entering 'third_party/sleef' 2024-12-18T02:19:25.3251274Z Entering 'third_party/tensorpipe' 2024-12-18T02:19:25.3320898Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-12-18T02:19:25.3387197Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-12-18T02:19:25.3453728Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-12-18T02:19:25.3520254Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-12-18T02:19:25.3584577Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-12-18T02:19:25.3685473Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2024-12-18T02:19:25.3706865Z http.https://github.com/.extraheader 2024-12-18T02:19:25.3716334Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader 2024-12-18T02:19:25.3748067Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2024-12-18T02:19:25.4104924Z Entering 'android/libs/fbjni' 2024-12-18T02:19:25.4149016Z http.https://github.com/.extraheader 2024-12-18T02:19:25.4193510Z Entering 'third_party/FP16' 2024-12-18T02:19:25.4238579Z http.https://github.com/.extraheader 2024-12-18T02:19:25.4282045Z Entering 'third_party/FXdiv' 2024-12-18T02:19:25.4325527Z http.https://github.com/.extraheader 2024-12-18T02:19:25.4368878Z Entering 'third_party/NNPACK' 2024-12-18T02:19:25.4412337Z http.https://github.com/.extraheader 2024-12-18T02:19:25.4456656Z Entering 'third_party/NVTX' 2024-12-18T02:19:25.4500143Z http.https://github.com/.extraheader 2024-12-18T02:19:25.4549941Z Entering 'third_party/VulkanMemoryAllocator' 2024-12-18T02:19:25.4594124Z http.https://github.com/.extraheader 2024-12-18T02:19:25.4638958Z Entering 'third_party/XNNPACK' 2024-12-18T02:19:25.4686632Z http.https://github.com/.extraheader 2024-12-18T02:19:25.4746750Z Entering 'third_party/benchmark' 2024-12-18T02:19:25.4791014Z http.https://github.com/.extraheader 2024-12-18T02:19:25.4835602Z Entering 'third_party/composable_kernel' 2024-12-18T02:19:25.4879746Z http.https://github.com/.extraheader 2024-12-18T02:19:25.4930372Z Entering 'third_party/cpp-httplib' 2024-12-18T02:19:25.4974357Z http.https://github.com/.extraheader 2024-12-18T02:19:25.5018247Z Entering 'third_party/cpuinfo' 2024-12-18T02:19:25.5063518Z http.https://github.com/.extraheader 2024-12-18T02:19:25.5108007Z Entering 'third_party/cudnn_frontend' 2024-12-18T02:19:25.5153393Z http.https://github.com/.extraheader 2024-12-18T02:19:25.5199614Z Entering 'third_party/cutlass' 2024-12-18T02:19:25.5244108Z http.https://github.com/.extraheader 2024-12-18T02:19:25.5297304Z Entering 'third_party/eigen' 2024-12-18T02:19:25.5343329Z http.https://github.com/.extraheader 2024-12-18T02:19:25.5389971Z Entering 'third_party/fbgemm' 2024-12-18T02:19:25.5435226Z http.https://github.com/.extraheader 2024-12-18T02:19:25.5479358Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-12-18T02:19:25.5526888Z http.https://github.com/.extraheader 2024-12-18T02:19:25.5570372Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-12-18T02:19:25.5617922Z http.https://github.com/.extraheader 2024-12-18T02:19:25.5662629Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-12-18T02:19:25.5709599Z http.https://github.com/.extraheader 2024-12-18T02:19:25.5760889Z Entering 'third_party/fbgemm/third_party/googletest' 2024-12-18T02:19:25.5807065Z http.https://github.com/.extraheader 2024-12-18T02:19:25.5850237Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-12-18T02:19:25.5899218Z http.https://github.com/.extraheader 2024-12-18T02:19:25.5949405Z Entering 'third_party/flatbuffers' 2024-12-18T02:19:25.5994414Z http.https://github.com/.extraheader 2024-12-18T02:19:25.6043310Z Entering 'third_party/fmt' 2024-12-18T02:19:25.6087932Z http.https://github.com/.extraheader 2024-12-18T02:19:25.6133147Z Entering 'third_party/gemmlowp/gemmlowp' 2024-12-18T02:19:25.6177980Z http.https://github.com/.extraheader 2024-12-18T02:19:25.6222568Z Entering 'third_party/gloo' 2024-12-18T02:19:25.6267952Z http.https://github.com/.extraheader 2024-12-18T02:19:25.6312144Z Entering 'third_party/googletest' 2024-12-18T02:19:25.6357968Z http.https://github.com/.extraheader 2024-12-18T02:19:25.6404409Z Entering 'third_party/ideep' 2024-12-18T02:19:25.6449636Z http.https://github.com/.extraheader 2024-12-18T02:19:25.6492198Z Entering 'third_party/ideep/mkl-dnn' 2024-12-18T02:19:25.6534369Z http.https://github.com/.extraheader 2024-12-18T02:19:25.6588273Z Entering 'third_party/ittapi' 2024-12-18T02:19:25.6634328Z http.https://github.com/.extraheader 2024-12-18T02:19:25.6678925Z Entering 'third_party/kineto' 2024-12-18T02:19:25.6724956Z http.https://github.com/.extraheader 2024-12-18T02:19:25.6770376Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-12-18T02:19:25.6817507Z http.https://github.com/.extraheader 2024-12-18T02:19:25.6862498Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-12-18T02:19:25.6907461Z http.https://github.com/.extraheader 2024-12-18T02:19:25.6954364Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-12-18T02:19:25.6998290Z http.https://github.com/.extraheader 2024-12-18T02:19:25.7046181Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-12-18T02:19:25.7091095Z http.https://github.com/.extraheader 2024-12-18T02:19:25.7136397Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-12-18T02:19:25.7180653Z http.https://github.com/.extraheader 2024-12-18T02:19:25.7225021Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-12-18T02:19:25.7269560Z http.https://github.com/.extraheader 2024-12-18T02:19:25.7318424Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-12-18T02:19:25.7362496Z http.https://github.com/.extraheader 2024-12-18T02:19:25.7407026Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-12-18T02:19:25.7451336Z http.https://github.com/.extraheader 2024-12-18T02:19:25.7497101Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-12-18T02:19:25.7541605Z http.https://github.com/.extraheader 2024-12-18T02:19:25.7587531Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-12-18T02:19:25.7631838Z http.https://github.com/.extraheader 2024-12-18T02:19:25.7678854Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-12-18T02:19:25.7722529Z http.https://github.com/.extraheader 2024-12-18T02:19:25.7765824Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-12-18T02:19:25.7809286Z http.https://github.com/.extraheader 2024-12-18T02:19:25.7858318Z Entering 'third_party/mimalloc' 2024-12-18T02:19:25.7907158Z http.https://github.com/.extraheader 2024-12-18T02:19:25.7952748Z Entering 'third_party/nccl/nccl' 2024-12-18T02:19:25.7996812Z http.https://github.com/.extraheader 2024-12-18T02:19:25.8042859Z Entering 'third_party/nlohmann' 2024-12-18T02:19:25.8086543Z http.https://github.com/.extraheader 2024-12-18T02:19:25.8131577Z Entering 'third_party/onnx' 2024-12-18T02:19:25.8175400Z http.https://github.com/.extraheader 2024-12-18T02:19:25.8234409Z Entering 'third_party/onnx/third_party/pybind11' 2024-12-18T02:19:25.8278310Z http.https://github.com/.extraheader 2024-12-18T02:19:25.8327592Z Entering 'third_party/opentelemetry-cpp' 2024-12-18T02:19:25.8374994Z http.https://github.com/.extraheader 2024-12-18T02:19:25.8420359Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-12-18T02:19:25.8468306Z http.https://github.com/.extraheader 2024-12-18T02:19:25.8515635Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-12-18T02:19:25.8558699Z http.https://github.com/.extraheader 2024-12-18T02:19:25.8602816Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-12-18T02:19:25.8647200Z http.https://github.com/.extraheader 2024-12-18T02:19:25.8689688Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-12-18T02:19:25.8738467Z http.https://github.com/.extraheader 2024-12-18T02:19:25.8782422Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-12-18T02:19:25.8825506Z http.https://github.com/.extraheader 2024-12-18T02:19:25.8869007Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-12-18T02:19:25.8911093Z http.https://github.com/.extraheader 2024-12-18T02:19:25.8955367Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-12-18T02:19:25.9001463Z http.https://github.com/.extraheader 2024-12-18T02:19:25.9045769Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-12-18T02:19:25.9089802Z http.https://github.com/.extraheader 2024-12-18T02:19:25.9136747Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-12-18T02:19:25.9180937Z http.https://github.com/.extraheader 2024-12-18T02:19:25.9228764Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-12-18T02:19:25.9271446Z http.https://github.com/.extraheader 2024-12-18T02:19:25.9338808Z Entering 'third_party/pocketfft' 2024-12-18T02:19:25.9382995Z http.https://github.com/.extraheader 2024-12-18T02:19:25.9426900Z Entering 'third_party/protobuf' 2024-12-18T02:19:25.9471276Z http.https://github.com/.extraheader 2024-12-18T02:19:25.9516988Z Entering 'third_party/protobuf/third_party/benchmark' 2024-12-18T02:19:25.9560502Z http.https://github.com/.extraheader 2024-12-18T02:19:25.9604679Z Entering 'third_party/protobuf/third_party/googletest' 2024-12-18T02:19:25.9648847Z http.https://github.com/.extraheader 2024-12-18T02:19:25.9695550Z Entering 'third_party/psimd' 2024-12-18T02:19:25.9741133Z http.https://github.com/.extraheader 2024-12-18T02:19:25.9786455Z Entering 'third_party/pthreadpool' 2024-12-18T02:19:25.9831187Z http.https://github.com/.extraheader 2024-12-18T02:19:25.9874924Z Entering 'third_party/pybind11' 2024-12-18T02:19:25.9918922Z http.https://github.com/.extraheader 2024-12-18T02:19:25.9963210Z Entering 'third_party/python-peachpy' 2024-12-18T02:19:26.0007588Z http.https://github.com/.extraheader 2024-12-18T02:19:26.0053485Z Entering 'third_party/sleef' 2024-12-18T02:19:26.0097536Z http.https://github.com/.extraheader 2024-12-18T02:19:26.0141791Z Entering 'third_party/tensorpipe' 2024-12-18T02:19:26.0186668Z http.https://github.com/.extraheader 2024-12-18T02:19:26.0230062Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-12-18T02:19:26.0273025Z http.https://github.com/.extraheader 2024-12-18T02:19:26.0315264Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-12-18T02:19:26.0359879Z http.https://github.com/.extraheader 2024-12-18T02:19:26.0403425Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-12-18T02:19:26.0448065Z http.https://github.com/.extraheader 2024-12-18T02:19:26.0490878Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-12-18T02:19:26.0539576Z http.https://github.com/.extraheader 2024-12-18T02:19:26.0585016Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-12-18T02:19:26.0629152Z http.https://github.com/.extraheader 2024-12-18T02:19:26.0793372Z A job completed hook has been configured by the self-hosted runner administrator 2024-12-18T02:19:26.0824056Z ##[group]Run '/home/ec2-user/runner-scripts/after_job.sh' 2024-12-18T02:19:26.0832340Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T02:19:26.0832719Z ##[endgroup] 2024-12-18T02:19:33.3332396Z Cleaning up orphan processes